Imaging device

Abstract

The present invention provides, at a low cost, an imaging device equipped with stereophonic audio functionality using a small number of microphones.　A first microphone (21) and a second microphone (22) are disposed so as to extend in the optical axis (OA) direction. The first microphone (21) is disposed closer to the subject side than is the second microphone (22). A processor: acquires a combination of data including at least two of first data from the first microphone (21), second data from the second microphone (22), and third data from a third microphone (23); and acquires a combination including the first data in a first posture and a second posture, where the combination differs between the first posture and the second posture.

Description

Imaging device

[0001] The present invention relates to an imaging device.

[0002] Patent document 1 describes a data editing processing device (imaging device) that is capable of editing a moving image file of a container structure having a first area in which image data and first audio data in a lossy compressed format are stored, and a second area in which second audio data in a lossless compressed format or an uncompressed format is stored, and that has an editing processing unit that reads and edits the second audio data from the second area when the moving image file is edited, a first replacement processing unit that replaces the second audio data stored in the second area with the second audio data edited by the editing processing unit, an encoding processing unit that encodes the second audio data edited by the editing processing unit, and a second replacement processing unit that replaces the first audio data stored in the first area with the second audio data encoded by the encoding processing unit.

[0003] Patent document 2 describes an imaging device that includes an imaging optical system including multiple wide-angle lenses and an imaging element, and in which four or more sound collection devices are arranged at positions corresponding to each vertex of a triangular pyramid shape, with the distance between adjacent sound collection devices being equal, with at least two sound collection devices arranged above the imaging optical system and at least two below the imaging optical system, and with the wide-angle lenses of the imaging optical system protruding from an opening in the housing of the imaging device.

[0004] Patent No. 7247616 Patent No. 6878974

[0005] An object of one embodiment of the technique of the present disclosure is to provide an imaging device that has a stereophonic function with a small number of microphones at low cost.

[0006] An imaging device according to one aspect of the disclosed technology is an imaging device comprising at least a first microphone, a second microphone, and a third microphone, a processor, and an imaging optical system, wherein the first microphone and the second microphone are arranged extending in the optical axis direction, the first microphone is arranged closer to the subject than the second microphone, and the processor acquires a combination including any two or more of first data from the first microphone, second data from the second microphone, and third data from the third microphone, the combination being different between a first posture and a second posture different from the first posture, and the processor acquires a combination including the first data in both the first posture and the second posture.

[0007] In addition to the first microphone, the second microphone, and the third microphone, a fourth microphone is provided, and the processor acquires a combination including any two or more of the first data, the second data, the third data, and the fourth data from the fourth microphone, and preferably acquires a combination including at least the first data and the second data in the first and second postures.

[0008] It is preferable that in the first posture, the processor obtains the first data, the second data, and the third data as a combination, and in the second posture, the processor obtains the first data, the second data, and the fourth data as a combination.

[0009] It is preferable that the third microphone is arranged on a first plane including the first microphone and the second microphone, the fourth microphone is arranged on a second plane including the first microphone and the second microphone and intersecting the first plane, and the third microphone and the fourth microphone are arranged opposite a third plane including the first microphone, the second microphone, and the optical axis.

[0010] Preferably, in the first posture, the processor acquires the first data, the second data, and the third data as a combination, and in the second posture, the processor acquires the first data and the second data, or the first data and the third data as a combination.

[0011] In the first position, the processor preferably sets a range of sound directivity for the acquired data, the range of directivity preferably including the optical axis direction and a direction intersecting the optical axis.

[0012] In the first attitude, the processor preferably sets the directivity to a wider angle than in the second attitude.

[0013] It is preferable that a sensor for detecting the attitude is provided, and the processor determines the first attitude and the second attitude based on the result detected by the sensor.

[0014] It is preferable that the camera includes an image sensor that captures an image of a subject formed by an image capturing optical system, and the processor maintains a state in which the combination data is acquired from the start of image capturing by the image sensor to the end of image capturing.

[0015] When the posture is changed from the first posture to the second posture, or when the posture is changed from the second posture to the first posture, the processor preferably changes the range of directivity regarding the sound of the acquired data.

[0016] It is preferable that the system is provided with an imaging element that captures the subject image formed by the imaging optical system, and that the processor sets the range of directivity regarding the sound of the acquired data and changes the range of directivity depending on the aspect ratio of the captured image captured by the imaging element.

[0017] It is preferable that the processor widens the directionality of the sound of the acquired data in the first posture compared to the second posture.

[0018] It is preferable that the device is provided with an imaging element that captures an image of a subject formed by an imaging optical system, and that the processor recognizes the face of the subject from the captured image captured by the imaging element, and sets the sound directionality of the acquired data in the direction in which the subject whose face has been recognized is located relative to the imaging device.

[0019] It is preferable that the device is provided with an image sensor that captures an image of a subject formed by an imaging optical system, and a display that displays the image captured by the image sensor and whose display direction can be switched, and that the processor sets a range of directionality related to the sound of the acquired data and switches the range of directionality in response to switching of the display direction.

[0020] 1 is a front perspective view of a digital camera in a first position. FIG. 2 is a front perspective view of a digital camera in a second position. FIG. 3 is a perspective view of an imaging optical system, an imaging element, and a microphone. FIG. 4 is a cross-sectional view of a main part of a digital camera taken along a cross section perpendicular to the optical axis. FIG. 5 is an explanatory diagram of horizontal shooting (A) and vertical shooting (B). FIG. 6 is an explanatory diagram of horizontal shooting position (A) and vertical shooting position (B). FIG. 7 is a block diagram showing a schematic configuration of a digital camera. FIG. 8 is an explanatory diagram explaining acquisition of stereophonic data when the digital camera is in the first position. FIG. 9 is an explanatory diagram explaining acquisition of stereophonic data when the digital camera is in the second position. FIG. 10 is a flowchart showing operation of a digital camera. FIG. 11 is an explanatory diagram explaining acquisition of stereophonic data when the digital camera in the first modified example is in the first position. FIG. 12 is an explanatory diagram explaining acquisition of stereophonic data when the digital camera in the first modified example is in the second position. FIG. 13 is a front perspective view of a digital camera in the first position in a second embodiment. FIG. 14 is a front perspective view of a digital camera in the second position in a second embodiment. FIG. 15 is an explanatory diagram explaining acquisition of stereophonic data when the digital camera in the second embodiment is in the first position. It is a flowchart showing the operation of the digital camera according to the second embodiment. It is an explanatory diagram of a second modified example in which directivity is set in a direction recognized by face recognition. It is an explanatory diagram of a third modified example in which directivity is set in a display direction to which a display is pointed.

[0021] [First Embodiment] [Schematic Configuration of Imaging Device] As shown in Fig. 1 , a digital camera 10 includes a camera body 11 and a lens barrel 12. The digital camera 10 is an example of an imaging device according to the present invention. The camera body 11 has a generally rectangular box shape in which one adjacent side (long side) is longer than the other adjacent side (short side) when viewed from the front. The lens barrel 12 is disposed in front of the camera body 11 and is provided with an imaging optical system 13. The imaging optical system 13 forms an image of subject light on an imaging element 25.

[0022] 2, a mode dial 14, a release switch 15, a power switch 16, etc. are provided on a side surface 11B including a long side 11A of the camera body 11. The camera body 11 is equipped with a first microphone 21, a second microphone 22, a third microphone 23, and a fourth microphone 24.

[0023] In this embodiment, the first microphone 21, the second microphone 22, the third microphone 23, and the fourth microphone 24 are, for example, omnidirectional microphones that do not have directivity in terms of sensitivity characteristics in a specific direction. However, the microphones are not limited to this, and may be microphones whose directivity can be controlled (control of the sound collection range, sound collection direction, sound collection distance (sensitivity), etc.) by the control unit 51.

[0024] The first microphone 21, the second microphone 22, the third microphone 23, and the fourth microphone 24 are arranged near the side surface 11B and the side surface 11D adjacent to the side surface 11B and including the short side 11C of the camera body 11.

[0025] An image sensor 25 is built into the camera body 11. The image sensor 25 is held by a holder (not shown) and fixed to the image plane side of the lens barrel 12. The image sensor 25 is, for example, a CMOS (Complementary Metal Oxide Semiconductor) image sensor, a CCD (Charge Coupled Device) image sensor, or an organic thin-film image sensor.

[0026] A display 26 is provided on the rear surface of the camera body 11. The display 26 is an LCD (Liquid Crystal Display) or an OELD (Organic Electroluminescent Display), etc. The display 26 is used for live view display, captured image display, setting menu display, etc. In live view display, a captured image of a subject represented by image data acquired by the image sensor 25 is displayed in real time on the display 26. The display 26 is attached to the camera body 11 so as to be rotatable around a hinge portion 11E.

[0027] 3, the first microphone 21 and the second microphone 22 are arranged to extend in the direction of the optical axis OA. The optical axis OA is the optical axis of the imaging optical system 13. The first microphone 21 is arranged closer to the subject of the optical axis OA than the second microphone 22.

[0028] The third microphone 23 is disposed on the first surface 31 (the surface hatched in FIG. 3 ), the fourth microphone 24 is disposed on the second surface 32 (the surface hatched with cross-hatching in FIG. 3 ), and the third microphone 23 and the fourth microphone 24 are disposed opposite the third surface 33 (see FIG. 4 ). The first surface 31, the second surface 32, and the third surface 33 are different surfaces, and the first surface 31 is a surface that includes the first microphone 21 and the second microphone 22. The second surface 32 is a surface that includes the first microphone 21 and the second microphone 22 and intersects with the first surface 31. The third surface 33 is a surface that includes the first microphone 21, the second microphone 22, and the optical axis OA and intersects with the first surface 31 and the second surface 32. Note that in the above definitions, "including" a microphone means including at least a portion thereof, rather than the entire microphone.

[0029] In this embodiment, the first surface 31 and the second surface 32 are positioned perpendicular to each other, but this is not limiting and any positional relationship may be used as long as the first surface 31 and the second surface 32 intersect. In this specification, "perpendicular" includes not only completely perpendicular but also approximately perpendicular, which means an error that is generally acceptable in the technical field to which the technology of the present disclosure belongs and is permissible within a range that does not deviate from the technology of the present disclosure. In addition, in this specification, "parallel" includes not only completely parallel but also approximately parallel, which means an error that is generally acceptable in the technical field to which the technology of the present disclosure belongs and is permissible within a range that does not deviate from the technology of the present disclosure.

[0030] The horizontal shooting position and the vertical shooting position will be described below. Note that the horizontal shooting position corresponds to the first position in the claims, and the vertical shooting position corresponds to the second position in the claims. The first microphone 21, the second microphone 22, and the third microphone 23 arranged on the first surface 31 are microphones for the horizontal shooting position, and the first microphone 21, the second microphone 22, and the fourth microphone 24 arranged on the second surface 32 are microphones for the vertical shooting position. In other words, the first microphone 21 and the second microphone 22 are microphones that are used in both the vertical shooting position and the horizontal shooting position.

[0031] 4, the first surface 31 is parallel to the side surface 11B including the long side 11A of the camera body 11, and the second surface 32 is parallel to the side surface 11D including the short side 11C of the camera body 11. The first microphone 21 and the second microphone 22 are disposed in a position facing a corner portion 11F where the side surface 11B and the side surface 11D of the camera body 11 are connected. A through-hole 11G is formed in the corner portion 11F, and the first microphone 21 and the second microphone 22 are disposed so as to be aligned with the through-hole 11G. This prevents the corner portion 11F from interfering with the first microphone 21 and the second microphone 22 collecting sound.

[0032] The third microphone 23 is disposed in a position facing the side surface 11B of the camera body 11, and the fourth microphone 24 is disposed in a position facing the side surface 11D of the camera body 11. A through-hole 11H is formed in the side surface 11B, and a through-hole 11I is formed in the side surface 11D, and the third microphone 23 and the fourth microphone 24 are disposed so as to align with the through-holes 11H and 11I, respectively. This allows the third microphone 23 and the fourth microphone 24 to collect sound without being obstructed by the side surfaces 11B and 11D.

[0033] As shown in Figure 5 (A), "horizontal shooting" in this specification refers to a case where the short side (the shorter side in the aspect ratio) 35B of the captured image 35 captured by the image sensor 25 is parallel to the vertical direction (arrow Y direction), and as shown in Figure 5 (B), "vertical shooting" refers to a case where the long side (the longer side in the aspect ratio) 35A of the captured image 35 captured by the image sensor 25 is parallel to the vertical direction (arrow Y direction).

[0034] 6A and 6B show the positional relationship between the effective imaging area 36 of the image sensor 25 and the first microphone 21, the second microphone 22, the third microphone 23, and the fourth microphone 24. The aspect ratio of the captured image 35 is generally similar to the aspect ratio of the effective imaging area 36. In this embodiment, the long side 36A of the effective imaging area 36 is arranged parallel to the long side 11A of the camera body 11, and the short side 36B of the effective imaging area 36 is arranged parallel to the short side 11C of the camera body 11. In other words, when the long side 11A of the camera body 11 is parallel to the vertical direction, the captured image 35 is "portrait shot," and when the short side 11C of the camera body 11 is parallel to the vertical direction, the captured image 35 is "landscape shot." For this reason, in the following, when the long side 11A of the camera body 11 is in a horizontal position perpendicular to the vertical direction, it will be referred to as the "landscape shooting position," and when the short side 11C of the camera body 11 is in a horizontal position perpendicular to the vertical direction, it will be referred to as the "vertical shooting position."

[0035] 6A, in the landscape orientation, the first microphone 21, the second microphone 22, and the third microphone 23 arranged on the first surface 31 are used. In the landscape orientation, the long side 11A of the camera body 11 is in a horizontal position perpendicular to the vertical direction, and therefore the first surface 31, which is in a position parallel to the long side 11A, is also in a horizontal position.

[0036] 6B, in the case of the vertical shooting position, the first microphone 21, the second microphone 22, and the fourth microphone 24 arranged on the second surface 32 are used. In the case of the vertical shooting position, the short side 11C of the camera body 11 is in a horizontal position perpendicular to the vertical direction, and therefore the second surface 32, which is in a position parallel to the short side 11C, is also in a horizontal position.

[0037] [Electrical Configuration of the Imaging Device] As shown in FIG. 7 , the control unit 51 is made up of a microcomputer including a CPU, a ROM (Read Only Memory) that stores programs and parameters used by the CPU, and a RAM (Random Access Memory) (none of which are shown) that is used as a work memory for the CPU, and controls each unit of the digital camera 10.

[0038] A mode switching signal is input to the control unit 51 from the mode dial 14, and a release signal is input from the release switch 15. The digital camera 10 has a still image capture mode and a video capture mode, which can be switched using the mode dial 14. When the digital camera 10 executes the video capture mode, it acquires sound data from any one of the first microphone 21, second microphone 22, third microphone 23, and fourth microphone 24, as will be described later.

[0039] The shutter unit 52 is, for example, a focal plane shutter, and is disposed between the imaging optical system 13 and the imaging element 25. The shutter unit 52 is provided so as to be able to block the optical path between the imaging optical system 13 and the imaging element 25, and is changeable between an open state and a closed state. The shutter unit 52 is in the open state when capturing live view images and videos. The shutter unit 52 is changed from the open state to a closed state when capturing still images. The shutter unit 52 is driven by a shutter motor 53. A motor driver 54 controls the driving of the shutter motor 53.

[0040] The image sensor 25 is driven and controlled by the control unit 51. The image sensor 25 has a light receiving surface made up of a plurality of pixels (not shown) arranged in a two-dimensional matrix. Each pixel includes a photoelectric conversion element, and photoelectrically converts the subject image formed on the light receiving surface by the imaging optical system 13 to generate an image signal.

[0041] The image sensor 25 also includes signal processing circuits (none of which are shown), such as a noise reduction circuit, an auto-gain controller, and an A / D conversion circuit. The noise reduction circuit performs noise reduction processing on the image signal. The auto-gain controller amplifies the level of the image signal to an optimal value. The A / D conversion circuit converts the image signal into a digital signal and outputs it from the image sensor 25 to the bus line 56. The output signal from the image sensor 25 is image data (so-called RAW data) with one color signal for each pixel.

[0042] The image memory 55 stores one frame of image data output to the bus line 56. The image data processing unit 57 reads one frame of image data from the image memory 55 and performs known image processing such as matrix calculation, demosaic processing, gamma correction, luminance / color difference conversion, and resizing.

[0043] The display driver 58 sequentially inputs one frame's worth of image data that has been image-processed by the image data processing unit 57 to the display 26. The display 26, for example, sequentially displays live view images at regular intervals. A card I / F (Interface) 61 is incorporated in a card slot (not shown) provided in the camera body 11 and is electrically connected to a memory card 62 inserted into the card slot. The card I / F 61 stores the image data that has been image-processed by the image data processing unit 57 in the memory card 62. When playing back and displaying the image data stored in the memory card 62, the card I / F 61 reads the image data from the memory card 62.

[0044] The attitude detection sensor 63 uses, for example, a gyro sensor and detects the attitude of the digital camera 10. Based on the result detected by the attitude detection sensor, the control unit 51 determines whether the digital camera 10 is in a landscape orientation or a portrait orientation. Note that the attitude detection sensor 63 is not limited to this, and may also perform facial recognition of a subject from a captured image 35 captured by the image sensor 25 and detect the attitude of the digital camera 10 from the positional relationship of the subject whose face has been recognized with respect to the long side or short side of the captured image 35.

[0045] [Acquisition of Stereophonic Data] The data acquisition unit 64 acquires a combination including any two or more of the first data from the first microphone 21, the second data from the second microphone 22, the third data from the third microphone 23, and the fourth data from the fourth microphone 24. The above-mentioned combinations differ between the landscape shooting position and the portrait shooting position, and the data acquisition unit 64 acquires a combination including the first data in both the landscape shooting position and the portrait shooting position.

[0046] Specifically, in the case of landscape shooting, as described above, the first microphone 21, the second microphone 22, and the third microphone 23 arranged on the first surface 31 are used. That is, in the case of landscape shooting, the data acquisition unit 64 acquires first data from the first microphone 21, second data from the second microphone 22, and third data from the third microphone 23.

[0047] On the other hand, in the case of the vertical shooting position, as described above, the first microphone 21, the second microphone 22, and the fourth microphone 24 arranged on the second surface 32 are used. That is, in the case of the vertical shooting position, the data acquisition unit 64 acquires the first data from the first microphone 21, the second data from the second microphone 22, and the fourth data from the fourth microphone 24.

[0048] In the digital camera 10, in either the horizontal or vertical shooting orientation, the data acquisition unit 64 acquires data from the three microphones, and the stereophonic data processing unit 65 generates stereophonic data from this data. The stereophonic data generated by the stereophonic data processing unit 65 will be described below.

[0049] 8 , as described above, the first surface 31 is in a horizontal position, and sound data is acquired from the first microphone 21, the second microphone 22, and the third microphone 23 arranged on the first surface 31. Furthermore, in the horizontal position, the first microphone 21 and the second microphone 22 are arranged spaced apart in the front-to-rear direction (the direction of the arrow Z), and the first microphone 21 and the third microphone 23 are arranged spaced apart in the left-to-right direction (the direction of the arrow X). Note that the front-to-rear direction is a direction parallel to the optical axis OA, and the left-to-right direction is a direction perpendicular to the vertical direction and the front-to-rear direction.

[0050] The data acquisition unit 64 acquires first data from the first microphone 21 and second data from the second microphone 22, which are arranged spaced apart in the front-to-rear direction. This allows the stereophonic data processing unit 65 to calculate, from the first data and second data acquired by the data acquisition unit 64, the difference in timing (phase difference), volume difference, etc., between when sound reaches the first microphone 21 and the second microphone 22 from the sound source. Similarly, the data acquisition unit 64 acquires first data from the first microphone 21 and third data from the third microphone 23, which are arranged spaced apart in the left-to-right direction. This allows the stereophonic data processing unit 65 to calculate the difference in timing (phase difference), volume difference, etc., between when sound reaches the first microphone 21 and the third microphone 23 from the sound source from the sound source.

[0051] The stereophonic data processing unit 65 can analyze the direction of a sound source from the data containing the phase differences and volume differences of sounds in the front-rear and left-right directions calculated as described above. Note that the direction of the arrow 41 in Figure 8 shows an example of the direction of the sound source. The stereophonic data processing unit 65 can then generate directional stereophonic data by amplifying the sounds from the analyzed direction of the sound source.

[0052] In the case of landscape shooting, as described above, the stereophonic data processing unit 65 analyzes the direction of the sound source from the phase difference and volume difference of the sound in the front-to-back and left-to-right directions, and therefore can set the range of sound directionality all around the first microphone 21, the second microphone 22, and the third microphone 23 (in all directions of 360°).

[0053] 9 , as described above, the second surface 32 is in a horizontal position, and sound data is acquired from the first microphone 21, the second microphone 22, and the fourth microphone 24 arranged on the second surface 32. Furthermore, in the vertical shooting position, the first microphone 21 and the second microphone 22 are arranged spaced apart in the front-to-back direction (the direction of the arrow Z), and the first microphone 21 and the fourth microphone 24 are arranged spaced apart in the left-to-right direction (the direction of the arrow X).

[0054] The data acquisition unit 64 acquires first data from the first microphone 21 and second data from the second microphone 22, which are arranged spaced apart in the front-to-rear direction. This allows the stereophonic data processing unit 65 to calculate sound phase differences, volume differences, etc. in the front-to-rear direction from the first data and second data acquired by the data acquisition unit 64. Similarly, the data acquisition unit 64 acquires first data from the first microphone 21 and fourth data from the fourth microphone 24, which are arranged spaced apart in the left-to-right direction. This allows the stereophonic data processing unit 65 to calculate sound phase differences, volume differences, etc. in the left-to-right direction.

[0055] The stereophonic data processing unit 65 can analyze the direction of a sound source from data containing sound phase differences and volume differences in the front-to-back and left-to-right directions, even in the case of a vertical shooting position, just as in the case of a horizontal shooting position. Note that the direction of the arrow 42 in Figure 9 shows an example of the direction of the sound source. The stereophonic data processing unit 65 can then generate directional stereophonic data by amplifying the sound from the analyzed direction of the sound source.

[0056] In the case of a vertical shooting position, as described above, the stereophonic data processing unit 65 analyzes the direction of the sound source from the phase difference and volume difference of the sound in the front-to-back and left-to-right directions, and therefore can set the range of sound directionality all around the first microphone 21, the second microphone 22, and the fourth microphone 24 (in all directions of 360°).

[0057] Next, the operation of recording a moving image using digital camera 10 according to the present invention will be described with reference to the flowchart shown in Fig. 10. When the user turns on the power by operating power switch 16, switches to moving image capture mode by operating mode dial 14, and then operates release switch 15, control unit 51 of digital camera 10 drives image sensor 25 to start recording a moving image (ST110).

[0058] After starting video recording, the orientation sensor 63 executes an orientation detection process to detect the orientation of the digital camera 10 (ST120). If the control unit 51 determines that the digital camera 10 is in landscape orientation based on the detected orientation (Y in ST130), the data acquisition unit 64 selects the first microphone 21, the second microphone 22, and the third microphone 23 and starts collecting sound (ST140). Next, the data acquisition unit 64 executes a data acquisition process to acquire first data from the first microphone 21, second data from the second microphone 22, and third data from the third microphone 23 (ST150). The stereophonic data processing unit 65 executes a stereophonic data generation process to generate stereophonic data from the first data, second data, and third data (ST180). The control unit 51 then executes a stereophonic data recording process to record the stereophonic data by associating the captured video data with the stereophonic data or storing them in a single file (ST190). As described above, in the case of landscape shooting, the direction of the sound source can be analyzed from the phase difference and volume difference of the sound in the front-to-back and left-to-right directions, and directional stereophonic data can be generated.

[0059] On the other hand, if the attitude detection sensor 63 detects a vertical shooting position and the control unit 51 determines that the camera is in a vertical shooting position (N in ST130), the data acquisition unit 64 selects the first microphone 21, the second microphone 22, and the fourth microphone 24 and starts collecting sound (ST160). The data acquisition unit 64 executes a data acquisition process to acquire first data from the first microphone 21, second data from the second microphone 22, and fourth data from the fourth microphone 24 (ST170), and executes a stereophonic data generation process to generate stereophonic data from the first data, second data, and fourth data (ST180). The control unit 51 then executes a stereophonic data recording process to record the stereophonic data by associating the captured video data with the stereophonic data or storing them in a single file (ST190). As described above, even in a vertical shooting position, the direction of the sound source can be analyzed based on the phase difference and volume difference between the sounds in the front-to-back and left-to-right directions, and directional stereophonic data can be generated.

[0060] If video recording continues (Y in ST200), the control unit 51 continues the sound data acquisition process by the data acquisition unit 64. In the case of landscape orientation, the control unit 51 repeats the data acquisition process (ST150) to acquire first data from the first microphone 21, second data from the second microphone 22, and third data from the third microphone 23, the stereophonic data generation process (ST180) to generate stereophonic data, and the stereophonic data recording process (ST190) to record the stereophonic data. It is preferable that the data acquisition unit 64 maintains the state of acquiring the above combination of data (first data, second data, and third data) from the start of imaging by the image sensor 25 until the end of imaging. This is to prevent the discomfort of changing the microphone collecting sound during imaging.

[0061] On the other hand, in the vertical shooting position, the control unit 51 repeats a data acquisition process (ST170) for acquiring first data from the first microphone 21, second data from the second microphone 22, and third data from the third microphone 23, a stereophonic data generation process (ST180) for generating stereophonic data, and a stereophonic data recording process (ST190) for recording the stereophonic data. Even in the vertical shooting position, it is preferable that the data acquisition unit 64 maintains the state of acquiring the above combination of data (first data, second data, and fourth data) from the start of imaging by the image sensor 25 to the end of imaging. When video recording in video shooting mode ends (N in ST200), the sound data acquisition process, stereophonic data generation process, and stereophonic data recording process also end.

[0062] As described above, the digital camera 10 can be provided with a stereophonic function that acquires sound data and generates directional stereophonic data whether the camera is in a landscape orientation or a portrait orientation. Furthermore, because the data acquisition unit 64 acquires a combination that includes at least the first data and the second data in both the landscape orientation and the portrait orientation, there is no need to increase the number of microphones, and the stereophonic function can be provided with a small number of microphones.

[0063] [First Modification] In the first embodiment described above, the range of sound directivity of the acquired data is set to the entire periphery (all directions of 360°) in both the landscape and portrait shooting positions, but the present invention is not limited to this. When the landscape shooting position is changed to the portrait shooting position, or when the portrait shooting position is changed to the landscape shooting position, the range of sound directivity of the acquired data may be changed. In this case, for example, as shown in Fig. 11, when the digital camera 10 is in the landscape shooting position, the range of sound directivity acquired by the data acquisition unit 64 and generated by the stereophonic data processing unit 65 is the range indicated by angle D11, and when the digital camera 10 is in the portrait shooting position, the range of sound directivity is the range indicated by angle D12, as shown in Fig. 12.

[0064] The range indicated by angles D11 and D12 is a fixed range that includes the direction of the optical axis OA and a direction intersecting the optical axis OA. Angle D11 is wider than angle D12. That is, the range of sound directionality acquired by the data acquisition unit 64 and generated by the stereophonic data processing unit 65 is wider in the horizontal shooting position than in the vertical shooting position.

[0065] It is preferable that the angle D11 and angle D12, which are the ranges of sound directionality described above, be changed in accordance with the aspect ratio of the captured image 35 captured by the image sensor 25. That is, when the aspect ratio of the captured image 35 is long side 35A:short side 35B (see FIG. 5), it is preferable that angle D11:angle D12=long side 35A:short side 35B. This allows the range of sound directionality to be set within a range that matches the size of the angle of view in both the horizontal and vertical shooting positions, making it possible to generate stereophonic data from an appropriate range of directionality.

[0066] [Second Embodiment] In the first embodiment, the present invention is applied to an imaging device that generates directional stereophonic data using four microphones: a first microphone 21, a second microphone 22, a third microphone 23, and a fourth microphone 24. However, the present invention is not limited to this, and any imaging device may be used that includes at least three microphones (a first microphone, a second microphone, and a third microphone), as in the second embodiment described below. Note that, in the following, when parts and members similar to those in the first embodiment are used, the same reference numerals are used and descriptions thereof are omitted.

[0067] 13 , a digital camera 70 includes a camera body 71 and a lens barrel 12. The digital camera 70 is an example of an imaging device according to the present invention. Similar to the camera body 11 in the first embodiment, the camera body 71 has a generally rectangular box shape in which one adjacent side (long side) is longer than the other adjacent side (short side) when viewed from the front.

[0068] 14 , a display 26 is rotatably attached to a camera body 71 via a hinge portion 71E, similar to the camera body 11 in the first embodiment. The camera body 71 is equipped with a first microphone 81, a second microphone 82, and a third microphone 83. In this embodiment, the first microphone 81, the second microphone 82, and the third microphone 83 are omnidirectional microphones, similar to the first microphone 21, the second microphone 22, the third microphone 23, and the fourth microphone 24 in the first embodiment, but are not limited to this and may be microphones whose directionality can be controlled.

[0069] [Arrangement of microphones in the second embodiment] The first microphone 81 and the second microphone 82 are arranged extending in the direction of the optical axis OA. The first microphone 81 is arranged closer to the subject of the optical axis OA than the second microphone 82. The third microphone 83 is arranged on the first surface 84. The first surface 84 is a surface that includes the first microphone 21 and the second microphone 22. Note that "including" a microphone means including at least a portion of the microphone, rather than the entire microphone, as in the first embodiment.

[0070] The definitions of "horizontal shooting" and "vertical shooting" are the same as those in the first embodiment. In this embodiment, the state in which the long side 71A of the camera body 71 is in a horizontal position perpendicular to the vertical direction is referred to as the "horizontal shooting position," and the state in which the short side 71C of the camera body 71 is in a horizontal position perpendicular to the vertical direction is referred to as the "vertical shooting position."

[0071] Similar to the first surface 31 in the first embodiment, the first surface 84 is parallel to the side surface 71B including the long side 71A of the camera body 71. The first microphone 81 and the second microphone 82 are disposed in positions facing the corner portion 71F where the side surfaces 71B and 71D of the camera body 71 are connected. The third microphone 83 is disposed in a position facing the side surface 71B of the camera body 71.

[0072] In the landscape orientation, the first microphone 81, the second microphone 82, and the third microphone 83 arranged on the first surface 84 are used. In the landscape orientation, the long side 71A of the camera body 71 is in a horizontal position perpendicular to the vertical direction, and therefore the first surface 84, which is in a position parallel to the long side 71A, is also in a horizontal position.

[0073] In the vertical shooting position, either the first microphone 81 and the second microphone 82 or the first microphone 81 and the third microphone 83 are used in combination depending on the sound acquisition mode of the digital camera 70. For example, when the sound acquisition mode of the digital camera 70 is a directional mode in the vertical shooting position, the first microphone 81 and the second microphone 82 are used in combination, and when the sound acquisition mode is an omnidirectional mode in the vertical shooting position, the first microphone 81 and the third microphone 83 are used in combination. The sound acquisition mode can be switched by operating, for example, the mode dial 14 or a touch panel (not shown) provided on the display 26.

[0074] The electrical configuration of digital camera 70 is the same as that of digital camera 10 in the first embodiment, except that the four microphones, first microphone 21, second microphone 22, third microphone 23, and fourth microphone 24, are replaced with three microphones, first microphone 81, second microphone 82, and third microphone 83, and the combination of data acquired by data acquisition unit 64 and the content of the stereophonic sound data generated by stereophonic data processing unit 65 are different, and therefore further description will be omitted. The combination of data acquired by data acquisition unit 64 and the stereophonic sound data generated by stereophonic data processing unit 65 in this embodiment will be described below.

[0075] The data acquisition unit 64 acquires a combination including any two or more of the first data from the first microphone 81, the second data from the second microphone 82, and the third data from the third microphone 83. The above-mentioned combinations differ between the landscape shooting position and the portrait shooting position, and the data acquisition unit 64 acquires a combination including the first data in both the landscape shooting position and the portrait shooting position.

[0076] 15 , as described above, the first surface 84 is in a horizontal position, and the first microphone 81, second microphone 82, and third microphone 83 arranged on the first surface 84 are used. Furthermore, in the horizontal position, the first microphone 81 and second microphone 82 are arranged spaced apart in the front-to-back direction (arrow Z direction), and the first microphone 81 and third microphone 83 are arranged spaced apart in the left-to-right direction (arrow X direction).

[0077] The data acquisition unit 64 acquires first data from the first microphone 81, second data from the second microphone 82, and third data from the third microphone 83. The arrangement of the first microphone 81, second microphone 82, and third microphone 83 in the landscape shooting position and the combination of data acquired by the data acquisition unit 64 are the same as in the landscape shooting position in the first embodiment. This allows the stereophonic data processing unit 65 to analyze the direction of the sound source from the first data, second data, and third data, based on data containing sound phase differences and volume differences in the front-to-back and left-to-right directions.

[0078] The direction of the arrow 85 in FIG. 15 indicates an example of the direction of the sound source. The stereophonic data processing unit 65 can generate directional stereophonic data by amplifying the sound from the direction of the analyzed sound source. In the case of landscape orientation, as in the first modified example, the range of directivity of the sound acquired by the data acquisition unit 64 and generated by the stereophonic data processing unit 65 is set to the range indicated by angle D21. The range indicated by angle D21 is a certain range that includes the direction of the optical axis OA and a direction intersecting with the optical axis OA. However, without being limited to this, the stereophonic data processing unit 65 may set the range of directivity of the sound of the acquired data in the entire periphery (all directions of 360°) of the first microphone 81, the second microphone 82, and the third microphone 83.

[0079] 16 , the combination of sound data acquired by the data acquisition unit 64 differs between the directional mode and the omnidirectional mode. In the directional mode with the vertical shooting position, the data acquisition unit 64 acquires first data from the first microphone 81 and second data from the second microphone 82, which are spaced apart in the front-to-rear direction. This allows the stereophonic data processing unit 65 to calculate the phase difference and volume difference of the sound in the front-to-rear direction from the first data and second data acquired by the data acquisition unit 64.

[0080] The stereophonic data processing unit 65 can then generate directional stereophonic data by amplifying the sound from the direction of the analyzed sound source. The direction of the arrow 86 in FIG. 16 is an example of the direction of the sound source. In this case, the stereophonic data processing unit 65 analyzes the direction of the sound source from the phase difference and volume difference of the sound in the front-to-rear direction (arrow Z direction), so sound directivity can only be set in the front-to-rear direction. That is, the range of sound directivity acquired by the data acquisition unit 64 and generated by the stereophonic data processing unit 65 is wider in the landscape shooting position than in the portrait shooting position. However, this is not limiting, and the range of directivity may be changed depending on the aspect ratio of the captured image 35 captured by the image sensor 25, as in the first modified example described above.

[0081] On the other hand, in the omnidirectional mode with the vertical shooting position, the data acquisition unit 64 acquires the first data from the first microphone 81 and the third data from the third microphone 83. The stereophonic data processing unit 65 uses the first data and second data acquired by the data acquisition unit 64 as omnidirectional sound data that does not have directional sensitivity characteristics in a specific direction, and records the first data and the third data as they are in a single file, for example.

[0082] Next, the operation of recording a moving image using digital camera 70 according to the present invention will be described with reference to the flowchart shown in Fig. 17. When the user operates power switch 16, mode dial 14, and release switch 15, control unit 51 of digital camera 10 drives image sensor 25 to start recording a moving image (ST210).

[0083] After starting video recording, the orientation sensor 63 executes orientation detection processing to detect the orientation of the digital camera 70 (ST220). If the control unit 51 determines that the digital camera 70 is in landscape orientation based on the detection result (Y in ST230), the data acquisition unit 64 selects the first microphone 81, the second microphone 82, and the third microphone 83 and starts collecting sound (ST240). Next, the data acquisition unit 64 executes data acquisition processing to acquire first data, second data, and third data (ST250). The stereophonic data processing unit 65 executes stereophonic data generation processing to generate stereophonic data from the first data, second data, and third data (ST280). The control unit 51 then executes stereophonic data recording processing to record the stereophonic data (ST290). As described above, in the landscape orientation, the direction of the sound source can be analyzed based on the phase difference and volume difference of the sound in the front-to-back and left-to-right directions, and directional stereophonic data can be generated.

[0084] On the other hand, if the attitude detection sensor 63 detects the camera in a vertical shooting position and the control unit 51 determines that the camera is in a vertical shooting position (N in ST230), and if directional mode is selected, the data acquisition unit 64 selects the first microphone 81 and the second microphone 82 and starts collecting sound (ST260). The data acquisition unit 64 executes a data acquisition process to acquire the first data and the second data (ST270), and executes a stereophonic data generation process to generate stereophonic data from the first data and the second data (ST280). The control unit 51 then executes a stereophonic data recording process to record the stereophonic data (ST290). As described above, even in the vertical shooting position, the direction of the sound source can be analyzed from the phase difference and volume difference of the sound in the front-to-rear direction, and directional stereophonic data can be generated, although only in the front-to-rear direction.

[0085] If the orientation detected by the orientation detection sensor 63 is the vertical orientation (N in ST230) and the omnidirectional mode is selected, the data acquisition unit 64 selects the first microphone 81 and the third microphone 83 and starts collecting sound (ST260). The data acquisition unit 64 executes a data acquisition process to acquire the first data and the third data (ST270), and the stereophonic data processing unit 65 executes a stereophonic data recording process to record the first data and the third data as omnidirectional sound data (ST290).

[0086] If video recording continues (Y in ST300), the control unit 51 continues the sound data acquisition process by the data acquisition unit 64. In the case of landscape orientation, the control unit 51 repeats the data acquisition process (ST250) for acquiring the first data, the second data, and the third data, the stereophonic data generation process (ST280) for generating the stereophonic data, and the stereophonic data recording process (ST290) for recording the stereophonic data. It is preferable that the data acquisition unit 64 maintains the state of acquiring the above combinations of data (first data, second data, and third data) from the start of imaging by the image sensor 25 until the end of imaging.

[0087] On the other hand, in the case of the vertical shooting posture and directional mode, the control unit 51 repeats a data acquisition process (ST270) for acquiring the first data and the second data, a stereophonic data generation process (ST280) for generating stereophonic data, and a stereophonic data recording process (ST290) for recording the stereophonic data. Note that it is preferable that the data acquisition unit 64 maintains the state of acquiring the above-described combination of data (first data and second data) from the start of imaging by the image sensor 25 until the end of imaging.

[0088] In addition, in the case of the omnidirectional mode in the vertical shooting position, the control unit 51 repeats the data acquisition process (ST270) for acquiring the first data and the third data, and the stereophonic data recording process (ST290) for recording the omnidirectional sound data as is. When the video recording in the video shooting mode ends (N in ST300), the sound data acquisition process, the stereophonic data generation process, and the stereophonic data recording process also end.

[0089] As described above, digital camera 70 can be provided with a stereophonic function that acquires sound data and generates directional stereophonic data whether the camera is in a landscape or portrait orientation. Furthermore, because the first microphone 21 and the second microphone 22, or the first microphone 21 and the third microphone 23, are used in common whether the camera is in a landscape or portrait orientation, there is no need to increase the number of microphones, and the stereophonic function can be provided with a small number of microphones.

[0090] [Second Modification] In each of the above embodiments and the first modification, the stereophonic data processing unit 65 analyzes the direction of a sound source from the phase difference and volume difference of the sounds, and amplifies the sound from the direction of the analyzed sound source, or controls the directivity of the microphone (controlling the sound collection range, sound collection direction, sound collection distance (sensitivity), etc.), thereby generating directional stereophonic data. However, the present invention is not limited to this. As in the digital camera 90 shown in Fig. 18 , face recognition of a subject H may be performed from a captured image 35 captured by the image sensor 25, and the sound directionality of the data may be set to the direction in which the subject whose face has been recognized is located relative to the digital camera 90. In this case, for example, the control unit 51 performs face recognition processing to recognize the face of the subject H from the captured image 35, and direction identification processing to identify the direction in which the subject H whose face has been recognized is located relative to the digital camera 90.

[0091] The direction of arrow 91 in the figure indicates an example of the direction in which subject H, whose face has been recognized, is located relative to digital camera 90. In the example shown in Fig. 18 , in the case of landscape shooting orientation, as in the first and second embodiments, sound data is acquired from first microphone 81, second microphone 82, and third microphone 83. Data acquisition unit 64 acquires first data from first microphone 81, second data from second microphone 82, and third data from third microphone 83. The arrangement of first microphone 81, second microphone 82, and third microphone 83 in the landscape shooting orientation and the combination of data acquired by data acquisition unit 64 are the same as in the case of landscape shooting orientation in the first and second embodiments.

[0092] The stereophonic data processing unit 65 can generate directional stereophonic data by amplifying sounds from the direction of the subject H identified by the direction identification process. Alternatively, the control unit 51 controls the microphone directivity (control of the sound collection range, sound collection direction, sound collection distance (sensitivity), etc.) so as to collect sound from a certain range centered on the direction of the subject H identified by the direction identification process. The angle D31 is an example of a range in which the directivities of the first microphone 21, the second microphone 22, and the third microphone 23 are controlled with the direction of the subject H as the center. This achieves the same effects as the above-described embodiments. Furthermore, in this modified example, directivity is imparted based on the direction of the subject H, which is likely to be the sound source, making it possible to generate realistic stereophonic data.

[0093] [Third Modification] In another modification, the range of directivity may be switched in response to a change in the display orientation of the display 26, as in the digital camera 95 shown in FIG. 19 . In this modification, for example, a display orientation detection sensor is provided that detects the display orientation of the display 26. The display orientation detection sensor is, for example, a contact-type sensor that is provided in the hinge portion 71E and detects the rotation angle of the display 26. Furthermore, the stereophonic data processing unit 65 sets a range of directivity related to the sound of the data acquired by the microphone, as in the first modification and the second embodiment. The control unit 51 switches the range of directivity in response to the detected change in the display orientation of the display 26.

[0094] The direction of the arrow 96 in the figure is an example of the display direction of the display 26 detected by the display direction detection sensor. In this example, the display 26 has a display direction parallel to the optical axis OA and facing the subject. That is, the subject is displayed on the display 26, and the subject can see themselves displayed on the display 26, creating a so-called selfie state. In this case, the control unit 51 switches the range of directivity to the front of the digital camera 95, i.e., the direction of the optical axis OA and the subject.

[0095] The stereophonic data processing unit 65 can generate directional stereophonic data by amplifying sounds coming from the direction of the optical axis OA and the direction toward the subject. Alternatively, the control unit 51 controls the directivity of the microphones so that sounds are collected from a certain range centered on the direction of the optical axis OA and the direction toward the subject. This achieves the same effects as the above-described embodiments or the first and second modifications.

[0096] In each of the above embodiments, a microphone to be used is selected, and the data acquisition unit 64 acquires sound data from the selected microphone. However, this is not limited to this. Sound data from all microphones may be input to the data acquisition unit 64, and only data to be used for generating stereophonic data may be selected and acquired from all the data. Furthermore, in each of the above embodiments, the first orientation is a horizontal shooting orientation and the second orientation is a vertical shooting orientation. However, the present invention is not limited to this. The first orientation and the second orientation may be different orientations of the digital camera. Furthermore, in each of the above embodiments, the data acquisition unit 64 maintains a state in which it acquires the same combination of data from the start of imaging by the image sensor 25 to the end of imaging. However, this is not limited to this. If the orientation of the digital camera changes midway between the start of imaging by the image sensor 25 and the end of imaging, the combination of data acquired by the data acquisition unit 64 may be changed depending on the detected orientation.

[0097] The hardware structures of processing units that execute various processes, such as the control unit 51, the data acquisition unit 64, and the stereophonic data processing unit 65, are various processors as shown below. The various processors include a CPU (Central Processing Unit), which is a general-purpose processor that executes software (programs) and functions as various processing units, a GPU (Graphical Processing Unit), a PLD (Programmable Logic Device), which is a processor whose circuit configuration can be changed after manufacture, such as an FPGA (Field Programmable Gate Array), and a dedicated electrical circuit, which is a processor having a circuit configuration designed specifically for executing various processes.

[0098] A single processing unit may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (e.g., multiple FPGAs, a combination of a CPU and an FPGA, or a combination of a CPU and a GPU). Multiple processing units may also be configured with a single processor. Examples of multiple processing units configured with a single processor include: a first configuration, as typified by client or server computers, in which a single processor is configured with a combination of one or more CPUs and software, and this processor functions as multiple processing units; and a second configuration, as typified by SoCs (System On Chips), in which a processor is used to realize the functions of an entire system including multiple processing units on a single IC (Integrated Circuit) chip. In this way, the various processing units are configured with one or more of the above-mentioned various processors as a hardware structure.

[0099] Furthermore, the hardware structure of these various processors is, more specifically, an electric circuit in the form of a combination of circuit elements such as semiconductor elements.

[0100] In each of the above embodiments, a digital camera in which the imaging optical system 13 is fixed to the camera body 11, 71 is exemplified, but this is not limited to this and the invention may also be applied to a lens-interchangeable digital camera in which the imaging optical system is interchangeable with respect to the camera body.

[0101] Although the above embodiments illustrate lens barrel 12 without a zoom lens, the present invention is not limited to this, and a zoom lens may be included in imaging optical system 13. Furthermore, the present invention is applicable to imaging devices other than digital cameras, such as smartphones and video cameras.

[0102] 10, 70, 90, 95 Digital camera 11, 71 Camera body 11A Long side 11B, 11D Side surface 11C Short side 11E Hinge portion 11F Corner portion 11G, 11H, 11I Through-hole 12 Lens barrel 13 Imaging optical system 14 Mode dial 15 Release switch 16 Power switch 21 First microphone 22 Second microphone 23 Third microphone 24 Fourth microphone 25 Imaging element 26 Display 31 First surface 32 Second surface 33 Third surface 35 Captured image 35A Long side 35B Short side 36 Effective imaging area 36A Long side 36B Short side 41, 42 Arrows 51 Control unit 52 Shutter unit 53 Shutter motor 54 Motor driver 55 Image memory 56 Bus line 57 Image data processing unit 58 Display driver 61 Card I / F (Interface) 62 Memory card 63 Attitude detection sensor 64 Data acquisition unit 65 Stereophonic data processing unit 71A Long side 71B, 71D Side surface 71C Short side 71E Hinge portion 71F Corner portion 81 First microphone 82 Second microphone 83 Third microphone 84 First surface 85, 86, 91, 96 Arrows D11, D12, D21, D31 Angle H Subject OA Optical axis X, Y, Z directions

Claims

1. An imaging device comprising at least a first microphone, a second microphone, and a third microphone; a processor; and an imaging optical system, wherein the first microphone and the second microphone are arranged extending in the optical axis direction, the first microphone is arranged closer to the subject than the second microphone, and the processor acquires a combination including any two or more of first data from the first microphone, second data from the second microphone, and third data from the third microphone, wherein the combination differs between a first posture and a second posture different from the first posture, and the combination including the first data is acquired in the first posture and the second posture.

2. The imaging device of claim 1, further comprising a fourth microphone in addition to the first microphone, the second microphone, and the third microphone, and wherein the processor acquires a combination including any two or more of the first data, the second data, the third data, and the fourth data from the fourth microphone, and acquires the combination including at least the first data and the second data in the first attitude and the second attitude.

3. The imaging device of claim 2, wherein the processor acquires, in the first posture, the first data, the second data, and the third data as the combination, and, in the second posture, acquires, in the first posture, the first data, the second data, and the fourth data as the combination.

4. The imaging device of claim 2, wherein the third microphone is disposed on a first plane including the first microphone and the second microphone, the fourth microphone is disposed on a second plane including the first microphone and the second microphone and intersecting the first plane, and the third microphone and the fourth microphone are disposed opposite a third plane including the first microphone, the second microphone, and the optical axis.

5. The imaging device of claim 1, wherein the processor acquires, in the first posture, the first data, the second data, and the third data as the combination, and, in the second posture, acquires, in the combination, the first data and the second data, or the first data and the third data.

6. The imaging device according to claim 5, wherein the processor sets a range of sound directivity for the acquired data when the imaging device is in the first attitude.

7. The imaging device according to claim 6, wherein the range of directivity includes the optical axis direction and a direction intersecting the optical axis.

8. The imaging device according to claim 6, wherein the processor sets the directivity to a wider angle in the first attitude than in the second attitude.

9. An imaging device as described in claim 1 or 2, further comprising a sensor for detecting an attitude, and the processor determines the first attitude and the second attitude based on a result detected by the sensor.

10. The imaging device according to claim 1 or 2, further comprising an imaging element for capturing an image of a subject formed by the imaging optical system, and wherein the processor maintains a state for acquiring the combination of data from the start of imaging by the imaging element to the end of imaging.

11. The imaging device of claim 1, wherein the processor changes a range of sound directionality of the acquired data when the attitude is changed from the first attitude to the second attitude, or when the attitude is changed from the second attitude to the first attitude.

12. The imaging device according to claim 1, further comprising an imaging element for capturing an image of a subject formed by the imaging optical system, wherein the processor sets a range of directionality with respect to sound of the acquired data, and changes the range of directionality according to an aspect ratio of an image captured by the imaging element.

13. The imaging device according to claim 11 or 12, wherein the processor sets the sound-related directivity of the acquired data to a wide angle in the first posture and in the second posture.

14. An imaging device as described in claim 1, further comprising an imaging element for capturing an image of a subject formed by the imaging optical system, wherein the processor performs facial recognition of the subject from the captured image captured by the imaging element, and sets the sound-related directivity of the acquired data in a direction in which the subject whose face has been recognized is located relative to the imaging device.

15. An imaging device as described in claim 1, comprising an imaging element that captures an image of a subject formed by the imaging optical system, and a display that displays an image captured by the imaging element and has a switchable display direction, wherein the processor sets a range of directionality related to sound of the acquired data, and switches the range of directionality in response to the switching of the display direction.

Images