Electronic equipment and control methods for electronic equipment

Abstract

This device provides an electronic device that allows users to determine the shooting angle while more accurately understanding the range in which they can capture the subject's voice. [Solution] The electronic device includes detection means for detecting a subject from an image captured by an imaging unit, and display control means for controlling the display of the image in a manner that allows identification of the sound-collectible range, which is the range in which sound from the subject can be collected, based on the distance from the imaging unit to the subject, the focal length of the imaging unit, and information on the sound-collectible range by a sound-collecting unit that collects sound recorded together with the image.

Description

[Technical Field]

[0001] The present invention relates to an electronic device and a control method for an electronic device. [Background Art]

[0002] An imaging device (electronic device) such as a digital camera capable of capturing moving images and still images and collecting audio includes an imaging unit and a sound collection microphone, and can record, for example, audio specialized in the direction of a subject together with an image of the subject. Patent Document 1 discloses an imaging device that indicates, by a frame on a shooting screen (a so-called through screen), a range where sound can be picked up from the directivity range of a sound collecting microphone (zoom microphone). Patent Document 2 discloses a technology of specifying a subject included in both a sound collection range and an imaging range as a sound collection target, and adjusting an output sound volume to achieve a sound volume within a certain range based on a distance to the sound collection target. [Prior Art Documents] [Patent Documents]

[0003] [Patent Document 1] Japanese Unexamined Patent Application Publication No. 2010-004303 [Patent Document 2] Japanese Unexamined Patent Application Publication No. 2022-180926 [Summary of the Invention] [Problem to be Solved by the Invention]

[0004] The sound collection range of a directional sound collection microphone changes according to the distance between a subject to be imaged and the sound collection microphone. For example, the appropriate sound collection range when using a microphone with narrow sound collection characteristics has sound collection characteristics such that the range becomes narrow in cases such as close-range self-shooting, and becomes wide when shooting at a distance of several meters. In Patent Document 1 and Patent Document 2, the sound collection range is determined without considering the distance between the subject and the sound collection microphone, so it is difficult for a user to accurately grasp the range in which the audio of the subject can be collected.

[0005] Therefore, the present invention aims to provide an electronic device that enables the user to determine the shooting angle while more accurately understanding the range in which the subject's sound can be picked up. [Means for solving the problem]

[0006] The electronic device according to the present invention is characterized by comprising: detection means for detecting a subject from an image captured by an imaging unit; and display control means for controlling the display of the image in a manner that allows identification of a sound-collectible range, which is the range in which sound from the subject can be collected, based on the distance from the imaging unit to the subject, the focal length of the imaging unit, and information on the sound-collectible range by a sound-collecting unit that collects sound recorded together with the image. [Effects of the Invention]

[0007] According to the present invention, it becomes possible for the user to determine the shooting angle while more accurately understanding the range in which the subject's sound can be picked up. [Brief explanation of the drawing]

[0008] [Figure 1] This is a block diagram illustrating the configuration of an imaging device. [Figure 2] This is a diagram illustrating the directional microphone mounted on the imaging device. [Figure 3] This diagram illustrates the sound pickup range according to the distance between the imaging device and the subject. [Figure 4] This figure shows a conventional example of how the sound pickup range is presented. [Figure 5] This diagram illustrates the sound pickup range at the first focal length. [Figure 6] This figure shows an example of the sound pickup range at the first focal length. [Figure 7] This diagram illustrates the sound pickup range at the second focal length. [Figure 8] This figure shows an example of the sound pickup range at the second focal length. [Figure 9]This diagram illustrates the sound pickup range when the subject moves. [Figure 10] This figure shows an example of the sound pickup range when the subject moves. [Figure 11] This flowchart illustrates the process of indicating the range of sound pickup possible. [Modes for carrying out the invention]

[0009] <Embodiment> Embodiments of the present invention will be described below with reference to the drawings. Figure 1 is a block diagram illustrating the configuration of an imaging device 100, which is an example of an electronic device according to the present invention. The electronic device according to the present invention may be an imaging device 100 such as a digital camera, as well as a smartphone, a tablet terminal, and a personal computer (PC). The imaging device 100 includes a control unit 101, a lens 102, and a lens actuator drive unit 103. The control unit 101 is, for example, a CPU (Central Processing Unit) and controls the entire imaging device 100.

[0010] The lens 102 is a lens unit and is an imaging optical system that includes a zoom unit, an aperture / shutter unit, and a focus unit. The lens actuator drive unit 103 includes a motor driver IC and drives various actuators of the lens 102, such as the zoom unit, aperture / shutter unit, and focus unit. The lens actuator drive unit 103 drives the various actuators based on actuator drive instruction data for the lens 102 received from the control unit 101.

[0011] The imaging device 100 also includes an imaging unit 104, an imaging signal processing unit 105, and an image signal processing unit 106. The imaging unit 104 includes an image sensor such as a CMOS sensor and a CCD sensor, and outputs an electrical signal by photoelectric conversion of the optical image formed by the lens 102. The imaging signal processing unit 105 converts the electrical signal output from the imaging unit 104 into a video signal. The image signal processing unit 106 processes the video signal output from the imaging signal processing unit 105 according to the application. The processing of the video signal includes image cropping and electronic vibration isolation operation by rotation processing. The imaging unit 104, including the lens 102, lens actuator drive unit 103, imaging signal processing unit 105, and image signal processing unit 106, is also referred to as the imaging unit.

[0012] The control unit 101 includes a subject detection unit 107 and a distance measuring unit 108. The subject detection unit 107 detects a person or other subject from image data output from the image signal processing unit 106. The subject detection unit 107 can detect the positional relationship between the subject and the surrounding walls. The distance measuring unit 108 acquires distance information to the focused subject by controlling the lens actuator drive unit 103.

[0013] Furthermore, the imaging device 100 includes a sound pickup unit 109, an audio signal processing unit 110, an audio playback unit 111, an operation unit 112, a storage unit 113, a display unit 114, an external input / output terminal unit 115, a power supply unit 116, a power supply control unit 117, and a storage medium 118.

[0014] The sound pickup unit 109 is an audio input unit including a microphone (hereinafter referred to as "microphone"), which converts the audio signal into an electrical signal and outputs it to the audio signal processing unit 110. The output signal may be an analog signal or an A / D converted digital signal. The sound pickup unit 109 may be a directional microphone. The sound pickup unit 109 may be a built-in microphone mounted on the imaging device 100, an external wired microphone, or a cableless microphone. The external wired microphone and cableless microphone are wired to the imaging device 100 via a microphone jack or multi-accessory shoe mounted on the imaging device 100. An output signal from a microphone accessory is input to an audio signal processing unit 110.

[0015] The audio signal processing unit 110 performs audio processing on an audio signal received from a sound collection unit 109. For example, when a received signal from the sound collection unit 109 is an analog signal, the audio signal processing unit 110 executes A / D conversion processing on the received signal. An audio reproduction unit 111 includes a speaker, converts audio data into an electric signal, and reproduces audio.

[0016] An operation unit 112 is an operation member for operating an imaging apparatus 100. The operation unit 112 includes a main switch that is a power switch of the imaging apparatus 100, a volume operation member that corrects a recording gain of audio data, and the like.

[0017] A storage unit 113 stores parameters for processing imaging data, information related to control of the imaging apparatus 100, information related to face detection of a subject to be collected, and the like. A display unit 114 includes a display such as an LCD (Liquid Crystal Display), and displays an image based on a signal output from an image signal processing unit 106. An external input / output terminal unit 115 inputs and outputs communication signals and video signals to and from an external device.

[0018] A power supply unit 116 supplies power to the entire imaging apparatus 100 (each element) according to the application. A power supply control unit 117 performs control to individually turn on and turn off different types of power supplies of the power supply unit 116. A storage medium 118 stores video information obtained by imaging performed by the imaging apparatus 100, audio data collected during imaging, attribute information related to imaging conditions, and the like.

[0019] Referring to FIG. 2, a directional microphone 200 mounted on the imaging apparatus 100 will be described. The directional microphone 200 corresponds to the sound collection unit 109 and the audio signal processing unit 110. The directional microphone 200 generally includes a plurality of microphones. The directional microphone 200 implements sound collection processing by processing audio signals from the plurality of microphones by the audio signal processing unit 110.

[0020] Figures 3(A) and 3(B) illustrate the sound pickup range depending on the distance between the imaging device 100 and the subject. Figure 3(A) illustrates the sound pickup range 304 in a side view when the subject 302 is 0.5 m away from the imaging device 100, or when the subject 303 is 3 m away from the imaging device 100. The dotted line indicating the field of view range 301 shows the field of view range captured by the imaging device 100. The sound pickup range 304 shows the sound pickup range by the directional microphone 200 mounted on the imaging device 100.

[0021] Figure 3(B) illustrates the sound pickup range 304 in a plan view when the subject 302 is 0.5 m away from the imaging device 100, or when the subject 303 is 3 m away from the imaging device 100. The field of view range 301 shown by the dotted line indicates the field of view range captured by the imaging device 100. The sound pickup range 304 indicates the sound pickup range by the directional microphone 200 mounted on the imaging device 100.

[0022] Figures 4(A) to 4(C) show conventional examples of how the sound pickup range is presented. The display screen 401 in Figures 4(A) to 4(C) shows the area corresponding to the field of view range 301 shown in Figures 3(A) and 3(B). The display screen 401 in Figures 4(A) to 4(C) displays the captured image of the field of view range 301 according to the focal length of the lens 102 at the time of each image capture, and the distance between the subject and the microphone.

[0023] The display screen 401 in Figure 4(A) shows the field of view range 301 when the focal length of the lens 102 is 24 mm and the distance from the imaging device 100 (microphone) to the subject 303 is 3 m. The sound pickup range 402 is when the focal length of the lens 102 is 24 mm and the distance from the microphone to the subject 203 This represents the sound pickup range at a distance of 3m, and is indicated by a dotted circle near the center of display screen 401.

[0024] The display screen 401 in Figure 4(B) shows the field of view range 301 when the focal length of the lens 102 is 24 mm and the distance from the imaging device (microphone) 100 to the subject 302 is 0.5 m. The sound pickup range 403 is the range in which sound can be picked up when the focal length of the lens 102 is 24 mm and the distance from the microphone to the subject 302 is 0.5 m, and is shown as a dotted circle near the center of the display screen 401.

[0025] The display screen 401 in Figure 4(C) shows the field of view range 301 when the focal length of the lens 102 is 70 mm and the distance from the imaging device (microphone) 100 to the subject 303 is 3 m. The sound pickup range 404 is the range in which sound can be picked up when the focal length of the lens 102 is 70 mm and the distance from the microphone to the subject 303 is 3 m, and is shown as a dotted circle near the center of the display screen 401.

[0026] As shown in Figures 4(A) to 4(C), in conventional examples, even when conditions such as the shooting angle of view, the focal length of lens 102, and the position of the subject were changed, the sound pickup range remained the same.

[0027] Figures 5(A) and 5(B) illustrate the sound pickup range at a first focal length. The first focal length is 24 mm. That is, Figures 5(A) and 5(B) illustrate the sound pickup range according to the distance between the imaging device 100 and the subject when the focal length of the lens 102 is 24 mm. The imaging device 100 has a directional microphone 200 mounted on its top surface, as shown in Figure 2.

[0028] Figure 5(A), similar to Figure 3(A), illustrates the sound pickup range 504 in a side view when the subject 502 is 0.5 m away from the imaging device 100, or when the subject 503 is 3 m away from the imaging device 100. The angle of view range 501, shown by the dotted line, indicates the range of the shooting angle of view when the focal length of the lens 102 is 24 mm. The sound pickup range 504 indicates the sound pickup range by the directional microphone 200 mounted on the imaging device 100.

[0029] Figure 5(B), similar to Figure 3(B), illustrates the sound pickup range 504 in a plan view when the subject 502 is 0.5 m away from the imaging device 100, or when the subject 503 is 3 m away from the imaging device 100. The field of view range 501, shown by the dotted line, indicates the range of the shooting field of view when the focal length of the lens 102 is 24 mm. The sound pickup range 504 indicates the sound pickup range by the directional microphone 200 mounted on the imaging device 100.

[0030] Figures 6(A) and 6(B) show examples of the sound-collectible range at a first focal length. The first focal length is set to 24 mm. The display screen 601 in Figures 6(A) and 6(B) shows the area corresponding to the field of view range 501 shown in Figures 5(A) and 5(B), and is displayed on the display unit 114 of the imaging device 100. The display screen 601 in Figures 6(A) and 6(B) displays the captured image for the field of view range 501 corresponding to the distance between each subject and the microphone. The display screen 601 displays the captured image in a manner that allows identification of the sound-collectible range, which is the range in which sound from the subject can be collected.

[0031] The display screen 601 in Figure 6(A) shows the field of view 501 when the focal length of the lens 102 is 24 mm and the distance from the imaging device 100 (microphone) to the subject 503 is 3 m. The sound-collectible range 602 is the range in which sound can be collected when the focal length of the lens 102 is 24 mm and the distance from the microphone to the subject 503 is 3 m. The sound-collectible range 602 is shown as a dotted circle of size corresponding to the actual sound-collectible range 504 by the directional microphone 200 relative to the display screen 601. It is shown.

[0032] The display screen 601 in Figure 6(B) shows the field of view 501 when the focal length of the lens 102 is 24 mm and the distance from the imaging device 100 (microphone) to the subject 502 is 0.5 m. The sound pickup range 603 is the range in which sound can be picked up when the focal length of the lens 102 is 24 mm and the distance from the microphone to the subject 502 is 0.5 m, and is shown as a dotted circle near the center of the display screen 601 that is large enough to fit the upper body of the subject.

[0033] Figures 7(A) and 7(B) illustrate the sound pickup range at a second focal length. The second focal length is set to 70 mm. That is, Figures 7(A) and 7(B) illustrate the sound pickup range according to the distance between the imaging device 100 and the subject when the focal length of the lens 102 is 70 mm. As shown in Figure 2, the imaging device 100 is equipped with a directional microphone 200 on its top surface.

[0034] Figure 7(A) illustrates the sound pickup range 704 in a side view when the subject 702 is 0.5 m away from the imaging device 100, or when the subject 703 is 3 m away from the imaging device 100. The field of view range 701 shown by the dotted line indicates the range of the shooting field of view when the focal length of the lens 102 is 70 mm. The sound pickup range 704 indicates the sound pickup range by the directional microphone 200 mounted on the imaging device 100.

[0035] Figure 7(B) illustrates the sound pickup range 704 in a plan view when the subject 702 is 0.5 m away from the imaging device 100, or when the subject 703 is 3 m away from the imaging device 100. The field of view range 701 shown by the dotted line indicates the range of the shooting field of view when the focal length of the lens 102 is 70 mm. The sound pickup range 704 indicates the sound pickup range by the directional microphone 200 mounted on the imaging device 100.

[0036] Figures 8(A) and 8(B) show examples of the sound pickup range at a second focal length. The second focal length is set to 70 mm. The display screen 801 in Figures 8(A) and 8(B) shows the area corresponding to the field of view range 701 shown in Figures 7(A) and 7(B), and is displayed on the display unit 114 of the imaging device 100. The display screen 801 in Figures 8(A) and 8(B) displays the captured image for the field of view range 701 corresponding to the distance between each subject and the microphone. The display screen 801 displays the captured image in a manner that allows identification of the sound pickup range, which is the range in which sound from the subject can be picked up.

[0037] The display screen 801 in Figure 8(A) shows the field of view 701 when the focal length of the lens 102 is 70 mm and the distance from the imaging device 100 (microphone) to the subject 703 is 3 m. The sound-collectible range 802 shows the range within the field of view 701 where sound can be collected, and is indicated by a dotted rectangle along the periphery of the display screen 801. The actual sound-collectible range 704 under the conditions that the focal length of the lens 102 is 70 mm and the distance from the imaging device 100 (microphone) to the subject 703 is 3 m is wider than the field of view 701. Therefore, the field of view 701 shown on the display screen 801 is the range in which sound can be collected by the directional microphone 200.

[0038] The display screen 801 in Figure 8(B) shows the field of view 701 when the focal length of the lens 102 is 70 mm and the distance from the imaging device 100 (microphone) to the subject 702 is 0.5 m. The sound pickup range 803 is the range in which sound can be picked up when the focal length of the lens 102 is 70 mm and the distance from the microphone to the subject 702 is 0.5 m, and is shown as a dotted circle near the center of the display screen 801, approximately the size of the center of the subject's face.

[0039] The sound pickup range changes depending on the shooting angle of view, the focal length of the lens 102, and the distance from the imaging device to the subject. The imaging device 100 is controlled by the shooting angle of view, the focal length of the lens 102, and the imaging Based on the distance from the device to the subject, the captured image is displayed on the display unit 114 in a manner that allows the actual sound pickup range to be identified. Therefore, the user, who is the photographer, can take pictures while confirming the appropriately presented sound pickup range.

[0040] Figures 9(A) and 9(B) illustrate the sound pickup range when the subject moves. When the subject moves while the sound pickup range is displayed, the sound pickup range changes according to the distance between the moved subject and the imaging device 100. The imaging device 100 has a directional microphone 200 mounted on its top surface, as shown in Figure 2.

[0041] Figure 9(A) illustrates the sound pickup range 904 in a side view when a subject 902, which is 1.5m away from the imaging device 100, moves 0.5m in the direction of the imaging device 100. Subject 903 is the subject 902 after the movement. The field of view range 901, shown by the dotted line, indicates the range of the shooting field of view when the focal length of the lens 102 is 24mm. The sound pickup range 904 indicates the sound pickup range by the directional microphone 200 mounted on the imaging device 100.

[0042] Figure 9(B) illustrates the sound pickup range 904 in a plan view when a subject 902, located 1.5m away from the imaging device 100, moves 0.5m in the direction of the imaging device 100. The dotted line indicating the field of view range 901 shows the range of the shooting field of view when the focal length of the lens 102 is 24mm. The sound pickup range 904 shows the sound pickup range by the directional microphone 200 mounted on the imaging device 100.

[0043] Figures 10(A) and 10(B) show examples of how the sound pickup range is displayed when the subject moves. The display screen 1001 in Figure 10(A) shows the field of view 901 when the focal length of the lens 102 is 24 mm and the distance from the imaging device 100 (microphone) to the subject 902 is 1.5 m. The sound pickup range 1002 shows the range within the field of view 901 where sound can be picked up, and is shown as a dotted circle that includes the subject 902 from head to knees.

[0044] The display screen 1001 in Figure 10(B) shows the field of view 901 when the focal length of the lens 102 is 24 mm and the distance from the imaging device 100 (microphone) to the subject 903 is 1.0 m. The sound pickup range 1003 shows the range in which sound can be picked up when the subject 902 moves 0.5 m in the direction of the imaging device 100 to the position of the subject 903.

[0045] The sound pickup range 1003 indicates the range in which sound can be picked up when the distance from the microphone to the subject 903 is 1.0m, and is shown as a dotted circle near the center of the display screen 1001 that is large enough to fit the upper body of the subject.

[0046] Furthermore, in order to inform the user early on that the sound-collectible range is gradually decreasing while the subject 902 is moving, the control unit 101 may display a sound-collectible range 1004 that is smaller than the actual sound-collectible range 1003 on the display screen 1001. When the subject 902 stops at the position of subject 903, the control unit 101 returns the sound-collectible range 1004 to the sound-collectible range 1003 and presents it to the user.

[0047] The distance between the imaging device 100 and the subject, which is considered when determining the sound pickup range, is the distance along the optical axis of the imaging unit (lens 102). The imaging device 100 determines the sound pickup range to present based on the distance along the optical axis between the imaging device 100 and the subject, even when the subject is moving obliquely with respect to the optical axis.

[0048] Furthermore, the control unit 101 may notify the system of changes in the sound pickup range earlier, not only when the subject is approaching the imaging device 100, but also when the subject is moving away from the imaging device 100. The displayed range is larger than the actual sound-collectible range. In this way, when the subject is moving along the optical axis of the imaging unit (lens 102), the control unit 101 predicts the sound-collectible range after a predetermined time and controls the display of the captured image in a manner that allows the predicted sound-collectible range to be identified.

[0049] As shown in Figure 10(B), the intention of displaying the sound-collectible range 1004 smaller than the actual sound-collectible range 1003 is to allow the user, who is taking the picture, to recognize changes in the sound-collectible range earlier. Even when the subject is moving, the size of the sound-collectible range changes according to the distance the subject is moving, but when the subject is moving closer to the imaging device 100, the appropriate sound-collectible range becomes narrower, and the subject is more likely to move out of the sound-collectible range. Therefore, in order to allow the user to recognize changes in the sound-collectible range earlier, the imaging device 100 displays the sound-collectible range smaller than the actual sound-collectible range. By controlling the display of the sound-collectible range in this way, the user can notice early on even if the subject is moving out of the sound-collectible range, and take countermeasures such as changing the angle of view.

[0050] In Figures 10(A) and 10(B), the imaging device 100 displays the sound pickup range, which changes according to the movement of the subject. Therefore, the user can take pictures while confirming the appropriate sound pickup range.

[0051] Figure 11 is a flowchart illustrating the process of indicating the sound-collectible range. The sound-collectible range indication process is a display control process that displays the captured image in a manner that allows the sound-collectible range, which is the range in which sound from the subject can be collected, to be identified. In step S1101, the control unit 101 detects an operation from the user to the power switch of the operation unit 112 and turns on the power of the imaging device 100.

[0052] In step S1102, the control unit 101 determines whether the imaging device 100 is set to video recording mode. If the imaging device 100 is set to video recording mode, the process proceeds to step S1103. If the imaging device 100 is not set to video recording mode, the control unit 101 returns to step S1102 and repeats the process of determining whether it is in video recording mode until it is set to video recording mode. The states in which it is determined to be in video recording mode include the state during video recording, the state while waiting to record video (live view state), and other states related to video recording.

[0053] In step S1103, the control unit 101 acquires sound pickup range information of the directional microphone 200. The sound pickup range information of the directional microphone 200 is stored in advance in the storage unit 113 or the like. The sound pickup range information is information about the sound pickup range of the microphone, which changes to widen according to the distance from the directional microphone 200 mounted on the imaging device 100, for example, as shown in the sound pickup range 304 in Figure 3(A). The sound pickup range can be a range of distance (distance from the directional microphone 200) and angle (angle with respect to the axis of the directional microphone 200) in which sound of a predetermined frequency can be recorded at a predetermined recording level or higher. In step S1104, the control unit 101 acquires information about the focal length of the lens 102 mounted on the imaging device 100.

[0054] In step S1105, the subject detection unit 107 determines whether or not a subject (for example, a person) has been detected within the shooting angle range from the captured image taken by the imaging unit 104. If a subject is detected, the process proceeds to step S1106. If no subject is detected, the process proceeds to step S1111.

[0055] In step S1106, the distance measuring unit 108 detects the subject detected by the subject detection unit 107 from the imaging device 100 based on the focus information acquired by the lens actuator drive unit 103. Get the distance to the subject.

[0056] In step S1107, the control unit 101 acquires information on the sound pickup range based on the sound pickup range information of the directional microphone 200, the focal length of the lens 102, and the distance from the imaging device 100 to the subject. The sound pickup range is the range in the captured image from which sound from the subject can be picked up.

[0057] In step S1108, the display unit 114 displays the sound-collectible range acquired in step S1107. The display unit 114 should display the captured image (live view image) in a manner that allows the sound-collectible range to be identified.

[0058] The sound pickup range is presented on the display screen 601 by being enclosed by a dotted line, for example, as shown in the sound pickup range 602 in Figure 6(A) and the sound pickup range 603 in Figure 6(B). The sound pickup ranges 602 and 603 indicate the range where the sound pickup range 504 in Figures 5(A) and 5(B) is represented on the plane of the display screen 601. Similarly, the sound pickup range is presented on the display screen 801 by being enclosed by a dotted line, for example, as shown in the sound pickup range 802 in Figure 8(A) and the sound pickup range 803 in Figure 8(B). The sound pickup ranges 802 and 803 indicate the range where the sound pickup range 704 in Figures 7(A) and 7(B) is represented on the plane of the display screen 801. Note that the sound pickup range is not limited to being enclosed by a dotted line; it may also be enclosed by a solid line, blink, or presented in various other ways.

[0059] In step S1109, the control unit 101 determines whether the subject detected in step S1105 is within the sound pickup range presented in step S1108. If the subject is within the sound pickup range, the process proceeds to step S1112. If the subject is not within the sound pickup range, the process proceeds to step S1110.

[0060] If no subject is detected in step S1109, in step S1110, the control unit 101 notifies the photographer or the subject if there is no subject within the sound pickup range. The control unit 101 can notify the photographer and the subject, for example, by sound and LED display. The notification by sound and LED display may be performed by the imaging device 100 or by an external device that can communicate with the imaging device 100. By recognizing that there is no subject within the sound pickup range, the photographer can adjust the shooting angle so that the subject is included in the sound pickup range. Also, by recognizing that they have moved out of the sound pickup range, the subject can move into the sound pickup range.

[0061] If no subject is detected within the field of view in step S1105, the control unit 101 does not present the sound pickup range in step S1111 and proceeds to step S1112. This is because if no subject is detected, an appropriate sound pickup range corresponding to the distance between the imaging device 100 and the subject cannot be obtained. However, even if no subject is detected, if it is predicted that a subject will enter the field of view, the control unit 101 may obtain and present the sound pickup range based on the distance between the predicted position of the subject and the imaging device 100.

[0062] In step S1112, the control unit 101 determines whether the video recording mode has ended. If the video recording mode has ended, the control unit 101 terminates the process of presenting the sound pickup range shown in Figure 11. If the video recording mode has not ended, the process returns to the sound pickup range information acquisition process in step S1103. The control unit 101 repeats the processes from step S1103 to step S1111 until the video recording mode ends.

[0063] In step S1105, the subject to be detected can be a person pre-registered in the memory unit 113. The subject detection unit 107 may detect a person by comparing the image captured by the imaging unit 104 with the face image of a person registered in the memory unit 113. The subject detection unit 107 is not limited to detecting people; it may also detect animals or other objects.

[0064] Furthermore, as explained in Figures 10(A) and 10(B), when the subject is moving along the optical axis of the imaging unit (lens 102), the control unit 101 predicts the sound-collectible range after a predetermined time and controls the system to display the predicted sound-collectible range, although this control is not required. Whether or not to control the system to display the sound-collectible range after a predetermined time while the subject is moving may be set by the user. For example, the user can switch the control to display the sound-collectible range after a predetermined time on or off in the menu screen displayed on the display unit 114. When the control to display the sound-collectible range after a predetermined time is set to on, the control unit 101 predicts the position of the subject after a predetermined time based on the positional relationship between the subject in the previous frame and the subject in the current frame during the processing from step S1103 to step S1108. The control unit 101 can then predict the sound-collectible range after a predetermined time using the distance between the predicted position of the subject and the imaging device 100.

[0065] Furthermore, the ease with which sound spreads differs between indoors and outdoors, for example. Therefore, the control unit 101 may control the size of the sound-collectible range presented in the captured image to differ depending on the sound collection conditions, such as whether the captured image is being taken indoors or outdoors.

[0066] In indoor environments, the sound pickup range of the directional microphone 200 tends to be wider than in outdoor environments due to reflections from surrounding walls and other factors. Therefore, if the distance from the imaging device 100 to the subject and the focal length of the lens 102 are the same indoors and outdoors, the control unit 101 controls the system so that the size of the sound pickup range in the image captured indoors is larger than that outdoors.

[0067] The control unit 101 can, for example, determine in step S1107 whether the surrounding environment is indoors or outdoors based on the captured image. Specifically, the control unit 101 can determine that the captured image was taken indoors if there is a wall around the subject in the captured image. Alternatively, the control unit 101 may determine that the captured image was taken indoors if the distance between the subject and the background in the captured image is shorter than a predetermined threshold, and determine that the captured image was taken outdoors if the distance between the subject and the background in the captured image is greater than or equal to a predetermined threshold.

[0068] Furthermore, the control unit 101 may control the size of the sound-collectible range in the captured image differently depending on whether the ambient environment is indoors or outdoors, for example, whether the volume of ambient sounds other than the subject is greater than or less than a threshold. In this way, the control unit 101 can control the size of the sound-collectible range presented in the captured image differently depending on the sound-collecting conditions in the environment in which the captured image is being taken.

[0069] According to the above embodiment, the imaging device 100 displays the captured image in a manner that allows the sound-collectible range to be identified in the captured image, based on the distance from the imaging device 100 to the subject, the focal length of the lens 102, and the sound-collecting range of the directional microphone 200. This allows the user to determine the shooting angle appropriately while more accurately understanding the range in which sound from the subject can be collected.

[0070] Note that the various controls mentioned above are performed by a single piece of hardware (e.g., a processor or circuit). This is acceptable, or it is not. Multiple pieces of hardware (for example, multiple processors, multiple circuits, or a combination of one or more processors and one or more circuits) may share the processing to control the entire device.

[0071] Furthermore, the above-mentioned processors are processors in a broad sense, including general-purpose processors and specialized processors. General-purpose processors include, for example, CPUs (Central Processing Units), MPUs (Micro Processing Units), and DSPs (Digital Signal Processors). Specialized processors include, for example, GPUs (Graphics Processing Units), ASICs (Application Specific Integrated Circuits), and PLDs (Programmable Logic Devices). Programmable logic devices include, for example, FPGAs (Field Programmable Gate Arrays) and CPLDs (Complex Programmable Logic Devices).

[0072] Furthermore, the embodiments described above (including modified examples) are merely examples, and configurations obtained by appropriately modifying or changing the above-described configurations within the scope of the gist of the present invention are also included in the present invention. Configurations obtained by appropriately combining the above-described configurations are also included in the present invention.

[0073] <Other Embodiments> The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit that implements one or more functions.

[0074] This embodiment includes the following configurations, methods, and programs. (Composition 1) A detection means for detecting a subject from an image captured by an imaging unit, A display control means controls the display of the captured image in a manner that allows the sound-collectible range, which is the range in which sound from the subject can be collected, to be identified, based on the distance from the imaging unit to the subject, the focal length of the imaging unit, and information on the sound collection range by the sound collection unit that collects sound recorded together with the captured image. An electronic device characterized by having the following features. (Configuration 2) The detection means detects a person or an animal as the subject. The electronic device according to configuration 1, characterized by the features described above. (Composition 3) The display control means, when the subject is moving in the optical axis direction of the imaging unit, predicts the sound-collectible range after a predetermined time and controls the display of the captured image in a manner that allows the predicted sound-collectible range to be identified. The electronic device according to configuration 1 or 2, characterized by the above. (Composition 4) Whether or not to control the display of the captured image in a manner that allows identification of the predicted sound-collectible range is set by the user. The electronic device according to configuration 3, characterized by the features described above. (Composition 5) The display control means controls the size of the sound-collectible range in the captured image to differ depending on whether the captured image is captured in a first environment or in a second environment where the sound collection conditions are different from those of the first environment. An electronic device according to any one of configurations 1 to 4, characterized by the above. (Composition 6) The display control means controls the size of the sound-collectible range in the image captured indoors to be larger than the sound-collectible range in the image captured outdoors, provided that the distance from the imaging unit to the subject and the focal length of the imaging unit are the same indoors and outdoors, when the first environment is indoors and the second environment is outdoors. The electronic device according to configuration 5, characterized by the features described herein. (Composition 7) The display control means determines that the captured image was taken indoors if there is a wall around the subject in the captured image. The electronic device according to configuration 6, characterized by the features described therein. (Composition 8) The display control means is If the distance between the subject and the background in the captured image is shorter than a predetermined threshold, it is determined that the captured image was taken indoors. If the distance between the subject and the background in the captured image is greater than or equal to a predetermined threshold, it is determined that the captured image was taken outdoors. The electronic device according to configuration 6, characterized by the features described therein. (Composition 9) The sound-collecting unit has directionality. An electronic device according to any one of configurations 1 to 8, characterized by the above. (method) A step of detecting a subject from an image captured by the imaging unit, A step of controlling the display of the captured image in a manner that allows identification of the sound-collectible range, which is the range in which sound from the subject can be collected, based on the distance from the imaging unit to the subject, the focal length of the imaging unit, and information on the sound collection range by the sound collection unit that collects sound recorded together with the captured image. A method for controlling electronic equipment, characterized by having the following features. (program) A program for causing a computer to function as one of the electronic devices described in configurations 1 to 9. [Explanation of Symbols]

[0075] 100: Imaging device (electronic equipment), 101: Control unit, 104: Imaging unit, 107: Subject detection unit, 108: Distance measuring unit, 109: Sound collection unit, 114: Display unit

Claims

1. A detection means for detecting a subject from an image captured by an imaging unit, A display control means controls the display of the captured image in a manner that allows the sound-collectible range, which is the range in which sound from the subject can be collected, to be identified, based on the distance from the imaging unit to the subject, the focal length of the imaging unit, and information on the sound collection range by the sound collection unit that collects sound recorded together with the captured image. An electronic device characterized by having the following features.

2. The detection means detects a person or an animal as the subject. The electronic device according to feature 1.

3. The display control means, when the subject is moving in the optical axis direction of the imaging unit, predicts the sound-collectible range after a predetermined time and controls the display of the captured image in a manner that allows the predicted sound-collectible range to be identified. The electronic device according to feature 1.

4. Whether or not to control the display of the captured image in a manner that allows identification of the predicted sound-collectible range is set by the user. The electronic device according to feature 3.

5. The display control means controls the size of the sound-collectible range in the captured image to differ depending on whether the captured image is captured in a first environment or in a second environment where the sound collection conditions are different from those of the first environment. The electronic device according to feature 1.

6. The display control means controls the display control means such that, when the first environment is indoors and the second environment is outdoors, the size of the sound-collectible range in the image captured indoors is larger than the size of the sound-collectible range in the image captured outdoors, provided that the distance from the imaging unit to the subject and the focal length of the imaging unit are the same indoors and outdoors. The electronic device according to feature 5.

7. The display control means determines that the captured image was taken indoors if there is a wall around the subject in the captured image. The electronic device according to feature 6.

8. The display control means is If the distance between the subject and the background in the captured image is shorter than a predetermined threshold, it is determined that the captured image was taken indoors. If the distance between the subject and the background in the captured image is greater than or equal to a predetermined threshold, it is determined that the captured image was taken outdoors. The electronic device according to feature 6.

9. The sound-collecting unit has directionality. The electronic device according to feature 1.

10. A step of detecting a subject from an image captured by the imaging unit, Based on the distance from the imaging unit to the subject, the focal length of the imaging unit, and the sound pickup range information of the sound pickup unit that picks up sound recorded together with the captured image, the captured image The steps include controlling the display of the captured image in a manner that allows identification of the sound pickup range, which is the range in which sound from the subject can be picked up, and A method for controlling electronic equipment, characterized by having the following features.

11. A program for causing a computer to function as one of the means of an electronic device according to any one of claims 1 to 9.

Images