Imaging apparatus, method for controlling imaging apparatus, and program

Abstract

To provide an imaging apparatus, a method for controlling the imaging apparatus, and a program, capable of allowing a performer to create a moving image focused on an intended target, without operating the imaging apparatus.SOLUTION: The method for controlling an imaging apparatus including imaging means for acquiring an image includes a recognition process for recognizing a person from the image obtained by the imaging means, an approach detection process for detecting the approach of an object to the imaging apparatus, a focus adjustment process for adjusting the focus state of a subject on the basis of the image, a storage process for storing the image, and a creation process for creating the moving image on the basis of the image obtained by the imaging means. In the focus adjustment process, the target whose focus state is adjusted is switched in response to that the approach of the object to the imaging apparatus is detected by the approach detection process.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an imaging device for capturing moving images, a control method for an imaging device, and a program. [Background technology]

[0002] In recent years, videos shot by individuals are becoming more common on video distribution sites. For example, when a product is introduced in a video distributed by an individual, the person appearing on screen to introduce the product and the person filming the video are often the same person. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] WO2010 / 150348 Summary of the Invention [Problem to be solved by the invention]

[0004] In such cases, it is difficult for the performers to operate the imaging device during filming, making it difficult to focus on the intended subject.

[0005] Therefore, an object of the present invention is to provide an imaging device, an imaging device control method, and a program that enable a performer to create a video that focuses on an intended subject without operating the imaging device. [Means for solving the problem]

[0006] A technical feature of the present invention is a control method for an imaging device having an imaging means for acquiring images, comprising a recognition process for recognizing a person from an image acquired by the imaging means, an approach detection process for detecting the approach of an object to the imaging device, a focus adjustment process for adjusting the focus state of the subject based on the image, a storage process for storing the image, and a creation process for creating a video based on the image acquired by the imaging means, wherein the focus adjustment process switches the object for which the focus state is adjusted in response to the approach detection process detecting that the object has approached the imaging device. Effect of the Invention

[0007] According to the present invention, it is possible to provide an imaging device, an imaging device control method, and a program that enable a performer to create a moving image focused on an intended target without operating the imaging device. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram showing an example of a configuration diagram of an imaging device according to a first embodiment. [Diagram 2] FIG. 2 is a diagram illustrating a configuration of an imaging unit in the first embodiment. [Diagram 3] FIG. 13 is a diagram showing a control flow when a target object approaches in the first embodiment. [Figure 4] FIG. 13 is a diagram showing a control flow when the target object moves away in the first embodiment. [Diagram 5] 13 is a diagram showing a configuration of an imaging unit including a plurality of imaging elements in a second embodiment. FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

[0010] Imaging device configuration FIG. 1 shows a configuration diagram of an image pickup apparatus 100 as an example of an image pickup apparatus to which the present invention can be applied.

[0011] The imaging device 100 is composed of an imaging unit 101, a control unit 102, a storage unit 103, a communication unit 104, a focus adjustment unit 105, a display unit 106, an input unit 107, and an output unit 108. The imaging device 100 can also be connected to an external monitor 110 and an external network 120, and is configured to be able to transmit or receive image information and necessary information other than images.

[0012] 2, an optical imaging system 201, a mechanical shutter 202, and an image sensor 203. The optical imaging system 201, the mechanical shutter 202, and the image sensor 203 convert an optical image of a subject into digital data, which is then transmitted to the control unit 102 as a captured image.

[0013] The control unit 102 is composed of a CPU, a program memory, etc., and controls the imaging device 100 in this embodiment by executing a predetermined program. The control unit 102 also processes the captured images received from the imaging unit 101 to perform subject detection processing and video creation processing for combining images.

[0014] The storage unit 103 is a rewritable volatile memory that stores image information such as still images and moving images, as well as necessary information other than images. The stored image information also includes specific image information. The specific image information will be described later with reference to FIG.

[0015] The communication unit 104 includes an interface circuit for communicably connecting the imaging device 100 to an external device via a network such as the Internet. The communication unit 104 can transmit and receive data to and from an external device connected to an external network 120 in a wired or wireless manner.

[0016] The focus adjustment unit 105 is composed of a drive control circuit for driving the lens, etc., and a focus detection circuit for detecting information related to the subject distance. The focus adjustment unit 105 transmits information related to the subject distance detected by the focus detection circuit to the control unit 102, operates the drive control circuit according to an instruction signal from the control unit 102, and controls the imaging optical system 201 of the imaging unit 101 to adjust the focus state and the depth of field.

[0017] The display unit 106 is configured with a display device such as a liquid crystal panel or an organic EL display, and displays the image from the imaging unit 101 .

[0018] The input unit 107 is a switch, a button, a touch panel, a microphone, etc., and is used to receive user operations. The microphone of the input unit 107 also allows audio input of moving images.

[0019] The output unit 108 is a speaker, an LED, etc., and is used to notify the user of information by sound or light. The output unit 108 also outputs audio data of the video to an external monitor 110.

[0020] The external monitor 110 is a monitor such as a liquid crystal monitor that is located outside the image capturing apparatus 100. It receives images and the like from the image capturing apparatus 100 and displays them.

[0021] The external network 120 is composed of network devices such as a network cable, a modem, a router, and a server. The imaging device 100 is capable of distributing moving images to viewers via the external network 120. The moving images to be transmitted to the external network 120 may be transmitted directly from the control unit 102 via the communication unit 104, or may be once stored in the storage unit 103 and then transmitted to the external network 120 via the communication unit 104. Once a moving image has been stored in the storage unit 103, the distributor may also edit the moving image. When the moving image is transmitted directly from the control unit 102 to the external network 120 via the communication unit 104, it is used for real-time live distribution, etc.

[0022] Example 1 Configuration of the imaging unit 101 in the first embodiment The first embodiment of the present invention will be described in detail below.

[0023] FIG. 2 is a diagram showing the configuration of the image capturing unit 101 according to the first embodiment.

[0024] As described above, the imaging unit 101 is composed of the imaging optical system 201, the mechanical shutter 202, and the imaging element 203.

[0025] The imaging optical system 201 is composed of an aperture, an image stabilization lens, a focus lens, a zoom lens, etc., and guides an optical image of a subject to an image sensor 203 through a mechanical shutter 202. The mechanical shutter 202 adjusts the exposure time for exposing the image sensor 203. The image sensor 203 photoelectrically converts the optical image formed by the lens to create an image signal. Note that if the image sensor 203 has an electronic shutter function that can adjust the exposure time by controlling the signal accumulation time and signal readout time, the mechanical shutter 202 is not necessary.

[0026] Control flow of the imaging device 100 in the first embodiment Next, a control flow of the image capturing apparatus 100 in the first embodiment will be described.

[0027] FIG. 3 is a diagram showing a control flow of the imaging device 100 when an object, which is a subject other than a person, approaches.

[0028] In S301, the control unit 102 recognizes a person by performing image processing on the captured image received from the imaging unit 101. For person recognition, shape information and color information of the person's face, pupils, head, and torso are stored in advance, and the person is recognized from the captured image based on the stored information. A known image recognition method is used for this person detection. Here, the control unit 102 preferably narrows the aperture of the imaging unit 101 to the narrowest and widens the depth of field range, but if the person cannot be detected, the aperture may be narrowed to make it detectable. In S302, the control unit 102 determines whether or not a person has been detected in S301. If a person has been detected, the process proceeds to S303, where the control unit 102 controls the focus adjustment unit 105 to adjust the focus on the detected person, thereby focusing on the person. Here, the control unit 102 adjusts the imaging optical system 201, such as the lens and aperture, via the focus adjustment unit 105 so that the target person is clear.

[0029] In S304, the control unit 102 determines whether or not the approach of a subject (object) has been detected based on the focus detection result by the focus detection circuit of the focus adjustment unit 105. In this case, if it is determined that the subject is approaching based on the focus detection result, the subject is detected as approaching. Alternatively, the subject may be detected as approaching if the subject distance is equal to or greater than a predetermined distance for a predetermined period of time. The control unit 102 repeats the detection operation at a predetermined interval until it detects the approach of the object, and proceeds to S305 when it detects that the object has approached. Here, the control unit 102 may determine the detection of the approach of the object from the ratio of the object area to the angle of view by image processing of the captured image.

[0030] In S305, since the control unit 102 has detected the approach of the object in S304, the control unit 102 controls the focus adjustment unit 105 to adjust the focus to the approaching object, thereby focusing on the object.

[0031] In S306, the control unit 102 determines whether or not there is a registered image in the storage unit 103. If the control unit 102 determines that there is a registered image, the process proceeds to S307, and if the control unit 102 determines that there is no registered image, the process proceeds to S309. The registered image is an image that a performer (distributor) captures an image of an object in focus in advance and registers in the storage unit 103. The registered image may be a still image or a video. The registered image is an image related to the object, and may be, for example, an enlarged image for checking a part of the object in detail, or an image capturing the entire image of the object. When creating a video using the registered image, the video is created using audio input by the input unit 107.

[0032] In S307, the control unit 102 determines whether the object has approached by a predetermined amount or more. The control unit 102 repeats the detection operation at a predetermined interval until it detects that the object has approached by the predetermined amount or more, and when it detects that the object has approached by the predetermined amount or more, the process proceeds to S308.

[0033] In S308, the control unit 102 executes a process for creating a video for inserting the images registered in the storage unit 103 into the captured image received from the imaging unit 101, and ends the control flow when the target object approaches. When creating a video using the registered images, the registered images may be displayed full screen, or may be superimposed on the captured image to create a video.

[0034] In S309, since the control unit 102 determined in S306 that there is no registered image, it determines whether the object has come closer and reached the shortest focus position that can be adjusted by the focus adjustment unit 105. The control unit 102 repeats this detection process at predetermined intervals until the object reaches the shortest focus position, and if it determines that the object is at the shortest focus position, the process proceeds to S310. Here, although it was determined in the above that the object has reached the shortest focus position, it may instead be determined whether the object is close to the shortest focus position.

[0035] In step S310, the control unit 102 outputs information to notify the user that the focal position is at the shortest position by using the LED of the output unit 108 or the display device of the display unit 106, and ends the control flow when the target object approaches. At this time, the control unit 102 functions as a display control means.

[0036] In this way, the control flow of the imaging device 100 of this embodiment makes it possible for a performer to bring an object other than a person, which is a subject, close to the camera, etc., to obtain an image in focus as intended without the performer operating the camera, and to create a video. Here, the object may be a product held by the person, or may be something worn by the person.

[0037] 4 is a diagram showing a control flow of the imaging device 100 when an object that is a subject other than a person moves away. This control flow when the object moves away is executed after the control flow when the object approaches, which is described in FIG.

[0038] In S401, the control unit 102 determines whether or not the object has moved away using the focus detection circuit of the focus adjustment unit 105. Here, determining that the object has moved away means, for example, that the control unit 102 determines that the object has returned to the position where the focus adjustment target was switched to the object. The control unit 102 performs detection processing at a predetermined interval until it detects that the object is moving away, and proceeds to S402 when it determines that the object has moved away.

[0039] In S402, control unit 102 changes the target for focus adjustment by focus adjustment unit 105 to a person. If no person is detected, the focus is adjusted to a predetermined position such as the center of the screen.

[0040] In S403, the control unit 102 determines whether or not there is a registered image in the storage unit 103, and if it is determined that there is a registered image, the process proceeds to S404. If the control unit 102 determines that there is no registered image, the control unit 102 ends this control flow since the video is created using only captured images.

[0041] In S404, the control unit 102 creates a moving image using the captured images received from the imaging unit 101 without using the registered images stored in the storage unit 103, and ends this control flow.

[0042] In this way, the control flow of the imaging device 100 of this embodiment makes it possible for a human performer to move objects other than the human subject away from the camera, thereby creating a video that is focused on the human subject as intended, without the performer having to operate the camera.

[0043] Example 2 The second embodiment of the present invention will be described in detail below.

[0044] Configuration of the imaging unit 101 in the second embodiment Fig. 5 is a diagram showing the configuration of the image capturing unit 101 of the embodiment 2. The main difference from Fig. 2 of the embodiment 1 is that this is a configuration diagram in which there are two imaging optical systems, two mechanical shutters, and two image capturing elements.

[0045] The imaging unit 101 of the second embodiment is composed of an imaging optical system 501a, a mechanical shutter 502a, an imaging element 503a, an imaging optical system 501b, a mechanical shutter 502b, an imaging element 503b, and a selector 504. Here, the portion composed of the imaging optical system 501a, the mechanical shutter 502a, and the imaging element 503a is referred to as imaging unit a, and the portion composed of the imaging optical system 501b, the mechanical shutter 502b, and the imaging element 503b is referred to as imaging unit b.

[0046] The selector 504 selects one of the captured images from the imaging unit a and the imaging unit b, and outputs it to the control unit 102 as the captured image from the imaging unit 101.

[0047] Here, the imaging unit a is for example used for wide-angle photography, and the imaging unit b is for macro photography.

[0048] The control unit 102 controls the selector 504 to switch between macro photography and wide-angle photography.

[0049] Control flow of the imaging device 100 in the second embodiment Next, a control flow of the image capturing apparatus 100 in the second embodiment will be described.

[0050] When the control flow of FIG. 3 described in the first embodiment is started, the control unit 102 controls the selector 504 so that the image captured by the imaging unit a on the wide-angle side is selected in S301, and controls the selector 504 so that the image captured by the imaging unit b on the macro side is selected in S305. In addition, in S402, the control unit 102 controls the selector 504 so that the image captured by the imaging unit a on the wide-angle side is selected. Then, when the control flow of FIG. 4 described in the first embodiment is started, the control unit 102 controls the selector 504 so that the image captured by the imaging unit b on the macro side is selected in S401. Then, when it is determined that the object has left a predetermined position, the control unit 102 controls the selector 504 so that the image captured by the imaging unit a is selected in S402. In addition, the control unit 102 controls the focus adjustment unit 105 so that the focus is adjusted to focus on the detected person. Other operation flows are the same as those in FIG. 3 and FIG. 4, and therefore description thereof will be omitted.

[0051] Even if the imaging unit 101 is thus composed of a plurality of imaging units, by having the performer bring a subject other than a person closer to the camera, it is possible to create a moving image with an enlarged image in focus as intended, without the performer having to operate the camera. Furthermore, when a registered image is superimposed on a captured image, it is possible to create a moving image in which the focus is on the person other than the registered image.

[0052] (Other embodiments) The present invention can be applied not only to integrated lens digital cameras and interchangeable lens digital cameras, but also to mobile phone terminals, tablet PCs, game consoles, and the like.

[0053] The present invention can also be realized by executing the following process. That is, software (programs) that realize the functions of the above-described embodiments are supplied to a system or device via a network or various storage media, and the computer (or CPU, MPU, etc.) of the system or device reads and executes the program codes. In this case, the program and the storage medium storing the program constitute the present invention. [Explanation of symbols]

[0054] 100 Imaging device 101 Imaging unit 102 Control section 103 Storage section 104 Communications Department 105 Focus adjustment section 106 Display section 107 Input section 108 Output section 110 External Monitor 120 External Network

Claims

1. An imaging device having an imaging means for acquiring an image, recognition means for recognizing a person from the image obtained by the imaging means; approach detection means for detecting an approach of an object to the imaging device; a focus adjustment means for adjusting a focus state of a subject based on the image; a storage means for storing an image; a creation means for creating a video based on the images obtained by the imaging means, The creation means generates a video using the image of the object stored in the storage means when the approach detection means detects that an object has approached the imaging device by a predetermined amount or more and when it is determined that the image stored in the storage means is an image of the object.

2. The imaging device described in Claim 1, characterized in that the focus adjustment means switches the object for which the focus state is adjusted in response to the detection by the approach detection means that an object has approached the imaging device.

3. The imaging device according to claim 1, characterized in that, when the approach detection means detects that an object has approached the imaging device by a predetermined amount or more, the creation means creates the video by superimposing an image stored in the memory means on an image obtained by the imaging means.

4. The imaging device according to claim 1, characterized in that when the approach detection means detects that an object has approached the imaging device by a predetermined amount or more, the creation means creates the video by replacing the image obtained by the imaging means with the image stored in the storage means.

5. 2. The imaging device according to claim 1, wherein the recognition means recognizes a person's face.

6. 2. The imaging device according to claim 1, wherein said recognition means recognizes the eyes of a person.

7. 2. The imaging device according to claim 1, wherein said recognition means recognizes a person's head.

8. 2. The imaging device according to claim 1, wherein said recognition means recognizes a torso of a person.

9. Further comprising a communication means for communicating with an external device of the imaging device, The video created by the creating means is transmitted to the outside by the communication means. The imaging device according to claim 1 .

10. 2. The imaging device according to claim 1, further comprising a display control means for controlling the video created by said creating means to be displayed on a display means.

11. 2. The imaging device according to claim 1, wherein the storage means stores the moving image created by the creating means.

12. 2. The imaging apparatus according to claim 1, further comprising a notification unit that notifies a user that the subject distance is at or near the minimum focus position when the subject distance is at or near the minimum focus position.

13. 2. The imaging device according to claim 1, wherein the focus adjustment means switches the object for which the focus state is to be adjusted in response to a predetermined distance or more of the object being moved away from the imaging device.

14. The imaging device according to claim 1 , wherein the predetermined amount is a minimum focal position.

15. 2. The imaging device according to claim 1, wherein the approach detection means detects the approach based on the ratio of the area of ​​the object to the angle of view in the image obtained by the imaging means.

16. 2. The imaging device according to claim 1, wherein said approach detecting means detects that an object has approached when the object distance is equal to or less than a predetermined distance for a predetermined period of time.

17. 2. The image pickup apparatus according to claim 1, wherein said approach detecting means detects that the subject has approached when it is determined that the subject is approaching based on a focus detection result.

18. A control method for an imaging device having an imaging means for acquiring an image and a storage means for storing the image, comprising: a recognition step of recognizing a person from the image obtained by the imaging means; an approach detection step of detecting an approach of an object to the imaging device; a focus adjustment step of adjusting a focus state of a subject based on the image; a creation step of creating a video based on the images obtained by the imaging means, A control method characterized in that in the creation process, when an approach of an object of a predetermined amount or more to the imaging device is detected and the image stored in the storage means is determined to be an image of the object, a video is generated using the image of the object stored in the storage means.

19. A program for causing a computer to function as each of the means of the imaging device according to claim 1.

20. A computer-readable storage medium storing a program for causing a computer to function as each of the means of the imaging device according to claim 1.

Images