Imaging apparatus and imaging method

Abstract

To perform imaging reflecting the intention of a user by controlling AF and consecutive photographing in automatic imaging using a virtual figure.SOLUTION: An imaging apparatus 1 includes acquisition means 109 for acquiring information on a three-dimensional space as an imaging target and control means 101 and 107 for performing control relating to imaging. The control means arranges a virtual figure VO in the three-dimensional space, specifies a search area for searching the three-dimensional space for the subject on the basis of the virtual figure, and performs at least one of focus control and consecutive photographing control for the subject existing in the search area.SELECTED DRAWING: Figure 5

Description

[Technical field]

[0001] The present invention relates to an image capture device that performs automatic image capture control. [Background technology]

[0002] Automatic imaging devices that automatically frame and capture images of a subject without user operation are used for purposes such as security cameras, capturing images of wild animals, etc. And, like imaging devices for normal use, it is desirable for such automatic imaging devices to have a function that allows them to capture images that reflect the user's intentions.

[0003] In technical fields such as Augmented Reality (AR) and Mixed Reality (MR), a composite image is generated by superimposing a virtual object on an image obtained by capturing an image of a real space. Patent Document 1 discloses an imaging device that places a virtual object as a three-dimensional figure in a three-dimensional space and captures an image when a subject enters or exits the virtual object. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2014-155173 A Summary of the Invention [Problem to be solved by the invention]

[0005] One of the problems with capturing images through user operation is that the autofocus (AF) may not be able to keep up with the timing required to capture an image, making it difficult to obtain a captured image that is in focus. Another problem is that when a moving subject is captured continuously from start to finish at a uniform interval (continuous shooting speed), a large number of captured images are obtained, which requires the time and effort of selecting the desired captured images from among them.

[0006] The imaging device disclosed in Patent Document 1 does not allow settings such as AF for a subject entering and exiting a virtual object or continuous shooting speed for a moving subject. This makes it difficult to ensure that AF is completed in time for imaging, or to appropriately control the continuous shooting speed and the number of captured images from the start to the end of continuous shooting, thereby performing imaging that reflects the user's intentions.

[0007] The present invention provides an imaging device that is capable of capturing images that reflect a user's intentions by controlling AF and continuous shooting in automatic imaging using a virtual object. [Means for solving the problem]

[0008] An imaging device according to one aspect of the present invention includes an acquisition unit that acquires information about a three-dimensional space to be imaged, and a control unit that controls imaging. The control unit arranges a virtual figure in the three-dimensional space, specifies a search area in which a subject is searched for in the three-dimensional space based on the virtual figure, and performs at least one of focus control and continuous shooting control on the subject present in the search area.

[0009] An imaging control method according to another aspect of the present invention includes the steps of acquiring information about a three-dimensional space to be imaged, arranging a virtual figure in the three-dimensional space, specifying a search area for searching for a subject in the three-dimensional space based on the virtual figure, and performing at least one of focus control and continuous shooting control on the subject present in the search area. Note that a program for causing a computer to execute a process according to the imaging control method also constitutes another aspect of the present invention. Effect of the Invention

[0010] According to the present invention, by controlling AF and continuous shooting in automatic imaging using a virtual figure (virtual object), imaging that reflects the user's intentions can be performed. [Brief description of the drawings]

[0011] [Figure 1] FIG. 1 is a block diagram showing a configuration of an imaging apparatus according to a first embodiment. [Diagram 2] 4 is a flowchart showing an automatic imaging process in the first embodiment. [Diagram 3] 5A to 5C are diagrams showing a virtual object, an AF area, and a continuous shooting area arranged on a live view image in the first embodiment. [Figure 4] 4A and 4B are diagrams showing a subject entering the imaging angle of view in the first embodiment. [Diagram 5] FIG. 4 is a diagram showing a subject that has entered an AF area in the first embodiment. [Figure 6] 13 is a flowchart showing an automatic imaging process in the embodiment 2. [Figure 7] 13 is a diagram showing the centers of gravity of two virtual objects in the second embodiment. [Figure 8] 13A to 13C are diagrams illustrating different continuous shooting intervals within two virtual objects in the second embodiment. [Figure 9] 5A to 5C are diagrams showing a case where a part of the AF area is not within the imaging angle of view in the first embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[0013] The imaging device of each embodiment recognizes a three-dimensional space to be imaged, and constantly acquires distance information and object shape information within the three-dimensional space during imaging. The imaging device also arranges a virtual object to divide the recognized three-dimensional space into a plurality of regions, and divides the imaged object space within the three-dimensional space into an attention region and a non-attention region. This allows AF and continuous shooting to be performed only on the object present in the attention region. EXAMPLES

[0014] 1 shows a hardware configuration of an imaging device of Example 1. The imaging device 1 has a calculation unit 101, an image processing unit 102, a primary storage unit 103, a secondary storage unit 104, a display unit 105, an optical imaging unit 106, an imaging control unit 107, a command input unit 108, and a three-dimensional space information acquisition unit 109. These components exchange data and control signals via a bus 110.

[0015] The calculation unit 101 is a microcomputer such as a CPU, and performs control of each component and calculation processing of data. The image processing unit 102 performs processing to generate an image from an imaging signal obtained by imaging performed by the optical imaging unit 106, display the image on the display unit 105, and associate distance information obtained by the three-dimensional space information acquisition unit 109 with a live view (LV) image. The image processing unit 102 also performs encoding processing on the generated image.

[0016] The primary storage unit 103 is composed of a storage element such as a DRAM, and temporarily stores data such as images and three-dimensional space information processed by the image processing unit 102. The secondary storage unit 104 is a storage medium such as an SD card or a flash memory, and stores images for recording processed by the image processing unit 102.

[0017] The display unit 105 displays the LV image. The optical imaging unit 106 has an optical system and an imaging sensor, and converts light from a subject (subject image) into an electrical signal to output an imaging signal. The imaging control unit 107 performs focus control (AF) and exposure control (AE) for the optical imaging unit 106, and performs imaging control such as continuous shooting. The calculation unit 101 and the imaging control unit 107 form a control means.

[0018] The command input unit 108 as an operating means has operating members such as buttons, dials, switches, joysticks, and touch panels that the user operates to select modes, set imaging conditions, etc., and outputs commands in response to user operations to the calculation unit 101 and the imaging control unit 107.

[0019] The three-dimensional space information acquisition unit 109 as an acquisition means is configured with a distance sensor, a GPS, etc., and acquires information about the three-dimensional space as the real space, that is, distance information and shape information in the three-dimensional space, and further, position information of the imaging device 1. In the following description, information about the three-dimensional space is referred to as three-dimensional space information. As the distance sensor, an imaging sensor having multiple light receiving parts for each pixel and capable of detecting a phase difference according to distance, an imaging sensor capable of measuring distance by a ToF (Time of Flight) method, etc. may be used. Also, a distance sensor other than an imaging sensor may be used.

[0020] 2 shows an automatic imaging process (imaging control method) executed according to a program by the calculation unit 101. This process starts when the imaging mode is switched to the automatic imaging mode by the user operating the touch panel, buttons, etc. of the command input unit 108.

[0021] In step S201, the calculation unit 101 causes the optical imaging unit 106 to start capturing an LV image, causes the image processing unit 102 to generate an LV image, and causes the display unit 105 to start displaying the LV image.

[0022] Next, in step S202, the calculation unit 101 causes the three-dimensional space information acquisition unit 109 to acquire three-dimensional space information such as distance information from the imaging device 1 to objects (subjects and background objects) within the imaging angle of view and position information indicating the position of the imaging device 1. Then, the calculation unit 101 causes the primary storage unit 103 to temporarily store the acquired three-dimensional space information.

[0023] Next, in step S203, the calculation unit 101 associates the three-dimensional space information acquired in step S202 with each pixel of the LV image, that is, generates three-dimensional space information for each pixel of the LV image.

[0024] Next, in step S204, the calculation unit 101 places a virtual object VO having a size in the vertical, horizontal and depth directions set in advance on the LV image 3 (i.e., within the imaging field of view) as shown in FIG. 3 in response to the user's operation of the touch panel or the like of the command input unit 108. The virtual object VO is a virtual three-dimensional figure, and has a rectangular parallelepiped shape in this embodiment. For example, such a virtual object VO is placed so that the center of gravity of the virtual object VO is located at the touch position of the user's finger on the touch panel. At this time, as shown in FIG. 9, there are cases where the virtual object VO is set in a state where a part or the whole of the virtual object VO does not fit within the LV image 3. The virtual object VO is synthesized with the LV image by the image processing unit 102 and displayed on the display unit 105.

[0025] The image processing unit 102 changes the size of the virtual object VO in response to a pinch operation with two fingers on the touch panel after the virtual object VO is placed, or an operation of moving the fingers touching an edge or vertex of the virtual object VO. Also, the image processing unit 102 changes the position of the virtual object VO in response to an operation of moving the fingers touching the surface of the virtual object VO on the touch panel. Furthermore, the image processing unit 102 changes the size of the virtual object VO in the depth direction in response to the elapsed time during which the surface of the virtual object VO is kept touched. The placement, size, and position of the virtual object may be changed in response to a user operation of a button, dial, switch, joystick, or the like of the command input unit 108.

[0026] The virtual object VO is arranged to specify a search area for searching for a subject and determining its presence. FIG. 3 shows a case where the search area is specified to the entire inside of the virtual object VO. The search area includes a continuous shooting area 301 and an AF area (focus area) 302. The continuous shooting area 301 is an area where the calculation unit 101 causes the imaging control unit 107 to perform continuous shooting control of the optical imaging unit 106 when a subject exists therein. The continuous shooting interval (continuous shooting speed) in the continuous shooting control can be set arbitrarily by the user. The AF area 302 is an area where the calculation unit 101 causes the imaging control unit 107 to perform AF control (focus control) of the optical imaging unit 106 when a subject exists therein. FIG. 3 shows a case where the AF area 302 is set to the entire inside of the virtual object VO, and the continuous shooting area 301 is set to a part of the inside of the AF area 302.

[0027] Note that the search area may be specified not only inside the virtual object VO but also outside it. For example, after first arranging a virtual object corresponding to the continuous shooting area, a predetermined area outside the virtual object may be specified as the AF area. Also, the continuous shooting area and the virtual object specifying the AF area may be arranged separately. Furthermore, in FIG. 3, the continuous shooting area 301 is specified to be smaller than the AF area 302, but the continuous shooting area and the AF area may be specified to be the same size. Also, in FIG. 3, the virtual object VO, the continuous shooting area 301, and the AF area 302 all have a rectangular parallelepiped shape, but they may have other shapes and may be two-dimensional figures such as planes, lines, and points.

[0028] Next, in step S205, the calculation unit 101 calculates the coordinates of the center of gravity of the virtual object placed in step S204.

[0029] Next, in step S206, the calculation unit 101 causes the imaging control unit 107 to perform AF control of the optical imaging unit 106 so as to focus on the center of gravity of the virtual object calculated in step S205.

[0030] Next, in step S207, the calculation unit 101 causes the three-dimensional space information acquisition unit 109 to acquire three-dimensional space information within the imaging angle of view (LV image). Then, it is determined whether or not the subject exists within the imaging angle of view and within the AF area. Here, it is determined that the subject exists within the imaging angle of view and within the AF area if distance information corresponding to coordinates within the AF area exists within the three-dimensional space information within the imaging angle of view acquired by the three-dimensional space information acquisition unit 109.

[0031] FIG. 4 shows a case where a subject (bird) 401 enters an LV image 3 including a continuous shooting area 301 and an AF area 302. In this case, since the subject 401 is located outside the AF area 302, the 3D space information acquired by the 3D space information acquisition unit 109 does not contain distance information corresponding to coordinates within the AF area. For this reason, the subject is determined to be present within the imaging angle of view but not within the AF area. Thereafter, when the subject 401 moves and enters the AF area 302 as shown in FIG. 5, the 3D space information acquisition unit 109 acquires distance information corresponding to coordinates within the AF area. At this time, the subject is determined to be present within the imaging angle of view and the AF area.

[0032] 9, when a part of the AF area 302 is not within the LV image 3, it is determined that the subject 401 is within the imaging angle of view but not within the AF area 302. Also, the subject 401a is determined to be within the imaging angle of view and within the AF area 302. Furthermore, the subject 401b is determined to be within the AF area 302 but not within the imaging angle of view. For the subject 401a, the orientation of the imaging device 1 is changed so that the AF area 302 is within the LV image 3, and the subject is determined to be within the imaging angle of view and within the AF area.

[0033] Next, in step S208, if it is determined in step S207 that the subject is present within the imaging angle of view and within the AF area, the calculation unit 101 proceeds to step S209, and if not, proceeds to step S217.

[0034] In step S209, the calculation unit 101 causes the imaging control unit 107 to perform AF control of the optical imaging unit 106 so as to focus on a subject that exists within the imaging angle of view and within the AF area.

[0035] Next, in step S210, the calculation unit 101 causes the 3D space information acquisition unit 109 to acquire 3D space information within the imaging angle of view, and determines whether or not a subject is present within the imaging angle of view and within the continuous shooting area. Here, the determination is performed by a method in which the AF area in step S207 is replaced with the continuous shooting area.

[0036] Next, in step S211, if it is determined in step S210 that the subject is within the imaging angle of view and the continuous shooting area, the calculation unit 101 proceeds to step S212, and if not, returns to step S207.

[0037] In step S212, the calculation unit 101 starts continuous shooting by having the imaging control unit 107 control continuous shooting of the optical imaging unit 106. The calculation unit 101 causes the imaging control unit 107 to continue continuous shooting control from step S212 to step S216.

[0038] Next, in step S213, the calculation unit 101 causes the imaging control unit 107 to perform AF control of the optical imaging unit 106 so as to track the moving subject and keep it in focus.

[0039] Next, in step S214, the calculation unit 101 causes the three-dimensional space information acquisition unit 109 to acquire three-dimensional space information within the imaging angle of view, and determines whether or not the subject is present within the imaging angle of view and the continuous shooting area. This determination is performed in the same manner as in step S210.

[0040] Next, in step S215, if it is determined in step S214 that the subject is within the imaging angle of view and the continuous shooting area, the calculation unit 101 proceeds to step S216, and if not, returns to step S213.

[0041] In step S216, the calculation unit 101 causes the imaging control unit 107 to end the continuous shooting control of the optical imaging unit .

[0042] Next, in step S217, the calculation unit 101 causes the imaging control unit 107 to perform AF control of the optical imaging unit 106 so as to focus on the center of gravity of the virtual object calculated in step S205, similarly to step S206.

[0043] Next, in step S218, the calculation unit 101 determines whether or not rearrangement of the virtual objects has been selected by a user operation on the command input unit 108, and if rearrangement has been selected, the process returns to step S202. On the other hand, if rearrangement has not been selected, the process proceeds to step S219.

[0044] In step S219, the calculation unit 101 determines whether or not the end of the automatic capture mode has been selected by a user operation on the command input unit 108, and if the end has been selected, the process proceeds to step S220. If the end has not been selected, the process returns to step S207.

[0045] In step S220, the calculation unit 101 causes the image processing unit 102 to end the display of the LV image on the display unit 105.

[0046] According to this embodiment, by controlling AF and continuous shooting in automatic imaging using a virtual object, imaging that reflects the user's intention can be performed. EXAMPLES

[0047] Next, an imaging device of Example 2 will be described. In Example 1, one virtual object is arranged, but in Example 2, multiple virtual objects are arranged. By arranging multiple virtual objects, it is possible to perform AF control and continuous shooting control in multiple search areas that are separated from each other, or to perform different AF control and continuous shooting control depending on the search area. The hardware configuration of the imaging device of this example is the same as that of the imaging device of Example 1, and the same reference numerals as those of Example 1 are used for common components.

[0048] The flowchart in FIG. 6 shows the automatic imaging process executed by the calculation unit 101 in this embodiment.

[0049] The processes from step S601 to step S603 are the same as those from step S201 to S203 in FIG.

[0050] In step S604, which follows step S603, the calculation unit 101 arranges N virtual objects (N is a natural number equal to or greater than 1) on the LV image by the user operating the touch panel of the command input unit 108 or the like. At this time, the N virtual objects are arranged so that the continuous shooting areas do not overlap each other. The method of arranging the virtual objects and the method of changing the size and position are as described in step S204.

[0051] Next, in step S605, the calculation unit 101 calculates the coordinates of the center of gravity of each virtual object arranged in step S604. Furthermore, the calculation unit 101 calculates the center of gravity of the centers of gravity of all virtual objects (hereinafter referred to as the inter-object center of gravity).

[0052] 7 shows a case where two virtual objects VO1 and VO2 are placed in the LV image 3. Virtual object VO1 specifies a search area including AF area 3021 and continuous shooting area 3011, and virtual object VO2 specifies a search area including AF area 3022 and continuous shooting area 3012. Virtual object VO1 has a center of gravity 703, and virtual object VO2 has a center of gravity 704. An inter-object center of gravity 705 of virtual objects VO1 and VO2 corresponds to the midpoint of the line connecting the centers of gravity 703 and 704. When three virtual objects are placed, the inter-object center of gravity corresponds to the center of gravity of a triangle formed by connecting the centers of gravity of the three virtual objects.

[0053] Next, in step S606, the calculation unit 101 causes the imaging control unit 107 to perform AF control of the optical imaging unit 106 so as to focus on the center of gravity between the objects.

[0054] Next, in step S607, the calculation unit 101 causes the three-dimensional space information acquisition unit 109 to acquire three-dimensional space information within the imaging angle of view. Then, the calculation unit 101 determines whether or not the subject is present within the imaging angle of view and within an AF area 302k in a search area specified by a virtual object k, which is the kth (k=1, 2, ..., N) virtual object (hereinafter, referred to as corresponding to virtual object k). The determination method here is the same as the determination method in step S207.

[0055] In step S608, the calculation unit 101 proceeds to step S610 if the subject exists within the imaging angle of view and within the AF area 302k corresponding to the virtual object k in step S607, and proceeds to step S609 if not.

[0056] In step S609, the calculation section 101 determines whether k is equal to N or not, and if so, proceeds to step S620, and if not, increments k by 1 in step S609a and returns to step S607.

[0057] In step S610, the calculation unit 101 causes the imaging control unit 107 to perform AF control of the optical imaging unit 106 so as to focus on a subject that exists within the imaging angle of view and within the AF area 302k corresponding to virtual object k.

[0058] In step S611, the calculation unit 101 causes the 3D space information acquisition unit 109 to acquire 3D space information within the imaging angle of view. Then, the calculation unit 101 determines whether or not the subject is present within the imaging angle of view and within the continuous shooting area corresponding to virtual object k. This determination is performed by a method in which the AF area in step S607 is replaced with the continuous shooting area.

[0059] In step S612, if it is determined in step S611 that the subject is present within the imaging angle of view and within the continuous shooting area corresponding to virtual object k, the calculation unit 101 proceeds to step S613. If not, in step S612a, k is set to 1 and the process returns to step S607.

[0060] In step S613, the calculation unit 101 starts continuous shooting by having the imaging control unit 107 control continuous shooting of the optical imaging unit 106. The calculation unit 101 causes the imaging control unit 107 to continue continuous shooting control from step S613 to step S617.

[0061] Next, in step S614, the calculation unit 101 causes the imaging control unit 107 to perform AF control of the optical imaging unit 106 so as to track the moving subject and keep it in focus.

[0062] Next, in step S615, the calculation unit 101 causes the three-dimensional space information acquisition unit 109 to acquire three-dimensional space information within the imaging angle of view, and determines whether or not the subject is present within the imaging angle of view and within the continuous shooting area corresponding to virtual object k. This determination is performed in the same manner as in step S611.

[0063] Next, in step S616, if it is determined in step S615 that the subject is present within the imaging angle of view and within the continuous shooting area corresponding to virtual object k, the calculation unit 101 returns to step S614, and if not, proceeds to step S617.

[0064] In step S617, the calculation unit 101 causes the imaging control unit 107 to end the continuous shooting control of the optical imaging unit .

[0065] Next, in step S618, the calculation unit 101 causes the three-dimensional space information acquisition unit 109 to acquire three-dimensional space information within the imaging angle of view, similarly to step S607. Then, the calculation unit 101 determines whether or not the subject is present within the imaging angle of view and within the AF area 302k corresponding to the virtual object k.

[0066] Next, in step S619, if it is determined in step S618 that the subject is present within the imaging angle of view and within the AF area 302k corresponding to the virtual object k, the calculation unit 101 returns to step S610. If not, in step S612a, k is set to 1, and the process returns to step S607.

[0067] In step S620 following step S609, the calculation unit 101 causes the imaging control unit 107 to perform AF control of the optical imaging unit 106 so as to focus on the center of gravity between the objects, similarly to step S606.

[0068] Next, in step S621, the calculation unit 101 determines whether or not rearrangement of the virtual objects has been selected by a user operation on the command input unit 108, and if rearrangement has been selected, the process returns to step S602. On the other hand, if rearrangement has not been selected, the process proceeds to step S622.

[0069] In step S622, the calculation unit 101 determines whether or not the end of the automatic capture mode has been selected by a user operation on the command input unit 108, and proceeds to step S623 if the end has been selected. If the end has not been selected, the calculation unit 101 proceeds to step S612a, sets k to 1, and returns to step S607.

[0070] In step S623, the calculation unit 101 causes the image processing unit 102 to end the display of the LV image on the display unit 105.

[0071] As shown in Fig. 8, when multiple virtual objects are arranged in step S604, a different continuous shooting interval can be set for each continuous shooting area of ​​the virtual objects. Fig. 8 shows a subject 804 moving (passing) from left to right in continuous shooting areas 3011 and 3012 corresponding to two virtual objects for which different continuous shooting intervals are set. In the continuous shooting area 3011, a wide continuous shooting interval (slow continuous shooting speed) is set, and in the continuous shooting area 3012, a narrower continuous shooting interval (faster continuous shooting speed) is set than in the continuous shooting area 3011. The positions of the subject 804 in Fig. 8 indicate the positions of the subject at the timing of each image capture in continuous shooting. The difference in the continuous shooting intervals in the continuous shooting areas 3011 and 3012 is recognized by the user by the color and transparency of the continuous shooting areas 3011 and 3012.

[0072] According to this embodiment, by controlling AF and continuous shooting in automatic imaging using a plurality of virtual objects, it is possible to perform imaging that reflects the user's intention.

[0073] When multiple subjects enter the search area (AF area and continuous shooting area) with a time difference, AF control and continuous shooting control may be performed preferentially on a first subject that entered the search area first. In this case, even if a second subject enters the search area later between steps S610 and S619, AF control and continuous shooting control are not performed on the second subject.

[0074] Also, a priority may be set for each search area, and AF control or continuous shooting control may be performed preferentially on a first subject that has entered a search area with a higher priority first. In this case, the priority is set when placing a virtual object in step S604 or when a subject is not present in the search area in step S607. Then, when a second subject enters a search area with a higher priority than the search area between steps S610 and S619, AF control or continuous shooting control may be interrupted, and AF control or continuous shooting control may be performed on the first subject that has entered the search area with the higher priority.

[0075] Furthermore, when multiple virtual objects are placed with a time difference, the search area corresponding to a virtual object placed earlier may be set to a higher priority, or the search area corresponding to a virtual object placed later may be set to a higher priority. Also, the search area corresponding to a virtual object placed closer to the image capture device 1 may be set to a higher priority, or the search area corresponding to a virtual object placed further back may be set to a higher priority. Furthermore, the priority of each search area corresponding to multiple virtual objects may be set according to a user's selection.

[0076] The above embodiment includes the following configurations.

[0077] (Configuration 1) An acquisition means for acquiring information regarding a three-dimensional space to be imaged; A control unit for controlling imaging, The control means A virtual figure is placed in the three-dimensional space; designating a search area for searching for a subject within the three-dimensional space based on the virtual figure; An imaging apparatus that performs at least one of focus control and continuous shooting control on a subject present within the search area. (Configuration 2) 2. The imaging device according to claim 1, wherein the control means specifies the search area inside or outside a three-dimensional figure as the virtual figure. (Configuration 3) 3. The imaging device according to claim 1, wherein the control means searches for a subject within the search area using information about the three-dimensional space. (Configuration 4) 4. The imaging device according to any one of configurations 1 to 3, wherein the control unit performs the focus control on the subject that is present within a focus area that is set inside the search area. (Configuration 5) 5. The imaging device according to any one of configurations 1 to 4, wherein the control means performs the continuous shooting control on the subject that exists within a continuous shooting area that is set inside the search area. (Configuration 6) The control means performing the focus control on the subject present within a focus area set inside the search area; The imaging device according to any one of configurations 1 to 5, characterized in that the continuous shooting control is performed on the subject that is inside the search area and exists inside the focus area or within a continuous shooting area set to be the same as the focus area. (Configuration 7) The control means A plurality of the virtual figures are arranged in the three-dimensional space; 7. The imaging device according to any one of configurations 1 to 6, wherein the search area is specified for each of the plurality of virtual figures. (Configuration 8) The imaging device according to configuration 7, wherein the control means performs at least one of the focus control and the continuous shooting control in any one of the search areas specified for each of the plurality of virtual figures with priority over other search areas. (Configuration 9) 9. The imaging apparatus according to configuration 8, wherein the control means sets the search area in which at least one of the focus control and the continuous shooting control is given priority in accordance with a user's selection. (Configuration 10) 8. The imaging device according to claim 7, wherein the control means performs the continuous shooting control at a continuous shooting interval that differs for each of the search areas designated for each of the plurality of virtual figures. (Configuration 11) 11. The imaging device according to any one of configurations 1 to 10, wherein the control means changes a position and a size of the virtual figure in the three-dimensional space in response to a user's operation.

[0078] (Other Examples) The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions.

[0079] The embodiments described above are merely representative examples, and various modifications and alterations are possible for each embodiment when implementing the present invention. [Explanation of symbols]

[0080] 1. Imaging device 101 Arithmetic section 107 Imaging control section 109 3D spatial information acquisition unit 301 Continuous shooting area 302 AF Area VO Virtual Objects

Claims

1. an acquisition means for acquiring information about a three-dimensional space to be imaged; a control means for controlling imaging, The control means specifying a three-dimensional search area for searching for a subject within the three-dimensional space in response to a user instruction; A control device characterized in that a subject existing within the search area is determined to be a main subject.

2. The control device described in Claim 1, characterized in that the control means performs focus control on the main subject.

3. The control device described in Claim 1, characterized in that the control means places a virtual figure in the three-dimensional space.

4. 4. The imaging device according to claim 3, wherein the control means changes the position and size of the virtual figure in the three-dimensional space in response to a user's operation.

5. 4. The control device according to claim 3, wherein the control means specifies the search area inside or outside a three-dimensional figure as the virtual figure.

6. The control means A plurality of virtual figures are arranged in the three-dimensional space; 2. The control device according to claim 1, wherein the search area is designated for each of the plurality of virtual figures.

7. 2. The control device according to claim 1, wherein the control means searches for the subject within the search area using information about the three-dimensional space.

8. 2. The imaging apparatus according to claim 1, wherein the control means controls continuous shooting of the main subject.

9. The control device according to claim 5, characterized in that the control means places a plurality of virtual figures in the three-dimensional space and performs at least one of focus control and continuous shooting control within any one of the search areas specified for each of the plurality of virtual figures, giving priority to focus control and continuous shooting control within other search areas.

10. 9. The control device according to claim 8, wherein the control means sets the search area in which at least one of focus control and continuous shooting control is given priority in accordance with a user's selection.

11. 10. The imaging apparatus according to claim 9, wherein the control means controls the continuous shooting at different continuous shooting intervals for each of the search areas designated for each of the plurality of virtual figures.

12. acquiring information about a three-dimensional space to be imaged; a control step of performing control related to imaging, In the control step, specifying a three-dimensional search area for searching for a subject within the three-dimensional space in response to a user instruction; An imaging control method, characterized in that a subject present within the search area is determined as a main subject.

13. A program causing a computer to execute processing according to the imaging control method of claim 12.

Images