Imaging apparatus, control method for the same, and program
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-04-07
- Publication Date
- 2026-04-06
AI Technical Summary
Existing imaging devices lack the ability to control their operating state based on the imaging intention of the photographer, as they do not account for the state of the imager when capturing an image.
An imaging device equipped with first and second imaging units, a motion detection unit, and determination units to detect and determine the photographer's intention and preparation for image capture, allowing the device to switch between power-saving and normal imaging modes accordingly.
The device can automatically adjust its operating state to align with the photographer's intention, reducing power consumption when not in use and ensuring readiness for immediate image capture.
Smart Images
Figure 00000000_0000_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to an imaging device. [Background technology]
[0002] 2. Description of the Related Art Conventionally, techniques have been proposed for enabling an electronic device to be used immediately from a hibernation state by turning on the power of the electronic device at a timing suited to the user's intention.
[0003] Patent Document 1 discloses a technique for detecting a change in the attitude of a camera body and automatically turning on the power of an imaging device. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] JP 2004-312477 A Summary of the Invention [Problem to be solved by the invention]
[0005] However, the technology disclosed in Patent Document 1 is not related to technology for capturing an image of the photographer himself, and it is not possible to grasp the state of the photographer when capturing an image of a subject. Therefore, with the imaging device disclosed in Patent Document 1, it is not possible to control the operating state of the imaging device in accordance with the photographer's imaging intention.
[0006] The present invention provides an imaging apparatus capable of controlling the operating state of the imaging apparatus in accordance with the imaging intention of the photographer by determining the state of the imaging apparatus and the state of the photographer when capturing an image of a subject. [Means for solving the problem]
[0007] An imaging device according to one aspect of the present invention is an imaging device having a first imaging unit that acquires an image of a subject, a second imaging unit that acquires an image of a user operating the imaging device in an imaging area on a rear side of the imaging device, a motion detection unit that detects motion of the imaging device, a first determination unit that, when a first motion is detected by the motion detection unit, determines based on the image acquired by the second imaging unit that an imaging preparation operation for acquiring an image of the subject has been started by the user, and a second determination unit that, when a second motion is detected by the motion detection unit after the first determination unit has determined that the imaging preparation operation has been started by the user, determines that the user has an intention to capture an image.
[0008] Other objects and features of the present invention will be described in the following embodiments. Effect of the Invention
[0009] According to the present invention, it is possible to provide an imaging device that can control the operating state of the imaging device in accordance with the photographer's intentions for imaging by determining the state of the imaging device and the state of the photographer when imaging a subject. [Brief description of the drawings]
[0010] [Figure 1] 1 is an external view of an imaging device according to an embodiment. [Diagram 2] 1 is a block diagram showing a functional configuration of an imaging apparatus according to an embodiment. [Diagram 3] 4 is a flowchart illustrating the operation of the imaging device according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0011] Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings. In each drawing, the same reference numerals are used for the same components, and duplicated explanations will be omitted. The configurations described in the following embodiments are merely examples, and the scope of the present invention is not limited by the configurations described in the embodiments. <Embodiment> An imaging device 100 according to an embodiment will be described with reference to FIGS. 1, 2, and 3. FIG. <Overview of the imaging device> FIG. 1 is an external view of an imaging device 100 according to this embodiment. FIG. 1(a) is a rear view of the imaging device 100, and FIG. 1(b) is a perspective view of the front of the imaging device 100. The imaging device 100 has a first imaging section 101 and a second imaging section 102. As shown in FIG. 1(b), the first imaging section 101 is provided on the front of the imaging device 100 and acquires an image of a subject. The first imaging section 101 has an imaging lens. An image of the subject is formed on an imaging element (not shown) through the imaging lens. As shown in FIG. 1(a), the second imaging section 102 is provided on the rear of the imaging device 100 and acquires an image of a photographer (a user who operates the imaging device 100) in an imaging area on the rear side of the imaging device 100. That is, the second imaging section 102 acquires an image in the direction of the photographer. The photographer himself may or may not be included in the captured image in the direction of the photographer. <Functional configuration> FIG. 2 is a block diagram showing a functional configuration of the imaging device 100. The imaging device 100 has a first imaging unit 101 for acquiring an image of a subject, and a second imaging unit 102 for acquiring an image of a user in an imaging area on the rear side of the imaging device 100. Furthermore, the imaging device 100 has a motion detection unit 103, an imaging preparation start determination unit (first determination unit) 104, an imaging intention determination unit (second determination unit) 105, and a control unit 106. Each process in this embodiment is realized by developing a program recorded in a non-volatile memory (not shown) in a system memory (not shown) and executing the program by the control unit 106, which is a processor such as a CPU that controls the entire imaging device 100. Note that the first imaging unit 101 and the second imaging unit 102 shown in FIG. 2 have functions common to the first imaging unit 101 and the second imaging unit 102 described with reference to FIG. 1, and therefore repeated description will be omitted.
[0012] The motion detection unit 103 detects the motion of the imaging device 100 by calculating a motion vector between images acquired by the second imaging unit 102. Specifically, when a downward motion vector is calculated from the images acquired by the second imaging unit 102, the motion detection unit 103 detects the upward motion of the imaging device 100 (for example, the motion of the imaging device 100 being lifted by the imaging person). When the imaging device 100 is lifted by the imaging person, a downward motion vector is calculated from the images acquired by the second imaging unit 102, but if the imaging device 100 is tilted, the calculated motion vector is not directly downward. Therefore, in this embodiment, a motion vector including a downward component is regarded as a downward motion vector. Also, when the motion vector amount calculated from the images acquired by the second imaging unit 102 is smaller than a predetermined amount, the motion detection unit 103 detects a state in which the imaging device 100 is not moving (for example, the imaging person holds the imaging device 100 and is stationary).
[0013] When a predetermined action (first action) is detected by the motion detection unit 103, the imaging preparation start determination unit 104 determines that the imaging preparation for acquiring an image of a subject has been started by the imager based on the image in the imager's direction acquired by the second imaging unit 102. In this embodiment, the imaging preparation start determination unit 104 determines that "the imaging preparation by the imager has been started" when the image acquired by the second imaging unit 103 includes the face of the imager after the motion detection unit 103 detects upward movement of the imaging device 100 by a predetermined amount or more. Note that, although the presence or absence of the imager's face in the acquired image is used to determine the start of imaging preparation, the presence or absence of a feature of the imager other than the face may be used. For example, the presence or absence of a feature included in the face of the imager, such as the pupil, nose, or mouth, may be used.
[0014] The imaging intention determination unit 105 determines that the photographer has an intention to capture an image when the motion detection unit 103 detects a motion (second motion) of the imaging device 100 after the imaging preparation start determination unit 104 has determined that "imaging preparation by the photographer has started,". In this embodiment, the imaging intention determination unit 105 determines that the photographer has an "intention to capture an image" when the motion detection unit 103 detects that the imaging device 100 is still. On the other hand, the imaging intention determination unit 105 determines that the photographer has no "intention to capture an image" when the motion detection unit 103 does not detect that the imaging device 100 is still.
[0015] The first imaging unit 101 and the second imaging unit 102 are controlled by the control unit 106 to one of the operation modes of the "normal imaging mode", the "power saving mode", and the "imaging stop mode". The imaging device 100 is in a lower power consumption state in the "power saving mode" than in the "normal imaging mode". The "normal imaging mode" is a mode in which imaging is possible. The "power saving mode" is a mode in which imaging is possible with lower power consumption than in the normal imaging mode. The "imaging stop mode" is a mode in which imaging of a subject is stopped. For example, in a state in which the imaging device 100 displays a subject through image, in the power saving mode, the read cycle and pixel resolution of the subject through image are reduced. This makes it possible to make the power saving mode a lower power consumption state than the normal imaging mode. Also, for example, in the imaging stop mode, the driving operation of the subject through image is stopped, and the power supply to the first imaging unit 101 is stopped. This makes it possible to make the imaging stop mode a lower power consumption state. The imaging device 100 is in a lower power consumption state in the "imaging stop mode" than in the "power saving mode". In other words, in terms of power consumption, the mode that consumes the least power is the "imaging stop mode," the next lowest power consumption is the "power saving mode," and the highest power consumption is the "normal imaging mode."
[0016] The control unit 106 controls the power states of the first imaging unit 101 and the second imaging unit 102, and may change the power state of the first imaging unit 101 from a first state to a second state when the imaging intention determination unit 105 determines that the photographer has an intention to capture an image. The second state is a state in which power consumption is greater than that of the first state. Here, for example, the first state is a "power saving mode" or a "capture stop mode" in which power consumption is less than that of the "normal imaging mode", and the second state is the "normal imaging mode". <Example 1> Next, the operation of the imaging device 100 will be described with reference to Fig. 3. The process in this flowchart starts from a state in which the first imaging unit 101 is set to "imaging stop mode" by the control unit 106 in accordance with a predetermined condition, such as no operation by the photographer on the imaging device 100 for a predetermined period of time or more. At this time, the control unit 106 controls the second imaging unit 102 to be in the "imaging stop mode".
[0017] First, in step S301, the control unit 106 changes the operation mode of the second imaging unit 102 to the "normal imaging mode" and causes the second imaging unit 102 to start capturing an image of the imaging device 100 in the direction of the person imaging the image.
[0018] Next, in step S302, the control unit 106 causes the motion detection unit 103 to start detecting the motion of the imaging device 100. In this embodiment, the motion detection unit 103 receives an image captured by the second imaging unit 102 in the direction of the image capturer as an input, calculates a motion vector, and detects the motion of the imaging device 100.
[0019] Next, in step S303, the control unit 106 causes the imaging preparation start determination unit 104 to determine whether or not the imaging preparation operation by the imager has started. Specifically, the imaging preparation start determination unit 104 determines that "imaging preparation operation has started" when both of the following two conditions are detected.
[0020] The motion detection unit 103 detects a predetermined amount or more of upward (vertical) motion of the imaging device 100. The face of the photographer is included in the captured image captured by the second imaging unit 102 in the direction of the photographer. On the other hand, if either of the above two conditions is not detected, the imaging preparation start determination unit 104 determines that "imaging preparation operation has not started." If the imaging preparation start determination unit 104 determines that "imaging preparation operation has started" (Yes in S303), the flow proceeds to step S304. If the imaging preparation start determination unit 104 determines that "imaging preparation operation has not started" (No in S303), the flow returns to step S303.
[0021] Next, in step S304, the control unit 106 causes the imaging intention determination unit 105 to determine whether or not the photographer has an "imaging intention." Specifically, in step S304, if it is determined that the imaging device 100 is "not moving" based on the motion detection result of the motion detection unit 103 (Yes in step S304), the imaging intention determination unit 105 determines that the photographer has an "imaging intention." Note that in step S304, since the momentary motion detection result of the motion detection unit 103 cannot accurately determine the presence or absence of the photographer's "imaging intention," the determination may be made based on the motion detection result of the motion detection unit 103 over a predetermined period (e.g., one second). Then, the flow proceeds to step S305. In step S305, the control unit 106 changes the operation mode of the first imaging unit 101 from the "imaging stop mode" to the "normal imaging mode," and ends the process in FIG. 3.
[0022] If it is determined that the imaging device 100 is "moving" based on the motion detection result of the motion detection unit 103 (No in step S304), the imaging intention determination unit 105 determines that the photographer has "no intention to capture images," and the flow returns to step S303. That is, in step S303, the control unit 106 repeats the determination by the imaging preparation start determination unit 104 as to whether or not the photographer has started an imaging preparation operation.
[0023] As described above, in this embodiment, when the photographer has no intention of capturing an image, the control unit 106 maintains the operation mode of the first imaging unit 101 in the "imaging stop mode" to realize low power consumption of the imaging device 100. At this time, when the operation mode of the first imaging unit 101 is the "power saving mode", the control unit 106 may maintain the "power saving mode" or may change it to the "imaging stop mode". Also, when the photographer has an intention of capturing an image, the control unit 106 automatically changes the setting of the operation mode of the first imaging unit 101 from the "imaging stop mode" to the "normal shooting mode". This saves the photographer the trouble of putting the imaging device 100 into a state in which it is possible to capture an image of a subject, and allows for immediate capture. At this time, the operation mode of the first imaging unit 101 may be automatically changed from the "imaging stop mode" to the "power saving mode". In other words, by determining the state of the imaging device 100 and the state of the photographer, it is possible to control the operation state of the imaging device 100 in accordance with the intention of capturing an image.
[0024] The imaging device 100 may include a motion sensor 107 capable of detecting motion information such as acceleration, velocity, and angular velocity. In this case, the motion detection unit 103 may detect the motion of the imaging device 100 based on the motion information detected by the motion sensor 107. When configured in this manner, in the above-described embodiment, the motion detection unit 103 can detect the motion of the imaging device 100 instead of or in addition to the calculation result of the motion vector between images acquired by the second imaging unit 102. As a result, the imaging intention of the photographer can be determined more accurately. For example, the inclination of the imaging device 100 is detected by the motion sensor 107, and the direction of the motion vector detected when the imaging device 100 is moved in the vertical direction is specified, whereby the imaging intention of the photographer can be determined more accurately.
[0025] In the above embodiment, the "imaging preparation start determination process" by the imaging preparation start determination unit 104 and the "imaging intention determination process" by the imaging intention determination unit 105 are performed, and an example has been described in which the operating state of the imaging device 100 is controlled according to the imaging intention of the photographer. On the other hand, an application is assumed in which an image with a visual effect of the background of the subject flowing is obtained by moving the imaging device to follow a moving subject as in panning. In such a case, an operation unit (not shown) may be provided for setting whether or not the "imaging intention determination process" by the imaging intention determination unit 105 based on the absence of motion of the imaging device is to be performed. The control unit 106 can also perform control in this embodiment according to the operation of this operation unit (not shown). Also, in the case where there is a predetermined movement such as panning, it may be determined in step S304 that "there is an intention to capture". In other words, it may be determined that "there is an intention to capture" when there is a predetermined movement or when there is no movement as the movement of the imaging device 100. In this case, to determine whether the movement is a predetermined movement such as a panning shot or other movement, any of a motion vector based on an image acquired by the second imaging unit 102, a motion vector based on an image acquired by the first imaging unit 101, and motion information detected by the motion sensor 107 may be used. In addition, a known method may be used to determine whether the movement is a predetermined movement such as a panning shot or other movement, and for example, it may be determined whether a movement component in a predetermined direction (horizontal direction) is continuously detected for a predetermined period of time or more.
[0026] The disclosure of this embodiment includes the following configurations and methods.
[0027] (Configuration 1) An imaging device having a first imaging unit that captures an image of a subject, a second imaging unit that captures an image of a user operating the imaging device in an imaging area on a rear side of the imaging device; a motion detection unit that detects a motion of the imaging device; a first determination unit that determines, when a first action is detected by the motion detection unit, that an image capture preparation action for capturing an image of the subject has been started by the user based on an image captured by the second imaging unit; and a second determination unit that determines that the user has an intention to capture an image when a second movement is detected by the motion detection unit after the first determination unit determines that the image capture preparation operation has been started by the user. (Configuration 2) the first movement is a vertical movement of the imaging device of at least a predetermined amount; 2. The imaging device according to configuration 1, wherein the second operation is a predetermined movement of the imaging device or the imaging device being stationary. (Configuration 3) 3. The imaging device according to configuration 1 or 2, wherein the motion detection section detects motion of the imaging device by calculating a motion vector between images acquired by the second imaging section. (Configuration 4) a motion sensor for detecting motion information of the imaging device; 3. The imaging device according to configuration 1 or 2, wherein the motion detection section detects the motion of the imaging device based on the motion information detected by the motion sensor. (Configuration 5) The imaging device according to any one of configurations 1 to 4, wherein the first determination unit determines that the imaging preparation operation has been started by the user when a characteristic feature of the user is included in the image acquired by the second imaging unit. (Configuration 6) A control unit that controls a power state of the first imaging unit, The imaging device described in any one of configurations 1 to 5, characterized in that when the second determination unit determines that the user has an intention to capture an image, the control unit changes the power state of the first imaging unit from a first state to a second state having higher power consumption than the first state. (Configuration 7) the second state is a normal imaging mode in which imaging by the first imaging unit is enabled, 7. The imaging device according to configuration 6, wherein the first state is a power saving mode in which power consumption is smaller than that in the normal imaging mode, or an imaging stop mode in which power supply to the first imaging unit is stopped. (Configuration 8) The imaging device of any one of configurations 1 to 7, characterized in that the second determination unit determines that the user has no intention of capturing an image when the motion detection unit does not detect a second movement after the first determination unit determines that the imaging preparation operation has been started by the user. (Configuration 9) the second determination unit determines that the user has no intention of capturing an image when the second action is not detected by the motion detection unit after the first determination unit has determined that the image capturing preparation action has been started by the user; The imaging device described in configuration 6 or 7, characterized in that when the second determination unit determines that the user has no intention of capturing an image, the control unit maintains the power state of the first imaging unit in the first state. (Method 1) A method for controlling an imaging device having a first imaging unit that captures an image of a subject, comprising: an imaging step of acquiring an image of a user operating the imaging device in an imaging area on a rear side of the imaging device; a motion detection step of detecting a motion of the imaging device; a first determination step of determining, when a first motion is detected by the motion detection step, that an image capture preparation operation for capturing an image of the subject has been started by the user based on the image captured by the image capture step; and a second determination step of determining that the user has an intention to capture an image when a second movement is detected by the motion detection step after the first determination step has determined that the image capture preparation operation has been started by the user. (Configuration 10) A program for causing a computer to execute the control method according to method 1. (Other Examples) The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-mentioned embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions.
[0028] Although the preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments, and various modifications and changes are possible within the scope of the gist of the present invention. [Explanation of symbols]
[0029] 100 Imaging device 101 First imaging unit 102 Second imaging unit 103 Motion detection unit 104 Imaging preparation start determination unit (first determination unit) 105 Imaging intention determination unit (second determination unit) 106 Control section 107 Motion Sensor
Claims
1. An imaging device having a first imaging unit for acquiring an image of a subject, A second imaging unit that acquires an image in an imaging area on the back side of the aforementioned imaging device, A motion detection unit for detecting the movement of the imaging device, The system includes a control unit that controls the operating mode of the imaging device based on the image acquired by the second imaging unit and the detection result of the motion detection unit, The control unit is characterized in that it sets a first mode as the operating mode of the imaging device when it detects that the image acquired by the second imaging unit contains predetermined features, and that after vertical movement of the imaging device exceeds a predetermined amount, the amount of movement of the imaging device remains below a predetermined amount for a predetermined period of time.
2. The imaging apparatus according to claim 1, characterized in that the motion detection unit detects the movement of the imaging apparatus by calculating a motion vector between images acquired by the second imaging unit.
3. The device further includes a motion sensor that detects motion information of the imaging device, The imaging device according to claim 1, characterized in that the motion detection unit detects the movement of the imaging device based on motion information detected by the motion sensor.
4. The imaging device according to Claim 1, further comprising a first determination unit that determines that the user has initiated an imaging preparation operation to acquire an image of the subject when the image acquired by the second imaging unit includes a user's characteristic portion and the motion detection unit detects vertical movement of the imaging device exceeding a predetermined amount.
5. The imaging apparatus according to claim 1, characterized in that the control unit controls the power state of the first imaging unit and changes the power state of the first imaging unit from a first state to a second state which consumes more power than the first state, according to the setting of the first mode.
6. The first mode is a normal imaging mode that enables imaging by the first imaging unit. The imaging apparatus according to claim 5, characterized in that the first state is a power-saving mode that consumes less power than the normal imaging mode, or an imaging stop mode in which the power supply to the first imaging unit is stopped.
7. The imaging apparatus according to claim 5 or 6, wherein the control unit maintains the power state of the first imaging unit in the first state when the motion detection unit determines that after vertical movement of the imaging apparatus exceeds a predetermined amount, the amount of movement of the imaging apparatus has not remained below a predetermined amount for a predetermined period of time.
8. A control method for an imaging device having a first imaging unit for acquiring an image of a subject, The imaging step involves acquiring an image in an imaging area on the back side of the imaging device, A motion detection step for detecting the movement of the imaging device, A control method characterized by comprising: a setting step, in which the image acquired in the imaging step contains predetermined features, and when the motion detection step detects that the amount of movement of the imaging device remains below a predetermined amount for a predetermined period after vertical movement of the imaging device of a predetermined amount or more, a first mode is set as the operating mode of the imaging device.
9. A program for causing a computer to execute the control method described in claim 8.