Imaging device, control method for imaging device, and recording medium
The processing unit determines the lens position relationship and adjusts the shooting parameters, and solves the problem of low efficiency of the shooting device in different states, and achieves an efficient and energy-saving shooting effect.
Patent Information
- Application Number
- CN202210287758.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2021-03-25
- Filing Date
- 2022-03-22
- Publication Date
- 2025-07-29
- Estimated Expiration
- 2042-03-22
AI Technical Summary
In the prior art, it is difficult for the photographing device installed on the human body to automatically adjust the shooting parameters in different usage states to meet different shooting needs, resulting in inefficiency and waste of electricity.
The processing unit determines the positional relationship of the lens with respect to the mounting target unit, and adjusts the shooting parameters of the shooting element and the lens, including viewing angle and sensitivity, to adapt to different usage states.
It realizes efficient shooting of the shooting device in different states, reduces power consumption, and improves shooting quality and user experience.
Smart Images

Figure CN115209013B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a photographing device, a control method of the photographing device, and a recording medium. Background Art
[0002] As a photographing device that can be mounted on a human body, for example, Japanese Unexamined Patent Application Publication No. 2003-244294 discloses a watch-type electronic device with a built-in camera that can rotate the orientation of the camera in various directions around while being mounted on the wrist. Summary of the Invention
[0003] In order to achieve the above object, one aspect of the photographing device of the present invention includes:
[0004] A lens that guides reflected light from a subject to a photographing element;
[0005] A mounting member that mounts at least the lens on a mounting target portion; and
[0006] A processing unit,
[0007] The processing unit determines whether a first condition based on the positional relationship of the lens with respect to the mounting target portion is satisfied,
[0008] The processing unit determines whether a second condition different from the first condition, which includes a condition based on the positional relationship of the lens with respect to the mounting target portion, is satisfied,
[0009] When the first condition is satisfied and the second condition is satisfied, the processing unit makes the photographing parameters of at least one of the photographing element and the lens different. Brief Description of the Drawings
[0010] Figure 1 It is a front view of the photographing device of the embodiment.
[0011] Figure 2 It is a rear view of the photographing device of the embodiment.
[0012] Figure 3 It is a block diagram showing the functional configuration of the photographing device of the embodiment.
[0013] Figure 4 It is a flowchart of the photographing control process of the embodiment.
[0014] Figure 5 It is a diagram showing an example of an image obtained by photographing a tape with the photographing device of the embodiment.
[0015] Figure 6 It is a diagram showing a state in which a main body is lifted in the photographing device of the modification.
[0016] Figure 7 It is the first part of the flowchart of the shooting control process of the modified example.
[0017] Figure 8 It is the second part of the flowchart of the shooting control process of the modified example. Detailed implementation mode
[0018] The shooting device of the implementation mode will be described with reference to the accompanying drawings. In addition, the same or corresponding parts in the drawings are marked with the same reference numerals.
[0019] (Implementation mode)
[0020] As Figure 1 shown, the shooting device 100 of the implementation mode is a watch-type device having a display unit 150 and a front camera 132 (second camera) on the front surface of the main body 170. In addition, as Figure 2 shown, the shooting device 100 has an illuminance sensor 141 and a rear camera 131 (first camera) on the back surface of the main body 170. And the shooting device 100 has bands 171 and 172, which are mounting members for mounting the main body 170 having the rear camera 131, the front camera 132, etc. on the arm (generally the wrist of the left arm) of the user as the mounting object part. The upper end of the main body 170 is connected to the band 171, and the lower end of the main body 170 is connected to the band 172. In addition, the shooting device 100 has a push button as the operation unit 160 on the side surface of the main body 170.
[0021] When the user mounts the shooting device 100 on the wrist through the bands 171 and 172, the lens of the rear camera 131 and the illuminance sensor 141 approach the wrist, obstructing the light incident on the rear camera 131 and the illuminance sensor 141 from the outside. In addition, when the shooting device 100 is removed from the wrist, the shooting angle is made wide-angle by using the rear camera 131, thereby shooting the bands 171 and 172. That is, the bands 171 and 172 are connected to the main body 170 so as to extend toward the back side of the shooting device 100.
[0022] As a functional structure, as Figure 3 shown, the shooting device 100 has: a processing unit 110, a storage unit 120, a camera unit 130, a sensor unit 140, a display unit 150, and an operation unit 160.
[0023] The processing unit 110 is constituted by a processor such as a CPU (Central Processing Unit), for example. By executing the program stored in the storage unit 120, the processing unit 110 functions as each of the units (determination unit 111, setting unit 112) described later. In addition, corresponding to the multi-thread function of executing a plurality of processes in parallel, the processing unit 110 also has a function of counting time using an RTC (Real Time Clock) or the like.
[0024] The storage unit 120 stores the programs and necessary data executed by the processing unit 110. The storage unit 120 can include a RAM (Random Access Memory), a ROM (Read Only Memory), a flash memory, etc., but is not limited thereto. In addition, the storage unit 120 may be provided inside the processing unit 110.
[0025] The camera unit 130 includes a rear camera 131 and a front camera 132. The rear camera 131 and the front camera 132 each have an imaging element and a lens that guides the reflected light from the subject to the imaging element. That is, the rear camera 131 has a first imaging element and a first lens, and the front camera 132 has a second imaging element and a second lens. The imaging element is, for example, a CCD (Charge Coupled Device) image sensor, a CMOS (Complementary Metal Oxide Semiconductor) image sensor, or the like. The camera unit receives the reflected light from the subject (object) that has passed through the lens by the imaging element and converts it into an electrical signal, thereby capturing an image. In addition, in the present embodiment, the camera unit 130 includes a rear camera 131 and a front camera 132, but the camera unit 130 may only include a rear camera 131, or may include three or more cameras.
[0026] The sensor unit 140 includes an illuminance sensor 141 and an acceleration sensor 142. The illuminance sensor 141 has a light receiving element such as a photodiode and detects the surrounding brightness (illuminance). The acceleration sensor 142 detects the accelerations on three mutually orthogonal axes (for example, the axis in the up-down direction, the axis in the front-rear direction, and the axis in the left-right direction). In addition, the sensor unit 140 may further include other sensors such as a pulse sensor.
[0027] The lens of the rear camera 131 is set to be located at a position (first position) covered by the wrist when it is mounted on the wrist through the bands 171 and 172. And when the lens of the rear camera 131 is mounted on the wrist through the bands 171 and 172, the illuminance sensor 141 is also set at a position covered by the wrist.
[0028] The display unit 150 includes a display device such as a liquid crystal display or an organic EL (Electro-Luminescence) display, and displays the image captured by the camera unit 130, the current time, etc.
[0029] The operation unit 160 is a user interface such as a push button switch, and accepts operation inputs from the user. The photographing apparatus 100 has, for example, a photographing button, a mode switching button, etc. as the operation unit 160. In the photographing apparatus 100, the photographing of the rear camera 131 needs to be performed through the photographing control process described later, but the photographing of the front camera 132 can be arbitrarily performed by the user pressing the photographing button. In addition, the photographing of the rear camera 131 can also be arbitrarily performed by the user pressing the photographing button.
[0030] Next, the functional structure of the processing unit 110 will be described. As described above, the processing unit 110 functions as a determination unit 111 and a setting unit 112.
[0031] In the photographing control process described later, the determination unit 111 determines whether a condition based on the positional relationship of the camera (rear camera 131) with respect to the mounting object portion (the user's wrist) is satisfied.
[0032] The setting unit 112 sets the photographing parameters (such as the viewing angle, sensitivity, etc.) of the camera (at least one of the photographing element and the lens) according to whether the condition determined by the determination unit 111 is satisfied.
[0033] Next, with reference to Figure 4 The photographing control process executed by the processing unit 110 will be described. When the power is turned on, the photographing apparatus 100 starts the photographing control process automatically or by the operation of the user.
[0034] First, the processing unit 110 performs initialization processing (step S101). Specifically, for example, the driving of the photographing element of the rear camera 131 is stopped, and the illuminance sensor 141 is started.
[0035] Next, the processing unit 110 (determination unit 111) determines whether a condition (first condition) that the illuminance (ambient brightness) detected by the illuminance sensor 141 exceeds a first threshold is satisfied (step S102). In addition, the first threshold is a value determined to be the lowest brightness at which the camera can photograph the bands 171 and 172 when the camera is set to the high sensitivity mode. Also, when it is bright around, if the rear camera 131 (lens) is removed from the wrist (the external light blocked by the wrist is incident on the illuminance sensor 141), then this first condition is satisfied, so this is a condition based on the positional relationship of the rear camera 131 (lens) with respect to the wrist.
[0036] If the illuminance does not exceed the first threshold (step S102; No), the processing unit 110 determines that the rear camera 131 is mounted on the wrist (the incident light to the illuminance sensor 141 is blocked by the wrist), and returns to step S102.
[0037] If the illuminance exceeds the first threshold (step S102; Yes), the processing unit 110 tentatively determines that the rear camera 131 has been removed from the wrist and stands by for a specified time (e.g., 3 seconds) (step S103). Regarding this standby, for example, considering that it takes a certain amount of time T for the user to remove the photographing device 100 from the wrist and place it in another place, the value of the specified time is determined to be the time of this time T + α.
[0038] Then, the processing unit 110 obtains the value of the acceleration detected by the acceleration sensor 142 (step S104) and activates the imaging element of the rear camera 131 (step S105).
[0039] Next, the processing unit 110 (setting unit 112) sets the shooting parameters of the rear camera 131 to the first set value (step S106). The first set value is a set value that enables the lens and imaging element of the rear camera 131 to photograph the tapes 171 and 172. More specifically, it is a set value that sets the viewing angle of the lens of the rear camera 131 to a wide angle (a first viewing angle value equal to or greater than a wide angle reference viewing angle value (e.g., 60 degrees)) and sets the sensitivity of the imaging element of the rear camera 131 to the high sensitivity mode (e.g., ISO sensitivity 3200).
[0040] Then, the processing unit 110 obtains the image captured by the rear camera 131 whose shooting parameters are set to the first set value (step S107), and performs image analysis (S108) for detecting whether the tapes 171 and 172 appear in the image. When the photographing device 100 is detached from the wrist, as Figure 5 shown, the tapes 171 and 172 appear in the image captured by the rear camera 131 whose shooting parameters are set to the first set value. Therefore, after the processing unit 110 detects that the tapes 171 and 172 appear in the image through image analysis, it can determine that the rear camera 131 has been detached from the wrist. In addition, Figure 5 An example in the case where the photographing device 100 is detached from the wrist and placed on the table 200 is shown, but even if it is not placed on the table 200, as described above, when the photographing device 100 is detached from the wrist, the tapes 171 and 172 appear in the image captured by the rear camera 131 whose shooting parameters are set to the first set value.
[0041] Return to Figure 4, the processing unit 110 obtains the value of the acceleration detected by the acceleration sensor 142, calculates the difference between the obtained acceleration value and the acceleration value obtained in step S104, and thereby calculates the acceleration change value (step S109). In addition, when the elapsed time since the time point when the acceleration value was obtained in step S104 is short, the processing unit 110 may also obtain the acceleration value after waiting for a certain time in step S109 and calculate the acceleration change value. This is because when the acceleration values are obtained twice at short time intervals, the calculated acceleration change value may become unstable.
[0042] Next, the processing unit 110 (determination unit 111) determines whether the conditions (second condition) such as the bands 171 and 172 are detected in the image analysis in step S108 are satisfied (step S110). This second condition is satisfied when it is determined that the rear camera 131 (its lens) has been removed from the wrist based on the image captured by the rear camera 131 whose shooting parameters are set to the first set value. Therefore, this is a condition based on the positional relationship of the rear camera 131 (its lens) with respect to the wrist. If the bands 171 and 172 are not detected (step S110: No), it is determined that the photographing device 100 is attached to the wrist (for example, a gap is generated between the photographing device 100 and the wrist, and ambient light enters the illuminance sensor 141 through this gap, and the determination in step S102 is Yes), and the processing unit 110 stops driving the imaging element of the rear camera 131 (step S111), and returns to step S102.
[0043] In addition, as a case where the determination in step S110 is No, in addition to the case where a gap is generated between the photographing device 100 and the wrist as described above, cases such as the case where the band is not correctly photographed due to shaking and the case where the user holds the photographing device 100 so that the band is not photographed by the rear camera 131 are also considered. In these cases, it can be considered that it is also effective to repeatedly take pictures until the band is photographed. Therefore, when the determination in step S110 is No, the driving of the imaging element of the rear camera 131 may not be stopped and the process may return to step S106. Also, the number of times of the process continuous from step S110 (No determination) to step S106 may be counted, and if the count value reaches a specified value (for example, 10), the process may return to step S101 as an operation abnormality.
[0044] If the bands 171 and 172 are detected (step S110; YES), the processing unit 110 determines a determination that the rear camera 131 has detached from the wrist. Then, the processing unit 110 determines whether there is no acceleration change, that is, whether the value of the acceleration change calculated in step S109 is less than the acceleration change threshold (step S112). In addition, as the value of the acceleration change threshold, a value slightly smaller than the value of the acceleration change that should be calculated after the imaging device 100 is mounted on the wrist is set in advance. By setting the acceleration change threshold in this way, if the value of the acceleration change is less than the acceleration change threshold, it can be determined that the imaging device 100 is placed on a table or the like.
[0045] If the value of the acceleration change exceeds the acceleration change threshold (step S112; NO), it is determined that the imaging device 100 has detached from the wrist, but the user is carrying it in a state of being put in a pocket or a bag, etc., and the processing unit 110 stops the driving of the imaging element of the rear camera 131 (step S111) and returns to step S102.
[0046] If the value of the acceleration change is less than the acceleration change threshold (step S112; YES), the processing unit 110 (setting unit 112) sets the imaging parameters of the rear camera 131 to the second set value (step S113). The second set value is a set value determined according to the content that the user wants to image using the rear camera 131 (for example, landscape imaging, surveillance imaging, etc.), and the viewing angle is selected to be narrower than the wide angle (a second viewing angle value smaller than the wide angle reference viewing angle value. For example, normal, telephoto), and in addition, regarding the sensitivity, the optimal set value is selected according to the surrounding brightness. In the case of the use of surveillance imaging, by setting the set value with the frame rate reduced, the imaging device 100 can also continue surveillance in a power-saving and memory-saving manner.
[0047] Next, the processing unit 110 performs imaging using the rear camera 131 (step S114). In this step, imaging of the content that the user wants to image using the rear camera 131, such as landscape imaging and surveillance imaging, is performed.
[0048] Then, the processing unit 110 determines whether the illuminance (surrounding brightness) detected by the illuminance sensor 141 is less than the first threshold (step S115). If the illuminance exceeds the first threshold (step S115; NO), it returns to step S114.
[0049] If the illuminance is less than the first threshold (step S115; YES), it is determined that the imaging device 100 is reinstalled on the wrist (the incident light to the illuminance sensor 141 is blocked by the wrist), and the processing unit 110 stops driving the imaging element of the rear camera 131 (step S111), and returns to step S102. Further, in step S115, the processing unit 110 determines the reinstallation of the imaging device 100 based on the illuminance detected by the illuminance sensor 141. However, by this, the determination of reinstallation can be made even without performing image processing such as in step S108, so that the load on the processing unit 110 can be suppressed. In addition, in step S113, the viewing angle of the rear camera 131 is narrow. Therefore, it is highly likely that the bands 171 and 172 do not appear in the image captured in step S114. However, in step S115, the processing unit 110 makes a determination based on the illuminance. Thus, even when the bands 171 and 172 do not appear in the captured image, the reinstallation of the imaging device 100 can be determined.
[0050] Through the above-described imaging control process, the imaging device 100 can appropriately perform imaging according to the conditions based on the position of the rear camera 131. That is, if the imaging device 100 is installed on the wrist, the processing unit 110 stops driving the imaging element of the rear camera 131. And, in the case where the first condition is satisfied by temporarily determining that the imaging device 100 has detached from the wrist, the processing unit 110 sets the viewing angle of the rear camera 131 to wide angle for imaging, attempts to detect the bands 171 and 172, and in the case where the second condition is satisfied by determining the detachment of the imaging device 100 from the wrist by detecting the bands 171 and 172, the viewing angle of the rear camera 131 can be changed to perform landscape imaging and surveillance imaging.
[0051] In addition, in the present embodiment, the illuminance sensor 141 is provided in the sensor unit 140, and in steps S102 and S115 of the imaging control process, the processing unit 110 determines whether the ambient brightness detected by the illuminance sensor 141 is less than the first threshold. Since the power consumption of the illuminance sensor 141 is less than the power consumption of the rear camera 131, the imaging device 100 can determine the ambient brightness with lower power consumption by using the illuminance sensor 141. Further, when the ambient brightness is dark and imaging by the rear camera 131 cannot be performed, the imaging device 100 can stop driving the imaging element of the rear camera 131 to reduce the power consumption.
[0052] However, the photographing device 100 may not have the illuminance sensor 141. In this case, in steps S102 and S115 of the photographing control process, the surrounding brightness is detected by photographing using the rear camera 131. Therefore, in the photographing control process of the photographing device 100 that does not have the illuminance sensor 141, in steps S101 and S111, the driving of the imaging element of the rear camera 131 is not stopped, and as photographing parameters, photographing parameters such as an open aperture that are easy to detect the surrounding brightness are set.
[0053] In addition, in the present embodiment, the acceleration sensor 142 is provided in the sensor unit 140, and in step S112 of the photographing control process, it is determined whether there is an acceleration change. Therefore, even when the photographing device 100 is detached from the wrist and placed in a pocket or a bag, etc., it is determined that photographing by the rear camera 131 is not required, the driving of the imaging element of the rear camera 131 is stopped, useless photographing inside the pocket or the bag is not performed, and the power consumption of the photographing device 100 can be reduced.
[0054] However, the photographing device 100 may not have the acceleration sensor 142. In this case, the processes of steps S104, S109, and S112 of the photographing control process can be omitted, and when the determination in step S110 is yes, the process proceeds to step S113. In this case, when it is determined that the photographing device 100 is removed from the wrist, photographing by the rear camera 131 is performed regardless of whether there is an acceleration change.
[0055] In addition, in the above-described embodiment, in the photographing control process, the rear camera 131 is controlled, but the front camera 132 can also be controlled. For example, when it is determined that the photographing device 100 is mounted on the wrist, the photographing parameters of the front camera 132 can be set to a set value (front first set value) for photographing (selfie) the user's face or for authentication photographing, and when it is determined that the device is detached from the wrist, the photographing parameters of the front camera 132 can be set to a set value (front second set value) for landscape photographing or surveillance photographing. As the front first set value, for example, as a set value for selfies, in order to be able to photograph the user's face at close range with high image quality, it is considered to set the viewing angle of the front camera 132 to a wide angle (a viewing angle value equal to or greater than the wide angle reference viewing angle value. For example, a viewing angle set value at which the focus is on the face when the front camera 132 is located in front of the user's face), and the sensitivity is set to a medium sensitivity mode (when the sensitivity is reduced, the image quality is improved, so for example, an ISO sensitivity of 400).
[0056] In addition, as the first pre-set value, the set value for authentication is also considered. For example, the set value for iris authentication (the macro perspective set value for focusing on the iris when the front camera 132 is positioned in front of the user's eyeball), the set value for face authentication (the same set value as the set value for selfies), the set value for fingerprint authentication (the macro perspective set value for focusing on the fingerprint when the front camera 132 is positioned in front of the finger for fingerprint authentication), etc. In addition, as the second pre-set value, for example, in order to be able to zoom in on a distant landscape and take a high-quality photo, consider setting the perspective of the front camera 132 to telephoto (a perspective value less than the telephoto reference perspective value (e.g., 30 degrees)), and setting the sensitivity to the medium sensitivity mode (e.g., ISO sensitivity 400); for surveillance purposes, set the perspective of the front camera 132 to ultra-wide angle (a perspective value of 100 degrees or more, the ultra-wide angle reference perspective value), and set the sensitivity to the high sensitivity mode (e.g., ISO sensitivity 3200), etc.
[0057] To achieve this, in the steps S101 and S111 of the shooting control process, just perform the process of setting the shooting parameters of the front camera 132 to the first pre-set value (thus, setting the set value when shooting with the front camera 132 through the shooting button of the operation unit 160), in step S113, perform the process of setting the shooting parameters of the front camera 132 to the second pre-set value, and in step S114, perform the process of shooting with the front camera 132. Thus, regarding the front camera 132, it is possible to appropriately perform shooting according to the conditions based on the position of the lens. For example, when the shooting device 100 is mounted on the wrist, it is set to the selfie mode, and after being detached from the wrist, it is set to the surveillance camera mode.
[0058] In addition, as the shooting parameters when the shooting device 100 is removed from the wrist, the set value for the rear camera 131 (the second set value) and the set value for the front camera 132 (the second pre-set value) can both be set to the same ultra-wide angle (180-degree perspective) fisheye lens shooting mode. Thus, it is possible to use these two cameras to shoot a 360-degree omnidirectional image.
[0059] In addition, the shooting ranges of the rear camera 131 and the front camera 132 only need to be at least partially different, and a part of the shooting ranges may also overlap. For example, by using a fish-eye lens, a part of the shooting ranges can be made to overlap. Further, in the above-described embodiment, the rear camera 131 is provided on the back surface of the main body 170, and the front camera 132 is provided on the front surface, but for example, two rear cameras 131 may be arranged at different positions on the back surface of the main body 170. In this case, the shooting ranges of the two rear cameras 131 also differ by the amount of deviation of the positions where the cameras are arranged, but a part of them overlaps.
[0060] Further, in the above-described embodiment, the wrist (arm) of the user is assumed as the mounting object portion of the photographing device 100, but the mounting object portion is not limited to the wrist of the user. Moreover, the mounting object portion is not limited to the human body (head, torso, feet, etc.), and any component can be used as the mounting object portion as long as it is configured such that mounting on the mounting object portion such as a column, a wall, or a pipe obstructs the light incident on the rear camera 131 or the illuminance sensor 141.
[0061] In addition, in the above-described embodiment, as the first condition for determining that the lens of the rear camera 131 is removed from the mounting object portion, the condition that the illuminance (ambient brightness) detected by the illuminance sensor 141 exceeds the first threshold is used, but the first condition is not limited to such a condition. As the first condition, any condition can be used as long as it is a condition that holds when the lens of the rear camera 131 is mounted on the mounting object portion by the mounting member. For example, instead of or in addition to the illuminance sensor 141, the photographing device 100 may further include a proximity sensor, and the condition that the mounting object portion is detected to be approaching by the proximity sensor may be used as the first condition.
[0062] In addition, in the above-described embodiment, as the second condition for determining the removal of the lens of the rear camera 131 from the mounting object portion, a condition of detecting a band as a mounting member from the image captured by the rear camera 131 is used. However, the second condition is not limited to such a condition. As the second condition, any condition can be used as long as it is a condition that holds when the lens of the rear camera 131 is not mounted on the mounting object portion through the mounting member. For example, when the rear camera 131 is an infrared camera (capable of blood vessel imaging by approaching the skin for imaging), if the first condition is satisfied, the shooting parameters of the rear camera 131 are set as the first set value for close-up shooting (macro shooting). As the second condition, a condition such as "no blood vessels are imaged when close-up shooting is performed by the rear camera 131" can also be used. In addition, in this case, in order to use the infrared camera removed from the wrist as a surveillance camera, a set value that makes the viewing angle wide (a viewing angle value equal to or greater than the wide-angle reference viewing angle value) is considered as the second set value.
[0063] In addition, when the imaging device 100 continuously displays the time on the display unit 150 like a watch, if it is determined that the device has been removed from the wrist, the time display on the display unit 150 can be stopped, etc., and the clock function can be shifted to the low power mode. In addition, when the imaging device 100 has a pulse sensor, if it is determined that the device has been removed from the wrist, power consumption can also be reduced by stopping the pulse sensor.
[0064] In addition, in the present embodiment, the bands 171 and 172 as the mounting members mount the main body 170 including all the structures of the imaging device 100 to the mounting object portion (wrist). However, the imaging device 100 may not be constituted by a single main body 170. For example, the imaging device 100 may be constituted in a form separated into a plurality of frames. In this case, the mounting member only needs to mount at least the lens of the rear camera 131 to the mounting object portion (for example, the wrist).
[0065] (Modification example)
[0066] As Figure 6 shown, a modification example is also considered in which, in a state where the imaging device 101 is mounted on the wrist, the upper end of the main body 170 can be lifted forward so that the user's front can be imaged by the rear camera 131. In addition, the rear camera 131 and the front camera 132 are provided near the upper end (the end connected to the band 171) of the main body 170. Although not shown, a hinge is provided at the lower end (the end connected to the band 172) of the main body 170, and the main body 170 is lifted about the hinge. The hinge rotates about a line that is perpendicular to the line connecting the midpoints of the upper and lower ends of the main body 170 and passes through the main body 170.
[0067] That is, the lens of the rear camera 131 is connected to the belt 172 via a hinge (movable part). Moreover, when the lens of the rear camera 131 is attached to the wrist by the belts 171 and 172, it can move freely (rotate freely) via the hinge between the position covered by the wrist (the first position) and the position not covered by the wrist (the second position).
[0068] Even when the imaging device 101 of the modified example is attached to the wrist, when the upper end of the main body 170 is lifted, it is impossible to detect that the imaging device 101 is attached to the wrist using the rear camera 131 and the illuminance sensor 141. This is because when the upper end of the main body 170 is lifted, even if the imaging device 101 is attached to the wrist, the incident light to the rear camera 131 and the illuminance sensor 141 is not obstructed (not blocked). Therefore, as long as the belts 171 and 172 are not photographed using the rear camera 131, it cannot be distinguished from the case where the imaging device 101 is not attached to the wrist. However, when the main body 170 is not lifted, the form of the imaging device 101 is exactly the same as that of the imaging device 100, and the same imaging control process can be applied. In addition, when the belts 171 and 172 are photographed using the rear camera 131, it can be determined that the imaging device 101 is in the state of being detached from the wrist, which is the same as the imaging device 100.
[0069] Therefore, in the imaging control process of the imaging device 101 of the modified example, when the belts 171 and 172 are not photographed using the rear camera 131, if there is an acceleration change or the surrounding brightness is low, the driving of the imaging element of the rear camera 131 is stopped. This is because even if imaging is performed when an acceleration change occurs, jitter occurs in the captured image, and when the surrounding brightness is low, normal imaging cannot be performed due to insufficient light quantity.
[0070] In this way, the imaging control process of the modified example changes Figure 4 a part of the imaging control process shown. Referring to Figure 7 and Figure 8 , the imaging control process of the modified example will be described. However, the difference between the process of Figure 7 and the process of Figure 4 is that the step S110 of Figure 4 is replaced by the step S120. When it is determined as No (A) in the step S120, it proceeds to the step S121 of Figure 8 . When returning (B) from the process of Figure 8 , it proceeds to the step S111. And except for this point, the process of Figure 7 is the same as the process of Figure 4 . Therefore, the following will focus on the differences for explanation.
[0071] If in Figure 7 it is determined as No in step S120 of Figure 8 , the processing proceeds to
[0072] where the processing unit 110 determines whether there is no acceleration change, that is, whether the value of the acceleration change calculated in step S109 is less than the acceleration change threshold (step S121). Figure 7 If the value of the acceleration change exceeds the acceleration change threshold (step S121; No), the processing returns to
[0073] step S111 of Figure 7 . In this case, considering the case where the photographing device 101 is attached to the wrist and the case of detachment, if it is attached to the wrist, it is determined that the hand is moving while the main body 170 is lifted, and if it is detached from the wrist, it is determined that the user is carrying it in a state of being put in a pocket or a bag or the like. In either case, based on the presence of acceleration change, normal photographing cannot be performed (jitter occurs in the photographed image), so the driving of the photographing element of the rear camera 131 is stopped in step S111.
[0073] If the value of the acceleration change is less than the acceleration change threshold (step S121; Yes), the processing unit 110 determines whether a condition (third condition) that the illuminance (ambient brightness) detected by the illuminance sensor 141 exceeds the second threshold is satisfied (step S122). In addition, this second threshold is a value determined to be the lowest brightness value at which an object can be photographed when the rear camera 131 is set to the normal photographing mode (more precisely, the photographing parameters of the rear camera 131 are set to the third set value described later). In addition, as described above, the first threshold is a value determined to be the lowest brightness value at which the belts 171 and 172 can be photographed when the camera is set to the high-sensitivity mode. Therefore, generally, the second threshold is a value larger than the first threshold, but the second threshold can also be the same value as the first threshold.
[0074] If the illuminance is less than the second threshold (step S122; No), the processing returns to Figure 7Step S111. In this case, consider the situation where the photographing device 101 is mounted on the wrist (for example, when the main body 170 is lifted, or when there is a gap between the photographing device 101 and the wrist allowing ambient light to enter the illuminance sensor 141), and the situation of detachment (for example, when the user holds the bands 171, 172 in an unfolded state, etc., where the device is detached from the wrist but the bands 171, 172 are not photographed). When the main body 170 is lifted or the user holds the bands 171, 172 in an unfolded state, it is also possible to consider proceeding to step S123 for photographing without returning to step S111. However, when there is a gap between the photographing device 101 and the wrist allowing ambient light to enter the illuminance sensor 141, photographing should not be performed. Also, when the illuminance is less than the second threshold, the processing unit 110 cannot distinguish these various situations. Therefore, in this modified example, in any case, the light amount is insufficient for normal photographing, so these various situations are not distinguished and the process returns to step S111.
[0075] If the illuminance exceeds the second threshold (step S122; yes), the processing unit 110 sets the photographing parameters of the rear camera 131 to a third set value (step S123). The third set value is a set value determined according to the content that the user wants to photograph using the rear camera 131 in the state of lifting the main body 170 (for example, landscape photographing, surveillance photographing, etc.). The perspective is selected to be other than wide angle (for example, normal, telephoto). Additionally, regarding the sensitivity, the optimal set value is selected according to the ambient brightness. Furthermore, the above-mentioned second set value is the set value when the photographing device 101 is removed from the wrist. Therefore, as a surveillance camera, it is a set value that reduces the frame rate compared to normal to lower power consumption. On the other hand, it is considered that the user wants to actively use the rear camera 131 for photographing and lifts the main body 170, or removes the photographing device 101 and holds the bands 171, 172 in an unfolded state. Therefore, the third set value is a set value for photographing landscapes, etc., and is a set value with the frame rate being normal.
[0076] Next, the processing unit 110 performs photographing using the rear camera 131 (step S124). In this step, photographing is performed on the content that the user wants to photograph using the rear camera 131 in the state of lifting the main body 170 (or the state where the user removes the photographing device 101 from the wrist and unfolds and holds the bands 171, 172), such as landscape photographing and surveillance photographing.
[0077] Then, the processing unit 110 determines whether the illuminance (ambient brightness) detected by the illuminance sensor 141 is less than the second threshold (step S125). If the illuminance exceeds the second threshold (step S125; no), the process returns to step S124.
[0078] If the illuminance is less than the second threshold (step S125; YES), the process returns to Figure 7 step S111 of Figure 7 . In this case, consider the case where the main body 170 is pressed while the photographing device 101 is mounted on the wrist, the case where the bands 171 and 172 are removed from the wrist and unfolded and the photographing device 101 held by the user is put into a pocket or a bag, etc. In any case, since the amount of light is insufficient to perform normal photographing, the process returns to step S111 in this modified example.
[0079] With the photographing control device of the above modified example, the photographing device 101 can appropriately perform photographing according to the conditions based on the position of the rear camera 131. That is, when the first condition is satisfied because it is temporarily determined that the photographing device 101 has detached from the wrist, the processing unit 110 sets the viewing angle of the rear camera 131 to wide angle for photographing and attempts to detect the bands 171 and 172. And, when the second condition is satisfied because it is determined that the photographing device 101 has detached from the wrist by detecting the bands 171 and 172, the processing unit 110 sets photographing parameters so that landscape photographing and surveillance photographing can be performed using the rear camera 131.
[0080] In addition, when the illuminance detected by the illuminance sensor 141 exceeds the second threshold and the third condition is satisfied without detecting the bands 171 and 172, it is considered that the main body 170 is lifted, or the state where the bands 171 and 172 are held in an extended state after being removed from the wrist. Therefore, the processing unit 110 sets photographing parameters so that landscape photographing and surveillance photographing can be performed using the rear camera 131. When the second condition is satisfied, the bands 171 and 172 will be photographed when the viewing angle of the rear camera 131 is set to wide angle, but when the third condition is satisfied, the bands 171 and 172 will not be photographed even when the viewing angle of the rear camera 131 is set to wide angle. Therefore, compared with the photographing parameters when the second condition is satisfied, the degree of freedom of setting can be increased for the photographing parameters when the third condition is satisfied.
[0081] In addition, in the photographing device 101, when the rear camera 131 does not detect the bands 171 and 172, the possibility of being in a state where the main body 170 is lifted while being mounted on the wrist is considered. That is, if the acceleration change is less than the acceleration change threshold and the surrounding brightness exceeds the second threshold, the processing unit 110 determines that the user has lifted the main body 170 while the photographing device 101 is mounted. And, in this case, the photographing parameters are set according to the content that the user wants to photograph using the rear camera 131 in the state where the main body 170 is lifted. Therefore, the photographing device 101 can lift the main body 170 even in the mounted state and perform photographing with the photographing parameters desired by the user using the rear camera 131.
[0082] In addition, regardless of whether the main body 170 is lifted or whether it is installed, if the ambient brightness is less than the second threshold value, the imaging device 101 cannot perform normal imaging. Therefore, in this case, the imaging device 101 can stop driving the imaging element of the rear camera 131 to reduce power consumption.
[0083] In addition, in the above-described modification, the rear camera 131 is controlled in the imaging control process, but the front camera 132 can also be controlled. For example, when it is determined that the imaging device 101 is mounted on the wrist and the main body 170 is not lifted, a set value (front first set value) for imaging the user's face or for authentication imaging can be set. When it is determined that the device has been detached from the wrist, a set value (front second set value) for landscape imaging or surveillance imaging can be set. When it is determined that the device is mounted on the wrist and the main body 170 is lifted, another set value (front third set value) for landscape imaging or surveillance imaging can be set. As the front first set value, for example, as a set value for self-portrait, in order to be able to image the user's face at close range with high image quality, it is considered to set the viewing angle of the front camera 132 to wide angle (a viewing angle value equal to or greater than the wide-angle reference viewing angle value. For example, a viewing angle set value at which the focus is on the face when the front camera 132 is positioned in front of the user's face), and the sensitivity is set to the medium sensitivity mode (when the sensitivity is reduced, the image quality is improved. Therefore, for example, the ISO sensitivity is 400).
[0084] In addition, as the first front set value, a set value for authentication is also considered. For example, a set value for iris authentication (a macro viewing angle set value at which the focus is on the iris when the front camera 132 is positioned in front of the user's eyeball), a set value for face authentication (the same set value as the set value for self-portrait), a set value for fingerprint authentication (a macro viewing angle set value at which the focus is on the fingerprint when the front camera 132 is positioned in front of the finger for fingerprint authentication), etc. In addition, as the front second set value and the front third set value, for example, in order to be able to magnify a distant landscape and image it with high image quality, it is considered to set the viewing angle of the front camera 132 to telephoto (a viewing angle value less than the telephoto reference viewing angle value (for example, 30 degrees)), the sensitivity is set to the medium sensitivity mode (for example, the ISO sensitivity is 400), and for surveillance, the viewing angle of the front camera 132 is set to ultra-wide angle (a viewing angle value equal to or greater than the ultra-wide angle reference viewing angle value (for example, 100 degrees)), and the sensitivity is set to the high sensitivity mode (for example, the ISO sensitivity is 3200).
[0085] For this purpose, as long as in the steps S101 and S111 of the shooting control process, the shooting parameters of the front camera 132 are also set to the first front setting value (thus, the setting value for shooting with the front camera 132 is set by operating the shooting button of the operation unit 160), in the step S113, the shooting parameters of the front camera 132 are also set to the second front setting value, in the step S114, the process of shooting with the front camera 132 is also performed, in the step S123, the shooting parameters of the front camera 132 are also set to the third front setting value, and in the step S124, the process of shooting with the front camera 132 is also performed. Thus, regarding the front camera 132, for example, when the shooting device 101 is mounted on the wrist and the main body 170 is not lifted, it is set to the self-timer mode, when the main body 170 is lifted, it is set to the landscape shooting mode, and when it is detached from the wrist, it is set to the surveillance camera mode. In this way, shooting can be appropriately performed according to the conditions based on the position of the lens.
[0086] In addition, regarding the above-described modification example, a hinge is used as the movable member, and the main body 170 is rotated about the hinge as the rotation axis, so that the position of the lens of the rear camera 171 can move freely between the first position and the second position. However, the movable member is not limited to a hinge. For example, like a slide-type mobile phone, the shooting device 101 may also have a slide mechanism that enables the main body 170 to slide in a predetermined direction (for example, the direction in which the bands 171 are connected) as the movable member.
[0087] In the shooting device 101 having a slide mechanism, the lens of the rear camera 131 is connected to the bands 171 and 172 via the slide mechanism. And in the state where the lens of the rear camera 131 is mounted on the wrist through the bands 171 and 172, it can move freely between the first position (the position covered by the wrist) and the second position (the position not covered by the wrist) where the positions on the optical axis are different, through the slide mechanism.
[0088] The shooting device 101 having a slide mechanism can apply the same shooting control process as the shooting device 101 using the above-described hinge by replacing the "state where the main body 170 is lifted" in the shooting device 101 using the above-described hinge with the "state where the main body 170 slides". That is, it is considered that when the first condition is satisfied, the lens of the rear camera 131 is in the state of being mounted on the wrist and not sliding, when the second condition is satisfied, the lens of the rear camera 131 is in the state of being detached from the wrist, and when the third condition is satisfied, the lens of the rear camera 131 is in the state of being mounted on the wrist and sliding, or in the state of being held by the user with the bands 171 and 172 unfolded after being detached from the wrist. Therefore, the processing unit 110 can set shooting parameters suitable for each state.
[0089] In addition, each function of the photographing devices 100 and 101 can also be implemented by a general computer such as a PC. Specifically, in the above-described embodiment, it has been described that a program for photographing control processing and the like executed by the photographing devices 100 and 101 is pre-stored in the ROM of the storage unit 120. However, the program can also be stored in a computer-readable recording medium such as a floppy disk, a CD-ROM (Compact Disc ReadOnly Memory), a DVD (Digital Versatile Disc), an MO (Magneto-Optical disc), a memory card, or a USB (Universal Serial Bus) memory for distribution, and the program can be read into the computer for installation, thereby constituting a computer capable of implementing the above-described various functions.
[0090] Furthermore, the program can also be superimposed on a carrier wave and applied via a communication medium such as the Internet. For example, the program can also be distributed by posting it on a bulletin board (BBS: Bulletin Board System) on a communication network. Also, it can be configured to start the program and execute it in the same manner as other application programs under the control of the OS (Operating System), whereby the above-described processing can be performed.
[0091] In addition, the processing unit 110 can be constituted not only by an arbitrary single processor such as a single-processor, a multi-processor, or a multi-core processor, but also by combining these arbitrary processors with a processing circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field-Programmable Gate Array).
Claims
1. A photographing device, characterized in that, comprising: a lens that guides reflected light from a subject to an imaging element; a mounting member that mounts at least the lens to a mounting target portion; an illuminance sensor that is covered by the mounting target portion when the lens is mounted to the mounting target portion by the mounting member; and a processing unit, the lens is arranged to be in a first position covered by the mounting target portion when mounted to the mounting target portion by the mounting member, when the illuminance detected by the illuminance sensor exceeds a first threshold, the processing unit determines that a first condition is satisfied, and sets a shooting parameter of at least one of the imaging element and the lens to a first set value that enables the lens and the imaging element to shoot the mounting member; when the mounting member is captured in an image obtained by shooting using the lens and the imaging element in a state where the shooting parameter is set to the first set value, the processing unit determines that a second condition is satisfied, and sets the shooting parameter to a second set value, and the second set value is used to shoot content different from the mounting member.
2. The shooting device according to claim 1, wherein when the imaging element is activated, if the illuminance is less than the first threshold, the processing unit stops driving the imaging element.
3. The shooting device according to claim 1 or 2, wherein the lens is connected to the mounting member via a movable member, in a state where the lens is mounted to the mounting target portion by the mounting member, the lens is movable between the first position and a second position not covered by the mounting target portion via the movable member, the processing unit shoots using the lens and the imaging element in a state where the shooting parameter is set to the first set value, thereby obtaining an image, the processing unit determines whether the mounting member is captured in the obtained image, even if the mounting member is not captured in the obtained image, if the illuminance exceeds a second threshold that is higher than the first threshold, the processing unit also determines that a third condition is satisfied, in a case where the first condition is satisfied and a case where the third condition is satisfied, the processing unit makes the shooting parameter different.
4. The shooting device according to claim 3, wherein when the imaging element is activated, if the third condition is not satisfied, the processing unit stops driving the imaging element.
5. The shooting device according to claim 1 or 2, wherein the shooting device further includes an acceleration sensor, the processing unit shoots using the lens and the imaging element in a state where the shooting parameter is set to the first set value, thereby obtaining an image, the processing unit determines whether the mounting member is captured in the obtained image and whether a change amount of the acceleration detected by the acceleration sensor is less than an acceleration change threshold, if the mounting member is captured in the obtained image and the change amount of the acceleration is less than the acceleration change threshold, the processing unit determines that the second condition is satisfied.
6. The imaging device according to claim 1 or 2, wherein: the lens and the imaging element are a first lens and a first imaging element respectively; the imaging device further has a second lens and a second imaging element with a different imaging range from that of the first lens and the first imaging element; when the second condition is satisfied and when it is not satisfied, imaging parameters of at least one of the second lens and the second imaging element are made different.
7. The imaging device according to claim 6, wherein: when the second condition is satisfied, imaging parameters of at least one of the second lens and the second imaging element are made the same as imaging parameters of at least one of the first lens and the first imaging element.
8. The imaging device according to claim 1, wherein: the first condition includes a case where the lens is mounted on the mounting object portion through the mounting member as a condition; the second condition includes a case where the lens is not mounted on the mounting object portion through the mounting member as a condition.
9. The imaging device according to claim 8, wherein: the lens is connected to the mounting member via a movable member; in a state where the lens is mounted on the mounting object portion through the mounting member, the lens can move freely between a first position and a second position where positions of the optical axis of the lens with respect to the mounting object portion are different from each other; the first condition includes a case where the lens is located at the first position; the second condition includes a case where the lens is located at the second position.
10. A control method for an imaging device, the imaging device having: a lens that guides reflected light from a subject to an imaging element; a mounting member that mounts at least the lens to a mounting object portion; an illuminance sensor that is covered by the mounting object portion when the lens is mounted on the mounting object portion through the mounting member; and a processing unit, the lens being arranged to be located at a first position covered by the mounting object portion in a state where the lens is mounted on the mounting object portion through the mounting member, wherein: when the illuminance detected by the illuminance sensor exceeds a first threshold, the processing unit determines that the first condition is satisfied and sets imaging parameters of at least one of the imaging element and the lens to a first set value that enables the lens and the imaging element to image the mounting member; when the mounting member is imaged in an image obtained by imaging using the lens and the imaging element in a state where the imaging parameters are set to the first set value, the processing unit determines that the second condition is satisfied and sets the imaging parameters to a second set value, the second set value being used to image something different from the mounting member.
11. A recording medium storing a program for a computer of an imaging device, wherein: The imaging device has: a lens that guides reflected light from a subject to an imaging element; a mounting member that mounts at least the lens to a mounting target portion; an illuminance sensor that is covered by the mounting target portion when the lens is mounted to the mounting target portion by the mounting member; and a processing unit. The lens is disposed at a first position covered by the mounting target portion in a state where the lens is mounted to the mounting target portion by the mounting member. The program causes the computer to execute the following: When the illuminance detected by the illuminance sensor exceeds a first threshold, it is determined that a first condition is satisfied, and a shooting parameter of at least one of the imaging element and the lens is set to a first set value that enables the lens and the imaging element to image the mounting member. When the mounting member is imaged in an image obtained by imaging using the lens and the imaging element in a state where the shooting parameter is set to the first set value, it is determined that a second condition is satisfied, and the shooting parameter is set to a second set value that is used to image content different from the mounting member.
Citation Information
Patent Citations
Watch type portable electronic device
JP2003244294A
Imaging device, method for controlling same, program, and storage medium
WO2019124056A1