Electronic device, imaging device, and control method
The electronic device uses millimeter-wave radar and gyro/acceleration sensors to control power supply based on user interaction, addressing power management challenges in complex portable devices by entering power-saving modes when not in use, thus optimizing battery life and user convenience.
Patent Information
- Application Number
- JP2021131007
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-08-11
- Publication Date
- 2026-01-13
- Estimated Expiration
- 2041-08-11
AI Technical Summary
Existing technologies struggle to efficiently control power supply in portable electronic devices with complex operations, such as imaging devices, due to unpredictable user interactions, leading to increased power consumption and reduced shot count or recording time.
An electronic device equipped with a first detection means for human body detection using millimeter-wave radar and a second detection means for posture and movement, utilizing gyro and acceleration sensors, to control power supply based on user interaction and device state, entering power-saving modes when not in use.
Accurately estimates user interaction and device state to efficiently manage power consumption, preventing interruptions during use while conserving battery life.
Smart Images

Figure 0007797135000001 
Figure 0007797135000002 
Figure 0007797135000003
Abstract
Description
[Technical Field]
[0001] The present invention relates to an electronic device, an imaging device, and a control method. [Background technology]
[0002] There have been proposed devices and apparatuses that detect the state of the human body or electronic devices and change control depending on the detection results. Patent Document 1 discloses a vehicle control system that acquires vehicle information, estimates future operation needs of multiple control means, and determines the operation states of the multiple control means based on the estimation results. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2012-1020 Summary of the Invention [Problem to be solved by the invention]
[0004] The vehicle control system disclosed in Patent Document 1 predicts the driver's next operational needs from operational patterns based on operations within an operational range corresponding to the vehicle and the vehicle's state, and controls the vehicle, etc. However, when the controlled object is a portable electronic device that the user can carry in their hand, the user operates it with random and complex movements, making it difficult for the technology disclosed in Patent Document 1 to predict operational needs without false detection or malfunction.
[0005] Portable electronic devices include a wide variety of devices, and the relationship between their actions and operations varies. For example, smartphones, tablet devices, and portable game consoles can be operated by facing the screen directly to the user, or by activating a built-in camera located on the back or within the screen and pointing it at a subject to take a picture.
[0006] One example of a portable electronic device with a complex operation and control system is an imaging device (for example, a digital single-lens reflex camera or mirrorless camera). Taking the imaging operation as an example, an imaging device can be in a state where the user places their eye on the viewfinder and tracks the subject, a state where the user performs live view shooting or operation while looking at the LCD screen on the back of the imaging device, or a state where the imaging device is attached to a fixture such as a tripod and photographs are taken. Furthermore, from these states, there are also states where the imaging device is photographed in a normal position or portrait orientation. There are also a wide variety of states where the user operates various operating components, performs panning as a photography technique, takes their line of sight away from the imaging device and looks at the subject, or simply holds the imaging device.
[0007] Recent imaging devices are equipped with attitude detection sensors, proximity detection sensors, and acceleration sensors. However, it is difficult for these sensors alone to distinguish between a state in which a user is holding the imaging device up and looking at a subject, and a state in which the user is tracking the subject while viewing a live view image on an LCD screen.
[0008] In recent years, interchangeable-lens digital cameras, an example of an imaging device, have been increasingly becoming mirrorless. Mirrorless cameras eliminate the mirrors and pentaprisms used to guide the light beam from the interchangeable lens to the viewfinder and instead use an EVF (Electronic Viewfinder). This allows images captured using an image sensor to be displayed as video in the viewfinder. Furthermore, the incorporation of various sensors allows real-time detection of camera status, such as camera attitude and motion.
[0009] As imaging devices become mirrorless, the electronic functionality of each component increases power consumption, resulting in a decrease in the number of possible shots and video recording time. Increasing the number of possible shots and video recording time while maintaining current power consumption requires increasing the battery capacity, which also raises concerns about the camera becoming larger and heavier. Therefore, imaging devices are required to efficiently control their power supply, such as by frequently entering a power-saving mode when not in use by the user. The present invention aims to provide an electronic device capable of efficiently controlling power supply according to the operation and state of the electronic device. [Means for solving the problem]
[0010] An electronic device according to one embodiment of the present invention includes a first detection means for detecting whether an object is a human body based on the results of transmission and reception of radio waves of a specific wavelength, a second detection means for detecting the posture or movement of the electronic device, and a control means for controlling the power supply to the electronic device based on the detection results of the first detection means and the second detection means. The control means includes control relating to reduction of power consumption of the electronic device, and when the first detection means detects a human body whose distance from the electronic device is equal to or less than a threshold and the detection result of the second detection means is not equal to or greater than a predetermined value, the control means does not perform control relating to reduction of power consumption of the electronic device, and when the first detection means detects a human body whose distance from the electronic device is equal to or less than a threshold and the detection result of the second detection means is equal to or greater than a predetermined value, the control means performs control relating to reduction of power consumption of the electronic device. . [Effects of the Invention]
[0011] The electronic device of the present invention has an object to provide an electronic device that can efficiently control the power supply according to the operation and state of the electronic device. [Brief explanation of the drawings]
[0012] [Figure 1] FIG. 1 is a diagram illustrating an external appearance of an electronic device. [Figure 2] FIG. 2 is an example of an exploded perspective view of an imaging device. [Figure 3] FIG. 2 is an example of a functional block diagram of an imaging device. [Figure 4] 1A and 1B are diagrams illustrating the imaging device as viewed from the rear side and the top side. [Figure 5] 4 is a flowchart showing an operation process of the imaging apparatus of the first embodiment. [Figure 6] 4 is a flowchart showing an operation process of the imaging apparatus of the first embodiment. [Figure 7]FIG. 10 is a diagram illustrating a configuration of an imaging apparatus according to a second embodiment. [Figure 8] 10 is a flowchart showing an operation process of the imaging apparatus according to the second embodiment. [Figure 9] 10 is a flowchart showing an operation process of the imaging apparatus according to the second embodiment. DETAILED DESCRIPTION OF THE INVENTION
[0013] Example 1 FIG. 1 is a diagram showing the appearance of an electronic device according to this embodiment. 1, an imaging device will be described as an example of an electronic device. However, the scope of application of the present invention is not limited to imaging devices. The present invention can be applied to any electronic device other than imaging devices, such as smartphones, tablet terminals, and portable game consoles.
[0014] 1 has a housing shape in which a normal position grip part 101 and a vertical position grip part 102 are integrated. The normal position grip part 101 is used by a user to grip the imaging device 100 when the imaging device 100 is in the normal position. The vertical position grip part 102 is used by a user to grip the imaging device 100 when the imaging device 100 is in the vertical position.
[0015] The normal position operation member 104 is an operation member used when shooting in portrait position. The vertical position operation member 105 is an operation member used when shooting in portrait position. When shooting in portrait position, it is possible to disable operation input using the vertical position operation member 105 under control of the central processing unit 301 (FIG. 3). This makes it possible to prevent malfunctions even if the user accidentally touches the vertical position operation member 105 when shooting in the normal position. The physical operation member 106 is a general term for operation members that the user physically operates. The TFT display unit 103 is a display device that displays predetermined information. TFT is an abbreviation for Thin Film Transistor. The TFT display unit 103 displays, for example, a menu screen, information about played images, etc.
[0016] FIG. 2 is an example of an exploded perspective view of the imaging device. The front cover unit 201 is an exterior cover on the front side of the imaging device 100. The front cover unit 201 also serves as a chassis that maintains the rigidity of the imaging device 100. For example, the front cover unit 201 is mainly made of a lightweight and strong magnesium alloy.
[0017] The front cover unit 201 is also fitted with a lens mount for lens attachment and electrical communication, electrical contact pins, front physical operation buttons, ear loops for hanging a strap, etc. The front cover unit 201 is combined with a bottom cover (not shown) to form a battery compartment for accommodating a battery 208.
[0018] The front surface of the front cover unit 201 is the exterior surface, and is therefore painted for aesthetic purposes, and further has attached thereto grip rubber 608 made of NBR / PVC or the like for gripping the imaging device 100. Each unit, which will be described later, is assembled in order so as to be stacked on the back surface of the front cover unit 201.
[0019] The EVF unit 202 includes an eyepiece, a diopter adjustment mechanism, an organic EL (Electro Luminescence) liquid crystal panel, and an eyepiece detection sensor (proximity sensor) that detects when the eye is placed near the EVF unit 202. The EVF unit 202 is connected to the main board unit 206 via an FPC. FPC is an abbreviation for Flexible Printed Circuits. A commonly used eyepiece detection sensor is one that emits infrared light and detects the proximity of an object based on the presence or absence of light reflected off the object. The eyepiece detection sensor detects whether the user has placed their eye near the EVF unit 202.
[0020] Furthermore, the user can check the shooting angle of view by displaying in real time the image captured by the imaging unit 205 on an organic EL liquid crystal panel arranged in the EVF unit 202. The EVF unit 202 can also display information similar to the menu screen and playback image information displayed on the TFT display section 103, allowing the user to check the displayed information while keeping their eye on the EVF unit 202.
[0021] Top cover unit 203 is provided with a release button, an accessory shoe, normal position operation member 104 for changing settings during shooting, and a liquid crystal panel for displaying the status set by normal position operation member 104. Top cover unit 203 is an exterior part and needs to be strong enough to withstand shocks such as being dropped, so it is made of, for example, a magnesium alloy and has a painted exterior surface.
[0022] The shutter unit 204 determines the exposure amount. The shutter unit 204 has, for example, a focal plane shutter, a mechanical shutter equipped with a sequence mechanism, or the like. Note that the imaging device 100 may also employ an electronic shutter that determines the exposure amount by forming an electrical slit for each pixel column of the imaging element. Alternatively, a combination of an electronic shutter and a mechanical shutter may be used to form a slit and use it to determine the exposure amount.
[0023] The imaging unit 205 functions as an imaging means for capturing an image of a subject. The imaging unit 205 photoelectrically converts subject light and outputs a signal related to the captured image. The imaging unit 205 includes an imaging drive circuit, an imaging element, an A / D conversion circuit, and a stabilizer unit. The imaging drive circuit drives the imaging element. The imaging element performs photoelectric conversion of subject light and outputs an analog signal. The imaging element is, for example, a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS). The A / D conversion circuit converts the analog signal output by the imaging element into a digital signal. The stabilizer unit vibrates the imaging element using a drive method that utilizes electromagnetic force. This corrects blurring (image blur) that occurs in the captured image due to shaking or vibration of the imaging device 100.
[0024] The main board unit 206 is a multi-layer board that controls the entire image pickup device 100. The main board unit 206 is mounted with ICs such as a central processing unit 301 and a nonvolatile memory 302, connectors for connecting FPCs extending from each unit, and the like.
[0025] The rear cover unit 207 is an exterior component on the rear side of the imaging device 100. The rear cover unit 207 is provided with the TFT display unit 103 and a touch operation unit 306 (FIG. 3). The TFT display unit 103 has a vari-angle mechanism that can be opened, closed, and rotated, and is equipped with a liquid crystal panel. When the vari-angle mechanism is open, the TFT display unit 103 is in an open state, and when the vari-angle mechanism is closed, the TFT display unit 103 is in a closed state.
[0026] Also, various physical operation members 106 are arranged inside the rear cover unit 207 and are used to select a focus point when capturing an image, change settings on the imaging device 100, and play, erase, and edit captured images. The rear cover unit 207 is an exterior part and must be strong enough to withstand shocks such as being dropped, so it is made of, for example, a magnesium alloy and has a painted exterior surface.
[0027] FIG. 3 is an example of a functional block diagram of the imaging device. The imaging device 100 includes a TFT display unit 103 to a millimeter-wave radar device 309. A central processing unit 301 controls the entire imaging device 100. The central processing unit 301 includes a microprocessor and the like that executes various processes of the imaging device 100. The central processing unit 301, nonvolatile memory 302, main storage device 303, and image processing unit 305 are realized by ICs or microcomputers.
[0028] The touch operation unit 306 is an operation unit used for touch operations. The gyro sensor 307 or acceleration sensor 308 is a sensor that functions as a second detection unit. The gyro sensor 307 is a sensor that uses Coriolis force to detect changes in the rotation or orientation of the image capture device 100 as angular velocity and outputs the angular velocity as an electrical signal. The gyro sensor 307 is mounted on an FPC (not shown) and can detect angular velocity in the X, Y, and Z axis directions. For this purpose, three sensors serving as the gyro sensor 307 are disposed inside the top cover unit 203 and are held between sponges or the like to prevent them from being affected by unnecessary vibrations or shocks from the image capture device 100.
[0029] The central processing unit 301 estimates the shake and vibration direction of the image capture device 100 based on the output result of the gyro sensor 307. The central processing unit 301 performs feedback control using the stabilizer unit so that the image capture element swings in a direction that cancels the estimated shake, thereby correcting image blur that occurs in the captured image.
[0030] The acceleration sensor 308 is one of inertial sensors designed to measure gravity, movement, vibration, and shock, and is a sensor that detects three-dimensional inertial movement (translational movement in three orthogonal axial directions) of the image capture device 100. The acceleration sensor 308 can use, for example, a frequency change type, a piezoelectric type, a piezo-resistance type, or a capacitance type detection method. The output value of the acceleration sensor 308 can detect the movement of the image capture device 100 in the X-, Y-, and Z-axes, translational directions, and gravity direction. The output values of the gyro sensor 307 and the acceleration sensor 308 can be combined to determine the attitude or movement state of the image capture device 100.
[0031] The central processing unit 301 receives a signal related to a captured image output by the imaging unit 205, and outputs the signal as a video signal to the organic EL liquid crystal panel in the TFT display unit 103 or the EVF unit 202. The central processing unit 301 also develops the video signal as image data and performs processes such as recording the image data in a storage medium 304 and reading out the stored image from the storage medium 304.
[0032] The nonvolatile memory 302 stores in advance a control program for controlling the device, such as imaging, an operating system (OS), etc. The nonvolatile memory 302 also stores, for example, setting information, information to be retained even when the imaging device 100 is powered off, and transferred information generated each time image data is transferred. The nonvolatile memory 302 includes a flash memory, etc. The main storage device 303 is used to temporarily store data from the image processing unit 305. The main storage device 303 includes a RAM (Random Access Memory), etc.
[0033] Image data obtained by capturing images is stored in the storage medium 304. For example, a slot-type connector socket is mounted on the main board unit 206, and the card-type storage medium 304 is detachable and replaceable via the connector socket.
[0034] The image processing unit 305 performs image processing such as object recognition, image analysis of captured images and videos, etc. When the image processing unit 305 recognizes an object, the central processing unit 301 calculates and defines the range of the recognized object, and the recognized range (zone) can be displayed on the TFT display unit 103.
[0035] The millimeter-wave radar device 309 is a radar device that functions as a first detection means. The millimeter-wave radar device 309 detects targets based on the results of transmitting and receiving millimeter waves, an example of radio waves with a specific wavelength. The millimeter-wave radar device 309 uses a device called a synthesizer to generate millimeter-wave signals and transmit them from a transmitting TX antenna. The millimeter-wave radar device 309 continuously emits millimeter-wave signals while gradually changing their frequency using a continuous frequency modulation method and detects targets by measuring the reflected waves reflected from the target. The reflected waves are received by a receiving RX antenna. An IF signal is generated by mixing the transmitted millimeter-wave signal with the received reflected wave signal. The distance to the target is then calculated based on the IF signal. The millimeter-wave radar device 309 performs continuous ranging based on the time delay difference of the reflected waves, thereby determining the distance to the target, the target's speed, the target's direction, the presence of the object, and its approximate shape.
[0036] FIG. 4 is a diagram showing an example of the imaging device as viewed from the rear side and from the top side. Fig. 4(A) shows the imaging device 100 as viewed from the rear side. Fig. 4(B) shows the imaging device 100 as viewed from the top side. In the example shown in Figs. 4(A) and (B), the imaging device 100 has the top cover unit 203 removed, the vari-angle mechanism open, and the TFT display unit 103 open toward the photographer.
[0037] In this embodiment, the millimeter-wave radar device 309 is provided at a position where it can detect an object on the opposite side from the subject side. In the example shown in FIG. 4 , the millimeter-wave radar device 309 is mounted on an FPC (not shown) and is disposed at a predetermined angle near the right side of the EVF unit 202. The detection range 401 of the millimeter-wave radar device 309 is generally approximately 60° horizontally and 40° vertically. Therefore, when disposing the millimeter-wave radar device 309 near the right side of the EVF unit 202, it is preferable to dispose the millimeter-wave radar device 309 so that the detection range 401 of the millimeter-wave radar device 309 includes an eyepoint range 402 and a predetermined range 403 at the end of the vari-angle mechanism. The eyepoint range 402 is a predetermined range near the end of the eyepiece of the EVF unit 202.
[0038] Millimeter waves have the property of penetrating parts made of low-dielectric plastic, glass, and the like, and can therefore pass through the resin parts and eyepiece lens group of the image capture device 100, as shown in Figure 4(B). Therefore, by positioning the millimeter-wave radar device 309 so that the detection range 401 includes the eyepoint range 402 and a predetermined range 403 at the end of the variable-angle mechanism, it is possible to detect objects within a predetermined distance even when it is positioned inside the image capture device 100. Furthermore, by having the millimeter-wave radar device 309 take on the roles of a proximity sensor that detects the eyepiece and a magnetic detection-type GMR sensor that detects the opening, closing, and rotation of the variable-angle mechanism, it is possible to reduce costs and size.
[0039] 5 and 6 are flowcharts showing the operation process of the imaging apparatus of the first embodiment. The processing according to this flowchart is realized by the control of the central processing unit 301 (FIG. 3). The central processing unit 301 estimates the state of the image capture device 100 based on the output results of the gyro sensor 307, the acceleration sensor 308, and the millimeter-wave radar device 309. The central processing unit 301 then controls the power supply to the image capture device 100 according to the estimated state. The control of the power supply performed by the central processing unit 301 includes control related to reduction in power consumption. Control related to reduction in power consumption is performed by, for example, turning on the power saving mode of the image capture device 100 or turning off the power of the image capture device 100. Not performing control related to reduction in power consumption is, for example, turning off the power saving mode of the image capture device 100 or keeping the power of the image capture device 100 on.
[0040] As an example of control related to reduction of power consumption, a control to set the imaging device 100 into a sleep state for power saving by turning on the power saving mode will be described. The power saving mode is a mode in which, for example, power supply to various devices and units inside the imaging device 100 is minimized and control monitoring is not performed on anything other than sensors and operation members that trigger a return to the normal state, thereby reducing power consumption.
[0041] The processing of S501 starts when the imaging device 100 is powered on and a predetermined time has elapsed. In S501, the central processing unit 301 determines whether the imaging device 100 is in a state where it can be remotely controlled. The central processing unit 301 determines whether it can be remotely controlled, for example, by checking whether a remote control is connected to a remote control terminal of the imaging device 100 and whether a remote control device is connected wirelessly via Bluetooth or the like. If a remote control is connected to the remote control terminal and there is a remote control device connected wirelessly, the central processing unit 301 determines that the imaging device 100 is in a state where it can be remotely controlled. If a remote control is not connected to the remote control terminal or there is no remote control device connected wirelessly, the central processing unit 301 determines that the imaging device 100 is not in a state where it can be remotely controlled.
[0042] If the imaging device 100 is in a state where remote control is possible, the process proceeds to S512 in FIG. 6 . When a user remotely controls the imaging device 100 using a remote control device such as a remote control vise, the output results of the gyro sensor 307, acceleration sensor 308, and millimeter-wave radar device 309 may change frequently and in complex ways depending on the shooting settings, composition settings, the photographer's behavior, etc. Changing control depending on the shooting settings, composition settings, the photographer's behavior, etc. may impair the user's shooting or operation. Therefore, in S512, the central processing unit 301 turns off the power-saving mode and controls the imaging device 100 not to enter a sleep state so as not to interfere with the user's shooting or operation. This ensures that all functions of the imaging device 100 remain immediately available and does not enter a power-saving sleep state even after a predetermined time has elapsed. Furthermore, if the imaging device 100 has entered a power-saving sleep mode, the central processing unit 301 performs a return operation from the sleep mode.
[0043] If the image capturing device 100 is not in a state where it can be remotely controlled, the process proceeds to S502. In S502, the central processing unit 301 checks the detection result of the first detection means (millimeter wave radar device 309).
[0044] Based on the confirmed detection result, the central processing unit 301 determines whether the millimeter-wave radar device 309 has detected an object whose distance from the image capture device 100 is equal to or less than a threshold, i.e., an object at a short distance. For example, when a user looks through the viewfinder, the distance to the user as an object is considered to be short. Also, for example, when a user holds the image capture device 100 in their hand and captures or checks an image while checking the display content on the TFT display unit 103, the distance to the user as an object is considered to be long. Therefore, in this embodiment, for example, the threshold is set to approximately 30 mm, which is the eyepoint distance of a typical image capture device 100, and a distance equal to or less than this threshold is considered to be short. Also, for example, the threshold is set to approximately 300 mm, which is the distance to the body or head when the user holds the image capture device 100 in their hand and looks at the TFT display unit 103, and a distance equal to or greater than this threshold is considered to be long. Of course, the thresholds used as the references for short distance and long distance can be set to any values depending on the electronic device and its usage.
[0045] If the millimeter-wave radar device 309 detects an object at a short distance, the process proceeds to S503. If the millimeter-wave radar device 309 detects an object at a long distance, not at a short distance, the process proceeds to S506 in FIG. In S503, the central processing unit 301 determines whether the detected nearby object is a living body. If the object is a living body, the central processing unit 301 determines that a human body has been detected, and the process proceeds to S504. If the detected object is not a living body, the central processing unit 301 determines that an object has been detected, and the process proceeds to S505.
[0046] The central processing unit 301 can detect the presence or absence of skin pulsation due to the human heart or pulse, and body surface movements or changes due to breathing, etc., based on the continuous millimeter-wave transmission and reception results and calculation results from the millimeter-wave radar device 309. Therefore, the central processing unit 301 can identify whether or not the target object is a living organism based on the detected information. It is also possible to store information on typical millimeter-wave transmission and reception results and calculation results in the non-volatile memory 302 and distinguish between a human body and a face based on the focus rate of the subject corresponding to the stored information.
[0047] In S504, the central processing unit 301 determines whether the detection result of the second detection means (gyro sensor 307 or acceleration sensor 308) is equal to or greater than a predetermined value. In this specification, the detection result of the second detection means means the output value of the second detection means or the amount of change therein. In S504, the central processing unit 301 determines whether the output value of the second detection means is equal to or greater than a predetermined value. If the output value of the second detection means is not equal to or greater than the predetermined value (if it is smaller), the process proceeds to S512 in FIG. 6.
[0048] If the output value of the second detection means is small, it can be assumed that the user is holding the image capture device 100 in their hand or using a tripod and looking through the EVF unit 202. This state may occur, for example, when the user is looking through the EVF unit 202 to take a picture or is operating the image capture device 100. In this case, it is preferable to turn off the power-saving mode and control the image capture device 100 so as not to interrupt the user's photographing activity and prevent it from entering a power-saving sleep state. Therefore, in S512 of FIG. 6, the central processing unit 301 turns off the power-saving mode of the image capture device 100 or wakes the image capture device 100 from the power-saving mode and controls the image capture device 100 not to enter the power-saving sleep state. In other words, control related to reducing power consumption (turning on the power-saving mode) is not performed. It is preferable to control the return from the power-saving mode so as to return to the normal state in a very short time so as not to impair user convenience.
[0049] If the output value of the second detection means is equal to or greater than a predetermined value (large), the process proceeds to S513 in FIG. 6. If the output value of the gyro sensor 307 or the acceleration sensor 308 is large, it is estimated that the user is wearing the image capture device 100 around their neck with a strap or carrying it, and the millimeter-wave radar device 309 is detecting the user's body. In this case, it is highly likely that the image capture device 100 will not be used immediately. Therefore, in S513 in FIG. 6, the central processing unit 301 performs control related to reducing power consumption (turning on the power-saving mode). This allows the remaining power to be conserved. Note that in the determination process of S504 above, the central processing unit 301 may determine whether the amount of change in the output value of the second detection means is equal to or greater than a predetermined value. If the amount of change is equal to or greater than the predetermined value, the process proceeds to S513. If the amount of change is not equal to or greater than the predetermined value, the process proceeds to S512.
[0050] Next, in S505, the central processing unit 301 determines whether or not to perform control related to reducing power consumption, depending on the direction indicated by the detection result of the second detection means. Specifically, the central processing unit 301 determines whether or not the output value of the second detection means includes a component in the direction of gravity.
[0051] If the output value of the second detection means does not include a component in the direction of gravity, the process proceeds to S512 in Fig. 6, where the power saving mode is turned off, or the image capture device 100 is controlled to return from the power saving mode and not enter a sleep state for power saving. If the output value of the second detection means does not include a component in the direction of gravity, it can be assumed that the user is removing the image capture device 100 from a small space such as a bag. After removing the image capture device 100 from the bag, the user is likely to operate the image capture device 100. Therefore, in this case, the power saving mode is turned off and the image capture device 100 is returned to a normal state in which all operations are accepted, thereby improving user convenience.
[0052] If the output value of the second detection means includes a component in the direction of gravity, the process proceeds to S513 in FIG. 6, where the power-saving mode is turned on. When the output value of the second detection means includes a component in the direction of gravity, it can be assumed that the user has stored the image capture device 100 in a small space such as a bag. When the user stores the image capture device 100 in a bag or the like, it is highly likely that the image capture device 100 will not be used for a certain period of time. Therefore, in this case, the power-saving mode is quickly turned on, and the remaining power is conserved. After the power-saving mode is turned on, the process from S501 is repeated at predetermined time intervals, so that the image capture device 100 can automatically return from the power-saving mode when the user takes the image capture device 100 out of the bag again.
[0053] 6, the central processing unit 301 determines whether the object at a long distance detected by the millimeter-wave radar device 309 is a living organism. If the detected object is a living organism, the central processing unit 301 determines that a human body has been detected, and the process proceeds to S507. If the detected object is not a living organism, the central processing unit 301 determines that an object has been detected, and the process proceeds to S508.
[0054] In S507, the central processing unit 301 determines whether the detection result of the second detection means (gyro sensor 307 or acceleration sensor 308) is equal to or greater than a predetermined value. In this example, the central processing unit 301 determines whether the amount of change in the output value of the second detection means is equal to or greater than a predetermined value. If the amount of change in the output value of the second detection means is not equal to or greater than the predetermined value (if it is small), the process proceeds to S512.
[0055] If the amount of change in the output value of the gyro sensor 307 or the acceleration sensor 308 is small, it is presumed that the user is using a tripod mount and performing live view shooting, in which the user shoots while checking the shooting angle of view and composition on the TFT display unit 103. Therefore, in this case, the central processing unit 301 keeps the power saving mode OFF and performs control not to enter a sleep state for power saving so as not to interfere with the user's shooting actions or operations. If the amount of change in the output value of the second detection means is not greater than the predetermined value (if it is greater), the process proceeds to S509.
[0056] Next, in S509, the central processing unit 301 reduces the detection range 401 of the millimeter-wave radar device 309. In this example, the central processing unit 301 sets the horizontal angle (e.g., 60°) of the detection range 401 of the millimeter-wave radar device 309 to an angle such that a human face located approximately 300 mm away falls within the detection range. For example, the width of a typical human face is approximately 160 mm, and the horizontal angle of the detection range 401 to enable detection of a face located 300 mm away is approximately 28°. Therefore, the central processing unit 301 reduces the horizontal angle of the detection range 401 to approximately 30°. By reducing the detection range 401 to a predetermined range, the position of the user's head and face can be limited, and the detection result of the object based on the reduced detection range can be used to estimate the user's movement and intention. Note that in the determination process of S507 described above, the central processing unit 301 may determine whether the output value of the second detection means is equal to or greater than a predetermined value, as in S504. If the output value is equal to or greater than the predetermined value, the process proceeds to S509, and if the output value is not equal to or greater than the predetermined value, the process proceeds to S512.
[0057] Next, in S510, the central processing unit 301 determines whether the millimeter-wave radar device 309 has detected a living body. The central processing unit 301 may perform control so that the detection target is limited to a human face or head. If the millimeter-wave radar device 309 has detected a living body, the process proceeds to S504. If the millimeter-wave radar device 309 has detected a living body, that is, a human body, it is presumed that the user is holding the image capture device 100 in their hand and performing live view capture, in which they capture an image while checking the angle of view and composition on the TFT display unit 103. Therefore, in this case, the central processing unit 301 keeps the power-saving mode OFF so as not to interfere with the user's image capture or operation, and prevents the image capture device 100 from entering a sleep state for power saving.
[0058] If the millimeter-wave radar device 309 does not detect a living body, the process proceeds to S513. If a living body is not detected within the reduced detection range in step 509, the following photographing action by the user is assumed: For example, the user is holding the image capture device 100 in their hand, and before performing live view photographing, they move the image capture device 100 out of their face or line of sight, and then they take their eyes off the TFT display unit 103 to directly check the subject and composition. In this state, it is highly likely that the image capture device 100 will not be used for a certain period of time, so the image capture device 100 quickly enters power-saving mode and is controlled to conserve the remaining power.
[0059] In S508, the central processing unit 301 determines whether the detection result of the second detection means (gyro sensor 307 or acceleration sensor 308) is equal to or greater than a predetermined value. In this example, the central processing unit 301 determines whether the amount of change in the output value of the second detection means is equal to or greater than a predetermined value. If the amount of change in the output value of the second detection means is not equal to or greater than the predetermined value (if it is small), the process proceeds to S513.
[0060] If the amount of change in the output value of the gyro sensor 307 or the acceleration sensor 308 is small, it is estimated that the user is using a tripod mount to take a picture and is temporarily away from the image capture device 100 to check the composition or for other reasons. Therefore, in this case, the central processing unit 301 causes the image capture device 100 to quickly enter power saving mode to conserve the remaining power.
[0061] If the amount of change in the output value of the second detection means is equal to or greater than a predetermined value (large), the process proceeds to S511. Then, the central processing unit 301 determines whether to turn the power-saving mode on or off depending on the orientation of the TFT display unit 103. Specifically, in S511, the central processing unit 301 determines whether the variable angle mechanism is closed. The determination process in S511 is performed, for example, based on the detection results of a magnetic detection type GMR sensor (not shown) that detects the opening, closing, and rotation of the variable angle mechanism. Alternatively, if the millimeter-wave radar device 309 is also used to detect the opening and closing of the variable angle, the determination process is performed based on the change in the output value of the millimeter-wave radar device 309.
[0062] If the vari-angle mechanism is closed, the process proceeds to S513. If the vari-angle mechanism is closed and the TFT display unit 103 is closed, it is assumed that the user is holding the imaging device 100 in their hand without any intention of taking a picture. In this state, it is highly likely that the device will not be used for a certain period of time. Therefore, in this case, the device quickly enters power-saving mode and is controlled to conserve the remaining power.
[0063] If the vari-angle mechanism is open and not closed, the process proceeds to S512. If the vari-angle mechanism is open and the TFT display unit 103 is open, it is assumed that the user is taking high-angle or low-angle shots using the vari-angle mechanism. Therefore, in this case, the central processing unit 301 keeps the power-saving mode of the imaging device 100 OFF so as not to interfere with the user's photographing or operation, and prevents the imaging device 100 from entering a sleep state for power saving. Note that in the determination process of S508 described above, the central processing unit 301 may determine whether the output value of the second detection means is equal to or greater than a predetermined value, as in S504. If the output value is equal to or greater than the predetermined value, the process proceeds to S511. If the output value is not equal to or greater than the predetermined value, the process proceeds to S513.
[0064] 5, it is possible to accurately estimate the state of the image capture device 100, which has a complex operation and operating system, as well as the intentions and actions of the user, and to reduce power consumption without reducing user convenience. Furthermore, the above control can also be applied to many portable electronic devices, such as smartphones, tablet terminals, and portable game consoles, which have simpler operations and operating systems than the image capture device 100.
[0065] Example 2 FIG. 7 is a diagram illustrating the configuration of an imaging apparatus according to a second embodiment. The imaging device of the second embodiment executes control related to reduction of power consumption based on the detection result of the grip sensor. The imaging device of the second embodiment has the same physical configuration as the imaging device of the first embodiment, except that a grip sensor 601 is provided.
[0066] Fig. 7(A) shows a see-through view of the grip sensor 601 arranged in the normal position grip part 101 of the imaging device 100. Fig. 7(B) shows a cross section of the grip sensor 601 when the imaging device 100 is turned along the dashed line 602 in Fig. 7(B). In FIG. 7(B), the grip sensor 601 is configured with a substrate (FPC) having multiple wiring layers on both sides of a base film 603. Specifically, the grip sensor (FPC) 601 has a first wiring layer 604 and a second wiring layer 605. The base film 603 is formed of polyimide resin. The first wiring layer 604 is patterned copper foil adhered to the base film 603 with an adhesive, and mainly serves as a signal line. The second wiring layer 605 is patterned copper foil adhered to the base film 603 with an adhesive, and mainly serves as a GND.
[0067] The coverlay film 606 provides insulation to prevent the first wiring layer 604 and the second wiring layer 605 from coming into contact with other metal bodies and causing a short circuit. The coverlay film 606 is formed of, for example, polyimide resin, and is adhered to the first wiring layer 604, the second wiring layer 605, and the base film 603 so as to cover the first wiring layer 604 and the second wiring layer 605. The grip sensor 601 is attached to the front cover unit 201 with double-sided tape or the like, and is fixed by being sandwiched between grip rubber 608. The grip rubber 608 is made of rubber such as NBR+PVC, and is attached to the front cover unit 201 with double-sided tape 609 or the like.
[0068] The front cover unit 201 is provided with a through-hole 607 for inserting a connector connection portion (not shown) of the grip sensor 601 into the inside of the imaging device 100. The connector connection portion of the grip sensor 601 can be connected to the main board unit 206 or the like by passing through the through-hole 607. Furthermore, the grip rubber 608 is attached to the front cover unit 201 without any gaps with double-sided tape 609, so that water will not get into the grip sensor 601, the through-hole 607, or the like even if the imaging device 100 is used during rainfall, for example.
[0069] FIG. 7C is a diagram of the grip sensor 601 as viewed from above. A plurality of electrodes are provided on a first wiring layer 604, which is one of a plurality of wiring layers included in the grip sensor 601. In this example, a first electrode 610, a second electrode 611, and a third electrode 612 are provided on the first wiring layer 604. The number of electrodes is preferably three or more. Furthermore, it is desirable to arrange the electrodes at the portion of the normal position gripping portion 101 where the first joint of each of the user's fingers touches. Each electrode is connected to a predetermined circuit by wiring (not shown). By separating the wiring to the predetermined circuit and controlling them separately, each electrode can detect a change in capacitance separately.
[0070] The grip sensor 601 is a capacitive and self-capacitive touch sensor. The central processing unit 301 generates an electric field in each electrode of the grip sensor 601. When the user grips the normal position grip part 101 via the grip rubber 608, a finger 613, which is a part of the user's body, approaches the first electrode 610, the second electrode 611, and the third electrode 612. This generates a pseudo-capacitor between the electric field and the finger 613, causing a change (increase) in capacitance. The grip sensor 601 detects contact with the finger 613 (performs touch detection) in response to the change in capacitance.
[0071] Assume that a user is taking a selfie with themselves as the subject. The user points the lens at themselves and inserts the thumb of their left hand into the grip of the normal position grip portion 101, where the middle finger to little finger of their right hand would normally rest. The user then places the index finger of their left hand on the shutter button and rotates the middle finger to little finger of their left hand from the side of the image capture device 100 to the back, supporting the image capture device 100 to take a picture. In other words, when taking a selfie, only the thumb of the left hand is present on the surface where the grip sensor 601 is located. In the case of three electrodes, regardless of the position where the thumb is in contact, the maximum number of locations where the capacitance changes is two, straddling two electrodes, as shown in FIG. 7(C). Therefore, if there is no change in capacitance in one or more of the first electrode 610, the second electrode 611, and the third electrode 612, the central processing unit 301 determines that the user is taking a selfie. In this case, the central processing unit 301 keeps the power saving mode of the imaging device 100 OFF so as not to interfere with the user's photographing actions or operations, and prevents the imaging device 100 from entering a sleep state for power saving. In other words, if there is an electrode among the multiple electrodes of the grip sensor 601 that does not detect contact, the central processing unit 301 does not perform control related to reducing the power consumption of the imaging device 100.
[0072] 8 and 9 are flowcharts showing the operation process of the imaging apparatus of the second embodiment. S501 to S513 in FIGS. 8 and 9 are similar to S501 to S513 in FIGS. In the determination process of S508 in FIG. 9 , if the amount of change in the output value of the second detection means (gyro sensor 307 or acceleration sensor 308) is equal to or greater than a predetermined value, the process proceeds to S701. In S701, the central processing unit 301 determines whether any of the electrodes of the grip sensor 601 does not detect contact with the user's finger. If any of the electrodes does not detect contact with the user's finger, the central processing unit 301 determines that the user is taking a selfie by holding the grip of the image capture device 100 with their left hand. Then, the process proceeds to S512, where the central processing unit 301 keeps the power-saving mode of the image capture device 100 OFF so as not to interfere with the user's photographing or operation, and prevents the image capture device 100 from entering a sleep state for power saving. As a result, even if a living body is not detected by the millimeter-wave radar device 309, if it is determined that a selfie is being taken based on the detection result of the grip sensor 601, the power-saving mode OFF can be kept OFF.
[0073] If all of the electrodes of the grip sensor 601 detect contact, the process proceeds to S511. Then, in S511, the central processing unit 301 determines whether to turn on or off the power saving mode depending on the attitude of the TFT display unit 103, as in the first embodiment.
[0074] Even if the millimeter-wave radar device 309 does not detect a living body, the imaging device of the second embodiment can estimate that a selfie is being taken based on the detection result of the grip sensor 601. This makes it easier to estimate the user's intentions and actions, thereby making it possible to reduce power consumption without reducing user convenience.
[0075] Furthermore, in this embodiment, a capacitance sensor using FPC patterning is used for the grip sensor 601, which is considered to have the lowest manufacturing costs, but a pressure-sensitive sensor may also be used for the grip sensor 601. Alternatively, a method may be used in which only the grip portion of the front cover unit 201 is formed from resin or the like, the surface is roughened with a laser, and a thin metal film is formed and patterned. While the preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments and various modifications and variations are possible within the scope of the invention.
[0076] (Other embodiments) The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program.The present invention can also be realized by a circuit (e.g., ASIC) that realizes one or more functions. [Explanation of symbols]
[0077] 100 Imaging device 301 Central Processing Unit
Claims
1. a first detection means for detecting whether an object is a human body based on a result of transmission and reception of radio waves of a specific wavelength; a second detection means for detecting the attitude or movement of the electronic device; a control unit that controls the power supply of the electronic device based on the detection results of the first detection unit and the second detection unit, The control means includes control relating to reduction of power consumption of the electronic device, and when the first detection means detects a human body whose distance from the electronic device is equal to or less than a threshold and the detection result of the second detection means is not equal to or greater than a predetermined value, the control means does not perform control relating to reduction of power consumption of the electronic device, and when the first detection means detects a human body whose distance from the electronic device is equal to or less than a threshold and the detection result of the second detection means is equal to or greater than a predetermined value, the control means performs control relating to reduction of power consumption of the electronic device. An electronic device characterized by:
2. a first detection means for detecting whether an object is a human body based on a result of transmission and reception of radio waves of a specific wavelength; a second detection means for detecting the attitude or movement of the electronic device; a control unit that controls the power supply of the electronic device based on the detection results of the first detection unit and the second detection unit, The control means includes control relating to reduction of power consumption of the electronic device, and when the first detection means detects an object whose distance from the electronic device is equal to or less than a threshold, determines whether or not to perform control relating to reduction of power consumption of the electronic device depending on the direction of information indicated by the detection result of the second detection means. An electronic device characterized by:
3. The control means and determining whether to perform control related to reduction of power consumption of the electronic device depending on whether or not the information indicated by the detection result of the second detection means includes a component in the direction of gravity.
3. The electronic device according to claim 2.
4. The control means When the information indicated by the detection result of the second detection means does not include a component in the direction of gravity, control relating to reduction of power consumption of the electronic device is not performed.
4. The electronic device according to claim 3.
5. The control means When the information indicated by the detection result of the second detection means includes a component in the direction of gravity, control is performed to reduce the power consumption of the electronic device.
5. The electronic device according to claim 3 or 4.
6. The control means When the first detection means detects a human body whose distance from the electronic device is equal to or greater than a threshold value and the detection result of the second detection means is not equal to or greater than a predetermined value, control relating to reduction of power consumption of the electronic device is not performed.
6. The electronic device according to claim 2, wherein the first and second electrodes are electrically connected to the first and second electrodes.
7. The control means When the first detection means detects a human body whose distance from the electronic device is equal to or greater than a threshold value and the detection result of the second detection means is equal to or greater than a predetermined value, the detection range of the first detection means is changed; and determining whether to perform control related to reduction of power consumption of the electronic device depending on whether a human body is detected within the changed detection range.
7. The electronic device according to claim 2, wherein the first and second electrodes are electrically connected to the first and second electrodes.
8. a display means for displaying predetermined information; The control means When the first detection means detects an object whose distance from the electronic device is equal to or greater than a threshold value and the detection result of the second detection means is equal to or greater than a predetermined value, it is determined whether or not to perform control relating to reduction of power consumption of the electronic device in accordance with the attitude of the display means.
8. The electronic device according to claim 2, wherein the first and second electrodes are electrically connected to the first and second electrodes.
9. a gripping portion used by a user to grip the electronic device; a third detection means provided on the gripping portion and configured to detect contact with a part of the user gripping the electronic device, The control means When the first detection means detects an object whose distance from the electronic device is equal to or greater than a threshold value and the detection result of the second detection means is equal to or greater than a predetermined value, a determination is made as to whether or not to perform control relating to reduction of power consumption of the electronic device, depending on the detection result of the third detection means.
3. The electronic device according to claim 1 or 2.
10. the third detection means has a plurality of electrodes provided on one of a plurality of wiring layers, The third detection means detects contact with the user's body part in response to a change in capacitance of the plurality of electrodes.
10. The electronic device according to claim 9.
11. The control means When the third detection means has, among the plurality of electrodes thereof, an electrode that detects the contact and an electrode that does not detect the contact, control relating to reduction of power consumption of the electronic device is not performed.
11. The electronic device according to claim 10.
12. The control means When all of the plurality of electrodes of the third detection means detect the contact, it is determined whether or not to perform control relating to reduction of power consumption of the electronic device depending on the attitude of a display means having a vari-angle mechanism provided in the electronic device.
12. The electronic device according to claim 10 or 11.
13. The display means has a vari-angle mechanism, The control means performs control relating to reduction of power consumption of the electronic device when the display means is closed, and does not perform control relating to reduction of power consumption of the electronic device when the display means is open.
9. The electronic device according to claim 8.
14. The electronic device described in Claim 12, characterized in that the control means performs control related to reducing power consumption of the electronic device when the display means is closed, and does not perform control related to reducing power consumption of the electronic device when the display means is open.
15. The control means When the electronic device is in a state where it can be remotely controlled, control related to reduction of power consumption of the electronic device is not performed.
15. The electronic device according to claim 1.
16. the first detection means is a radar device that detects the object based on a reflected wave of the transmitted radio wave, The second detection means detects the angular velocity or acceleration of the electronic device.
16. The electronic device according to claim 1, wherein the electronic device is a semiconductor device.
17. The detection range of the first detection means includes a predetermined range near the end of the eyepiece of the electronic device and a predetermined range at the end of the main body side when the display means having a vari-angle mechanism is unfolded.
17. The electronic device according to claim 1.
18. The first detection means detects the distance from the electronic device to the target object based on the transmission and reception results of the radio waves of the specific wavelength.
18. The electronic device according to claim 1.
19. an imaging means for imaging a subject; An imaging device comprising the electronic device according to any one of claims 1 to 18, The imaging device, wherein the first detection means is provided at a position for detecting a rear side of the imaging device, which is on the opposite side of the imaging device from a subject imaged by the imaging means.
20. A method for controlling an electronic device, comprising: a step of detecting by a first detection means whether the target object is a human body based on the results of transmission and reception of radio waves of a specific wavelength; detecting a state of attitude or movement of the electronic device by a second detection means; and controlling the power supply of the electronic device based on the detection results of the first detection means and the second detection means, The step of controlling the power supply includes control relating to reduction of power consumption of the electronic device, and when the first detection means detects a human body whose distance from the electronic device is equal to or less than a threshold value and the detection result of the second detection means is not equal to or greater than a predetermined value, control relating to reduction of power consumption of the electronic device is not performed, and when the first detection means detects a human body whose distance from the electronic device is equal to or less than a threshold value and the detection result of the second detection means is equal to or greater than a predetermined value, control relating to reduction of power consumption of the electronic device is performed. A control method comprising:
21. A method for controlling an electronic device, comprising: a step of detecting by a first detection means whether the target object is a human body based on a result of transmission and reception of radio waves of a specific wavelength; detecting a state of attitude or movement of the electronic device by a second detection means; and controlling the power supply of the electronic device based on the detection results of the first detection means and the second detection means, The step of controlling the power supply includes control relating to reduction of power consumption of the electronic device, and when the first detection means detects an object whose distance from the electronic device is equal to or less than a threshold, it is determined whether or not to control reduction of power consumption of the electronic device depending on the direction of information indicated by the detection result of the second detection means. A control method comprising:
Citation Information
Patent Citations
Imaging device
JP2004205402A
Mobile terminal and power saving control method in the same
JP2007080219A
Imaging apparatus
JP2010136163A
Vehicle control system
JP2012001020A
Electronic device and display control method
JP2016126234A