Imaging device and control method thereof
The imaging device uses detection systems to determine unintended falls and stops the drive mechanism to prevent malfunctions and power wastage, addressing issues of unintended tilts and falls.
Patent Information
- Application Number
- JP2020198082
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2020-11-30
- Publication Date
- 2024-11-12
- Estimated Expiration
- 2040-11-30
AI Technical Summary
Conventional imaging devices face issues when the movable part is automatically displaced relative to the fixed part, such as malfunctioning due to unintended falls or tilts, which can lead to rolling and power wastage, especially when installed at angles or used handheld, making it difficult to determine if the device has fallen unintentionally.
The imaging device incorporates a detection system using a first detection device for tilt angle, a second detection device for movement, and control means to determine if the device has fallen by analyzing angular velocity amplitudes in specific frequency bands, stopping the drive mechanism if certain conditions are met to prevent malfunctions and power wastage.
The solution effectively determines if the device has fallen unintentionally, preventing malfunctions and power wastage by stopping the drive mechanism, ensuring reliable operation and user notification.
Smart Images

Figure 0007581025000004 
Figure 0007581025000005 
Figure 0007581025000006
Abstract
Description
[Technical field]
[0001] The present invention relates to an imaging device that drives a movable part so as to displace the movable part relative to a fixed part. Placement and It relates to a control method. [Background technology]
[0002] Conventionally, imaging devices are known as electronic devices that drive a movable part to displace relative to a fixed part. For example, imaging devices such as digital cameras include imaging devices that can be rotated in the pan direction or tilt direction of the camera for subject search, etc. In such imaging devices, a person is detected using a face detection function or a human body detection function that detects the face or human body of a person included in a subject, and focus control, exposure control, and subject tracking by pan-tilt rotation can be performed according to information on the detected person.
[0003] Patent Document 1 discloses an imaging device that performs automatic subject search, automatic tracking, and automatic shooting using a pan-tilt rotation mechanism. Some conventional imaging devices are also equipped with an image stabilization device. The image stabilization device can, for example, suppress image shake on the image plane by moving a lens or an image sensor on a plane perpendicular to the optical axis according to the amount of camera shake, or can perform image stabilization by rotating a lens barrel including a photographing optical system and an image sensor.
[0004] Patent Document 2 discloses an imaging device that includes a rotating section that holds a lens barrel including an imaging optical system and an image sensor, a main body that holds the rotating section so that the lens barrel can rotate in at least two axial directions, and a vibration detection section that detects rotational vibration in three axial directions disposed in the main body. This imaging device calculates a target value for shake correction from the vibration from the vibration detection section and the relative angle between the main body and the movable section, and performs shake correction by rotating the rotating section according to the target value. [Prior art documents] [Patent documents]
[0005] [Patent Document 1] JP 2019-106694 A [Patent Document 2] JP 2008-116836 A Summary of the Invention [Problem to be solved by the invention]
[0006] However, when driving the movable part to automatically displace relative to the fixed part, the following problems arise. First, when automatically searching for, tracking, and photographing a subject, the camera is often installed at a position away from the user to photograph. For example, if a child or a pet knocks over the camera, or if the camera is toppled over by wind or the like, if the user is at a position away from the camera, it may take a long time for the user to notice that the camera has fallen.
[0007] When the pan-tilt rotation mechanism is used to drive the rotation mechanism for automatic search, tracking, or vibration control when the camera is in a tilted state, the camera may roll if the moving part is in contact with the tilted installation surface and the camera is driven. If the camera rolls, it may fall off the desk and break down. In addition, friction and resistance with the tilted installation surface may prevent the rotation mechanism from being driven properly to the target position, and high torque and high output driving force may continue to be generated. In such a case, the rotation mechanism may break down or waste power.
[0008] In addition, when considering cases where the camera is installed and used in a tilted state with respect to the direction of gravity or when it is handheld, it is difficult to determine whether the camera has fallen over using only the camera tilt information.
[0009] An object of the present invention is to make it possible to determine if a device has unintentionally tipped over. [Means for solving the problem]
[0010] In order to achieve the above object, the present invention provides an imaging device including movable means having an imaging means, fixed means for supporting the movable means so as to be relatively displaceable, and drive means for driving the movable means to displace the movable means relative to the fixed means, the imaging device including: a first detection means for detecting an inclination angle of the imaging device; a second detection means for detecting a motion of the imaging device; and a control means for controlling the imaging device when it falls over, based on the inclination angle detected by the first detection means and frequency information and amplitude information of the motion detected by the second detection means. The control means performs the control during the fall when a difference between an amplitude of an angular velocity in a predetermined direction corresponding to a drive direction by the drive means in a first frequency band and an amplitude in a band other than the first frequency band exceeds a first predetermined difference, and a difference between an amplitude of the angular velocity in the predetermined direction and an amplitude of the angular velocity in a direction different from the predetermined direction exceeds a second predetermined difference. It is characterized by: Effect of the Invention
[0011] According to the present invention, it is possible to determine whether or not a device has unintentionally tipped over. [Brief description of the drawings]
[0012] [Figure 1] FIG. 1 is a schematic perspective view of an imaging device. [Diagram 2] FIG. 2 is a block diagram of the camera. [Diagram 3] FIG. 1 is a diagram illustrating an example of the configuration of a wireless communication system. [Figure 4] 13 is a flowchart showing a shooting mode process. [Diagram 5] 13 is a flowchart showing a fall detection process. [Figure 6] 13 is a flowchart showing a camera shock determination process. [Figure 7] 13 is a flowchart showing a rolling determination process. [Figure 8] FIG. 13 illustrates the camera in a tipped over state. [Figure 9] FIG. 1 is a diagram showing a reporting mode in a wireless communication system. [Figure 10] FIG. 13 is a diagram showing the amount of shaking in three axial directions when the camera rolls. [Figure 11] 13 is a flowchart showing a rolling determination process. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0013] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
[0014] FIG. 1(a) is a schematic perspective view of an imaging device according to an embodiment of the present invention. This imaging device is configured as, for example, a camera 101 capable of capturing still images, but may also be capable of capturing moving images. The camera 101 has a fixed part 103, which is a camera body, and a lens barrel 102, which is a lens barrel. The lens barrel 102 includes a group of photographing lenses for capturing images and an imaging element. An optical axis 108 is an imaging optical axis of the imaging optical system in the lens barrel 102. An angular velocity meter 106 and an accelerometer 107 are mounted on the fixed part 103. The camera 101 is provided with various operating members such as a power switch.
[0015] Fixed section 103 supports lens barrel 102 as a movable section so that it can be relatively displaced. Specifically, lens barrel 102 is connected to fixed section 103 via tilt rotation unit 104 and pan rotation unit 105. Tilt rotation unit 104 and pan rotation unit 105 are collectively referred to as the "pan / tilt rotation mechanism." Hereinafter, the three axial directions, that is, the rotation directions around the X-axis, Y-axis, and Z-axis shown in FIG. 1(a) are defined as the pitch direction, yaw direction, and roll direction, respectively.
[0016] The tilt rotation unit 104 is a motor drive mechanism that rotates the lens barrel 102 in the pitch direction. The pan rotation unit 105 is a motor drive mechanism that rotates the lens barrel 102 in the yaw direction. FIGS. 1(b) and (c) show the state of the lens barrel 102 tilting. The camera 101 detects the vibration state of the camera 101 based on the detection results of the angular velocity meter 106 and the accelerometer 107, and controls the drive of the tilt rotation unit 104 and the pan rotation unit 105 based on the detected shaking angle. This makes it possible to correct the vibration and tilt of the lens barrel 102, which is a movable part.
[0017] 2 is a block diagram of the camera 101. In the lens barrel 102, the zoom unit 201 includes a zoom lens that changes magnification. The zoom drive control unit 202 drives and controls the zoom unit 201. The focus unit 203 includes a lens that adjusts focus. The focus drive control unit 204 drives and controls the focus unit 203. The imaging unit 206 includes an image sensor that receives light incident through each lens group and generates charge information according to the amount of light as analog image data. This analog image data is output to an image processing unit 207.
[0018] In the fixed unit 103, the control unit 223 is composed of, for example, a CPU (MPU), memory (DRAM, SRAM), non-volatile memory (EEPROM), etc. The control unit 223 executes various processes (programs) to control each block of the camera 101 and to control data transfer between each block. The non-volatile memory 216 is an electrically erasable and recordable memory, and stores constants, programs, etc. for the operation of the control unit 223.
[0019] The image processing unit 207 converts the analog image data input from the imaging unit 206 into digital image data by A / D conversion. The image processing unit 207 applies image processing such as distortion correction, white balance adjustment, and color interpolation processing to this digital image data, and outputs the digital image data after the processing. The digital image data output from the image processing unit 207 is converted into a recording format such as JPEG format by the image recording unit 208, and transmitted to the memory 215 and the video output unit 217.
[0020] The lens barrel rotation drive section 205 is a drive means for driving the tilt rotation unit 104 and the pan rotation unit 105, and drives and rotates the lens barrel 102 in the tilt direction and the pan direction. The lens barrel rotation drive section 205 is driven and controlled by the control section 223. The device shaking detection section 209 includes an angular velocity meter 106 and an accelerometer 107 (FIG. 1(a)). The angular velocity meter 106 is composed of a gyro sensor or the like, and detects the angular velocity of the camera 101 in three axial directions. The accelerometer 107 is composed of an acceleration sensor or the like, and detects the acceleration of the camera 101 in three axial directions. The rotation angle of the camera 101, the shift amount of the camera 101, etc. are calculated based on the detection signals output from the angular velocity meter 106 and the accelerometer 107.
[0021] The operation unit 210 is operated by a user and includes a power button and a button for changing the settings of the camera. When the power button is operated, power is supplied to the entire camera 101 according to the purpose, and the camera 101 is started up. The audio input unit 213 acquires an audio signal from the surroundings of the camera 101 from a microphone provided in the camera 101, performs analog-to-digital conversion, and transmits the signal to the audio processing unit 214. The audio processing unit 214 performs audio-related processing such as optimization processing of the input digital audio signal. The audio signal processed by the audio processing unit 214 is then transmitted to the memory 215 by the control unit 223. The memory 215 temporarily stores the image signal and audio signal obtained by the image processing unit 207 and the audio processing unit 214.
[0022] The image processing unit 207 and the audio processing unit 214 read out the image signal and the audio signal temporarily stored in the memory 215, and respectively encode the image signal and the audio signal to generate a compressed image signal and a compressed audio signal. The control unit 223 transmits these compressed image signals and compressed audio signals to the recording and playback unit 220.
[0023] The recording and reproducing unit 220 records the compressed image signal, compressed audio signal, and other control data related to shooting generated by the image processing unit 207 and audio processing unit 214 on the recording medium 221. When the audio signal is not compression-encoded, the control unit 223 transmits the audio signal generated by the audio processing unit 214 and the compressed image signal generated by the image processing unit 207 to the recording and reproducing unit 220 to record them on the recording medium 221.
[0024] The recording medium 221 is a recording medium built into the camera 101, but may be a removable recording medium. Various data such as compressed image signals, compressed audio signals, and audio signals generated by the camera 101 can be recorded on the recording medium 221. For this reason, a medium with a larger capacity than the nonvolatile memory 216 is generally adopted for the recording medium 221. For example, the recording medium 221 may be any type of recording medium, such as a hard disk, an optical disk, a magneto-optical disk, a CD-R, a DVD-R, a magnetic tape, a nonvolatile semiconductor memory, or a flash memory.
[0025] The recording and reproducing unit 220 reads (reproduces) the compressed image signal, compressed audio signal, audio signal, various data, and programs recorded on the recording medium 221. Then, the control unit 223 transmits the read compressed image signal and compressed audio signal to the image processing unit 207 and the audio processing unit 214. The image processing unit 207 and the audio processing unit 214 temporarily store the compressed image signal and compressed audio signal in the memory 215, decode them in a predetermined procedure, and transmit the decoded signal to the video output unit 217.
[0026] The audio output unit 218 outputs a preset audio pattern from the speaker 901, for example, during shooting. The LED control unit 224 controls the LED 902 with a preset lighting / flashing pattern, for example, during shooting. The video output unit 217 includes, for example, a video output terminal, and transmits an image signal to display a video on a connected external display or the like. The audio output unit 218 and the video output unit 217 may include a single combined terminal, for example, a terminal such as an HDMI (registered trademark) (High-Definition Multimedia Interface) terminal.
[0027] The communication unit 222 communicates between the camera 101 and an external device, and transmits and receives data such as audio signals, image signals, compressed audio signals, and compressed image signals. When the camera 101 detects an abnormal state, the communication unit 222 transmits information for notifying the external device of the internal state of the camera, such as error information. The communication unit 222 includes wireless communication modules, such as an infrared communication module, a Bluetooth communication module, a wireless LAN communication module, a Wireless USB, and a GPS receiver. In addition, the fixed unit 103 has a learning processing unit 219.
[0028] 3 is a diagram showing an example of the configuration of a wireless communication system including a camera 101 and an external device. The external device is, for example, a smart device 301 including a Bluetooth communication module and a wireless LAN communication module.
[0029] The camera 101 and the smart device 301 can communicate with each other through communication 302 and communication 303. The communication 302 is, for example, communication by wireless LAN conforming to the IEEE802.11 standard series. The communication 303 is, for example, communication having a master-slave relationship such as a control station and a slave station, such as Bluetooth Low Energy (hereinafter referred to as "BLE").
[0030] Note that wireless LAN and BLE are examples of communication methods, and other communication methods may be used. Each of the camera 101 and the smart device 301 may have two or more communication functions, and may be capable of controlling the other communication function by one communication function that communicates in the relationship between a control station and a dependent station. However, without loss of generality, it is assumed that the first communication such as wireless LAN is capable of faster communication than the second communication such as BLE, and the second communication is at least one of lower power consumption and shorter communication distance than the first communication.
[0031] 4 is a flowchart showing the shooting mode process. This process is realized by the CPU of the control unit 223 reading and executing a program stored in a storage unit such as a ROM of the control unit 223. This process is started when a shooting mode that automatically performs pan-tilt driving, such as automatic tracking, is set, and is executed at regular time intervals.
[0032] In step S401, the control unit 223 executes image recognition processing. First, the control unit 223 generates image data by having the image processing unit 207 perform image processing for subject detection on the signal captured by the imaging unit 206. Then, the control unit 223 performs subject detection such as person and object detection from the generated image data. When detecting a person, the control unit 223 detects the face or human body of the subject. In face detection processing, a pattern for determining the face of a person is determined in advance, and a portion that matches the above pattern included in the captured image is detected as the face image of the person. In addition, a reliability indicating the likelihood that the subject is a face is also calculated at the same time. The reliability is calculated, for example, from the size of the face area in the image and the degree of agreement with the face pattern. Similarly, in object recognition, an object that matches a pre-registered pattern is recognized. The control unit 223 calculates an evaluation value for each image area of the recognized subject, and determines the image area of the subject with the highest evaluation value as the main subject area.
[0033] In step S402, the control unit 223 calculates an image shake correction amount. Specifically, the control unit 223 first calculates a shake angle based on the angular velocity and acceleration information acquired by the device shake detection unit 209. Then, the control unit 223 obtains an anti-shake angle for moving the tilt rotation unit 104 and the pan rotation unit 105 in an angular direction that cancels the shake angle, and sets these as image shake correction amounts.
[0034] In step S403, the control unit 223 determines the camera state. That is, the control unit 223 determines the current vibration / movement state of the camera 101 based on the camera angle and the camera movement amount detected from the angular velocity information, the acceleration information, and the GPS position information.
[0035] For example, when the camera 101 is attached to a car and photographed, subject information such as the surrounding scenery changes significantly depending on the distance traveled. Therefore, the control unit 223 judges whether or not the camera is in a "vehicle moving state" in which the camera is attached to a car or the like and moving at a high speed. This can be used for automatic subject search, which will be described later. The control unit 223 also judges whether or not the camera is in a "stationary shooting state" in which the camera 101 has almost no shaking angle, based on the magnitude of the change in the camera angle. In the "stationary shooting state," it can be considered that there is no change in the angle of the camera 101 itself, so the control unit 223 can perform subject search for stationary shooting. In addition, when the change in the camera angle is relatively large, the control unit 223 judges the state to be a "handheld state" and can perform handheld subject search.
[0036] The camera state determined in step S403 includes a determination of whether the camera 101 is in a fallen state or a non-fall state based on the fall detection. That is, it is also determined whether the camera 101 is in a fallen state or a non-fall state. The method of determining whether the camera 101 is in a fallen state or a non-fall state will be described later.
[0037] In step S404, the control unit 223 executes a subject search process. If a state where a subject to be photographed is not detected continues for a predetermined time, the control unit 223 determines that the subject is not within the angle of view at the current pan / tilt angle position. Then, the control unit 223 calculates a target angle for driving the pan / tilt to search for a subject that may currently be outside the angle of view. If a subject to be photographed is detected during the search operation, the control unit 223 calculates a target angle for performing tracking control to hold the subject at a predetermined position (for example, the center) of the image by driving the pan / tilt. When the automatic shooting operation described later is performed a predetermined number of times, the control unit 223 calculates a target angle for driving the pan / tilt to search for another subject.
[0038] In step S405, the control unit 223 executes pan / tilt driving. Specifically, the control unit 223 calculates a pan / tilt driving amount by adding the image blur correction amount calculated in step S402 and the pan / tilt search / tracking target angle calculated in step S404. Then, the control unit 223 controls the lens barrel rotation driving unit 205 to drive the tilt rotation unit 104 and the pan rotation unit 105 by the pan / tilt driving amount.
[0039] In step S406, the control unit 223 controls the zoom unit 201 to perform zoom driving. Specifically, the control unit 223 drives the zoom according to the state of the subject to be searched for determined in step S404. For example, when the subject to be searched for is a person's face, if the face on the image is too small, it may fall below the minimum size that can be detected and may be lost. In such a case, the control unit 223 controls the zooming to the telephoto side so that the size of the face on the image becomes larger. On the other hand, if the face on the image is too large, the subject is likely to fall out of the angle of view due to the movement of the subject or the camera itself. In such a case, the control unit 223 controls the zooming to the wide-angle side so that the size of the face on the screen becomes smaller. By performing zoom control in this way, it is possible to maintain a state suitable for tracking the subject.
[0040] In step S407, the control unit 223 determines whether or not a manual shooting instruction has been given. A manual shooting instruction may be given by pressing a shutter button, tapping the camera housing with a finger or the like (tapping), inputting a voice command, or receiving an instruction from an external device. A shooting instruction by a tap operation is a shooting instruction method in which, when a user taps the camera housing, the device shake detection unit 209 detects continuous high-frequency acceleration in a short period of time and uses this as a trigger for shooting. A voice command input is a shooting instruction method in which, when a user utters a password (for example, "take a picture") instructing a specific shooting, the voice processing unit 214 recognizes the voice and uses this as a trigger for shooting. An instruction from an external device is a shooting instruction method in which, for example, a shutter instruction signal transmitted from a smartphone connected to the camera via a dedicated application is used as a trigger.
[0041] If the result of the determination in step S407 is that there is a manual shooting instruction, the control unit 223 advances the process to step S410, and if there is no manual shooting instruction, the control unit 223 advances the process to step S408. In step S408, the control unit 223 executes automatic shooting determination. That is, the control unit 223 determines whether to perform automatic shooting from the detected subject. For example, the control unit 223 detects a specific person subject, and determines to perform automatic shooting if the facial expression or pose satisfies a preset condition.
[0042] In step S409, if it is determined in step S408 that automatic shooting is to be performed, the control unit 223 advances the process to step S410, and if it is not determined that automatic shooting is to be performed, ends the process shown in FIG.
[0043] In step S410, the control unit 223 starts shooting. At this time, the control unit 223 performs autofocus control by the focus drive control unit 204. The control unit 223 also performs exposure control using an aperture control unit, a sensor gain control unit, and a shutter control unit (not shown) so that the subject has appropriate brightness. Furthermore, after shooting, the control unit 223 performs various known image processing such as auto white balance processing, noise reduction processing, gamma correction processing, etc., by the image processing unit 207 to generate an image.
[0044] In step S411, the control unit 223 performs editing processing such as processing the image generated in step S410 and adding it to the video. Specifically, the image processing here includes a trimming process based on a person's face or a focus position, an image rotation process, an HDR (high dynamic range) effect, a bokeh effect, a color conversion filter effect, and the like. Note that in the image processing, a plurality of images may be generated based on the image generated in step S410 by a combination of the above processes, and the images may be stored separately from the image generated in step S410. In addition, in the video processing, a process may be performed in which a captured video or still image is added to the generated edited video while adding special effect processing such as a slide, zoom, fade, and the like.
[0045] In step S412, the control unit 223 updates the past shooting information. For example, the control unit 223 sets a count for each of the number of shots taken for each person registered in personal authentication who is the subject of the shooting target, the number of shots taken for each subject recognized by general object recognition, and the number of shots taken for each scene in scene determination. The control unit 223 then increments the count number corresponding to the image shot this time by one, and uses the updated count value in the subject search process in step S404 and in the automatic shooting determination in step S408.
[0046] Fig. 5 is a flowchart showing the fall detection process. This fall detection process is included in the camera state determination process in step S403 in Fig. 5. This fall detection process is started by executing the camera state determination process in step S403, and is then repeatedly executed at a constant cycle until the process shown in Fig. 4 ends. In this fall detection process, the control unit 223 plays the role of the determination means and control means in the present invention.
[0047] In this process, a state variable State is used as a status indicating the state (state related to posture) of the camera 101. The state variable State is set to a fallen state or a non-fallen state, and the initial value is set to the non-fallen state. In step S501, the control unit 223 determines whether the state variable State is set to the non-fallen state. If State=non-fallen state, the control unit 223 can determine that the camera 101 is not currently falling, and therefore advances the process to step S502. On the other hand, if State=fallen state, the control unit 223 can determine that the camera 101 is currently falling, and therefore advances the process to step S514.
[0048] In step S502, control unit 223 determines whether the tilt angle of camera 101 is greater than a predetermined value A (first tilt angle). Here, the tilt angle of camera 101 is defined with a direction perpendicular to the direction of gravity as a reference of 0. The tilt angle of camera 101 can be calculated based on the output value of a three-axis acceleration sensor of accelerometer 107 mounted on fixed unit 103. The value of predetermined value A is in the range greater than 0 degrees and equal to or less than 180 degrees, for example, 60 degrees. If the tilt angle exceeds predetermined value A, control unit 223 advances the process to step S503, and if the tilt angle is equal to or less than predetermined value A, ends the process shown in FIG. 5.
[0049] In step S503, the control unit 223 executes a camera shock determination process (FIG. 6). FIG. 6 is a flowchart showing the camera shock determination process executed in step S503.
[0050] First, in step S601, the control unit 223 calculates the gravitational acceleration a from a scalar quantity calculated from the three-axis acceleration output from the accelerometer 107 using Equation 1. g The absolute value of the acceleration scalar a s It is calculated as follows.
[0051]
number
[0052] If the camera 101 falls and hits the desk, the acceleration scalar value a s is the component of the shock acceleration only, with the gravitational acceleration removed, so the acceleration scalar value a s In step S602, the control unit 223 determines the impact force based on the magnitude of the acceleration scalar value a s The control unit 223 determines whether the acceleration scalar value a is equal to or greater than a predetermined value. s If the acceleration scalar value a is equal to or greater than the predetermined value, in step S603, a flag is set to indicate that the camera has been subjected to an impact, and the time of the impact is recorded. s If is smaller than the predetermined value, in step S604, a flag indicating that the camera has not been subjected to an impact is set, and the time of impact is recorded. After steps S603 and S604, the control unit 223 ends the process shown in FIG.
[0053] In step S504 in Fig. 5, the control unit 223 refers to the flag set in the process shown in Fig. 6 to determine whether or not the camera 101 has been subjected to an impact. If the camera 101 has not been subjected to an impact, the control unit 223 advances the process to step S506. If the camera 101 has been subjected to an impact, the control unit 223 temporarily suspends control of and power supply to the pan-tilt rotation mechanism (tilt rotation unit 104 and pan rotation unit 105) in step S505. This is because there is a possibility that the camera 101 has unintentionally fallen over and hit a desk or the like. After step S505, the control unit 223 advances to step S506.
[0054] In step S506, the control unit 223 determines whether a predetermined time has elapsed after it was determined in step S504 that the camera 101 was subjected to an impact. If the predetermined time has not elapsed after it was determined that the camera 101 was subjected to an impact, the control unit 223 advances the process to step S508. However, if the predetermined time has elapsed after it was determined that the camera 101 was subjected to an impact, the control unit 223 releases the stop of control and power supply to the pan-tilt rotation mechanism in step S507, reactivates the drive control, and advances the process to step S508. Therefore, the stop of the pan-tilt rotation mechanism is maintained for at least the predetermined time after the impact has occurred.
[0055] In step S508, the control unit 223 executes a rolling judgment process (described later in FIG. 7). In general, when the movable part has a rounded shape, the camera is likely to roll if it falls sideways on a desk. In addition, when the rotation mechanism is driven in a state where the camera is in a fallen state and anti-shake control is applied, the rotation mechanism cannot be driven appropriately to the target position due to friction and resistance with the fallen installation surface, and a high-torque, high-output driving force may continue to be generated. In such a case, the rotation mechanism may break down or consume power unnecessarily.
[0056] For example, as shown in FIG. 8, consider a case where the camera 101, whose cross section perpendicular to the Y axis is circular, falls onto the installation surface 801. Assume that the pan-tilt rotation mechanism is driven and anti-shake control is applied while the camera 101 is in the fallen state. In this case, the lens barrel 102 attempts to rotate in a panning manner, but the target control angle cannot be reached due to the influence of friction with the installation surface 801, so the control unit 223 controls to increase the driving force of the panning rotation. As a result of increasing the driving force of the panning rotation, the fixed unit 103 rotates, and a large angular velocity is output from the angular velocity meter 106, so that the angle target value is set to an even larger value by anti-shake control. However, the target position still cannot be reached due to the influence of the friction with the installation surface 801, and the rotation drive amount becomes even larger, causing the camera 101 to roll due to the movement of the panning rotation mechanism. Depending on the outer shape of the camera 101, rolling may or may not occur easily, and there are directions in which rolling is easy or difficult.
[0057] In this way, because the camera 101 may unintentionally roll due to control of the pan-tilt rotation mechanism, the control unit 223 executes a rolling determination process (FIG. 7) to avoid malfunctions and unnecessary power consumption. The rolling determination process determines whether the camera is rolling or not.
[0058] In step S509, the control unit 223 determines whether or not the camera 101 is rolling based on the result of the rolling determination process. If the result of the rolling determination process is "rolling", the state is determined to be "rolling state". "Rolling" indicates that the camera 101 is rotating. If the camera 101 is rolling, the control unit 223 sets the state variable State to the falling state in step S511, and the process proceeds to step S512.
[0059] In step S512, the control unit 223 stops the drive control and power supply to the pan-tilt rotation mechanism (tilt rotation unit 104 and pan rotation unit 105) to avoid the camera 101 falling or a breakdown due to a high load on the rotation mechanism, and to avoid problems with power consumption. In step S513, the control unit 223 notifies that the camera 101 has fallen and that the drive control of the pan-tilt rotation mechanism has been stopped. An example of this notification is shown in FIG.
[0060] FIG. 9 is a diagram showing a manner of notifying the smart device 301 in the wireless communication system. First, the control unit 223 outputs a preset lighting / flashing pattern from the LED 902 of the camera 101 as a first notification, and outputs a preset error notification sound from the speaker 901 of the camera 101. In this way, when a user is near the camera 101, the user can immediately be notified that the camera 101 has fallen. In addition, the control unit 223 notifies the smart device 301 of event information indicating that the camera 101 has fallen using wireless LAN or BLE as a second notification, and displays the event information on a monitor provided in the smart device 301. For example, a message 903 indicating that the camera has fallen is displayed. In this way, even if the user is not near the camera 101, the user can immediately know that the camera 101 has fallen as long as the user holds the smart device 301. Note that the manner of notification is not limited to the exemplified one, and may be any one of them or a combination of them. After step S513, the control unit 223 ends the process shown in FIG. 5.
[0061] If the result of the determination in step S509 is that the camera 101 is not rolling, the control unit 223 determines whether the camera 101 is stationary or not in step S510. For example, the control unit 223 compares the three-axis signals of the angular velocity meter 106 with respective predetermined thresholds, and determines whether the camera 101 is stationary or moving based on the number of counts that exceed the predetermined thresholds within a predetermined time, or the number of counts that fall below the predetermined thresholds within a predetermined time. Alternatively, the control unit 223 may determine whether the camera 101 is stationary or not based on the signal of the accelerometer 107, or may perform the determination based on a signal in which a specific frequency is extracted by a filter such as an HPF (high-pass filter or high-pass filter).
[0062] This determination is made to distinguish whether the camera 101 is placed still on a desk or the like, or whether the camera 101 is moving with the user, such as being handheld or wearable. Since it is determined in step S502 that the camera 101 has tilted, if it is determined in step S510 that the camera 101 is stationary, there is a possibility that the camera 101 has unintentionally remained lying on a desk or the like. Therefore, in this case, the control unit 223 advances the process to step S511. Therefore, even if the rolling of the camera 101 stops, if the camera 101 remains stationary while remaining tilted, the state variable State is set to the fallen state.
[0063] On the other hand, if it is determined in step S510 that the camera 101 is not stationary, the camera 101 is not rolling and is not stationary, and therefore it can be assumed that the camera is in a hand-held or wearable state. Therefore, the control unit 223 ends the process shown in FIG. 5 without updating the state variable State.
[0064] Therefore, when the camera 101 is not stationary, the state variable State remains in the non-tipped state. This is for the following reasons. First, in general, when shooting while operating the camera in a handheld state, if the rotation mechanism is stopped frequently, automatic search, tracking, and vibration prevention control may not be performed correctly. In addition, if the camera angle changes significantly in a handheld state, frequent notifications such as sounds may be generated, which may cause discomfort. Therefore, when the camera falls onto a desk or the like, it is better to stop driving the pan-tilt rotation mechanism, but on the other hand, when the camera is handheld, it is considered better not to stop driving the pan-tilt rotation mechanism.
[0065] After the state variable State is set to the fallen state in step S511, the process transitions from step S501 to step S514. In step S514, control unit 223 determines whether the tilt angle of camera 101 is smaller than a predetermined value B (a second tilt angle). Note that predetermined value B is larger than 0 degrees and smaller than predetermined value A, for example, 20 degrees.
[0066] Then, if the tilt angle of the camera 101 is smaller than the predetermined value B, it is highly likely that the user has corrected the camera 101 from the upturned state to the correct position. Therefore, in step S516, the control unit 223 sets the state variable State to a non-upturned state. In step S517, the control unit 223 releases the drive control and power supply to the pan-tilt rotation mechanism (tilt rotation unit 104 and pan rotation unit 105) that had been stopped. That is, the control unit 223 enables and resumes the drive control of the pan-tilt rotation mechanism. Thereafter, the control unit 223 ends the process shown in FIG. 5.
[0067] On the other hand, if the tilt angle of camera 101 is not smaller than predetermined value B, it can be determined that the fallen state of camera 101 continues, and control unit 223 advances the process to step S515. In step S515, control unit 223 determines whether or not a subject to be photographed has been detected within the angle of view of camera 101. That is, control unit 223 determines whether or not a subject set as a subject to be photographed has been detected from the photographed image.
[0068] If the result of this determination is that a subject is detected within the angle of view, there is a high possibility that the user has intentionally tilted camera 101. For example, it is conceivable that camera 101 may be intentionally installed facing downward to capture an image of a baby in a crib. In this case, control unit 223 sets state variable State to a non-tipped state in step S516. However, if no subject is detected within the angle of view, it can be determined that camera 101 continues to be in a tilted state, and control unit 223 ends the process shown in FIG. 5.
[0069] Fig. 7 is a flowchart showing the rolling determination process executed in step S508 of Fig. 5. In step S701, control unit 223 acquires the three-axis angular velocity sensor output of angular velocity meter 106, and in step S702 calculates the frequency and amplitude of the angular velocity in a predetermined direction. The predetermined direction is a rolling rotation direction corresponding to the drive direction of tilt rotation unit 104 and pan rotation unit 105 by lens barrel rotation drive unit 205, and is determined in advance according to the outer shape of camera 101. For example, the direction that is easiest to rotate is set as the predetermined direction. For example, if lens barrel 102 has a shape that makes it easy to rotate in the yaw direction, the predetermined direction is the yaw rotation direction.
[0070] The control unit 223 calculates the frequency and amplitude in each direction by FFT (Fast Fourier Transform) using the angular velocity value for a predetermined period as an input value. The control unit 223 also calculates the yaw angular velocity, pitch angular velocity, and roll angular velocity. The calculation of the amplitude and frequency may be performed by a simplified process that shortens the processing time, as described below.
[0071] 10 is a diagram showing the amount of shaking in three axial directions when the camera 101 rolls. The control unit 223 measures periods T1, T2, and T3 corresponding to one period for the yaw angular velocity based on the sign inversion timing (+ to -, - to +) and calculates the frequency from these. The control unit 223 also stores the peak values of the angular velocity during periods T1, T2, and T3 as amplitudes corresponding to each period. The control unit 223 also performs similar processing for the pitch angular velocity and roll angular velocity.
[0072] Next, in step S703, control unit 223 determines whether the vibration reduction function for the rotation drive is ON (enabled). The conditions under which the vibration reduction function is turned ON / OFF will be described. First, if it is not determined in step S504 that the camera 101 has been subjected to an impact and therefore the rotation mechanism is not temporarily stopped, the vibration reduction function is set ON. Also, if it is determined that the camera 101 has been subjected to an impact and the temporary stop of the rotation mechanism is released in step S507, and it is determined that the output of the angular velocity meter 106 is large to a certain extent and there is camera shaking, vibration reduction control is set ON.
[0073] On the other hand, if the rotation mechanism continues to be temporarily stopped in step S505, the anti-shake control is set to OFF. Even if the rotation mechanism is not in a stopped state, if the output of the angular velocity meter 106 is very small and it is determined that the camera is stationary, the anti-shake control is set to OFF.
[0074] If the result of the determination in step S703 is that the vibration reduction function for rotational drive is ON, control unit 223 proceeds to step S704, and if the vibration reduction function for rotational drive is OFF (disabled), control unit 223 proceeds to step S705. In step S704, control unit 223 sets parameters for when vibration reduction is ON as threshold parameters for performing rolling determination, and proceeds to processing in step S706. In step S705, control unit 223 sets parameters for when vibration reduction is OFF as threshold parameters, and proceeds to processing in step S706. Each parameter for when vibration reduction is ON and when vibration reduction is OFF is stored in non-volatile memory 216 in advance.
[0075] The reason why the threshold parameters are different for when vibration isolation is ON / OFF is because the rolling characteristics of the camera 101 differ depending on whether the vibration isolation function is ON or OFF. When the vibration isolation function is OFF (power OFF), the amount of shaking is determined by the shape of the camera 101, and in most cases, the amount of rolling shaking is small. However, when the vibration isolation function is ON (power ON), the amount of rolling shaking can become very large due to malfunction of the vibration isolation control caused by the influence of frictional force.
[0076] In step S706, the control unit 223 determines whether or not the amplitude and frequency of the angular velocity calculated in step S702 satisfy a predetermined condition described below. If the amplitude and frequency of the angular velocity satisfy the predetermined condition, the control unit 223 sets the determination result of the rolling determination process to "rolling" in step S707. On the other hand, if the amplitude and frequency of the angular velocity do not satisfy the predetermined condition, the control unit 223 sets the determination result of the rolling determination process to "not rolling" in step S708. After steps S707 and S708, the control unit 223 ends the process shown in FIG. 7.
[0077] A method of determining whether the amplitude and frequency of the angular velocity satisfy a predetermined condition in step S706 will be described below. The control unit 223 determines whether the vehicle is rolling or not based on the amplitude and frequency of each of the pitch angular velocity, yaw angular velocity, and roll angular velocity calculated in step S702.
[0078] First, as shown in Fig. 8, it is assumed that fixed part 103 is cylindrical, and the cross-sectional shapes of lens barrel 102 and fixed part 103 perpendicular to the Y axis are both circular. In this case, the axis that swings the most when camera 101 rolls is the Y axis, and the amount of swing in the yaw rotation direction around the Y axis becomes large. In addition, since the yaw rotation direction and the drive direction in the pan direction by the rotation mechanism coincide with each other, if anti-shake control is performed in the pan direction in the tipped state shown in Fig. 8, the amount of swing in the yaw rotation direction becomes very large due to malfunction of anti-shake control caused by the influence of frictional force described above.
[0079] At this time, the amount of rolling vibration in the pitch and roll rotation directions is very small compared to the yaw rotation direction. The frequency band during rolling is determined by the camera shape, weight, etc., and if the movable part, lens barrel 102, is heavy, the rolling frequency will be on the low frequency side. Therefore, control unit 223 compares the amplitude of the yaw angular velocity in a specific frequency range (for example, 1 to 3 Hz) with the amplitude of the other frequency range. Then, control unit 223 can determine that the camera is rolling when the difference between the two exceeds a first predetermined difference and the amplitude difference between the pitch and roll angular velocity and the yaw angular velocity exceeds a second predetermined difference.
[0080] If the amplitude difference between the specific frequency range of the yaw angular velocity and the other frequency ranges is small, it is highly likely that the camera is in a shaking state due to hand-holding, etc., so the control unit 223 can determine that the camera 101 is not rolling. Also, if the amplitude difference between the yaw angular velocity and the pitch roll angular velocity is small, it is highly likely that the camera is in a shaking state due to hand-holding, etc., so the control unit 223 can determine that the camera 101 is not rolling. Note that parameters such as the specific frequency range and the first and second predetermined differences are included in the threshold parameters set in steps S704 and S705. Therefore, these parameters may differ between when anti-shake is ON and when anti-shake is OFF.
[0081] These can be summarized as follows. The "first condition" is that the difference between the amplitude of the angular velocity in a specific direction (here, the yaw rotation direction) in a specific frequency range (first frequency band) and the amplitude in a band other than the specific frequency range (other than the first frequency band) exceeds a first predetermined difference. The "second condition" is that the difference between the amplitude of the angular velocity in a specific direction and the amplitude of the angular velocity in a direction different from the specific direction (here, the pitch and roll rotation directions) exceeds a second predetermined difference. When both the first and second conditions are satisfied, the above-mentioned predetermined condition is established and it is determined that the vehicle is rolling. The amplitude used for comparison may be the maximum value or the average value.
[0082] It should be noted that other rolling determination methods may be adopted.
[0083] If the highest amplitude frequency detected within a predetermined time period for the yaw angular velocity is within a specific frequency range (e.g., 1 to 3 Hz) and its amplitude exceeds a first predetermined value, and the amplitudes of the pitch and roll angular velocities are below a second predetermined value, it may be determined that the vehicle is rolling. The parameters of the specific frequency range and the first and second predetermined values are included in the threshold parameters set in steps S704 and S705. Therefore, these parameters may differ between when anti-shake is ON and when anti-shake is OFF.
[0084] These can be summarized as follows: The "third condition" is that the amplitude of the angular velocity in a predetermined direction (here, the yaw rotation direction) exhibits a maximum value in a first frequency band and that maximum value exceeds a first predetermined value. The "fourth condition" is that the amplitudes of the angular velocity in a direction different from the predetermined direction (here, the pitch and roll rotation directions) fall below a second predetermined value. When both the third and fourth conditions are met, the above-mentioned predetermined condition is established and it is determined that the vehicle is rolling. The amplitude used in the fourth condition may be a maximum value or an average value.
[0085] 7, another rolling determination method as shown in Fig. 11 may be adopted. Fig. 11 is a flowchart showing the rolling determination process executed in step S508 of Fig. 5.
[0086] In step S1101, the control unit 223 acquires the triaxial angular velocity sensor output of the angular velocity meter 106. In step S1102, the control unit 223 calculates the degree of correlation between the angular velocities. There are several possible methods for calculating the degree of correlation, but first, a first correlation degree calculation method will be described.
[0087] The first correlation degree calculation method is a method using coherence, which is a correlation value in the frequency domain. The control unit 223 performs a Fourier transform on the time series data of the angular velocity of each axis shown in FIG. 10, calculates the power spectrum, and calculates the coherence using Equation 2.
[0088]
number
[0089] Here, f is the frequency, and N is the number of frequency samples. X(f) and Y(f) are the Fourier transforms of the time series data xi and yi of the pitch angular velocity and yaw angular velocity, respectively. X*(f) and Y*(f) are the complex conjugates of X(f) and Y(f), respectively. Coh represents coherence. The control unit 223 calculates the coherence for several frequencies f set in the vicinity of a specific frequency range (for example, 1 to 3 Hz).
[0090] If the rolling direction and the yaw direction measured by the angular velocity meter do not completely match, a similar rolling rotation will occur in the angular velocity in the pitch and roll directions. Therefore, the control unit 223 obtains the coherence between the yaw angular velocity and the pitch angular velocity, and the coherence between the yaw angular velocity and the roll angular velocity, and determines whether or not the vehicle is rolling based on whether or not there is a phase correlation.
[0091] In step S1106, the control unit 223 determines whether or not there is a correlation between the angular velocities. That is, when the coherence in a specific frequency range is greater than the coherence threshold, the control unit 223 determines that there is a correlation between the rotations due to the rolling effect, that is, there is a correlation between the angular velocities. On the other hand, when the coherence is equal to or less than the coherence threshold, the control unit 223 determines that there is no correlation between the rotations due to the rolling effect, that is, there is no correlation between the angular velocities. As a result of the determination in step S1106, when there is a correlation between the angular velocities, the control unit 223 executes the same process as step S707 in step S1107 and ends the process shown in FIG. 11. When there is no correlation between the angular velocities, the control unit 223 executes the same process as step S708 in step S1108 and ends the process shown in FIG. 11.
[0092] The method for determining whether or not there is a correlation between the angular velocities can be summarized as follows. The fifth condition is that the degree of correlation between the angular velocity in a predetermined direction (here, the yaw rotation direction) and the angular velocity in a direction different from the predetermined direction (here, the pitch and roll rotation directions) exceeds a predetermined degree of correlation. When the coherence in a specific frequency range is greater than the coherence threshold, the fifth condition is met. Then, when the fifth condition is met, the above-mentioned predetermined condition is established, and it is determined that the vehicle is rolling.
[0093] Next, the second correlation degree calculation method will be described. The second correlation degree calculation method is a calculation method using simplified processing that shortens the processing time.
[0094] 10, the control unit 223 may determine that there is a phase correlation when the difference in the sign inversion timing between the yaw angular velocity and the pitch angular velocity is within a permissible value and each of the periods T1, T2, and T3 is within a permissible value. In this case, the fifth condition is also satisfied, and the above-mentioned predetermined condition is established.
[0095] Alternatively, the control unit 223 may constantly calculate the cross-correlation coefficient for a predetermined period using Equation 3, obtain the correlation value, and determine whether or not there is a correlation.
[0096]
number
[0097] Here, Xi and Yi are time series data of the pitch angular velocity and the yaw angular velocity, respectively. Rxy represents the cross-correlation coefficient of the time series data Xi and Yi. The control unit 223 calculates the cross-correlation coefficient of the roll angular velocity and the yaw angular velocity in a similar manner. When the correlation value is larger than a predetermined value, the fifth condition is satisfied. Then, when the fifth condition is satisfied, the above-mentioned predetermined condition is established, and it is determined that the vehicle is rolling.
[0098] The first to fifth conditions may be applied in any suitable combination as long as there is no contradiction. For example, when both the first condition and the fifth condition are satisfied, the predetermined condition may be satisfied and it may be determined that the vehicle is rolling. Alternatively, when both the second condition and the fifth condition are satisfied, the predetermined condition may be satisfied and it may be determined that the vehicle is rolling.
[0099] According to this embodiment, when the state of camera 101 is determined to be a tipped over state during drive control of lens barrel rotation drive unit 205, control unit 223 stops drive control of lens barrel rotation drive unit 205. This makes it possible to determine that the device has tipped over unintentionally. Also, by stopping drive control when camera 101 has tipped over unintentionally, it is possible to avoid failures due to malfunctions and the like and unnecessary power consumption.
[0100] In particular, when it is determined that the camera 101 is rolling while the tilt angle of the camera 101 is greater than the predetermined value A (first tilt angle), the state of the camera 101 is determined to be a falling state (S509). This makes it possible to avoid the camera 101 continuing to roll without being able to reach the target position.
[0101] Furthermore, if it is determined that the tilt angle of the camera 101 exceeds the predetermined value A and the camera 101 is stationary, it is determined that the state of the camera 101 is in a fallen state (S510). This prevents the drive control of the lens barrel rotation drive unit 205 from continuing while the camera 101 is in a fallen state, thereby making it possible to suppress the occurrence of malfunctions and power consumption.
[0102] On the other hand, even if the tilt angle of camera 101 exceeds predetermined value A and camera 101 is not rolling, if it is determined that camera 101 is not stationary, the state of camera 101 is not determined to be in a fallen state (S510). Therefore, even if camera 101 is tilted, drive control of lens barrel rotation drive unit 205 continues when the camera is hand-held or wearable, which provides good usability.
[0103] Furthermore, if the state of camera 101 changes from an upturned state to a non-upturned state after stopping drive control of lens barrel rotation drive unit 205, control unit 223 releases the stop of drive control of lens barrel rotation drive unit 205 (S517). As a result, if the conditions are met, drive control is automatically resumed without the user having to perform an operation to resume drive control, thereby improving usability.
[0104] For example, if the tilt angle of camera 101 falls below a predetermined value B after camera 101 has fallen over, the state of camera 101 is switched from the fallen state to a non-fallen state (S514). This allows the drive control stop to be automatically released when, for example, the user returns camera 101 to the correct position. Also, for example, if a preset subject is detected in a captured image after camera 101 has fallen over, the state of camera 101 is switched from the fallen state to a non-fallen state (S515). This allows the drive control stop to be automatically released when, for example, the user intentionally tilts camera 101.
[0105] When the tilt angle of camera 101 exceeds predetermined value A and an impact is detected, drive control of lens barrel rotation drive unit 205 is stopped for a certain period of time regardless of whether camera 101 is in a tipped or not tipped state (S504, S505). However, the comparison value of the tilt angle of camera 101 in this case is not limited to predetermined value A, and may be a third tilt angle different from predetermined value A. Also, the process of temporarily suspending drive control of lens barrel rotation drive unit 205 when an impact is detected may be provided immediately before step S501, or between steps S501 and S502, or between steps S501 and S514. It is not essential to provide this process.
[0106] In this embodiment, camera 101 is an imaging device having two rotation axes, but it may be an imaging device having at least one rotation axis. Also, in this embodiment, the relative displacement of the movable part with respect to the fixed part is a rotational displacement, but the relative displacement of the movable part with respect to the fixed part may be a linear displacement. In other words, the present invention is not limited to a rotation mechanism, but can also be applied to a moving mechanism that moves in a linear direction.
[0107] In addition, in this embodiment, various information is used to determine whether the state of the imaging device is in a tipped state or not, but it is sufficient to perform the determination based on at least the tilt information and angular velocity information of the imaging device, and the processing based on other information may be omitted. In addition, the process of stopping the rotation mechanism and the process of notifying the tipped state when the state of the imaging device is determined to be in a tipped state may be omitted, and if the imaging device has a mechanism for automatically returning from a tipped state, the recovery process may be executed when the imaging device is determined to be in a tipped state. In addition, the method of determining whether the imaging device is in a tipped state or not described in this embodiment can be applied to devices other than imaging devices as long as the electronic device has an angular velocity meter and an accelerometer and the movable part can be displaced relatively to the fixed part by a driving means.
[0108] The present invention has been described above in detail based on its preferred embodiments, but the present invention is not limited to these specific embodiments, and various forms that do not deviate from the gist of the present invention are also included in the present invention. [Explanation of symbols]
[0109] 102 Telescope tube 103 Fixed part 104 Tilt rotation unit 105 Pan Rotation Unit 106 Angular velocity meter 107 Accelerometer 205 Tube Rotation Drive Unit 223 Control Unit
Claims
1. a movable means having an imaging means; a fixing means for supporting the movable means so as to be relatively displaceable; and a driving means for driving the movable means so as to displace the movable means relative to the fixed means, a first detection means for detecting a tilt angle of the imaging device; a second detection means for detecting a motion of the imaging device; a control means for controlling the imaging device when the imaging device falls over, based on the tilt angle detected by the first detection means and frequency information and amplitude information of the movement detected by the second detection means, an imaging device characterized in that the control means performs the fall control when a difference between an amplitude of an angular velocity in a predetermined direction corresponding to a driving direction by the driving means in a first frequency band and an amplitude in a band other than the first frequency band exceeds a first predetermined difference, and when a difference between the amplitude of the angular velocity in the predetermined direction and the amplitude of the angular velocity in a direction different from the predetermined direction exceeds a second predetermined difference.
2. A movable means having an imaging means; a fixing means for supporting the movable means so as to be relatively displaceable; and a driving means for driving the movable means so as to displace the movable means relative to the fixed means, a first detection means for detecting a tilt angle of the imaging device; a second detection means for detecting a motion of the imaging device; a control means for controlling the imaging device when the imaging device falls over, based on the tilt angle detected by the first detection means and frequency information and amplitude information of the movement detected by the second detection means, an imaging device characterized in that the control means performs the fall control when the amplitude of the angular velocity in a predetermined direction corresponding to the driving direction by the driving means indicates a maximum value in a first frequency band and the maximum value exceeds a first predetermined value, and when the amplitude of the angular velocity in a direction different from the predetermined direction falls below a second predetermined value.
3. A movable means having an imaging means; a fixing means for supporting the movable means so as to be relatively displaceable; and a driving means for driving the movable means so as to displace the movable means relative to the fixed means, a first detection means for detecting a tilt angle of the imaging device; a second detection means for detecting a motion of the imaging device; a control means for controlling the imaging device when the imaging device falls over, based on the tilt angle detected by the first detection means and frequency information and amplitude information of the movement detected by the second detection means, The control means performs the fall control when a correlation between an angular velocity in a predetermined direction corresponding to a drive direction by the drive means and an angular velocity in a direction different from the predetermined direction exceeds a predetermined correlation.
4. A movable means having an imaging means; a fixing means for supporting the movable means so as to be relatively displaceable; and a driving means for driving the movable means so as to displace the movable means relative to the fixed means, a first detection means for detecting a tilt angle of the imaging device; a second detection means for detecting a motion of the imaging device; a control means for controlling the imaging device when the imaging device falls over, based on the tilt angle detected by the first detection means and frequency information and amplitude information of the movement detected by the second detection means, an imaging device characterized in that the control means performs the fall control when a correlation between an angular velocity in a predetermined direction corresponding to a drive direction by the drive means and an angular velocity in a direction different from the predetermined direction exceeds a predetermined correlation, and a difference between an amplitude of the angular velocity in the predetermined direction in a first frequency band and an amplitude in a band other than the first frequency band exceeds a first predetermined difference.
5. A movable means having an imaging means; a fixing means for supporting the movable means so as to be relatively displaceable; and a driving means for driving the movable means so as to displace the movable means relative to the fixed means, a first detection means for detecting a tilt angle of the imaging device; a second detection means for detecting a motion of the imaging device; a control means for controlling the imaging device when the imaging device falls over, based on the tilt angle detected by the first detection means and frequency information and amplitude information of the movement detected by the second detection means, an imaging device characterized in that the control means performs the fall control when a correlation between an angular velocity in a predetermined direction corresponding to a drive direction by the drive means and an angular velocity in a direction different from the predetermined direction exceeds a predetermined correlation, and a difference between an amplitude of the angular velocity in the predetermined direction and an amplitude of the angular velocity in a direction different from the predetermined direction exceeds a second predetermined difference.
6. 6. The imaging apparatus according to claim 1, wherein the control means limits drive control of the drive means as the control at the time of the fall.
7. 7. The imaging device according to claim 6, wherein the control means stops the drive control of the drive means as the fall-time control when the imaging device becomes in a falling state during the drive control of the drive means.
8. The imaging device according to claim 7, wherein the control means cancels the stop of the drive control of the drive means when the state of the imaging device changes from a fallen state to a non-fallen state after stopping the drive control of the drive means.
9. 9. The imaging device according to claim 1, wherein the control means notifies the user that the device is in a falling state as the control for when the device is falling.
10. The fall control is performed on the condition that the tilt angle of the imaging device exceeds a first tilt angle, The imaging device according to any one of claims 1 to 9, characterized in that the control means terminates the fall control when the tilt angle of the imaging device falls below a second tilt angle smaller than the first tilt angle after the imaging device enters a fallen state.
11. The camera further includes a subject detection unit that detects a subject set as a subject to be photographed from the image photographed by the imaging unit, 11. The imaging device according to claim 1, wherein the control means terminates the control during a fall when the subject is detected after the imaging device has entered a falling state.
12. 12. The imaging device according to claim 1, wherein the cross section of the imaging device parallel to the driving direction has a circular shape.
13. The imaging device further includes an impact detection unit for detecting an impact to the imaging device. The imaging device according to any one of claims 1 to 12, characterized in that the control means stops drive control of the drive means for a certain period of time when the tilt angle of the imaging device exceeds a third tilt angle and an impact on the imaging device is detected.
14. 14. The imaging device according to claim 1, wherein the relative displacement of the movable member with respect to the fixed member is a rotational displacement.
15. 15. The imaging device according to claim 1, wherein the first detection means and the second detection means are provided on the fixing means.
16. A method for controlling an imaging device having a movable means having an imaging means, a fixing means supporting the movable means so as to be relatively displaceable, a driving means driving the movable means to displace the movable means relative to the fixing means, a first detecting means detecting an inclination angle of the imaging device, and a second detecting means detecting a movement of the imaging device, comprising: a step of controlling the imaging device when the imaging device falls over, based on the tilt angle detected by the first detection means and frequency information and amplitude information of the movement detected by the second detection means; A control method for an imaging device, characterized in that the fall control is performed when a difference between an amplitude of an angular velocity in a predetermined direction corresponding to a drive direction by the drive means in a first frequency band and an amplitude in a band other than the first frequency band exceeds a first predetermined difference, and a difference between an amplitude of the angular velocity in the predetermined direction and an amplitude of an angular velocity in a direction different from the predetermined direction exceeds a second predetermined difference.
17. A method for controlling an imaging device having movable means having an imaging means, fixed means supporting the movable means so as to be displaceable relative to the fixed means, drive means driving the movable means to displace the movable means relative to the fixed means, first detection means detecting a tilt angle of the imaging device, and second detection means detecting a movement of the imaging device, comprising: a step of controlling the imaging device when the imaging device falls over, based on the tilt angle detected by the first detection means and frequency information and amplitude information of the movement detected by the second detection means; a control method for an imaging device, characterized in that the fall control is performed when the amplitude of the angular velocity in a predetermined direction corresponding to the drive direction by the drive means shows a maximum value in a first frequency band and the maximum value exceeds a first predetermined value, and the amplitude of the angular velocity in a direction different from the predetermined direction falls below a second predetermined value.
18. A method for controlling an imaging device having movable means having an imaging means, fixed means supporting the movable means so as to be displaceable relative to the fixed means, a driving means driving the movable means to displace the movable means relative to the fixed means, a first detecting means detecting a tilt angle of the imaging device, and a second detecting means detecting a movement of the imaging device, comprising: a step of controlling the imaging device when the imaging device falls over, based on the tilt angle detected by the first detection means and frequency information and amplitude information of the movement detected by the second detection means; A control method for an imaging device, comprising: performing the control during a fall when a correlation between an angular velocity in a predetermined direction corresponding to a drive direction by the drive means and an angular velocity in a direction different from the predetermined direction exceeds a predetermined correlation.
19. A method for controlling an imaging device having movable means having an imaging means, fixed means supporting the movable means so as to be displaceable relative to the fixed means, drive means driving the movable means to displace the movable means relative to the fixed means, first detection means detecting a tilt angle of the imaging device, and second detection means detecting a movement of the imaging device, comprising: a step of controlling the imaging device when the imaging device falls over, based on the tilt angle detected by the first detection means and frequency information and amplitude information of the movement detected by the second detection means; A control method for an imaging device, characterized in that the fall control is performed when a correlation between an angular velocity in a predetermined direction corresponding to a drive direction by the drive means and an angular velocity in a direction different from the predetermined direction exceeds a predetermined correlation, and a difference between an amplitude of the angular velocity in the predetermined direction in a first frequency band and an amplitude in a band other than the first frequency band exceeds a first predetermined difference.
20. A method for controlling an imaging device having movable means having an imaging means, fixed means supporting the movable means so as to be displaceable relative to the fixed means, driving means driving the movable means to displace the movable means relative to the fixed means, first detection means detecting a tilt angle of the imaging device, and second detection means detecting a movement of the imaging device, comprising: a step of controlling the imaging device when the imaging device falls over, based on the tilt angle detected by the first detection means and frequency information and amplitude information of the movement detected by the second detection means; A control method for an imaging device, characterized in that the fall control is performed when a correlation between an angular velocity in a predetermined direction corresponding to a drive direction by the drive means and an angular velocity in a direction different from the predetermined direction exceeds a predetermined correlation, and a difference between an amplitude of the angular velocity in the predetermined direction and an amplitude of the angular velocity in a direction different from the predetermined direction exceeds a second predetermined difference.
Citation Information
Patent Citations
Picture input device
JP1997284611A
Imaging apparatus, control method, and program
JP2008116836A
Imaging apparatus and control method of the same
JP2010237251A
Imaging device and control method thereof
JP2013046149A
Search device, imaging device thereof, and search method
JP2018050146A
