Image Stabilization Pixel Array Unit for Roll Direction Blur Correction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional electronic image stabilization (EIS) methods provide a lower image stabilization effect compared to optical image stabilization (OIS), and they face challenges in controlling the image stabilization system and power consumption, particularly in compact devices where only yaw and pitch blurs are corrected, leaving roll direction blurs unaddressed.
Innovation Solution
An image pickup element with a pixel array unit that performs high-speed short-time exposure imaging and an exposure control unit determining whether the blur exceeds a prescribed value based on gyro sensor data, extending or terminating the exposure time as necessary to achieve better image stabilization, allowing for correction of blurs in all directions without additional driving components.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If optical image stabilization is used to correct image blur, then image stabilization effect is improved, but system complexity and power consumption increase
Solution Approach 1:
The patent replaces the mechanical lens movement system of OIS with an electronic image processing system. The pixel array unit captures multiple frames at high speed, and the image processing unit synthesizes these frames to correct blur, eliminating the need for mechanical stabilization components while achieving comparable or superior stabilization效果
Solution Approach 2:
The patent creates multiple copies of the same scene by capturing multiple frames at high speed. These frame copies are then processed and synthesized to produce a final stabilized image, replacing the need for physical stabilization mechanisms
2Reliability
If optical image stabilization is used to correct image blur, then image stabilization effect is improved, but power consumption increases
Solution Approach 1:
The patent replaces the power-intensive mechanical lens driving system with a low-power electronic processing system that uses the pixel array unit and image processing unit to achieve stabilization through software algorithms rather than mechanical actuation
Solution Approach 2:
The pixel array unit itself performs the stabilization function by capturing multiple frames and enabling synthesis processing, eliminating the need for separate power-consuming stabilization hardware
3Device complexity
If electronic image stabilization is used to correct image blur, then system complexity is reduced, but image stabilization effect deteriorates
Solution Approach 1:
The patent uses periodic high-speed frame capture at specific intervals to gather multiple images for synthesis. This periodic sampling approach enables effective blur correction while maintaining system simplicity, achieving better stabilization than conventional EIS
Solution Approach 2:
The patent dynamically adjusts the imaging process by continuously capturing frames at high speed and adaptively synthesizing them based on detected blur conditions, enabling superior stabilization performance compared to static conventional EIS methods
4Volume of moving object
If compact device design is used to reduce device size, then device compactness is improved, but ability to correct roll direction blur is lost
Solution Approach 1:
The patent makes the pixel array unit perform multiple functions: it captures normal images, performs high-speed frame capture for EIS, and enables synthesis processing. This multi-functionality allows compact device design without sacrificing roll direction blur correction capability
Solution Approach 2:
The patent replaces mechanical stabilization components that would increase device size with an electronic processing approach that achieves comprehensive blur correction including roll direction, maintaining compactness while enhancing functionality
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach enhances the image stabilization effect, improving image quality, especially in low-light environments, and prevents imaging failures due to camera shake, while simplifying the system by integrating gyro sensor data for precise control and synchronization of image and gyro data.
Implementation Method 1
a pixel array unit including a plurality of pixels arranged in an array and configured to output a plurality of frames
Implementation Method 2
blur information indicating a physical blur in a case where the pixel array unit is shaken
Data Source
AI summary
The present disclosure relates to an image pickup element, an image pickup method, and an electronic device that achieve a better image stabilization effect. A pixel array unit in which a plurality of pixels are arranged in an array outputs a plurality of frames by EIS imaging that continuously performs short-time exposure imaging at high speed. Then, the exposure control unit determines whether or not a blur of the pixel array unit exceeds a prescribed value on the basis of blur information indicating a physical blur in a case where the pixel array unit is shaken, and causes the pixel array unit to perform EIS imaging until it is determined that the blur of the pixel array unit exceeds the prescribed value. The present technology can be applied to, for example, a CMOS image sensor having an electronic image stabilization function.