Camera Module OIS Multi-Frame Synthesis to Reduce Artifacts
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing camera modules face limitations in improving image resolution and are prone to artifacts such as noise and blur during optical image stabilization (OIS) due to constraints in modulation transfer function (MTF) and pixel count.
Innovation Solution
An electronic device with a camera module that continuously acquires multiple images using OIS, combining pixel data to generate a single high-resolution image frame by averaging or calculating the center of mass, thereby reducing artifacts.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Stability of the object's composition
If optical image stabilization (OIS) function is performed by shifting lens assembly or image sensor, then image stability is improved, but image resolution and quality deteriorate due to artifacts such as noise, blur, and jagging artifacts
Solution Approach 1:
The patent combines multiple image frames captured during OIS operation into a single composite image. By merging the information from multiple frames that were stabilized at different positions, the system achieves both image stability and high resolution, eliminating the trade-off between these two qualities.
Solution Approach 2:
The patent introduces a temporal dimension by capturing images across multiple time points during OIS operation. Instead of relying on a single static frame, the system utilizes the sequence of frames captured as the lens or sensor shifts, thereby gaining additional spatial information that improves resolution while maintaining stability.
2Manufacturing precision
If modulation transfer function (MTF) of lens assembly or number of pixels in image sensor is increased to improve resolution, then image resolution is improved, but device complexity and cost increase
Solution Approach 1:
The patent changes the parameter of image acquisition from single-frame to multi-frame sequence. By capturing multiple frames during OIS operation and processing them computationally, the system achieves high resolution without requiring higher MTF lenses or higher pixel density sensors, thereby avoiding increased device complexity and cost.
3Manufacturing precision
If multiple image frames are captured continuously during OIS operation, then image resolution and quality are improved through data combination, but processing time and computational load increase
Solution Approach 1:
The patent performs preliminary alignment and registration of multiple image frames during the capture phase itself, utilizing the OIS position information that is already being tracked. By preparing the data in advance during capture rather than performing all processing after capture, the system reduces subsequent processing time while maintaining high resolution output.
Data Source
AI summary
An electronic device is provided. The electronic device includes a camera module which can perform an optical image stabilization (OIS) function, and at least one processor electrically connected to the camera module. The at least one processor is configured to control the camera module to continuously acquire first image data including first pixel data, second image data including second pixel data, third image data including third pixel data, and fourth image data including fourth pixel data by using the OIS function, acquire fifth pixel data on the basis of the first pixel data, the second pixel data, the third pixel data, and the fourth pixel data, and generate a first image frame on the basis of the fifth pixel data.