Camera Module Super-Resolution via Optical Path Shifting
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional camera modules face limitations in generating super-resolution images without increasing the number of pixels, leading to constraints in resolution and power consumption, especially when implementing features like auto-focusing and optical image stabilizers.
Innovation Solution
A camera module that includes an image sensor, a lens assembly with a variable lens or actuator to adjust the optical path, and an image synthesizer to combine multiple image frames generated along different optical paths or sensor positions, effectively increasing the image resolution without adding pixels.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the number of pixels in the image sensor is increased to achieve high-resolution images, then the image resolution is improved, but the size of the image sensor and power consumption increase
Solution Approach 1:
The patent transitions from increasing resolution through adding pixels (2D sensor plane expansion) to achieving super-resolution through temporal dimension exploitation. Multiple low-resolution frames captured at different time points are synthesized to generate a high-resolution image, effectively moving the resolution enhancement problem from the spatial domain to the temporal domain.
Solution Approach 2:
The patent creates multiple copies of the same scene captured at different time points (multiple image frames) and uses these copies to reconstruct a higher resolution image. Instead of using more pixels to capture the scene once at high resolution, the system captures multiple lower-resolution copies and synthesizes them computationally.
2Adaptability or versatility
If a separate lens driving apparatus is used to perform auto-focusing and hand-tremor compensation functions, then the photographing functions are improved, but the power consumption increases and additional cover glass is needed
Solution Approach 1:
The patent makes the image sensor serve multiple functions: it acts as both the image capturing device and the positioning sensor for focus and stabilization control. By reading pixel data at specific locations, the sensor system determines lens position and hand tremor state, eliminating the need for separate sensing mechanisms and reducing overall system complexity.
Solution Approach 2:
The image sensor performs self-diagnosis and self-positioning by analyzing the data it captures. The sensor system uses its own output data to determine its relative position to the lens assembly and to control focusing and stabilization, without requiring external or separate sensing apparatus.
3Measurement precision
If multiple cameras are used to generate super-resolution images, then the image resolution is improved, but the device complexity increases
Solution Approach 1:
The patent divides the high-resolution image capture task into multiple low-resolution frame captures taken at different time points. Each frame captures a portion of the information needed for the final high-resolution image, and the segmentation is performed temporally rather than spatially (i.e., using multiple cameras simultaneously).
Solution Approach 2:
The patent performs preliminary actions by capturing multiple low-resolution frames that contain redundant and complementary information about the scene. These preliminary captures are then processed through synthesis algorithms to produce the final high-resolution image, avoiding the need for complex multi-camera hardware setup.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach allows for the generation of high-resolution images with reduced computational complexity and maintains frame rate, preventing deterioration in image quality and power consumption.
Implementation Method 1
a lens assembly disposed on the image sensor and including a variable lens configured to adjust an optical path of light incident on the image sensor from the outside
Data Source
AI summary
A camera module according to an embodiment includes an image sensor configured to output a plurality of image frames; a lens assembly disposed on the image sensor, the lens assembly forming an optical path of light incident on the image sensor from outside; a controller configured to generate a control signal to adjust at least one of the optical path of the lens assembly or the position of the image sensor relative to the lens assembly; and an image synthesizer configured to synthesize the plurality of image frames to generate a composite image, wherein the composite image has a higher resolution than the plurality of image frames, and wherein the plurality of image frames are respective image frames generated along respectively different optical paths changed by the lens assembly or respective image frames generated by change in the position of the image sensor relative to the lens assembly.