Image Sensor Pixel Shifting for Color Resolution
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Image sensors with color and white pixel arrays in predetermined patterns face challenges in color reproduction and resolution, particularly at low illuminance and high resolution, leading to noise and reduced color accuracy.
Innovation Solution
An electronic device with an image sensor module that shifts pixels based on a designated pixel unit, combining color information from multiple images to improve color reproduction and resolution, by moving the lens or image sensor to adjust the location of white pixels relative to color pixels.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If color and white pixel sensors are arranged in a predetermined pattern to enable both color and brightness information capture, then the image sensor can provide both color and luminance data, but color reproduction and color resolution are degraded
Solution Approach 1:
The patent divides the pixel array into distinct color pixel regions and white pixel regions with different functions. Color pixels (R, G, B) are dedicated to color information capture, while white pixels are dedicated to brightness information capture. This segmentation allows each pixel type to specialize in its function, preventing the color resolution degradation that occurs when white pixels are interspersed among color pixels in conventional patterns.
Solution Approach 2:
The patent resolves the contradiction by shifting the spatial arrangement from a mixed 2D pattern to a separated layout where color and white pixels are grouped in different regions. By using pixel shifting technology, the system captures multiple images at different positions and combines them, effectively adding a temporal dimension to the data collection process. This allows full-color resolution to be achieved while still utilizing white pixels for brightness information.
2Productivity
If pixel sensors are arranged in a mixed color and brightness pattern, then both color and luminance information can be obtained from a single image, but noise increases and color accuracy decreases particularly at low illuminance
Solution Approach 1:
The patent performs preliminary actions by capturing multiple images at different pixel positions before final image processing. The system shifts the pixel array to different positions and captures several images, then combines them through image processing. This preliminary multi-position capture allows the system to accumulate sufficient color information for accurate color reproduction while using white pixels separately for brightness data, thereby improving color accuracy especially in low illuminance conditions.
Solution Approach 2:
The patent creates multiple copies of the image at different pixel positions through shifting. By capturing multiple images with the pixel array at different positions and combining them, the system generates a final image with improved color accuracy. This copying approach allows the system to overcome the limitations of single-position capture where white pixels would degrade color information.
3Measurement precision
If white pixels are used in the pixel array to capture brightness information, then luminance data is improved, but color reproduction capability is reduced
Solution Approach 1:
The patent merges the functionality of color pixels and white pixels by capturing images at multiple positions and combining the data. Color pixels capture color information at their positions, while white pixels capture brightness information. Through pixel shifting and image combination, the system merges these separate data streams to produce a final image that has both complete color information (from color pixels across multiple positions) and high-quality brightness information (from white pixels), thereby resolving the trade-off between the two.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enhances color reproduction and resolution by generating images with improved color representation through pixel shifting and combination of color information, effectively addressing the limitations of existing pixel array configurations.
Implementation Method 1
An image sensor may convert a received optical signal into an electric signal using pixel sensors
Data Source
Figure 1
Figure 2
Figure 3
AI summary
An image processing method and device are provided. The image processing device includes an image sensor module including a lens and an image sensor; and a processor configured to obtain, using the image sensor module, a first image having first color information, the first image corresponding to an external object, by; move at least one of the lens and the image sensor based on a designated pixel unit; obtain, using the image sensor module with the moved at least one of the lens and the image sensor, a second image having second color information, the second image corresponding to the external object; and generate a third image having third color information based on the first color information and the second color information, the third image corresponding to the external object.