Image processing device and image processing method for obtaining two sub-images from original image
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing technologies face challenges when dealing with image data from sensors with non-Bayer pixel arrangements, as they require additional conversion processes, and the processing load increases with higher image resolution, leading to higher power consumption and processing time.
Innovation Solution
An image processing device that separates first image data from a Bayer arrangement image sensor into second image data containing brightness information and third image data containing color information, with a lower resolution, where the pixel arrangement of the third image data is specifically configured to reduce processing load.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If image data is separated into high-frequency components and low-frequency components, then processing load is reduced, but additional conversion processes are required for non-Bayer arrangements
Solution Approach 1:
The patent segments image data into high-frequency components (brightness information) and low-frequency components (color information) with different resolutions. This segmentation allows independent processing of each component, reducing overall processing load while maintaining image quality.
Solution Approach 2:
Instead of converting non-Bayer image data to Bayer arrangement first (conventional approach), the patent inverts the process by directly separating high-frequency and low-frequency components from the original non-Bayer image data, avoiding unnecessary conversion steps.
2Measurement precision
If image resolution is increased, then image quality is improved, but processing load and power consumption increase
Solution Approach 1:
The patent applies different quality levels to different components of the image data. High-frequency components (brightness) maintain full resolution for sharpness, while low-frequency components (color) use lower resolution since color variations are less critical for perceived image quality, thereby reducing power consumption.
Solution Approach 2:
The patent changes the resolution parameter differently for different frequency components. By setting the low-frequency component resolution to half or less of the high-frequency component resolution, the system optimizes the balance between image quality and power consumption.
3Measurement precision
If image resolution is increased, then image quality is improved, but processing time increases
Solution Approach 1:
By segmenting image data into different frequency components with different resolution requirements, the patent enables parallel or independent processing of each component, significantly reducing total processing time while maintaining overall image quality.
Solution Approach 2:
The patent applies full resolution processing only where necessary (high-frequency brightness components) and reduced resolution where sufficient (low-frequency color components), avoiding excessive processing in areas where high resolution provides minimal benefit.
Data Source
AI summary
An image processing device includes a memory and a processor configured to separate first image data obtained by an image sensor having a Bayer arrangement, into second image data that includes brightness information, and third image data that includes color information and has a lower resolution than the first image data and the second image data, wherein a pixel arrangement of the third image data includes two pixels in each of a horizontal direction and a vertical direction, among which two pixels on one diagonal are of a same type, two pixels on another diagonal are of types different from each other, and the two pixels on said another diagonal are of the types different from the two pixels on the one diagonal.