Array Image Processing for Dynamic Sensitivity-Resolution Balance
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image capturing devices face challenges in optimizing image processing modes to balance sensitivity enhancement and resolution enhancement within limited space and power constraints, particularly when using array lenses.
Innovation Solution
An image processing method and apparatus that determines setting parameters for using multi-view or single view, prioritizing sensitivity or resolution enhancement through pixel binning or interpolation, and employs hardware or software-based binning processing to generate output images based on these parameters.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Illumination intensity
If pixel binning is used for sensitivity enhancement, then image sensitivity is improved, but resolution is degraded
Solution Approach 1:
The patent implements dynamic switching between pixel binning mode and pixel interpolation mode based on real-time scene assessment. The processing mode determination module evaluates scene characteristics (such as lighting conditions, texture complexity, and subject distance) and automatically selects the appropriate processing mode, allowing the system to adapt between sensitivity enhancement and resolution enhancement as needed.
2Measurement precision
If pixel interpolation is used for resolution enhancement, then image resolution is improved, but sensitivity enhancement is reduced
Solution Approach 1:
The system dynamically adjusts processing modes based on scene assessment. When the scene assessment module detects conditions favorable for resolution enhancement (such as adequate lighting, static subjects, or textured scenes), it switches to pixel interpolation mode, thereby optimizing resolution while accepting reduced sensitivity enhancement.
3Measurement precision
If multi-view processing is used, then image quality is enhanced, but power consumption increases
Solution Approach 1:
The patent implements dynamic selection between multi-view processing and single-view processing based on scene assessment results. The processing mode determination module evaluates whether multi-view processing is necessary by analyzing scene characteristics, and only activates multi-view processing when the scene benefits from it, thereby reducing unnecessary power consumption while maintaining image quality enhancement when needed.
4Productivity
If hardware logic-based binning processing is used, then processing efficiency is improved, but flexibility in processing modes is reduced
Solution Approach 1:
The patent segments the image processing pipeline into distinct functional modules: a hardware logic-based binning processing module for efficient sensitivity enhancement, a pixel interpolation module for resolution enhancement, and a processing mode determination module that coordinates between them. This segmentation allows the system to use efficient hardware processing where applicable while maintaining software-based flexibility for mode selection and parameter adjustment.
Data Source
AI summary
An image processing method includes: based on an imaging device generating an input array image of a multi-view through an array lens, determining a first setting parameter indicating whether to use the multi-view or a single view selected from the multi-view; determining a second setting parameter indicating whether a priority is assigned to sensitivity enhancement based on pixel binning or to resolution enhancement based on pixel interpolation; determining an image processing mode based on the first setting parameter and the second setting parameter; and generating an output image by performing image processing on the input array image based on a processing procedure that is based on the determined image processing mode.