Quad Bayer Image Sensor Fusion for Resolution and Light Sensitivity Trade-off

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing methods for electronic devices struggle to balance image resolution and light sensitivity, often compromising either quality or resolution depending on the ambient lighting conditions.

Innovation Solution

The method involves acquiring images using a Quad Bayer pixel arrangement pattern for high light sensitivity and a standard Bayer pattern, then fusing these images to balance resolution and light sensitivity, with adjustments based on ambient light intensity to optimize image quality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the resolution is increased to ensure high resolution in high light environment, then the image resolution is improved, but the image quality is lost

Engineering Contradiction:
Improveimage resolutionVSAvoidimage quality
Core Design Contradiction:
Measurement precisionVSManufacturing precision

Solution Approach 1:

The patent applies dynamics by dynamically switching between different photographing modes (first mode with higher resolution and second mode with higher light sensitivity) based on ambient light conditions. The system adjusts the photographing parameters in real-time according to the lighting environment, allowing it to optimize between resolution and quality adaptively rather than being fixed in one mode.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the photographing parameters (resolution settings and light sensitivity settings) based on ambient light intensity. When light intensity is above a threshold, it uses parameters optimized for resolution; when below the threshold, it switches to parameters optimized for light sensitivity, thus resolving the contradiction between resolution and quality under different conditions.

Inventive Principle:
Principle #35Parameter changes

2Manufacturing precision

If the light sensitivity is increased to ensure image quality in low light environment, then the image quality is improved, but the image resolution is lost

Engineering Contradiction:
Improveimage qualityVSAvoidimage resolution
Core Design Contradiction:
Manufacturing precisionVSMeasurement precision

Solution Approach 1:

The system dynamically adjusts the photographing mode based on ambient light conditions. In low light environments (below threshold), it switches to the second photographing mode that prioritizes light sensitivity for quality, while in high light environments (above threshold), it switches to the first mode that prioritizes resolution. This dynamic adaptation resolves the contradiction between quality and resolution.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the photographing parameters according to ambient light intensity thresholds. When light intensity is below the threshold, it uses parameters optimized for light sensitivity; when above the threshold, it uses parameters optimized for resolution. This parameter switching mechanism allows the system to overcome the limitation of having to choose between quality and resolution in fixed modes.

Inventive Principle:
Principle #35Parameter changes

3Device complexity

If a single photographing mode is used to maintain consistent settings, then the device complexity is reduced, but the adaptability to different lighting conditions is worsened

Engineering Contradiction:
Improvephotographing mode settingsVSAvoidadaptability to lighting conditions
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The patent implements a dynamic photographing mode selection mechanism that automatically switches between first and second photographing modes based on ambient light intensity detection. The system monitors light conditions in real-time and adjusts the mode accordingly, achieving high adaptability to different lighting environments while maintaining relatively simple device architecture through automated control.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system uses feedback from ambient light intensity detection to automatically determine which photographing mode to use. By continuously monitoring light conditions and adjusting the photographing mode based on this feedback, the system achieves high adaptability without requiring complex manual configuration, thus balancing simplicity and versatility.

Inventive Principle:
Principle #23Feedback

Data Source

PatentEP3621027B1Method and apparatus for processing image, electronic device and storage medium
Publication Date: 2024.10.30 BEIJING XIAOMI MOBILE SOFTWARE CO LTD
  • EP3621027B1 patent drawingFigure 1A~1B
  • EP3621027B1 patent drawingFigure 1C~1D
  • EP3621027B1 patent drawingFigure 2~3

AI summary

The present disclosure provides a method for processing an image, an electronic device and a storage medium. The method includes: at least one first image frame is acquired based on a first pixel arrangement pattern when receiving a photographing instruction, wherein a pixel in the first pixel arrangement pattern includes sub-pixels of the same color component distributed in a square array in a photosensitive element; at least one second image frame is acquired based on a second pixel arrangement pattern, wherein the second pixel arrangement pattern is a standard Bayer arrangement pattern; and the at least one first image frame and the at least one second image frame are fused to obtain an image to be displayed.