Image Sensor Merged Pixel Autofocus Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional image processing methods either result in low-resolution images or require significant time and resources to achieve high-resolution images, which is inconvenient for users.

Innovation Solution

An image processing method that outputs a merged image with collective photosensitive pixels as merged pixels, determines a focusing area, and converts it into a true-color image based on brightness, green proportion, and space frequency thresholds, or uses interpolation algorithms to enhance image quality depending on the scene.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional image processing methods are used to achieve high resolution, then image quality is improved, but processing time and resource consumption increase significantly

Engineering Contradiction:
Improveimage resolutionVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent applies preliminary action by performing autofocus determination and scene analysis before final image processing. The system determines the focusing area and analyzes scene characteristics (brightness, green proportion, space frequency) in advance, then selects the appropriate processing path (merged true-color image or simulation true-color image) accordingly. This preliminary analysis enables efficient processing without unnecessary computational steps.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements dynamics by adaptively selecting different image processing paths based on real-time scene conditions. When the scene contains a target object in the focusing area, the system generates a merged true-color image; when the scene is landscape or lacks target objects, it generates a simulation true-color image using interpolation algorithms. This dynamic adaptation optimizes processing efficiency while maintaining image quality appropriate for each scene type.

Inventive Principle:
Principle #15Dynamics

2Productivity

If merged image processing is used, then processing time is reduced, but image resolution and quality may deteriorate

Engineering Contradiction:
Improveprocessing speedVSAvoidimage resolution
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent applies local quality by determining a specific focusing area within the image where target objects are located. The system performs different processing operations on different regions: merged pixel processing is applied to the focusing area to maintain speed, while simulation true-color image processing with interpolation algorithms is applied to non-focusing areas to maintain resolution and quality. This localized approach ensures high quality where needed while maintaining overall processing efficiency.

Inventive Principle:
Principle #3Local quality

3Measurement precision

If simulation true-color image processing with interpolation algorithms is used, then image quality is improved, but processing complexity and resource consumption increase

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies partial action by performing simulation true-color image processing with interpolation algorithms only on non-focusing areas of the image, rather than the entire image. The focusing area undergoes simpler merged true-color image processing. This partial application of complex processing reduces overall computational complexity and resource consumption while maintaining image quality in the critical focusing regions.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentEP3327781B1Image processing method and apparatus, and electronic device
Publication Date: 2019.12.25 GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP LTD
  • EP3327781B1 patent drawingFigure 1~2
  • EP3327781B1 patent drawingFigure 3~4
  • EP3327781B1 patent drawingFigure 5

AI summary

An image processing method and apparatus (4000), and an electronic device (1000) are provided. The image processing method is applied in an electronic device (1000). The electronic device (1000) includes an image sensor (10). The image sensor (10) includes an array (12) of photosensitive pixel units and an array (14) of filter units arranged on the array (12) of photosensitive pixel units, each filter unit (14a) corresponds to one photosensitive pixel unit (12a), and each photosensitive pixel unit (12a) includes a plurality of photosensitive pixels (122). The image processing method includes outputting (211) a merged image by the image sensor (10); determining (212) a focusing area of the merged image; determining (214) whether there is a target object in the focusing area; and when there is the target object in the focusing area, converting (216) the merged image into a merged true-color image.