Image Sensor Pixel Array Merged Binning Zoom Processing

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing electronic devices with image sensors face challenges in implementing zoom-in and zoom-out functions without compromising image quality, as using image signal processing alone degrades quality, while employing separate zoom lenses or image sensors is expensive and not compact.

Innovation Solution

An image sensor with a pixel array arranged in a Bayer pattern, featuring merged pixels that can be driven to generate full resolution images, which are then processed in normal, zoom-in, or zoom-out modes through remosaicing or binning to maintain image quality without the need for additional lenses or sensors.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If image signal processing (ISP) is used to implement zoom functions, then the zoom-in function can be realized, but image quality is downgraded

Engineering Contradiction:

Improvezoom functionVSAvoidimage quality

Core Design Contradiction:

Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The pixel array is divided into multiple regions with different merged pixel configurations. Some regions use 2x2 merged pixels while others use different merging patterns, allowing different parts of the image to be processed differently to maintain overall image quality during zoom operations

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

Different regions of the pixel array have different local structures optimized for specific functions. The remosaic processor applies different processing strategies to different regions based on their merged pixel patterns, preserving image quality in critical areas while enabling zoom functionality

Inventive Principle:

Principle #3Local quality

2Adaptability or versatility

If separate zoom-in and zoom-out image sensors or lenses are used, then zoom functions can be implemented, but the device becomes expensive and not compact

Engineering Contradiction:

Improvezoom functionVSAvoidhardware structure

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

A single pixel array with merged pixels configured in Bayer patterns serves multiple functions - it can capture full-resolution images, perform zoom-in operations, and execute remosaic processing all within one sensor structure, eliminating the need for separate zoom sensors or lenses

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

Multiple functional capabilities (normal imaging, zoom-in, remosaic processing) are merged into a single image sensor system. The pixel array combines different merged pixel patterns that can be processed to achieve various zoom effects without requiring separate hardware components

Inventive Principle:

Principle #5Merging (Combining)

Data Source

PatentUS11044407B2Image sensor and electronic device including the image sensor, and method of image zoom processing

Publication Date: 2021.06.22 SAMSUNG ELECTRONICS CO LTD

AI summary

An image sensor may include a pixel array having an N×M array of merged pixels arranged in a Bayer pattern, each merged pixel including an k*l matrix of unit pixels of a same color, where k and l are integers greater than two; and an image signal processor to process signals output by the pixel array in accordance with a normal mode or a zoom-in mode. In the zoom-in mode, signals from the pixel array may be remosaiced such that signals corresponding to the unit pixels are arranged in a p*q matrix of unit pixels of a same color, wherein p is a non-negative integer that is less than k and q is a non-negative integer less than 1, the p*q matrixes being arranged in a Bayer pattern.