Multi-Exposure Image Sensor Pixel Segmentation for Viewfinder Stability

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing camera systems face challenges in setting optimal exposure times for multi-exposure images, such as High Dynamic Range (HDR) images, which can result in inadequate exposure of scene elements and disrupt the user experience due to changing viewfinder brightness.

Innovation Solution

The use of an image sensor with at least two sets of pixels enabling different exposure times, where one set is controlled for exposure analysis and another for maintaining consistent viewfinder brightness, allowing for customized exposure times for each scene and optimizing the number of images needed for multi-exposure images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If a single set of pixels is used for both viewfinder exposure and multi-exposure image analysis, then the device complexity is reduced, but the exposure quality and viewfinder brightness stability deteriorate

Engineering Contradiction:
Improvepixel set configurationVSAvoidexposure quality
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The image sensor is divided into at least two separate sets of pixels: a first set dedicated to viewfinder exposure and a second set dedicated to multi-exposure image capture. This segmentation allows each pixel set to independently perform its specific function without interfering with the other, thereby maintaining both device simplicity and exposure quality reliability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different regions (pixel sets) of the image sensor are assigned different functional qualities: the first set of pixels is optimized for viewfinder exposure with consistent exposure parameters, while the second set is optimized for multi-exposure capture with variable exposure times. This local differentiation ensures each region performs its specific function optimally.

Inventive Principle:
Principle #3Local quality

2Manufacturing precision

If exposure times are customized for each scene in multi-exposure imaging, then the image quality is improved, but the time required for exposure analysis and image capture increases

Engineering Contradiction:
Improveimage qualityVSAvoidexposure analysis time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The system performs preliminary exposure analysis using the second set of pixels to determine optimal exposure times for different scene regions before actual multi-exposure capture. This preliminary analysis allows the system to pre-calculate exposure parameters, reducing the time required during actual image capture while maintaining high image quality.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent replaces traditional single-exposure mechanical timing mechanisms with a computational approach using the second pixel set to analyze scene characteristics and calculate optimal exposure times. This substitution of mechanical timing with intelligent analysis enables customized exposure times without proportionally increasing capture time.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Device complexity

If the viewfinder uses the same pixels as multi-exposure analysis, then the device structure is simplified, but the viewfinder brightness becomes unstable

Engineering Contradiction:
Improvesensor structureVSAvoidviewfinder brightness
Core Design Contradiction:
Device complexityVSStability of the object's composition

Solution Approach 1:

The image sensor is segmented into distinct pixel sets: the first set exclusively for viewfinder display with stable, consistent exposure parameters, and the second set for multi-exposure analysis with variable exposure times. This physical segmentation eliminates the brightness instability that would occur if the same pixels were used for both purposes.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The first set of pixels is assigned the local quality of stable brightness through consistent exposure parameters, while the second set has the local quality of variable exposure for analysis. This differentiation ensures the viewfinder maintains stable brightness independent of the multi-exposure capture process.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS10097766B2Provision of exposure times for a multi-exposure image
Publication Date: 2018.10.09 MICROSOFT TECHNOLOGY LICENSING LLC
  • US10097766B2 patent drawing
  • US10097766B2 patent drawing
  • US10097766B2 patent drawing

AI summary

According to one aspect, there is provided an apparatus comprising at least one processing unit and at least one memory. The at least one memory stores program instructions that, when executed by the at least one processing unit, cause the apparatus to control a first set of pixels of an image sensor for exposure of a scene for a camera viewfinder, the image sensor having at least two sets of pixels enabling different exposure times, and control a second set of pixels of the image sensor for exposure analysis of the scene for images to be captured for a multi-exposure image.