Single-Chip Sensor Image Processing for High Frame Rate Color Resolution

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional single-chip color image capturing schemes face challenges in achieving high color resolution and sensitivity due to inefficient light usage and low frame rates, particularly when compared to three-chip methods.

Innovation Solution

An image generation device processes moving pictures captured with a single-chip color image sensor by combining images with different exposure times and frame rates to generate a new moving picture with increased color resolution and sensitivity, utilizing a getting section to retrieve video signals and a processing section to enhance frame rate and output a high-quality image.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If a single-chip color image capturing scheme is used, then the device complexity is reduced and cost is lowered, but the color resolution and sensitivity decrease due to inefficient light usage

Engineering Contradiction:
Improvedevice complexityVSAvoidcolor resolution
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent applies preliminary action by capturing images at multiple exposure times before processing. The image capturing unit acquires a plurality of images with different exposure times, allowing the processing unit to later synthesize these pre-captured images to generate high-color-resolution output without requiring complex optical systems during the capturing phase

Inventive Principle:
Principle #10Preliminary action

2Device complexity

If a single-chip color image capturing scheme is used, then the device complexity is reduced, but the sensitivity becomes low due to light rays being absorbed or reflected

Engineering Contradiction:
Improvedevice complexityVSAvoidsensitivity
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The system performs preliminary capture of multiple images with varying exposure times. By pre-capturing images at different exposure levels, the processing unit can later combine these to achieve high sensitivity output without requiring the complex light-separating optical system that would be needed to capture all light components simultaneously

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces a temporal dimension by capturing images across multiple exposure times rather than relying solely on spatial color separation. This transforms the problem from a spatial color filtering approach to a temporal multi-exposure approach, allowing all color information to be captured through a single chip over time

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Reliability

If images are captured with longer exposure time to increase sensitivity, then the sensitivity increases, but the frame rate decreases

Engineering Contradiction:
ImprovesensitivityVSAvoidframe rate
Core Design Contradiction:
ReliabilityVSSpeed

Solution Approach 1:

The system uses periodic action by capturing images at regular intervals with different exposure times. The image capturing unit systematically acquires multiple images with varying exposure times in a periodic sequence, allowing the processing unit to select and combine appropriate frames to achieve both high sensitivity and maintained frame rate in the output

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The patent resolves the frame rate conflict by moving from a single-exposure-time dimension to a multi-exposure-time dimension. Instead of being constrained to a single exposure time that limits frame rate, the system captures across multiple exposure time points and selectively combines them, effectively adding a temporal sampling dimension that decouples sensitivity from frame rate

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

4Measurement precision

If virtual signals are calculated based on adjacent pixels to increase color resolution, then the color resolution increases, but the manufacturing precision and light usage efficiency remain limited

Engineering Contradiction:
Improvecolor resolutionVSAvoidlight usage efficiency
Core Design Contradiction:
Measurement precisionVSManufacturing precision

Solution Approach 1:

Rather than calculating virtual signals from adjacent pixels after capture, the system performs preliminary capture of multiple images with different exposure times. This pre-capture approach allows direct extraction of color information from pixels that actually received the respective color light, eliminating the need for post-capture virtual signal calculation and improving both color resolution and light usage efficiency

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS8749673B2Image generation device and image generation system, method and program
Publication Date: 2014.06.10 PANASONIC HOLDINGS CORP
  • US8749673B2 patent drawing
  • US8749673B2 patent drawing
  • US8749673B2 patent drawing

AI summary

The image generation device generates a new moving picture of a subject based on first and second moving pictures shot with a single-chip color image sensor, which detects two light rays including first and second color components, respectively, to represent the first and second color components of the subject. As the first moving picture has been shot in a longer exposure time than the second moving picture, the first picture has a lower frame rate than the second picture. The image generation device includes: a getting section which gets video signals representing the first and second moving pictures, respectively; a processing section which generates a new moving picture with as high a frame rate as the second moving picture based on the respective video signals representing the first and second moving pictures gotten; and an output section which outputs the new moving picture.