Image Sensor With On-Chip Decompressor and Processor

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional image sensors require external image processing chips for processing RAW images and decompressing compressed data, leading to inefficiencies in data communication and processing speed.

Innovation Solution

An image sensor with a stacked structure incorporating an input unit for compressed data, a decompressor, and an image processor that applies processing directly to the image data, enabling high-speed input and processing of image data within the sensor.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If image processing and decompression are performed outside the image sensor using external chips, then device complexity is reduced in the image sensor itself, but processing speed and data communication efficiency deteriorate

Engineering Contradiction:
Improveimage sensor structureVSAvoidprocessing speed
Core Design Contradiction:
Device complexityVSProductivity

Solution Approach 1:

The patent merges the decompression function and image processing function into the image sensor substrate itself. The decompressor is configured to decompress compressed image data (e.g., JPEG format) directly on the image sensor substrate, and the image processor applies image processing to the decompressed data without requiring external chips, thereby improving processing speed and data communication efficiency while maintaining manageable device complexity through integrated design.

Inventive Principle:
Principle #5Merging (Combining)

2Quantity of substance

If compressed image data is processed outside the image sensor, then data communication volume is reduced, but processing time and speed deteriorate

Engineering Contradiction:
Improvedata communication volumeVSAvoidprocessing time
Core Design Contradiction:
Quantity of substanceVSLoss of time

Solution Approach 1:

The patent changes the spatial dimension of processing by moving the decompression and image processing functions from external devices to the image sensor substrate itself. This dimensional shift allows compressed image data to be decompressed and processed in-place immediately after capture, eliminating the time delay associated with external processing while maintaining the data volume benefits of compression.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Adaptability or versatility

If additional image processing functions are added outside the image sensor, then image processing capability is improved, but device complexity and integration deteriorate

Engineering Contradiction:
Improveimage processing capabilityVSAvoidsystem integration
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements multi-functionality within the image sensor substrate by integrating the decompressor, image processor, and their interconnections directly on the sensor. This universal design allows the image sensor to perform both capture and processing functions, enabling flexible image processing capabilities (including decompression of various formats and application of different processing algorithms) without requiring separate external processing systems.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This configuration allows for efficient execution of image processing and decompression within the image sensor, reducing data communication and enabling faster processing of RAW images and compressed data, while also allowing for the application of developing processing to stored images.

Implementation Method 1

an imaging unit including a plurality of photoelectric converters, the image sensor comprising

Methodology Applied
Scientific EffectPhotoelectric conversion: Photoelectric Effect

Data Source

PatentUS10021325B2Image sensor and image capturing apparatus
Publication Date: 2018.07.10 CANON KK
  • US10021325B2 patent drawing
  • US10021325B2 patent drawing
  • US10021325B2 patent drawing

AI summary

An image sensor provided with an imaging unit including a plurality of photoelectric converters, the image sensor comprises: an input unit to which compressed image data is input from the outside of the image sensor; a decompressor for decompressing the compressed image data input from the input unit; and an image processor that applies image processing to image pickup data obtained from the imaging unit and to the image data decompressed by the decompressor.