On-Chip Image Sensor Data Compression Engine

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The increasing resolution and frame rate of digital images and videos lead to a power consumption bottleneck in image sensors, causing battery depletion and noise in image data transfer between the image sensor and the digital signal processor, with traditional solutions like increasing pins being physically constrained and reducing quality by capturing at lower resolutions and frame rates.

Innovation Solution

Implementing on-chip image sensor data compression using a compression engine that transforms pixel data into compressed formats within the available bandwidth of the output bus, allowing for high-resolution and high-frame rate image capture without excessive power consumption.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If image resolution and frame rate are increased, then image quality is improved, but power consumption increases

Engineering Contradiction:
Improveimage qualityVSAvoidpower consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent applies preliminary action by performing compression operations on the image sensor chip before data transmission. The compression engine processes pixel data and generates compressed data that fits within the available bus bandwidth, reducing the power required for data transfer while maintaining high-resolution and high-frame-rate image quality.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If bus bandwidth is increased to transfer more image data, then image quality is improved, but device complexity increases

Engineering Contradiction:
Improveimage qualityVSAvoiddevice complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies parameter changes by dynamically adjusting the compression rate of the compression engine to match the available bus bandwidth. This allows the system to transfer high-resolution image data at high frame rates without increasing physical bus bandwidth or device complexity, as the compression adapts to the existing transmission capabilities.

Inventive Principle:
Principle #35Parameter changes

3Use of energy by moving object

If compression rate is increased to reduce power consumption, then power usage is reduced, but image quality deteriorates

Engineering Contradiction:
Improvepower consumptionVSAvoidimage quality
Core Design Contradiction:
Use of energy by moving objectVSMeasurement precision

Solution Approach 1:

The patent applies dynamics by making the compression rate variable rather than fixed. The compression engine adjusts its compression rate dynamically based on the available bus bandwidth, allowing the system to optimize the balance between power consumption and image quality for different operating conditions and bandwidth availability.

Inventive Principle:
Principle #15Dynamics

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables efficient transfer of high-resolution and high-frame rate image data with reduced power usage and noise, allowing for higher-quality image capture without the need for professional-grade equipment.

Implementation Method 1

an image sensor chip configured to convert light into pixel data

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Data Source

PatentUS11375139B2On-chip image sensor data compression
Publication Date: 2022.06.28 GOPRO INC
  • US11375139B2 patent drawing
  • US11375139B2 patent drawing
  • US11375139B2 patent drawing

AI summary

Systems and methods are disclosed that capture and compress frames of pixel data. In an implementation, an image sensor chip is configured to convert light into pixel data and generate compressed pixel data at a variable compression rate including applying a transform to pixel data associated with a pixel category from a plurality of pixel categories. The variable compression rate is within an available bandwidth of an output bus configured to output the compressed pixel data.