Image Sensor Macropixel Processing for Power Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

High-power consumption and high clock frequency requirements in image processing for increasing resolution and frame rates pose challenges for image sensor devices, particularly in low-power systems like mobile devices and security cameras, where efficient processing is needed without increasing physical implementation complexity.

Innovation Solution

An image sensor device with a processor configured to arrange pixel signals into macropixel signal sets, performing parallel image enhancement operations to generate enhanced signals, which reduces clock speed and power consumption by processing similar color pixels together, using a Bayer color filter array and multiple pipelines to lower operational frequency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If pixel density and frame rates are increased to improve image quality and processing performance, then image processing capability is improved, but power consumption and clock frequency requirements increase

Engineering Contradiction:
Improveimage processing capabilityVSAvoidpower consumption
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The patent divides the image sensor array into multiple macropixels, where each macropixel contains multiple adjacent pixels that are processed together. This segmentation allows the processing system to handle data in smaller, more manageable units, reducing the overall computational load and enabling lower clock frequency operation while maintaining processing capability for high-resolution images

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent merges adjacent pixels with similar color characteristics into macropixels that are processed in parallel. By combining pixels of the same color type (e.g., all red pixels in a macropixel), the system can perform parallel processing operations that reduce total processing time and power consumption compared to processing each pixel independently at high frequencies

Inventive Principle:
Principle #5Merging (Combining)

2Productivity

If pixel density and frame rates are increased to improve image quality and processing performance, then image processing capability is improved, but clock frequency requirements increase

Engineering Contradiction:
Improveimage processing capabilityVSAvoidclock frequency
Core Design Contradiction:
ProductivityVSSpeed

Solution Approach 1:

The patent segments the image sensor into macropixels containing multiple adjacent pixels, allowing the processing system to operate at lower clock frequencies by handling data in smaller units. This segmentation reduces the processing burden per clock cycle, enabling high-resolution image processing without requiring proportionally high clock frequencies

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements dynamic processing where the system can adaptively process macropixels in parallel based on the specific requirements of each image region. This dynamic approach allows the system to optimize processing speed and power consumption by adjusting the degree of parallelization and processing intensity according to the actual image content and requirements

Inventive Principle:
Principle #15Dynamics

3Use of energy by moving object

If macropixel processing is implemented to reduce power consumption and clock speed, then energy efficiency is improved, but device complexity increases

Engineering Contradiction:
Improvepower consumptionVSAvoidprocessing architecture complexity
Core Design Contradiction:
Use of energy by moving objectVSDevice complexity

Solution Approach 1:

The patent segments the image sensor array into macropixels with consistent color filter patterns, creating a structured organization that simplifies the processing architecture. By maintaining regular patterns within macropixels, the system can use standardized processing circuits that reduce overall device complexity despite the enhanced processing capabilities

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent designs the macropixel processing architecture to handle multiple color types and processing operations through universal circuits. The same processing infrastructure can handle different color channels and various image processing tasks, reducing the need for separate dedicated circuits for each function and thereby minimizing device complexity

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS10097799B2Image sensor device with macropixel processing and related devices and methods
Publication Date: 2018.10.09 STMICROELECTRONICS INT NV
  • US10097799B2 patent drawing
  • US10097799B2 patent drawing
  • US10097799B2 patent drawing

AI summary

An image sensor device may include an array of image sensing pixels with adjacent image sensing pixels being arranged in macropixel, and a processor coupled to the array of image sensing pixels. The processor may be configured to receive pixel signals from the array of image sensing pixels, and arrange the received pixel signals into macropixel signal sets for respective macropixels. The processor may be configured to perform, in parallel, an image enhancement operation on the received pixel signals for each macropixel signal set to generate enhanced macropixel signals, and transmit the enhanced macropixel signals.