Image Sensor Module With Processor-In-Memory Circuit

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

As demands for high-quality and high-resolution images and videos increase, the size of image data generated by image sensors has grown, necessitating higher bandwidth for smooth calculation processing.

Innovation Solution

An image sensor module is developed, incorporating an image sensor, a memory with a Processor-in-Memory (PIM) circuit, and a signal processor. The memory performs calculation processing on image data using processing elements corresponding to memory banks, enabling efficient image processing and storage.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the size of image data is increased to meet high-quality and high-resolution demands, then the image quality and resolution are improved, but the bandwidth requirement increases making smooth calculation processing difficult

Engineering Contradiction:
Improveimage qualityVSAvoidcalculation processing speed
Core Design Contradiction:
Measurement precisionVSSpeed

Solution Approach 1:

The patent merges the processing elements directly into the memory structure, creating a Processor-in-Memory (PIM) architecture where calculation operations are performed within the memory device itself rather than requiring external processing units to access the data through high-speed interfaces. This integration eliminates the bandwidth bottleneck by performing computations directly on the stored image data.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent introduces an intermediary data transfer mechanism between the image sensor and the processing system. The memory acts as an intermediary that receives image data from the sensor and performs calculations internally, mediating between the need for high-resolution data retention and the requirement for efficient processing without requiring direct high-bandwidth connections to external processors.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If the bandwidth is increased to support larger image datasets, then the calculation processing becomes smoother, but the device complexity and memory requirements increase

Engineering Contradiction:
Improvecalculation processing smoothnessVSAvoidmemory structure complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent combines storage and processing functions into a single integrated memory device with PIM circuitry. This merging eliminates the need for separate high-bandwidth external processing units and complex interconnection infrastructure, achieving smooth calculation processing on large datasets while reducing overall system complexity through functional integration.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS12302008B2Image sensor module and method of operating the same
Publication Date: 2025.05.13 SAMSUNG ELECTRONICS CO LTD
  • US12302008B2 patent drawing
  • US12302008B2 patent drawing
  • US12302008B2 patent drawing

AI summary

An image sensor module includes an image sensor configured to generate image data; a memory including a processor in memory (PIM) circuit, of the PIM circuit including banks configured to store the image data and a plurality of processing elements; and a signal processor, wherein the memory is configured to read the image data from the banks, perform a first image processing operation on the image data by using the processing elements corresponding to the banks, and store image-processed image data on which the first image processing operation is performed in the banks or output the image-processed image data.