ISP Data Traffic Management via Threshold-Based Batching

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Modern electronic devices, such as cell phones, experience higher power consumption due to slow and uniformly spread-out image signal processor (ISP) data traffic patterns, which are not efficiently managed, leading to increased energy usage.

Innovation Solution

An apparatus and method that include an ISP front-end configured to receive and store image data in a first memory, with the data being output to a second memory via a memory link when the data reaches a size threshold, allowing the memory link to enter a low-power mode and reducing unnecessary power consumption.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Use of energy by moving object

If image data is continuously transferred through the memory link in a uniform pattern, then data processing is maintained, but power consumption increases

Engineering Contradiction:
Improvepower consumptionVSAvoiddata processing efficiency
Core Design Contradiction:
Use of energy by moving objectVSProductivity

Solution Approach 1:

The patent implements periodic batching of image data transfers, where the memory link operates in alternating active and idle states. Instead of continuous uniform transfer, data is accumulated in buffers and transferred in periodic bursts, allowing the memory link to enter low-power modes during idle periods while maintaining overall data processing throughput

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The patent uses buffer memories to preliminarily store image data before transfer through the memory link. By pre-loading buffers with data and enabling the memory link to operate in low-power mode while buffers are being filled, the system prepares data in advance for efficient batched transfer, reducing active memory link operation time and power consumption

Inventive Principle:
Principle #10Preliminary action

2Use of energy by moving object

If the memory link operates continuously to maintain data flow, then data processing efficiency is maintained, but power consumption increases

Engineering Contradiction:
Improvepower consumptionVSAvoiddata processing continuity
Core Design Contradiction:
Use of energy by moving objectVSReliability

Solution Approach 1:

The system implements periodic data transfer batches with controlled idle periods between them. Buffers are filled during active periods and then transferred in batches, creating a rhythmic pattern of operation that allows the memory link to enter low-power states while ensuring data processing continuity through proper buffer management and timing

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

Buffer memories serve as intermediary storage between the image data source and the memory link. These buffers decouple the continuous data generation from the batched transfer process, allowing the memory link to operate intermittently in low-power mode while buffers maintain data availability, thus ensuring processing continuity without requiring constant memory link operation

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS10506161B2Image signal processor data traffic management
Publication Date: 2019.12.10 QUALCOMM INC
  • US10506161B2 patent drawing
  • US10506161B2 patent drawing
  • US10506161B2 patent drawing

AI summary

Methods and apparatus to manage image signal processor (ISP) data traffic is provided. The apparatus includes an ISP having an ISP front-end configured to receive image data and a first memory configured to store the image data. The ISP front-end is further configured to output the image data stored in the first memory to a second memory via a memory link in response to the image data stored in the first memory reaching a size threshold. Another apparatus includes apparatus includes a camera sensor configured to output image data in a camera mode, an ISP on a die, a camera link coupling the camera sensor and the ISP, a memory, and a memory link coupling the ISP and the memory. The memory link is configured to enter a low-power mode in the camera mode.