Image Sensor to DSP Interface Protocol for High-Speed Data Transmission

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing interfaces between image sensors and digital signal processors (DSPs) face challenges in efficiently transmitting high-capacity image data due to redundant functions and increased circuit complexity, power consumption, and real-time data transmission issues, particularly when using standards like MIPI, which require advanced error handling and buffer management.

Innovation Solution

A specialized transmission system is implemented with multiple transmission and reception units that use a packet format with embedded header and error correction, allowing efficient data transmission over multiple lanes, minimizing redundant functions, and reducing circuit complexity and power consumption by eliminating the need for re-sending data and large buffers.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If general-purpose interface standards like MIPI are used for image sensor to DSP interface, then transmission capacity is improved, but circuit area and power consumption increase due to redundant functions

Engineering Contradiction:
Improvetransmission capacityVSAvoidcircuit area
Core Design Contradiction:
SpeedVSDevice complexity

Solution Approach 1:

The patent extracts and removes redundant functions from general-purpose interface standards like MIPI that are not needed for the specific image sensor to DSP interface application. This includes eliminating re-send request mechanisms, advanced error correction protocols, and other features that increase circuit complexity but are unnecessary for this dedicated high-speed imaging data transmission path.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies local quality by tailoring the interface protocol specifically for image sensor to DSP communication, creating a specialized version that maintains the high transmission capacity of standards like MIPI while removing unnecessary functions. The interface is optimized locally for this specific application rather than using a general-purpose solution.

Inventive Principle:
Principle #3Local quality

2Reliability

If re-send request mechanism is implemented for error correction, then transmission reliability is improved, but real-time property deteriorates

Engineering Contradiction:
Improvetransmission reliabilityVSAvoidreal-time property
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent implements preliminary action by incorporating forward error correction (FEC) codes into the transmission protocol. Error correction capabilities are built in advance into the data stream itself through redundant check bits and correction codes, allowing the receiving end to correct errors immediately without needing to request re-sends, thus maintaining real-time transmission properties.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent converts the potential harm of transmission errors into a benefit by using the redundant bits necessary for error correction as a means to achieve both reliability and real-time performance. The redundancy that might seem to increase overhead is actually utilized efficiently to provide on-the-fly error correction without stalling the transmission.

Inventive Principle:
Principle #22Blessing in disguise (Convert harm into benefit)

Data Source

PatentEP3567484B1Image output device, image output method, image processing device, image processing method, program, data structure, and imaging device
Publication Date: 2021.05.05 SONY GROUP CORP
  • EP3567484B1 patent drawingFigure 1
  • EP3567484B1 patent drawingFigure 2
  • EP3567484B1 patent drawingFigure 3

AI summary

The present technology relates to an image output device, an image output method, an image processing device, an image processing method, a program, a data structure, and an imaging device that enable image data to be efficiently transmitted. The present technology generates a header including header information including line information that indicates a line number of a line made of pixel data included in a payload, and an error detection code used for error detection of the header information, generates a packet including pixel data for one line that configures an image obtained by imaging in a payload, and to which the header is added, and outputs the packet. The present technology can be applied to an imaging device having an image sensor and a DSP.