Interleaved Multi-Focal Plane Image Data Transmission

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional camera systems face challenges in efficiently transmitting and reconstructing image data from multiple focal planes, particularly in maintaining image integrity and resolution when capturing scenes with varying exposure times and perspectives.

Innovation Solution

The system interleaves image data from multiple focal planes, generating lines of data that include additional metadata describing the capture process, such as focal plane configuration and gain settings, to enable accurate reconstruction of images. This data is packetized and transmitted using interface formats like MIPI CSI-2, allowing for efficient transmission and processing of high-resolution images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If image data from multiple focal planes is transmitted using traditional single-focal-plane interface formats, then transmission compatibility is maintained, but image data integrity and resolution are compromised

Engineering Contradiction:
Improveimage data integrityVSAvoidinterface format compatibility
Core Design Contradiction:
Manufacturing precisionVSAdaptability or versatility

Solution Approach 1:

The patent segments the transmission data into distinct packets, with each packet containing image data from a specific focal plane along with metadata identifying the focal plane characteristics. This segmentation allows traditional interface formats to transmit each packet independently while maintaining overall multi-focal-plane data integrity through proper packet identification and assembly at the receiving end.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary data structure (packet format with metadata) that bridges traditional interface formats and multi-focal-plane requirements. The metadata acts as an intermediary layer that carries focal plane identification information, enabling compatibility with existing interfaces while preserving the ability to distinguish and process data from multiple focal planes with different exposure times and perspectives.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If additional metadata is transmitted with image data to describe focal plane configuration, then image reconstruction accuracy is improved, but data transmission volume increases

Engineering Contradiction:
Improveimage reconstruction accuracyVSAvoiddata transmission volume
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent applies local quality by transmitting metadata selectively at the packet level rather than globally for all data. Each packet contains only the specific metadata needed to identify and process that particular focal plane's data (such as focal plane index, exposure time, and perspective information), avoiding unnecessary data transmission while maintaining reconstruction accuracy for each individual packet.

Inventive Principle:
Principle #3Local quality

3Adaptability or versatility

If image data from multiple focal planes is captured simultaneously, then scene coverage with varying exposure times is improved, but data processing complexity increases

Engineering Contradiction:
Improvescene coverage capabilityVSAvoiddata processing complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by embedding focal plane identification metadata and configuration information directly into each data packet during the capture phase. This preliminary tagging of data with identification information simplifies subsequent processing, as the receiving system can immediately sort and process packets from different focal planes based on the pre-provided metadata without requiring complex post-capture analysis to determine data origins.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10742861B2Systems and methods for transmitting and receiving array camera image data
Publication Date: 2020.08.11 FOTONATION LIMITED
  • US10742861B2 patent drawing
  • US10742861B2 patent drawing
  • US10742861B2 patent drawing

AI summary

Systems and methods for transmitting and receiving image data captured by an imager array including a plurality of focal planes are described. One embodiment of the invention includes capturing image data using a plurality of active focal planes in a camera module, where an image is formed on each active focal plane by a separate lens stack, generating lines of image data by interleaving the image data captured by the plurality of active focal planes, and transmitting the lines of image data and the additional data.