Imaging Apparatus Parallel Channel Processing High Frame Rate

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

High-speed imaging apparatuses face challenges in achieving high spatial resolution and long-time recording due to reduced pixel readout, complex image conversion processing, and limited semiconductor memory capacity, as well as the need for complex processing of spatially divided image segments.

Innovation Solution

An imaging apparatus that captures data at a high rate, divides it into N channels of lower rate, and processes these channels in parallel, allowing for output and recording of processed data without requiring high-speed signal processing, and enables frame combination for various output rates.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If the number of pixels read from a solid-state imaging element is reduced to achieve high-speed imaging, then the frame rate is improved, but the spatial resolution deteriorates

Engineering Contradiction:
Improveframe rateVSAvoidspatial resolution
Core Design Contradiction:
SpeedVSMeasurement precision

Solution Approach 1:

The imaging data is divided into N channels by distributing frames sequentially to each channel. This segmentation allows the high-speed imaging data to be processed in parallel at lower speeds, achieving both high frame rate and high spatial resolution without requiring high-speed signal processing circuits.

Inventive Principle:
Principle #1Segmentation

2Speed

If imaging data is recorded directly onto a semiconductor memory to realize high-speed imaging, then the frame rate is improved, but the recording duration deteriorates due to limited memory capacity

Engineering Contradiction:
Improveframe rateVSAvoidrecording duration
Core Design Contradiction:
SpeedVSDuration of action of moving object

Solution Approach 1:

The imaging data is divided into N channels and recorded in parallel. This segmentation increases the effective recording capacity by distributing data across multiple channels, allowing both high frame rate and extended recording duration without requiring a single large-capacity high-speed memory.

Inventive Principle:
Principle #1Segmentation

3Productivity

If an image is spatially divided into segments and processed in parallel to perform image processing at a high speed, then the processing speed is improved, but the device complexity deteriorates due to the need for combining images during reproduction

Engineering Contradiction:
Improveprocessing speedVSAvoidprocessing complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The imaging data is divided into N channels by distributing frames sequentially to each channel. This temporal and channel-based segmentation is simpler than spatial segmentation because it maintains complete frame information in each channel, eliminating the need for complex spatial recombination processing during reproduction.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Instead of dividing images spatially (within each frame), the patent divides data along the temporal dimension by distributing different frames to different channels. This dimensional change simplifies processing because each channel receives complete frame data that can be independently processed without spatial recombination.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

4Speed

If high-speed signal processing is performed to process imaging data output at high speed, then the frame rate is improved, but the device complexity deteriorates

Engineering Contradiction:
Improveframe rateVSAvoidsignal processing complexity
Core Design Contradiction:
SpeedVSDevice complexity

Solution Approach 1:

The high-speed imaging data stream is segmented into N parallel channels, each processing a subset of frames at a lower speed (1/N of the original frame rate). This segmentation allows standard low-speed processing circuits to handle the data, eliminating the need for complex high-speed signal processing hardware while maintaining the overall high frame rate capability.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS8687079B2Imaging apparatus, imaging method, recording medium, and program
Publication Date: 2014.04.01 SONY GROUP CORP
  • US8687079B2 patent drawing
  • US8687079B2 patent drawing
  • US8687079B2 patent drawing

AI summary

An imaging method, a recording medium, and a program which are capable of processing imaging data of a high rate in a manner similar to that of a normal frame rate. Image data captured by a solid-state imaging element capable of performing imaging at a high resolution and a high frame rate is supplied to a memory control unit. The memory control unit, at the same time as writing the imaging data input from the imaging element in a frame memory, reads preceding frames of imaging data that are recorded on the frame memory, and sequentially respectively outputs them in parallel, as video image data items for each frame, to respective camera signal processing units. Then, in the camera signal processing units, a video output unit, a viewfinder output unit, codec units, and recording units, processing similar to that in the case of a frame rate that is ¼ the imaging frame rate is executed.