Imaging Element Parallel Frame Reading for Smooth Motion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing imaging technologies face challenges in producing smooth motion picture images when the exposure time period is shorter than the output frame rate, leading to awkward subject movement and potential overexposure.

Innovation Solution

The imaging element employs a higher first frame rate for reading and processing image data, which is then output at a lower second frame rate, allowing for parallel reading and storage of multiple frames within an output period, and generates output image data by combining image data from multiple frames to reduce waiting times and prevent overexposure.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If the exposure time period is shorter than the output frame rate, then the imaging speed is improved, but the motion picture image becomes awkward and subject movement appears unnatural

Engineering Contradiction:
Improveimaging speedVSAvoidsmoothness of motion picture image
Core Design Contradiction:
SpeedVSReliability

Solution Approach 1:

The patent applies preliminary action by performing multiple exposures and capturing multiple frames within a single output period before the final output is generated. The reading portion reads image data from multiple frames in parallel, and the processing portion combines these pre-captured frames to generate the final output image data, ensuring smooth motion picture images even when exposure time is shorter than the output frame rate.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent merges multiple frames by combining image data from several exposures within one output period. The processing portion integrates the image data from multiple frames read by the reading portion, creating a composite output that maintains temporal continuity and smoothness in motion pictures while allowing for faster exposure rates.

Inventive Principle:
Principle #5Merging (Combining)

2Reliability

If the exposure time period is extended to capture smooth motion, then the image quality is improved, but overexposure occurs and brightness control is lost

Engineering Contradiction:
Improvesmoothness of motion picture imageVSAvoidbrightness control
Core Design Contradiction:
ReliabilityVSIllumination intensity

Solution Approach 1:

The patent segments the output period into multiple shorter exposure intervals, each capturing a frame. Instead of using a single long exposure, the system divides the time period into discrete segments (frames) that are read and combined later. This allows each individual exposure to remain short enough to avoid overexposure while the combination of multiple segments provides the smoothness of a longer effective exposure.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent employs periodic action by performing repeated exposures at regular intervals within the output period. The reading portion reads image data from multiple frames captured at different time points, and the processing portion combines these periodically captured frames. This periodic sampling approach maintains brightness control for each individual exposure while achieving smooth motion representation through the sequence of periodic captures.

Inventive Principle:
Principle #19Periodic action

3Device complexity

If multiple frames are processed sequentially, then the processing is simple, but the time delay increases and productivity decreases

Engineering Contradiction:
Improveprocessing complexityVSAvoidframe processing speed
Core Design Contradiction:
Device complexityVSProductivity

Solution Approach 1:

The patent transitions from sequential processing to parallel processing by utilizing multiple dimensions of the data structure. The reading portion reads image data from multiple frames simultaneously along the frame dimension, and the processing portion combines data across frames in parallel. This dimensional approach to processing allows multiple frames to be handled concurrently rather than one after another, significantly improving processing throughput while maintaining manageable complexity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent ensures continuity of useful action by having the reading portion continuously read image data from multiple frames in parallel without idle waiting periods. The processing portion continuously combines the read data to generate output image data. This continuous parallel operation eliminates the time delays inherent in sequential processing, maintaining high productivity while the systematic combination process keeps complexity under control.

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentUS12149838B2Imaging element, imaging apparatus, imaging method, and program
Publication Date: 2024.11.19 FUJIFILM CORP
  • US12149838B2 patent drawing
  • US12149838B2 patent drawing
  • US12149838B2 patent drawing

AI summary

An imaging element incorporates a reading portion that reads out captured image data at a first frame rate, a storage portion that stores the image data, a processing portion that processes the image data, and an output portion that outputs the processed image data at a second frame rate lower than the first frame rate. The reading portion reads out the image data of each of a plurality of frames in parallel. The storage portion stores, in parallel, each image data read out in parallel by the reading portion. The processing portion performs generation processing of generating output image data of one frame using the image data of each of the plurality of frames stored in the storage portion.