Imaging Element Frame Rate Control for Power Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current imaging technologies consume high power when outputting every image data obtained by imaging, especially when there are no significant changes in the subject, leading to inefficient use of resources.

Innovation Solution

The proposed solution involves an imaging element that stores image data at a first frame rate and processes it to determine the degree of difference with earlier data, only outputting image data when the difference exceeds a threshold, and optionally performing thinning processing or detecting main subject images to reduce processing load and power consumption. Additionally, the imaging element can decrease frame rates during periods of minimal subject motion and omit outputting closed-eye or poorly focused images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If every image data obtained by imaging is output, then the output frequency is high, but power consumption increases

Engineering Contradiction:
Improveoutput frequencyVSAvoidpower consumption
Core Design Contradiction:
SpeedVSUse of energy by moving object

Solution Approach 1:

The system performs preliminary difference calculation between consecutive frames before output decision. By calculating the degree of difference in advance and comparing it with a threshold, the system determines whether output is necessary, thereby avoiding unnecessary output operations and reducing power consumption while maintaining high output frequency when needed

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The output frame rate is dynamically adjusted based on the degree of difference between consecutive frames. When the degree of difference exceeds the threshold, the system outputs at the first (higher) frame rate; when it does not exceed the threshold, the system outputs at the second (lower) frame rate. This dynamic adjustment optimizes the balance between output frequency and power consumption

Inventive Principle:
Principle #15Dynamics

2Measurement precision

If difference calculation is performed on entire image data, then the degree of difference is accurately determined, but processing load increases

Engineering Contradiction:
Improvedegree of difference accuracyVSAvoidprocessing load
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The image data is segmented into multiple regions of interest (ROIs) based on subject detection. The difference calculation is performed only within these segmented regions rather than on the entire image. This segmentation approach maintains measurement precision for the subject area while significantly reducing processing load by excluding background regions

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different processing quality is applied to different regions of the image. High-precision difference calculation is applied to regions containing the subject (where accuracy is critical), while lower processing or no processing is applied to background regions. This local quality approach optimizes the balance between accuracy and processing load

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11438504B2Imaging element, imaging apparatus, operation method of imaging element, and program
Publication Date: 2022.09.06 FUJIFILM CORP
  • US11438504B2 patent drawing
  • US11438504B2 patent drawing
  • US11438504B2 patent drawing

AI summary

An imaging element incorporates a memory and a processor. The memory stores image data obtained by imaging a subject at a first frame rate. The processor is configured to derive a degree of difference between first image data obtained as the image data by performing imaging and second image data that is obtained as the image data earlier than the first image data and stored in the storage portion, and perform processing of deciding at least one of the first image data or the second image data as the output image data in a case where the derived degree of difference is greater than or equal to a threshold value. The processor is configured to output the decided output image data at a second frame rate.