Imaging Device Predictive Motion Frame Selection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Imaging devices struggle to capture the motion of a subject at a moment desired by the user during high-speed continuous imaging due to memory limitations, leading to incomplete image data storage when the user initiates high-speed imaging too early.

Innovation Solution

An imaging device equipped with an imaging unit, memory, and a decision unit that predicts the moving direction of the subject using Deep Neural Networks, selectively stores image data matching the predicted direction, erasing unnecessary data to optimize memory usage and ensure capture of the desired moment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If high-speed continuous imaging is performed to capture moving subjects, then the frame speed is increased, but the memory capacity is quickly depleted and the desired moment cannot be captured

Engineering Contradiction:
Improveframe speedVSAvoidmemory capacity
Core Design Contradiction:
SpeedVSQuantity of substance

Solution Approach 1:

The patent extracts only the necessary image data for storage by using motion detection and direction prediction to identify and retain only those frames that contain the subject moving in the predicted direction, while discarding unnecessary frames. This selective extraction approach reduces memory consumption while ensuring the desired moment is captured.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent performs preliminary motion detection and direction prediction on continuously captured image data before storing it in memory. By predicting the subject's moving direction in advance and pre-identifying relevant frames, the system prepares the optimal set of images for storage, ensuring memory capacity is used efficiently from the outset.

Inventive Principle:
Principle #10Preliminary action

2Loss of information

If all captured image data is stored in memory during high-speed imaging, then complete image data is preserved, but memory capacity is insufficient and data overflow occurs

Engineering Contradiction:
Improveimage data completenessVSAvoidmemory capacity
Core Design Contradiction:
Loss of informationVSQuantity of substance

Solution Approach 1:

The system extracts only the essential image data by detecting motion and comparing it against predicted movement patterns. Only frames showing the subject moving in the predicted direction are extracted for storage, while other frames are discarded, preventing memory overflow while preserving the critical moment.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent changes the selection criterion for stored image data from 'all captured frames' to 'frames matching predicted motion parameters'. By using motion detection and direction prediction as filtering parameters, the system dynamically determines which frames to store based on actual subject movement, optimizing memory usage.

Inventive Principle:
Principle #35Parameter changes

3Reliability

If high-speed continuous imaging is initiated early to ensure capture of the desired moment, then the probability of capturing the moment increases, but unnecessary image data accumulates in memory

Engineering Contradiction:
Improvecapture reliabilityVSAvoidimage data volume
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The system extracts only relevant image data by continuously monitoring motion detection results against predicted direction. Even when imaging starts early, only frames containing the subject moving in the predicted direction are retained, eliminating unnecessary data accumulation while maintaining high capture reliability.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent implements feedback through continuous motion detection and direction prediction comparison. The system constantly monitors whether detected motion matches predicted motion and adjusts frame selection accordingly, ensuring that only relevant frames are stored even when imaging begins early, thus preventing unnecessary data accumulation.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11823493B2Imaging device, electronic device, and imaging method
Publication Date: 2023.11.21 SONY SEMICON SOLUTIONS CORP
  • US11823493B2 patent drawing
  • US11823493B2 patent drawing
  • US11823493B2 patent drawing

AI summary

To provide an imaging device and an electronic device capable of capturing a motion of a subject at a moment desired by a user in the motions of the subject. A CIS (2), which is an example of an imaging device according to the present disclosure, includes an imaging unit (5), a memory (6), a detection unit (83), and a decision unit (84). The imaging unit (5) continuously captures images of the subject to generate image data. The memory (6) stores image data. The detection units (83) detects motions of the subject based on the image data. The decision unit (84) decides the image data in which the motion of the subject in a direction matching the moving direction of the subject predicted based on the image data has been detected by the detection unit, as image data to be saved in the memory.