Adaptive Frame Extraction for Variable-Speed Video Timeline Display

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing display control systems fail to perform time-line display of moving images recorded at different speeds accurately, leading to inconsistent frame extraction intervals and an uncomfortable user experience when comparing scenes with varying recording speeds.

Innovation Solution

A display control apparatus and method that dynamically adjusts frame extraction intervals based on the recording speed of each section of a moving image, allowing for precise time-line display at user-designated intervals, even when sections are recorded at different frame rates.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If frame extraction is performed at a fixed frame interval determined with reference to normal recording speed, then the time-line display is simple to implement, but the display time intervals become inconsistent when the moving image includes sections recorded at different recording speeds

Engineering Contradiction:
Improveframe extraction mechanismVSAvoiddisplay time interval consistency
Core Design Contradiction:
Device complexityVSManufacturing precision

Solution Approach 1:

The frame extraction mechanism dynamically adjusts the frame interval based on the recording speed of each section. The control unit changes the frame extraction timing according to the recording speed information, making the extraction process adaptive rather than fixed, thereby maintaining consistent display time intervals across sections with different recording speeds.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the frame extraction parameter (frame interval) based on the recording speed parameter. When the recording speed differs from the reproduction speed, the frame extraction timing is adjusted proportionally, ensuring that the display time intervals remain consistent with the user-designated intervals regardless of the original recording speed variations.

Inventive Principle:
Principle #35Parameter changes

2Productivity

If frames are extracted at uniform intervals from sections recorded at different speeds, then the extraction process is simple, but the displayed frames do not align with user-designated time intervals

Engineering Contradiction:
Improveframe extraction efficiencyVSAvoidtime interval accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The frame extraction process dynamically adapts its timing based on the recording speed of each section. The control unit modifies the extraction intervals in real-time according to the recorded speed information, ensuring that frames are extracted at the correct time intervals to match user expectations while maintaining efficient processing.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system uses recording speed information as feedback to adjust the frame extraction timing. By continuously referencing the recording speed data and adjusting the extraction intervals accordingly, the system ensures accurate time interval representation in the time-line display without sacrificing extraction efficiency.

Inventive Principle:
Principle #23Feedback

3Ease of operation

If time-line display is performed using a single frame extraction interval for the entire moving image, then the display process is uniform and simple, but it becomes difficult to compare moving images recorded at different speeds side by side

Engineering Contradiction:
Improvedisplay process uniformityVSAvoidimage comparison accuracy
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The moving image is segmented into sections based on recording speed, and each section is processed with appropriate frame extraction intervals. This segmentation allows the system to handle different recording speeds appropriately while maintaining overall display coherence, enabling accurate side-by-side comparison of moving images recorded at different speeds.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different frame extraction intervals are applied to different sections of the moving image based on their specific recording speeds. This local adaptation ensures that each section is displayed with the correct time interval representation, improving the reliability of image comparison while maintaining ease of operation through automated section-based processing.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS10438630B2Display control apparatus that performs time-line display, method of controlling the same, and storage medium
Publication Date: 2019.10.08 CANON KK
  • US10438630B2 patent drawing
  • US10438630B2 patent drawing
  • US10438630B2 patent drawing

AI summary

A display control apparatus capable of performing time-line display of a moving image including a section recorded at a different recording speed from the real-time recording speed, at time intervals designated by a user. Frames are extracted from a moving image at time intervals set by a user to display the extracted frames in a line. When a moving image includes a first section recorded at a recording frame rate which is the same as a reproduction frame rate, and a second section recorded at a frame rate different from the reproduction frame rate, frames are extracted from the first section at a first frame interval, and from the second section at a second frame interval different from the first frame interval. The frames extracted from the first section and the second section, respectively, are displayed in a line.