Video Decoding Method for High Frame Rate Reconstruction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Videos of high-speed moving objects often exhibit discontinuous motion due to insufficient frame rates, which becomes apparent when playback speed is reduced for slow motion viewing.

Innovation Solution

A video decoding method that calculates optical flow fields between adjacent frames, inserts new frames based on these flow fields, and assigns pixel values from previous frames to create a high-frame-rate video, ensuring continuous motion.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Stability of the object's composition

If video frame rate is increased to capture high-speed moving objects, then motion continuity is improved, but device complexity and processing requirements increase

Engineering Contradiction:
Improvemotion continuityVSAvoidprocessing requirements
Core Design Contradiction:
Stability of the object's compositionVSDevice complexity

Solution Approach 1:

The patent pre-calculates optical flow fields between adjacent frames before frame insertion. By computing the optical flow in advance and storing it, the system reduces real-time processing complexity during playback while maintaining motion continuity through high-frame-rate reconstruction.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent generates intermediate frames by copying and interpolating pixel information from existing frames using optical flow guidance. Instead of capturing actual high-speed frames, the system creates synthetic copies that maintain motion coherence, reducing the need for high-speed hardware capture.

Inventive Principle:
Principle #26Copying

2Manufacturing precision

If optical flow calculation is performed between adjacent frames, then frame interpolation accuracy is improved, but computation time increases

Engineering Contradiction:
Improveframe interpolation accuracyVSAvoidcomputation time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent divides the optical flow calculation into segments between adjacent frames rather than calculating across all frames. This segmentation reduces the computational scope at each step, maintaining interpolation accuracy while decreasing overall computation time through manageable incremental calculations.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs optical flow calculation only where needed - specifically between adjacent frames that will be interpolated - rather than calculating optical flow for all possible frame combinations. This partial action approach maintains necessary accuracy while avoiding excessive computation in areas that don't require interpolation.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS11509859B2Video decoding method and camera
Publication Date: 2022.11.22 ARASHI VISION INC
  • US11509859B2 patent drawing

AI summary

The present invention provides a video decoding method and a camera. Said method comprises: loading a video, and decoding each frame from the video; calculating, for any two adjacent frames, a first optical flow field; calculating, according to the first optical flow field, a second optical flow field of a position where a frame is to be inserted, the position being located between two adjacent frames; using the second optical flow field to calculate a corresponding pixel position, in a previous frame of two adjacent frames, of each pixel of the frame to be inserted, and assigning the pixel value of the previous frame to the pixel of the frame to be inserted; and placing the inserted frame and the decoded original frame together according to a time sequence, so as to reconstitute a video having a high frame rate. The present invention eliminates or improves discrete motion, providing a more fluent viewing experience.