Frame Accurate Video Splicing via Timestamp Alteration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video splicing technologies face challenges in seamlessly integrating compressed video segments without decompressing and recompressing individual files, leading to inefficiencies and potential loss of content, especially when dealing with B-frames that rely on information from subsequent frames.

Innovation Solution

The method involves altering the timestamp information of frames in compressed video files to indicate that they have already been presented, allowing for accurate rendering without displaying them, and enabling the seamless splicing of compressed video segments without converting B-frames to I-frames or P-frames, thus maintaining necessary content for rendering and avoiding unnecessary frame presentations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Stability of the object's composition

If B-frames are converted to I-frames or P-frames to enable splicing, then frame independence is improved, but video quality and compression efficiency deteriorate

Engineering Contradiction:
Improveframe independenceVSAvoidvideo quality
Core Design Contradiction:
Stability of the object's compositionVSManufacturing precision

Solution Approach 1:

The patent applies preliminary action by pre-processing B-frames before the splice point to make them display-independent. Specifically, it converts B-frames to either I-frames or P-frames that do not reference future frames, ensuring they can be displayed correctly even when frames after the splice point are omitted. This preliminary conversion resolves the contradiction by maintaining video quality while enabling seamless splicing without requiring actual frame conversion at the splice point.

Inventive Principle:
Principle #10Preliminary action

2Productivity

If frames after splice point are omitted to enable splicing, then splicing efficiency is improved, but rendering accuracy of preceding frames deteriorates

Engineering Contradiction:
Improvesplicing efficiencyVSAvoidrendering accuracy
Core Design Contradiction:
ProductivityVSLoss of information

Solution Approach 1:

The patent uses copying by creating a copy or reference of the necessary frame data from after the splice point and embedding it in the preceding frames. When a B-frame before the splice point references a frame after the splice point, the system copies the required data from that future frame and incorporates it into the B-frame or its reference structure, allowing the B-frame to be rendered accurately without actually displaying or transmitting the frames after the splice point.

Inventive Principle:
Principle #26Copying

3Reliability

If decompression and recompression are performed for splicing, then content integrity is improved, but processing complexity and time increase

Engineering Contradiction:
Improvecontent integrityVSAvoidprocessing complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies parameter changes by modifying the temporal reference parameters of B-frames rather than changing the compression format itself. It adjusts the reference frame pointers and timing information in the compressed bitstream to ensure that B-frames before the splice point reference only frames that will be displayed, while maintaining the original compression encoding. This allows splicing to occur directly on the compressed files without decompression and recompression, preserving content integrity while minimizing processing complexity.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS10992969B2Frame accurate splicing
Publication Date: 2021.04.27 GOOGLE LLC
  • US10992969B2 patent drawing
  • US10992969B2 patent drawing
  • US10992969B2 patent drawing

AI summary

A video delivery system alters information (such as time stamp information) associated with one or more frames of a first compressed video file to allow for accurate rendering of frames within the first compressed video file prior to a transition to a second compressed video file. For example, a time stamp of a particular frame of a compressed video file is altered prior to transmission of the particular frame by a video transmission system such that the altered time stamp indicates a time that has already passed. The particular frame can be decoded by a display system that receives the particular frame so that information included in the particular frame can be used in rendering of subsequently received frames. The display system can bypass display of the particular frame due to the altered time stamp.