Supplemental Content Insertion at Natural Video Break Points
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for inserting supplemental content items into audio-visual content items cause unnatural interruptions due to improper timing, leading to increased computing and network resource consumption, energy usage, and user rewinding, especially when inserting within segments or at mid-sentence/mid-word, and require re-encoding with IDR pictures, increasing bitrate.
Innovation Solution
A client device or server analyzes content segments to identify natural insertion points within segments, avoiding interruptions by decoding and buffering frames to seamlessly integrate supplemental content, maintaining initial segment sizes and reducing re-encoding needs.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If supplemental content items are inserted at segment boundaries, then insertion is simple, but interruptions occur at unnatural points (mid-sentence, mid-word, during music)
Solution Approach 1:
The content item is divided into segments with metadata indicating natural break points (sentence boundaries, music ends). The supplemental content insertion system segments the content at these natural boundaries rather than uniformly at segment boundaries, allowing insertion points to be identified within segments based on linguistic and audio analysis metadata.
2Reliability
If supplemental content items are inserted within segments, then natural insertion points are found, but segment sizes are shortened requiring re-encoding with additional IDR pictures
Solution Approach 1:
The system performs preliminary analysis during the encoding phase to identify and mark natural break points (sentence endings, music transitions) within segments. This metadata is stored alongside the encoded content, allowing the playback device to locate insertion points without requiring re-encoding. The break point information is prepared in advance during content creation.
3Reliability
If supplemental content items are inserted within segments, then natural insertion points are found, but bitrate increases due to additional IDR pictures
Solution Approach 1:
The system performs preliminary analysis during the encoding phase to identify and mark natural break points (sentence endings, music transitions) within segments. This metadata is stored alongside the encoded content, allowing the playback device to locate insertion points without requiring re-encoding. The break point information is prepared in advance during content creation.
Data Source
AI summary
The present disclosure relates to methods and systems, implemented by a device such as a client device, for seamlessly inserting a supplemental content item into a content item to negate the user's need for rewinding to a point prior to the interruption of the content item by the supplemental content item. The client device accesses the supplemental content insertion logic to identify a default supplemental content insertion point between two consecutive segments of the content item. The client device analyzes the two consecutive segments of the content item to identify a natural supplemental content insertion point within one of the two consecutive segments. The client device then decodes a first set of frames of the content item up to the natural supplemental content insertion point, a second set of frames of the supplemental content item and a third set of frames of the content item from the natural supplemental content insertion point. The client device places these three sets of frames in a buffer and plays the frames from the buffer.