Panoramic Video Playback Initiation Using Staggered Keyframe Encoding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for streaming panoramic videos and images over a network often result in significant user wait time before playback begins, as they do not efficiently manage video file loading and playback initiation.
Innovation Solution
The method involves storing videos as keyframe distance length files for opposing directions on each cube face and encoding videos with staggered starting points, allowing playback to start as soon as the desired frame is downloaded, while using a server-client architecture and intuitive user controls to navigate and play panoramic content.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of time
If videos are stored as complete files for each cube face, then video quality and completeness are maintained, but user wait time increases significantly before playback can begin
Solution Approach 1:
The patent segments video content into keyframe-based units organized by cube face and direction. Instead of treating each cube face video as a single complete file, the system divides videos into discrete keyframe intervals that can be independently loaded and played back, allowing progressive rendering as data becomes available
Solution Approach 2:
The system performs preliminary organization of video data during encoding, creating staggered keyframe sequences with predetermined starting points for each cube face. This pre-processing allows the playback system to immediately begin rendering from available keyframes without waiting for complete video file downloads
2Speed
If videos are encoded with staggered starting points and stored as keyframe distance files, then playback start time is reduced, but server storage requirements increase
Solution Approach 1:
The patent applies different storage strategies to different cube faces and directions based on local playback requirements. Each cube face has its own keyframe distance file optimized for its specific viewing direction, allowing efficient playback initiation without uniformly increasing storage across all possible video configurations
Solution Approach 2:
The system changes the organizational parameters of video storage from complete file formats to keyframe distance length files with staggered encoding parameters. By varying the keyframe intervals and starting points as controlled parameters, the system optimizes playback start performance while managing storage through parameterized video encoding
3Reliability
If the system loads all cube faces and video segments, then complete video playback is ensured, but bandwidth consumption and latency increase
Solution Approach 1:
The system extracts and loads only the necessary keyframe segments required for current playback needs rather than loading complete video files. By extracting specific keyframe intervals based on playback position and direction, the system reduces bandwidth consumption while maintaining playback continuity through selective data transmission
Solution Approach 2:
The patent implements partial loading of video data by loading keyframe segments that are sufficient for current playback requirements without loading excessive data. The system loads just enough keyframes to maintain continuous playback, balancing reliability with reduced bandwidth usage through partial data transmission
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A method for providing panoramic videos and images to a user using a server-client architecture while minimizing the wait time necessary before still images are available for viewing or videos begin playing. A series of locationreferenced panoramic images are separated into one-dimensional tracks. Intuitive user controls are provided which allow the user to start and stop video playback, step through the panoramas in a track one at a time, and change the viewing orientation within the panorama. A video will start playing as soon as the video files for the preferred projected cube faces have been downloaded. This delay is reduced by storing the videos as keyframe distance files for opposing directions for each cube face and further reduced by encoding videos with different starting points so that they are staggered by a portion of the keyframe distance.