Adaptive Panoramic Video Streaming Composite Pictures
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing panoramic video playback systems face disruptions when a viewer suddenly changes the view direction or zoom factor, or when encoded data for a section of the video is lost or corrupted, leading to resource wastage and playback issues.
Innovation Solution
A computer system implementing a panoramic video stream configuration tool and playback tool that uses an input buffer, formatter, video encoders, and output buffers to create low-resolution versions of input pictures and split them into composite pictures with overlapping sections, allowing for efficient encoding and decoding of panoramic video.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of energy
If the playback tool retrieves and reconstructs only the visible sections of panoramic video, then memory usage and processing cycles are reduced, but playback may freeze or stall when the view direction or zoom factor changes
Solution Approach 1:
The system performs preliminary action by retrieving and buffering encoded data for multiple sections of panoramic video in advance, before they are actually needed for rendering. This allows the playback tool to have pre-prepared image content ready when the viewer changes view direction or zoom factor, preventing playback freezes while still avoiding the need to buffer entire panoramic video.
2Quantity of substance
If the playback tool retrieves and reconstructs only the visible sections of panoramic video, then memory usage is reduced, but the tool may not have image content needed when the view direction or zoom factor changes
Solution Approach 1:
The system proactively retrieves encoded data for multiple sections ahead of time based on predicted or potential view directions, storing them in buffers before they are needed. This preliminary preparation ensures memory efficiency during normal operation while providing ready-to-use image content when view changes occur.
Solution Approach 2:
The system merges multiple encoded data streams for different sections of panoramic video into a unified playback system. By combining these pre-retrieved sections with the current view requirements, the system can seamlessly switch between sections when the viewer changes direction or zoom level.
3Loss of energy
If encoded data for sections of panoramic video is not pre-retrieved, then network bandwidth usage is reduced, but playback disruption occurs when data is lost or corrupted
Solution Approach 1:
The system performs preliminary retrieval of encoded data for multiple potential sections before playback needs them, storing redundant copies in buffers. This advance preparation ensures that if network issues occur during playback, alternative sections are already available locally, preventing disruption while minimizing continuous network bandwidth consumption.
Data Source
AI summary
Innovations in stream configuration operations and playback operations for adaptive streaming of panoramic video are described. The innovations include features of adaptive streaming of panoramic video with composite pictures. For example, a stream configuration tool splits an input picture of panoramic video into multiple sections and creates multiple composite pictures. A composite picture includes one of the sections as well as a low-resolution version of the input picture. A playback tool reconstructs one or more composite pictures. Under normal operation, the playback tool can use the reconstructed section(s) of the composite picture(s) to render high-quality views of the panoramic video. If the view window dramatically changes, however, or if encoded data for a section is lost or corrupted, the playback tool can use the low-resolution version of the input picture to render lower-quality details for views of the panoramic video, without disruption of playback.