Zoomable Stereo 360 VR Streaming With Unified MPD Switching
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies face inefficiencies when applying multiple functions such as stereo 3D, 360 VR, and zoom in/out to streaming video, as they require multiple pieces of MPD information, leading to user experience issues.
Innovation Solution
A method and system that utilize scalable high efficiency video coding (SHVC) and high efficiency video coding (HEVC) to encode left and right eye videos with different resolutions and tile structures, allowing for real-time adjustment based on user input and communication environment, using a single MPD information format.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple pieces of MPD information are used to apply multiple functions (stereo 3D, 360 VR, scalability, zoom in/out) to streaming video, then functional versatility is improved, but system complexity and processing overhead increase
Solution Approach 1:
The patent combines multiple function-specific MPD information elements (stereo 3D, 360 VR, scalability, zoom in/out) into a single unified MPD information structure. This allows the streaming system to support multiple functions simultaneously while reducing the complexity of managing separate MPD files, as the server can provide all necessary configuration data through one consolidated MPD information set that the client device can process efficiently.
Solution Approach 2:
The unified MPD information structure is designed to be universal, supporting multiple video functions (stereo 3D, 360 VR, scalability, zoom in/out) within a single framework. This multi-functional MPD structure allows the same streaming infrastructure to serve diverse video types and requirements without requiring separate specialized MPD files for each function, thereby reducing system complexity while maintaining versatility.
2Adaptability or versatility
If multiple pieces of MPD information are used to support multiple functions, then functional adaptability is improved, but processing time and user convenience deteriorate
Solution Approach 1:
The server prepares and provides all necessary MPD information elements (stereo 3D, 360 VR, scalability, zoom in/out) in advance through a single unified MPD structure. This preliminary organization of all possible function configurations allows the client device to quickly select and apply the appropriate functions based on current conditions without requiring multiple separate processing steps or additional lookup operations, thereby reducing processing time while maintaining functional adaptability.
3Manufacturing precision
If video bit streams are encoded with different resolutions for left and right eye videos, then stereo 3D quality is improved, but data transmission requirements increase
Solution Approach 1:
The patent implements dynamic resolution allocation for left and right eye video bit streams based on the unified MPD information structure. The system can adaptively adjust the resolution of each eye's video stream according to the client device's capabilities, network conditions, and user preferences, allowing high stereo 3D quality when conditions permit while reducing data transmission requirements when bandwidth is limited, thus dynamically balancing quality and transmission efficiency.
Data Source
AI summary
A method, apparatus, and system for providing a zoomable stereo 360 virtual reality (VR) video are provided. The method includes receiving media presentation description (MPD) information including information on video bit streams obtained by encoding each piece of video data by different conditions, decoding a video bit stream corresponding to a communication environment of a client device based on the MPD information and outputting a streaming video, receiving a user's resizing input for the streaming video, and decoding a video bit stream corresponding to the resizing input and outputting an adjusted streaming video.