Panoramic Video Streaming Adaptation for Mobile Devices
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current methods for delivering panoramic video content to mobile devices are inefficient, as they often transmit high-resolution content that exceeds device capabilities, leading to bandwidth and computational resource wastage, and fail to accurately adjust content based on user viewpoints and head movements.
Innovation Solution
The system adjusts panoramic video content to equirectangular format, downscales, and crops it according to the mobile device's capabilities and user head movements, ensuring optimal pixel density and resolution for seamless viewing, while optimizing bandwidth usage.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If high-resolution panoramic video content is transmitted to mobile devices, then visual quality is improved, but bandwidth consumption increases and device computational resources are wasted
Solution Approach 1:
The patent applies local quality by adjusting the resolution and format of video content based on the specific capabilities of each mobile device. Different devices receive differently optimized content - full HD for capable devices, lower resolution for limited devices - ensuring each user gets appropriate visual quality without unnecessary bandwidth consumption for devices that cannot display high resolution
Solution Approach 2:
The system changes parameters such as resolution, format (equirectangular projection), and bitrate based on device capabilities and network conditions. The edge server dynamically adjusts these parameters to match the mobile device's display resolution and processing power, optimizing the balance between visual quality and bandwidth usage
2Manufacturing precision
If high-resolution panoramic video content is transmitted to mobile devices, then visual quality is improved, but device computational resources are wasted
Solution Approach 1:
The edge server performs preliminary actions by pre-processing the panoramic video content into equirectangular format and appropriate resolutions before transmission. This eliminates the need for mobile devices to perform computationally intensive format conversions and rescaling operations, reducing device energy consumption while maintaining visual quality
Solution Approach 2:
The patent substitutes the mechanical/computational processing system at the mobile device with a similar processing system at the edge server. The edge server handles the computationally intensive tasks of format conversion and resolution adjustment, replacing the need for equivalent processing power at the mobile device
3Device complexity
If panoramic video content is delivered without adjusting for user viewpoint and head movements, then system complexity is reduced, but viewing accuracy and user experience deteriorate
Solution Approach 1:
The system implements feedback by tracking user head movements and viewpoint changes, then using this information to dynamically adjust and retransmit the appropriate portion of the panoramic video content. This closed-loop approach maintains high viewing accuracy while managing system complexity through efficient use of tracking data
4Loss of information
If the entire panoramic video content is transmitted, then content completeness is improved, but bandwidth consumption increases
Solution Approach 1:
The patent segments the panoramic video content into different resolution layers and format variations. The edge server transmits only the necessary segments based on device capabilities - transmitting full HD content only to devices that can display it, and lower-resolution content to devices with limited display capabilities, maintaining content completeness for each device type while reducing overall bandwidth consumption
Solution Approach 2:
The system applies partial action by transmitting a subset of the total possible content variations to each device. Instead of sending all resolution formats to all devices, it sends only the appropriate subset - ensuring each device receives sufficient content completeness for its capabilities while avoiding unnecessary bandwidth consumption from excessive content transmission
Data Source
AI summary
Aspects of the subject disclosure may include, for example, obtaining image content over a communication network, determining a predicted viewpoint of a user associated with the image content, and adjusting the image content to equirectangular image content according to the predicted viewpoint. Further aspects can include downscaling the equirectangular image content according to a display capability of a mobile device resulting in a downscaled equirectangular image content, cropping the downscaled equirectangular image content resulting in a cropped equirectangular image content, and providing, over the communication network, the cropped equirectangular image content to the mobile device. Other embodiments are disclosed.