Video Orientation Signaling for Adaptive Mobile Streaming
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current mobile broadband technologies face challenges in delivering high-quality multimedia services that adapt to device orientation, leading to misalignment issues in video content rendering across various devices with different capabilities and orientations.
Innovation Solution
The implementation of coordination of video orientation (CVO) capabilities through signaling and embedding CVO information in media files, allowing servers to adapt content delivery based on device orientation, using protocols like DASH and RTP, and embedding CVO data in 3GP files for orientation-aware multimedia adaptation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If separate video streams are transmitted for each orientation (portrait and landscape), then video quality and user experience are improved, but network bandwidth consumption and system complexity increase
Solution Approach 1:
The patent merges portrait and landscape video streams into a single omnidirectional video stream by mapping video content to a spherical coordinate system. This consolidation eliminates the need for separate stream transmissions while maintaining the ability to deliver orientation-specific content, thereby reducing network bandwidth consumption and system complexity while preserving video quality.
Solution Approach 2:
The omnidirectional video stream serves multiple functions simultaneously: it can be viewed in portrait orientation, landscape orientation, or any intermediate angle. This multi-functionality allows a single stream to replace multiple orientation-specific streams, resolving the contradiction between maintaining video quality and reducing system complexity.
2Productivity
If a single omnidirectional video stream is used, then network bandwidth is reduced and device compatibility is improved, but the ability to provide optimized video for specific orientations is lost
Solution Approach 1:
The patent segments the omnidirectional video stream into orientation-specific portions during playback based on the client device's detected orientation. The server or client software divides the spherical video content and delivers only the relevant segment (portrait, landscape, or intermediate) to the device, thereby maintaining network efficiency while restoring orientation optimization capability.
Solution Approach 2:
The video delivery system dynamically adapts to the client device's orientation by detecting the device's rotational state and adjusting the delivered video content accordingly. This dynamic adjustment allows the system to provide optimized video for specific orientations while using a single omnidirectional stream, resolving the contradiction between network efficiency and orientation adaptability.
3Device complexity
If video is streamed without considering device orientation, then system simplicity is maintained, but user experience deteriorates due to incorrect video orientation
Solution Approach 1:
The patent performs preliminary action by pre-mapping video content to a spherical coordinate system during encoding, which embeds orientation information within the video data structure. This preliminary preparation allows the system to automatically deliver correctly oriented video without requiring complex real-time processing, thereby maintaining system simplicity while improving user experience.
Solution Approach 2:
The system implements feedback by detecting the client device's orientation state and using this information to automatically adjust the delivered video content. The orientation detection feedback loop ensures that the correct video portion is delivered without user intervention, maintaining system simplicity while ensuring proper video orientation and thus improving user experience.
Data Source
Figure 1
Figure 2~3
Figure 4
AI summary
Technology to provide streaming with coordination of video orientation (CVO) is disclosed. In an example, a server can include computer circuitry configured to: receive a device capability for a client; and modify streamed content to the client based on an inclusion of a CVO attribute in the device capability.