Light Field Streaming Switching for Immersive Content Delivery
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional methodologies for streaming immersive content require significant computational resources and can degrade in situations with limited bandwidth or computing power, affecting the quality of the immersive content experience.
Innovation Solution
The method involves a device detecting upcoming segments of media available in a light field format, notifying the user, and upon user request, switching to stream the segment in light field format using a real-time transport protocol (RTP) stream, while continuously monitoring the user's position to maintain the 3D effect.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If traditional streaming methodologies are used to stream immersive content, then the content can be delivered to users, but significant computational resources are required and quality degrades with limited bandwidth or computing power
Solution Approach 1:
The media content is divided into segments, with metadata indicating which segments are available in light field format. This allows selective processing and delivery of immersive content portions rather than requiring full computational processing of entire content streams.
Solution Approach 2:
Metadata is prepared in advance that indicates which media segments are available in light field format. This preliminary information allows the system to plan and prepare immersive content delivery without requiring real-time computational decisions, reducing processing demands during streaming.
2Adaptability or versatility
If immersive content is personalized to the user based on position, then the 3D effect is improved, but the computational complexity increases
Solution Approach 1:
The system automatically detects user position using sensors and selectively activates light field processing only for segments where immersive content is available and the user is appropriately positioned. This self-service approach personalizes the experience without requiring continuous complex computational analysis of all content.
Solution Approach 2:
The system dynamically switches between 2D and light field formats based on real-time user position detection and segment availability. This dynamic adaptation allows personalization while maintaining computational efficiency by processing only necessary portions of content in the immersive format.
3Reliability
If light field format is used for upcoming segments, then the immersive experience is enhanced, but bandwidth requirements increase
Solution Approach 1:
The system delivers light field content only for specific segments where it is available and where it will provide value to the user experience. Other segments are delivered in standard 2D format, optimizing bandwidth usage by applying high-quality immersive delivery only where necessary rather than uniformly across all content.
Data Source
AI summary
Systems and methods are provided herein for streaming immersive content to a device. This may be accomplished by a system displaying a piece of media on a display in a first format and determining that the piece of media is approaching a segment of the piece of media that is available in a second format (e.g., light field content). In response to determining that the upcoming segment is available in the second format, the system can use one or more sensors to determine a position of a user in relation to the display. The system can then send a request for the piece of media in the second format, wherein the request comprises the position of the user. The system can then receive and display the segment of the piece of media in the second format, wherein the segment is customized according to the position of the user.