Adaptive Lightfield Streaming via Scene Depth Adjustment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current technologies for capturing and streaming content for lightfield or holographic displays are costly due to the need for expensive camera setups and require significant bandwidth for transmission, leading to buffering and interruptions when bandwidth is limited.
Innovation Solution
A method for adaptive streaming of lightfield or holographic immersive media that determines scene characteristics and adjusts the scene based on available network bandwidth and processing capacity, allowing for depth-based or priority-based adaptive streaming to optimize content delivery.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If expensive camera setups (multiple depth cameras or camera arrays) are used to capture lightfield/holographic content, then the quality and completeness of captured light ray information improves, but the device cost increases significantly
Solution Approach 1:
The patent uses a traditional 2D camera to capture images, then creates multiple virtual camera views through computational rendering. Instead of using expensive physical camera arrays, the system captures light field information by rendering what multiple virtual cameras would see from the single captured image, achieving lightfield display effects with simple hardware
Solution Approach 2:
The patent replaces the mechanical/optical system of multiple physical cameras with a computational system. A single camera captures 2D images, and computer algorithms process these images to generate lightfield data and render multiple virtual views, substituting complex mechanical camera arrays with software-based computational photography
2Reliability
If full scene data is transmitted to ensure complete immersive media quality, then the playback quality improves, but the bandwidth requirement increases causing buffering under limited network conditions
Solution Approach 1:
The patent divides the scene into multiple depth layers or priority regions. Instead of transmitting complete high-resolution data for the entire scene, the system segments the content and transmits only the necessary portions based on what the user is likely to view, reducing overall data transmission while maintaining quality for relevant areas
Solution Approach 2:
The patent transmits partial scene data rather than complete data. By sending only the portions of the scene that are most likely to be viewed (based on user position, gaze direction, or scene importance), the system achieves adequate playback quality with reduced bandwidth consumption, avoiding the need to transmit excessive complete scene data
Data Source
AI summary
Method, device, and non-transitory storage medium for adaptive streaming of immersive media are provided. The method may include determining characteristics associated with a scene to be transmitted to the end client, adjusting at least a part of the scene to be transmitted to the end client based on the determined characteristics, and transmitting an adaptive stream of the lightfield or holographic immersive media comprising the adjusted scene based on the determined characteristics.