Panoramic Video Streaming Delta Frame Updates
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current streaming technologies for panoramic video content struggle to efficiently update video frames when a user changes their viewpoint, leading to delays and increased network capacity requirements due to the need to retransmit entire frames rather than just the changes.
Innovation Solution
The system processes original frames into first viewpoint frames and generates delta frames that represent changes in the video content when a user changes their viewpoint, allowing the client device to efficiently update the video by processing these delta frames and generating second viewpoint frames, reducing the need for retransmitting entire frames.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the server retransmits entire frames when viewpoint changes, then the user can view the new viewpoint, but the network capacity requirements increase and latency increases
Solution Approach 1:
The patent extracts only the changed portions (delta frames) from the complete video frames and transmits these differences to the client device. This allows the client to reconstruct the new viewpoint frames by applying the deltas to the previously received frames, significantly reducing network data transmission volume while maintaining viewpoint update completeness
Solution Approach 2:
The patent segments the video content into discrete frames and further segments the updates into delta frames that contain only the changes. This segmentation allows efficient incremental updates rather than transmitting complete frames, resolving the contradiction between reliable viewpoint updates and reduced network capacity requirements
2Reliability
If the server retransmits entire frames when viewpoint changes, then the user can view the new viewpoint, but the latency increases
Solution Approach 1:
By extracting and transmitting only the essential changes (delta frames) rather than complete frames, the patent reduces the time required for transmission and processing, thereby reducing viewpoint update latency while maintaining complete and accurate viewpoint updates
Solution Approach 2:
The patent performs preliminary processing to identify and prepare delta frames in advance, allowing for faster transmission when viewpoint changes occur. This preliminary preparation of difference data reduces the latency associated with real-time viewpoint updates
3Measurement precision
If the client device processes complete frames for viewpoint changes, then the viewpoint accuracy is maintained, but the device processing load increases
Solution Approach 1:
The patent extracts only the changed portions (delta frames) for transmission to the client device. The client device then processes only these small delta frames rather than complete frames, significantly reducing processing energy consumption while maintaining viewpoint accuracy through precise difference application
Solution Approach 2:
The patent changes the parameter of data representation from complete frames to compressed difference frames (delta frames). This parameter change reduces both the size of data to be processed and the computational complexity, thereby reducing client device processing energy while preserving viewpoint accuracy
Data Source
AI summary
Aspects of the subject disclosure may include, for example, embodiments comprising obtaining a plurality of original frames for video content, receiving a first viewpoint from a mobile device, and processing the plurality of original frames according to the first viewpoint generating a plurality of first viewpoint frames. Further embodiments include providing the plurality of first viewpoint frames to the mobile device, generating a group of delta frames in response to receiving a change in viewpoint from the mobile device, and providing the group of delta frames to the mobile device. The mobile device processes a portion of the plurality of first viewpoint frames according to the group of delta frames to generate a group of second viewpoint frames and the mobile device presents the group of second viewpoint frames. Other embodiments are disclosed.