Video Transmission Apparatus for VR Inter-View Redundancy Removal
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current VR systems face challenges in providing efficient data transmission, robustness between networks, and flexible network support, especially for mobile devices, which affects the quality of VR content delivery and user interaction.
Innovation Solution
A video transmission method that removes inter-view redundancy, generates and encodes sparse view pictures, and synthesizes views based on source and reference pictures, allowing for adaptive data transmission and efficient playback, while also decoding and unpacking packed pictures to regenerate accurate views.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If all source view pictures for multiple viewing positions are transmitted, then the VR content quality is maintained, but the data transmission load increases significantly
Solution Approach 1:
The patent extracts and transmits only the essential sparse view pictures (including center view picture and selected source view pictures) while removing redundant inter-view information. The decoder can reconstruct other views using view synthesis techniques, thus extracting only the necessary data components for high-quality VR transmission.
Solution Approach 2:
Instead of transmitting all source view pictures, the patent transmits a compressed representation (sparse views) that allows the receiver to copy/reconstruct the full set of views through view synthesis algorithms, reducing transmission load while maintaining quality.
2Productivity
If inter-view redundancy removal is performed, then data transmission efficiency is improved, but the encoding complexity increases
Solution Approach 1:
The patent segments the view synthesis process into distinct stages: generating center view picture, selecting sparse source view pictures, and encoding. This segmentation allows for systematic handling of complexity while achieving efficient compression through structured processing.
Solution Approach 2:
The patent performs preliminary view synthesis operations (generating center view and intermediate views) before encoding, which simplifies the subsequent encoding process by pre-organizing the data in an optimal structure for compression and transmission.
3Adaptability or versatility
If sparse view pictures are selected based on transmission environment, then adaptability to different networks is improved, but the selection process complexity increases
Solution Approach 1:
The patent implements dynamic selection of sparse view pictures based on transmission environment conditions. The system adapts the selection of which source view pictures to include in the sparse set according to available bandwidth and network conditions, providing flexible adaptation to different transmission scenarios.
Solution Approach 2:
The patent changes the parameters of the transmitted sparse view set based on transmission environment. By adjusting which views are included and the resolution quality according to network conditions, the system optimizes transmission efficiency while maintaining acceptable VR quality across different network scenarios.
4Quantity of substance
If view synthesis is performed at the receiver, then data transmission is reduced, but the computational load at the receiver increases
Solution Approach 1:
The patent merges the view synthesis computation between transmitter and receiver. The transmitter performs preliminary synthesis (center view generation) while the receiver completes the synthesis using transmitted reference information, distributing the computational load to balance transmission efficiency and receiver processing requirements.
Data Source
AI summary
A video transmitting method according to embodiments may comprise the steps of: removing inter-view redundancy of pictures with respect to a plurality of viewing positions; packing the pictures in which the inter-view redundancy is removed; and encoding the packed pictures and signaling information. A video receiving method according to embodiments may comprise the steps of: decoding a bitstream of a video, on the basis of a viewing position and viewport information; unpacking pictures and signaling information in the decoded bitstream; view regenerating the unpacked pictures; and view synthesizing the view-regenerated pictures.