Multi-View Video Encoding Pruning for VR
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional multi-view image compression technologies are inadequate for efficiently handling the increased number of view images and higher resolution requirements in immersive 360-degree virtual reality applications, leading to data processing challenges and inefficiencies.
Innovation Solution
A method for determining an optimal pruning order for encoding and decoding multiple reference view images in 360-degree virtual reality, which involves identifying and removing overlapping areas between basic and reference view images based on various criteria such as overlapping pixels, image indices, and camera parameters, to reduce data and improve encoding efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If conventional multi-view image compression technology is used, then compression is achieved for relatively small unidirectional viewing space, but the number of view images increases and resolution increases for omnidirectional viewing space, leading to increased pixel rate and data amount
Solution Approach 1:
The patent segments the view images into basic view images and reference view images, processing them differently through pruning operations. Basic view images are retained in full resolution while reference view images are pruned to remove overlapping areas, reducing the total data amount while maintaining omnidirectional coverage capability
Solution Approach 2:
The patent extracts and removes overlapping areas from reference view images through pruning operations. By identifying and eliminating redundant pixel data that overlaps with basic view images, the system reduces the data amount while preserving the essential omnidirectional viewing information
2Measurement precision
If the number of view images and resolution are increased for omnidirectional viewing space, then immersion quality is improved, but the pixel rate and compression processing complexity increase
Solution Approach 1:
The patent performs preliminary pruning operations on reference view images before compression encoding. By pre-processing the images to remove overlapping areas and reduce redundancy, the system simplifies the subsequent compression processing while maintaining high resolution for immersive quality
Solution Approach 2:
The patent applies different processing qualities to different types of view images. Basic view images are maintained at full resolution with no pruning, while reference view images undergo pruning to remove only the overlapping portions. This localized quality adjustment reduces overall complexity while preserving necessary detail
3Quantity of substance
If reference view images are pruned based on overlapping areas with basic view images, then data amount is reduced, but determining the optimal pruning order requires additional processing
Solution Approach 1:
The patent changes the processing parameters of reference view images by applying pruning operations that remove overlapping areas. By modifying the image data structure to eliminate redundancy, the system reduces data amount while the pruning order determination uses efficient algorithms to minimize additional processing time
Data Source
AI summary
A video encoding method of encoding a multi-view image including one or more basic view images and a plurality of reference view images includes determining a pruning order of the plurality of reference view images, acquiring a plurality of residual reference view images, by pruning the plurality of reference view images based on the one or more basic view images according to the pruning order, encoding the one or more basic view images and the plurality of residual reference view images, and outputting a bitstream including encoding information of the one or more basic view images and the plurality of residual reference view images.