Virtual View Synthesis Encoding Using Depth Thresholds
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current image encoding and decoding methods for virtual view synthesis in immersive media, such as 6DoF videos, face inefficiencies in encoding and reproducing motion parallax across various viewer movements, particularly in handling empty and non-empty regions, which affects the quality and efficiency of virtual view synthesis.
Innovation Solution
The proposed method generates basic and supplementary view images using input images, encoding texture and depth information, and employing a threshold to differentiate between empty and non-empty regions, allowing for efficient synthesis and decoding by prioritizing regions and reducing redundant data transmission.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If multiple view images are encoded for virtual view synthesis, then synthesis quality is improved, but encoding efficiency deteriorates due to redundant data transmission
Solution Approach 1:
The patent extracts and transmits only the essential information (non-empty regions with depth values) rather than all view images. By identifying and transmitting only the necessary regions that contain actual content, the system reduces redundant data transmission while maintaining synthesis quality.
Solution Approach 2:
The patent applies different encoding strategies to different regions of the view images. Non-empty regions containing actual content are encoded with full detail, while empty regions are marked with placeholder values. This local differentiation optimizes encoding efficiency by avoiding redundant transmission of empty space information.
2Reliability
If all view images are transmitted for virtual view synthesis, then synthesis completeness is improved, but data transmission volume increases
Solution Approach 1:
The patent extracts only the necessary depth information and non-empty region markers from the view images for transmission. By removing empty region data and transmitting only essential information, the system maintains synthesis completeness while significantly reducing data transmission volume.
Solution Approach 2:
The patent segments the view images into non-empty regions and empty regions, treating them differently in the transmission process. Non-empty regions are transmitted with full detail while empty regions are represented by compact placeholder values, reducing overall data volume while maintaining completeness.
3Reliability
If empty regions are included in view images, then region completeness is improved, but encoding complexity increases
Solution Approach 1:
The patent applies different encoding representations to different regions: non-empty regions use full image data while empty regions use simple placeholder values. This local differentiation simplifies the encoding process by providing clear, distinct representations for different region types, reducing overall encoding complexity.
Solution Approach 2:
Instead of transmitting detailed information for all regions and using complex algorithms to identify empty spaces, the patent inverts the approach by directly marking empty regions with placeholder values and transmitting only non-empty region data. This inversion simplifies the encoding process while maintaining region completeness.
Data Source
AI summary
Disclosed herein is an image encoding/decoding method and apparatus for virtual view synthesis. The image decoding for virtual view synthesis may include decoding texture information and depth information of at least one or more basic view images and at least one or more additional view images from a bit stream and synthesizing a virtual view on the basis of the texture information and the depth information, wherein the basic view image and the additional view image comprise a non-empty region and an empty region, and wherein the synthesizing of the virtual view comprises determining the non-empty region through a specific value in the depth information and a threshold and synthesizing the virtual view by using the determined non-empty region.