3D Video Encoding with Group Classifier for Multi-Display Rendering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing three-dimensional video data formats are often tailored for specific display devices, limiting their versatility and requiring additional processing to accommodate different disparity ranges, which can degrade quality and complicate rendering on various display systems.
Innovation Solution
A method that encodes at least two views of a scene with depth information and additional information linking view and depth information using a group classifier, enabling more versatile three-dimensional video data representation and improved rendering across multiple displays by indicating relationships between stereo or multi-view images and depth information.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If three-dimensional video data is encoded in formats tailored for specific display devices, then rendering quality for that specific device is improved, but versatility across different display devices deteriorates
Solution Approach 1:
The patent applies universality by creating a single video data structure that can be used across multiple display device types. The format includes view information and depth information that can be adapted to different disparity ranges, allowing the same encoded data to serve stereoscopic displays, autostereoscopic displays, and other variants without requiring device-specific encoding
Solution Approach 2:
The patent applies dynamics by making the rendering process adaptive rather than static. The encoded video data includes information that allows the rendering device to dynamically adjust disparity ranges and select appropriate views based on the specific display device being used, enabling quality optimization for each device type from a single source
2Adaptability or versatility
If additional processing is applied to accommodate different disparity ranges, then adaptability to different display devices is improved, but image quality deteriorates
Solution Approach 1:
The patent applies preliminary action by pre-encoding multiple views and depth information in a versatile format during the encoding stage. This preparation allows receiving devices to directly utilize the pre-prepared data for their specific disparity ranges without requiring additional quality-degrading processing operations
3Adaptability or versatility
If multiple full views are encoded, then rendering flexibility is improved, but bandwidth requirements increase
Solution Approach 1:
The patent applies the extraction principle by separating view information from depth information in the encoded data structure. This allows receiving devices to extract only the specific views and depth information needed for their particular display type and disparity range, rather than transmitting and processing complete sets of multiple full views
Solution Approach 2:
The patent applies partial action by encoding and transmitting partial view information combined with depth information, which is sufficient for rendering multiple views at the receiving end. This approach provides the necessary rendering flexibility while keeping the transmitted data quantity lower than encoding complete multiple full views
Data Source
Figure 1
Figure 2~5
Figure 3~4
AI summary
The present invention relates to a method and device (580) for encoding three- dimensional video data, the device comprising: a first encoder (505) arranged to encode multiple simultaneous views (501) of a scene from different viewpoints; a second encoder (510) arranged to encode depth information of the scene and a third encoder (515) arranged to encode additional information indicative of a relationship between the multiple views and the depth information and a combiner (520) arranged to combine the encoded information into a representation (513) of the three-dimensional video data. The additional information comprises a group classifier indicating whether or not the depth information and at least one of the multiple views correspond to the same source material for, when corresponding, using the depth information and the at least one of the multiple views to render further views of the scene from further different viewpoints. The invention further related to a method and device (585) for decoding three- dimensional video data, as well as a computer program product comprising program instructions for executing a method according to the present invention.