Dynamic Mesh Local Coordinates for Higher Coding Efficiency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The coding efficiency in video-based dynamic mesh coding (V-DMC) is affected by the choice of local coordinate systems, which are not optimally determined by conventional methods based on normal vectors derived for rendering, leading to potential decreases in quality and information amount of displacement vectors.
Innovation Solution
An information processing device and method that decodes and encodes data using local coordinate systems set based on vertex normal vectors, employing methods such as non-interpolated averaging, method selection, or combination of interpolated and non-interpolated methods to derive vertex normal vectors, thereby setting optimal local coordinate systems for displacement vectors.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If local coordinate systems are set based on normal vectors derived by the interpolated method for rendering, then rendering quality is improved, but coding efficiency deteriorates
Solution Approach 1:
The patent separates the normal vector derivation process into two distinct paths: one for rendering (interpolated method) and one for coding (non-interpolated method). This segmentation allows each path to optimize for its specific purpose without compromising the other, resolving the contradiction between rendering quality and coding efficiency.
Solution Approach 2:
The patent extracts the normal vector derivation step from the rendering pipeline and creates a separate coding-oriented derivation process. By taking out the normal vector calculation from the rendering-specific interpolated method, the system can use optimal coordinate systems for coding without affecting rendering quality.
2Manufacturing precision
If the interpolated method is used to derive normal vectors for rendering, then shadow processing quality is improved, but the amount of information of displacement video increases
Solution Approach 1:
The patent segments the normal vector usage into two separate functions: rendering-related operations (shadow processing) use interpolated normal vectors, while coding operations use non-interpolated normal vectors. This segmentation prevents the increase in displacement video information for coding purposes while maintaining shadow processing quality.
Solution Approach 2:
The patent applies different quality levels of normal vectors to different purposes: high-quality interpolated normal vectors for rendering and shadow processing, and computationally efficient non-interpolated normal vectors for coding. This local quality approach optimizes each function without unnecessary overhead.
3Productivity
If local coordinate systems are optimized for coding efficiency, then coding efficiency is improved, but rendering quality may deteriorate
Solution Approach 1:
The patent creates separate normal vector derivation paths for rendering and coding, allowing each to use the method optimal for its purpose. The rendering path uses interpolated methods for quality, while the coding path uses non-interpolated methods for efficiency, eliminating the need to compromise either side.
4Manufacturing precision
If normal vectors are derived using weighted averaging in the interpolated method, then independent processing result for each vertex is obtained, but the complexity of the system increases
Solution Approach 1:
The patent segments the normal vector derivation into two distinct algorithms: the interpolated method with weighted averaging for rendering, and a simpler non-interpolated method for coding. This segmentation reduces system complexity by providing a straightforward alternative for coding operations.
Data Source
AI summary
There is provided an information processing device and method for making it possible to suppress a decrease in coding efficiency. Coded data regarding a base mesh is decoded, coded data regarding a displacement video including, as frames, 2D images storing local coordinates as displacement vectors is decoded, vertex normal vectors, which are normal vectors of vertices of a subdivided base mesh, are derived, and local coordinates of the vertices of the subdivided base mesh are applied to the vertices as displacement vectors using local coordinate systems corresponding to the vertex normal vectors. The present disclosure can be applied to, for example, an information processing device, an electronic device, an information processing method, a program, or the like.