Volumetric Video Texture Geometry Frame Synchronization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies face challenges in ensuring a match between geometry and texture when playing volumetric videos in web browsers, leading to potential mismatches and degraded image quality.
Innovation Solution
A system and method are introduced to synchronize the texture and geometry frames by encoding geometric information in the same format as color data, generating initial faces, determining relevant geometric information, and assigning it to corresponding geometry faces, ensuring that both geometry and texture are from the same frame.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If texture decoder and mesh decoder work independently using video time to decide which frame to decode, then decoding efficiency is improved, but frame number mismatch between texture and geometry occurs
Solution Approach 1:
The patent implements a feedback mechanism where the system continuously monitors the frame numbers of decoded texture and geometry frames, and adjusts the decoding process to ensure they match. The renderer requests geometry frames based on the current texture frame number, creating a closed-loop control system that prevents frame number mismatch while maintaining independent decoding operations.
Solution Approach 2:
The patent introduces an intermediary component (the geometry decoding control mechanism) that coordinates between the independent texture and geometry decoders. This intermediary ensures that geometry frames are requested and decoded at the correct timing to match the texture frames, resolving the synchronization issue without compromising decoder independence.
2Manufacturing precision
If frame synchronization mechanisms are implemented to match texture and geometry frames, then image quality is improved, but system complexity increases
Solution Approach 1:
The system employs a self-service approach where the renderer autonomously determines the current texture frame number and uses this information to request the corresponding geometry frame. This self-regulating mechanism achieves frame synchronization without requiring complex external control systems or additional synchronization hardware.
Solution Approach 2:
The patent merges the frame synchronization logic into the existing rendering pipeline, combining the texture decoding and geometry rendering processes through shared frame number information. This integration achieves synchronization without adding separate complex control systems, as the renderer naturally coordinates both streams using the same timing reference.
Data Source
AI summary
The present invention generally pertains to systems, methods, and non-transitory processor-readable mediums for ensuring a match between geometry and texture when playing volumetric videos in a web browser.