Dynamic 3D Model Fusion Using Intrinsic Texture Weights
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing VR and AR systems face challenges in generating accurate dynamic 3D models, particularly when depth values are unreliable or unavailable, and in applying texture details, which can result in inaccurate or incomplete models with noticeable seams and blurring, especially in real-time applications.
Innovation Solution
The implementation of a computer system that incorporates intrinsic texture values when fusing depth maps, applies smoothed viewpoint-dependent texture weights to reduce blurring and seams, and allows for the application of special effects to enhance the rendering of dynamic 3D models.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If depth maps are fused to generate dynamic 3D models using conventional methods, then the process can be completed in real-time, but the models may be inaccurate or incomplete when depth values are unreliable or unavailable
Solution Approach 1:
The patent introduces an intermediary process that combines depth map fusion with texture map analysis. When depth values are unreliable, the system uses texture maps as a mediator to supplement and verify the 3D model construction, ensuring accuracy without sacrificing real-time performance
Solution Approach 2:
The system dynamically changes processing parameters based on depth map quality assessment. When depth values are found to be unreliable, the algorithm adjusts weighting parameters to rely more heavily on texture map information, maintaining model accuracy while preserving real-time processing capability
2Productivity
If texture details are stitched from different viewpoints onto a dynamic 3D model using previous approaches, then the texturing process can be performed efficiently, but the result may produce blurred details or noticeable seams
Solution Approach 1:
The patent applies local quality by treating different regions of the 3D model differently during texturing. Regions identified as important (such as faces) receive enhanced processing with reduced blending to avoid blurring, while less critical areas use standard efficient stitching methods
Solution Approach 2:
The system dynamically adjusts texture blending parameters based on the specific viewpoint and region being textured. By making the texturing process adaptive rather than static, it maintains high quality for critical regions while preserving overall processing efficiency
3Productivity
If conventional rendering methods are used for dynamic 3D models, then the rendering process can be completed quickly, but artistic effects cannot be applied to the rendered views
Solution Approach 1:
The patent applies preliminary action by pre-computing and storing artistic effect parameters during the rendering process. This allows the base rendering to proceed quickly while artistic effects are applied as pre-prepared overlays or post-processing steps, maintaining speed while adding versatility
Data Source
AI summary
Various approaches described herein improve the quality of results when fusing depth maps to generate dynamic three-dimensional (“3D”) models, applying texture details to dynamic 3D models, or rendering views of textured, dynamic 3D models. For example, when fusing depth maps to generate a dynamic 3D model, a fusion component can also incorporate intrinsic color values for points of the dynamic 3D model, potentially making the dynamic 3D model more accurate, especially for areas in which depth values are not reliable or not available. As another example, when applying texture details, a rendering component can apply smoothed, viewpoint-dependent texture weights to texture values from different texture maps, which can reduce blurring and avoid the introduction of noticeable seams. As another example, a rendering component can apply special effects indicated by metadata to rendered views, thereby allowing a content provider to assert artistic control over presentation.