3D Model Editing via Sketch-Driven Parameter Optimization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for editing 3D models in AR/VR environments are limited, as they cannot effectively edit inner edges of 3D models or handle the complexity of mesh editing, leading to non-plausible results and high computational costs.
Innovation Solution
A computer-implemented method that allows for the editing of 3D models in an AR/VR environment by modifying parameters of extruded sections, performing discretization to create a 3D point cloud, and optimizing an energy function that penalizes inconsistencies between the modified and initial models, as well as mismatches between the point cloud and user sketches.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If direct mesh editing is performed in AR/VR environments, then 3D model modification is enabled, but computational complexity increases and results become non-plausible
Solution Approach 1:
The patent introduces an intermediary representation layer between the user sketch and the final 3D model. Instead of directly editing the complex mesh, the system uses a simplified intermediate representation (e.g., modified 2D sketch or coarse 3D structure) that can be easily manipulated and then transformed into the final model, reducing computational complexity while maintaining editing capability
Solution Approach 2:
The patent segments the 3D model editing process into distinct stages: sketching phase, interpretation phase, and refinement phase. By dividing the complex editing task into manageable segments, the system reduces the computational burden at each stage and produces more plausible results overall
2Adaptability or versatility
If complete 3D model editing is allowed, then all aspects of the model can be modified, but the number of degrees of freedom becomes too large
Solution Approach 1:
The patent applies partial action by allowing users to modify only specific parts of the 3D model through localized sketching or selection, rather than requiring complete model editing. This selective modification approach reduces the effective number of degrees of freedom while maintaining the versatility to edit any part when needed
Solution Approach 2:
The patent implements local quality by enabling different levels of detail and modification freedom in different regions of the model. Users can apply high-detail editing to specific areas of interest while keeping other areas at coarser resolution, effectively managing the overall complexity through localized manipulation
3Reliability
If optimization algorithms with plausibility constraints are used, then non-plausible mesh results are avoided, but processing time increases
Solution Approach 1:
The patent applies preliminary action by establishing plausibility constraints and guiding principles before the optimization process begins. By pre-defining reasonable modification ranges and structural constraints, the system narrows the search space and reduces the time needed to achieve plausible results during optimization
Solution Approach 2:
The patent implements feedback mechanisms that continuously monitor the optimization process and adjust parameters in real-time. By providing feedback about plausibility and convergence, the system can stop optimization early when satisfactory results are achieved, reducing overall processing time while maintaining reliability
Data Source
Figure 1a~1d
Figure 2~3
Figure 4
AI summary
The invention relates to a computer-implemented method for designing a 3D model in an AR/VR environment, which comprises the steps of: e) Providing a 3D model in a 3D scene, the 3D model comprising at least one extruded section which results from the extrusion of a planar section, said extruded section being defined by a set of parameters; f) Receiving a 3D user sketch in the 3D scene; g) At each iteration of a plurality of iterations: - c1) Modifying at least one of said parameters, thereby obtaining a modified 3D model; - c2) Performing a discretization of the modified 3D model, thereby obtaining a 3D point cloud; - c3) Computing an energy which comprises a first term which penalizes an inconsistency between the modified 3D model (4) and the initial 3D model (1), and a second term which penalizes a mismatch between the 3D point cloud and the 3D user sketch (3); said parameters being modified so as to minimize said energy; h) outputting the modified 3D model (4).