Surface Modeling via Boundary Polygon Extraction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional VR/AR/MR systems face challenges in providing a comfortable, rich, binocular 3D experience due to the vergence-accommodation conflict and require high processing power for accurate surface modeling, leading to eye fatigue, increased power consumption, and heat generation.

Innovation Solution

The method involves generating a surface model of a physical environment by extracting boundary polygons, computing a truncated signed distance function, and using algorithms like Graham-Scan and rotating calipers to create minimal area oriented boundary polygons, which are then used to generate a planar polygon mesh, reducing processing requirements and improving interaction accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If conventional surface modeling algorithms are used to achieve accurate surface representation, then manufacturing precision is improved, but device complexity and processing power requirements increase

Engineering Contradiction:
Improvesurface modeling accuracyVSAvoidprocessing complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent segments the surface modeling process into distinct phases: image capture, feature detection, boundary extraction, and mesh generation. Each phase processes only necessary data at appropriate levels of detail, avoiding unnecessary computational complexity while maintaining modeling accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent extracts only the essential boundary polygons from captured images using contour detection algorithms, rather than processing entire images or all visual data. This extraction approach reduces data volume and processing requirements while preserving the geometric information needed for accurate surface modeling.

Inventive Principle:
Principle #2Taking out (Extraction)

2Manufacturing precision

If high processing power is used for accurate surface modeling, then manufacturing precision is improved, but use of energy increases

Engineering Contradiction:
Improvesurface modeling accuracyVSAvoidpower consumption
Core Design Contradiction:
Manufacturing precisionVSUse of energy by moving object

Solution Approach 1:

The patent applies partial action by processing only the necessary portions of visual data required for surface modeling. Boundary extraction algorithms identify and process only relevant contour information rather than analyzing entire image datasets, reducing computational energy consumption while maintaining sufficient modeling accuracy for AR/MR applications.

Inventive Principle:
Principle #16Partial or excessive action

3Manufacturing precision

If complex processing algorithms are used for surface modeling, then manufacturing precision is improved, but productivity decreases

Engineering Contradiction:
Improvesurface modeling accuracyVSAvoidprocessing efficiency
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The patent performs preliminary action by pre-processing images to identify and extract boundary contours before full surface modeling begins. This preliminary boundary extraction prepares the data structure in advance, allowing subsequent mesh generation and rendering operations to proceed more efficiently without sacrificing modeling precision.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11378798B2Surface modeling systems and methods
Publication Date: 2022.07.05 MAGIC LEAP INC
  • US11378798B2 patent drawing
  • US11378798B2 patent drawing
  • US11378798B2 patent drawing

AI summary

A method of generating a simulation of a physical object in an image of a physical environment. The method also includes generating a planar polygon mesh from at least the image. The method further includes extracting a boundary polygon of the planar polygon mesh. Moreover, the method includes generating a convex hull for the boundary polygon of the surface mesh. In addition, the method includes generating a minimal area oriented boundary polygon from the convex hull. The method may also include generating a maximal area oriented internal polygon (MAOBP) inside of the boundary polygon of the planar polygon mesh. The MAOBP is utilized to generate a 3-D surface model of the physical object, and the 3-D surface model is used to generate a simulation involving an interaction with the 3-D surface model of the physical object.