AR 3D Model Reconstruction Guiding Scanning Paths

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current three-dimensional modeling systems face limitations due to the need for specialized hardware, restricted applications, and high training requirements, particularly in the use of active scanners and reliance on predetermined patterns or markers for image-based reconstruction.

Innovation Solution

A model reconstruction system using augmented reality to guide users in generating three-dimensional models on mobile devices, dynamically adjusting scanning paths and providing real-time feedback to ensure accurate data collection without the need for specialized equipment or markers.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If active non-contact scanners (laser scanners) are used to generate three-dimensional models, then manufacturing precision and measurement precision are improved, but device complexity and cost increase due to specialized hardware requirements

Engineering Contradiction:

Improvethree-dimensional model accuracyVSAvoidhardware requirements

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts the essential function of active scanning (obtaining depth and geometry data) and implements it through passive camera-based structure from motion techniques, eliminating the need for specialized laser scanning hardware while maintaining three-dimensional reconstruction capability

Inventive Principle:

Principle #2Taking out (Extraction)

Solution Approach 2:

The patent uses multiple standard camera images to capture and reconstruct three-dimensional information, creating a virtual copy of the scanning process that achieves similar results to active scanning without requiring active scanning hardware

Inventive Principle:

Principle #26Copying

2Measurement precision

If predetermined patterns or markers are used in image-based reconstruction, then measurement precision is improved, but ease of operation deteriorates due to setup constraints and training requirements

Engineering Contradiction:

Improvereconstruction accuracyVSAvoiduser training requirements

Core Design Contradiction:

Measurement precisionVSEase of operation

Solution Approach 1:

The system performs self-calibration by automatically determining camera parameters and scene geometry from the captured images themselves, without requiring external calibration objects, markers, or patterns. The reconstruction algorithm inherently extracts scale and metric information from the image data

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The patent transitions from methods requiring fixed calibration parameters (marker dimensions, pattern geometries) to methods where parameters are dynamically determined from the image data itself, allowing flexible operation without predetermined reference objects

Inventive Principle:

Principle #35Parameter changes

3Measurement precision

If predetermined backgrounds or reference objects with known dimensions are used, then measurement precision is improved, but adaptability deteriorates due to limited application scope

Engineering Contradiction:

Improvedimensional reconstruction accuracyVSAvoidapplication scope

Core Design Contradiction:

Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent creates a universal three-dimensional reconstruction system that works across diverse applications and environments using standard camera equipment, eliminating the need for application-specific calibration objects or controlled backgrounds, thereby achieving both precision and versatility

Inventive Principle:

Principle #6Universality (Multi-functionality)

4Manufacturing precision

If specialized hardware and predetermined patterns are required for scanning, then manufacturing precision is improved, but ease of manufacture deteriorates due to restricted distribution and higher costs

Engineering Contradiction:

Improvethree-dimensional model qualityVSAvoidsystem distribution cost

Core Design Contradiction:

Manufacturing precisionVSEase of manufacture

Solution Approach 1:

The patent replaces expensive, specialized scanning hardware with inexpensive, widely available standard camera equipment, making three-dimensional scanning accessible to general users without requiring investment in specialized equipment

Inventive Principle:

Principle #27Cheap short-living objects (Disposable)

Solution Approach 2:

The patent substitutes mechanical/optical scanning systems (laser scanners, structured light projectors) with a computational photography approach using standard cameras, replacing complex hardware mechanisms with software-based reconstruction algorithms

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS12165356B2Augmented reality for three-dimensional model reconstruction

Publication Date: 2024.12.10 ECLO INC

AI summary

Systems, devices, media, and methods are presented for object modeling using augmented reality. An object modeling mode for generating three-dimensional models of objects is initiated by one or more processors of a device. The processors of the device detect an object within a field of view. Based on a position of the object, the processors select a set of movements forming a path for the device relative to the object and cause presentation of at least one of the movements. The processors detect a set of object surfaces as portions of the object are positioned in the field of view. In response to detecting at least a portion of the object surface, the processors modify a graphical depiction of a portion of the object. The processors then construct a three-dimensional model of the object from the set of images, depth measurements, and IMU readings collected during the reconstruction process.