3D Scanning System Using Crude Model to Guide Image Capture

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

High-quality 3D models required for photorealistic images are typically generated using expensive and complex 3D scanners, which are prohibitively costly and not feasible for all products, while less expensive scanners produce inaccurate models with holes and artifacts.

Innovation Solution

A scanning system using a portable computing device and range imaging sensor to generate a crude 3D model, which is refined using photogrammetry techniques, allowing for the identification of optimal imaging positions and reducing the number of images needed, thus eliminating the need for expensive arrays of cameras and turntables.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If expensive and complex 3D scanners are used, then manufacturing precision of 3D models is improved, but device complexity and cost increase

Engineering Contradiction:
Improve3D model accuracyVSAvoidscanner complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The scanning process is divided into two distinct phases: first generating a crude 3D model to identify object characteristics, then using that information to guide targeted image capture for refinement. This segmentation allows each phase to be optimized independently, avoiding the need for a single complex scanning system.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

A crude 3D model is generated in advance to identify object characteristics and determine optimal imaging positions before the final high-quality scanning phase. This preliminary action enables the system to plan the scanning strategy based on actual object geometry rather than using a fixed complex scanning approach.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If expensive arrays of cameras and turntables are used, then measurement precision is improved, but device complexity and cost increase

Engineering Contradiction:
Improveimage capture accuracyVSAvoidcamera array complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The crude 3D model serves itself by providing the information needed to determine optimal imaging positions. The system uses the initially generated model to identify what additional views are needed, eliminating the requirement for complex pre-configured camera arrays and turntables.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system changes the parameter of imaging positions dynamically based on the object's characteristics identified in the crude model. Rather than using fixed camera array configurations, the imaging positions are adapted to the specific object being scanned, achieving high measurement precision with simpler hardware.

Inventive Principle:
Principle #35Parameter changes

3Device complexity

If less expensive scanners are used, then device complexity is reduced, but manufacturing precision of 3D models deteriorates

Engineering Contradiction:
Improvescanner simplicityVSAvoid3D model quality
Core Design Contradiction:
Device complexityVSManufacturing precision

Solution Approach 1:

The system replaces complex mechanical scanning systems with a computational approach using photogrammetry and image processing. Instead of relying on sophisticated mechanical scanners, the invention uses software algorithms to process images from simpler cameras and reconstruct high-quality 3D models through computational methods.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

A set of strategically selected images captured at optimized positions serves as an intermediary between the crude model and the final high-quality 3D model. These intermediate images provide the additional detail needed to refine the model without requiring a single complex scanning operation.

Inventive Principle:
Principle #24Intermediary (Mediator)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables the creation of high-quality 3D models suitable for photorealistic images using inexpensive hardware, reducing costs and improving accuracy by leveraging existing sensors in portable devices and guiding users through a user interface to capture images at tailored positions.

Implementation Method 1

A scanning system using a portable computing device and range imaging sensor to generate a crude 3D model

Methodology Applied
Scientific EffectRange imaging: LIDAR

Implementation Method 2

which is refined using photogrammetry techniques

Methodology Applied
Scientific EffectPhotogrammetry: Photogrammetry

Data Source

PatentUS11557060B2Systems and methods for scanning three-dimensional objects
Publication Date: 2023.01.17 WAYFAIR LLC
  • US11557060B2 patent drawing
  • US11557060B2 patent drawing
  • US11557060B2 patent drawing

AI summary

According to at least one aspect, a system for scanning an object is provided. The system comprises at least one hardware processor; and at least one non-transitory computer-readable storage medium storing processor executable instructions that, when executed by the at least one hardware processor, cause the at least one hardware processor to perform: generating a first 3-dimensional (3D) model of the object; identifying a set of imaging positions from which to capture at least one image based on the first 3D model of the object; obtaining a set of images of the object captured at, or approximately at, the set of imaging positions; and generating a second 3D model of the object based on the set of images.