3D Structured Light Scanner for Real-Time Dynamic Surface Imaging

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current 3D surface imaging technologies face limitations in rendering quality, speed, and cost, particularly in applications like skin cancer detection and stereotactic body radiation therapy, where real-time dynamic 3D surface capture is essential but hindered by the use of 2D cameras that fail to accurately capture depth and texture information.

Innovation Solution

A 3D scanner system using structured light that projects fringe patterns onto a 3D object, capturing both gray-scale and color images to process phase maps and texture images, enabling high-speed, high-resolution 3D surface reconstruction with geometric processing tools for accurate alignment and registration.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If 2D cameras are used to capture skin surface images, then the system cost is reduced, but the depth information and rendering quality are insufficient

Engineering Contradiction:
Improvedepth information captureVSAvoidimaging system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent transitions from 2D camera imaging to 3D structured light imaging by projecting fringe patterns onto the skin surface and capturing the deformed patterns with a camera. This dimensional change enables depth information acquisition through phase calculation, resolving the contradiction between measurement precision and device complexity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent introduces a projector as an intermediary device that projects structured light patterns onto the skin surface. This intermediary enables the camera to capture depth information indirectly through the deformation of projected patterns, achieving 3D measurement without requiring complex direct 3D sensing hardware.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If high-resolution 3D imaging is achieved using structured light, then the rendering quality is improved, but the processing time increases

Engineering Contradiction:
Improvesurface imaging accuracyVSAvoidimage processing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent performs preliminary calibration by establishing a mapping relationship between camera coordinates and 3D space coordinates before actual imaging. This pre-established mapping enables real-time 3D reconstruction without iterative computation during imaging, reducing processing time while maintaining high accuracy.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent replaces complex iterative mathematical optimization methods with a pre-established coordinate mapping system. This substitution transforms the time-consuming iterative solving process into a direct coordinate transformation, significantly reducing processing time while preserving measurement precision.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Reliability

If sequential full-body scanning is performed for skin cancer detection, then the detection accuracy is improved, but the examination time increases

Engineering Contradiction:
Improveskin cancer detection accuracyVSAvoidexamination throughput
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent enables dynamic real-time 3D imaging that can capture skin surface changes during movement. This dynamic capability allows for more efficient scanning protocols where patients can be imaged in natural positions without requiring prolonged static positioning, thereby maintaining detection accuracy while reducing examination time.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent creates a controlled imaging environment with structured lighting that eliminates the need for complex positioning fixtures and adjustment tools. This inert imaging environment allows rapid sequential scanning without requiring time-consuming setup and adjustment between scans, improving examination throughput while maintaining reliability.

Inventive Principle:
Principle #39Inert atmosphere (Inert environment)

4Object-affected harmful factors

If optical surface imaging is used for patient positioning monitoring, then the radiation exposure is reduced, but the ability to detect small movements is insufficient

Engineering Contradiction:
Improveradiation exposureVSAvoidmovement detection accuracy
Core Design Contradiction:
Object-affected harmful factorsVSMeasurement precision

Solution Approach 1:

The patent uses 3D structured light imaging to capture surface geometry in three dimensions, enabling detection of subtle movements and deformations that 2D optical imaging cannot detect. The phase-based depth measurement provides millimeter-level precision for monitoring patient positioning without radiation exposure.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The system provides real-time, accurate 3D surface imaging capable of capturing dynamic expressions and changes, enhancing early detection of skin cancer and improving patient positioning during radiation therapy, while reducing radiation exposure and increasing efficiency in medical and security applications.

Implementation Method 1

a projector configured to project structured light onto a three-dimensional object

Methodology Applied
Scientific EffectStructured light projection: Light

Implementation Method 2

a gray-scale camera configured to capture fringe image of the object

Methodology Applied
Scientific EffectLight reflection: Reflection

Implementation Method 3

a color camera configured to capture color image of the object

Methodology Applied
Scientific EffectLight reflection: Reflection

Implementation Method 4

a processor configured to process the fringe image to extract a phase map and a texture image, to calculate depth information from the phase map

Methodology Applied
Scientific EffectPhase analysis:

Data Source

PatentUS20230168081A1System and method for 3D image scanning
Publication Date: 2023.06.01 THE RES FOUNDATION FOR THE STATE UNVIERSITY OF NEW YORK
  • US20230168081A1 patent drawing
  • US20230168081A1 patent drawing
  • US20230168081A1 patent drawing

AI summary

Systems and methods for 3D image scanner for real-time, dynamic 3D surface imaging are disclosed. Embodiments of the present system and methods describe a system and method including a first and/or second, camera, and projector projecting structured light with fringe patterns onto a 3D object, and a processor configured to extract a phase map and a texture image from the image, and to calculate depth information from the phase map by the processor. Embodiments further describe methods and systems for determining an wrapped phase from the images using the Hilbert transformation, generating an absolute phase from the wrapped phase using the combination of a quality-guidance path following algorithm, a double wavelength phase unwrap algorithm, or a Markov Random field method, and generating a phase map from the absolute phase to determine depth information of the 3D object. The captured 3D geometric surfaces are registered, tracked using algorithms of conformal map, optimal transportation map and a Teichmuller map.