3D Spatial Scanning Sensor Fusion and Confidence Adjustment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current 3D spatial scanning technologies using time-of-flight (ToF) and stereo RGB sensors face accuracy limitations in large indoor or outdoor spaces due to distance, resolution, light reflection, and low illumination, leading to reduced scanning quality.

Innovation Solution

A 3D spatial scanning system and method that fuses sensing values from ToF and stereo RGB sensors, estimates confidence, and adjusts sensor functions such as sensing distance, resolution, and illumination to improve scanning accuracy, incorporating a confidence estimator and function adjuster to optimize sensor performance based on environmental conditions and object detection within a region of interest.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If ToF sensor and stereo RGB sensor are used for 3D spatial scanning, then scanning capability is enhanced, but scanning accuracy deteriorates in large indoor or outdoor spaces due to distance, resolution, light reflection, and low illumination

Engineering Contradiction:
Improvescanning capabilityVSAvoidscanning accuracy
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The patent combines ToF sensor and stereo RGB sensor into a unified scanning system that fuses depth information from ToF with high-resolution image data from stereo RGB sensors. This merging allows the system to leverage the strengths of both sensor types while compensating for their individual weaknesses in challenging environments

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system dynamically adjusts scanning parameters including sensing distance, resolution, light reflection compensation, and illumination levels based on environmental conditions and confidence estimates. This adaptive parameter adjustment maintains scanning accuracy across varying distances and lighting conditions

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If sensor function is adjusted to improve scanning accuracy, then measurement precision is improved, but device complexity increases due to confidence estimator and function adjuster

Engineering Contradiction:
Improvescanning accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system implements a feedback mechanism where confidence estimates from the confidence estimator continuously inform the function adjuster to optimize sensor parameters. This closed-loop feedback ensures accuracy improvement while maintaining manageable complexity through automated adaptive control

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The confidence estimator and function adjuster operate autonomously to self-optimize scanning parameters based on real-time confidence assessments. This self-service capability reduces the need for manual intervention and simplifies system operation despite the added computational complexity

Inventive Principle:
Principle #25Self-service

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enhances the quality and accuracy of 3D spatial scanning by compensating for sensor shortcomings, allowing continuous detection and improving data quality across various environments by selectively adjusting sensor functions based on confidence estimation and object discrimination.

Implementation Method 1

a depth sensor that can recognize space... using a time-of-flight (ToF) sensor

Methodology Applied
Scientific EffectTime of flight: Time of Flight

Data Source

PatentUS20240219573A1Three-dimensional spatial scanning system and method
Publication Date: 2024.07.04 KOREA ELECTRONICS TECH INST
  • US20240219573A1 patent drawing
  • US20240219573A1 patent drawing
  • US20240219573A1 patent drawing

AI summary

A 3D spatial scanning system and method can perform accurate 3D spatial scanning in various environments. The 3D spatial scanning system may include a sensor group, a confidence estimator, a function adjuster, and a fusion part. The sensor group may scan space using a time-of-flight (ToF) sensor and a stereo red-green-blue (RGB) sensor included therein. The confidence estimator may fuse a sensing value of the ToF sensor and a sensing value of the stereo RGB sensor and estimate a confidence of the sensing values. The function adjuster may adjust a function of at least one of the ToF sensor and the stereo RGB sensor based on the confidence estimated by the confidence estimator. The fusion part may fuse the sensing value of the ToF sensor and the sensing value of the stereo RGB sensor based on function adjustment of the function adjuster.