Thermal Compensation for Structured Light 3D Depth Accuracy

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Structured light 3D systems face distortion and pixel drift due to temperature changes, affecting the accuracy of depth maps generated by image capturing and projecting devices.

Innovation Solution

A system and method for thermal compensation, involving temperature-sensing circuits, storage of temperature-related parameters, and a processing device that generates compensated images by interpolating based on detected temperatures to correct for pixel shifts and lens distortions, ensuring accurate depth map generation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If temperature compensation is not implemented, then the system structure remains simple, but the depth map accuracy deteriorates due to thermal distortion and pixel drift

Engineering Contradiction:
Improvedepth map accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by pre-storing multiple sets of intrinsic parameters (K0, K1, K2, K3, K4) and distortion coefficients (k1, k2, k3, k4) corresponding to different temperature points. When operation occurs, the system directly retrieves and applies the appropriate parameter set based on detected temperature, avoiding complex real-time calculations while maintaining high measurement precision across varying thermal conditions

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements parameter changes by dynamically adjusting camera intrinsic parameters and lens distortion coefficients based on temperature variations. The system stores multiple parameter sets calibrated at different temperatures and selects the appropriate set according to the detected temperature, thereby compensating for thermal effects on image quality and depth map accuracy without requiring complex real-time optimization algorithms

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If real-time temperature compensation is implemented, then the depth map accuracy is maintained, but the processing time and computational load increase

Engineering Contradiction:
Improvedepth map accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent eliminates real-time computational overhead by performing all parameter calibration work in advance. Multiple sets of intrinsic parameters and distortion coefficients are pre-calculated and stored in memory for different temperature points. During operation, the system only needs to detect temperature and retrieve the corresponding pre-stored parameters, reducing processing time from complex real-time optimization to simple table lookup and application

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses copying by creating and storing multiple copies of parameter sets (K0, K1, K2, K3, K4 and k1, k2, k3, k4) corresponding to different temperature conditions. Instead of calculating corrections in real-time, the system copies the appropriate pre-calculated parameter set from storage based on the detected temperature and applies it directly to compensate for thermal effects, significantly reducing processing time

Inventive Principle:
Principle #26Copying

3Reliability

If temperature sensing circuits and parameter storage are added, then thermal compensation capability is achieved, but the device complexity increases

Engineering Contradiction:
Improvethermal compensation capabilityVSAvoiddevice complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies segmentation by separating the thermal compensation function into distinct modular components: temperature sensing circuits integrated with the camera and projector, parameter storage modules containing pre-calibrated data, and processing logic for retrieving and applying appropriate parameters. This modular segmentation allows each component to be independently optimized and maintained while achieving reliable thermal compensation capability

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements self-service by integrating temperature sensing circuits directly into the camera and projector units, allowing each device to autonomously detect its own temperature and retrieve corresponding compensation parameters. The system automatically performs thermal compensation without requiring external intervention or complex control systems, thereby achieving reliable thermal adaptation with minimal additional complexity

Inventive Principle:
Principle #25Self-service

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The solution effectively compensates for thermal effects, enhancing the accuracy of depth maps by accounting for both device-specific and ambient temperature variations, thereby improving the reliability of structured light 3D systems.

Implementation Method 1

a first sensing circuit, configured for detecting a first temperature of the image capturing device

Methodology Applied
Scientific EffectTemperature detection:

Implementation Method 2

a second sensing circuit, configured for detecting a second temperature of the projecting device

Methodology Applied
Scientific EffectTemperature detection:

Implementation Method 3

The thermal effect leads to the distortion in the projected image of the projecting device and the pixel drifts in the captured image and the reference image

Methodology Applied
Scientific EffectThermal expansion: Thermal Expansion

Data Source

PatentUS11792374B1System and method for handling a thermal compensation
Publication Date: 2023.10.17 HIMAX TECH LTD
  • US11792374B1 patent drawing
  • US11792374B1 patent drawing
  • US11792374B1 patent drawing

AI summary

A system for handling a thermal compensation comprises: an image capturing device comprising a capturing circuit, for capturing a first image, and a first sensing circuit, for detecting a first temperature; a projecting device comprising a second sensing circuit, for detecting a second temperature; a storage device, for storing a plurality of first parameters associated with the image capturing device, a plurality of second parameters associated with the projecting device and a reference image associated with the projecting device; and a processing device comprising a processing circuit, for compensating the first image according to the first temperature and the plurality of first parameters, to generate a first compensated image, compensating the reference image according to the second temperature and the plurality of second parameters, to generate a second compensated image, and generating a second image according to the first compensated image and the second compensated image.