Acquiring Light Ray Correspondence for Transparent Object 3D Reconstruction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional three-dimensional reconstruction algorithms are ineffective for transparent objects due to complex reflection and refraction, resulting in unreliable data acquisition and inability to reconstruct transparent objects accurately.

Innovation Solution

A system comprising a camera device, a display device, and a turntable connected to a control device, which rotates the transparent object and captures images from different angles to obtain correspondence between light rays, improving data reliability and enabling three-dimensional modeling.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If conventional three-dimensional reconstruction algorithms are used for transparent objects, then the algorithms can process non-transparent objects effectively, but the data acquisition reliability deteriorates due to complex reflection and refraction

Engineering Contradiction:
Improvedata acquisition reliabilityVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent segments the light transport process into multiple discrete views by rotating the transparent object on a turntable to capture images from different angles. This segmentation allows the complex refraction and reflection processes to be analyzed separately in each view, improving data reliability while managing system complexity through systematic multi-view acquisition

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transitions from single-view to multi-view imaging by adding the rotational dimension. The turntable rotates the transparent object to capture images from multiple angular positions, effectively adding a temporal/angular dimension to the data acquisition process. This dimensional expansion enables reliable reconstruction by capturing light ray correspondences that cannot be obtained from a single viewpoint

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If conventional algorithms are applied to transparent objects, then the processing flow remains simple, but the measurement precision deteriorates due to ineffective data acquisition

Engineering Contradiction:
Improvethree-dimensional reconstruction precisionVSAvoiddata acquisition time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent performs preliminary action by capturing multiple views of the transparent object before reconstruction. The turntable rotates the object to predetermined angular positions, and images are captured at each position. This preliminary multi-view data acquisition ensures that all necessary light ray correspondence information is collected before the actual three-dimensional reconstruction process, improving measurement precision

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent maintains continuity of useful action by systematically rotating the object through multiple angular positions and continuously capturing images at each position. This continuous multi-view data collection ensures uninterrupted acquisition of light ray correspondences, improving reconstruction precision while optimizing the balance between data quality and acquisition time

Inventive Principle:
Principle #20Continuity of useful action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The system effectively acquires reliable correspondence between light rays of transparent objects from multiple viewing angles, enhancing the accuracy of three-dimensional reconstruction by improving data reliability and constructing precise three-dimensional models.

Implementation Method 1

control the display device in a first preset position to display a preset image, and acquire images corresponding to the display device in the first preset position, which are photographed by the camera device through the transparent object

Methodology Applied
Scientific EffectLight emission from display device: Light

Implementation Method 2

because of the complex reflection and refraction involved in the light transport of transparent object

Methodology Applied
Scientific EffectLight refraction: Refraction

Implementation Method 3

acquire images corresponding to the display device in the first preset position, which are photographed by the camera device through the transparent object

Methodology Applied
Scientific EffectLight detection: Photoelectric Effect

Data Source

PatentUS10964107B2System for acquiring correspondence between light rays of transparent object
Publication Date: 2021.03.30 SHENZHEN UNIV
  • US10964107B2 patent drawing
  • US10964107B2 patent drawing
  • US10964107B2 patent drawing

AI summary

The present disclosure relates to a system for acquiring a correspondence between light rays of a transparent object. The system includes a camera device, a display device, a turntable and a control device; the camera device, the display device and the turntable are electrically connected with the control device respectively; the turntable is configured to rotate a transparent object; the control device is configured to acquire images corresponding to display device in the first preset position, which are photographed by the camera device through the transparent object at different rotation angles, to obtain a primary image set; acquire images corresponding to the display device in the second preset position, which are photographed by the camera device through the transparent object at different rotation angles, to obtain a secondary image set; and obtain the correspondence between light rays of the transparent object from different viewing angles.