Multi-Viewpoint 3D Detection Using Light Source Positioning

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing detection systems struggle to accurately determine the relative positions between multiple detection devices while accounting for light source information, which is crucial for integrating three-dimensional shape information from different viewpoints.

Innovation Solution

A detection device and system that includes a detector for capturing images from a first viewpoint, an information calculator for determining shape information, a light source calculator for estimating light source information, and a position calculator for determining the positional relation between viewpoints, using light source information to integrate shape information from multiple viewpoints.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If multiple detection devices are used to detect objects from different viewpoints, then the completeness of three-dimensional shape information is improved, but the difficulty of determining relative positions between devices increases

Engineering Contradiction:
Improvecompleteness of three-dimensional shape informationVSAvoiddifficulty of determining relative positions
Core Design Contradiction:
Loss of informationVSDifficulty of detecting and measuring

Solution Approach 1:

The patent introduces light source information as an intermediary element to establish the relationship between multiple detection devices. By detecting the position and characteristics of light sources from different viewpoints, the system creates a common reference framework that enables accurate determination of relative positions between detection devices without requiring direct measurement between them.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system uses light source detection results as feedback to iteratively refine the relative position information between detection devices. The detected light source positions from multiple viewpoints are processed to calculate and update the spatial relationship parameters, which then feed back into the integration process for improved accuracy.

Inventive Principle:
Principle #23Feedback

2Measurement precision

If light source information is integrated into the detection system, then the precision of three-dimensional modeling is improved, but the device complexity increases

Engineering Contradiction:
Improveprecision of three-dimensional modelingVSAvoiddevice complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The detection devices are designed with multi-functionality, serving both as object detectors and as light source detectors. This universal approach allows the same hardware to gather both object shape information and light source position information, reducing the need for separate specialized devices and thereby managing complexity while improving precision.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system uses the detection devices themselves to detect light sources, rather than requiring separate light source detection equipment. The same sensors and processors that capture object information also capture light source information, allowing the system to self-configure its reference framework without additional external components.

Inventive Principle:
Principle #25Self-service

3Manufacturing precision

If relative positions between detection devices are accurately determined, then the quality of integrated three-dimensional model is improved, but the calculation complexity increases

Engineering Contradiction:
Improvequality of integrated three-dimensional modelVSAvoidcalculation complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The system performs preliminary detection of light source positions from multiple viewpoints before integrating the three-dimensional models. By pre-establishing the relative position relationships through light source detection and calculation, the system prepares the spatial transformation parameters in advance, which simplifies the subsequent model integration process and reduces overall calculation complexity.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS12203744B2Detection device, detection system, detection method, and storage medium
Publication Date: 2025.01.21 NIKON CORP
  • US12203744B2 patent drawing
  • US12203744B2 patent drawing
  • US12203744B2 patent drawing

AI summary

A detection device includes: a detector that detects an object from a first viewpoint; an information calculator that calculates first model information including shape information on the object from the first viewpoint by using detection results of the detector; a light source calculator that calculates light source information on the light source by using a first taken image obtained by imaging a space including a light source that irradiates the object with illumination light and including the object; and a position calculator that calculates a positional relation between the first viewpoint and the object by using the light source information as information used to integrate the first model information and second model information including shape information obtained by detecting the object from a second viewpoint different from the first viewpoint.