3D Hole Position Detection Using Photometric Stereo Fusion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for detecting hole position information in industrial automation are inaccurate due to factors like hole thickness, color, edge noise, and burrs, failing to meet high-precision industrial automation detection requirements.

Innovation Solution

A method involving the acquisition of both photometric stereo and non-photometric stereo scan data to determine hole position information, enhancing contrast and reducing noise through a combination of scan data types.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If photometric stereo scanning is used to detect hole position information, then measurement precision is improved, but device complexity increases

Engineering Contradiction:
Improvehole position detection accuracyVSAvoidscanning system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent combines photometric stereo scanning and non-photometric stereo scanning into a unified detection system. The system merges the advantages of both scanning methods by acquiring scan data from multiple modes and fusing them through coordinate transformation and data integration, thereby improving measurement precision while managing device complexity through software-based fusion rather than separate physical systems

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent changes the scanning parameters by switching between photometric stereo mode and non-photometric stereo mode during the scanning process. By adjusting lighting conditions and scanning parameters dynamically, the system optimizes detection accuracy for different feature types (hole positions versus surface profiles) without requiring fundamentally different hardware configurations

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If photometric stereo scan data is used to enhance contrast and reduce noise, then measurement precision is improved, but processing time increases

Engineering Contradiction:
Improvehole position detection accuracyVSAvoiddata processing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent segments the detection process into distinct phases: photometric stereo scanning for hole position detection, non-photometric stereo scanning for surface profile acquisition, and a separate data fusion stage. By dividing the processing into modular segments with specialized algorithms for each data type, the system reduces overall processing time while maintaining high precision in hole position detection

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary coordinate transformations and data preprocessing during the scanning phase itself. By pre-aligning coordinate systems and preparing data structures in advance, the system minimizes computational overhead during the final fusion stage, thereby reducing total processing time while preserving measurement precision

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentEP4711707A1Hole site information detection method and apparatus, and device and storage medium
Publication Date: 2026.03.18 SHINING 3D TECH CO LTD
  • EP4711707A1 patent drawingFigure 1~2
  • EP4711707A1 patent drawingFigure 3
  • EP4711707A1 patent drawingFigure 4~5

AI summary

The present disclosure relates to a method for detecting hole position information, apparatus, device, and storage medium. During scanning a structure to be detected using a three-dimensional scanner, first scan data and second scan data of the structure to be detected are acquired, wherein the first scan data is photometric stereo scan data of positioning holes on the structure to be detected; the second scan data includes non-photometric stereo scan data of the positioning holes, or the second scan data is non-photometric stereo scan data of feature points other than the positioning holes. The hole position information of the positioning holes is determined based on the first scan data and the second scan data. The photometric stereo scan data is obtained through detection in a photometric stereo scanning mode, which may include subtle changes on the surface of an object and has the effects of enhancing the contrast between different feature points and reducing noise. Therefore, by using the photometric stereo scan data and non-photometric stereo scan data, hole position information with higher accuracy may be determined, meeting the requirements of high-precision industrial automation detection.