Object Identification Device Using Structured Light and Color Imaging

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing object identification systems face challenges in fully automated recognition without operator assistance, particularly with barcodes being obstructed, incorrectly read due to reflections, or absent on items like loose fruit, necessitating alternative identification methods and validity checks for manipulation detection.

Innovation Solution

An identification device employing a first lighting device for homogeneous visible or infrared illumination and a second device for structured illumination, combined with a color camera, enables real-time detection of three-dimensional shape and color features, allowing for barcode-independent object recognition and validity checks.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If barcode reading is used for object identification, then identification speed is improved, but reliability deteriorates when barcodes are covered, misplaced, or incorrectly read

Engineering Contradiction:
Improveidentification speedVSAvoididentification reliability
Core Design Contradiction:
SpeedVSReliability

Solution Approach 1:

The system changes the identification parameters from barcode-specific (1D/2D codes) to general object characteristics (3D shape, color, texture). By using structured light projection and multi-angle imaging, the system captures geometric and visual parameters that inherently describe the object, providing reliable identification regardless of barcode condition.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The invention transitions from 2D barcode recognition to 3D object characterization by projecting structured light patterns and capturing images from multiple angles. This dimensional expansion allows the system to identify objects based on their spatial geometry and surface properties, bypassing barcode limitations entirely.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Reliability

If additional identification methods (color, shape detection) are implemented, then reliability is improved for barcode-independent identification, but device complexity increases

Engineering Contradiction:
Improveidentification reliabilityVSAvoiddevice complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system employs a multi-functional imaging platform that simultaneously performs 3D shape capture, color detection, and texture analysis using integrated sensors and processing units. This universal approach allows a single device to handle diverse identification tasks (barcoded and non-barcoded objects) without requiring separate specialized systems.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The identification process is segmented into distinct functional modules: structured light projection for 3D shape capture, multi-spectral imaging for color and texture detection, and hierarchical processing pipelines that analyze different object features separately before integration. This modular segmentation manages complexity by organizing functions into independent, manageable components.

Inventive Principle:
Principle #1Segmentation

3Measurement precision

If structured illumination and multi-angle imaging are used for 3D shape detection, then identification accuracy is improved, but measurement time increases

Engineering Contradiction:
Improveidentification accuracyVSAvoidmeasurement time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system uses periodic projection of structured light patterns (multiple phases and orientations) combined with synchronized multi-angle imaging. By capturing images at different time points during the periodic illumination sequence, the system reconstructs 3D shape information through temporal sampling, achieving high precision without requiring continuous illumination or excessive measurement time.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system performs preliminary capture of multiple images and structured light patterns in rapid succession before processing. By pre-capturing all necessary data points (multi-angle views, multiple illumination phases) in advance, the subsequent 3D reconstruction and identification processing can proceed efficiently without time-consuming sequential measurements.

Inventive Principle:
Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables clear identification of objects in real-time, even without barcodes, by correlating 3D and color data, effectively addressing issues in automated recognition and validity checks in retail environments.

Implementation Method 1

a first lighting device (8), which is designed to homogeneously illuminate an object (3) to be identified with light of the visible spectrum

Methodology Applied
Scientific EffectVisible light reflection: Reflection

Implementation Method 2

with light of the visible spectrum and/or with infrared light

Methodology Applied
Scientific EffectInfrared illumination: Infrared Radiation

Implementation Method 3

a second lighting device (1), which is designed to illuminate the object to be identified with a structured illumination pattern

Methodology Applied
Scientific EffectStructured light projection: Light

Implementation Method 4

a color camera (2), which records the object illuminated with the first illumination device and with the second illumination device

Methodology Applied
Scientific EffectPhotoelectric detection: Photoelectric Effect

Data Source

PatentEP3018446B1Identification device for an object
Publication Date: 2021.12.29 WINCOR NIXDORF INT GMBH
  • EP3018446B1 patent drawingFigure 1
  • EP3018446B1 patent drawingFigure 2
  • EP3018446B1 patent drawingFigure 3

AI summary

The invention relates to an identification device for an object, comprising: a first illumination device (8, 81, 82) configured to homogeneously illuminate an object (3) to be identified with light of the visible spectrum and/or with infrared light; a second illumination device (1) configured to illuminate the object (3) to be identified with a structured illumination pattern; and at least one color camera (2, 21-24) that records the object (3) illuminated by the first illumination device (8, 81, 82) and by the second illumination device (1). There is an acute angle between the illumination direction of the second illumination device (1) and the optical axis of the color camera (2, 21-24).It is provided that the at least one color camera (2, 21-24) provides first data relating to the image of the object (3) illuminated by the first lighting device (8, 81, 82) and provides second data relating to the image of the object (3) illuminated by the second lighting device (1).