3D Range Image Landmark Localization via Synthetic Visible Rendering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing biometric identification methods face challenges in accurately localizing landmarks in 3D range images due to the need for image registration between 3D and visible images, which can be imprecise, and the difficulty in reconciling the registration process, especially when using 3D range images that contain large amounts of data and require custom detectors for each feature.

Innovation Solution

A method that renders a synthetic visible image from a 3D range image, eliminating the need for image registration by producing an inherently aligned image, allowing landmark localization to be performed directly on the rendered visible image, which is then mapped back to the 3D image without registration, using techniques similar to computer graphics and ray tracing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If image registration is performed between 3D range images and visible images for landmark localization, then landmark localization can be achieved, but the accuracy deteriorates due to imprecise registration and the process becomes complex

Engineering Contradiction:
Improvelandmark localization accuracyVSAvoidimage registration process complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent creates a synthetic visible image from the 3D range image data, which serves as a copy that is inherently aligned with the 3D image. This synthetic image is generated by projecting 3D landmark locations and orientations onto a 2D plane using rendering techniques, eliminating the need for complex registration between separate 3D and visible images while maintaining accurate landmark localization

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent performs preliminary rendering of the 3D range image to create a synthetic visible image before landmark localization is attempted. By pre-aligning the visible and 3D image spaces through the rendering process, the system eliminates the need for subsequent registration operations, simplifying the overall workflow while improving accuracy

Inventive Principle:
Principle #10Preliminary action

2Loss of information

If 3D range images are used for biometric identification, then more information is available, but the data volume increases making processing more difficult

Engineering Contradiction:
Improveinformation completenessVSAvoiddata processing complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent extracts only the necessary information from the 3D range image by rendering a synthetic visible image that contains landmark locations and orientations. This extraction process converts the large-volume 3D data into a simplified 2D representation that retains the essential biometric information needed for identification while reducing processing complexity

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent transforms 3D range image data into a 2D synthetic visible image through rendering. This dimensionality reduction converts complex three-dimensional data into a two-dimensional format that is easier to process while preserving the critical landmark information needed for biometric identification

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Measurement precision

If custom detectors are created for each feature in 3D range images, then accurate detection is possible, but the time required increases significantly

Engineering Contradiction:
Improvefeature detection accuracyVSAvoidprocessing speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent creates a universal synthetic visible image from the 3D range data that can be used for detecting multiple different facial features and landmarks simultaneously. Instead of creating custom detectors for each feature, the rendered image provides a unified representation where standard detection algorithms can identify multiple landmarks, significantly reducing processing time while maintaining accuracy

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS8682041B2Rendering-based landmark localization from 3D range images
Publication Date: 2014.03.25 HONEYWELL INTERNATIONAL INC
  • US8682041B2 patent drawing
  • US8682041B2 patent drawing
  • US8682041B2 patent drawing

AI summary

A computer implemented method comprising acquiring a three-dimensional (3D) range image containing one or more 3D landmarks; rendering the 3D range image into a rendered visible image containing intensity patterns related to the one or more 3D landmarks; and localizing at least one of the one or more 3D landmarks in the rendered visible image to provide at least one localized 3D landmark. is provided. Such methods, and related systems, and devices, are useful in biometric identification applications.