3D Visual Sensor Edge Projection Verification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current three-dimensional visual sensors require complex user settings and calibration processes, leading to potential errors in three-dimensional information restoration and difficulty in understanding recognition results, particularly in manufacturing scenarios where accurate positioning and attitude of objects are crucial.

Innovation Solution

A method and system for three-dimensional recognition result display that performs perspective transformation of three-dimensional information and models into a common coordinate system, allowing users to easily verify the accuracy of edge projection images and model projections, enhancing user-friendliness by displaying these images in parallel or superimposed formats.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If complex user settings and calibration processes are required for three-dimensional visual sensors, then the measurement precision can be improved, but the ease of operation deteriorates

Engineering Contradiction:
Improvethree-dimensional information restoration accuracyVSAvoiduser setting complexity
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent implements a feedback mechanism by displaying the recognized three-dimensional object superimposed on the original image. This allows users to visually verify whether the recognition results match the actual object, enabling them to detect and correct setting errors or calibration issues without requiring complex manual verification procedures.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent creates a visual copy of the three-dimensional recognized object and superimposes it onto the two-dimensional image. This copying approach transforms abstract three-dimensional data into a familiar two-dimensional visual format that users can easily interpret, simplifying the verification process while maintaining measurement precision.

Inventive Principle:
Principle #26Copying

2Device complexity

If only coordinate and rotation angle are displayed for recognition results, then the device complexity is reduced, but the ease of operation deteriorates due to difficulty in understanding

Engineering Contradiction:
Improvedisplay system simplicityVSAvoidrecognition result understandability
Core Design Contradiction:
Device complexityVSEase of operation

Solution Approach 1:

The patent transforms the abstract recognition results (coordinates and rotation angles) into a visual copy of the three-dimensional object rendered in the same coordinate system as the original image. This visual representation is much easier for users to understand and verify than raw numerical data.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent transitions from displaying only one-dimensional numerical parameters (coordinates and angles) to a two-dimensional visual representation. By projecting the three-dimensional recognized object onto the two-dimensional image plane, the system provides intuitive spatial information that is immediately understandable to users.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Productivity

If three-dimensional information is restored without proper verification, then the productivity is improved, but the reliability deteriorates due to potential errors in measurement

Engineering Contradiction:
Improveprocessing efficiencyVSAvoidmeasurement accuracy
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent provides real-time visual feedback by displaying the recognized three-dimensional object superimposed on the original image. Users can immediately see whether the recognition results are accurate, allowing them to detect errors and correct settings without requiring time-consuming manual verification processes.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent performs preliminary verification by displaying the recognized object before finalizing the measurement results. This allows users to check for obvious errors or inconsistencies in the three-dimensional information restoration process, ensuring reliability before the data is used for downstream applications.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS8565515B2Three-dimensional recognition result displaying method and three-dimensional visual sensor
Publication Date: 2013.10.22 OMRON CORP
  • US8565515B2 patent drawing
  • US8565515B2 patent drawing
  • US8565515B2 patent drawing

AI summary

In the present invention, whether three-dimensional measurement or checking processing with a model is properly performed by setting information and recognition processing result can easily be confirmed. After setting processing is performed to a three-dimensional visual sensor including a stereo camera, a real workpiece is imaged, the three-dimensional measurement is performed to an edge included in a produced stereo image, and restored three-dimensional information is checked with a three-dimensional model to compute a position of the workpiece and a rotation angle for an attitude indicated by the three-dimensional model. Thereafter, perspective transformation of the three-dimensional information on the edge obtained through measurement processing and the three-dimensional model to which coordinate transformation is already performed based on recognition result is performed into a coordinate system of a camera that performs the imaging, and projection images are displayed while being able to be checked with each other.