Robot Surface Designation for Grasping Hard-to-Recognize Objects

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Robots struggle to correctly recognize objects, especially when objects are complex, intermingled, or have reflective or transparent surfaces, leading to difficulties in accurately grasping and moving them.

Innovation Solution

A designation device and method that allow a worker to input the surface of an object to be moved, displaying a two-dimensional image of the object and its surface, enabling the robot to grasp and move the object based on this input, even if the robot cannot correctly recognize the object.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If expensive industrial cameras are used for automatic recognition, then recognition capability is improved, but cost increases and recognition still fails for complex objects

Engineering Contradiction:
Improveobject recognition accuracyVSAvoidrecognition system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

A designation device serves as an intermediary between the worker and the robot system. It receives surface designation inputs from the worker, generates two-dimensional images showing the designated surfaces, and transmits this information to the robot control device, enabling the robot to grasp objects without complex automatic recognition systems

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system creates a two-dimensional image copy of the object's surface as designated by the worker. This 2D representation captures the essential surface information needed for robot grasping, replacing the need for complex 3D automatic recognition while maintaining sufficient accuracy for the task

Inventive Principle:
Principle #26Copying

2Extent of automation

If automatic recognition systems are used, then object detection is automated, but they fail to recognize objects with reflective, transparent, or complex surfaces

Engineering Contradiction:
Improveobject detection automationVSAvoidobject recognition reliability
Core Design Contradiction:
Extent of automationVSReliability

Solution Approach 1:

The worker manually designates the object surface directly through the designation device, eliminating dependence on automatic recognition systems. The worker's direct input serves the system with accurate surface information, making the process reliable regardless of object appearance characteristics such as reflectivity, transparency, or complexity

Inventive Principle:
Principle #25Self-service

3Measurement precision

If manual surface designation is implemented, then object recognition accuracy is improved, but operational complexity increases

Engineering Contradiction:
Improvesurface recognition accuracyVSAvoiddesignated operation simplicity
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The system creates a two-dimensional image copy of the designated surface, which is visually presented to the worker for confirmation. This visual feedback mechanism makes the manual designation process intuitive and easy to verify, reducing operational complexity despite the manual input requirement

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system replaces complex mechanical or optical recognition mechanisms with a simplified information processing approach. The designation device processes worker inputs and generates 2D images, substituting physical recognition complexity with straightforward digital image generation and display

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS20250144808A1Designation device, robot system, designation method, and recording medium
Publication Date: 2025.05.08 NEC CORP
  • US20250144808A1 patent drawing
  • US20250144808A1 patent drawing
  • US20250144808A1 patent drawing

AI summary

A designation device in a robot system that moves an object to be moved by following a predetermined algorithm in accordance with a work goal receives an input of a surface designating a predetermined surface of the object to be moved. The designation device makes a display device display a two-dimensional image including the object to be moved, and the surface designating the predetermined surface, received by the reception means. The designation device is configured to be included in a robot system that moves the object to be moved by following a predetermined algorithm in accordance with a work goal.