Vision-Guided Robot Tool Control for Submicron Micro-Operation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current micro-operation systems for robots, such as those used in micro-machining and ultra-precision machining, face challenges in achieving high motion accuracy and safety due to the limitations of human vision and control devices, which are inefficient and pose safety risks when operating at submicron and nano-scales.

Innovation Solution

A vision-based operation system that uses a camera to capture images of a robot's tool and object, generating commands based on parameters like field of view and distance to control the robot's speed, thereby improving accuracy and safety by reducing reliance on human eyes and enhancing semi-automatic operation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a human operator manually controls the robot using a Teach Pendant Unit for micro-operation, then the robot can be positioned with fine control, but the operation efficiency is low and safety risk increases due to the need for operator eyes to be close to the tips

Engineering Contradiction:
Improvepositioning accuracyVSAvoidoperation efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent introduces a camera as an intermediary device between the human operator and the robot tool tip. The camera captures real-time images of the tool tip and workpiece, allowing the operator to view the micro-operation area remotely on a display screen. This intermediary system enables precise positioning control without requiring the operator to physically靠近 the dangerous area, thus improving both safety and operation efficiency

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces the direct mechanical control approach with a vision-based control system. Instead of relying solely on manual joystick control, the system uses camera images to provide visual feedback and guide the operator's control actions. This substitution of mechanical direct control with optical-mechanical-hybrid control improves positioning accuracy while maintaining operational efficiency

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If the robot motion accuracy is increased to submicron level, then the positioning precision improves, but the control difficulty increases significantly for manual operation

Engineering Contradiction:
Improvemotion accuracyVSAvoidcontrol difficulty
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent implements a real-time visual feedback system where the camera continuously captures images of the tool tip and workpiece position. These images are displayed on a screen, providing the operator with immediate visual feedback about the robot's position and movement. This feedback loop enables the operator to make precise control adjustments to achieve submicron positioning accuracy without the extreme difficulty of manual operation alone

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The camera acts as an intermediary that amplifies and makes visible the submicron-level movements and positions. By optically magnifying and displaying the tool tip position, the system enables the operator to perceive and control movements at the submicron level, which would otherwise be imperceptible and extremely difficult to control manually

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If the operator keeps eyes close to the tips for precise control, then the positioning accuracy improves, but the safety risk increases due to potential collision hazards

Engineering Contradiction:
Improvepositioning accuracyVSAvoidsafety risk
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The patent introduces a camera as an intermediary viewing device that allows the operator to observe the tool tip and workpiece from a safe distance. The camera captures real-time images and transmits them to a display screen, enabling the operator to maintain precise visual monitoring of the operation area without physically靠近 the potential collision hazards. This resolves the contradiction by decoupling visual accuracy from physical proximity

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system creates a visual copy of the actual operation scene through the camera. Instead of directly viewing the real tool tip and workpiece interaction from close range, the operator views a captured image copy on a display screen. This copy provides all necessary visual information for precise positioning control while eliminating the safety risks associated with close physical proximity to moving parts

Inventive Principle:
Principle #26Copying

Data Source

PatentUS11926065B2Vision-based operation for robot
Publication Date: 2024.03.12 ABB (SCHWEIZ) AG
  • US11926065B2 patent drawing
  • US11926065B2 patent drawing

AI summary

Embodiments of the present disclosure relates to an electronic device, a vision-based operation method and system for a robot. The electronic device includes at least one processing unit; and a memory coupled to the at least one processing unit and storing computer program instructions therein, the instructions, when executed by the at least one processing unit, causing the electronic device to perform acts including: obtaining an image containing a tool of a robot and an object to be operated by the tool, the image being captured by a camera with a parameter, obtaining a command for operating the tool, the command generated based on the image; and controlling the robot based on the command and the parameter. Embodiments of the present disclosure can greatly improve the accuracy, efficiency and safety of an operation of a robot.