Remote Manipulator Visual Overlay for Low-Complexity Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The remote control system for robot hands with multiple sensors requires high-performance computing and large software scales, making development costly and challenging, with stability and reliability issues remaining in autonomous systems.

Innovation Solution

A remote control manipulator system that includes a manipulator, a camera, a posture sensor, an action instruction inputter, and a control device with a control signal generator, structural data storage, a model image generator, and a presentation image generator to simplify system configuration and enhance operator control.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multiple sensors (pressure sensor, force sensor) are used on the robot hand for remote control, then the control precision and feedback accuracy are improved, but the calculation amount becomes enormous and high-performance electronic computers are required

Engineering Contradiction:
Improvecontrol feedback accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts and removes the complex sensor feedback processing system from the robot control architecture. Instead of using multiple sensors on the robot hand, the invention uses only simple position detection means, eliminating the need for pressure sensors, force sensors, and complex calculation systems while maintaining effective remote control capability through visual feedback from the presentation image.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent creates a visual copy of the robot's operational state through the presentation image that combines camera imagery with model image overlay. This visual representation provides the operator with comprehensive feedback about robot position and status without requiring complex sensor arrays, replacing physical sensor feedback with visual information copying.

Inventive Principle:
Principle #26Copying

2Extent of automation

If multiple sensors and complex control processing are implemented, then the robot can operate autonomously, but the software scale becomes large and development becomes difficult requiring tremendous cost

Engineering Contradiction:
Improveautonomous operation capabilityVSAvoiddevelopment ease
Core Design Contradiction:
Extent of automationVSEase of manufacture

Solution Approach 1:

The patent enables the operator to directly control the robot through simple action instructions without requiring complex autonomous decision-making software. The system serves the operator's control intentions directly through the presentation image feedback loop, eliminating the need for large-scale autonomous operation software while maintaining effective robot operation.

Inventive Principle:
Principle #25Self-service

3Adaptability or versatility

If complex sensor feedback processing is used, then the robot can perform advanced work, but stability and reliability problems remain in autonomous systems

Engineering Contradiction:
Improvework capabilityVSAvoidsystem stability
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent implements a simplified feedback mechanism through the presentation image that provides the operator with real-time visual information about the robot's position and operational state. This direct visual feedback loop replaces complex sensor feedback processing, improving reliability by eliminating unstable autonomous decision-making while maintaining the ability to perform advanced work through operator control.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11498216B2Remote control manipulator system and control device
Publication Date: 2022.11.15 MITSUBISHI ELECTRIC CORP
  • US11498216B2 patent drawing
  • US11498216B2 patent drawing
  • US11498216B2 patent drawing

AI summary

A remote control manipulator system includes a manipulator controlled remotely by an operator; a camera to capture an image including the manipulator; a posture sensor to detect posture data; an action instruction inputter with which the operator inputs an action instruction instructing action to move or stop the manipulator; a control device including a structural data storage to store manipulator structural data representing a structure of the manipulator, a model image generator to generate a model image with referring to the structural data storage and the posture data, and a presentation image generator to generate a presentation image by superimposing a model image on the captured image; and a display to display the presentation image.