Robot Remote Control Route Estimation From Handwritten Input

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing remote control systems for robots struggle to accurately determine whether a conveyance route for an object to be grasped indicates a moving route for the robot or the end effector, leading to inaccurate processing.

Innovation Solution

A remote control system that includes an imaging unit, a recognition unit, an operation terminal, and an estimation unit. The system shoots an image of the environment, recognizes objects and areas, and estimates the object to be grasped and the motion content based on handwritten information, distinguishing between robot and end effector movements.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If handwritten information is used for remote control, then ease of operation is improved, but measurement precision deteriorates because it cannot be determined whether the conveyance route indicates robot movement or end effector movement

Engineering Contradiction:
Improveintuitive handwriting inputVSAvoidroute interpretation accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent introduces an estimation unit as an intermediary that processes the handwritten conveyance route information. This unit uses recognition results (objects, movable areas, immovable areas) to estimate whether the handwritten route represents robot movement or end effector movement, thereby resolving the ambiguity while maintaining intuitive handwriting input

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system employs feedback by using recognition results (objects that can be grasped, movable areas, immovable areas) to inform the estimation process. The estimation unit continuously refines its determination of route meaning based on the recognized environment, improving accuracy while preserving ease of operation

Inventive Principle:
Principle #23Feedback

2Manufacturing precision

If automatic estimation of conveyance route meaning is implemented, then manufacturing precision is improved, but device complexity increases due to additional processing units

Engineering Contradiction:
Improveprocessing accuracyVSAvoidsystem structure
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The estimation unit is merged with the existing recognition unit and operation terminal, forming an integrated processing system. The estimation function combines recognition results with conveyance route information in a unified processing flow, achieving high processing accuracy without requiring completely separate independent systems

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The estimation unit serves multiple functions: it determines whether conveyance routes represent robot or end effector movement, identifies objects to be grasped, and estimates motion contents. This multi-functionality reduces the need for separate specialized components, balancing precision with manageable complexity

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS12325144B2Remote control system, remote control method, and control program
Publication Date: 2025.06.10 TOYOTA JIDOSHA KK
  • US12325144B2 patent drawing
  • US12325144B2 patent drawing
  • US12325144B2 patent drawing

AI summary

A remote control system includes: a recognition unit configured to recognize, based on a shot image, objects that can be grasped, and movable and immovable areas of a device to be operated; an operation terminal configured to receive handwritten information; and an estimation unit configured to estimate an object to be grasped requested to be grasped and estimate a content of a motion with regard to the object to be grasped which is requested to be performed by the device to be operated, in which the estimation unit estimates, a conveyance route positioned in the movable area of the device to be operated among the conveyance routes as a moving route of the device to be operated and estimates a conveyance route positioned in the immovable area of the device to be operated as a moving route of an end effector that grasps the object to be grasped.