Remote Robot Operation Using Predicted Next-Step Motion Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional remote operation systems for robots are limited by the operator's skill level and input device performance, making it difficult to smoothly operate robots, especially in tasks requiring precise motion control.

Innovation Solution

An information processing device with a prediction unit that predicts the next action based on executed actions and step information, and a motion control unit that assists in remote operation by controlling the operation unit based on the predicted action and operation information, improving the efficiency and accuracy of robot operations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If remote operation is performed using conventional methods, then the operator can control the robot, but the operability is limited by the operator's skill level and input device performance

Engineering Contradiction:
Improveoperability of remote operationVSAvoiddependence on operator skill level
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The system performs preliminary actions by predicting the operator's intended operations based on current operation history and task information. The prediction unit anticipates future operations before the operator actually inputs them, preparing control commands in advance to improve responsiveness and reduce the burden on the operator's skill level.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent replaces the mechanical dependency on operator skill and input device performance with an intelligent prediction system. The prediction unit uses computational algorithms to substitute for the operator's decision-making process, transforming the control system from a purely manual mechanical operation to an intelligent automated assistance system.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Productivity

If the operator manually controls each action, then precise control is possible, but the operation efficiency decreases due to skill limitations

Engineering Contradiction:
Improveoperation efficiencyVSAvoiddifficulty in smooth operation
Core Design Contradiction:
ProductivityVSEase of operation

Solution Approach 1:

The system provides self-service by automatically generating predicted operation commands based on the current task context and operation history. The prediction unit serves itself by continuously analyzing the situation and generating appropriate control commands without requiring constant manual intervention, thereby improving operation efficiency while maintaining ease of use.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system implements feedback by continuously monitoring the operation history and task information to refine its predictions. The prediction unit uses feedback from the current operation state and historical data to improve the accuracy of predicted commands, creating a closed-loop system that enhances both efficiency and operational smoothness.

Inventive Principle:
Principle #23Feedback

3Productivity

If complex tasks are performed manually, then flexibility is maintained, but the motion control efficiency decreases

Engineering Contradiction:
Improvemotion control efficiencyVSAvoidcomplexity of task execution
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent applies segmentation by dividing complex tasks into discrete operation steps that can be individually predicted and optimized. The prediction unit breaks down complex motion sequences into manageable segments based on task information and operation history, allowing each segment to be controlled more efficiently while maintaining overall task flexibility.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS20240231325A1Information processing device, remote operation system, and information processing method
Publication Date: 2024.07.11 SONY GROUP CORP
  • US20240231325A1 patent drawing
  • US20240231325A1 patent drawing
  • US20240231325A1 patent drawing

AI summary

An information processing device (30) includes a prediction unit (321) that predicts, based on an action executed by an operation unit (120) and step information capable of identifying a work step, a next action to be executed in a next step by the operation unit (120) in accordance with a remote operation, and a motion control unit (323) that controls the operation unit (120) so as to assist in the remote operation of the operation unit (120) based on a relationship between the predicted next action, operation information (D10) about the remote operation, and an object to be operated by the operation unit (120).