Remote Operation Feedback for Operator Skill Transfer

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Less skilled operators face challenges in understanding and replicating the operational mode of a working machine during remote operation, hindering skill improvement.

Innovation Solution

A remote operation system comprising a working machine with an imaging device, a first remote operation apparatus with a passive mode detector, and a second remote operation apparatus with an actuator, allowing data transmission and control to replicate the operational mode of the first operator's actions, enabling the second operator to grasp the operational mode through visual and tactile feedback.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a skilled operator remotely operates a working machine, then the working machine can be operated effectively, but a less skilled operator cannot grasp the operational mode from this process

Engineering Contradiction:
Improveoperational effectivenessVSAvoidoperational mode information
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

The system implements feedback by detecting the passive mode of the operation mechanism in the first remote operation apparatus and transmitting this operational mode data to the second remote operation apparatus. This allows the second operator to receive information about the first operator's operational patterns, enabling skill transfer while maintaining effective machine operation.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system creates a copy of the operational mode by detecting the passive mode data from the first operator's operation mechanism and reproducing this information in the second remote operation apparatus. This copying mechanism enables the second operator to observe and learn the first operator's techniques without interfering with the actual machine control.

Inventive Principle:
Principle #26Copying

2Adaptability or versatility

If operational mode data is transmitted between remote operation apparatuses, then skill transfer is enabled, but system complexity increases

Engineering Contradiction:
Improveskill transfer capabilityVSAvoidsystem structure
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The remote operation server performs multiple functions: it manages communication between remote operation apparatuses, detects passive mode data, transmits operational mode information, and controls actuators. By consolidating these functions in a single server, the system achieves skill transfer capability without proportionally increasing overall system complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The remote operation server acts as an intermediary between the first and second remote operation apparatuses. It receives operational mode data from the first apparatus, processes this information, and transmits it to the second apparatus, thereby enabling skill transfer while centralizing the complexity management in a dedicated intermediary component.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Ease of operation

If an actuator actively operates the operation mechanism in the second remote operation apparatus, then tactile feedback is provided to the less skilled operator, but energy consumption increases

Engineering Contradiction:
Improvetactile feedbackVSAvoidactuator energy consumption
Core Design Contradiction:
Ease of operationVSUse of energy by moving object

Solution Approach 1:

The actuator in the second remote operation apparatus performs partial action by only actively operating the operation mechanism when operational mode data is received and needs to be demonstrated. The actuator remains inactive during normal operation, consuming minimal energy, and activates selectively to provide tactile feedback for skill transfer purposes.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS11993922B2Remote operation system
Publication Date: 2024.05.28 KOBELCO CONSTR MASCH CO LTD
  • US11993922B2 patent drawing
  • US11993922B2 patent drawing
  • US11993922B2 patent drawing

AI summary

Provided is a system which can supply appropriate information to one operator from a viewpoint that the one operator grasps a remotely operational mode for a working machine by the other operator. In a first remote operation apparatus 10, a passive mode detector 112 detects a passive mode of a first operation mechanism 111, and transmits operational mode data corresponding to the passive mode. In a second remote operation apparatus 20, an operation of an actuator 212 is controlled in accordance with the passive mode of the first operation mechanism 111 in response to the operational mode data, and thereby, a second operation mechanism 211 actively operates.