Unified Remote Control Interface for Multi-Robot Task Allocation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional autonomous robots struggle with adapting to dynamically changing environments and interacting with users in unstructured settings, such as nursing care facilities, while remote operation systems require multiple skilled operators, leading to increased burden and reduced efficiency.

Innovation Solution

Decompose robot actions into micro-level tasks, allowing autonomous execution of some tasks and remote operation for others, utilizing skill-specialized modules and operators to efficiently manage multiple robots with specialized skills.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If one remote operator is assigned to one robot, then the robot can be operated remotely, but the burden on the remote operator increases and work efficiency decreases

Engineering Contradiction:
Improveremote operation capabilityVSAvoidwork efficiency
Core Design Contradiction:
Ease of operationVSProductivity

Solution Approach 1:

The patent enables one remote operator to control multiple robots simultaneously by designing a unified control interface that aggregates tasks from multiple robots. The operator wears a single head-mounted display and uses one controller to perform remote operations across different robots, making the operator multi-functional rather than dedicated to a single robot.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent merges the control interfaces of multiple robots into a single unified system. The head-mounted display combines video feeds and control elements from multiple robots, and the controller integrates operation inputs that can be distributed to different robots. This consolidation allows one operator to manage multiple robots through a single integrated interface rather than separate control stations.

Inventive Principle:
Principle #5Merging (Combining)

2Reliability

If multiple skilled operators are required for remote operation, then complex tasks can be performed, but the cost increases and availability decreases

Engineering Contradiction:
Improvetask execution reliabilityVSAvoidoperator system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent implements an autonomous task selection mechanism where robots independently determine which tasks require remote operation and automatically present these tasks to available operators. The system self-manages task distribution, operator assignment, and coordination without requiring complex human-to-human or human-to-system negotiation, thereby reducing operational complexity while maintaining reliability.

Inventive Principle:
Principle #25Self-service

3Productivity

If autonomous execution is implemented for some tasks, then work efficiency improves, but the ability to handle unstructured environments decreases

Engineering Contradiction:
Improvework efficiencyVSAvoidenvironmental adaptability
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The patent implements a dynamic task allocation system where the boundary between autonomous and remote-controlled tasks is not fixed but adapts based on environmental conditions, task complexity, and operator availability. Robots autonomously execute routine tasks in structured environments but can dynamically switch to remote control mode when encountering unstructured situations, creating a flexible hybrid operation system that optimizes both efficiency and adaptability.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentEP4679858A1Information processing device, remote operation control method, remote operation control system, and autonomous mobile body
Publication Date: 2026.01.14 SONY GROUP CORP
  • EP4679858A1 patent drawingFigure 1
  • EP4679858A1 patent drawingFigure 2
  • EP4679858A1 patent drawingFigure 3

AI summary

The present technology relates to an information processing apparatus, a remote operation control method, a remote operation control system, and an autonomous mobile body that enable efficient execution of remote operation of the autonomous mobile body. The information processing apparatus according to the present technology includes: a matching unit that performs matching of, among tasks obtained by decomposing an action of an autonomous mobile body, a non-autonomous task that is the task not autonomously performed by the autonomous mobile body with a remote operator who performs a remote operation of the non-autonomous task; and a remote control unit that controls the remote operation of the non-autonomous task by the remote operator. The present technology can be applied to, for example, a robot.