Remote Robotic Avatar Control for Object-Based Teleoperation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current robotic systems lack the ability to dynamically control remote robotic avatars to functionally equivalent locations based on the movement of a local user, limiting their ability to interact with specific objects or areas in a teleoperative manner across different locations.

Innovation Solution

A method and system that uses sensors to detect a user approaching an object, transmitting instructions to a remote robotic avatar to identify and approach a similar object at a different location, enabling a teleoperative session, which includes a sensor receiver, instruction receiver, autonomous locomotion system, and teleoperative device for interacting with the object.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If traditional robotic systems are used for remote interaction, then basic teleoperation is possible, but the ability to dynamically control the robot to functionally equivalent locations based on user movement is limited

Engineering Contradiction:
Improveability to dynamically control remote robotic avatar to functionally equivalent locationsVSAvoidsystem complexity for dynamic control and object identification
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system creates a virtual copy of the user's environment and state in the remote location. Sensors at the user's location detect objects and user movement, then transmit this information to control a robotic avatar at the remote location, which replicates the user's actions and interactions in that environment. This copying approach enables dynamic control without requiring complex direct mapping hardware at the remote site.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

A communication system acts as an intermediary between the user and the remote robotic avatar. The system receives sensor data from the user's location, processes it to identify objects and determine user intent, then transmits appropriate control signals to the robotic avatar. This intermediary layer simplifies the overall system by centralizing the complexity of object recognition and movement translation.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If the system transmits detailed object information to control the robotic avatar, then accurate object identification is achieved, but transmission time and system response delay increase

Engineering Contradiction:
Improveobject identification accuracyVSAvoidtransmission time for object description and control signals
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system extracts only the essential information needed for robotic control from the complete sensor data set. Instead of transmitting all sensor readings and detailed object descriptions, the system identifies and transmits only the critical parameters such as object type, position, and relevant characteristics. This extraction approach maintains object identification accuracy while significantly reducing transmission time and data bandwidth requirements.

Inventive Principle:
Principle #2Taking out (Extraction)

3Speed

If the robotic avatar autonomously navigates to objects, then interaction speed is improved, but control precision and user intent accuracy may be reduced

Engineering Contradiction:
Improverobotic avatar movement speedVSAvoidcontrol precision for object interaction
Core Design Contradiction:
SpeedVSMeasurement precision

Solution Approach 1:

The control system dynamically adjusts the level of autonomy based on the interaction context. For navigation to objects, the system employs autonomous control to maximize speed. When approaching the target object and during interaction, the system transitions to more direct user-controlled modes to ensure precision. This dynamic adjustment of control modes allows the system to optimize both speed and precision at different phases of the interaction sequence.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS10901430B2Autonomous robotic avatars
Publication Date: 2021.01.26 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US10901430B2 patent drawing
  • US10901430B2 patent drawing
  • US10901430B2 patent drawing

AI summary

A method controls a remote robotic avatar based on a description of a physical object. A message transmitter transmits a message to a remote robotic avatar instructing the remote robotic avatar to identify a physical object at a remote second location, where an appearance of the physical object is described in the message. The message transmitter also transmits an instruction to the remote robotic avatar to approach the physical object at the remote second location and to initiate a teleoperative session between an entity in a first location and the remote robotic avatar at the remote second location.