Eye-Tracking Robot Remote Control for Low-Stress Teleoperation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing robot control systems require complex operations, leading to operator stress and difficulty in controlling avatar robots effectively.
Innovation Solution
A robot remote control system utilizing a human-machine interface with an eye tracker and processor to determine target positions based on an operator's sightline and operation intention, allowing for simple control commands through a wearable display.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If traditional mouse or VR controller is used to control avatar robot, then robot can be controlled to move to instructed position, but operator feels stressed and operation becomes complex
Solution Approach 1:
The patent replaces mechanical control interfaces (mouse, VR controller with buttons and levers) with an eye-tracking based control system. The eye tracker detects the operator's gaze direction and the processor determines operation intentions based on gaze patterns, substituting mechanical input devices with optical detection and algorithmic interpretation.
Solution Approach 2:
The system allows the operator to control the robot simply by looking at the desired direction without manual manipulation. The eye tracker automatically detects gaze direction and the processor automatically determines movement commands, making the operator's natural visual attention the control input mechanism.
2Measurement precision
If many buttons or levers are provided for robot control, then robot can be precisely controlled, but operator feels more stressed
Solution Approach 1:
The patent replaces multiple mechanical control elements (buttons, levers) with an eye-tracking based control system. The eye tracker detects precise gaze direction and the processor interprets gaze patterns to determine operation intentions, achieving precise control without requiring multiple physical controls.
Solution Approach 2:
The system changes the control parameter from manual button/lever positions to eye gaze direction and movement patterns. By monitoring changes in gaze parameters over time, the system determines the operator's intended operations with high precision.
3Extent of automation
If avatar robot is made to autonomously understand outside situation and move to instructed position, then robot can avoid obstacles, but operator still feels troubled in operating mouse or VR controller
Solution Approach 1:
The patent replaces the complex mechanical control interface (mouse or VR controller) with an eye-tracking based system. The autonomous navigation capability is maintained while the control method is fundamentally changed from manual manipulation to gaze-based intention recognition.
Solution Approach 2:
The eye tracker and processor act as intermediaries between the operator and the robot control system. Instead of directly manipulating mechanical controls, the operator's gaze is captured by the eye tracker and translated by the processor into robot commands, simplifying the interaction.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
The robot remote control system includes a control device controlling a robot and an HMI used by an operator when remotely controlling the robot. The HMI displays a video of surroundings of the robot on a display, detects a sightline or the like of the operator using an eye tracker, estimates an operation intention of the operator, and transmits sightline data indicating the detected sightline or the like and operation data indicating the estimated operation intention of the operator to the control device. The control device determines a target position of the robot on the basis of the sightline data and the operation data received from the HMI and moves the robot to the target position.