Eye-Tracking Robot Remote Control for Low-Stress Target Positioning
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing robot control systems require complex operations, leading to operator stress and discomfort, particularly when multiple buttons or levers are used, making it difficult to intuitively control an avatar robot.
Innovation Solution
A robot remote control system utilizing a human-machine interface with an eye tracker and estimator to detect an operator's sightline and operation intention, allowing for simple control of a robot's movement and rotation based on detected data, reducing stress through intuitive control methods.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If traditional control interfaces with multiple buttons and levers are used, then the robot can be controlled with precise commands, but the operator experiences high stress and discomfort
Solution Approach 1:
The patent replaces mechanical control interfaces (buttons, levers, joysticks) with an eye-tracking based control system. The eye tracker detects the operator's gaze direction and the estimator infers operation intentions, substituting physical mechanical interactions with optical detection and computational interpretation, thereby eliminating the need for operators to physically manipulate multiple controls
Solution Approach 2:
The system enables self-service control by automatically detecting the operator's attention focus through eye tracking and autonomously determining the intended robot operation. The estimator component automatically interprets gaze patterns and converts them into control commands without requiring the operator to manually select or configure control parameters
2Adaptability or versatility
If complex control interfaces with multiple buttons are provided, then comprehensive robot operations can be achieved, but the operation becomes difficult and time-consuming
Solution Approach 1:
The eye tracker and estimator combination serves as a universal control interface that can handle multiple robot operations (movement, rotation, stopping) through a single detection mechanism. Instead of requiring separate controls for each function, the system universally interprets various gaze patterns and temporal sequences to determine diverse operation intentions
3Measurement precision
If traditional mouse or VR controller is used for position selection, then accurate position selection is possible, but the learning curve is steep and operator skill is required
Solution Approach 1:
The system performs automatic position selection by detecting where the operator is looking rather than requiring manual cursor movement or pointer control. The eye tracker automatically identifies the gazed-at position on the display, and the estimator directly converts this into a robot target position, eliminating the need for operators to learn cursor control techniques
Data Source
AI summary
The robot remote control system includes a control device controlling a robot and an HMI used by an operator when remotely controlling the robot. The HMI displays a video of surroundings of the robot on a display, detects a sightline or the like of the operator using an eye tracker, estimates an operation intention of the operator, and transmits sightline data indicating the detected sightline or the like and operation data indicating the estimated operation intention of the operator to the control device. The control device determines a target position of the robot on the basis of the sightline data and the operation data received from the HMI and moves the robot to the target position.