Gaze-Based Multi-Robot Remote Control on a Single Screen
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing unmanned robot remote control systems primarily allow control of a single robot using a single operating device, with a growing need for collective control of multiple robots and vehicles.
Innovation Solution
A remote control device with a display that receives and displays driving and monitoring images from multiple robots, a sensor to track user gaze, and a controller that provides control rights based on gaze input, enabling collective control of multiple robots by selecting additional robots based on user gaze and input via interfaces.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If a single operating device is used to control multiple mobile robots, then the operator can perform collective control of multiple robots simultaneously, but the complexity of the control system increases
Solution Approach 1:
The control system segments the control of multiple robots by designating one robot as a master and others as slaves. The master robot's control interface is divided into multiple image regions, each corresponding to a different slave robot. This segmentation allows the operator to control multiple robots through a single unified interface without overwhelming complexity.
Solution Approach 2:
The operating device is designed with multi-functionality to handle both single-robot and multi-robot control scenarios. The display device can show images from multiple robots simultaneously, and the control signals generated can be distributed to different robots based on their master-slave relationships, making the device universal for various control configurations.
2Ease of operation
If the operator must switch between multiple control screens to control different robots, then each robot can be controlled individually, but the operator cannot perform collective control efficiently
Solution Approach 1:
The control interfaces of multiple slave robots are merged into a single display screen, with each slave robot's image displayed as a separate region within the master robot's interface. This merging allows the operator to monitor and control multiple robots from one screen, improving ease of operation while maintaining collective control efficiency through the master-slave architecture.
3Ease of operation
If gaze tracking is used to select robots for control, then the interface becomes more intuitive, but the system requires additional sensors and processing
Solution Approach 1:
A gaze tracking sensor acts as an intermediary between the operator and the control system. The sensor detects the operator's eye movements and translates them into selection commands for different robot images on the display. This intermediary layer provides an intuitive selection mechanism while isolating the complexity of gaze processing from the core control logic.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables a single operator to simultaneously control multiple unmanned mobile objects using a single operating device by designating a master robot based on user gaze and allowing collective control of other robots, enhancing operational efficiency and flexibility.
Implementation Method 1
a sensor configured to track a gaze of a user
Data Source
AI summary
A remote control device includes: a display configured to receive a driving image and a monitoring image from each of N mobile robots, such that N driving images and M monitoring images are received, and to display the received N driving images and M monitoring images; a sensor configured to track a gaze of a user; and a controller configured to provide a control right to the user for a first robot of the N mobile robots as a master mobile robot based on the gaze of the user being tracked by the sensor as staying on the driving image or the monitoring image of the first robot displayed on the display.