Robot Image Display With Latency-Compensated View Overlay
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Remote control of mobile robots is hindered by time delays in image transmission from the robot to the user's electronic device, making real-time control challenging due to latency caused by communication network delays, protocol differences, and varying image processing speeds.
Innovation Solution
An electronic device calculates and displays the time delay between the robot and itself, using this information to adjust the display of images and control commands, allowing for smoother robot control by overlaying graphical objects on the screen to reflect the robot's current position and movement, even with latency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If real-time image transmission is implemented from mobile robot to electronic device, then remote monitoring capability is improved, but time delay occurs due to communication network latency and image processing time
Solution Approach 1:
The system performs preliminary actions by calculating the time delay between image capture and display before the user issues control commands. This advance calculation allows the system to compensate for latency by adjusting the timing of control signals, ensuring that commands are sent at the appropriate moment to achieve desired robot movements despite transmission delays.
Solution Approach 2:
The system implements feedback by continuously monitoring and calculating the time delay between image capture at the robot and display at the electronic device. This feedback mechanism allows the system to dynamically adjust control signal timing based on actual transmission conditions, improving remote control accuracy despite network latency and processing variations.
2Speed
If image processing speed is increased to reduce delay, then responsiveness is improved, but device complexity increases due to additional processing requirements
Solution Approach 1:
The system introduces a time delay calculation mechanism as an intermediary between image capture and display processes. Rather than increasing processing speed, this intermediary component measures and compensates for delays by adjusting control signal timing, achieving responsiveness improvement without adding complex processing hardware or algorithms.
3Ease of operation
If control signals are sent immediately based on displayed images, then control responsiveness appears improved, but actual robot control accuracy deteriorates due to unaccounted time delay
Solution Approach 1:
The system performs preliminary calculation of time delay before sending control signals. By knowing the delay in advance, the system can time control signal transmission appropriately, maintaining both operational ease and control accuracy. The user interacts with the interface as usual, while the system compensates for latency in the background.
Solution Approach 2:
The system uses feedback from time delay measurements to adjust control signal timing. This feedback loop ensures that control accuracy is maintained despite transmission delays, while the user experiences responsive control through the interface. The feedback mechanism dynamically adapts to varying network conditions and processing speeds.
Data Source
Figure 1~2
Figure 3~5
Figure 6~7
AI summary
An electronic device and a method for displaying an image transmitted by a robot and remotely controlling a movement of the robot are provided. The electronic device includes a communicator, an inputter, a display, and a controller. The communicator receives, from the robot, an image photographed by the robot and time information. The inputter receives a command to control the robot. The display displays a screen corresponding to the image. The controller calculates a time delay between the electronic device and the robot based on the time information, control the display to display a graphical object to be overlaid on the screen, and control the communicator to transmit the command to the robot. The graphical object represents a field of view of the robot at a current time. The field of view of the robot at the current time may be estimated based on the time delay information.