Digital Twin Teleoperation for Low-Bandwidth Remote Vehicle Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current teleoperation systems face significant challenges in maintaining situational awareness and control efficiency due to high data bandwidth requirements, particularly when operating vehicles at high speeds over public internet or cellular networks, as they rely on sending multiple high-definition image streams to remote operators.
Innovation Solution
Implementing a digital twin system that represents the environment with static objects mapped once and dynamic objects updated periodically, allowing remote operators to control teleoperated objects based on a digital representation rather than continuous image feeds, using independent information channels and object description models for accurate positioning and motion modeling.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If multiple high-definition image streams are sent to remote operators to maintain situational awareness, then the quality of teleoperation control is improved, but the data bandwidth requirement increases significantly
Solution Approach 1:
The patent creates a digital twin (a virtual copy) of the physical environment and teleoperated objects. Instead of transmitting raw image streams, the system maintains a synchronized digital representation that is updated with essential state information. This copy allows remote operators to interact with the virtual environment, reducing the need for continuous high-bandwidth image transmission while preserving situational awareness.
Solution Approach 2:
The system extracts only the essential state information and critical changes from the physical environment, rather than transmitting complete image streams. By separating and transmitting only the necessary data elements (object positions, velocities, environmental changes) to update the digital twin, the system maintains control quality while dramatically reducing bandwidth consumption.
2Ease of operation
If image streams are transmitted over public internet and cellular networks for high-speed teleoperation, then remote control capability is enabled, but network bandwidth constraints and latency are worsened
Solution Approach 1:
The digital twin serves as a virtual copy that can be transmitted over networks with much lower bandwidth requirements compared to real-time image streams. The simplified data structure of the digital twin (containing essential state parameters rather than pixel data) enables reliable transmission over public internet and cellular networks, making high-speed teleoperation feasible in constrained network environments.
Solution Approach 2:
The system changes the representation parameters from high-resolution image data to compressed state parameters (positions, velocities, orientations). This parameter transformation reduces the data volume by orders of magnitude, enabling teleoperation over networks that would be insufficient for traditional image-based approaches.
3Quantity of substance
If a digital twin with static objects mapped once and dynamic objects updated periodically is used, then data bandwidth requirements are reduced, but the complexity of maintaining synchronized digital representation increases
Solution Approach 1:
The digital twin is segmented into static objects (mapped once) and dynamic objects (updated periodically). This segmentation allows the system to minimize update frequencies for stable elements while focusing computational resources on tracking moving objects. The segmented approach reduces overall synchronization complexity compared to continuously updating all environmental elements.
Solution Approach 2:
The system implements periodic updates for dynamic objects rather than continuous real-time tracking. By updating the digital twin at controlled intervals and only when significant changes occur, the system reduces the computational burden of synchronization while maintaining adequate fidelity for teleoperation control.
Data Source
Figure 1~2
Figure 3~5
AI summary
Disclosed is a computer-implemented digital-twin-system for teleoperation of an object, configured to: - obtain environment information comprising information about a TO-object, about one or more static objects and about one or more dynamic objects, wherein the information about the TO-object and of at least one of other objects is obtained from different information sources; - provide information about the TO-object and one or more of the dynamic objects related to one or more of the static objects to a teleoperator interface; - obtain control information for the TO-object from the teleoperator interface based on the provided information; - provide a control input to the TO-object based on the environment information and/or on the control information.