Digital Twin Teleoperation for Low-Bandwidth Autonomous Driving
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing teleoperated driving systems face challenges with high bandwidth demands, data transmission delays, and security vulnerabilities due to the transmission of high-capacity real-time video information, which strain network resources.
Innovation Solution
Implementing a digital twin-based system that simulates the real-world environment and objects as virtual entities, allowing teleoperated control through message-type data of reduced capacity, enabling efficient teleoperated driving with reduced network load.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If real-time video information is transmitted from the vehicle to the control center, then the teleoperated driver can control the autonomous vehicle, but network bandwidth demands increase significantly
Solution Approach 1:
The patent creates a digital twin (virtual copy) of the autonomous vehicle and its surrounding environment. Instead of transmitting raw video data, the system transmits message data that represents the state of this digital twin, which can be visualized remotely. This copying approach maintains teleoperated control capability while dramatically reducing network bandwidth consumption from video-level data to structured message data.
Solution Approach 2:
The digital twin serves as an intermediary between the physical autonomous vehicle and the teleoperated driver. Rather than directly transmitting video feeds, the system uses the digital twin as a mediator that processes vehicle sensor data into a virtual representation, which is then transmitted to the control center. This intermediary layer reduces data transmission requirements while preserving control functionality.
2Loss of information
If high-resolution video data is transmitted in real-time, then the teleoperated driver has complete situational awareness, but data transmission delays increase
Solution Approach 1:
By transmitting message data that describes the digital twin's state rather than raw video frames, the system maintains complete situational awareness information in a compressed format. The digital twin continuously updates based on vehicle sensor data, ensuring the virtual representation remains synchronized with the physical vehicle without requiring continuous high-bandwidth video streaming.
Solution Approach 2:
The system changes the data representation from continuous video streams to discrete message data with specific parameters (position, velocity, sensor readings). This parameter-based representation maintains all necessary situational information while reducing data size and transmission time, directly addressing the delay problem.
3Ease of operation
If video transmission protocols are used for teleoperated control, then real-time visualization is achieved, but security vulnerabilities increase
Solution Approach 1:
The patent transitions from video transmission protocols to message data protocols for communicating vehicle state information. This parameter-based communication method maintains real-time visualization capability through the digital twin while improving security by using structured, authenticated data formats rather than vulnerable video stream protocols.
Data Source
AI summary
a method and an apparatus for teleoperated driving based on digital twin are disclosed. According to an aspect of the present disclosure, there is provided a computer-implemented method for teleoperated driving based on digital twin, comprising: receiving, from autonomous driving mobility, message data including information about the autonomous driving mobility and information about a surrounding object; generating, based on the message data, virtual mobility and a virtual object respectively corresponding to the autonomous driving mobility and the surrounding object on a virtual environment simulating an environment in which the autonomous driving mobility is driving; and transmitting an operation input of a teleoperated driver for the virtual mobility to the autonomous driving mobility.