Remote Cockpit Image Motion Sync for Delay-Induced Vertigo
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In remote driving systems, time delays in uploading vehicle environment video cause vertigo in cloud end drivers, severely affecting the driving experience and compromising safety.
Innovation Solution
A method for processing image display in remote cockpits that involves obtaining and processing vehicle state data and original images, and performing dynamic movements of the display image based on the vehicle's state and control module inputs, such as steering wheel and pedal positions, to synchronize visual feedback with control actions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If vehicle environment video is uploaded in real-time, then visual feedback is provided to the cloud end driver, but time delay occurs in the upload process causing vertigo
Solution Approach 1:
The patent applies preliminary action by pre-processing the video feed to extract key visual elements and vehicle state information before transmission. The system prepares simplified visual representations in advance, allowing the display to be updated immediately when control actions occur, rather than waiting for complete video frames to be uploaded and processed.
2Loss of information
If the display image is updated with complete video frames, then accurate visual information is provided, but time delay causes vertigo in cloud end drivers
Solution Approach 1:
The patent extracts essential visual elements from complete video frames and displays only the most relevant portions. By taking out key visual information (such as the central field of view and critical vehicle surroundings) and displaying it separately from the full video feed, the system provides accurate visual feedback without the time delay penalties of processing complete frames.
Solution Approach 2:
The patent applies local quality by providing different visual information quality levels in different display regions. The central or primary display area shows high-quality, immediately updated visual information corresponding to the driver's control actions, while other areas may show delayed or summarized video information. This ensures the most critical visual feedback is delay-free.
3Ease of operation
If the display image moves synchronously with control actions, then visual feedback is immediate, but system complexity increases
Solution Approach 1:
The patent applies dynamics by making the display content adaptive and responsive to control actions in real-time. The displayed visual information dynamically adjusts its position, scale, or content based on the current vehicle state and control inputs, creating a synchronized experience without requiring complex full-video processing. The system dynamically selects and positions visual elements based on current operational context.
Data Source
Figure 1~2
Figure 3
Figure 4
AI summary
The present disclosure relates to a method for processing image display of a remote cockpit, an apparatus for processing image display of a remote cockpit, a cockpit, and a system. The method includes: obtaining a vehicle state and an original image uploaded by a vehicle, processing the original image, and displaying the processed original image as a display image in a display of the cockpit; and performing different movement processings on the display image in the display based on the vehicle state and monitored different states of a vehicle control module in the cockpit. The solution provided by the present disclosure can reduce or eliminate vertigo of a cloud end driver, enhance cloud end driving experience, and improve safety performance of remote driving of a vehicle.