Remote Driving Video Prediction to Suppress Display Flickering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing remote driving systems experience display flickering due to frequent switching between different communication delay time boundaries, leading to operator fatigue.
Innovation Solution
A method and device that generate future frames by performing alteration processing using prediction information, and display these frames at a set time after their reference time, thereby compensating for communication delay and reducing display flickering.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the display mode is switched frequently to compensate for communication delay, then the compensation accuracy is improved, but the display stability deteriorates causing flickering
Solution Approach 1:
The system generates future frames in advance using prediction information before the actual display time arrives. By pre-processing the video frames with prediction algorithms that anticipate future states based on past and present motion patterns, the system prepares compensated content ahead of time, avoiding last-minute switching and resulting flicker
Solution Approach 2:
The system creates predicted future frames as copies of current frames, modified using prediction information about future vehicle states. These predicted copies are then displayed instead of raw current frames, providing compensation for communication delay without requiring real-time switching of display modes
2Manufacturing precision
If the communication delay compensation is applied, then the video accuracy is improved, but the processing complexity increases
Solution Approach 1:
The video processing system performs self-service by using its own historical frame data and motion information to generate prediction information. The system leverages its existing video stream and embedded sensors to autonomously create future frame predictions without requiring external complex processing infrastructure
Solution Approach 2:
The system applies parameter changes to existing frames by modifying pixel data according to prediction information about future vehicle states. Instead of complex re-rendering, the system adjusts frame parameters such as position, orientation, and content based on predicted motion, achieving accurate compensation through relatively simple parameter transformations
Data Source
AI summary
Video information including a plurality of frames acquired by a camera of a mobile body and reference times of the frames is received from the mobile body. A plurality of future frames is generated from each of the plurality of frames by performing alteration processing using prediction information of a set time destination from each reference time of the plurality of frames. The display control of the camera video including the plurality of future frames is performed so that the plurality of future frames is displayed on the display of the terminal operated by the operator at the time when the set time has elapsed from each reference time of the plurality of frames.