Remote Vehicle Support Imaging for Delay-Compensated View Alignment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In existing remote vehicle monitoring systems, there is a delay in data transmission that can cause the surrounding environment depicted in synthetic images to deviate from the actual environment, reducing accuracy due to vehicle movement during this delay.
Innovation Solution
A system that predicts vehicle movement during image delay times and applies projection transformation to adjust images, ensuring the synthetic image reflects the actual surroundings by generating images from a future viewpoint adjusted for predicted movement.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If image data and object data are separately transmitted from the mobile vehicle to the remote server, then communication efficiency is improved, but image processing delay increases causing deviation between synthetic image and actual surrounding environment
Solution Approach 1:
The system performs preliminary actions by predicting vehicle movement during transmission delay and pre-calculating the adjusted viewpoint position. The projection transformation parameters are prepared in advance based on predicted movement, so that when the image data arrives, the synthetic image can be immediately generated with corrected viewpoint alignment, eliminating the need for post-processing adjustments.
2Measurement precision
If projection transformation is applied to adjust images for predicted vehicle movement, then accuracy of synthetic image is improved, but device complexity increases
Solution Approach 1:
The system changes parameters by adjusting the viewpoint position and projection transformation parameters based on predicted vehicle movement. Instead of complex real-time 3D rendering, the solution modifies existing image parameters (viewpoint coordinates, projection matrix) to achieve accurate alignment between synthetic and actual surrounding environments, maintaining simplicity while improving precision.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A movement amount of a mobile vehicle at an image delay time indicating a timing difference D1 between a timing T1 at which an image IMG1 is acquired by a camera CAM and a timing T3 at which a remote operator terminal 200 decodes the image IMG1 is predicted. Then, when a predicted movement amount Lv of the mobile vehicle exceeds a movement threshold THLv, the image IMG1 is projection-transformed to a future image IMG2 obtained at a camera viewpoint at a timing T2 ahead of the timing T1 by a mobile vehicle adjustment time α based on information regarding a movement of the mobile vehicle, and a synthetic image SIMG1 output from the display device 220 is generated.