Remote Vehicle Support Image Alignment for Transmission Delay
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing remote vehicle monitoring systems suffer from inaccuracies due to delays in data transmission, causing deviations between the actual surrounding environment and the synthetic image displayed, especially when the vehicle moves significantly during the delay time.
Innovation Solution
A system that predicts the movement of the vehicle and adjusts the image using projection transformation to align the synthetic image with the actual environment by encoding image data and object recognition information, ensuring the image is adjusted to a future viewpoint based on movement thresholds.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If image data and object recognition results are transmitted separately from the vehicle to the remote server, then communication efficiency is improved, but the timing delay between image acquisition and processing increases
Solution Approach 1:
The system performs preliminary actions by predicting the vehicle's movement amount during the delay period and pre-calculating the required image adjustment parameters. This allows the system to compensate for the timing delay by proactively adjusting the image based on predicted movement, rather than waiting for the actual delay to occur.
2Area of stationary object
If the vehicle moves significantly during the image delay time, then the remote monitoring system can cover larger areas, but the accuracy of the synthetic image relative to the actual surrounding environment decreases
Solution Approach 1:
The system dynamically changes image parameters (position, size, orientation) based on the predicted vehicle movement amount. By adjusting these parameters according to the movement prediction, the system maintains image accuracy even when the vehicle moves significantly during the delay period, thus preserving measurement precision while allowing for larger monitoring coverage.
3Measurement precision
If image adjustment processing is performed to compensate for vehicle movement, then image accuracy is maintained, but the processing complexity increases
Solution Approach 1:
The system replaces complex mechanical image adjustment mechanisms with computational image processing. Instead of physically adjusting the camera or image display, the system uses software-based projection transformation and image rendering to achieve the same effect, thereby maintaining image accuracy while reducing mechanical complexity.
Data Source
AI summary
A movement amount of a mobile vehicle at an image delay time indicating a timing difference D1 between a timing T1 at which an image IMG1 is acquired by a camera CAM and a timing T3 at which a remote operator terminal 200 decodes the image IMG1 is predicted. Then, when a predicted movement amount Lv of the mobile vehicle exceeds a movement threshold THLv, the image IMG1 is projection-transformed to a future image IMG2 obtained at a camera viewpoint at a timing T2 ahead of the timing T1 by a mobile vehicle adjustment time α based on information regarding a movement of the mobile vehicle, and a synthetic image SIMG1 output from the display device 220 is generated.