Remote Support Image Alignment for Moving Vehicle Recognition Delays
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems for remotely monitoring vehicles face inaccuracies in synthetic images due to delays in processing camera images and object recognition, leading to significant deviations in the position and size of moving objects, especially when the movement amount of these objects is substantial during the delay time.
Innovation Solution
A remote support system that performs projection transformation on partial images of moving bodies to adjust their position and size based on predicted movement, using a monotonic non-decreasing object movement adjustment time to generate a synthetic image that reflects the objects' actual positions and sizes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If camera images and object recognition results are separately transmitted and processed with a delay, then the system can process data sequentially with simpler architecture, but the position and size of moving bodies in synthetic images greatly deviate from actual position and size
Solution Approach 1:
The system performs preliminary actions by predicting the movement amount of moving bodies based on their speed and direction before generating the synthetic image. This prediction is used to compensate for the delay time, allowing the system to adjust the position and size of moving bodies in advance, thereby resolving the contradiction between simple sequential processing architecture and high measurement precision for moving objects
Solution Approach 2:
The system introduces an intermediary processing step that calculates movement amount, speed, and direction of moving bodies as intermediate data. This intermediary information serves as a bridge between the delayed object recognition results and the current camera image, enabling accurate positioning and sizing of moving bodies in the synthetic image without requiring complex real-time processing architecture
2Reliability
If the delay time for processing object recognition is increased, then more computation can be completed for accurate recognition, but the movement amount of moving bodies during delay increases causing larger deviations in synthetic images
Solution Approach 1:
The system implements feedback by continuously monitoring the speed and direction of moving bodies and using this information to predict their movement during the delay period. This feedback loop allows the system to maintain reliable object recognition accuracy while compensating for position and size deviations caused by the necessary processing delay time
Solution Approach 2:
The system performs preliminary calculation of movement amount based on detected speed and direction before the delay period ends. This preliminary action enables the system to prepare the necessary compensation data in advance, ensuring both accurate object recognition and minimal position/size deviation in the final synthetic image
Data Source
AI summary
When an object to be noted in an image IMG1 is a moving body, projection transformation of a partial image OBJ1 of the moving body included in the image IMG1 used for a recognition of the moving body is performed. According to the projection transformation of the partial image OBJ1, a partial image OBJ2 obtained at a camera viewpoint ahead of an acquisition timing T1 of the image IMG1 including the partial image OBJ1 by an object movement adjustment time a is generated. A synthetic image SIMG1 is generated based on the partial image OBJ2, the image IMG1 in which the partial image OBJ1 is included and recognition information OR of the moving body in the image IMG1, and is output from a display device.