Virtual Window Motion Compensation for Clear Vehicle Scene Viewing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current see-thru display systems, such as head-up displays in vehicles, do not effectively provide a window-like view of the external environment when a clear view is desired, especially for navigation and obstacle avoidance.
Innovation Solution
A virtual window system that includes a display device and a controller, which receives images from an imaging system, predicts the vehicle's location at a future time, translates the image to account for position and angle changes, and displays the estimated view on the device, using factors like scenery angle change, scaling, and sliding factors to ensure a realistic external view.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If see-thru display systems are used to allow viewing of the external environment, then navigation and obstacle avoidance are improved, but the system does not provide an effective window-like view when a clear view is desired
Solution Approach 1:
The patent creates a virtual window by capturing images with imaging sensors and displaying them on display panels, effectively copying the external visual scene. This allows the system to provide a window-like view quality while maintaining the see-thru display's viewing capability, resolving the contradiction between ease of operation and view quality reliability
Solution Approach 2:
The patent introduces a controller as an intermediary that processes imaging sensor data and coordinates display panel output. This intermediary system enables the transition from raw sensor data to a polished virtual window display, maintaining both the operational simplicity of see-thru displays and the reliability of clear view quality
2Productivity
If images are captured and displayed in real-time for navigation, then situational awareness is improved, but image accuracy deteriorates due to vehicle motion between capture and display times
Solution Approach 1:
The patent applies preliminary action by predicting the vehicle's future position and pre-calculating the required image transformations before display. The controller receives imaging data, predicts vehicle motion, and pre-adjusts the image parameters (translation, rotation, scaling) to compensate for anticipated movement, ensuring image accuracy is maintained despite the time delay between capture and display
Solution Approach 2:
The patent implements feedback by continuously monitoring vehicle motion data and using it to dynamically adjust displayed images. The system receives feedback from motion sensors and imaging sensors, processes this information to determine actual vehicle movement, and applies corrective transformations to the displayed images in real-time, maintaining measurement precision while preserving navigation responsiveness
3Measurement precision
If image processing is performed to account for vehicle motion, then image accuracy is improved, but system complexity increases due to multiple processing factors
Solution Approach 1:
The patent merges multiple image processing operations (translation, rotation, scaling) into a unified transformation pipeline within the controller. By combining these separate processing factors into an integrated system that handles all corrections simultaneously, the patent reduces device complexity while maintaining high image accuracy through coordinated application of all necessary transformations
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A virtual window system for a vehicle is disclosed. The virtual window system includes a display device and a controller. The controller is configured to: receive an image of a scene in a field of view (FOV) of an imaging system of the vehicle at an image capture time; predict a vehicle location at a predicted image display time; translate the image to a predicted image having an estimated view of the scene from the vehicle at the predicted vehicle location based on a predicted render time, a predicted display time, an amount of predicted position change between vehicle position at the image capture time and predicted vehicle position at the predicted image display time; and cause the translated image to be displayed on the display device at the predicted image display time.