Vehicle Vision Augmentation System for Sensor Data Overlay
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Operators of machines, particularly in vehicles, face challenges in simultaneously monitoring the vehicle's operation and sensor data, leading to potential safety issues due to distractions and miscommunication, especially in autonomous or partially autonomous systems.
Innovation Solution
An augmentation system that supplements the operator's view with images representative of sensor data, using a receiver to convert data signals into display data and present them on a display, such as a heads-up display or video glasses, allowing the operator to see both the environment and sensor information, including trajectory, object locations, and collision predictions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If sensor data is displayed on traditional displays, then information availability is improved, but operator distraction increases
Solution Approach 1:
The patent projects sensor data overlays onto the windshield or dashboard surface, transforming the display from a traditional 2D screen to a spatially integrated 3D environment. This allows operators to view sensor information (e.g., object detection boxes, trajectory lines) in the same visual field as the actual environment, eliminating the need to shift attention between separate displays and maintaining situational awareness while accessing data.
2Measurement precision
If the operator focuses on monitoring sensor data, then data accuracy is improved, but machine operation capability deteriorates
Solution Approach 1:
The system merges sensor data visualizations with the operator's direct view of the environment by projecting overlays onto the windshield or dashboard. This integration allows simultaneous monitoring of sensor information (such as detected objects, trajectories, and safety zones) and operation of the machine without requiring the operator to switch attention between separate displays, thereby maintaining both monitoring accuracy and operational capability.
3Loss of information
If comprehensive sensor information is provided, then situational awareness is improved, but information overload increases
Solution Approach 1:
The system applies local quality by selectively displaying different types of sensor information in specific spatial locations on the windshield or dashboard. For example, detected objects are shown with bounding boxes near their actual positions in the environment, trajectories are displayed along the vehicle's path, and warning indicators are positioned in peripheral vision areas. This spatial organization allows comprehensive information delivery while maintaining visual clarity and preventing overload.
Data Source
AI summary
An augmentation system may supplement a person's view from at least one of an actual vehicle or a virtual vehicle of an environment through which the vehicle travels. The system may include a receiver configured to receive data signals representative of operation of the vehicle and representative of objects in the environment through which the vehicle travels. The system may also include a converter in communication with the receiver. The converter may be configured to convert the data signals into display data representative of the operation of the vehicle and representative of the objects in the environment through which the vehicle travels. The converter may also be configured to communicate the display data to a display in communication with the converter and configured to display, within the person's view from the vehicle, images representative of the display data to supplement the person's view.