3D Point Cloud Visualization for UGV Situational Awareness
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current robotic mapping systems for unmanned ground vehicles (UGVs) provide inadequate situational awareness to operators, especially in unknown environments, due to limitations in video stream visualization, such as inability to easily change perspective, zoom, or understand depth, which hampers military operations in urban areas.
Innovation Solution
A real-time and after-action mission review tool that displays camera, ladar, and navigation sensor data, allowing users to pan, tilt, and zoom through images from multiple cameras, with geo-referenced mapping and time-stamped data, enabling intuitive visualization and comparison of multiple data collections.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If video stream is used for visualization, then real-time viewing is enabled, but user cannot easily change perspective, zoom, or gain depth understanding
Solution Approach 1:
The system transitions from 2D video streams to 3D point cloud representations, adding depth dimension to the visualization. This allows operators to view environmental data from multiple angles and perspectives while maintaining depth perception, directly resolving the limitation of flat video imagery.
Solution Approach 2:
The system creates a digital copy of the physical environment through laser scanning, generating accurate 3D point cloud models. This digital replica can be manipulated freely for perspective changes and zoom operations without losing depth information, unlike the original video stream.
2Device complexity
If video stream is used for visualization, then simple implementation is achieved, but high bandwidth requirements are imposed
Solution Approach 1:
The system extracts only the essential geometric and spatial data from the environment using laser scanners, rather than transmitting complete video streams. This extraction of critical information reduces data bandwidth requirements while maintaining visualization effectiveness.
3Loss of information
If detailed environmental mapping is performed, then situational awareness is improved, but data processing complexity increases
Solution Approach 1:
The mapping system divides the environment into discrete point cloud data sets that can be processed and visualized independently. This segmentation allows detailed environmental capture while managing data processing complexity through modular handling of spatial information.
Data Source
AI summary
An after-action, mission review tool that displays camera and navigation sensor data allowing a user to pan, tilt, and zoom through the images from front and back cameras on an vehicle, while simultaneously viewing time/date information, along with any available navigation information such as the latitude and longitude of the vehicle at that time instance. Also displayed is a visual representation of the path the vehicle traversed; when the user clicks on the path, the image is automatically changed to the image corresponding to that position. If aerial images of the area are available, the path can be plotted on the geo-referenced image.