AR Navigation Labels Sensor Fusion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional navigational systems for mobile structures, such as watercraft and aircraft, operate independently without integrating data from disparate sensors like radar, sonar, and GNSS, leading to a fragmented representation of the environment, which hinders intuitive navigation.
Innovation Solution
A sensor fusion system that combines data from multiple navigational sensors, including sonar, radar, and GNSS, to provide an integrated model of the environment, enhancing data interpretation and navigation by rendering a unified, intuitive display of navigational data on an augmented reality interface.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If multiple navigational sensors (radar, sonar, GNSS) operate independently with separate displays, then each sensor system can be optimized for its specific function, but the overall navigation system becomes complex and provides a fragmented environmental representation
Solution Approach 1:
The patent combines data from multiple independent navigational sensors (radar, sonar, GNSS) into a single integrated display interface. The system fuses sensor data to create a unified environmental model that shows terrain features, water depth, and navigation position together, replacing multiple separate displays with one cohesive visualization that reduces system complexity while maintaining navigation accuracy
Solution Approach 2:
The integrated display system serves multiple functions simultaneously: it displays radar terrain data, sonar water depth information, and GNSS position data within a single interface. This multi-functional approach allows the system to provide comprehensive navigational awareness without requiring separate dedicated displays for each sensor type, thereby reducing overall system complexity
2Ease of operation
If separate display views are used for each navigational sensor, then data processing for each sensor can be optimized independently, but the user cannot intuitively understand the mobile structure's position and orientation in the environment
Solution Approach 1:
The system merges environmental context information from multiple sensors into a single integrated display that shows terrain features, water depth contours, and navigation position together. This unified visualization allows users to intuitively understand the mobile structure's position and orientation by seeing all environmental elements in one coherent view rather than scattered across separate displays
Solution Approach 2:
The integrated display acts as an intermediary that synthesizes data from radar, sonar, and GNSS sensors into a unified environmental model. This mediator presentation layer translates raw sensor data into an intuitive visual representation that helps users comprehend their position and orientation in the environment without being overwhelmed by separate data streams
Data Source
AI summary
Techniques are disclosed for systems and methods for labeling objects displayed by an augmented reality display system used to assist in the operation of mobile structures. Such an augmented reality display system includes a logic device configured to communicate with navigational sensors and imaging modules coupled to a mobile structure, where the navigational sensors are configured to provide navigational data associated with the mobile structure and the imaging module is configured to image a scene from a position on the mobile structure. The logic device is configured to detect an object in the scene, determine a heading reliability associated with the detected object based, at least in part, on the navigational data, and render an integrated model of the scene on a display, where the integrated model is configured to indicate the determined heading reliability associated with the detected object.