AR Wearable Dual-Lens Display for Multimodal Decision Support
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Operators in safety-critical operations such as Arctic search and rescue and oil spill responses face challenges in effectively processing and displaying real-time, multimodal information to support rapid decision-making, as existing systems fail to efficiently integrate and present critical data from various sources.
Innovation Solution
An augmented reality (AR) system utilizing a wearable device with two lenses, where image-based data is displayed on one lens and text-based data on the other, allowing users to toggle between views and pages, and integrating data from multiple sources including sensors, communication networks, and UAVs, to enhance human cognitive processing and support real-time decision-making.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If multimodal information is displayed on a single display device, then all information is available to the user, but cognitive overload increases and decision-making efficiency decreases
Solution Approach 1:
The patent divides multimodal information into separate channels by displaying image-based data on one lens and text-based data on the other lens, allowing parallel processing of different information types without cognitive overload
2Loss of information
If multiple data sources are integrated into a single display channel, then comprehensive information is provided, but information processing complexity increases
Solution Approach 1:
The system segments data from multiple sources into distinct modalities (image-based and text-based), processing and displaying each modality through dedicated channels to reduce processing complexity
Solution Approach 2:
The patent adds a spatial dimension to information processing by utilizing binocular display, where the left and right lenses provide separate display channels, effectively transforming a single-dimensional display problem into a two-dimensional spatial solution
3Reliability
If real-time information from multiple sources is processed, then decision support quality improves, but system complexity and resource requirements increase
Solution Approach 1:
The computing platform segments information processing into separate pipelines for image-based data and text-based data, allowing parallel processing that maintains decision support quality while managing system complexity
Solution Approach 2:
The system performs preliminary processing and organization of data from multiple sources before display, preparing information in advance in the appropriate modality format to reduce real-time processing complexity
Data Source
AI summary
An augmented reality (AR) system and method that provides multimodal decision support for users engaged in safety critical missions. A system includes a wearable device having a first lens configured for a first eye of a user and a second lens configured for a second eye of the user; and a computing platform integrated into the wearable device that includes: a communication manager configured to receive and process communication feeds from a plurality of data sources; and a display manager configured to display image-based data on the first lens and text-based data on the second lens, wherein the image-based data includes a set of user-selectable views and the text-based data includes a set of user-selectable pages, and wherein only one of the image-based data or text-based data is displayable for the user at a time.