Sensor Fusion AR Eyewear for Vision Impaired Users
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality eyewear devices often provide a poor user experience due to limited field of view and inadequate user interaction methods, which can hinder effective use in environments requiring detailed information overlays.
Innovation Solution
A sensor fusion augmented reality eyewear device with a wide field of view, featuring a processor, sensor assembly, camera assembly, and user interface control, utilizing multiple IMU sensors, wide-angle cameras, and Open CV for 3D content display, along with audio and Bluetooth controls for hands-free operation, and adjustable brightness for indoor and outdoor use.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If conventional head-mounted augmented reality displays are used, then information overlay capability is provided, but field of view is limited
Solution Approach 1:
The device segments the optical system into multiple components: transparent display screen for information overlay, wide-angle camera assembly for capturing environment, and separate sensor assemblies for tracking. This segmentation allows each component to be optimized independently, achieving wide field of view without proportionally increasing overall device complexity
Solution Approach 2:
The transparent display screen serves multiple functions: displaying augmented reality information, providing user interface feedback, and maintaining visual transparency for environmental awareness. The camera assembly simultaneously captures images for AR overlay and environmental mapping, reducing the need for separate dedicated components
2Ease of operation
If conventional augmented reality eyewear is used, then basic AR functionality is achieved, but user interaction capability is inadequate
Solution Approach 1:
The system replaces mechanical interaction (buttons, switches, manual controls) with voice command recognition and gesture-based control through sensors. This substitution improves ease of operation for vision-impaired users while managing device complexity by using software-based solutions rather than adding numerous physical controls
Solution Approach 2:
Voice commands and sensor-based gestures serve as intermediaries between the user and the AR system. These intermediaries translate user intent into system actions without requiring direct manual manipulation of the device, enhancing accessibility while maintaining manageable device complexity
3Loss of information
If AR information overlay is provided, then information availability is improved, but user experience quality deteriorates
Solution Approach 1:
The system applies different information display strategies to different regions of the user's field of view. Critical information is positioned in peripheral areas for quick awareness, while detailed information is available on demand. The transparent display adjusts information density and positioning based on user gaze and context, maintaining high information availability while preventing overwhelming the user
Data Source
AI summary
An augmented reality eyewear device is configured to operate augmented reality applications and provides a wide-angle field view that can be utilized for low vision, vision impaired, and the blind. The software utilizes custom firmware to enable features such as greyscale viewing and the use of smart glasses in outdoors and indoors. The hardware is specifically designed to be entirely hands-free with no wires, thereby enabling easy use by the low vision community. Further, the augmented reality eyewear device is used for Glaucoma, Macular degeneration and other vision-impaired impairments.