Haptic Feedback Interface for 3D Environmental Mapping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional assistive technologies for visually impaired individuals are limited to Braille-based tactile systems, which are of limited functionality and do not effectively utilize the higher sensory resolution of the sense of touch to help users navigate three-dimensional real-world areas, especially in environments with limited light.
Innovation Solution
An assistive device with a haptic feedback interface that uses a combination of sensors to gather data on the user's surroundings, determines relevant objects, and adjusts their size and position on the haptic interface based on proximity and mode selection, providing touch-discernible feedback to enhance navigation and understanding of the environment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If Braille-based tactile systems are used, then tactile feedback is provided, but functionality is limited and cannot effectively utilize higher sensory resolution of touch for navigating three-dimensional real-world areas
Solution Approach 1:
The haptic feedback interface is divided into multiple independently controllable haptic elements arranged in a spatial pattern that corresponds to a three-dimensional representation of the environment. Each haptic element can be independently actuated to provide localized tactile feedback corresponding to specific objects or features in the virtual model, enabling detailed navigation guidance without requiring Braille literacy.
Solution Approach 2:
A three-dimensional virtual model of the real-world environment is created using sensor data from cameras, LIDAR, and other sensors. This virtual copy is then projected onto the haptic feedback interface, allowing users to interact with a simplified tactile representation of their surroundings without needing to physically manipulate the actual environment or read Braille characters.
2Measurement precision
If multiple sensors are used to gather data on surroundings, then accuracy of object detection is improved, but device complexity and processing requirements increase
Solution Approach 1:
Multiple sensor types (cameras, LIDAR, depth sensors, microphones) are integrated into a unified system that fuses their data streams to create a comprehensive three-dimensional environmental model. The sensor fusion algorithm combines information from different modalities (visual, spatial, acoustic) to improve object detection accuracy while managing computational load through hierarchical processing.
Solution Approach 2:
The system performs preliminary processing of sensor data by filtering, segmenting, and pre-processing information before it is used to generate the final haptic feedback. Object detection and classification are performed in advance, and only relevant objects are mapped to haptic elements, reducing real-time computational requirements and managing system complexity.
3Loss of information
If all detected objects are displayed on haptic interface, then comprehensive environmental information is provided, but processing load and battery consumption increase
Solution Approach 1:
The haptic feedback interface provides differentiated levels of detail for different objects based on their relevance to the user's current task and position. Objects that are immediately relevant (e.g., obstacles in the direct path) receive detailed haptic representation, while less relevant objects receive simplified or no feedback. This selective rendering reduces processing load and energy consumption while maintaining essential environmental information.
Solution Approach 2:
The system performs partial object detection and representation by focusing computational resources on the most relevant objects within a defined radius around the user. Objects beyond this radius or those classified as less important are excluded from haptic feedback generation, reducing energy consumption while providing sufficient environmental awareness for safe navigation.
Data Source
AI summary
An assistive device and method for non-visually discerning a three dimensional (3D) real-world area surrounding a user, includes a haptic feedback interface. The assistive device receives input to establish a mapping of a plurality of objects within a proximity range to at least one haptic element of the plurality of haptic elements in a defined region of the haptic feedback interface. Further, the assistive device merges two or more nearby relevant objects in the plurality of objects as one object so as to map the one relevant object to a corresponding haptic element of the set of haptic elements in the touch-discernible feedback. Furthermore, the assistive device adjusts sizes of the plurality of objects to map the plurality of objects with a set of haptic elements of the plurality of haptic elements while merging the two or more nearby relevant objects.