Multi-Sensory Mixed Reality Interface for Cognitive Load Management
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional VR and AR technologies often distract users from the real world due to intermodal distance between real and virtual presentations, leading to sensory or cognitive overload, especially in high-stress contexts where attention is divided between real-world tasks and digital information.
Innovation Solution
A system that automatically selects combinations of human interface devices to present imperceptible data via different senses, such as visual, auditory, thermal, and tactile stimuli, based on environmental and physiological factors to optimize situational awareness and information absorption.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If digital information is overlaid over the real world using conventional AR devices, then information availability increases, but sensory and cognitive overload occurs
Solution Approach 1:
The patent segments information presentation across multiple sensory modalities (visual, auditory, tactile, thermal) rather than overloading a single sense. Different types of digital information are distributed to different senses based on their nature and urgency, preventing any one sensory channel from becoming overwhelmed while maintaining high information availability.
Solution Approach 2:
The patent transitions from two-dimensional visual display (AR overlays) to multi-dimensional sensory presentation by incorporating auditory, tactile, and thermal dimensions. This allows information to be conveyed through multiple independent channels simultaneously, increasing overall information capacity without overloading any single sensory modality.
2Reliability
If visual sense is dedicated to a high-priority task, then task performance improves, but ability to receive digital information decreases
Solution Approach 1:
The patent introduces intermediary sensory modalities (auditory, tactile, thermal) that mediate the delivery of digital information when the primary visual sense is occupied. These intermediary channels act as alternative pathways, allowing information to reach the user without interfering with visual task performance while maintaining information reception capability.
Solution Approach 2:
The patent dynamically changes the sensory parameters of information presentation by switching between different modalities based on task demands. When visual attention is required for a high-priority task, the system transitions information delivery to auditory or tactile parameters, thereby maintaining both task performance and information reception.
3Loss of information
If virtual world presentation is too conceptually close to the real world, then information absorption increases, but real world occlusion occurs
Solution Approach 1:
The patent segments the virtual information presentation across multiple sensory modalities rather than concentrating it in visual displays that occlude the real world. By distributing information to auditory, tactile, and thermal senses, the system maintains high information absorption rates while leaving the visual channel clear for observing the real environment.
Solution Approach 2:
The patent replaces the mechanical/visual display system (AR overlays that block vision) with alternative sensory systems (auditory speakers, tactile actuators, thermal elements). This substitution eliminates real-world occlusion while maintaining effective information absorption through non-visual modalities.
Data Source
AI summary
Decision making speed of a human is improved by presenting data to the human in ways that enable the human to receive the data at higher rates, and spend more time analyzing received data. The data may represent information, such as infrared imagery or map data, that is not directly perceivable by the human. An individual datum may be presented to the human via multiple senses, to make receiving the datum easier, and to make it more likely that the datum is received, especially in contexts where the human may be busy, stressed, cognitively loaded or distracted by other demands on the human's attention. Some embodiments automatically select which sense or combination of senses to use for presenting each datum, based on various factors, such as how the human's current environment may interfere with the human's ability to receive or process the datum or how busy a given sense is.