Head-Mountable Display Sound Direction Overlay
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users of head-mountable displays (HMDs) often have difficulty detecting external sounds, particularly when wearing immersive HMDs that obscure the real-world environment, leading to issues such as missed notifications or unacknowledged approaching vehicles.
Innovation Solution
The system generates visual image elements to indicate the direction of sound sources, using sound information analysis to detect the source's location and displaying these elements on the HMD, allowing users to visually identify external sounds even when they cannot hear them.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If immersive HMDs that obscure the real-world environment are used, then immersion and display quality are improved, but external sound detection capability deteriorates
Solution Approach 1:
The patent introduces an intermediary system consisting of external microphones and visual indicators that mediate between the user and external sounds. The microphones capture sounds from the environment, and the HMD displays visual indicators showing the direction and presence of these sounds, allowing users to detect external audio cues without removing the device or compromising immersion.
Solution Approach 2:
The patent replaces the natural acoustic detection mechanism (ears hearing sounds directly) with an electronic system. Microphones capture sound waves, convert them to electrical signals, process them to determine direction, and display visual representations. This substitution allows sound detection to function independently of the user's direct line of sight or acoustic exposure.
2Reliability
If headphones are provided for sound output, then immersion and audio quality are improved, but awareness of external sounds deteriorates
Solution Approach 1:
The patent implements a feedback mechanism where external sounds captured by microphones are processed and presented back to the user in visual form through the HMD display. This feedback loop allows users to maintain headphone usage for immersive audio while simultaneously receiving information about external sounds through visual indicators that show sound direction and presence.
Solution Approach 2:
The patent transforms auditory information into visual information, changing the dimension in which sound data is presented. Instead of delivering external sound information through the auditory channel (which would compete with headphone audio), the system converts it to visual indicators displayed on the HMD, utilizing a different sensory dimension that does not conflict with headphone usage.
3Measurement precision
If display devices are positioned directly in front of the user's eyes, then display clarity and focus are improved, but peripheral awareness and external sound detection deteriorate
Solution Approach 1:
The patent segments the information presentation function between the display devices (for visual content) and the visual sound indicators (for spatial audio information). The display devices maintain their primary function of providing clear visual output directly in front of the user's eyes, while separate visual indicators are overlaid or positioned to indicate sound directions, dividing the information delivery task between different display elements.
Data Source
AI summary
An image processing system for generating an image for display to a user at a head-mountable display device includes: a sound input unit configured to receive sound information relating to one or more sounds, an audio processing unit configured to analyse the sound information relating to the one or more sounds, an image generation unit configured to generate one or more image elements that indicate properties of analysed sound information, and an image output unit configured to output display images for display to a user of a head-mountable display device, the images comprising the generated image elements as an image overlay, where the one or more generated image elements are indicative of the direction of the source of the one or more sounds.