3D Audio Space Translation for UI Sound Localization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users of multiple computer programs face challenges in identifying the source of alert sounds due to overlapping and indistinguishable notifications, especially when using accessibility features like screen readers, which fail to provide clear feedback on ongoing tasks and application statuses.
Innovation Solution
Translating user interface sounds into a three-dimensional audio space using a surround sound system, where each application or event is assigned a specific position, allowing sounds to be localized and prioritized, enhancing user feedback and differentiation between applications.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If multiple programs use common sounds for status and information messages, then the information can be conveyed to the user, but the user cannot distinguish which program made the sound
Solution Approach 1:
The patent applies spatial dimensionality to audio output by mapping different applications and windows to specific positions in a 3D audio space. Instead of all sounds coming from a single speaker, the system distributes sounds across multiple speakers in a surround sound configuration, creating a spatial map where each application has its own auditory location. This allows users to identify which program is generating notifications based on the direction and position of the sound.
Solution Approach 2:
The patent segments the audio output by application and window, dividing the monolithic sound output into distinct spatial channels. Each application window is assigned a specific position in the 3D audio space, and sounds from different applications are routed to different spatial locations. This segmentation enables users to distinguish between multiple programs even when they use the same sound files, as each program's sounds originate from a different spatial position.
2Loss of information
If screen readers are used to provide accessibility information, then users can perceive on-screen content, but the detail and clarity needed to build understanding of overall screen status is insufficient
Solution Approach 1:
The patent enhances screen reader output by incorporating spatial positioning information. Instead of merely announcing window titles and messages in sequence, the screen reader provides directional cues about where each application is located in the visual interface. Sounds from different applications are positioned in corresponding spatial locations, creating a unified audio-visual map that helps users build a comprehensive understanding of the overall screen status and application hierarchy.
Solution Approach 2:
The system implements feedback by providing continuous spatial audio information that reflects the current state of the graphical interface. As users navigate between windows and applications, the audio positions dynamically update to match the visual arrangement, giving users real-time feedback about which application is currently active, which are in the background, and how they are spatially organized on the screen.
3Productivity
If users switch between multiple tasks and programs to organize and monitor them, then task management is possible, but the time required to gauge what is going on increases
Solution Approach 1:
The patent creates an auditory representation of the graphical interface's spatial layout, allowing users to monitor multiple tasks simultaneously without switching between them. By mapping application positions in the visual interface to corresponding positions in the 3D audio space, users can perceive the state of multiple programs at once through spatial audio cues, eliminating the need to sequentially tab through each application to check its status.
Solution Approach 2:
The system merges visual and auditory information channels to create a unified task monitoring experience. The spatial positioning of sounds corresponds to the spatial arrangement of windows on the screen, allowing users to perceive both visual and auditory information from multiple applications simultaneously. This merging enables users to monitor task status across multiple programs without the time-consuming process of switching between them.
Data Source
AI summary
Translating user interface sounds into 3D audio comprises: receiving an audio request call from a process relating to a user interface event; converting the audio request call into a position in 3D audio space representative of the process from which the call has been received; and playing a corresponding sound in a surround sound system in the position in 3D audio space. Each open application in a graphical user interface may be provided with a sound space, in the 3D audio space, from which any event sounds are played.