Augmented Audio API Inputs for Spatialized Playback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional portable electronic devices for augmented reality audio experiences fail to fully capitalize on the benefits of augmented audio, lacking immersive and interactive features that align with user environments and orientations.
Innovation Solution
A computing device with a processor and memory generates API inputs for an augmented audio environment, including narrative and interactive audio file selections, which are rendered based on user actuation and device orientation, creating an immersive audio experience by playing back spatialized audio files in response to location and orientation inputs.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If conventional portable electronic devices are used for augmented reality audio experiences, then basic audio playback is provided, but the system fails to capitalize on the various benefits that augmented audio can provide and lacks immersive and interactive features
Solution Approach 1:
The system divides the augmented audio functionality into separate modules: a computing device that generates API inputs, an audio device that renders the audio, and spatialized audio files that provide contextual information. This segmentation allows each component to specialize in specific tasks, enhancing augmented audio capabilities without requiring all features to be integrated into a single complex device.
Solution Approach 2:
The audio device serves multiple functions: it plays back narrative audio files, interactive audio files, and spatialized audio files; it detects user orientation and location; and it renders augmented audio experiences based on API inputs. This multi-functionality allows the system to provide comprehensive augmented audio capabilities while using a unified device platform.
2Reliability
If spatialized audio files are rendered based on user orientation and location, then an immersive and interactive augmented audio environment is created, but the processing and rendering requirements increase
Solution Approach 1:
The system pre-processes audio files into spatialized formats with embedded metadata about orientation and location. The computing device generates API inputs in advance that contain structured information about narrative audio files, interactive audio files, and spatialized audio files. This preliminary preparation reduces the real-time processing burden on the audio device during actual playback.
Solution Approach 2:
The API acts as an intermediary layer between the computing device and the audio device. The computing device generates structured API inputs that contain all necessary information for rendering augmented audio experiences. This intermediary structure allows complex spatialized audio processing to be described through standardized interfaces, reducing the computational burden on the audio rendering device.
3Ease of operation
If the system provides both narrative audio file playback and interactive audio file playback with user actuation detection, then user interaction capability is enhanced, but the system complexity increases
Solution Approach 1:
The system combines narrative audio playback and interactive audio playback into a unified augmented audio experience. Both audio file types are rendered by the same audio device using the same API input structure. User actuation detection is integrated with the existing orientation and location detection capabilities, merging multiple interaction modalities into a single coherent control system.
Data Source
AI summary
Various implementations include computing devices and related computer-implemented methods for rendering a scene in an augmented audio environment. Certain implementations include approaches for generating application programming interface (API) inputs on a display. Additional implementations include approaches for rendering the API inputs at an audio device.