Media Packet Motion Data Extraction for Wireless Audio Latency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems for providing wireless immersive audio experience, such as those using headphones, suffer from high latency due to the transmission of head motion data between devices and the processing of audio data at remote servers.
Innovation Solution
Conveying motion data, such as head tracking information, via media packets allows for extraction and processing at a link layer, reducing latency compared to processing at an application layer.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If motion data is transmitted between headphone device and remote server for audio scene updates, then immersive audio experience is enabled, but motion-to-sound latency becomes unnaturally high
Solution Approach 1:
The patent segments the audio processing system into two parts: the remote server handles audio scene updates while the headphone device performs local binauralization. This segmentation allows motion data to be processed locally at the headphone device rather than being transmitted round-trip to the server, reducing latency while maintaining immersive audio capabilities.
Solution Approach 2:
The patent introduces an intermediary approach where the headphone device acts as a local processing node between the remote server and the audio output. The device receives audio scene updates from the server, combines them with locally captured motion data from sensors, and performs binauralization locally, serving as an intermediary that eliminates the need to transmit motion data to the server.
2Measurement precision
If head tracking information is transmitted to remote server for processing, then spatial audio accuracy is improved, but transmission and processing time increases
Solution Approach 1:
The patent extracts the binauralization processing function from the remote server and relocates it to the headphone device. This extraction allows motion data to be processed locally without transmission delays, while the device still receives audio scene updates from the server to maintain spatial audio accuracy.
Solution Approach 2:
The headphone device performs self-service by capturing its own motion data through onboard sensors and processing it locally for binauralization. This eliminates the need to transmit motion data to the server, reducing transmission and processing time while maintaining spatial audio accuracy through local processing.
3Device complexity
If audio scene updates are performed at remote server, then processing resources at headphone device are reduced, but system latency increases
Solution Approach 1:
The patent segments the processing tasks between server and device: the server handles complex audio scene updates while the device handles local motion capture and binauralization. This segmentation balances processing resource requirements with latency constraints by performing time-critical operations locally.
Solution Approach 2:
The patent implements preliminary action by having the headphone device capture and buffer motion data locally before it is needed for binauralization. This preliminary capture of motion data eliminates transmission delays, allowing the device to immediately process audio with the latest motion information when receiving updates from the server.
Data Source
AI summary
A device includes a memory configured to store instructions and one or more processors configured to execute the instructions to receive a media packet and to determine, based on a field of the media packet, whether the media packet includes motion data. The one or more processors are also configured to execute the instructions to, based on the media packet including motion data, extract the motion data from the media packet.