Ultrasonic Messaging for Mixed Reality Media Coordination
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing mixed reality (xR) devices face challenges in coordinating presentations with traditional audio-video content without requiring special media players or xR devices.
Innovation Solution
The method involves detecting digital patterns in human-inaudible sonic messages from media players, which are then used to control xR device outputs, allowing coordination with traditional audio-video content without the need for special hardware.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If wireless radio signaling is used to coordinate AR device with media player, then coordination between AR output and entertainment content is achieved, but the system requires special media players and xR devices which limits accessibility for home use and transitory use
Solution Approach 1:
The patent replaces the mechanical/wireless radio signaling system with an acoustic communication system. The media player embeds control messages in audio output that can be detected by the xR device's microphone, eliminating the need for specialized wireless communication hardware and enabling compatibility with any traditional media player that outputs audio.
Solution Approach 2:
The audio output of the media player serves multiple functions: it provides the entertainment content to users and simultaneously carries embedded control messages for coordinating the xR device. This multi-functionality allows any standard media player to work with xR devices without requiring specialized hardware.
2Loss of information
If ultrasonic frequencies are used for control messages, then human-inaudible coordination is achieved, but detection precision requires sensitive microphones and signal processing
Solution Approach 1:
The patent changes the frequency parameter of the control messages to the ultrasonic range (above human hearing), allowing the media player to embed control information in the audio output without interfering with the audible entertainment content. The xR device's microphone and signal processing system are configured to detect and decode these ultrasonic frequencies.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This solution enables seamless integration of xR content with traditional media, enhancing the user experience by allowing xR devices to render content in sync with audio-video presentations from any media player.
Implementation Method 1
captured by a microphone of the xR device, which converts the audio output to digital data
Implementation Method 2
The acoustic output may be human-inaudible, for example, ultrasonic or subliminal
Data Source
AI summary
A method for receiving and processing sonic messaging by a mixed reality (xR) device from acoustic output of a media player playing content for a two-dimensional (2D) screen or projection surface, to coordinate the rendering and playing of an xR output in the xR device with the playing of the 2D content at the media player.


