Mobile Device Lightshow Synchronization via Acoustic TDOA Trilateration
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing crowd participation lightshow systems at live events face challenges such as high costs due to one-time use devices, environmental impact, synchronization issues, and inaccurate location determination of devices, particularly in indoor settings where GPS and other wireless signals are unreliable.
Innovation Solution
A system utilizing Bluetooth Low Energy (BLE) beacon transmitters to broadcast lightshow parameters to mobile devices, enabling dynamic and real-time control of pixel devices, which can determine their location using ultrasonic audio signals and TDOA-based trilateration for precise positioning, allowing for synchronized and location-aware lightshow effects.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If one-time use devices with LEDs are provided to audience members, then lightshow effects can be produced, but manufacturing costs and environmental impact increase
Solution Approach 1:
The patent repurposes universally available mobile devices (smartphones, tablets) that audience members already possess for their primary communication functions, making them serve the additional function of lightshow pixels. This eliminates the need to manufacture separate one-time-use devices while leveraging the existing display screens and processors of mobile devices to produce lightshow effects.
Solution Approach 2:
The system utilizes the mobile devices' own existing hardware components (display screens, processors, cameras) to perform the lightshow function without requiring external specialized equipment. The devices serve themselves by using their inherent capabilities rather than requiring additional manufactured components.
2Ease of operation
If IR or RF signals are used to control devices, then wireless control is achieved, but stage smoke interferes with signals and mobile phones' camera views are adversely affected
Solution Approach 1:
The patent replaces electromagnetic signal-based control (IR/RF) with acoustic signal-based control using audible sound waves. Instead of using infrared or radio frequency signals that are blocked by smoke and interfere with camera views, the system uses sound waves that can penetrate smoke and are detectable by mobile device microphones, thereby substituting one physical mechanism for another to overcome the harmful interference effects.
3Measurement precision
If GPS information is used to determine device location, then location-based control is achieved, but GPS signals are blocked by building walls and precision is insufficient
Solution Approach 1:
The patent introduces acoustic signals (sound waves) as an intermediary medium for location determination. Instead of relying on GPS satellite signals that are blocked by buildings, the system uses locally generated acoustic signals that propagate through the indoor environment and can be detected by mobile device microphones. The time difference of arrival of these acoustic signals from multiple known sources enables precise triangulation of device location without requiring GPS signal penetration.
4Adaptability or versatility
If audio signals are used to control computing devices, then existing mobile devices can be utilized, but synchronization across devices is compromised due to varying signal reception times
Solution Approach 1:
The patent incorporates feedback mechanisms where the central control system receives timing information from each mobile device about when it detected the acoustic signal, and adjusts the lightshow coordination accordingly. This feedback loop allows the system to compensate for varying signal propagation times and device processing delays, maintaining synchronization across all devices despite their different reception times.
Solution Approach 2:
The system performs preliminary calibration and timing measurements before the actual lightshow performance. During this preliminary phase, the system characterizes the acoustic signal propagation times to different locations in the venue and pre-computes the timing offsets needed for synchronization. This preliminary action enables the system to pre-adjust for synchronization delays rather than reacting to them during the performance.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The system reduces costs by reusing mobile devices, enhances synchronization across multiple devices, and provides accurate location determination for precise lightshow effects, enabling complex animations and improved audience engagement without the need for extensive infrastructure.
Implementation Method 1
listening for and recording a plurality of audio signals emitted concurrently from a plurality of speaker nodes, processing the recorded audio signals to determine a time difference of arrival (TDOA) for each audio signal, and, employing TDOA hyperbolic trilateration and/or multilateration methods, calculate the position of the pixel
Implementation Method 2
The audio signals may comprise tones, chirps or other sounds. In particular embodiments, the audio signal is an ultrasonic audio signal (above the frequency of audible sound), such as an audio signal having a frequency in the range of 16 kHz to 24 kHz
Data Source
AI summary
A lightshow control system for generating a lightshow across a plurality of pixels or mobile devices comprises a controller configured to receive a lightshow operator's input and to generate a plurality of lightshow parameters. The system comprises a beacon transmitter in communication with the lightshow controller and configured to receive the lightshow parameters from the lightshow controller, encode the lightshow parameters on a beacon signal, and broadcast the beacon signal to the pixels, wherein each pixel is configured to receive and decode the beacon signal to perform one or more display actions. The decoded beacon signal includes reference timing information to facilitate synchronization of the pixels. The display actions may be based in part on the individual pixel location which is determined by the pixel based on TDOA multilateration and/or trilateration from distinct audio signals emitted by a plurality of speaker nodes.