Event Camera Optical Communication for Pairing-Free Low-Latency Links

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Radio communications between electronic devices over short distances using short-wavelength UHF radio waves require pairing and have low data rates, leading to increased latency.

Innovation Solution

Utilizing modulated light detected by an event camera to transmit information between electronic devices, where the event camera data is interpreted to identify information such as device identity, location, and actions based on the modulation pattern of the light.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If radio communication using short-wavelength UHF radio waves is used for data exchange between electronic devices, then communication can be established between devices, but the data rate is low and latency increases

Engineering Contradiction:

Improvedata rateVSAvoidlatency

Core Design Contradiction:

ProductivityVSLoss of time

Solution Approach 1:

The patent replaces radio wave-based communication with light-based communication using an event camera. The event camera detects modulated light from LEDs on other devices, capturing visual information that is then decoded to retrieve communication data. This substitution of electromagnetic spectrum band (from radio to visible light) enables higher data rates and lower latency while maintaining device identification and tracking capabilities.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Ease of operation

If radio communication pairing is implemented between electronic devices, then communication can be established, but the pairing process adds complexity and time to device interaction

Engineering Contradiction:

Improvedevice pairing processVSAvoidpairing time

Core Design Contradiction:

Ease of operationVSLoss of time

Solution Approach 1:

The event camera continuously captures and processes visual information from modulated light sources in the environment. Devices automatically detect and decode light modulations from other devices without requiring manual pairing actions. The system self-services by continuously monitoring the visual field and automatically establishing communication channels based on detected light patterns, eliminating the need for traditional pairing protocols.

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The event camera operates continuously to detect modulated light, maintaining constant awareness of nearby devices. Rather than initiating communication only when pairing is requested, the system continuously captures light modulations and decodes information in real-time, enabling immediate communication establishment without pairing delays.

Inventive Principle:

Principle #20Continuity of useful action

3Speed

If traditional camera systems are used to detect light for communication, then light detection is possible, but the frame rate is limited and latency increases

Engineering Contradiction:

Improvedetection speedVSAvoiddetection latency

Core Design Contradiction:

SpeedVSLoss of time

Solution Approach 1:

The event camera uses asynchronous event-based detection where pixels independently respond to light intensity changes without being constrained by a global frame rate. Each pixel generates events periodically when light changes occur, enabling high-speed detection of modulated light signals. This periodic event generation at the pixel level replaces the traditional frame-based capture approach, achieving microsecond-level detection latency.

Inventive Principle:

Principle #19Periodic action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables low-latency communication by leveraging event cameras to detect and interpret modulated light, allowing for efficient device identification and tracking in augmented and mixed reality environments.

Implementation Method 1

modulated light that is detected using an event camera... light including an information signal in its modulation

Methodology Applied

Scientific EffectLight modulation: Phase Modulation

Implementation Method 2

obtaining, at a receiving electronic device with an event camera, event camera data indicative of an intensity of received modulated light incident on the event camera

Methodology Applied

Scientific EffectPhotoelectric detection: Photoelectric Effect

Data Source

PatentUS12499680B2Method and system for encoded optical communication using a modulated light source

Publication Date: 2025.12.16 APPLE INC

AI summary

Various implementations disclosed herein include devices, systems, and methods that obtain information from a first electronic device (e.g., to improve interactions for a CGR environment). In some implementations at a second electronic device having a processor, event camera data is obtained corresponding to modulated light (e.g., light including an information signal in its modulation) emitted by an optical source on the first electronic device and received at an event camera. The second electronic device is able to identify information from the first electronic device based on detecting a modulation pattern of the modulated light based on the event camera data. In some implementations, second electronic device is the same electronic device that has the event camera (e.g., laptop) or a different electronic device that receives the event data (e.g., a server receiving the event data from a laptop computer).