Active Sensor Synchronization via Light Pattern Sequences

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing techniques for synchronizing multiple active sensors in the same real-world environment are inefficient and prone to errors, requiring pre-known 3D information and detectable markers, which limits their effectiveness in immersive extended-reality applications.

Innovation Solution

A system and method using a server to synchronize cameras by receiving depth information from devices, detecting when they are in the same surroundings, and controlling active illuminators and sensors to project and sense sequences of light patterns, allowing for simultaneous synchronization of active sensors without markers.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If detectable markers of known shapes are used for determining poses, then pose determination is enabled, but pre-known 3D information is required and the system becomes error-prone

Engineering Contradiction:
Improvepose determination accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent removes the requirement for pre-known 3D information and detectable markers by extracting only the essential depth information from the environment. Instead of relying on artificial markers, the system uses natural environmental features captured by depth sensors to determine device poses, thereby simplifying the system while maintaining accuracy.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system uses the devices' own depth sensors to capture and process environmental information for pose determination. Each device independently contributes depth data that is processed to determine relative poses, eliminating the need for external marker systems and pre-known 3D models.

Inventive Principle:
Principle #25Self-service

2Area of stationary object

If multiple active sensors are employed in the same real-world environment, then sensor coverage is increased, but synchronization becomes difficult and data corruption occurs

Engineering Contradiction:
Improvesensor coverage areaVSAvoidsensor data consistency
Core Design Contradiction:
Area of stationary objectVSReliability

Solution Approach 1:

The patent implements periodic depth information capture where each device captures depth data at regular time intervals. This periodic sampling, combined with timestamping and sequence numbering, enables precise synchronization of multiple active sensors without data corruption, allowing them to operate simultaneously in the same environment.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system uses feedback mechanisms where depth information from multiple devices is continuously monitored and compared. Timestamps and sequence numbers provide feedback on the timing and order of captures, enabling the system to detect and correct synchronization issues, thereby maintaining data consistency across multiple sensors.

Inventive Principle:
Principle #23Feedback

3Loss of information

If depth information is captured by multiple devices simultaneously, then environmental coverage is improved, but synchronization errors and data corruption occur

Engineering Contradiction:
Improveenvironmental information completenessVSAvoidsynchronization time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The patent implements preliminary actions by having each device capture depth information with embedded timestamps and sequence numbers before processing. This preliminary tagging of temporal information allows for accurate post-capture synchronization and matching of depth data from multiple devices without losing environmental information or incurring synchronization delays.

Inventive Principle:
Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables efficient, accurate, real-time synchronization of active sensors, eliminating the need for pre-known 3D information and markers, resulting in consistent and immersive sensor data collection.

Implementation Method 1

controlling a first active illuminator of one of the at least two devices to project a sequence of light patterns on the same surroundings, whilst switching off a second active illuminator of another of the at least two devices, and controlling a first active sensor of the one of the at least two devices and a second active sensor of the another of the at least two devices to sense simultaneously reflections of the sequence of light patterns off the same surroundings

Methodology Applied
Scientific EffectReflection: Reflection

Data Source

PatentUS11758077B1Employing sequences of light patterns to synchronize cameras
Publication Date: 2023.09.12 VARJO TECH OY
  • US11758077B1 patent drawing
  • US11758077B1 patent drawing
  • US11758077B1 patent drawing

AI summary

Disclosed is a system (100) comprising server(s) (102) communicably coupled to devices (104a, 104b, 202a-202c). Server(s) is/are configured to: receive depth information generated by said device using active illuminator and active sensor; detect when at least two devices are in same surroundings, based on at least partial matching of depth information received from at least two devices; and send instructions to at least two devices to generate new depth information by: controlling active illuminator (106a) of one of at least two devices (104a, 202a) to project sequence of light patterns on same surroundings, whilst switching off active illuminator (106b) of another of at least two devices (104b, 202b), and controlling first active sensor (108a) of one of at least two devices and second active sensor (108b) of another of at least two devices to sense simultaneously reflections of sequence of light patterns.