Temporal Video Synchronization via Optical Pulse Signaling

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional methods for synchronizing videos from multiple imaging devices, such as those used in the entertainment and defense industries, require labor-intensive physical connections and are not feasible for cameras in motion, leading to inaccuracies in synchronization, especially in applications like augmented reality and motion capturing.

Innovation Solution

An electronic device generates a synchronization signal with a preamble pulse and a sequence of alternating ON and OFF pulses, which is used to control lighting devices to create a pattern of alternating light pulses, allowing imaging devices to synchronize without physical wiring, achieving sub-frame level timing accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If physical wiring is used to connect multiple cameras for synchronization, then synchronization accuracy is improved, but setup complexity and time consumption increase

Engineering Contradiction:
Improvesynchronization accuracyVSAvoidsetup complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces the mechanical wiring system with an optical signaling system. Instead of using physical electrical connections to trigger cameras, the system uses a centralized controller that sends optical synchronization signals (light pulses) to multiple imaging devices. This substitution eliminates the need for complex physical wiring while maintaining synchronization accuracy, directly resolving the contradiction between measurement precision and device complexity.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces a centralized controller as an intermediary device that coordinates multiple imaging devices. This controller generates and distributes synchronization signals to all cameras, acting as a mediator that enables precise timing without requiring direct physical connections between cameras. The intermediary approach simplifies the overall system architecture while preserving synchronization precision.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If physical wiring is used to connect cameras, then synchronization is achievable, but the method becomes infeasible for cameras in motion

Engineering Contradiction:
Improvesynchronization feasibilityVSAvoidadaptability to motion
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

By replacing the mechanical wiring system with wireless optical signaling, the patent enables synchronization of cameras in motion. The optical signals can be transmitted through air or other media without requiring physical connections, making the system adaptable to moving platforms such as drones, vehicles, or handheld cameras while maintaining reliable synchronization.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent creates a dynamic synchronization system where the controller can adapt to moving cameras by continuously sending synchronization signals that account for motion. The system is designed to work with cameras that are not fixed in position, allowing the synchronization mechanism to remain effective even as the spatial relationships between cameras change over time.

Inventive Principle:
Principle #15Dynamics

3Measurement precision

If manual alignment of image frames is performed for synchronization, then synchronization is achieved, but time consumption increases and timing accuracy is limited to frame-level

Engineering Contradiction:
Improvetiming accuracyVSAvoidtime consumption
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent implements preliminary synchronization by sending a preamble signal before the actual imaging capture. This preamble contains timing information that allows cameras to pre-align their capture timing, eliminating the need for post-capture manual frame alignment. The preliminary action occurs at the signal level rather than requiring frame-level processing, thereby reducing time consumption while improving timing accuracy beyond frame-level precision.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system uses feedback mechanisms where the controller monitors the received signals from multiple cameras and adjusts synchronization timing accordingly. This feedback loop enables automatic correction of timing deviations, achieving high precision synchronization without manual intervention and reducing the time required compared to traditional manual frame alignment methods.

Inventive Principle:
Principle #23Feedback

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This method enables accurate temporal synchronization of videos from multiple imaging devices without physical connections, improving efficiency and accuracy in applications like augmented reality and motion capturing.

Implementation Method 1

control a lighting device to generate, based on the generated synchronization signal, a pattern of alternating light pulses

Methodology Applied
Scientific EffectLight emission: Light

Data Source

PatentUS11743444B2Electronic device and method for temporal synchronization of videos
Publication Date: 2023.08.29 SONY GROUP CORP
  • US11743444B2 patent drawing
  • US11743444B2 patent drawing
  • US11743444B2 patent drawing

AI summary

Provided is an electronic device for a temporal synchronization, which determines a set of parameters associated with each imaging device of a plurality of imaging devices. The set of parameters include frame rate of each imaging device. The electronic device generates a synchronization signal that includes a preamble pulse of a first time duration set based on the frame rate and a sequence of alternating ON and OFF pulses. Each pulse of the sequence of alternating ON and OFF pulses is of a second time duration set based on the set of parameters. Based on the synchronization signal, lighting devices may be controlled to generate a pattern of alternating light pulses that is captured by each imaging device. The electronic device further acquires a plurality of images that includes information about the pattern of alternating light pulses. The electronic device further synchronizes the plurality of images, based on the information.