Multi-Camera Synchronization Using Distinct Reference Sounds

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Multi-camera systems face challenges in synchronizing imaging devices while maintaining cost-effectiveness and simplicity, particularly when using reference sounds, as existing methods require both sound capture and output functions in each device, leading to increased complexity and cost, and are hindered by the need for precise sound speed measurements affected by environmental conditions.

Innovation Solution

The system employs three sound devices that output distinct reference sounds, allowing imaging devices to capture and store relative positional information to generate synchronization signals, eliminating the need for devices to output reference sounds and simplifying the system by using captured sound intervals and positions to correct delay times.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If each imaging device outputs and captures reference sounds to measure delay time, then synchronization accuracy is improved, but device complexity and manufacturing cost increase

Engineering Contradiction:
Improvedelay time measurement accuracyVSAvoiddevice configuration complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The reference sound output function is extracted from imaging devices and concentrated into dedicated sound devices. Each imaging device only needs to capture reference sounds, while sound devices generate and output multiple distinct reference sounds. This separation eliminates the need for imaging devices to have both output and capture functions, reducing device complexity while maintaining synchronization accuracy through precise delay time measurement.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

Dedicated sound devices act as intermediaries between the synchronization system and imaging devices. These sound devices output multiple distinct reference sounds that are captured by imaging devices, enabling delay time measurement without requiring imaging devices to generate sounds themselves. The intermediary sound devices simplify the overall system architecture while preserving measurement precision.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If sound speed measurement mechanisms are added to accurately measure delay time, then synchronization accuracy is improved, but system complexity and construction cost increase

Engineering Contradiction:
Improvedelay time measurement accuracyVSAvoidsystem configuration complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces complex mechanical sound speed measurement mechanisms with an acoustic signal processing approach. By outputting multiple distinct reference sounds from known positions and measuring the time intervals of their capture, the system calculates delay times directly from sound arrival time differences. This substitution eliminates the need for separate sound speed measurement devices while maintaining high measurement precision through mathematical calculation based on sound propagation time.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Measurement precision

If three sound devices output distinct reference sounds and imaging devices capture them with position information, then synchronization accuracy is improved, but the number of components increases

Engineering Contradiction:
Improvesynchronization accuracyVSAvoidnumber of sound devices
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The three sound devices serve multiple functions simultaneously: they generate distinct reference sounds for identification, provide spatial position information for delay calculation, and enable triangulation-based synchronization. Each sound device acts as both a sound source and a position reference point, maximizing the utility of each component while achieving high synchronization accuracy through the collective information from all three devices.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enables accurate and easy synchronization of imaging devices, reducing manufacturing costs and complexity, while allowing for real-time synchronization even in dynamic environments like underwater settings, without the need for additional distance or sound speed measurement systems.

Implementation Method 1

synchronization is performed on the basis of the reference sound after a delay time of capture of each imaging device from the point of time of output of the reference sound is corrected, the delay time being due to propagation of the reference sound from an output device that outputs the reference sound to the imaging device that captures the reference sound

Methodology Applied
Scientific EffectSound propagation: Sound

Data Source

PatentUS11006035B2Imaging system, imaging device, and imaging method
Publication Date: 2021.05.11 SONY GROUP CORP
  • US11006035B2 patent drawing
  • US11006035B2 patent drawing
  • US11006035B2 patent drawing

AI summary

To provide an imaging system, an imaging device, and an imaging method capable of accurately and easily synchronizing a plurality of imaging devices while suppressing a manufacturing cost and the like of the imaging device. Provided is an imaging system including three sound devices configured to output reference sounds different from one another, and a plurality of imaging devices configured to perform imaging in synchronization with one another on the basis of the reference sounds, in which each of the sound devices includes a first capture unit configured to capture the reference sound output from another of the sound devices, and an output unit configured to output the corresponding reference sound on the basis of the capture of the reference sound from the another of the sound devices, and each of the imaging devices includes a second capture unit configured to capture each of the reference sounds, a storage unit configured to store information regarding mutual relative positions of the three sound devices, and a synchronization signal generation unit configured to correct any one of the reference sounds on the basis of an interval of capturing each of the reference sounds and the relative positions to generate a synchronization signal for imaging.