Image Transfer Apparatus Synchronizing Asynchronous Video Streams

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image transfer systems face challenges in synchronizing moving images from multiple imaging devices without a synchronization support function, such as time code or GenLock, leading to difficulties in achieving frame synchronization during panoramic composition and increased system costs.

Innovation Solution

An image transfer apparatus that uses a frame selecting unit to synchronize moving image data by referencing a vertical synchronization signal from one imaging device, integrating frame image data items into a single stream, and sending them over a network, allowing for synchronization even when imaging devices capture videos asynchronously.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If imaging apparatuses with synchronization support functions (time code, GenLock) are used, then frame synchronization between moving images is achieved, but system cost increases

Engineering Contradiction:
Improveframe synchronizationVSAvoidsystem cost
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent replaces expensive imaging apparatuses with synchronization support functions (time code, GenLock) with inexpensive imaging apparatuses that lack these functions. The synchronization capability is transferred from the imaging apparatuses to the image transfer apparatus, allowing the use of cheaper, simpler imaging devices while maintaining frame synchronization through the central control system.

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

Solution Approach 2:

The image transfer apparatus acts as an intermediary that receives vertical synchronization signals from selected frame image data items and uses these signals to control the timing of frame selection and integration. This mediator approach enables synchronization without requiring the imaging apparatuses themselves to have built-in synchronization support functions.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If moving images are transmitted in independent streams over network, then transmission flexibility is improved, but synchronization between respective moving images becomes difficult to achieve

Engineering Contradiction:
Improvetransmission flexibilityVSAvoidframe synchronization
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent integrates multiple frame image data items selected from independent streams into a single integrated stream based on vertical synchronization signals. This merging process combines the flexibility of independent stream transmission with the synchronization capability of unified control, as the image transfer apparatus coordinates frame selection from each stream according to synchronization signals to produce a synchronized integrated output.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system uses vertical synchronization signals as feedback to adjust and coordinate frame selection from multiple independent streams. The synchronization signals provide timing information that feeds back into the frame selection process, ensuring that frames selected from different independent streams are synchronized when integrated into the final stream.

Inventive Principle:
Principle #23Feedback

3Device complexity

If frame images are selected from multiple imaging apparatuses without synchronization support, then system cost is reduced, but imaging timing difference between frames increases

Engineering Contradiction:
Improvesystem costVSAvoidimaging timing synchronization
Core Design Contradiction:
Device complexityVSManufacturing precision

Solution Approach 1:

The image transfer apparatus serves as an intermediary that receives vertical synchronization signals from the selected frame image data items and uses these signals to coordinate the timing of frame selection. This mediator function compensates for the lack of synchronization support in the inexpensive imaging apparatuses, maintaining precise imaging timing synchronization through centralized control.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system performs preliminary selection of frame image data items based on vertical synchronization signals before integration. By pre-selecting frames that align with synchronization signals and buffering them temporarily, the system ensures timing synchronization is established before the frames are combined, compensating for the asynchronous operation of inexpensive imaging apparatuses.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10834315B2Image transfer apparatus and moving image generating system for transferring moving image data
Publication Date: 2020.11.10 SONY GROUP CORP
  • US10834315B2 patent drawing
  • US10834315B2 patent drawing
  • US10834315B2 patent drawing

AI summary

An imaging apparatus having no synchronization support function by a time code and to cut down a system cost, in synchronizing respective moving images in the case of outputting and displaying moving images input from a plurality of imaging apparatuses through network transmission. A vertical synchronization signal input from a particular imaging apparatus among a plurality of imaging apparatuses is used as a reference to select frame image data items from moving image data input from the plurality of imaging apparatuses, and the selected frame image data items are integrated into a single stream and sent. Even in a case where the plurality of imaging apparatuses captures videos asynchronously, it becomes possible to select, from the respective moving images, frame images with a small imaging timing difference on the basis of the vertical synchronization signal of the particular imaging apparatus.