Video synchronization based on audio

Abstract

A content reproduction screen displays a plurality of content items. A video reproduction processing section reproduces substantially simultaneously videos of a plurality of content items on a screen. An audio reproduction processing section reproduces substantially simultaneously audio signals of a plurality of content items. During reproduction of a plurality of content items, a comparison is made between a current reproduction position of the audio signal in an audio reproduction processing section and a current reproduction position of each video in the video reproduction processing section, and, if a discrepancy between the compared current reproduction positions is equal to or greater than a threshold value, the current reproduction position of the video is corrected on the basis of the current reproduction position of the audio signal. In this way, the current reproduction position of each video is synchronized with the reproduction position of the audio signal.

Description

FIELD OF THE INVENTION[0001]The present invention relates generally to a content reproduction (playback) method, apparatus and program for reproducing a content item comprising a combination of video data and audio data, and it relates more particularly to a technique for synchronously reproducing video data and audio data constituting a one content item. Further, the present invention relates to a technique for reproducing a plurality of content items substantially simultaneously. Furthermore, the present invention relates to a technique for creating a musical work by combining a plurality of performance content items.BACKGROUND OF THE INVENTION[0002]It has been known to simultaneously reproduce a plurality of content items each comprising video data and audio data. Such content items are reproduced in various environments, such as a general-purpose environment where a personal computer is used. In cases where a plurality of content items are to be reproduced simultaneously or sync...

AI Technical Summary

Benefits of technology

[0010]In view of the foregoing prior art problems, it is an object of the present invention to permit reliable synchronization betwee...

Problems solved by technology

Because video data has a great data quantity and a high compression ratio, an enormous number of arithmetic operations would be required if the synchronization processing is executed frequently.

Because of a heavy load of the aforementioned synchronization processing, content reproduction cannot be resumed immediately following the synchronization, so that the video cannot sometimes be reproduced smoothly.

Particularly, in cases where a plurality of content items are to be reproduced simultaneously, synchronism between the content items may be undesirably lost due to the heavy load of the aforementioned synchronization processing.

For example, in a case where one music piece (more specifically, an ensemble performance of one music piece) is to be reproduced with a plurality of content items, and particularly if reproduction of a plurality of audio signals of the content items is displaced from each other, reproduction of the music piece would fail musically.

However, the technique disclosed in Patent Literature 2, which requires complicated operations for extracting sound volume levels of a given time period and then performing a pattern matching comparison between the extracted sound volume levels, is not suited for synchronization processing performed in real time during content data reproduction.

With this method, however, it is not possible to change ove...

Images