Video playback device, video playback method, and video playback program

Abstract

To provide a video reproducing device capable of providing a video that a viewer hardly feels tired of by reproducing audio without a sense of incompatibility with a moving image, and a video reproducing method.SOLUTION: A video reproducing device comprises: storage means for storing spot moving image information, in which moving image information for a predetermined time is segmented, in association with a plurality of pieces of first audio information for the predetermined time is extracted based on one or more videos consisting of moving images and audio and for storing a plurality of pieces of second audio information; audio reproduction instruction means for designating a reproduction order of the first audio information to a first audio reproduction layer and designating a reproduction order of the second audio information to a second audio reproduction layer; moving image reproduction instruction means for designating reproduction timing of the spot moving image information to the first moving image reproduction layer; and video synthesizing means for synthesizing a video based on the first and second audio information designated by the first audio reproduction layer and the second audio reproduction layer and the spot moving image information designated by the first moving image reproduction layer.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a video playback device, a video playback method, and a video playback program for playing back video that includes moving images and audio. [Background technology]

[0002] Videos that consist of moving images and audio can record memories, stimulate interest in the content of the video, and provide a sense of healing to viewers.

[0003] For example, the electronic album system described in Patent Document 1 includes an image storage means for storing specific image data and image attribute information that have been searched and edited, a music storage means for storing music data and music attribute information, and a system for playing back in parallel specific image data and music data related to the image data that have been selected based on the image attribute information and music attribute information. The electronic album system described in Patent Document 1 can automatically create an electronic album with music, eliminating the need for album editing such as selecting music that matches the images and obtaining music data. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2009-20836 Summary of the Invention [Problem to be solved by the invention]

[0005] However, the electronic album system described in Patent Document 1 selects music data related to specific image data based on image attribute information and music attribute information, so if music data that matches the image data is not selected, users may feel uncomfortable. Also, the same music data is always selected for specific image data, which can lead to boredom.

[0006] SUMMARY OF THE INVENTION It is therefore an object of the present invention to provide a video playback device and a video playback method that can play audio that is natural with video and that is unlikely to tire the viewer. [Means for solving the problem]

[0007] The video playback device of the present invention is characterized by comprising: a storage means for storing spot video information, which is a predetermined length of video information extracted based on the video from which the first audio information was extracted, in association with a plurality of first audio information, in which a predetermined length of audio is extracted based on one or more videos consisting of video and audio, and for storing a plurality of second audio information to be played together with the first audio information; an audio playback instruction means for specifying the playback order of the first audio information in a first audio playback layer and the playback order of the second audio information in a second audio playback layer; a video playback instruction means for specifying the playback timing of the spot video information associated with the first audio information specified by the audio playback instruction means in the first video playback layer; and a video synthesis means for synthesizing a video based on the first and second audio information specified by the first audio playback layer and the second audio playback layer and the spot video information specified by the first video playback layer.

[0008] Furthermore, the video playback method of the present invention includes a step in which an audio extraction means extracts a predetermined time of audio based on one or more videos consisting of video and audio as a plurality of first audio information and stores the extracted audio in a storage means, and a step in which a plurality of second audio information to be played together with the first audio information is stored in the storage means; and a video clipping means clips the predetermined time of video information based on the video from which the first audio information has been extracted. ,vinegarThe method includes the steps of: extracting the audio information as spot video information, associating it with the first audio information, and storing it in a storage means; an audio playback instruction means specifying the playback order of the first audio information in the first audio playback layer and the playback order of the second audio information in the second audio playback layer; a video playback instruction means specifying the playback timing of the spot video information associated with the first audio information specified by the audio playback instruction means in the first video playback layer; and a video synthesis means synthesizing a video based on the first and second audio information specified by the first audio playback layer and the second audio playback layer and the spot video information specified by the first video playback layer.

[0009] Furthermore, the video playback program of the present invention is characterized in that it causes a computer to function as: a storage means for storing spot video information, in which a predetermined length of video information is extracted based on the video from which the first audio information was extracted, in association with a plurality of first audio information, in which a predetermined length of audio is extracted based on one or more videos consisting of video and audio, and for storing a plurality of second audio information to be played together with the first audio information; an audio playback instruction means for specifying the playback order of the first audio information in a first audio playback layer and the playback order of the second audio information in a second audio playback layer; a video playback instruction means for specifying the playback timing of the spot video information associated with the first audio information specified by the audio playback instruction means in the first video playback layer; and a video synthesis means for synthesizing a video based on the first and second audio information specified by the first audio playback layer and the second audio playback layer and the spot video information specified by the first video playback layer.

[0010] According to the present invention, first audio information is extracted based on the audio of a video that is made up of a video and audio, and spot video information is extracted based on the video from which the first audio information was extracted. Therefore, the audio according to the first audio information that matches the video according to the spot video information is played back, allowing the viewer to watch without feeling uncomfortable. Furthermore, since the audio playback instruction means specifies the playback order of the first audio information in the first audio playback layer, the playback order of the video based on the spot video information and the audio based on the first audio information can be changed during playback, making it possible to make the video less boring to watch. Furthermore, by specifying the second audio information as the second audio playback layer and playing it back, the audio from the second audio information and the audio from the first audio information can be played back in combination, which further reduces the viewers' boredom when watching the video.

[0011] The audio playback instruction means may randomly designate the plurality of first audio information pieces, including no audio, so that even if the pieces are played back repeatedly, the playback order will not be the same, and it is possible to provide a video that the viewer will not tire of.

[0012] The first audio information has an audio length extracted based on a first basic time, and the spot video information has a video length extracted based on a second basic time shorter than the first basic time. The storage means further stores base video information longer than the spot video information. The video playback instruction means , th The second video playback layer specifies that the base video information is to be repeatedly played back, and the video composition means may be configured to play back the base video information specified by the second video playback layer when the spot video information ends while the first audio information is being played back. Since video based on the base video information is played back between each piece of spot video information, the spot video information and the base video information are played back alternately, making it possible to create complex combinations.

[0013] When designating the second audio information as the second audio playback layer, the audio playback instruction means may refer to first condition information of the second audio information and second condition information of the spot video information and determine that the combination is not possible, and may designate other second audio information as the second audio playback layer. In this way, a video can be created by combining audio of the second audio information that matches the video of the spot video information. [Effects of the Invention]

[0014] The present invention plays audio from first audio information that matches the video from the spot video information, and plays a combination of audio from the second audio information and audio from the first audio information, so that audio that does not feel out of place with the video can be played, making it possible to provide video that is unlikely to become boring. [Brief explanation of the drawings]

[0015] [Figure 1] 1 is a diagram illustrating a video playback system using a video playback device according to an embodiment of the present invention. [Figure 2] FIG. 2 is a diagram for explaining the video playback device shown in FIG. [Figure 3] 2 is a diagram for explaining the operation of the video playback device shown in FIG. 1. FIG. DETAILED DESCRIPTION OF THE INVENTION

[0016] A video playback system using a video playback device according to an embodiment of the present invention will be described with reference to the drawings. Note that in this specification, video refers to a moving image with audio added. The video playback system 10 shown in Fig. 1 is installed in Hotel H, an example of an accommodation facility. The video playback system 10 provides tourists with tourist videos of the area around Hotel H, which can motivate them to visit and spark their interest in the tourist destination.

[0017] In the video playback system 10, a video playback device 1 and a terminal device 2 called a set-top box installed in each guest room R are connected to each other via a wired LAN so that they can communicate with each other. A television receiver T that functions as a display means for displaying images is installed in each guest room R. The terminal device 2 and the television receiver T are connected via an HDMI (High-Definition Multimedia Interface: registered trademark) terminal, which is an example of an input / output terminal.

[0018] In this embodiment, the terminal device 2 is connected to the video playback device 1 via a LAN cable, but communication may also be performed via a wireless relay device installed in the corridor of each floor or in each guest room. In this case, the wireless communication may be Wi-Fi (registered trademark). In addition, the terminal device 2 can be a set-top box that receives each broadcast and displays it on the television receiver T, or it can be a stick-shaped computer that is directly connected to the HDMI terminal of the television receiver T and communicates with the video playback device 1 via wireless communication.

[0019] Next, the configuration of the video playback device 1 will be described with reference to FIG. The video playback device 1 shown in FIG. 2 is installed in, for example, a machine room of a hotel H, and is a video distribution server that distributes video to terminal devices 2 installed in each guest room R. As shown in Figure 2, the video playback device 1 includes a communication means 11, an audio playback instruction means 12, a video playback instruction means 13, a music providing means 14, a video synthesis means 15, an audio extraction means 16, a video clipping means 17, and a storage means 18.

[0020] The communication means 11 has the function of receiving each data from the LAN and outputting it to each means of the video playback device 1, and inputting data from each means and transmitting it to the LAN. The audio reproduction instruction means 12 specifies the reproduction order of the first audio information in the first audio reproduction layer, and specifies the reproduction order of the second audio information in the second audio reproduction layer. Furthermore, when designating the second audio information as the second audio playback layer, the audio playback instruction means 12 refers to the first condition information of the second audio information and the second condition information of the spot video information and, if it determines that the combination is not possible, designates other second audio information as the second audio playback layer. The video playback instruction means 13 specifies the playback timing of the spot video information associated with the first audio information specified by the audio playback instruction means 12 in the first video playback layer.

[0021] The music providing means 14 provides music to be played as background for the first audio information and the second audio information, and assigns this music to the third audio playback layer. The music providing means 14 may provide predetermined music repeatedly, or may generate and provide music in real time. The video synthesis means 15 synthesizes video based on the first and second audio information specified by the first audio playback layer and the second audio playback layer, and the spot video information and base video information specified by the first video playback layer and the second video playback layer.

[0022] The audio extraction means 16 extracts audio of a specified section from the video and stores it as first audio information in the storage means 18. The audio extraction means 16 can also extract audio from the video and store it as second audio information in the storage means 18. The video clipping means 17 has a function of clipping a video of a predetermined length from a long video. For example, the video clipping means 17 clips a six-second video from a few minutes of video and stores it in the storage means 18 as video information.

[0023] The storage means 18 stores a plurality of pieces of first audio information, each of which has a predetermined duration and is extracted based on one or more videos consisting of video and audio, and stores the video information of the video from which the first audio information was extracted as spot video information. The storage means 18 also stores a plurality of pieces of second audio information to be played together with the first audio information. The storage means 18 also stores base video information that is longer than the spot video information.

[0024] The first audio information and the second audio information can be in various audio file formats, such as WAV, AIFF, BWF, AAC, and WMA. In this embodiment, the first audio information and the second audio information are stored in the storage means 18 in MP3 format. The spot video information and base video information may be in various video file formats. For example, the spot video information and base video information may be in AVI, MOV, WMV, FLV, MPG, MKV, etc. In this embodiment, the spot video information and base video information are stored in the storage unit 18 in MP4 format.

[0025] A video playback method using the video playback system 10 using the video playback device 1 according to the embodiment of the present invention configured as above will be described with reference to the drawings. It is assumed that the base video information is a long video previously shot of a tourist spot and stored in the storage means 18 so that it can be repeatedly played back on the second video playback layer.

[0026] First, the operator operates the video playback device 1, causing the audio extraction means 16 to extract an audio portion of a predetermined time from the video and store it in the storage means 18 as first audio information. By extracting a plurality of parts from one video or extracting parts from several videos, the storage means 18 stores a plurality of pieces of first audio information.

[0027] For example, the audio extraction means 16 extracts an arbitrary 11-second audio from several minutes of video footage of a tourist spot and stores the extracted audio in the storage means 18 as first audio information. The second audio information may be prepared in advance and stored in the storage means 18, or the audio portion extracted from the video by the audio extraction means 16 in the same manner as the first audio information may be stored in the storage means 18 as the second audio information, or the first audio information may be used as the second audio information. In the present embodiment, the audio is unrelated to the first audio information and the spot video information, but is intended to have a soothing effect.

[0028] In this embodiment, the first audio information includes 10 types of "babbling sounds" extracted from video of a stream, 4 types of "stone sounds" extracted from video of walking on a gravel road, 4 types of "shrine bell sounds" extracted from video of a shrine, 9 types of "bird chirping" extracted from video of a forest, 3 types of "tree sounds," and about 4 types of footsteps walking on cobblestones. The second audio information may be, for example, the sound of wind, water, waves, a whistle, rain, cicadas, etc. The second audio information may be the same audio as the first audio information.

[0029] In this embodiment, the audio length of the first audio information and the second audio information is cut out from the video with a basic length (first basic time) of 11 seconds. Furthermore, the video length of the spot video information is cut out from the video with a basic length (second basic time) of 6 seconds.

[0030] Next, the video clipping means 17 clips one or more video segments of a predetermined length from several videos of several minutes each from which the first audio information has been extracted, and stores the clipped video segment information in the storage means 18 in association with the first audio information extracted from the video. The spot video information can be an image video introducing tourist spots in various places, such as a video of a babbling river, a video of a forest, a video of a festival at a shrine, or a video of bells ringing at a shrine. Furthermore, various videos can be prepared as base video information, and for example, a video showing a sightseeing tour of a tourist spot can be used.

[0031] Next, the audio reproduction instruction means 12 designates the first audio information to be reproduced as the first audio reproduction layer, and designates the second audio information to be reproduced as the second audio reproduction layer. This designation may be made by the audio playback instruction means 12 by the operator operating the video playback device 1 to select the first audio information and second audio information to be played back, but in this embodiment, the audio playback instruction means 12 randomly selects and designates the first audio information and second audio information.

[0032] Next, the video playback instruction means 13 assigns the spot video information associated with the first audio information, which is assigned to the first audio playback layer, to the first video playback layer.

[0033] At this time, when specifying the second audio information in the second audio playback layer, the audio playback instruction means 12 refers to the first condition information of the second audio information and the second condition information of the spot video information. The first condition information and the second condition information may be information indicating a time period such as morning, afternoon, or night. For example, although the second condition information of the spot video information indicates night, the second audio information is the sound of birds singing in the morning. Therefore, if the first condition information of the second audio information indicates morning, the audio of the second audio information, which creates a morning atmosphere, will feel unnatural when paired with a video of the spot video information of a night view.

[0034] Therefore, when the audio playback instruction means 12 determines that the first condition information of the second audio information and the second condition information of the spot video information cannot be combined, it can specify other second audio information as the second audio playback layer to create a video that combines the audio of the second audio information that matches the video of the spot video information. The determination of whether the first condition and the second condition can be combined or not can be made by the audio playback instruction means 12 referring to a table stored in the storage means 18 that indicates whether the combination of the first condition and the second condition is permitted or not. Moreover, the music providing means 14 designates the generated music as the third audio playback layer.

[0035] Then, the video synthesis means 15 sequentially reads out from the storage means 18 the first audio information specified in the first audio playback layer, the second audio information specified in the second audio playback layer, the spot video information specified in the first video playback layer, and the base video information specified in the second video playback layer, and synthesizes it with the music specified in the third audio playback layer, and transmits it as a single video to the terminal device 2 via the communication means 11.

[0036] For example, the first audio layer is set to have the first 11 seconds of silence, the next 11 seconds to play the sound of a babbling brook, and the next 11 seconds to play the sound of stones. Since the first 11 seconds are silent and no first audio information is specified, video playback instruction means 13 does not specify spot video information for the first video playback layer.

[0037] Therefore, during the first basic time of the first 11 seconds, the video synthesis means 15 synthesizes the unvoiced sound specified in the first audio playback layer, the second audio information specified in the second audio playback layer, the base video information specified in the second video playback layer, and the music generated by the music provision means 14 and specified in the third audio playback layer.

[0038] Furthermore, for the next 11 seconds after the "sound of a babbling brook" is played, the image of the stream associated with the first audio information "sound of a babbling brook" is specified as the first video playback layer. Therefore, during the second basic time of the first 6 seconds of the next 11 seconds, the video synthesis means 15 synthesizes the "babbling sound" specified in the first audio playback layer, the video of the stream specified in the second video playback layer, the second audio information specified in the second audio playback layer, and the music generated by the music provision means 14 and specified in the third audio playback layer.

[0039] Then, for the first 6 seconds of the 11 seconds, the video of the stream, which is the spot video information specified in the second video playback layer, is played, but for the remaining 5 seconds, the spot video information ends. Therefore, the video synthesis means 15 synthesizes the "sound of the stream" specified in the first audio playback layer, the base video information specified in the second video playback layer, the second audio information specified in the second audio playback layer, and the music generated by the music provision means 14, which is specified in the third audio playback layer.

[0040] The video synthesized by the video synthesis means 15 is transmitted to the terminal device 2 via the communication means 11, and the viewer can watch the video on the television receiver T via the terminal device 2.

[0041] In this way, the first audio information is extracted based on the audio of the video that is made up of video and audio, and the spot video information is cut out based on the video from which the first audio information was extracted. Therefore, the audio according to the first audio information that matches the video according to the spot video information is played back, allowing the viewer to watch without feeling uncomfortable.

[0042] Furthermore, since the audio playback instruction means 12 specifies the playback order of the first audio information in the first audio playback layer, the playback order of the video based on the spot video information and the audio based on the first audio information can be changed during playback, making it possible to make the video less boring to the viewer. Furthermore, by specifying the second audio information as the second audio playback layer and playing it back, the audio from the second audio information and the audio from the first audio information can be played back in combination, which further reduces the viewers' boredom when watching the video.

[0043] Since audio reproduction instruction means 12 randomly selects the first audio information, not only is the first audio information randomly reproduced, but spot video information is also randomly assigned to the first video reproduction layer according to the first audio information and reproduced. Therefore, even if the video is reproduced repeatedly, the reproduction order will not be the same, so video reproduction device 1 can provide the viewer with video that they will not tire of.

[0044] When the first audio information has been played for 11 seconds (the first basic time), and the spot video information played for 6 seconds (the second basic time) ends, the video composition means plays the base video information specified by the second video playback layer. This causes videos based on the base video information to be played between each piece of spot video information. Therefore, the alternating playback of the spot video information and the base video information creates a complex combination, creating a sense of freshness.

[0045] Furthermore, the music provided by the music providing means 14 is played by designating the generated music as the third audio playback layer, so that by playing not only the first audio information and the second audio information but also the generated music together, it is possible to create an image with depth and richness.

[0046] In this embodiment, the video playback device 1 is installed in the hotel H, but it may also be installed on the cloud and communicate with the terminal device 2 via the Internet.

[0047] The first audio information and spot video information extracted from the video, and the second audio information are stored in the storage means 18, but may be switched for each season. Alternatively, the first audio information, spot video information, and second audio information relating to each of the four seasons may be stored in the storage means 18, the audio reproduction instruction means 12 may select the first audio information based on the date, time, temperature, and weather input from outside, and the video reproduction instruction means 13 may select the spot video information associated with the selected first audio information. This allows viewers to watch videos that are appropriate for the season. [Industrial Applicability]

[0048] The present invention is suitable for video playback devices installed in various facilities, and is particularly suitable for accommodation facilities. [Explanation of symbols]

[0049] 10 Video playback system 1. Video playback device 11. Means of communication 12 Audio playback instruction means 13 Video playback instruction means 14 Music distribution methods 15 Video Composition Methods 16 Audio extraction method 17 Video Extraction Methods 18 Memory means 2. Terminal Device T television receiver H Hotel R Guest Room

Claims

1. a storage means for storing spot video information obtained by extracting a predetermined time of video information based on the video from which the first audio information was extracted in association with a plurality of first audio information pieces obtained by extracting a plurality of audio information pieces for a predetermined time based on one or more videos consisting of video and audio, and for storing a plurality of second audio information pieces to be played together with the first audio information; an audio reproduction instruction means for specifying the reproduction order of the first audio information in the first audio reproduction layer and for specifying the reproduction order of the second audio information in the second audio reproduction layer; a video playback instruction means for specifying, on a first video playback layer, a playback timing of the spot video information associated with the first audio information specified by the audio playback instruction means; a video synthesis means for synthesizing a video based on the first and second audio information specified by the first audio playback layer and the second audio playback layer and the spot video information specified by the first video playback layer.

2. 2. The video reproducing apparatus according to claim 1, wherein the audio reproduction instruction means randomly specifies the plurality of pieces of first audio information, including no audio.

3. The first audio information is extracted by a first basic time as an audio length; the spot video information is cut out based on a second basic time, the length of which is shorter than the first basic time, The storage means further stores base video information longer than the spot video information, the video playback instruction means instructs that the base video information is repeatedly played back by the second video playback layer, 3. The video playback device according to claim 1, wherein the video synthesis means plays the base video information specified by the second video playback layer when the spot video information ends while the first audio information is being played back.

4. A video playback device as described in any one of claims 1 to 3, wherein the audio playback instruction means, when designating the second audio information as the second audio playback layer, designates other second audio information as the second audio playback layer if it determines that the combination is not possible by referring to the first condition information of the second audio information and the second condition information of the spot video information.

5. an audio extraction means extracting audio of a predetermined time based on one or more images consisting of video and audio as a plurality of first audio information and storing the extracted audio in a storage means, and also storing a plurality of second audio information to be played together with the first audio information in the storage means; a step in which a video clipping means clips out video information of a predetermined time as spot video information based on the video from which the first audio information has been extracted, and stores the spot video information in a storage means in association with the first audio information; an audio reproduction instruction means specifying the reproduction order of the first audio information in a first audio reproduction layer and specifying the reproduction order of the second audio information in a second audio reproduction layer; a step in which a video playback instruction means specifies, on a first video playback layer, a playback timing of the spot video information associated with the first audio information specified by the audio playback instruction means; A video playback method including a step in which a video synthesis means synthesizes a video based on first and second audio information specified by the first audio playback layer and the second audio playback layer and the spot video information specified by the first video playback layer.

6. Computer, a storage means for storing spot video information obtained by extracting video information of a predetermined time based on the video from which the first audio information was extracted in association with a plurality of first audio information pieces obtained by extracting a plurality of audio pieces of a predetermined time based on one or more videos consisting of video and audio, and for storing a plurality of second audio information pieces to be played together with the first audio information; an audio reproduction instruction means for specifying the reproduction order of the first audio information in the first audio reproduction layer and for specifying the reproduction order of the second audio information in the second audio reproduction layer; a video playback instruction means for specifying, on a first video playback layer, a playback timing of the spot video information associated with the first audio information specified by the audio playback instruction means; A video playback program that functions as a video synthesis means for synthesizing video based on the first and second audio information specified by the first audio playback layer and the second audio playback layer and the spot video information specified by the first video playback layer.

Images