Video delivery device, video delivery system, and video delivery program

Abstract

A video delivery device (30) is communicatively connected to panoramic imaging cameras (10a, 10b) for imaging a panoramic view of a prescribed area at different angles to generate panoramic videos, and partial imaging cameras (20a to 20f) for imaging different partial areas in the prescribed area to generate partial videos, and comprises a panoramic delivery video generation unit (312). The panoramic delivery video generation unit (312) generates a panoramic delivery video by using the panoramic video captured by one of the panoramic imaging cameras, delivers the panoramic delivery video to viewer terminals, and switches the delivery video being delivered to a viewer terminal that has designated any of the partial videos respectively captured by the plurality of partial imaging cameras from the panoramic delivery video to the designated partial video. The panoramic delivery video generation unit (312) generates the panoramic delivery video by using a panoramic video selected on the basis of information indicating the status in the prescribed area or information indicating the delivery status of the partial videos.

Description

Video distribution device, video distribution system, and video distribution program

[0001] The present invention relates to a video distribution device, a video distribution system, and a video distribution program.

[0002] There is a technology in which a panoramic video of a specified area is distributed to multiple viewer terminals, and when a partial area within the panoramic video is specified from one of the multiple viewer terminals, the video distributed to the viewer terminal is switched to a partial video of the specified partial area. By switching the video to be distributed in this way, the video of the partial area in which the user is interested can be displayed full screen on the viewer terminal and viewed.

[0003] Japanese Patent Application Laid-Open No. 2023-92665

[0004] When using the above-mentioned technology, if a user manually specifies a partial area within a panoramic image on a viewer terminal, the portions of the subject in the panoramic image that are farther from the camera capturing the panoramic image are displayed smaller, making it difficult for the user to determine whether or not that is the partial area they want to view.

[0005] An object of the present invention is to provide a video distribution device, a video distribution system, and a video distribution program that distribute a panoramic video that allows a user to easily determine a partial area that the user wants to view.

[0006] A video distribution device according to a first aspect of this embodiment is communicatively connected to a plurality of panoramic cameras that capture a panoramic view of a predetermined area from different angles and each generate a panoramic video, and a plurality of partial capture cameras that capture different partial areas within the predetermined area and each generate a partial video, and generates a panoramic distribution video using the panoramic video captured by any of the plurality of panoramic cameras and distributes it to a viewer terminal, and is equipped with a distribution video generation unit that, upon receiving from the viewer terminal designation information that designates any of the partial videos captured by each of the plurality of partial capture cameras, switches the distribution video to be distributed to the viewer terminal from the panoramic distribution video to the partial video designated by the designation information, and the distribution video generation unit executes a panoramic video selection process that selects one panoramic video from the plurality of panoramic videos captured by each of the plurality of panoramic cameras, based on information indicating the situation within the predetermined area or information indicating the distribution status of the partial videos, and generates the panoramic distribution video using the panoramic video selected in the panoramic video selection process.

[0007] A video distribution system according to a second aspect of this embodiment includes a plurality of panoramic cameras that capture a panoramic view of a predetermined area from different angles and generate each panoramic video; a plurality of partial capture cameras that capture a different partial area within the predetermined area and generate each partial video; and a video distribution device that generates a panoramic distribution video using the panoramic video captured by any of the plurality of panoramic cameras and distributes it to a viewer terminal, and that has a distribution video generation unit that, upon receiving from the viewer terminal designation information that designates one of the partial videos captured by each of the plurality of partial capture cameras, switches the distribution video to be distributed to the viewer terminal from the panoramic distribution video to the partial video designated by the designation information, wherein the distribution video generation unit executes a panoramic video selection process that selects one panoramic video from among the plurality of panoramic videos captured by each of the plurality of panoramic cameras, based on information indicating the situation within the predetermined area or information indicating the distribution status of the partial video, and generates the panoramic distribution video using the panoramic video selected in the panoramic video selection process.

[0008] A video distribution program according to a third aspect of this embodiment is communicably connected to a plurality of panoramic cameras that capture a panoramic view of a predetermined area from different angles and each generate a panoramic video, and a plurality of partial capture cameras that capture different partial areas within the predetermined area and each generate a partial video, and generates a panoramic distribution video using the panoramic video captured by any of the plurality of panoramic cameras and distributes it to a viewer terminal, and upon receiving designation information from the viewer terminal that designates any of the partial videos captured by each of the plurality of partial capture cameras, the video distribution program has a distribution video generation unit that switches the distribution video to be distributed to the viewer terminal from the panoramic distribution video to the partial video designated by the designation information, and executes a panoramic video selection process that selects one panoramic video from the plurality of panoramic videos captured by each of the plurality of panoramic cameras based on information indicating the situation within the predetermined area or information indicating the distribution status of the partial video, and realizes the function of generating the panoramic distribution video using the panoramic video selected in the panoramic video selection process and distributing it to the viewer terminal.

[0009] According to the present embodiment, it is possible to provide a video distribution device, a video distribution system, and a video distribution program that distribute a panoramic video that allows a user to easily determine the partial area that the user wants to view.

[0010] FIG. 1 is an overall diagram showing the configuration of a video distribution system according to this embodiment. FIG. 2 is a block diagram showing the detailed configuration of the video distribution system according to this embodiment. FIG. 3 is a sequence diagram showing processing executed between a video distribution device and a viewer terminal in the video distribution system according to this embodiment. FIG. 4A is an example of a panoramic view distribution video distributed using a panoramic view video captured by a first panoramic view camera in the video distribution system according to this embodiment. FIG. 4B is an example of a panoramic view distribution video distributed using a panoramic view video captured by a second panoramic view camera in the video distribution system according to this embodiment.

[0011] The video distribution device according to this embodiment will be described below with reference to the drawings. In this embodiment, a case where multiple gymnastics events taking place in a gymnasium are filmed and distributed will be taken as an example.

[0012] 1 is an overall diagram showing the configuration of a video distribution system 1 using a video distribution device 30. The video distribution system 1 films and distributes multiple gymnastics events held in a gymnasium X. Within the gymnasium X, floor (women's) events are held in area ARa, which is a partial area within the gymnasium X, balance beam events are held in area ARb, vault (women's) events are held in area ARc, floor (men's) events are held in area ARd, horizontal bar events are held in area ARe, and pommel horse events are held in area ARf.

[0013] The video distribution system 1 comprises two panoramic cameras, a first panoramic camera 10a and a second panoramic camera 10b, six partial shooting cameras, a first partial shooting camera 20a, a second partial shooting camera 20b, a third partial shooting camera 20c, a fourth partial shooting camera 20d, a fifth partial shooting camera 20e, and a sixth partial shooting camera 20f, a video distribution device 30, and a viewer terminal 40.

[0014] The first panoramic camera 10a is installed near the ceiling in the front left corner when looking into the gymnasium X from the entrance E of the gymnasium X, and the second panoramic camera 10b is installed near the ceiling in the front right corner. The first partial image capturing camera 20a is installed near the area ARa, the second partial image capturing camera 20b is installed near the area ARb, the third partial image capturing camera 20c is installed near the area ARc, the fourth partial image capturing camera 20d is installed near the area ARd, the fifth partial image capturing camera 20e is installed near the area ARe, and the sixth partial image capturing camera 20f is installed near the area ARf.

[0015] The number of cameras for capturing a panoramic view is not limited to two, and may be any number greater than or equal to two. The number of cameras for capturing a partial view is not limited to six, and may be any number greater than or equal to two. For the sake of simplicity, only one viewer terminal 40 is shown connected to the video distribution device 30 in Fig. 1, but in reality, multiple viewer terminals 40 are connected to the video distribution device 30 so as to be able to communicate with each other.

[0016] 2 is a block diagram showing a detailed configuration of the video distribution system 1. The first panoramic shooting camera 10a has an imaging unit 11a, an encoder 12a, and a transmission unit 13a. The imaging unit 11a captures a panoramic view of the gymnasium X from a predetermined angle to generate a panoramic video. The encoder 12a encodes the panoramic video generated by the imaging unit 11a. The transmission unit 13a transmits the panoramic video encoded by the encoder 12a to the video distribution device 30 together with a video identifier for identifying the panoramic video.

[0017] The second panoramic view shooting camera 10b has an imaging unit 11b, an encoder 12b, and a transmission unit 13b. The imaging unit 11b captures a panoramic view of the gymnasium X from an angle different from that captured by the imaging unit 11a of the first panoramic view shooting camera 10a to generate a panoramic view video. The encoder 12b encodes the panoramic view video generated by the imaging unit 11b. The transmission unit 13b transmits the panoramic view video encoded by the encoder 12b to the video distribution device 30 together with a video identifier for identifying the panoramic view video.

[0018] The first partial image capturing camera 20a has an imaging unit 21a, an encoder 22a, and a transmission unit 23a. The imaging unit 21a captures an image of an area ARa, which is a partial area within the gymnasium X, to generate a partial video. The encoder 22a encodes the partial video generated by the imaging unit 21a. The transmission unit 23a transmits the partial video encoded by the encoder 22a to the video distribution device 30 together with a video identifier for identifying the partial video.

[0019] The second partial image capturing camera 20b, the third partial image capturing camera 20c, the fourth partial image capturing camera 20d, the fifth partial image capturing camera 20e, and the sixth partial image capturing camera 20f have the same configuration as the first partial image capturing camera 20a. The second partial image capturing camera 20b encodes the partial video generated by capturing area ARb and transmits it to the video distribution device 30 together with a video identifier for identifying the partial video. The third partial image capturing camera 20c encodes the partial video generated by capturing area ARc and transmits it to the video distribution device 30 together with a video identifier for identifying the partial video. The fourth partial image capturing camera 20d encodes the partial video generated by capturing area ARd and transmits it to the video distribution device 30 together with a video identifier for identifying the partial video. The fifth partial image capturing camera 20e encodes the partial video generated by capturing area ARe and transmits it to the video distribution device 30 together with a video identifier for identifying the partial video. The sixth partial image capturing camera 20f captures the area ARf and generates a partial image, encodes the image, and transmits the encoded image to the image distribution device 30 together with a video identifier for identifying the partial image.

[0020] The video distribution device 30 has a CPU 31. The CPU 31 is, for example, a CPU (Central Processing Unit) provided in a general-purpose microcomputer, and by installing and executing a predetermined video distribution program, configures one or more information processing units described below.

[0021] CPU 31 has a panoramic video acquisition unit 311, a panoramic video distribution generation unit 312, a partial video acquisition unit 313, a distribution unit 314, and a specified information acquisition unit 315. CPU 31 is also referred to as a distribution video generation unit. In this case, the distribution video generation unit has panoramic video acquisition unit 311, panoramic video distribution generation unit 312, a partial video acquisition unit 313, a distribution unit 314, and a specified information acquisition unit 315.

[0022] The panoramic view image acquisition unit 311 acquires the encoded panoramic view images transmitted from the first panoramic view camera 10a and the second panoramic view camera 10b. The panoramic view distribution image generation unit 312 executes a panoramic view image selection process to select the panoramic view image to be used for distribution from the panoramic view image captured by the first panoramic view camera 10a or the panoramic view image captured by the second panoramic view camera 10b. Details of the panoramic view image selection process performed by the panoramic view distribution image generation unit 312 will be described later.

[0023] The panoramic view delivery video generation unit 312 decodes the panoramic view video selected in the panoramic view video selection process from the encoded panoramic view videos acquired by the panoramic view video acquisition unit 311. Specifically, the panoramic view delivery video generation unit 312 decodes the panoramic view video assigned a video identifier that matches the video identifier of the panoramic view video selected in the panoramic view video selection process from the encoded panoramic view videos acquired by the panoramic view video acquisition unit 311. The panoramic view delivery video generation unit 312 generates and encodes panoramic view delivery video by superimposing frame images indicating the portions captured by the first partial capture camera 20a, the second partial capture camera 20b, the third partial capture camera 20c, the fourth partial capture camera 20d, the fifth partial capture camera 20e, and the sixth partial capture camera 20f on the decoded panoramic view video. Note that the video distribution device 30 stores designation information specifying each frame image in association with the video identifier of the partial video corresponding to the frame image.

[0024] The partial image acquisition unit 313 acquires encoded partial images transmitted from the first partial image capturing camera 20a, the second partial image capturing camera 20b, the third partial image capturing camera 20c, the fourth partial image capturing camera 20d, the fifth partial image capturing camera 20e, and the sixth partial image capturing camera 20f.

[0025] Distribution unit 314 distributes the panoramic distribution video generated by panoramic distribution video generation unit 312 to viewer terminal 40. When distribution unit 314 acquires designation information designating one of the frame images in the panoramic distribution video via designation information acquisition unit 315 from viewer terminal 40 to which the panoramic distribution video has been distributed, distribution unit 314 switches the distribution video to be distributed to viewer terminal 40 from the panoramic distribution video to a partial video corresponding to the frame image designated by the designation information. Specifically, distribution unit 314 switches the distribution video to be distributed to viewer terminal 40 from the panoramic distribution video to a partial video assigned a video identifier matching the video identifier linked to the acquired designation information.

[0026] When the designation information acquisition unit 315 acquires designation information that designates one of the frame images in the panoramic view distribution video from the viewer terminal 40 , it sends this designation information to the distribution unit 314 .

[0027] The viewer terminal 40 is a terminal operated by a user U who watches the distributed video, and includes a video acquisition unit 41 , a decoder 42 , a display unit 43 , an input unit 44 , and a specified information transmission unit 45 .

[0028] The video acquisition unit 41 acquires the encoded panoramic distribution video or partial video transmitted from the video distribution device 30. The decoder 42 decodes the encoded distribution video acquired by the video acquisition unit 41. The display unit 43 plays the video by displaying the information decoded by the decoder 42.

[0029] The input unit 44 inputs information about an operation performed by the user U. When information about an operation to select one of the frame images in the panoramic distribution video displayed on the display unit 43 is input from the input unit 44, the designation information transmission unit 45 generates designation information that designates the selected frame image and transmits it to the video distribution device 30.

[0030] [Operation of Video Distribution System 1] The following describes the operation of video distribution system 1. While video distribution system 1 is in operation, first panoramic camera 10a and second panoramic camera 10b each capture panoramic images of gymnasium X to generate panoramic images, encode the images, and sequentially transmit them to video distribution device 30.

[0031] In addition, the first partial image capturing camera 20a, the second partial image capturing camera 20b, the third partial image capturing camera 20c, the fourth partial image capturing camera 20d, the fifth partial image capturing camera 20e, and the sixth partial image capturing camera 20f each capture an image of the area to be captured, generate partial images, encode the images, and transmit them sequentially to the video distribution device 30.

[0032] In the video distribution device 30, the panoramic video acquisition unit 311 acquires the encoded panoramic video transmitted from the first panoramic camera 10a and the second panoramic camera 10b, and sends it to the panoramic video distribution generation unit 312.

[0033] In addition, the partial image acquisition unit 313 acquires the encoded partial images transmitted from the first partial image capturing camera 20a, the second partial image capturing camera 20b, the third partial image capturing camera 20c, the fourth partial image capturing camera 20d, the fifth partial image capturing camera 20e, and the sixth partial image capturing camera 20f.

[0034] The panoramic view delivery video generation unit 312 executes a panoramic view video selection process at predetermined time intervals, for example, one minute intervals, to select a panoramic view video to be used for delivery from among the panoramic view videos captured by the first panoramic view shooting camera 10a and the panoramic view videos captured by the second panoramic view shooting camera 10b. The panoramic view video selection processes (1) to (4) executed by the panoramic view delivery video generation unit 312 will now be described.

[0035] [Panoramic image selection process (1)] A 360° camera (not shown) is installed inside gymnasium X to capture images of the spectator seats in gymnasium X, and panoramic image distribution generation unit 312 determines the line of sight or facial direction of each spectator as the situation inside gymnasium X based on analysis information of the image information captured by this 360° camera, and identifies the area that each spectator is looking at. From the panoramic image captured by first panoramic image capture camera 10a and the panoramic image captured by second panoramic image capture camera 10b, panoramic image distribution generation unit 312 identifies the panoramic image that shows an area with a larger number of spectators viewing it. Panoramic image distribution generation unit 312 selects the identified panoramic image as the panoramic image to be used for distribution.

[0036] For example, if the panoramic view distribution video generation unit 312 determines that the number of spectators in gymnasium X looking at the area ARa, area ARb, and area ARc portions is greater than the number of spectators looking at the area ARd, area ARe, and area ARf portions, it generates a panoramic view distribution video using the panoramic view video captured by the first panoramic view shooting camera 10a, as shown in Figure 4A.

[0037] Conversely, if it is determined that the number of spectators viewing the area ARd, area ARe, and area ARf portions is greater than the number of spectators viewing the area ARa, area ARb, and area ARc portions, the panoramic view distribution video generation unit 312 generates a panoramic view distribution video using the panoramic view video captured by the second panoramic view shooting camera 10b, as shown in Figure 4B.

[0038] In this way, by selecting the panoramic image to be used for the distribution image, the panoramic image distribution generation unit 312 can generate a panoramic image distribution in which areas in gymnasium X that are attracting a lot of attention from spectators are displayed in a large size.

[0039] [Panoramic image selection process (2)] The panoramic image distribution generation unit 312 decodes and analyzes the encoded panoramic images transmitted from the first panoramic image shooting camera 10a and the second panoramic image shooting camera 10b, respectively, to detect the amount of movement of the subjects in the left half area and the right half area of ​​the gymnasium X as viewed from the entrance E, as the situation inside the gymnasium X.

[0040] The panoramic view distribution image generating unit 312 identifies the panoramic view image captured by the first panoramic view shooting camera 10 a or the panoramic view image captured by the second panoramic view shooting camera 10 b, which one shows a larger image of the area with the greater amount of subject movement. The panoramic view distribution image generating unit 312 selects the identified panoramic view image as the panoramic view image to be used for distribution.

[0041] For example, when the panoramic view delivery video generating unit 312 determines that the movement of the subject is greater in the left half area as seen from the entrance E than in the right half area, it generates a panoramic view delivery video using the panoramic view video photographed by the first panoramic view photographing camera 10a.

[0042] Conversely, when it is determined that the movement of the subject is greater in the right half area as viewed from the entrance E than in the left half area, the panoramic view distribution video generating unit 312 generates a panoramic view distribution video using the panoramic view video photographed by the second panoramic view photographing camera 10b.

[0043] In addition, the panoramic view distribution video generation unit 312 may detect the amount of movement of the subject by decoding and analyzing the encoded partial video transmitted from each of the first partial shooting camera 20a to the sixth partial shooting camera 20f, and generate a panoramic view distribution video using a panoramic view video that shows larger areas of the subject with a large amount of movement.

[0044] By selecting the panoramic video to be used for the distribution video in this way, the panoramic video distribution generation unit 312 can generate a panoramic video distribution in which the area where the competition is currently taking place is displayed in a large size.

[0045] [Panoramic Image Selection Process (3)] A first microphone (not shown) is installed near the first panoramic camera 10a, and a second microphone (not shown) is installed near the second panoramic camera 10b. The panoramic distribution image generation unit 312 detects the sounds of the spectators' cheers picked up by the first microphone and the second microphone as the situation inside the gymnasium X. Based on the detected sounds, the panoramic distribution image generation unit 312 identifies the microphone that picked up the louder sound of the spectators' cheers. The panoramic distribution image generation unit 312 also selects the panoramic image captured by the panoramic camera near the identified microphone as the panoramic image to be used for distribution.

[0046] For example, if the panoramic view distribution video generating unit 312 determines that the cheers of the audience picked up by the first microphone are louder than the cheers of the audience picked up by the second microphone, it generates a panoramic view distribution video using the panoramic view video captured by the first panoramic view shooting camera 10a.

[0047] Conversely, if it is determined that the cheers of the audience picked up by the second microphone are louder than the cheers of the audience picked up by the first microphone, the panoramic view distribution video generating unit 312 generates a panoramic view distribution video using the panoramic view video taken by the second panoramic view shooting camera 10b.

[0048] In this way, by selecting the panoramic image to be used for the distribution image, the panoramic image distribution generation unit 312 can generate a panoramic image distribution in which areas in gymnasium X that are highly exciting for the spectators are displayed in a large size.

[0049] [Panoramic View Video Selection Process (4)] The panoramic view video distribution generation unit 312 counts the number of partial videos currently being distributed to the viewer terminal 40 for each of the partial videos generated by the first partial image capturing camera 20a, the second partial image capturing camera 20b, the third partial image capturing camera 20c, the fourth partial image capturing camera 20d, the fifth partial image capturing camera 20e, and the sixth partial image capturing camera 20f, and acquires this count as information indicating the distribution status. The distribution of partial videos to the viewer terminal 40 will be described later.

[0050] The panoramic view distribution video generation unit 312 identifies the panoramic view video that shows the area that is the subject of the partial video with the largest number of counted distributions larger than the panoramic view video captured by the first panoramic view shooting camera 10 a and the panoramic view video captured by the second panoramic view shooting camera 10 b. The panoramic view distribution video generation unit 312 selects the identified panoramic view video as the panoramic view video to be used for distribution.

[0051] For example, if the panoramic distribution video generation unit 312 determines that the total number of distributions of the partial video generated by the first partial shooting camera 20a, the partial video generated by the second partial shooting camera 20b, and the partial video generated by the third partial shooting camera 20c is greater than the total number of distributions of the partial video generated by the fourth partial shooting camera 20d, the partial video generated by the fifth partial shooting camera 20e, and the sixth partial shooting camera 20f, it generates a panoramic distribution video using the panoramic video captured by the first panoramic shooting camera 10a.

[0052] Conversely, if it is determined that the total number of broadcasts of the partial video generated by the fourth partial shooting camera 20d, the fifth partial shooting camera 20e, and the sixth partial shooting camera 20f is greater than the total number of broadcasts of the partial video generated by the first partial shooting camera 20a, the second partial shooting camera 20b, and the third partial shooting camera 20c, then a panoramic broadcast video is generated using the panoramic video captured by the second panoramic shooting camera 10b.

[0053] By selecting a panoramic view video to be used for the distribution video in this way, the panoramic view distribution video generation unit 312 can generate a panoramic view distribution video in which areas that are attracting a lot of attention from viewers are displayed in a large size.

[0054] The panoramic view delivery video generation unit 312 determines in advance which of the above-described panoramic view video selection processes (1) to (4) to use for each content or each type of content. In this case, one of the panoramic view video selection processes (1) to (4) may be specified and set for each content or each type of content, or multiple different panoramic view video selection processes may be set.

[0055] When setting a plurality of different panoramic image selection processes for a given content or type of content, the panoramic image delivery generation unit 312 sets a priority for each panoramic image selection process in advance. Then, the panoramic image delivery generation unit 312 executes the panoramic image selection processes in descending order of priority, and uses the first properly selected panoramic image as the delivery image.

[0056] For example, if the highest priority panoramic image selection process (1) is executed, but the audience is looking in different directions and an area with a large number of audience members cannot be identified, making it impossible to select a panoramic image appropriately, then the next highest priority panoramic image selection process (2) is executed. By executing multiple panoramic image selection processes in sequence in this way, it is possible to select a panoramic image to be used for distribution video with even greater accuracy and reliability.

[0057] FIG. 3 is a sequence diagram showing the distribution process executed between the video distribution device 30 and the viewer terminal 40 while the panoramic video selection process is being executed at predetermined time intervals as described above.

[0058] The panoramic view distribution video generation unit 312 decodes the panoramic view video selected by the panoramic view video selection process described above from the encoded panoramic view videos acquired from the first panoramic view camera 10a and the second panoramic view camera 10b. The panoramic view distribution video generation unit 312 generates a panoramic view distribution video by superimposing, on the decoded panoramic view video, frame images showing the portions captured by the first partial view camera 20a, the second partial view camera 20b, the third partial view camera 20c, the fourth partial view camera 20d, the fifth partial view camera 20e, and the sixth partial view camera 20f. The panoramic view distribution video generation unit 312 does not need to superimpose a frame image on the panoramic view video. In this case, when the panoramic view distribution video is displayed on the viewer terminal 40, the display unit 43 superimposes the respective frame images.

[0059] The panoramic video used here is selected by one of the panoramic video selection processes (1) to (4), so the panoramic video distribution generation unit 312 can generate a panoramic video distribution in which areas that are likely to be of great interest to viewers are displayed enlarged.

[0060] The distribution unit 314 performs streaming distribution by encoding the panoramic view distribution video generated by the panoramic view distribution video generation unit 312 and sequentially transmitting the encoded panoramic view distribution video to multiple viewer terminals 40 (S1). Furthermore, if the panoramic view distribution video generation unit 312 does not superimpose a frame image, the distribution unit 314 transmits a selected panoramic view video from the encoded panoramic view videos acquired from the first panoramic view shooting camera 10a and the second panoramic view shooting camera 10b as the panoramic view distribution video. In this case, the distribution unit 314 may transmit information about the portions captured by each of the first partial view shooting camera 20a to the sixth partial view shooting camera 20f along with the panoramic view distribution video.

[0061] In the viewer terminal 40, the encoded panoramic view distribution video distributed from the video distribution device 30 is acquired by the video acquisition unit 41 and decoded by the decoder 42. The decoded panoramic view distribution video is sequentially displayed on the display unit 43 and streamed (S2).

[0062] 4A is an example of a panoramic view distribution image using a panoramic view image captured by the first panoramic view camera 10 a. In the panoramic view distribution image in FIG. 4A , a frame image Fa indicating the area ARa captured by the first partial image capture camera 20 a, a frame image Fb indicating the area ARb captured by the second partial image capture camera 20 b, a frame image Fc indicating the area ARc captured by the third partial image capture camera 20 c, a frame image Fd indicating the area ARd captured by the fourth partial image capture camera 20 d, a frame image Fe indicating the area ARe captured by the fifth partial image capture camera 20 e, and a frame image Ff indicating the area ARf captured by the sixth partial image capture camera 20 f are superimposed on the panoramic view image captured by the first panoramic view camera 10 a. Furthermore, when the video distribution device 30 is configured to stream the panoramic distribution video without superimposing a frame image, the display unit 43 superimposes frame images Fa to Ff on the panoramic distribution video based on information relating to the parts photographed by each of the first partial photographing camera 20a to the sixth partial photographing camera 20f.

[0063] In FIG. 4A, areas ARa, ARb, and ARc, which are closer to the first panoramic photography camera 10a, are displayed larger than areas ARd, ARe, and ARf, which are farther from the first panoramic photography camera 10a.

[0064] Fig. 4B is an example of a distributed panoramic image using the panoramic image captured by the second panoramic camera 10b. In the distributed image of Fig. 4B, frame images Fa, Fb, Fc, Fd, Fe, and Ff are superimposed on the panoramic image captured by the second panoramic camera 10b, as in Fig. 4A.

[0065] In FIG. 4B, areas ARd, ARe, and ARf, which are closer to the second panoramic photography camera 10b, are displayed larger than areas ARa, ARb, and ARc, which are farther from the second panoramic photography camera 10b.

[0066] 4A or 4B is generated and distributed, and while streaming playback is being performed on viewer terminal 40, user U uses input unit 44 of viewer terminal 40 to select a frame image, for example, frame image Fa, corresponding to the position where the desired competition is displayed from the panoramic distribution video displayed on display unit 43. When user U performs the operation to select frame image Fa ("YES" in S3), designation information transmission unit 45 generates designation information that designates the selected frame image Fa and transmits it to video distribution device 30 (S4).

[0067] In the video distribution device 30, the designation information acquisition unit 315 acquires designation information that designates the frame image Fa in the panoramic distribution video transmitted from the viewer terminal 40 (S5), and sends this designation information to the panoramic distribution video generation unit 312.

[0068] Based on the designation information acquired from the designation information acquisition unit 315, the panoramic view distribution video generation unit 312 switches the distribution video to be distributed to the viewer terminal 40 that sent the designation information from the panoramic view distribution video to a partial video using the partial video captured by the first partial image capturing camera 20a that corresponds to the frame image Fa designated in the designation information. Specifically, the distribution unit 314 starts processing to distribute the encoded partial video of area ARa acquired by the partial image acquisition unit 313 from the first partial image capturing camera 20a to the viewer terminal 40 (S6).

[0069] At the viewer terminal 40, the encoded partial video distributed from the video distribution device 30 is acquired by the video acquisition unit 41 and decoded by the decoder 42. The decoded partial video is displayed on the display unit 43 and played back as a stream (S7). This allows the user U to view the video of the desired competition in full screen display.

[0070] Thereafter, when the user U uses the input unit 44 of the viewer terminal 40 to cancel the designation of the frame image Fa and return to displaying the panoramic distribution video ("YES" in S8), the designation information transmission unit 45 generates designation cancellation information and transmits it to the video distribution device 30 (S9).

[0071] In the video distribution device 30, the designation cancellation information transmitted from the viewer terminal 40 is acquired by the designation information acquisition unit 315 (S10), and this designation cancellation information is sent to the distribution unit 314 and the panoramic view distribution video generation unit 312.

[0072] When the panoramic view distribution video generation unit 312 receives the designation release information from the designation information acquisition unit 315, it executes one of the panoramic view distribution processes described above to select a suitable panoramic view video, and generates and encodes the panoramic view distribution video using the selected panoramic view video. When the distribution unit 314 receives the designation release information from the designation information acquisition unit 315, it switches the distribution video to be distributed to the viewer terminal 40 that sent the designation release information from the partial view video to the panoramic view distribution video. At that time, the distribution unit 314 distributes the panoramic view distribution video generated by the panoramic view distribution video generation unit 312 after receiving the designation release information to the viewer terminal 40 (S11). Thereafter, the video distribution device 30 continues distributing the panoramic view distribution video until it receives the next designation information from the viewer terminal 40, and proceeds to step S5 upon receiving the designation information.

[0073] When the video delivered from the video delivery device 30 is switched to the panoramic video, the viewer terminal 40 proceeds to step S2 and continues streaming playback.

[0074] According to the above embodiment, when the user selects a partial area that he or she wishes to view from within the panoramic image, the user can be provided with a panoramic image that allows the user to easily determine the partial area that he or she wishes to view.

[0075] In the above-described embodiment, when three or more panoramic cameras are installed in video distribution system 1, panoramic distribution video generation unit 312 of video distribution device 30 performs a panoramic video selection process to select one panoramic video from among the multiple panoramic videos captured by the multiple panoramic video cameras, based on information indicating the situation inside gymnasium X or information indicating the distribution status of partial videos. Then, panoramic distribution video generation unit 312 generates a panoramic video using the panoramic video selected in the panoramic video selection process. This makes it possible to provide the user with a panoramic video that makes it easier to determine the partial area they want to view with greater accuracy.

[0076] Furthermore, by programming the functional configuration of the video distribution device 30 described above and incorporating it into a computer, it is possible to construct a video distribution program that causes the computer to function as the video distribution device 30 .

[0077] According to the present embodiment, it is possible to provide a video distribution device, a video distribution system, and a video distribution program that distribute a panoramic video that allows a user to easily determine the partial area that the user wants to view.

Claims

1. A video distribution device that is communicably connected to a plurality of panoramic cameras that capture a panoramic view of a specified area from different angles and generate each panoramic video, and a plurality of partial shooting cameras that capture different partial areas within the specified area and generate each partial video, wherein the video distribution device generates a panoramic distribution video using the panoramic video captured by any of the plurality of panoramic shooting cameras and distributes it to a viewer terminal, and comprises a distribution video generation unit that, upon receiving from the viewer terminal specification information that specifies one of the partial videos captured by each of the plurality of partial shooting cameras, switches the distribution video to be distributed to the viewer terminal from the panoramic distribution video to the partial video specified by the specification information, and the distribution video generation unit executes a panoramic video selection process that selects one panoramic video from among the plurality of panoramic videos captured by each of the plurality of panoramic shooting cameras based on information indicating the situation within the specified area or information indicating the distribution status of the partial videos, and generates the panoramic distribution video using the panoramic video selected in the panoramic video selection process.

2. The video distribution device of claim 1, wherein the distribution video generation unit executes the panoramic video selection process based on the number of distributions of each partial video generated by each of the plurality of partial shooting cameras, which is information indicating the situation within the specified area, such as the partial area being viewed by people within the specified area, the amount of movement of the subject within the specified area, the audio within the specified area, or information indicating the distribution status of the partial video.

3. The video distribution device of claim 2, wherein the distribution video generation unit selects, as the panoramic video selection process, from among the plurality of panoramic videos, a panoramic video that shows the partial area in which more people are viewing the subject in a larger size.

4. The video distribution device of claim 2, wherein the distribution video generation unit selects, as the panoramic video selection process, from among the plurality of panoramic videos, a panoramic video in which the partial area with the greater amount of movement of the subject is shown larger.

5. The video distribution device of claim 2, wherein the distribution video generation unit selects, as the panoramic video selection process, from among the plurality of panoramic videos, a panoramic video that shows a larger image of the area that is the subject of the partial video that is distributed more frequently.

6. The video distribution device of claim 1, wherein the distribution video generation unit executes a plurality of different panoramic video selection processes in descending order of pre-set priority, and generates the panoramic distribution video using the first properly selected panoramic video.

7. A video distribution system comprising: a plurality of panoramic cameras that capture a panoramic view of a specified area from different angles and each generate a panoramic video; a plurality of partial camera cameras that capture a different partial area within the specified area and each generate a partial video; and a video distribution device having a distribution video generation unit that generates a panoramic distribution video using the panoramic video captured by any of the plurality of panoramic cameras and distributes it to a viewer terminal, and that, upon receiving from the viewer terminal designation information specifying one of the partial videos captured by each of the plurality of partial camera cameras, switches the distribution video to be distributed to the viewer terminal from the panoramic distribution video to the partial video designated by the designation information, wherein the distribution video generation unit executes a panoramic video selection process that selects one panoramic video from the plurality of panoramic videos captured by each of the plurality of panoramic cameras based on information indicating the situation within the specified area or information indicating the distribution status of the partial videos, and generates the panoramic distribution video using the panoramic video selected by the panoramic video selection process.

8. A video distribution device communicably connected to a plurality of panoramic cameras that shoot a panoramic view of a specified area from different angles and generate each panoramic video, and a plurality of partial shooting cameras that shoot different partial areas within the specified area and generate each partial video, wherein the video distribution device generates a panoramic distribution video using the panoramic video shot by any of the plurality of panoramic cameras and distributes it to a viewer terminal, and upon receiving from the viewer terminal designation information specifying one of the partial videos shot by each of the plurality of partial shooting cameras, the video distribution device is equipped with a distribution video generation unit that switches the distribution video to be distributed to the viewer terminal from the panoramic distribution video to the partial video designated by the designation information; and a video distribution program for implementing the functions of the video distribution device: executing a panoramic video selection process that selects one panoramic video from multiple panoramic videos shot by each of the plurality of panoramic cameras based on information indicating the situation within the specified area or information indicating the distribution status of the partial video; and generating the panoramic distribution video using the panoramic video selected in the panoramic video selection process and distributing it to the viewer terminal.

Images