Video information distribution apparatus, video information distribution method, and video information distribution program

Abstract

To provide a video information distribution apparatus, a video information distribution method, and a video information distribution program configured to allow a user who viewed video information to generate new video information, thereby developing the video information.SOLUTION: A metaverse space distribution server 10 distributes, to a user terminal 40, re-distribution video information to be generated based on original video information or response information input by a viewing user. The metaverse space distribution server 10 includes: response information acquisition means 13 which acquires response information regarding the original video information or the re-distribution video information; merge rule acquisition means 14 which acquires a merge rule that defines a rule for generating new re-distribution video information by merging the response information with the original video information or the re-distribution video information; re-distribution video generation means 15 which merges the original video information or the re-distribution video information with the response information based on the merge rule, to generate new re-distribution video information; and video distribution means 16 which distributes the new re-distribution video information to the user terminal 40.SELECTED DRAWING: Figure 5

Description

Technical Field

[0001] The present invention relates to a video information distribution device, a video information distribution method, and a video information distribution program, and particularly relates to a video information distribution device, a video information distribution method, and a re-distribution video distribution program that distribute re-distribution video information generated based on original video information.

Background Art

[0002] Conventionally, a virtual space called the metaverse space has been created, and users participating in the virtual space have been provided with virtual experiences. Specifically, the metaverse space is a virtual reality world in which multiple users share time and space. And users participating in the metaverse space can obtain appearances, tools, or human relationships that cannot be obtained in the real world through their own avatars, and enjoy virtual experiences that cannot be experienced in the real world.

[0003] In recent years, the number of cases of utilizing the metaverse space for music events has been increasing. Specifically, a music live, which is one of the music events, is held in the metaverse space, and by performing effects unique to virtual reality, the interest of the music live is enhanced. In addition, by holding a music live in the metaverse space, it is possible to attract a wide range of participants while suppressing the cost of the live venue. Patent Document 1 describes a metaverse space providing program in which users participating as avatars in a large-scale event with thousands to tens of thousands of participants can enjoy virtual experiences.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] According to the technology described in Patent Document 1, although the metaverse space of a large-scale event can be shared among a large number of users and the satisfaction of users can be improved, there is still room for further improvement. That is, in the conventional metaverse space, since the same time is shared among users, the video information is uniform and lacks variation for all users, and there is a problem that the distributed video cannot be enjoyed repeatedly.

[0006] The present invention has been made in view of the above problems, and an object of the present invention is to provide a video information distribution apparatus, a video information distribution method, and a video information distribution program capable of generating new video information by a user who has viewed the video information and thereby developing the video information. Another object of the present invention is to provide a video information distribution apparatus, a video information distribution method, and a video information distribution program capable of distributing video information rich in variation and valuable for individual users by generating redistributed video information reflecting the intention of a video provider or a user.

Means for Solving the Problems

[0007] The above problems are solved by a video information distribution apparatus according to the present invention, which is a video information distribution apparatus that distributes redistributed video information generated based on original video information or reaction information input by a viewer to a viewer terminal, the apparatus comprising: reaction information acquisition means for acquiring the reaction information regarding the original video information or the redistributed video information; fusion rule acquisition means for acquiring a fusion rule that defines a rule for generating new redistributed video information by fusing the original video information or the redistributed video information and the reaction information; redistributed video generation means for fusing the original video information or the redistributed video information and the reaction information based on the fusion rule to generate new redistributed video information; and video distribution means for distributing the new redistributed video information generated by the redistributed video generation means to the viewer terminal.

[0008] Also, according to the video information distribution method of the present invention, the above problem is solved by a computer that performs video information distribution processing for distributing original video information or re-distributed video information generated based on reaction information input by a viewer to a viewer terminal, including: a reaction information acquisition step of acquiring the reaction information regarding the original video information or the re-distributed video information; a fusion rule acquisition step of acquiring a fusion rule that defines a rule for fusing the original video information or the re-distributed video information and the reaction information to generate new re-distributed video information; a re-distributed video generation step of fusing the original video information or the re-distributed video information and the reaction information based on the fusion rule to generate new re-distributed video information; and a video distribution step of distributing the new re-distributed video information generated in the re-distributed video generation step to the viewer terminal.

[0009] Also, according to the video information distribution program of the present invention, the above problem is solved by causing a computer that performs video information distribution processing for distributing original video information or re-distributed video information generated based on reaction information input by a viewer to a viewer terminal to function as: a reaction information acquisition means for acquiring the reaction information regarding the original video information or the re-distributed video information; a fusion rule acquisition means for acquiring a fusion rule that defines a rule for fusing the original video information or the re-distributed video information and the reaction information to generate new re-distributed video information; a re-distributed video generation means for fusing the original video information or the re-distributed video information and the reaction information based on the fusion rule to generate new re-distributed video information; and a video distribution means for distributing the new re-distributed video information generated by the re-distributed video generation means to the viewer terminal.

[0010] According to the above configuration, by acquiring the reaction information of a viewer who has viewed the original video information or the re-distributed video information, and fusing the original video information or the re-distributed video information and the reaction information based on a fusion rule to generate new re-distributed video information, the video information can be developed. Therefore, it becomes possible to entertain users who repeatedly view the video information. In addition, by generating redistributed video information based on the fusion rules, it becomes possible to provide video information that is rich in variety and highly valuable to individual users.

[0011] In addition, the original video information is video information that is distributed in real time to one or more of the viewer terminals, and the reaction information may be information input by the viewer who views at least one of the originally distributed video information and the redistributed video information via the viewer terminal. According to the above configuration, a redistributed video is generated using the video information distributed in real time as the original video. Therefore, it is possible to share video information between one or more users who viewed the real-time video and users who viewed the redistributed video later, and it is possible to entertain users who repeatedly view the video information.

[0012] In addition, the original video information and the redistributed video information may be video information in the metaverse space. According to the above configuration, it is possible to provide a virtual experience that cannot be experienced in the real world through the video information in the metaverse space, and it is possible to improve the user satisfaction.

[0013] In addition, the fusion rule acquisition means may acquire at least one of the fusion rule input via the provider terminal used by the provider of the original video information and the fusion rule input via the viewer terminal. According to the above configuration, the provider of the original video information or the user who viewed the video can set the fusion rules. Therefore, since the intention of the provider of the original video information and the preferences of individual users can be reflected in the redistributed video information, it is possible to provide video information that is rich in variety and highly valuable.

[0014] In addition, the video information distribution device includes viewer information storage means for storing viewer attribute information in which viewer identification information capable of identifying the viewer is associated with the attribute information of the viewer, and input history information storage means for storing input history information in which the viewer identification information is associated with the past input history input by the viewer to the viewer terminal. The fusion rule includes a viewer determination condition related to at least any one of the viewer identification information, the viewer attribute information, and the input history information. The re-distributed video generation means may determine whether the viewer determination condition is satisfied, and based on the determination result, fuse the original video information or the re-distributed video information with the reaction information. According to the above configuration, by setting the fusion rule using at least any one of the viewer identification information, the viewer attribute information, and the past input history information as a determination condition, it is possible to provide video information of high value for each individual user.

[0015] In addition, the fusion rule includes a reaction information determination condition related to the reaction information. The re-distributed video generation means may determine whether the reaction information determination condition is satisfied, and based on the determination result, fuse the original video information or the re-distributed video information with the reaction information. According to the above configuration, among the reaction information input by various users, it is possible to set so as not to fuse inappropriate ones, so that it is possible to enhance the public value of the video information distributed by a large number of users.

[0016] In addition, the video information distribution device includes viewer position information acquisition means for acquiring the position information of the viewer in the metaverse space. The fusion rule includes a position determination condition related to the position information. The re-distributed video generation means may determine whether the position determination condition is satisfied, and based on the determination result, fuse the original video information or the re-distributed video information with the reaction information. According to the above configuration, by using the position information in the metaverse space as a determination condition, it is possible to arrange the avatar in an appropriate space, making it easy to visually recognize each individual avatar and enhancing the value of the video information.

[0017] Also, the position determination condition is a determination condition regarding the population density of the viewer in the metaverse space, and the re-distribution video generation means may include a process of fusing the video information of the viewer at a position where the population density in the metaverse space is low based on the determination result of the population density. According to the above configuration, since the population density of the avatars in the metaverse space can be adjusted to an appropriate population density, it is possible to smoothly operate an event (such as a music live) in the metaverse space in the same manner as an event in the real space.

[0018] Also, the position determination condition is a determination condition regarding the total number of viewers located within a predetermined area of the metaverse space, and the re-distribution video generation means may not fuse the videos of the viewers within the predetermined area based on the determination result of the total number within the predetermined area. According to the above configuration, since the total number of avatars within a predetermined area of the metaverse space can be adjusted to an appropriate number, it is possible to smoothly operate an event in the metaverse space in the same manner as an event in the real space.

[0019] Also, the original video information and the re-distribution video information have a plurality of partial video information output at a predetermined timing and in a predetermined order, the fusion rule includes a partial video determination condition regarding the partial video information, and the re-distribution video generation means may determine the success or failure of the partial video determination condition and fuse the original video information or the re-distribution video information and the reaction information based on the determination result. According to the above configuration, by setting the fusion rule using the partial video information (scene video) that constitutes a part of the timing of the entire video information as a determination condition, it is possible to reflect the intention of the original video provider and the intention of the user in the re-distribution video for each scene video, and it is possible to flexibly enhance the value of the video information.

[0020] Further, the fusion rule may include permission information indicating whether the viewer is permitted to distribute the new redistributed video information generated by the redistributed video generation means to viewers other than the viewer. According to the above configuration, since the user who has viewed the video information can set whether or not to redistribute the redistributed video information generated based on the reaction information input by the user and the fusion rule, it is possible to prevent the redistributed video information from being distributed to a third party that the user does not want.

[0021] Further, the fusion rule includes a contradiction determination condition for determining the presence or absence of a contradiction in the metaverse space, and the redistributed video generation means determines whether or not the contradiction determination condition is satisfied, and based on the determination result, fuses the original video information or the redistributed video information and the reaction information. According to the above configuration, it is possible to prevent the occurrence of contradictions that occur when users participating in the metaverse space share time and space.

[0022] Further, the video information distribution device includes viewer position information acquisition means for acquiring the position information of the viewer in the metaverse space, and the contradiction determination condition may include a position contradiction determination condition for determining a contradiction in the position information in the metaverse space. According to the above configuration, it is possible to prevent the occurrence of contradictions such as the avatars of multiple users overlapping when users participating in the metaverse space share the metaverse space.

Effects of the Invention

[0023] According to the video information distribution device, video information distribution method, and video information distribution program according to the present invention, it is possible to generate new video information by the user who has viewed the video information, thereby developing the video information. Further, according to the video information distribution device, video information distribution method, and video information distribution program according to the present invention, it is possible to distribute video information that is rich in changes and highly valuable for individual users.

Brief Description of the Drawings

[0024]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8A

Figure 8B

Figure 8C

Figure 8D

Figure 8E

Figure 8F

Figure 8G

Figure 8H

Figure 8I

Figure 8J

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Embodiments for Carrying Out the Invention

[0025] Hereinafter, with reference to FIGS. 1 to 16, a metaverse space distribution system 1 according to an embodiment of the present invention (hereinafter referred to as "this embodiment") will be described. However, the embodiment described below is merely an example for facilitating the understanding of the present invention and does not limit the present invention. That is, the present invention can be changed and improved without departing from its gist, and it goes without saying that the present invention includes equivalents thereof.

[0026] The metaverse space distribution system 1 of the present invention is used to distribute video information of a metaverse space in which a large number of viewing users participate to user terminals 40, and to obtain reaction information of the viewing users who have participated in the metaverse space to generate new redistributed video information. In addition, by generating a redistributed video based on a fusion rule set by at least one of the video information provider and the viewing user, it is possible to provide video information that is rich in changes and highly valuable to individual viewing users.

[0027] In the following description, the distribution of the metaverse space means transmitting the video information constituting the metaverse space to the terminals of the viewing users. The real-time video information of an entertainment event (outdoor music live) held in the metaverse space is referred to as original video information, and the video information generated based on the original video information and redistributed to the viewing users is referred to as redistributed video information.

[0028] In addition, in the following description, the reaction information is information that a viewing user of the original video information or the redistributed video information inputs as a reaction (response, reaction) to the original video information or the redistributed video information and is output as the speech and actions of the avatar 51 in the metaverse space. As a specific example of the reaction information, a "like" message by the viewing user can be cited, and other messages and actions expressing support, emotion, evaluation, etc. are included in the reaction information. The reaction information is also information used to generate redistributed video information by fusing it with the original video information.

[0029] In addition, in the following description, "fusion" means generating new video information by associating a plurality of video information with each other. "Fusion" includes generating a new graphics model by associating a plurality of graphics models and reaction information with each other, and generating a new frame image by overlapping the frame images constituting the video.

[0030] <Overview of the Metaverse Space Distribution System 1> <<System Configuration>> First, the configuration of the metaverse space distribution system 1 will be described. FIG. 1 shows the system configuration of the metaverse space distribution system 1. The metaverse space distribution system 1 is an information system used to distribute the metaverse space of an entertainment event (such as an event) in which a large number of viewing users participate. Specifically, the metaverse space distribution system 1 transmits the metaverse space of an outdoor music live to the user terminal 40 of the viewing user. The viewing user who receives the distribution can participate in the outdoor music live as an avatar 51 and enjoy a virtual experience through activities in the metaverse space.

[0031] The metaverse space distribution system 1 mainly includes a metaverse space distribution server 10, a host terminal 30, and a user terminal 40. The metaverse space distribution server 10, the host terminal 30, and the user terminal 40 are connected to be mutually communicable via a publicly available communication line NW such as the Internet. In FIG. 1, one user terminal 40 connected to the communication line NW represents a plurality of user terminals 40, and actually, a plurality of user terminals 40 used by a large number of viewing users are connected to the communication line NW.

[0032] The metaverse space distribution server 10 is a server device that distributes the metaverse space to the user terminal 40. In other words, the metaverse space distribution server 10 transmits the video information of the metaverse space shared by a plurality of viewing users to the user terminal 40 and provides a virtual experience in the metaverse space. The metaverse space distribution server 10 is managed and operated by the organizer of the outdoor music live in the metaverse space or a video distributor commissioned by the organizer. The metaverse space distribution server 10 corresponds to a video information distribution device.

[0033] The organizer terminal 30 is an information communication terminal operated by the organizer of the outdoor music live event, and is used when the organizer registers video information or sets the fusion rules described later. The organizer terminal 30 is a desktop-type terminal, but is not limited thereto. The organizer terminal 30 may be a notebook-type terminal or a tablet-type terminal. The organizer terminal 30 corresponds to the provider terminal.

[0034] The user terminal 40 is an information communication terminal operated by the viewing user who receives the distribution of the metaverse space, and is used when the viewing user participates in the outdoor music live event in the metaverse space or sets the fusion rules described later. The user terminal 40 is a smartphone, but is not limited thereto. The user terminal 40 may be a tablet-type terminal, a notebook-type terminal, or a desktop-type terminal. Further, the user terminal 40 may be a goggle-type terminal equipped with a head-mounted display and worn on the head of the viewing user. By adopting the goggle-type terminal, the sense of presence in the metaverse space can be enhanced, and it becomes possible to improve the satisfaction of the viewing user. The user terminal 40 corresponds to the viewer terminal.

[0035] <<Video information of the metaverse space>> Next, the metaverse space distributed by the metaverse space distribution server 10 and its video information will be described with reference to FIG. 2. FIG. 2 shows a metaverse space distributed from the metaverse space distribution server 10 to the user terminal 40, which shows a virtual outdoor music live venue 50. In the outdoor music live venue 50, a stage 50a, a front screen 50b, lighting 50c, an enlarged screen 50d, etc. are installed. On the front screen 50b and the enlarged screen 50d, the video of the artist 50e is displayed.

[0036] In addition, in the outdoor music live venue 50, an avatar 51 (virtual doppelgänger character) of the viewing user is displayed. The viewing user can support the artist 50e via the avatar 51 and communicate with other viewing users. That is, the viewing user can input a stamp 52, a comment 53 (see FIG. 4), or an action, etc., and thus can engage in activities with friends in the metaverse space and enjoy a virtual experience.

[0037] The viewing user can freely move the outdoor music live venue 50 by operating the movement cursor 54 and enjoy the video of the outdoor music live venue 50 from various angles. In addition, the viewing user can enjoy chatting with other viewing users by inputting the comment 53 in the comment input field 55.

[0038] In addition, the viewing user can output the stamp 52 by selecting any one of a plurality of stamp buttons 56b arranged on the stamp launcher 56a displayed when the stamp input icon 56 is pressed. As shown in FIG. 2, the viewing user can select a heart mark stamp button 56b, a like mark stamp button 56b, a congratulatory mark stamp button 56b, etc. However, the types of stamp buttons 56b that the viewing user can select are not limited to those shown in FIG. 2, and of course, other stamp buttons 56b can also be selected.

[0039] In addition, when the viewing user presses the action input icon 57, the viewing user can cause the avatar 51 to execute an action by selecting any one of a plurality of action buttons (not shown) arranged in an action launcher (not shown) displayed at that time. The viewing user can select an applause action to praise the artist 50e, a cheering action to cheer the artist 50e by waving one hand left and right above the head, a dance action to dance in rhythm while waving both hands above the head, and the like. However, the types of actions that the viewing user can select are not limited to this, and of course, other actions can also be selected.

[0040] In addition, when the viewing user presses the effect input icon 58, the viewing user can cause a special effect to be displayed at the outdoor music live venue 50 by selecting one effect button from a plurality of effect buttons arranged in an effect launcher (not shown) displayed at that time. The viewing user can select an effect to display soap bubbles at the outdoor music live venue 50, an effect to display balloons, an effect to display a mirror ball, and the like. However, the types of effects that the viewing user can select are not limited to this, and of course, other effects can also be selected.

[0041] As described above, the outdoor music live venue 50 in the metaverse space is composed of three-dimensional or two-dimensional (symbolic) model information of virtual objects such as the stage 50a and the reaction information of the avatar 51 (avatar body, comment 53, stamp 52, action, and effect display). In this specification, video information means model information that constitutes the metaverse space. However, it is not limited to this, and the video information may include a plurality of frame images that constitute a video.

[0042] Note that the entertainment (event) to which the metaverse space is applied is not limited to outdoor music concerts. The entertainment may be sports or dance. Also, in FIG. 2, the images of the artist 50e are displayed on the front screen 50b and the enlarged screen 50d, but it is not limited to this. The artist 50e may be displayed as an avatar 51. Also, the artist 50e may be an artist 50e existing in the real world or a virtual artist 50e.

[0043] <<Redistribution and Fusion Processing of Video Information>> Next, the redistribution and fusion processing of video information will be described. Conventionally, the metaverse space has been shared by the viewing users who participate in the metaverse space at the same time. In contrast, in this embodiment, the metaverse space distributed in the past is redistributed. Therefore, the metaverse space can be shared including the viewing users who participated in the taberse space afterwards. Also, the metaverse space distribution server 10 fuses the reaction information of the viewing users who participated in the metaverse space to generate a new metaverse space. Thereby, the metaverse space can be developed and it becomes possible to repeatedly enjoy the redistributed metaverse space. The fusion processing will be described in detail below.

[0044] As shown in FIG. 3, in the metaverse space initially distributed by the metaverse space distribution server 10, the artist 50e, the avatar 51a of the viewing user (real-time viewer) who participated in the metaverse space in real time, and the stamp 52a input by the real-time viewer are displayed.

[0045] After that, when the metaverse space is redistributed by the metaverse space distribution server 10, the artist 50e, the avatar 51a of the real-time viewer, and the avatar 51b of the viewing user (redistribution viewer) who views the redistributed video are displayed in the metaverse space. Similar to the real-time viewer, the redistribution viewer can input the stamp 52b. As a result, at a predetermined timing after redistribution, a fusion process is performed to add the avatar 51b and the stamp 52b of the redistribution viewer to the original video information to generate new video information (redistribution video information).

[0046] The fusion process is a process of generating new video information by fusing the reaction information of the viewing user with the original video information or the redistributed video information based on a preset fusion rule. In other words, the fusion process refers to a process of generating new model information by adding reaction information to the model information and adding and displaying the avatar 51 and the stamp 52 in the metaverse space. The fusion process makes it possible to develop the metaverse space and enhance the value as video information.

[0047] The fusion rule is information that can specify a predetermined determination condition and a fusion process to be executed when the determination condition is satisfied. The fusion rule makes it possible to generate video information that matches the intentions of the organizer of an outdoor music live or the viewing user. As a result, it is possible to enhance the publicity as video information distributed to the public and generate video information that is rich in changes and valuable to individual viewing users.

[0048] Figure 4 is a diagram for explaining the fusion rules. As shown in Figure 4, comments 53 input by redistributed viewers who participated in the metaverse space afterwards can be set to be fused or not fused based on predetermined judgment conditions defined in the fusion rules. Specifically, when a viewing user who has participated in the metaverse space inputs inappropriate comments 53 (prohibited words) that violate public order and good customs, the avatar 51b of the viewing user and the comments 53 can be set not to be fused. This prevents the value of video information from being reduced by inappropriate comments 53 and enables the development of highly public video information. In addition, since the viewing user can fuse redistributed videos that match their preferences, it is possible to generate video information rich in changes for each viewing user. In Figure 4, the comments 53 are displayed in the speech bubble of the avatar 51b, but the output mode of the comments 53 is not limited to this. The comments 53 may be displayed in a dedicated comment display column.

[0049] <Metaverse Space Distribution Server 10> Next, the Metaverse Space Distribution Server 10 will be described. Figure 5 shows the functional configuration of the Metaverse Space Distribution Server 10. As shown in Figure 5, the Metaverse Space Distribution Server 10 mainly includes a distribution control device 11 that controls the entire Metaverse Space Distribution Server 10 and a storage device 20.

[0050] The storage device 20 is a non-volatile auxiliary storage device composed of an HDD (Hard Disk Drive), an SSD (Solid State Drive), or the like. The storage device 20 stores a real-time video information storage unit 21, a redistributed video information storage unit 22, a user information DB 23, an input history information DB 24, an avatar information DB 25, a fusion rule TBL 26, a prohibited word TBL 27, and a video information distribution program (not shown) executed by the distribution control device 11.

[0051] The real-time video information storage unit 21 stores the original video information of the metaverse space of the outdoor music live. The original video information includes model information such as the stage 50a installed at the outdoor music live venue 50, model information of the artist 50e, and reaction information of real-time viewers. The re-distribution video information storage unit 22 stores the re-distribution video information of the metaverse space of the outdoor music live. The re-distribution video information is video information generated by integrating the reaction information of the re-distribution viewers into the original video information or the re-distribution video information.

[0052] The user information DB 23 stores the user information of the viewing users who use the metaverse space distribution system 1. The user information DB 23 is updated by the user information registration means 12 and the avatar information reception means 42 of the user terminal 40, which will be described later. The user information DB 23 corresponds to the viewer information storage means.

[0053] Figure 6 shows an example of the data structure of the user information DB 23. As shown in Figure 6, the user information DB 23 stores records having items of "user ID", "group ID", "avatar ID", and "fan club member". The "user ID" is identification information capable of identifying the viewing user and is a character string consisting of alphanumeric characters. The "group ID" is identification information capable of identifying the group to which the viewing user belongs and is a character string consisting of alphanumeric characters.

[0054] The "avatar ID" is identification information capable of identifying the avatar 51, which is the alter ego of the viewing user in the metaverse space, and is a character string consisting of alphanumeric characters. Each viewing user can participate in the metaverse space through one or more avatars 51 and communicate with the avatars 51 of other viewing users. In other words, the viewing user can form a personality different from the real world by transforming into the avatar 51. The user information DB 23 may include information capable of specifying the hairstyle, facial features, clothing, accessories, etc. of the avatar 51 together with the avatar ID.

[0055] "Fan club member" is information about the fan club to which the viewing user belongs, and stores information such as the name of the fan club to which the viewing user belongs. The information stored in "Fan club member" corresponds to the attribute information of the viewing user. Of course, the user information DB 23 may include items such as the gender, age, occupation, etc. of the viewing user in addition to the items shown in FIG. 6.

[0056] The input history information DB 24 stores the user ID of the viewing user who participated in the metaverse space and the input history of the past reaction information input to the user terminal 40 in association with each other. The input history information DB 24 is updated when the reaction information acquisition means 13 described later acquires the reaction information. The input history information DB 24 corresponds to the input history information storage means.

[0057] FIG. 7 shows an example of the data structure of the input history information DB 24. As shown in FIG. 7, the input history information DB 24 stores records having items of "action ID", "user ID", "video information ID", "input date", "viewing timing", "reaction type", and "reaction content". The "action ID" is identification information capable of identifying the reaction information input by the viewing user, and is a character string consisting of alphanumeric characters.

[0058] The "user ID" is the user ID of the viewing user who input the reaction information. The "video information ID" is identification information capable of identifying the video information being viewed when the viewing user inputs the reaction information. The "input date" is information indicating the year, month, and day when the reaction information was input. The input date may include the time information when the reaction information was input together with the information indicating the year, month, and day. The "viewing timing" is information indicating the timing when the viewing user inputs the reaction information, and is the elapsed time after the video information is distributed and the viewing user starts viewing.

[0059] The "reaction type" is information indicating the type of reaction information input by the viewing user, and is information selected from "stamp", "comment", "action", etc., but is not limited thereto. The "reaction type" may include "movement", "item purchase", etc. The "detailed information" is information indicating the detailed content of the reaction information input by the viewing user. For example, when the viewing user inputs comment 53, the detailed information is the character string of the input comment 53. Also, when the viewing user inputs stamp 52, the detailed information is information (such as a heart stamp, a like stamp, or a congratulatory stamp) that can identify the input stamp 52.

[0060] The avatar information DB25 stores information about the avatars 51 available to the viewing users of the metaverse space distribution system 1. Specifically, the avatar information includes avatar body information that can identify a pre-prepared avatar body (character), and information that can specify the hairstyle, facial features, clothing, accessories, etc. of the avatar 51.

[0061] The fusion rule TBL26 stores fusion rules. The fusion rules define rules for fusing the original video information or the redistributed video information with the reaction information to generate new redistributed video information. Specifically, the fusion rules include information that can identify a predetermined determination condition and a fusion process to be executed when the determination condition is satisfied. Also, the fusion rules include fusion rules set by the host (video provider) of the metaverse space via the host terminal 30 and fusion rules set by the viewing user via the user terminal 40. Hereinafter, the fusion rules will be described with specific examples.

[0062] FIG. 8A shows an example of the data structure of the fusion rule TBL26. As shown in FIG. 8A, the fusion rule TBL26 stores setting information having items of "user ID" and "fusion process". The "user ID" is a determination condition for determining the viewing user to be subject to the fusion process and the reaction information input by the viewing user, and corresponds to the viewer determination condition regarding the viewer identification information. The "fusion process" stores setting information that defines whether to fuse (fusion) or not fuse (non-fusion) the reaction information of the viewing user having a user ID that matches the determination condition.

[0063] Figure 8B shows the fusion rule TBL26B according to the modification example. The fusion rule TBL26B according to the modification example stores setting information having items of "fan club member" and "fusion process". The "fan club member" is a determination condition for determining the fan club to which the viewing user to be subject to the fusion process belongs, and corresponds to the viewer determination condition regarding the viewer attribute information. The "fusion process" stores setting information that defines highlighting and fusing the avatar 51 of the viewing user belonging to a specific fan club.

[0064] Figure 9 shows the metaverse space that has been fusion-processed based on the fusion rule TBL26B according to the modification example. As shown in Figure 9, the avatar 51b of the viewing user who is a fan club member of the artist 50e is fused in a display mode that is larger and more prominent than the other avatars 51a. In this way, by highlighting the reaction information of the fan club members, it becomes possible to generate video information that is highly valuable to the fan club members.

[0065] Figure 8C shows the fusion rule TBL26C according to the second modification example. The fusion rule TBL26C according to the second modification example stores setting information having items of "reaction type", "detailed information", and "fusion process". The "reaction type" and "detailed information" are determination conditions for determining the type and detailed content of the reaction information input by the viewing user, and correspond to the reaction information determination conditions. The "fusion process" stores setting information that defines highlighting and fusing the reaction information of the viewing user who input the clap action.

[0066] FIG. 10 shows a metaverse space that has been fusion-processed based on the fusion rule TBL26C according to the second modification example. As shown in FIG. 10, the avatar 51b of the viewer user who input the clapping action during the performance of the artist 50e and the stamp 52b are fused in a display mode that is larger and more prominent than those of other viewer users. In this way, by highlighting the reaction information that enlivens the outdoor music live, it becomes possible to generate highly valuable video information.

[0067] FIG. 8D shows the fusion rule TBL26D according to the third modification example. The fusion rule TBL26D according to the third modification example stores setting information having items of "reaction type", "detailed information", "number of inputs", and "fusion process". "Reaction type" and "detailed information" are determination conditions for determining the type and detailed content of the reaction information input by the viewer user, similar to the second modification example described above, and correspond to the reaction information determination conditions. "Number of inputs" is a determination condition for determining the number of times the type and detailed content of the reaction information have been input within a predetermined time, and corresponds to the viewer determination condition regarding the input history information. "Fusion process" stores setting information that determines that when a viewer user inputs an inappropriate utterance (prohibited word) stored in the prohibited word TBL27 a predetermined number of times (for example, 5 times) or more within a predetermined time, the reaction information of that viewer user will not be fused.

[0068] FIG. 8E shows the fusion rule TBL26E according to the fourth modification example. The fusion rule TBL26E according to the fourth modification example stores setting information having items of "position information" and "fusion process". "Position information" is a determination condition for determining the position information of the viewer user in the metaverse space, and corresponds to the position determination condition. "Fusion process" stores setting information that determines to fuse the avatars 51 of the viewer users located near a specific viewer user in the metaverse space.

[0069] FIG. 11 shows a metaverse space that has been fusion-processed based on the fusion rule TBL26E according to the fourth modification example. As shown in FIG. 11, by fusing only the reaction information of viewing users located near a specific viewing user, it becomes possible to generate video information that attracts the interest of other viewing users to the vicinity of the specific viewing user. Therefore, by setting oneself as the specific viewing user, it is possible to generate video information that makes one's own avatar 51 appear as the protagonist, and it becomes possible to generate video information that is highly valuable to that viewing user.

[0070] FIG. 8F shows the fusion rule TBL26F according to the fifth modification example. The fusion rule TBL26F according to the fifth modification example stores setting information having items of "position information" and "fusion process". The "position information" is a determination condition for determining the position information of a viewing user in the metaverse space, and corresponds to a position determination condition. The "fusion process" stores setting information that determines not to fuse viewing users who are separated from a specific viewing user by a predetermined distance or more in the metaverse space. By combining with the fusion rule TBL26E according to the fourth modification example, it becomes possible to generate video information that attracts the interest of other viewing users to the vicinity of the specific viewing user.

[0071] FIG. 8G shows the fusion rule TBL26G according to the sixth modification example. The fusion rule TBL26G according to the sixth modification example stores setting information having items of "position information" and "fusion process". The "position information" is a determination condition for determining the position information of a viewing user in the metaverse space, and corresponds to a position determination condition. The "fusion process" stores setting information that determines to highlight and fuse the reaction information of viewing users within a predetermined distance from the stage 50a in the metaverse space. Thereby, it becomes possible to generate a video that attracts the interest of viewing users to the vicinity of the stage 50a.

[0072] FIG. 8H shows the fusion rule TBL26H according to the seventh modification. The fusion rule TBL26H according to the seventh modification stores setting information having items of "position information" and "fusion process". "Position information" is a determination condition for determining a contradiction in the position information of the viewing user in the metaverse space, and corresponds to a contradiction determination condition and a position contradiction determination condition. "Fusion process" stores setting information that defines that when the avatar 51b of the viewing user approaches the artist 50e and the video of the artist 50e is blocked by the avatar 51b of the viewing user, the avatar 51b of the viewing user is moved and fused.

[0073] FIG. 12 shows the metaverse space that has been fusion-processed based on the fusion rule TBL26H according to the seventh modification. As shown in FIG. 12, when the video of the artist 50e is blocked by the overlap of the video of the artist 50e and the avatar 51b of the viewing user, the avatar 51b of the viewing user is separated from the artist 50e and fused. Thereby, it becomes possible to improve the visibility of the artist 50e in the metaverse space.

[0074] FIG. 8I shows the fusion rule TBL26I according to the eighth modification. The fusion rule TBL26I according to the eighth modification stores setting information having items of "density" and "fusion process". "Density" is a determination condition for determining the density (population density) around the viewing user in the metaverse space, and is a position determination condition. "Fusion process" stores setting information that defines that when the density around the avatar 51b of the viewing user exceeds a preset threshold value, the avatar 51b is moved to a position with a lower density and fused.

[0075] FIG. 13 shows a metaverse space that has been fusion-processed based on the fusion rule TBL26I according to the eighth modification example. As shown in FIG. 13, by moving and fusing the avatar 51b of the viewing user who is at the position where the avatars 51 are concentrated to a position where they are not concentrated, the avatars 51 can be dispersed throughout the outdoor music live venue 50. Thereby, it is possible to prevent the stamps 52, comments 53, actions, etc. of the individual avatars 51 from overlapping, and it becomes possible to generate video information that can easily visually recognize the actions and words of the avatars 51.

[0076] FIG. 8J shows the fusion rule TBL26 according to the ninth modification example. The fusion rule TBL26J according to the sixth modification example stores setting information having items of "scene" and "fusion process". "Scene" is a partial video determination condition for determining the scene when the video information to be distributed has a plurality of partial video information (scenes) based on a predetermined timing and order. As specific examples of the scene, an "appearance scene" in which the artist 50e appears at the outdoor music live venue 50, a "talk scene" in which the artist 50e talks to the audience during the song, etc. can be given. "Fusion process" stores setting information that determines not to fuse the reaction information of the viewing user when outputting a specific scene of the outdoor music live. Thereby, it becomes possible to flexibly set whether or not to fuse the reaction information for each scene.

[0077] Returning to FIG. 5, the prohibited word TBL27 defines inappropriate expressions that deteriorate the atmosphere of the outdoor music live venue 50. The prohibited word TBL27 is preset by the organizer of the music live. Note that the storage device 20 may have a prohibited action table that defines inappropriate actions together with the prohibited word TBL27. Thereby, it is possible to prevent the reaction information of the viewing user who takes inappropriate actions in the metaverse space from being fused into the redistributed video, and it becomes possible to enhance the value of the video information having publicness.

[0078] The distribution control device 11 has a CPU, a volatile memory, and a non-volatile memory, and is a control circuit that controls the metaverse space distribution server 10. The CPU of the distribution control device 11 loads the video information distribution program stored in the storage device 20 into the volatile memory and sequentially executes it. As a result, the distribution control device 11 functions as user information registration means 12, reaction information acquisition means 13, fusion rule acquisition means 14, redistributed video generation means 15, and video distribution means 16, which will be described later. The distribution control device 11 corresponds to a computer that performs video information distribution processing.

[0079] The user information registration means 12 acquires user information from the user terminal 40 and stores it in the user information DB 23. Specifically, the user information registration means 12 transmits a web page having an input field for user information to the user terminal 40, acquires the user information input via the web page, and stores it in the user information DB 23. Further, the user information registration means 12 may accept the input of avatar information together with the user information.

[0080] The reaction information acquisition means 13 acquires the reaction information input when the viewing user views the original video information or the redistributed video information. The reaction information acquisition means 13 may acquire the reaction information input via the user terminal 40 as it is, or may acquire the reaction information subjected to predetermined pre-processing or processing. When the reaction information acquisition means 13 acquires the reaction information, it stores the reaction information in the input history information DB 24. The reaction information includes information regarding the user ID of the viewing user who input the reaction information, the video information ID, the input date of the reaction information, the viewing timing, the type of reaction (comment input, stamp input, action input, etc.), and the detailed information of the reaction.

[0081] The fusion rule acquisition means 14 acquires the fusion rules input by the organizer of the outdoor music live or the viewing user. Specifically, the fusion rule acquisition means 14 acquires the fusion rules by reading the fusion rule TBL26 in the storage device 20. Also, the fusion rule acquisition means 14 may acquire the fusion rules received by the fusion rule reception means 33 (see FIG. 14) of the organizer terminal 30. Further, the fusion rule acquisition means 14 may acquire the fusion rules received by the fusion rule reception means 46 (see FIG. 15) of the user terminal 40. When the fusion rule acquisition means 14 acquires the fusion rules, it updates the fusion rule TBL26.

[0082] The re-distribution video generation means 15 fuses the original video information or the re-distribution video information and the reaction information based on the fusion rules. Specifically, first, the re-distribution video generation means 15 compares the reaction information acquired by the reaction information acquisition means 13 with the fusion rules acquired by the fusion rule acquisition means 14, and determines whether or not the reaction information satisfies the determination conditions set in the fusion rules. When the determination conditions are satisfied, the re-distribution video generation means 15 performs processes such as highlighting defined in the fusion rules to fuse the original video information or the re-distribution video information and the reaction information, and generates new re-distribution video information.

[0083] Also, the re-distribution video generation means 15 is provided with an avatar position information acquisition means for acquiring the position information of the avatar 51 of the viewing user in the metaverse space, compares the position information of the avatar 51 with the fusion rules, and determines whether or not the position information satisfies the determination conditions set in the fusion rules. When the determination conditions are satisfied, the re-distribution video generation means 15 performs processes such as the movement process of the avatar 51 defined in the fusion rules to fuse the original video information or the re-distribution video information and the reaction information, and generates new re-distribution video information. The avatar position information acquisition means corresponds to the viewer position information acquisition means.

[0084] The fusion process by the re-distribution video generation means 15 is performed after the viewing of the original video information or the re-distribution video information ends. Specifically, the fusion process is executed at a predetermined timing, but it may also be executed at a timing based on the operation of the organizer of the music live or the viewing user. The re-distribution video generation means 15 stores the newly generated re-distribution video information in the re-distribution video information storage unit 22 of the storage device 20.

[0085] The video distribution means 16 transmits the original video information or the re-distribution video information to the user terminal 40. Specifically, when a predetermined time (the start timing of the music live) arrives, the video distribution means 16 simultaneously transmits the original video information to the user terminals 40 of a plurality of viewing users. Also, when there is a request from a viewing user, the video distribution means 16 transmits the re-distribution video information to the user terminal 40 of the viewing user who made the request.

[0086] <Organizer terminal 30> Next, the organizer terminal control device 31 of the organizer terminal 30 will be described. FIG. 14 shows the functional configuration of the organizer terminal 30. As shown in FIG. 14, the organizer terminal 30 has an organizer terminal control device 31 that controls the organizer terminal 30. The organizer terminal control device 31 has a CPU, a volatile memory, and a non-volatile memory, and is a control circuit that controls the organizer terminal 30. The CPU of the organizer terminal control device 31 loads a program stored in the auxiliary storage device of the organizer terminal 30 into the volatile memory and sequentially executes it. Thereby, the organizer terminal control device 31 functions as the original video information registration means 32, the fusion rule reception means 33, and the prohibited word reception means 34.

[0087] The original video information registration means 32 receives the registration of the original video information of the outdoor music live in the metaverse space and transmits it to the metaverse space distribution server 10. Thereby, the original video information is stored in the real-time video information storage unit 21 of the metaverse space distribution server 10 and becomes in a state where it can be distributed to the user terminal 40. In addition, the original video information registration means 32 may register distribution conditions including the distribution date and distribution time of the metaverse space.

[0088] The fusion rule reception means 33 receives the setting input of the fusion rule and transmits it to the metaverse space distribution server 10. As a result, the fusion rule is stored in the fusion rule TBL 26 of the metaverse space distribution server 10. Specifically, the fusion rule reception means 33 causes a fusion rule setting screen capable of inputting the fusion rule to be displayed on the display unit of the organizer terminal 30. The fusion rule setting screen can input at least any one of the fusion rules described with reference to FIGS. 8A to 8J, or a combination of these. The fusion rule input through the fusion rule setting screen is transmitted to the metaverse space distribution server 10.

[0089] The prohibited word reception means 34 receives the setting input of the prohibited word and transmits it to the metaverse space distribution server 10. As a result, the prohibited word is stored in the prohibited word TBL 27 of the metaverse space distribution server 10. Specifically, the prohibited word reception means 34 causes a prohibited word setting screen capable of inputting the prohibited word to be displayed on the display unit of the organizer terminal 30. Then, the prohibited word input through the prohibited word setting screen is transmitted to the metaverse space distribution server 10.

[0090] <User terminal 40> Next, the user terminal control device 41 of the user terminal 40 will be described. FIG. 15 shows the functional configuration of the user terminal 40. As shown in FIG. 15, the user terminal 40 has a user terminal control device 41 that controls the user terminal 40. The user terminal control device 41 includes a CPU, a volatile memory, and a non-volatile memory, and is a control circuit that controls the user terminal 40. The CPU of the user terminal control device 41 loads a program stored in the auxiliary storage device of the user terminal 40 in advance into the volatile memory and sequentially executes it. As a result, the user terminal control device 41 functions as an avatar information reception means 42, a video information acquisition means 43, a video display control means 44, a reaction information reception means 45, and a fusion rule reception means 46.

[0091] The avatar information receiving means 42 receives information about the avatar 51 desired by the viewing user and transmits it to the metaverse space distribution server 10. Specifically, the avatar information receiving means 42 displays an avatar information input screen on the display unit of the user terminal 40, which enables input of information about the avatar 51 (such as the avatar body, facial features, clothing, accessories, etc.), and receives selective input of information about the avatar 51. Then, the avatar information receiving means 42 transmits the information about the avatar 51 selected by the viewing user to the metaverse space distribution server 10. As a result, the viewing user can set their own avatar 51 in the metaverse space according to their preferences.

[0092] The video information acquisition means 43 acquires video information of the metaverse space in which the viewing user wishes to participate. Specifically, the video information acquisition means 43 acquires video information by receiving the original video information or the reproduced video information transmitted by the metaverse space distribution server 10.

[0093] The video display control means 44 causes the video information acquired by the video information acquisition means 43 to be displayed on the display unit of the user terminal 40. Specifically, the video display control means 44 acquires the model information of the metaverse space and information about the current position and orientation of the viewing user's avatar 51. Next, the video display control means 44 generates the metaverse space based on the model information and the position and orientation of the avatar 51 and causes it to be displayed on the display unit of the user terminal 40. Also, the video display control means 44 causes comments 53, stamps 52, actions, etc. acquired via the reaction information receiving means 45 described later to be displayed on the display unit.

[0094] The reaction information reception means 45 receives the input of reaction information from the viewing user. Specifically, the reaction information reception means 45 receives inputs related to the speech and actions of the avatar 51 (such as the movement of the avatar 51, the input of the comment 53, the input of the stamp 52, the input of an action, etc.) during the viewing of the original video information or the re-distributed video information. The reaction information acquired by the reaction information reception means 45 is transmitted to the metaverse space distribution server 10.

[0095] The fusion rule reception means 46 receives the input of the fusion rule, transmits it to the metaverse space distribution server 10, and stores it in the fusion rule TBL 26. Specifically, the fusion rule reception means 46 causes a fusion rule setting screen on which the fusion rule can be input to be displayed on the display unit of the user terminal 40. The fusion rule setting screen can input at least any one of the fusion rules described with reference to FIGS. 8A to 8J, or a fusion rule combining these. Then, the fusion rule input through the fusion rule setting screen is transmitted to the metaverse space distribution server 10.

[0096] <Flow of video information fusion processing> Next, the flow of video information fusion processing executed by the distribution control device 11 of the metaverse space distribution server 10 will be described. FIG. 16 shows the flow of video information fusion processing. The video information fusion processing is executed after the viewing user views the original video information or the re-distributed video information. In the following description, it is assumed that the fusion rule TBL 26 already stores the fusion rule.

[0097] First, the distribution control device 11 acquires video information (step S10). Specifically, when a predetermined timing arrives, the distribution control device 11 reads the original video information stored in the real-time video information storage unit 21 or the re-distributed video information stored in the re-distributed video information storage unit 22 to acquire the video information. Also, the distribution control device 11 may acquire the video information based on the input operation of the organizer of the outdoor music live or the viewing user.

[0098] Next, the distribution control device 11 acquires reaction information (reaction information acquisition step, step S11). Specifically, the distribution control device 11 acquires reaction information in which the video information acquired in step S10 matches the video information ID among the plurality of input history information stored in the input history information DB24 and the input date of the reaction information is after the execution timing of the previous video information fusion process. Further, the distribution control device 11 may acquire reaction information obtained by performing predetermined pre-processing or processing on the reaction information input via the user terminal 40 at the metaverse space distribution server 10 or the organizer terminal 30.

[0099] Next, the distribution control device 11 acquires a fusion rule (fusion rule acquisition step, step S12). Specifically, the distribution control device 11 acquires the fusion rule by reading the fusion rule stored in the fusion rule TBL26.

[0100] Next, the distribution control device 11 generates redistributed video information (redistributed video generation step, step S13). Specifically, the distribution control device 11 compares the reaction information acquired in step S11 with the fusion rule acquired in step S12, and determines whether or not the determination conditions defined in the fusion rule are satisfied. When it is determined that the determination conditions are satisfied, the distribution control device 11 fuses the reaction information with the video information acquired in step S10. That is, the distribution control device 11 applies the fusion process defined in the fusion rule to the model information of the metaverse space acquired in step S10 to generate new redistributed video information. The newly generated redistributed video information is transmitted to the user terminal 40 (video distribution step). On the other hand, when it is determined that the determination conditions are not satisfied, the distribution control device 11 ends the video information fusion process as it is.

[0101] According to the metaverse space distribution system 1 configured as described above, new video information can be created by the viewing user who has viewed the video information, and thus the video information can be developed. Also, according to the metaverse space distribution system 1, it is possible to generate re-distributed video information that reflects the intentions of video providers (the organizers of events in the metaverse space) or viewing users. As a result, the metaverse space distribution system 1 can distribute video information that is rich in variety and highly valuable to individual viewing users.

[0102] The above is an explanation of an embodiment of the metaverse space distribution device, the metaverse space distribution method, and the metaverse space distribution program. The above-described embodiment is merely an example for facilitating the understanding of the present invention and does not limit the present invention. That is, the present invention can be changed and improved without departing from its gist, and it goes without saying that equivalents of the present invention are included therein.

[0103] In the above-described embodiment, the viewing user has been described as inputting reaction information via the movement cursor 54, the comment input field 55, the stamp input icon 56, or the action input icon 57, but it is not limited thereto. The user terminal 40 may be provided with a detection device capable of detecting the voice and actions (such as gestures) of the viewing user, and reaction information may be input via the detection device. Specifically, the user terminal 40 includes a sensor device (microphone, acceleration sensor, camera, etc.) and an action recognition unit (motion capture or an action recognition processor pre-trained by machine learning), and the viewing user may input reaction information via the sensor device and the action recognition unit. In this way, by diversifying the input mode of the reaction information, it is possible to enrich the virtual experience in the metaverse space and improve the satisfaction of the viewing user.

[0104] Also, in the above-described embodiments, the fusion rule has been described as determining whether to fuse or not fuse the reaction information with the original video information or the re-distributed video information when a predetermined determination condition is satisfied. However, the present invention is not limited to this. The fusion rule may be defined such that when a predetermined determination condition is satisfied, the reaction information is displayed or not displayed (not displayed) together with the original video information or the re-distributed video information. Even in such a case, the same effects as those of the above-described embodiments can be achieved.

[0105] Further, the fusion rule may include permission information indicating whether or not to permit a viewing user to distribute new re-distributed video information generated by the fusion process to other viewing users. Thereby, since the viewing user can set whether or not to re-distribute the re-distributed video information generated based on the reaction information input by the user himself / herself and the fusion rule, it is possible to prevent the re-distributed video information from being distributed to a third party that the viewing user does not desire.

[0106] Also, in the above-described embodiments, it has been described that the reaction information of the fan club members belonging to a specific fan club is highlighted and fused. However, the present invention is not limited to this. Video information limited to fan club members may be generated by not fusing the reaction information of viewing users who do not belong to a specific fan club. Thereby, it becomes possible to further enhance the value of the video information for the fan club members.

[0107] Also, in the above-described embodiments, it has been described that the reaction information of the viewing user who has input the clapping action is highlighted and fused. However, the present invention is not limited to this. It may be possible to generate video information with a high production effect by fusing the reaction information of the viewing user who has selected a specific production. Thereby, it becomes possible to further enhance the value of the video information.

[0108] In addition, in the above-described embodiment, when the video of the artist 50e is obstructed, it has been described that the avatar 51 of the viewing user is moved and merged, but the present invention is not limited to this. When predetermined model information (for example, the avatar 51 of a fan club member) in the metaverse space is obstructed, it may be possible to set a merging rule for moving the avatars 51 of other viewing users.

[0109] In addition, in the above-described embodiment, the determination conditions for determining the contradiction of the position information in the metaverse space have been described, but the present invention is not limited to this. It may be possible to set determination conditions for determining a temporal contradiction (for example, a contradiction in which a plurality of avatars 51 of the same viewing user exist within a predetermined metaverse space) by a viewing user who repeatedly views the redistributed video information.

[0110] In addition, in the above-described embodiment, the metaverse space distribution server 10 has been described as distributing the video information of an outdoor music live as video information in the metaverse space, but the present invention is not limited to this. The video of a real-world music live (actual live video) may be distributed. Even in this case, the viewing user can view the video of the music live and input stamps 52, comments 53, etc. as reaction information into the video information, and can achieve the same effects as those of the above-described embodiment. Further, video information of an entertainment event held in a space where the real world and the virtual world are merged may be distributed.

[0111] <Second Embodiment> Next, a real live video distribution system 101 according to the second embodiment will be described. The real live video distribution system 101 is a video distribution system that gives a specific viewing user the authority to edit a real live video and publicly distributes the real live video generated by the viewing user to whom the authority has been given to a third party. The real live video distribution system 101 can distribute real live videos that are rich in variation and highly valuable to individual viewing users.

[0112] The actual live video distribution system 101 mainly includes an actual live video distribution server 110 that distributes actual live videos, a host terminal 30, and a user terminal 140. The actual live video distribution server 110, the host terminal 30, and the user terminal 140 are connected to be mutually communicable via a publicly available communication line NW such as the Internet.

[0113] <Actual live video distribution server 110> First, the actual live video distribution server 110 will be described. FIG. 17 shows the functional configuration of the actual live video distribution server 110 according to the second embodiment. The actual live video distribution server 110 of the second embodiment changes the user information DB 23 of the metaverse space distribution server 10 of the first embodiment to a user information DB 123, adds a privilege information acquisition means 112, a real-time video transmission means 113, an edited video acquisition means 114, a public determination means 115, and a public determination result notification means 116, and deletes the avatar information DB 25. Since the other configurations are the same as those of the metaverse space distribution server 10 of the first embodiment, the same reference numerals are given and the description thereof is omitted, and only the different parts will be described.

[0114] The user information DB 123 of the storage device 120 stores the user information of the viewing users who receive the distribution of the actual live videos. In addition, the user information DB stores information regarding the editing privilege for editing the actual live videos.

[0115] FIG. 18 shows an example of the data structure of the user information DB 123. As shown in FIG. 18, the user information DB 123 stores records having an item of "editing privilege" in addition to the items of "user ID", "group ID", and "fan club member". The "editing right", which is an item added to the user information DB23 described in the first embodiment, stores whether or not the viewing user specified by the user ID has the right to edit the actual live video stored in the real-time video information storage unit 21. In other words, a viewing user with the editing right can edit the actual live video and generate a re-distributed video that matches their preferences.

[0116] The authority information acquisition means 112 of the distribution control device 111 acquires editing authority information regarding the presence or absence of the right to edit the actual live video. Specifically, the authority information acquisition means 112 acquires information regarding the presence or absence of the editing right of the viewing user by referring to the user information DB123 of the storage device 120. However, without being limited to this, the authority information acquisition means 112 may acquire the user ID of the viewing user who has the editing right.

[0117] The real-time video transmission means 113 transmits a real-time video (actual live video) to the user terminal 140 operated by the viewing user based on the editing authority information acquired by the authority information acquisition means 112. Specifically, the real-time video transmission means 113 first determines whether or not the viewing user who wishes to edit the music live video has the editing right. If it is determined that the viewing user has the editing right, the real-time video transmission means 113 transmits the actual live video to the user terminal 140 of the person with the editing right.

[0118] The edited video acquisition means 114 acquires the edited video information edited by the person with the editing right. Specifically, the edited video acquisition means 114 receives the edited video information from the user terminal 140 of the person with the editing right and stores it in the re-distributed video information storage unit 22.

[0119] The public release determination means 115 determines whether or not to permit the use of the edited video information by unspecified persons or specific persons based on a predetermined public release determination criterion. Specifically, the public release determination means 115 determines whether or not to publicly release the edited video acquired by the edited video acquisition means 114 to a third party other than the editor of the edited video. The public disclosure determination means 115 determines whether to publicly disclose the edited video information based on a predetermined public disclosure criterion, but is not limited thereto. As an example, the public disclosure determination means 115 may determine based on whether an input permitting public disclosure has been received from the editing authority. Also, as another example, the public disclosure determination means 115 may determine based on whether an input permitting the public disclosure of the edited video has been received from a person who has the distribution right for the actual live video before editing.

[0120] The public disclosure determination result notification means 116 notifies the determination result of the public disclosure determination means 115. Specifically, the public disclosure determination result notification means 116 transmits the determination result by the public disclosure determination means 115 to the user terminal 40 of the editing authority. Also, the public disclosure determination result notification means 116 may transmit the determination result to a person who has permitted the distribution of the actual live video.

[0121] <User terminal 40> Next, the user terminal 40 will be described. FIG. 19 shows the functional configuration of the user terminal 140 according to the second embodiment. The user terminal 40 of the second embodiment is obtained by changing the video information acquisition means 43 of the user terminal 40 according to the first embodiment shown in FIG. 15 to the video information acquisition means 142, adding the edited video generation means 143, and deleting the avatar information reception means 42. Since the other configurations are the same as those of the metaverse space distribution server 10 of the first embodiment, the same reference numerals are given and the description is omitted, and only the different parts will be described.

[0122] The video information acquisition means 142 of the user terminal control device 141 acquires the real live video transmitted by the real-time video transmission means 113 of the distribution control device 111. Specifically, first, the video information acquisition means 142 transmits the user ID of the viewing user to the real live video distribution server 110 and requests the real live video distribution server 110 to transmit the real live video. The real-time video transmission means 113 of the real live video distribution server 110 determines whether the viewing user has the editing authority. When it is determined that the viewing user has the editing authority, the video information acquisition means 142 receives the real live video transmitted by the real-time video transmission means 113 to acquire the music live video.

[0123] The edited video generation means 143 receives an editing input for the real live video acquired by the video information acquisition means 142 and generates an edited video. The generated edited video is transmitted to the real live video distribution server 110 and stored in the re-distributed video information storage unit 22. Thereby, a viewing user having the editing authority can edit the music live video to generate a video reflecting his / her preference, and can generate video information of high value for that viewing user.

[0124] For example, a viewing user having the editing authority can generate a real live video by extracting the video of the artist 50e that he / she supports from the real live video of a music band composed of a plurality of artists 50e. As another example, a viewing user having the editing authority can extract a favorite scene from the real live video and generate video information by combining the extracted scenes in a predetermined order.

[0125] <Flow of distributed video generation process> Next, the flow of the distributed video generation process executed by the distribution control device 111 of the real live video distribution server 110 will be described. FIG. 20 shows the flow of the distributed video generation process. The distributed video generation process is executed when a real live video to be edited is requested by a viewing user having the editing authority.

[0126] First, the distribution control device 111 acquires editing authority information (step S20). Specifically, the distribution control device 111 refers to the user information DB 123 and acquires information regarding the editing authority of the actual live video.

[0127] Next, the distribution control device 111 transmits the music live video to the user terminal 140 (step S21). Specifically, the distribution control device 111 determines whether the viewing user has the editing authority, and if it is determined that the user has the editing authority, the distribution control device 111 transmits the music live video to the user terminal 140.

[0128] Next, the distribution control device 111 receives the edited video edited by the user terminal 140 (step S22). Specifically, the distribution control device 111 receives the edited video from the user terminal 140 and stores the received edited video in the re-distribution video information storage unit 22 as re-distribution video information.

[0129] Next, the distribution control device 111 determines whether the edited video can be publicly disclosed to a third party or a predetermined specific person (step S23). Specifically, the distribution control device 111 determines whether the edited video can be publicly disclosed by determining whether it meets the predetermined public disclosure criteria.

[0130] Next, the distribution control device 111 notifies the determination result of the public disclosure availability (step S24). Specifically, the distribution control device 111 transmits the determination result to the user terminal 140 operated by the editing authority holder and ends the distribution video generation process. Note that the distribution control device 111 may transmit the determination result to the terminal operated by the person who has the distribution authority for the actual live video before editing.

[0131] By executing the above-described distribution video generation process, it becomes possible to generate re-distribution video information reflecting the preferences of viewing users and disclose this to third parties. Further, the distribution video information generated by the distribution video generation process is fused with the reaction information of the viewing users, similar to the first embodiment, to generate re-distribution video information. Therefore, the actual live video distribution system 101 can achieve the same effects as the first embodiment.

[0132] Regarding the second embodiment described with reference to FIGS. 17 to 20, the following supplementary note is disclosed. (Supplementary Note) Entertainment video information storage means for storing one or more pieces of entertainment video information for displaying entertainment videos; Authority information acquisition means for acquiring editing authority information capable of identifying an editor having the editing authority for the entertainment video information; Entertainment video information transmission means for transmitting the entertainment video information to an editor terminal for use by the editor based on the editing authority information; Edited video information acquisition means for acquiring edited video information edited by the editor from the editor terminal; Publication determination means for determining whether to permit the use of the edited video information by unspecified or specified persons via a publicly available telecommunications line based on a predetermined publication determination criterion; A entertainment video management apparatus characterized by comprising publication determination result notification means for transmitting the determination result of the publication determination means to the editor terminal.

Explanation of Reference Numerals

[0133] 1 Metaverse space distribution system 10 Metaverse space distribution server (video information distribution apparatus) 11 Distribution control apparatus (computer) 12 User information registration means 13 Reaction information acquisition means 14 Fusion rule acquisition means 15 Re-distribution video generation means 16 Video distribution means 20 Storage device 21 Real-time video information storage unit 22 Redistribution video information storage unit 23 User information DB (viewer information storage means) 24 Input history information DB (input history information storage means) 25 Avatar information DB 26, 26B, 26C, 26D, 26E, 26F, 26G, 26H, 26I, 26J Fusion rule TBL 27 Prohibited word TBL 30 Organizer terminal (provider terminal) 31 Organizer terminal control device 32 Original video information registration means 33 Fusion rule reception means 34 Prohibited word reception means 40 User terminal (viewer terminal) 41 User terminal control device 42 Avatar information reception means 43 Video information acquisition means 44 Video display control means 45 Reaction information reception means 46 Fusion rule reception means 50 Outdoor music live venue 50a Stage 50b Front screen 50c Lighting 50d Enlarged screen 50e Artist 51 Avatar 51a Avatar (real-time viewer) 51b Avatar (redistribution viewer) 52 Stamp 52a Stamp (real-time viewer) 52b Stamp (redistribution user) 53 Comment 54 Moving cursor 55 Comment input field 56 Stamp input icon 56a Stamp launcher 56b Stamp button 57 Action input icon 58 Effect input icon 110 Actual live video distribution server (video information distribution device) 111 Distribution control device (computer) 112 Authority information acquisition means 113 Real-time video transmission means 114 Edited video acquisition means 115 Publicity determination means 116 Publicity determination result notification means 120 Storage device 123 User information DB 140 User terminal 141 User terminal control device 142 Video information acquisition means 143 Edited video generation means NW communication line

Claims

1. A video information distribution device that distributes re-distribution video information generated based on original video information or reaction information input by a viewer to a viewer terminal, comprising: reaction information acquisition means for acquiring the reaction information regarding the original video information or the re-distribution video information; fusion rule acquisition means for acquiring a fusion rule that defines a rule for fusing the original video information or the re-distribution video information and the reaction information to generate new re-distribution video information; re-distribution video generation means for fusing the original video information or the re-distribution video information and the reaction information based on the fusion rule to generate new re-distribution video information; video distribution means for distributing the new re-distribution video information generated by the re-distribution video generation means to the viewer terminal. The video information distribution device is characterized by comprising the above.

2. The original video information is video information that is distributed in real time to one or more viewer terminals, The reaction information is information input by the viewer who views at least one of the original video information and the re-distribution video information distributed in real time via the viewer terminal. The video information distribution device according to claim 1 is characterized by this.

3. The original video information and the re-distribution video information are video information in a metaverse space. The video information distribution device according to claim 2 is characterized by this.

4. The fusion rule acquisition means acquires at least one of the fusion rule input via a provider terminal used by the provider of the original video information and the fusion rule input via the viewer terminal. The video information distribution device according to claim 3 is characterized by this.

5. The video information distribution device comprises viewer information storage means for storing viewer attribute information in which viewer identification information capable of identifying the viewer and the attribute information of the viewer are associated; input history information storage means for storing input history information in which the viewer identification information and the past input history input by the viewer to the viewer terminal are associated. The fusion rule includes viewer determination conditions regarding at least one of the viewer identification information, the viewer attribute information, and the input history information. The re-distribution video generation means determines whether the viewer determination conditions are satisfied, and fuses the original video information or the re-distribution video information and the reaction information based on the determination result. The video information distribution device according to claim 3 is characterized by this.

6. The fusion rule includes reaction information determination conditions regarding the reaction information. The re-distributed video generation means determines whether the reaction information determination conditions are met, and based on the determination result, fuses the original video information or the re-distributed video information with the reaction information. The video information distribution device according to claim 3 is characterized in that.

7. The video information distribution device includes viewer position information acquisition means for acquiring position information of the viewer in the metaverse space. The fusion rule includes position determination conditions regarding the position information. The re-distributed video generation means determines whether the position determination conditions are met, and based on the determination result, fuses the original video information or the re-distributed video information with the reaction information. The video information distribution device according to claim 3 is characterized in that.

8. The position determination condition is a determination condition regarding the population density of the viewer in the metaverse space, The re-distributed video generation means includes a process of fusing the video information of the viewer at a position where the population density in the metaverse space is low based on the determination result of the population density. The video information distribution device according to claim 7 is characterized in that.

9. The position determination condition is a determination condition regarding the total number of viewers located within a predetermined area of the metaverse space, The re-distributed video generation means does not fuse the video of the viewer within the predetermined area based on the determination result of the total number within the predetermined area. The video information distribution device according to claim 8 is characterized in that.

10. The original video information and the re-distributed video information have a plurality of partial video information output at a predetermined timing and order. The fusion rule includes partial video determination conditions regarding the partial video information. The re-distributed video generation means determines whether the partial video determination conditions are met, and based on the determination result, fuses the original video information or the re-distributed video information with the reaction information. The video information distribution device according to claim 3 is characterized in that.

11. The fusion rule includes permission information indicating whether the viewer is permitted to distribute the new re-distributed video information generated by the re-distributed video generation means to viewers other than the viewer. The video information distribution device according to claim 3 is characterized in that.

12. The fusion rule includes contradiction determination conditions for determining the presence or absence of contradictions in the metaverse space. The re-distribution video generation means determines whether the contradiction determination condition is satisfied, and fuses the original video information or the re-distribution video information and the reaction information based on the determination result, and the video information distribution apparatus according to claim 3 is characterized in that.

13. The video information distribution apparatus includes viewer position information acquisition means for acquiring position information of the viewer in the metaverse space. The contradiction determination condition includes a position contradiction determination condition for determining a contradiction in the position information in the metaverse space, and the video information distribution apparatus according to claim 12 is characterized in that.

14. A computer that performs video information distribution processing for distributing re-distribution video information generated based on original video information or reaction information input by a viewer to a viewer terminal, a reaction information acquisition step of acquiring the reaction information related to the original video information or the re-distribution video information; a fusion rule acquisition step of acquiring a fusion rule that defines a rule for fusing the original video information or the re-distribution video information and the reaction information to generate new re-distribution video information; a re-distribution video generation step of fusing the original video information or the re-distribution video information and the reaction information based on the fusion rule to generate new re-distribution video information; and a video distribution step of distributing the new re-distribution video information generated in the re-distribution video generation step to the viewer terminal, and a video information distribution method is characterized in that.

15. A computer that performs video information distribution processing for distributing re-distribution video information generated based on original video information or reaction information input by a viewer to a viewer terminal, is caused to function as reaction information acquisition means for acquiring the reaction information related to the original video information or the re-distribution video information, fusion rule acquisition means for acquiring a fusion rule that defines a rule for fusing the original video information or the re-distribution video information and the reaction information to generate new re-distribution video information, re-distribution video generation means for fusing the original video information or the re-distribution video information and the reaction information based on the fusion rule to generate new re-distribution video information, and video distribution means for distributing the new re-distribution video information generated by the re-distribution video generation means to the viewer terminal, and a video information distribution program is characterized in that.

Images