Virtual Space Content Delivery System, Virtual Space Content Delivery Program, and Virtual Space Content Delivery Method

Abstract

To provide a virtual space content distribution system, a virtual space content distribution program, and a virtual space content distribution method that can suppress a decrease in the interest of virtual space content by making the processing load for displaying and outputting a viewer avatar smaller in order to suppress the occurrence of output failures. 【Solution means】The virtual space content may include a viewer avatar when the viewer user can participate in a virtual space corresponding to the virtual space content using a viewer user terminal with a viewer avatar corresponding to the user himself / herself. The viewer avatar includes a first viewer avatar and a second viewer avatar with a smaller processing load for display output than the first viewer avatar, and is provided with viewer avatar setting means by which the viewer user himself / herself can execute settings regarding using the viewer avatar as the second viewer avatar.

Description

Technical Field

[0001] The present invention relates to a virtual space content distribution system capable of distributing virtual space content in a virtual space, a virtual space content distribution program, and a virtual space content distribution method.

Background Art

[0002] Conventionally, a plurality of viewer terminals possessed by viewers (viewer users) and a server computer capable of executing processing related to virtual space content and processing related to distribution of virtual space content are connected via a communication network, and a virtual character (viewer avatar, first viewer avatar) indicating a viewer is allowed to participate in a virtual space for distributing virtual space content (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in Patent Document 1, since viewer avatars corresponding to each viewer user can participate in the virtual space, it is necessary to display and output these viewer avatars participating in the virtual space as avatars participating in the virtual space of the virtual space content. However, when the number of viewer avatars participating in the virtual space increases according to the progress of the virtual space content and the like, the processing load related to the display and output of the virtual space content increases, and there may be a problem in the display and output of the virtual space content. Therefore, for the purpose of preventing such problems, it is conceivable to set the mode of the viewer avatar to a mode with a smaller processing load for display output (the mode of the second viewer avatar). However, if all viewer avatars are uniformly set to a mode with a smaller processing load (the second viewer avatar), there is a risk that the interest in the virtual space content will decrease because the intentions of the viewers are not reflected in the modes of these viewer avatars.

[0005] The present invention has been made paying attention to such problems, and aims to provide a virtual space content distribution system, a virtual space content distribution program, and a virtual space content distribution method capable of suppressing a decrease in the interest in virtual space content by setting the processing load for displaying and outputting a viewer avatar to a smaller mode in order to suppress the occurrence of display and output problems.

Means for Solving the Problems

[0006] The virtual space content distribution system according to claim 1 is a virtual space content distribution system capable of distributing virtual space content (for example, virtual live) in a virtual space, a terminal capable of outputting an image of the virtual space content, which is a viewer user terminal (for example, viewer terminal 300) that can be viewed by a viewer user, a server computer (for example, distribution server computer 100) connected to the viewer user terminal via a communication network and capable of executing at least processing related to the virtual space and processing related to the distribution of the virtual space content at least includes where there are multiple said viewer users, and a viewer user terminal is assigned to each viewer user, the virtual space content may include the viewer avatar by allowing the viewer user to participate in the virtual space targeted by the virtual space content with the viewer user terminal and having a viewer avatar corresponding to the user himself / herself (for example, as shown in FIG. 13, the part where the viewer avatars of each viewer are displayed to virtually participate in the virtual live venue on the viewer terminal 300), the viewer avatar includes a first viewer avatar (for example, a full avatar) and a second viewer avatar (for example, a simple avatar) with a smaller processing load for display output than the first viewer avatar, The viewer user himself / herself corresponds to other viewer users Settings regarding using the viewer avatar as the second viewer avatar to implement is equipped with viewer avatar setting means that can be performed (for example, as shown in FIGS. 71 and 76, the part where the viewer terminal 300 executes a simple area designation operation process) is characterized by this. According to this feature, since the viewer user himself / herself can perform the setting regarding using the viewer avatar as the second viewer avatar, the intention of the viewer user can be reflected regarding the viewer avatar that becomes the second viewer avatar. Therefore, it is possible to suppress the decrease in the interest of the virtual space content by using the second viewer avatar with a smaller processing load for displaying the viewer avatar to suppress the occurrence of display output problems.

[0007] The virtual space content distribution system according to claim 2 is the virtual space content distribution system according to claim 1, In the viewer avatar setting means, the viewer user can set, as a setting regarding making the viewer avatar the second viewer avatar, the area in the virtual space that is to be the second viewer avatar (for example, as shown in FIGS. 76 and 77, the part where the viewer user selects a simplification target area from the third area and the fourth area by the viewer terminal 300 executing a simplification target area designation operation process). It is characterized by this. According to this feature, since the viewer user can set the area to be the second viewer avatar by himself / herself, it is possible to further suppress a decrease in the interest of virtual space content due to a viewer avatar in an area not intended by the viewer user becoming the second viewer avatar.

[0008] The virtual space content distribution system according to claim 3 is the virtual space content distribution system according to claim 1 or 2, wherein In the viewer avatar setting means, the viewer user can set, as a setting regarding making the viewer avatar the second viewer avatar, the number of viewer avatars that are to be the second viewer avatar (for example, as shown in FIG. 80, the part where the viewer user sets the number of viewer avatars to be simple avatars). It is characterized by this. According to this feature, since the viewer user can set the number of viewer avatars to be the second viewer avatar by himself / herself, it is possible to further suppress a decrease in the interest of virtual space content due to a number of viewer avatars not intended by the viewer user becoming the second viewer avatar.

[0009] The virtual space content distribution system according to claim 4 is the virtual space content distribution system according to claim 1, wherein In the viewer avatar setting means, the viewer user can set the ratio of the number of viewer avatars that are to be the second viewer avatar to the number of viewer avatars participating in the virtual space (for example, as shown in FIG. 81, the part where the viewer user sets the ratio of viewer avatars to be simple avatars). It is characterized by the following. According to this feature, since the viewer user can set the ratio of the number of viewer avatars to be the second viewer avatar with respect to the number of viewer avatars participating in the virtual space, it is possible to further suppress a decrease in the interest in the virtual space content due to viewer avatars with an unintended ratio becoming the second viewer avatars.

[0010] The virtual space content distribution system according to claim 5 is the virtual space content distribution system according to claim 1, comprising a highly related user registration means by which a viewer user can register other viewer users having a high relationship with himself / herself as highly related users, in the viewer avatar setting means, the viewer user can set the viewer avatar of a viewer user not registered as the highly related user to be the second viewer avatar preferentially (for example, as shown in FIG. 79, the part where the viewer avatar of a viewer user who is not a friend is preferentially set as a simple avatar). It is characterized by the following. According to this feature, since the viewer avatar of a viewer user registered as a highly related user is more likely to be displayed as the first viewer avatar than the viewer avatar of a viewer user not registered as a highly related user, when a plurality of viewer avatars are displayed, it is easier to recognize the viewer avatar of a viewer user registered as a highly related user.

[0011] The virtual space content distribution system according to claim 6 is the virtual space content distribution system according to claim 1, The setting regarding making the viewer avatar the second viewer avatar includes a first-stage setting and a second-stage setting with a smaller processing load related to display output than the first-stage setting (for example, as shown in FIGS. 83 and 84, the part where only one of the third area and the fourth area can be set as the simplification target area, and the part where both the third area and the fourth area can be set as the simplification target area). It is characterized by the following. According to this feature, it is possible to change the level of processing load related to display output according to the situation.

[0012] The virtual space content distribution system according to claim 7 is the virtual space content distribution system according to claim 6, The setting in the viewer avatar setting means is executable during a specific period, When the setting in the viewer avatar setting means is not completed during the specific period, the second-stage setting is set (for example, as shown in FIG. 82, when the designation of the area to be simplified is not completed during the live virtual space participation period, the viewer terminal 300 sets both the third area and the fourth area as the areas to be simplified). It is characterized by this. According to this feature, even when the setting in the viewer avatar setting means is not completed during the specific period, it is possible to reduce the processing load related to display output.

[0013] The virtual space content distribution system according to claim 8 is the virtual space content distribution system according to claim 1, It includes a processing capacity specifying means capable of specifying the processing capacity related to the display output of the viewer user terminal, The viewer avatar setting means can perform an operation setting (for example, as shown in FIG. 77, the part where the viewer user operates the viewer terminal 300 to set the area to be simplified) as a setting regarding setting the viewer avatar as the second viewer avatar, and a non-operation setting (for example, as shown in FIGS. 83 and 84, the viewer terminal 300 identifies the processing capacity of the viewer terminal 300 and sets the number of areas corresponding to the identified processing capacity as the areas to be simplified) based on the processing capacity specified by the processing capacity specifying means without the viewer user performing an operation. It is characterized by this. According to this feature, it is possible to increase the degree of freedom of the viewer user in the setting of the viewer avatar setting means, and by making it a non-operation setting, the viewer user can perform an appropriate setting corresponding to the processing ability of the viewer user terminal used by himself without performing an operation by himself.

[0014] The virtual space content distribution system according to claim 9 is the virtual space content distribution system according to claim 1, The viewer avatar setting means has an auxiliary function for assisting a setting operation regarding setting the viewer avatar as the second viewer avatar (for example, as shown in FIG. 86, in the display device 310, a part for displaying a message explaining what settings are possible in the viewer terminal 300). It is characterized by this. According to this feature, the viewer user can accurately perform an operation for setting the viewer avatar as the second viewer avatar by means of the auxiliary function.

[0015] The virtual space content distribution system according to claim 10 is the virtual space content distribution system according to claim 1, The virtual space content is a video generated by the viewer user terminal, which is a viewer viewpoint video seen from the viewer avatar corresponding to the viewer user terminal, and a video generated by the server computer, which is a common viewpoint video seen from a predetermined position in the virtual space, and includes The viewer viewpoint video is a video reflecting the setting regarding setting the viewer avatar for each viewer user terminal as the second viewer avatar, The common viewpoint video is a video in which all the viewer avatars are set as the second viewer avatar (for example, as shown in FIG. 85, the viewer viewpoint video is a video reflecting the setting of the simplification target area, and the virtual camera designated video is a video in which the viewer avatar is a simple avatar without reflecting the setting of the simplification target area). It is characterized by this. According to this feature, it is possible to reduce the processing load related to the display output of the viewer avatar video on the viewer user terminal, and on the server computer, by generating a common viewpoint video for all viewer avatars as the second viewer avatar, it is also possible to reduce the processing load related to the display output of the common viewpoint video.

[0016] The virtual space content distribution program according to claim 11 is A virtual space content distribution program for distributing virtual space content (for example, virtual live) in a virtual space, The virtual space content is Content including videos that can be viewed by a viewer user on a viewer user terminal (for example, viewer terminal 300) assigned to each of a plurality of viewer users, Using the viewer user terminal connected via a communication network to a server computer (for example, distribution server computer 100) capable of executing at least processing related to the virtual space and processing related to the distribution of the virtual space content, it is possible to participate a viewer avatar corresponding to itself in the virtual space targeted by the virtual space content, and thus the viewer avatar may be included (for example, as shown in FIG. 13, the part where the viewer avatars of each viewer are displayed to virtually participate in the virtual live venue on the viewer terminal 300), The viewer avatar includes a first viewer avatar (for example, full avatar) and a second viewer avatar (for example, simple avatar) with a smaller processing load for display output than the first viewer avatar, The viewer user himself / herself corresponds to other viewer users Settings regarding using the viewer avatar as the second viewer avatar to implement Including viewer avatar setting processing that can be performed (for example, as shown in FIGS. 71 and 76, the part where the viewer terminal 300 executes a simplification target area designation operation process) It is characterized by this. According to this feature, since the viewer user himself / herself can execute the setting regarding making the viewer avatar the second viewer avatar, the intention of the viewer user can be reflected in the viewer avatar that becomes the second viewer avatar. Therefore, it is possible to suppress a decrease in the interest in the virtual space content due to the viewer avatar becoming the second viewer avatar against the intention of the viewer user, and at the same time, it is possible to reduce the processing load related to display output.

[0017] The virtual space content distribution method according to claim 12 is a virtual space content distribution method for distributing virtual space content (for example, virtual live) in a virtual space, wherein the virtual space content is content including video that can be viewed by a viewer user on a viewer user terminal (for example, viewer terminal 300) assigned to each of a plurality of viewer users, and it is possible to participate in the virtual space corresponding to the viewer user himself / herself in the virtual space targeted by the virtual space content by using the viewer user terminal connected via a communication network to a server computer (for example, distribution server computer 100) capable of executing at least the processing related to the virtual space and the processing related to the distribution of the virtual space content, and in this case, the viewer avatar may be included (for example, as shown in FIG. 13, the part where the viewer avatars of each viewer are displayed as virtually participating in the virtual live venue on the viewer terminal 300), the viewer avatar includes a first viewer avatar (for example, a full avatar) and a second viewer avatar (for example, a simple avatar) with a smaller processing load for display output than the first viewer avatar, The viewer user himself / herself corresponds to other viewer users settings regarding making the viewer avatar the second viewer avatar to implement include viewer avatar setting procedures that can be performed (for example, as shown in FIGS. 71 and 76, the part where the viewer terminal 300 executes a simplification target area designation operation process) and is characterized by this. According to this feature, the viewer user himself can perform the settings regarding making the viewer avatar the second viewer avatar, so the viewer user's intentions can be reflected regarding the viewer avatar that will become the second viewer avatar.This makes it possible to reduce the processing load related to the display output while suppressing a decrease in interest in the virtual space content due to the viewer avatar becoming the second viewer avatar against the viewer user's intentions.

[0018] Furthermore, the present invention may have only the invention-specific matters set forth in the claims of the present invention, or may have the invention-specific matters set forth in the claims of the present invention as well as configurations other than the invention-specific matters. [Brief explanation of the drawings]

[0019]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Figure 21

Figure 22

Figure 23

Figure 24

Figure 25

Mode for Carrying Out the Invention

[0020] A mode for implementing the virtual space content distribution system of the present invention will be described below with reference to the drawings based on an embodiment. In a plurality of drawings, the same or similar components are given the same reference numerals, and redundant explanations are omitted. Further, the virtual space content distribution program according to the present invention may be a program used for the entire system including a server computer and each terminal described later that constitutes the virtual space content distribution system, or may be a program that operates only on a part of the devices constituting the virtual space content distribution system, for example, a server computer or each terminal. Each process described below is executed by a program stored in the device where the process is performed.

Embodiment

[0021] FIG. 1 is a block diagram showing a system configuration example of a virtual space content distribution system in Example 1 which is one embodiment of the present invention. In the system of Example 1 shown in FIG. 1, a virtual live in which a performer avatar 1 corresponding to a performer user holds a live event in the virtual live venue shown in FIG. 12 is distributed as virtual space content. Hereinafter, distribution means transmission to a plurality of recipients and is synonymous with transmission.

[0022] As shown in FIG. 1, the virtual space content distribution system of Example 1 mainly includes a distribution server computer 100 capable of executing various processes related to the virtual live venue shown in FIG. 11 which is a virtual space and various processes related to the distribution of virtual live, an event manager M of an event operation organization that operates and manages virtual live events, a manager terminal 150 used to manage the distribution of virtual live events, a performer terminal 200 used by a performer user, and a viewer terminal 300 that can be used by a viewer user who virtually participates in and views a virtual live event. The distribution server computer 100, the manager terminal 150, the performer terminal 200, and the viewer terminal 300 are connected to be capable of data communication with each other via the Internet network N which is an open computer network.

[0023] In the present Example 1, a form in which the administrator terminal 150 and the performer terminal 200 are also connected to the distribution server computer 100 via the Internet network N is illustrated. However, the present invention is not limited to this. For example, in the case where the studio shown in FIG. 11 is a studio operated by an event management organization and the event management organization provides the studio to performer users, and the distribution server computer 100 is installed in these studios, the administrator terminal 150 and the performer terminal 200 may be locally data communication-connected to the distribution server computer 100, or may be communication-connected via a local area network LAN within the studio facility.

[0024] Also, as shown in FIG. 1, there are a plurality of viewer users such as viewer user A, viewer user B, viewer user C, etc. As the viewer terminal 300, viewer terminals 300a, 300b, 300c,... that can be used by individual viewer users A, viewer user B, viewer user C,... are included. Note that the number of viewer users is usually plural, but may be one person or four or more persons, and the number may be appropriately determined according to a virtual live venue or the like that is a virtual space. Hereinafter, viewer users A, viewer user B, viewer user C,... may be collectively referred to as viewer users, and viewer terminals 300a, 300b, 300c,... may be collectively referred to as viewer terminal 300.

[0025] In the present Example 1, a form in which there is one performer user is illustrated. However, the present invention is not limited to this. The virtual live may be a co-starring event in which a plurality of performer users who are acting alone virtually participate, or may be a group event in which a plurality of people who are acting together virtually participate. Thus, when a plurality of performers appear, performer terminals 200a, 200b, 200c,... may be provided for each performer user, or when a plurality of people appear as a group, one performer terminal 200 may be used by a plurality of people.

[0026] In addition, in FIG. 1, the distribution server computer 100 is illustrated alone, but the present invention is not limited thereto. These distribution server computers 100 may be configured with a plurality of server computers such as a first server computer mainly performing virtual space processing and a second server computer mainly performing distribution processing, or may be configured with a cloud server or the like, and the number of server computers may be appropriately changed according to the scale of the event, the number of listener users participating, and the like.

[0027] Similarly, regarding the administrator terminal 150, although it is illustrated alone in FIG. 1, the present invention is not limited thereto. Needless to say, these administrator terminals 150 may be plural according to the number of performer users and viewer users virtually participating in the live event and the like.

[0028] <Distribution server computer> FIG. 2 is a diagram showing the configuration of the distribution server computer 100 used in the first embodiment. The distribution server computer 100 used in the first embodiment is a normal server computer with relatively excellent processing capabilities installed in a studio operated by an event management organization as described above. As shown in FIG. 2, it has a processor (CPU) 101 connected to a data bus 108, a memory (RAM) 102, a storage 103 such as a hard disk, a communication interface (I / F) 104 capable of two-way communication by the TCP / IP protocol via the Internet which is an open computer network, and an input / output interface (I / F) 105 to which an input device such as a keyboard can be connected.

[0029] In addition, in the first embodiment, an input / output interface (I / F) 105 is provided to enable local operations. However, when remote operations via the communication interface (I / F) 104 are possible, the input / output interface (I / F) 105 may not be provided.

[0030] In the storage 103 of the distribution server computer 100, in addition to an operation system (server OS) for providing server functions (not shown), various data and programs are stored as shown in FIG. 3. Specifically, mainly, an event management program 110 for providing an event management function for managing live events, a virtual space generation program 120 for providing a virtual space of a virtual live venue which is a virtual space, a performer user management program 130 for providing a performer user management function for managing performer users, and an audience user management program 132 for providing an audience user management function for managing audience users are stored.

[0031] The event management program 110 is a program for managing a virtual live which is an event held in a virtual live venue (see FIG. 12) in cooperation with the administrator terminal 150, and can manage the progress of the virtual live event using event data 111 (see FIG. 7), time schedule data (TS data) 112, and music data 113 stored in the storage 103 together with the event management program 110.

[0032] The event data 111 used in the first embodiment is illustrated in FIG. 7. The event data 111 is associated with an event ID uniquely assigned to the event, and stores information such as the event name, the file name of the time schedule (TS) data, the performer ID uniquely assigned to the performer user who is the performer, the file name of the music list, the file name of the participating audience list in which information of special audience users permitted virtual participation is registered in the third area of the virtual audience area described later, and the file name of the participating audience list in which information of audience users who have reserved virtual participation is registered in the fourth area of the virtual audience area described later.

[0033] Still, the time schedule data (TS data) 112 is data in which the order of progress of the virtual live event to be held and the programs such as music are described in time series, and the virtual live event is managed so as to progress based on the time schedule described in the time schedule data (TS data) 112. Also, these time schedule data (TS data) 112, event data 111, etc. can be changed, updated, and added by the event administrator M operating the administrator terminal 150.

[0034] Also, the music data 113 is data of the performance parts (so-called karaoke) of each music sung by the performer user, and is reproduced by the voice control program 124 described later based on the time schedule data (TS data) 112 by the event management program 110 and transmitted to the performer terminal 200 and the viewer terminal 300 (see FIG. 11).

[0035] The virtual space generation program 120 is a program for providing a virtual live venue which is the virtual space shown in FIG. 12, and uses the virtual space data 121 in which the structure of the virtual live venue stored in the storage 103 together with the virtual space generation program 120 is described, the object data 122 for arranging various objects (including the virtual arrangement object 43 which is a star decoration on the stage and the virtual air objects 50 to 52 which are star objects in the sky) arranged in the virtual live venue in the virtual space, and the performer avatar data included in the performer user data 131 described later and the viewer avatar data included in the viewer user data 133, and has a function of providing a virtual live venue in which the performer avatar and the viewer avatar virtually participate.

[0036] As shown in FIG. 12, the viewpoint video control program 123 provides a function of generating viewpoint videos from virtual cameras C1 to C4 and an aerial movement virtual camera (not shown) virtually set in a virtual live venue, and cooperates with the viewer terminal 300 to virtually participate in the third area of the virtual live venue. It is a program for providing a function of displaying videos from the viewpoints of viewer avatars 11 to 14 and viewer avatars 21 to 32 virtually participating in the fourth area on the viewer terminal 300. Note that the virtual camera C2 is a virtual camera set to be the video from the viewpoint of the performer avatar 1 on the stage of the virtual live venue, and the viewpoint video from the virtual camera C2 is connected to the performer terminal 200 in cooperation with the performer terminal 200. It is projected onto the screen S provided in the studio by a projector 211 described later.

[0037] The audio control program 124 is a program for controlling the audio (including music) distributed in a virtual live event. Specifically, it provides a function of playing music data 113 and a function of synthesizing the music played with the voice uttered by the performer user and distributing it to the administrator terminal 150 and the viewer terminal 300.

[0038] The comment control program 125 cooperates with the viewer comment control program stored in the viewer terminal 300 described later to provide a function of displaying various comments input by each viewer user on the viewer terminal 300 in time series on the performer terminal 200 and the viewer terminal 300.

[0039] The gift control program 126 is a program for controlling gifts given from viewer users to performer users in cooperation with the viewer program stored in the viewer terminal 300 described later. Specifically, it provides functions for viewer users to purchase gifts based on the information on the purchase unit prices set for various gifts stored in the gift data 134, processing functions for viewer users to give the gifts purchased using the object data of the gifts included in the gift data 134 to performer users (including processing such as effects when giving), processing functions for changing the owner of the given gift from the viewer user to the performer user, and the like.

[0040] The performer user management program 130 provides a management function and an authentication function for information related to performer users based on the performer user data 131 shown in FIG. 8 stored in the storage 103 together with the performer user management program 130.

[0041] The performer user data 131 used in the first embodiment is illustrated in FIG. 8. The performer user data 131 stores various information such as the account (e-mail address) of the performer user, name, authentication information, file name of avatar data of the avatar used in the virtual space, and file name of the item list in which the owned items are registered, in association with the performer user ID uniquely assigned to the performer user. Although not shown in FIG. 8, information on virtual values such as points owned by each performer user may be stored as the performer user data 131.

[0042] Performer users can be authenticated by verifying the performer user ID, account, and authentication information, and can identify the items (gifts) that have become owned by each performer user by being given from viewers from the item list.

[0043] The viewer user management program 132 provides a management function and an authentication function for information related to viewer users based on the viewer user data 133 shown in FIG. 9 stored in the storage 103 together with the program.

[0044] The viewer user data 133 used in the first embodiment is illustrated in FIG. 9. The viewer user data 133 is associated with a viewer user ID uniquely assigned to the viewer user, and includes the account (e-mail address) of the viewer user, authentication information, the file name of avatar data of the avatar used in the virtual space, the number of owned points which is the number of points available for use in the virtual space, the file name of the item list in which items (gifts) purchased using points are registered, personal information such as name, date of birth, and telephone number, and other various information. Although not shown in FIG. 9, the nickname (comment name) displayed together with comments is also registered in the viewer user data 133, and the nickname (comment name) is displayed together with comments. Also, points can be increased, for example, by purchasing from a predetermined operating company.

[0045] <Performer terminal> FIG. 4 is a diagram showing a configuration example of the performer terminal 200 in the virtual space content distribution system of the first embodiment. In the first embodiment, as shown in FIG. 11, the performer terminal 200 is provided in an adjustment room adjacent to the studio where the performer user performs acting operations, and uses a normal computer with relatively excellent processing capabilities. As shown in FIG. 4, it has a processor (CPU) 201 connected to the data bus 208, a memory (RAM) 202, a storage 203 such as a hard disk, a communication interface (I / F) 204 capable of two-way communication by the TCP / IP protocol via the Internet which is an open computer network, an image processing unit 206 including a graphics processing unit (GPU) to which display devices A210 to display devices C212 are connected, and an input / output interface (I / F) 205 to which various input / output devices are connected.

[0046] The input / output interface (I / F) 205 is connected with, as input devices, a motion sensor 220 including a plurality of wearable sensors 220C1 to 220C5 (see FIG. 11) worn by the performing user on the left and right hands, feet, and waist, an expression input device 221 composed of an imaging camera for inputting the expression of the performing user's face, a voice input device 222 composed of a sound collecting microphone worn on the head of the performing user, an operation input device 224 such as a keyboard or a touch panel on which an auxiliary operator O for assisting the performing user is operably provided, and the like. Incidentally, as these input devices, a controller that enables various operations by being held by the performing user may be provided so that the performing user himself / herself can perform various operations without the auxiliary operator O.

[0047] Incidentally, in the first embodiment, since the performing user performs a performing operation (including music operations such as singing and dancing) according to the music, the auxiliary operator O assists the operations during the performance. However, the auxiliary operator O may be plural, or the operation content may be set in advance in the performer terminal 200, for example, in a sequence program or the like, so that the auxiliary operator O may not be provided.

[0048] The input / output interface (I / F) 205 is connected with a voice output device 223 including a high-function earphone (ear monitor) worn by the performing user and a speaker arranged in the adjustment room as output devices, so that the sound of the reproduced music transmitted from the distribution server computer 100 is output to the performing user via the high-function earphone (ear monitor), and the music sound together with the voice of the performer is output from the speaker, so that the auxiliary operator O and the like can confirm the situation of the music including the voice emitted by the performing user in the adjustment room.

[0049] In the first embodiment, a high - performance earphone (ear monitor) is used to avoid the inconvenience caused by the input of the reproduced music voice from the sound - collecting microphone worn by the performer user. However, the present invention is not limited to this. As long as the inconvenience caused by the input of the music voice can be avoided, the music voice may be output from a speaker in the studio or the like.

[0050] In addition, in the first embodiment, the form in which the performer user wears the sound - collecting microphone is exemplified. However, these sound - collecting microphones may be of an installation type installed on the floor, wall, or ceiling of the studio.

[0051] Here, the motion sensor 220 used in the performer terminal 200 of the first embodiment will be described. Any motion sensor 220 can be used as long as it can appropriately detect (measure) the movement (action) of the body of the performer user. In the first embodiment, in order to detect the actions of the performer more accurately and in a short cycle, a plurality of wearable sensors 220C1 to 220C5 worn on the body of the performer user are used. In addition, a type of motion sensor 220 that does not require the performer to wear a device, such as LiDER using laser light or the like, may be used.

[0052] In addition, in the first embodiment, in order to reduce the operational burden caused by wearing sensors or the like when the performer user performs a performance action, particularly the operational burden on the head, the movement of the head of the performer user is detected by image recognition using an image captured by an imaging camera that constitutes the expression input device 221, as will be described later. The form in which the movements other than the head are detected using the five wearable sensors 220C1 to 220C5 is exemplified. However, for example, wearable sensors may also be provided on the head of the performer user, or more (7 or more) wearable sensors may be worn in order to detect more detailed movements.

[0053] As shown in FIG.  11, the wearable sensors 220C1 to 220C5 cooperate with the base stations 220a and 220b installed in the studio room separated from the adjacent adjustment room by the glass window to detect their own positions and orientations.

[0054] These base stations 220a and 220b can use, for example, a multi-axis laser emitter. After emitting the blinking light for synchronization, the base station 220a scans the laser light around, for example, the vertical axis. The base station 220b scans the laser light around, for example, the horizontal axis.

[0055] Each of the mounting sensors 220C1 to 220C5 may include a plurality of optical sensors that detect the incidence of the blinking light and the laser light from the base station 220a and the base station 220b.

[0056] Each of the mounting sensors 220C1 to 220C5 can detect its own position and orientation based on, for example, the time difference between the incidence timing of the blinking light and the incidence timing of the laser light, the light reception time at each optical sensor, the incidence angle of the laser light detected by each optical sensor, and other information as necessary. For example, the ViveTracker provided by HTC CORPORATION or the base station can be preferably used.

[0057] Since the base stations 220a and 220b emit the blinking light and scan the laser light at regular intervals, the detection information of each of the mounting sensors 220C1 to 220C5 is updated for each such interval. Then, the detection information indicating the position and orientation of each motion sensor calculated in each of these mounting sensors 220C1 to 220C5 is input to the performer terminal 200 by short-range wireless communication and transmitted to the distribution server computer 100 as performer avatar information together with the face motion information (see FIG. 10).

[0058] In addition, in the first embodiment, a form using two base stations, i.e., the base station 220a and the base station 220b, is exemplified. However, the present invention is not limited to this, and three or more of these base stations may be used.

[0059] Alternatively, the motion sensor 220 may be configured such that each of a plurality of motion sensors worn by the performer user is equipped with a number of infrared LEDs or visible light LEDs, and the position and orientation of each of the motion sensors are detected by detecting the light from these LEDs with an infrared camera provided on the floor or wall of the studio.

[0060] Alternatively, in order to reduce the burden on the performer user, the motion sensor 220 may be replaced with a motion sensor using a lighter reflective marker instead of the wearing sensors 220C1 to 220C5. That is, the performer user's motion may be detected by photographing reflective markers attached to various parts of the performer user's body with adhesive tape or the like to generate photographed data, and detecting the position and orientation of the reflective markers by performing image processing on this photographed data. In this case, a cameraman for photographing the performer user may be arranged in the studio, and the cameraman may photograph the performer user so that the performer user's motion can be photographed from a direction suitable for detection.

[0061] Alternatively, as the motion sensor 220, a suit incorporating an inertial sensor, for example, a suit incorporating an inertial sensor for the MVN motion capture system marketed by Xsens.com, may be used, and the motion of the performer user may be detected by analyzing the sensor signal output from the inertial sensor.

[0062] The expression input device 221 can be any device as long as it can appropriately detect the motion of the head including the face of the performer user. In the first embodiment, specifically, it is configured by an imaging camera (digital camera) arranged to be able to continuously image the head image including the face of the performer user. The motion of the head and the motion (expression) of the face of the performer user imaged by the imaging camera are detected by image recognition, and the face motion information, which is the detected motion of the head and the motion (expression) of the face, is transmitted to the distribution server computer 100 as performer avatar information together with the body motion information as shown in FIG. 10.

[0063] Furthermore, the expression input device 221 is not limited to the imaging camera (digital camera) used in the first embodiment. For example, the expression input device 221 may be a 3D camera capable of detecting the depth of a person's face. Alternatively, for example, a mobile terminal such as a smartphone equipped with a LiDAR device can also be used. In this case, the performer user may wear these mobile terminals.

[0064] In the performer terminal 200 of the first embodiment, as described above, it has three display devices A210 to C212. The display device A210 is, as shown in FIG. 11, a liquid crystal monitor or the like provided in the adjustment room. The display device B211 is a projector that projects an image onto the screen S provided in the studio. The display device C212 is a vertical large display provided adjacent to the screen S in the studio.

[0065] On the display device A210 arranged in the adjustment room of the studio, images from each viewpoint of the virtual cameras C1 to C4, viewpoint images from the aerial movement virtual camera during the flying effect period described later, the content of the comment, and a message input window for the assistant operator O to input a message to be conveyed to the performer user are displayed.

[0066] On the other hand, on the screen S projected by the projector which is the display device B211 provided in the studio, an image including the avatars of the viewers virtually participating in the live event in the third region and the fourth region, which is the viewpoint image of the virtual camera C2 (see FIG. 12) from the performer's viewpoint, is displayed. Thus, the performer user can confirm the situation of the viewer users virtually participating in the virtual live event through the image.

[0067] In addition, on the display device C212 provided in the studio, comments from viewer users, comments and messages input by the assistant operator O, etc. are displayed, so that the performer user can check the comments of the viewer users even during the performance and check the messages from the assistant operator O.

[0068] In the storage 203, in addition to the operation system (OS) for operating the computer which is the performer terminal 200, various functions including the function of controlling the operation of the performer avatar 1 by the performer user in the virtual live which is virtual space content by the execution of the processor (CPU) 201 etc. are provided in cooperation with the distribution server computer 100. A performer program is stored.

[0069] As shown in FIG. 4, the performer program includes a performer avatar control program, a performer viewpoint video control program, a performer viewpoint video control program, a performer voice control program, a performer comment control program, performer authentication data, etc.

[0070] The performer avatar control program mainly scans the body motion of the performer user using the motion sensor 220 and scans the face motion (expression) of the performer user using the expression input device 221, and generates performer avatar information for operating the performer avatar. It is a program that provides a function of transmitting to the distribution server computer 100.

[0071] The performer viewpoint video control program is a program that provides a function of generating and outputting a viewpoint video of the virtual camera C2 which is the performer's viewpoint based on the virtual space update data distributed from the distribution server computer 100.

[0072] The performer voice control program outputs the playback sound of a music piece based on the music piece playback data distributed from the distribution server computer 100 via the voice output device 223, digitizes the voice input from the voice input device 222, transmits it as performer voice data to the distribution server computer 100, and provides a function of generating and outputting a monitor voice composed of the playback sound of the music piece and the performer voice.

[0073] The performer comment control program is a program that provides a function of displaying each comment etc. by the viewer user distributed from the distribution server computer 100.

[0074] The performer authentication data is data for authenticating that the performer user is the actual person in the communication connection with the distribution server computer 100.

[0075] In addition, the performer avatar control program includes a motion parameter generation program etc. that can generate parameter information on the positions and rotation angles of bones (bones) that make up rig data (sometimes called skeleton data) indicating the skeleton of the performer avatar included in the performer avatar data, and also includes an image recognition processing program etc. for image-recognizing the position and expression of the head of the performer user from the image captured by the imaging camera.

[0076] Also, in the first embodiment, the performer terminal 200 is a computer that becomes the performer terminal 200 installed in the studio operated by the event management organization, and is jointly used by a plurality of performer users. When holding a live event, each performer user can use it as the performer terminal 200 of that performer user by inputting the performer authentication data. However, the present invention is not limited to this. For example, when a performer user appears in a virtual live from home etc., the performer terminal 200 is a dedicated computer installed by the performer user at home. It may be a form used only by the owning performer user. In such a case, it is not always necessary to store the performer authentication data.

[0077] In this way, by the performer user or the like using the performer terminal 200 that constitutes the virtual space content distribution system of the first embodiment, the performer user can operate the performer avatar 1 placed on the virtual stage G in the virtual live venue in conjunction with his or her own actions, and can reflect his or her own expression in the expression of the performer avatar 1. Also, the user's own voice can be distributed to the viewers through the distribution server computer 100 as the voice of the performer avatar 1.

[0078] <Viewer terminal> FIG. 5 is a diagram showing a configuration example of the viewer terminal 300 in the virtual space content distribution system of the first embodiment. In the first embodiment, the viewer terminal 300 is a smartphone P carried by the viewer user or a stationary normal computer (PC) installed by the viewer user at home or the like. As shown in FIG. 5, it has a processor (CPU) 301 connected to a data bus 308, a memory (RAM) 302, a storage 303 such as a hard disk or a non-volatile memory, a communication interface (I / F) 304 capable of two-way communication by the TCP / IP protocol via the Internet which is an open computer network, an image processing unit 306 including a graphics processing unit (GPU) to which a display device 310 is connected, and an input / output interface (I / F) 305 to which various input / output devices are connected.

[0079] As will be described later, the display device 310 is generated based on the virtual space data of the virtual live venue, which is a virtual space updated by virtual space update data (see FIG. 10) distributed from the distribution server computer 100 by the viewer viewpoint video control program included in the viewer program stored in the storage 303. Any device capable of displaying each viewpoint video and the flying viewpoint video distributed from the distribution server computer 100 during the flying effect period described later may be used. When the viewer terminal 300 is a smartphone P, the display of the smartphone P is applicable. When the viewer terminal 300 is a normal computer (PC), the stationary display constituting the computer (PC) is applicable. Note that these displays are not limited to those that display a planar view image (2D image), and may be capable of displaying a stereoscopic view image (3D image) by displaying a right-eye image and a left-eye image, such as a head-mounted display (HMD) that can be worn by the viewer.

[0080] Connected to the input / output interface (I / F) 305 are, as input devices, an operation input device 321 composed of one or a plurality of devices that enable the viewer to perform various operations, and an audio output device 322 such as earphones or a speaker that can output live audio and the like distributed from the distribution server computer 100.

[0081] Needless to say, the audio output device 322 may not be a single device and may be integrated with the display device 310 like the above-described head-mounted display (HMD).

[0082] The operation input device 321 can use any device as long as it can execute various operations such as operation operations including movement of the viewer avatar, zoom operation, operation related to comments, operation related to gifts, etc. For example, it is composed of at least one or more of a transparent touch panel formed on the display surface of a smartphone, a keyboard constituting a computer, a game controller, and the like.

[0083] Furthermore, in the first embodiment, as a viewer, as will be described later, the virtual audience area in the virtual live venue is divided into a third area near the virtual stage G where only viewer users specially permitted by the performer user can virtually participate, as shown in FIG. 12, and a fourth area around the third area where general viewer users can virtually participate. Viewer users who virtually participate in the fourth area may use an operation input device 321 such as a touch panel, a keyboard, or a game controller, as described above. However, viewer users who virtually participate in the third area are viewer users who can finely operate the viewer avatar according to their own actions, like the performer user, by owning, for example, an MVN motion capture suit with the above-described inertial sensor as the operation input device 321.

[0084] However, even viewer users permitted to virtually participate in the third area cannot change the expression of the viewer avatar. However, the present invention is not limited to this, and the expressions of these viewer avatars may be changed, for example, as described above, by having the viewer user use the camera function of a smartphone or a camera connected to a computer to recognize the facial expression of the viewer user, even at a level different from the change level of the performer user.

[0085] Furthermore, various input / output devices connected to these input / output interfaces (I / F) 305 may be built-in or external. In the case of an external device, it may be connected in either a wired or wireless connection form.

[0086] In the storage 303, in addition to an operation system (OS) for operating a smartphone or a computer, which is the viewer terminal 300, a viewer program for providing various functions including a live viewing function related to viewer users in a virtual live, which is virtual space content, by being executed by a processor (CPU) 301 or the like is stored as a viewing app in cooperation with the distribution server computer 100.

[0087] As shown in FIG. 5, the viewer program includes a viewer viewpoint video control program that provides a function of generating each viewpoint video of the virtual live to be displayed on the display device 310, a viewer audio control program that provides a function of outputting live audio (data) of the virtual live distributed from the distribution server computer 100 from the audio output device 322, a function of displaying comments based on the comment data distributed from the distribution server computer 100, and a function related to comments such as transmitting the comments input by the viewer to the distribution server computer 100. It includes viewer authentication data for authenticating that the viewer user is the person himself / herself in the communication connection with the distribution server computer 100.

[0088] Although not shown in FIG. 5, in addition to the above programs, there are a gift control program for performing control related to gifts, and as shown in Modification Example 3-1 (see FIGS. 42 and 43) described later, a region designation program for reserving a region (position) where the viewer avatar virtually participates in the virtual live venue before the start of the live event. However, other programs other than these may be included.

[0089] In this Example , the comments input by the viewer are short text messages in text format. However, they are not limited to these short text messages in text format. For example, they may be messages in still image format, messages in video format, and any other electronic messages in other formats. The comments are displayed superimposed on each viewpoint video on the display device 310.

[0090] In this way, by the viewer user of the viewer terminal 300 constituting the virtual space content distribution system of this Example, it is possible to move and operate the viewer avatar virtually participating in the virtual live venue, change the viewpoint video displayed on the display device 310 by changing the viewpoint by the viewer avatar, change the zoom state (state of the viewpoint), and operate the viewer avatar to support the performer avatar 1.

[0091] Also, in the case of a viewer avatar that virtually participates in the third area, movement is only possible within the third area, and movement to the fourth area is not possible. On the other hand, in the case of a viewer avatar that virtually participates in the fourth area, movement is only possible within the fourth area, and movement to the third area is not possible. However, the present invention is not limited to this, and in the case of a viewer avatar that virtually participates in the third area, it may be possible to move to the fourth area. Also, of course, the viewer avatar cannot move to the virtual stage G or the like, so the visibility of the performer avatar 1 will not be hindered by the movement of the viewer avatar on the virtual stage G.

[0092] In addition, when the viewpoint video is displayed on these display devices 310 and the live audio is output, the virtual live can be enjoyed as if one were present at the virtual live venue.

[0093] Also, although detailed description is omitted, by the comment function provided by the viewer comment control program, the virtual live can be enjoyed while checking the comments input by oneself and other viewer users, and by the gift function by the gift control program, the virtual live can also be livened up by giving the items one owns to the performer avatar 1.

[0094] <Administrator terminal> FIG. 6 is a diagram showing a configuration example of the administrator terminal 150 in the virtual space content distribution system of the first embodiment. In the first embodiment, the administrator terminal 150, together with the performer terminal 200, uses a normal computer provided in an adjustment room adjacent to the studio. As shown in FIG. 6, it includes a processor (CPU) 151 connected to a data bus 158, a memory (RAM) 152, a storage 153 such as a hard disk, a communication interface (I / F) 154 capable of two-way communication by the TCP / IP protocol via the Internet which is an open computer network, an image processing unit 156 including a graphics processing unit (GPU) to which a display device 160 is connected, and an input / output interface (I / F) 155 to which various input / output devices are connected.

[0095] As will be described later, the display device 160 can individually display the perspective videos of each of the virtual cameras C1 to C4 and the aerial movement virtual camera during the flying effect period, which are generated based on the virtual space data of the virtual live venue, which is a virtual space updated by the virtual space update data (see FIG. 10) distributed from the distribution server computer 100 by the administrator perspective video control program included in the administrator program stored in the storage 153. As long as it can display the comments based on the comment data distributed from the distribution server computer 100, it may be composed of one or more stationary displays.

[0096] Connected to the input / output interface (I / F) 155 as input devices are an operation input device 161 composed of one or more devices that enable various operations by the event administrator M, and an audio output device 162 such as earphones, headphones, or speakers capable of outputting live audio and the like distributed from the distribution server computer 100.

[0097] The operation input device 161 can be any device as long as the event manager M can execute various operations such as input and settings related to the virtual live event. For example, it can be composed of at least one of a keyboard that makes up a computer, a transparent touch panel formed on the display surface, a viewpoint switching controller, etc.

[0098] In addition, various input / output devices connected to these input / output interfaces (I / F) 155 may be in either a wired or wireless connection form.

[0099] In the storage 153, in addition to an operation system (OS) for operating the computer which is the administrator terminal 150, there is stored an administrator program for providing various functions including a distribution management function related to the distribution of virtual live, which is virtual space content, by the execution of a processor (CPU) 151, etc., in cooperation with the distribution server computer 100.

[0100] As shown in Figure 6, the administrator program includes an administrator viewpoint video control program, an administrator audio control program, an administrator comment control program, an audience management program, a performer management program, etc.

[0101] The administrator viewpoint video control program is a program that provides a function of generating viewpoint videos from each virtual camera to be displayed on the display device 160 and a function of changing and switching viewpoints.

[0102] The administrator audio control program is a program that provides a function of outputting live audio based on the audio data of the virtual live distributed from the distribution server computer 100 from the audio output device 162.

[0103] The administrator comment control program is a program that displays comments based on the comment data distributed from the distribution server computer 100 and provides functions related to comments such as prohibiting the distribution of comments and selecting viewers so that they are not distributed.

[0104] The viewer management program is a program for managing viewer users who virtually participate in a virtual live event, and the performer management program is a program for managing performer users who virtually participate in a virtual live event.

[0105] Although not shown in FIG. 6, there are included an authentication program for the administrator, who is an operator, to authenticate whether he / she is the actual person, a schedule program for editing the time schedule, music order, etc. of the virtual live event, and other programs may be included as well.

[0106] In this way, by the event administrator M operating the administrator terminal 150 that constitutes the virtual space content distribution system of the first embodiment, various settings for executing an event can be performed, for example, settings related to the program, music order, production, time schedule, the trajectory along which the virtual camera moves in the air during the flying production period, etc. Thus, the virtual live event is managed based on the content set in this way.

[0107] <Virtual live venue> The virtual live venue, which is the virtual space used in the first embodiment, is shown in FIG. 12. As shown in FIG. 12, the virtual live venue is a virtual space having a virtual stage G where performer users appear as performer avatars 1 and a virtual audience area where viewer users who are the audience virtually participate as viewer avatars, similar to a live venue in the real space.

[0108] As shown in FIG. 12, the virtual stage G has a trapezoidal floor surface with a relatively large area. Similar to the live venue in the real space, the performer avatar 1 can move on the virtual stage G. On the side opposite to the virtual audience direction of the virtual stage G, as shown in FIG. 12, a virtual stage wall divided into three parts, namely a central part, a right side part, and a left side part, is formed. On the front surfaces of these virtual stage walls, virtual displays 40, 41, and 42 are provided, and production images and videos are virtually displayed on the virtual displays 40, 41, and 42.

[0109] In addition, between the virtual displays 40, 41, and 42, a virtual placement object 43 of stars related to the performer user is arranged. In the second region, which is a region on the virtual stage G above the first region surrounded by the virtual stage wall, as shown in FIG. 12, large virtual aerial objects 50 to 52 of stars are arranged. The virtual aerial objects 50 to 52 can move within the second region.

[0110] In front of the virtual stage G, a virtual audience area is provided where viewer users can virtually participate in the virtual live venue as viewer avatars. As shown in FIG. 12, this virtual audience area includes a third region, which is a special area close to the center of the virtual stage G where the performer avatar 1 takes the stage, and a fourth region formed to surround the third region and having a greater distance from the center of the virtual stage G than the third region.

[0111] In these third regions, within a predetermined upper limit number range, special viewer users permitted virtual participation can virtually participate. In the first embodiment, as shown in FIG. 12, for example, viewer avatars 11 to 14 of four viewer users who meet a predetermined virtual participation record and are permitted virtual participation by the performer user are arranged.

[0112] In the fourth area, viewer avatars 21 to 32 of general viewer users who reserved virtual participation before the start of the virtual live are arranged. In FIG. 12, the viewer avatars 21 to 32 are shown in a simplified manner for convenience, but they are the same avatars as the viewer avatars 11 to 14.

[0113] In addition, each of the viewer avatars 11 to 14 arranged in the third area can move within the third area by the viewer user operating the viewer terminal, and each of the viewer avatars 21 to 32 arranged in the fourth area can also move within the fourth area by the viewer user operating the viewer terminal.

[0114] As shown in FIG. 12, four virtual cameras C1 to C4 are virtually arranged (set) in the virtual live venue. The virtual camera C1 is a virtual camera that is virtually arranged in front of the performer avatar 1 so as to face the performer avatar 1. The perspective video by the virtual camera C1 is, as shown in FIG. 13(a), a perspective video of seeing the performer avatar 1 from a position near the front.

[0115] The virtual camera C2 is a camera that is virtually arranged above the performer avatar 1. The perspective video by the virtual camera C2 is, as shown in FIG. 15, a performer's perspective video of seeing the virtual audience area from the performer avatar 1.

[0116] The virtual camera C3 is a virtual camera that is virtually arranged on the virtual display 41 diagonally behind the performer avatar 1. The perspective video by the virtual camera C3 is, as shown in FIG. 13(c), a perspective video of seeing the virtual audience area from diagonally behind the performer avatar 1.

[0117] The virtual camera C4 is a virtual camera that is virtually arranged on the virtual display 42 diagonally behind the performer avatar 1. The perspective video by the virtual camera C4 is, as shown in FIG. 13(b), a perspective video of seeing the virtual audience area from diagonally behind the performer avatar 1.

[0118] In addition, in the first embodiment, in addition to the virtual cameras C1 to C4 fixedly arranged (set), an airborne virtual camera (not shown) that can move in the air within the space of the virtual live venue, which is a virtual space, is virtually arranged. The airborne trajectories along which these airborne virtual cameras move and the viewing directions (angles) at individual positions on the airborne trajectories are preset by the administrator terminal 150. During the flying effect period described later, the performer avatar 1 virtually flies so as to follow the airborne trajectory of the airborne virtual camera, and a viewpoint video capturing the virtually flying performer avatar 1 with the airborne virtual camera is generated.

[0119] In the first embodiment, as shown in FIG. 12, a form in which four virtual cameras C1 to C4 are virtually arranged as fixedly arranged (set) virtual cameras is exemplified. However, the present invention is not limited to this, and the number of these fixedly arranged (set) virtual cameras may be five or more. Conversely, without providing fixedly arranged (set) virtual cameras, only the viewpoint videos seen from the viewpoints corresponding to the respective avatars virtually participating in the virtual live venue may be displayed on the performer terminal 200 and the viewer terminal 300.

[0120] In the first embodiment, a form in which there is one airborne virtual camera is exemplified. However, the present invention is not limited to this, and a form in which there are a plurality of these airborne virtual cameras may be used. Conversely, a form in which the airborne virtual camera is not virtually arranged may also be used.

[0121] <Studio> FIG. 11 is a diagram showing the studio used in the first embodiment. As described above, an adjustment room separated by a glass window is provided adjacent to the studio. The performer user performs various operations corresponding to singing in the studio, and the auxiliary operator O assists in operating the performer terminal 200 installed in the adjustment room. Around the performer user wearing the mounting sensors 220C1 to 220C5, the base station 220a and the base station 220b are mounted and arranged on the stand, and in the approximate front position of the performer user, the imaging camera constituting the expression input device 221 is mounted and arranged on the stand.

[0122] A screen S is provided on the wall surface where the performer user confronts in the studio. The perspective video of the virtual camera C2 is projected onto the screen S from the projector (display device B211) arranged on the ceiling of the studio. As shown in FIG. 15, the perspective video seen from the performer avatar 1 in the virtual audience area is displayed on the screen S, and the performer user can proceed with the live while sequentially grasping the state of the viewer avatar virtually participating in the virtual audience area (the reaction of the viewers to the live).

[0123] In addition, a vertical large display as the display device C212 is arranged at the side position of the screen S, and comments of the viewers and messages that the auxiliary operator O wants to convey to the performer user are displayed on the large display. Incidentally, lyrics of the song sung by the performer in the live, information such as lines (performer support information) may be displayed on the display device C212.

[0124] <Operation of the virtual space content distribution system> FIG. 10 is an explanatory diagram for explaining the operation of the virtual space content distribution system according to the first embodiment, specifically, the flow in which the video and audio of the virtual live are distributed.

[0125] First, the video system will be described. As described above, the distribution server computer 100 is capable of providing a virtual space for a virtual live venue based on the virtual space generation program 120 and avatar data of performer users, viewer users, etc. The operations of the avatars of these performer users and viewer users are such that the state of the virtual space is described by the performer avatar information transmitted from the performer terminal 200 and the viewer avatar information transmitted from the viewer terminal 300. The virtual space data is updated, so that the operations of the performer users are reflected in the operations of the performer avatar 1, and the operations (operations) of the viewer users are reflected in the operations of the viewer avatar.

[0126] Note that although not shown in FIG. 10, the performer terminal 200 and the viewer terminal 300 are pre-distributed and stored with virtual space data of the virtual live venue from the distribution server computer 100 when communicating and connecting with the distribution server computer 100 to virtually participate in the virtual live. The virtual space data pre-stored in this way is sequentially updated by the virtual space update data sequentially distributed from the distribution server computer 100 as described later, so that the latest state of the virtual live venue can be specified by the performer terminal 200 and the viewer terminal 300.

[0127] Specifically, the operations and expressions of the performer users in the studio described above are scanned at predetermined time intervals by the functions of body motion scanning and face motion scanning by the performer avatar control program described above to generate performer avatar information and transmitted to the distribution server computer 100.

[0128] On the other hand, viewer users who are permitted to virtually participate in the third area use a motion sensor like the performer, so they are scanned at predetermined time intervals by the functions of body motion scanning and face motion scanning to generate viewer avatar information and transmitted to the distribution server computer 100.

[0129] In addition, viewer users who are permitted virtual participation in the fourth region can use the touch panel, keyboard, or controller of the viewer terminal 300 to perform various operations such as movement operations, viewpoint direction change operations, viewing situation (zoom) change operations, raising hand operations, clapping hand operations, jumping operations, etc., thereby causing the actions corresponding to the viewer avatar to be performed. Among these operations, viewer avatar information is generated based on the operations related to the actions of the viewer avatar and transmitted to the distribution server computer 100.

[0130] In addition, viewer users who are virtually participating in the third region can also execute various operations such as movement, viewing situation (zoom) change operations, raising hand operations, clapping hand operations, jumping operations, etc. using a controller or the like. In this case, menu items corresponding to each action are displayed, and the menu items corresponding to each action can be selected using a controller or the like.

[0131] In this way, on the viewer terminal 300, avatar action operation processing for receiving operations corresponding to each action to be performed by the viewer avatar is executed. In addition, the avatar action operation processing also includes processing such as display and deletion of menu items corresponding to the above-described actions.

[0132] Based on the performer avatar information transmitted from the performer terminal 200 and the viewer avatar information transmitted from the viewer terminal 300 in this way, the distribution server computer 100 executes virtual space update processing for updating the virtual space data, thereby reflecting the actions and operations of the performer user and the viewer user on each avatar virtually participating in the virtual live venue.

[0133] After executing virtual space update data generation processing for generating virtual space update data based on the virtual space data before update and the virtual space data after update, the generated virtual space update data is distributed to the performer terminal 200 and the viewer terminal 300.

[0134] In the presenter terminal 200 and the viewer terminal 300 to which the virtual space update data is distributed, as shown in FIG. 10, based on the distributed virtual space update data, the pre-stored virtual space data is updated, and the presenter viewpoint video generation process and the viewer viewpoint video generation process using the updated virtual space data are executed. As a result, a presenter viewpoint video and a viewer viewpoint video based on the updated virtual space data are generated, and the generated presenter viewpoint video and viewer viewpoint video are displayed on the presenter terminal 200 and the viewer terminal 300 (viewer viewpoint video output process).

[0135] As described above, in the first embodiment, the viewpoint videos of the respective viewer users virtually participating in the virtual live venue by the viewer avatars are generated and displayed on the viewer terminal 300 side of each viewer user. By generating the viewer avatar viewpoint videos of these viewer users by the distribution server computer 100, the processing load on the distribution server computer 100 is significantly increased, and it is possible to avoid the situation where many viewer users cannot participate in the virtual live, and it is also possible to avoid the situation where the distribution becomes difficult due to the increase in the processing load.

[0136] In the first embodiment, on the display device 310 of the viewer terminal 300 of the viewer user of the viewer avatar 13 virtually participating in the third region close to the presenter avatar 1 on the virtual stage G, as shown in FIG. 13(d), a viewpoint video in which the substantially front of the presenter avatar 1 as seen from the viewer avatar 13 close to the presenter avatar 1 is largely displayed is generated and displayed. On the other hand, in the fourth region far from the presenter avatar 1 on the virtual stage G, for example, on the display device 310 of the viewer terminal 300 of the viewer user of the viewer avatar 28 virtually participating at a position behind the viewer avatar 13, as shown in FIG. 1(e), a viewpoint video in which the substantially front of the presenter avatar 1 is relatively small as seen through the viewer avatar 13 and the viewer avatar 14 virtually participating in the third region, which is a viewpoint video as seen from the viewer avatar 28 far from the presenter avatar 1, is displayed.

[0137] Also, on the display device 310 of the viewer terminal 300 of the viewer user of the viewer avatar 32 virtually participating at the end side position of the virtual stage G in the fourth region set in a U-shape in top view, as shown in Fig. 13(f), a viewpoint video seen from the viewer avatar 32 at a diagonally forward position of the performer avatar 1, through the viewer avatar 14 virtually participating in the third region, where the performer avatar 1 appears relatively small, is displayed.

[0138] Note that the display examples shown in Fig. 13 all illustrate the case where the viewer terminal 300 is a stationary computer (PC) and the display device 310 is a stationary display. However, for example, when the viewer terminal 300 is a smartphone P or a tablet, etc., in the case of the viewpoint video of the virtual camera C1, it is displayed as shown in Fig. 14(a), and when the viewer terminal 300 is the viewer terminal 300 of the viewer avatar 13, it is displayed as shown in Fig. 14(b).

[0139] Next, regarding the audio system, in the distribution server computer 100, music data 113 is reproduced by the audio control program 124 based on the time schedule data (TS data) 112 and transmitted to the performer terminal 200 as the reproduced music (data) (music reproduction process).

[0140] In the performer terminal 200, the music audio from the reproduced music (data) transmitted from the distribution server computer 100 is output to the performer user through the high-performance earphone (ear monitor) worn by the performer user (reproduced music output process), and as the performer user sings in accordance with the output reproduced music, the performer voice input from the sound collection microphone (voice input device 222) is digitized and transmitted to the distribution server computer 100 as the performer voice (data).

[0141] The distribution server computer 100 generates distribution audio (data) from the performer audio (data) received from the performer terminal 200 and the reproduced music reproduced in the above-described music reproduction process (distribution audio generation process), and distributes the generated distribution audio (data) to the viewer terminal 300 (generated audio distribution process).

[0142] In the viewer terminal 300, the distribution audio is output from the audio output device 322 such as earphones or speakers by the distribution audio (data) distributed from the distribution server computer 100, so that the viewer can listen to the live audio as if the performer avatar 1 is singing in a virtual live venue.

[0143] In addition, in the performer terminal 200, as described above, the performer audio (data) is transmitted to the distribution server computer 100, and as shown in FIG. 10, by executing the monitor audio generation process and the monitor audio output process, the music audio of the reproduced music and the performer audio are output from the speakers arranged in the adjustment room, so that the auxiliary operator O and the like can confirm the singing situation of the performer user in the adjustment room.

[0144] <Viewer Perspective Video Control Process> Next, the viewer perspective video control process executed based on the viewer perspective video control program included in the viewer program in the viewer terminal 300 will be described with reference to FIG. 20.

[0145] In the viewer perspective video control process, first, it is determined whether the performer avatar 1 is in the flying performance period of virtual flight as shown in FIG. 19 (step S1). Whether it is in the flying performance period can be specified by the performance state data indicating that it is in the flying performance period from the distribution server computer 100. In addition, the distribution server computer 100 transmits the performance state data indicating that it is in the flying performance period to the viewer terminal 300 when it becomes the flying performance period based on the time schedule data.

[0146] If it is during the flying effect period (Y in step S1), the process proceeds to step S21. On the other hand, if it is not during the flying effect period (N in step S1), it is determined whether viewpoint-related operations including viewpoint movement operations (including changes in viewpoint due to avatar movement operations and action operations) and zoom operations are disabled (step S2).

[0147] If the viewpoint-related operations are disabled (Y in step S2), the process proceeds to step S7. If the viewpoint-related operations are not disabled (N in step S2), it is determined whether there are operations that change the viewpoint such as avatar movement operations and action operations (step S3). If there are operations (Y in step S3), the viewer's viewpoint is changed according to the operations. If there are no operations (N in step S3), the process proceeds to step S5 to determine whether there is a zoom operation (step S5).

[0148] If there is a zoom operation (Y in step S5), the video area displayed on the display device 310 is changed to the video area corresponding to the operation. If there is no zoom operation (N in step S5), it is determined whether there is motion following setting (step S7).

[0149] This motion following setting can be arbitrarily set on the viewer terminal 300 by the viewer user according to the type of device used for operation and the proficiency in operation, for example, before or during the live broadcast. Specifically, for example, when not accustomed to operating the operation input device 321 such as the touch panel, keyboard, game controller, etc. used, or when not accustomed to changing the viewpoint by avatar movement operations and action operations, as will be described later, the virtual participation position of the viewer's own avatar is far from the performer avatar 1 and is enlarged and displayed by zooming in, so that even a slight movement of the performer avatar 1 cannot be properly displayed. It is set in cases where the viewpoint cannot be changed well in response to the movement and actions of the performer avatar 1, etc.

[0150] When there is no motion following setting (N in step S7), the process proceeds to step S11. On the other hand, when there is a motion following setting (Y in step S7), it is further determined whether the motion following condition is satisfied (step S8).

[0151] In the first embodiment, the motion following condition is a condition under which it is almost certain that the performer avatar 1 is not displayed well on the display device 310. Specifically, when the head (or face) of the performer avatar 1 is within a predetermined range around the periphery of the display area of the display device 310, there is a significantly high possibility that the head (or face) moves outside the display area due to the movement or action of the performer avatar 1 and is no longer displayed well. Therefore, it is determined that the motion following condition is satisfied.

[0152] As described above, in the first embodiment, by determining that the motion following condition is satisfied before the head (or face) of the performer avatar 1 disappears from the display area, it is possible to significantly reduce the situation where the head (or face) of the performer avatar 1 disappears from the display area. However, the present invention is not limited to this. These motion following conditions may be based on the condition that the head (or face) has moved outside the display area, or other conditions may be used as the motion following conditions. That is, as long as these motion following conditions can prevent the performer avatar 1 from being no longer displayed well in the display area, any conditions can be used.

[0153] When the motion following condition is satisfied (Y in step S8), after invalidating the viewpoint-related operation (step S12), as the viewpoint video displayed in the display area of the display device 310, the viewpoint is automatically changed to the motion following viewpoint where the head (or face) of the performer avatar 1 is within the non - established range surrounded by a predetermined range around the periphery of the display area, and the viewpoint video seen from the motion following viewpoint is displayed in the display area of the display device 310 (step S13).

[0154] On the other hand, when the motion following condition is not satisfied (N in step S8), it is further determined whether the viewpoint-related operation is disabled (step S9). If the viewpoint-related operation is disabled (Y in step S9), the disabled viewpoint-related operation is enabled (step S10), and then the process proceeds to step S11. If the viewpoint-related operation is not disabled (N in step S9), the process proceeds to step S11 without going through step S10.

[0155] In step 11, since the motion following setting is not set or the motion following condition is not satisfied, the viewpoint video of the viewer avatar continues to be displayed in the display area of the display device 310 (step S11).

[0156] Also, as described above, when it becomes the flying production period in which the performer avatar 1 virtually flies during the live broadcast, it is determined to be Y in step S1 and the process proceeds to step S21, and it is determined whether it is the start timing of the flying production period (step S21).

[0157] If it is the start timing of the flying production period (Y in step S21), instead of the viewpoint video of the viewer avatar or the motion following viewpoint video that was displayed in the display area of the display device 310 before the start of the flying production period, the flying viewpoint video distributed from the distribution server computer 100 is displayed (step S22). Then, the viewpoint-related operation is disabled (step S23), and the process returns to step S1.

[0158] Further, in the first embodiment, during the flying effect period, since the same flying viewpoint video is displayed on the viewer terminals 300 of all viewer users, rather than generating the flying viewpoint video on each viewer terminal 300 side like different viewer avatar viewpoint videos for individual viewer users, the distribution server computer 100 generates the flying viewpoint video and distributes it to the viewer terminals 300, so that even for the viewer terminal 300 with low processing power, the flying viewpoint video with a large rendering load due to the aerial movement of the viewpoint can be displayed well. However, the present invention is not limited to this, and these flying viewpoint videos may be generated on the individual viewer terminal 300 side in the same manner as the viewer avatar viewpoint videos.

[0159] On the other hand, when it is not the start timing of the flying effect period (N in step S21), it is further determined whether it is the end timing of the flying effect period (step S24).

[0160] Whether it is the end timing of the flying effect period may be specified based on the data indicating the end included in the data of the flying viewpoint video transmitted from the distribution server computer 100, or may be specified by the above-described effect state data different from the flying viewpoint video.

[0161] When it is not the end timing of the flying effect period (N in step S24), that is, when it is during the flying effect period, the process proceeds to step S26, and after updating the flying viewpoint video, it returns to step 1. On the other hand, when it is the end timing of the flying effect period (Y in step S24), after enabling the viewpoint-related operation (step S25), the process proceeds to step S11, and instead of the flying viewpoint video displayed in the display area of the display device 310 during the flying effect period, the viewpoint video of the viewer avatar is displayed in the display area of the display device 310, and then it returns to step S1.

[0162] As described above, each viewpoint video displayed on the viewer terminal 300 will be described with reference to FIGS. 16 to 19 by executing the viewer viewpoint video control process shown in FIG. 20 on the viewer terminal 300 of the first embodiment.

[0163] FIG. 16 is a diagram showing the display content of the display device 310 when a zoom operation is performed on the viewer terminal 300 of the first embodiment. In the default state where no zoom operation is performed, as shown in FIG. 16(a), a viewpoint video of a video area centered on the upper body of the performer avatar 1 is displayed. In this default state, when the viewer user performs a zoom-in operation, for example, if the viewer terminal 300 is a smartphone P, an operation of touching the display of “+” (not shown) is performed, or if the viewer terminal 300 is a computer (PC), when the “+” key on the keyboard is operated, for example, as shown in FIG. 16(b), a viewpoint video of a video area centered on the head (face) of the performer avatar 1 is displayed.

[0164] On the other hand, when the viewer user performs a zoom-out operation, for example, if the viewer terminal 300 is a smartphone P, an operation of touching the display of “-” (not shown) is performed, or if the viewer terminal 300 is a computer (PC), when the “-” key on the keyboard is operated, for example, as shown in FIG. 16(c), a viewpoint video of a video area including the entire body of the performer avatar 1 is displayed.

[0165] Note that in FIG. 16, for the sake of easy understanding of the zoom function, the description is made using the viewpoint video of the virtual camera C1 instead of the viewpoint of the viewer avatar. However, as shown in FIG. 17, the viewer avatar can also be zoomed in and out in the same manner.

[0166] Also, in the viewer's perspective video control process of FIG. 20, although not described in detail, for example, when the live broadcast starts and the performer avatar 1 makes its first appearance on the virtual stage G, since the viewer avatar's perspective is not facing the performer avatar 1, there is a possibility that the period during which the appearing performer avatar 1 is not displayed on the viewer terminal 300 may become long. Thus, the period when the performer avatar 1 first appears, etc., is defined as the appearance performance period, etc. During these performance periods, the perspective video displayed on the viewer terminal 300 is automatically switched to the perspective video of the virtual camera C1, etc., instead of the viewer avatar's perspective video, and zooming in, etc., may also be enabled for each viewer user in the perspective video of these virtual cameras C1.

[0167] FIG. 17 shows, as an example of the viewer avatar's perspective video, the perspective video of the viewer avatar 28 virtually participating in the fourth region. As shown in FIG. 17, the perspective video of the viewer avatar 28 includes the heads of the viewer avatars 13 and 14 virtually participating in the third region, and it becomes a video of seeing the performer avatar 1 through the heads of these viewer avatars 13 and 14.

[0168] Therefore, the viewer user of the viewer avatar 28 can, for example, perform a zoom-up operation to change to a video area where the upper body of the performer avatar 1 is centrally displayed as shown in FIG. 17(b), so that the viewer avatars 13 and 14 are not displayed and enjoy the live broadcast.

[0169] However, in the zoomed-up state shown in FIG. 17(b), for example, when the live broadcast progresses and the performer avatar 1 moves or makes large movements, if the viewer user cannot properly change the perspective of the viewer avatar 28 in accordance with the movements of the performer avatar 1, as shown in FIGS. 18(d) to (f), the performer avatar 1 may not be displayed well. Therefore, by paying attention to the perspective operation, it becomes difficult to concentrate on the live broadcast, and there may be a case where the live broadcast cannot be enjoyed well.

[0170] However, in the first embodiment, as described above, when the viewer user performs the motion tracking setting, as shown in FIGS. 18(a) to (c), when the head of the performer avatar 1 enters a predetermined area near the display area, the motion tracking condition is satisfied and the viewpoint is automatically changed to the motion tracking viewpoint, and the viewpoint video of the motion tracking viewpoint is displayed. Therefore, the viewer user does not need to pay attention to the operation of the viewpoint, and can enjoy the live well by concentrating on the live.

[0171] Then, when the live progresses to the flying performance period, as shown in FIG. 19, it is automatically changed to the flying viewpoint video seen from the aerial moving virtual camera from the viewpoint video of each viewer avatar without the viewer user operating.

[0172] Specifically, before the performer avatar 1 performs virtual flight, an image in which the object of the wings grows on the back of the performer avatar 1 is displayed. Then, by having the performer avatar 1 look up at the virtual aerial object 50 of the star virtually arranged in the second area of the virtual live venue, the viewpoint of the viewer avatar also moves similarly. At this time, a light effect 61 appears around the performer avatar 1.

[0173] After that, when the performer avatar 1 moves to virtual flight, the viewpoint video displayed on the display device 310 automatically switches from the viewpoint video of the viewer avatar up to FIG. 19(b) to the flying viewpoint video seen from the aerial moving virtual camera as shown in FIG. 19(c).

[0174] And during the flying performance period, as described above, the aerial moving virtual camera moves in the air within the second area based on the preset aerial trajectory, and the flying viewpoint video seen from these aerial moving virtual cameras is displayed on the display device 310 as shown in FIG. 19(d).

[0175] <Modification Example of the First Embodiment> In the above-described Example 1, the general operation (first operation) is the operation in which the performer avatar 1 stands without moving to the virtual stage G, the special operation (second operation) is the operation in which the performer avatar 1 performs virtual flight, and the specific operation (third operation) is the operation in which the performer avatar 1 makes a sudden lateral movement. However, the present invention is not limited to this, and the operation may be an operation according to the content to be distributed. For example, the general operation (first operation) may be the operation (normal operation) that the performer avatar executes for the longest period in the content to be distributed. The special operation (second operation) may be the operation executed in the special period that is the shortest period or the operation with the lowest frequency in the content to be distributed. The specific operation (third operation) may be an operation in which the execution period is shorter than that of the general operation (first operation) but longer than that of the special operation, or an operation in which the execution frequency is lower than that of the general operation (first operation) but higher than that of the special operation. Note that the special operation (second operation) may include the specific operation (third operation).

[0176] Also, in the above-described Example 1, the form having both the switching function to the viewpoint corresponding to the special operation (second operation) and the following function following the specific operation (third operation) was exemplified. However, the present invention is not limited to this, and a virtual space content distribution system having only one of these functions may be used.

[0177] In the above-described Example 1, the form in which the viewpoint of the viewer user is changed and followed according to the operation of the performer avatar was exemplified. However, the present invention is not limited to this. For example, the change and following of these viewpoints may be executed according to specific effects such as the effects of smoke or fireworks (fire pillars), special lighting, and deformation of the virtual stage G, which are effects on the virtual stage G.

Example

[0178] Next, the virtual space content distribution system of Example 2 will be described below with reference to FIGS. 21 to 28. Note that the same components as those in Example 1 are denoted by the same reference numerals, and the description thereof will be omitted.

[0179] The configuration of the virtual space content distribution system of Example 2 is the same as that of Example 1 shown in FIG. 1, but due to the different progress of the virtual live, the periods during which the perspective videos from the virtual cameras C1 to C4 and the aerial moving virtual camera (hereinafter collectively referred to as virtual camera perspective videos) are distributed, and the entities that generate these virtual camera perspective videos are different from those of Example 1, which are the characteristic parts of this Example 2.

[0180] FIG. 21 is a diagram showing the progress of the virtual live distributed in the virtual space content distribution system of Example 2. In the virtual live of Example 2, first, as the period before the start of the virtual live, there are a "period when participation in the live virtual space is possible" and a "pre-performance explanation" period. Viewing user can virtually participate in the virtual live venue, which is the virtual space targeted by the virtual live, during the period when participation in the live virtual space is possible.

[0181] In addition, the period until the pre-data DL completion check timing set near the end of the "pre-performance explanation" period is regarded as the pre-data download (DL) period. For the viewer terminals 300 of the viewing users who virtually participated during the period when participation in the live virtual space is possible, virtual space data (basic data) of the virtual live venue, avatar data of the performer avatar 1, and avatar data of other viewing users who virtually participated are downloaded (DL) from the distribution server computer 100 as pre-data.

[0182] Also, at the pre-data DL completion check timing, which is the end timing of the pre-data download (DL) period, it is checked whether the download (DL) of the pre-data is completed on each viewer terminal 300.

[0183] If the pre-data download (DL) has not been completed by the pre-data DL completion check timing due to differences in the model, processing capacity, communication environment, etc. of the viewer terminal 300, the pre-data download (DL) will continue. However, in this case, data with high importance in the virtual live distribution, for example, virtual space data (basic data) of the virtual live venue required for the opening performance and the first MC, avatar data of the performer avatar 1, etc. will be preferentially downloaded (DL).

[0184] Also, in the second embodiment, as described above, an example is shown in which data required to generate a viewpoint video in the viewer terminal 300 in the virtual live distribution is downloaded (DL) as pre-data. However, the present invention is not limited to this. For these data, particularly special data required individually in each act and each MC described later, etc., at the timing corresponding to the timing when each of these acts and each MC are distributed, they may be sequentially downloaded (DL) each time.

[0185] In addition, during the "pre-opening explanation" period, explanations about the virtual live are introduced by video images, etc. Therefore, by making the period during which the pre-data can be downloaded (DL) also during these "pre-opening explanation" periods, each viewer terminal 300 can also download (DL) the avatar data of the viewer avatar who virtually participated near the end of the virtual participation period in the live virtual space participation period from the distribution server computer 100.

[0186] As shown in FIG. 21, the virtual live performance in Example 2 progresses as follows: "Opening performance" → "First MC" → "First performance" → "Second MC" → "Second performance" ... "Opening performance" is a performance in which performer avatar 1 appears on virtual stage G. "First MC" is a performance in which performer avatar 1 appears on virtual stage G, greets the audience through a talk, and introduces the first performance to be performed. "First performance" is a performance that includes singing and dancing by performer avatar 1 (performer), and also includes a flying performance in which video of performer avatar 1 virtually flying around the virtual live venue is captured by a virtual camera moving in the air. "Second MC" is a performance in which performer avatar 1 (performer) mainly introduces the second performance through a talk. The "second performance" includes singing and dancing by performer avatar 1 (performer), and also includes a costume change performance using footage virtually captured by virtual camera C1 of performer avatar 1 changing clothes, and an avatar split performance using footage virtually captured by virtual camera C1 of performer avatar 1 splitting into multiple people.

[0187] The processing load on the distribution server computer 100 during each period in which these effects and programs are executed is the lowest ("low") during the period in which participation in the live virtual space is possible, while it is the highest ("high") during the period in which the special effects "flying effect," "costume change effect," and "double-self effect" are executed. The processing load on the distribution server computer 100 during the "first performance" from the "introduction," "opening effect," "first MC," and "flying effect" is "medium." The processing load is also "medium" during the "first performance" after the "flying effect" and the "second performance" from the "second MC" and "costume change effect." The processing load is also "medium" during the "second performance" from the "costume change effect" to the "double-self effect." The processing load is also "medium" during the "second performance" from the "costume change effect" to the "double-self effect."

[0188] Next, we will explain the viewpoint images that can be viewed on the viewer terminal 300 for each period in the virtual live performance in Example 2. During the period in which participation in the live virtual space is possible, from the time of virtual participation until the start of the "pre-performance speech," only the viewer avatar viewpoint images can be displayed.

[0189] And at the timing when the "pre-show explanation" starts, only the virtual camera viewpoint video, specifically, the viewpoint video of the virtual camera C1, can be displayed. Thus, even though it is before the start of the virtual live, setting the viewpoint video in the "pre-show explanation" to only the virtual camera viewpoint video is because these pre-show explanations also include explanations such as precautions regarding the virtual live. By displaying the viewer avatar viewpoint video on the viewer terminal 300, it aims to prevent the occurrence of viewer users who do not watch the pre-show explanation being conducted on the virtual stage G.

[0190] Incidentally, as will be described later, the virtual camera viewpoint videos of these "pre-show explanations" are generated by the distribution server computer 100 and distributed to each viewer terminal 300, so they can also be displayed on a viewer terminal 300 where the download of the pre-data has not been completed.

[0191] For the viewer terminal 300 where the download of the pre-data is completed at the above-mentioned pre-data DL completion check timing, during the period of the "first act" from "the first MC" to the "flying performance", and also during the period after the "flying performance", in addition to the virtual camera viewpoint video, the viewer avatar viewpoint video can be displayed.

[0192] On the other hand, for the viewer terminal 300 where the download of the pre-data is not completed at the above-mentioned pre-data DL completion check timing, since the viewer avatar viewpoint video cannot be accurately generated, when the virtual camera viewpoint video generated by the distribution server computer 100 is distributed, only the virtual camera viewpoint video can be displayed during all periods of the virtual live, and the viewer avatar viewpoint video cannot be displayed.

[0193] In addition, among the videos of "Flying Performance", "Costume Change Performance", and "Doppelganger Performance" where the processing load of the distribution server computer 100 is "high", the virtual camera viewpoint videos of the virtual camera C1 for the "Costume Change Performance" and "Doppelganger Performance" are generated not on the distribution server computer 100 but on each viewer terminal 300, similar to the virtual camera viewpoint videos during the second act period other than these "Costume Change Performance" and "Doppelganger Performance", so as to reduce the processing load of the distribution server computer 100 for generating the virtual camera viewpoint videos of the virtual camera C1 for these "Costume Change Performance" and "Doppelganger Performance".

[0194] Regarding the period of the "Flying Performance" as well, since it is a period with a high processing load on the distribution server computer 100, it is conceivable to generate it on the viewer terminal 300 similar to the "Costume Change Performance" and "Doppelganger Performance". However, in this case, since it is necessary to pre-distribute detailed trajectory data such as the movement trajectory of the airborne moving virtual camera moving within the virtual live venue to each viewer terminal 300 to generate the video, in the second embodiment, the distribution server computer 100 generates and distributes the video of the "Flying Performance". However, the present invention is not limited to this, and for the video of the "Flying Performance", it may also be generated on each viewer terminal 300 for the purpose of reducing the processing load of the distribution server computer 100.

[0195] Here, the participant user table used in the distribution server computer 100 of the second embodiment will be briefly described with reference to FIG. 23.

[0196] The participant user table is a data table used to identify the participation status of viewer users in virtual live events registered in the event data shown in Fig. 7, the download status of pre-data, etc. As shown in Fig. 23, in association with the participant ID (viewer user ID), participation identification data (participation identification flag) capable of identifying the participation status of the participant (viewer user), the participation area of the participant (viewer user), and data such as pre-data DL identification data (pre-data DL identification flag) capable of identifying the download status of pre-data can be stored in the table.

[0197] In addition, in the item of the participant ID, in the event data, all the viewer user IDs of the participants scheduled to watch described in the file of each participant group stored corresponding to the virtual live are registered and used.

[0198] The participation identification data (participation identification flag) has "0" corresponding to the non-participation status registered at the time of registration of the participant ID (viewer user ID), and is updated to "1" indicating participation when the participation of each participant (viewer user) is permitted by authentication. Therefore, based on the participation identification data (participation identification flag), it is possible to identify viewer users who have participated among the viewer users scheduled to participate and viewer users who could not participate for some reason.

[0199] The data of the participation area is data capable of identifying whether the participation area of each participant (viewer user) is the third area or the fourth area, and is the data registered when the participation of each participant (viewer user) is permitted by authentication.

[0200] The pre-data DL identification data (pre-data DL identification flag) is updated from "0" indicating incomplete to "1" indicating completion based on the check of whether the download (DL) of the pre-data is completed at the pre-data DL completion check timing described above. Therefore, by using these pre-data DL identification data (pre-data DL identification flag), it is possible to easily identify all the participants (viewer users) among the virtual participants for whom the download (DL) of the pre-data has not been completed.

[0201] Next, the process of downloading pre-data when a viewer user virtually participates in a virtual live venue in Example 2 will be described with reference to FIG. 22.

[0202] First, the viewer user executes a participation operation for a virtual live that the user plans to virtually participate in, for example, selects a participation menu or operates a specific key assigned for the participation operation on the keyboard, in the viewer program (viewing app) running on the viewer terminal 300.

[0203] By executing this participation operation, a participation request including the viewer user ID and authentication data for authenticating the viewer user is sent from the viewer terminal 300 to the distribution server computer 100.

[0204] In the distribution server computer 100 that has received the participation request, participant authentication processing is executed on the condition that it is within the live virtual space participation period. In the participant authentication processing, it is determined whether or not the viewer user corresponding to the received participation request is a prospective participant in the virtual live corresponding to the participation target, depending on whether the viewer user ID included in the received participation request is registered as a participant ID in the participant user database corresponding to the virtual live of the participation target. At the same time, in the viewer user data shown in FIG. 9, the authentication data described in the authentication information file specified from the authentication information file data stored in association with the viewer user ID is collated with the authentication data included in the participation request to authenticate the viewer user.

[0205] If the viewer user is a prospective participant and the authentication by the authentication data is completed, the participation identification data (participation identification flag) in the participant user table is updated to "1" corresponding to "participation".

[0206] Then, the distribution server computer 100 transmits (returns) prior data DL instruction information to the viewer terminal 300 that is the transmission source of the participation request in order to cause the viewer terminal 300 to download the prior data corresponding to the virtual live of the participation target. The viewer terminal 300 can confirm that participation is permitted by receiving the prior data DL instruction information.

[0207] In response to the reception of the prior data DL instruction information, the viewer terminal 300 specifies the prior data to be downloaded and transmits a prior data DL request for requesting the download of the specified prior data to the distribution server computer 100.

[0208] In response to the reception of this prior data DL request, the distribution server computer 100 executes prior data transmission processing.

[0209] In this pre-data transmission process, the pre-data requested for the viewer terminal 300 that is the source of the pre-data DL request is transmitted. Note that, as described above, the pre-data includes virtual space data (basic data) of the virtual live venue, avatar data of the performer avatar 1, and avatar data of other viewer users who have already virtually participated, etc.

[0210] Note that, in the pre-data transmission process, for viewer terminals 300 other than the source of the pre-data DL request and that are viewer terminals of viewer users whose participation has already been confirmed by the participant data table, the avatar data of the viewer user who is the source of the pre-data DL request is additionally distributed as pre-data. As a result, in the viewer terminals 300 of each viewer user who has virtually participated in the virtual live, in addition to the virtual space data (basic data) and the avatar data of the performer avatar, the avatar data of all viewer users who have virtually participated in the virtual live is pre-distributed and stored in advance.

[0211] And the pre-data stored in the viewer terminal 300 in this way is checked to see if the download of all pre-data is complete at the above-mentioned pre-data DL completion check timing (see FIG. 21). When the download of the pre-data is complete, the pre-data DL identification data (pre-data DL identification flag) in the participant user table is updated from "0" indicating incomplete to "1" indicating complete.

[0212] Note that, for a participant (viewer user) whose pre-data DL identification data (pre-data DL identification flag) remains "0" indicating incomplete because the download of the pre-data is not complete, only the virtual camera viewpoint video is made displayable as described above.

[0213] Next, the situation where the entity that generates the various viewpoint videos displayed on the viewer terminal 300 changes in each period of the virtual live will be described with reference to FIGS. 24 to 27.

[0214] First, during the period when only the viewer avatar perspective video can be displayed on the viewer terminal 300 and it is possible to participate in the live virtual space, as shown in FIG. 24, based on the virtual space update data including the actor avatar operation data for generating the operations of the actor avatar 1 that performs operations linked to the operations of the performer user and is transmitted from the distribution server computer 100, the virtual space data already stored in the viewer terminal 300 by receiving the pre-data is sequentially updated. Based on the updated virtual space data, the viewer perspective video generation process is executed on the viewer terminal 300 to generate the viewer avatar perspective video, which is output (displayed) by the video output process. In FIG. 24, the actor terminal 200 is omitted, but the virtual space update data is also transmitted to the actor terminal 200 as shown in FIG. 10 in the first embodiment.

[0215] Also, for each of the periods of "pre-opening explanation", "opening performance", and "flying performance" during which only the virtual camera perspective video can be displayed on the viewer terminal 300, as shown in FIG. 25, in the distribution server computer 100, in the virtual space update data distribution process, the virtual space update data is transmitted only to the actor terminal 200. Then, following the virtual space update data distribution process, a virtual camera perspective video generation process for generating the virtual camera perspective video and a virtual camera perspective video data distribution process for distributing the video data of the virtual camera perspective video generated in the virtual camera perspective video generation process to all viewer terminals 300 participating in the virtual live are executed.

[0216] The virtual camera perspective video data distributed from the distribution server computer 100 in these virtual camera perspective video data distribution processes is displayed on the viewer terminal 300 that has received the virtual camera perspective video data by executing the video output process.

[0217] That is, as shown in FIG. 27, for each of the periods of "pre-opening explanation", "opening performance", and "flying performance" during which only the virtual camera perspective video can be displayed, the virtual camera perspective video is generated in the distribution server computer 100.

[0218] Also, during the program period excluding the MC period and the flying effect period, which is a period during which either the viewer avatar viewpoint video or the virtual camera viewpoint video can be selected and displayed on the viewer terminal 300, as shown in FIG. 26, by executing the virtual space update data distribution process in the distribution server computer 100, virtual space update data is distributed to the viewer terminals 300 of each viewer user participating in the virtual live, and the virtual space update process is executed in the viewer terminals 300.

[0219] Then, in the viewer terminal 300, it is determined whether or not the viewer avatar viewpoint video is selected as the video to be displayed. If the viewer avatar viewpoint video is selected, in the same flow as shown in FIG. 24, the viewer viewpoint video generation process is executed to generate the viewer avatar viewpoint video, and the generated viewer avatar viewpoint video is displayed by the video output process.

[0220] On the other hand, when the viewer avatar viewpoint video is not selected as the video to be displayed, that is, when the virtual camera viewpoint video is selected as the video to be displayed, the virtual camera viewpoint video generation process is executed in the viewer terminal 300 to generate the virtual camera viewpoint video, and the generated virtual camera viewpoint video is displayed by the video output process.

[0221] In addition, for the virtual camera viewpoint video generated in this virtual camera viewpoint video, the viewer user may be able to select which of the viewpoints of the virtual cameras C1, C3, and C4 the virtual camera viewpoint video is to be, or the distribution server computer 100 may instruct all the viewer terminals 300.

[0222] That is, as shown in FIG. 27, during the performance period excluding the MC period and the flying effect period in which either the virtual camera viewpoint video or the viewer avatar viewpoint video can be displayed on the viewer terminal 300, the virtual camera viewpoint video is generated on the viewer terminal 300. In this way, for the period in which either the virtual camera viewpoint video or the viewer avatar viewpoint video can be selected and displayed on the viewer terminal 300, since the mutual switching between the virtual camera viewpoint video and the viewer avatar viewpoint video is executed according to the selection of the viewer user, compared with the case of displaying the virtual camera viewpoint video data by distribution from the distribution server computer 100, it is possible to execute the switching of these videos without causing problems such as the video being interrupted, and while preventing an increase in the processing load of the distribution server computer 100 associated with the switching of these videos.

[0223] On the other hand, for each of the periods of "pre-performance explanation", "opening performance", and "flying effect", which are periods in which only the virtual camera viewpoint video can be displayed on the viewer terminal 300, the virtual camera viewpoint video is generated only on the distribution server computer 100 and distributed to each viewer terminal 300. In this way, during the period in which only the virtual camera viewpoint video can be displayed on the viewer terminal 300, since the virtual camera viewpoint video is generated only on the distribution server computer 100, it is possible to prevent the processing load of the entire system from increasing uselessly due to the processing of generating the virtual camera viewpoint video being duplicated on the viewer terminal 300.

[0224] Here, regarding the situation when the viewpoint video is switched on the viewer terminal 300, taking the "flying effect" period, which is a period in which only the virtual camera viewpoint video can be displayed, as an example, it will be described with reference to FIG. 28.

[0225] For example, as shown in FIG. 28, in the viewer terminal 300 where the viewer avatar viewpoint video is being displayed during the period of "First MC" and the period of the first act up to the "Flying Performance", when the period of the "Flying Performance" during which only the virtual camera viewpoint video (viewpoint video from the airborne moving virtual camera) can be displayed starts, and the distribution server computer 100 starts distributing the virtual camera viewpoint video (viewpoint video from the airborne moving virtual camera), there is a risk that the virtual camera viewpoint video (viewpoint video from the airborne moving virtual camera) will not be displayed on the viewer terminal 300 during the period from the start of this distribution until the virtual camera viewpoint video is displayed, resulting in a problem where the viewer cannot view the first video of the "Flying Performance".

[0226] Therefore, as shown in FIG. 28, the distribution server computer 100 of Example 2 notifies the viewer terminal 300 of the start timing of the distribution start (buffering start) of pre-distributing the virtual camera viewpoint video (viewpoint video from the airborne moving virtual camera) before the start of the "Flying Performance" by transmitting a BF prior notice to the viewer terminal 300 at a specific timing before the start timing of the "Flying Performance" when the viewpoint video is forcibly changed from the viewer avatar viewpoint video to the virtual camera viewpoint video (viewpoint video from the airborne moving virtual camera) at the start of the "Flying Performance".

[0227] In response to receiving the BF prior notice, the viewer terminal 300 specifies the timing when the distribution of the virtual camera viewpoint video (viewpoint video from the airborne moving virtual camera) starts from the distribution server computer 100, and starts buffering the received virtual camera viewpoint video (viewpoint video from the airborne moving virtual camera) when that timing arrives.

[0228] The timing when the distribution of these virtual camera viewpoint videos (viewpoint videos from the airborne moving virtual camera) starts, that is, the timing to start buffering, may be appropriately determined in consideration of the differences in the video storage functions of the viewer terminal 300. For example, it may be a period corresponding to several tens of frames as the number of video frames.

[0229] Thus, the distribution server computer 100 of Example 2 starts generating and distributing the virtual camera viewpoint video (video from the virtual camera moving in the air) of the flying effect before the start of the flying effect period. Since the viewer terminal 300 buffers the distributed virtual camera viewpoint video, when the flying effect period starts, the video can be instantaneously changed from the viewer avatar viewpoint video displayed before the start of the flying effect period to the virtual camera viewpoint video, thus preventing the problem that the viewer cannot view the first video of the "flying effect".

[0230] Also, when the "flying effect" period ends, since the viewer avatar viewpoint video was selected before the start of the "flying effect", the viewpoint video switches from the virtual camera viewpoint video (video from the virtual camera moving in the air) of the flying effect to the viewer avatar viewpoint video in response to the end of the "flying effect" period. However, even in this case, if the viewer avatar viewpoint video is generated and displayed starting from when the "flying effect" period ends, there is a risk of a problem that the viewer avatar viewpoint video is not displayed on the viewer terminal 300 during the period until the viewer avatar viewpoint video is generated and displayed, similar to when the "flying effect" starts.

[0231] Therefore, even when the "flying effect" period ends, the distribution server computer 100 of Example 2 notifies the viewer terminal 300 of the end timing of the "flying effect" period when the distribution of the virtual camera viewpoint video (video from the virtual camera moving in the air) ends by sending a pre-notification of the end TM (timing) to the viewer terminal 300 as shown in FIG. 28.

[0232] In response to receiving a pre-notification of the end TM (timing), the viewer terminal 300 identifies in advance the timing at which the distribution of the virtual camera viewpoint video (viewpoint video from an airborne virtual camera) from the distribution server computer 100 stops, and starts the viewer viewpoint video generation process from a predetermined timing before that timing to pre-generate the viewer avatar viewpoint video.

[0233] In addition, from the time of sending the pre-notification of the end TM (timing), the distribution server computer 100 executes the distribution of virtual space update data, so the viewer terminal 300 executes virtual space processing to update the virtual space data with the received virtual space update data. Therefore, at the above-mentioned predetermined timing, it is possible to generate a viewer avatar viewpoint video reflecting the situation of the virtual live venue at that time.

[0234] As described above, the distribution server computer 100 of the second embodiment sends a pre-notification of the end TM (timing) to the viewer terminal 300 before the end of the flying effect period, so that the viewer terminal 300 can pre-generate the viewer avatar viewpoint video before the end of the flying effect period. Therefore, it is possible to prevent a problem that the viewer avatar viewpoint video is not displayed on the viewer terminal 300.

[0235] In addition, in FIG. 28, the "flying effect" is used as an example for explanation, but the same control is also performed for the periods of "pre-opening explanation" and "opening effect" in which the viewpoint video is forcibly changed from the viewer avatar viewpoint video to the virtual camera viewpoint video.

[0236] In the virtual space content distribution system of the second embodiment described above, there are multiple viewer users, and a viewer terminal 300 is assigned to each viewer user. When the viewer terminal 300 displays a viewer avatar viewpoint video, which is a viewpoint video of a virtual live venue (virtual space) corresponding to the viewer avatar, it is generated based on virtual space update data (virtual space data) transmitted from the distribution server computer 100. Since the generation of the viewer avatar viewpoint video, which involves a large processing load, is performed by the viewer terminal 300, more viewer users can participate in the virtual live event.

[0237] In addition, the virtual space content of the second embodiment is content in which a performer user can participate in the virtual live venue as the performer avatar 1, and the performer avatar 1 performs musical operations (performances) such as singing and dancing in the virtual live venue. Therefore, the interest of the virtual space content can be improved.

[0238] In addition, since the virtual space update data (virtual space data) of the second embodiment includes action data for the performer avatar for generating the actions of the performer avatar 1, the actions of the performer avatar 1 can be accurately reflected in the viewer avatar viewpoint video generated on the viewer terminal 300.

[0239] Regarding the common viewpoint videos that are commonly displayed on each viewer terminal 300 in the second embodiment, such as the videos of "pre-show explanation", "opening performance", and "flying performance", they are generated on the distribution server computer 100 and distributed to each viewer terminal 300. Therefore, it is possible to prevent the processing load of the entire system from increasing unnecessarily due to duplicate processing being executed on each viewer terminal 300.

[0240] Also, in the viewer terminal 300 of Example 2, during the program period (specific period) other than the "MC period" and the period of the "flying effect", which is the period in which either the viewer avatar viewpoint video or the virtual camera viewpoint video can be selected and displayed, since the virtual camera viewpoint video is generated and displayed on the viewer terminal 300, it is possible to prevent problems such as the video being interrupted when the viewpoint video is switched.

[0241] Also, in the period of the "costume change effect" and the "duplication effect", which are special periods with a large processing load on the distribution server computer 100 in Example 2, since each viewer terminal 300 also generates and displays the virtual camera viewpoint video (common viewpoint video), it is possible to prevent the processing load on the distribution server computer 100 from temporarily becoming extremely large.

[0242] Also, since the distribution server computer 100 in Example 2 pre-transmits preliminary data including the basic data of the virtual live venue (virtual space) and the basic data of the performer avatar 1 and the viewer avatar who virtually participate in the virtual live venue to each viewer terminal 300 before the virtual live starts, it is possible to prevent the occurrence of a problem that the viewer avatar viewpoint video is not displayed properly at the start of the virtual live.

[0243] Also, the distribution server computer 100 in Example 2 transmits the virtual camera viewpoint video (common viewpoint video) to the viewer terminal 300 for which the completion of reception of the preliminary data cannot be confirmed. By doing so, while preventing the processing load on the distribution server computer 100 from excessively increasing due to the transmission of the basic data and the like after the start of the virtual live, it is also possible to prevent the viewer user from being unable to view the virtual live.

[0244] <Modification Example of Example 2> FIG. 29 is a flowchart showing the processing contents of the viewer viewpoint video generation process in Modification Example 2-1 for Example 2.

[0245] In the above-described Example 2, a form in which the viewer avatar perspective video including the operation of the performer avatar 1 is always uniformly generated was shown. However, the present invention is not limited to this, and these viewer avatar perspective videos may be generated in a plurality of modes with different processing loads in video generation according to the selection of the viewer user on the viewer terminal 300.

[0246] That is, as an example shown in Example 1, the viewer terminal 300 used by the viewer user may be a stationary personal computer (PC) with high processing power, or may be a smartphone terminal or a tablet terminal with relatively lower processing power than a personal computer (PC). It is assumed that terminals with different processing capabilities are used. However, if the viewer avatar perspective video is always uniformly generated on terminals with different processing capabilities like this, on a terminal with low processing power, the viewer avatar perspective video cannot be appropriately generated, and there is a risk that the viewer avatar perspective video and the audio will be out of sync, or the viewer avatar perspective video will become a discontinuous and unnatural video. Therefore, for example, when generating a viewer avatar perspective video including the performer's movement, whether to generate a high-definition viewer avatar perspective video including the performer's movement with a high processing load related to video generation, or to generate a low-definition viewer avatar perspective video including the performer's movement with a low processing load related to video generation, may be appropriately selected by the viewer according to the processing power of the terminal being used.

[0247] Specifically, the viewer perspective video generation process executed on the viewer terminal 300 may be the content shown in the flowchart of FIG. 29. In this viewer perspective video generation process, first, the mode of generating the actor motion selected by the viewer user on the viewer terminal 300 is specified (step S101). Then, it is determined whether the specified mode of generating the actor motion is a high processing load mode (step S102). If the high processing load mode is selected (Y in step S102), a viewer avatar perspective video including a high-definition actor motion is generated (step S103). On the other hand, if the high processing load mode is not selected (N in step S102), a viewer avatar perspective video including a low-definition actor motion is generated (step S104).

[0248] Note that in FIG. 29, a form with two modes, namely a high processing load mode and a low processing load mode, is illustrated as an example. However, the present invention is not limited to this, and these processing load modes may be three or more modes.

[0249] Also, in the above-described Example 2 (the same applies to Example 1), a form is illustrated in which all operations including the movement of the viewer avatar of the viewer user are reflected in each viewer avatar by distributing virtual space update data. However, the present invention is not limited to this. For example, as operations of these viewer avatars, operations that are normally not executable but become possible when a special fee is paid, for example, when the viewer terminal 300 enables an operation of performing a special operation capable of appealing one's own viewer avatar to the actor avatar 1. Since this special operation is an operation directed to the actor user and not to other viewer users, the virtual space update data including these special operations is not distributed to the viewer terminals 300 of other viewer users, and it may be possible to prevent the processing load of the distribution server computer 100 from increasing excessively by making these special operations executable.

[0250] Thus, when virtual space update data including special operations is not distributed to the viewer terminals 300 of other viewer users, as shown in Modification Example 2-2 of FIG. 30, when the viewer avatar of viewer user A performs a special operation by executing an operation corresponding to the special operation, virtual space update data A corresponding to the fact that the viewer avatar of viewer user A is performing the special operation is transmitted from the distribution server computer 100 to the viewer terminal 300 of viewer user A, but virtual space update data B indicating that the viewer avatar of viewer user A is not performing the special operation is distributed to the viewer terminal 300 of viewer user B different from viewer user A.

[0251] Therefore, different virtual space update data is distributed from the distribution server computer 100 to the viewer terminal 300 of viewer user A and the viewer terminal 300 of viewer user B, so that the degree of freedom of the virtual space update data can be increased, and different viewer avatar viewpoint videos can be generated on the viewer terminal 300 of viewer user A and the viewer terminal 300 of viewer user B.

[0252] In addition, the viewer terminal 300 of viewer user A can generate and display a video of the viewer avatar of viewer user A performing a special operation different from the possible operations of the viewer avatar of viewer user B based on virtual space update data A different from virtual space update data B distributed to the viewer terminal 300 of viewer user B, so that the interest of viewer user A in the virtual live, which is virtual space content, can be improved.

[0253] Also, in the above-described Example 2 (the same applies to Example 1), regarding the viewer avatars of the viewer users virtually participating in the fourth region, although an example is shown in which the form of the avatar is a normal avatar that varies among individual viewer users, the present invention is not limited to this. For example, for the purpose of reducing the processing load when generating various perspective videos in a virtual live, the viewer avatars of the viewer users virtually participating in the fourth region may be made into simple avatars with simplified avatar forms.

[0254] In addition, in FIG. 30, an example is shown of the case of executing a special operation that becomes possible when a special fee is paid. For example, as described above, in the case of using a simple avatar, for normal operations other than the movement of the simple avatar, such as waving a hand, tapping a hand, and changing the direction of the viewer avatar, similar to the special operation, it may be possible to further reduce the processing load on the distribution server computer 100 by not including them in the virtual space update data distributed to other viewer users.

[0255] In addition, in the above-described Example 1 and Example 2, an example is shown in which the video displayed on the viewer terminal 300 is automatically switched between the viewer perspective video and the virtual camera perspective video according to the time schedule data preset on the administrator side, such as when executing the flying effect shown in FIG. 19. However, the present invention is not limited to this, and the video displayed on the viewer terminal 300 may be appropriately switched between the virtual camera perspective video and the viewer perspective video according to the operation by the viewer user. By doing so, the viewer user can view the virtual live from various perspectives by their own operation, and the interest of the virtual live can be improved.

[0256] Furthermore, as described above, even when the video displayed on the viewer terminal 300 can be switched between a virtual camera viewpoint video and a viewer viewpoint video by an operation of the viewer user, during the execution period of an effect that the viewer user wants to strongly impress, such as a flying effect (see FIG. 19), the operation of the viewer terminal 300 by the viewer user (the operation of switching the displayed video) may be disabled to prevent the viewer user from missing the effect.

Example

[0257] Next, the virtual space content distribution system of Example 3 will be described below with reference to FIGS. 31 to 56. For the same configurations as those in Examples 1 and 2, the same reference numerals will be used and the description will be omitted.

[0258] As shown in FIG. 31, the virtual space content distribution system of Example 3 is provided with the same live progress content as in Example 2. In particular, in this Example 3, a performance by the avatars of two performers, Performer A and Performer B, is provided during the live show.

[0259] After the performer avatar 1A of the first performer, Performer A, appears from the timing immediately after the start of the first MC period, a solo performance by the performer avatar 1A of the performer A is executed as the first performance. After the performer avatar 1B of the second performer, Performer B, appears (the number of performer avatars increases from one to two) from the timing during the second MC period, a joint performance by the performer avatar 1A of the performer A and the performer avatar 1B of the performer B is executed as the second performance.

[0260] In addition, in the third embodiment, it is possible to execute a light emission effect that causes the virtual aerial objects 50 to 52 to emit light as part of the production of the virtual live show. In particular, the light emission effect is not executed during the period when participation in the virtual live venue is possible and during the period of the pre-show explanation (light emission intensity of the light emission effect: none). During the opening show period, the first MC period, and the second MC period, the virtual aerial objects 50 to 52 emit light with a relatively weak light emission intensity (light emission intensity of the light emission effect: weak). During the first act period and the second act period, the virtual aerial objects 50 to 52 emit light with a light emission intensity stronger than that during the opening show period, the first MC period, and the second MC period (light emission intensity of the light emission effect: strong).

[0261] Also, as shown in FIG. 31, until immediately after the start of the first MC period, since the performer avatar 1A of performer A has not appeared, it is a period without the movement of the performer avatar 1A of performer A (performer avatar movement of performer A: none). During the first MC period and the second MC period after the performer avatar 1A of performer A appears, the movement of the performer avatar 1A of performer A is relatively small (performer avatar movement of performer A: small). During the first act period and the second act period, since the performer avatar 1A of performer A performs dance and singing, the movement of the performer avatar of performer A becomes larger (more intense) than in other periods (performer avatar movement of performer A: large).

[0262] Similarly, until the performer avatar 1B of performer B appears during the second MC period, it is a period without the movement of the performer avatar 1B of performer B (performer avatar movement of performer B: none). During the second MC period after the performer avatar 1B of performer B appears, the movement of the performer avatar 1B of performer B is relatively small (performer avatar movement of performer B: small). During the second act period, since the performer avatar of performer B performs dance and singing together with the performer avatar 1B of performer A, the movement of the performer avatar 1B of performer B becomes larger (more intense) than in other periods (performer avatar movement of performer B: large).

[0263] In addition, since the period during which the virtual live venue can be participated in is the period during which a plurality of viewer terminals 300 sequentially connect to the distribution server computer 100, as time passes, viewer avatars that virtually participate in the virtual live venue due to such connections are gradually added and arranged in the virtual space.

[0264] For this reason, as shown in FIGS. 31 and 32(A), immediately after the start of the period during which the virtual live venue can be participated in, the light emission effect is not executed, the display of the performer avatars 1A and 1B of each performer is not present, and since the number of viewer avatars that virtually participate in the virtual live venue is small, there are few viewer avatars that require updating of position information and the like in the distribution server computer 100, and the update processing load of virtual space update is in a relatively small state. Also, for each viewer terminal 300, since the number of viewer avatars that virtually participate in the virtual live venue is small as described above, the drawing processing load for drawing the viewer avatars is in a relatively low state.

[0265] When the number of viewer avatars that virtually participate in the virtual live venue increases from this state, as shown in FIG. 32(B), since the viewer avatar information to be updated in the virtual space data in the distribution server computer 100 increases, the update processing load of virtual space update by the distribution server computer 100 increases. Also, since the number of viewer avatars to be drawn in each viewer terminal 300 increases due to the increase in the number of viewer avatars that virtually participate in the virtual live venue, the drawing processing load for drawing the viewer avatars also increases.

[0266] In addition, when the number of viewer avatars that virtually participate in the virtual live venue increases, as shown in FIGS. 31 and 33, since the number of viewers who perform a movement operation from the viewer terminal 300 also increases, the number of viewer avatars that move within the virtual live venue may also increase.

[0267] Since the information such as the current position in the virtual live venue of a moving viewer avatar changes more frequently than that of a viewer avatar stationary at a specific location, when the number of viewer avatars moving within the virtual live venue increases as shown in FIGS. 31 and 33, the update processing load of virtual space update by the distribution server computer 100 increases. At this time, also in each viewer terminal 300, when the number of moving viewer avatars increases, the drawing amount due to the movement of each viewer avatar also increases, so the drawing processing load in the viewer terminal 300 also increases.

[0268] During each program period, when performing a light emission effect, as shown in FIGS. 31 and 34(A), in the distribution server computer 100, based on the current position of each avatar, the distance and angle from the light sources (virtual airborne objects 50 to 52 in this Example 3), etc., calculation processing of the way light hits and the generated shadows of each viewer avatar and performer avatar occurs, so the update load of virtual space update by the distribution server computer 100 increases. At this time, also in each viewer terminal 300, drawing to cause the virtual airborne objects 50 to 52 to emit light, drawing to make the way light hits different for each viewer avatar, and drawing of the shadow for each viewer avatar are performed along with the light emission effect, so the drawing processing load also increases.

[0269] In addition, in this Example 3, there may be a case where the light emission intensity of the virtual airborne objects 50 to 52 is increased as a light emission effect (see FIG. 31). When the light emission intensity increases in this way, the processing load associated with the calculation processing of the way light hits and the generated shadows of each viewer avatar and performer avatar in the distribution server computer 100 described above further increases. As a result, the update load of virtual space update by the distribution server computer 100 further increases, and similarly, the drawing processing load in each viewer terminal 300 further increases.

[0270] Also, when the performer avatar 1A appears, as shown in FIGS. 31 and 34(B), since the performer avatar information is added to the information to be updated of the virtual space data in the distribution server computer 100, the update processing load of the virtual space update by the distribution server computer 100 increases. Further, when the performer avatar 1B appears, as shown in FIGS. 31 and 34(B), in addition to the performer avatar information of the performer avatar 1A, the performer avatar information of the performer avatar 1B is also added as the information to be updated of the virtual space data in the distribution server computer 100, so the update processing load of the virtual space update by the distribution server computer 100 further increases. In the viewer terminal 300, since the process of drawing the performer avatar 1A of the performer A starts from the appearance timing of the performer avatar 1A, the drawing processing load increases. Further, from the appearance timing of the performer avatar 1B, in addition to the process of drawing the performer avatar 1A, the process of drawing the performer avatar 1B of the performer B also starts, so the drawing processing load further increases. Note that in the present Example 3, after the performer avatar 1B of the performer B appears (after the number of performer avatars becomes two), since the number of performer avatars does not decrease, the process of drawing the performer avatar 1A and the process of drawing the performer avatar 1B continue until the end of the virtual live.

[0271] During each act period, as shown in FIGS. 31 and 35, in addition to the increase in the emission intensity of the virtual airborne objects 50 to 52 as the emission effects, each of the performer avatars 1A and 1B performs a performance such as singing or dancing. For this reason, as described above, since the processing load associated with the calculation process of how the light hits each viewer avatar and the performer avatar in the distribution server computer 100 and the generated shadow further increases, the update processing load of the virtual space update by the distribution server computer 100 further increases. Also, in each viewer terminal 300, the drawing processing load for drawing how the light hits each viewer avatar and the shadow generated by emitting the virtual airborne objects 50 to 52 and for drawing the performer avatars 1A and 1B increases.

[0272] In the third embodiment, when the processing load on the distribution server computer 100 and the viewer terminal 300 increases due to an increase in the number of viewer avatars and performer avatars arranged in the virtual live venue, an increase in the emission intensity of the light emission effect, an increase in the number of operating viewer avatars and performer avatars, an increase in the amount of movement of the performer avatar, etc., as described above, the display mode of the viewer avatar is changed from a full avatar with a relatively large processing load for display to a simple avatar with a relatively small processing load for display, thereby suppressing an excessive increase in the processing load on the entire equipment constituting the virtual space content distribution system, such as the distribution server computer 100 and the viewer terminal 300.

[0273] <Time schedule data> As described above, the virtual live of the third embodiment progresses as follows. As shown in FIG. 36, it is managed by the distribution server computer 100 based on time schedule data (TS data). The time schedule data is stored in a form included in the event management program 110 in the storage 103 of the distribution server computer 100.

[0274] The time schedule data is data in a table format in which the scheduled time of that timing, the elapsed time since the start of the live, the content of that timing, and the file name of the related data related to that timing are stored in association with the timing ID assigned in the order of individual timings in the virtual live.

[0275] As these timings, as shown in FIG. 36, in addition to the start and end timings of the opening production and the performer appearance production, and the timings at which the performer avatars 1A and 1B appear during the performer appearance production, the start and end timings of each transition period, and the timings for simplifying each viewer avatar (viewer avatar first simplification timing T1, viewer avatar second simplification timing T2, viewer avatar third simplification timing T3) are included. Hereinafter, in this embodiment, the viewer avatar first simplification timing T1, the viewer avatar second simplification timing T2, and the viewer avatar third simplification timing T3 may be simply referred to as timings T1, T2, and T3.

[0276] Timing T1 is the timing immediately before the start of the first act period when the light emission intensity of the light emission production increases and the operation of the performer avatar 1A becomes intense, increasing the drawing processing load on the viewer terminal 300. Timing T2 is the timing immediately before the start of the second MC period when the performer avatar 1B is added, increasing the drawing processing load on the viewer terminal 300. Timing T3 is the start timing of the second act period when the light emission intensity of the light emission production increases and the operations of the performer avatars 1A and 1B become intense, increasing the drawing processing load on the viewer terminal 300. These timings T1 to T3 are provided to change the viewer avatar from a full avatar to a simple avatar in advance at a stage where the processing load has not yet increased immediately before the drawing processing load on the viewer terminal 300 increases as described above.

[0277] <Video Generation During the Live Virtual Space Participable Period> Also, during the live virtual space participable period in which only the viewer avatar viewpoint video can be displayed on the viewer terminal 300 in the third embodiment, as shown in FIG. 37, similar to the second embodiment, after the avatar movement operation process is performed on the viewer terminal 300, the virtual space update process and the virtual space update data generation process are performed on the distribution server computer 100, and then the avatar simplification determination process for determining whether to change the display of the viewer avatar from a full avatar to a simple avatar is further performed on the distribution server computer 100.

[0278]

[0279] After the avatar simplification determination process is executed, the distribution server computer 100 executes virtual space update data distribution processing in the same manner as in the second embodiment, and transmits the simplification determination value data, which is the result of the avatar simplification determination process, together with the virtual space update data to the viewer terminal 300.

[0280] <Video generation during the performance period excluding the MC period and the flying effect period>

[0281] After the avatar simplification determination process is executed, the distribution server computer 100 executes virtual space update data distribution processing in the same manner as in the second embodiment, and transmits the simplification determination value data, which is the result of the avatar simplification determination process, together with the virtual space update data to the viewer terminal 300.

[0282] On the viewer terminal 300, based on receiving these virtual space update data and simplified determination value data, when the viewer avatar viewpoint video is selected as the video to be displayed in the virtual space update process, the viewer viewpoint video generation process is executed, and when the virtual camera viewpoint video is selected as the video to be displayed, the virtual camera designated video generation process is executed respectively. In particular, in this Example 3, although details will be described later, by using the received simplified determination value data, in the viewer viewpoint video generation process and the virtual camera designated video generation process, a process of drawing (generating) the viewer avatar as a full avatar or a simplified avatar is performed.

[0283] <Regarding friend registration> Also, regarding the virtual space content distribution system of this Example 3, it is possible for a viewer to register another viewer as their friend by operating the viewer terminal 300. Incidentally, in the storage 303 of the viewer terminal 300 of this Example 3, a friend user data table (see FIG. 40) for storing the user ID and nickname of the viewer user who has been pre-registered as a friend is stored.

[0284] As shown in FIG. 39, on the viewer terminal 300, when executing a viewer avatar selection process of selecting a specific viewer avatar from a plurality of viewer avatars by receiving an operation of the viewer's operation input device 321 during the live virtual space participation period, the file name (viewer avatar file name) of the selected viewer avatar is specified, and a viewer avatar inquiry process for transmitting viewer avatar inquiry information including the specified viewer avatar file name to the distribution server computer 100 is executed.

[0285] When the distribution server computer 100 receives viewer avatar inquiry information from the viewer terminal 300, it executes a viewer avatar identification process to identify the viewer user ID stored in association with the viewer avatar file name included in the viewer avatar inquiry information from the viewer user data shown in FIG. 9. Then, the distribution server computer 100 transmits viewer user ID information including the viewer user ID to the viewer terminal 300 that has transmitted the viewer avatar inquiry information.

[0286] When the viewer terminal 300 receives the viewer user ID information, it executes a friend addition operation process that prompts an operation to register, as a friend, the viewer (viewer user ID) of the viewer avatar selected by the viewer in association with the viewer avatar file name on the display device 310.

[0287] At this time, if the viewer performs an operation to register a friend, a friend addition process is executed to store the viewer user ID and the viewer avatar file name in association in the friend user data table. If the operation to register a friend is not performed, the viewer terminal 300 executes a friend addition cancellation process that displays on the display device 310 a message indicating that no friend registration is performed.

[0288] <Avatar Simplification Determination Process> FIG. 41 is a flowchart showing an example of the avatar simplification determination process shown in FIG. 38. In the avatar simplification determination process, the distribution server computer 100 first determines whether it is during the virtual live venue participation period (see FIG. 31) by referring to the time schedule data or the like (step S401). If it is not during the virtual live venue participation period (step S401; No), the process proceeds to step S407. If it is during the virtual live venue participation period (step S401; Yes), it further determines whether the participation number threshold reached flag is set (step S402). Note that the participation number threshold reached flag is a flag indicating that the number of viewer avatars (the number of viewers watching the virtual live) arranged in the virtual live venue has reached a predetermined threshold.

[0289] If the distribution server computer 100 determines that the participation number threshold reached flag is not set (step S402; Yes), the process proceeds to step S407. If the participation number threshold reached flag is set (step S402; No), it further refers to the participant user table shown in FIG. 23 to identify the number of participants in the live (the number of viewer avatars virtually participating in the virtual live venue) (step S403), and determines whether the identified number of participants in the live has reached the threshold (step S404).

[0290] Note that the participation number threshold is a value determined from the number of viewer avatars in full avatars that can be drawn at once on each viewer terminal 300 and the number of viewer avatars in full avatars that can be arranged in the virtual live venue. For example, when the limit number of viewer avatars in full avatars that can be drawn at once on each viewer terminal 300 and the number of viewer avatars in full avatars that can virtually participate in the virtual live venue is 200, an administrator or the like of the distribution server computer 100 may set it to 180, which is about 10% lower than the limit number. The participation number threshold is a value determined by the processing load corresponding to the number of viewer avatars that can be drawn on the viewer terminal 300, not simply the number of viewer avatars to be drawn.

[0291] Still, the threshold for the number of participants may be set to a value different from the above as appropriate by the administrator or the like of the distribution server computer 100 in the administrator terminal 150 in consideration of the performance (drawing processing ability) of each viewer terminal 300 and the like.

[0292] When the number of participants has not reached the threshold (step S404; No), the process proceeds to step S407. When the number of participants in the live event that has reached the threshold (step S404; Yes), based on the fact that the drawing processing load of the viewer avatar in full avatar at the viewer terminal 300 is almost at the limit, the distribution server computer 100 adds 1 to the simplification determination value (step S405), sets the participant number threshold reached flag (step S406), and proceeds to step S407. Still, the simplification determination value is a value for specifying the range to be displayed with a simple avatar having a small number of polygons constituting each viewer avatar to be displayed at each viewer terminal 300. The initial value is set to "0".

[0293]

[0294] In step S407, the distribution server computer 100 determines whether it is during the virtual live venue participation period or the MC period by referring to the time schedule data or the like (step S407). If it is neither during the virtual live venue participation period nor during the MC period (step S407; No), the process proceeds to step S413. If it is during the virtual live venue participation period or the MC period (step S407; Yes), it is determined whether the moving number threshold reached flag is set (step S408). Still, the moving number threshold reached flag is a flag indicating that the number of viewer avatars moving in the virtual live venue in full avatar among the viewer avatars arranged in the virtual live venue has already reached a predetermined threshold.If the moving person count threshold reached flag is set (step S408; Yes), the process proceeds to step S413. If the moving person count threshold reached flag is not set (step S408; No), the distribution server computer 100 identifies the number of viewer avatars currently moving (the number of viewer terminals 300 for which a moving operation is being performed by each viewer) from the viewer avatar information received from each viewer terminal 300 (step S409).

[0295] In step S409, the distribution server computer 100 may, for example, store the position information of each viewer avatar in the virtual live venue every unit time (e.g., 10 ms), and compare the stored position information of each viewer avatar in the virtual live venue with the previously stored position information of each viewer avatar in the virtual live venue, and aggregate the number of viewer avatars for which position information different from the previous storage is stored to identify the number of viewer avatars currently moving.

[0296] Then, the distribution server computer 100 determines whether the identified number of viewer avatars currently moving (the number of viewer avatars currently moving) has reached the threshold (step S410). Note that the threshold for the number of viewer avatars currently moving in step S410 is a value determined from the number of viewer avatars currently moving with full avatars that can be drawn at once on each viewer terminal 300. For example, if the limit number of viewer avatars currently moving with full avatars that can be drawn at once on each viewer terminal 300 is 200, the administrator of the distribution server computer 100 or the like may set it to 150, which is 25% lower than the limit number. The threshold for the number of viewer avatars currently moving is a value determined by the processing load corresponding to the number of viewer avatars that can be drawn on the viewer terminal 300, not simply the number of viewer avatars to be drawn.

[0297] Note that the administrator of the distribution server computer 100 or the like may appropriately set a value different from the above in consideration of the performance (drawing processing ability) etc. of each viewer terminal 300 for the threshold of the number of viewer avatars currently moving.

[0298] If the number of viewer avatars in motion has not reached the threshold (step S410; No), the process proceeds to S413. If the number of viewer avatars in motion has reached the threshold (step S410; Yes), the distribution server computer 100 adds 1 to the simplification determination value based on the fact that the rendering processing load of the viewer avatars in full avatar at the viewer terminal 300 is near the limit (step S411), sets the moving number threshold reached flag, and proceeds to step S413 (step S412).

[0299] In step S413, the distribution server computer 100 determines whether it is the timing T1 immediately before the start of the first act (step S413). If it is determined that the time is the timing T1 immediately before the start of the first act (step S413; Yes), the process proceeds to step S416.

[0300] If it is determined that the time is not the timing T1 immediately before the start of the first act (step S413; No), the distribution server computer 100 determines whether it is the timing T2 when the performer avatar 1B of performer B appears (step S414). If it is determined that the current time is the timing T2 immediately before the appearance of the performer avatar 1B of performer B (step S414; Yes), the process proceeds to step S416.

[0301] Also, if it is determined that the time is not the timing T2 immediately before the appearance of the performer avatar 1B of performer B (step S414; No), the distribution server computer 100 determines whether it is the timing T3 immediately before the start of the second act (step S415). If it is determined that the time is the timing T3 immediately before the start of the second act (step S415; Yes), the process proceeds to step S416, and if it is determined that the time is not the timing T3 immediately before the start of the second act (step S415; No), the process proceeds to step S417.

[0302] In step S416, upon reaching the above-described timings T1, T2, and T3, the distribution server computer 100 adds 1 to the simplification determination value based on the fact that the rendering processing load of the viewer terminal 300 immediately increases, and proceeds to step S417 (step S416).

[0303] Also, in step S417, the distribution server computer 100 executes a composite simplification determination process. The composite simplification determination process determines, for example, whether the total processing load, which is the sum of the rendering processing load of the viewer avatar as a full avatar, the generation calculation of the shadow of each viewer avatar, and the rendering processing load of the performer avatar in the viewer terminal 300, is approaching the limit of the processing load of the viewer terminal 300 even when the threshold number of participants has not been reached in step S404, the threshold number of moving viewer avatars has not been reached in step S410, or none of the timings T1 to T3 are met in steps S413 to S415. If the total processing load is approaching the limit of the processing load of the viewer terminal 300, the process of adding 1 to the simplification determination value may be performed in the same manner as in step S405, step S411, and step S416.

[0304] In addition, in the present Example 3, a form is exemplified in which, based on the fact that the number of performer avatars immediately becomes 2 at timing T2 (the appearance of performer avatar 1B in addition to performer avatar 1A), 1 is added to the simplification determination value. That is, although the threshold number of performer avatars is set to "2", the threshold number of performer avatars is a value determined by the processing load corresponding to the number of performer avatars that can be rendered in the viewer terminal 300, not simply the number of performer avatars to be rendered.

[0305] Furthermore, the threshold value for the number of performer avatars may be set to a value different from the above as appropriate by the administrator of the distribution server computer 100 or the like in consideration of the performance (drawing processing ability) of each viewer terminal 300 and the like. In particular, in the third embodiment, when "1" is set as the threshold value for the number of performer avatars, the simplified determination value is incremented by 1 at the timing immediately before the appearance of the performer avatar 1A of performer A during the first MC period.

[0306] Furthermore, in the composite simplification determination process of the third embodiment, an example of a form for determining whether or not the total processing load including the drawing processing load of the viewer avatar as a full avatar in the viewer terminal 300, the generation calculation of the shadow of each viewer avatar, the drawing processing load of the performer avatar, etc. has reached near the limit of the processing load of the viewer terminal 300 is illustrated. However, the present invention is not limited to this. As the composite simplification determination process, the simplified determination value may be incremented by 1 on the condition that the processing load of the viewer terminal 300 has reached a processing load different from the processing load corresponding to the threshold value of the number of participants or the threshold value of the number of viewer avatars in motion.

[0307] After executing the process of step S417, the distribution server computer 100 only performs the transmission setting of the simplified determination value and ends the avatar simplification determination process (step S418).

[0308] <Viewer Perspective Video Generation Process> FIG. 42 is a flowchart showing an example of the viewer perspective video generation process shown in FIG. 38. In the viewer perspective video generation process, the viewer terminal 300 first generates the video of the performer avatar as a full avatar shown in FIG. 45(A) (step S501). As shown in FIG. 45(A), as the performer avatars 1A and 1B, there are a full avatar produced based on the taste of each performer (performer A and performer B in the third embodiment) and a simplified avatar obtained by simplifying the full avatar. The simplified avatar is an avatar model created with a smaller number of polygons than the full avatar (number of polygons: performer's full avatar > performer's simplified avatar), and the drawing processing load in each viewer terminal 300 is lighter than that of the full avatar.

[0309] Next, it is determined whether the simplification determination value is 0 (step S502). If the simplification determination value is 0 (step S502; Yes), the videos of both the viewer avatars of the registered friends and the viewer avatars of the unregistered friends are generated as full avatars, and the process proceeds to step S509 (step S503). Incidentally, as shown in FIG. 45(B), as the viewer avatars, full avatars created based on the preferences of each viewer are provided. These full avatars as viewer avatars are avatar models created with approximately the same number of polygons as the simple avatars of the performers (number of polygons: simple avatar of the performer ≒ full avatar of the viewer), and the shape, color scheme, etc. are different for each viewer.

[0310] Incidentally, in the third embodiment, a form in which the full avatars of the performers and the full avatars of the viewers are created with approximately the same number of polygons is illustrated. However, the present invention is not limited to this. Regarding the number of polygons of these full avatars of the performers and the full avatars of the viewers, as long as the number of polygons of the full avatars of the viewers is less than that of the full avatars of the performers, the number of polygons of the full avatars of the viewers may be more than that of the simple avatars of the performers, or the number of polygons of the simple avatars of the performers may be more than that of the full avatars of the viewers.

[0311] Also, as shown in FIG. 45(B), as the viewer avatars, simple avatars created with a smaller number of polygons than the full avatars of each viewer are also provided. The simple avatars as the viewer avatars are in a common form regardless of the form of the full avatars of each viewer and are created with a smaller number of polygons than the full avatars of each viewer (number of polygons: full avatar of the viewer > simple avatar of the viewer), and the rendering processing load on each viewer terminal 300 is lighter than that of the full avatars.

[0312] Returning to FIG. 42, when the simplification determination value is not 0 (step S502; No), the viewer terminal 300 further determines whether the simplification determination value is 1 (step S504). When the simplification determination value is 1 (step S504; Yes), it determines whether the friend viewer avatar identified flag is set (step S505a). Note that the friend viewer avatar identified flag is a flag indicating that the viewer avatar file name existing in the friend user data table has been identified. When the friend viewer avatar identified flag is set (step S505a; Yes), it proceeds to step S506. When the friend viewer avatar identified flag is not set (step S505a; No), it refers to the friend user data table shown in FIG. 40, identifies the viewer avatar data file name existing in the friend user data table, and stores the identified viewer avatar data file name (step S505b). Further, the viewer terminal 300 sets the friend viewer avatar identified flag and proceeds to step S506 (step S505c).

[0313] Then, in step S506, while the viewer terminal 300 generates the video of the viewer avatar (friend's viewer avatar) corresponding to the viewer avatar data file name specified in step S505 in full avatar (step S506), it generates the video of the viewer avatar excluding the viewer avatar corresponding to the viewer avatar data file name specified in step S505b (other people's viewer avatars) in simplified avatar (step S507), and proceeds to step S509.

[0314] Also, when the simplification determination value is not 1 (step S504; No), the viewer terminal 300 generates the videos of all viewer avatars in simplified avatar regardless of whether they are viewers registered as friends assuming that the simplification determination value is 2 or more (step S508), and proceeds to step S509.

[0315] In step S509, the viewer terminal 300 generates other performer avatars 1A and 1B and viewer perspective videos other than the viewer avatar (step S509), and ends the viewer perspective video generation process.

[0316] As described above, in the third embodiment, as shown in FIG. 44(A), the performer avatars 1A and 1B generated in the viewer perspective video generation process are always generated as full avatars regardless of the value of the simplification determination process. That is, from the viewer avatar perspective of the viewer operating the viewer terminal 300, the performer avatars 1A and 1B are always displayed as full avatars.

[0317] Also, for the viewer avatars of viewers who are registered as friends, when the simplification determination value is 1 or less, the video is generated as a full avatar, while when the simplification determination value is 2 or more, the video is generated as a simple avatar. That is, from the viewer avatar perspective of the viewer operating the viewer terminal 300, the viewer avatars of viewers who are registered as friends are displayed as full avatars when the simplification determination value is 1 or less, while they are displayed as simple avatars when the simplification determination value is 2 or more.

[0318] Furthermore, for the viewer avatars of viewers who are not registered as friends, when the simplification determination value is 0, the video is generated as a full avatar, while when the simplification determination value is 1 or more, the video is generated as a simple avatar. That is, from the viewer avatar perspective of the viewer operating the viewer terminal 300, the viewer avatars of viewers who are not registered as friends are displayed as full avatars only when the simplification determination value is 0, while they are displayed as simple avatars when the simplification determination value is 1 or more.

[0319] <Virtual Camera Perspective Video Generation Process (Viewer Terminal)> FIG. 43 is an example of a flowchart showing the virtual camera viewpoint video generation process (the virtual camera viewpoint video generation process executed by the viewer terminal 300) shown in FIG. 38. In the virtual camera viewpoint video generation process, the viewer terminal 300 first generates the videos of the performer avatars 1A and 1B in full avatar (step S511), and determines whether the simplification determination value is 0 (step S512). If the simplification determination value is 0 (step S512; Yes), the viewer terminal 300 generates the videos of the viewer's own viewer avatar who is operating the viewer terminal 300 and all other viewer avatars regardless of whether they are friend-registered in full avatar (step S513), and proceeds to step S523.

[0320] If the simplification determination value is not 0 (step S512; No), it is further determined whether the simplification determination value is 1 (step S514). If the simplification determination value is 1 (step S514; Yes), it is determined whether the friend viewer avatar identification completed flag is set (step S515a). If the friend viewer avatar identification completed flag is set (step S515a; yes), the process proceeds to step S516. If the friend viewer avatar identification completed flag is not set (step S515a; No), the friend user data shown in FIG. 40 is referred to, and the viewer avatar data file name existing in the friend user data is identified (step S515b). Further, the viewer terminal 300 sets the friend viewer avatar identification completed flag and proceeds to step S516 (step S515c)

[0321] Then, the viewer terminal 300 generates, in full avatar, the video of the viewer avatar of the viewer who is operating the viewer terminal 300 itself and the viewer avatar (the viewer avatar of a friend) corresponding to the viewer avatar data file name specified in step S515b (step S516). On the other hand, the viewer terminal 300 generates, in simplified avatar, the video of the viewer avatars other than the viewer avatar of the viewer who is operating the viewer terminal 300 itself and the viewer avatar corresponding to the viewer avatar data file name specified in step S515 (the viewer avatars of others) (step S517), and proceeds to step S523.

[0322] If the simplification determination value is not 1 (step S514; No), it is further determined whether the simplification determination value is 2 (step S518). If the simplification determination value is 2 (step S518; No), the viewer terminal 300 generates, in full avatar, the video of the viewer avatar of the viewer who is operating the viewer terminal 300 itself (step S520). On the other hand, the viewer terminal 300 generates, in simplified avatar, the video of the viewer avatars other than the viewer of the viewer who is operating the viewer terminal 300 itself (step S521), and proceeds to step S523.

[0323] If the simplification determination value is not 2 (step S518; No), the viewer terminal 300 generates, in simplified avatar, the video of the viewer avatar of the viewer who is operating the viewer terminal 300 itself and all other viewer avatars regardless of whether they are registered as friends, assuming that the simplification determination value is 3 or more (step S522), and proceeds to step S523. In step S523, the viewer terminal 300 generates other virtual camera viewpoint videos and ends the virtual camera viewpoint video generation process (step S523).

[0324] As described above, in the third embodiment, as shown in FIG. 44(B), the performer avatars 1A and 1B generated in the viewer viewpoint video generation process of the viewer terminal 300 are always generated as full avatars regardless of the value of the simplification determination process. That is, from the viewer avatar viewpoint of the viewer operating the viewer terminal 300, the performer avatars are always displayed as full avatars.

[0325] Also, among the viewer avatars, for the viewer avatar of the viewer himself / herself operating the viewer terminal 300, when the simplification determination value is 2 or less, the video is generated as a full avatar, while when the simplification determination value is 3 or more, the video is generated as a simple avatar. That is, from the virtual camera viewpoint, the viewer avatar of the viewer himself / herself operating the viewer terminal 300 is displayed as a full avatar when the simplification determination value is 2 or less, while it is displayed as a simple avatar when the simplification determination value is 3 or more.

[0326] Also, among the viewer avatars, for the viewer avatars of the viewers with friend registration, when the simplification determination value is 1 or less, the video is generated as a full avatar, while when the simplification determination value is 2 or more, the video is generated as a simple avatar. That is, from the virtual camera viewpoint, the viewer avatars of the viewers with friend registration are displayed as full avatars when the simplification determination value is 1 or less, while they are displayed as simple avatars when the simplification determination value is 2 or more.

[0327] Furthermore, among the viewer avatars, for the viewer avatars of the viewers without friend registration, when the simplification determination value is 0, the video is generated as a full avatar, while when the simplification determination value is 1 or more, the video is generated as a simple avatar. That is, from the virtual camera viewpoint, the viewer avatars of the viewers without friend registration are displayed as full avatars only when the simplification determination value is 0, while they are displayed as simple avatars when the simplification determination value is 1 or more.

[0328] In the present Example 3, as shown in FIGS. 38, 42, and 43, regarding the viewer viewpoint video and the virtual camera viewpoint video generated on the viewer terminal 300, a form in which each viewer avatar is changed from a full avatar to a simple avatar according to an increase in the drawing processing load on the viewer terminal 300 has been exemplified. However, the present invention is not limited to this. As shown in FIG. 25, regarding the virtual camera viewpoint video generated on the distribution server computer 100, each viewer avatar may also be changed from a full avatar to a simple avatar. In this case, each viewer avatar may be changed from a full avatar to a simple avatar according to an increase in the drawing processing load on the distribution server computer 100.

[0329] Furthermore, since it is only necessary to prevent an excessive increase in the processing load of the entire virtual space content distribution system of the present invention, according to an increase in the drawing processing load on the distribution server computer 100, the viewer avatar in the viewer viewpoint video or the virtual camera viewpoint video generated on the viewer terminal 300 may be changed from a full avatar to a simple avatar, or according to an increase in the drawing processing load on the viewer terminal 300, the viewer avatar in the virtual camera viewpoint video generated on the distribution server computer 100 may be changed from a full avatar to a simple avatar.

[0330] In the present Example 3, as described above, a form in which the viewer avatar is changed from a full avatar to a simple avatar on the viewer terminal 300 according to the processing load corresponding to the number of avatars that can be drawn on the viewer terminal 300 has been exemplified. However, the present invention is not limited to this. The viewer avatar may also be changed from a full avatar to a simple avatar based on simply exceeding a threshold value of the number of participants, a threshold value of the number of viewer avatars during movement, or a threshold value of the number of performer avatars.

[0331] Next, regarding the display changes of the performer avatars 1A and 1B and the viewer avatars in the virtual live venue, an example of the display from the perspective of the virtual camera C2 on the viewer terminal 300 of the viewer operating the viewer avatar 11 will be described. Also, hereinafter, the viewer avatars 12, 13, and 14 will be described as the avatars of viewers who have been friend-registered by the viewer operating the viewer avatar 11, and the other viewer avatars will be described as the avatars of viewers who have not been friend-registered by the viewer operating the viewer avatar 11.

[0332] Note that in the third embodiment, the display changes of the performer avatars 1A and 1B and the viewer avatars from the perspective of the virtual camera C2 will be described. However, regarding the display of the performer avatars 1A and 1B and the viewer avatars from the viewer's perspective (the perspective from the viewer avatar 11), since it is the same as the perspective of the virtual camera C2 except that the viewer avatar 11 is not displayed, the description will be omitted.

[0333] Also, in the third embodiment, since the composite simplification determination process (step S417) is executed in the avatar simplification determination process shown in FIG. 41, it is not necessarily the case that the viewer avatar changes from the full avatar to the simple avatar at the timing when the number of participants reaches the threshold, or at the timing when the number of moving viewer avatars reaches the threshold, or at any of the timings T1 to T3. However, to prevent the description from becoming complicated, hereinafter, an example in which the viewer avatar changes from the full avatar to the simple avatar at the timing when the number of participants reaches the threshold, or at the timing when the number of moving viewer avatars reaches the threshold, or at the timings T1 to T3 will be used for the description.

[0334] First, as shown in FIG. 46, when neither the determination of reaching the threshold number of participants nor the determination of reaching the threshold number of viewer avatars in motion is executed in the virtual live venue, the presenter avatar 1A of Presenter A is displayed as a full avatar from the appearance timing, which is immediately after the start of the first MC period, and the presenter avatar 2B of Presenter B is displayed as a full avatar from the appearance timing during the second MC period. Note that both the presenter avatar 1A of Presenter A and the presenter avatar 1B of Presenter B are maintained in full avatar display without changing to a simple avatar.

[0335] On the other hand, until the timing T1, which is immediately before the start of the program (the first program) by the presenter avatar 1A of Presenter A after the display starts during the virtual live venue participation period, all viewer avatars are displayed as full avatars (see FIG. 49(A)). From timing T1, as the light emission intensity of the light emission effect increases from the immediately following first program start timing and the movement of the presenter avatar 1A becomes intense, resulting in an increase in the drawing processing load on the viewer terminal 300, the simplification determination value is updated from 0 to 1, and the display as a simple avatar is started for the viewer avatars of viewers who are not friend-registered by the viewer operating the viewer avatar 11 (see FIG. 49(B)).

[0336] Also, from timing T2, as the presenter avatar 1B appears immediately afterwards, that is, as the number of presenter avatars increases from 1 to 2, resulting in an increase in the drawing processing load on the viewer terminal 300, the simplification determination value is updated from 1 to 2, and the display as a simple avatar is started for the viewer avatars of viewers who are friend-registered by the viewer operating the viewer avatar 11 (see FIG. 49(C)).

[0337] Then, from timing T3, as the second program, in which the light emission intensity of the light emission effect increases immediately afterwards and the movements of the presenter avatars 1A and 2B of Presenter A and Presenter B become intense, starts, the simplification determination value is updated from 2 to 3, and the display of the viewer avatar 11 itself as a simple avatar is started (see FIG. 49(D)).

[0338] As shown in FIG. 47, when the determination of reaching the participation number threshold is executed in the virtual live venue, the performer avatar 1A of performer A is displayed as a full avatar from the appearance timing which is the timing immediately after the start of the first MC period, and the performer avatar 1B of performer B is displayed as a full avatar from the appearance timing during the second MC period. Note that both the performer avatar 1A of performer A and the performer avatar 1B of performer B are maintained in the display as full avatars without changing to simple avatars.

[0339] On the other hand, after the display is started during the virtual live venue participation period, until it is determined that the participation number threshold is reached during the virtual live venue participation period, all viewer avatars are displayed as full avatars (see FIG. 49(A)). However, when it is determined that the participation number threshold is reached during the virtual live venue participation period, the simplified determination value is updated from 0 to 1 at the arrival determination timing, and the display as a simple avatar is started for the viewer avatars of viewers who are not friend-registered by the viewer operating the viewer avatar 11 (see FIG. 49(B)).

[0340] From timing T1, as the light emission intensity of the light emission effect increases immediately thereafter and the first act in which the operation of the performer avatar 1A becomes intense starts, the simplified determination value is updated from 1 to 2 in response to the increase in the drawing processing load in the viewer terminal 300, and the display as a simple avatar is started for the viewer avatars of viewers who are friend-registered by the viewer operating the viewer avatar 11 (see FIG. 49(C)).

[0341] Then, from timing T2, immediately after the performer avatar 1B appears, that is, as the number of performer avatars increases from 1 to 2, the simplified determination value is updated from 2 to 3 in response to the increase in the drawing processing load in the viewer terminal 300, and the display of the viewer avatar 11 itself as a simple avatar is started (see FIG. 49(D)).

[0342] As shown in Fig. 48, when the determination of reaching the threshold number of participants and the determination of reaching the threshold number of viewer avatars in motion are executed in the virtual live venue, the presenter avatar 1A of Presenter A is displayed as a full avatar from the appearance timing, which is the timing immediately after the start of the first MC period, and the presenter avatar 1B of Presenter B is displayed as a full avatar from the appearance timing during the second MC period. Note that both the presenter avatar 1A of Presenter A and the presenter avatar 1B of Presenter B are maintained in the full avatar display without changing to a simple avatar.

[0343] On the other hand, from the start of the display during the virtual live venue participation period until it is determined that the threshold number of participants has been reached during the virtual live venue participation period, all viewer avatars are displayed as full avatars (see Fig. 49(A)). However, when it is determined that the threshold number of participants has been reached during the virtual live venue participation period, the simplified determination value is updated from 0 to 1 at the timing of the reaching determination, and the display as a simple avatar is started for the viewer avatars of viewers who are not friend-registered by the viewer operating the viewer avatar 11 (see Fig. 49(B)).

[0344] Also, when it is determined that the number of viewer avatars in motion has reached the threshold during the virtual live venue participation period, the simplified determination value is updated from 1 to 2 at the timing of the reaching, and the display as a simple avatar is started for the viewer avatars of viewers who are friend-registered by the viewer operating the viewer avatar 11 (see Fig. 49(C)).

[0345] Then, from timing T1, in response to the increase in the drawing processing load in the viewer terminal 300 due to the start of the first act where the light emission intensity of the light emission effect increases immediately afterwards and the operation of the presenter avatar 1A becomes intense, the simplified determination value is updated from 2 to 3, and the display of the viewer avatar 11 itself as a simple avatar is started (see Fig. 49(D)).

[0346] Furthermore, in the third embodiment, even after the simplified determination value is updated to 3 and the display of all viewer avatars in the simplified avatar is started, the simplified determination value may be updated to 4 or 5. However, even if the simplified determination value is updated to 4 or more, the all viewer avatars will not change further from the simplified avatar.

[0347] As described above, in the third embodiment, as shown in FIGS. 41 to 44 and FIGS. 46 to 49, when the number of performer avatars to be displayed increases to 2, the rendering processing load of the performer avatars increases; when the operation of the performer avatars becomes large (intense) at the start of the first act period or the second act period, the update processing load of the virtual space and the rendering processing load of the performer avatars increase; when the emission intensity of the light emission effect increases based on the start of the first act period or the second act period, the rendering processing load of the virtual space and each avatar increases; when the number of viewer avatars (number of live participants) virtually participating in the virtual live venue exceeds the threshold number, the update processing load of the virtual space and the rendering processing load of the viewer avatars increase; when the number of moving viewer avatars (number of moving people) among the viewer avatars virtually participating in the virtual live venue exceeds the threshold, the update processing load of the virtual space and the rendering processing load of the viewer avatars increase. Based on the occurrence of any of these (the establishment of the specific conditions of the present invention), by changing the viewer avatars in the virtual live venue from full avatars to simplified avatars, the processing load for the viewer terminal 300 to display (render) these viewer avatars is reduced. Therefore, it is possible to prevent an excessive increase in the overall processing load of the virtual space content distribution system due to the establishment of the above specific conditions.

[0348] Also, in the third embodiment, time schedule data for managing the progress of the virtual live is stored in the storage 103 of the distribution server computer 100. The distribution server computer 100 can specify the timing immediately before the processing load increases from the time schedule data in the avatar simplification determination process shown in FIG. 41. Therefore, the timing when the processing load increases can be accurately specified at timings T1 to T3 before the actual increase in the processing load.

[0349] In particular, in the third embodiment, the timing at which the number of displayed performer avatars increases to two, thereby increasing the rendering processing load of the performer avatars, or the timing at which the operations of the performer avatars become large (intense) due to the start of the first act period or the second act period, resulting in an increase in the update processing load of the virtual space and the rendering processing load of the performer avatars, or the timing at which the emission intensity of the light emission effect increases based on the start of the first act period or the second act period, resulting in an increase in the rendering processing load of the virtual space and each avatar, by changing the viewer avatar from a full avatar to a simple avatar from timings T1 to T3 before these timings, the timings of the increase in the number of these performer avatars, the timings at which the operations of the performer avatars 1A and 1B become intense, and the timings at which the emission intensity is enhanced as the light emission effect do not overlap with the timing of changing the viewer avatar from a full avatar to a simple avatar, thereby preventing the processing loads required for these processes from overlapping and the overall processing load of the virtual space content distribution system from increasing excessively.

[0350] In the third embodiment, the form in which the time schedule data is stored in the storage 103 of the distribution server computer 100 and the distribution server computer 100 changes the viewer avatar from a full avatar to a simple avatar based on identifying timings T1 to T3 has been exemplified. However, the present invention is not limited to this. The time schedule data may be stored in the storage 303 of the viewer terminal 300, and the viewer terminal 300 itself may identify timings T1 to T3 from the time schedule data and execute the change of the viewer avatar from a full avatar to a simple avatar based on the identification.

[0351] Also, in the third embodiment, the form of changing the viewer avatar from a full avatar to a simple avatar from timings T1 to T3 immediately before the rendering processing load increases has been exemplified. However, the present invention is not limited to this. If there is sufficient margin in the rendering processing ability of the viewer terminal 300, the viewer avatar may be changed from a full avatar to a simple avatar at the timing when the rendering processing load increases.

[0352] Also, as shown in FIG. 49, as for the virtual camera designated video, the viewer avatar of the viewer who operates the viewer terminal 300 (viewer avatar 11 in the example of FIG. 49) will ultimately change from the full avatar to the simple avatar and be displayed, so that an excessive increase in the processing load can be further prevented.

[0353] Also, in the third embodiment, since the viewer avatar of the viewer who operates another viewer terminal 300 changes from the full avatar to the simple avatar prior to the viewer avatar of the viewer who operates the viewer terminal 300 (viewer avatar in the example of FIG. 49), an excessive increase in the processing load can be effectively prevented.

[0354] Note that in the third embodiment, the viewer avatars are divided into the viewer avatar of the viewer who operates the viewer terminal 300 (viewer avatar 11 in the example of FIG. 49), the viewer avatars of the viewers who have been registered as friends by the viewer (viewer avatars 12, 13, 14 in the example of FIG. 49), and the viewer avatars of the viewers who have not been registered as friends by the viewer. The priority of changing from the full avatar to the simple avatar is set such that the viewer avatar of the viewer who has not been registered as a friend is the highest, and the viewer avatar of the viewer who operates the viewer terminal 300 (viewer avatar 11 in the example of FIG. 49) is the lowest (priority of changing from the full avatar to the simple avatar: viewer avatar of the viewer who has not been registered as a friend > viewer avatar of the viewer who has been registered as a friend > viewer avatar of the viewer who operates the viewer terminal 300). However, the present invention is not limited to this, and the priority of changing from the full avatar to the simple avatar may be other than the above, or the priority of changing from the full avatar to the simple avatar may not be set among the viewer avatars.

[0355] In addition, in the third embodiment, as shown in FIGS. 45 to 48, both the performer avatars 1A and 1B and the viewer avatar are provided with full avatars and simple avatars. However, as for the viewer avatar, as the rendering processing load of the viewer terminal 300 increases, the full avatar changes to the simple avatar, while as for the performer avatars 1A and 1B, only the full avatar is always displayed regardless of the increase in the rendering processing load of the viewer terminal 300. That is, during the virtual live performance, since a simple avatar with a small rendering processing load for display as the performer avatars 1A and 1B is not displayed, it is possible to prevent the interest of the live performance from decreasing due to the display of the simple avatar as the performer avatars 1A and 1B.

[0356] Note that in the third embodiment, a form in which the performer avatars 1A and 1B are provided with full avatars and simple avatars is exemplified, but the present invention is not limited to this. Since there is no opportunity to display the simple avatar as the performer avatars 1A and 1B in the first place, only the full avatar may be provided as the performer avatars 1A and 1B without providing the simple avatar.

[0357] In addition, in the third embodiment, a performer terminal 200 operable by a performer is provided as a device constituting the virtual space content distribution system, and as the virtual space content, the operations of the performer avatars 1A and 1B in which the operations of the performer are immediately reflected can be distributed. However, the present invention is not limited to this, and as the virtual space content, the operations of the performer avatars 1A and 1B photographed or produced in advance may be distributed.

[0358] Also, in the third embodiment, as shown in FIG. 41, based on the fact that the number of viewer avatars installed in the virtual live venue and the number of viewer avatars in motion have reached a predetermined threshold value, the distribution server computer 100 univocally determines that the rendering processing load in the viewer terminal 300 is approaching the limit, and an example is given in which the viewer avatar in the viewer terminal 300 is changed from a full avatar to a simple avatar. However, the present invention is not limited to this. In reality, since it is extremely unlikely that each viewer is using the same viewer terminal 300, even when the distribution server computer 100 determines that the rendering processing load in the viewer terminal 300 is approaching the limit, if there is still sufficient rendering processing capacity on the viewer terminal 300 side for rendering viewer avatars, performer avatars, etc., the viewer terminal 300 side may continue to display the viewer avatar as a full avatar.

[0359] Also, in the third embodiment, when the number of viewer avatars virtually participating in the virtual live venue exceeds the threshold number, when the number of viewer avatars in motion among the viewer avatars virtually participating in the virtual live venue exceeds the threshold number, when the emission intensity of the light emission effect increases, when the movement of the performer avatar becomes large (intense), when the number of performer avatars increases, the distribution server computer 100 determines that the rendering load of the viewer terminal 300 increases and changes the viewer avatar from a full avatar to a simple avatar for the viewer terminal 300. However, the present invention is not limited to this. When the number of viewer avatars virtually participating in the virtual live venue exceeds the threshold number, when the number of viewer avatars in motion among the viewer avatars virtually participating in the virtual live venue exceeds the threshold number, when the emission intensity of the light emission effect increases, when the movement of the performer avatar becomes large (intense), when the number of performer avatars increases, the viewer terminal 300 itself may determine that the rendering processing load of the viewer terminal 300 increases and change the viewer avatar from a full avatar to a simple avatar. In this case, the viewer himself / herself who is viewing the virtual live using the viewer terminal 300 may set the threshold number of the number of viewer avatars virtually participating in the virtual live venue and the threshold number of the number of viewer avatars in motion by operating the viewer terminal 300.

[0360] In addition, in the third embodiment, an example is given of a form in which the viewer avatar of a viewer who is not a friend is preferentially displayed as a simple avatar over the viewer avatar of a viewer who is a friend and has a high relationship with the viewer user using the viewer terminal 300. However, the present invention is not limited to this. Relatives such as the parents and siblings of the viewer user using the viewer terminal 300, and persons related to the viewer user using the viewer terminal 300 who belong to the same organization (for example, school, company, club, etc.) are registered in advance in the same procedure as shown in FIG. 39 in advance, and the viewer avatars of viewers who are not these relatives or related persons may be preferentially displayed as simple avatars. That is, the "other viewer users with a high relationship with themselves" for each viewer user in the third embodiment may be a concept including not only friends but also relatives of the viewer user himself and related persons belonging to the same organization.

[0361] In addition, in the third embodiment, an example is given of a form in which the viewer avatar is changed from a full avatar to a simple avatar based on an increase in the processing load of the viewer terminal 300. However, the present invention is not limited to this. A plurality of simple avatars with different drawing loads are provided as viewer avatars, and when the processing load of the viewer terminal 300 increases, a simple avatar corresponding to the drawing ability may be displayed as the viewer avatar for each viewer terminal 300.

[0362] <Modification Example of the Third Embodiment> As described above, the present invention has been described based on each embodiment and modification example. However, the specific configuration is not limited to the above-described embodiments and modification examples, and changes and additions within the scope not departing from the gist of the present invention are also included in the present invention.

[0363] For example, in the above-described Example 3, although both a full avatar and a simple avatar are prepared as the performer avatars 1A and 1B, a form in which the simple avatar is not displayed as the performer avatars 1A and 1B was exemplified. However, the present invention is not limited to this. As Modification 3-1, a case where the performer avatars 1A and 1B are displayed as simple avatars may be provided, or a period may be provided during which it is possible to select whether to display the performer avatars 1A and 1B as full avatars or simple avatars by operating the performer terminals 200 by each performer.

[0364] For example, as shown in FIG. 50, during a period other than the performance period, both the performer avatar 1A of performer A and the performer avatar 1B of performer B may be made selectable as to whether to be displayed as a full avatar or a simple avatar by an operation from each performer terminal 200. Further, during the performance period, when the performance period is a performance period in which only the performer avatar 1A of performer A sings or dances, the performer avatar 1A of performer A is displayed as a full avatar while the performer avatar 1B of performer B is displayed as a simple avatar, thereby reducing the processing load for displaying the performer avatar 1B of performer B on the viewer terminal 300. When the performance period is a performance period in which only the performer avatar 1B of performer B sings or dances, the performer avatar 1B of performer B may be displayed as a full avatar while the performer avatar 1A of performer A is displayed as a simple avatar, thereby reducing the processing load for displaying the performer avatar 1A of performer A on the viewer terminal 300.

[0365] Further, when the performance period is a performance period in which both the performer avatar 1A of performer A and the performer avatar 1B of performer B sing or dance, both the performer avatar 1A of performer A and the performer avatar 1B of performer B may be displayed.

[0366] In addition, in the third embodiment, as an example of a simple avatar of the viewer avatar, a form in which only one type of simple avatar is provided regardless of the performer who sings or dances was exemplified. However, the present invention is not limited to this. As shown in FIG. 51 as Modification 3-2, the form of the simple avatar of the viewer may be made different according to the performer avatar performing the program. In particular, during non-program periods such as the period during which virtual live venue participation is possible, the opening performance period, and the MC period, the viewer avatar is displayed in the manner shown in the third embodiment, while during each program period, according to the performer avatar who sings or dances, the viewer avatar is displayed using a simple avatar in a form set in advance for each performer. By doing so, the form of the simple avatar as the viewer avatar changes according to the performer avatar, so the interest of the virtual live can be improved.

[0367] In addition, when the form of the viewer avatar is thus made different according to the performer, as shown in FIGS. 52 and 53, from the pre-data download request received by the distribution server computer 100 from the viewer terminal 300 in the pre-data transmission process, the performer for whom the simple avatar has been set in advance for the viewer (the performer for whom the data of the simple avatar for the viewer is stored in the storage 103 in the distribution server computer 100 in advance) is specified (step S601), and the transmission setting of the data of the simple avatar for the viewer for each specified performer (step S602) and the transmission setting of other pre-data from the received pre-data download request (step S603) are performed, and the pre-data for which these transmission settings have been performed may be transmitted to the viewer terminal 300 (step S604).

[0368] By doing so, the viewer terminal 300 can receive, as part of the pre-data from the distribution server computer 100, the data of the simple avatar for the viewer corresponding to each performer (performer avatars 1A and 1B), and display the simple avatar in a form corresponding to each of the performer avatars 1A and 1B as the viewer avatar during the program period.

[0369] In the present Modification Example 3-2, a form has been exemplified in which a simple avatar in a form corresponding to each performer avatar 1A, 1B is displayed as a viewer avatar. However, the present invention is not limited to this. For a performer without a setting of a simple avatar for the viewer as pre-data (a performer in which data of a simple avatar for the viewer is not stored in the storage 103 in the distribution server computer 100 in advance), during the performance period, as shown in FIG. 51, a simple avatar in the same form as during the non-performance period may be displayed as the viewer avatar.

[0370] Also, in the present Modification Example 3-2, a form has been exemplified in which a simple avatar in a form corresponding to each performer avatar 1A, 1B is displayed as a viewer avatar. However, the present invention is not limited to this, and the simple avatar displayed as the viewer avatar may be made different over time. For example, as shown in FIG. 54 as Modification Example 3-3, a heart-shaped character is displayed as the simple avatar of the viewer until a predetermined timing S from the start of the performance, while a star-shaped character is displayed as the simple avatar of the viewer after the timing S.

[0371] Also, in the above Example 3, a form has been exemplified in which two types of avatars, namely, a full avatar and a simple avatar with a smaller drawing processing load than the full avatar, are provided for the viewer avatar and the performer avatars 1A, 1B, respectively. However, the present invention is not limited to this. As Modification Example 3-4, as the viewer avatar or the performer avatars 1A, 1B, a plurality of simple avatars with different drawing processing loads (for example, a first simple avatar with a smaller drawing processing load than the full avatar and a second simple avatar with a smaller drawing processing load than the first simple avatar) may be provided.

[0372] Thus, when providing a plurality of simple avatars with different rendering processing loads, the number of viewer avatars virtually participating in the virtual live venue exceeds the threshold number, the number of viewer avatars in motion among the viewer avatars virtually participating in the virtual live venue exceeds the threshold number, reaching any of the timings T1 to T3, etc. Under such conditions, the mode of the viewer avatar may be changed step by step to a full avatar, a first simple avatar, a second simple avatar, etc. so that the rendering processing load of the viewer terminal 300 decreases.

[0373] Also, in the third embodiment, the form of changing the viewer avatar from a full avatar to a simple avatar on the condition that the number of viewer avatars in motion among the viewer avatars virtually participating in the virtual live venue exceeds the threshold number was exemplified. However, the present invention is not limited to this. As a modification example 3-5, even if the viewer avatar is not in motion, if the number of viewer avatars performing actions such as dancing or jumping among the viewer avatars virtually participating in the virtual live venue exceeds the threshold number, the viewer avatar may be changed from a full avatar to a simple avatar. That is, the “performer avatar operating in the virtual space” in the third embodiment may include a performer avatar performing actions other than moving within the virtual live venue in addition to the performer avatar moving within the virtual live venue.

[0374] Also, in the third embodiment, the form of once displaying each viewer avatar as a full avatar and then changing these viewer avatars to simple avatars based on the establishment of specific conditions was exemplified. However, the present invention is not limited to this. As a modification example 3-6, when it is surely seen that the number of viewer avatars virtually participating in the virtual live venue exceeds a predetermined threshold number, each viewer avatar may be displayed as a simple avatar from the beginning.

[0375] Also, in the third embodiment, as the number of displayed performer avatars increases to two, the rendering processing load of the performer avatars increases; as the operation of the performer avatars becomes large (intense) at the start of the first act period or the second act period, the update processing load of the virtual space and the rendering processing load of the performer avatars increase; as the emission intensity of the emission effect increases based on the start of the first act period or the second act period, the rendering processing load of the virtual space and each avatar increases; as the number of viewer avatars (number of live participants) virtually participating in the virtual live venue exceeds the threshold number, the update processing load of the virtual space and the rendering processing load of the viewer avatars increase; as the number of moving viewer avatars (number of moving people) among the viewer avatars virtually participating in the virtual live venue exceeds the threshold, the update processing load of the virtual space and the rendering processing load of the viewer avatars increase. These are set as specific conditions in the present invention. Based on the establishment of any of these specific conditions, a form of changing the viewer avatar from a full avatar to a simple avatar is exemplified. However, the present invention is not limited to this. As Modification Example 3-7, the specific conditions in the present invention may be only a part of the above, or may include events other than the above conditions as long as they increase the processing load in the distribution server computer 100 or the viewer terminal 300 constituting the virtual space content distribution system of the present invention.

[0376] In addition, in the third embodiment, as shown in FIGS. 41 to 43, when generating a viewer perspective video and when generating a virtual camera perspective video, the same threshold values (the threshold value for the number of participants and the threshold value for the number of moving viewer avatars) are used to change the viewer avatar from a full avatar to a simple avatar. However, the present invention is not limited to this. As a modification 3-8, different threshold values may be used when generating a viewer perspective video and when generating a virtual camera perspective video to change the viewer avatar from a full avatar to a simple avatar. For example, as shown in FIG. 13, when generating a virtual camera C1 video, since almost only the performer avatar is drawn, which is different from the cases of generating virtual camera C2 video, virtual camera C3 video, virtual camera C4 video, and each viewer perspective video, while setting a high threshold value for the number of participants and the threshold value for the number of moving viewer avatars, in the virtual camera C2 video, virtual camera C3 video, virtual camera C4 video, and each viewer perspective video, since each viewer avatar is also actively displayed in addition to the performer avatar, the threshold value for the number of participants and the threshold value for the number of moving viewer avatars may be set high.

[0377] Also, even in the case of a viewer perspective video, when the line of sight of the viewer avatar is not directed at the virtual stage G, since it is more difficult to draw the performer avatar as a viewer perspective video than when the line of sight of the viewer avatar is directed at the virtual stage G, the drawing processing load due to drawing the performer avatar is less likely to increase. Therefore, the threshold value for the number of participants and the threshold value for the number of moving viewer avatars may be set higher than when the line of sight of the viewer avatar is directed at the virtual stage G.

[0378] In addition, in the third embodiment, as an example, in accordance with the increase in the drawing processing load of the viewer terminal 300, the viewer avatars of viewers who are not friend-registered, the viewer avatars of viewers who are friend-registered, and the viewer avatar of oneself are changed to simple avatars in this order. However, the present invention is not limited to this. As a modification 3-9, each time the drawing processing load of the viewer terminal 300 increases, the viewer avatars may be changed to simple avatars in order from the viewer avatars that are far from one's own viewer avatar.

Example

[0379] Next, the virtual space content distribution system of Example 4 will be described below with reference to FIGS. 55 to 60. Regarding the same configurations as those in Examples 1 and 2, the same reference numerals will be used and the description will be omitted.

[0380] As shown in FIGS. 55 and 56, the virtual space content distribution system of Example 4 is provided with, as viewer avatars, full avatars having different appearances for each corresponding viewer user (viewer terminal 300) in order to have a relatively large rendering processing load and to be able to identify each viewer avatar, and simple avatars having a smaller rendering processing load than these full avatars. Also, as performer avatars, two types of full avatars corresponding to Performer A and full avatars corresponding to Performer B are provided, and no simple avatars are provided for these performer avatars of Performer A and Performer B. Note that the full avatars as performer avatars also have a larger rendering processing load than the full avatars as viewer avatars.

[0381] In the virtual live performed in the virtual space content distribution system of this Example 4, as in Examples 1 and 2, it proceeds in the order of "period during which participation in the live virtual space is possible", "pre-opening explanation", and "opening performance". After the "opening performance", it proceeds as "First MC" → "First act" → "Second MC" → "Second act" → "Third MC" → "Third act".

[0382] Among these, in the "First MC", the performer avatar of Performer A gives a talk or introduces the first act alone, in the "Second MC", the performer avatar of Performer B gives a talk or introduces the second act alone, and in the "Third MC", the performer avatars of Performer A and Performer B give a talk or introduce the third act together. Also, the "First act" is an act in which the performer avatar of Performer A sings or dances alone, the "Second act" is an act in which the performer avatar of Performer B sings or dances alone. Also, the "Third act" is an act in which Performer A and Performer B sing or dance together.

[0383] In the progress of such a virtual live show, in the fourth embodiment, during the "Live Virtual Space Participable Period", the "Pre-show Explanation" period, and the "Opening Performance" period, where the load of rendering processing in the entire virtual space content distribution system is relatively low due to reasons such as a small number of viewer avatars participating in the virtual live show, no light emission effects associated with the virtual live show being performed, or the performer avatar not appearing on the virtual stage G, the viewer avatars are displayed (rendered) as full avatars. On the other hand, after the first MC period when the performer avatar appears, the viewer avatars are displayed (rendered) as simple avatars.

[0384] More specifically, as shown in FIGS. 55 and 56, during the "First MC" where the performer avatar of Performer A conducts a talk or the like alone and the "First Act" where the performer avatar of Performer A sings or dances alone, the viewer avatars are displayed as simple avatars in a display mode corresponding to the performer avatar of Performer A (the heart-shaped mode α shown in FIG. 56(B)). During the "Second MC" where the performer avatar of Performer B conducts a talk or the like alone and the "Second Act" where the performer avatar of Performer B sings or dances alone, the viewer avatars are displayed as simple avatars in a display mode corresponding to the performer avatar of Performer B (the star-shaped mode β shown in FIG. 56(B)). During the "Third MC" where the performer avatars of Performer A and Performer B conduct a talk or the like together and the "Third Act" where they sing or dance together, the viewer avatars are displayed as simple avatars in a display mode different from the above-described mode α and mode β (the mode γ shown in FIG. 56(B), which is a shape combining a cone and a sphere).

[0385] That is, in the fourth embodiment, when the state of the performer avatar of Performer A singing or dancing alone is displayed on each viewer terminal 300, each viewer avatar is displayed as a simple avatar in mode α. When the state of the performer avatar of Performer B singing or dancing alone is displayed on each viewer terminal 300, each viewer avatar is displayed as a simple avatar in mode β. When the state of the performer avatar of Performer A and the performer avatar of Performer B singing or dancing together is displayed on each viewer terminal 300, each viewer avatar is displayed as a simple avatar in mode γ.

[0386] Also, in the virtual space content distribution system of the fourth embodiment, as shown in FIG. 57, by operating their viewer terminal 300, viewer users can make the viewer avatar wear items such as chemiluminescent lights (chemical lights), hats, and shirts that the viewer users have purchased in advance. Details will be described later, but these items will all be displayed in a state of being worn by the viewer avatar when the viewer avatar is a full avatar, but the display position and display mode may change when the viewer avatar is a simple avatar.

[0387] When making the viewer avatar wear each item, as shown in FIG. 58, during the period when participation in the live virtual space is possible, the viewer terminal 300 executes a purchased item data request information transmission process for requesting item data purchased in advance to the distribution server computer 100. Note that the purchased item data request information includes the ID of the viewer user (viewer user ID) who operates the viewer terminal 300.

[0388] When the distribution server computer 100 receives the purchased item data request information, it refers to the viewer user data (see FIG. 9) based on the viewer user ID included in the purchased item data request information, and executes a purchased item data identification process for identifying the purchased items (purchased items). Then, it executes a purchased item data transmission process for transmitting the information of the identified purchased item data (purchased item data information) to the viewer terminal 300.

[0389] When the viewer terminal 300 receives the purchased item data information, it executes a purchased item display process for displaying the purchased items on the display device 310 based on the received purchased item data. Then, as shown in FIG. 57, it executes a purchased item selection operation reception process for receiving a selection operation from the viewer user in a state where the purchased items are displayed on the display device 310. At this time, the item selected by the operation of the viewer user is worn by the viewer avatar.

[0390] FIG. 59 is a flowchart showing the viewer perspective video generation process in the fourth embodiment. In the fourth embodiment, the video generated in the viewer perspective video generation process described below is displayed on the viewer terminal 300, so that the first act by the actor avatar of actor A, the second act by the actor avatar of actor B, and the third act by the actor avatars of both actor A and actor B are output. In the viewer perspective video generation process, the viewer terminal 300 first generates the video of the actor avatar as a full avatar (step S501), and determines whether it is currently during the live virtual space participation period, the pre-opening explanation period, or the opening performance period (step S502).

[0391] If it is any of the live virtual space participation period, the pre-opening explanation period, or the opening performance period (step S502; Yes), the video of each viewer avatar is generated as a full avatar (step S503). Also, the video of the chemiluminescent light is generated in a manner corresponding to each full avatar (step S504), and the videos of the shirt and hat are generated in a manner corresponding to each full avatar (step S505).

[0392] On the other hand, if it is not any of the live virtual space participation period, the pre-opening explanation period, or the opening performance period (step S502; Yes), the viewer terminal 300 determines whether it is during the first MC period or the first act period (step S506). If it is during the first MC period or the first act period (step S506; Yes), the video of each viewer avatar is generated as a simple avatar (mode α) corresponding to actor A (step S507). If it is neither during the first MC period nor the first act period (step S506; No), it further determines whether it is during the second MC period or the second act period (step S508).

[0393] If it is during the second MC period or during the second act period (step S508; Yes), the video of each viewer avatar is generated in a simple avatar (mode β) according to the performer B (step S509). If it is neither during the second MC period nor during the second act period (step S508; No), the video of each viewer avatar is generated in an intermediate avatar (mode γ) according to the fact that it is during the third MC period or during the third act period (step S510).

[0394] After executing any one of the processes of step S507, step S509, and step S510, the viewer terminal 300 generates the video of the chemiluminescent light at the position corresponding to each simple avatar in a mode corresponding to the full avatar (step S511), and generates the videos of the shirt and the hat in a mode corresponding to each simple avatar.

[0395] After executing the process of step S505 or step S512, the viewer terminal 300 executes a process for generating other viewer perspective videos (step S513), and ends the viewer perspective video generation process.

[0396] Here, the positions and display modes of each item when the viewer avatar is a full avatar and when it is a simple avatar will be described. As shown in FIG. 60, when the viewer avatar is a full avatar, the viewer avatar is displayed while holding the chemiluminescent light in one arm, wearing a hat, and wearing a shirt.

[0397] On the other hand, when the viewer avatar is a simple avatar, the vertical length of these simple avatars is shorter than that of the full avatar, so the positions of the chemiluminescent light and the hat are arranged lower than those in the case of the full avatar. Note that the size of the chemiluminescent light does not change from when it is a full avatar, but the size of the hat is smaller than that when it is a full avatar according to the size of the head of the simple avatar.

[0398] In addition, as shown in FIG. 60, in modes α and β of the simple avatar, since they have arms, they are shown holding the chemiluminescent light in one arm. However, in mode γ of the simple avatar, since it has no arms, the chemiluminescent light is shown floating on the side of the head.

[0399] Also, since the simple avatar is set to be shorter than the full avatar in any of modes α to γ, the shirt is not displayed.

[0400] As described above, in the present Example 4, as shown in FIG. 60, even if the viewer avatar is changed from the full avatar to the simple avatar, the mode of the chemiluminescent light itself is common, so that it is possible to prevent a decrease in the interest in the virtual live by using the simple avatar as the viewer avatar.

[0401] Also, as shown in FIG. 60, in the present Example 4, for items such as hats and shirts that the viewer avatar can wear, when the viewer avatar changes from the full avatar to the simple avatar, these items change corresponding to the mode of the simple avatar (the size of the hat becomes smaller and the shirt is not displayed), so that it is possible to prevent the wearing of these items from becoming inappropriate for the simple avatar.

[0402] Also, for the chemiluminescent light that the viewer avatar can wear, since the position is different when the viewer avatar is the full avatar and when it is the simple avatar, it is possible to prevent a decrease in the interest in the virtual live due to the chemiluminescent light not being held at an appropriate position according to the simple avatar.

[0403] In addition, in the fourth embodiment, as a simple avatar of the viewer avatar, by providing Mode α when the performer avatar performing the program on the virtual stage G is the performer avatar of performer A and Mode β when the performer avatar performing the program on the virtual stage G is the performer avatar of performer B, while reducing the processing load related to display by making the viewer avatar a simple avatar from a full avatar, it is possible to give a change to the virtual live by making the modes of the simple avatar different between the case where the performer avatar performing the program on the virtual stage G is the performer avatar of performer A and the case where it is the performer avatar of performer B, and it is possible to prevent a decrease in interest due to the virtual live becoming monotonous.

[0404] In addition, in the fourth embodiment, when the state of the performer avatar of performer A performing the program is being displayed on the viewer terminal 300, the simple avatar of Mode α as the viewer avatar is displayed, and when the state of the performer avatar of performer B performing the program is being displayed on the viewer terminal 300, the simple avatar of Mode β as the viewer avatar is displayed. Therefore, while realizing a reduction in the processing load related to display by making the viewer avatar a simple avatar, it is possible to prevent the interest in the virtual live from decreasing because the mode of the simple avatar is made common regardless of the performer avatar.

[0405] In addition, in the fourth embodiment, during the "Third Program" in which the performer avatar of performer A and the performer avatar of performer B jointly perform singing or dancing on the virtual stage G, corresponding to the fact that the performer avatar of performer A and the performer avatar of performer B jointly perform singing or dancing, the viewer avatar is displayed as a simple avatar of Mode γ different from Mode α corresponding to the period of the "First Program" in which the performer avatar of performer A performs singing or dancing alone and Mode β corresponding to the period of the "Second Program" in which the performer avatar of performer B performs singing or dancing alone. By doing so, it is possible to give a change to the virtual live and improve the interest in the "Third Program", which is a joint program in which the performer avatar of performer A and the performer avatar of performer B jointly perform singing or dancing on the virtual stage G.

[0406] In addition, in the fourth embodiment, during the "first act" in which the performer avatar of the viewer avatar performs singing or dancing alone as the performer avatar of performer A, the performer avatar is displayed as a simple avatar in mode α corresponding to the performer avatar of performer A. During the "second act" in which the performer avatar of performer B performs singing or dancing alone as the viewer avatar, the performer avatar is displayed as a simple avatar in mode β corresponding to the performer avatar of performer B. Therefore, it is possible to prevent a decrease in the interest in the virtual live that partially includes the acts of a plurality of performer avatars.

[0407] In addition, as shown in FIG. 55, in the fourth embodiment, since each viewer avatar changes from a full avatar to a simple avatar at a common timing (the start timing of the period of "first MC"), it is possible to prevent giving a sense of inequality to the viewer users due to each viewer avatar changing from a full avatar to a simple avatar at different timings.

[0408] In addition, as shown in FIG. 56(A), while the performer avatar is provided with a full avatar and not provided with a simple avatar, the performer avatar does not change to a simple avatar at the timing when each viewer avatar changes from a full avatar to a simple avatar. It is possible to prevent a decrease in the interest in the virtual live due to the performer avatar changing to a simple avatar.

[0409] <Modification Example of Embodiment 4> Furthermore, in the fourth embodiment, a plurality of performer avatars (the performer avatar of performer A and the performer avatar of performer B) are provided, and while the mode of the viewer avatar is varied according to the performer avatar performing the act on the virtual stage G, the display mode of some items (chemiluminescent in the fourth embodiment) displayed with the viewer avatar is common regardless of the performer avatar performing the act on the virtual stage G. However, the present invention is not limited to this. As a modification 4-1, the display mode of the chemiluminescent may be varied according to the performer avatar performing the act on the virtual stage G. For example, as shown in FIG. 61, when the performer avatar of performer A performs the act on the virtual stage G, the color (emission color) of the chemiluminescent may be set to red, and when the performer avatar of performer B performs the act on the virtual stage G, the color (emission color) of the chemiluminescent may be set to blue.

[0410] By doing so, it is possible to change the virtual live according to the mode of the chemiluminescent when the performer avatar performing the act on the virtual stage G is the performer avatar of performer A and when it is the performer avatar of performer B, and it is possible to prevent a decrease in interest due to the virtual live becoming monotonous.

[0411] Also, as shown in FIG. 61, when varying the display mode of the chemiluminescent according to the performer avatar performing the act on the virtual stage G, the mode (color in the example shown in FIG. 61) of items other than the chemiluminescent such as a hat may also be varied according to the performer avatar performing the act on the virtual stage G. By doing so, it is possible to change the virtual live according to the mode of the hat when the performer avatar performing the act on the virtual stage G is the performer avatar of performer A and when it is the performer avatar of performer B, and it is possible to prevent a decrease in interest due to the virtual live becoming monotonous.

[0412] Furthermore, in this modification 4-1, the form of varying the color of the item according to the performer avatar performing the act on the virtual stage G is exemplified. However, the present invention is not limited to this, and the size or shape of the item may be varied according to the performer avatar performing the act on the virtual stage G.

[0413] Also, in the above-described Example 4, when the viewer avatar is a full avatar or a simple avatar of Mode α or Mode β, a form in which a chemiluminescent light is held by the arm of these viewer avatars was exemplified. However, as shown in FIGS. 62(A) to 62(C) as Modification 4-2, for these full avatars or simple avatars of Mode α or Mode β, by causing the viewer to execute an operation of swinging the arm left and right by operating the viewer terminal 300, the chemiluminescent light may be made to follow these arms and be operable. Incidentally, when the viewer avatar is a simple avatar of Mode γ, as shown in FIG. 62(D), since the simple avatar does not have arms, only the chemiluminescent light may be made to operate by operating the viewer terminal 300 by the viewer. By doing so, it is possible to prevent the reduction effect of the processing load (for example, the drawing processing load) related to the display by making the viewer avatar a simple avatar of Mode γ from being impaired by the operation of the arm.

[0414] Also, in the above-described Example 4, a form in which a full avatar and a simple avatar are provided for the viewer avatar as the virtual space content distribution system of the present invention was exemplified. However, the present invention is not limited to this, and as the virtual space content distribution system of the present invention, a friend registration function that allows a specific viewer user to register another viewer user as his / her friend may be provided.

[0415] As such a friend registration function, as shown in FIG. 63 as Modification 4-3, in the viewer terminal 300, during the period in which participation in the live virtual space is possible, a viewer avatar selection process is executed to select a specific viewer avatar from among a plurality of viewer avatars by receiving an operation of the operation input device 321 of the viewer. The file name (viewer avatar file name) of the selected viewer avatar is specified, and a viewer avatar inquiry process for transmitting viewer avatar inquiry information including the specified viewer avatar file name to the distribution server computer 100 is executed.

[0416] When the distribution server computer 100 receives viewer avatar inquiry information from the viewer terminal 300, it executes a viewer avatar identification process to identify the viewer user ID associated with the viewer avatar file name included in the viewer avatar inquiry information from the viewer user data shown in FIG. 9. Then, the distribution server computer 100 transmits viewer user ID information including the viewer user ID to the viewer terminal 300 that has transmitted the viewer avatar inquiry information.

[0417] When the viewer terminal 300 receives the viewer user ID information, it executes a friend addition operation process that prompts an operation to register, as a friend, the viewer user (viewer user ID) of the viewer avatar selected by the viewer in the display device 310 in association with the viewer avatar file name.

[0418] At this time, when an operation to register a friend is performed by the viewer, a friend addition process is executed to store the viewer user ID and the viewer avatar file name in association with each other in the friend user data table. When an operation to register a friend is not performed, the viewer terminal 300 executes a friend addition cancellation process that displays a message indicating that friend registration is not performed on the display device 310.

[0419] In addition, in this modification example 4-3, a friend user data table (see FIG. 64) for storing the user ID of the viewer user and the avatar data is created in advance in the storage 303 of the viewer terminal 300. When executing the friend addition process, the viewer user ID and the viewer avatar file name may be additionally stored in association with each other by updating the friend user data table.

[0420] Regarding the case of providing the friend registration function as described above, as shown in FIG. 65, the color of the simple avatar of the viewer user who has registered a friend may be made different from the simple avatars of other viewer users who have not registered a friend, so that it is possible to easily recognize which simple avatar is the simple avatar of the viewer user who has registered a friend.

[0421] Further, in the fourth modification 4-3, by changing the color of the simple avatar according to whether the viewer user is a friend-registered viewer user or not, an example of a form that enables easy recognition of which simple avatar is the simple avatar of the friend-registered viewer user is illustrated. However, the present invention is not limited to this. By changing the shape of the simple avatar according to whether the viewer user is a friend-registered viewer user or not, it may be possible to easily recognize which simple avatar is the simple avatar of the friend-registered viewer user. Also, for the simple avatar of the friend-registered viewer user, it may be possible to easily recognize which simple avatar is the simple avatar of the friend-registered viewer user by adding an object that follows the simple avatar.

[0422] Also, in the fourth embodiment, during the "third performance" in which the performer avatar of performer A and the performer avatar of performer B jointly sing and dance on the virtual stage G, in correspondence with the fact that the performer avatar of performer A and the performer avatar of performer B jointly sing and dance, an example of a form in which the viewer avatar is displayed as a simple avatar in mode γ is illustrated. However, the present invention is not limited to this. As shown in FIG. 66 as a modification 4-4, during the "third performance" in which the performer avatar of performer A and the performer avatar of performer B jointly sing and dance on the virtual stage G, on the viewer terminal 300, the viewer user may be able to select an operation to display his or her viewer avatar as either the simple avatar in mode α corresponding to the performer avatar of performer A or the simple avatar in mode β corresponding to the performer avatar of performer B. By doing so, during the "third performance" in which the performer avatar of performer A and the performer avatar of performer B jointly sing and dance on the virtual stage G, it becomes possible to select the simple avatar according to the viewer user's preference. Therefore, the interest of the "third performance", which is a joint performance in which the performer avatar of performer A and the performer avatar of performer B jointly sing and dance on the virtual stage G, can be improved.

[0423] Also, in the fourth embodiment, during the "first act" in which the performer avatar of performer A performs singing or dancing alone on the virtual stage G, the viewer avatar is displayed as a simple avatar in mode α in the shape of a heart, and during the "second act" in which the performer avatar of performer B performs singing or dancing alone on the virtual stage G, the viewer avatar is displayed as a simple avatar in mode β in the shape of a star. However, the present invention is not limited to this, and the simple avatars in mode α and mode β may include elements corresponding to the attributes of the corresponding performer avatars. For example, as shown in FIG. 67 as Modification 4-5, by attaching a heart-shaped hair ornament to the performer avatar of performer A, the simple avatar in mode α is an avatar including the element of the heart-shaped hair ornament worn by the performer avatar of performer A, and by attaching a star-shaped hair ornament to the performer avatar of performer B, the simple avatar in mode β may be an avatar including the element of the star-shaped hair ornament worn by the performer avatar of performer B. By doing so, it becomes intuitively easy for the viewer user to understand which performer avatar the simple avatars in mode α and mode β correspond to, and it is possible to prevent the interest in the virtual live performance from decreasing due to the difficulty in understanding which performer avatar the mode of the simple avatar as the viewer avatar corresponds to.

[0424] In addition, in this Modification 4-5, by making the shape of the simple avatar as the viewer avatar the same as the shape of the hair ornament worn by the performer avatars of performer A and performer B, an example is given of a form that makes it easy for the viewer user to understand which performer avatar the corresponding simple avatar is. However, the present invention is not limited to this, and by making the color, pattern, etc. of the simple avatar as the viewer avatar the same as at least a part of the performer avatars of performer A and performer B, it may be made easy for the viewer user to understand which performer avatar the corresponding simple avatar is.

[0425] In the fourth embodiment, when the performer avatar of performer A performs singing or dancing alone on the virtual stage G, a simple avatar in mode α is displayed as the viewer avatar, and when the performer avatar of performer B performs singing or dancing alone on the virtual stage G, a simple avatar in mode β is displayed as the viewer avatar. However, the present invention is not limited to this. As shown in FIG. 68 as Modification Example 4-6, when the performer avatar of performer A performs singing or dancing alone in the first virtual live venue and the performer avatar of performer B performs singing or dancing alone in a second virtual live venue different from the first virtual live venue, the mode of the simple avatar as the viewer avatar participating in the first virtual live venue and the mode of the simple avatar as the viewer avatar participating in the second virtual live venue may be different. By doing so, the mode of the simple avatar can be varied depending on the virtual live venue in which the viewer avatar participates, and it is possible to prevent the interest in the virtual live from decreasing.

[0426] In the fourth embodiment, a form in which the viewer avatar is displayed as a simple avatar during the periods of "First MC", "First Performance", "Second MC", "Second Performance", "Third MC", and "Third Performance" is exemplified. However, the present invention is not limited to this. In a part of the periods of "First MC", "First Performance", "Second MC", "Second Performance", "Third MC", and "Third Performance", as Modification Example 4-7, a period in which the viewer avatar is displayed as a full avatar may be provided.

[0427] In particular, when the viewer avatar is displayed as a full avatar in a part of the periods of "First Performance", "Second Performance", and "Third Performance", for a specific viewer avatar, the mode of the full avatar during the periods of "First Performance", "Second Performance", and "Third Performance" may be common. By doing so, since the mode of the full avatar, which has a large processing load for display, is common regardless of the performer performing on the virtual stage G, an increase in the processing load and an increase in the display data can be prevented.

Embodiment

[0428] Next, the virtual space content distribution system of Example 5 will be described below with reference to FIGS. 69 to 79. For the same configurations as those in Examples 1 and 2, the same reference numerals will be used and the description will be omitted.

[0429] As shown in FIGS. 69 and 70, in the virtual space content distribution system of Example 5, as viewer avatars, a full avatar having a different appearance for each viewer user (viewer terminal 300) for which the processing load (rendering processing load) for display is relatively large and each viewer avatar can be identified, and a simple avatar having a smaller rendering processing load than these full avatars are used.

[0430] In the virtual live implemented in the virtual space content distribution system of this Example 5, as in Examples 1 and 2, it proceeds in the order of "live virtual space participation period", "pre-opening explanation", and "opening performance". After the "opening performance", it proceeds as "First MC" → "First act" → "Second MC" → "Second act" → "Third MC" → "Third act".

[0431] For "First MC", "Second MC", and "Third MC", the performer avatar 1 who appears on the virtual stage G greets the viewer users by talking and introduces the next act to be performed. "First act", "Second act", and "Third act" are acts including the singing and dancing of the performer avatar (performer).

[0432] In such a virtual live progression, in this Example 5, first, during the live virtual space participation period, each viewer user can operate the viewer terminal 300 to participate in the virtual live with the viewer avatar corresponding to the viewer terminal 300 as a full avatar. Then, from the start timing of the period of "First MC", each viewer terminal 300 can reduce the processing load for displaying the viewer avatar by changing the viewer avatar, which has been a full avatar until then, to a simple avatar.

[0433] Particularly in Example 5, as shown in FIG. 75, the available period for participating in the live virtual space is a period during which the viewer user can specify a simplification target area, which is an area (simplification target area) where the viewer avatar changes from a full avatar to a simple avatar by operating the viewer terminal 300, and can be selected from the third area and the fourth area of the virtual audience area. If the viewer user does not specify a simplification target area during the available period for participating in the live virtual space in Example 5, both the third area and the fourth area are non-simplification target areas, and the viewer avatar will not be displayed as a simple avatar.

[0434] Hereinafter, a series of processes for selecting an area (simplification target area) where the viewer avatar changes from a full avatar to a simple avatar from the third area and the fourth area of the virtual audience area will be described based on FIGS. 71 to 79.

[0435] As shown in FIG. 71, during the available period for participating in the live virtual space, the viewer terminal 300 that has allowed the viewer avatar to participate in the virtual live venue first executes a simplification target area designation operation process for receiving an operation from the viewer user on which area to set as the area where the viewer avatar changes from a full avatar to a simple avatar.

[0436] At this time, when the viewer terminal 300 receives an operation from the viewer user, it transmits simplification target area information including the participant ID (viewer user ID) of the viewer user to the distribution server computer 100.

[0437] When the distribution server computer 100 receives the simplification target area information from the viewer terminal 300, it specifies the participant ID (viewer user ID) and which area is to be the simplification target area from the simplification target area information, and as shown in FIG. 72, executes a participant user table update process for associating the data of the specified simplification target area with the participant ID and storing it in the participant user table.

[0438] In addition, the distribution server computer 100 executes a participant user table update completion information transmission process of transmitting participant user table update completion information to the viewer terminal 300 based on having executed the participant user table update process. Then, based on having received the participant user table update completion information, the viewer terminal 300 executes a participant user table update completion notification process of notifying, on the display device 310, that the update of the participant user table has been completed, that is, that the registration of which of the third area and the fourth area is to be the simplification target area has been completed in the viewer terminal 300.

[0439] In this way, by the viewer terminal 300 and the distribution server computer 100 executing the series of processes shown in FIG. 71, the viewer terminal 300 can set the simplification target area, and on the side of the distribution server computer 100, it is possible to grasp which of the third area and the fourth area the viewer terminal 300 has set as the simplification target area.

[0440] In addition, the virtual space content distribution system in the fifth embodiment includes a friend registration function that allows a viewer user to register another viewer user as a friend by operating the viewer terminal 300.

[0441] As such a friend registration function, as shown in FIG. 73, in the viewer terminal 300, during the period in which participation in the live virtual space is possible, a viewer avatar selection process of selecting a specific viewer avatar from among a plurality of viewer avatars is executed by receiving an operation of the operation input device 321 of the viewer, the file name (viewer avatar file name) of the selected viewer avatar is specified, and a viewer avatar inquiry process for transmitting viewer avatar inquiry information including the specified viewer avatar file name to the distribution server computer 100 is executed.

[0442] When the distribution server computer 100 receives viewer avatar inquiry information from the viewer terminal 300, it executes a viewer avatar identification process to identify the viewer user ID associated with the viewer avatar file name included in the viewer avatar inquiry information from the viewer user data shown in FIG. 9. Then, the distribution server computer 100 transmits viewer user ID information including the viewer user ID to the viewer terminal 300 that has transmitted the viewer avatar inquiry information.

[0443] When the viewer terminal 300 receives the viewer user ID information, it executes a friend addition operation process that prompts an operation to register, as a friend, the viewer user (viewer user ID) of the viewer avatar selected by the viewer in the display device 310 in association with the viewer avatar file name.

[0444] At this time, when an operation to register a friend is performed by the viewer, the viewer terminal 300 executes a friend addition process to store the viewer user ID and the viewer avatar file name in association with each other in the friend user data table. Also, when an operation to register a friend is not performed, the viewer terminal 300 executes a friend addition cancellation process to perform a display indicating that no friend registration is performed in the display device 310.

[0445] In addition, in the fifth embodiment, a friend user data table (see FIG. 74) for storing the user ID of the viewer user and the avatar data is created in advance in the storage 303 of the viewer terminal 300, and when executing the friend addition process, the viewer user ID and the viewer avatar file name may be additionally stored in association with each other by updating the friend user data table.

[0446] FIG. 76 is a flowchart showing the simplified target area designation operation process shown in FIG. 71. In the simplified target area designation operation process, the viewer terminal 300 first executes a simplified target area designation operation process for receiving from the viewer user an operation as to whether to set either the third area or the fourth area of the virtual audience area as the simplified target area (step S801).

[0447] In addition, as shown in FIGS. 77(A) and 77(B), on the display device 310 during the execution of the simplified target area designation operation process, a window menu 310WA for the viewer user to designate the simplified target area is displayed. As the window menu 310WA, items of "third area" and "fourth area" that can be designated as the simplified target area are arranged, and below these items, check boxes for selecting whether to preferentially display friends in the simplified target area in full avatar are arranged.

[0448] Returning to FIG. 76, it is determined whether there is a third area designation operation for setting the third area as the simplified target area in the simplified target area designation operation process (step S802). If there is a third area designation operation (step S802; Yes), the third area is stored as the simplified target area (step S803).

[0449] Also, when there is no third area designation operation (step S802; No), or after the viewer terminal 300 executes the process of step S803, it is determined whether there is a fourth area designation operation for setting the fourth area as the simplified target area in the simplified target area designation operation process (step S804). If there is a fourth area designation operation (step S804; Yes), the fourth area is stored as the simplified target area (step S805).

[0450] Then, when there is no fourth area designation operation (step S804; No), or after the viewer terminal 300 executes the process of step S805, the viewer terminal 300 transmits simplified target area information corresponding to the area stored as the simplified target area to the distribution server computer 100 (step S806).

[0451] Also, the viewer terminal 300 determines whether there is a full avatar priority display operation for a friend in the simplified target area designation operation process, that is, as shown in FIG. 77(B), whether a check box arranged at the lower part of the window menu 310WA is checked by the operation of the viewer user (step S807). When there is a full avatar priority display operation (step S807; Yes), a friend full avatar priority display flag indicating that the viewer avatars of friends arranged in the simplified target area are to be displayed in full avatars is set, and the simplified target area designation operation process is terminated (step S808).

[0452] Also, when there is no full avatar priority display operation (step S807; No), the viewer terminal 300 determines whether the friend full avatar priority display flag has already been set (step S809). When the friend full avatar priority display flag is not set (step S809; No), the simplified target area designation operation process is terminated. When the friend full avatar priority display flag is set (step S809; Yes), it is further determined whether a cancellation operation of the full avatar priority display has been executed, that is, whether the check has been removed from the check box arranged at the lower part of the window menu 310WA by the operation of the viewer user (step S810).

[0453] When the cancellation operation of the full avatar priority display has not been executed (step S810; No), the simplified target area designation operation process is terminated. When the cancellation operation of the full avatar priority display has been executed (step S810; Yes), the friend full avatar priority display flag is cleared, and the simplified target area designation operation process is terminated (step S811).

[0454] FIG. 78 is a flowchart showing the viewer perspective video generation process executed by the viewer terminal 300 in the fifth embodiment. In the viewer perspective video generation process, the viewer terminal 300 first generates the video of the performer avatar as a full avatar (step S501), and determines whether it is after the start timing of the period of the first MC in the virtual live (step S502). If it is before the start timing of the period of the first MC in the virtual live (step S502; No), the viewer terminal 300 generates the videos of the viewer avatars of both the registered friend viewer users and the unregistered other viewer users as full avatars, and ends the viewer perspective video generation process (step S503).

[0455] Also, if it is after the start timing of the period of the first MC in the virtual live (step S502; Yes), the viewer terminal 300 further determines whether a friend viewer avatar identification completed flag indicating that the viewer avatar of the registered friend viewer user has already been identified in the viewer perspective video generation process is set (step S504).

[0456] If the friend viewer avatar identification completed flag is not set (step S504; No), the viewer terminal 300 refers to the friend user data table shown in FIG. 74, identifies and stores the file name of the friend viewer avatar data (step S505), and sets the friend viewer avatar identified flag (step S506).

[0457] Also, when the friend viewer avatar identification completed flag is set (step S504; Yes) or after the execution of the process in step S506, the viewer terminal 300 identifies the simplification target area stored in the simplification target area designation operation process of FIG. 76 (step S507), and generates the videos of all viewer avatars outside the identified simplification target area as full avatars (step S508).

[0458] Next, the viewer terminal 300 generates, using a simplified avatar, the video of another viewer avatar (viewer avatar of a viewer who is not friend-registered) in the area to be simplified (step S509), and generates, using a full avatar, the video of the viewer avatar of a friend outside the area to be simplified (step S510). Further, the viewer terminal 300 determines whether or not a friend full avatar priority display flag is set (step S511).

[0459] If the friend full avatar priority display flag is set (step S511; Yes), the viewer terminal 300 generates, using a full avatar, the viewer avatar of a friend in the area to be simplified and executes the process of step S514 (step S512). If the friend full avatar priority display flag is not set (step S511; No), the viewer terminal 300 generates, using a simplified avatar, the video of the viewer avatar of a friend in the area to be simplified and executes the process of step S514 (step S513).

[0460] By executing the viewer viewpoint video generation process as described above, in the fifth embodiment, as shown in FIG. 79(A), when comparing the modes of the respective viewer avatars generated in the viewer viewpoint video generation process when the friend full avatar priority display flag is not set, at a timing before the start of the first MC period, for the viewer avatars arranged in either the area to be simplified or the area outside the area to be simplified, regardless of whether or not they are the viewer avatars of friend-registered viewer users, all are displayed as full avatars.

[0461] On the other hand, at a timing after the start of the second MC period, for the viewer avatars arranged in the area to be simplified, all are displayed as simplified avatars regardless of whether or not they are the viewer avatars of friend-registered viewer users, while for the viewer avatars arranged in the area outside the area to be simplified, all are displayed as full avatars regardless of whether or not they are the viewer avatars of friend-registered viewer users.

[0462] Also, as shown in FIG. 79(B), when comparing the modes of each viewer avatar generated in the viewer perspective video generation process with the friendly avatar priority display flag set, at a timing before the start of the first MC period, all viewer avatars placed in either the simplification target area or the non-simplification target area are displayed as full avatars regardless of whether they are the viewer avatars of friend-registered viewer users or not.

[0463] On the other hand, at a timing after the start of the second MC period, among the viewer avatars placed in the simplification target area, the viewer avatars of friend-registered viewer users are displayed as full avatars, and the viewer avatars of non-friend-registered viewer users are displayed as simple avatars. Also, all viewer avatars placed in the non-simplification target area are displayed as full avatars regardless of whether they are the viewer avatars of friend-registered viewer users or not.

[0464] As described above, in the virtual space content distribution system according to the fifth embodiment, by executing the simplification target area designation operation process shown in FIG. 76 and the viewer perspective video generation process shown in FIG. �8, the viewer user himself / herself can execute the setting regarding making the viewer avatar a simple avatar. As a result, since the intention of the viewer user can be reflected in the viewer avatar to be displayed as a simple avatar, it is possible to suppress a decrease in the interest of the virtual space live by making the processing load for displaying the viewer avatar a smaller simple avatar in order to suppress the occurrence of display output defects.

[0465] Also, in the virtual space content distribution system according to the fifth embodiment, by executing the simplified target area designation operation process shown in FIG. 76 and the viewer viewpoint video generation process shown in FIG. 78, the viewer user can operate the viewer terminal 300 to designate the simplified target area as the third area and the fourth area with the viewer avatar and the simplified avatar. Therefore, it is possible to further suppress the decrease in the interest of the virtual live due to the viewer avatar in the area not intended by the viewer user becoming a simplified avatar.

[0466] Also, in the virtual space content distribution system according to the fifth embodiment, as shown in FIGS. 73 and 74, other viewer users can be registered as one's own friends. As shown in FIG. 79, the viewer avatar of the viewer user who has become a friend can be set to be displayed as a full avatar even when participating in the simplified target area. Therefore, it becomes easier for the viewer avatar of the viewer user who is a friend to be displayed as a full avatar. When a plurality of viewer avatars participate in the virtual live, it is possible to make it easier to recognize the viewer avatar of the viewer user who is a friend and the viewer avatar of the viewer user who is not a friend.

[0467] Also, in the fifth embodiment, in addition to being able to set only one of the third area and the fourth area in the virtual audience area as the simplified target area by the viewer user operating the viewer terminal 300, by setting both the third area and the fourth area as the simplified target area, the processing load related to the display output can be reduced compared to the case of setting only one area as the simplified target area. Therefore, the level of the processing load related to the display output can be changed according to the situation.

[0468] <Modification Example of Embodiment 5> In addition, in the fifth embodiment, as shown in FIGS. 76 and 77, by executing the simplified target area designation operation process, it is possible to select whether or not to set the third area and the fourth area of the virtual audience area as the simplified target areas. However, the present invention is not limited to this. As a modification example 5-1, as shown in FIG. 80, among the viewer avatars participating in the virtual live, it may be possible to select, by the operation of the viewer user, which viewer avatars are to be simplified. Incidentally, when the number of viewer avatars to be simplified is selected in this way, with the selected number of viewer avatars as the upper limit, the viewer avatars close in position to the viewer avatars corresponding to the viewer terminal 300 may be displayed as simplified avatars in order from the closest one, or any viewer avatar within all the viewer avatars participating in the virtual live may be displayed as a simplified avatar.

[0469] By doing so, the viewer user can set the number of viewer avatars as simplified avatars by himself / herself, so that it is possible to further suppress a decrease in the interest of the virtual live due to an unintended number of viewer avatars becoming simplified avatars.

[0470] In addition, in the fifth embodiment, as shown in FIGS. 76 and 77, by executing the simplified target area designation operation process, it is possible to select whether or not to set the third area and the fourth area of the virtual audience area as the simplified target areas. However, the present invention is not limited to this. As a modification example 5-2, as shown in FIG. 81, it may be possible to select, by the selection operation of the viewer user, the ratio of the number of viewer avatars to be simplified avatars with respect to the number of viewer avatars participating in the virtual live. Incidentally, when the ratio of the viewer avatars to be simplified is selected in this way, with the selected ratio, the viewer avatars close in position to the viewer avatars corresponding to the viewer terminal 300 may be displayed as simplified avatars in order from the closest one, or any viewer avatar within all the viewer avatars participating in the virtual live may be displayed as a simplified avatar.

[0471] By doing so, the viewer user can set the ratio of the number of viewer avatars that are simple avatars to the number of viewer avatars participating in the virtual live, so that the decline in the interest of the virtual live due to a ratio of viewer avatars that are simple avatars that the viewer user does not intend can be further suppressed.

[0472] Also, in the fifth embodiment, as shown in FIG. 75, the live virtual space participation period is set as the area designation period for simplification target areas. When the viewer user does not set the simplification target area during the live virtual space participation period, both the third area and the fourth area of the virtual audience area are areas not subject to simplification, and no viewer avatars are displayed as simple avatars. However, the present invention is not limited to this. When the viewer user does not designate the simplification target area during the live virtual space participation period, the viewer terminal 300 may automatically and uniquely set both the third area and the fourth area of the virtual audience area as the simplification target areas at the end timing of the live virtual space participation period.

[0473] By doing so, both the third area and the fourth area of the virtual audience area can be automatically set as the simplification target areas, and the processing load related to the display output of the viewer avatars can be reduced compared to the case where only one of the third area and the fourth area is set as the simplification target area.

[0474] Furthermore, in this modified example 5-3, as shown in FIG. 84, only one of the third area and the fourth area of the virtual audience area can be set as the simplificatio...

Claims

1. A virtual space content distribution system capable of distributing virtual space content in a virtual space, a terminal capable of outputting an image of the virtual space content, the viewer user terminal being a terminal through which a viewer user can view the image, a server computer connected to the viewer user terminal via a communication network and capable of executing at least processing related to the virtual space and processing related to the distribution of the virtual space content, including at least, wherein there are a plurality of viewer users, and a viewer user terminal is assigned to each viewer user, the virtual space content may include a viewer avatar corresponding to the viewer user himself / herself by allowing the viewer user to participate in the virtual space targeted by the virtual space content using the viewer user terminal, the viewer avatar includes a first viewer avatar and a second viewer avatar having a smaller processing load for display output than the first viewer avatar, the viewer user himself / herself is provided with viewer avatar setting means capable of executing settings regarding setting the viewer avatar corresponding to another viewer user as the second viewer avatar, A virtual space content distribution system characterized by the above.

2. In the viewer avatar setting means, the viewer user can set an area in the virtual space as the second viewer avatar as a setting regarding setting the viewer avatar as the second viewer avatar, The virtual space content distribution system according to claim 1, characterized by the above.

3. In the viewer avatar setting means, the viewer user can set the number of viewer avatars to be the second viewer avatar as a setting regarding setting the viewer avatar as the second viewer avatar, The virtual space content distribution system according to claim 1 or 2, characterized by the above.

4. In the viewer avatar setting means, the viewer user can set the ratio of the number of viewer avatars to be the second viewer avatar to the number of viewer avatars participating in the virtual space, The virtual space content distribution system according to claim 1, characterized by the above.

5. It is provided with high relationship user registration means capable of registering another viewer user having a high relationship with the viewer user himself / herself as a high relationship user, In the viewer avatar setting means, the viewer user can set the viewer avatar of a viewer user not registered as the high-relationship user as the second viewer avatar preferentially. The virtual space content distribution system according to claim 1, characterized in that.

6. The setting for setting the viewer avatar as the second viewer avatar includes a first-stage setting and a second-stage setting with a smaller processing load related to display output than the first-stage setting. The virtual space content distribution system according to claim 1, characterized in that.

7. The setting in the viewer avatar setting means is executable during a specific period, When the setting in the viewer avatar setting means is not completed during the specific period, the second-stage setting is set. The virtual space content distribution system according to claim 6, characterized in that.

8. It is provided with processing ability specifying means capable of specifying the processing ability related to the display output of the viewer user terminal, The viewer avatar setting means can perform an operation setting in which the viewer user performs an operation and a non-operation setting in which the setting is performed based on the processing ability specified by the processing ability specifying means without the viewer user performing an operation, as the setting for setting the viewer avatar as the second viewer avatar. The virtual space content distribution system according to claim 1, characterized in that.

9. The viewer avatar setting means has an auxiliary function for assisting the setting operation for setting the viewer avatar as the second viewer avatar. The virtual space content distribution system according to claim 1, characterized in that.

10. The virtual space content is a video generated by the viewer user terminal, which is a viewer perspective video seen from the viewer avatar corresponding to the viewer user terminal, and a video generated by the server computer, which is a common perspective video seen from a predetermined position in the virtual space, including The viewer perspective video is a video reflecting the setting for setting the viewer avatar of each viewer user terminal as the second viewer avatar, The common perspective video is a video with all the viewer avatars set as the second viewer avatar. The virtual space content distribution system according to claim 1, characterized in that.

11. A virtual space content distribution program for distributing virtual space content in a virtual space, wherein the virtual space content is content including video that can be viewed by a viewer user on a viewer user terminal assigned to each of a plurality of viewer users, and it is possible to participate a viewer avatar corresponding to oneself in a virtual space targeted for the virtual space content by using the viewer user terminal connected via a communication network to a server computer capable of executing at least processing related to the virtual space and processing related to distribution of the virtual space content, and thus the viewer avatar may be included, the viewer avatar includes a first viewer avatar and a second viewer avatar having a smaller processing load for display output than the first viewer avatar, and includes viewer avatar setting processing in which the viewer user himself / herself can execute setting regarding making the viewer avatar corresponding to another viewer user the second viewer avatar characterized virtual space content distribution program.

12. A virtual space content distribution method for distributing virtual space content in a virtual space, wherein the virtual space content is content including video that can be viewed by a viewer user on a viewer user terminal assigned to each of a plurality of viewer users, and it is possible to participate a viewer avatar corresponding to oneself in a virtual space targeted for the virtual space content by using the viewer user terminal connected via a communication network to a server computer capable of executing at least processing related to the virtual space and processing related to distribution of the virtual space content, and thus the viewer avatar may be included, the viewer avatar includes a first viewer avatar and a second viewer avatar having a smaller processing load for display output than the first viewer avatar, and includes viewer avatar setting procedures in which the viewer user himself / herself can execute setting regarding making the viewer avatar corresponding to another viewer user the second viewer avatar characterized virtual space content distribution method.

Images