Virtual Space Content Delivery System, Virtual Space Content Delivery Program, and Virtual Space Content Delivery Method

Abstract

To provide a virtual space content distribution system that can prevent an excessive increase in processing load. 【Solution means】When a specific condition corresponding to the processing load related to the virtual space content in the virtual space content distribution system increasing to a predetermined specific magnitude is satisfied, a second viewer avatar with a small processing load for display is used as the viewer avatar, while when the specific condition is not satisfied, a first viewer avatar is used as the viewer avatar.

Description

Technical Field

[0001] The present invention relates to a virtual space content distribution system, a virtual space content distribution program, and a virtual space content distribution method capable of distributing virtual space content in a virtual space.

Background Art

[0002] Conventionally, while distributing the content of a character object (avatar) 10 operating in a virtual space, for a viewer user who views, in response to a request from the viewer user, the character object (avatar) of the distributor (performer) is placed as a viewer in the virtual space where the 10 is located. There is known a distribution system that enables virtual participation (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the system of Patent Document 1, along with the process of sequentially updating the data of the virtual space, processes such as drawing the virtual space and each character object (avatar) of the distributor (performer) and the viewer user to generate a video of the virtual space are required. However, an increase in the number of character objects of the distributor (performer) in the virtual space or an increase in the number of character objects of viewer users who virtually participate as viewers in the virtual space is not considered. Therefore, an increase in the number of character objects 10 participating in these virtual spaces causes an excessive increase in the processing load on the content distribution server 500 and the viewer terminal 300 constituting the distribution system, resulting in inconveniences such as viewers being unable to view the content well.

[0005] The present invention has been made paying attention to such problems, and an object thereof is to provide a virtual space content distribution system, a virtual space content distribution program, and a virtual space content distribution method capable of preventing an excessive increase in processing load.

Means for Solving the Problems

[0006] The virtual space content distribution system according to claim 1 is a virtual space content distribution system capable of distributing virtual space content (for example, virtual live) in a virtual space, a terminal capable of displaying the video of the virtual space content, which is a viewer user terminal (for example, viewer terminal 300) that can be viewed by a viewer user, a server computer (for example, distribution server computer 100) connected to the viewer user terminal via a communication network and capable of executing at least processing related to the virtual space and processing related to the distribution of the virtual space content, and at least includes wherein there are a plurality of viewer users, and a viewer user terminal is assigned to each viewer user (for example, as shown in FIG. 1, viewer terminal A300a is assigned to viewer user A, viewer terminal B300b is assigned to viewer user B, viewer terminal C300c... is assigned to viewer user C...), the virtual space content may include a viewer avatar corresponding to itself in a virtual space targeted by the virtual space content when the viewer user can participate in the virtual space with the viewer avatar using the viewer user terminal (for example, as shown in FIG. 32, the viewer avatars of each viewer are displayed to virtually participate in the virtual live venue on the viewer terminal 300), the viewer User terminal is capable of displaying a viewpoint video from the viewer avatar corresponding to the viewer user using the viewer User terminal, The viewer avatar includes a first viewer avatar (for example, a full avatar as the viewer avatar shown in FIG. 45(B)) and a second viewer avatar with a smaller processing load for display than the first viewer avatar (for example, a simple avatar as the viewer avatar shown in FIG. 45(B)). When a specific condition corresponding to an increase in the processing load related to the virtual space content in the virtual space content distribution system to a predetermined specific magnitude is satisfied, the second viewer avatar is used as the viewer avatar (for example, as shown in FIGS. 31, 41 to 43, 46 to 48, when the number of viewer avatars virtually participating in a virtual live venue exceeds a threshold number, when the number of moving viewer avatars among the viewer avatars virtually participating in a virtual live venue exceeds a threshold number, when the light emission intensity of a light emission effect increases, when the movement of a performer avatar becomes large (intense), when the number of performer avatars increases, based on the increase in the processing load of the distribution server computer 100 and the viewer terminal 300 due to the satisfaction of these conditions, the viewer terminal 300 executes the processes of steps S507 and S508 of the viewer viewpoint video generation process and steps S517, S521, and S522 of the virtual camera designated video generation process, and the display of the viewer avatar changes from a full avatar to a simple avatar). On the other hand, when the specific condition is not satisfied, the first viewer avatar is used as the viewer avatar (for example, as shown in FIGS. 31, 41 to 43, 46 to 48, when the number of viewer avatars virtually participating in a virtual live venue does not exceed a threshold number, when the number of moving viewer avatars among the viewer avatars virtually participating in a virtual live venue does not exceed a threshold number, when the light emission intensity of a light emission effect does not increase, when the movement of a performer avatar does not become large (intense), when the number of performer avatars does not increase, based on the fact that the processing load of the distribution server computer 100 and the viewer terminal 300 does not increase due to the non-satisfaction of these conditions, the viewer terminal 300 executes the processes of steps S503 and S506 of the viewer viewpoint video generation process and steps S513, S526, and S520 of the virtual camera designated video generation process, and the display of the viewer avatar does not change from a full avatar to a simple avatar). It is characterized by this. According to this feature, when a specific condition is met, a second viewer avatar with a lower processing load for display than the first viewer avatar is used, thus preventing an excessive increase in the processing load due to the fulfillment of the specific condition.

[0009] Claim 2 The virtual space content distribution system of is the virtual space content distribution system according to claim 1, wherein the specific condition is a processing load condition related to the number of viewer avatars participating in the virtual space (for example, as shown in FIGS. 47 and 48, a condition corresponding to an increase in the update processing load of the virtual space and the rendering processing load of the viewer avatars when the number of viewer avatars (number of live participants) virtually participating in a virtual live venue exceeds a threshold number), which is characterized in that. According to this feature, it is possible to prevent the processing load from increasing excessively due to the number of viewer avatars participating in the virtual space.

[0010] Claim 3 The virtual space content distribution system of is the virtual space content distribution system according to claim 1, wherein the specific condition is a processing load condition related to the number of viewer avatars operating in the virtual space (for example, as shown in FIG. 48, a condition corresponding to an increase in the update processing load of the virtual space and the rendering processing load of the viewer avatars when the number of moving viewer avatars (number of movers) among the viewer avatars virtually participating in a virtual live venue exceeds a threshold), which is characterized in that. According to this feature, it is possible to prevent the processing load from increasing excessively due to the number of operating viewer avatars.

[0011] Claim 4 The virtual space content distribution system of is the virtual space content distribution system according to claim 1, wherein the virtual space content includes content in which a light emission effect accompanied by light emission in the virtual space is executed, The specific condition is a condition regarding the processing load related to the light emission performance (for example, as shown in FIGS. 31, 46 to 48, a condition corresponding to an increase in the update load of the virtual space and the drawing processing load of each avatar due to an increase in the light emission intensity of the light emission performance based on the start of the first act period or the second act period). It is characterized by this. According to this feature, it is possible to prevent the processing load from increasing excessively due to the light emission performance.

[0014] Claim 5 The virtual space content distribution system of is the virtual space content distribution system according to claim 1, wherein The virtual space content includes content by a performer avatar (for example, singing or dancing). The performer avatar includes a performer A avatar (for example, the performer avatar 1A of performer A shown in FIG. 45(A)) and a performer B avatar different from the performer A avatar (for example, the performer avatar 1B of performer B shown in FIG. 45(A)). The mode of the second viewer avatar is different when the performer avatar is the performer A avatar and when it is the performer B avatar (for example, as shown in FIG. 51, the part where the mode of the simple avatar displayed as the viewer avatar is different during the act by the performer avatar 1A of performer A and during the act by the performer avatar 1B of performer B). It is characterized by this. According to this feature, since the mode of the second viewer avatar changes depending on the performer avatar, the interest of the virtual space content can be improved.

[0015] Claim 6 The virtual space content distribution system of is the virtual space content distribution system according to claim 1, wherein The second viewer avatar is used as the viewer avatar of the viewer user himself / herself who uses the viewer user terminal (for example, as shown in FIG. 49, the part where a simple avatar is displayed as the viewer avatar 11 of the viewer himself / herself who uses the viewer terminal 300). It is characterized by this. According to this feature, by using the viewer user's own viewer avatar as the second viewer avatar as well, an excessive increase in the processing load can be further prevented.

[0016] Claim 7 The virtual space content distribution system of is the virtual space content distribution system according to claim 1, wherein the second viewer avatar is preferentially used over the viewer avatar of another viewer user different from the viewer user himself / herself, rather than the viewer avatar of the viewer user himself / herself who uses the viewer user terminal (for example, as shown in FIG. 49, the viewer avatars 12, 13, and 14 of other viewers are displayed earlier as simple avatars than the viewer avatar 11 of the viewer himself / herself who uses the viewer terminal 300), which is characterized in that. According to this feature, by preferentially using the second viewer avatar over the viewer avatars of relatively many other viewer users, an excessive increase in the processing load can be effectively prevented.

[0017] Claim 8 The virtual space content distribution system of is the virtual space content distribution system according to claim 1, including high-relationship user registration means (for example, as shown in FIG. 39, the part where the viewer terminal 300 executes viewer avatar selection processing, viewer avatar inquiry processing, friend addition operation processing, and friend addition processing, and the part where the distribution server computer 100 executes viewer avatar identification processing and inquiry response processing) that enables each viewer user to register other viewer users with a high degree of relationship with himself / herself (such as friends, blood relatives of the viewer user himself / herself, persons belonging to the same organization, etc.) as high-relationship users, wherein the viewer avatar includes a third viewer avatar that has a smaller processing load for display than the first viewer avatar and is different from the second viewer avatar in addition to the first viewer avatar and the second viewer avatar (see, for example, FIG. 56), When the specific condition is satisfied, the second viewer avatar is used as the viewer avatar of a viewer user not registered in the high-relationship user registration means, and the third viewer avatar is used as the viewer avatar of a viewer user registered in the high-relationship user registration means (for example, as shown in FIG. 56, there are differences in the aspects between the simple avatar displayed as the viewer avatar of a registered viewer and the simple avatar displayed as the viewer avatar of a non-registered viewer). It is characterized by this. According to this feature, by registering in the high-relationship user registration means, it is possible to easily identify high-relationship users participating in the virtual space.

[0018] Claim 9 The virtual space content distribution system of is the virtual space content distribution system according to claim 1, wherein The virtual space content includes content by a performer avatar (for example, singing or dancing). The performer avatar includes a first performer avatar (for example, a full avatar as the performer avatar shown in FIG. 45(A)) and a second performer avatar with a smaller processing load for display than the first performer avatar (for example, a simple avatar as the performer avatar shown in FIG. 45(A)). When the specific condition is not satisfied, the first performer avatar is used as the performer avatar, and when the specific condition is satisfied, the first performer avatar is also used as the performer avatar (for example, as shown in FIGS. 46 to 48, the performer avatar is always displayed as a full avatar and is never displayed as a simple avatar). It is characterized by this. According to this feature, it is possible to prevent a decrease in the interest of the content due to the use of the second performer avatar with a low processing load for display as the performer avatar.

[0019] Claim 1 0The virtual space content distribution system is the virtual space content distribution system according to claim 1, wherein the virtual space content includes at least operation content (for example, singing or dancing) in which a performer avatar operates in the virtual space, includes a performer terminal (for example, performer terminal 200) that can be used by a performer corresponding to the performer avatar, the performer terminal is connected to the server computer via the communication network and can operate the performer avatar as the operation content (for example, the part that operates the performer avatar by reflecting the operation of the performer detected by the performer terminal 200 as shown in FIG. 7), is characterized by the above. According to this feature, it is possible to distribute virtual space content including operation content in which the operation of the performer on the performer terminal is quickly reflected.

[0020] The virtual space content distribution program of claim 11 is a virtual space content distribution program for distributing virtual space content (for example, virtual live) in a virtual space, the virtual space content is content including a video that can be viewed by a viewer user on a viewer user terminal (for example, viewer terminal 300) assigned to each of a plurality of viewer users, the viewer user terminal connected to a server computer (for example, distribution server computer 100) capable of executing at least processing related to the virtual space and processing related to distribution of the virtual space content via a communication network can participate a viewer avatar corresponding to itself in the virtual space targeted by the virtual space content, and thus may include the viewer avatar (for example, the part where the viewer avatars of each viewer are displayed to be arranged in the virtual live venue on the viewer terminal 300 as shown in FIG. 32), the viewer User on the terminal, the viewer UserThe viewpoint video from the viewer avatar corresponding to the viewer user who uses the terminal can be displayed as the virtual space content. The viewer avatar includes a first viewer avatar (for example, a full avatar as the viewer avatar shown in FIG. 45(B)) and a second viewer avatar with a smaller processing load for display than the first viewer avatar (for example, a simple avatar as the viewer avatar shown in FIG. 45(B)). When a specific condition corresponding to an increase in the processing load related to the virtual space content to a predetermined specific magnitude is satisfied, a second viewer avatar usage process for using the second viewer avatar as the viewer avatar (for example, as shown in FIGS. 31, 41 to 43, 46 to 48, when the number of viewer avatars virtually participating in a virtual live venue exceeds a threshold number, when the number of moving viewer avatars among the viewer avatars virtually participating in the virtual live venue exceeds a threshold number, when the light emission intensity of a light emission effect increases, when the movement of a performer avatar becomes large (violent), when the number of performer avatars increases, based on the increase in the processing load of the distribution server computer 100 and the viewer terminal 300 due to the satisfaction of these conditions, the viewer terminal 300 executes the processes of steps S507, S508 of the viewer viewpoint video generation process and steps S517, S521, S522 of the virtual camera designation video generation process, and the display of the viewer avatar changes from a full avatar to a simple avatar), and when the specific condition is not satisfied, a first viewer avatar usage process for using the first viewer avatar as the viewer avatar (for example, as shown in FIGS. 31, 41 to 43, 46 to 48, when the number of viewer avatars virtually participating in a virtual live venue does not exceed a threshold number, when the number of moving viewer avatars among the viewer avatars virtually participating in the virtual live venue does not exceed a threshold number, when the light emission intensity of a light emission effect does not increase, when the movement of a performer avatar does not become large (violent), when the number of performer avatars does not increase, based on the fact that the processing load of the distribution server computer 100 and the viewer terminal 300 does not increase due to the non - satisfaction of these conditions, the viewer terminal 300 executes the processes of steps S503, S506 of the viewer viewpoint video generation process and steps S513, S526, S520 of the virtual camera designation video generation process, and the display of the viewer avatar does not change from a full avatar to a simple avatar), including A virtual space content distribution program, characterized by the above. According to this feature, when a specific condition is met, a second viewer avatar with a lower processing load for display than the first viewer avatar is used, so that an excessive increase in the processing load due to the specific condition being met can be prevented.

[0021] The virtual space content distribution method according to claim 12 is a virtual space content distribution method for distributing virtual space content (for example, virtual live) in a virtual space, wherein the virtual space content is content including video that can be viewed by a viewer user on a viewer user terminal (for example, viewer terminal 300) assigned to each of a plurality of viewer users, and it is possible to participate a viewer avatar corresponding to oneself in a virtual space targeted by the virtual space content by using the viewer user terminal connected via a communication network to a server computer (for example, distribution server computer 100) capable of executing at least processing related to the virtual space and processing related to the distribution of the virtual space content, and thus the viewer avatar may be included (for example, as shown in FIG. 32, the part where the viewer avatars of each viewer are displayed to be arranged in a virtual live venue on viewer terminal 300), in the viewer User terminal, a viewpoint video from the viewer avatar corresponding to the viewer user using the viewer terminal can be displayed as the virtual space content, User and the viewer avatar includes a first viewer avatar (for example, a full avatar as the viewer avatar shown in FIG. 45(B)) and a second viewer avatar with a smaller processing load for display than the first viewer avatar (for example, a simple avatar as the viewer avatar shown in FIG. 45(B)). ​When a specific condition corresponding to an increase in the processing load related to the virtual space content to a predetermined specific magnitude is satisfied, a second viewer avatar usage procedure for using the second viewer avatar as the viewer avatar (for example, as shown in FIGS. 31, 41 to 43, 46 to 48, when the number of viewer avatars virtually participating in the virtual live venue exceeds a threshold number, when the number of moving viewer avatars among the viewer avatars virtually participating in the virtual live venue exceeds a threshold number, when the emission intensity of the light emission effect increases, when the movement of the performer avatar becomes large (violent), when the number of performer avatars increases, based on the increase in the processing load of the distribution server computer 100 and the viewer terminal 300 due to the satisfaction of these conditions, the viewer terminal 300 executes the processes of steps S507, S508 of the viewer viewpoint video generation process and steps S517, S521, S522 of the virtual camera designated video generation process, and the display of the viewer avatar changes from a full avatar to a simple avatar), and when the specific condition is not satisfied, a first viewer avatar usage procedure for using the first viewer avatar as the viewer avatar (for example, as shown in FIGS. 31, 41 to 43, 46 to 48, when the number of viewer avatars virtually participating in the virtual live venue does not exceed a threshold number, when the number of moving viewer avatars among the viewer avatars virtually participating in the virtual live venue does not exceed a threshold number, when the emission intensity of the light emission effect does not increase, when the movement of the performer avatar does not become large (violent), when the number of performer avatars does not increase, based on the fact that the processing load of the distribution server computer 100 and the viewer terminal 300 does not increase due to the non-satisfaction of these conditions, the viewer terminal 300 executes the processes of steps S503, S506 of the viewer viewpoint video generation process and steps S513, S526, S520 of the virtual camera designated video generation process, and the display of the viewer avatar does not change from a full avatar to a simple avatar), including A virtual space content distribution method characterized by the above. According to this feature, when a specific condition is met, a second viewer avatar with a lower processing load for display than the first viewer avatar is used, so an excessive increase in the processing load due to the specific condition being met can be prevented.

[0022] Note that the present invention may have only the invention-specific matters described in the claims of the present invention, or may also have configurations other than the invention-specific matters together with the invention-specific matters described in the claims of the present invention.

Brief Description of the Drawings

[0023]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Figure 21

Figure 22

Figure 23

Figure 24

Figure 25

Figure 26

Figure 27

Figure 28

Figure 29

Figure 30

Figure 31

Figure 32

Figure 33

Figure 34

Figure 35

Figure 36

Figure 37

Figure 38

Figure 39

Figure 40

Figure 41

Figure 42

Figure 43

Figure 44

Figure 45

Figure 46

Figure 47

Figure 48

Figure 49

Figure 50

Figure 51

Figure 52

Figure 53

Figure 54

Figure 55

Figure 56

Mode for Carrying Out the Invention

[0024] A mode for implementing the virtual space content distribution system of the present invention will be described below with reference to the drawings based on examples. In a plurality of drawings, the same or similar components are denoted by the same reference numerals, and redundant descriptions are omitted. Further, the virtual space content distribution program according to the present invention may be a program used in the entire system including a server computer and each terminal described later that constitute the virtual space content distribution system, or may be a program that operates only on a part of the devices constituting the virtual space content distribution system, for example, a server computer or each terminal. Each process described below is executed by a program stored in the device where the process is performed.

Example

[0025] FIG. 1 is a block diagram showing a system configuration example of a virtual space content distribution system in Example 1 which is one embodiment of the present invention. In the system of Example 1 shown in FIG. 1, a performer avatar 1 corresponding to a performer user distributes a virtual live in which a live event is held in the virtual live venue shown in FIG. 12 as virtual space content. Hereinafter, "distribution" means transmission to a plurality of recipients and is synonymous with "transmission".

[0026] As shown in Fig. 1, the virtual space content distribution system of the first embodiment mainly includes a distribution server computer 100 capable of executing various processes related to a virtual live venue shown in Fig. 11, which is a virtual space, and various processes related to the distribution of virtual live events, an administrator terminal 150 used by an event administrator M of an event operation organization that operates and manages virtual live events to manage the distribution of virtual live events, a performer terminal 200 used by a performer user, and a viewer terminal 300 that can be used by a viewer user who virtually participates in a virtual live event and watches the virtual live event. The distribution server computer 100, the administrator terminal 150, the performer terminal 200, and the viewer terminal 300 are connected to each other so as to be capable of data communication via the Internet network N, which is an open computer network.

[0027] In addition, in the first embodiment, a form in which the administrator terminal 150 and the performer terminal 200 are also connected to the distribution server computer 100 via the Internet network N is exemplified, but the present invention is not limited thereto. For example, in the case where the studio shown in Fig. 11 is a studio operated by an event operation organization and the event operation organization provides the studio to a performer user, and the distribution server computer 100 is installed in these studios, the administrator terminal 150 and the performer terminal 200 may be locally connected to the distribution server computer 100 for data communication, or may be communicatively connected via a local area network LAN within the studio facility.

[0028] Also, as shown in FIG. 1, there are a plurality of viewer users, such as viewer user A, viewer user B, viewer user C, etc. As the viewer terminals 300, there are viewer terminals 300a, 300b, 300c, etc. that can be used by individual viewer users A, B, C, etc. Note that the viewer users are usually plural, but may be one person or four or more people, and the number may be appropriately determined according to the virtual live venue or the like, which is a virtual space. Hereinafter, viewer users A, B, C, etc. may be collectively referred to as viewer users, and viewer terminals 300a, 300b, 300c, etc. may be collectively referred to as viewer terminals 300.

[0029] In addition, in this Example 1, a form in which there is one performer user is illustrated, but the present invention is not limited to this. The virtual live may be a co-starring event in which a plurality of performer users who are acting alone virtually participate, or a group event in which a plurality of people who are acting together virtually participate. Thus, when a plurality of performers appear, performer terminals 200a, 200b, 200c, etc. may be provided for each performer user, or when a plurality of people appear as a group, one performer terminal 200 may be used by a plurality of people.

[0030] Also, in FIG. 1, the distribution server computer 100 is shown as a single unit, but the present invention is not limited to this. These distribution server computers 100 may be composed of a plurality of server computers such as a first server computer mainly performing virtual space processing and a second server computer mainly performing distribution processing, or may be composed of a cloud server or the like, and the number of server computers may be appropriately changed according to the scale of the event, the number of listener users participating, etc.

[0031] Similarly, although the administrator terminal 150 is shown as a single unit in FIG. 1, the present invention is not limited thereto, and it goes without saying that these administrator terminals 150 may be plural according to the number of performer users and viewer users who virtually participate in the live event, etc.

[0032] <Distribution server computer> FIG. 2 is a diagram showing the configuration of the distribution server computer 100 used in the first embodiment. The distribution server computer 100 used in the first embodiment is a normal server computer having relatively excellent processing capabilities installed in a studio operated by an event management organization as described above. As shown in FIG. 2, it includes a processor (CPU) 101 connected to a data bus 108, a memory (RAM) 102, a storage 103 such as a hard disk, a communication interface (I / F) 104 capable of two-way communication by the TCP / IP protocol via the Internet which is an open computer network, and an input / output interface (I / F) 105 to which an input device such as a keyboard can be connected.

[0033] In addition, in the first embodiment, an input / output interface (I / F) 105 is provided to enable local operations. However, when remote operations via the communication interface (I / F) 104 are possible, the input / output interface (I / F) 105 may not be provided.

[0034] In the storage 103 of the distribution server computer 100, in addition to an operation system (server OS) for providing a server function (not shown), various data and programs are stored as shown in FIG. 3. Specifically, mainly, an event management program 110 for providing an event management function for managing live events, a virtual space generation program 120 for providing a virtual space of a virtual live venue which is a virtual space, a performer user management program 130 for providing a performer user management function for managing performer users, and a viewer user management program 132 for providing a viewer user management function for managing viewer users are stored.

[0035] The event management program 110 is a program for managing a virtual live event, which is an event held in a virtual live venue (see FIG. 12) in cooperation with the administrator terminal 150. The event management program 110 can manage the progress of the virtual live event using event data 111 (see FIG. 7), time schedule data (TS data) 112, and music data 113 stored in the storage 103 together with the program.

[0036] The event data 111 used in the first embodiment 1 is illustrated in FIG. 7. The event data 111 is associated with an event ID uniquely assigned to the event, and stores information such as the event name, the file name of the time schedule (TS) data, the performer ID uniquely assigned to the performer user who is the performer, the file name of the music list, the file name of the participation viewer list in which information of special viewer users who are permitted virtual participation is registered in the third area of the virtual audience area described later, and the file name of the participation viewer list in which information of viewer users who have reserved virtual participation is registered in the fourth area of the virtual audience area described later.

[0037] The time schedule data (TS data) 112 is data in which the order of progress of the virtual live event to be held and the programs such as music are described in time series. The virtual live event is managed to proceed based on the time schedule described in the time schedule data (TS data) 112. Also, these time schedule data (TS data) 112, event data 111, etc. can be changed, updated, and added by the event administrator M operating the administrator terminal 150.

[0038] The music data 113 is data of the performance part (so-called karaoke) of each music sung by the performer user. It is reproduced by the voice control program 124 described later based on the time schedule data (TS data) 112 by the event management program 110 and transmitted to the performer terminal 200 and the viewer terminal 300 (see FIG. 11).

[0039] The virtual space generation program 120 is a program for providing a virtual live venue, which is the virtual space shown in FIG. 12. Using virtual space data 121 that describes the structure of the virtual live venue and the like stored in the storage 103 together with the virtual space generation program 120, object data 122 for arranging various objects (including virtual placement object 43 which is a star decoration on the stage and virtual air objects 50 to 52 which are star objects in the sky) and the like in the virtual space, and the performer avatar data included in the performer user data 131 described later and the viewer avatar data included in the viewer user data 133, it has a function of providing a virtual live venue where the performer avatar and the viewer avatar virtually participate.

[0040] As shown in FIG. 12, the viewpoint video control program 123 provides a function of generating viewpoint videos from virtual cameras C1 to C4 and an aerial movement virtual camera (not shown) virtually set in the virtual live venue, and a function of displaying videos from the viewpoints of viewer avatars 11 to 14 virtually participating in the third area and viewer avatars 21 to 32 virtually participating in the fourth area of the virtual live venue on the viewer terminal 300 in cooperation with the viewer terminal 300. Note that the virtual camera C2 is a virtual camera set to be the video from the viewpoint of the performer avatar 1 on the stage of the virtual live venue, and the viewpoint video from the virtual camera C2 is projected onto the screen S provided in the studio by a projector 211 described later connected to the performer terminal 200 in cooperation with the performer terminal 200.

[0041] The audio control program 124 is a program for controlling the audio (including music) distributed in the virtual live event. Specifically, it provides a function of playing the music data 113 and a function of synthesizing the music played with the voice emitted by the performer user and distributing it to the administrator terminal 150 and the viewer terminal 300.

[0042] The comment control program 125, in cooperation with the viewer comment control program stored in the viewer terminal 300 described later, provides a function of displaying various comments input by each viewer user on the viewer terminal 300 in time series on the performer terminal 200 and the viewer terminal 300 in a virtual live event.

[0043] The gift control program 126 is a program for controlling gifts given from viewer users to performer users in cooperation with the viewer program stored in the viewer terminal 300 described later. Specifically, it includes functions such as allowing viewer users to purchase gifts based on the information of the purchase unit prices set for various gifts stored in the gift data 134, a processing function (including processing such as effects when giving) for viewer users to give the gifts purchased using the object data of the gifts included in the gift data 134 to performer users, and a processing function for changing the owner of the given gift from the viewer user to the performer user, etc.

[0044] The performer user management program 130 provides a management function and an authentication function, etc., for information related to performer users based on the performer user data 131 shown in FIG. 8 stored in the storage 103 together with the performer user management program 130.

[0045] The performer user data 131 used in the first embodiment is illustrated in FIG. 8. The performer user data 131 stores various information such as the account (e-mail address), name, authentication information, file name of the avatar data of the avatar used in the virtual space, and file name of the item list in which the owned items are registered, in association with the performer user ID uniquely assigned to the performer user. Although not shown in FIG. 8, information on virtual values such as points owned by each performer user may be stored as the performer user data 131.

[0046] The performer user can be authenticated by verifying the performer user ID, account, authentication information, etc., and can identify the items (gifts) owned by each performer user by being given by viewers from the item list.

[0047] Based on the viewer user data 133 shown in FIG. 9 stored in the storage 103 together with the program, the viewer user management program 132 provides a management function and an authentication function for information related to the viewer user.

[0048] The viewer user data 133 used in the first embodiment is illustrated in FIG. 9. The viewer user data 133 is associated with the viewer user ID uniquely assigned to the viewer user, and includes the account (email address) of the viewer user, authentication information, the file name of the avatar data of the avatar used in the virtual space, the number of owned points which is the number of points available for use in the virtual space, the file name of the item list in which the items (gifts) purchased using the points are registered, personal information such as name, date of birth, phone number, and various other information. Although not shown in FIG. 9, the nickname (comment name) displayed together with the comment is also registered in the viewer user data 133, and the nickname (comment name) is displayed together with the comment. Also, the points can be increased, for example, by purchasing from a predetermined operating company.

[0049] <Performer terminal> FIG. 4 is a diagram showing a configuration example of the performer terminal 200 in the virtual space content distribution system of the first embodiment. In the first embodiment, as shown in FIG. 11, the performer terminal 200 is provided in an adjustment room adjacent to the studio where the performer user performs acting operations, and uses a normal computer with relatively excellent processing capabilities. As shown in FIG. 4, it includes a processor (CPU) 201 connected to a data bus 208, a memory (RAM) 202, a storage 203 such as a hard disk, a communication interface (I / F) 204 capable of two-way communication by the TCP / IP protocol via the Internet which is an open computer network, an image processing unit 206 including a graphics processing unit (GPU) to which display devices A210 to display devices C212 are connected, and an input / output interface (I / F) 205 to which various input / output devices are connected.

[0050] Connected to the input / output interface (I / F) 205 are, as input devices, a motion sensor 220 including a plurality of wearable sensors 220C1 to 220C5 (see FIG. 11) worn by the performer user on the left and right hands, feet, and waist, an expression input device 221 composed of an imaging camera for inputting the expression of the performer's face, a voice input device 222 composed of a sound collection microphone worn on the head of the performer user, an operation input device 224 such as a keyboard or a touch panel on which an auxiliary operator O for assisting the performer user is operably provided, and the like. Incidentally, as these input devices, by providing a controller that allows the performer user to perform various operations by gripping it, the performer himself / herself may be able to perform various operations without the need for the auxiliary operator O.

[0051] In the first embodiment, in order for the performer user to perform a performance operation (including music operations such as singing and dancing) in accordance with the music, the operation during the performance is assisted by the auxiliary operator O. However, the auxiliary operator O may be plural, or the form without providing the auxiliary operator O may be adopted by setting the operation content in advance in the performer terminal 200, for example, in a sequence program or the like.

[0052] The input / output interface (I / F) 205 is connected to an audio output device 223 including high-functional earphones (ear monitors) worn by the performer user as an output device, speakers arranged in the adjustment room, etc. As a result, the sound of the reproduced music transmitted from the distribution server computer 100 is output to the performer user via the high-functional earphones (ear monitors), and the music sound is output from the speakers together with the voice of the performer, so that the situation of the music including the voice uttered by the performer user can be confirmed by the assistant operator O etc. in the adjustment room.

[0053] In the first embodiment, high-functional earphones (ear monitors) are used to avoid the inconvenience caused by the input of the reproduced music sound from the sound collection microphone worn by the performer user. However, the present invention is not limited to this, and if the inconvenience caused by the input of the music sound can be avoided, the music sound may be output from speakers in the studio etc.

[0054] In the first embodiment, the form in which the performer user wears the sound collection microphone is illustrated, but these sound collection microphones may be of an installation type installed on the floor, wall, or ceiling of the studio.

[0055] Here, the motion sensor 220 used in the performer terminal 200 of the first embodiment will be described. Any motion sensor 220 can be used as long as it can appropriately detect (measure) the movement (operation) of the body of the performer user. In the first embodiment, a plurality of wearable sensors 220C1 to 220C5 worn on the body by the performer user are used to enable more accurate and short-cycle detection of the performer's movement. Incidentally, a type of motion sensor 220 that does not require the performer to wear a device, such as LiDER using laser light etc., may be used.

[0056] Further, in the first embodiment, in order to reduce the operational burden due to wearing sensors or the like when the performer user performs a performance operation, particularly the operational burden on the head, the movement of the head of the performer user is detected by image recognition using an image captured by the imaging camera constituting the expression input device 221 as described later, and an example of a form in which movements other than the head are detected using five wearable sensors 220C1 to 220C5 is shown. However, for example, a wearable sensor may be provided on the head or the like of the performer user, or more (seven or more) wearable sensors may be worn in order to detect more detailed movements.

[0057] As shown in FIG. 11, the wearable sensors 220C1 to 220C5 cooperate with the base stations 220a and 220b installed in the studio room that separates the adjacent adjustment rooms and the glass windows to detect their own positions and orientations.

[0058] As an example, these base stations 220a and 220b can use a multi-axis laser emitter. After emitting the blinking light for synchronization, the base station 220a scans the laser light around, for example, the vertical axis. The base station 220b scans the laser light around, for example, the horizontal axis.

[0059] Each of the wearable sensors 220C1 to 220C5 may include a plurality of optical sensors that detect the incidence of the blinking light and the laser light from the base stations 220a and 220b.

[0060] Each of the wearable sensors 220C1 to 220C5 can detect its own position and orientation based on the time difference between the incidence timing of the blinking light and the incidence timing of the laser light, the light reception time at each optical sensor, the incidence angle of the laser light detected by each optical sensor, and other information as necessary. For example, the ViveTracker provided by HTC CORPORATION or the base station can be preferably used.

[0061] Since the base stations 220a and 220b emit blinking light and scan laser light at regular intervals, the detection information of each of the wearable sensors 220C1 to 220C5 is updated for each such interval. Then, the detection information indicating the position and orientation of each motion sensor calculated in each of these wearable sensors 220C1 to 220C5 is input to the performer terminal 200 by short-range wireless communication, and together with the face motion information, it is transmitted to the distribution server computer 100 as performer avatar information (see FIG. 10).

[0062] Note that in the present Example 1, a form using two base stations, namely the base station 220a and the base station 220b, is illustrated, but the present invention is not limited thereto, and three or more of these base stations may be used.

[0063] Further, a plurality of infrared LEDs or visible light LEDs may be mounted on each of the plurality of motion sensors worn by the performer user, and the light from these LEDs may be detected by an infrared camera provided on the floor or wall of the studio, thereby detecting the position and orientation of each of the motion sensors.

[0064] Further, in order to reduce the burden on the performer user, instead of the wearable sensors 220C1 to 220C5, a motion sensor using a lighter reflective marker may be used. That is, by photographing reflective markers attached to each part of the performer user's body with an adhesive tape or the like to generate photographed data, and by performing image processing on this photographed data to detect the position and orientation of the reflective markers, the motion of the performer user may be detected. In this case, a cameraman for photographing the performer user may be arranged in the studio, and the cameraman may photograph the performer user so that the motion of the performer user can be photographed from a direction suitable for detection, thereby enabling good detection.

[0065] Alternatively, as the motion sensor 220, a suit with a built-in inertial sensor, for example, a suit with a built-in inertial sensor for the MVN motion capture system marketed by Xsens.com, may be used, and the motion of the performer user may be detected by analyzing the sensor signal output from the inertial sensor.

[0066] The expression input device 221 can be any device as long as it can appropriately detect the motion of the head including the face of the performer user. In the first embodiment, specifically, it is configured by an imaging camera (digital camera) arranged to be able to continuously capture an image of the head including the face of the performer user, and the motion of the head and the motion (expression) of the face of the performer user captured by the imaging camera are detected by image recognition, and the face motion information, which is the detected motion of the head and the motion (expression) of the face, is transmitted to the distribution server computer 100 as performer avatar information together with the body motion information as shown in FIG. 10.

[0067] Note that the expression input device 221 is not limited to the imaging camera (digital camera) used in the first embodiment. For example, the expression input device 221 may be a 3D camera capable of detecting the depth of a person's face, or for example, a mobile terminal such as a smartphone equipped with a LiDER device may be used. In this case, these mobile terminals may be worn by the performer user.

[0068] In the performer terminal 200 of the first embodiment, as described above, it has three display devices A210 to display device C212. The display device A210 is, as shown in FIG. 11, a liquid crystal monitor or the like provided in the adjustment room, the display device B211 is a projector that projects an image onto the screen S provided in the studio, and the display device C212 is a vertical large display provided adjacent to the screen S in the studio.

[0069] On the display device A210 arranged in the adjustment room of the studio, images from the viewpoints of the virtual cameras C1 to C4, viewpoint images from the aerial movement virtual camera during the flying effect period described later, the content of the commentary, and a message input window for inputting messages that the assistant operator O wants to convey to the performer user are displayed.

[0070] On the other hand, on the screen S projected from the projector which is the display device B211 provided in the studio, a viewpoint image of the virtual camera C2 (see FIG. 12) which is the viewpoint of the performer, for example, as shown in FIG. 15, an image including the avatars of the viewers virtually participating in the live in the third area and the fourth area is displayed, so that the performer user can confirm the situation of the viewer users virtually participating in the virtual live by the image.

[0071] In addition, on the display device C212 provided in the studio, comments of the viewer users, comments and messages input by the assistant operator O, etc. are displayed, so that the performer user can confirm the comments of the viewer users during the performance and the messages from the assistant operator O.

[0072] In the storage 203, in addition to the operation system (OS) for operating the computer which is the performer terminal 200, various functions including the operation control function of the performer avatar 1 by the performer user in the virtual live which is virtual space content are provided by the cooperation of the processor (CPU) 201 etc., and a performer program for providing in cooperation with the distribution server computer 100 is stored.

[0073] As shown in FIG. 4, the performer program includes a performer avatar control program, a performer viewpoint image control program, a performer viewpoint image control program, a performer voice control program, a performer comment control program, performer authentication data, etc.

[0074] The performer avatar control program mainly provides a function of scanning the body motion of the performer user using the motion sensor 220 and scanning the face motion (expression) of the performer user using the expression input device 221, generating performer avatar information for operating the performer avatar, and transmitting it to the distribution server computer 100.

[0075] The performer perspective video control program is a program that provides a function of generating and outputting a perspective video of the virtual camera C2, which is the performer's perspective, based on the virtual space update data distributed from the distribution server computer 100.

[0076] The performer voice control program outputs the playback sound of the music based on the music playback data distributed from the distribution server computer 100 via the voice output device 223, digitizes the voice input from the voice input device 222, transmits it to the distribution server computer 100 as performer voice data, and provides a function of generating and outputting a monitor voice composed of the playback sound of the music and the performer voice.

[0077] The performer comment control program is a program that provides a function of displaying each comment, etc. by the viewer user distributed from the distribution server computer 100.

[0078] The performer authentication data is data for authenticating that the performer user is the actual person in the communication connection with the distribution server computer 100.

[0079] In addition, the performer avatar control program includes a motion parameter generation program that can generate parameter information on the positions and rotation angles of bones (bones) that make up rig data (sometimes called skeleton data) indicating the skeleton of the performer avatar included in the performer avatar data, and also includes an image recognition processing program for image-recognizing the position and expression of the head of the performer user from the image captured by the imaging camera.

[0080] In addition, in the first embodiment, the performer terminal 200 is a computer that is installed in a studio operated by an event management organization and is jointly used by a plurality of performer users. When holding a live event, each performer user can use it as the performer terminal 200 by inputting performer authentication data. However, the present invention is not limited to this. For example, when a performer user participates in a virtual live from home or the like, the performer terminal 200 may be a dedicated computer installed at the performer user's home, and only the owning performer user may use it. In such a case, it is not necessarily required to store the performer authentication data.

[0081] In this way, by using the performer terminal 200 that constitutes the virtual space content distribution system of the first embodiment by a performer user or the like, the performer user can operate the performer avatar 1 arranged on the virtual stage G in the virtual live venue in conjunction with his or her own actions, and can reflect his or her own expression on the expression of the performer avatar 1. In addition, the user's own voice can be distributed to the viewers through the distribution server computer 100 as the voice of the performer avatar 1.

[0082] <Viewer Terminal> FIG. 5 is a diagram showing a configuration example of the viewer terminal 300 in the virtual space content distribution system of the first embodiment. In the first embodiment, the viewer terminal 300 is a smartphone P carried by the viewer user or a stationary normal computer (PC) installed by the viewer user at home or the like. As shown in FIG. 5, a processor (CPU) 301 connected to the data bus 308, a memory (RAM) 302, a storage 303 such as a hard disk or a non-volatile memory, a communication interface (I / F) 304 capable of two-way communication by the TCP / IP protocol via the Internet which is an open computer network, an image processing unit 306 including a graphics processing unit (GPU) to which a display device 310 is connected, and an input / output interface (I / F) 305 to which various input / output devices are connected.

[0083] As will be described later, the display device 310 can be any device that can display each viewpoint video generated based on the virtual space data of the virtual live venue, which is a virtual space updated by the virtual space update data (see FIG. 10) distributed from the distribution server computer 100 by the viewer viewpoint video control program included in the viewer program stored in the storage 303, and the flying viewpoint video distributed from the distribution server computer 100 during the flying effect period described later. When the viewer terminal 300 is the smartphone P, the display of the smartphone P corresponds to it. When the viewer terminal 300 is a normal computer (PC), the stationary display constituting the computer (PC) corresponds to it. Note that these displays are not limited to those that display a planar view image (2D image), and may be capable of displaying a stereoscopic view image (3D image) by displaying a right-eye image and a left-eye image, such as a head-mounted display (HMD) that the viewer can wear.

[0084] The input / output interface (I / F) 305 is connected to, as input devices, an operation input device 321 composed of one or more devices that enable a viewer to perform various operations, and an audio output device 322 such as earphones or speakers that can output live audio or the like distributed from the distribution server computer 100.

[0085] Needless to say, the audio output device 322 may not be a single device, but may be integrated with the display device 310 like the above-described head-mounted display (HMD).

[0086] The operation input device 321 can be any device as long as it enables a viewer to perform various operations including operation operations such as moving a viewer avatar, zoom operations, operations related to comments, operations related to gifts, etc. For example, it can be composed of at least one or more of a transparent touch panel formed on the display surface of a smartphone, a keyboard constituting a computer, a game controller, etc.

[0087] In addition, in the first embodiment, as will be described later, as a viewer, the virtual audience area in the virtual live venue is divided into a third area near the virtual stage G where only viewer users specially permitted by the performer user can virtually participate, as shown in FIG. 12, and a fourth area around the third area where general viewer users can virtually participate. The viewer users who virtually participate in the fourth area may be the operation input device 321 such as a touch panel, a keyboard, or a game controller as described above. However, the viewer users who virtually participate in the third area are viewer users who can finely operate the viewer avatar according to their own actions like the performer user by owning, for example, an MVN motion capture suit with the above-described inertial sensor as the operation input device 321.

[0088] However, even for viewer users who are permitted virtual participation in the third area, they cannot change the expressions of the viewer avatars. However, the present invention is not limited to this, and the expressions of these viewer avatars can be changed at a level different from the change level of the performer user, for example, by allowing the viewer user to recognize the facial expressions of the viewer user using the camera function of a smartphone or a camera connected to a computer as described above.

[0089] In addition, various input / output devices connected to these input / output interfaces (I / F) 305 may be built-in or external. In the case of an external device, it may be connected in any form of wired or wireless connection.

[0090] In the storage 303, in addition to an operation system (OS) for operating a smartphone or a computer which is the viewer terminal 300, various functions including a live viewing function regarding a viewer user in a virtual live which is virtual space content by being executed by a processor (CPU) 301 etc. are stored as a viewer program for providing in cooperation with the distribution server computer 100.

[0091] As shown in FIG. 5, the viewer program includes a viewer viewpoint video control program that provides a function of generating each viewpoint video of the virtual live to be displayed on the display device 310, a viewer audio control program that provides a function of outputting live audio based on the live audio (data) of the virtual live distributed from the distribution server computer 100 from the audio output device 322, a viewer comment control program that displays comments based on the comment data distributed from the distribution server computer 100 and provides functions related to comments such as sending the comments input by the viewer to the distribution server computer 100, and viewer authentication data etc. for authenticating that the viewer user is the person himself / herself in the communication connection with the distribution server computer 100.

[0092] Although not shown in FIG. 5, in addition to the above-described program, there are a gift control program for performing control related to gifts and an area designation program for reserving an area (position) where viewer avatars virtually participate in a virtual live venue in advance before the start of a live event as shown in Modification 3-1 (see FIGS. 42 and 43) to be described later. However, other programs may be included.

[0093] In the present Example 1, the comments input by the viewers are short text messages in text format. However, they are not limited to these short text messages in text format. For example, they may be messages in still image format, messages in moving image format, and electronic messages in any other format. Note that the comments are displayed superimposed on each viewpoint video on the display device 310.

[0094] In this way, by using the viewer terminal 300 used by the viewer user who constitutes the virtual space content distribution system of the present Example 1, the viewer avatar virtually participating in the virtual live venue can be moved and operated, and the viewpoint video displayed on the display device 310 can be changed by changing the viewpoint by the viewer avatar. At the same time, the zoom state (state of the viewpoint) can also be changed, and the viewer avatar can be operated to support the performer avatar 1.

[0095] Note that in the case of a viewer avatar that has virtually participated in the third area, it can only move within the third area and cannot move to the fourth area. On the other hand, in the case of a viewer avatar that has virtually participated in the fourth area, it can only move within the fourth area and cannot move to the third area. However, the present invention is not limited to this, and in the case of a viewer avatar that has virtually participated in the third area, it may be possible to move to the fourth area. Note that, of course, the viewer avatar cannot move to the virtual stage G or the like, so the visibility of the performer avatar 1 will not be hindered by the movement of the viewer avatar on the virtual stage G.

[0096] In addition, when perspective videos are displayed on these display devices 310 and live audio is output, the user can enjoy the virtual live performance as if they were present at the virtual live venue.

[0097] Also, although detailed description is omitted, with the comment function provided by the viewer comment control program, the user can enjoy the virtual live performance while checking comments input by themselves and other viewer users. Moreover, with the gift function provided by the gift control program, the user can liven up the virtual live performance by giving items they own to the performer avatar 1.

[0098] <Administrator terminal> FIG. 6 is a diagram showing a configuration example of the administrator terminal 150 in the virtual space content distribution system of the first embodiment. In the first embodiment, the administrator terminal 150 uses a normal computer provided in an adjustment room adjacent to the studio, together with the performer terminal 200. As shown in FIG. 6, it includes a processor (CPU) 151 connected to a data bus 158, a memory (RAM) 152, a storage 153 such as a hard disk, a communication interface (I / F) 154 capable of two-way communication by the TCP / IP protocol via the Internet which is an open computer network, an image processing unit 156 including a graphics processing unit (GPU) to which a display device 160 is connected, and an input / output interface (I / F) 155 to which various input / output devices are connected.

[0099] As will be described later, the display device 160 is generated based on the virtual space data of the virtual live venue, which is a virtual space updated by the virtual space update data (see FIG. 10) distributed from the distribution server computer 100 by the administrator perspective video control program included in the administrator program stored in the storage 153. It is sufficient that it can individually display the perspective videos of each of the virtual cameras C1 to C4 and the aerial movement virtual camera during the flying effect period described later, and can display comments based on the comment data distributed from the distribution server computer 100, and is composed of one or more stationary displays.

[0100] Connected to the input / output interface (I / F) 155 are, as input devices, an operation input device 161 consisting of one or more devices that enable various operations by the event administrator M, and an audio output device 162 such as earphones, headphones, or speakers that can output live audio or the like distributed from the distribution server computer 100.

[0101] The operation input device 161 can use any device as long as it enables the event administrator M to execute various operations such as input and setting related to the virtual live event. For example, it is composed of at least one or more of a keyboard that constitutes a computer, a transparent touch panel formed on the display surface, a viewpoint switching controller, and the like.

[0102] In addition, the various input / output devices connected to the input / output interface (I / F) 155 may be in any connection form, either wired or wireless.

[0103] Stored in the storage 153 are, in addition to the operation system (OS) for operating the computer that is the administrator terminal 150, various functions including a distribution management function related to the distribution of the virtual live, which is virtual space content, when executed by the processor (CPU) 151 and the like, and an administrator program for providing these functions in cooperation with the distribution server computer 100.

[0104] As shown in FIG. 6, the program for the administrator includes a program for controlling the viewpoint video for the administrator, a program for controlling the audio for the administrator, a program for controlling the comments for the administrator, a program for managing viewers, a program for managing performers, and the like.

[0105] The program for controlling the viewpoint video for the administrator is a program that provides a function of generating viewpoint videos from each virtual camera to be displayed on the display device 160 and a function of changing and switching viewpoints.

[0106] The program for controlling the audio for the administrator is a program that provides a function of outputting live audio based on the audio data of the virtual live broadcast distributed from the distribution server computer 100 from the audio output device 162.

[0107] The program for controlling the comments for the administrator is a program that displays comments based on the comment data distributed from the distribution server computer 100 and provides functions related to comments such as prohibiting distribution and selecting viewers so that they are not distributed.

[0108] The program for managing viewers is a program for managing viewer users who virtually participate in the virtual live broadcast, and the program for managing performers is a program for managing performer users who virtually participate in the virtual live broadcast.

[0109] Although not shown in FIG. 6, it includes an authentication program for authenticating whether the administrator, who is the operator, is the person himself / herself, a schedule program for editing the time schedule of the virtual live broadcast, the order of music, etc. Other programs may also be included.

[0110] In this way, by the event administrator M operating the administrator terminal 150 that constitutes the virtual space content distribution system of the first embodiment, various settings for executing an event can be performed. For example, settings related to the program, music order, production, time schedule, the trajectory along which the virtual camera moves during the flying production period, and other various settings can be implemented. Based on the content set in this way, the virtual live performance is managed.

[0111] <Virtual live venue> The virtual live venue, which is the virtual space used in the first embodiment, is shown in FIG. 12. As shown in FIG. 12, the virtual live venue is a virtual space that, like the live venue in the real space, has a virtual stage G on which the performer user appears as the performer avatar 1 and a virtual audience area in which the viewer users who are the audience virtually participate as viewer avatars.

[0112] As shown in FIG. 12, the virtual stage G has a trapezoidal floor surface with a relatively large area, and the performer avatar 1 can move on the virtual stage G, similar to the live venue in the real space. On the side opposite to the virtual audience direction of the virtual stage G, as shown in FIG. 12, a virtual stage wall divided into three parts, a central part, a right side part, and a left side part, is formed. On the front surfaces of these virtual stage walls, virtual displays 40, 41, and 42 are provided, and images and videos for production are virtually displayed on the virtual displays 40, 41, and 42.

[0113] In addition, between the virtual displays 40, 41, and 42, a virtual arrangement object 43 of stars related to the performer user is arranged. In the second area, which is an area on the virtual stage G above the first area surrounded by the virtual stage wall, large virtual aerial objects 50 to 52 of stars are arranged as shown in FIG. 12. The virtual aerial objects 50 to 52 can move within the second area.

[0114] In front of the virtual stage G, a virtual audience area is provided where viewer users can virtually participate in the virtual live venue as viewer avatars. As shown in FIG. 12, this virtual audience area includes a third area, which is a special area close to the center of the virtual stage G where the performer avatar 1 appears on stage, and a fourth area formed so as to surround the third area and having a distance from the center of the virtual stage G greater than that of the third area.

[0115] In these third areas, within a predetermined upper limit number range, special viewer users permitted virtual participation can virtually participate. In the first embodiment, as shown in FIG. 12, for example, viewer avatars 11 to 14 of four viewer users who satisfy a predetermined virtual participation record and are permitted virtual participation by the performer user are arranged.

[0116] Also, in the fourth area, viewer avatars 21 to 32 of general viewer users who reserved virtual participation before the start of the virtual live are arranged. In FIG. 12, viewer avatars 21 to 32 are shown in a simplified manner for convenience, but they are the same avatars as viewer avatars 11 to 14.

[0117] Each of the viewer avatars 11 to 14 arranged in the third area can be moved within the third area by the viewer user operating the viewer terminal, and each of the viewer avatars 21 to 32 arranged in the fourth area can also be moved within the fourth area by the viewer user operating the viewer terminal.

[0118] As shown in FIG. 12, four virtual cameras C1 to C4 are virtually arranged (set) in the virtual live venue. The virtual camera C1 is a virtual camera virtually arranged at the front position of the performer avatar 1 so as to face the performer avatar 1. The viewpoint video by the virtual camera C1 is, as shown in FIG. 13(a), a viewpoint video of the performer avatar 1 seen from a position near the front.

[0119] The virtual camera C2 is a camera that is virtually arranged (set) above the head of the performer avatar 1. As shown in FIG. 15, the viewpoint video by the virtual camera C2 is a performer's viewpoint video that views the virtual audience area from the performer avatar 1.

[0120] The virtual camera C3 is a virtual camera that is virtually arranged on the virtual display 41 diagonally behind the performer avatar 1. As shown in FIG. 13(c), the viewpoint video by the virtual camera C3 is a viewpoint video that views the virtual audience area from diagonally behind the performer avatar 1.

[0121] The virtual camera C4 is a virtual camera that is virtually arranged on the virtual display 42 diagonally behind the performer avatar 1. As shown in FIG. 13(b), the viewpoint video by the virtual camera C4 is a viewpoint video that views the virtual audience area from diagonally behind the performer avatar 1.

[0122] In addition, in the present Example 1, in addition to the fixed-arranged (set) virtual cameras C1 to C4, an airborne moving virtual camera (not shown) that is set to be able to move in the air within the space of the virtual live venue, which is a virtual space, is virtually arranged. The airborne orbit along which these airborne moving virtual cameras move and the viewpoint direction (angle) at each position on the airborne orbit, etc. are preset by the administrator terminal 150. During the flying effect period described later, the performer avatar 1 virtually flies so as to follow the airborne orbit of the airborne moving virtual camera, and a viewpoint video that captures the virtually flying performer avatar 1 with the airborne moving virtual camera is generated.

[0123] In addition, in the present Example 1, as shown in FIG. 12, a form in which four virtual cameras C1 to C4 are virtually arranged as fixed-arranged (set) virtual cameras is exemplified, but the present invention is not limited to this. These fixed-arranged (set) virtual cameras may be five or more. Conversely, without providing fixed-arranged (set) virtual cameras, only the viewpoint videos seen from the viewpoints corresponding to each avatar that virtually participates in the virtual live venue may be displayed on the performer terminal 200 and the viewer terminal 300.

[0124] In addition, in the first embodiment, a form with one virtual camera moving in the air is illustrated. However, the present invention is not limited to this, and a form with a plurality of these virtual cameras moving in the air may be used. Conversely, a form in which the virtual cameras moving in the air are not virtually arranged may also be used.

[0125] <Studio> FIG. 11 is a diagram showing the studio used in the first embodiment. As described above, an adjustment room separated by a glass window is provided adjacent to the studio. The performer user performs each operation corresponding to singing in the studio, and the auxiliary operator O assists in operating the performer terminal 200 installed in the adjustment room. Around the performer user wearing the mounting sensors 220C1 to 220C5, a base station 220a and a base station 220b are mounted and arranged on a stand. At a position almost directly in front of the performer user, an imaging camera constituting the expression input device 221 is mounted and arranged on a stand.

[0126] A screen S is provided on the wall surface where the performer user faces in the studio. A viewpoint video of the virtual camera C2 is projected onto the screen S from a projector (display device B211) arranged on the ceiling of the studio. Thus, as shown in FIG. 15, a viewpoint video seen from the virtual audience area from the performer avatar 1 is displayed on the screen S, and the performer user can proceed with the live while sequentially grasping the state of the viewer avatars virtually participating in the virtual audience area (the reaction of the viewers to the live).

[0127] In addition, a vertical large display as the display device C212 is arranged at a side position of the screen S, and comments of the viewers and messages that the auxiliary operator O wants to convey to the performer user are displayed on the large display. Note that lyrics of the song that the performer sings in the live, information such as lines (performer support information), etc. may be displayed on the display device C212.

[0128] <Operation of the virtual space content distribution system> FIG. 10 is an explanatory diagram for explaining the operation of the virtual space content distribution system according to the first embodiment, specifically, the flow in which virtual live video and audio are distributed.

[0129] First, the video system will be described. As described above, the distribution server computer 100 can provide a virtual space of a virtual live venue based on the virtual space generation program 120 and avatar data of performer users and viewer users. The operations of the avatars of these performer users and viewer users are described by the state of the virtual space in the virtual space data updated by the performer avatar information transmitted from the performer terminal 200 and the viewer avatar information transmitted from the viewer terminal 300. By updating the virtual space data, the operation of the performer user is reflected in the operation of the performer avatar 1, and the operation (operation) of the viewer user is reflected in the operation of the viewer avatar.

[0130] Although not shown in FIG. 10, in the performer terminal 200 and the viewer terminal 300, when communicating with the distribution server computer 100 to virtually participate in the virtual live, the virtual space data of the virtual live venue is pre-distributed and stored from the distribution server computer 100. In this way, the pre-stored virtual space data is sequentially updated by the virtual space update data sequentially distributed from the distribution server computer 100, so that the latest state of the virtual live venue can be specified by the performer terminal 200 and the viewer terminal 300.

[0131] Specifically, the operations and expressions of the performer user in the studio described above are scanned at predetermined time intervals by the functions of body motion scanning and face motion scanning by the performer avatar control program described above to generate performer avatar information and transmitted to the distribution server computer 100.

[0132] On the other hand, since the viewer user permitted to virtually participate in the third area also uses a motion sensor like the performer, the body motion scan and each function of the face motion scan scan at predetermined time intervals to generate viewer avatar information, which is then transmitted to the distribution server computer 100.

[0133] In addition, the viewer user permitted to virtually participate in the fourth area can use the touch panel, keyboard, or controller of the viewer terminal 300 to perform various operations such as movement operations, viewpoint direction change operations, viewing situation (zoom) change operations, raising hand operations, clapping hand operations, and jumping operations, thereby making the avatar corresponding to the viewer avatar perform corresponding actions. Then, based on the operations related to the actions of the viewer avatar among these operations, viewer avatar information is generated and transmitted to the distribution server computer 100.

[0134] In addition, the viewer user virtually participating in the third area can also execute various operations such as movement, viewing situation (zoom) change operations, raising hand operations, clapping hand operations, and jumping operations using a controller or the like. In this case, menu items corresponding to each action are displayed, and the menu items corresponding to each action can be selected using a controller or the like.

[0135] In this way, on the viewer terminal 300, an avatar action operation process for receiving operations corresponding to each action to be performed by the viewer avatar is executed. In addition, the avatar action operation process also includes processes such as display and deletion of menu items corresponding to the above-described actions.

[0136] Based on the performer avatar information transmitted from the performer terminal 200 and the viewer avatar information transmitted from the viewer terminal 300 in this way, the distribution server computer 100 executes a virtual space update process for updating the virtual space data, thereby reflecting the actions of the performer user and the actions (operations) of the viewer user on each avatar virtually participating in the virtual live venue.

[0137] After executing a virtual space update data generation process that generates virtual space update data based on the virtual space data before the update and the virtual space data after the update, the generated virtual space update data is distributed to the performer terminal 200 and the viewer terminal 300.

[0138] In the performer terminal 200 and the viewer terminal 300 to which the virtual space update data has been distributed, as shown in FIG. 10, based on the distributed virtual space update data, the pre-stored virtual space data is updated, and the performer viewpoint video generation process and the viewer viewpoint video generation process using the updated virtual space data are executed, so that a performer viewpoint video and a viewer viewpoint video based on the updated virtual space data are generated, and the generated performer viewpoint video and viewer viewpoint video are displayed on the performer terminal 200 and the viewer terminal 300 (viewer viewpoint video output process).

[0139] As described above, in the first embodiment, the viewpoint videos of the respective viewer users who are virtually participating in the virtual live venue by the viewer avatars are generated and displayed on the viewer terminal 300 side of each viewer user, so that the processing load on the distribution server computer 100 is significantly increased by generating the viewer avatar viewpoint videos of these respective viewer users on the distribution server computer 100, and it is possible to avoid the situation where many viewer users cannot participate in the virtual live, and it is also possible to avoid the situation where distribution becomes difficult due to an increase in the processing load.

[0140] In the first embodiment, on the display device 310 of the viewer terminal 300 of the viewer user of the viewer avatar 13 virtually participating in the third region close to the performer avatar 1 on the virtual stage G, as shown in FIG. 13(d), a viewpoint video is generated and displayed in which the substantially front view of the performer avatar 1 as seen from the viewer avatar 13 close to the performer avatar 1 is largely displayed. On the other hand, in the fourth region far from the performer avatar 1 on the virtual stage G, for example, on the display device 310 of the viewer terminal 300 of the viewer user of the viewer avatar 28 virtually participating at the rear position of the viewer avatar 13, as shown in FIG. 13(e), a viewpoint video is displayed in which the substantially front view of the performer avatar 1 appears relatively small through the viewer avatar 13 and the viewer avatar 14 virtually participating in the third region, which is the viewpoint video as seen from the viewer avatar 28 far from the performer avatar 1.

[0141] Also, on the display device 310 of the viewer terminal 300 of the viewer user of the viewer avatar 32 virtually participating at the end side position of the virtual stage G in the fourth region set in a U-shaped top view, as shown in FIG. 13(f), a viewpoint video is displayed in which the performer avatar 1 appears relatively small through the viewer avatar 14 virtually participating in the third region, which is the viewpoint video as seen from the viewer avatar 32 at the diagonally forward position of the performer avatar 1.

[0142] Note that the display examples shown in FIG. 13 all illustrate the case where the viewer terminal 300 is a stationary computer (PC) and the display device 310 is a stationary display. However, for example, when the viewer terminal 300 is a smartphone P or a tablet, in the case of the viewpoint video of the virtual camera C1, it is displayed as shown in FIG. 14(a), and when the viewer terminal 300 is the viewer terminal 300 of the viewer avatar 13, it is displayed as shown in FIG. 14(b).

[0143] Next, regarding the audio system, in the distribution server computer 100, music data 113 is reproduced by the audio control program 124 based on the time schedule data (TS data) 112, and is transmitted to the performer terminal 200 as the reproduced music (data) (music reproduction process).

[0144] At the performer terminal 200, the music audio from the reproduced music (data) transmitted from the distribution server computer 100 is output to the performer user through the high - performance earphone (ear monitor) worn by the performer user (reproduced music output process). At the same time, as the performer user sings in accordance with the output reproduced music, the performer voice input from the sound collection microphone (voice input device 222) is digitized and transmitted to the distribution server computer 100 as the performer voice (data).

[0145] The distribution server computer 100 generates distribution audio (data) from the performer voice based on the performer voice (data) received from the performer terminal 200 and the reproduced music reproduced in the above - mentioned music reproduction process (distribution audio generation process), and distributes the generated distribution audio (data) to the viewer terminal 300 (generated audio distribution process).

[0146] At the viewer terminal 300, the distribution audio is output from the audio output device 322 such as an earphone or a speaker based on the distribution audio (data) distributed from the distribution server computer 100, so that the viewer can hear the live audio as if the performer avatar 1 is singing in a virtual live venue.

[0147] In addition, at the performer terminal 200, as described above, the performer voice (data) is transmitted to the distribution server computer 100, and as shown in FIG. 10, by executing the monitor voice generation process and the monitor voice output process, the music audio of the reproduced music and the performer voice are output from the speaker arranged in the adjustment room, so that the assistant operator O etc. can confirm the singing situation etc. of the performer user in the adjustment room.

[0148] <Viewer Perspective Video Control Process> Next, the viewer perspective video control process executed based on the viewer perspective video control program included in the viewer program in the viewer terminal 300 will be described with reference to FIG. 20.

[0149] In the viewer perspective video control process, first, it is determined whether or not the performer avatar 1 is in the flying production period of virtual flight as shown in FIG. 19 (step S1). Whether or not it is in the flying production period can be specified by the production state data indicating that it is in the flying production period from the distribution server computer 100. Incidentally, the distribution server computer 100 transmits the production state data indicating that it is in the flying production period to the viewer terminal 300 when it becomes the flying production period based on the time schedule data.

[0150] If it is in the flying production period (Y in step S1), the process proceeds to step S21. On the other hand, if it is not in the flying production period (N in step S1), it is determined whether or not the perspective-related operations including the movement operation of the perspective (including the change of the perspective by the movement operation or the action operation of the avatar) and the zoom operation are disabled (step S2).

[0151] If the perspective-related operations are disabled (Y in step S2), the process proceeds to step S7. If the perspective-related operations are not disabled (N in step S2), it is determined whether or not there are operations that change the perspective such as the movement operation or the action operation of the avatar (step S3). If there is an operation (Y in step S3), the viewer perspective is changed according to the operation. If there is no operation (N in step S3), the process proceeds to step S5 to determine whether or not there is a zoom operation (step S5).

[0152] If there is a zoom operation (Y in step S5), the video area displayed on the display device 310 is changed to the video area corresponding to the operation. If there is no zoom operation (N in step S5), it is determined whether or not there is an action following setting (step S7).

[0153] This motion tracking setting can be arbitrarily set on the viewer terminal 300, for example, before or during the live broadcast, according to the type of device the viewer user uses for operations and their proficiency in operations. Specifically, for example, when not accustomed to operating the operation input device 321 such as the touch panel, keyboard, game controller, etc. used, or when not accustomed to changing the viewpoint by moving or operating the avatar, as described later, the virtual participation position of the viewer's own avatar is far from the performer avatar 1 and is enlarged and displayed in a zoomed-in state, so that even a slight movement of the performer avatar 1 may cause the performer avatar 1 not to be properly displayed. It is set in cases where the viewpoint cannot be properly changed in response to the movement or operation of the performer avatar 1, etc.

[0154] If there is no motion tracking setting (N in step S7), the process proceeds to step S11. On the other hand, if there is a motion tracking setting (Y in step S7), it is further determined whether the motion tracking condition is satisfied (step S8).

[0155] In the first embodiment, the motion tracking condition is defined as a condition under which it is almost certain that the performer avatar 1 is not properly displayed on the display device 310. Specifically, when the head (or face) of the performer avatar 1 enters a predetermined range near the periphery of the display area of the display device 310, since the possibility that the head (or face) moves outside the display area and is not properly displayed due to the movement or operation of the performer avatar 1 is extremely high, it is determined that the motion tracking condition is satisfied.

[0156] Thus, in the first embodiment, by determining that the motion tracking condition is satisfied before the head (face) of the performer avatar 1 disappears from the display area, it is possible to significantly reduce the situation where the head (face) of the performer avatar 1 disappears from the display area. However, the present invention is not limited to this, and these motion tracking conditions may be based on the condition that the head (face) has moved outside the display area, or other conditions may be used as the motion tracking conditions. That is, as long as these motion tracking conditions can prevent the performer avatar 1 from being poorly displayed in the display area, any conditions can be used.

[0157] When the motion tracking condition is satisfied (Y in step S8), after invalidating the viewpoint-related operation (step S12), as the viewpoint video displayed in the display area of the display device 310, the viewpoint is automatically changed to the motion tracking viewpoint where the head (face) of the performer avatar 1 is within the non-established range surrounded by a predetermined range around the display area, and the viewpoint video seen from the motion tracking viewpoint is displayed in the display area of the display device 310 (step S13).

[0158] On the other hand, when the motion tracking condition is not satisfied (N in step S8), it is further determined whether the viewpoint-related operation is invalidated (step S9). If the viewpoint-related operation is invalidated (Y in step S9), the invalidated viewpoint-related operation is enabled (step S10) and then proceed to step S11. If the viewpoint-related operation is not invalidated (N in step S9), it proceeds to step S11 without passing through step S10.

[0159] In step 11, due to the motion tracking setting not being set or the motion tracking condition not being satisfied, the viewpoint video of the viewer avatar continues to be displayed in the display area of the display device 310 (step S11).

[0160] Also, as described above, when it is the flying performance period in which the performer avatar 1 virtually flies during the live broadcast, it is determined as Y in step S1 and proceeds to step S21, and it is determined whether it is the start timing of the flying performance period (step S21).

[0161] If it is the start timing of the flying performance period (Y in step S21), instead of the viewpoint video or the motion-following viewpoint video of the viewer avatar that was displayed in the display area of the display device 310 before the start of the flying performance period, the flying viewpoint video distributed from the distribution server computer 100 is displayed (step S22), and then, the viewpoint-related operation is invalidated (step S23), and it returns to step S1.

[0162] In addition, in the present Example 1, during the flying performance period, since the same flying viewpoint video is displayed on the viewer terminals 300 of all viewer users, rather than generating the flying viewpoint video on each viewer terminal 300 side like different viewer avatar viewpoint videos for individual viewer users, it is generated on the distribution server computer 100 side and distributed to the viewer terminals 300, so that even for the viewer terminal 300 with low processing power, the flying viewpoint video with a large drawing load due to the aerial movement of the viewpoint can be displayed well. However, the present invention is not limited to this, and these flying viewpoint videos may be generated on each viewer terminal 300 side in the same manner as the viewer avatar viewpoint videos.

[0163] On the other hand, if it is not the start timing of the flying performance period (N in step S21), it is further determined whether it is the end timing of the flying performance period (step S24).

[0164] Whether it is the end timing of the flying performance period may be specified based on the data indicating the end included in the data of the flying viewpoint video transmitted from the distribution server computer 100, or may be specified by the above-described performance state data different from the flying viewpoint video.

[0165] If it is not the end timing of the flying effect period (N in step S24), that is, if it is during the flying effect period, the process proceeds to step S26. After updating the flying perspective video, the process returns to step 1. On the other hand, if it is the end timing of the flying effect period (Y in step S24), after enabling the viewpoint-related operation (step S25), the process proceeds to step S11. Instead of the flying perspective video that was displayed in the display area of the display device 310 during the flying effect period, the viewpoint video of the viewer avatar is displayed in the display area of the display device 310, and then the process returns to step 1.

[0166] In this way, by executing the viewer viewpoint video control process shown in FIG. 20 in the viewer terminal 300 of the first embodiment, each viewpoint video displayed on the viewer terminal 300 will be described with reference to FIGS. 16 to 19.

[0167] FIG. 16 is a diagram showing the display content of the display device 310 when a zoom operation is performed on the viewer terminal 300 of the first embodiment. In the default state where no zoom operation is performed, as shown in FIG. 16(a), the viewpoint video of the video area centered on the upper body of the performer avatar 1 is displayed. In this default state, if the viewer user performs a zoom-in operation, for example, if the viewer terminal 300 is a smartphone P, an operation of touching the display of “+” (not shown), or if the viewer terminal 300 is a computer (PC), when the “+” key on the keyboard is operated, for example, as shown in FIG. 16(b), the viewpoint video of the video area centered on the head (face) of the performer avatar 1 is displayed.

[0168] On the other hand, if the viewer user performs a zoom-out operation, for example, if the viewer terminal 300 is a smartphone P, an operation of touching the display of “-” (not shown), or if the viewer terminal 300 is a computer (PC), when the “-” key on the keyboard is operated, for example, as shown in FIG. 16(c), the viewpoint video of the video area including the entire body of the performer avatar 1 is displayed.

[0169] Also, in FIG. 16, for the sake of easy understanding of the zoom function, the description was made using the perspective video of the virtual camera C1 instead of the perspective of the viewer avatar. However, as shown in FIG. 17, zooming in and zooming out can also be performed in the same way for the perspective of the viewer avatar.

[0170] In addition, in the viewer perspective video control process of FIG. 20, although not described in detail, for example, when the live broadcast starts and the performer avatar 1 first appears on the virtual stage G, since the perspective of the viewer avatar is not facing the performer avatar 1, there is a possibility that the period during which the appearing performer avatar 1 is not displayed on the viewer terminal 300 becomes long. Thus, the period when the performer avatar 1 first appears, etc. is set as the appearance performance period, etc. During these performance periods, the perspective video displayed on the viewer terminal 300 is automatically switched to the perspective video of the virtual camera C1, etc. instead of the perspective video of the listener avatar, and zooming in, etc. can also be made possible for each viewer user to execute in these perspective videos of the virtual camera C1.

[0171] FIG. 17 shows, as an example of the perspective video of the viewer avatar, the perspective video of the viewer avatar 28 who is virtually participating in the fourth area. As shown in FIG. 17, the perspective video of the viewer avatar 28 includes the heads of the viewer avatars 13 and 14 who are virtually participating in the third area, and it becomes a video in which the performer avatar 1 can be seen through the heads of these viewer avatars 13 and 14.

[0172] Therefore, the viewer user of the viewer avatar 28 can, for example, perform a zoom-in operation and change to a video area where the upper body of the performer avatar 1 is centrally displayed as shown in FIG. 17(b), so that the viewer avatars 13 and 14 are not displayed and enjoy the live broadcast.

[0173] However, as shown in Fig. 17(b), in the zoomed-up state, for example, when the live event progresses and the performer avatar 1 moves or makes large movements, if the viewer cannot successfully change the viewpoint of the viewer avatar 28 according to the movements of these performer avatars 1, as shown in Figs. 18(d) to (f), there may be a situation where the performer avatar 1 is not displayed well. Therefore, by paying attention to the operation of the viewpoint, it becomes difficult to concentrate on the live event, and there may be a case where the live event cannot be enjoyed well.

[0174] However, in the first embodiment, as described above, when the viewer user performs the motion tracking setting, as shown in Figs. 18(a) to (c), when the head of the performer avatar 1 enters a predetermined area around the display area, the motion tracking condition is satisfied and the viewpoint is automatically changed to the motion tracking viewpoint, and the viewpoint video of the motion tracking viewpoint is displayed. Therefore, the viewer user does not need to pay attention to the operation of the viewpoint, and can concentrate on the live event and enjoy the live event well.

[0175] Then, when the live event progresses to the flying effect period, as shown in Fig. 19, the viewpoint video of each viewer avatar is automatically changed to the flying viewpoint video seen from the aerial moving virtual camera without the viewer user's operation.

[0176] Specifically, before the performer avatar 1 makes a virtual flight, a video in which the object of the wings becomes larger on the back of the performer avatar 1 is displayed. Then, when the performer avatar 1 looks up at the virtual aerial object 50 of the star that is virtually arranged in the second area of the virtual live venue, the viewpoint of the viewer avatar also moves in the same way. At this time, a light effect 61 appears around the performer avatar 1.

[0177] After that, when the performer avatar 1 moves to the virtual flight, the viewpoint video displayed on the display device 310 automatically switches from the viewpoint video of the viewer avatar up to Fig. 19(b) to the flying viewpoint video seen from the aerial moving virtual camera as shown in Fig. 19(c).

[0178] And during the flying effect period, as described above, the virtual camera in the air moves within the second area based on the preset air trajectory, and the flying perspective video seen from these virtual cameras moving in the air is displayed on the display device 310 as shown in FIG. 19(d).

[0179] <Modification Example of Embodiment 1> In the above-described Embodiment 1, the general operation (the first operation) is an operation in which the performer avatar 1 stands without moving to the virtual stage G, the special operation (the second operation) is an operation in which the performer avatar 1 performs virtual flight, and the specific operation (the third operation) is an operation in which the performer avatar 1 makes a sudden lateral movement. However, the present invention is not limited to this, and it may be an operation according to the content to be distributed. For example, the general operation (the first operation) may be an operation (normal operation) that the performer avatar executes for the longest period in the content to be distributed. The special operation (the second operation) may be an operation executed during a special period that is the shortest period or an operation with the lowest frequency in the content to be distributed. The specific operation (the third operation) may be an operation whose execution period is shorter than that of the general operation (the first operation) but longer than that of the special operation, or an operation whose execution frequency is lower than that of the general operation (the first operation) but higher than that of the special operation. Note that the special operation (the second operation) may include the specific operation (the third operation).

[0180] Also, in the above-described Embodiment 1, an example is shown in which it has both functions: a switching function to a viewpoint corresponding to the special operation (the second operation) and a following function that follows the specific operation (the third operation). However, the present invention is not limited to this, and it may be a virtual space content distribution system having only one of these functions.

[0181] In the above-described Example 1, a form in which the viewpoint of the viewer user is changed and followed according to the actions of the performer avatar was exemplified. However, the present invention is not limited to this. For example, these changes and followings of the viewpoints may be executed according to specific effects such as the setup of smoke or fireworks (fire pillars), special lighting, or the transformation of the virtual stage G, which are effects in the virtual stage G.

Example

[0182] Next, the virtual space content distribution system of Example 2 will be described below with reference to FIGS. 21 to 28. Regarding the same configuration as that of Example 1, the same reference numerals will be used and the description will be omitted.

[0183] The configuration of the virtual space content distribution system of Example 2 is the same as the configuration of Example 1 shown in FIG. 1. However, due to the different progress of the virtual live, the periods during which the viewpoint videos from the virtual cameras C1 to C4 and the airborne moving virtual camera (hereinafter collectively referred to as virtual camera viewpoint videos) are distributed, and the entities that generate these virtual camera viewpoint videos are different from those of Example 1, which are the characteristic parts of this Example 2.

[0184] FIG. 21 is a diagram showing the progress of the virtual live distributed in the virtual space content distribution system of Example 2. In the virtual live of Example 2, first, as periods before the start of the virtual live, a "period when the virtual live space can be participated in" and a "pre-opening explanation" period are provided. The viewer user can virtually participate in the virtual live venue, which is the target virtual space of the virtual live, during the period when the virtual live space can be participated in.

[0185] Furthermore, the period until the pre-data DL completion check timing set near the end of the "pre-show explanation" period is defined as the pre-data download (DL) period. During the period when participation in the live virtual space is possible, virtual space data (basic data) of the virtual live venue, avatar data of the performer avatar 1, and avatar data of other viewer users who participated virtually are downloaded (DL) from the distribution server computer 100 as pre-data to the viewer terminals 300 of the viewer users who participated virtually.

[0186] Also, at the pre-data DL completion check timing, which is the end timing of the pre-data download (DL) period, it is checked whether the download (DL) of the pre-data has been completed on each viewer terminal 300.

[0187] Furthermore, if the download (DL) of the pre-data has not been completed by the pre-data DL completion check timing due to differences in the models, processing capabilities, communication environments, etc. of the viewer terminals 300, the download (DL) of the pre-data is continued. However, in this case, data that is highly important in the distribution of the virtual live, such as virtual space data (basic data) of the virtual live venue required for the opening performance and the first MC, avatar data of the performer avatar 1, etc., is preferentially downloaded (DL).

[0188] Also, in the second embodiment, as described above, an example is given of the form in which data required to generate a viewpoint video on the viewer terminal 300 in the distribution of the virtual live is downloaded (DL) as pre-data. However, the present invention is not limited to this, and for these data, particularly special data that is individually required in each performance item and each MC described later, etc., they may be downloaded (DL) sequentially each time at a timing corresponding to the timing when each of these performance items and each MC is distributed.

[0189] During the "pre-show speech" period, explanations about the virtual live show are given by video footage, etc. Therefore, by making the "pre-show speech" period a period during which advance data can be downloaded (DL), each viewer terminal 300 can also download (DL) from the distribution server computer 100 the avatar data of viewer avatars who virtually participated in the live virtual space just before the end of the participation period.

[0190] As shown in FIG. 21, the virtual live performance of Example 2 progresses as follows: "Opening performance" → "First MC" → "First performance" → "Second MC" → "Second performance" ... "Opening performance" is a performance in which the performer avatar 1 appears on the virtual stage G. In the "First MC", the performer avatar 1 appears on the virtual stage G, greets the audience through a talk, and introduces the first performance that will be performed first. The "First performance" is a performance that includes singing and dancing by the performer avatar 1 (performer), and also includes a flying performance in the middle of the performance, in which the performer avatar 1 virtually flies through the virtual live venue and is virtually captured by a virtual camera moving in the air. In the "Second MC", the performer avatar 1 (performer) mainly introduces the second performance through a talk. The "second performance" includes singing and dancing by the performer avatar 1 (performer), and also includes a costume change performance using footage virtually captured by the virtual camera C1 of the performer avatar 1 changing clothes, and a clone performance using footage virtually captured by the virtual camera C1 of the performer avatar 1 cloned into multiple people.

[0191] As the processing load of the distribution server computer 100 during each period in which each of these performances, programs, etc. is executed, the "lowest" is during the period when the live virtual space can be participated in, while the "highest" is during the period when the special performances "Flying Performance", "Costume Change Performance", and "Doppelganger Performance" are executed. During the period of the "Pre-Show Explanation", "Opening Performance", "First MC", and "First Program" up to the "Flying Performance", the processing load of the distribution server computer 100 is "medium". During the period of the "First Program" after the "Flying Performance", the period of the "Second MC", and the period of the "Second Program" up to the "Costume Change Performance", the processing load is also "medium". The period of the "Second Program" from the "Costume Change Performance" to the "Doppelganger Performance" is also "medium", and the period of the "Second Program" after the "Doppelganger Performance" is also "medium".

[0192] Next, regarding each period in the virtual live of Example 2, the viewpoint videos viewable on the viewer terminal 300 will be described. During the period when the live virtual space can be participated in from virtual participation until the "Pre-Show Explanation" starts, only the viewer avatar viewpoint video is displayable.

[0193] And at the timing when the "Pre-Show Explanation" starts, only the virtual camera viewpoint video, specifically, the viewpoint video of the virtual camera C1, is displayable. Thus, even though it is before the start of the virtual live, setting the viewpoint video in the "Pre-Show Explanation" to only the virtual camera viewpoint video is for the purpose of preventing the occurrence of viewer users who do not watch the pre-show explanation being conducted on the virtual stage G because the pre-show explanation also includes explanations of precautions regarding the virtual live, and the viewer avatar viewpoint video is being displayed on the viewer terminal 300.

[0194] Incidentally, as will be described later, these virtual camera viewpoint videos of the "Pre-Show Explanation" are generated by the distribution server computer 100 and distributed to each viewer terminal 300, so they can also be displayed on viewer terminals 300 where the download of pre-data is not yet complete.

[0195] For the viewer terminal 300 for which the download of the pre-data has been completed at the above-described pre-data DL completion check timing, during the period of the "First Act" from "First MC" to "Flying Performance", and during the period after the "Flying Performance", in addition to the virtual camera viewpoint video, the viewer avatar viewpoint video can be displayed.

[0196] On the other hand, for the viewer terminal 300 for which the download of the pre-data has not been completed at the above-described pre-data DL completion check timing, since the viewer avatar viewpoint video cannot be accurately generated, by delivering the virtual camera viewpoint video generated in the distribution server computer 100, only the virtual camera viewpoint video can be displayed during all periods of the virtual live, and the viewer avatar viewpoint video cannot be displayed.

[0197] Also, among the videos of the "Flying Performance", "Costume Change Performance", and "Doppelganger Performance" for which the processing load of the distribution server computer 100 is "high", the virtual camera viewpoint videos of the virtual camera C1 for the "Costume Change Performance" and "Doppelganger Performance" are generated not in the distribution server computer 100 but in each viewer terminal 300, similar to the virtual camera viewpoint videos during the second act period other than these "Costume Change Performance" and "Doppelganger Performance", so as to reduce the processing load of the distribution server computer 100 for generating the virtual camera viewpoint videos of the virtual camera C1 for these "Costume Change Performance" and "Doppelganger Performance".

[0198] Furthermore, regarding the period of the "flying performance" as well, since it is a period with a high processing load in the distribution server computer 100, it is conceivable to generate it in the viewer terminal 300 like the "costume change performance" and the "duplication performance". However, in this case, since it is necessary to distribute detailed trajectory data of the movement trajectory of the airborne virtual camera moving within the virtual live venue to each viewer terminal 300 in advance to generate the video, in the second embodiment, the distribution server computer 100 generates and distributes the video of the "flying performance". However, the present invention is not limited to this, and the video of the "flying performance" may also be generated in each viewer terminal 300 for the purpose of reducing the processing load of the distribution server computer 100.

[0199] Here, the participant user table used in the distribution server computer 100 of the second embodiment will be briefly described with reference to FIG. 23.

[0200] The participant user table is a data table used to identify the participation status of viewer users in the virtual live and the download status of pre-data, etc. in each virtual live event registered in the event data shown in FIG. 7. As shown in FIG. 23, it is a table that can store data such as participation identification data (participation identification flag) that can identify the participation status of the participant (viewer user) in association with the participant ID (viewer user ID), the participation area of the participant (viewer user), and pre-data DL identification data (pre-data DL identification flag) that can identify the download status of pre-data.

[0201] Furthermore, in the item of the participant ID, all the viewer user IDs of the participants scheduled to watch described in the files of each participant group stored corresponding to the virtual live in the event data are registered and used.

[0202] The participation identification data (participation identification flag) is registered with "0" corresponding to the non-participation state when registering the participant ID (viewer user ID), and is updated to "1" indicating participation when the participation of each participant (viewer user) is permitted by authentication. Therefore, based on this participation identification data (participation identification flag), it is possible to identify among the prospective viewer users who are participating viewer users and those viewer users who could not participate for some reason.

[0203] The data of the participation area is data that can identify whether the participation area of each participant (viewer user) is the third area or the fourth area, and is the data registered when the participation of each participant (viewer user) is permitted by authentication.

[0204] The pre-data DL identification data (pre-data DL identification flag) is updated from "0" indicating incomplete to "1" indicating complete based on the check of whether the download (DL) of the pre-data is complete at the pre-data DL completion check timing described above. Therefore, based on these pre-data DL identification data (pre-data DL identification flag), it is possible to easily identify all the participants (viewer users) among the virtual participating participants (viewer users) whose pre-data download (DL) is not complete.

[0205] Next, the flow in which pre-data is downloaded when a viewer user virtually participates in a virtual live venue in Example 2 will be described with reference to FIG. 22.

[0206] First, the viewer user executes a participation operation for a virtual live that the user plans to virtually participate in, for example, selects a participation menu or operates a specific key to which a participation operation is assigned on the keyboard, in the viewer program (viewing app) being executed on the viewer terminal 300.

[0207] By executing this participation operation, a participation request including the viewer user ID and authentication data for authenticating the viewer user is sent from the viewer terminal 300 to the distribution server computer 100.

[0208] In the distribution server computer 100 that has received the participation request, participant authentication processing is executed on the condition that it is within the live virtual space participation period. In the participant authentication processing, whether the viewer user is a scheduled participant in the virtual live corresponding to the received participation request is determined by whether the viewer user ID included in the received participation request is registered as a participant ID in the participant user database corresponding to the virtual live to be participated in. At the same time, in the viewer user data shown in FIG. 9, the authentication data described in the authentication information file specified from the authentication information file data stored in association with the viewer user ID is collated with the authentication data included in the participation request to authenticate the viewer user.

[0209] When the viewer user is a scheduled participant and the authentication by the authentication data is completed, the participation identification data (participation identification flag) in the participant user table is updated to "1" corresponding to "participation".

[0210] Then, the distribution server computer 100 transmits (returns) pre-data DL instruction information to the viewer terminal 300 that is the transmission source of the participation request in order to cause it to download pre-data corresponding to the virtual live to be participated in. The viewer terminal 300 can confirm that participation is permitted by receiving the pre-data DL instruction information.

[0211] In response to receiving the pre-data DL instruction information, the viewer terminal 300 specifies the pre-data to be downloaded and transmits a pre-data DL request for requesting the download of the specified pre-data to the distribution server computer 100.

[0212] In response to receiving this pre-data DL request, the distribution server computer 100 executes pre-data transmission processing.

[0213] In this pre-data transmission process, the pre-data requested for the viewer terminal 300 that is the source of the pre-data DL request is transmitted. Note that, as described above, the pre-data includes virtual space data (basic data) of the virtual live venue, avatar data of the performer avatar 1, and avatar data of other viewer users who have already virtually participated, etc.

[0214] Note that, in the pre-data transmission process, for the viewer terminal 300 of a viewer user who is a viewer terminal 300 other than the source of the pre-data DL request and for whom participation has already been confirmed by the participant data table, the avatar data of the viewer user who is the source of the pre-data DL request is additionally distributed as pre-data. As a result, on the viewer terminal 300 of each viewer user who has virtually participated in the virtual live, in addition to the virtual space data (basic data) and the avatar data of the performer avatar, the avatar data of all viewer users who have virtually participated in the virtual live is pre-distributed and stored in advance.

[0215] Then, for the pre-data stored in the viewer terminal 300 in this way, it is confirmed whether or not the download of all the pre-data has been completed at the above-described pre-data DL completion check timing (see FIG. 21). When the download of the pre-data has been completed, the pre-data DL identification data (pre-data DL identification flag) in the participant user table is updated from "0" indicating incomplete to "1" indicating completion.

[0216] Note that, for a participant (viewer user) for whom the pre-data DL identification data (pre-data DL identification flag) remains "0" indicating incomplete because the download of the pre-data has not been completed, as described above, only the virtual camera viewpoint video is made displayable.

[0217] Next, the situation where the entity that generates the various viewpoint videos displayed on the viewer terminal 300 changes in each period of the virtual live will be described with reference to FIGS. 24 to 27.

[0218] First, during the live virtual space participation period in which only the viewer avatar perspective video can be displayed on the viewer terminal 300, as shown in FIG. 24, based on the virtual space update data including the actor avatar operation data for generating the operation of the actor avatar 1 that performs an operation linked to the operation of the actor user, which is transmitted from the distribution server computer 100, the virtual space data already stored in the viewer terminal 300 by receiving the pre-data is sequentially updated. Based on the updated virtual space data, the viewer perspective video generation process is executed on the viewer terminal 300 to generate the viewer avatar perspective video, which is output (displayed) by the video output process. In FIG. 24, the actor terminal 200 is omitted, but the virtual space update data is also transmitted to the actor terminal 200 as shown in FIG. 10 in the first embodiment.

[0219] Also, for each of the periods of "pre-opening explanation", "opening performance", and "flying performance" in which only the virtual camera perspective video can be displayed on the viewer terminal 300, as shown in FIG. 25, in the distribution server computer 100, in the virtual space update data distribution process, the virtual space update data is transmitted only to the actor terminal 200. Then, the virtual camera perspective video generation process for generating the virtual camera perspective video following the virtual space update data distribution process, and the virtual camera perspective video data distribution process for distributing the video data of the virtual camera perspective video generated in the virtual camera perspective video generation process to all the viewer terminals 300 participating in the virtual live are executed.

[0220] The virtual camera perspective video data distributed from the distribution server computer 100 in these virtual camera perspective video data distribution processes is displayed on the viewer terminal 300 that has received the virtual camera perspective video data by executing the video output process.

[0221] That is, as shown in FIG. 27, for each period of "pre-show explanation", "opening show", and "flying show" in which only the virtual camera viewpoint video can be displayed, the virtual camera viewpoint video is generated in the distribution server computer 100.

[0222] Also, during the performance period except for the MC period and the flying show period, which are periods in which either the viewer avatar viewpoint video or the virtual camera viewpoint video can be selected and displayed on the viewer terminal 300, as shown in FIG. 26, by executing the virtual space update data distribution process in the distribution server computer 100, virtual space update data is distributed to the viewer terminals 300 of each viewer user participating in the virtual live, and the virtual space update process is executed in the viewer terminal 300.

[0223] Then, in the viewer terminal 300, it is determined whether or not the viewer avatar viewpoint video is selected as the video to be displayed. When the viewer avatar viewpoint video is selected, in the same flow as shown in FIG. 24, the viewer viewpoint video generation process is executed to generate the viewer avatar viewpoint video, and the generated viewer avatar viewpoint video is displayed by the video output process.

[0224] On the other hand, when the viewer avatar viewpoint video is not selected as the video to be displayed, that is, when the virtual camera viewpoint video is selected as the video to be displayed, the virtual camera viewpoint video generation process is executed in the viewer terminal 300 to generate the virtual camera viewpoint video, and the generated virtual camera viewpoint video is displayed by the video output process.

[0225] In addition, for the virtual camera viewpoint video generated in this virtual camera viewpoint video, the viewer user may be able to select whether it is the viewpoint video of any of the virtual cameras C1, C3, or C4, or the distribution server computer 100 may instruct all the viewer terminals 300.

[0226] That is, as shown in FIG. 27, during the performance period excluding the MC period and the flying effect period in which either the virtual camera viewpoint video or the viewer avatar viewpoint video can be displayed on the viewer terminal 300, the virtual camera viewpoint video is generated on the viewer terminal 300. In this way, for the period in which either the virtual camera viewpoint video or the viewer avatar viewpoint video can be selected and displayed on the viewer terminal 300, since the mutual switching between the virtual camera viewpoint video and the viewer avatar viewpoint video is executed according to the selection of the viewer user, compared with the case of displaying the virtual camera viewpoint video data by distribution from the distribution server computer 100, it is possible to execute the switching of these videos without causing problems such as the video being interrupted, and while preventing an increase in the processing load of the distribution server computer 100 associated with the switching of these videos.

[0227] On the other hand, for each of the periods of "pre-performance explanation", "opening performance", and "flying effect", which are periods in which only the virtual camera viewpoint video can be displayed on the viewer terminal 300, the virtual camera viewpoint video is generated only on the distribution server computer 100 and distributed to each viewer terminal 300. In this way, during the period in which only the virtual camera viewpoint video can be displayed on the viewer terminal 300, since the virtual camera viewpoint video is generated only on the distribution server computer 100, it is possible to prevent the processing load of the entire system from increasing uselessly due to the processing of generating the virtual camera viewpoint video being duplicated on the viewer terminal 300.

[0228] Here, the situation when the viewpoint video is switched on the viewer terminal 300 will be described using FIG. 28, taking the "flying effect" period, which is a period in which only the virtual camera viewpoint video can be displayed, as an example.

[0229] For example, as shown in FIG. 28, in the viewer terminal 300 where the viewer avatar viewpoint video is being displayed during the period of "First MC" and the period of the first act up to the "Flying Performance", when the period of the "Flying Performance" during which only the virtual camera viewpoint video (viewpoint video from the airborne virtual camera) can be displayed starts, and the distribution server computer 100 starts distributing the virtual camera viewpoint video (viewpoint video from the airborne virtual camera), there is a risk that the virtual camera viewpoint video (viewpoint video from the airborne virtual camera) will not be displayed on the viewer terminal 300 during the period from the start of this distribution until the virtual camera viewpoint video is displayed, resulting in a problem where the viewer cannot view the first video of the "Flying Performance".

[0230] Therefore, as shown in FIG. 28, the distribution server computer 100 of Example 2, at the start of the "Flying Performance" where the viewpoint video is forcibly changed from the viewer avatar viewpoint video to the virtual camera viewpoint video (viewpoint video from the airborne virtual camera), notifies the viewer terminal 300 of the BF prior notice at a specific timing earlier than the start timing of the "Flying Performance", thereby notifying the viewer terminal 300 of the distribution start (buffering start) timing to start pre-distributing the virtual camera viewpoint video (viewpoint video from the airborne virtual camera) before the start of the flying performance period.

[0231] In response to receiving the BF prior notice, the viewer terminal 300 identifies the timing when the distribution of the virtual camera viewpoint video (viewpoint video from the airborne virtual camera) starts from the distribution server computer 100, and starts buffering the received virtual camera viewpoint video (viewpoint video from the airborne virtual camera) when that timing arrives.

[0232] The timing when the distribution of these virtual camera viewpoint videos (viewpoint videos from the airborne virtual camera) starts, that is, the timing to start buffering, may be appropriately determined in consideration of the differences in the video storage functions of the viewer terminal 300. For example, it may be a period corresponding to several tens of frames as the number of video frames.

[0233] In this way, before the start of the flying performance period, the distribution server computer 100 of the second embodiment starts generating and distributing the virtual camera viewpoint video (the viewpoint video from the virtual camera moving in the air) of the flying performance. Since the viewer terminal 300 buffers the distributed virtual camera viewpoint video, when the flying performance period starts, the video can be instantaneously changed from the viewer avatar viewpoint video displayed before the start of the flying performance period to the virtual camera viewpoint video. Thus, it is possible to prevent the problem that the viewer cannot view the first video of the "flying performance".

[0234] Also, when the "flying performance" period ends, since the viewer avatar viewpoint video was selected before the start of the "flying performance", the viewpoint video switches from the virtual camera viewpoint video (the viewpoint video from the virtual camera moving in the air) of the flying performance to the viewer avatar viewpoint video in response to the end of the "flying performance" period. Even in this case, if the viewer avatar viewpoint video is generated and displayed starting from when the "flying performance" period ends, similar to the start of the "flying performance", there is a risk of a problem that the viewer avatar viewpoint video is not displayed on the viewer terminal 300 during the period until the viewer avatar viewpoint video is generated and displayed.

[0235] Therefore, even when the "flying performance" period ends, the distribution server computer 100 of the second embodiment notifies the viewer terminal 300 of the end timing in advance as shown in FIG. 28 by sending a pre-notification of the end TM (timing), thereby notifying the viewer terminal 300 in advance of the end timing of the "flying performance" period when the distribution of the virtual camera viewpoint video (the viewpoint video from the virtual camera moving in the air) ends.

[0236] In response to receiving the end TM (timing) advance notice, the viewer terminal 300 identifies in advance the timing at which the distribution of the virtual camera viewpoint video (viewpoint video from the airborne virtual camera) stops from the distribution server computer 100, and starts the viewer viewpoint video generation process from a predetermined timing before that timing to pre-generate the viewer avatar viewpoint video.

[0237] In addition, from the time of sending the end TM (timing) advance notice, the distribution server computer 100 executes the distribution of the virtual space update data, so the viewer terminal 300 executes the virtual space process of updating the virtual space data with the received virtual space update data. Therefore, at the above-mentioned predetermined timing, it is possible to generate a viewer avatar viewpoint video reflecting the situation of the virtual live venue at that time.

[0238] As described above, the distribution server computer 100 of the second embodiment sends the end TM (timing) advance notice to the viewer terminal 300 before the end of the flying effect period, so that the viewer terminal 300 can pre-generate the viewer avatar viewpoint video before the end of the flying effect period. Therefore, it is possible to prevent the problem that the viewer avatar viewpoint video is not displayed on the viewer terminal 300.

[0239] In addition, in FIG. 28, the "flying effect" is used as an example for explanation, but the same control is also performed for the periods of the "pre-opening explanation" and the "opening effect" in which the viewpoint video is forcibly changed from the viewer avatar viewpoint video to the virtual camera viewpoint video.

[0240] In the virtual space content distribution system of the second embodiment described above, there are a plurality of viewer users, and a viewer terminal 300 is assigned to each viewer user. When the viewer terminal 300 displays a viewer avatar perspective video, which is a perspective video of a virtual live venue (virtual space) corresponding to the viewer avatar, it is generated based on virtual space update data (virtual space data) transmitted from the distribution server computer 100. Since the generation of the viewer avatar perspective video, which involves a large processing load, is performed by the viewer terminal 300, more viewer users can participate in the virtual live event.

[0241] Also, the virtual space content of the second embodiment is content in which a performer user can participate in the virtual live venue as the performer avatar 1, and since the performer avatar 1 performs musical actions (performances) such as singing and dancing in the virtual live venue, the interest of the virtual space content can be improved.

[0242] In addition, since the virtual space update data (virtual space data) of the second embodiment includes action data for the performer avatar for generating the actions of the performer avatar 1, the actions of the performer avatar 1 can also be accurately reflected in the viewer avatar perspective video generated on the viewer terminal 300.

[0243] Regarding the common perspective videos commonly displayed on each viewer terminal 300 in the second embodiment, such as the videos of "pre-show explanation", "opening performance", and "flying performance", they are generated on the distribution server computer 100 and distributed to each viewer terminal 300. Therefore, it is possible to prevent the processing load of the entire system from increasing unnecessarily due to duplicate processing being executed on each viewer terminal 300.

[0244] Also, in the viewer terminal 300 of Example 2, during the performance period (specific period) other than the "MC period" and the period of the "flying effect", which is the period in which either the viewer avatar viewpoint video or the virtual camera viewpoint video can be selected and displayed, since the virtual camera viewpoint video is generated and displayed on the viewer terminal 300, it is possible to prevent problems such as the video being interrupted when the viewpoint video is switched.

[0245] Also, in the periods of the "costume change effect" and the "duplication effect", which are special periods with a large processing load on the distribution server computer 100 of Example 2, each viewer terminal 300 also generates and displays the virtual camera viewpoint video (common viewpoint video), so it is possible to prevent the processing load on the distribution server computer 100 from temporarily becoming extremely large.

[0246] Also, since the distribution server computer 100 of Example 2 pre-transmits the preliminary data including the basic data of the virtual live venue (virtual space) and the basic data of the performer avatar 1 and the viewer avatar who virtually participate in the virtual live venue to each viewer terminal 300 before the virtual live starts, it is possible to prevent the occurrence of problems where the viewer avatar viewpoint video is not properly displayed at the start of the virtual live.

[0247] Also, the distribution server computer 100 of Example 2 transmits the virtual camera viewpoint video (common viewpoint video) to the viewer terminal 300 for which the completion of receiving the preliminary data cannot be confirmed. By doing so, while preventing the processing load on the distribution server computer 100 from excessively increasing due to the transmission of basic data and the like after the start of the virtual live, it is also possible to prevent the viewer user from being unable to view the virtual live.

[0248] <Modification Example of Example 2> FIG. 29 is a flowchart showing the processing content of the viewer viewpoint video generation process in Modification Example 2-1 for Example 2.

[0249] In the above-described Example 2, a form in which the viewer avatar viewpoint video including the operation of the performer avatar 1 is always uniformly generated was shown. However, the present invention is not limited to this, and these viewer avatar viewpoint videos may be generated in a plurality of modes with different processing loads in video generation according to the selection of the viewer user on the viewer terminal 300.

[0250] That is, as an example shown in Example 1, the viewer terminal 300 used by the viewer user may be a stationary personal computer (PC) with high processing power, or may be a smartphone terminal or a tablet terminal with relatively lower processing power than a personal computer (PC). It is assumed that terminals with different processing capabilities are used. However, if the viewer avatar viewpoint video is always uniformly generated on such terminals with different processing capabilities, on a terminal with low processing power, the viewer avatar viewpoint video cannot be appropriately generated, and there is a risk that the viewer avatar viewpoint video and the audio may be misaligned, or the viewer avatar viewpoint video may become a discontinuous and unnatural video. Therefore, for example, when generating a viewer avatar viewpoint video including the performer's movement, whether to generate a high-definition viewer avatar viewpoint video including the performer's movement with a high processing load related to video generation or a low-definition viewer avatar viewpoint video including the performer's movement with a low processing load related to video generation may be appropriately selected by the viewer according to the processing power of the terminal being used.

[0251] Specifically, the viewer perspective video generation process executed on the viewer terminal 300 may be as shown in the flowchart of FIG. 29. In this viewer perspective video generation process, first, the mode of generating the actor actions selected by the viewer user on the viewer terminal 300 is specified (step S101). Then, it is determined whether the specified mode of generating the actor actions is a high processing load mode (step S102). If the high processing load mode is selected (Y in step S102), a viewer avatar perspective video including high-definition actor actions is generated (step S103). On the other hand, if the high processing load mode is not selected (N in step S102), a viewer avatar perspective video including low-definition actor actions is generated (step S104).

[0252] Note that in FIG. 29, a form with two modes, namely the high processing load mode and the low processing load mode, is illustrated as an example. However, the present invention is not limited to this, and these processing load modes may be three or more modes.

[0253] Also, in the above-described Example 2 (the same applies to Example 1), a form is illustrated in which all actions including the movement of the viewer avatar of the viewer user are reflected in each viewer avatar by distributing virtual space update data. However, the present invention is not limited to this. For example, as actions of these viewer avatars, actions that are normally not executable and become possible when a special fee is paid, for example, when the viewer terminal 300 enables an operation of performing a special action that can appeal the viewer's own avatar to the actor avatar 1. Since this special action is an action directed to the actor user and not to other viewer users, the virtual space update data including these special actions is not distributed to the viewer terminals 300 of other viewer users, and it may be possible to prevent the processing load of the distribution server computer 100 from increasing excessively by making these special actions executable.

[0254] Thus, when virtual space update data including special operations is not distributed to the viewer terminals 300 of other viewer users, as shown in Modification Example 2-2 of FIG. 30, when the viewer avatar of viewer user A performs a special operation by executing an operation corresponding to the special operation, virtual space update data A corresponding to the fact that the viewer avatar of viewer user A is performing the special operation is transmitted from the distribution server computer 100 to the viewer terminal 300 of viewer user A. However, virtual space update data B indicating that the viewer avatar of viewer user A is not performing the special operation is distributed to the viewer terminal 300 of viewer user B, who is different from viewer user A.

[0255] Therefore, different virtual space update data will be distributed from the distribution server computer 100 to the viewer terminal 300 of viewer user A and the viewer terminal 300 of viewer user B. As a result, the degree of freedom of the virtual space update data can be increased, and different viewer avatar perspective videos can be generated on the viewer terminal 300 of viewer user A and the viewer terminal 300 of viewer user B.

[0256] In addition, based on virtual space update data A, which is different from virtual space update data B distributed to the viewer terminal 300 of viewer user B, the viewer terminal 300 of viewer user A can generate and display a video of the viewer avatar of viewer user A performing a special operation different from the possible operations of the viewer avatar of viewer user B. Therefore, the interest of viewer user A in the virtual live, which is virtual space content, can be improved.

[0257] Also, in the above-described Example 2 (the same applies to Example 1), regarding the viewer avatars virtually participating in the fourth region, although an example is shown in which the avatar forms are normal avatars that differ among individual viewer users, the present invention is not limited to this. For example, for the purpose of reducing the processing load when generating various perspective videos in a virtual live, the viewer avatars of viewer users virtually participating in the fourth region may be made into simple avatars with simplified avatar forms.

[0258] In addition, in FIG. 30, an example is shown for the case of executing a special operation that becomes possible when a special fee is paid. For example, as described above, in the case of using a simple avatar, for normal operations other than the movement of the simple avatar, such as the operation of waving a hand, the operation of knocking a hand, the operation of changing the direction of the viewer avatar, etc., similar to the special operation, it may be made not to be included in the virtual space update data distributed to other viewer users, so that the processing load on the distribution server computer 100 can be further reduced.

Example

[0259] Next, the virtual space content distribution system of Example 3 will be described below with reference to FIGS. 31 to 56. Regarding the same configurations as those in Examples 1 and 2, the same reference numerals will be given and the description will be omitted.

[0260] As shown in FIG. 31, the virtual space content distribution system of Example 3 is provided with the same live progress content as in Example 2. In particular, in this Example 3, during the live, a performance by the avatars of two performers, Performer A and Performer B, is provided.

[0261] After the avatar 1A of the first performer, performer A, appeared immediately after the start of the first MC period, a solo performance by the avatar 1A of the performer A was executed as the first act. After the avatar 1B of the second performer, performer B, appeared at a timing during the second MC period (the number of avatars increased from 1 to 2), a joint performance by the avatar 1A of the performer A and the avatar 1B of the performer B was executed as the second act.

[0262] Also, in this Example 3, it is possible to execute a light emission effect that causes the virtual airborne objects 50 to 52 to emit light as part of the production of the virtual live show. In particular, the light emission effect is not executed during the period when the virtual live venue can be participated in and the period of the pre-show explanation (light emission intensity of the light emission effect: none), but the virtual airborne objects 50 to 52 emit light with a relatively weak light emission intensity during the opening show period, the first MC period, and the second MC period (light emission intensity of the light emission effect: weak), and the virtual airborne objects 50 to 52 emit light with a stronger light emission intensity than during the opening show period, the first MC period, and the second MC period during the first act period and the second act period (light emission intensity of the light emission effect: strong).

[0263] Also, as shown in FIG. 31, since the avatar 1A of the performer A has not appeared until immediately after the start of the first MC period, it is a period without the movement of the avatar 1A of the performer A (movement of the avatar of the performer A: none). The first MC period and the second MC period after the avatar 1A of the performer A appears are periods with relatively little movement of the avatar 1A of the performer A (movement of the avatar of the performer A: small). The first act period and the second act period are periods when the avatar 1A of the performer A dances and sings, so the movement of the avatar of the performer A becomes larger (more intense) than in other periods (movement of the avatar of the performer A: large).

[0264] Similarly, the period until the appearance of the performer avatar 1B of performer B during the second MC period is a period without the operation of the performer avatar 1B of performer B (Performer B's performer avatar operation: none), and the second MC period after the appearance of the performer avatar 1B of performer B is a period with relatively little operation of the performer avatar 1B of performer B (Performer B's performer avatar operation: small). The second act period is a period in which the performer avatar of performer B performs dance and singing with the performer avatar 1B of performer A, so the operation of the performer avatar 1B of performer B becomes larger (more intense) than other periods (Performer B's performer avatar operation: large).

[0265] In addition, since the virtual live venue participation period is a period in which a plurality of viewer terminals 300 sequentially connect to the distribution server computer 100, it is a period in which viewer avatars virtually participating in the virtual live venue are gradually added and arranged in the virtual space as time passes due to this connection.

[0266] For this reason, as shown in FIGS. 31 and 32(A), immediately after the start of the virtual live venue participation period, the light emission effect is not executed, the display of the performer avatars 1A and 1B of each performer is not present, and since the number of viewer avatars virtually participating in the virtual live venue is small, there are few viewer avatars that require updating of position information and the like in the distribution server computer 100, and the update processing load of the virtual space update is in a relatively small situation. Also, for each viewer terminal 300, since the number of viewer avatars virtually participating in the virtual live venue is small as described above, the drawing processing load for drawing the viewer avatars is in a relatively low situation.

[0267] When the number of viewer avatars virtually participating in the virtual live venue increases from this state, as shown in FIG. 32(B), since the viewer avatar information to be updated in the virtual space data in the distribution server computer 100 increases, the update processing load of the virtual space update by the distribution server computer 100 increases. Also, as the number of viewer avatars virtually participating in the virtual live venue increases, the number of viewer avatars to be drawn in each viewer terminal 300 also increases, so the drawing processing load for drawing the viewer avatars also increases.

[0268] Also, when the number of viewer avatars virtually participating in the virtual live venue increases, as shown in FIGS. 31 and 33, since the number of viewers performing a movement operation from the viewer terminal 300 also increases, the number of viewer avatars moving within the virtual live venue may also increase.

[0269] Since the information change frequency of the current position etc. in the virtual live venue of the moving viewer avatar is higher than that of the viewer avatar stationary at a specific location, as shown in FIGS. 31 and 33, when the number of viewer avatars moving within the virtual live venue increases, the update processing load of the virtual space update by the distribution server computer 100 increases. At this time, also in each viewer terminal 300, when the number of moving viewer avatars increases, the drawing amount due to the movement of each viewer avatar also increases, so the drawing processing load in the viewer terminal 300 also increases.

[0270] When performing a light emission effect during each program period, as shown in FIGS. 31 and 34(A), in the distribution server computer 100, based on the current position of each avatar, the distance and angle from the light source (virtual airborne objects 50 to 52 in this Example 3), etc., calculation processing of the way light hits and the shadow generated for each viewer avatar and performer avatar occurs, so the update load of the virtual space update by the distribution server computer 100 increases. At this time, also in each viewer terminal 300, drawing for emitting the virtual airborne objects 50 to 52 with the light emission effect, drawing with different ways of light hitting for each viewer avatar, and drawing of the shadow for each viewer avatar are performed, so the drawing processing load also increases.

[0271]

[0272]

[0273] During each performance period, as shown in FIGS. 31 and 35, in addition to the increase in the emission intensity of the virtual airborne objects 50 to 52 as the light emission effect, each performer avatar 1A, 1B performs a performance such as singing or dancing. Therefore, as described above, the processing load associated with the calculation process of how the light hits each viewer avatar and performer avatar and the generated shadow in the distribution server computer 100 further increases, and thus the update processing load of the virtual space update by the distribution server computer 100 further increases. Also, in each viewer terminal 300, the rendering processing load for rendering the way the light hits each viewer avatar and the shadow generated by causing the virtual airborne objects 50 to 52 to emit light, and for rendering the performer avatars 1A, 1B increases.

[0274] In the third embodiment, as described above, when the processing load of the distribution server computer 100 and the viewer terminal 300 increases due to an increase in the number of viewer avatars and performer avatars arranged in the virtual live venue, an increase in the emission intensity of the light emission effect, an increase in the number of operating viewer avatars and performer avatars, an increase in the amount of movement of the performer avatars, etc., the display mode of the viewer avatar is changed from a full avatar with a relatively large processing load for displaying to a simple avatar with a relatively small processing load, thereby suppressing an excessive increase in the processing load of the entire equipment constituting the virtual space content distribution system, such as the distribution server computer 100 and the viewer terminal 300.

[0275] <Time schedule data> As shown in FIG. 36, the virtual live of the third embodiment proceeding as described above is managed by the distribution server computer 100 based on time schedule data (TS data). The time schedule data is stored in a form included in the event management program 110 in the storage 103 of the distribution server computer 100.

[0276] The time schedule data is data in a table format that stores the scheduled time of the timing, the elapsed time since the start of the live, the content of the timing, and the file name of the related data related to the timing, in association with the timing ID assigned in the order of individual timings in the virtual live.

[0277] As these timings, as shown in FIG. 36, in addition to the start and end timings of the opening production and the performer appearance production, and the timings at which the performer avatars 1A and 1B appear during the performer appearance production, the start and end timings of each transition period, and the timings for simplifying each viewer avatar (viewer avatar first simplification timing T1, viewer avatar second simplification timing T2, viewer avatar third simplification timing T3) are included. Hereinafter, in this embodiment, these viewer avatar first simplification timing T1, viewer avatar second simplification timing T2, and viewer avatar third simplification timing T3 may be simply referred to as timing T1, T2, and T3.

[0278] Timing T1 is the timing immediately before the start of the first act period when the drawing process load on the viewer terminal 300 increases due to the increasing light emission intensity of the light emission production and the intense movement of the performer avatar 1A. Timing T2 is the timing immediately before the start of the second MC period when the drawing process load on the viewer terminal 300 increases due to the addition of the performer avatar 1B. Timing T3 is the start timing of the second act period when the drawing process load on the viewer terminal 300 increases due to the increasing light emission intensity of the light emission production and the intense movement of the performer avatars 1A and 1B. These timings T1 to T3 are provided to change the viewer avatar from a full avatar to a simplified avatar in advance at a stage where the processing load has not yet increased, immediately before the drawing process load on the viewer terminal 300 increases as described above.

[0279] <Video Generation During the Period When Participation in the Live Virtual Space is Possible> Also, during the live virtual space participation period in which only the viewer avatar perspective video can be displayed on the viewer terminal 300 in the third embodiment, as shown in FIG. 37, similar to the second embodiment, after performing avatar movement operation processing on the viewer terminal 300, virtual space update processing and virtual space update data generation processing on the distribution server computer 100, the distribution server computer 100 further executes an avatar simplification determination process for determining whether to change the display of the viewer avatar from a full avatar to a simple avatar.

[0280] In addition, after executing the avatar simplification determination process, the distribution server computer 100 transmits the simplification determination value data, which is the result of the avatar simplification determination process, together with the virtual space update data to the viewer terminal 300 by executing the virtual space update data distribution process in the same manner as in the second embodiment.

[0281] On the viewer terminal 300, virtual space update processing, viewer perspective video generation processing, and video output processing are executed based on the reception of these virtual space update data and simplification determination value data. In particular, in the third embodiment, although details will be described later, by using the received simplification determination value data, a process of drawing (generating) the viewer avatar as a full avatar or a simple avatar is performed in the viewer perspective video generation process.

[0282] <Video Generation During the Performance Period Excluding the MC Period and the Flying Effect Period> Also, during the performance period excluding the MC period and the flying effect period in which the viewer avatar perspective video and the virtual camera perspective video can be displayed on the viewer terminal 300 in the third embodiment, as shown in FIG. 38, similar to the second embodiment, after performing avatar movement operation processing on the viewer terminal 300, virtual space update processing and virtual space update data generation processing on the distribution server computer 100, the distribution server computer 100 further executes an avatar simplification determination process for determining whether to change the display of the viewer avatar from a full avatar to a simple avatar. Note that this avatar simplification determination process is the same process as the avatar simplification determination process shown in FIG. 38.

[0283] After executing the avatar simplification determination process, the distribution server computer 100 executes the virtual space update data distribution process in the same manner as in the second embodiment, and transmits the simplification determination value data, which is the result of the avatar simplification determination process, together with the virtual space update data to the viewer terminal 300.

[0284] Based on receiving the virtual space update data and the simplification determination value data, the viewer terminal 300 executes virtual space update processing, viewer perspective video generation processing when the viewer avatar perspective video is selected as the video to be displayed, and virtual camera designated video generation processing when the virtual camera perspective video is selected as the video to be displayed. In particular, in the third embodiment, although details will be described later, by using the received simplification determination value data, the viewer avatar is drawn (generated) as a full avatar or a simple avatar in the viewer perspective video generation processing and the virtual camera designated video generation processing.

[0285] <Regarding friend registration> In addition, in the virtual space content distribution system of the third embodiment, a viewer can register other viewers as his / her friends by operating the viewer terminal 300. Note that the storage 303 of the viewer terminal 300 in the third embodiment stores a friend user data table (see FIG. 40) that stores the user IDs and nicknames of the viewer users who have been pre-registered as friends.

[0286] As shown in FIG. 39, in the viewer terminal 300, when executing a viewer avatar selection process for selecting a specific viewer avatar from a plurality of viewer avatars by receiving an operation of the viewer's operation input device 321 during the live virtual space participation period, the file name (viewer avatar file name) of the selected viewer avatar is specified, and a viewer avatar inquiry process for transmitting viewer avatar inquiry information including the specified viewer avatar file name to the distribution server computer 100 is executed.

[0287] When the distribution server computer 100 receives viewer avatar inquiry information from the viewer terminal 300, it executes a viewer avatar identification process to identify the viewer user ID associated with the viewer avatar file name included in the viewer avatar inquiry information from the viewer user data shown in FIG. 9. Then, the distribution server computer 100 transmits viewer user ID information including the viewer user ID to the viewer terminal 300 that has transmitted the viewer avatar inquiry information.

[0288] When the viewer terminal 300 receives the viewer user ID information, it executes a friend addition operation process that prompts an operation to register, as a friend, the viewer (viewer user ID) of the selected viewer avatar for the viewer on the display device 310 in association with the viewer avatar file name.

[0289] At this time, when the viewer performs an operation to register a friend, a friend addition process is executed to store the viewer user ID and the viewer avatar file name in association in the friend user data table. When the operation to register a friend is not performed, the viewer terminal 300 executes a friend addition cancellation process that displays on the display device 310 a message indicating that no friend registration is performed.

[0290] <Avatar Simplification Determination Process> FIG. 41 is a flowchart showing an example of the avatar simplification determination process shown in FIG. 38. In the avatar simplification determination process, the distribution server computer 100 first determines whether it is during the virtual live venue participation period (see FIG. 31) by referring to the time schedule data or the like (step S401). If it is not during the virtual live venue participation period (step S401; No), the process proceeds to step S407. If it is during the virtual live venue participation period (step S401; Yes), it further determines whether the participation number threshold reached flag is set (step S402). The participation number threshold reached flag is a flag indicating that the number of viewer avatars (the number of viewers watching the virtual live) arranged in the virtual live venue has reached a predetermined threshold.

[0291] If the distribution server computer 100 determines that the participation number threshold reached flag is not set (step S402; Yes), the process proceeds to step S407. If the participation number threshold reached flag is set (step S402; No), it further refers to the participant user table shown in FIG. 23 to identify the number of participants in the live (the number of viewer avatars virtually participating in the virtual live venue) (step S403), and determines whether the identified number of participants in the live has reached the threshold (step S404).

[0292] The participation number threshold is a value determined from the number of viewer avatars in full avatars that can be drawn at one time on each viewer terminal 300 and the number of viewer avatars in full avatars that can be arranged in the virtual live venue. For example, if the limit number of viewer avatars in full avatars that can be drawn at one time on each viewer terminal 300 or the limit number of viewer avatars in full avatars that can virtually participate in the virtual live venue is 200, the administrator of the distribution server computer 100 or the like may set it to, for example, 180, which is about 10% lower than the limit number. The participation number threshold is a value determined by the processing load corresponding to the number of viewer avatars that can be drawn on the viewer terminal 300, not simply the number of viewer avatars to be drawn.

[0293] Furthermore, the threshold value of the number of participants may be set to a value different from the above as appropriate by the administrator or the like of the distribution server computer 100 in the administrator terminal 150 in consideration of the performance (drawing processing ability) etc. of each viewer terminal 300.

[0294] When the number of participants has not reached the threshold value (step S404; No), the process proceeds to step S407. When the number of participants in the live event that has reached the threshold value (step S404; Yes), the distribution server computer 100 adds 1 to the simplification determination value based on the fact that the drawing processing load of the viewer avatar in full avatar at the viewer terminal 300 is almost at the limit (step S405), sets the participation number threshold reached flag (step S406), and proceeds to step S407. Incidentally, the simplification determination value is a value for designating the range to be displayed with a simple avatar having a small number of polygons constituting each viewer avatar to be displayed at each viewer terminal 300. Although details will be described later, the initial value is set to "0".

[0295] In step S407, the distribution server computer 100 determines whether it is during the virtual live venue participation period or during the MC period by referring to the time schedule data or the like (step S407). When it is neither during the virtual live venue participation period nor during the MC period (step S407; No), the process proceeds to step S413. When it is during the virtual live venue participation period or during the MC period (step S407; Yes), it is determined whether the moving number threshold reached flag is set (step S408). Incidentally, the moving number threshold reached flag is a flag indicating that the number of viewer avatars moving in full avatar within the virtual live venue among the viewer avatars arranged in the virtual live venue has already reached a predetermined threshold value.

[0296] If the moving person count threshold reached flag is set (step S408; Yes), the process proceeds to step S413. If the moving person count threshold reached flag is not set (step S408; No), the distribution server computer 100 identifies the number of viewer avatars currently moving (the number of viewer terminals 300 for which a moving operation is being performed by each viewer) from the viewer avatar information received from each viewer terminal 300 (step S409).

[0297] In step S409, the distribution server computer 100 may, for example, store the position information of each viewer avatar in the virtual live venue every unit time (e.g., 10 ms), and compare the stored position information of each viewer avatar in the virtual live venue with the previously stored position information of each viewer avatar in the virtual live venue, and aggregate the number of viewer avatars for which position information different from the previous storage is stored to identify the number of viewer avatars currently moving.

[0298] Then, the distribution server computer 100 determines whether the identified number of viewer avatars currently moving (the number of viewer avatars currently moving) has reached the threshold (step S410). Note that the threshold for the number of viewer avatars currently moving in step S410 is a value determined from the number of viewer avatars currently moving with full avatars that can be drawn at one time on each viewer terminal 300. For example, if the limit number of viewer avatars currently moving with full avatars that can be drawn at one time on each viewer terminal 300 is 200, the administrator of the distribution server computer 100 or the like may set it to 150, which is 25% lower than the limit number. The threshold for the number of viewer avatars currently moving is a value determined by the processing load corresponding to the number of viewer avatars that can be drawn on the viewer terminal 300, not simply the number of viewer avatars to be drawn.

[0299] Note that the administrator of the distribution server computer 100 or the like may appropriately set a value different from the above in consideration of the performance (drawing processing ability) of each viewer terminal 300 or the like for the threshold of the number of viewer avatars currently moving.

[0300] If the number of viewer avatars in motion has not reached the threshold value (step S410; No), the process proceeds to S413. If the number of viewer avatars in motion has reached the threshold value (step S410; Yes), the distribution server computer 100 adds 1 to the simplification determination value based on the fact that the rendering processing load of the viewer avatar in full avatar at the viewer terminal 300 is near the limit (step S411), sets the moving population threshold reached flag, and proceeds to step S413 (step S412).

[0301] In step S413, the distribution server computer 100 determines whether it is the timing T1 immediately before the start of the first act (step S413). If it is determined that the time is the timing T1 immediately before the start of the first act (step S413; Yes), the process proceeds to step S416.

[0302] If it is determined that the time is not the timing T1 immediately before the start of the first act (step S413; No), the distribution server computer 100 determines whether it is the timing T2 when the performer avatar 1B of performer B appears (step S414). If it is determined that the current time is the timing T2 immediately before the appearance of the performer avatar 1B of performer B (step S414; Yes), the process proceeds to step S416.

[0303] Also, if it is determined that the time is not the timing T2 immediately before the appearance of the performer avatar 1B of performer B (step S414; No), the distribution server computer 100 determines whether it is the timing T3 immediately before the start of the second act (step S415). If it is determined that the time is the timing T3 immediately before the start of the second act (step S415; Yes), the process proceeds to step S416. If it is determined that the time is not the timing T3 immediately before the start of the second act (step S415; No), the process proceeds to step S417.

[0304] In step S416, upon reaching the above-described timings T1, T2, and T3, the distribution server computer 100 adds 1 to the simplification determination value based on the fact that the drawing processing load of the viewer terminal 300 increases immediately thereafter, and proceeds to step S417 (step S416).

[0305] Also, in step S417, the distribution server computer 100 executes a composite simplification determination process. The composite simplification determination process determines, for example, whether the total processing load, which is the sum of the drawing processing load of the viewer avatar as a full avatar, the generation calculation of the shadow of each viewer avatar, and the drawing processing load of the performer avatar, etc. in the viewer terminal 300, is approaching the limit of the processing load of the viewer terminal 300 even when the threshold number of participants has not been reached in step S404, or when the number of moving viewer avatars has not reached the threshold in step S410, or when it is not any of the timings T1 to T3 in steps S413 to S415. If the total processing load has reached near the limit of the processing load of the viewer terminal 300, the process of adding 1 to the simplification determination value may be performed in the same manner as in step S405, step S411, and step S416.

[0306] In addition, in the present Example 3, a form is exemplified in which, at timing T2, 1 is added to the simplification determination value based on the fact that the number of performer avatars immediately becomes 2 (the performer avatar 1B appears in addition to the performer avatar 1A). That is, the threshold value of the number of performer avatars is set to "2", but the threshold value of the number of performer avatars is a value determined by the processing load corresponding to the number of performer avatars that can be drawn in the viewer terminal 300, not simply the number of performer avatars to be drawn.

[0307] Incidentally, the threshold value for the number of performer avatars may be set to a value different from the above as appropriate by the administrator of the distribution server computer 100 or the like in consideration of the performance (rendering processing ability) of each viewer terminal 300. In particular, in the third embodiment, when "1" is set as the threshold value for the number of performer avatars, the simplified determination value is incremented by 1 at the timing immediately before the appearance of the performer avatar 1A of performer A during the first MC period.

[0308] Incidentally, in the composite simplification determination process of the third embodiment, an example of a form for determining whether or not the total processing load including the rendering processing load of the viewer avatar as a full avatar in the viewer terminal 300, the generation calculation of the shadow of each viewer avatar, the rendering processing load of the performer avatar, etc. has reached near the limit of the processing load of the viewer terminal 300 is illustrated. However, the present invention is not limited to this. As the composite simplification determination process, the simplified determination value may be incremented by 1 on the condition that the processing load of the viewer terminal 300 has reached a processing load different from the processing load corresponding to the threshold value of the number of participants or the threshold value of the number of viewer avatars in motion.

[0309] After executing the process of step S417, the distribution server computer 100 only performs the transmission setting of the simplified determination value and ends the avatar simplification determination process (step S418).

[0310] <Viewer Perspective Video Generation Process> FIG. 42 is a flowchart showing an example of the viewer perspective video generation process shown in FIG. 38. In the viewer perspective video generation process, the viewer terminal 300 first generates the video of the performer avatar as a full avatar shown in FIG. 45(A) (step S501). Incidentally, as shown in FIG. 45(A), as the performer avatars 1A and 1B, there are a full avatar produced based on the taste of each performer (performer A and performer B in the third embodiment) and a simplified avatar obtained by simplifying the full avatar. The simplified avatar is an avatar model created with a smaller number of polygons than the full avatar (number of polygons: full avatar of the performer > simplified avatar of the performer), and the rendering processing load in each viewer terminal 300 is lighter than that of the full avatar.

[0311] Next, it is determined whether the simplification determination value is 0 (step S502). If the simplification determination value is 0 (step S502; Yes), the videos of both the viewer avatars of the registered friends and the viewer avatars of the unregistered friends are generated as full avatars, and the process proceeds to step S509 (step S503). Incidentally, as shown in FIG. 45(B), as viewer avatars, full avatars created based on the preferences of each viewer are provided. These full avatars as viewer avatars are avatar models created with approximately the same number of polygons as the simple avatars of the performers (number of polygons: simple avatar of the performer ≒ full avatar of the viewer), and the shapes, color schemes, etc. are different for each viewer.

[0312] Incidentally, in the third embodiment, a form in which the full avatars of the performers and the full avatars of the viewers are created with approximately the same number of polygons is illustrated, but the present invention is not limited to this. Regarding the number of polygons of these full avatars of the performers and the full avatars of the viewers, if the number of polygons of the full avatar of the performer is less, the number of polygons of the full avatar of the viewer may be more than the number of polygons of the simple avatar of the performer, or the number of polygons of the simple avatar of the performer may be more than the number of polygons of the full avatar of the viewer.

[0313] Also, as shown in FIG. 45(B), as viewer avatars, simple avatars created with fewer polygons than the full avatars of each viewer are also provided. The simple avatars as the viewer avatars are in a common form regardless of the form of the full avatars of each viewer and are created with fewer polygons than the full avatars of each viewer (number of polygons: full avatar of the viewer > simple avatar of the viewer), and the rendering processing load is lighter on each viewer terminal 300 than the full avatar.

[0314] Returning to FIG. 42, when the simplification determination value is not 0 (step S502; No), the viewer terminal 300 further determines whether the simplification determination value is 1 (step S504). When the simplification determination value is 1 (step S504; Yes), it is determined whether the friend viewer avatar identified flag is set (step S505a). The friend viewer avatar identified flag is a flag indicating that the viewer avatar file name existing in the friend user data table has been identified. When the friend viewer avatar identified flag is set (step S505a; Yes), the process proceeds to step S506. When the friend viewer avatar identified flag is not set (step S505a; No), the friend user data table shown in FIG. 40 is referred to, the viewer avatar data file name existing in the friend user data table is identified, and the identified viewer avatar data file name is stored (step S505b). Further, the viewer terminal 300 sets the friend viewer avatar identified flag and proceeds to step S506 (step S505c).

[0315] Then, in step S506, while the viewer terminal 300 generates the video of the viewer avatar (friend's viewer avatar) corresponding to the viewer avatar data file name identified in step S505 in full avatar (step S506), it generates the video of the viewer avatar excluding the viewer avatar corresponding to the viewer avatar data file name identified in step S505b (other people's viewer avatar) in simple avatar (step S507), and proceeds to step S509.

[0316] Also, when the simplification determination value is not 1 (step S504; No), the viewer terminal 300 generates the videos of all viewer avatars in simple avatar regardless of whether they are viewers registered as friends assuming that the simplification determination value is 2 or more (step S508), and proceeds to step S509.

[0317] In step S509, the viewer terminal 300 generates other performer avatars 1A and 1B and viewer perspective videos other than the viewer avatar (step S509), and ends the viewer perspective video generation process.

[0318] As described above, in the third embodiment, as shown in FIG. 44(A), the performer avatars 1A and 1B generated in the viewer perspective video generation process are always generated as full avatars regardless of the value of the simplification determination process. That is, from the viewer avatar perspective of the viewer operating the viewer terminal 300, the performer avatars 1A and 1B are always displayed as full avatars.

[0319] Also, for the viewer avatars of the viewers who have registered as friends, when the simplification determination value is 1 or less, the video is generated as a full avatar, while when the simplification determination value is 2 or more, the video is generated as a simple avatar. That is, from the viewer avatar perspective of the viewer operating the viewer terminal 300, the viewer avatars of the viewers who have registered as friends are displayed as full avatars when the simplification determination value is 1 or less, while they are displayed as simple avatars when the simplification determination value is 2 or more.

[0320] Furthermore, for the viewer avatars of the viewers who have not registered as friends, when the simplification determination value is 0, the video is generated as a full avatar, while when the simplification determination value is 1 or more, the video is generated as a simple avatar. That is, from the viewer avatar perspective of the viewer operating the viewer terminal 300, the viewer avatars of the viewers who have not registered as friends are displayed as full avatars only when the simplification determination value is 0, while they are displayed as simple avatars when the simplification determination value is 1 or more.

[0321] <Virtual Camera Perspective Video Generation Process (Viewer Terminal)> FIG. 43 is an example of a flowchart showing the virtual camera viewpoint video generation process (the virtual camera viewpoint video generation process executed by the viewer terminal 300) shown in FIG. 38. In the virtual camera viewpoint video generation process, the viewer terminal 300 first generates the videos of the performer avatars 1A and 1B as full avatars (step S511), and determines whether the simplification determination value is 0 (step S512). If the simplification determination value is 0 (step S512; Yes), the viewer terminal 300 generates the videos of the viewer avatar of the viewer operating the viewer terminal 300 and all other viewer avatars regardless of whether they are friend-registered as full avatars (step S513), and proceeds to step S523.

[0322] If the simplification determination value is not 0 (step S512; No), it is further determined whether the simplification determination value is 1 (step S514). If the simplification determination value is 1 (step S514; Yes), it is determined whether the friend viewer avatar identified flag is set (step S515a). If the friend viewer avatar identified flag is set (step S515a; yes), the process proceeds to step S516. If the friend viewer avatar identified flag is not set (step S515a; No), the friend user data shown in FIG. 40 is referred to, and the viewer avatar data file name existing in the friend user data is specified (step S515b). Further, the viewer terminal 300 sets the friend viewer avatar identified flag and proceeds to step S516 (step S515c)

[0323] Then, the viewer terminal 300 generates, in full avatar, the video of the viewer avatar of the viewer operating the viewer terminal 300 itself and the viewer avatar (the viewer avatar of a friend) corresponding to the viewer avatar data file name specified in step S515b (step S516). On the other hand, the viewer terminal 300 generates, in simplified avatar, the video of the viewer avatars other than the viewer avatar of the viewer operating the viewer terminal 300 itself and the viewer avatar corresponding to the viewer avatar data file name specified in step S515 (the viewer avatars of others) (step S517), and proceeds to step S523.

[0324] If the simplification determination value is not 1 (step S514; No), it is further determined whether the simplification determination value is 2 (step S518). If the simplification determination value is 2 (step S518; No), the viewer terminal 300 generates, in full avatar, the video of the viewer avatar of the viewer operating the viewer terminal 300 itself (step S520). On the other hand, the viewer terminal 300 generates, in simplified avatar, the video of the viewer avatars other than the viewer avatar of the viewer itself (step S521), and proceeds to step S523.

[0325] If the simplification determination value is not 2 (step S518; No), assuming that the simplification determination value is 3 or more, the viewer terminal 300 generates, in simplified avatar, the video of the viewer avatar of the viewer operating the viewer terminal 300 itself and all other viewer avatars regardless of whether they are registered as friends (step S522), and proceeds to step S523. In step S523, the viewer terminal 300 generates other virtual camera viewpoint videos and ends the virtual camera viewpoint video generation process (step S523).

[0326] As described above, in the third embodiment, as shown in FIG. 44(B), the performer avatars 1A and 1B generated in the viewer viewpoint video generation process of the viewer terminal 300 are always generated as full avatars regardless of the value of the simplification determination process. That is, from the viewer avatar viewpoint of the viewer operating the viewer terminal 300, the performer avatars are always displayed as full avatars.

[0327] Also, regarding the viewer avatar of the viewer himself / herself who operates the viewer terminal 300 among the viewer avatars, when the simplification determination value is 2 or less, the video is generated as a full avatar, while when the simplification determination value is 3 or more, the video is generated as a simple avatar. That is, from the virtual camera viewpoint, the viewer avatar of the viewer himself / herself who operates the viewer terminal 300 is displayed as a full avatar when the simplification determination value is 2 or less, while it is displayed as a simple avatar when the simplification determination value is 3 or more.

[0328] Also, regarding the viewer avatars of the viewers who are friend-registered among the viewer avatars, when the simplification determination value is 1 or less, the video is generated as a full avatar, while when the simplification determination value is 2 or more, the video is generated as a simple avatar. That is, from the virtual camera viewpoint, the viewer avatars of the viewers who are friend-registered are displayed as full avatars when the simplification determination value is 1 or less, while they are displayed as simple avatars when the simplification determination value is 2 or more.

[0329] Furthermore, regarding the viewer avatars of the viewers who are not friend-registered among the viewer avatars, when the simplification determination value is 0, the video is generated as a full avatar, while when the simplification determination value is 1 or more, the video is generated as a simple avatar. That is, from the virtual camera viewpoint, the viewer avatars of the viewers who are not friend-registered are displayed as full avatars only when the simplification determination value is 0, while they are displayed as simple avatars when the simplification determination value is 1 or more.

[0330] In Example 3 as described above, as shown in FIGS. 38, 42, and 43, regarding the viewer viewpoint video and the virtual camera viewpoint video generated on the viewer terminal 300, a form in which each viewer avatar is changed from a full avatar to a simple avatar according to an increase in the rendering processing load on the viewer terminal 300 was exemplified. However, the present invention is not limited to this. As shown in FIG. 25, regarding the virtual camera viewpoint video generated on the distribution server computer 100, each viewer avatar may also be changed from a full avatar to a simple avatar. In this case, each viewer avatar may be changed from a full avatar to a simple avatar according to an increase in the rendering processing load on the distribution server computer 100.

[0331] Furthermore, since it is sufficient to prevent an excessive increase in the processing load of the entire virtual space content distribution system of the present invention, according to an increase in the rendering processing load on the distribution server computer 100, the viewer avatar in the viewer viewpoint video or the virtual camera viewpoint video generated on the viewer terminal 300 may be changed from a full avatar to a simple avatar, or according to an increase in the rendering processing load on the viewer terminal 300, the viewer avatar in the virtual camera viewpoint video generated on the distribution server computer 100 may be changed from a full avatar to a simple avatar.

[0332] In Example 3 as described above, a form in which the viewer avatar is changed from a full avatar to a simple avatar on the viewer terminal 300 according to the processing load corresponding to the number of avatars that can be rendered on the viewer terminal 300 as described above was exemplified. However, the present invention is not limited to this. The viewer avatar may also be changed from a full avatar to a simple avatar based on simply exceeding a threshold value of the number of participants, a threshold value of the number of viewer avatars during movement, or a threshold value of the number of performer avatars.

[0333] Next, regarding the display changes of the performer avatars 1A and 1B and the viewer avatars in the virtual live venue, an example of the display from the perspective of the virtual camera C2 on the viewer terminal 300 of the viewer operating the viewer avatar 11 will be described. Also, hereinafter, the viewer avatars 12, 13, and 14 will be described as the avatars of viewers who have been friend-registered by the viewer operating the viewer avatar 11, and the other viewer avatars will be described as the avatars of viewers who have not been friend-registered by the viewer operating the viewer avatar 11.

[0334] Note that in this Embodiment 3, the display changes of the performer avatars 1A and 1B and the viewer avatars from the perspective of the virtual camera C2 will be described. However, regarding the display of the performer avatars 1A and 1B and the viewer avatars from the viewer's perspective (the perspective from the viewer avatar 11), since it is the same as the perspective of the virtual camera C2 except that the viewer avatar 11 is not displayed, the description will be omitted.

[0335] Also, in this Embodiment 3, since the composite simplification determination process (step S417) is executed in the avatar simplification determination process shown in FIG. 41, it is not necessarily the case that the viewer avatar changes from a full avatar to a simple avatar at the timing when the number of participants reaches the threshold, or at the timing when the number of moving viewer avatars reaches the threshold, or at any of the timings T1 to T3. However, to prevent the description from becoming complicated, hereinafter, an example in which the viewer avatar changes from a full avatar to a simple avatar at the timing when the number of participants reaches the threshold, or at the timing when the number of moving viewer avatars reaches the threshold, or at the timings T1 to T3 will be used for the description.

[0336] First, as shown in FIG. 46, when neither the determination of reaching the threshold number of participants nor the determination of reaching the threshold number of viewer avatars in motion is executed within the virtual live venue, the performer avatar 1A of performer A is displayed as a full avatar from the appearance timing, which is immediately after the start of the first MC period, and the performer avatar 2B of performer B is displayed as a full avatar from the appearance timing during the second MC period. Note that both the performer avatar 1A of performer A and the performer avatar 1B of performer B are maintained in the full avatar display without changing to a simple avatar.

[0337] On the other hand, until the timing T1, which is immediately before the start of the performance (the first performance) by the performer avatar 1A of performer A after the display starts during the virtual live venue participation period, all viewer avatars are displayed as full avatars (see FIG. 49(A)). From timing T1, as the light emission intensity of the light emission effect increases from the immediately subsequent first performance start timing and the movement of the performer avatar 1A becomes intense, resulting in an increase in the drawing processing load on the viewer terminal 300, the simplification determination value is updated from 0 to 1, and the display as a simple avatar is started for the viewer avatars of viewers who are not friend-registered by the viewer operating the viewer avatar 11 (see FIG. 49(B)).

[0338] Also, from timing T2, as the performer avatar 1B appears immediately afterwards, that is, as the number of performer avatars increases from 1 to 2, resulting in an increase in the drawing processing load on the viewer terminal 300, the simplification determination value is updated from 1 to 2, and the display as a simple avatar is started for the viewer avatars of viewers who are friend-registered by the viewer operating the viewer avatar 11 (see FIG. 49(C)).

[0339] Then, from timing T3, as the second performance starts immediately afterwards, with the light emission intensity of the light emission effect increasing and the movements of the performer avatars 1A and 2B of performer A and performer B becoming intense, the simplification determination value is updated from 2 to 3, and the display of the viewer avatar 11 itself as a simple avatar is started (see FIG. 49(D)).

[0340] As shown in FIG. 47, when it is determined that the number of participants has reached the threshold value in the virtual live venue, the performer avatar 1A of performer A is displayed as a full avatar from the appearance timing, which is immediately after the start of the first MC period, and the performer avatar 1B of performer B is displayed as a full avatar from the appearance timing during the second MC period. Note that both the performer avatar 1A of performer A and the performer avatar 1B of performer B are maintained in the full avatar display without changing to the simple avatar.

[0341] On the other hand, from the start of the display during the virtual live venue participation period until it is determined that the number of participants has reached the threshold value during the virtual live venue participation period, all viewer avatars are displayed as full avatars (see FIG. 49(A)). However, when it is determined that the number of participants has reached the threshold value during the virtual live venue participation period, the simplified determination value is updated from 0 to 1 at the arrival determination timing, and the display as a simple avatar is started for the viewer avatars of viewers who are not friend-registered by the viewer operating the viewer avatar 11 (see FIG. 49(B)).

[0342] From timing T1, the first act starts, where the light emission intensity of the light emission effect increases immediately and the movement of the performer avatar 1A becomes intense, increasing the rendering processing load on the viewer terminal 300. In response, the simplified determination value is updated from 1 to 2, and the display as a simple avatar is started for the viewer avatars of viewers who are friend-registered by the viewer operating the viewer avatar 11 (see FIG. 49(C)).

[0343] Then, from timing T2, the performer avatar 1B appears immediately, that is, the number of performer avatars increases from 1 to 2, increasing the rendering processing load on the viewer terminal 300. In response, the simplified determination value is updated from 2 to 3, and the display of the viewer avatar 11 itself as a simple avatar is started (see FIG. 49(D)).

[0344] As shown in FIG. 48, when the determination of reaching the threshold value of the number of participants and the determination of reaching the threshold value of the number of viewer avatars in motion are executed in the virtual live venue, the performer avatar 1A of performer A is displayed as a full avatar from the appearance timing, which is the timing immediately after the start of the first MC period, and the performer avatar 1B of performer B is displayed as a full avatar from the appearance timing during the second MC period. Note that both the performer avatar 1A of performer A and the performer avatar 1B of performer B are maintained in the display as full avatars without changing to simple avatars.

[0345] On the other hand, from the start of the display during the period when participation in the virtual live venue is possible until it is determined that the threshold value of the number of participants is reached during the period when participation in the virtual live venue is possible, all viewer avatars are displayed as full avatars (see FIG. 49(A)). However, when it is determined that the threshold value of the number of participants is reached during the period when participation in the virtual live venue is possible, the simplified determination value is updated from 0 to 1 at the timing of the reaching determination, and the display as a simple avatar is started for the viewer avatars of viewers who are not friend-registered by the viewer operating the viewer avatar 11 (see FIG. 49(B)).

[0346] Also, when it is determined that the number of viewer avatars in motion reaches the threshold value during the period when participation in the virtual live venue is possible, the simplified determination value is updated from 1 to 2 at the timing of the reaching, and the display as a simple avatar is started for the viewer avatars of viewers who are friend-registered by the viewer operating the viewer avatar 11 (see FIG. 49(C)).

[0347] Then, from timing T1, in response to the increase in the drawing processing load in the viewer terminal 300 due to the start of the first act in which the emission intensity of the light emission effect increases immediately thereafter and the operation of the performer avatar 1A becomes intense, the simplified determination value is updated from 2 to 3, and the display of the viewer avatar 11 itself as a simple avatar is started (see FIG. 49(D)).

[0348] Furthermore, in the third embodiment, even after the simplified determination value is updated to 3 and the display of all viewer avatars in the simple avatar is started, the simplified determination value may be updated to 4 or 5. However, even if the simplified determination value is updated to 4 or more, the all viewer avatars will not change further from the simple avatar.

[0349] As described above, in the third embodiment, as shown in FIGS. 41 to 44 and FIGS. 46 to 49, when the number of performer avatars to be displayed increases to 2, the drawing processing load of the performer avatars increases. When the operation of the performer avatars becomes large (intense) at the start of the first act period or the second act period, the update processing load of the virtual space and the drawing processing load of the performer avatars increase. Based on the start of the first act period or the second act period, when the emission intensity of the emission effect increases, the drawing processing load of the virtual space and each avatar increases. When the number of viewer avatars (number of live participants) virtually participating in the virtual live venue exceeds the threshold number, the update processing load of the virtual space and the drawing processing load of the viewer avatars increase. When the number of moving viewer avatars (number of moving people) among the viewer avatars virtually participating in the virtual live venue exceeds the threshold, the update processing load of the virtual space and the drawing processing load of the viewer avatars increase. Based on the occurrence of any of these (the establishment of the specific conditions of the present invention), by changing the viewer avatars in the virtual live venue from full avatars to simple avatars, the processing load for the viewer terminal 300 to display (draw) these viewer avatars is reduced. Therefore, it is possible to prevent an excessive increase in the overall processing load of the virtual space content distribution system due to the establishment of the above specific conditions.

[0350] Also, in the third embodiment, time schedule data for managing the progress of the virtual live is stored in the storage 103 of the distribution server computer 100. The distribution server computer 100 can specify the timing immediately before the processing load increases from the time schedule data in the avatar simplification determination process shown in FIG. 41. Therefore, the timing when the processing load increases can be accurately specified at timings T1 to T3 before the actual increase in the processing load.

[0351] In particular, in the third embodiment, the timing at which the number of displayed performer avatars increases to two, thereby increasing the rendering processing load of the performer avatars, or the start of the first act period or the second act period causes the movement of the performer avatars to become large (intense), thereby increasing the update processing load of the virtual space and the rendering processing load of the performer avatars. The timing at which the light emission intensity of the light emission effect increases based on the start of the first act period or the second act period, thereby increasing the rendering processing load of the virtual space and each avatar. By changing the viewer avatar from a full avatar to a simple avatar from timings T1 to T3 before these timings, the timings of the increase in the number of these performer avatars, the timings at which the movements of the performer avatars 1A and 1B become intense, and the timings at which the light emission intensity is enhanced as the light emission effect do not overlap with the timings of changing the viewer avatar from a full avatar to a simple avatar, preventing the processing loads required for these processes from overlapping and the overall processing load of the virtual space content distribution system from increasing excessively.

[0352] In the third embodiment, time schedule data is stored in the storage 103 of the distribution server computer 100, and the distribution server computer 100 changes the viewer avatar from a full avatar to a simple avatar on the viewer terminal 300 based on identifying timings T1 to T3. However, the present invention is not limited to this. Time schedule data may be stored in the storage 303 of the viewer terminal 300, and the viewer terminal 300 itself may identify timings T1 to T3 from the time schedule data and execute the change of the viewer avatar from a full avatar to a simple avatar based on the identification.

[0353] Also, in the third embodiment, a form of changing the viewer avatar from a full avatar to a simple avatar from timings T1 to T3 immediately before the rendering processing load increases is exemplified. However, the present invention is not limited to this. If there is sufficient margin in the rendering processing ability of the viewer terminal 300, the viewer avatar may be changed from a full avatar to a simple avatar at the timing when the rendering processing load increases.

[0354] Also, as shown in FIG. 49, as the virtual camera designated video, for the viewer avatar of the viewer himself / herself operating the viewer terminal 300 (viewer avatar 11 in the example of FIG. 49), it will finally change from the full avatar to the simple avatar and be displayed, so an excessive increase in the processing load can be further prevented.

[0355] Also, in the third embodiment, the viewer avatars of the viewers operating other viewer terminals 300 change from the full avatar to the simple avatar with priority over the viewer avatar of the viewer himself / herself operating the viewer terminal 300 (viewer avatar 11 in the example of FIG. 49), so an excessive increase in the processing load can be effectively prevented.

[0356] In the third embodiment, the viewer avatars are divided into the viewer avatar of the viewer himself / herself operating the viewer terminal 300 (viewer avatar 11 in the example of FIG. 49), the viewer avatars of the viewers who have been friend-registered by the viewer (viewer avatars 12, 13, 14 in the example of FIG. 49), and the viewer avatars of the viewers who have not been friend-registered by the viewer. The priority of changing from the full avatar to the simple avatar is set such that the viewer avatar of the viewer who has not been friend-registered is the highest, and the viewer avatar of the viewer himself / herself operating the viewer terminal 300 (viewer avatar 11 in the example of FIG. 49) is the lowest (priority of changing from the full avatar to the simple avatar: viewer avatar of the viewer who has not been friend-registered > viewer avatar of the viewer who has been friend-registered > viewer avatar of the viewer himself / herself operating the viewer terminal 300). However, the present invention is not limited to this, and the priority of changing from the full avatar to the simple avatar may be other than the above, or the priority of changing from the full avatar to the simple avatar may not be set among the viewer avatars.

[0357] Also, in the third embodiment, as shown in FIGS. 45 to 48, both the performer avatars 1A and 1B and the viewer avatar are provided with full avatars and simple avatars. However, as for the viewer avatar, as the rendering processing load of the viewer terminal 300 increases, the full avatar changes to the simple avatar. On the other hand, as for the performer avatars 1A and 1B, only the full avatar is always displayed regardless of the increase in the rendering processing load of the viewer terminal 300. That is, during the virtual live, since a simple avatar with a small rendering processing load for display as the performer avatars 1A and 1B is not displayed, it is possible to prevent a decrease in the interest of the live due to the display of the simple avatar as the performer avatars 1A and 1B.

[0358] In addition, in the third embodiment, a form in which the performer avatars 1A and 1B are provided with full avatars and simple avatars is exemplified. However, the present invention is not limited to this. Since there is no opportunity to display the simple avatar as the performer avatars 1A and 1B in the first place, only the full avatar may be provided as the performer avatars 1A and 1B without providing the simple avatar.

[0359] Also, in the third embodiment, a performer terminal 200 operable by a performer is provided as a device constituting the virtual space content distribution system, and as the virtual space content, the operations of the performer avatars 1A and 1B in which the operations of the performer are immediately reflected can be distributed. However, the present invention is not limited to this. As the virtual space content, the operations of the performer avatars 1A and 1B photographed or produced in advance may be distributed.

[0360] In addition, in the third embodiment, as shown in FIG. 41, based on the fact that the number of viewer avatars installed in the virtual live venue or the number of viewer avatars in motion has reached a predetermined threshold value, the distribution server computer 100 univocally determines that the rendering processing load in the viewer terminal 300 is approaching the limit, and an example is given of a form in which the viewer avatar in the viewer terminal 300 is changed from a full avatar to a simple avatar. However, the present invention is not limited to this. In reality, since it is extremely unlikely that each viewer is using the same viewer terminal 300, even when the distribution server computer 100 determines that the rendering processing load in the viewer terminal 300 is approaching the limit, if there is still sufficient rendering processing capacity on the viewer terminal 300 side for rendering viewer avatars, performer avatars, etc., the viewer terminal 300 side may continue to display the viewer avatar as a full avatar.

[0361] In addition, in the third embodiment, when the number of viewer avatars virtually participating in the virtual live venue exceeds the threshold number, when the number of viewer avatars in motion among the viewer avatars virtually participating in the virtual live venue exceeds the threshold number, when the emission intensity of the light emission effect increases, when the movement of the performer avatar becomes large (intense), when the number of performer avatars increases, the distribution server computer 100 determines that the rendering load of the viewer terminal 300 increases and gives an example of a form in which the viewer avatar in the viewer terminal 300 is changed from a full avatar to a simple avatar. However, the present invention is not limited to this. When the number of viewer avatars virtually participating in the virtual live venue exceeds the threshold number, when the number of viewer avatars in motion among the viewer avatars virtually participating in the virtual live venue exceeds the threshold number, when the emission intensity of the light emission effect increases, when the movement of the performer avatar becomes large (intense), when the number of performer avatars increases, the viewer terminal 300 itself may determine that the rendering processing load of the viewer terminal 300 increases and change the viewer avatar from a full avatar to a simple avatar. In this case, the viewer himself / herself who is watching the virtual live using the viewer terminal 300 may set the threshold number of the number of viewer avatars that virtually participate in the virtual live venue by operating the viewer terminal 300 and the threshold number of the number of viewer avatars in motion.

[0362] In addition, in the third embodiment, an example is given of a form in which the viewer avatar of a viewer who is not a friend is preferentially displayed as a simple avatar over the viewer avatar of a viewer who is a friend and has a high relationship with the viewer user using the viewer terminal 300. However, the present invention is not limited to this. Relatives such as the parents and siblings of the viewer user using the viewer terminal 300, and persons related to the viewer user using the viewer terminal 300 who belong to the same organization (for example, school, company, club, etc.) are registered in advance in the same procedure as shown in FIG. 39 in advance, and the viewer avatars of viewers who are not these relatives or related persons may be preferentially displayed as simple avatars. That is, the "other viewer users with a high relationship with themselves" for each viewer user in the third embodiment may be a concept including not only friends but also relatives of the viewer user himself and related persons belonging to the same organization.

[0363] In addition, in the third embodiment, an example is given of a form in which the viewer avatar is changed from a full avatar to a simple avatar based on an increase in the processing load of the viewer terminal 300. However, the present invention is not limited to this. A plurality of simple avatars with different drawing loads are provided as viewer avatars, and when the processing load of the viewer terminal 300 increases, a simple avatar corresponding to the drawing ability may be displayed as the viewer avatar for each viewer terminal 300.

[0364] <Modification Example of the Third Embodiment> As described above, the present invention has been described based on each embodiment and modification example. However, the specific configuration is not limited to the above-described embodiments and modification examples, and changes and additions within the scope not departing from the gist of the present invention are also included in the present invention.

[0365] For example, in the third embodiment, although both a full avatar and a simple avatar are prepared as the performer avatars 1A and 1B, a form in which the simple avatar is not displayed as the performer avatars 1A and 1B was exemplified. However, the present invention is not limited to this. As a modification 3-1, a case where the performer avatars 1A and 1B are displayed as simple avatars may be provided, or a period may be provided during which it is possible to select whether to display the performer avatars 1A and 1B as full avatars or simple avatars by operating the performer terminals 200 by each performer.

[0366] For example, as shown in FIG. 50, during a period other than the performance period, both the performer avatar 1A of performer A and the performer avatar 1B of performer B may be selectable to be displayed as either a full avatar or a simple avatar by an operation from each performer terminal 200. Also, during the performance period, when the performance period is a performance period in which only the performer avatar 1A of performer A sings or dances, the performer avatar 1A of performer A is displayed as a full avatar while the performer avatar 1B of performer B is displayed as a simple avatar, so as to reduce the processing load for displaying the performer avatar 1B of performer B on the viewer terminal 300. When the performance period is a performance period in which only the performer avatar 1B of performer B sings or dances, the performer avatar 1B of performer B may be displayed as a full avatar while the performer avatar 1A of performer A is displayed as a simple avatar, so as to reduce the processing load for displaying the performer avatar 1A of performer A on the viewer terminal 300.

[0367] Also, when the performance period is a performance period in which both the performer avatar 1A of performer A and the performer avatar 1B of performer B sing or dance, both the performer avatar 1A of performer A and the performer avatar 1B of performer B may be displayed.

[0368] In addition, in the third embodiment, as an example of the simple avatar of the viewer avatar, a form in which only one type of simple avatar is provided regardless of the performer who sings or dances was illustrated. However, the present invention is not limited to this. As shown in FIG. 51 as Modification 3-2, the form of the simple avatar of the viewer may be different according to the performer avatar performing the program. In particular, during non-program periods such as the period during which virtual live venue participation is possible, the opening performance period, and the MC period, the viewer avatar is displayed in the manner shown in the third embodiment, while during each program period, the viewer avatar is displayed as a simple avatar in a form set in advance according to each performer according to the performer avatar who sings or dances. By doing so, the form of the simple avatar as the viewer avatar changes according to the performer avatar, so the interest of the virtual live can be improved.

[0369] In addition, when the form of the viewer avatar is thus made different according to the performer, as shown in FIGS. 52 and 53, from the pre-data download request received by the distribution server computer 100 from the viewer terminal 300 in the pre-data transmission process, a performer (a performer for whom simple avatar settings have been made in advance for the viewer, and the data of the simple avatar for the viewer is stored in the storage 103 in the distribution server computer 100 in advance) is specified (step S601), and the transmission setting of the data of the simple avatar for the viewer for each specified performer (step S602) and the transmission setting of other pre-data from the received pre-data download request (step S603) are performed, and the pre-data for which these transmission settings have been made may be transmitted to the viewer terminal 300 (step S604).

[0370] By doing so, the viewer terminal 300 can receive, as part of the pre-data from the distribution server computer 100, the data of the simple avatar for the viewer according to each performer (performer avatars 1A and 1B), and display the simple avatar in a form corresponding to each of the performer avatars 1A and 1B as the viewer avatar during the program period.

[0371] Further, in the third modification example 3-2, although the form of displaying a simple avatar corresponding to each performer avatar 1A, 1B as the viewer avatar has been exemplified, the present invention is not limited to this. For a performer without a pre-set simple avatar for the viewer as pre-data (a performer whose simple avatar data for the viewer is not stored in the storage 103 in the distribution server computer 100 in advance), during the performance period, as shown in FIG. 51, a simple avatar in the same form as during the non-performance period may be displayed as the viewer avatar.

[0372] Also, in the third modification example 3-2, although the form of displaying a simple avatar corresponding to each performer avatar 1A, 1B as the viewer avatar has been exemplified, the present invention is not limited to this. The simple avatar displayed as the viewer avatar may be made different over time. For example, as shown in FIG. 54 as the third modification example 3-3, a heart-shaped character may be displayed as the simple avatar of the viewer until a predetermined timing S from the start of the performance, while a star-shaped character may be displayed as the simple avatar of the viewer after the timing S.

[0373] Furthermore, in the third modification example 3-2, although the form of displaying a simple avatar corresponding to each performer avatar 1A, 1B as the viewer avatar has been exemplified, the present invention is not limited to this. When a plurality of virtual live venues (virtual spaces) where viewers can participate in the viewer avatar are provided and the same content is distributed in each virtual live venue, as shown in FIG. 55 as the third modification example 3-4, simple avatars in different forms may be displayed as the viewer avatar for each virtual live venue.

[0374] In the third embodiment, only one type of simple avatar is provided as the simple avatar of the viewer avatar. However, the present invention is not limited to this. As a modification 3-5, as shown in FIG. 56, the simple avatars of viewers registered as friends and the simple avatars of viewers not registered as friends may be made different. By doing so, even when a simple avatar is displayed as the viewer avatar, the viewer avatars of viewers registered as friends and the viewer avatars of viewers not registered as friends can be distinguished by the form of each simple avatar.

[0375] In the third embodiment, a form in which two types of avatars, namely a full avatar and a simple avatar with a smaller rendering processing load than the full avatar, are provided for the viewer avatar and the performer avatars 1A and 1B, respectively, is exemplified. However, the present invention is not limited to this. As a modification 3-6, as the viewer avatar or the performer avatars 1A and 1B, a plurality of simple avatars with different rendering processing loads (for example, a first simple avatar with a smaller rendering processing load than the full avatar and a second simple avatar with a smaller rendering processing load than the first simple avatar) may be provided.

[0376] In this way, when a plurality of simple avatars with different rendering processing loads are provided, the form of the viewer avatar may be changed step by step to a full avatar, a first simple avatar, a second simple avatar,... so that the rendering processing load of the viewer terminal 300 decreases, under the conditions that the number of viewer avatars virtually participating in the virtual live venue exceeds a threshold number, the number of viewer avatars in motion among the viewer avatars virtually participating in the virtual live venue exceeds a threshold number, reaching any of the timings T1 to T3, etc.

[0377] In addition, in the third embodiment, an example is given of a form in which the viewer avatar is changed from a full avatar to a simple avatar on the condition that the number of moving viewer avatars among the viewer avatars virtually participating in the virtual live venue exceeds a threshold number. However, the present invention is not limited to this. As Modification Example 3-7, even if the number of viewer avatars performing actions such as dancing or jumping, rather than moving, among the viewer avatars virtually participating in the virtual live venue exceeds a threshold number, the viewer avatar may be changed from a full avatar to a simple avatar. That is, the "performer avatar operating in the virtual space" in the third embodiment may include a performer avatar performing an action other than moving in the virtual live venue, in addition to the performer avatar moving in the virtual live venue.

[0378] Also, in the third embodiment, an example is given of a form in which each viewer avatar is once displayed as a full avatar and these viewer avatars are changed to simple avatars based on the establishment of specific conditions. However, the present invention is not limited to this. As Modification Example 3-8, when it is reliably observed that the number of viewer avatars virtually participating in the virtual live venue exceeds a predetermined threshold number, each viewer avatar may be displayed as a simple avatar from the beginning.

[0379] Also, in the third embodiment, as the number of displayed performer avatars increases to two, the rendering processing load of the performer avatars increases; as the operation of the performer avatars becomes large (intense) at the start of the first act period or the second act period, the update processing load of the virtual space and the rendering processing load of the performer avatars increase; based on the start of the first act period or the second act period, as the emission intensity of the light emission effect increases, the rendering processing load of the virtual space and each avatar increases; when the number of viewer avatars (number of live participants) virtually participating in the virtual live venue exceeds the threshold number, the update processing load of the virtual space and the rendering processing load of the viewer avatars increase; when the number of moving viewer avatars (number of moving people) among the viewer avatars virtually participating in the virtual live venue exceeds the threshold, the update processing load of the virtual space and the rendering processing load of the viewer avatars increase are specified conditions in the present invention. Based on the establishment of any of these specified conditions, a form in which the viewer avatar is changed from a full avatar to a simple avatar is exemplified. However, the present invention is not limited to this. As Modification 3-9, the specified conditions in the present invention may be only a part of the above, or may include things other than the above conditions as long as they are events that increase the processing load in the distribution server computer 100 or the viewer terminal 300 constituting the virtual space content distribution system of the present invention.

[0380] In addition, in the third embodiment, as shown in FIGS. 41 to 43, when generating the viewer's perspective video and when generating the virtual camera's perspective video, the same threshold values (the threshold value of the number of participants and the threshold value of the number of viewer avatars in motion) are used to change the viewer avatars from full avatars to simple avatars. However, the present invention is not limited to this. As a modification example 3-10, different threshold values may be used when generating the viewer's perspective video and when generating the virtual camera's perspective video to change the viewer avatars from full avatars to simple avatars. For example, as shown in FIG. 13, when generating the virtual camera C1 video, since almost only the performer avatar is drawn, which is different from the cases of generating the virtual camera C2 video, the virtual camera C3 video, the virtual camera C4 video, and each viewer's perspective video, while setting a high threshold value for the number of participants and the threshold value of the number of viewer avatars in motion, in the virtual camera C2 video, the virtual camera C3 video, the virtual camera C4 video, and each viewer's perspective video, since each viewer avatar is also actively displayed in addition to the performer avatar, the threshold value for the number of participants and the threshold value of the number of viewer avatars in motion may be set high.

[0381] Also, even in the case of the viewer's perspective video, when the line of sight of the viewer avatar is not directed at the virtual stage G, it is more difficult to draw the performer avatar as the viewer's perspective video than when the line of sight of the viewer avatar is directed at the virtual stage G. Therefore, the drawing processing load due to drawing the performer avatar is less likely to increase. Thus, the threshold value for the number of participants and the threshold value of the number of viewer avatars in motion may be set higher than when the line of sight of the viewer avatar is directed at the virtual stage G.

[0382] In addition, in the third embodiment, an example is given in which, in accordance with an increase in the drawing processing load of the viewer terminal 300, the viewer avatars of viewers who are not friend-registered, the viewer avatars of viewers who are friend-registered, and the viewer avatar of oneself are changed to simple avatars in this order. However, the present invention is not limited to this. As a modification example 3-11, each time the drawing processing load of the viewer terminal 300 increases, the viewer avatars may be changed to simple avatars in order from the viewer avatars that are far from one's own viewer avatar.

[0383] In addition, in each of the above-described embodiments and modified examples, the form in which the viewer avatar viewpoint video is generated and displayed on the viewer terminal 300 side has been exemplified. However, the present invention is not limited to this. For example, in the case of a live event with few virtual participants, etc., the viewpoint video from the viewer avatar may also be generated and distributed on the distribution server computer 100 side. Further, the viewer user may be able to select whether to generate the viewer avatar viewpoint video on the viewer terminal 300 side or on the distribution server computer 100 side according to the processing ability of the terminal owned by the user and the available data communication environment. Alternatively, the distribution server computer 100 may identify the processing ability of the viewer terminal 300 to which it is communicatively connected, and determine whether to generate on the viewer terminal 300 side or on the distribution server computer 100 side based on the identified processing ability.

[0384] In addition, in each of the above-described embodiments and modified examples, the form in which the distribution server computer 100 is installed in a studio operated by an event management organization that hosts a virtual live has been exemplified. However, the present invention is not limited to this. As these distribution server computers 100, a server computer owned by a company that leases server computers in a data center or the like may be used, or as described above, a server computer provided by a cloud service may be used. The installation form of these server computers can be any form as long as the function of the distribution server computer 100 can be obtained.

[0385] In addition, in each of the above-described embodiments and modified examples, the form in which the performer terminal 200 is provided for each performer user on a one-to-one basis has been exemplified. However, the present invention is not limited to this. A plurality of people may share one performer terminal 200. In the case where the performer user is a unit or group consisting of a plurality of members, for example, by executing the viewpoint following target person designation process on at least one of the distribution server computer 100 and the viewer terminal 300, the viewer user may be able to select the member to be the target of viewpoint following.

[0386] In addition, in each of the above-described embodiments and modified examples, a form in which a performer user performs performance actions such as singing and dancing alone is exemplified. However, the present invention is not limited thereto, and a singer who performs singing and an actor who performs dance actions may be separate individuals. In this case, the performer terminal of the singer and the performer terminal of the actor may be separate, and the singer may sing at a location other than the studio where the actor performs the performance actions.

[0387] In addition, in each of the above-described embodiments and modified examples, the Internet is exemplified as the computer communication network that connects the distribution server computer 100, the administrator terminal 150, the performer terminal 200, and the viewer terminal 300. However, the present invention is not limited thereto, and these communication networks may be configured by a local area network capable of data communication only within a specific area, or may include a local area network or local data communication in a part thereof.

[0388] In addition, in each of the above-described embodiments and modified examples, a form in which the viewer terminal 300 is a smartphone P or a computer (PC) is exemplified. However, the present invention is not limited thereto, and these computers may be portable notebook computers, or may be tablet terminals, e-book readers, wearable computers, game consoles, and various information processing devices capable of outputting at least 2D video and audio other than these.

[0389] In addition, in each of the above-described embodiments and modified examples, a form in which a performer user performs a performance including singing in a studio is exemplified. However, the present invention is not limited thereto. For example, the performer user may use the performer terminal 200 installed at home or the like to appear in a virtual live performance from home or the like.

[0390] In addition, in each of the above-described embodiments and modified examples, a virtual live event has been exemplified as the virtual space content. However, the present invention is not limited thereto. As such virtual space content, for example, a fan meeting where a performer user gathers with his or her fans, a talk session, or the like, which is beneficial content for viewer users, and any content may be used as long as it is related to a virtual space in which a performer avatar 1 and viewer avatars virtually participate.

[0391] In addition, in each of the above-described embodiments and modified examples, a form has been exemplified in which switching of viewpoints of four virtual cameras C1 to C4 or an airborne moving virtual camera, which are fixedly arranged (set) virtual cameras, can be performed in advance by settings and operations on the administrator terminal 150. However, the present invention is not limited thereto. For example, the event administrator M on the administrator terminal 150 may perform such viewpoint switching in real time using a viewpoint switching controller or the like that constitutes the operation input device 161.

[0392] In addition, in each of the above-described embodiments and modified examples, a form has been exemplified in which virtual cameras C1 to C4 fixedly arranged (set) in the virtual space are used as virtual cameras. However, the present invention is not limited thereto. For example, in addition to or instead of the virtual cameras C1 to C4, movable virtual moving cameras may be arranged in the virtual live venue, and the positions and imaging directions of the virtual moving cameras in the virtual space may be controlled by operations by the event administrator M, a cameraman, or the like on the administrator terminal 150 to obtain viewpoint videos of the virtual moving cameras.

[0393] In addition, in each of the above-described embodiments and modified examples, in order to reflect the expression of the performer avatar, in order to be able to detect the expression of the face of the performer user, a form in which the perspective video of the virtual camera C2 is displayed on the screen S is exemplified. However, the present invention is not limited to this. For example, if it is a high-functional head-mounted display having a sensor function for detecting the expression of the face of the performer user, the performance may be carried out while wearing these high-functional head-mounted displays. By doing so, the immersion feeling of the performer user in the virtual live may be improved. Further, when it is not necessary to reflect the expression of the face of the performer user in detail in the expression of the performer avatar, the performance may be carried out while the performer user wears a normal head-mounted display.

[0394] In addition, although Examples 1 to 3 and each modified example are exemplified as the virtual space content distribution system in the present invention, the present invention is not limited to this. As the virtual space content distribution system in the present invention, only any one of the examples and modified examples may be implemented, or a plurality of examples and modified examples may be combined and implemented.

[0395] Further, instead of the singing and singing actions (performances) of the performer user, the singing and singing actions (performance actions) by a virtual performer created by computer graphics or the like are recorded in the distribution server computer as performer avatar information, and the recorded singing voice and singing actions (performance actions) are reproduced according to the progress of the live to hold a virtual live.

[0396] Thus, in the case of recording and reproducing the performer avatar information by executing singing and singing actions (performance actions) in advance and distributing the virtual live, the configuration of the virtual space content distribution system at the time of distribution is composed of the distribution server computer 100, the administrator terminal 150, and the viewer terminal 300, and does not include the performer terminal 200 which is a performer user terminal available to the performer user who performs the operation of operating the performer avatar 1 in the virtual space.

[0397] In addition, in claim 14 of the present invention, "usable by the performer" does not mean something operated by the performer user, but simply includes use for the performer user to view virtual space content.

Explanation of Signs

[0398] 1 Performer avatar 100 Distribution server computer 150 Administrator terminal 200 Performer terminal 300 Viewer terminal

Claims

1. A virtual space content distribution system capable of distributing virtual space content in a virtual space, comprising: a viewer user terminal capable of outputting an image of the virtual space content, the viewer user being able to view the image; a server computer connected to the viewer user terminal via a communication network and capable of executing at least processes related to the virtual space and processes related to the distribution of the virtual space content; At least The viewer users are multiple, and the viewer user terminal is assigned to each viewer user; The virtual space content may include a viewer avatar by allowing the viewer user to participate in a virtual space that is the subject of the virtual space content by using the viewer user terminal; the viewer user terminal is capable of displaying a viewpoint video from a viewer avatar corresponding to a viewer user using the viewer user terminal; the viewer avatars include a first viewer avatar and a second viewer avatar that requires a smaller processing load for display than the first viewer avatar; when a specific condition corresponding to an increase in a processing load related to the virtual space content in the virtual space content distribution system to a predetermined specific size is satisfied, the second viewer avatar is used as the viewer avatar, whereas when the specific condition is not satisfied, the first viewer avatar is used as the viewer avatar. A virtual space content delivery system comprising:

2. The specific condition is a processing load condition related to the number of viewer avatars participating in the virtual space.

2. The virtual space content delivery system according to claim 1.

3. The specific condition is a processing load condition related to the number of the viewer avatars operating in the virtual space.

2. The virtual space content delivery system according to claim 1.

4. The virtual space content includes content in which a light emission effect involving light emission in the virtual space is executed, The specific condition is a processing load condition related to the light emission performance.

2. The virtual space content delivery system according to claim 1.

5. The virtual space content includes content based on a performer avatar, The performer avatars include a performer avatar A and a performer avatar B different from the performer avatar A, The appearance of the second viewer avatar is different when the performer avatar is the performer A avatar and when the performer avatar is the performer B avatar.

2. The virtual space content delivery system according to claim 1.

6. The second viewer avatar is used as the viewer avatar of the viewer user who uses the viewer user terminal.

2. The virtual space content delivery system according to claim 1.

7. the second viewer avatar is used in preference to the viewer avatar of another viewer user different from the viewer user himself / herself who uses the viewer user terminal, over the viewer avatar of the viewer user himself / herself who uses the viewer user terminal; 7. The virtual space content delivery system according to claim 6.

8. a highly related user registration means for allowing each viewer user to register other viewer users who have a high relationship with the viewer user as highly related users; the viewer avatars include, in addition to the first viewer avatar and the second viewer avatar, a third viewer avatar that requires a smaller processing load for display than the first viewer avatar and is different from the second viewer avatar; When the specific condition is met, the second viewer avatar is used as the viewer avatar of a viewer user who is not registered in the highly-related user registration means, and the third viewer avatar is used as the viewer avatar of a viewer user who is registered in the highly-related user registration means.

2. The virtual space content delivery system according to claim 1.

9. The virtual space content includes content based on a performer avatar, the performer avatars include a first performer avatar and a second performer avatar that requires a smaller processing load for display than the first performer avatar; When the specific condition is not met, the first performer avatar is used as the performer avatar, and when the specific condition is met, the first performer avatar is used as the performer avatar.

2. The virtual space content delivery system according to claim 1.

10. the virtual space content includes at least an action content in which a performer avatar acts in the virtual space; a performer terminal usable by a performer corresponding to the performer avatar; the performer terminal is connected to the server computer via the communication network and is capable of operating the performer avatar as the motion content; 2. The virtual space content delivery system according to claim 1.

11. A virtual space content distribution program for distributing virtual space content in a virtual space, comprising: The virtual space content includes: A content including a video that can be viewed by a viewer user at a viewer user terminal assigned to each of a plurality of viewer users, The viewer may include a viewer avatar by being able to participate in the virtual space that is the subject of the virtual space content by using the viewer user terminal connected via a communication network to a server computer that is capable of executing at least processes related to the virtual space and processes related to the distribution of the virtual space content, In the viewer user terminal, a viewpoint image from the viewer avatar corresponding to the viewer user using the viewer user terminal can be displayed as the virtual space content; the viewer avatars include a first viewer avatar and a second viewer avatar that requires a smaller processing load for display than the first viewer avatar; a second viewer avatar use process for using the second viewer avatar as the viewer avatar when a specific condition corresponding to an increase in a processing load related to the virtual space content to a predetermined specific magnitude is satisfied, and a first viewer avatar use process for using the first viewer avatar as the viewer avatar when the specific condition is not satisfied. A virtual space content delivery program comprising:

12. A virtual space content distribution method for distributing virtual space content in a virtual space, comprising: The virtual space content includes: A content including a video that can be viewed by a viewer user at a viewer user terminal assigned to each of a plurality of viewer users, The viewer may include a viewer avatar by being able to participate in the virtual space that is the subject of the virtual space content by using the viewer user terminal connected via a communication network to a server computer that is capable of executing at least processes related to the virtual space and processes related to the distribution of the virtual space content, In the viewer user terminal, a viewpoint image from the viewer avatar corresponding to the viewer user using the viewer user terminal can be displayed as the virtual space content; the viewer avatars include a first viewer avatar and a second viewer avatar that requires a smaller processing load for display than the first viewer avatar; a second viewer avatar using step for using the second viewer avatar as the viewer avatar when a specific condition corresponding to an increase in a processing load related to the virtual space content to a predetermined specific magnitude is satisfied, and a first viewer avatar using step for using the first viewer avatar as the viewer avatar when the specific condition is not satisfied. A virtual space content distribution method comprising:

Images