Program, method, and system

Abstract

To provide a program, a method, and a system that enables the restriction of entry into a virtual space by setting an upper limit on the number of entries to be changed according to the situation.SOLUTION: By accepting a request from a user to enter a virtual space, processing is performed to associate the user with one of a plurality of virtual space providing units, each of which has a predetermined upper limit on the number of users to which the virtual space can be provided, and the users include a non-specific user who does not satisfy a specific condition and a specific user who satisfies a specific condition, and when the accepted request to enter is a request to enter from a non-specific user, the non-specific user is not allowed to be associated with a virtual space providing unit with the number of associated users having reached the predetermined number, whereas when the accepted request to enter is a request to enter from a specific user, the specific user is allowed to be associated with a specific virtual space providing unit regardless of whether the number of associated users has reached the predetermined number.SELECTED DRAWING: Figure 42

Description

Technical Field

[0001] The present invention relates to a program, a method, and a system.

Background Art

[0002] There is known a system that provides a virtual space to a user via a network and enables communication with other users in the virtual space.

[0003] In such a system, there are some cases where an upper limit is set on the number of users who can enter the virtual space due to factors such as the processing capacity of a server that provides the virtual space. Also, regardless of the processing capacity of a server or the like, there are some cases where an upper limit is set on the number of users who can enter a so-called room (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, in the conventional system, although the processing capacity of the server is considered, it is common that the upper limit is set with a margin so that the processing capacity of the server is not affected even when the upper limit is reached. When the upper limit is reached, access to the virtual space is uniformly restricted. On the other hand, for example, in order to liven up an event in the virtual space, there may be situations where a plurality of talents or famous people wish to enter the same virtual space, or where other users who are in a friendship relationship wish to enter the same virtual space because their friends are already in the virtual space. However, when the upper limit has been reached in the conventional system, such situations cannot be dealt with.

[0006] The present invention has been conceived in view of such circumstances, and provides a program, a method, and a system that enable the regulation of entry into a virtual space based on an upper limit number to be variable according to the situation.

Means for Solving the Problems

[0007] (1) A program (for example, a virtual space generation program 120, a viewer program) according to an aspect of the present invention is a program for causing a computer (for example, a distribution server computer 100, etc.) that controls a plurality of virtual space providing units (for example, rooms corresponding to space areas ER1a to ER1d in FIG. 12, a plurality of rooms constituting each virtual space in FIG. 42(a)) for providing a virtual space to a user to execute, causing the computer to function as means (for example, steps S423, S425, S426, etc. of room entry special case processing in FIG. 42(b)) for performing processing for associating the user with any one of the plurality of virtual space providing units by receiving an entry request from the user to the virtual space (for example, entry into a room by login, selection of content, etc., designation of a room to enter, etc.), each of the plurality of virtual space providing units has an upper limit of the number of users to be provided set to a predetermined number (for example, 200 people), the users include unspecified users who do not satisfy a specific condition (for example, general users, users having no relevance to other users, etc.) and specified users who satisfy the specific condition (for example, accounts of talents, accounts of operators, etc., or users having relevance to other users), The means for performing the association process does not allow the non-specific user to be associated with a virtual space providing unit where the number of associated users has reached the predetermined number when the received entry request is an entry request from the non-specific user (for example, NO in step S421 or S424 of FIG. 42(b)). On the other hand, when the received entry request is an entry request from the specific user, it is possible to allow the specific user to be associated with a predetermined virtual space providing unit regardless of whether the number of associated users has reached the predetermined number (for example, steps S421 to S423, steps S424 to 425 of FIG. 42(b)).

[0008] According to such a configuration, when it is an entry request from a specific user, the restriction on entry into the virtual space due to the upper limit number is exceptionally lifted, and it is allowed to associate the specific user with a predetermined virtual space providing unit, thereby improving the convenience of the specific user.

[0009] (2) In the above (1), the predetermined virtual space providing unit (for example, a room corresponding to space areas ER1a to ER1d in FIG. 12, a plurality of rooms constituting each virtual space in FIG. 42(a)) is a virtual space providing unit designated by the operator who operates the provision of the virtual space as a virtual space providing unit that can associate the specific user regardless of whether the predetermined number has been reached if it is an entry request from the specific user among the plurality of virtual space providing units (for example, a room with a predetermined room ID).

[0010] According to such a configuration, for a specific user, since it is associated with a virtual space providing unit designated by the operator, the processing burden can be reduced.

[0011] (3) In the above (1), the entry request from the specific user includes designation information for designating the virtual space providing unit to enter (for example, the designation of the room ID in step S422 of FIG. 42(b)). The predetermined virtual space providing unit is a virtual space providing unit specified based on the specified information included in the room entry request from the specific user among the plurality of virtual space providing units.

[0012] According to such a configuration, for a specific user, since the specific user is associated with the virtual space providing unit designated by the specific user, the processing load can be reduced, and the convenience of the specific user can be further improved.

[0013] (4) In the above (3), when the means for performing the association process receives room entry requests from a plurality of specific users to the same virtual space providing unit within a predetermined period, the means performs a process for associating the plurality of specific users with the same virtual space providing unit (for example, allowing the plurality of specific users to enter the same room where a specific user has already entered, refer to the (special case processing for room entry) of the modification example).

[0014] According to such a configuration, by intentionally aligning the entry times, a plurality of specific users can be associated with the same virtual space providing unit. As a result, a plurality of specific users with intentionally aligned entry times can be made to act, etc. within the same virtual space provided by the same virtual space providing unit, and the convenience of the plurality of specific users can be further improved.

[0015] (5) In the above (1), the predetermined virtual space providing unit is a virtual space providing unit with which another specific user having a relevance (for example, a user who appears in the same live content, a relationship with an intimacy level of a predetermined value or more, etc.) with the specific user making the room entry request is associated.

[0016] According to such a configuration, since the specific users can be associated with the virtual space providing unit in consideration of the relevance between the specific users, actions and communications, etc. within the same virtual space provided by the same virtual space providing unit become easier to perform, and the atmosphere within the virtual space can be easily improved.

[0017] (6) In the above (1), the specific user includes a performer who progresses content in the virtual space (for example, a performer who appears as a performer in a live event such as FIG. 35).

[0018] According to such a configuration, the convenience of the performer can be improved.

[0019] (7) In the above (1), the specific user includes a user who has obtained the right to output an image taken in the virtual space so that it can be displayed on another computer (for example, a user who has the right to operate a virtual camera).

[0020] According to such a configuration, the convenience of the user who has obtained the right to output can be improved.

[0021] (8) In the above (1), the specific user includes a user who has a relationship with another user who is already associated with any of the plurality of virtual space providing units (for example, a friend relationship, a relationship where the intimacy is equal to or greater than a predetermined value, etc.). The predetermined virtual space providing unit with which the specific user is associated is the virtual space providing unit with which the other user is associated.

[0022] According to such a configuration, since users can be associated with the virtual space providing unit in consideration of the relationship between users not limited to specific users, actions and communications in the same virtual space provided by the same virtual space providing unit become easier, and the atmosphere in the virtual space can be easily improved.

[0023] (9) A method according to an aspect of the present invention is a control method of a computer (for example, a distribution server computer 100, etc.) that controls a plurality of virtual space providing units (for example, rooms corresponding to space areas ER1a to ER1d in FIG. 12, a plurality of rooms constituting each virtual space in FIG. 42(a)) for providing a virtual space to a user, By accepting an entry request from the user to the virtual space (for example, logging in, entering a room by selecting content, specifying the room to enter, etc.), a process for associating the user with any of the plurality of virtual space providers is performed (for example, steps S423, S425, S426 of the room entry special case process in FIG. 42(b), etc.). Each of the plurality of virtual space providers has a predetermined upper limit on the number of users to be provided (for example, 200 people). The users include unspecified users who do not meet the specific conditions (for example, general users, users who have no relevance to other users, etc.) and specified users who meet the specific conditions (for example, accounts of talents, accounts of operators, etc., or users who have relevance to other users). When the received entry request is an entry request from the unspecified user, the step of association does not allow the unspecified user to be associated with a virtual space provider whose associated number of users has reached the predetermined number (for example, NO in step S421 or S424 of FIG. 42(b)). On the other hand, when the received entry request is an entry request from the specified user, it is possible to allow the specified user to be associated with a predetermined virtual space provider regardless of whether the associated number of users has reached the predetermined number (for example, steps S421 to S423, steps S424 to 425 of FIG. 42(b)).

[0024] According to such a configuration, when it is an entry request from a specified user, the restriction on entry to the virtual space due to the upper limit number is exceptionally lifted, and it is allowed to associate the specified user with a predetermined virtual space provider, thereby improving the convenience of the specified user.

[0025] (10) A system (virtual space content distribution system) according to an aspect of the present invention is a system including a computer (e.g., distribution server computer 100, etc.) that controls a plurality of virtual space providing units (e.g., rooms corresponding to space areas ER1a to ER1d in FIG. 12, etc., a plurality of rooms constituting each virtual space in FIG. 42(a)) for providing a virtual space to a user, means (e.g., steps S423, S425, S426, etc. of room entry special case processing in FIG. 42(b)) for performing processing for associating the user with any one of the plurality of virtual space providing units by receiving an entry request from the user to the virtual space (e.g., login, entry into a room by selecting content, etc., designation of a room to enter, etc.), each of the plurality of virtual space providing units has an upper limit of the number of users to be provided set to a predetermined number (e.g., 200 people), the users include unspecified users who do not satisfy a specific condition (e.g., general users, users having no relevance to other users, etc.) and specified users who satisfy the specific condition (e.g., accounts of talents or operators, etc., or users having relevance to other users), the means for performing the association processing does not allow associating the unspecified user with a virtual space providing unit in which the number of associated users has reached the predetermined number when the received entry request is an entry request from the unspecified user (e.g., NO in step S421 or S424 in FIG. 42(b)), while allowing associating the specified user with a predetermined virtual space providing unit regardless of whether the number of associated users has reached the predetermined number when the received entry request is an entry request from the specified user (e.g., steps S421 to S423, steps S424 to 425 in FIG. 42(b)).

[0026] According to such a configuration, when it is an entry request from a specific user, exceptionally, the restriction on entry into the virtual space due to the upper limit number is released, and it is allowed to associate the specific user with a predetermined virtual space providing unit, thereby improving the convenience of the specific user.

Brief Description of the Drawings

[0027]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Figure 21

Figure 22

Figure 23

Figure 24

Figure 25

Figure 26

Figure 27

Figure 28

Figure 29

Figure 30

Figure 31

Figure 32

Figure 33

Figure 34

Figure 35

Figure 36

Figure 37

Figure 38

Figure 39

Figure 40

Figure 41

Figure 42

Figure 43

Figure 44

Embodiments for Carrying Out the Invention

[0028] A form for implementing a virtual space content distribution system for distributing various contents within a virtual space of the present invention will be described below with reference to the drawings based on examples. In a plurality of drawings, the same or similar components are denoted by the same reference numerals, and redundant explanations are omitted. Also, the distribution program to be executed in the virtual space content distribution system according to the present invention may be a program used throughout the system composed of a server computer and each terminal described later that constitutes the virtual space content distribution system, or it may be a program that operates only on a part of the devices constituting the virtual space content distribution system, for example, a server computer or each terminal.

Examples

[0029] FIG. 1 is a block diagram showing a system configuration example of a virtual space content distribution system in an example which is one embodiment of the present invention. In the system of the present example shown in FIG. 1, a performer avatar 1 corresponding to a performer user is distributed as virtual space content for performing events such as live shows, games, exchange meetings, movie screenings, etc. in the virtual space.

[0030] As shown in FIG. 1, the virtual space content distribution system of the present example mainly includes a distribution server computer 100 capable of executing various processes related to the virtual space and various processes related to the provision and distribution of the virtual space, an event administrator K of an event operation organization that operates and manages events in the virtual space, a manager terminal 150 used by the event administrator K to manage the distribution of events in the virtual space, a performer terminal 200 used by a performer user, and a viewer terminal 300 that can be used by a viewer user who enters and participates in (for example, logs in to) the virtual space and views event content in the virtual space. The distribution server computer 100, the manager terminal 150, the performer terminal 200, and the viewer terminal 300 are connected to each other so as to be capable of data communication via the Internet network N which is an open computer network.

[0031] Note that, in the present example, a form in which the manager terminal 150 and the performer terminal 200 are also connected to the distribution server computer 100 via the Internet network N is illustrated, but the present invention is not limited to this. For example, in a case where an event operation organization provides a studio to a performer user and the distribution server computer 100 is installed in these studios, the manager terminal 150 and the performer terminal 200 may be locally data communication-connected to the distribution server computer 100, or may be communication-connected via a local area network LAN within the studio facility.

[0032] Also, as shown in FIG. 1, there are a plurality of viewer users, such as viewer user A, viewer user B, viewer user C, etc. As the viewer terminals 300, there are viewer terminals 300a, 300b, 300c, etc. that can be used by individual viewer users A, B, C, etc. Note that the number of viewer users is usually plural, but it may be one person or four or more people, and the number may be appropriately determined according to the type of event content provided in the virtual space. Hereinafter, viewer users A, B, C, etc. may be collectively referred to as viewer users, and viewer terminals 300a, 300b, 300c, etc. may be collectively referred to as viewer terminals 300.

[0033] In addition, in this embodiment, a form in which there is one performer user is illustrated, but the present invention is not limited to this. The event content provided in the virtual space may be a co-starring event in which a plurality of performer users who are acting alone participate and proceed, or a group event in which a plurality of people who are acting together participate and proceed. Thus, when a plurality of performers appear, performer terminals 200a, 200b, 200c, etc. may be provided for each performer user, or when a plurality of people appear as a group, one performer terminal 200 may be used by a plurality of people. Note that a performer user (also referred to as a talent user) is a user who serves as a speaker, emcee / progress controller, lead actor, etc. in the event content. In the event content, it will be proceeded by avatars that serve as progress controllers, such as performer avatars corresponding to the actions of the performer users and operation avatars corresponding to the operations of operators (also referred to as operation users) who operate the event.

[0034] In addition, in FIG. 1, the distribution server computer 100 is shown alone, but the present invention is not limited thereto. These distribution server computers 100 may be configured with a plurality of server computers such as a first server computer mainly performing virtual space processing and a second server computer mainly performing distribution processing, or may be configured with a cloud server or the like, and the number of server computers may be appropriately changed according to the scale of the event and the number of viewer users participating.

[0035] Similarly, regarding the administrator terminal 150, although it is shown alone in FIG. 1, the present invention is not limited thereto. Needless to say, these administrator terminals 150 may be plural according to the number of performer users and viewer users participating in event contents such as live.

[0036] <Distribution server computer> FIG. 2 is a diagram showing the configuration of the distribution server computer 100 used in this embodiment. The distribution server computer 100 used in this embodiment is a normal server computer with relatively excellent processing ability installed in a studio operated by an event management organization as described above. As shown in FIG. 2, it has a processor (CPU) 101 connected to a data bus 108, a memory (RAM) 102, a storage 103 such as a hard disk, a communication interface (I / F) 104 capable of two-way communication by the TCP / IP protocol via the Internet which is an open computer network, and an input / output interface (I / F) 105 to which an input device such as a keyboard can be connected.

[0037] In addition, in this embodiment, an input / output interface (I / F) 105 is provided to enable local operations. However, when remote operations via the communication interface (I / F) 104 are possible, it may be in a form without providing the input / output interface (I / F) 105.

[0038] In the storage 103 of the distribution server computer 100, in addition to an operation system (server OS) for providing server functions (not shown), various data and programs are stored as shown in FIG. 3. Specifically, mainly, an event management program 110 for providing an event management function for managing various events, a virtual space generation program 120 for providing a virtual space for an event venue, a speaker user management program 130 for providing a speaker user management function for managing speaker users, and a viewer user management program 132 for providing a viewer user management function for managing viewer users are stored.

[0039] The event management program 110 is a program for managing an event held at an event venue in cooperation with the administrator terminal 150, and can manage the progress of the event using event data 111 (see FIG. 7), time schedule data (TS data) 112, music data 113, etc. stored in the storage 103 together with the event management program 110.

[0040] The event data 111 used in this embodiment is illustrated in FIG. 7. The event data 111 is associated with an event ID uniquely assigned to the event, and includes information such as the event name, the file name of the time schedule (TS) data, the speaker ID uniquely assigned to the speaker user who is the performer, the file name of the music list, etc., the file name of the participation viewer list in which information of special viewer users who are permitted virtual participation is registered in the third area of the virtual audience area described later, and the file name of the participation viewer list in which information of viewer users who have reserved virtual participation is registered in the fourth area of the virtual audience area described later. Further, the event data includes information for specifying the date and time when the event is held, and the event content will be distributed at that date and time. Furthermore, the event data includes information for specifying the date and time when the virtual space for holding the event is released to allow users to enter the content before the scheduled date of the event.

[0041] Still, the time schedule data (TS data) 112 is data in which the order of progress of the virtual space live event to be held and programs such as music are described in time series, and the virtual space live event is managed to proceed based on the time schedule described in the time schedule data (TS data) 112. Further, these time schedule data (TS data) 112, event data 111, etc. can be changed, updated, and added by the event administrator K operating the administrator terminal 150.

[0042] Also, the music data 113 is data of the performance parts (so-called karaoke) of each music sung by the performer user, and is reproduced by the voice control program 124 described later based on the time schedule data (TS data) 112 by the event management program 110 and transmitted to the performer terminal 200 and the viewer terminal 300 (see FIG. 11).

[0043] The virtual space generation program 120 is a program for providing an event venue that is a virtual space, and uses the virtual space data 121 in which the structure of the event venue stored in the storage 103 together with the virtual space generation program 120 is described, object data 122 for arranging various objects (including the star decorations 43 on the stage and the star objects 50 to 52 in the sky) arranged in the event venue in the virtual space, and the performer avatar data included in the performer user data 131 described later and the viewer avatar data included in the viewer user data 133 to provide a function of providing an event venue in which the performer avatar and the viewer avatar are virtually participating.

[0044] The viewpoint video control program 123 provides a function to generate viewpoint videos from virtual cameras C1 to C4 and an airborne virtual camera (not shown) virtually set in the event venue as shown in FIG. 13, etc. It is also a program for providing functions such as displaying videos from the viewpoints of viewer avatars 11 to 14 virtually participating in the third area of the event venue and viewer avatars 21 to 32 virtually participating in the fourth area on the performer terminal 200 in cooperation with the viewer terminal 300. Note that the virtual camera C2 is a virtual camera set to be the video from the viewpoint of the performer avatar 1 on the stage of the event venue, and the viewpoint video from the virtual camera C2 is projected onto the screen S provided in the studio by a projector 211 described later connected to the viewer terminal 300.

[0045] The audio control program 124 is a program for controlling the audio (including music) distributed in the event in the virtual space. Specifically, it provides functions such as a function to play music data 113 and a function to synthesize the music played with the voice uttered by the performer user and distribute it to the administrator terminal 150 and the viewer terminal 300.

[0046] The comment control program 125 provides a function to display various comments input by each viewer user on the viewer terminal 300 in the event in the virtual space on the performer terminal 200 and the viewer terminal 300 in chronological order in cooperation with the viewer comment control program stored in the viewer terminal 300 described later.

[0047] The gift control program 126 is a program for controlling gifts given from viewer users to performer users in cooperation with the viewer program stored in the viewer terminal 300 described later. Specifically, it provides functions such as the viewer user purchasing a gift based on the information on the purchase unit price set for each gift stored in the gift data 134 (e.g., purchasing an object), a processing function for the viewer user to give the purchased gift to the performer user using the object data of the gift included in the gift data 134 (including processing such as effects when giving), and a processing function for changing the owner of the given gift from the viewer user to the performer user, etc.

[0048] The performer user management program 130 provides a management function and an authentication function, etc., for information related to performer users based on the performer user data 131 shown in FIG. 8 stored in the storage 103 together with the performer user management program 130.

[0049] The performer user data 131 used in this embodiment is illustrated in FIG. 8. The performer user data 131 stores various information such as the account (email address), name, authentication information, file name of the avatar data of the avatar used in the virtual space, file name of the item list where the owned items are registered, etc., in association with the performer user ID uniquely assigned to the performer user. Although not shown in FIG. 8, information on virtual values such as points owned by each performer user may be stored as the performer user data 131.

[0050] The performer user can be authenticated by verifying the performer user ID, account, and authentication information, etc., and can identify the items (gifts) that each performer user will own after being given by the viewer from the item list.

[0051] The viewer user management program 132 provides a management function and an authentication function for information related to viewer users based on the viewer user data 133 shown in FIG. 9 stored in the storage 103 together with the program.

[0052] The viewer user data 133 used in this embodiment is illustrated in FIG. 9. The viewer user data 133 is associated with a viewer user ID uniquely assigned to a viewer user, and includes the account (e-mail address) of the viewer user, authentication information, the file name of avatar data of an avatar used in the virtual space, the number of owned points which is the number of points available for use in the virtual space, the file name of an item list in which items (gifts) purchased using points are registered, personal information such as name, date of birth, and telephone number, and various other information. Although not shown in FIG. 9, a nickname (comment name) displayed together with a comment is also registered in the viewer user data 133, and the nickname (comment name) is displayed together with the comment. Also, points can be increased, for example, by purchasing from a predetermined operating company.

[0053] <Performer terminal> FIG. 4 is a diagram showing a configuration example of the performer terminal 200 in the virtual space content distribution system of this embodiment. In this embodiment, as shown in FIG. 11, the performer terminal 200 is provided in an adjustment room adjacent to a studio where a performer user performs acting operations, and uses a normal computer with relatively excellent processing capabilities. As shown in FIG. 4, it has a processor (CPU) 201 connected to a data bus 208, a memory (RAM) 202, a storage 203 such as a hard disk, a communication interface (I / F) 204 capable of two-way communication by the TCP / IP protocol via the Internet which is an open computer network, an image processing unit 206 including a graphics processing unit (GPU) to which display devices A210 to display devices C212 are connected, and an input / output interface (I / F) 205 to which various input / output devices are connected.

[0054] The input / output interface (I / F) 205 is connected to, as input devices, a motion sensor 220 including a plurality of wearable sensors 220C1 to 220C5 (see FIG. 11) worn by the performer user on the left and right hands, feet, and waist, an expression input device 221 composed of an imaging camera for inputting the expression of the performer's face, a voice input device 222 composed of a sound collection microphone worn on the head of the performer user, an operation input device 224 such as a keyboard or a touch panel on which an auxiliary operator O for assisting the performer user is operably provided, and the like. Incidentally, as these input devices, by providing a controller that enables various operations by being held by the performer user, the performer himself / herself may be able to perform various operations without the auxiliary operator O.

[0055] Incidentally, in this embodiment, since the performer user performs a performance operation (music operation) according to the music, the operation during the performance is assisted by the auxiliary operator O. However, it may be configured without providing the auxiliary operator O by having a plurality of these auxiliary operators O or by setting the operation content in advance in the performer terminal 200, for example, in a sequence program or the like.

[0056] The input / output interface (I / F) 205 is connected to a voice output device 223 including a high-function earphone (ear monitor) worn by the performer user and a speaker arranged in the adjustment room as an output device. Thus, the sound of the reproduced music transmitted from the distribution server computer 100 is output to the performer user via the high-function earphone (ear monitor), and the music sound together with the voice of the performer is output from the speaker. As a result, the auxiliary operator O and the like can confirm the situation of the music including the voice emitted by the performer user in the adjustment room.

[0057] In this embodiment, a high - performance earphone (ear monitor) is used to avoid the inconvenience caused by the input of the reproduced music voice from the sound - collecting microphone worn by the performer user. However, the present invention is not limited to this. As long as the inconvenience caused by the input of the music voice can be avoided, the music voice may be output from a speaker in the studio or the like.

[0058] In addition, in this embodiment, the form in which the performer user wears the sound - collecting microphone is exemplified. However, these sound - collecting microphones may be of an installation type installed on the floor, wall, or ceiling of the studio.

[0059] Here, the motion sensor 220 used in the performer terminal 300 of this embodiment will be described. Any motion sensor 220 can be used as long as it can appropriately detect (measure) the movement (action) of the body of the performer user. In this embodiment, in order to detect the motion of the performer more accurately and with a short cycle, a plurality of wearable sensors 220C1 to 220C5 worn on the body of the performer user are used. In addition, a motion sensor 220 of a type such as LiDER using laser light or the like, which the performer does not wear a device, may be used.

[0060] In addition, in this embodiment, in order to reduce the operation burden caused by wearing sensors or the like when the performer user performs a performance operation, particularly the operation burden on the head, the movement of the head of the performer user is detected by image recognition using an image captured by an imaging camera constituting the expression input device 221 as described later, and the movement other than the head is exemplified in a form using five wearable sensors 220C1 to 220C5. However, for example, a wearable sensor may also be provided on the head or the like of the performer user, and furthermore, in order to detect more detailed movements, more (7 or more) wearable sensors may be worn.

[0061] As shown in FIG. 11, the wearable sensors 220C1 to 220C5 cooperate with a base station 220a and a base station 220b installed in a studio room separated from an adjacent adjustment room by a glass window to detect their own positions and orientations.

[0062] These base stations 220a and 220b can use a multi-axis laser emitter as an example. After emitting the blinking light for synchronization, the base station 220a scans the laser light around, for example, the vertical axis. The base station 220b scans the laser light around, for example, the horizontal axis.

[0063] Each of the mounting sensors 220C1 to 220C5 may include a plurality of optical sensors that detect the incidence of the blinking light and the laser light from the base stations 220a and 220b.

[0064] Each of the mounting sensors 220C1 to 220C5 can detect its own position and orientation based on, for example, the time difference between the incidence timing of the blinking light and the incidence timing of the laser light, the light reception time at each optical sensor, the incidence angle of the laser light detected by each optical sensor, and other information as necessary. For example, it can preferably use the ViveTracker provided by HTC CORPORATION or the base station.

[0065] Since the base stations 220a and 220b emit the blinking light and scan the laser light at regular intervals, the detection information of each of the mounting sensors 220C1 to 220C5 is updated for each interval. Then, the detection information indicating the position and orientation of each motion sensor calculated in each of these mounting sensors 220C1 to 220C5 is input to the performer terminal 200 by short-range wireless communication, and together with the face motion information, it is transmitted to the distribution server computer 100 as performer avatar information (see FIG. 10).

[0066] In addition, in this embodiment, a form using two base stations, the base station 220a and the base station 220b, is exemplified, but the present invention is not limited to this, and three or more of these base stations may be used.

[0067] Alternatively, the motion sensor 220 may be configured such that each of a plurality of motion sensors worn by the performer user is equipped with a number of infrared LEDs or visible light LEDs, and the position and orientation of each of the motion sensors are detected by detecting the light from these LEDs with an infrared camera provided on the floor or wall of the studio.

[0068] Alternatively, in order to reduce the burden on the performer user, the motion sensor 220 may be replaced with a motion sensor using lighter reflective markers instead of the wearable sensors 220C1 to 220C5. That is, by photographing reflective markers attached to each part of the performer user's body with adhesive tape or the like to generate photographed data, and by performing image processing on this photographed data to detect the position and orientation of the reflective markers, the motion of the performer user may be detected. In this case, a cameraman for photographing the performer user may be arranged in the studio, and the cameraman may photograph the performer user so that the motion of the performer user can be photographed from a direction suitable for detection.

[0069] Alternatively, as the motion sensor 220, a suit incorporating an inertial sensor, for example, an inertial sensor-incorporated suit for the MVN motion capture system marketed by Xsens.com, may be used, and the motion of the performer user may be detected by analyzing the sensor signal output from the inertial sensor.

[0070] The expression input device 221 can be any device as long as it can appropriately detect the motion of the head including the face of the performer user. In this embodiment, specifically, it is configured by an imaging camera (digital camera) arranged to be able to continuously image the head image including the face of the performer user. The motion of the head and the motion of the face (expression) of the performer user imaged by the imaging camera are detected by image recognition, and the information of the face motion, which is the detected motion of the head and the motion of the face (expression), is transmitted to the distribution server computer 100 as performer avatar information together with the information of the body motion as shown in FIG. 10.

[0071] Furthermore, the expression input device 221 is not limited to the imaging camera (digital camera) used in this embodiment. For example, the expression input device 221 may be a 3D camera capable of detecting the depth of a person's face. Alternatively, for example, a mobile terminal such as a smartphone equipped with a LiDER device may be used. In this case, these mobile terminals may be worn by the performer user.

[0072] In the performer terminal 200 of this embodiment, as described above, it has three display devices A210 to C212. As shown in FIG. 11, the display device A210 is a liquid crystal monitor or the like provided in the adjustment room. The display device B211 is a projector that projects an image onto the screen S provided in the studio. The display device C212 is a vertical large display provided adjacent to the screen S in the studio.

[0073] On the display device A210 arranged in the adjustment room of the studio, images from the viewpoints of the virtual cameras C1 to C4, the viewpoint images from the aerial moving virtual camera during the flying effect period described later, the content of the comment, and a message input window for the assistant operator O to input a message to be transmitted to the performer user are displayed.

[0074] On the other hand, on the screen S projected from the projector which is the display device B211 provided in the studio, for example, as shown in FIG. 16, an image including the avatars of the viewers virtually participating in the live in the third region and the fourth region, which is the viewpoint image of the virtual camera C2 (see FIG. 13) from the performer's viewpoint, is displayed. Thus, the performer user can confirm the situation of the viewer users virtually participating in the virtual space live through the image.

[0075] In addition, on the display device C212 provided in the studio, comments from the viewer users, comments and messages input by the assistant operator O, etc. are displayed. Thus, the performer user can confirm the comments of the viewer users or the messages from the assistant operator O even during the performance.

[0076] In the storage 203, in addition to an operation system (OS) for operating the computer which is the performer terminal 200, various functions including the operation control function of the performer avatar 1 by the performer user in the virtual space live which is virtual space content by the execution of a processor (CPU) 201 etc. are provided in cooperation with the distribution server computer 100, and a performer program is stored.

[0077] As shown in FIG. 4, the performer program includes a performer avatar control program, a performer viewpoint video control program, a performer viewpoint video control program, a performer voice control program, a performer comment control program, performer authentication data, etc.

[0078] The performer avatar control program mainly scans the body motion of the performer user using the motion sensor 220, scans the face motion (expression) of the performer user using the expression input device 221, generates performer avatar information for operating the performer avatar, and is a program that provides a function of transmitting it to the distribution server computer 100.

[0079] The performer viewpoint video control program is a program that provides a function of generating and outputting a viewpoint video of the virtual camera C2 which is the performer viewpoint based on the virtual space update data distributed from the distribution server computer 100.

[0080] The performer voice control program outputs the reproduction sound of the music based on the reproduction music data distributed from the distribution server computer 100 via the voice output device 223, digitizes the voice input from the voice input device 222, transmits it to the distribution server computer 100 as performer voice data, and is a program that provides a function of generating and outputting a monitor voice composed of the reproduction sound of the music and the performer voice.

[0081] The presenter comment control program is a program that provides a function to display each comment etc. by viewer users distributed from the distribution server computer 100.

[0082] The presenter authentication data is data for authenticating that the presenter user is the actual person in the communication connection with the distribution server computer 100.

[0083] In addition, the presenter avatar control program includes a motion parameter generation program etc. that can generate parameter information on the positions and rotation angles of bones (bones) that make up rig data (sometimes called "skeleton data") indicating the skeleton of the presenter avatar included in the presenter avatar data, and also includes an image recognition processing program etc. for image-recognizing the position and expression of the head of the presenter user from the image captured by the imaging camera.

[0084] Also, in this embodiment, the presenter terminal 200 is an example of a form in which a computer that becomes the presenter terminal 200 installed in a studio operated by an event management organization is jointly used by a plurality of presenter users, and when holding a live event, each presenter user can use it as the presenter terminal 200 of that presenter user by inputting the presenter authentication data. However, the present invention is not limited to this. For example, when a presenter user appears in a virtual space live from home etc., the presenter terminal 200 may be a dedicated computer installed by the presenter user at home, and in such a case, it may be a form used only by the owning presenter user, and in such a case, it is not always necessary to store the presenter authentication data.

[0085] In this way, by the performer user or the like using the performer terminal 200 that constitutes the virtual space content distribution system of this embodiment, the performer user can operate the performer avatar 1 arranged on the virtual stage G in the event venue in conjunction with his or her own actions, can reflect his or her own expression in the expression of the performer avatar 1, and can distribute his or her own voice as the voice of the performer avatar 1 to the viewers through the distribution server computer 100.

[0086] <Viewer terminal> FIG. 5 is a diagram showing a configuration example of the viewer terminal 300 in the virtual space content distribution system of this embodiment. In this embodiment, the viewer terminal 300 is a smartphone P carried by the viewer user or a stationary ordinary computer (PC) installed by the viewer user at home or the like. As shown in FIG. 5, it has a processor (CPU) 301 connected to the data bus 308, a memory (RAM) 302, a storage 303 such as a hard disk or a non-volatile memory, a communication interface (I / F) 304 capable of two-way communication by the TCP / IP protocol via the Internet which is an open computer network, an image processing unit 306 including a graphics processing unit (GPU) to which a display device 310 is connected, and an input / output interface (I / F) 305 to which various input / output devices are connected.

[0087] As will be described later, the display device 310 is generated based on the virtual space data of the event venue, which is a virtual space updated by virtual space update data (see FIG. 10) distributed from the distribution server computer 100 by the viewer viewpoint video control program included in the viewer program stored in the storage 303. Any device that can display each viewpoint video and the flying viewpoint video distributed from the distribution server computer 100 during the flying effect period described later may be used. When the viewer terminal 300 is a smartphone P, the display of the smartphone P is applicable. When the viewer terminal 300 is a normal computer (PC), the stationary display that constitutes the computer (PC) is applicable. Note that these displays are not limited to those that display a planar view image (2D image). For example, they may be able to display a stereoscopic image (3D image) by displaying a right-eye image and a left-eye image, such as a head-mounted display (HMD) that a viewer can wear.

[0088] Connected to the input / output interface (I / F) 305 are, as input devices, an operation input device 321 composed of one or a plurality of devices that enable a viewer to perform various operations, and an audio output device 322 such as earphones or speakers that can output live audio and the like distributed from the distribution server computer 100.

[0089] Needless to say, the audio output device 322 may not be a single device and may be integrated with the display device 310 like the above-described head-mounted display (HMD).

[0090] The operation input device 321 can be any device as long as it can execute various operations such as operation operations including movement of the viewer avatar, zoom operations, operations related to comments, operations related to gifts, etc. For example, it is composed of at least one or more of a transparent touch panel formed on the display surface of a smartphone, a keyboard that constitutes a computer, a game controller, and the like.

[0091] Also, in this embodiment, as a viewer, as will be described later, the virtual audience area in the event venue is divided into, for example, as shown in FIG. 13, a third area near the virtual stage G where only viewer users specially permitted by the performer user can virtually participate, and a fourth area around the third area where general viewer users can virtually participate. Viewer users who virtually participate in the fourth area may use, as described above, an operation input device 321 such as a touch panel, a keyboard, or a game controller. However, viewer users who virtually participate in the third area are viewer users who can finely operate the viewer avatar according to their own actions, like the performer user, by owning, for example, an MVN motion capture suit with the above-described inertial sensor as the operation input device 321.

[0092] However, even viewer users permitted to virtually participate in the third area cannot change the expression of the viewer avatar. However, the present invention is not limited to this, and the expressions of these viewer avatars may be changed, for example, as described above, by having the viewer user use the camera function of a smartphone or a camera connected to a computer to recognize the facial expression of the viewer user, even at a level different from the change level of the performer user.

[0093] In addition, various input / output devices connected to these input / output interfaces (I / F) 305 may be built-in or external. In the case of an external device, it may be connected in either a wired or wireless connection form.

[0094] In the storage 303, in addition to an operation system (OS) for operating a smartphone or a computer which is the viewer terminal 300, a viewer program for providing various functions including a live viewing function for viewer users in the virtual space live which is virtual space content by being executed by a processor (CPU) 301 or the like is stored as a viewing app in cooperation with the distribution server computer 100.

[0095] As shown in Fig. 5, the viewer program includes a viewer perspective video control program that provides a function to generate each perspective video of the virtual space live broadcast to be displayed on the display device 310, a viewer audio control program that provides a function to output live audio (data) of the virtual space live broadcast distributed from the distribution server computer 100 from the audio output device 322, a function to display comments based on the comment data distributed from the distribution server computer 100, and a function related to comments such as sending the comments input by the viewer to the distribution server computer 100. It also includes viewer authentication data for authenticating that the viewer user is the actual person in the communication connection with the distribution server computer 100.

[0096] Although not shown in Fig. 5, in addition to the above programs, there may be a gift control program for controlling gifts and object placement in the virtual space, a program for purchasing tickets for the viewer avatar to virtually participate in the event, and as shown in Figs. 22 and 23, a region designation program for reserving in advance the region (position) where the viewer avatar can virtually participate in the event venue before the start of the event. Other programs may also be included.

[0097] In this embodiment, the comments input by the viewer are short text messages in text format, but they are not limited to these short text messages in text format. For example, they may be messages in still image format, messages in video format, or any other electronic messages in other formats. The comments are overlaid and displayed on each perspective video on the display device 310.

[0098] In this way, by using the viewer terminal 300 used by the viewer user who constitutes the virtual space content distribution system of this embodiment, the viewer avatar virtually participating in the event venue can be moved and operated, and by changing the viewpoint by the viewer avatar, the viewpoint video displayed on the display device 310 can be changed. At the same time, the zoom state (state of the viewpoint) can also be changed, and the viewer avatar can be operated to cheer for the performer avatar 1.

[0099] In addition, in the case of a viewer avatar that has virtually participated in the third area, it is only possible to move within the third area and it is not possible to move to the fourth area. On the other hand, in the case of a viewer avatar that has virtually participated in the fourth area, it is only possible to move within the fourth area and it is not possible to move to the third area. However, the present invention is not limited to this, and in the case of a viewer avatar that has virtually participated in the third area, it may be possible to move to the fourth area. In addition, of course, the viewer avatar cannot move to the virtual stage G or the like, so the visibility of the performer avatar 1 will not be hindered by the movement of the viewer avatar on the virtual stage G.

[0100] In addition, while the viewpoint video is displayed on these display devices 310 and the live audio is output, it is possible to enjoy the virtual space live as if one is present at the event venue.

[0101] In addition, although detailed description is omitted, by the comment function provided by the viewer comment control program, it is possible to enjoy the virtual space live while checking the comments input by oneself and other viewer users. At the same time, by the gift function of the gift control program, it is also possible to liven up the virtual space live by giving the items one owns to the performer avatar 1.

[0102] <Administrator terminal> FIG. 6 is a diagram showing a configuration example of the administrator terminal 150 in the virtual space content distribution system of this embodiment. In this embodiment, the administrator terminal 150, together with the performer terminal 200, uses a normal computer provided in an adjustment room adjacent to the studio. As shown in FIG. 6, it includes a processor (CPU) 151 connected to a data bus 158, a memory (RAM) 152, a storage 153 such as a hard disk, a communication interface (I / F) 154 capable of two-way communication by the TCP / IP protocol via the Internet, which is an open computer network, an image processing unit 156 including a graphics processing unit (GPU) to which a display device 160 is connected, and an input / output interface (I / F) 155 to which various input / output devices are connected.

[0103] As will be described later, the display device 150 can individually display the perspective videos of each of the virtual cameras C1 to C4 and the aerial movement virtual camera during the flying effect period, which are generated based on the virtual space data of the event venue, which is a virtual space updated by the virtual space update data (see FIG. 10) distributed from the distribution server computer 100 by the administrator perspective video control program included in the administrator program stored in the storage 153. As long as it can display comments based on the comment data distributed from the distribution server computer 100, it may be composed of one or more stationary displays.

[0104] Connected to the input / output interface (I / F) 155 are, as input devices, an operation input device 161 composed of one or more devices that enable various operations by the administrator K, and an audio output device 162 such as earphones, headphones, or speakers that can output live audio and the like distributed from the distribution server computer 100.

[0105] The operation input device 161 can be any device as long as the administrator K can perform various operations such as input and settings related to the events of the virtual space live. For example, it can be composed of at least one or more of the keyboard that makes up a computer, the transparent touch panel formed on the display surface, the viewpoint switching controller, and the like.

[0106] In addition, the various input / output devices connected to these input / output interfaces (I / F) 155 may be in any connection form, either wired or wireless.

[0107] In the storage 153, in addition to the operation system (OS) for operating the computer which is the administrator terminal 150, various functions including the distribution management function related to the distribution of the virtual space live which is virtual space content by the execution of the processor (CPU) 151 etc. are stored, and an administrator program for providing in cooperation with the distribution server computer 100 is stored.

[0108] As shown in FIG. 6, the administrator program includes an administrator viewpoint video control program, an administrator voice control program, an administrator comment control program, a viewer management program, a performer management program, and the like.

[0109] The administrator viewpoint video control program is a program that provides a function of generating a viewpoint video from each virtual camera to be displayed on the display device 160 and a function of changing and switching each viewpoint.

[0110] The administrator voice control program is a program that provides a function of outputting the live voice based on the voice data of the virtual space live distributed from the distribution server computer 100 from the voice output device 162.

[0111] The administrator comment control program is a program that displays comments based on the comment data distributed from the distribution server computer 100 and provides functions related to comments such as prohibiting the distribution of comments and selecting viewers so that they are not distributed.

[0112] The viewer management program is a program for managing viewer users who virtually participate in a virtual space live, and the performer management program is a program for managing performer users who virtually participate in a virtual space live.

[0113] Although not shown in FIG. 6, there are included an authentication program for the administrator, who is the operator, to authenticate whether he / she is the actual person, a schedule program for editing the time schedule, music order, etc. of the virtual space live, and other programs may be included as well.

[0114] In this way, by the administrator K operating the administrator terminal 150 that constitutes the virtual space content distribution system of this embodiment, various settings for executing an event can be carried out, for example, settings related to the program, music order, production, time schedule, the trajectory along which the virtual camera moves in the air during the flying production period, etc. Thus, the virtual space live is managed based on the content set in this way.

[0115] <Overall view of the virtual space> Hereinafter, as an example of content, content in which a live event is performed by a performer in a virtual live venue will be described. An overall view of the virtual space provided by the system of this embodiment is shown in FIG. 12. The virtual space ER of this embodiment includes a plurality of types of space areas ER (space area ER1, space area ER2...). In each space area ER, it is possible to provide contents with different genres and types. As the plurality of types of space areas ER, for example, an entrance that functions as a lobby when a user logs in to the virtual space ER, a live venue, game content, an exhibition hall, and other areas corresponding to each of various contents are provided. Note that various areas may be selectable from a title screen displayed when a user logs in to the virtual space ER. The event venue described later using FIGS. 13, 24, and 25 is constructed in the whole of a predetermined space area ER or a part of a predetermined space area ER.

[0116] Each space area ER is provided with a plurality of rooms in which the same content is provided. Each room has a determined upper limit number of people who can enter the room. For example, up to 200 people can be accommodated. Each room is managed by, for example, a real-time synchronization server. Users who have entered the same room can visually recognize each other's user avatars and communicate with each other. For example, they can play a game together or have a conversation by chatting. For example, if the space area ER1 is a space imitating a town, in the rooms ER1a, ER1b... corresponding to the space area ER1, a space imitating the same town is provided to the user, but the avatars that can be displayed in the space are only the user avatars corresponding to the users associated with the same room. For example, the user avatar 1 of the user associated with the room ER1a is not displayed on the user screen of the user associated with the room ER1b. However, exceptionally, for the user avatars of special users (for example, talents), it is possible to be displayed not only in the room where they actually enter but also in other rooms (also referred to as mirroring).

[0117] The movement between the respective spatial areas ER may be such that after the user logs in to the virtual space, the user cannot move to other spatial areas ER unless via a spatial area ER defined as an area (e.g., an entrance) that provides specific content. Alternatively, they may be able to move back and forth between each other. For example, it may be that the user cannot move from spatial area ER2 to spatial area ER3 without passing through spatial area ER1, or it may be possible to move directly between spatial area ER2 and spatial area ER3 without passing through spatial area ER1. Also, when moving between spatial areas ER, a switching effect may be performed. For example, when moving to another spatial area ER, the display screen may fade to black (e.g., a screen where a message such as "Loading..." is displayed on a black screen) and then switch. Also, regarding the user's access to each spatial area ER, after logging in, the user may first enter the entrance area, or there may be a case where the user can select and enter their preferred spatial area ER without passing through the entrance area, or the user may transition to a randomly determined spatial area ER by lottery. For each room as well, the user may select and enter their preferred room, or the user may enter a randomly determined room by lottery.

[0118] <Virtual live venue> The virtual live venue, which is the virtual space used in this embodiment, is shown in FIG. 13. The virtual live venue shown in FIG. 13 is constructed in a predetermined spatial area ER among the spatial areas ER shown in FIG. 12. As shown in FIG. 13, the virtual live venue is a virtual space that, similar to a live venue in the real space, has a virtual stage G where a performer user appears as a performer avatar 1 and a virtual audience area where viewer users who are the audience virtually participate as viewer avatars.

[0119] As shown in FIG. 13, the virtual stage G has a trapezoidal floor surface with a relatively large area, and the performer avatar 1 can move on the virtual stage G, similar to a live venue in the real space. On the side opposite to the virtual audience direction of the virtual stage G, as shown in FIG. 13, a virtual stage wall divided into three parts, namely a central part, a right side part, and a left side part, is formed. On the front surfaces of these virtual stage walls, virtual displays 40, 41, and 42 are provided, and production images and videos are virtually displayed on the virtual displays 40, 41, and 42.

[0120] In addition, between the virtual displays 40, 41, and 42, a virtual arrangement object 43 of stars related to the performer user is arranged. In the second region, which is a region on the virtual stage G above the first region surrounded by the virtual stage wall, as shown in FIG. 13, large virtual sky objects 50 to 52 of stars are arranged. The virtual sky objects 50 to 52 can move within the second region.

[0121] In front of the virtual stage G, a virtual audience area is provided where viewer users can virtually participate in the virtual live venue as viewer avatars. As shown in FIG. 13, this virtual audience area includes a third region, which is a special area close to the center of the virtual stage G where the performer avatar 1 takes the stage, and a fourth region formed to surround the third region and having a greater distance from the center of the virtual stage G than the third region.

[0122] In these third regions, within a predetermined upper limit number range, special viewer users permitted virtual participation can virtually participate. In this embodiment, as shown in FIG. 13, for example, viewer avatars 11 to 14 of four viewer users who meet a predetermined virtual participation record and are permitted virtual participation by the performer user are arranged.

[0123] In the fourth area, viewer avatars 21 to 32 of general viewer users who reserved virtual participation before the start of the virtual space live are arranged. In FIG. 13, the viewer avatars 21 to 32 are shown in a simplified manner for convenience, but they are the same avatars as the viewer avatars 11 to 14.

[0124] In addition, each of the viewer avatars 11 to 14 arranged in the third area can move within the third area by the viewer user operating the viewer terminal, and each of the viewer avatars 21 to 32 arranged in the fourth area can also move within the fourth area by the viewer user operating the viewer terminal.

[0125] In the virtual live venue, as shown in FIG. 13, four virtual cameras C1 to C4 are virtually arranged (set). The virtual camera C1 is a virtual camera that is virtually arranged in front of the performer avatar 1 so as to face the performer avatar 1. The perspective video by the virtual camera C1 is, as shown in FIG. 14(a), a perspective video of seeing the performer avatar 1 from a position near the front.

[0126] The virtual camera C2 is a camera that is virtually arranged above the performer avatar 1. The perspective video by the virtual camera C2 is, as shown in FIG. 16, a performer's perspective video of seeing the virtual audience area from the performer avatar 1.

[0127] The virtual camera C3 is a virtual camera that is virtually arranged on the virtual display 41 diagonally behind the performer avatar 1. The perspective video by the virtual camera C3 is, as shown in FIG. 14(c), a perspective video of seeing the virtual audience area from diagonally behind the performer avatar 1.

[0128] The virtual camera C4 is a virtual camera that is virtually arranged on the virtual display 42 diagonally behind the performer avatar 1. The perspective video by the virtual camera C4 is, as shown in FIG. 14(b), a perspective video of seeing the virtual audience area from diagonally behind the performer avatar 1.

[0129] In addition, in this embodiment, in addition to the virtual cameras C1 to C4 that are fixedly arranged (set), an airborne virtual camera (not shown) that is set to be movable in the air within the space of the virtual live venue, which is a virtual space, is virtually arranged. The airborne trajectories along which these airborne virtual cameras move, as well as the viewing directions (angles) at individual positions on the airborne trajectories, etc., are preset by the administrator terminal 150. During the flying effect period described later, the performer avatar 1 virtually flies so as to follow the airborne trajectory of the airborne virtual camera, and a viewpoint video capturing the virtually flying performer avatar 1 with the airborne virtual camera is generated.

[0130] In addition, in this embodiment, as shown in FIG. 13, a form in which four virtual cameras C1 to C4 are virtually arranged as fixedly arranged (set) virtual cameras is illustrated. However, the present invention is not limited to this, and the number of these fixedly arranged (set) virtual cameras may be five or more. Conversely, without providing these fixedly arranged (set) virtual cameras, only the viewpoint videos seen from the viewpoints corresponding to each avatar that virtually participates in the virtual live venue may be displayed on the performer terminal 200 and the viewer terminal 300.

[0131] In addition, in this embodiment, a form in which there is one airborne virtual camera is illustrated. However, the present invention is not limited to this, and a form in which there are a plurality of these airborne virtual cameras may also be used. Conversely, a form in which the airborne virtual camera is not virtually arranged may also be used.

[0132] <Studio> FIG. 11 is a diagram showing the studio used in this embodiment. In the studio, as described above, an adjustment room separated by a glass window is provided adjacent thereto. The performer user performs each operation corresponding to singing in the studio, and the auxiliary operator O assists in the operation of the performer terminal 300 installed in the adjustment room. Around the performer user wearing the mounting sensors 220C1 to 220C5, the base station 220a and the base station 220b are mounted and arranged on the stand, and in a position almost in front of the performer user, an imaging camera constituting the expression input device 221 is mounted and arranged on the stand.

[0133] On the wall surface where the performer user confronts within the studio, a screen S is provided. From the projector (display device B211) arranged on the ceiling of the studio, the viewpoint video of the virtual camera C2 is projected onto the screen S. As shown in FIG. 16, the viewpoint video seen from the performer avatar 1 of the virtual audience area is displayed on the screen S. The performer user can proceed with the live while sequentially grasping the state of the viewer avatars virtually participating in the virtual audience area (the reactions of the viewers to the live).

[0134] Also, at the side position of the screen S, a vertical large display as the display device C212 is arranged, and comments of the viewers and messages that the assistant operator O wants to convey to the performer user are displayed on the large display. Incidentally, lyrics of the songs sung by the performer in the live, information such as lines (performer support information) may be displayed on the display device C212.

[0135] <Operation of the virtual space content distribution system> FIG. 10 is an explanatory diagram for explaining the operation of the virtual space content distribution system of the present embodiment, specifically, the flow in which the video and audio of the virtual live are distributed.

[0136] First, the video system will be described. As described above, the distribution server computer 100 can provide the virtual space of the virtual live venue based on the virtual space generation program 120 and avatar data of the performer user and viewer users. The operations of the avatars of these performer users and viewer users are updated by the virtual space data in which the state of the virtual space is described by the performer avatar information transmitted from the performer terminal 200 and the viewer avatar information transmitted from the viewer terminal 300. Thus, the operation of the performer user is reflected in the operation of the performer avatar 1, and the operation (operation) of the viewer user is reflected in the operation of the viewer avatar.

[0137] Although not shown in FIG. 10, the performer terminal 200 and the viewer terminal 300 are communicatively connected to the distribution server computer 100 to virtually participate in the virtual space live event. As a result, virtual space data of the virtual live venue is pre-distributed and stored from the distribution server computer 100. The virtual space data pre-stored in this way is sequentially updated by virtual space update data sequentially distributed from the distribution server computer 100 as described later, so that the latest state of the virtual live venue can be specified by the performer terminal 200 and the viewer terminal 300.

[0138] Specifically, the actions and expressions of the performer user in the studio described above are scanned at predetermined time intervals by the functions of body motion scanning and face motion scanning by the performer avatar control program described above to generate performer avatar information, which is then transmitted to the distribution server computer 100.

[0139] On the other hand, viewer users permitted to virtually participate in the third area use a motion sensor, just like the performer. Therefore, they are scanned at predetermined time intervals by the functions of body motion scanning and face motion scanning to generate viewer avatar information, which is then transmitted to the distribution server computer 100.

[0140] In addition, viewer users permitted to virtually participate in the fourth area can cause the viewer avatar to perform corresponding actions by using the touch panel, keyboard, or controller of the viewer terminal 300 to perform various operations such as movement operations, viewpoint direction change operations, view status (zoom) change operations, hand raising operations, hand clapping operations, and jumping operations. Among these operations, viewer avatar information is generated based on the operations related to the actions of the viewer avatar and transmitted to the distribution server computer 100.

[0141] Based on the presenter avatar information transmitted from the presenter terminal 200 and the viewer avatar information transmitted from the viewer terminal 300 in this way, the distribution server computer 100 executes a virtual space update process for updating the virtual space data, thereby reflecting the actions (operations) of the presenter user and the viewer user on each avatar virtually participating in the virtual live venue.

[0142] Then, after executing a virtual space update data generation process for generating virtual space update data based on the virtual space data before the update and the virtual space data after the update, the generated virtual space update data is distributed to the presenter terminal 200 and the viewer terminal 300.

[0143] In the presenter terminal 200 and the viewer terminal 300 to which the virtual space update data is distributed, as shown in FIG. 10, based on the distributed virtual space update data, the pre-stored virtual space data is updated, and a presenter perspective video generation process and a viewer perspective video generation process using the updated virtual space data are executed, so that a presenter perspective video and a viewer perspective video based on the updated virtual space data are generated, and the generated presenter perspective video and viewer perspective video are displayed on the presenter terminal 200 and the viewer terminal 300 (viewer perspective video output process).

[0144] In this way, in this embodiment, the perspective videos of each viewer user virtually participating in the virtual live venue by the viewer avatar are generated and displayed on the viewer terminal 300 side of each viewer user, so that the processing load of the distribution server computer 100 is significantly increased by generating the viewer avatar perspective videos of these viewer users by the distribution server computer 100, and it is possible to avoid the situation where many viewer users cannot participate in the virtual space live, and it is also possible to avoid the situation where distribution becomes difficult due to an increase in the processing load.

[0145] In this embodiment, on the display device 310 of the viewer terminal 300 of the viewer user of the viewer avatar 13 virtually participating in the third area near the performer avatar 1 on the virtual stage G, as shown in FIG. 14(d), a viewpoint video in which the substantially front face of the performer avatar 1 as seen from the viewer avatar 13 close to the performer avatar 1 is largely displayed is generated and displayed. On the other hand, in the fourth area far from the performer avatar 1 on the virtual stage G, for example, on the display device 310 of the viewer terminal 300 of the viewer user of the viewer avatar 28 virtually participating at a position behind the viewer avatar 13, as shown in FIG. 14(e), a viewpoint video in which the substantially front face of the performer avatar 1 appears relatively small through the viewer avatar 13 and the viewer avatar 14 virtually participating in the third area, which is a viewpoint video as seen from the viewer avatar 28 far from the performer avatar 1, is displayed.

[0146] Also, on the display device 310 of the viewer terminal 300 of the viewer user of the viewer avatar 32 virtually participating at the end side position of the virtual stage G in the fourth area set in a U-shaped top view, as shown in FIG. 14(f), a viewpoint video in which the performer avatar 1 appears relatively small through the viewer avatar 14 virtually participating in the third area, which is a viewpoint video as seen from the viewer avatar 32 at the diagonally forward position of the performer avatar 1, is displayed.

[0147] Note that the display examples shown in FIG. 14 all illustrate the case where the viewer terminal 300 is a stationary computer (PC) and the display device 310 is a stationary display. However, for example, when the viewer terminal 300 is a smartphone P, a tablet, etc., in the case of the viewpoint video of the virtual camera C1, it is displayed as shown in FIG. 15(a), and when the viewer terminal 300 is the viewer terminal 300 of the viewer avatar 13, it is displayed as shown in FIG. 15(b).

[0148] Next, regarding the audio system, in the distribution server computer 100, music data 113 is reproduced by the audio control program 124 based on the time schedule data (TS data) 112, and is transmitted to the performer terminal 200 as the reproduced music (data) (music reproduction process).

[0149] At the performer terminal 200, the music audio from the reproduced music (data) transmitted from the distribution server computer 100 is output to the performer user through the high - performance earphone (ear monitor) worn by the performer user (reproduced music output process). Along with this, as the performer user sings in accordance with the output reproduced music, the performer voice input from the sound - collecting microphone (voice input device 222) is digitized and transmitted to the distribution server computer 100 as the performer voice (data).

[0150] The distribution server computer 100 generates distribution voice (data) from the performer voice based on the performer voice (data) received from the performer terminal 200 and the reproduced music reproduced in the above - mentioned music reproduction process (distribution voice generation process), and distributes the generated distribution voice (data) to the viewer terminal 300 (generated voice distribution process).

[0151] At the viewer terminal 300, the distribution voice is output from the voice output device 322 such as an earphone or a speaker by the distribution voice (data) distributed from the distribution server computer 100, so that the viewer can hear the live voice as if the performer avatar 1 is singing in a virtual live venue.

[0152] In addition, at the performer terminal 200, as described above, the performer voice (data) is transmitted to the distribution server computer 100, and as shown in FIG. 10, by executing the monitor voice generation process and the monitor voice output process, the music audio of the reproduced music and the performer voice are output from the speaker arranged in the adjustment room, so that the auxiliary operator O etc. can confirm the singing situation etc. of the performer user in the adjustment room.

[0153] <Viewer Perspective Video Control Process> Next, the viewer perspective video control process executed based on the viewer perspective video control program included in the viewer program in the viewer terminal 300 will be described with reference to FIG. 21.

[0154] In the viewer perspective video control process, first, it is determined whether or not the performer avatar 1 is in the flying performance period of virtual flight as shown in FIG. 20 (step S1). Whether or not it is in the flying performance period can be specified by the performance state data indicating that it is in the flying performance period from the distribution server computer 100. Incidentally, the distribution server computer 100 transmits the performance state data indicating that it is in the flying performance period to the viewer terminal 300 when it becomes the flying performance period based on the time schedule data.

[0155] If it is in the flying performance period (Y in step S1), the process proceeds to step S21. On the other hand, if it is not in the flying performance period (N in step S1), it is determined whether or not the perspective-related operations including the perspective movement operation (including the change of the perspective by the movement operation or action operation of the avatar) and the zoom operation are disabled (step S2).

[0156] If the perspective-related operations are disabled (Y in step S2), the process proceeds to step S7. If the perspective-related operations are not disabled (N in step S2), it is determined whether or not there is an operation that changes the perspective such as the movement operation or action operation of the avatar (step S3). If there is an operation (Y in step S3), the viewer perspective is changed according to the operation. If there is no operation (N in step S3), the process proceeds to step S5 to determine whether or not there is a zoom operation (step S5).

[0157] If there is a zoom operation (Y in step S5), the video area displayed on the display device 310 is changed to the video area according to the operation. If there is no zoom operation (N in step S5), it is determined whether or not there is an action follow setting (step S7).

[0158] This operation following setting can be arbitrarily set on the viewer terminal 300 by the viewer user according to the type of device used for operation and the proficiency in operation, for example, before or during the live broadcast. Specifically, for example, when not accustomed to operating the operation input device 321 such as the touch panel, keyboard, game controller, etc. used, or when not accustomed to changing the viewpoint by moving or operating the avatar, as described later, since the virtual participation position of the viewer's own avatar is far from the performer avatar 1 and is enlarged and displayed by zooming in, even a slight movement of the performer avatar 1 may cause the performer avatar 1 not to be properly displayed. This setting is made in cases where the viewpoint cannot be changed well in response to the movement or operation of the performer avatar 1, etc.

[0159] If there is no operation following setting (N in step S7), the process proceeds to step S11. On the other hand, if there is an operation following setting (Y in step S7), it is further determined whether the operation following condition is satisfied (step S8).

[0160] In this embodiment, the operation following condition is defined as a condition under which it is almost certain that the performer avatar 1 is not properly displayed on the display device 310. Specifically, when the head (or face) of the performer avatar 1 enters a predetermined range around the display area of the display device 310, since there is a significantly high possibility that the head (or face) will move outside the display area and not be properly displayed due to the movement or operation of the performer avatar 1, it is determined that the operation following condition is satisfied.

[0161] Thus, in this embodiment, by determining that the motion tracking condition is satisfied before the head (face) of the performer avatar 1 disappears from the display area, it is possible to significantly reduce the situation where the head (face) of the performer avatar 1 disappears from the display area. However, the present invention is not limited to this, and these motion tracking conditions may be based on the condition that the head (face) has moved outside the display area, or other conditions may be used as the motion tracking conditions. That is, as long as these motion tracking conditions can prevent the performer avatar 1 from being poorly displayed in the display area, any conditions can be used.

[0162] When the motion tracking condition is satisfied (Y in step S8), after invalidating the viewpoint-related operation (step S12), as the viewpoint video displayed in the display area of the display device 310, the viewpoint is automatically changed to the motion tracking viewpoint where the head (face) of the performer avatar 1 is within the non-established range surrounded by a predetermined range around the display area, and the viewpoint video seen from the motion tracking viewpoint is displayed in the display area of the display device 310 (step S13).

[0163] On the other hand, when the motion tracking condition is not satisfied (N in step S8), it is further determined whether the viewpoint-related operation has been invalidated (step S9). If the viewpoint-related operation has been invalidated (Y in step S9), the invalidated viewpoint-related operation is enabled (step S10) and then the process proceeds to step S11. If the viewpoint-related operation has not been invalidated (N in step S9), the process proceeds to step S11 without passing through step S10.

[0164] In step 11, due to the motion tracking setting not being set or the motion tracking condition not being satisfied, the viewpoint video of the viewer avatar continues to be displayed in the display area of the display device 310 (step S11).

[0165] Also, as described above, when it is the flying performance period in which the performer avatar 1 virtually flies during the live broadcast, it is determined as Y in step S1 and proceeds to step S21, and it is determined whether it is the start timing of the flying performance period (step S21).

[0166] If it is the start timing of the flying performance period (Y in step S21), instead of the viewpoint video or the motion tracking viewpoint video of the viewer avatar that was displayed in the display area of the display device 310 before the start of the flying performance period, a flying viewpoint video distributed from the distribution server computer 100 is displayed (step S22), and then, the viewpoint-related operation is invalidated (step S23), and the process returns to step S1.

[0167] In addition, in this embodiment, during the flying performance period, since the same flying viewpoint video is displayed on the viewer terminals 300 of all viewer users, rather than generating the flying viewpoint video on each viewer terminal 300 side like different viewer avatar viewpoint videos for individual viewer users, it is generated on the distribution server computer 100 side and distributed to the viewer terminals 300, so that even for a viewer terminal 300 with low processing power, a flying viewpoint video with a large drawing load due to the aerial movement of the viewpoint can be displayed well. However, the present invention is not limited to this, and these flying viewpoint videos may be generated on each viewer terminal 300 side in the same manner as the viewer avatar viewpoint videos.

[0168] On the other hand, if it is not the start timing of the flying performance period (N in step S21), it is further determined whether it is the end timing of the flying performance period (step S24).

[0169] Whether it is the end timing of the flying performance period may be specified based on the data indicating the end included in the data of the flying viewpoint video transmitted from the distribution server computer 100, or may be specified by the above-described performance state data different from the flying viewpoint video.

[0170] If it is not the end timing of the flying effect period (N in step S24), that is, if it is during the flying effect period, the process proceeds to step S26. After updating the flying perspective video, the process returns to step 1. On the other hand, if it is the end timing of the flying effect period (Y in step S24), after enabling the viewpoint-related operation (step S25), the process proceeds to step S11. Instead of the flying perspective video that was displayed in the display area of the display device 310 during the flying effect period, the viewpoint video of the viewer avatar is displayed in the display area of the display device 310, and then the process returns to step 1.

[0171] In this way, by executing the viewer viewpoint video control process shown in FIG. 21 in the viewer terminal 300 of the present embodiment, each viewpoint video displayed on the viewer terminal 300 will be described with reference to FIGS. 17 to 20.

[0172] FIG. 17 is a diagram showing the display content of the display device 310 when a zoom operation is performed on the viewer terminal 300 of the present embodiment. In the default state where no zoom operation is performed, as shown in FIG. 17(a), the viewpoint video of the video area centered on the upper body of the performer avatar 1 is displayed. In this default state, when the viewer user performs a zoom-in operation, for example, if the viewer terminal 300 is a smartphone P, an operation of touching the display of "+" (not shown) is performed. If the viewer terminal 300 is a computer (PC), when the "+" key on the keyboard is operated, for example, as shown in FIG. 17(b), the viewpoint video of the video area centered on the head (face) of the performer avatar 1 is displayed.

[0173] On the other hand, when the viewer user performs a zoom-out operation, for example, if the viewer terminal 300 is a smartphone P, an operation of touching the display of "-" (not shown) is performed. If the viewer terminal 300 is a computer (PC), when the "-" key on the keyboard is operated, for example, as shown in FIG. 17(c), the viewpoint video of the video area including the whole body of the performer avatar 1 is displayed.

[0174] In Fig. 17, for the sake of easy understanding of the zoom function, the explanation was given using the perspective video of the virtual camera C1 instead of the perspective of the viewer avatar. However, as shown in Fig. 18, zooming in and zooming out can also be performed in the same way for the perspective of the viewer avatar.

[0175] Also, in the viewer perspective video control process of Fig. 21, although not described in detail, for example, when the live broadcast starts and the performer avatar 1 first appears on the virtual stage G, since the perspective of the viewer avatar is not facing the performer avatar 1, there is a possibility that the period during which the appearing performer avatar 1 is not displayed on the viewer terminal 300 becomes long. Thus, the period when the performer avatar 1 first appears, etc. is set as the appearance performance period, etc. During these performance periods, the perspective video displayed on the viewer terminal 300 is automatically switched to the perspective video of the virtual camera C1, etc. instead of the perspective video of the viewer avatar, and zooming in, etc. can also be made possible for each viewer user to execute in these perspective videos of the virtual camera C1.

[0176] Fig. 18 shows, as an example of the perspective video of the viewer avatar, the perspective video of the viewer avatar 28 who is virtually participating in the fourth region. As shown in Fig. 18, the perspective video of the viewer avatar 28 includes the heads of the viewer avatars 13 and 14 who are virtually participating in the third region, and it becomes a video in which the performer avatar 1 is seen through the heads of these viewer avatars 13 and 14.

[0177] Therefore, the viewer user of the viewer avatar 28 can, for example, perform a zoom-in operation and change to a video area where the upper body of the performer avatar 1 is centrally displayed as shown in Fig. 18(b), so that the viewer avatars 13 and 14 are not displayed and enjoy the live broadcast.

[0178] However, as shown in Fig. 18(b), in the zoomed-in state, for example, when the live show progresses and the performer avatar 1 moves or makes large movements, if the viewer cannot successfully change the viewpoint of the viewer avatar 28 according to the movements of the performer avatar 1, as shown in Figs. 19(d) to (f), the performer avatar 1 may not be displayed properly. Therefore, by paying attention to the viewpoint operation, it becomes difficult to concentrate on the live show, and there may be a situation where the live show cannot be enjoyed well.

[0179] However, in this embodiment, as described above, when the viewer user sets the motion following, as shown in Figs. 19(a) to (c), when the head of the performer avatar 1 enters a predetermined area around the display area, the motion following condition is satisfied and the viewpoint is automatically changed to the motion following viewpoint, and the viewpoint video of the motion following viewpoint is displayed. Therefore, the viewer user does not need to pay attention to the viewpoint operation, and can concentrate on the live show and enjoy the live show well.

[0180] And when the live show progresses to the flying performance period, as shown in Fig. 20, the viewpoint video of each viewer avatar is automatically changed to the flying viewpoint video seen from the airborne virtual camera without the viewer user's operation.

[0181] Specifically, before the performer avatar 1 makes a virtual flight, a video in which the object of the wings grows large on the back of the performer avatar 1 is displayed. Then, by having the performer avatar 1 look up at the virtual airborne object 50 of the star virtually arranged in the second area of the virtual live venue, the viewpoint of the viewer avatar also moves in the same way. At this time, a light effect 61 appears around the performer avatar 1.

[0182] After that, when the performer avatar 1 moves to virtual flight, the viewpoint video displayed on the display device 310 automatically switches from the viewpoint video of the viewer avatar up to Fig. 20(b) to the flying viewpoint video seen from the airborne virtual camera as shown in Fig. 20(c).

[0183] And during the flying performance period, as described above, the virtual camera moving in the air moves within the second area based on a preset air trajectory, and the flying perspective video seen from these virtual cameras moving in the air is displayed on the display device 310 as shown in FIG. 20(d).

[0184] Note that the specific configuration is not limited to the above-described embodiment, and even if there are changes or additions within the scope not departing from the gist of the present invention, they are included in the present invention.

[0185] For example, in the above embodiment, the viewer avatar was exemplified in a form that can freely move within the third area or the fourth area where virtual participation is taking place. However, if this is done, for example, there may be problems such as virtual collisions between different viewer avatars participating in the fourth area or errors occurring in the virtual space data due to overlapping at the same virtual position.

[0186] In order to solve such problems, for example, it may be done as shown in the modified examples shown in FIGS. 22 and 23. Specifically, the third area and the fourth area are divided into fine areas as shown in FIG. 22, and which of these areas to participate in the virtual live is received in advance from the viewer user before the live starts as shown in FIG. 23. When the viewer user participates virtually with the viewer avatar, participation is possible only in the area selected in advance, and by restricting movement to only within the selected area, it is possible to prevent errors from occurring in the virtual space data due to virtual collisions between viewer avatars or overlapping at the same virtual position.

[0187] Further, when allowing each viewer user to pre-select the virtual participation position of the viewer avatar as described above, for example, for viewer users who select the area A1 to C6 on the right side toward the virtual stage G in the fourth area, as the viewpoint video during the flying effect period, a viewpoint video from the position in front of the right side of the virtual flying performer avatar 1 is generated and displayed. For viewer users who select the area D4 to H6 in the center toward the virtual stage G in the fourth area, as the viewpoint video during the flying effect period, a viewpoint video from the position in front of the center of the virtual flying performer avatar 1 is generated and displayed. For viewer users who select the area I1 to K6 on the left side toward the virtual stage G in the fourth area, as the viewpoint video during the flying effect period, a viewpoint video from the position in front of the left side of the virtual flying performer avatar 1 is generated and displayed. According to the position selected by the viewer user, the viewpoint video in the virtual flying, which is a special action, may be made to be a viewpoint video corresponding to the position (area) selected by each viewer user.

[0188] Also, in the above embodiment, the form of generating and displaying the viewpoint video from the viewer avatar on the viewer terminal 200 side is exemplified, but the present invention is not limited to this. For example, in the case of a live event with few virtual participants, the viewpoint video from the viewer avatar may also be generated and distributed on the distribution server computer 100 side. Further, the viewer user may be able to select whether to generate on the viewer terminal 200 side or on the distribution server computer 100 side according to the processing ability and data communication environment of the terminal owned by the user. Alternatively, the distribution server computer 100 may identify the processing ability of the viewer terminal 200 connected by communication and determine whether to generate on the viewer terminal 200 side or on the distribution server computer 100 side based on the identified processing ability.

[0189] In the above-described embodiment, the distribution server computer 100 is exemplified as being installed in a studio operated by an event management organization that hosts a virtual space live event. However, the present invention is not limited to this. As these distribution server computers 100, a server computer owned by a company that leases server computers in a data center or the like may be used, or as described above, a server computer provided by a cloud service may be used. The installation form of these server computers can be any form as long as the function of the distribution server computer 100 can be obtained.

[0190] In the above-described embodiment, the form in which a performer user performs singing and staging actions alone is exemplified. However, the present invention is not limited to this. These performer users may be a group consisting of a plurality of people. When performing a virtual space live event in a group consisting of a plurality of people, a plurality of people may share one performer terminal 200, or a performer terminal 200 may be provided for each member of the group. In addition, when the performer user is a group consisting of a plurality of members, for example, by executing the viewpoint following target person designation process on at least one of the distribution server computer 100 and the viewer terminal 300, the viewer user may be able to select the member to be the target of viewpoint following.

[0191] In the above-described embodiment, the singer who performs singing and the actor who performs staging actions may be separate individuals. In this case, the performer terminal of the singer and the performer terminal of the actor may be separate, and the singer may sing at a location other than the studio where the actor performs staging actions.

[0192] In the above embodiment, the Internet is exemplified as the computer communication network that connects the distribution server computer 100, the administrator terminal 150, the performer terminal 200, and the viewer terminal 300. However, the present invention is not limited thereto, and these communication networks may be configured by a local area network capable of data communication only within a specific area, or may include a local area network or local data communication in a part thereof.

[0193] In the above embodiment, at the time of distributing the virtual space live, the performer user performs singing or singing actions (performance actions) in real time, so that the performer user can proceed with the live while confirming the reactions of the viewer users virtually participating in the virtual space live. However, the present invention is not limited thereto, and the singing or singing actions (performance actions) of the performer user are not in real time, but rather, singing or singing actions (performance actions) are performed in advance, and the voices of these songs and the singing actions (performance actions) are recorded in the distribution server computer 100 as performer avatar information, and the virtual space live may be held by playing back the recorded singing voices and singing actions (performance actions) according to the progress of the live.

[0194] Alternatively, instead of the singing or singing actions (performance) of the performer user, singing or singing actions (performance actions) by a virtual performer created by computer graphics or the like are recorded in the distribution server computer as performer avatar information, and the virtual space live may be held by playing back the recorded singing voices and singing actions (performance actions) according to the progress of the live.

[0195] In this way, when performing singing or singing actions (performance actions) in advance, recording the performer avatar information on the distribution server computer 100, and playing it back to distribute a virtual space live, the configuration of the virtual space content distribution system at the time of distribution is composed of the distribution server computer 100, the administrator terminal 150, and the viewer terminal 200, and does not include the performer terminal 200 which is a performer user terminal available to the performer user who performs an operation to make the performer avatar 1 operate in the virtual space.

[0196] Also, in the above embodiment, the form of using the smartphone P or the computer (PC) as the viewer terminal 300 is exemplified, but the present invention is not limited to this, and these computers may be portable notebook computers, tablet terminals, e - book readers, wearable computers, game consoles, and various information processing devices other than these that can output at least 2D video and audio.

[0197] Also, in the above embodiment, the form in which the performer user performs a performance including singing in the studio is exemplified, but the present invention is not limited to this. For example, the performer user may use the performer terminal 200 installed at home or the like to appear in the virtual space live from home or the like.

[0198] In the above - described embodiment, the virtual space live is exemplified as the virtual space content, but the present invention is not limited to this. As these virtual space contents, for example, fan meetings where the performer user meets with his or her fans, talk sessions, etc., which are contents beneficial to the viewer user, and any content may be used as long as it is related to the virtual space in which the performer avatar 1 and the viewer avatar virtually participate.

[0199] In the above-described embodiment, the general operation (first operation) is an operation in which the performer avatar 1 stands without moving to the virtual stage G, the special operation (second operation) is an operation in which the performer avatar 1 performs virtual flight, and the specific operation (third operation) is an operation in which the performer avatar 1 makes a sudden lateral movement. However, the present invention is not limited to this, and the operation may be an operation according to the content to be distributed. For example, the general operation (first operation) may be an operation (normal operation) that the performer avatar executes for the longest period in the content to be distributed. The special operation (second operation) may be an operation executed during a special period that is the shortest period or an operation with the lowest frequency in the content to be distributed. The specific operation (third operation) may be an operation in which the execution period is shorter than that of the general operation (first operation) but longer than that of the special operation, or an operation in which the execution frequency is lower than that of the general operation (first operation) but higher than that of the special operation. Note that the special operation (second operation) may include the specific operation (third operation).

[0200] In the above-described embodiment, an example is given of a form having both a switching function to a viewpoint corresponding to the special operation (second operation) and a following function following the specific operation (third operation). However, the present invention is not limited to this, and it may be a virtual space content distribution system having only one of these functions.

[0201] In the above-described embodiment, an example is given of a form in which the switching of the viewpoints of the four virtual cameras C1 to C4 and the airborne virtual camera, which are fixed-positioned (set) virtual cameras, can be performed in advance by setting and operating on the administrator terminal 150. However, the present invention is not limited to this. For example, these viewpoint switches may be performed in real time by the administrator K on the administrator terminal 150 using a viewpoint switching controller or the like constituting the operation input device 161.

[0202] In the above-described embodiments, an example is given of a form in which virtual cameras C1 to C4 fixedly arranged (set) in the virtual space are used as virtual cameras. However, the present invention is not limited to this. For example, in addition to or instead of virtual cameras C1 to C4, a movable virtual moving camera is arranged in the virtual live venue, and the position and imaging direction of the virtual moving camera in the virtual space are controlled by an administrator K or a cameraman or the like operating on the administrator terminal 150 to obtain a viewpoint video of the virtual moving camera.

[0203] In the above-described embodiments, an example is given of a form in which the viewpoint video of virtual camera C2 is displayed on screen S in order to detect the facial expression of the performer user in order to reflect it in the expression of the performer avatar. However, the present invention is not limited to this. For example, if it is a high-function head-mounted display having a sensor function for detecting the facial expression of the performer user, the performance may be carried out while wearing these high-function head-mounted displays. By doing so, the immersion of the performer user in the virtual live may be improved. Also, when it is not necessary to reflect the facial expression of the performer user in detail in the expression of the performer avatar, the performer user may wear a normal head-mounted display and perform.

[0204] In the above-described embodiments, an example is given of a form in which the viewpoint of the viewer user is changed and followed according to the movement of the performer avatar. However, the present invention is not limited to this. For example, these changes and followings of the viewpoint may be executed according to specific effects such as the setting off of smoke or fireworks (fire columns), special lighting, and the transformation of stage G, which are effects on stage G.

[0205] <Related to Event Content> (Overview of Event Content) With reference to FIGS. 13 to 23, as an example of content, event content in which a live event is performed by a performer in a virtual live venue was described. The event content is distributed, for example, at a predetermined date and time (scheduled time of the scheduled date) according to event data. Further, before the start of the event, a space area ER where the event content is to be provided may be provided (distribution start, opening) so that viewer users can enter and participate in the virtual space where the event is held. In this case, the event data may include information for specifying the date and time for providing (distributing and opening) the space area ER where the event content is to be provided before the scheduled date.

[0206] Hereinafter, for example, from before the start of the virtual live event content as shown in FIG. 13, a virtual space in which the virtual live venue (event venue) shown in FIG. 13 is constructed as a predetermined type of virtual space is opened so that viewer users can enter and participate, and an example of gradually improving the viewers' interest in the event for viewer users from before the start of the event will be described. The predetermined type of virtual space is, for example, any of the virtual spaces in the space area ER of FIG. 12. Hereinafter, as an example of the predetermined type of virtual space, the space area ER5 shown in FIG. 24 will be used for explanation.

[0207] FIG. 24 is an overall bird's-eye view of the event venue constructed in the space area ER5. In the space area ER5 in the present embodiment, as an example, a virtual space in which objects such as buildings imitating a shrine and the town in front of the shrine are arranged is provided. Note that the objects arranged in the space area ER5 are not limited to buildings imitating a shrine, and may be objects along various themes such as the sea, a lake, a mountain, and a school. Further, the space area ER5 is composed of a plurality of areas. The space area ER5 is composed of, for example, a region ER51 corresponding to a town area, a region ER52 corresponding to an inner shrine area, a region ER53 corresponding to a main shrine area, etc., as shown in FIG. 24(A).

[0208] In the town area, for example, a plurality of house objects imitating houses are arranged, and a plurality of display areas for displaying (installing) lantern objects purchased, etc. by viewer users, etc. along the approach road leading to the precinct area are provided at multiple locations. The lantern objects can be purchased, for example, in a lantern shop area within the town area. Also, in the precinct area, for example, a large number of objects corresponding to torii gates, gates, statues, etc. arranged in the precinct of a shrine are arranged, and a game area where a predetermined game can be played and a fortune-telling area where fortune-telling can be done are provided, and a plurality of display areas are provided at multiple locations. In the main hall area, for example, a large number of objects corresponding to the main hall of a shrine and a stage object serving as a virtual live venue (event venue) are arranged, and a money offering area for making money offerings is provided, and a plurality of display areas are provided at multiple locations.

[0209] In the display area, lantern objects purchased by users, lantern objects associated with the operation (administrator) (including initially set lantern objects), lantern objects associated with special users, etc. are arranged. Special users include performer users, operation users, sponsor users who have sponsored an event, and other famous people, etc., who are authenticated as special users on the operation (administrator) side. Also, information on these sponsor users and other famous people, etc. is stored in the event data 111.

[0210] Also, as will be described later, the lantern objects displayed in the display area are determined in advance by random lottery, etc. every time the switching condition is satisfied as default lantern objects to be displayed in common for all users on the distribution server computer 100 side, and are transmitted to the viewer terminal 300 of the users who have entered the space area ER5 and are arranged. By bringing the viewer avatar closer to any of the display areas, the lantern objects displayed in the said display area can be displayed on the viewer terminal 300.

[0211] Various processes related to such a space area ER5 (a virtual space of a predetermined type) and various processes related to the provision and distribution of the space area ER5 are performed by the distribution server computer 100. The viewer user can use the viewer terminal 300 to enter and participate in the space area ER5, move the viewer avatar, and thereby display the image within the space area ER5 on the viewer terminal 300. Hereinafter, the viewer user and the viewer avatar (as well as the performer avatar, etc.) will also be simply referred to as the user and the user avatar (as well as the performer avatar, etc.).

[0212] Figure 25 is an example of an image of the space area ER5 displayed on the display unit 310 of the viewer terminal 300. Figure 25(A) is an example of a display image when the area ER52 (the precinct area in FIG. 24) is viewed obliquely from within the area ER51 (the town area). Figure 25(B) is an example of a display image when viewing the user avatar U operated by the user from behind while the user avatar U is being moved within the area ER52 in FIG. 24 near the boundary of the area ER53, and a gate object 53c corresponding to the gate leading from the area ER52 to the area ER53 is shown. Figure 25(C) is an example of a display image when viewing the state where the user avatar U is being moved under the torii object 52t corresponding to the large torii in the area ER52 in FIG. 24 from behind the user avatar U, and the base of the torii object 52t and the gate object 53c are shown. Figure 25(D) is an example of a display image when viewing the state where the user avatar U is being moved backward from the position shown in FIG. 25(C) from behind the user avatar U, and the torii object 52a and the house object 51d corresponding to the house are shown. In this way, by entering and participating in the space area ER5, the user can move within the space area ER5 according to the operations from the user, visually recognize the objects and scenery within the space area ER5, and can also purchase objects, offer money, and participate in the live event held in the worship hall area when the scheduled date arrives.

[0213] Note that the image obtained by looking down at the virtual space as shown in Fig. 25(A) may be displayable on the display device 310 by a user operation, or may be an image corresponding to the line of sight of the user avatar U as shown in Figs. 25(B) to (D). Further, by a user operation, even if it is an image obtained by looking down at the user avatar U as shown in Figs. 25(B) to (D), instead of displaying the user avatar U that the user operates, an image seen from the viewpoint of the user avatar U may be displayed.

[0214] In the present embodiment, even during a pre-scheduled period, which is a period before the scheduled date on which event content is to be provided within the space area ER5, the user can enter and participate (simply referred to as enter) the space area ER5. For example, even during the pre-scheduled period, when the user logs in to the virtual space ER and enters and participates in the space area ER5, the virtual space generation program 120 transmits to the viewer terminal 300 data for causing the display device 310 of the viewer terminal 300 to display an image of the generated space area ER5. The pre-scheduled period may be a day before the scheduled date on which the event content is to be provided, and may be a predetermined period (for example, one week) before the scheduled date, or may be all days before the scheduled date. In the present embodiment, it is assumed that the user can enter the space area ER5 from one week before the scheduled date.

[0215] Only users having the right (for example, a ticket, etc.) to participate in the event content to be provided on the scheduled date are allowed to enter and participate in the space area ER5 during the pre-scheduled period and on the scheduled date. The right to participate is given to the user, for example, by purchasing a ticket for participation by charging, or by clearing a predetermined game or mission.

[0216] The spatial area ER5, which is a virtual space of a specified type, is, for example, an area formed by a plurality of regions connected in series, and includes a first virtual space in which a viewer user can seamlessly move and enter from a certain region in the plurality of regions to other regions, and a second virtual space consisting only of regions having a common (identical) display mode with other regions. The virtual space corresponding to the spatial area ER5 in this embodiment is, as shown in FIG. 24(A), an area in which regions ER51 to ER53 are connected in series, and a first virtual space in which the user can seamlessly move and enter between region ER51 and region ER52 and between region ER52 and region ER53, and as shown on the right side of FIG. 24(B), a second virtual space consisting only of region ER53' having a common (identical) display mode with region ER53.

[0217] Also, for example, until a specific period (e.g., the day before) before the scheduled date of the event content, the first virtual space shown in FIG. 24(A) is provided. After the specific period before the scheduled date of the event content and when the release condition is satisfied, in addition to the first virtual space, the second virtual space shown in FIG. 24(B) is provided. A state where movement from some regions (regions ER51 and ER52) among the plurality of regions (regions ER51 to ER53) in the first virtual space to other regions (region ER53) is impossible (e.g., the gate of the large gate object 53c leading to region ER53 is closed), and a portal P is provided at a predetermined position in some regions (the position in front of the large gate object 53c within region ER52). By moving the user avatar U to the portal P, it becomes possible to transition to the second virtual space consisting only of region ER53' through, for example, the display of a predetermined screen (e.g., a fade-out screen).

[0218] The event content in this embodiment is provided in region ER53' having a common display mode with region ER53. Region ER53' is, for example, an area that cannot be entered until the release condition is satisfied. In region ER53', a venue similar to the virtual live venue shown in FIG. 13 is constructed, objects corresponding to a virtual stage and auditorium seats for the live event are arranged, and during the live event, the performer avatar operates on the virtual stage, and the user will view from the auditorium seat via the user avatar U.

[0219] On the other hand, before a specific period of the scheduled date, in the area ER53 in the first virtual space, for example, objects corresponding to the seats for the live event audience are gradually arranged, or objects under construction for the virtual stage are arranged, so that the state of gradually constructing the virtual live venue is reflected, and the user can confirm it through the user avatar U. For example, virtual space update data distribution processing for updating the displayed objects is performed every time a predetermined time elapses (for example, 24 hours, etc.). This can convey that the event is approaching and enhance the sense of presence and interest.

[0220] Also, when the release condition is satisfied, the user staying in the area ER53 is taken out of the area ER53. For example, the user avatar U is forcibly controlled to move to a predetermined position outside the area ER53 (for example, in front of the main gate object 53c in the area ER52). After that, while entry into the area ER53 becomes impossible, the user avatar U can be made to enter the area ER53' through the aforementioned portal P.

[0221] The area ER53 and the area ER53' have a common display mode, but restrictions are imposed on the space where the user avatar U can move. For example, in the area ER53, the user avatar U can freely move within the area, while in the area ER53', only the audience area 53'k can be moved to. This can make the burden on the server the minimum burden for providing event content. Also, the area ER53 and the area ER53' can use different servers (rooms) for the processing of constructing and generating each area. This can be managed, for example, by a server (room) corresponding to the heavy load when event content is provided. Note that the users who can enter the area ER53' may be limited to those who meet the predetermined conditions for providing event content.

[0222] (Regarding changes in the display mode within the virtual space) In this embodiment, the display mode within the spatial area ER5 can change according to an event that occurs within the spatial area ER5 during the period before the scheduled date. The event that occurs within the spatial area ER5 during the period before the scheduled date includes, for example, the actions of the user during the period before the scheduled date, the actions of other users, and other actions such as lotteries within the spatial area ER5 and setting changes to the virtual space executed by the operator's operations. The actions of the user (or the actions of other users) include, for example, operations such as purchasing and placing a predetermined object (item, lantern object, etc.) and playing a game such as completing a predetermined mission. The display mode within the spatial area ER5 that can change according to an event that occurs within the spatial area ER5 during the period before the scheduled date includes, for example, changes in the display mode of a specific object (for example, a lantern object, a display area for placing the lantern object, etc.) arranged within the spatial area ER5 and changes in the display mode of the production during the provision of event content.

[0223] (Regarding the change in the display mode during the period before the scheduled date due to the arrangement of a specific object) Hereinafter, with reference to FIGS. 26 to 32, an example will be described in which the display mode within the spatial area ER5 during the period before the scheduled date can be changed according to an event in which the user purchases and places a lantern object within the spatial area ER5. For example, the purchased lantern object within the spatial area ER5 is arranged in the display area, or a lantern object purchased by another user and arranged in the display area is switched to another lantern object according to the fulfillment of the switching condition. Note that since the lantern object can also be a kind of item for which the user throws money during the provision of event content (for example, a flower stand), it is also referred to as the frusta FS hereinafter.

[0224] The frusta FS can be purchased, for example, at the lantern shop 51s provided along the approach path within the area ER51 shown in FIG. 24. The user can purchase the frusta FS by moving the user avatar U to the lantern shop 51s or by performing a selection operation on the lantern shop 51s, etc., causing the image displayed on the viewer terminal 300 to switch from a screen displaying an image within the area ER51 to a screen for purchasing the frusta FS. FIG. 26(A) is an example of a screen at the time of purchasing the frusta FS.

[0225] As shown in FIGS. 27(A) and (B), a plurality of types of purchasable frusta FS are provided. FIG. 27(A) shows a table by attribute (motif) of the frusta FS. As the attributes (motifs), "plain", "cherry blossom", "demon", "white fox", "black fox", "luxurious and gorgeous", etc. are defined. For each attribute, a motif color is defined, and for each frusta FS of each attribute, the corresponding color is used and a design related to the attribute is applied. Among these attributes, "cherry blossom", "demon", "white fox", and "black fox" are the attributes and colors related to each of the actor avatars that appear as progress characters during the provision of event content. That is, purchasable frusta FS are prepared to match the image motifs and image colors defined for the actor avatars that appear during the provision of event content.

[0226] Also, the frusta FS are available in a plurality of sizes. The frusta FS differ in the types of sizes prepared and the price according to the attribute. For example, for the attribute "plain", only the "small" size is available, and the price is set at 500 coins. For the attribute "cherry blossom", two sizes, "large" and "small", are defined. The price of the "large" size is 2500 coins, and the price of the "small" size is 500 coins. The user selects any motif and size to purchase the desired frusta FS. For example, it is possible to provide a way to enjoy purchasing a frusta FS whose attribute, color, image motif, and image color match those related to the actor avatar that the user is supporting (favoring) among the actor avatars that appear during the provision of event content.

[0227] Figure 27(B) is a table by the size of the frusta FS. The user can decorate the frusta FS (generate the display mode of the frusta FS), for example, can perform decoration such as putting in characters. By the size of the frusta FS, the type of font and the color of the font are determined, and the user can select them at the time of purchase. Also, the upper limit of the number of characters that can be displayed by the size of the frusta FS is determined. For example, for the size "large", characters can be input in two columns, and there is a character limit of 15 characters each. For the size "small", there is a character limit of 10 characters.

[0228] For each size of the frusta FS, the area where it can be displayed (placed) is determined. When the user displays the purchased frusta FS in the space area ER5, the user can select (specify) and place it from among the display areas provided in plurality in the space area ER5 where the frusta FS can be displayed. For example, for the size "large", the display area for placement can be selected from any of the areas such as the main street (west) area 51a, the main street (east) area 51b, and the big torii area 52a (the area where the big torii object 52t is placed). For the size "small", the display area for placement can be selected from any of the areas such as the precincts (west) area 52b, the precincts (east) area 52c, the area in front of the worship hall (west) area 53a, and the area in front of the worship hall (east) area 53b.

[0229] On the purchase screen shown in Fig. 26(A), an image 411 of the selected flask FS is displayed. Below the image 411 of the flask FS, detailed information 412 of the selected flask FS is displayed. The detailed information 412 includes information regarding size and attributes (motifs). Also, the user can apply lettering decoration to the flask FS to be purchased and customize it to a preferred design. In the text input area 413, it is possible to input the text to be displayed on the flask FS. The input text is reflected in the image 411 of the flask FS, and it is possible to confirm the image when it is arranged. Also, there are defined NG words whose input is restricted for the text that can be displayed on the flask FS. The NG words are, for example, violent language, language contrary to public order and good customs, etc. When an NG word is input, the purchase icon 417 is grayed out and the purchase operation cannot be performed.

[0230] As shown in the example of the purchase screen in Fig. 26(A), by operating on the placement location selection area 414, the user selects the display area of the flask FS. Also, in the coin-related area 415, the number of coins the user has, the number of coins consumed as the purchase price of the flask FS, and the remaining number of coins after the purchase are displayed. The user confirms the purchase and the charging process is performed by operating the purchase icon 417. When canceling the purchase, an operation on the close icon 416 is performed.

[0231] After purchasing the frusta FS, as shown in Fig. 26(B), a display performance of the frusta FS is carried out. For example, in Fig. 26(A), for a user who has purchased a frusta FS1 with the attribute of "cherry blossom" and the size of "small" and with the character decoration of "sai kou", the frusta FS1 is displayed in the display area where the frusta FS1 is placed, and an effect such as the frusta FS1 being surrounded by light (displayed and highlighted in a specific manner different from other frusta) is carried out. When the user purchases a frusta FS and designates the display area on the viewer terminal 300 side, for example, in the distribution server computer 100, the display position is determined by lottery or the like from within the designated display area, and information including the display position of the frusta FS is stored, and information for specifying the display position is transmitted to the viewer terminal 300 of the user who is the source of the designation. In the viewer terminal 300, a process is performed to replace and display the frusta displayed at the display position specified from the received information with the frusta purchased by the user. Thereby, when the user enters and participates in the space area ER5, the user can be prompted to move to the display area of the frusta FS arranged by the user himself / herself, and the motivation to go and see the frusta FS of the user himself / herself can be activated. Also, it is possible to provide an interesting aspect such as checking the characters of the frusta FS of other users. Also, the display area is provided in any of the areas ER51 to ER53 that constitute the space area ER5 as shown in Fig. 24(A). For this reason, it is possible to prompt the user who has entered and participated in the space area ER5 to move to all of the areas ER51 to ER53, and the user can enjoy the entire space area ER5.

[0232] Next, the frusta purchase process of the frusta FS executed by the distribution server computer 100 will be described using the flowchart of Fig. 28.

[0233] In step S101, it is determined whether it is a purchasable period before the scheduled date. The purchasable period before the scheduled date may be a period that matches the period before the scheduled date, or may be a partial period of the period before the scheduled date. When it is not determined that it is a purchasable period before the scheduled date, since it cannot be purchased, the process ends. For example, on the scheduled date itself, since it is determined as NO in step S101, the frusta FS cannot be purchased. Therefore, before the event day, the user can be motivated to enter the space area ER5 at least once to purchase the frusta FS.

[0234] In step S101, when it is determined that it is a purchasable period before the scheduled date, in step S102, it is determined whether a shop selection operation has been performed. The shop selection operation is, for example, an operation on a frusta shop (for example, the lantern shops 51s, 53s in FIG. 24, etc.) within the space area ER5 (for example, actions such as approaching a shop assistant character, or selection operations on a predetermined icon of the shop are included). Specifically, in step S102, it is determined whether information transmitted when a shop selection operation is performed on the viewer terminal 300 has been received.

[0235] When it is determined in step S102 that a shop selection operation has been performed, in step S103, information for displaying a shop screen on the display device 310 is transmitted to the viewer terminal 300 that is the source of the shop selection operation. The shop screen is, for example, a screen that displays a list of products for selecting the frusta FS to be purchased, or the frusta FS purchase screen in FIG. 26(A), etc. Thereby, on the viewer terminal 300, the shop screen can be displayed and the preferred frusta FS can be selected. After outputting the information for displaying the shop screen in step S103, the process ends. Note that the purchase operation of the frusta FS is not limited to within the space area ER5, and may be an operation from a shop displayed in another space within the virtual space ER. By performing a purchase operation on a website separate from the virtual space, it may be reflected (usable and displayable) within the virtual space.

[0236] On the other hand, in step S102, when it is not determined that a shop selection operation has been performed, it is determined in step S104 whether a content editing operation has been performed. The content editing operation is a decoration operation such as entering characters into the frusta FS. Specifically, in step S104, after a frusta FS to be purchased is selected on the viewer terminal 300, it is determined whether information for specifying the characters input into the frusta FS by performing a decoration operation on the screen as shown in FIG. 26(A) has been received from the viewer terminal 300. When it is determined that a content editing operation has been performed, it is determined in step S105 whether an NG word is included. When it is not determined that an NG word is included, the process ends. On the other hand, when it is determined in step S105 that an NG word is included, in step S106, information for notifying that fact (that an NG word is included) and that purchase is not possible is transmitted to the viewer terminal 300 that is the source of the content editing operation, and the process ends. As a result, on the viewer terminal 300, for example, a pop-up display indicating that "an NG word is included" or a process for disabling the purchase icon 417 is performed.

[0237] In step S104, when it is not determined that a content editing operation has been performed, it is determined in step 107 whether a purchase confirmation operation has been performed. The purchase confirmation operation is, for example, an operation on the purchase icon 417 shown in FIG. 26(A). Specifically, in step 107, it is determined whether information for specifying the type of the purchased frusta FS, the input characters, the selected display area, etc., which is information transmitted when an operation on the purchase icon 417 is performed on the viewer terminal 300, has been received. When it is not determined that a purchase confirmation operation has been performed, the process ends.

[0238] On the other hand, when it is determined in step S107 that a purchase confirmation operation has been performed, a purchase process (charging process) is performed in step S108. After the purchase process has been performed, in step S109, a frusta display effect process is performed and the process ends. For example, based on the information received when the purchase confirmation operation is performed, the display position is determined by lottery or the like from within the selected display area, and the user-related information regarding the frusta FS (contained in the viewer user data 133) is updated. At the same time, information for specifying the display position is transmitted to the viewer terminal 300 of the user who is the purchaser, and processes such as a process for causing the display effect illustrated in FIG. 26(B) to be performed on the viewer terminal 300 of the purchasing user are performed. Note that the display position within the display area is not limited to being determined by lottery, and the user who makes the purchase may be able to perform a selection operation so that the frusta is displayed at a preferred position.

[0239] FIG. 27(C) is an example of a table that stores information related to the frusta FS purchased by the user among the user-related information stored in the viewer user data 133. For example, for each user ID, information for identifying the purchased frusta FS, information regarding the display location of the frusta FS within the display area specified by the user, etc. are associated. As an example, the "frusta ID" for individually identifying the frusta FS, the "purchased frusta" which is information regarding the attributes and size of the purchased frusta FS, the "character" which is information regarding the decoration (input characters) performed by the user, the "user-specified area" as information regarding the display area specified by the user, the "position" which is information regarding the display position within the display area, information such as the "purchase date and time" which is the date and time when the user purchased the frusta, etc. are stored. During the frusta display production process of step S109, information regarding the frusta FS purchased corresponding to the purchasing user is newly stored. Also, information regarding the frusta FS purchased is transmitted to the viewer terminal 300 of the purchasing user, and in the viewer terminal 300, a display production process is performed to display (show) the purchased frusta FS instead of the frusta FS already displayed at the display location. Note that when purchasing the frusta FS, not only when a display production is performed, but instead of or in addition to this, it may be that only the fact that the purchased frusta FS is displayed in the selected display area is notified.

[0240] Also, when any user purchases the frusta FS, in the viewer terminal 300 of that user, as described above, the frusta FS already displayed at the display location is displayed instead of the purchased frusta FS, but depending on the purchase, there is no influence on the frusta FS in the display area of the viewer terminals 300 of other users, and the same frusta FS as before the purchase continues to be displayed. Therefore, it is possible to make the frusta FS displayed in the display area different between the user who purchased the frusta FS and other users.

[0241] In step S101, it is determined whether it is a purchasable period before the scheduled date. However, it may be purchasable at any time, not limited to before the scheduled date. For example, depending on the timing when event content related to the frusta FS to be purchased is provided, it may be purchasable on or after the scheduled date of the event content. However, if it is not a purchasable period before the scheduled date in step S101, it may not be used for the production at the time of event content provision.

[0242] Also, the editing operation (character insertion operation, content editing operation) of the display mode of the frusta FS may be editable not only at the time of purchase but also instead of or in addition to after purchase. For example, after the purchase operation, the frusta FS may be saved in the user's item BOX, and it may be possible to take it out from the item BOX for display or editing operation at the user's preferred timing. Also, regarding the type and color of the font, it may be operable not only at the time of purchase but also after purchase. Not limited to characters, color editing or decoration for making a separately luxurious display mode as an option may be possible.

[0243] Regarding the example where the display position (for example, the display positions "A1", "A2", etc. in the display area A described later) in the display area selected by the user is determined by lottery or the like based on the information received when the purchase confirmation operation is performed in step S107 of FIG. 28 has been described. However, it is not limited to this. For example, the frusta FS may be made displayable at a timing different from the frusta FS purchase timing, and the display position may be determined at the timing of display.

[0244] (Regarding the change in the display mode during the period before the scheduled date due to the switching condition being satisfied) Next, with reference to FIGS. 29 to 32, the transition of the lantern object (display mode of the display area) arranged in the display area will be described. In the present embodiment, in a plurality of display areas provided in area ER5 (for example, the main street (west) area 51a, the main street (east) area 51b, the large torii area 52a, etc.), the lantern object is displayed. For each display area, the upper limit number of lantern objects that can be displayed is determined.

[0245] As described above, in the display area, not only the frusta FS purchased by the user himself / herself (associated with the user himself / herself) with reference to FIGS. 26 to 28, but also frusta FS purchased by other users (associated with other users), frusta FS associated with the operation (administrator), frusta FS associated with special users, etc. are arranged.

[0246] In the present embodiment, the display area A corresponds to, for example, the inner (west) area 52b of the area ER52 in FIG. 24 corresponding to the precinct area of the shrine, and is an area where, for example, the size "small" shown in FIG. 27(B) of the frusta FS that are lantern objects can be displayed. FIG. 29(A) is a part of the display area A corresponding to the inner (west) area 52b. As shown in FIG. 29(A), in the display area A, a plurality of frusta FS that are lantern objects are arranged side by side vertically and horizontally. FIG. 31(A) is a table included in the object data 122 and is an example of a data table regarding information for specifying the frusta FS to be displayed in the display area A and the display positions. In FIG. 31(A), for each display position (A1, A2, A3,...) in the display area A, as information for specifying the frusta FS, for example, a frusta ID and character information to be displayed are associated. The display position A1 corresponds to, for example, the upper left of FIG. 29(A), and is associated with a frusta FS with a frusta ID "a1", an attribute of "cherry blossom", and "character A" being displayed. The display position A2 corresponds to a position one right adjacent to the same row as the display position A1, and is associated with a frusta FS with a frusta ID "b1", an attribute of "demon", and "character B" being displayed.

[0247] FIG. 31(B) is a table included in the object data 122 and is an example of a data table regarding the frusta FS arranged in the display area B and information for specifying the display positions. The display area B is an area capable of displaying the frusta FS of the size "large" shown in FIG. 27(B), and corresponds to, for example, the location (torii gate area 52a) where the large torii gate object 52t in the area ER52 is located. In FIG. 31(B), similar to FIG. 31(A), for each display position (B1, B2, B3, ···) in the display area B, information for specifying the frusta FS, such as frusta IDs and character information to be displayed, is associated. For example, at the position corresponding to the display position B1, a frusta FS with the frusta ID "a1" and the character "A" displayed is associated. At the position corresponding to the display position B2, a frusta FS with the frusta ID "b1" and the character "B" displayed is associated.

[0248] Also, as shown in FIGS. 31(A) and 31(B) etc., the information of the frusta FS associated for each display area is switched to the information of other frusta FS determined by random selection etc. every time the switching condition is satisfied. The switching conditions for the frusta FS information for each display area may include, for example, the elapse of a predetermined time (for example, every 30 minutes, every 2 hours, etc.), the user performing an entry / exit operation to / from the virtual space (login, re-login, etc.), and conditions satisfied by the user's reloading of the display data (for example, in the case where the user avatar U's viewpoint returns to the relevant display area after the relevant display area has moved out of the user avatar U's viewpoint after a reload operation or the like). The probability of being selected for display by random selection is determined to be the same probability for each frusta FS, but is not limited thereto, and may be varied according to the characteristics of each frusta FS as described later.

[0249] Upon the satisfaction of the switching condition, the distribution server computer 100 determines the frusta FS to be displayed for each display area, updates the table for each display area (refer to FIGS. 31(A) and (B), etc.) stored as object data 122 (set as the default common to all users), and transmits information for specifying the frusta FS for each display area to the viewer terminal 300 of the user who has entered the spatial area ER5. As a result, on the viewer terminal 300, the frusta FS of each display area (the frusta FS of other users such as other users excluding the user's own frusta FS) can be switched and displayed to other frusta FS. Note that the switching of the frusta FS is performed within the range up to the upper limit number that can be displayed for each display area. For example, in display area A, when the upper limit number of frusta FS that can be displayed is 100, the information on the frusta FS of display area A stored as the object data 122 shown in FIG. 31(A) is switched and updated to the data of the determined 100 frusta FS determined by random selection or the like each time the switching condition is satisfied. Also, for example, when the display area is released, the number of frusta FS initially arranged in display area A where 100 frusta FS can be displayed may be set to 10, and it may gradually increase up to 100 as the user purchases and displays. The release of the display area means, for example, when the user can purchase and display the frusta FS in the display area. In this case, the random selection may be performed after reaching the upper limit.

[0250] Also, as described above, the information of the frusta FS arranged in the virtual space changes every time the switching condition is satisfied. However, for the frusta FS purchased by the user himself / herself, based on the information managed in FIG. 27(C), it can be continuously displayed in the display area within the virtual space. For example, FIG. 29 is an example of the transition of the display mode of the frusta FS in the display area A displayed on the display device 310 of user 1 when user 1 newly purchases a frusta FS. FIG. 30 is an example of the transition of the display mode of the frusta FS in the display area A (the same position as the display position illustrated in FIG. 29) displayed on the display device 310 of user 2 when user 1 newly purchases a frusta FS. FIGS. 29(A) and 30(A) are display examples of the frusta FS determined as the default corresponding to the display area A, in which the frusta FS specified from the frusta arrangement information in FIG. 31(A) is arranged. Note that at the timings of FIGS. 29(A) and 30(A), it is explained that for neither user 1 nor user 2 is the frusta FS purchased by each user displayed in the display area A.

[0251] FIGS. 29(B) and 30(B) are display examples at the timing when user 1 newly purchases frusta FS1. The frusta FS1 purchased by user 1 has, for example, the attribute "cherry blossom" of the frusta ID "a3" shown in FIG. 27(C) with a size of "small" and the input character being "sai kou". Also, it is assumed that user 1 selects "A" as the display area at the time of purchase and the location "A1" within the display area is associated.

[0252] When user 1 purchases frusta FS1, the purchased frusta information is delivered to user 1, and on the viewer terminal 300 of user 1, the frusta FS arranged at the display position A1 in the display area A is switched to the frusta FS1 purchased by user 1 and displayed. On the other hand, on the display device 301 of user 2, as shown in FIG. 30(B), the display of the same frusta FS as in FIG. 30(A) is maintained.

[0253] Figures 29(C) and 30(C) are display examples when the switching condition is satisfied after a predetermined time has elapsed since the previous switching. In the display device 301 of User 1, as shown in Figure 29(C), for the frusta FS1 purchased by User 1 himself / herself displayed in the display area A1, the display continues at the same position as in Figure 29(B), but for other frusta FS, they have switched to the frusta FS determined by lottery in response to the satisfaction of the switching condition. The other frusta FS are frusta FS not associated with User 1 and are frusta FS associated with other users or the like. Note that the other frusta FS may include frusta FS prepared by the operation that are not associated with any other users.

[0254] On the other hand, in the display device 310 of User 2, as shown in Figure 30(C), it has switched to the frusta FS determined by lottery in response to the satisfaction of the switching condition. Figure 30(C) is different from Figure 29(C) of User 1 in that a frusta FS different from the frusta FS1 associated with User 1 is displayed at the display position A1 in the display area A of the display area, and a common frusta FS based on the default data stored in the object data 122 is displayed at all display positions in the display area A including the display position A1.

[0255] Figures 29(D) and 30(D) show display examples when the switching condition is satisfied again due to the elapse of a predetermined time and the frusta FS in the display area A are switched. By chance, the frusta FS1 purchased by User 1 is included in the object data 122 of the display area A determined and stored by lottery at this switching timing, and the display position is A6 (the second position from the left in the lower row in Figures 29(D) and 30(D)). In this case, for User 2, as shown in Figure 30(D), the frusta FS1 of User 1 is displayed at A6 based on the default data.

[0256] On the display device 310 of User 1, as shown in Fig. 29(D), based on Fig. 27(C), the frusta FS1 are continuously displayed at location A1. That is, even if the frusta FS1 purchased by User 1 are included in the object data 122 of the same exhibition area on the viewer terminal 300 of User 1, the frusta FS1 purchased by User 1 are switched to be arranged at the exhibition positions based on Fig. 27(C). Further, on the viewer terminal 300 of User 1, a process is performed in which the frusta FS (default frusta FS) based on the object data 122 arranged at the exhibition position (A1) of the frusta FS1 purchased by User 1 are replaced with the frusta FS1 purchased by User 1 based on the object data 122 and then displayed. As a result, at A6 of User 1, instead of the frusta FS1, the frusta FS (the frusta FS of "character O") associated with A1 with the default data is displayed. Thereby, it is possible to prevent a plurality of the same frusta from being arranged in the same exhibition area.

[0257] Note that even if the frusta FS purchased by User 1 are included in the object data 122 of the same exhibition area, only the process of switching the frusta FS purchased by User 1 to be arranged at the exhibition positions based on Fig. 27(C) may be performed, and the frusta FS purchased by User 1 based on the object data 122 may also be displayed as they are. In this case, since a plurality of the same frusta FS of User 1 are displayed, a special feeling can be given to the user.

[0258] Also, in FIG. 29, an example was described in which the flask FS1 purchased by user 1 is displayed, fixed at position A1 within the display area A. However, it is not limited to this, and within the display area A arranged by the user, each time the switching condition is satisfied, the display position of the purchased flask FS may be switched. For example, at the timing of FIG. 29(C), the flask FS1 purchased by user 1 is displayed at position A1, but at the next switching timing, it is displayed at position A4 corresponding to the upper right of the display area A, and default data (data of the flask FS associated with A1 in FIG. 31(A)) may be displayed at A1.

[0259] Next, with reference to FIG. 32, the switching process of the flask FS to be displayed in the display area within the virtual space executed by the virtual space generation program 120 will be described.

[0260] In step S201, it is determined whether it is a displayable period before the scheduled date. The displayable period may be a period that matches the period before the scheduled date, or may be a partial period of the period before the scheduled date. When it is not determined that it is a displayable period before the scheduled date, the switching process ends.

[0261] On the one hand, in step S201, when it is determined that the displayable period is before the scheduled date, it is determined whether the switching condition is satisfied in step S202. The switching condition in step S202 will be described by taking an example where a predetermined time has elapsed (for example, 30 minutes, 2 hours, etc.). When it is determined in step S202 that the switching condition is satisfied, in step S203, the flasters to be displayed for each display area are randomly selected from all the flasters FS to be subject to the lottery, and the flaster arrangement information for each display area (such as FIGS. 31(A) and (B)) as the object data 122 is updated. The updated flaster arrangement information (including information for identifying the flaster FS (information for identifying the display mode of the flaster to be displayed on the viewer terminal, etc.)) is transmitted to the viewer terminal 300 of the user who has entered and participated in the space area ER5. For example, in the case of the display area A, the flaster arrangement information for the display area A illustrated in FIG. 31(A) is updated with the information of the randomly selected flaster FS and stored in the database that stores the object data 122. The updated flaster arrangement information is transmitted from the database that stores the object data 122 to the viewer terminal 300 of the user. As a result, the information of the flaster FS for each default display area is updated, and it becomes possible to switch and display the flasters of each display area on the viewer terminal 300 of the user who has entered and participated in the space area ER5.

[0262] Note that the flasters FS to be subject to the lottery may be all the flasters FS stored as the object data 122 excluding the NG flasters (for example, the flasters for which non-display settings have been made by the operator due to reports, etc.), or the flasters FS may be grouped into predetermined groups and selected from the flasters FS in the predetermined groups. For example, the grouping may be performed based on the purchase time, the type of the flaster, etc.

[0263] On the other hand, in step S202, when it is determined that the switching condition is not satisfied, it is determined in step S204 whether a user has newly entered the space area ER5.

[0264] In step S204, when it is determined that the user has not newly entered the room, the process ends. On the other hand, in step S204, when it is determined that the user has newly entered the room, in step S205, the frusta arrangement information for each display area is transmitted to the viewer terminal 300 of the user. As a result, the user can receive information for identifying the default frusta FS determined for each display area. For example, the frusta arrangement information of a predetermined range of display areas including the display area A updated in step S203 is transmitted.

[0265] In step S206, based on the information related to the purchased frusta shown in FIG. 27(C), it is determined whether there is a purchased frusta FS for the newly entered user. When it is determined that there is a purchased frusta FS, in step S207, the purchased frusta information for identifying the purchased frusta FS, the display position information determined at the time of purchase, etc. are transmitted to the viewer terminal 300 of the user. The purchased frusta information is information regarding the purchased frusta FS for each user exemplified in FIG. 27(C). For example, when processing is performed for user 1, for the display area A, assuming it is the timing shown in FIG. 29(C), the default data of the display area A at the time of FIG. 29(C) is transmitted in step S205. Also, in step S207, the purchased frusta information (frusta ID "a3") of user 1 shown in FIG. 27(C) and the display position information determined at the time of purchase ( "A1", which is the arrangement information of "a3") are transmitted. As a result, as shown in FIG. 29(C), the frusta FS1 with the frusta ID "a3" is displayed at the position of the display position A1, and the default frusta FS is displayed at the other display positions within the display area A.

[0266] In step S201, an example of determining whether it is a displayable period before the scheduled date has been described. However, the present invention is not limited to this, and the determination of whether it is a displayable period before the scheduled date may not be performed. For example, it may be applied to a spatial area ER where a specific object can be arranged regardless of the provision date of the event content (for example, the live event date).

[0267] Also, in step S203, an example has been described in which the frusta arrangement information is updated when the switching condition is satisfied, and the updated frusta arrangement information is transmitted to the users who have entered / participated in the spatial area ER5. However, in step S203, the present invention is not limited to this, and only the process of updating the frusta arrangement information when the switching condition is satisfied may be performed, and the process of transmitting the updated frusta arrangement information to the users who have entered / participated in the spatial area ER5 may not be performed. That is, the frusta switching associated with the satisfaction of the switching condition may not be performed on the viewer terminals 300 of the users who have already entered / participated. Also, in step S203, the frusta arrangement information may be updated when the switching condition is satisfied, and the updated frusta arrangement information may be transmitted only to the users who have entered / participated in the spatial area ER5 and who meet a predetermined requirement. The predetermined requirement may be established, for example, when a time longer than the time from entry / participation until the switching condition is satisfied has elapsed, or when the user has set the permission to switch due to the satisfaction of the switching condition in the individual settings. Note that, even for the users to whom the updated frusta arrangement information is not transmitted in step S203, the processes after step S205 are performed and the latest (updated in step S203) frusta arrangement information is transmitted when they re-enter the system or the like.

[0268] In the embodiment with reference to FIGS. 29 to 32, an example was described in which even when the switching condition is satisfied, the frusta FS purchased by the user himself / herself are continuously displayed, while the frusta FS associated with other users are switched and displayed. However, even for the frusta FS associated with other users, if the other users are special users, the frusta FS associated with the special users may be continuously displayed. As described above, special users include performer users, sponsor users who sponsor an event, other famous people, etc., who are authenticated as special users on the operation (administrator) side.

[0269] Next, the switching process 2 of the frusta FS to be displayed in the exhibition area in the virtual space executed by the virtual space generation program 120 will be described with reference to FIG. 33.

[0270] FIG. 33 is an example in which a process to be performed when the information of the frusta FS cannot be read from the database storing the information of the frusta FS in the desired state (the information of the frusta FS cannot be specified) in the above-described frusta switching process is added. In the present embodiment, a large number of frusta are exhibited, and each display mode may be different. In the frusta switching process, the information read from the database (for example, a database server) storing the information of many frusta FS is transmitted (distributed) for each user who has entered the room. For this reason, when the entry of many users concentrates, the load on the distribution server computer 100 increases in order to perform the frusta switching process for many users. For example, the load on the database server becomes too high due to the concentration of accesses to the database server storing the information of the frusta FS, and the frusta arrangement information cannot be read, so that the information necessary to display the virtual space on the login source (the viewer terminal of the user who has entered / participated in the virtual space) cannot be transmitted (distributed), and there is a risk of causing problems such as the inability to enter the room itself.

[0271] On the one hand, although the frusta in the display area are objects that liven up the virtual space, they are not objects that are essential for generating the virtual space (for example, objects such as the buildings and stage objects shown in FIG. 24, which may make the user feel uncomfortable if missing depending on the provided content, objects that form the basis of the virtual space, etc.). If the data of the essential objects cannot be read out and transmitted (distributed), the virtual space itself cannot be generated and displayed (the content provided in the virtual space cannot be established). In contrast, even if the frusta in the display area cannot be accurately displayed, it is possible to generate and display the virtual space itself. That is, when the data of the objects essential for generating the virtual space (objects of the first type) can be specified (read out and transmitted / received), the virtual space can be generated and displayed regardless of whether the data of objects such as frusta that are not essential for generating the virtual space (objects of the second type) are specified. Also, as described in steps S202 to S205 of FIG. 32, the frusta in the display area are updated and displayed as accurate frusta each time the switching condition is satisfied. That is, if access to the virtual space is possible, the frusta in the display area can be updated periodically. Therefore, the impact of the inability to access due to this reason is greater for both the user and the operator than the temporary inability to accurately display the frusta in the display area.

[0272] Therefore, in the frustum switching process 2 in this embodiment, the processes of steps S225 to S245 are performed following the process of step S215. In FIG. 33, mainly the processes within the dotted-line frame are added to the processes in FIG. 32 described above. For the description of the same processes as in FIG. 32, the same step numbers are used, and the description is simplified (and omitted). Also, steps S213 and S223 in FIG. 33 specifically explain the process in step S203 in FIG. 32, and steps S215 to S245 in FIG. 33 specifically explain the process until the frustum arrangement information in step S205 in FIGS. 32 and 33 is transmitted to the user.

[0273] In step S202, when it is determined that the switching condition is satisfied, in step S213, the flasks to be displayed for each display area are randomly selected from all the flasks FS to be subject to the lottery, and the flask arrangement information (such as FIGS. 31(A) and (B)) for each display area in the object data 122 is updated and stored. For example, in the case of display area A, the flask arrangement information for display area A illustrated in FIG. 31(A) is updated with the information of the randomly selected flask FS and stored in the database that stores the object data 122.

[0274] In step S214, the updated flask arrangement information (including the information specifying the flask FS (such as the information specifying the display mode of the flask to be displayed on the viewer terminal)) is read from the database that stores the updated flask arrangement information, and is transmitted to the viewer terminals 300 of the users who have entered and participated in the space area ER5. As a result, the information of the flask FS for each default display area is updated, and it becomes possible to switch and display the flasks of each display area on the viewer terminals 300 of the users who have entered and participated in the space area ER5.

[0275] In step S204, it is determined whether a user has newly entered. When it is determined that a user has not newly entered, the process ends in the same manner as in FIG. 32. On the other hand, when it is determined in step S204 that a user has newly entered, in step S215, the updated flask arrangement information for each display area (including the information specifying the flask FS (such as the information specifying the display mode of the flask to be displayed on the viewer terminal)) is read. For example, the distribution server computer 100 performs a process of reading the flask arrangement information updated in step S213 and transmitted to the users who have entered and participated in step S223 from the database in which the information of the updated arranged flask FS is stored as the object data 122.

[0276] Note that, in step S223 and step S215, the range of the frustum FS information read from the database in which the distribution server computer 100 stores the information (including the placement information) of the frustum FS as the object data 122 may be, for example, the frustum placement information that can be displayed in all the exhibition areas of the virtual space (e.g., within the space area ER5) where the user has entered, or the frustum placement information that can be displayed in some of the exhibition areas of the entered virtual space. The part may be, for example, the frustum placement information of the exhibition areas (e.g., the exhibition areas within the sections such as the area ER51 and the area ER52 in FIG. 24) within the section where the user avatar U is located in the area of the virtual space where the user has entered, or, along with the movement of the user avatar U, the frustum placement information of the range that can be displayed on the user screen (e.g., the exhibition areas within a predetermined distance of 360 degrees from the position of the user avatar U).

[0277] In step S225, it is determined whether all the frustum placement information has been read out. The state where all the frustum placement information has been read out includes, for example, the state when the information specifying the frustum FS to be read from the database is accurately returned from the database. When it is determined in step S225 that all the frustum placement information has been read out, the frustum placement information for each exhibition area read in step S205 is transmitted to the viewer terminal 300 of the user.

[0278] On the other hand, when it is not determined in step S225 that all the frusta arrangement information has been read out, it is determined in step S235 whether or not a predetermined time (for example, 100 ms) has elapsed since the reading in step S215 started. When it is not determined in step S235 that the predetermined time has elapsed, the process proceeds to step S215 to continue reading the frusta arrangement information that has not been read out (the frusta to be arranged at the missing location), and then proceeds to step S215 again. The determination of whether or not the predetermined time has elapsed may be made, for example, in the AP server, by starting the process of reading the information of the frusta FS from the database server and then waiting for the response from the database server to determine whether or not the predetermined time has elapsed. It may also be made by starting the process of identifying the information of the frusta FS to be returned as the frusta arrangement information in the database server and then determining whether or not the predetermined time has elapsed, and returning the information indicating that the predetermined time has elapsed (for example, information that could not be identified, etc.) to the AP server.

[0279] On the other hand, when it is determined in step S235 that a predetermined time has elapsed, a predetermined alternative frusta to be arranged at the missing locations that could not be read in step S245 is specified. When the frusta to be arranged at the missing locations are specified in step S245, the process proceeds to step S205, and the frusta arrangement information for each display area is transmitted to the viewer terminal 300 of the user. The alternative frusta are information with a lighter processing load for specification in the distribution server computer 100 than reading the frusta arrangement information updated in step S213. For example, a storage area different from the database from which the frusta FS are read in steps S223, S215, etc. in the storage 103 of the distribution server computer 100 (or past updated frusta arrangement information temporarily stored as a cache may also be used). The frusta FS are frusta FS that are not updated (not displayed) depending on the establishment of switching conditions, such as frusta FS displayed in a simple (e.g., plain) form of the frusta FS or frusta FS predetermined by the operator side. However, it is not limited to this, and it may be a predetermined frusta FS among the frusta FS that can be updated (displayed) depending on the establishment of switching conditions, or it may be a frusta FS included in the already read frusta arrangement information. In step S235, if the desired frusta arrangement information cannot be read (specified) due to a load on the database, etc., information for displaying an alternative frusta FS with a lighter processing for specification is distributed to the viewer terminal 300 instead of the unreadable data.

[0280] Also, if only a part of the information of the frusta FS read in step S215 is read normally, steps S245 and S205 are used to supplement the missing locations excluding the part that could be read. For example, if the information of display areas A and B was being read, but only the information of display area A could be read, then processing is performed to supplement the information of display area B. Note that even if only a part of the information of the frusta FS read in step S225 could be read, it may be replaced with the information of all alternative frusta FS in step S245.

[0281] As a result, the user can receive the information of the frustum FS that substitutes for the information of the default frustum FS that could not be read due to the load on the database. Therefore, it is possible to avoid problems such as being unable to enter the virtual space because the information for displaying the virtual space cannot be received. That is, the priority for displaying on the displayable objects is determined, and if the object with a high priority that was essential for establishing the content provided by the virtual space can be received, the virtual space is displayed regardless of whether the object with a low priority that is not essential can be received normally. At the same time, when the data of the object with a low priority that is not essential can be specified, the object is displayed in a display mode based on the data, while when the data cannot be specified, an alternative object corresponding to the object is displayed.

[0282] FIG. 34 is an example in which a frustum FST associated with a special user is further arranged in the display area A in the display example of the display screen 310 of user 1 in FIG. 29. The frustum FST is a frustum FS associated with a talent user related to the attribute "black fox", for example, a special frustum FST prepared or purchased by a special user. At the timing of FIG. 34(A), the frustum FST of the special user is displayed at the upper right display position A4 in the display area A by default. The frustum FST prepared or purchased by the special user is displayed in the display area, and even if the switching condition is satisfied, the frustum arrangement information of the frustum FST will not be switched to other frustums.

[0283] Next, in FIG. 34(B), when user 1 purchases frusta FS1, the frusta FS1 purchased by user 1 are displayed at display position A1 in display area A. When a user purchases a frusta FS, as described above, a display area is selected and a display position within the display area is determined. However, the display positions where frusta of special users are displayed as described above are excluded from the display positions to be determined. This can prevent a user from being determined to be at the display position of a frusta of a special user even if the user purchases a frusta.

[0284] After that, even after the switching timing when the switching condition in FIG. 34(C) is satisfied, in addition to frusta FS1 purchased by user 1 himself / herself, frusta FST of special users continue to be displayed at display position A4. Similarly, at the timing of FIG. 34(D), which is the next switching timing, frusta FS1 and frusta FST continue to be displayed.

[0285] Note that in space area ER5, a display area (special display area) where all the frusta FS to be displayed are frusta FS of special users may be provided, or a single unit area where frusta FS of special users are displayed individually in an object or photo spot manner may be provided. Also, the frusta to be displayed in the above-mentioned special display area or single unit area may be switched to frusta FS associated with other special users according to the satisfaction of the switching condition among the frusta FS associated with special users.

[0286] In this embodiment, the frusta FS (specific objects) can be purchased and owned by a user in multiple quantities. Therefore, the greater the number of frusta FS purchased by a user, the higher the ratio of being determined as the default frusta FS when the switching condition is satisfied, and the higher the possibility of being displayed within the spatial area ER5 in the viewer terminals 300 of other users. For example, as illustrated in FIG. 27(C), user 1 owns three frusta FS, while user 2 owns only one frusta FS. Therefore, when selected with a uniform probability, the ratio of any one of user 1's frusta FS being determined as the default frusta FS is three times higher than the ratio of user 2's frusta FS being determined. Thus, in order to appeal to other users, it is possible to motivate users to purchase more frusta FS.

[0287] On the other hand, even if a certain user owns a huge number (e.g., 10,000) of frustas FS, if the larger the number of owned frustas FS is, the easier it is to be determined as the default frustum FS as described above, the proportion of the frustum FS of the user who owns a huge number being determined as the default frustum FS and being displayed will be extremely high. As a result, there is a risk that the display mode of the frustum FS displayed in the display area of other users will become less distinctive, or that it will be misused, or that it will cause discomfort to other users. To prevent these situations, in this embodiment, for a user whose number of purchased and owned frustas FS has reached a predetermined number (e.g., 100), regardless of whether the user has more than the predetermined number, the number of purchased and owned frustas FS is regarded as the predetermined number, and the default frustum FS is determined so as to have the same ratio (probability) as that of a user whose number of purchased and owned frustas FS is the predetermined number. For example, when the predetermined number is 100, the proportion of the frustum FS of a user who purchases and owns 100 or more frustas FS being determined as the default frustum FS is the same as the proportion of the frustum FS of a user who purchases and owns 100 frustas FS being determined as the default frustum FS, even if the actual number of owned frustas FS is 1,000, 10,000, etc. Thereby, it is possible to prevent the frustum FS of a specific user from being displayed too much in the display area of the display device 300 of other users.

[0288] (Regarding the change in the display mode during the provision of event content) In this embodiment, during the provision of event content provided on the scheduled date, the frustum FS purchased by the user during the period before the scheduled date is displayed in the virtual space. Also, according to an event that occurred in the space area ER5 during the period before the scheduled date, the image (display mode) in the live area ER53' which is the event content changes. The event that occurred in the space area ER5 during the period before the scheduled date is, for example, that the user purchases a frustum FS and displays / arranges it in the display area within the space area ER5. Hereinafter, with reference to FIGS. 35 to 37, the change in the display mode of the virtual space during the provision of event content will be described.

[0289] FIG. 35 shows an example of a scene of the production of event content (for example, a live performance in which the same type of production as that shown in FIGS. 13 to 24 is executed) provided in the precincts of the area ER53' of FIG. 24 that functions as the virtual stage G. The virtual stage G in FIG. 35 will hereinafter be described as the virtual stage G2. On the virtual stage G2, the performer avatars 1a to 1d are on stage. Attributes "cherry blossom", "oni", "white fox", and "black fox" are respectively associated with the performer avatars 1a to 1d. These attributes correspond to the attributes associated with the frusta FS shown in FIG. 27(A).

[0290] During the provision of the event content, as shown in FIG. 35, a production is performed in which the performer avatars 1a to 1d hold the frusta FS and introduce them. In this embodiment, when the user who is viewing has purchased the frusta FS during the pre-scheduled period, a production is performed in which the performer avatars 1a to 1d hold the frusta FS purchased by the user. FIG. 36 is an example of a data table for specifying the frusta FS used in the production of the event content of FIG. 35. FIG. 36(A) shows the default event frusta information common to all users managed in the distribution server computer 100 (for example, gift data 134, etc.). The frusta FS during the provision of the event content displayed on the display device 310 for each user is specified based on the event frusta information in FIG. 36(A) and the purchased frusta-related information for each user in FIG. 27(C).

[0291] For the production of event content in this embodiment, a total of nine frusta FS, namely the frusta FS of the sizes "large" and "small" for each of the attributes "cherry blossom", "demon", "white fox", and "black fox", and the frusta FS of the attribute "luxurious and magnificent", are used. The default frusta FS in Fig. 36(A) is determined by randomly selecting in advance for each attribute and size from among the frusta FS purchased by any user during the pre-scheduled period from after the end of the pre-scheduled period until the start of the event content. As shown in Fig. 36(A), information specifying the default frusta FS to be used in the production is associated with each attribute and size of the frusta FS. For example, as the frusta FS of the size "large" of the attribute "cherry blossom", the frusta FS with the displayed character of frusta ID "a4" being "character A4" is associated. Note that not all types of frusta FS that can be purchased before the scheduled date exemplified in Fig. 27(A) need to be used for the production of event content, and even a part of them may be sufficient. For example, in this embodiment, it is assumed that the attribute "plain" is not used for the production during the provision of event content.

[0292] The distribution server computer 100 transmits the event frusta information in Fig. 36(A) and the purchased frusta-related information for each user in Fig. 27(C) to the viewer terminal 300 of the participating user at the start of the event content (login) or at a predetermined timing during the provision.

[0293] In the viewer terminal 300 of each user, among the flusters specified from the received event fluster information, the fluster with the same attributes and size as the fluster specified from the purchased fluster related information of the user is switched to the fluster specified from the purchased fluster related information of the user, and the event fluster data shown in FIG. 36(B) is updated. In this embodiment, when a user has purchased and owns multiple flusters FS of the same attribute and size, the last (most recent) purchased fluster FS is set (associated with the table) as the event fluster information. As shown in FIG. 27(C), User 1 owns one fluster FS of size "small" with the attribute "sakura", and the fluster ID is "a3". Therefore, in the default of FIG. 36(A), the fluster FS of size "small" with the attribute "sakura" is associated with the fluster ID "b4", but as shown in FIG. 36(B), in the event fluster information of User 1, "a3" is associated. Also, as shown in FIG. 27(C), User 1 owns two flusters FS with the attribute "luxurious and magnificent", namely fluster IDs "b3" and "c3". Since "c3" was purchased later than "b3", in FIG. 36(B), "c3" is associated with the attribute "luxurious and magnificent". As a result, for users who did not purchase a fluster during the early scheduled date period, the default event fluster information is maintained, and for users who purchased a fluster during the early scheduled date period, the event fluster information is updated to replace the fluster with the same attributes and size in the default event fluster information with the purchased fluster.

[0294] On each viewer terminal 300 of each user, an effect during the provision of event content as illustrated in FIG. 35 is performed based on the set event frusta information. FIG. 35 is an example of a display mode displayed on the display device 310 of User 1 and is displayed based on the event frusta information stored in FIG. 36(B). FIG. 35(A) is an example in which the performer avatars 1a to 1d each have a "small" size of the frusta FS of the attribute corresponding to each attribute. As the frusta FS that the performer avatar 1a has, the frusta FS1 of the frusta ID "a3" purchased by User 1 is displayed. Also, in the center of FIG. 35(A), a frusta FS of the attribute "luxurious and magnificent" is displayed, and the frusta FS2 of the frusta ID "c3" that User 1 last purchased is displayed. Further, in FIG. 35(B), the performer avatar 1b and the performer avatar 1c have a frusta FS of the "large" size of the attribute "demon". Since User 1 has not purchased a frusta FS of the "large" size of the attribute "demon", the frusta FS of the frusta ID "g4" defined by default in FIG. 36(A) is displayed. Note that the display mode of the virtual live venue is not limited to the set illustrated in FIG. 35, and various objects may be displayed.

[0295] The effect illustrated in FIG. 35 is performed by transmitting, from the distribution server computer 100, effect information including information for controlling the display operations of, for example, the performer avatars 1a to 1d, and information for specifying the attributes and sizes of the frusta to be held in the hands of each of the performer avatars 1a to 1d or to be displayed (suspended from the ceiling) at a predetermined position in the virtual space. On each viewer terminal 300 of each user, based on the effect information, the display mode in the virtual space including the performer avatars 1a to 1d is controlled, and a frusta that matches the information for specifying the attributes and sizes of the frusta FS specified from the event frusta information (see FIG. 36(B)) updated on each viewer terminal 300 is arranged, whereby the effect illustrated in FIG. 35 can be executed.

[0296] Next, with reference to FIG. 37(A), the event flasta determination process executed in the distribution server computer 100 will be described. In step S301, a flasta to be used in the production during the provision of event content is determined by randomly selecting for each of the above-described attributes and sizes of the flasta. In step S302, event display flasta information (see FIG. 36(A)) that can identify the determination result is transmitted to the viewer terminal 300. For example, as shown in FIG. 36(A), for each attribute and size, event flasta information that stores information identifying the flasta FS determined by the lottery in association therewith is transmitted to the viewer terminal 300 of a user who plans to participate in or is participating in the event content.

[0297] In step S303, based on the purchased flasta-related information for each user shown in FIG. 27(C), for a user who has a purchased flasta, the purchased flasta-related information for each user is transmitted to the viewer terminal 300 of each user, and the event flasta determination process is terminated.

[0298] Next, with reference to FIG. 37(B), the event flasta identification process executed in the viewer terminal 300 will be described.

[0299] In step S311, the event flasta information (see FIG. 36(A)) transmitted and received from the distribution server computer 100 in step S302 of FIG. 37(A) is stored as default data for identifying the default flasta FS to be used in the production. In step S312, it is determined whether or not there has been reception of purchased flasta-related information (the information of the user in FIG. 27(C) transmitted from the distribution server computer 100 in step S303 of FIG. 37(A)). When it is not determined in step S312 that there has been reception of purchased flasta-related information, the event flasta determination process is terminated.

[0300] On the one hand, when it is determined in step S312 that the purchased frusta-related information has been received, in step S313, based on the received purchased frusta-related information, for each attribute and size, information for specifying the frusta FS purchased by the user is stored as update data. At this time, when a plurality of frusta are specified as frusta having the same attribute and size, based on the purchase date and time, the frusta purchased last (most recently) is specified and stored as the frusta having the corresponding attribute and size.

[0301] In step S314, for the frusta specified from the default data and the frusta having the same attributes and size as the frusta specified from the update data, a process is performed to rewrite the information of the frusta used for the effect to the frusta specified from the update data.

[0302] As described above, for a user who has purchased the frusta FS, for the event display frusta, the frusta purchased by the user himself / herself can be displayed in association with the performer avatar. Also, in this embodiment, when there are a plurality of frusta having the same attributes and size as the purchased frusta, since the frusta FS purchased last is displayed, it is possible to display the frusta FS for which a more elaborate frusta FS has been created by the event content provision date. Note that it is not limited to replacing it with the frusta FS purchased last, and a frusta determined by lottery from among the frusta having the same attributes and size may be used for the effect.

[0303] Also, the event frusta determination process in FIG. 37(A) was described for the example where it is determined and stored in advance before the event content is provided. However, it is not limited to this, and during the provision of the event content, for example, it may be executed every time a predetermined time elapses (such as every 10 minutes) to update the event frusta information. Alternatively, during the provision of the event content, if the singing part and the MC part are repeatedly performed, the event frusta information for each part may be updated before the start of the next part. During the provision of the event content, the display mode of the production may be changed based on the event frusta information updated during the provision of the event content.

[0304] Note that, as the frusta FS to be the lottery target determined as the event frusta information illustrated in FIG. 36(A), the frusta FS associated with special users may be excluded. As a result, for example, it will be selected from among the frusta FS associated with fan users (ordinary users) of the performer avatar, and in the production of the event content, the consistency such as the displayed frusta FS and the message production for fans such as "Thank you for the support frusta!" will increase.

[0305] (Regarding the processing related to the event content) In the above, an example where the display mode in the space area ER5 can change according to the event that occurred in the space area ER5 during the period before the scheduled date of providing the event content was described. However, instead of or in addition to this, in this embodiment, according to the degree of displaying the image in the space area ER5 on the display device 310 of the viewer terminal 300 by entering and participating in the space area ER5 during the period before the scheduled date of providing the event content in the virtual space ER, processing related to the event content may be performed.

[0306] Processing related to event content includes, for example, processing to change the display mode of the production during the provision of event content, and processing to grant objects that can be used by the user to the user during the provision of event content. The degree of display is, for example, the number of times the user enters the space area ER5 during the period before the scheduled date. The number of times of entering the space area ER5 may be the number of days in order to count as 1 time when entering multiple times on the same day, or may be the number of times counted as 1 time when staying for a predetermined time (for example, 10 minutes) or more. Note that the degree of display is not limited to this, and may be the staying time in the space area ER5 during the period before the scheduled date, or the degree of displaying a specific area in the space area ER5 (the number of displays, the displayed time, etc.). The specific area may be a predetermined area in the space area ER5, such as an exhibition area or a donation area.

[0307] Hereinafter, an example will be described in which the "degree" of displaying an image in the space area ER5 is the "number of times of entering the space area ER5 (hereinafter also simply referred to as the number of entries) where event content can be held on the scheduled date", and the "processing related to event content" is "processing to change the production content during the provision of event content" and "processing to grant objects that can be used by the user to the user during the provision of event content".

[0308] The distribution server computer 100 (for example, event data 111 and gift data 134) counts and stores the number of entries for each user during the period before the scheduled date. FIG. 38 is an example of a data table for specifying the "items" assigned according to the number of entries and the "production content" changed during the provision of event content according to the number of entries.

[0309] The "items" granted (made available) according to the number of room entries are objects that can be used by the user during the provision of event content. For example, they may be limited items that can only be used in event content (such as a live event) held after the end of the scheduled early period, or items that can be used not only in event content held after the end of the scheduled early period but also in content different from the said event content. In the case of using them in content different from the event content held after the end of the scheduled early period, for example, certain restrictions may be imposed on the performance aspects such as the functions and effects of the said items (for example, a certain function cannot be used, the effect decreases, etc.), or instead of or in addition to these, they may be limited items related to, for example, the image theme of the event content held after the end of the scheduled early period.

[0310] As shown in FIG. 38, as "items", for example, items that liven up the said event by being used during the provision of event content. For example, if the number of room entries during the scheduled early period is 1, limited cracker A that can be used in event content is granted, if it is 2, limited cracker B, if it is 3, limited cracker C, etc. If it is 4, limited fireworks, if it is 5, limited thulium, if it is 6, limited stamps, if it is 7, a limited item set, etc. are granted. The stamp is a stamp that can be used in chats and message transmissions within the virtual space. The item set is a packed set containing a plurality of items. Note that the items shown in FIG. 38 are not limited to items that can be used during the provision of event content and liven up the said event, and may be so-called coin-tossing items, etc. Also, as items granted to the user, in addition to items corresponding to the actual number of room entries, items corresponding to a number less than the actual number of room entries may also be granted.

[0311] As shown in FIG. 38, for example, if the number of entries during the pre-scheduled period is 1 to 3 times, it is a normal production and the production content does not change. When the number of entries reaches 4 or more, the production content can change. For 4 times, Special Room A is provided, for 5 times, Special Room B is provided, and for 6 times, Special Room S is provided. The provision of a special room means obtaining the right to participate in event content in an animation (display mode) of a virtual live venue different from the normal production. For example, an area ER53´ that can only be accessed by the target users who have obtained the right to participate in the live in the special room may be prepared, and event content may be provided in the special room. Alternatively, when providing event content, the image of the set of the live venue distributed may be replaced with a different image for the target users.

[0312] Also, for 7 times, a production with a secret costume is provided. The secret costume is a costume (costume object) of the performer avatar that is displayed corresponding to the performer avatar when providing event content. For the target users who have obtained the right to have a production with the secret costume, data in which the costume data of the performer avatar is replaced with data different from that distributed to other normal users is distributed.

[0313] Regarding an example of event content-related processing executed according to the number of entries illustrated in FIG. 38 in the distribution server computer 100, it will be described with reference to FIG. 39. The event content-related processing is executed, for example, for each user who plans to participate in the event content (for example, in ascending order of user ID number) from after the end of the pre-scheduled period until the start of the event content.

[0314] In step S401, it is determined whether the user has entered the room one or more times during the period before the scheduled date. When it is determined that the user is not a user who has entered the room one or more times during the period before the scheduled date, the process ends. For a user determined in step S401 not to be a user who has entered the room one or more times during the period before the scheduled date, event content is distributed based on the data stored by default in the event data 111.

[0315] On the other hand, when it is determined in step S401 that the user has entered the room one or more times during the period before the scheduled date, in step S402, an item corresponding to the number of room entries is assigned. As a result, for example, an item assigned to an item box owned by the user in the virtual space ER is displayed. It may be assumed that the item enters the box in advance until the start time of providing the event content, but it may be grayed out until the start time of providing the content and may not be usable until the start time of providing the content, and may be usable in the virtual live venue that has been opened since the start time of providing the content.

[0316] In step S403, production content corresponding to the number of room entries is set for the user, and the process ends. For example, for a user who has entered the room 4 times, limited fireworks are displayed in the item box, and information for setting the design of the virtual live venue to the special room A is associated and stored for the target user.

[0317] (Regarding the re - provision of content for the period before the scheduled date and the event) With reference to FIGS. 24 to 39, examples of event content provided during the pre-scheduled period and on the scheduled date have been described. However, the content provided to the user by the distribution server computer 100 may be re-provided (replayed). In FIGS. 13 to 39, as an example of the content, a live event by a performer at a virtual live venue on the scheduled date is illustrated as the event content. However, in FIG. 40, the live event provided on the scheduled date and the content provided during the pre-scheduled period before the live event is held (for example, an area that can be used for a limited period in relation to the live event to be held, activities, etc.) are collectively referred to as event content. The content provided during the pre-scheduled period is, for example, content related to the live event, and includes the space area ER5 that is released during the pre-scheduled period before the live event described in FIGS. 24 to 39. Hereinafter, the space area ER5 released during the pre-scheduled period and the live event provided in the space area ER5 on the scheduled date will be collectively referred to as event content and described. Note that the content during the pre-scheduled period may include activities (such as game content) that can be used by the user in the space area ER5 released during the pre-scheduled period, objects that can be displayed, and the like.

[0318] FIG. 40 is a diagram for explaining the period before the scheduled date and the re - provision of event content. For example, as shown in FIG. 40(a), a first scheduled period and a second scheduled period are provided as the scheduled date on which the content of a live event is to be provided and the "scheduled period" including the period before the scheduled date. Before the first scheduled date in the first scheduled period, the content in the period before the scheduled date described above is provided, and on the first scheduled date, the content of the live event described above is provided. Also, the second scheduled period for re - providing the event content provided in the first scheduled period can be started after a predetermined period (for example, two months) has elapsed after the end of the first scheduled period. The provision of the event content once ends together with the first scheduled period, but the distribution server computer 100 stores and holds information (re - provision data) for re - providing by taking over the content data at the end of the first scheduled period. The stored re - provision data is re - provided to the user in the second scheduled period. The re - provision data includes, for example, information for generating a virtual space (for example, FIGS. 24, 25, etc.), information according to the actions of the user (for example, user - related information (related to the purchased frustration) in FIG. 27, the frustration arrangement information for each display area shown in FIG. 31, etc.), and performer information such as animation data and voice data including the motion data of the performer avatar in the live event (the performer avatar information distributed in FIG. 10, the performer voice, etc.), the information of the event frustum used for production by the performer in the live event illustrated in FIGS. 35 to 37, the data of the game conducted in the first scheduled period (for example, the previous save data, ranking data, user level), etc. Note that the space area ER5 may also be released for several days after the first scheduled date to provide a period after the first scheduled date, and the content data at the end of the first scheduled period including the period after the first scheduled date may be taken over.

[0319] At the start of the first scheduled period, the frusta FS in the virtual space are displayed in an initial state (e.g., an initial arrangement with the initially set frusta FS), and are updated according to the actions (e.g., purchases, etc.) of the user during the first pre-scheduled period as described above. At the start of the second scheduled period illustrated in FIG. 40(a) (e.g., when the space area ER5 is re-released), since the information corresponding to the actions from the user during the first scheduled period is carried over and reflected in the virtual space, the frusta FS for each display area are arranged based on the frusta arrangement information at the end before the end of the first scheduled period. As a result, when a user who purchased a frusta FS during the first scheduled period enters the room during the second scheduled period, the frusta FS purchased by the user is arranged at the same position and in the same display mode as the position where it was arranged during the first scheduled period. Note that, although the frusta arrangement information was the frusta arrangement information at the end before the end of the first scheduled period, it may be the frusta arrangement information at the end of the first scheduled date or at the end after the first scheduled date.

[0320] Also, in the second scheduled pre-period within the second scheduled period, similar to the first scheduled pre-period, the display mode within the virtual space can be changed according to the actions of the user, and can be made different among users, and the processes shown in FIGS. 32 to 39 are also executed. For this reason, for example, when a user who enters the room during the second scheduled pre-period purchases the frusta FS, as shown in FIGS. 29 and 30, within the virtual space that can be displayed on the viewer terminal 300 of the user, the frusta is displayed in a display mode such as the character mode in which the user performed an editing operation in a predetermined area designated by the frusta. On the other hand, the purchased frusta FS may not be reflected in the virtual spaces of other users, and the frusta FS displayed may be different among users. Also, every time the switching condition is satisfied, the frusta FS other than the frusta FS that the user has purchased (including both purchases in the first scheduled period and purchases in the second scheduled period) and arranged can be changed and updated. Also, since the data of the game played in the first scheduled period is carried over and ranking display etc. is performed, and the data such as the games cleared by each user is also carried over, the game can be started from the continuation of the first scheduled period.

[0321] Note that the re-provided data does not include the position information and movement information of the user avatar U of the user who entered the room during the first scheduled period (information for displaying the user avatars U of other users). For this reason, in the second scheduled period, it is assumed that the user avatar U of the user who is actually in the room during the second scheduled period is displayed. However, not limited to this, the re-provided data carried over for replaying includes the position information and movement information of the user avatar U of the user who entered the room during the first scheduled period, and according to the number of users who entered the space area ER5 during the second scheduled period (for example, when it is less than a predetermined number), virtual avatars may be displayed based on the carried-over position information and movement information of the user avatar U.

[0322] Also, on the second scheduled day within the second scheduled period, similar to the first scheduled day, a live event by the performer is held, and users who enter the space area ER5 can watch the event from a perspective corresponding to the operations from the users. Also, in the event on the second scheduled day, similar to the examples shown in FIGS. 35 to 37, the latest frusta (the last purchased frusta) for each user can be associated with the performer avatar and displayed. Note that the default frusta information in FIG. 36(A) may be the same as the frusta FS in the first scheduled period, but may be made different from the default in the first scheduled period based on the information of the frusta FS purchased by the users in the second scheduled period.

[0323] In FIG. 40(a), an example of inheriting frusta-related information in the first scheduled period to the second scheduled period is shown, but it is not limited to this. As shown in FIG. 40(b), the frusta-related information in the first scheduled period may not be inherited to the second scheduled period. In the case shown in FIG. 40(b), the frusta FS in the virtual space at the start of the second scheduled period is started to be displayed in the initial state similar to the start of the first scheduled period, and then is updated according to the actions of the users in the early stage of the second scheduled day. Note that the initial state of the frusta (the frusta to be displayed and the display mode) at the start of the second scheduled period may be the same as the initial state of the frusta at the start of the first scheduled period, may be partially different, or may be completely different (for example, the display mode of the frusta FS in the predetermined initial arrangement is changed to the design for the second scheduled period).

[0324] Also, on the second scheduled day within the second scheduled period, similar to the first scheduled day, a live event by the performer is held, and users who enter the space area ER5 can watch the event from a perspective corresponding to the operations from the users. However, the default frusta information in FIG. 36(A) may be made different from the default in the first scheduled period based on the information of the frusta FS purchased by the users in the second scheduled period.

[0325] Note that for the reproduced data of the re-provided live event, regarding the actions and voices of the performer's performer avatar, they are the same as the motion data and voice data at the time of the previous provision. However, the display modes other than the actions of the performer avatar are not limited to the same as those in the previous provision and may be different between the previous provision and the re-provision. For example, the costumes of the performer avatar at the live event on the first scheduled date and the costumes of the performer avatar at the live event on the second scheduled date may be different.

[0326] (Regarding audio and viewpoint special switching processing) Next, an explanation about the performer when the event content is re-provided will be given. During the first scheduled date period of the first scheduled period, the performer (for example, a talent who conducted a live stream, etc.) in the live event on the first scheduled date generally cannot (does not) enter the room. In contrast, during the second scheduled period, during both the second scheduled date period and the second scheduled date, the performer in the live event on the second scheduled date (that is, the same live event as the first scheduled date) can enter the space area ER5 as a participant. The performer avatar that enters as a participant during the second scheduled period is displayed in a display mode different from that of the performer avatar in the live event on the first scheduled date. For example, the performer avatar that is conducting the event as a performer is displayed as a different humanoid three-dimensional model for each performer (for example, the performer avatar 1 in FIG. 13, etc.). In contrast, the performer avatar that enters as a participant during the second scheduled period is displayed as the same user avatar as other general users. However, since the name of the performer is displayed corresponding to the same user avatar as the other general users (for example, the user name, an official mark that can be recognized as a performer together with the user name, etc.), other users can grasp that it is the avatar of the performer. Also, the user avatar of a general user may be a simple display avatar instead of a humanoid. For example, if it is a humanoid three-dimensional model, the amount of drawing information increases when displayed in the virtual space. However, a simple display avatar may be a three-dimensional model that can be displayed with a small amount of drawing information. For example, it may be a simple shape composed of a circle, a square, a triangle, etc. (for example, a triangular pyramid, a plain animal type, etc.).

[0327] Also, when the performer participates as a participant in the live event on the second scheduled date, the performer avatar (the avatar that operates and is displayed based on the motion data and voice data pre-stored as re-provided data) as the performer who progresses the live event and the avatar as the participant can be displayed. For this reason, other users participating in the event can watch (display) both avatars at the same time within one virtual space, and the interest can be improved. For example, it is possible to provide a way of enjoyment such as listening to the voice of the performer as a participant who is talking about the mood at the time of the event while looking at the avatar as the performer who progresses the live event. In order to easily perform such a way of enjoyment, in the present embodiment, the voice output from the viewer terminal 300 and the process for switching the viewpoints displayed on the viewer terminal 300 are performed.

[0328] Note that since only the user avatars of the users who have entered the same room in principle are displayed on the viewer terminal 300, when the performer enters the virtual space as a participant, the avatar of the performer as a participant is not displayed on the viewer terminal 300 other than the viewers who have entered the same room as the performer. However, for the user avatars of the accounts of special users, even if they enter as participants, it is possible to reflect the appearance and voice of the user avatar in other rooms (for example, replicated rooms with the same provided content) by mirroring. As a result, the avatar of the performer as a participant is also displayed in the virtual space displayed on the viewer terminal 300 of the users who have not entered the same room as the performer.

[0329] FIG. 41 is a flowchart showing an example of the voice and viewpoint special switching process for switching the voice and viewpoints. The voice and viewpoint special switching process is executed on each viewer terminal 300. The viewer terminal 300 is configured to display an icon for selecting the setting of the virtual space together with the image in the virtual space, and execute the voice and viewpoint special switching process when an operation on the icon for switching the voice and viewpoints is received.

[0330] In step S411, it is determined whether a voice switching operation has been performed. When it is not determined that a voice switching operation has been performed, the process proceeds to step S413. On the other hand, when it is determined in step S411 that a voice switching operation has been performed, the process proceeds to step S412. When the current voice setting is the normal voice, it is switched to a special voice that can output the voice of a special user. When the current voice setting is the special voice, a process of switching to the normal voice is performed. The special voice is obtained by extracting only the voice of a special user (for example, an account of a talent or a famous person including a performer) from the voices output from within the virtual space (or extracting it so that it is easier to hear) and outputting it on the viewer terminal 300. Thereby, the user can easily switch to the voice of the performer as a participant. The normal voice is a voice corresponding to the position where the user avatar of the user exists within the virtual space and is a voice generated within a predetermined radius from that position. For example, when located near the event stage, the voice of the performer conducting the event is output at a louder volume than other voices. When located far from the event stage, the voice of another user existing near the user avatar of the user is output at a louder volume than the voice of the performer conducting the event. When a plurality of performers exist as participants, it may be possible to select and set which performer's voice to use. For example, it may be possible to select one specific favorite performer, or it may be possible to select a plurality of performers.

[0331] Note that, due to the operation of switching to the special voice, it is not limited to the case where the normal voice is no longer output, and it may be the case where, in addition to the normal voice, the voice of the special user can be heard. For example, in addition to the voices emitted from user avatars located around the user avatar operated by the user, even if it is a user avatar located at a distance where the voice cannot normally be heard, as long as it is the voice emitted from the user avatar of the special user, it may be output.

[0332] Also, regarding the audio on the stage, since it is output based on the audio data distributed to the viewer terminal 300 by the generated audio distribution process (Figure 10), it may be output on the viewer terminal 300 regardless of whether normal audio or special audio is selected. During live content distribution, normal audio cannot be selected in the first place (voices such as other users' voice chats cannot be heard), but special audio may be output as secondary audio. Also, the special audio may be selectable and output only by users who meet certain conditions (for example, payment or game clearance). Thus, during live content distribution, while enjoying the live (main audio), the voice of the performer avatar as a participant may be output like secondary audio (narration).

[0333] Also, it is not limited to switching audio. For example, it may be something that switches the volume relationship. For example, when the current audio setting is normal audio, the normal audio may be output at a volume higher than that of the special audio, and when it is special audio, the special audio may be output at a volume higher than that of the normal audio.

[0334] Next, in step S413, it is determined whether a viewpoint switching operation has been performed. When it is determined that the viewpoint switching operation has not been performed, the audio and viewpoint special switching process ends. On the other hand, when it is determined in step S413 that the viewpoint switching operation has been performed, the process proceeds to step S414. When the current viewpoint setting is the normal viewpoint, it switches to a special viewpoint focusing on the user avatar of a special user (for example, the avatar of the performer who has entered the virtual space as a participant), while when the current viewpoint setting is the special viewpoint, a process of switching to the normal viewpoint is performed. Thus, the user can easily switch to a viewpoint focusing on the avatar of the performer as a participant.

[0335] The normal viewpoint is the viewpoint that the user avatar U of the user in the virtual space is facing, and an image in the virtual space that can be visually recognized from this viewpoint is displayed. For example, when facing the event stage, an image including the avatar of the performer conducting the event is displayed, and when facing the side opposite to the event stage, an image in the virtual space on the side opposite to the event stage is displayed.

[0336] On the other hand, the special viewpoint is an image taken by a virtual camera arranged in the virtual space, which captures the user avatar of a special user from an angle that can be different from the normal viewpoint. For example, if it is an image from a virtual camera fixed in advance, an image obtained from the virtual camera in which the user avatar of the special user is reflected (for example, it may be selected by the operator's operation, or the virtual camera may be selected based on the position information of the special user) may be distributed to the viewer terminal 300. Alternatively, an image in which the avatar of the performer as a participant being photographed by the operator (for example, the operator account) of the virtual camera (for example, drone shooting in the virtual space) is reflected may be distributed to the viewer terminal 300. For example, it may be a viewpoint that captures the avatar from an oblique top-down view. In addition, when there are a plurality of performers as participants, it may be possible to select and set which performer's avatar to use. For example, it may be possible to select one specific favorite performer, or it may be possible to select multiple performers.

[0337] Note that the switching operation to the special voice and special viewpoint in the voice and viewpoint special switching process may be operable only by users who meet a predetermined condition such as charging. Also, either the special voice or the special viewpoint may be operable only by users who meet a predetermined condition.

[0338] (Regarding the special processing for room entry) In the present embodiment, the virtual space is provided using a plurality of rooms in order to provide the same content to a plurality of users simultaneously. As a result, for example, content such as the space area ER5 that constructs a virtual live venue where the event content during the scheduled date period and on the scheduled date described above with reference to FIG. 40 is provided is provided using a plurality of rooms, enabling simultaneous distribution to many users. Note that, for example, one room can be defined for one server, but a plurality of rooms may be defined for one server.

[0339] FIG. 42(a) is a diagram for explaining a plurality of rooms that constitute a space area ER (for example, rooms corresponding to areas ER51 to ER53 of the space area ER5 that constructs a virtual live venue, or rooms corresponding to the area ER53' in FIG. 24 where a live event is provided on the scheduled date having the same mode as the area ER53) where predetermined content is provided. The plurality of rooms include a main room in which a virtual space is constructed and an actor enters (is associated) in an event, and a plurality of other rooms (room 1, room 2, room 3,...) in which the virtual space (including the actor's avatar) in the main room is mirrored. A user who wishes to enter the virtual live venue is randomly assigned (associated) to a room designated by the user among the plurality of rooms, or to any room by a load distribution system if no designation is made, and can display the same image of the virtual live venue. For example, it may be when entering by logging in to the virtual space, or a screen for selecting the content (for example, area) that the user wishes to enter after logging in is displayed, and when the user selects the area to enter instead of designating a room ID and no room is designated, the user may be randomly assigned to any room.

[0340] On the one hand, actions (such as voice, actions, comments, etc.) from users within the virtual space can be shared with users who have entered the same room, but cannot be shared with users who have entered other rooms. For this reason, for example, in situations where talents, celebrities, etc. wish to enter the same room in order to liven up the atmosphere of an event in the virtual space, or in situations where other users in a friendship relationship already have entered and thus another user wishes to enter the same virtual space, it is desirable to allow them to enter the same room.

[0341] However, for each room, an upper limit number (for example, 200 people, etc.) is set in advance as the maximum number of users who can enter, taking into account the server's processing capacity, load concentration, etc. Therefore, when strictly applying the upper limit number to allocate rooms, in the above-mentioned situations, it may not be possible to allow users to enter the same room, and there is a risk of not being able to meet the users' demands. On the other hand, the upper limit number is generally set to a value with a margin considering the server's processing capacity so that there is no impact on distribution (such as a state where distribution is impossible) even when the load on the server is concentrated.

[0342] Therefore, in this embodiment, when certain conditions are met, even if the upper limit is exceeded when entering a room, special processing is performed to allow entry into the same room. FIG. 42(b) is a flowchart showing an example of the room entry special processing. The room entry special processing is executed by the distribution server computer 100. The distribution server computer 100 is assumed to execute the room entry special processing when it receives a room entry request for a room where predetermined content is provided to a user (for example, constituting a spatial area ER that constructs a virtual live venue). The room entry request may be at the timing of logging in to the virtual space (a room ID may be specified at this time), or a screen for selecting content (such as an area) to enter may be displayed on the title screen or the like after logging in, and it may be at the timing when the content is selected (a room ID may be specified at this time). Examples of the certain conditions include, but are not limited to, when a special user enters a room by specifying it in the virtual space, or when a user having a relationship with the user attempting to enter the room is already in any room.

[0343] The special user includes, for example, the account of a performer who performs as a performer in a live event (such as the performer user ID and account in FIG. 8), a talent, a celebrity, etc. (any of which may also be a performer). For example, it may be an account of a user predetermined as a special user by the operator, or an attribute number or the like that can identify a talent, a celebrity, etc. may be pre-assigned together with the user ID and account of the viewer user data stored in the storage 103. Further, as the special user in the room entry special processing, the operator who operates the virtual space or a person related to a talent (such as a manager) may be included. Examples of the operator include an account of a user who has the authority to operate the virtual camera. This enables shooting the video in the room entered by the talent with the virtual camera and displaying it on the viewer screen of other users, or transmitting the video data to other computers (such as an external server for live distribution).

[0344] When having relevance with a user, for example, in the virtual space provided by the distribution server computer 100, a follow function such as a friend function is provided, and cases where there is a mutual follow relationship or the intimacy is equal to or higher than a predetermined value are included. The intimacy is calculated based on the action history in the virtual space and the like. For example, it may be increased by, for example, the large number of chat times, the large number of co-op game times, and the large number of times of being present at a position within a predetermined range from position information and the like. Also, among special users, special users with an intimacy equal to or higher than a predetermined value, or special users who are scheduled to appear in the same live event, etc., special users who need to enter the same room for the content by the operator, are users having relevance with each other.

[0345] In step S421, it is determined whether or not it is the entry of a special user. When it is determined in step S421 that it is the entry of a special user, it is determined in step S422 whether or not a room has been designated. For example, when a room ID is input on the terminal of the account of a talent who is a special user, a request for designating a room ID is transmitted to the distribution server computer 100 together with the request for entry into the room. When it is determined in step S422 that a designation has been made, in step S423, regardless of the number of users in the designated room and the upper limit number, a process of entering the room in association with the designated room is performed. In the distribution server computer 100, it is determined whether the user is a special user based on the ID of the user who has made an entry request, and if a room ID is designated, the user is made to enter the room with the designated room ID. For example, a process of associating the user ID of the special user who has entered with the designated room ID is performed.

[0346] Note that the room IDs that allow entry regardless of the upper limit number in advance may be determined by the operator in advance. That is, when a room ID other than the room ID that allows entry regardless of the predetermined upper limit number is specified, if the number of people entering the specified room has already reached the upper limit number, it may be considered that entry into the room is not possible. Also, in step S421, entry may be allowed into a room where a special user who has a relationship with the special user who has already entered has already entered.

[0347] On the other hand, when it is not determined that the entry is by a special user, or when the entry is by a special user but no room is specified, in step S424, it is determined whether a user who has a relationship (for example, a friend relationship, a relationship where the intimacy is equal to or greater than a predetermined value, etc.) with the user trying to enter has already entered any room. When it is determined in step S424 that a user with a relationship has already entered any room, in step S425, a process of allowing entry associated with the room where the user has already entered is performed regardless of the number of users in the room where entry has already occurred and the upper limit number. Note that when users with a relationship are dispersed in a plurality of rooms, entry may be allowed into the room where the most users with a relationship have entered. Alternatively, among the rooms where users with a relationship have entered, entry may be preferentially allowed from the room with the lowest congestion level.

[0348] On the contrary, when it is determined in step S424 that a user with a relationship has not entered any room, in step S426, a process of allowing entry associated with any room that has not reached the upper limit number is performed. For example, a process of distribution by normal load distribution processing is performed.

[0349] (Regarding the component reset of the humanoid avatar of the performer) Next, with reference to FIG. 43, a process for resetting an abnormal display of an object that sways in conjunction with a character object will be described for a process executed at a predetermined timing. As shown in FIGS. 13 and 20, for example, a humanoid avatar of a performer is associated with a character object in the shape of a human (a three-dimensional model with bones (skeleton)), and a clothing object corresponding to the clothing worn by the character object. Also, by associating components (parameters of functions) with the objects displayed in the virtual space, various objects can be displayed and operated in the virtual space. Various components (for example, various parameters such as so-called colliders and rigid bodies) used for physical calculations (calculation processes such as collision detection, gravity, and movement) are preset for the character object and the clothing object, respectively. Object data associated with various components is included in the virtual space update data of FIG. 10 and distributed to the viewer terminal 300. Also, in the viewer terminal 300, based on the motion data of the performer (performer avatar information included in the virtual space update data of FIG. 10) distributed by the distribution server computer 100, a process for operating and displaying the character object is performed. On the other hand, the clothing object is an object that displays a swaying motion (for example, cloth such as clothes or hair), and physical calculations are performed in conjunction with the motion of the character object to display the motion (for example, calculation processing based on a component that performs calculations on swaying objects such as cloth that functions in conjunction with the skin mesh associated with the character object). In this way, in the viewer terminal 300, a process for performing physical calculations and operating and displaying the clothing object (for example, swaying, bouncing, bending, etc.) in the same manner as in the real space according to the motion of the character object is performed.

[0350] In this way, the arithmetic processing for operating and displaying character objects and clothing objects is performed on the viewer terminal 300 based on virtual space update data streamed at predetermined intervals from the distribution server computer 100. When the operation display process using the previously received virtual space update data is completed, the operation display process is executed based on the next received data.

[0351] Here, even if the distributed data is the same, differences may occur among users due to the processing capabilities and communication environments (e.g., frame rate reduction) of the viewer terminals 300. In particular, in the case of a viewer terminal 300 with low processing capabilities or a communication speed below a certain level, for example, since it takes time to calculate by physical operations (the drawing speed is slow), when the movement speed and movement range of a character are large, there is an increased risk of calculating and displaying an abnormal display mode as the display mode of a clothing object. For example, it may happen that the final movement position of a character object based on the previously received streaming data and the starting movement position of the next received streaming data deviate greatly. Then, an object such as a skirt that is supposed to move smoothly following the character object does not move smoothly and instead makes extremely large swings. As an example, as a result of the performer's intense movement, due to the movement of the colliders of various objects, it is calculated that the hem of the skirt object has entered the upper part of the skirt or the feet of the character object, and the skirt hem is displayed in a state of being rolled up, or for a wing object, it is calculated that the tip of the wing has entered a part around the middle of the wing, and the wing is displayed in a state where it cannot flap. In the present embodiment, in order to eliminate the continuation of such abnormal display modes, the distribution server computer 100 performs component reset processing as a process for neutrally resetting the display state of the object.

[0352] FIG. 43 is a flowchart showing an example of component reset processing. The component reset processing is executed by the distribution server computer 100. The distribution server computer 100 executes the component reset processing every time a predetermined time (for example, 2 ms) elapses when delivering virtual space update data including data for operating a humanoid avatar. Hereinafter, as an example, the case where the above-described live event is being provided (delivering) will be described.

[0353] In step S431, it is determined whether or not it is the timing when a series of actions by the performer avatar has ended. The timing when a series of actions has ended is the timing when the action that the performer avatar can continue has once ended, and the movement speed and movement range of the performer avatar become small and the movement becomes stable. For example, in the case of content where the performer sings while dancing, it includes the timing when one song has ended, the inter-song timing until the start of the next second song, the start timing of the second song, and the like. Alternatively, in the case of content where the performer performs an attraction, it includes the timing when one attraction has ended, the timing until the start of the next second attraction, the start timing of the second attraction, and the like. In the present embodiment, any of these timings can be applied as the timing when a series of actions has ended. In the distribution server computer 100, it is determined whether the movement speed and movement range have become less than a predetermined amount. Whether it has become less than the predetermined amount can be determined when the acceleration has become less than or equal to a predetermined value (alternatively, it may be when it has continued for a predetermined number of seconds).

[0354] When it is not determined in step S431 that it is the timing at which a series of actions by the performer avatar has ended, the component reset process is terminated. On the other hand, when it is determined in step S431 that it is the timing at which a series of actions by the performer avatar has ended, in step S432, a component reset signal is distributed to the viewer terminal 300 to terminate the component reset process. The component reset signal is a signal for causing physical calculations for an object (for example, a clothing object) displayed corresponding to a character object to be performed from a predetermined initial state. That is, normally, it is a signal for causing calculations that would normally follow the results calculated based on the previously received streaming data to be calculated from the initial state without relying on the results of the previously calculated operations. As a result, even if the display state of the clothing object is in an abnormal mode, the display state is reset to neutral and then physical calculations are performed.

[0355] In this way, in the viewer terminal 300, in order to perform physical calculations and make the clothing object operate and be displayed in the same way as in the real space according to the movement of the character object, for example, when calculating the current acceleration and the like in physical calculations by considering the acceleration of each part of the clothing object at the previous calculation timing, when a component reset signal is received, the current acceleration and the like are calculated from a predetermined initial state (for example, zero acceleration) without considering the acceleration of each part at the previous calculation timing. As a result, even if an abnormal mode is calculated and displayed as the mode of the clothing object during a series of actions, the mode of the clothing object can be returned to the mode calculated from the initial state (neutral state). For example, a state where the hem of a skirt is rolled up or a state where the wings are bent and cannot flap can be eliminated. As a result, there is a risk of calculating and displaying a mode that should not originally be possible as the mode of the clothing object, and operating and displaying the clothing object and the like in an abnormal mode for the character and the like. Even if the possibility is higher when the movement speed and movement range of the character are large, the abnormal mode can be eliminated.

[0356] Note that the component reset signal may be an instruction to start physical calculations from the initial parameters of the clothing object (parameters in the state of being worn when the character object is in the initial posture, and a neutral display state such as a state where no acceleration is applied), or may be something that sets the components (parameters such as acceleration and gravity) of the clothing object to the same parameters as the initial position (when the character object is in the initial posture).

[0357] <Examples of specific configurations and effects>

[0358] (1-1) In the foregoing embodiments, as described with reference to FIGS. 1 to 25 and the like, the distribution server computer 100 generates a virtual space ER and performs processing for transmitting information for displaying an image within the virtual space ER that corresponds to an operation from a user based on a stored program and a method of controlling a computer by the program (hereinafter simply referred to as a program). The viewer terminal 300 performs processing for displaying an image corresponding to an operation from a user according to information from the distribution server computer 100 based on a stored program. Also, as described with reference to FIGS. 26 to 28 and the like, the distribution server computer 100 performs processing for arranging and updating an object such as a frusta FS purchased in response to a purchase operation from a user within the virtual space ER based on a stored program. The viewer terminal 300 performs processing for arranging and displaying the object purchased in response to the arrangement update in the distribution server computer 100 and the purchase operation from a user within the virtual space ER based on a stored program. Further, as described with reference to FIGS. 13 to 23, FIGS. 35, and the like, the distribution server computer 100 performs processing for constructing a space for providing event content on a scheduled date within a space area ER5 in the virtual space ER based on a stored program. The viewer terminal 300 enables the provision of event content on a scheduled date within the space area ER5 constructed by the distribution server computer 100 based on a stored program.

[0359] Also, in this embodiment, even during the period before the event scheduled date, the distribution server computer 100 and the viewer terminal 300 each perform processing based on the stored program to enter the spatial area ER5 in response to an operation from the user and display an image within the spatial area ER5, and perform processing to be able to arrange and display the purchased object within the spatial area ER5 in response to a purchase operation. Further, as shown in FIGS. 26, 29, 30, 34, and 35, etc., the distribution server computer 100 and the viewer terminal 300 each perform processing to change the display mode within the spatial area ER5 in response to arranging and displaying an object such as a frusta FS within the spatial area ER5 during the period before the scheduled date based on the stored program. Thereby, during the period before the scheduled date, the spatial area ER5 where the event content is provided and the event that can change the display mode within the spatial area ER5 can be shared and provided to the user, so that the interest in the event content can be gradually improved from before the event content is provided.

[0360] (1-2) The distribution server computer 100 and the viewer terminal 300 each perform processing to change the display mode of each display area within the spatial area ER5 as shown in FIGS. 26, 28, and 29, etc., in response to the purchase status of the user's frusta FS during the period before the scheduled date shown in FIG. 27(C), etc., based on the stored program. Thereby, during the period before the scheduled date, whether the frusta FS is purchased by the user, what attributes the purchased frusta FS has, what decorations are applied, where it is displayed, and as a result, how the display mode of each display area within the spatial area ER5 changes, etc., can attract the user's attention.

[0361] (1-3) In the space area ER5 that can change during the pre-scheduled period, the display mode of each display area can be different from the display mode shown to other users than the user who purchases and arranges the frusta FS during the pre-scheduled period, as described by comparing FIGS. 29 and 30, for example. As a result, the display mode of each display area in the space area ER5 during the pre-scheduled period can be customized for each user, and a special feeling can be given to each user.

[0362] (1-4) As shown in FIG. 35 and the like, the distribution server computer 100 and the viewer terminal 300 each perform processing for changing the display mode of the production of the live event performed in the space area ER5 during the provision of event content in response to the user purchasing and arranging the frusta FS during the pre-scheduled period, based on the stored programs. As a result, the user can be made to pay attention to whether the frusta FS is purchased by the user during the pre-scheduled period, what attributes the purchased frusta FS has and what decorations are applied, and how the display mode of the production of the live event performed in the space area ER5 during the provision of event content changes accordingly.

[0363] (1-5) The production of the live event performed in the space area ER5 that can change during the provision of event content can be different from the display mode shown to other users than the user who purchased and arranged the frusta FS during the pre-scheduled period, as described by FIGS. 27(C), 35, and 36, for example. As a result, the display mode of the production of the live event performed in the space area ER5 during the provision of event content can be customized for each user, and a special feeling can be given to each user.

[0364] (1-6) As an event that changes the display mode within the spatial area ER5, it is an action in response to the purchase operation of the frusta FS from the user, and is an action that reflects the purchased frusta FS by being displayed and arranged in the display area within the spatial area ER5. For example, it illustrates the action of being arranged in a predetermined display area A of the spatial area ER5 in step S109 by the purchase operation of the frusta FS from the user in step S107 of FIG. 28. As a result, an event that changes the display mode within the spatial area ER5 can be caused by the user's own operation, so that the user's participation awareness can be improved while prompting the user to operate.

[0365] (1-7) As an example of an event that changes the display mode within the spatial area ER5, it is the purchase operation of the frusta FS, which is an action in response to the operation from another user (for example, user 1 who is another user for user 2 in FIGS. 29 and 30), and is an action that is reflected by being displayed and arranged in the display area within the spatial area ER5. For example, it illustrates the action of being purchased by another user 1. That is, as shown as an example in FIG. 30(D), on the display device 310 of user 2, the frusta FS1 that cannot be arranged and displayed unless another user 1 has purchased it can be arranged and displayed in a predetermined display area A by being randomly selected from the default frusta FS to be displayed due to the action of another user 1 having purchased it. As a result, since an event that changes the display mode within the spatial area ER5 can also be caused by the operations and actions of other users, the change in the display mode can be made interesting and the interest can be improved.

[0366] (1-8) As an example of an event that changes the display mode within the spatial area ER5, the fulfillment of the switching condition is illustrated. Also, even if an event that changes the display mode within the spatial area ER5 occurs, the distribution server computer 100 and the viewer terminal 300 each perform processing to enable the display of the frustration FS related to the special user within the spatial area ER5 to be maintained, based on the stored program. For example, the display position of the frustration FS purchased by the user is randomly determined from positions other than the display position of the frustration FS of the special user. Also, even when the switching condition is fulfilled, as shown in FIG. 34, the display and presentation of the frustration FST associated with the special user continue. As a result, the display mode related to the special user can be continued without change, so that the convenience and superiority of the special user can be maintained and improved. Also, since it becomes possible to use objects such as the frustration of the special user for advertising and PR, for example, it becomes easier for the operator side to solicit sponsorships from sponsors who can be an example of special users.

[0367] As shown in Fig. 24 ((1-9)), within the spatial area ER5, there are provided a region ER53' of the second virtual space used for providing event content on the scheduled date, and a region ER53 which is a part of the first virtual space having the same display mode (the same, similar, etc.) as that of the region ER53'. The distribution server computer 100 and the viewer terminal 300, respectively, based on the stored programs, until, for example, the day before the event scheduled date during the period before the scheduled date, the portal P is not displayed and entry into the region ER53' is restricted while entry into the region ER53 is permitted, and an image of the region ER53 can be displayed in response to an operation by the user. After the day before the event scheduled date when the release condition is satisfied, by closing the gate of the large gate object 53c leading to the region ER53, entry into the region ER53 is restricted, while the portal P is displayed and entry into the region ER53' of the second virtual space is permitted, and processing is performed to enable an image of the region ER53' to be displayed in response to an operation by the user. Thus, by switching the region used according to whether the release condition is satisfied, a virtual space can be provided using a region suitable for the user's actions before the provision of event content before the release condition is satisfied, and a virtual space can be provided using a region suitable for the provision of event content after the release condition is satisfied.

[0368] (1-10) As shown in FIG. 24, in the spatial area ER5, areas ER51 and ER52, which are parts of the first virtual space, are provided. The area ER51, area ER52, and area ER53 in FIG. 24(A), which is the first virtual space, can be seamlessly accessed (can be accessed by moving the user avatar from one area to another by user operation). On the other hand, the area ER53' of the second virtual space and the areas ER51 and ER52, which are parts of the first virtual space, are formed separately. As shown in FIG. 24(B), the first virtual space and the second virtual space can communicate with each other through the portal P in areas ER53' and ER52 via fade-out display. Thereby, before the liberation condition is satisfied, the convenience of moving between the area ER51, area ER52, and area ER53 in FIG. 24(A), which is the first virtual space, can be improved. After the liberation condition is satisfied, when moving to the area ER53' of the second virtual space, a sense of specialness and tension can be given to the user by making a fade-out display, and the interest can be improved.

[0369] (1-11) The liberation condition can be satisfied when it is the day before the scheduled date when the event content is to be provided. Thereby, a period before the liberation condition is satisfied, a period after the liberation condition is satisfied but before the event content is provided, and a period during the provision of the event content can be formed, and the interest can be improved more step by step.

[0370] (1-12) The display mode in the changeable spatial area ER5 includes the frusta FS displayed in the display area in the spatial area ER5. The event that changes the display mode in the spatial area ER5 includes the event that the user purchases a frusta FS in the period before the scheduled date and associates it with the user and arranges the frusta FS in the selected display area in the spatial area ER5. Thereby, in the period before the scheduled date, by arranging the frusta FS purchased by the user in the display area selected by the user, the display mode of the display area can be changed, and the user's interest can be improved.

[0371] (1-13) Events that change the display mode within the spatial area ER5 include events that generate the display mode (such as decorations like characters) of the frusta FS in response to user operations when arranging the frusta FS. As a result, each user can change the display mode of the frusta FS to be arranged to an original display mode, thus improving the user's interest.

[0372] (1-14) As shown in FIG. 35, the display modes within the variable spatial area ER5 include the frusta FS held by the performer avatars that are displayed and operate within the spatial area ER5 during the provision of event content and can advance the event content. Thus, the frusta FS that can be displayed corresponding to the performer avatars can change according to the events occurring during the pre-scheduled period, and the interest can be improved by the events occurring during the pre-scheduled period.

[0373] (1-15) As shown in FIG. 39, the distribution server computer 100 and the viewer terminal 300 each perform processing to change the display mode within the spatial area ER5 according to the number of entries into the spatial area ER5, which is an example of the degree of displaying the image within the spatial area ER5 during the pre-scheduled period, based on the stored programs. Thus, the display mode within the spatial area ER5 can change according to the number of entries into the spatial area ER5 during the pre-scheduled period, and the user's motivation to enter the spatial area ER5 during the pre-scheduled period can be improved and promoted.

[0374] (1-16) The distribution server computer 100 and the viewer terminal 300 each perform processing to make the event content available on the scheduled date for users who meet the predetermined conditions, such as purchasing tickets to participate in the event content, and to allow entry into the spatial area ER5 and display the image within the spatial area ER5 for users who meet the predetermined conditions during the pre-scheduled period, based on the stored programs. Thus, the user's motivation to meet the predetermined conditions can be improved and promoted.

[0375] (2-1) In this embodiment, even during the period prior to the scheduled date of the event, the distribution server computer 100 and the viewer terminal 300 each perform processing based on the stored program to enter the spatial area ER5 in response to an operation from the user and display an image within the spatial area ER5. Also, as shown in FIGS. 38 and 39, etc., the distribution server computer 100 and the viewer terminal 300 each perform processing related to the event content according to the number of entries (including the number of entries into the spatial area ER5 within the virtual space ER even when logged in to the virtual space ER and not including the number of entries into other spatial areas ER other than the spatial area ER5 within the virtual space ER) into the spatial area ER5 where the event content is provided on the scheduled date within the virtual space ER during the period prior to the scheduled date. Thereby, during the period prior to the scheduled date, the spatial area ER5 where the event content is provided can be shared and provided to the user, and processing related to the event content is performed according to the number of entries into the spatial area ER5 during the period prior to the scheduled date. For this reason, the motivation of the user to enter the spatial area ER5 and display an image within the spatial area ER5 can be improved compared to other spatial areas within the virtual space ER, and the interest in the event content can be gradually improved from before the provision of the event content.

[0376] (2-2) The processing related to the event content includes processing for changing the display mode within the spatial area ER5 during the provision of the event content according to the number of entries during the period prior to the scheduled date, as shown in the production content of FIG. 38. Thereby, the motivation of the user to enter the spatial area ER5 during the period prior to the scheduled date can be improved, and the user can be made to pay attention to how the display mode within the spatial area ER5 changes.

[0377] (2-3) During the provision of event content, the display mode within the space area ER5, which changes according to the number of entries due to the processing related to the event content, can be a display mode different from that shown to other users according to the number of entries, because different production contents are set according to the number of entries as shown in the production content of FIG. 38. As a result, the display mode within the space area ER5 during the provision of event content can be customized for each user, and a special feeling can be given to each user.

[0378] (2-4) The display mode within the space area ER5 during the provision of changing event content includes a secret costume, which is the costume of the performer avatar displayed corresponding to the performer avatar that is displayed and operates within the space area ER5 during the provision of the event content and can advance the event content. That is, the costume of the performer avatar during the provision of the event content can change according to the number of entries into the space area ER5 during the pre-scheduled period. Therefore, the motivation of the user to enter the space area ER5 during the pre-scheduled period can be improved, and the interest can be improved.

[0379] (2-5) The processing related to the event content includes processing for enabling the user to use an item corresponding to the number of entries from among the items that are examples of objects available during the provision of the event content, as shown in step S402 of FIG. 39. Therefore, the motivation of the user to enter the space area ER5 during the pre-scheduled period can be improved, and the user can be made to pay attention to the item to be granted.

[0380] (2-6) The items granted to the user by the processing related to the event content can be different from the items granted to other users because different items are set according to the number of entries as shown in the items of FIG. 38. As a result, various items will be used during the provision of the event content, so the interest in the event content can be improved.

[0381] (3-1) In this embodiment, the distribution server computer 100 and the viewer terminal 300 each cause the frusta FS associated with the user's purchase to be arranged in the display area within the spatial area ER5 based on the stored program. Among the frusta FS shown in Fig. 29(A), for the frusta FS associated with other users (e.g., other than user 1) and arranged in the display area within the spatial area ER5, according to step S203 in Fig. 32, while switching to other frusta FS in response to the satisfaction of the switching condition, for the frusta FS associated with the user himself / herself (e.g., user 1), as described with reference to Fig. 27(C), processing is performed so that it can continue to be displayed in the same display area even when the switching condition is satisfied. Thereby, even when there are a large number of frusta FS to be displayed and the number of display positions available for display in the display area is limited, the frusta FS can be appropriately reflected within the spatial area ER5. Also, for the frusta FS associated with other users, they can be displayed relatively evenly within the spatial area ER5, and while being able to change the display mode of the display area within the spatial area ER5 to improve the interest, the frusta FS associated with the user himself / herself can be confirmed, thus enhancing the satisfaction.

[0382] (3-2) The switching condition can be satisfied by the elapse of a predetermined time, the user's login or entry / exit into the spatial area ER5, etc. Thereby, since the frusta FS associated with other users can be switched to other frusta FS without requiring the user's prior knowledge (e.g., switching method), the interest in the frusta FS that can be displayed in the display area within the spatial area ER5 can be improved for any user.

[0383] (3-3) As shown in Fig. 27, the frusta FS include a plurality of types with different attributes and sizes, and display areas are defined according to the types, in which the frusta can be arranged and displayed within the space area ER5. Thereby, appropriate types of frusta FS can be arranged in the display area according to the design, taste, worldview, etc. of the space area ER5. Also, the types of frusta FS arranged in each display area can be made to have a sense of unity.

[0384] (3-4) The frusta FS can be displayed and shown up to the upper limit number defined in the display area within the space area ER5. The distribution server computer 100 and the viewer terminal 300 can, respectively, based on the stored programs, as shown in Figs. 29(C) to 29(D), etc., while maintaining the number of frusta FS to be displayed within the range of the displayable upper limit number, switch and display the frusta FS associated with other users to other frusta FS when the switching condition is satisfied. Thereby, the frusta FS associated with other users can be evenly displayed in the display area within the range of the upper limit number, and the display modes of the display area and the space area ER5 can be changed to improve the interest.

[0385] (3-5) As shown in Fig. 24, a plurality of display areas where the frusta FS can be arranged and displayed are provided within the space area ER5. The distribution server computer 100 and the viewer terminal 300 can, respectively, based on the stored programs, as shown in Fig. 26, perform processes for arranging and displaying the frusta FS of the user in the display area designated according to the operation from the user among the plurality of display areas. Thereby, the user's own frusta FS can be arranged and displayed in the display area preferred by the user, and the interest can be improved.

[0386] (3-6) The distribution server computer 100 and the viewer terminal 300 each perform a process for changing a display mode and performing display by decorating a frusta FS to be displayed, such as adding characters, in accordance with an operation from a user as shown in FIG. 26 based on a program stored therein. As a result, the display mode of the frusta FS to be displayed can be made into a user-specific display mode, and the user's interest can be enhanced.

[0387] (3-7) The distribution server computer 100 and the viewer terminal 300 each display and present a default frusta FS at a higher rate to a user who has purchased a larger number of frusta FSs (for example, 11 or more than 10, 40 or more than 30) than to a user who has purchased a smaller number based on a program stored therein. However, for users who have reached a predetermined number, regardless of the number of frusta FSs they have purchased that is equal to or more than the predetermined number, they can be displayed and presented by being randomly selected as the default frusta FS at the same rate (for example, the same rate as that of a predetermined number of users). As a result, while it is possible to encourage users to purchase frusta FSs up to an appropriate number (less than the predetermined number), it is possible to prevent the proportion of frusta FSs of users who have reached the predetermined number among the default frusta FSs from increasing without limit.

[0388] (4-1) In the virtual space in this embodiment, there are multiple types of objects that can be displayed in a space ER5, etc., including a first type of object such as a virtual stage G, which is an object essential for generating the virtual space and is a building or a stage object, and a second type of object such as a frusta FS, which is an object for livening up the virtual space and is an example of an object not essential for establishing content. When it is possible to identify information for displaying essential objects, in steps S215 to S245 of FIG. 33, a process for displaying a predetermined space is performed regardless of whether it is possible to identify information for displaying a frusta FS whose non-essential display mode changes. If all frusta placement information can be read at step S225 of FIG. 33, the latest frusta placement information is transmitted to the user at step S205. When a predetermined time has elapsed while not all frusta placement information can be read at step S235 of FIG. 33, an alternative frusta is identified and transmitted to the user at step S245. According to such a configuration, the space ER5 can be displayed when identifying information on essential objects regardless of whether the frusta placement information can be identified, and an alternative object can be displayed when the frusta placement information cannot be identified. Therefore, even when some objects cannot be identified when the load on the server becomes large due to concentrated access, etc., the user can be allowed to enter the virtual space and the virtual space can be displayed.

[0389] (4―2) In the viewer terminal 300, when displaying a space for providing a live event, etc. in the space area ER5 of FIG. 24 to the viewer terminal 300 on a scheduled date, the space area ER5 can be displayed even if the frusta placement information cannot be identified. As a result, since the space area ER5 is a virtual space for providing event content on a scheduled date, access to a distribution device such as a server may concentrate on the scheduled date. However, the virtual space can be displayed when identifying essential object information regardless of whether the frusta placement information can be identified.

[0390] (4-3) As exemplified in FIGS. 29 and 30, the frusta FS is an object whose display mode changes according to the user's actions such as purchase. Even if the frusta arrangement information corresponding to the current display mode updated in step S203 of FIG. 32 or step S213 of FIG. 33 cannot be specified, the alternative frusta is specified in steps S225 to S245 of FIG. 33, and the information for specifying the frusta FS to the user is transmitted in step S205. Thereby, when the access to the distribution device such as the server of the latest updated frusta FS is concentrated, it is possible to enter the space area ER5 and display the image of the space area ER5.

[0391] (4-4) Also, since the object that can be replaced with an alternative object when it cannot be read in FIG. 33 is the frusta FS that the user can display in the display area by purchase in FIG. 28 or character input in step S104, etc., the display mode has many variations, so the information for specifying the frusta FS tends to be heavy, and it may happen that the frusta arrangement information cannot be read. However, in step S245 of FIG. 33, etc., it can be replaced with an alternative object with a light processing load.

[0392] (5-1) In the virtual space arranged in this embodiment, the objects include character objects such as actor avatars that operate based on motion data, and clothing objects such as skirts arranged corresponding to the character objects. Through processes such as viewer perspective video generation processing and viewer perspective video output processing based on virtual space update data, it is possible to perform processing for operating and displaying the clothing object in a manner corresponding to the operation of the character object that operates based on motion data. Also, at the timing when a series of actions in step S431 of FIG. 43 are completed, or during an interlude, etc., as a process for resetting the display state of the clothing object to neutral, a process of transmitting a component reset signal in step S432 of FIG. 43 is executed. As a result, since the process for resetting the display state of the clothing object to neutral is performed at a specific timing when the amount of motion of the actor avatar can be less than a predetermined amount, it can be reset at a timing that does not give the viewer an extreme sense of discomfort.

[0393] (5-2) In this embodiment, resetting the display state of the clothing object to neutral includes performing physical calculations (such as calculations of collision detection and acceleration) associated with the clothing object from a predetermined initial state without being based on the previously calculated result. As a result, at a timing that does not give the viewer an extreme sense of discomfort, the physical calculations associated with the linked object can be performed from a predetermined initial state.

[0394] In this embodiment, the process of resetting the display state of the clothing object in step S432 of FIG. 43 to neutral is performed at the timing when the series of actions in step S431 is completed, and in a live event where the performer avatar 1 in FIG. 13 etc. appears, it can be executed at the timing of the end of the first song, which is the first part sung by the performer avatar, the start timing of the second song, which is the second part, or any timing between the end of the first song and the start of the second song. As a result, the timing at which the component reset process is performed is between the first part and the second part during the event, and is a timing at which the amount of movement of the character object, which is the performer avatar, can be less than a predetermined amount. Therefore, even if it is reset, it will not give the viewer an extreme sense of discomfort.

[0395] (6-1) In this embodiment, as described with reference to FIG. 40, event content (including the live event provided on the scheduled date and the content provided in the period prior to the scheduled date before the live event is held) is provided in the space area ER5 during the first scheduled period, and the event content can also be re-provided in the space area ER5 during the second scheduled period after the first scheduled period has elapsed. Also, as described with reference to FIG. 40(a), the display mode of the frusta FS etc. in the space area ER5 when starting the second scheduled period inherits the frusta-related information in the first scheduled period, and is set to the display mode according to the frusta arrangement information (at the end of the scheduled period, at the end of the scheduled date, at the end of the period before the scheduled date, etc.) in the first scheduled period. It is possible to change the display mode of the frusta FS displayed in the space area ER5 and the display mode of the frusta FS used for the production of the live event in FIG. 35 according to user purchases etc. in the second scheduled period. Thereby, it is possible to improve the interest of the users who participated in the first scheduled period in the event content during the second scheduled period. Furthermore, since the display mode of the frusta FS displayed in the space area ER5 during the second scheduled period can be changed and shared among users, it is possible to improve the interest in the event content during the second scheduled period regardless of whether the user participated in the first scheduled period or not.

[0396] (6-2) In this embodiment, regarding the re-provision of the event content described with reference to FIG. 40, as described in FIG. 40(b), the display mode of the frusta FS in the space area ER5 when starting the second predetermined period, such as the frusta FS, does not inherit the frusta arrangement information in the first predetermined period, but is a predetermined display mode such as the initial state. Depending on user purchases, etc. in the second predetermined period, it is possible to change the display mode of the frusta FS displayed in the space area ER5, the frusta FS used for the production of the live event in FIG. 35, etc. Thus, by setting the display mode in the virtual space of a predetermined type when starting the second predetermined period to a predetermined display mode, even a user who participated in the first predetermined period can participate in the event content in the second predetermined period with a fresh feeling, so that the interest in the event content can be improved.

[0397] (6-3) In this embodiment, for the event content in the second predetermined period described with reference to FIG. 40, performers who conduct live events on the first scheduled date and the second scheduled date (such as the performer avatars 1a to 1d in FIG. 35, etc.) can participate as avatars of participants. Also, since the performer can participate in the live event on the second scheduled date, during the live event, it is possible to display the performer avatar on the virtual live stage in the virtual space, such as in FIG. 35, and the avatar of the performer participating as a participant. This makes it possible to provide a live event with an atmosphere and taste different from that of the first predetermined period, and to improve the interest in the live event.

[0398] (6-4) Also, the avatar of the performer displayed as a participant on the second scheduled date is displayed as a simple avatar identical to that of a general user, etc., and has a display mode different from that of the performer avatar in the live event. This makes it possible to distinguish the avatar object of the performer as a participant from the avatar object of the performer as a performer, thus preventing the user from being confused.

[0399] (6-5) In this embodiment, as described in steps S411 to S412 of the audio / video special switching process in FIG. 41, in the live event during the second predetermined period, when the performer in the live event also participates as a participant, it is possible to switch to the special audio emitted by the performer as a participant in response to an operation on the viewer terminal 300. Thereby, it is possible to switch and listen to the voice emitted by the performer as a participant according to the user's intention, improve the interest in event content such as live content, and increase the variations in the ways of enjoyment.

[0400] (6-6) In this embodiment, according to steps S413 to S414 of the audio / video special switching process in FIG. 41, in the live event during the second predetermined period, when the performer in the live event also participates as a participant, it is possible to switch and display the display image in the virtual space to the image of the avatar object of the performer as a participant viewed from a predetermined viewpoint in response to an operation on the viewer terminal 300. Thereby, it is possible to switch and view the image of the avatar object of the performer as a participant from a predetermined viewpoint according to the user's intention, improve the interest in event content such as live events, and increase the variations in the ways of enjoyment.

[0401] (6-7) In this embodiment, the display mode of the performer avatar on the virtual live stage in the live event for the re-provision of the event content in FIG. 40 is the same display mode based on the virtual space update data including the motion data on the first scheduled date and the information for displaying the performer's clothing in the first scheduled period and the second scheduled period. On the other hand, the frusta FS exemplified in FIG. 35 and the like used in the production of the live event can be changed to the latest ones based on user purchases and the like in the second scheduled period. Thereby, while making the quality of the live event in the second scheduled period the same as that of the live event in the first scheduled period, since the display mode of the objects such as the frusta FS for production is displayed in the display mode in the second scheduled period, the interest in the live event in the second scheduled period can be improved.

[0402] (7-1) In the present embodiment, as described in steps S423, S425, S426, etc. of the room entry special case process in Fig. 42(b), by accepting a login from a user, an entry request to a virtual space such as entry into a room by selecting content, or specifying the room to enter, it is possible to perform processing for associating the user with any of a plurality of virtual space providing units. Also, each room is set with a predetermined upper limit on the number of users that can be associated with each room, for example, a predetermined number such as 200 people. If a user who has made an entry request is an unspecified user who does not meet specific conditions, such as a general user or a user having no relevance to other users, the unspecified user is not associated with a room where the number of associated users has reached the upper limit and is not allowed to enter, and the user is allowed to enter a room where the number of associated users in step S426 has not reached the upper limit. On the other hand, for example, when it is an entry request from a specific user who meets specific conditions, such as a special user such as a talent account or an operator account, or a user having relevance to other users, in steps S421 to S423 and steps S424 to 425 in Fig. 42(b), it is possible to allow the specific user to be associated with a predetermined room regardless of whether the number of associated users has reached the upper limit. Thereby, when it is an entry request from a specific user, the restriction on entry into the virtual space due to the upper limit is exceptionally lifted, and it is allowed to associate the specific user with a predetermined room, improving the convenience of the specific user.

[0403] (7-2) In the present embodiment, in step S423 of Fig. 42(b), the room where entry is possible regardless of the upper limit of the number of rooms is the room with a room ID predetermined by the operator. Thereby, for a specific user, since the user is associated with a predetermined room designated by the operator, for example, it becomes easy to change the settings of the room designated by the operator, etc., and the processing load on the distribution server computer 100 can be reduced.

[0404] (7-3) In this embodiment, when a room ID described in step S422 of FIG. 42(b) or the like is specified in the room entry request, information on the specified room ID is included. As a result, since the user is associated with the room specified by the user, the processing load for allocating the user to any room can be reduced, and the convenience for the user can be further improved.

[0405] (7-4) In this embodiment, for special users or users having relevance with other users, such as users who appear in the same live content, other users having relevance such as a friendship relationship or a relationship with a predetermined or higher level of intimacy are already associated with a room where they can enter. As a result, since the user can be associated with a predetermined room in consideration of the relevance between users, actions and communications in the same virtual space provided by the same room become easier to perform, and the atmosphere in the virtual space can be easily improved.

[0406] (7-5) In this embodiment, the special users in the processes of steps S421 to S423 of FIG. 42(b) include performers who appear as performers in a live event such as FIG. 35, and the performers can enter a predetermined room regardless of the upper limit of the room. As a result, the convenience for the performers can be improved.

[0407] (7-6) In this embodiment, in the processes of steps S421 to S423 of FIG. 42(b), the special users who can enter a predetermined room regardless of the upper limit number of the room include users who have the authority to operate a virtual camera that outputs an image taken in the virtual space so that it can be displayed on another computer. As a result, the convenience for the users who have obtained the output authority can be improved.

[0408] <Modification Example> Modification examples and the like for the embodiments (including changes and additions) described with reference to FIGS. 1 to 43 are listed below.

[0409] (Redistribution of Content Regarding Scheduled Date Period and Events) In the above-described embodiment, an example in which event content is redistributed in the second scheduled period was described with reference to FIG. 40. In FIG. 40(a), an example in which the frustration-related information in the first scheduled period is carried over to the second scheduled period was described, and in FIG. 40(b), an example in which the frustration-related information in the first scheduled period is not carried over to the second scheduled period was described. However, it is not limited to this, and the information carried over to the second scheduled period may be made different depending on whether or not the user participated in the event content in the first scheduled period. For example, depending on whether or not the user participated in the live event of the event content in the first scheduled period, or entered a virtual space such as the space area ER5 where the event content was provided in the first scheduled period, for the users who participated or entered, instead of carrying over the frustration-related information in the first scheduled period, the second scheduled period may be started from an initial state different from the start of the first scheduled period, while for the users who did not participate or enter in the first scheduled period, the second scheduled period may be started from the same initial state as the first scheduled period. In this case, for the users who purchased the frustration FS in the first scheduled period, the information of the frustration FS they purchased may be carried over.

[0410] (Regarding Replay Data) In the above-described embodiment, the case where event content is re-provided (replayed) in the second scheduled period was described with reference to FIG. 40. However, the re-provision of event content is not limited to being provided in a predetermined scheduled period, and may be provided in response to a request at an arbitrary timing from the user. For example, the distribution server computer 100 stores the data of the event content (event data 111) provided in this embodiment so that it can be re-provided to the user, and even after the event content is provided, in response to a request from the user (for example, an operation to purchase replay data, a second viewing operation, etc.). It may perform processing to enable re-provision. For example, during the provision of event content on the scheduled date, the distribution server computer 100 stores in the storage 103 information for displaying an image within the area ER53' including animation data and voice data containing the motion data of the performer avatar, etc., such as the performer information (performer avatar information distributed in FIG. 10, performer voice, etc.) that responds to the user's operation, event frusta information illustrated in FIG. 36, item production content information that can be set according to FIG. 39, etc. as replay data of the event data, and transmits it to the viewer terminal 300 of the user who is the request source.

[0411] The event frusta information includes the default information of FIG. 36(A) selected for each event content, the user-related information of FIG. 27(C), and the information of the frusta FS purchased by the user who requested re-provision. Further, the item production content information includes information for specifying the item given by the event content-related process of FIG. 39 and the production content to be set according to the number of times of entry in the period before the scheduled date of the user who requested re-provision.

[0412] In the viewer terminal 300 that has received the replay data, at an arbitrary timing of the user, the event content provided on the scheduled date based on the replay data is played back. Further, when playing back the event content, in order to adopt a display mode according to the events that occurred during the period before the scheduled date, for example, among the flusters specified from the received event fluster information, the fluster having the same attributes and size as the fluster purchased by the user is switched to the fluster that the user has purchased, and the production of the event content is provided. That is, the display mode of the fluster FS that can be displayed based on the replay data can be different for each user depending on the fluster FS purchased during the period before the scheduled date. As a result, even after the event content is provided on the scheduled date, the event content can be provided in a display mode according to the events that occurred during the period before the scheduled date, so that the convenience and interest of the user can be improved. Specifically, for a user who could not participate in the event content on the scheduled date, the user can participate in the event content even after the scheduled date, and in that case, if the fluster FS was purchased during the period before the scheduled date, the production according to the fluster FS can be provided.

[0413] Also, when playing event content, in order to perform processing related to the event content according to, for example, the number of room entries which is an example of the degree of displaying the images in the space area ER5 during the period before the scheduled date, settings are made such that the production content is the production content specified from the item-production content information received as the production content of the event content, and the item specified from the received item-production content information is given and made available during the replay. That is, the display mode of the event content based on the replay data can be made different for each user according to the number of room entries of the user during the period before the scheduled date. Thereby, even after the event content is provided on the scheduled date, the event content can be provided in a display mode according to the degree of the number of room entries during the period before the scheduled date, so that the convenience and interest of the user can be improved. Also, processing is performed to make available to the user an item corresponding to the number of room entries of the user during the period before the scheduled date from among the items available in the event content based on the replay data. Thereby, the convenience and interest of the user can be improved.

[0414] (Right of entry to the space area ER5) In the above embodiment, an example has been described in which only users having the right (such as tickets) to participate in the event content provided on the scheduled date are allowed to enter and participate in the space area ER5 during the period prior to the scheduled date. However, not limited to this, even if a user does not have the right to participate in the event content provided on the scheduled date, during the period prior to the scheduled date, it is allowed to enter the space area ER5, and it may be possible to freely move within the space area ER5, such as purchasing a frusta FS or viewing the exhibition area. If one does not have the right to participate in the event content itself, one cannot participate (for example, entry into the area ER53´ is restricted), but during the period prior to the scheduled date, it is allowed to enter the space area ER5 and take a stroll or experience within the space area ER5, thereby enhancing the user's interest in the event content provided on the scheduled date and making the user have the motivation to acquire the right and also participate in the event content. Note that, if there is no right to participate in the event content itself and the user can participate in the virtual space ER, it may be possible for the user to participate in the event content on the scheduled date and enter the space area ER5 during the period prior to the scheduled date.

[0415] (Regarding the display balance of frusta attributes in the exhibition area) In the above-described embodiment, an example in which the frusta FS to be switched when the switching condition is satisfied in step S302 of FIG. 32 is determined by random selection has been described. However, the present invention is not limited to this, and the frusta FS to be displayed may be determined by lottery so that the number of attributes associated with the frusta FS displayed in the space area ER5 is substantially equal among the respective attributes. As described above, the attributes "cherry blossom", "oni", "white fox", and "black fox" are the attributes / colors associated with each of the performer avatars that appear as progress characters when event content is provided. Further, for example, assuming that 80,000 positions where frusta with the attributes "cherry blossom", "oni", "white fox", and "black fox" can be displayed are provided in the space area ER5, the number of positions where each attribute can be displayed is calculated to be 20,000. Therefore, when the switching condition is satisfied, the frusta FS to be switched may be determined by lottery, 20,000 for each attribute. That is, as shown in FIG. 27, any motif (attribute) is associated with the frusta FS, and the distribution server computer 100 and the viewer terminal 300 each perform a process for selecting and determining a default frusta FS based on the stored program so that the number of attributes associated with the frusta FS to be displayed is substantially equal among the respective attributes, so that the frusta of the four attributes are substantially equal throughout the space area ER5. Thereby, the attributes of the frusta displayed in the space area ER5 can be displayed in a well-balanced manner, and it is possible to prevent bias towards any one attribute. Further, even when paying attention to each display area, the number of attributes associated with the frusta FS displayed in one display area may be substantially equal among the respective attributes. That is, the frusta of the four attributes may be substantially equal for each display area.

[0416] In addition, an exhibition area with an upper limit set to a predetermined number may be provided only by attribute, and ...

Claims

1. A program executed by a computer that controls a plurality of virtual space providing units for providing a virtual space to a user, The computer, a means for performing a process of associating a user with any one of the plurality of virtual space providing units by accepting a request from the user to enter the virtual space; each of the plurality of virtual space providing units has a predetermined upper limit on the number of users to which the virtual space can be provided; The users include non-specific users who do not satisfy a specific condition and specific users who satisfy the specific condition, The means for performing the association process is a program that, when the received entry request is an entry request from the non-specific user, does not allow the non-specific user to be associated with a virtual space providing unit whose number of associated users has reached the specified number, while, when the received entry request is an entry request from the specific user, allows the specific user to be associated with a specified virtual space providing unit regardless of whether the number of associated users has reached the specified number.

2. A method for controlling a computer to control a plurality of virtual space providing units for providing a virtual space to a user, comprising: receiving a request from a user to enter the virtual space, and performing a process for associating the user with any one of the plurality of virtual space providing units; each of the plurality of virtual space providing units has a predetermined upper limit on the number of users to which the virtual space can be provided; The users include non-specific users who do not satisfy a specific condition and specific users who satisfy the specific condition, The associating step, when the received entry request is an entry request from the non-specific user, does not allow the non-specific user to be associated with a virtual space providing unit whose number of associated users has reached the specified number, whereas, when the received entry request is an entry request from the specific user, allows the specific user to be associated with a specified virtual space providing unit regardless of whether the number of associated users has reached the specified number.

3. A system including a computer that controls a plurality of virtual space providing units for providing a virtual space to a user, a means for performing a process of associating a user with any one of the plurality of virtual space providing units by accepting a request from the user to enter the virtual space, each of the plurality of virtual space providing units has a predetermined upper limit on the number of users to which the virtual space can be provided; The users include non-specific users who do not satisfy a specific condition and specific users who satisfy the specific condition, The system includes a means for performing the association process that, when the received entry request is an entry request from the non-specific user, does not allow the non-specific user to be associated with a virtual space providing unit whose number of associated users has reached the specified number, while, when the received entry request is an entry request from the specific user, allows the specific user to be associated with a specified virtual space providing unit regardless of whether the number of associated users has reached the specified number.

Images