Program, method, and system

Abstract

To provide a program, method and system for enabling entry into a virtual space and display of the virtual space even when access to a server is concentrated.SOLUTION: In a computer for providing a virtual space for a user, when first object information for displaying a first type of object can be identified, processing to display a predetermined space is performed regardless of whether or not second object information for displaying a second type of object can be identified. When the predetermined space is displayed, processing to display the second type of object in a display mode based on the second object information when the second object information can be identified and display a substitute object corresponding to the second type of object when the second object information cannot be identified is performed.SELECTED DRAWING: Figure 33

Description

[Technical Field]

[0001] The present invention relates to a program, a method, and a system. [Background technology]

[0002] BACKGROUND ART There is known a system that provides a virtual space to a user via a network and enables the user to interact with other users in the virtual space (see, for example, Patent Document 1).

[0003] In such a system, a server distributes desired data in response to a request from a user terminal, and a virtual space is generated and displayed on the user terminal based on the data. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2011-092240 Summary of the Invention [Problem to be solved by the invention]

[0005] However, in conventional systems, when access to a server is concentrated, the load on the server increases, making it impossible to deliver the desired data to the user terminal from which the access originates, and as a result, it is possible that the virtual space cannot be displayed. Furthermore, when an event is held in the virtual space on a predetermined date and time, a situation may arise in which it is not even possible to log in due to a concentration of logins as the time approaches.

[0006] The present invention was devised in light of the above situation, and provides a program, method, and system that allows users to enter a virtual space and display the virtual space even when access to the server is concentrated. [Means for solving the problem]

[0007] (1) A program according to an aspect of the present invention (e.g., a virtual space generation program 120, a viewer program) is a program executed by a computer (e.g., a distribution server computer 100, a viewer terminal 300, etc.) for providing a virtual space to a user, The computer functioning as a display means for performing processing to display the image of the virtual space (for example, a virtual space update data distribution process, a viewer's viewpoint video output process, etc.); The virtual space includes a predetermined space (e.g., space ER5) in which a plurality of types of objects including a first type of object (e.g., an object essential for generating the virtual space, such as a building or a virtual stage G which is a stage object) and a second type of object (e.g., an object that adds excitement to the virtual space, such as a flower stand FS) can be displayed; The display means When the first object information for displaying the first type of object can be identified, a process for displaying the predetermined space is performed (for example, see steps S215 to S245 in FIG. 33, and the modified example (regarding cluster switching process 2)), regardless of whether the second object information for displaying the second type of object can be identified. When displaying the predetermined space, Within a specified period When the second object information is identifiable, the second type of object is displayed in a display mode based on the second object information (for example, if all the cluster arrangement information has been read out in step S225 of FIG. 33, the cluster arrangement information is transmitted to the user in step S205), Within the specified period A program that performs processing to display an alternative object corresponding to the second type of object when the second object information cannot be identified (for example, in step S245 of Figure 33, an alternative cluster is identified; see the modified example (regarding cluster switching processing 2)).

[0008] According to this configuration, the virtual space can be displayed when the first object information is identified, regardless of whether the second object information can be identified or not. Within a specified period When the second object information cannot be identified, a substitute object can be displayed. Therefore, even when the second object information cannot be identified due to a heavy load on the server caused by concentrated access, the user can be allowed to enter the virtual space and the virtual space can be displayed.

[0009] (2) In the above (1), the computer is a user terminal (e.g., a viewer terminal 300) that displays the provided virtual space, When the first object information can be identified, the display means Within the specified period When the second object information cannot be identified, a substitute object is displayed (for example, see (regarding cluster switching process 2) in the modified example).

[0010] According to this configuration, a request for object information is made from a user terminal. Within a specified period Even when the second object information cannot be identified, a virtual space can be displayed by arranging a substitute object.

[0011] (3) In the above (1), the computer is a distribution device (e.g., a distribution server computer 100) that distributes information for providing the virtual space to a user terminal, When the display means receives a request for object information from the user terminal and identifies and delivers object information including the second object information, if the display means cannot identify the second object information (for example, if cluster placement information cannot be identified even after a predetermined time has elapsed, such as steps S225 to S235 in Figure 33), the display means delivers substitute object information for displaying the substitute object (for example, steps S245 to S205 in Figure 33).

[0012] According to this configuration, even when a distribution device that receives a request for object information from a user terminal cannot identify second object information, the virtual space can be displayed on the user terminal by distributing substitute object information for displaying a substitute object.

[0013] (4) In the above (1), the predetermined space is a space for providing event content (for example, a live event in the spatial area ER5 in FIG. 24) on a scheduled date.

[0014] With this configuration, since the virtual space is for providing event content on a scheduled date, even if there is a surge in access to a distribution device such as a server on that scheduled date, the virtual space can be displayed when the first object information is identified, regardless of whether the second object information can be identified or not.

[0015] (5) In the above (1), the second type of object is an object whose display mode can be changed (for example, a cluster FS in Figures 29 and 30), and when the second type of object information cannot be specified, this includes when display mode information corresponding to the current display mode of the second type of object (for example, cluster arrangement information updated in step S203 in Figure 32 or step S213 in Figure 33) cannot be specified. When displaying the specified space, the display means displays the second type of object in a display mode based on the display mode information if the display mode information can be identified (for example, if all the cluster arrangement information can be read in step S225, it transmits it to the user in step S205), and when the display mode information cannot be identified, it performs processing to display the second type of object as the substitute object in a specified display mode (for example, it identifies a substitute cluster in steps S225 to S245 of Figure 33 and transmits it to the user in step S205).

[0016] According to this configuration, even when the display mode information cannot be identified, the second type of object can be displayed in a predetermined display mode. Therefore, even when the display mode information corresponding to the current display mode of the second type of object cannot be identified, such as when there is concentrated access to a distribution device such as a server, the user can be allowed to enter the virtual space and the virtual space can be displayed.

[0017] (6) In (1) above, the second type of object is an object whose display mode can be changed depending on the user's actions in the virtual space (for example, a flower stand FS that the user can display in the exhibition area through the purchase process of Figure 28, etc.).

[0018] According to this configuration, by making it possible to display a second type of object whose display mode can be changed according to the user's actions, it is possible to draw the user's attention to how the display mode of the second type of object displayed in the virtual space changes according to the user's actions.

[0019] (7) In (6) above, the user's actions include the user's operation of placing the second type of object in the specified space, and the user's operation of generating the display mode of the second type of object when placing it (for example, a flower stand FS that the user can display in the exhibition area by the purchase process of Figure 28, and characters can be input by step S104 of Figure 28, etc.).

[0020] According to this configuration, it is possible to entertain the user by considering how the arrangement position and display mode of the second type of object are changed in response to an operation from the user.

[0021] (8) A computer control method according to an aspect of the present invention is a method for controlling a computer (e.g., a distribution server computer 100, a viewer terminal 300, etc.) for providing a virtual space to a user, the method comprising: a step of performing processing for displaying the image of the virtual space (for example, a virtual space update data distribution process, a viewer viewpoint video output process, etc.); The virtual space includes a predetermined space (e.g., space ER5) in which a plurality of types of objects including a first type of object (e.g., an object essential for generating the virtual space, such as a building or a virtual stage G which is a stage object) and a second type of object (e.g., an object that adds excitement to the virtual space, such as a flower stand FS) can be displayed; The step of performing processing to display an image of the virtual space includes: When the first object information for displaying the first type of object can be identified, a process for displaying the predetermined space is performed (for example, see steps S215 to S245 in FIG. 33, and the modified example (regarding cluster switching process 2)), regardless of whether the second object information for displaying the second type of object can be identified. When displaying the predetermined space, Within a specified period When the second object information is identifiable, the second type of object is displayed in a display mode based on the second object information (for example, if all the cluster arrangement information has been read out in step S225 of FIG. 33, the cluster arrangement information is transmitted to the user in step S205), Within the specified period When the second object information cannot be identified, a process is performed to display a substitute object corresponding to the second type of object.

[0022] According to this configuration, the virtual space can be displayed when the first object information is identified, regardless of whether the second object information can be identified or not. Within a specified period When the second object information cannot be identified, a substitute object can be displayed. Therefore, even when the second object information cannot be identified due to a heavy load on the server caused by concentrated access, the user can be allowed to enter the virtual space and the virtual space can be displayed.

[0023] (9) A system according to an aspect of the present invention is a system (virtual space content distribution system) that includes a computer (e.g., a distribution server computer 100, a viewer terminal 300, etc.) for providing a virtual space to a user, a display means for performing processing to display the image of the virtual space (for example, a virtual space update data distribution process, a viewer viewpoint video output process, etc.); The virtual space includes a predetermined space (e.g., space ER5) in which a plurality of types of objects including a first type of object (e.g., an object essential for generating the virtual space, such as a building or a virtual stage G which is a stage object) and a second type of object (e.g., an object that adds excitement to the virtual space, such as a flower stand FS) can be displayed; The display means When the first object information for displaying the first type of object can be identified, a process for displaying the predetermined space is performed (for example, see steps S215 to S245 in FIG. 33, and the modified example (regarding cluster switching process 2)), regardless of whether the second object information for displaying the second type of object can be identified. When displaying the predetermined space, Within a specified period When the second object information is identifiable, the second type of object is displayed in a display mode based on the second object information (for example, if all the cluster arrangement information has been read out in step S225 of FIG. 33, the cluster arrangement information is transmitted to the user in step S205), Within the specified period When the second object information cannot be identified, a process is performed to display an alternative object corresponding to the second type of object (for example, in step S245 of Figure 33, an alternative cluster is identified; see the modified example (regarding cluster switching process 2)).

[0024] According to this configuration, the virtual space can be displayed when the first object information is identified, regardless of whether the second object information can be identified or not. Within a specified periodWhen the second object information cannot be identified, a substitute object can be displayed. Therefore, even when the second object information cannot be identified due to a heavy load on the server caused by concentrated access, the user can be allowed to enter the virtual space and the virtual space can be displayed. [Brief explanation of the drawings]

[0025] [Figure 1] 1 is a block diagram illustrating an example of a system configuration of a virtual space content distribution system according to an embodiment of the present invention. [Figure 2] 1 is a diagram illustrating an example of the configuration of a delivery server computer in a virtual space content delivery system according to an embodiment of the present invention. [Figure 3] FIG. 2 is a diagram showing various data stored in a storage device of a delivery server computer according to an embodiment of the present invention. [Figure 4] 1 is a diagram illustrating an example of the configuration of a performer terminal in a virtual space content distribution system according to an embodiment of the present invention. [Figure 5] FIG. 2 is a diagram illustrating an example of the configuration of a viewer terminal in the virtual space content distribution system according to the embodiment of the present invention. [Figure 6] FIG. 2 is a diagram illustrating an example of the configuration of an administrator terminal in the virtual space content distribution system according to the embodiment of the present invention. [Figure 7] 3 is a diagram illustrating an example of the configuration of event data in the virtual space content distribution system according to the embodiment of the present invention. FIG. [Figure 8] FIG. 2 is a diagram showing an example of the configuration of performer user data in the virtual space content distribution system according to the embodiment of the present invention. [Figure 9] FIG. 2 is a diagram showing an example of the configuration of viewer user data in the virtual space content distribution system according to the embodiment of the present invention. [Figure 10] 2 is an explanatory diagram showing data transmitted and received between each terminal and a server computer that constitutes the virtual space content distribution system according to the embodiment of the present invention. FIG. [Figure 11]1 is a schematic diagram showing studio equipment used by performer users in a virtual space content distribution system according to an embodiment of the present invention. FIG. [Figure 12] FIG. 1 is a diagram showing an overall image of a virtual space according to an embodiment of the present invention. [Figure 13] 1 is a diagram showing a virtual live concert venue, which is a virtual space used in a virtual space content distribution system according to an embodiment of the present invention. [Figure 14] 10A and 10B are diagrams illustrating examples of displays on a viewer terminal constituting the virtual space content distribution system according to the embodiment of the present invention. [Figure 15] 10A and 10B are diagrams illustrating examples of displays on a viewer terminal constituting the virtual space content distribution system according to the embodiment of the present invention. [Figure 16] 10A and 10B are diagrams illustrating examples of displays on a performer terminal constituting a virtual space content distribution system according to an embodiment of the present invention. [Figure 17] 10A and 10B are diagrams illustrating examples of display by zooming operation on a viewer terminal constituting the virtual space content distribution system according to the embodiment of the present invention. [Figure 18] 10A and 10B are diagrams illustrating examples of display by zooming operation on a viewer terminal constituting the virtual space content distribution system according to the embodiment of the present invention. [Figure 19] 10A and 10B are diagrams illustrating examples of displays on a viewer terminal constituting the virtual space content distribution system according to the embodiment of the present invention. [Figure 20] 10A and 10B are diagrams showing examples of display of a flying effect period on a viewer terminal constituting a virtual space content distribution system according to an embodiment of the present invention. [Figure 21] 10 is a flowchart showing an example of a viewer viewpoint video control process executed in a viewer terminal constituting the virtual space content distribution system according to an embodiment of the present invention. FIG. [Figure 22] FIG. 10 is a diagram showing a virtual live concert venue in a modified example. [Figure 23] FIG. 10 is a diagram showing a participation position selection screen for a virtual live concert venue in a modified example. [Figure 24] FIG. 2 is a diagram showing an example of an overhead view of a predetermined type of virtual space according to an embodiment of the present invention. [Figure 25] FIG. 10 is a diagram showing an example of a display mode of a predetermined type of virtual space according to an embodiment of the present invention. [Figure 26] FIG. 10 is a diagram showing an example of a display mode during a purchase process for an object displayed in a virtual space according to an embodiment of the present invention. [Figure 27] 10 is a table showing an example of object types and user-related information used in a purchase process for an object displayed in a virtual space according to an embodiment of the present invention. [Figure 28] FIG. 10 is a flowchart showing an example of a purchasing process for an object displayed in a virtual space according to an embodiment of the present invention. [Figure 29] 10A to 10C are diagrams illustrating an example of a transition of a display mode of an object displayed in a predetermined type of virtual space according to an embodiment of the present invention. [Figure 30] FIG. 10 is a diagram showing another example of a transition of the display mode of an object displayed in a predetermined type of virtual space according to an embodiment of the present invention. [Figure 31] 10 is a table showing an example of associations between objects displayed in a predetermined type of virtual space and predetermined areas according to an embodiment of the present invention. [Figure 32] FIG. 10 is a flowchart showing an example of a process for switching objects displayed in a predetermined type of virtual space according to an embodiment of the present invention. [Figure 33] FIG. 10 is a flowchart showing an example of a process for switching objects displayed in a predetermined type of virtual space according to an embodiment of the present invention. [Figure 34] FIG. 10 is a diagram showing another example of a transition of the display mode of an object displayed in a predetermined type of virtual space according to an embodiment of the present invention. [Figure 35] FIG. 10 is a diagram showing an example of event content provided in a predetermined type of virtual space according to an embodiment of the present invention. [Figure 36] FIG. 10 is a diagram showing an example of a table relating to objects displayed in event content provided in a predetermined type of virtual space according to an embodiment of the present invention. [Figure 37]FIG. 10 is a diagram illustrating an example of a process for determining an object to be displayed in event content provided in a predetermined type of virtual space according to an embodiment of the present invention. [Figure 38] FIG. 10 is a diagram showing an example of a table used in processing related to event content provided in a predetermined type of virtual space according to an embodiment of the present invention. [Figure 39] FIG. 10 is a flow diagram showing an example of processing related to event content provided in a predetermined type of virtual space according to an embodiment of the present invention. [Figure 40] 10A and 10B are diagrams illustrating a period before the scheduled date and re-provision of event content according to an embodiment of the present invention. [Figure 41] FIG. 10 is a flowchart showing an example of a special switching process according to the present invention. [Figure 42] FIG. 10 is a flow chart showing an example of room entry exception processing of the present invention. [Figure 43] FIG. 10 is a flowchart illustrating an example of a component reset process according to the embodiment of the present invention. [Figure 44] FIG. 10 is a diagram showing an example of a screen on which an action is performed on an object displayed in a predetermined type of virtual space according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0026] The following describes an embodiment of a virtual space content distribution system for distributing various types of content within a virtual space according to the present invention, with reference to the accompanying drawings. Note that identical or similar components in multiple drawings are designated by the same reference numerals, and redundant description will be omitted. Furthermore, the distribution program executed in the virtual space content distribution system according to the present invention may be a program used by the entire system, which includes a server computer and terminals (described later) that constitute the virtual space content distribution system, or it may operate only on a portion of the devices that constitute the virtual space content distribution system, such as the server computer or terminals. [Example]

[0027] Figure 1 is a block diagram showing an example of the system configuration of a virtual space content distribution system in an example which is one embodiment of the present invention. In the system of this example shown in Figure 1, a performer avatar 1 corresponding to a performer user is distributed as virtual space content that holds events such as live performances, games, social gatherings, and movie viewing parties within the virtual space.

[0028] As shown in FIG. 1, the virtual space content distribution system of this embodiment is mainly composed of a distribution server computer 100 capable of executing various processes related to the virtual space and various processes related to the provision and distribution of the virtual space, an administrator terminal 150 used by an event manager K of an event management organization that operates and manages events in the virtual space to manage the distribution of events in the virtual space, a performer terminal 200 used by performer users, and a viewer terminal 300 that can be used by viewer users who enter and participate in the virtual space (for example, log in to the virtual space) and view the event content in the virtual space, and the distribution server computer 100, administrator terminal 150, performer terminal 200, and viewer terminal 300 are connected to each other so that they can communicate data with each other via the Internet N, which is an open computer network.

[0029] In this embodiment, the administrator terminal 150 and performer terminal 200 are also shown as being connected to the distribution server computer 100 via the Internet network N, but the present invention is not limited to this. For example, in cases where an event management organization provides studios to performer users and the distribution server computer 100 is installed in these studios, the administrator terminal 150 and performer terminal 200 may be locally connected to the distribution server computer 100 via data communication, or may be connected via a local area network LAN within the studio facility.

[0030] As shown in FIG. 1, there are multiple viewer users, such as viewer user A, viewer user B, viewer user C, etc., and viewer terminals 300 include viewer terminals 300a, 300b, 300c, etc., which can be used by each of viewer users A, B, C, etc. Typically, there are multiple viewer users, but the number may be one or four or more, and the number may be determined appropriately depending on the type of event content provided in the virtual space, etc. Hereinafter, viewer user A, viewer user B, viewer user C, etc. may be collectively referred to as viewer users, and viewer terminals 300a, 300b, 300c, etc. may be collectively referred to as viewer terminals 300.

[0031] Furthermore, although the present embodiment illustrates a single performer user, the present invention is not limited to this. The event content provided in the virtual space may be a joint event involving multiple performer users who are working independently, or a group event involving a group of multiple people who are working together. In this case, when multiple performers appear, performer terminal 200a, performer terminal 200b, performer terminal 200c, etc. may be provided for each performer user. In the case of a group of multiple people performing, one performer terminal 200 may be used by multiple people. Note that a performer user (also referred to as a talent user) is a user who serves as a speaker, host, facilitator, starring role, etc. in the event content. The event content is advanced by avatars that act as facilitators, such as a performer avatar that corresponds to the actions of the performer user and an operator avatar that corresponds to the operations of an operator (also referred to as an operator user) who manages the event.

[0032] Also, in Figure 1, the distribution server computer 100 is illustrated as a single unit, but the present invention is not limited to this. These distribution server computers 100 may be configured with multiple server computers, such as a first server computer that mainly performs virtual space processing and a second server computer that mainly performs distribution processing, or may be configured with a cloud server, etc., so that the number of server computers can be changed appropriately depending on the scale of the event, the number of participating viewer users, etc.

[0033] Similarly, although the administrator terminal 150 is shown as a single unit in Figure 1, the present invention is not limited to this, and it goes without saying that there may be multiple administrator terminals 150 depending on the number of performer users and viewer users participating in event content such as a live performance.

[0034] <Distribution server computer> Figure 2 is a diagram showing the configuration of the distribution server computer 100 used in this embodiment. As described above, the distribution server computer 100 used in this embodiment is a normal server computer with relatively high processing power installed in a studio operated by an event management organization, and as shown in Figure 2, has a processor (CPU) 101 connected to a data bus 108, memory (RAM) 102, storage 103 such as a hard disk, a communication interface (I / F) 104 capable of two-way communication using the TCP / IP protocol via the Internet, which is an open computer network, and an input / output interface (I / F) 105 to which an input device such as a keyboard can be connected.

[0035] In this embodiment, an input / output interface (I / F) 105 is provided to enable local operation, but if remote operation is possible via a communication interface (I / F) 104, the input / output interface (I / F) 105 may not be provided.

[0036] In addition to an operating system (server OS) for providing server functions (not shown), storage 103 of distribution server computer 100 stores various data and programs as shown in Fig. 3. Specifically, the following are mainly stored: event management program 110 for providing an event management function for managing various events, virtual space generation program 120 for providing a virtual space for the event venue, performer user management program 130 for providing a performer user management function for managing performer users, and viewer user management program 132 for providing a viewer user management function for managing viewer users.

[0037] The event management program 110 is a program for managing events held at an event venue in cooperation with the administrator terminal 150, and is capable of managing the progress of the event using event data 111 (see Figure 7), time schedule data (TS data) 112, music data 113, etc. stored in the storage 103 together with the event management program 110.

[0038] An example of the event data 111 used in this embodiment is shown in Figure 7. The event data 111 stores information such as an event name, a file name of time schedule (TS) data, a performer ID uniquely assigned to the event, a file name of a song list, etc., a file name of a participating viewer list in which information about special viewer users who are permitted to participate virtually is registered in a third area of ​​the virtual audience area (described later), and a file name of a participating viewer list in which information about viewer users who have reserved virtual participation is registered in a fourth area of ​​the virtual audience area (described later). The event data also includes information for specifying the date and time when the event will be held, and event content will be distributed at that date and time. The event data also includes information for specifying the date and time when the virtual space in which the event will be held will be released and users will be able to enter the content before the scheduled date of the event.

[0039] The time schedule data (TS data) 112 is data in which the order of progress and programs such as music of the virtual space live event to be held are described in chronological order, and the virtual space live event is managed so that it progresses based on the time schedule described in the time schedule data (TS data) 112. The time schedule data (TS data) 112, event data 111, etc. can be changed, updated, or added by the event manager K operating the manager terminal 150.

[0040] In addition, the song data 113 is data for the performance parts (so-called karaoke) of each song sung by the performer user, and is played by the audio control program 124 described later based on the time schedule data (TS data) 112 by the event management program 110, and is transmitted to the performer terminal 200 and the viewer terminal 300 (see Figure 11).

[0041] The virtual space generation program 120 is a program for providing an event venue, which is a virtual space, and has the function of providing an event venue in which performer avatars and viewer avatars are virtually participating, using virtual space data 121 that describes the structure of the event venue, which is stored in storage 103 together with the virtual space generation program 120, object data 122 for placing various objects to be placed in the event venue (including star decorations 43 on the stage and star objects 50-52 in the sky) within the virtual space, and performer avatar data included in performer user data 131, which will be described later, and viewer avatar data included in viewer user data 133.

[0042] 13, viewpoint image control program 123 is a program that provides a function to generate viewpoint images from virtual cameras C1-C4 virtually set up in the event venue and a virtual camera moving in the air (not shown), as well as a function to display images from the viewpoints of viewer avatars 11-14 virtually participating in a third area of ​​the event venue and viewer avatars 21-32 virtually participating in a fourth area on performer terminal 200 in cooperation with viewer terminal 300. Virtual camera C2 is a virtual camera set up to display an image from the viewpoint of performer avatar 1 on the stage of the event venue, and the viewpoint image from virtual camera C2 is projected onto a screen S set up in the studio by projector 211 (described later) connected to viewer terminal 300.

[0043] The audio control program 124 is a program for controlling the audio (including music) distributed during events in virtual space, and specifically provides the function of playing music data 113 and synthesizing the audio produced by the performer user with the played music and distributing it to the administrator terminal 150 and the viewer terminal 300.

[0044] The comment control program 125 cooperates with a viewer comment control program stored in the viewer terminal 300 described below to provide a function for displaying various comments entered by each viewer user at the viewer terminal 300 in chronological order on the performer terminal 200 and the viewer terminal 300 during an event in a virtual space.

[0045] The gift control program 126 is a program that cooperates with a viewer program stored in the viewer terminal 300 described below to control gifts given from viewer users to performer users. Specifically, it provides functions such as a function that allows viewer users to purchase gifts (e.g., purchase of objects, etc.) based on information on the purchase price set for various gifts stored in the gift data 134, a processing function that allows viewer users to give gifts purchased using the gift object data included in the gift data 134 to performer users (including processing for presentations when giving gifts), and a processing function that changes the owner of a given gift from the viewer user to the performer user.

[0046] The performer user management program 130 provides a management function for information relating to performer users, an authentication function, and the like, based on performer user data 131 shown in FIG. 8, which is stored in the storage 103 together with the performer user management program 130 .

[0047] An example of the performer user data 131 used in this embodiment is shown in Figure 8. The performer user data 131 stores various information, such as the performer user's account (email address), name, authentication information, file name of the avatar data of the avatar used in the virtual space, and file name of the item list in which the performer user's owned items are registered, in association with a performer user ID uniquely assigned to the performer user. Although not shown in Figure 8, information on virtual value such as points owned by each performer user may also be stored as the performer user data 131.

[0048] Performer users can be authenticated by matching their performer user ID, account, and authentication information, and items (gifts) that each performer user has received from viewers can be identified from an item list.

[0049] The viewer user management program 132 provides functions such as management of information relating to viewer users and authentication functions based on viewer user data 133 shown in FIG. 9, which is stored in the storage 103 together with the program.

[0050] An example of the viewer user data 133 used in this embodiment is shown in Figure 9. The viewer user data 133 stores various information associated with a viewer user ID uniquely assigned to the viewer user, such as the viewer user's account (email address), authentication information, the file name of the avatar data of the avatar used in the virtual space, owned points, which are the number of points owned that can be used in the virtual space, the file name of an item list in which items (gifts) purchased using points are registered, and personal information such as name, date of birth, and telephone number. Although not shown in Figure 9, nicknames (comment names) displayed together with comments are also registered in the viewer user data 133, and the nicknames (comment names) are displayed together with the comments. Points can be increased, for example, by purchasing points from a predetermined operating company.

[0051] <Presenter terminal> Fig. 4 is a diagram showing an example of the configuration of a performer terminal 200 in the virtual space content distribution system of this embodiment. In this embodiment, as shown in Fig. 11, performer terminal 200 is installed in a control room adjacent to a studio where performers perform their actions, and uses a normal computer with relatively excellent processing power. As shown in Fig. 4, performer terminal 200 has processor (CPU) 201 connected to data bus 208, memory (RAM) 202, storage 203 such as a hard disk, communication interface (I / F) 204 capable of two-way communication using the TCP / IP protocol via the Internet, which is an open computer network, image processing unit 206 including a graphics processing unit (GPU) to which display devices A210 to C212 are connected, and input / output interface (I / F) 205 to which various input / output devices are connected.

[0052] Connected to the input / output interface (I / F) 205 are input devices such as a motion sensor 220 including multiple wearable sensors 220C1-220C5 (see FIG. 11) worn by the performer user on the left and right limbs and waist, an expression input device 221 consisting of an imaging camera for inputting the performer's facial expressions, a voice input device 222 consisting of a sound-collecting microphone worn on the performer user's head, and an operation input device 224 such as a keyboard or touch panel operable by an assistant operator O assisting the performer user. Note that these input devices may be provided with controllers that the performer user can hold to perform various operations, allowing the performer to perform various operations himself or herself without the assistance of the assistant operator O.

[0053] In this embodiment, the performer user performs performance actions (musical actions) in accordance with the music, and an assistant operator O assists with operations during the performance. However, it is also possible to have multiple assistant operators O, or to set the operation content in advance in the performer terminal 200, for example, in a sequence program, thereby eliminating the need for an assistant operator O.

[0054] An audio output device 223 including high-performance earphones (ear monitors) worn by the performer user and speakers placed in the control room is connected to the input / output interface (I / F) 205 as an output device, so that the sound of the music being played sent from the distribution server computer 100 is output to the performer user via the high-performance earphones (ear monitors), and the music audio is output from the speakers along with the performer's voice, allowing an assistant operator O or the like to check the status of the music, including the voice produced by the performer user, in the control room.

[0055] In this embodiment, high-performance earphones (in-ear monitors) are used to avoid the inconvenience of the reproduced music audio being input from the sound collection microphone worn by the performer user, but the present invention is not limited to this, and the music audio may be output from speakers in the studio, etc., as long as the inconvenience of the music audio being input can be avoided.

[0056] In this embodiment, the sound collecting microphones are worn by the performers, but these sound collecting microphones may be installed on the floor, wall, or ceiling of the studio.

[0057] Here, we will explain the motion sensor 220 used in the performer terminal 300 of this embodiment. Any motion sensor 220 can be used as long as it can properly detect (measure) the body movements (movements) of the performer user. In this embodiment, in order to be able to detect the performer's movements more accurately and in a shorter cycle, multiple wearable sensors 220C1 to 220C5 are used that are worn by the performer user on the body. Note that the motion sensor 220 may also be a type that does not require the performer to wear any equipment, such as a LiDAR that uses laser light or the like.

[0058] In this embodiment, in order to reduce the burden on the performer user's head, particularly the burden on the performer user's head, caused by wearing sensors when performing a performance, the performer user's head movements are detected by image recognition using images captured by the imaging camera that constitutes the facial expression input device 221, as described below, and five wearable sensors 220C1 to 220C5 are used to detect movements other than the head.However, it is also possible to provide wearable sensors on the performer user's head, etc., or to wear more (seven or more) wearable sensors to detect more detailed movements.

[0059] As shown in FIG. 11, the wearing sensors 220C1 to 220C5 detect their own positions and orientations in cooperation with base station 220a and base station 220b installed in a studio room separated from the adjacent control room by a glass window.

[0060] Base station 220a and base station 220b may use, for example, a multi-axis laser emitter. Base station 220a emits a synchronous flashing light and then scans the laser light around, for example, a vertical axis. Base station 220b scans the laser light around, for example, a horizontal axis.

[0061] Each of the mounting sensors 220C1 to 220C5 may include a plurality of optical sensors that detect the incidence of blinking light and laser light from the base station 220a and the base station 220b.

[0062] Each of the wearing sensors 220C1 to 220C5 is capable of detecting its own position and orientation based on the time difference between the timing of the flashing light and the timing of the laser light, the light reception time at each optical sensor, the angle of incidence of the laser light detected by each optical sensor, and other information as necessary. For example, the ViveTracker provided by HTC CORPORATION or a base station can be suitably used.

[0063] Base station 220a and base station 220b emit flashing light and perform laser light scanning at regular intervals, so the detection information of each of wearable sensors 220C1-220C5 is updated at each interval. Detection information indicating the position and orientation of each motion sensor calculated by each of these wearable sensors 220C1-220C5 is input to performer terminal 200 via short-range wireless communication and transmitted to distribution server computer 100 as performer avatar information together with facial motion information (see FIG. 10).

[0064] In this embodiment, an example is shown in which two base stations, base station 220a and base station 220b, are used, but the present invention is not limited to this, and the number of base stations may be three or more.

[0065] Alternatively, the motion sensor 220 may be configured such that each of the multiple motion sensors worn by the performer user is equipped with a number of infrared LEDs or visible light LEDs, and the position and orientation of each of the motion sensors can be detected by detecting the light from these LEDs with an infrared camera installed on the floor or wall of the studio.

[0066] Furthermore, in order to reduce the burden on the performer user, motion sensor 220 may be replaced with a motion sensor using lighter reflective markers instead of wearable sensors 220C1-220C5. That is, reflective markers attached to various parts of the performer user's body with adhesive tape or the like may be photographed to generate photographic data, and this photographic data may be image-processed to detect the positions and orientations of the reflective markers, thereby detecting the performer user's movements. In this case, a cameraman may be positioned in the studio to photograph the performer user, and the cameraman may photograph the performer user from a direction suitable for detection, thereby enabling the performer user's movements to be detected well.

[0067] Furthermore, the motion sensor 220 may be a suit with a built-in inertial sensor, such as the inertial sensor suit for the MVN motion capture system marketed by Xsens.com, and the movements of the performer user may be detected by analyzing the sensor signal output from the inertial sensor.

[0068] Any facial expression input device 221 can be used as long as it can appropriately detect the head movements, including the face, of the performer user. In this embodiment, specifically, it is configured with an imaging camera (digital camera) arranged so as to be able to continuously capture head images, including the face, of the performer user, and the head movements and facial movements (facial expressions) of the performer user captured by the imaging camera are detected by image recognition, and facial motion information, which is the detected head movements and facial movements (facial expressions), is transmitted to the distribution server computer 100 as performer avatar information together with body motion information, as shown in Fig. 10.

[0069] The facial expression input device 221 is not limited to the imaging camera (digital camera) used in this embodiment, and may be, for example, a 3D camera capable of detecting the depth of a person's face, or a mobile terminal such as a smartphone equipped with a LiDAR device. In this case, the performer user may wear such a mobile terminal.

[0070] As described above, the performer terminal 200 of this embodiment has three display devices A210 to C212. Display device A210 is an LCD monitor or the like installed in the control room, as shown in Figure 11, display device B211 is a projector that projects images onto a screen S installed in the studio, and display device C212 is a large vertical display installed adjacent to the screen S in the studio.

[0071] Display device A210, located in the studio's adjustment room, displays images from each viewpoint of virtual cameras C1 to C4, viewpoint images from a virtual camera moving in the air during the flying performance period described below, the content of comments, and a message input window into which assistant operator O can input messages he or she wishes to convey to the performer users.

[0072] Meanwhile, a screen S projected from a projector, which is a display device B211 installed in the studio, displays an image from the viewpoint of a virtual camera C2 (see Figure 13), which is the viewpoint of the performer, including, for example, an image including avatars of viewers virtually participating in the live performance in the third and fourth areas, as shown in Figure 16, thereby enabling performer users to check the status of viewer users virtually participating in the virtual space live performance through the image.

[0073] In addition, the display device C212 installed in the studio displays comments from viewer users, as well as comments and messages entered by the assistant operator O, so that the performer user can check the comments from viewer users and messages from the assistant operator O even during the performance.

[0074] In addition to an operating system (OS) for operating the computer that is the performer terminal 200, the storage 203 stores a performer program that, when executed by the processor (CPU) 201, etc., works in cooperation with the distribution server computer 100 to provide various functions, including the ability for the performer user to control the movement of the performer avatar 1 in the virtual space live, which is virtual space content.

[0075] As shown in Figure 4, the performer program includes a performer avatar control program, a performer viewpoint image control program, a performer viewpoint image control program, a performer voice control program, a performer comment control program, performer authentication data, etc.

[0076] The performer avatar control program is a program that mainly provides the function of scanning the performer user's body motion using the motion sensor 220 and scanning the performer user's facial motion (expression) using the facial expression input device 221, generating performer avatar information for operating the performer avatar, and transmitting it to the distribution server computer 100.

[0077] The performer's viewpoint video control program is a program that provides the function of generating and outputting a viewpoint video of virtual camera C2, which is the performer's viewpoint, based on the virtual space update data distributed from distribution server computer 100.

[0078] The performer audio control program is a program that outputs the playback sound of a song based on the playback music data distributed from the distribution server computer 100 via the audio output device 223, converts the audio input from the audio input device 222 into data and transmits it to the distribution server computer 100 as performer audio data, and provides the function of generating and outputting monitor audio consisting of the playback sound of the song and the performer audio.

[0079] The performer's comment control program is a program that provides a function for displaying comments and the like by viewer users that are distributed from the distribution server computer 100 .

[0080] The performer authentication data is data for authenticating the identity of the performer user when communicating with the distribution server computer 100 .

[0081] In addition, the performer avatar control program includes a motion parameter generation program that can generate parameter information for the position and rotation angle of the bones that make up the rig data (sometimes called "skeleton data") that indicates the skeleton of the performer avatar included in the performer avatar data, as well as an image recognition processing program that performs image recognition of the performer user's head position and facial expression from images captured by an imaging camera.

[0082] In addition, in this embodiment, the performer terminal 200 is illustrated as a form in which a computer serving as the performer terminal 200 installed in a studio operated by an event management organization is jointly used by multiple performer users to hold a live event, and each performer user can use the computer as their own performer terminal 200 by inputting performer authentication data.However, the present invention is not limited to this, and for example, when a performer user appears in a virtual space live event from their home, etc., the performer terminal 200 may be a computer installed in the performer user's home and used exclusively by the performer user, and in such cases, it is not necessarily necessary to store performer authentication data.

[0083] In this way, by having a performer user or the like use the performer terminal 200 that constitutes the virtual space content distribution system of this embodiment, the performer user can cause the performer avatar 1 placed on the virtual stage G at the event venue to move in conjunction with his or her own movements, can reflect his or her own facial expressions in the facial expressions of the performer avatar 1, and can distribute his or her own voice as the voice of the performer avatar 1 to viewers via the distribution server computer 100.

[0084] <Viewer terminal> Fig. 5 is a diagram showing an example of the configuration of a viewer terminal 300 in the virtual space content distribution system of this embodiment. In this embodiment, the viewer terminal 300 is a smartphone P carried by a viewer user or a typical desktop computer (PC) installed in the viewer user's home or the like, and as shown in Fig. 5, has a processor (CPU) 301 connected to a data bus 308, memory (RAM) 302, storage 303 such as a hard disk or non-volatile memory, a communication interface (I / F) 304 capable of two-way communication via the Internet, which is an open computer network, using the TCP / IP protocol, an image processing unit 306 including a graphics processing unit (GPU) connected to a display device 310, and an input / output interface (I / F) 305 connected to various input / output devices.

[0085] As described below, display device 310 may be any device capable of displaying viewpoint images generated based on virtual space data of the event venue, which is a virtual space updated by virtual space update data (see FIG. 10) distributed from distribution server computer 100, using a viewer viewpoint image control program included in the viewer program stored in storage 303, as well as flying viewpoint images distributed from distribution server computer 100 during a flying performance period, as described below. If viewer terminal 300 is a smartphone P, the display device 310 corresponds to the display of the smartphone P. If viewer terminal 300 is an ordinary computer (PC), the display device 310 corresponds to a stationary display constituting the computer (PC). Note that these displays are not limited to those that display monoscopic images (2D images), and may also be, for example, displays capable of displaying stereoscopic images (3D images) by displaying right-eye and left-eye images, such as a head-mounted display (HMD) that can be worn by the viewer.

[0086] The input / output interface (I / F) 305 is connected to an operation input device 321 consisting of one or more devices that allow the viewer to perform various operations as input devices, and an audio output device 322 such as earphones or speakers that can output live audio, etc., distributed from the distribution server computer 100.

[0087] It goes without saying that the audio output device 322 may not be a standalone device, but may be integrated with the display device 310 like the head-mounted display (HMD) described above.

[0088] The operation input device 321 can be any device that allows the viewer to perform various operations such as movement operations including moving the viewer avatar, zoom operations, operations related to comments, operations related to gifts, etc., and can be composed of at least one of, for example, a transparent touch panel formed on the surface of a smartphone display, a keyboard that constitutes a computer, a game controller, etc.

[0089] In this embodiment, as will be described later, the virtual audience area at the event venue is divided into a third area near the virtual stage G in which only viewer users who have been specially permitted by the performer user can virtually participate, as shown in Figure 13, and a fourth area around the third area in which general viewer users can virtually participate.Viewer users who virtually participate in the fourth area may, as described above, have an operation input device 321 such as a touch panel, keyboard, or game controller, but viewer users who virtually participate in the third area possess an operation input device 321 such as an MVN motion capture suit with the above-mentioned inertial sensor built in, and are viewer users who, like performer users, can precisely move their viewer avatars with their own movements.

[0090] However, even viewer users who are permitted to virtually participate in the third area cannot change the facial expressions of the viewer avatars, but the present invention is not limited to this, and the facial expressions of these viewer avatars may be changed, for example, as described above, by the viewer user using the camera function of a smartphone or a camera connected to a computer to recognize the viewer user's facial expression, even if it is at a level different from the change level of the performer user.

[0091] The various input / output devices connected to these input / output interfaces (I / F) 305 may be built-in or external, and in the case of external devices, the connection may be either wired or wireless.

[0092] In addition to an operating system (OS) for operating the viewer terminal 300, which is a smartphone or computer, the storage 303 also stores a viewer program as a viewing application that, when executed by the processor (CPU) 301 or the like, works in cooperation with the distribution server computer 100 to provide various functions, including a live viewing function for viewer users in virtual space live, which is virtual space content.

[0093] As shown in FIG. 5, the viewer program includes a viewer viewpoint image control program that provides the function of generating each viewpoint image of the virtual space live to be displayed on the display device 310, a viewer audio control program that provides the function of outputting live audio from the audio output device 322 based on the live audio (data) of the virtual space live distributed from the distribution server computer 100, a viewer comment control program that displays comments based on comment data distributed from the distribution server computer 100 and provides comment-related functions such as comments entered by the viewer and sending them to the distribution server computer 100, and viewer authentication data for authenticating the identity of the viewer user in a communication connection with the distribution server computer 100.

[0094] Although not shown in Figure 5, in addition to the above-mentioned programs, the virtual space may also include a gift control program that controls gifts and the placement of objects in the virtual space, a program for purchasing tickets for viewer avatars to virtually participate in an event, and an area designation program for reserving an area (position) at the event venue in advance for a viewer avatar to virtually participate in the event, as shown in Figures 22 and 23, but other programs may also be included.

[0095] In this embodiment, the comments entered by the viewer are short messages in text format, but are not limited to these short messages in text format and may be, for example, messages in the form of still images, messages in the form of moving images, or any other electronic message format. The comments are displayed on the display device 310, superimposed on each viewpoint video.

[0096] In this way, by using the viewer terminal 300 that constitutes the virtual space content distribution system of this embodiment, a viewer user can move and operate the viewer avatar that is virtually participating in the event venue, and by changing the viewpoint of the viewer avatar, the viewpoint image displayed on the display device 310 can be changed, and the zoom state (viewpoint state) can also be changed, allowing the viewer avatar to operate and cheer on the performer avatar 1.

[0097] Note that a viewer avatar virtually participating in the third area is only allowed to move within the third area and cannot move to the fourth area. On the other hand, a viewer avatar virtually participating in the fourth area is only allowed to move within the fourth area and cannot move to the third area. However, the present invention is not limited to this, and a viewer avatar virtually participating in three areas may be allowed to move to the fourth area. Note that, naturally, a viewer avatar cannot move onto the virtual stage G, etc., so the viewer avatar's movement onto the virtual stage G will not obstruct the visibility of the performer avatar 1.

[0098] Furthermore, by displaying viewpoint images on these display devices 310 and outputting live audio, users can enjoy the virtual space live event with the feeling that they are actually present at the event venue.

[0099] Although a detailed explanation is omitted, the comment function provided by the viewer comment control program allows viewers to enjoy the virtual space live show while checking comments entered by themselves and other viewer users, and the gift function provided by the gift control program allows viewers to liven up the virtual space live show by gifting items they own to performer avatar 1.

[0100] <Administrator terminal> Fig. 6 is a diagram showing an example of the configuration of administrator terminal 150 in the virtual space content distribution system of this embodiment. In this embodiment, administrator terminal 150, together with performer terminal 200, uses a normal computer installed in a control room adjacent to the studio, and as shown in Fig. 6, has processor (CPU) 151 connected to data bus 158, memory (RAM) 152, storage 153 such as a hard disk, communication interface (I / F) 154 capable of two-way communication using the TCP / IP protocol via the Internet, which is an open computer network, image processing unit 156 including a graphics processing unit (GPU) connected to display device 160, and input / output interface (I / F) 155 connected to various input / output devices.

[0101] As will be described later, the display device 150 is configured by one or more stationary displays, and is capable of individually displaying the viewpoint images of each of the virtual cameras C1 to C4 described below and the virtual camera moving in the air during the flying performance period, which are generated based on the virtual space data of the event venue, which is a virtual space updated by the virtual space update data (see Figure 10) distributed from the distribution server computer 100, using an administrator viewpoint image control program included in the administrator program stored in storage 153, as well as being capable of displaying comments based on the comment data distributed from the distribution server computer 100.

[0102] The input / output interface (I / F) 155 is connected to an operation input device 161 consisting of one or more devices that allow the administrator K to perform various operations as input devices, and an audio output device 162 such as earphones, headphones, or speakers that can output live audio, etc., distributed from the distribution server computer 100.

[0103] The operation input device 161 can be any device that allows the administrator K to perform various operations such as input and settings related to the virtual space live event, and may be composed of, for example, at least one of a keyboard that constitutes a computer, a transparent touch panel formed on the display surface, a viewpoint switching controller, etc.

[0104] The various input / output devices connected to the input / output interface (I / F) 155 may be connected either by wire or wirelessly.

[0105] In addition to the operating system (OS) for operating the computer that is the administrator terminal 150, the storage 153 also stores an administrator program that is executed by the processor (CPU) 151, etc. to provide various functions in cooperation with the distribution server computer 100, including distribution management functions related to the distribution of virtual space live content.

[0106] As shown in FIG. 6, the administrator programs include an administrator viewpoint video control program, an administrator audio control program, an administrator comment control program, an audience management program, a performer management program, and the like.

[0107] The viewpoint video control program for administrator is a program that provides a function for generating viewpoint videos from each virtual camera to be displayed on the display device 160, as well as a function for changing and switching between each viewpoint.

[0108] The administrator audio control program is a program that provides a function for outputting live audio from the audio output device 162 based on the audio data of the virtual space live broadcast distributed from the distribution server computer 100 .

[0109] The administrator's comment control program is a program that displays comments based on comment data distributed from the distribution server computer 100, and provides comment-related functions such as prohibiting comments from being distributed and selecting viewers to prevent them from being distributed.

[0110] The viewer management program is a program for managing viewer users who virtually participate in the virtual space live event, and the performer management program is a program for managing performer users who virtually participate in the virtual space live event.

[0111] Although not shown in Figure 6, the system includes an authentication program for authenticating whether the administrator who is the operator is the person in question, and a schedule program for editing the time schedule and song order of the virtual space live performance, but other programs may also be included.

[0112] In this way, by having administrator K operate administrator terminal 150 that constitutes the virtual space content distribution system of this embodiment, various settings for executing the event can be made, such as settings related to the program, order of songs, performance, time schedule, and the trajectory of the aerial moving virtual camera during the flying performance period, and the virtual space live performance can be managed based on the settings made in this way.

[0113] <Overall image of virtual space> As an example of content, the following describes a live event featuring performers in a virtual live venue. FIG. 12 shows an overview of the virtual space provided by the system of this embodiment. The virtual space ER of this embodiment includes multiple spatial areas ER (spatial area ER1, spatial area ER2, etc.). Each spatial area ER can provide content of different genres and types. The multiple spatial areas ER include, for example, an entrance that functions as a lobby when a user logs into the virtual space ER, and areas corresponding to various content, such as a live venue, game content, and exhibition hall. Note that various areas may be selectable from a title screen displayed when a user logs into the virtual space ER. The event venue, described below using FIGS. 13, 24, and 25, is constructed in the entirety of a specified spatial area ER or in a portion of a specified spatial area ER.

[0114] Each spatial area ER has multiple rooms providing the same content. Each room has a set maximum number of users, up to 200 people. Each room is managed, for example, by a real-time synchronization server. Users in the same room can see each other's user avatars and communicate with each other. For example, they can play games together or chat. For example, if the spatial area ER1 is a space modeled after a city, the rooms ER1a, ER1b, etc. corresponding to the spatial area ER1 provide users with the same city-like space, but the only avatars that can be displayed in the space are those corresponding to users associated with the same room. For example, the user avatar 1 of a user associated with room ER1a is not displayed on the user screen of a user associated with room ER1b. However, in exceptional cases, the user avatar of a special user (e.g., a celebrity) can be displayed not only in the room they are actually in but also in other rooms (also known as mirroring).

[0115] Movement between spatial areas ER may be restricted to one after logging in to the virtual space, without first passing through a spatial area ER designated as an area providing specific content (e.g., an entrance). Alternatively, movement between spatial areas ER may be possible. For example, movement from spatial area ER2 to spatial area ER3 may be restricted without passing through spatial area ER1, or movement between spatial areas ER2 and ER3 may be possible directly without passing through spatial area ER1. Furthermore, when moving between spatial areas ER, a transition effect may be implemented. For example, when moving to another spatial area ER, the display screen may be switched to black (e.g., a black screen with a message such as "Loading..."). Furthermore, regarding user access to each spatial area ER, after logging in, the user may first enter an entrance area, or the user may be able to select and enter a spatial area ER of their choice without passing through the entrance area, or the user may transition to a spatial area ER randomly determined by lottery. Regarding each room, the user may select a room of their choice to enter, or may enter a room that is randomly determined by lottery.

[0116] <Virtual live venue> The virtual live venue, which is the virtual space used in this example, is shown in Fig. 13. The virtual live venue shown in Fig. 13 is constructed in a predetermined spatial area ER out of the spatial areas ER shown in Fig. 12. As shown in Fig. 13, the virtual live venue, like a live venue in real space, is a virtual space that has a virtual stage G where performer users appear as performer avatars 1 and a virtual audience area where viewer users who will become spectators virtually participate as viewer avatars.

[0117] As shown in Fig. 13, virtual stage G has a trapezoidal floor with a relatively large area, and performer avatar 1 can move on virtual stage G in the same way as at a live venue in real space. On the side of virtual stage G opposite the virtual audience seats, as shown in Fig. 13, a virtual stage wall is formed that is divided into three parts: a central part, a right part, and a left part. Virtual displays 40, 41, and 42 are provided in front of these virtual stage walls, and images and videos for performance purposes are virtually displayed on these virtual displays 40, 41, and 42.

[0118] A virtual star-shaped object 43 related to the performer user is placed between the virtual displays 40, 41, and 42, and large virtual star-shaped aerial objects 50 to 52 are placed in a second area on the virtual stage G, which is an area above the first area surrounded by the virtual stage walls, as shown in Fig. 13. The virtual aerial objects 50 to 52 are movable within the second area.

[0119] A virtual audience area where viewer users can virtually participate in the virtual live performance venue as viewer avatars is provided in front of the virtual stage G. As shown in Fig. 13, this virtual audience area is divided into a third area, which is a special area near the center of the virtual stage G where performer avatar 1 appears, and a fourth area, which is formed to surround the third area and is located at a greater distance from the center of the virtual stage G than the third area.

[0120] These third areas are available to special viewer users who are permitted to participate virtually, up to a predetermined upper limit. In this embodiment, as shown in FIG. 13, for example, viewer avatars 11 to 14 of four viewer users who have met a predetermined virtual participation record and have been permitted to participate virtually by the performer user are placed.

[0121] In addition, the fourth area is arranged with viewer avatars 21 to 32 of general viewer users who have reserved virtual participation before the start of the virtual space live. Note that in Fig. 13, the viewer avatars 21 to 32 are shown in a simplified manner for convenience, but are the same avatars as the viewer avatars 11 to 14.

[0122] Furthermore, each viewer avatar 11 to 14 placed in the third area can be moved within the third area by the viewer user operating the viewer terminal, and each viewer avatar 21 to 32 placed in the fourth area can also be moved within the fourth area by the viewer user operating the viewer terminal.

[0123] Four virtual cameras C1 to C4 are virtually placed (set) in the virtual live performance venue, as shown in Fig. 13. Virtual camera C1 is virtually placed in front of performer avatar 1 so as to face the performer avatar 1, and the viewpoint image captured by virtual camera C1 is a viewpoint image viewed from a position close to the front of performer avatar 1, as shown in Fig. 14(a).

[0124] Virtual camera C2 is a camera virtually placed (set) above the head of performer avatar 1, and the viewpoint image from virtual camera C2 is a performer viewpoint image looking at the virtual audience area from performer avatar 1, as shown in Figure 16.

[0125] Virtual camera C3 is a virtual camera virtually placed on the virtual display 41 diagonally behind the performer avatar 1, and the viewpoint image from virtual camera C3 is a viewpoint image looking at the virtual audience area from diagonally behind the performer avatar 1, as shown in Figure 14(c).

[0126] Virtual camera C4 is a virtual camera virtually placed on the virtual display 42 diagonally behind the performer avatar 1, and the viewpoint image from virtual camera C4 is a viewpoint image looking at the virtual audience area from diagonally behind the performer avatar 1, as shown in Figure 14(b).

[0127] Furthermore, in this embodiment, in addition to the fixedly placed (set) virtual cameras C1 to C4, aerial moving virtual cameras (not shown) are virtually placed so as to be movable in the air within the virtual space of the virtual live performance venue. The aerial trajectories along which these aerial moving virtual cameras move and the viewpoint directions (angles) at each position on the aerial trajectories are preset by the administrator terminal 150. During the flying performance period described below, the performer avatar 1 virtually flies so as to follow the aerial trajectory of the aerial moving virtual camera, thereby generating a viewpoint video of the virtually flying performer avatar 1 captured by the aerial moving virtual camera.

[0128] In this embodiment, as shown in FIG. 13, an example is given in which four virtual cameras C1 to C4 are virtually arranged as fixedly arranged (set) virtual cameras, but the present invention is not limited to this, and the number of these fixedly arranged (set) virtual cameras may be five or more, or conversely, without providing fixedly arranged (set) virtual cameras, only the viewpoint images seen from the viewpoints corresponding to each avatar virtually participating in the virtual live venue may be displayed on the performer terminal 200 and the viewer terminal 300.

[0129] Furthermore, in this embodiment, an example is given in which there is one virtual camera moving through the air, but the present invention is not limited to this, and it is also possible to have a configuration in which there are multiple virtual cameras moving through the air, or conversely, a configuration in which there is no virtual placement of a virtual camera moving through the air.

[0130] <Studio> 11 is a diagram showing the studio used in this example, and as mentioned above, the studio is adjacent to the control room separated by a glass window, and the performer user performs various movements corresponding to singing in the studio, while an assistant operator O assists with the operation of performer terminal 300 installed in the control room. Around the performer user wearing wearable sensors 220C1 to 220C5, base station 220a and base station 220b are mounted on stands, and an imaging camera constituting facial expression input device 221 is mounted on a stand and positioned approximately in front of the performer user.

[0131] A screen S is installed on the wall facing the performer user in the studio, and a projector (display device B211) installed on the ceiling of the studio projects the viewpoint image of virtual camera C2 onto screen S, so that the viewpoint image seen from performer avatar 1 as seen in the virtual audience area is displayed on screen S, as shown in Figure 16.This allows the performer user to proceed with the live performance while constantly keeping track of the behavior of the viewer avatars virtually participating in the virtual audience area (the audience's reactions to the live performance).

[0132] A large vertical display serving as the display device C212 is placed to the side of the screen S, and is configured to display comments from viewers and messages that the assistant operator O wants to convey to the performer users. The display device C212 may also be configured to display information (performer support information) such as the lyrics and lines of the songs sung by the performers during the live performance.

[0133] <Operation of virtual space content distribution system> FIG. 10 is an explanatory diagram illustrating the operation of the virtual space content distribution system of this embodiment, specifically, the flow of distribution of video and audio of a virtual live performance.

[0134] First, the video system will be described. As mentioned above, distribution server computer 100 is capable of providing a virtual space of a virtual live venue based on virtual space generation program 120 and avatar data of performer users and viewer users, and the movements of each avatar of these performer users and viewer users are reflected in the movements of performer avatar 1, and the movements (operations) of viewer users are reflected in the movements of the viewer avatar, as virtual space data describing the state of the virtual space is updated by performer avatar information transmitted from performer terminal 200 and viewer avatar information transmitted from viewer terminal 300.

[0135] Although not shown in Figure 10, when the performer terminal 200 and the viewer terminal 300 communicate with the distribution server computer 100 to virtually participate in the virtual space live performance, virtual space data of the virtual live performance venue is delivered and stored in advance from the distribution server computer 100.As will be described later, this pre-stored virtual space data is sequentially updated by virtual space update data that is continuously delivered from the distribution server computer 100, allowing the performer terminal 200 and the viewer terminal 300 to identify the latest state of the virtual live performance venue.

[0136] Specifically, the movements and facial expressions of the performer user in the studio are scanned at predetermined time intervals using the body motion scan and face motion scan functions of the performer avatar control program, and performer avatar information is generated and sent to the distribution server computer 100.

[0137] On the other hand, viewer users who are permitted to virtually participate in the third area use motion sensors, just like performers, and are scanned at predetermined time intervals using the body motion scan and face motion scan functions, and viewer avatar information is generated and sent to the distribution server computer 100.

[0138] Furthermore, a viewer user permitted to virtually participate in the fourth area can use the touch panel, keyboard, or controller of the viewer terminal 300 to perform various operations such as movement, changing the viewpoint direction, changing the viewpoint (zoom), raising a hand, clapping a hand, jumping, etc., to make the viewer avatar perform the corresponding action. Then, viewer avatar information is generated based on the operation related to the viewer avatar's action among these operations, and is transmitted to the distribution server computer 100.

[0139] In this way, based on the performer avatar information transmitted from the performer terminal 200 and the viewer avatar information transmitted from the viewer terminal 300, the distribution server computer 100 executes a virtual space update process to update the virtual space data, thereby reflecting the actions (operations) of the performer users and the viewer users in each avatar virtually participating in the virtual live venue.

[0140] Then, after executing a virtual space update data generation process for generating virtual space update data based on the virtual space data before the update and the virtual space data after the update, the generated virtual space update data is distributed to the performer terminal 200 and the viewer terminal 300.

[0141] As shown in Figure 10, at the performer terminal 200 and viewer terminal 300 to which the virtual space update data has been distributed, the pre-stored virtual space data is updated based on the distributed virtual space update data, and a performer perspective video generation process and a viewer perspective video generation process are executed using the updated virtual space data, thereby generating performer perspective video and viewer perspective video based on the updated virtual space data, and the generated performer perspective video and viewer perspective video are displayed on the performer terminal 200 and the viewer terminal 300 (viewer perspective video output process).

[0142] In this way, in this embodiment, the viewpoint images of each viewer user who is virtually participating in the virtual live venue using a viewer avatar are generated and displayed on the viewer terminal 300 of each viewer user, and by generating the viewer avatar viewpoint images of each viewer user on the distribution server computer 100, it is possible to avoid a situation where the processing load on the distribution server computer 100 becomes significantly large, which would prevent many viewer users from being able to participate in the virtual space live, and it is also possible to avoid a situation where an increased processing load would make distribution difficult.

[0143] In this embodiment, the display device 310 of the viewer terminal 300 of the viewer user of viewer avatar 13 who is virtually participating in the third area close to the performer avatar 1 on the virtual stage G generates and displays a viewpoint image in which the almost front of the performer avatar 1 is displayed large, which is the viewpoint image seen from the viewer avatar 13 who is close to the performer avatar 1, as shown in Figure 14(d).On the other hand, the display device 310 of the viewer terminal 300 of the viewer user of viewer avatar 28 who is virtually participating in the fourth area far from the performer avatar 1 on the virtual stage G, for example, at a position behind the viewer avatar 13, displays a viewpoint image in which the almost front of the performer avatar 1 appears relatively small through the viewer avatar 13 and viewer avatar 14 who are virtually participating in the third area, as shown in Figure 14(e).

[0144] In addition, the display device 310 of the viewer terminal 300 of the viewer user of the viewer avatar 32 who is virtually participating at the end position of the virtual stage G in the fourth area, which is set up in a U-shape when viewed from above, displays a viewpoint image as seen from the viewer avatar 32 positioned diagonally forward of the performer avatar 1, as shown in Figure 14(f), in which the performer avatar 1 appears relatively small over the viewer avatar 14 who is virtually participating in the third area.

[0145] Note that all of the display examples shown in Figure 14 illustrate the case where the viewer terminal 300 is a stationary computer (PC) and the display device 310 is a stationary display. However, if the viewer terminal 300 is a smartphone P, tablet, etc., the viewpoint image of the virtual camera C1 will be displayed as shown in Figure 15(a), and if the viewer terminal 300 is the viewer terminal 300 of the viewer avatar 13, it will be displayed as shown in Figure 15(b).

[0146] Next, regarding the audio system, in the distribution server computer 100, music data 113 is played back by the audio control program 124 based on the time schedule data (TS data) 112, and is transmitted to the performer terminal 200 as a played music piece (data) (music playback process).

[0147] In the performer terminal 200, the music audio from the played music (data) sent from the distribution server computer 100 is output to the performer user through high-performance earphones (ear monitors) worn by the performer user (played music output process), and when the performer user sings along with the output played music, the performer voice input from the sound collection microphone (voice input device 222) is converted into data and sent to the distribution server computer 100 as the performer voice (data).

[0148] The distribution server computer 100 generates distribution audio (data) from the performer audio (data) received from the performer terminal 200 and the music played back in the music playback process described above (distribution audio generation process), and distributes the generated distribution audio (data) to the viewer terminal 300 (generated audio distribution process).

[0149] At the viewer terminal 300, the distributed audio (data) distributed from the distribution server computer 100 is output from an audio output device 322 such as earphones or speakers, allowing the viewer to hear the live audio as if the performer avatar 1 were singing in a virtual live venue.

[0150] Furthermore, as described above, in the performer terminal 200, the performer's voice (data) is transmitted to the distribution server computer 100, and as shown in Figure 10, a monitor voice generation process and a monitor voice output process are executed, so that the music voice of the played song and the performer's voice are output from speakers located in the control room, allowing an assistant operator O or the like to check the performer user's singing status, etc. in the control room.

[0151] <Viewer's viewpoint video control processing> Next, a viewer's viewpoint video control process executed in the viewer terminal 300 based on a viewer's viewpoint video control program included in the viewer's program will be described with reference to FIG.

[0152] In the viewer viewpoint video control process, first, it is determined whether or not the performer avatar 1 is currently in a flying effect period in which the performer avatar 1 is virtually flying, as shown in Fig. 20 (step S1). Whether or not the performer avatar 1 is currently in a flying effect period can be determined from effect status data indicating that the performer avatar 1 is currently in a flying effect period, which is sent from the delivery server computer 100. When the delivery server computer 100 determines that the performer avatar 1 is currently in a flying effect period based on the time schedule data, the delivery server computer 100 sends effect status data indicating that the performer avatar 1 is currently in a flying effect period to the viewer terminal 300.

[0153] If the flying effect is in progress (Y in step S1), the process proceeds to step S21. If the flying effect is not in progress (N in step S1), it is determined whether viewpoint-related operations, including viewpoint movement operations (including viewpoint changes due to avatar movement operations and motion operations) and zoom operations, are disabled (step S2).

[0154] If the viewpoint-related operation is invalid (Y in step S2), the process proceeds to step S7. If the viewpoint-related operation is not invalid (N in step S2), it is determined whether or not there is an operation that changes the viewpoint, such as an operation to move or move the avatar (step S3), and if there is an operation (Y in step S3), the viewer viewpoint is changed according to the operation, and if there is no operation (N in step S3), the process proceeds to step S5, where it is determined whether or not there is a zoom operation (step S5).

[0155] If a zoom operation is performed (Y in step S5), the image area displayed on the display device 310 is changed to an image area corresponding to the operation, and if a zoom operation is not performed (N in step S5), it is determined whether or not a motion tracking setting is present (step S7).

[0156] This motion tracking setting can be set by the viewer user at will on the viewer terminal 300, for example, before the start of a live performance or during a live performance, depending on the type of device they use for operation and their level of proficiency in operation. Specifically, this setting is set when, for example, they are not familiar with operating the operation input device 321, such as a touch panel, keyboard, or game controller, or when they are not familiar with changing the viewpoint by moving or moving the avatar, or when, as will be described later, they are unable to properly change the viewpoint in response to the movement or movement of the performer avatar 1, for example, when the virtual participation position of their own viewer avatar is far from the performer avatar 1 and the display is zoomed in, causing the performer avatar 1 to be distorted even by the slightest movement of the performer avatar 1.

[0157] If there is no motion follow-up setting (N in step S7), the process proceeds to step S11, whereas if there is a motion follow-up setting (Y in step S7), it is further determined whether the motion follow-up condition is met (step S8).

[0158] In this embodiment, the motion tracking condition is a condition under which it is almost certain that the performer avatar 1 will no longer be displayed properly on the display device 310. Specifically, if the head (or face) of the performer avatar 1 is within a specified range around the display area of ​​the display device 310, it is highly likely that the movement or motion of the performer avatar 1 will cause the head (face) to move outside the display area, causing the performer avatar 1 to no longer be displayed properly, and therefore the motion tracking condition is determined to be met.

[0159] In this way, in this embodiment, by determining that the movement tracking condition is met before the head (face) of the performer avatar 1 disappears from the display area, it is possible to significantly reduce the occurrence of the head (face) of the performer avatar 1 disappearing from the display area, but the present invention is not limited to this, and these movement tracking conditions may be the movement of the head (face) outside the display area, or other conditions may be used as the movement tracking conditions. In other words, any conditions can be used as these movement tracking conditions as long as they can prevent the performer avatar 1 from disappearing from the display area properly.

[0160] If the action tracking condition is met (Y in step S8), after disabling the viewpoint-related operation (step S12), the viewpoint image displayed in the display area of ​​the display device 310 is automatically changed to an action tracking viewpoint in which the head (face) of the performer avatar 1 is within a non-establishment range surrounded by a predetermined range around the display area, and the viewpoint image seen from the action tracking viewpoint is displayed in the display area of ​​the display device 310 (step S13).

[0161] On the other hand, if the action tracking condition is not met (N in step S8), it is further determined whether or not the viewpoint-related operation is disabled (step S9), and if the viewpoint-related operation is disabled (Y in step S9), the disabled viewpoint-related operation is enabled (step S10) and then the process proceeds to step S11, and if the viewpoint-related operation is not disabled (N in step S9), the process proceeds to step S11 without going through step S10.

[0162] In step S11, since the action tracking setting is not set or the action tracking condition is not met, the viewpoint video of the viewer avatar continues to be displayed in the display area of ​​display device 310 (step S11).

[0163] Also, as mentioned above, if the flying performance period in which the performer avatar 1 virtually flies during a live performance has arrived, the result of step S1 is judged as Y, and the process proceeds to step S21, where it is determined whether it is the start timing of the flying performance period (step S21).

[0164] If it is the start timing of the flying performance period (Y in step S21), the flying viewpoint image delivered from the delivery server computer 100 is displayed (step S22) in place of the viewer avatar viewpoint image or action-tracking viewpoint image that was displayed in the display area of ​​the display device 310 before the start of the flying performance period, and then viewpoint-related operations are disabled (step S23) and the process returns to step S1.

[0165] In this embodiment, during the flying performance period, the same flying viewpoint video is displayed on the viewer terminals 300 of all viewer users. Therefore, instead of generating the flying viewpoint video on each viewer terminal 300 side, as is the case with viewer avatar viewpoint videos that differ for each viewer user, the flying viewpoint video is generated on the distribution server computer 100 side and distributed to the viewer terminals 300. This allows the flying viewpoint video, which involves movement of the viewpoint through the air and therefore places a heavy load on the drawing of the viewpoint video, to be displayed well even on viewer terminals 300 with low processing power. However, the present invention is not limited to this, and these flying viewpoint videos may also be generated on each viewer terminal 300 side, just like viewer avatar viewpoint videos.

[0166] On the other hand, if it is not the start timing of the flying effect period (N in step S21), it is further determined whether it is the end timing of the flying effect period (step S24).

[0167] Whether or not it is the end timing of the flying performance period may be determined based on data indicating the end contained in the flying viewpoint video data transmitted from the distribution server computer 100, or may be determined based on the aforementioned performance status data that is different from the flying viewpoint video.

[0168] If it is not the end of the flying performance period (N in step S24), that is, if it is during the flying performance period, proceed to step S26, update the flying viewpoint video, and then return to step 1; on the other hand, if it is the end of the flying performance period (Y in step S24), enable viewpoint-related operations (step S25), proceed to step S11, display the viewer avatar's viewpoint video in the display area of ​​display device 310 instead of the flying viewpoint video that was displayed in the display area of ​​display device 310 during the flying performance period, and then return to step S1.

[0169] The viewpoint videos displayed on the viewer terminal 300 as a result of the viewer viewpoint video control process shown in FIG. 21 being executed in the viewer terminal 300 of this embodiment will be described with reference to FIGS. 17 to 20. FIG.

[0170] 17A and 17B are diagrams showing the display contents of the display device 310 when a zoom operation is performed on the viewer terminal 300 of this embodiment, and in the default state where no zoom operation is performed, a viewpoint video of the video area centered on the upper body of performer avatar 1 is displayed, as shown in Fig. 17A. In this default state, if the viewer user performs a zoom-in operation, for example, by touching the "+" display (not shown) if the viewer terminal 300 is a smartphone P, or by operating the "+" key on the keyboard if the viewer terminal 300 is a computer (PC), then a viewpoint video of the video area centered on the head (face) of performer avatar 1 is displayed, as shown in Fig. 17B.

[0171] On the other hand, if the viewer user performs a zoom-down operation, for example, by touching the "-" display (not shown) if the viewer terminal 300 is a smartphone P, or by operating the "-" key on the keyboard if the viewer terminal 300 is a computer (PC), a viewpoint image of the image area including the entire body of the performer avatar 1 will be displayed, as shown in Figure 17(c), for example.

[0172] In Figure 17, in order to make the zoom function easier to understand, the explanation was given using the viewpoint image of virtual camera C1 rather than the viewpoint of the viewer avatar, but as shown in Figure 18, zooming up and down can also be performed in the same way from the viewpoint of the viewer avatar.

[0173] Also, although not described in detail in the viewer viewpoint image control process of Figure 21, for example, when performer avatar 1 appears on virtual stage G for the first time when a live performance begins, the viewpoint of the viewer avatar will not be directed toward performer avatar 1, and there is a possibility that the appearing performer avatar 1 will not be displayed on the viewer terminal 300 for a long period of time.Therefore, the period when performer avatar 1 first appears may be designated as an appearance performance period, and during this performance period, the viewpoint image displayed on the viewer terminal 300 may be automatically switched to the viewpoint image of virtual camera C1, etc., rather than the viewpoint image of the viewer avatar, and individual viewer users may be able to perform zooming in, etc. on the viewpoint images of virtual camera C1.

[0174] 18 shows an example of a viewer avatar's viewpoint image, that of viewer avatar 28, who is virtually participating in area 4. As shown in FIG. 18, the viewpoint image of viewer avatar 28 includes the heads of viewer avatar 13 and viewer avatar 14, who are virtually participating in area 3, and the viewer avatar 1 is viewed through the heads of viewer avatar 13 and viewer avatar 14.

[0175] Therefore, the viewer user of viewer avatar 28 can, for example, perform a zoom-in operation to change the video area so that the upper body of performer avatar 1 is displayed in the center, as shown in Figure 18(b), thereby preventing viewer avatar 13 and viewer avatar 14 from being displayed and allowing the viewer user to enjoy the live performance.

[0176] However, in the zoomed-in state shown in Figure 18(b), for example, as the live performance progresses and the performer avatar 1 begins to move and make large movements, if the viewer user is unable to properly change the viewpoint of the viewer avatar 28 to match the movements of the performer avatar 1, the performer avatar 1 may not be displayed properly, as shown in Figures 19(d) to (f).In this case, if the viewer pays attention to adjusting the viewpoint, it may become difficult to concentrate on the live performance and they may not be able to enjoy it properly.

[0177] However, in this embodiment, when the viewer user sets the action tracking setting as described above, as shown in Figures 19(a) to (c), the action tracking condition is met when the head of the performer avatar 1 enters a specified area around the display area, the viewpoint is automatically changed to the action tracking viewpoint, and the viewpoint image of the action tracking viewpoint is displayed, so the viewer user no longer needs to pay attention to operating the viewpoint, and can concentrate on the live performance and enjoy it to the fullest.

[0178] As the live performance progresses and the flying performance period begins, as shown in Figure 20, the viewpoint images of individual viewer avatars are automatically changed to flying viewpoint images seen from a virtual camera moving in the air, without any operation by the viewer user.

[0179] Specifically, before performer avatar 1 takes to the air, an image of a wing object growing larger is displayed on the back of performer avatar 1. Then, performer avatar 1 looks up at virtual star object 50 in the air, which is virtually placed in the second area of ​​the virtual live venue, and the viewpoint of the viewer avatar moves in the same way. At this time, light effects 61 appear around performer avatar 1.

[0180] After that, when the performer avatar 1 begins virtual flight, the viewpoint image displayed on the display device 310 automatically switches from the viewpoint image of the viewer avatar up to Figure 20(b) to a flying viewpoint image seen from a virtual camera moving in the air, as shown in Figure 20(c).

[0181] During the flying performance period, the aerial moving virtual cameras move through the air within the second area based on a pre-set aerial trajectory, as described above, and the flying viewpoint images seen from these aerial moving virtual cameras are displayed on the display device 310 as shown in Figure 20(d).

[0182] The specific configuration is not limited to the above-described embodiment, and the present invention also includes modifications and additions that do not deviate from the gist of the present invention.

[0183] For example, in the above embodiment, a viewer avatar is shown to be able to move freely within the third or fourth area in which it is virtually participating. However, this may lead to problems such as errors in the virtual space data due to different viewer avatars participating in the fourth area colliding with each other virtually or overlapping in the same virtual location.

[0184] In order to solve such problems, for example, modifications shown in Figures 22 and 23 may be used. Specifically, the third and fourth areas are divided into smaller areas as shown in Figure 22, and viewer users are asked in advance before the start of the live performance which of these areas they will participate in the virtual live performance in, as shown in Figure 23. When viewer users virtually participate using viewer avatars, they are only allowed to participate in the areas selected in advance, and movement is restricted to within the selected areas, thereby preventing viewer avatars from colliding with each other virtually or overlapping in the same virtual position, which could result in errors in the virtual space data.

[0185] In addition, when, as described above, each viewer user is required to select the virtual participation position of the viewer avatar in advance, for example, for a viewer user who selects areas A1 to C6 on the right side as facing the virtual stage G in the fourth area, a viewpoint image from the front right position of the virtually flying performer avatar 1 is generated and displayed as the viewpoint image during the flying performance period; for a viewer user who selects areas D4 to H6 on the center as facing the virtual stage G in the fourth area, a viewpoint image from the front central position of the virtually flying performer avatar 1 is generated and displayed as the viewpoint image during the flying performance period; and for a viewer user who selects areas I1 to K6 on the left side as facing the virtual stage G in the fourth area, a viewpoint image from the front left position of the virtually flying performer avatar 1 is generated and displayed as the viewpoint image during the flying performance period. In this way, depending on the position selected by the viewer user, the viewpoint image during the virtual flight, which is a special action, may be a viewpoint image corresponding to the position (area) selected by each viewer user.

[0186] Furthermore, in the above embodiment, an example was given in which a viewpoint video from a viewer avatar is generated and displayed on the viewer terminal 200 side, but the present invention is not limited to this, and for example, in the case of a live event with a small number of virtual participants, the viewpoint video from the viewer avatar may also be generated and distributed on the delivery server computer 100 side. Furthermore, the viewer user may be allowed to select whether to generate the video on the viewer terminal 200 side or the delivery server computer 100 side depending on the processing capacity of the terminal he or she owns and the data communication environment, or the delivery server computer 100 may identify the processing capacity of the viewer terminal 200 with which it is connected for communication, and based on the identified processing capacity, determine whether to generate the video on the viewer terminal 200 side or the delivery server computer 100 side.

[0187] Furthermore, in the above embodiment, the distribution server computer 100 is illustrated as being installed in a studio operated by an event management organization that hosts the virtual space live event, but the present invention is not limited to this. These distribution server computers 100 may be server computers owned by a company that rents out server computers in a data center, etc., or, as described above, server computers provided by a cloud service may be used. The installation form of these server computers may be any form that provides the functions of the distribution server computer 100.

[0188] Furthermore, in the above embodiment, an example is given in which a single performer user sings and performs, but the present invention is not limited to this, and these performer users may be a group of multiple people, and when a virtual space live performance is performed by a group of multiple people, the multiple people may share one performer terminal 200, or each member of the group may be provided with a performer terminal 200. Furthermore, when the performer users are a group of multiple members, for example, a viewpoint tracking target designation process may be executed by at least one of distribution server computer 100 and viewer terminal 300, so that the viewer user can select a member to follow the viewpoint.

[0189] In addition, in the above embodiment, the singer who sings and the actor who performs the performance may be separate persons, in which case the singer's performer terminal and the actor's performer terminal may be separate, and the singer may sing in a location other than the studio where the actor performs the performance.

[0190] In addition, in the above embodiment, the Internet network is used as an example of the computer communication network connecting the distribution server computer 100, administrator terminal 150, performer terminal 200, and viewer terminal 300, but the present invention is not limited to this, and these communication networks may be composed of local area networks that allow data communication only within a specific area, or may include local area networks and local data communication as part of them.

[0191] Furthermore, in the above embodiment, the performer user sings or performs singing actions (performance actions) in real time during the distribution of the virtual space live performance, allowing the performer user to proceed with the live performance while checking the reactions of the viewer users who are virtually participating in the virtual space live performance. However, the present invention is not limited to this, and the performer user's singing or singing actions (performance actions) may be performed in advance rather than in real time, and the singing audio and singing actions (performance actions) may be recorded on the distribution server computer 100 as performer avatar information, and the recorded singing audio and singing actions (performance actions) may be played back as the live performance progresses, thereby holding a virtual space live performance.

[0192] In addition, instead of the performer user's singing and singing actions (performance), the singing and singing actions (performance actions) of a virtual performer created using computer graphics, etc., can be recorded as performer avatar information on a distribution server computer, and the recorded singing voice and singing actions (performance actions) can be played back as the live performance progresses, thereby holding a virtual space live performance.

[0193] In this way, when singing or singing actions (performance actions) are performed in advance and performer avatar information is recorded and played back on the distribution server computer 100 to distribute a virtual space live performance, the configuration of the virtual space content distribution system at the time of distribution will be composed of the distribution server computer 100, administrator terminal 150, and viewer terminal 200, and will not include performer terminal 200, which is a performer user terminal that can be used by a performer user to perform operations to operate performer avatar 1 in the virtual space.

[0194] Furthermore, in the above embodiments, the viewer terminal 300 is exemplified as a smartphone P or a computer (PC), but the present invention is not limited to this, and these computers may be portable laptops, tablet terminals, e-book readers, wearable computers, game consoles, or any other information processing device capable of outputting at least 2D video and audio.

[0195] Furthermore, in the above embodiment, an example was given of a form in which a performer user performs in a studio, including singing, but the present invention is not limited to this, and for example, a performer user may use a performer terminal 200 installed in a home or the like to appear in a virtual space live performance from their home or the like.

[0196] In the above-described embodiment, a virtual space live performance was used as an example of virtual space content, but the present invention is not limited to this. Such virtual space content may be any content that is beneficial to viewer users, such as a fan meeting where performer users gather with their fans or a talk session, and that is related to a virtual space in which performer avatar 1 and viewer avatars virtually participate.

[0197] In the above-described embodiment, the general action (first action) is an action in which the performer avatar 1 stands without moving to the virtual stage G, the special action (second action) is an action in which the performer avatar 1 performs a virtual flight, and the specific action (third action) is an action in which the performer avatar 1 moves suddenly sideways. However, the present invention is not limited to this and may be an action corresponding to the content to be distributed. For example, the general action (first action) may be an action (normal action) that the performer avatar performs for the longest period of time in the distributed content, the special action (second action) may be an action that is performed in the shortest special period of time in the distributed content or the action that is performed least frequently, and the specific action (third action) may be an action that is performed for a shorter period of time than the general action (first action) but a longer period of time than the special action, or an operation that is performed less frequently than the general action (first action) but more frequently than the special action. Note that the special action (second action) may include the specific action (third action).

[0198] In the above-described embodiment, an example was given of a form having both a function of switching to a viewpoint corresponding to a special action (second action) and a function of following a specific action (third action), but the present invention is not limited to this, and may also be a virtual space content distribution system having only one of these functions.

[0199] In the above-described embodiment, an example is given in which viewpoint switching of four virtual cameras C1 to C4 as fixedly positioned (set) virtual cameras or a virtual camera moving in the air can be performed in advance by setting and operating the administrator terminal 150, but the present invention is not limited to this, and for example, these viewpoint switching may be performed in real time by the administrator K on the administrator terminal 150 using a viewpoint switching controller or the like that constitutes the operation input device 161.

[0200] In the above-described embodiment, an example is given of using virtual cameras C1 to C4 that are fixedly placed (set) in the virtual space as virtual cameras, but the present invention is not limited to this. For example, in addition to or instead of the virtual cameras C1 to C4, a movable virtual moving camera may be placed in the virtual live venue, and the position and imaging direction of the virtual moving camera in the virtual space may be controlled by an administrator K or a cameraman or the like through operation of the administrator terminal 150, to produce an image from the viewpoint of the virtual moving camera.

[0201] In the above-described embodiment, an example is given in which a viewpoint image of the virtual camera C2 is displayed on the screen S so that the facial expression of the performer user can be detected and reflected in the facial expression of the performer avatar, but the present invention is not limited to this. For example, if the performer user has a high-performance head-mounted display with a sensor function that detects the facial expression of the performer user, the performer user may wear this high-performance head-mounted display while performing the performance, thereby improving the performer user's sense of immersion in the virtual live performance. Furthermore, if the facial expression of the performer user does not need to be reflected in detail in the facial expression of the performer avatar, the performer user may wear a normal head-mounted display while performing the performance.

[0202] In the above-described embodiment, an example was given of a form in which the viewpoint of the viewer user is changed and followed in accordance with the movements of the performer avatar, but the present invention is not limited to this, and for example, these changes and following of the viewpoint may be performed in accordance with specific effects such as smoke or fireworks (pillars of fire) devices, special lighting, or deformation of stage G, which are props on stage G.

[0203] <Event content related> (Event content summary) 13 to 23, an example of content has been described in which event content is a live event with performers held in a virtual live venue. The event content is distributed, for example, at a predetermined date and time (scheduled time on a scheduled date) according to the event data. Furthermore, a spatial area ER in which the event content is to be provided may be provided (distribution starts, opened) before the event starts, allowing viewer users to enter and participate in the virtual space in which the event is to be held. In this case, the event data may include information for specifying the date and time when the spatial area ER in which the event content is to be provided will be provided (distribution starts, opened) before the scheduled date.

[0204] The following describes an example in which, before the start of event content for a virtual live concert, such as that shown in Fig. 13, a virtual space in which the virtual live venue (event venue) shown in Fig. 13 is constructed as a predetermined type of virtual space is opened to viewer users so that they can enter and participate, thereby gradually increasing viewer users' interest in the event even before the event starts. The predetermined type of virtual space is, for example, one of the virtual spaces in the space area ER in Fig. 12. The following description uses the space area ER5 shown in Fig. 24 as an example of a predetermined type of virtual space.

[0205] FIG. 24 is an overall bird's-eye view of an event venue constructed in the spatial area ER5. In the spatial area ER5 of this embodiment, a virtual space is provided in which objects such as buildings that resemble a shrine and a town in front of the shrine are arranged, as an example. Note that the objects arranged in the spatial area ER5 are not limited to buildings that resemble a shrine, but may be objects based on various themes such as the sea, a lake, a mountain, or a school. Furthermore, the spatial area ER5 is made up of multiple areas. For example, as shown in FIG. 24(A), the spatial area ER5 is made up of an area ER51 that corresponds to a town area, an area ER52 that corresponds to a temple grounds area, and an area ER53 that corresponds to a worship hall area.

[0206] In the town area, for example, a plurality of house objects resembling private homes are arranged, and along the approach to the shrine grounds area, a plurality of exhibition areas are provided for displaying (setting up) lantern objects purchased by viewer users and the like. Lantern objects can be purchased, for example, in a lantern shop area in the town area. In addition, in the shrine grounds area, a large number of objects corresponding to the torii gates, gates, ornaments, and the like that are arranged in the grounds of a shrine are arranged, and a game area where predetermined games can be played, a fortune-telling area where fortune-telling can be done, and a plurality of exhibition areas are provided. In the worship hall area, for example, a large number of objects corresponding to the worship hall of a shrine and a stage object that serves as a virtual live venue (event venue) are arranged, and an offering area for offering money is provided, and a plurality of exhibition areas are provided.

[0207] The exhibition area is arranged with lantern objects purchased by users, lantern objects associated with the operator (administrator) (including initially set lantern objects), and lantern objects associated with special users. Special users include performer users, operator users, sponsor users who sponsor the event, and other celebrities who have been authenticated as special users by the operator (administrator). Information on these sponsor users and other celebrities is stored in the event data 111.

[0208] Furthermore, as will be described later, the lantern objects displayed in the exhibition areas are determined in advance by random drawing or the like as default lantern objects to be displayed to all users on the distribution server computer 100 side each time a switching condition is met, and are transmitted and placed on the viewer terminals 300 of users who have entered the spatial area ER5. By bringing the viewer avatar close to one of the exhibition areas, the lantern object displayed in that exhibition area can be displayed on the viewer terminal 300.

[0209] Various processes related to such spatial area ER5 (predetermined type of virtual space) and various processes related to the provision and distribution of said spatial area ER5 are performed by the distribution server computer 100, and a viewer user can enter and participate in the spatial area ER5 using a viewer terminal 300 and move a viewer avatar to display images within said spatial area ER5 on the viewer terminal 300. Hereinafter, viewer users and viewer avatars (as well as performer avatars, etc.) are also simply referred to as users and user avatars (as well as performer avatars, etc.).

[0210] FIG. 25 is an example of an image of the spatial area ER5 displayed on the display unit 310 of the viewer terminal 300. FIG. 25(A) is an example of a display image when the area ER52 (temple grounds area) of FIG. 24 is viewed obliquely from within the area ER51 (town area). FIG. 25(B) is an example of a display image when the user avatar U operated by the user is moved within the area ER52 of FIG. 24 near the boundary of the area ER53, as viewed from behind the user avatar U, and shows a daimon object 53c corresponding to the daimon gate leading from the area ER52 to the area ER53. FIG. 25(C) is an example of a display image when the user avatar U is moved below a large torii object 52t corresponding to a large torii gate in the area ER52 of FIG. 24, as viewed from behind the user avatar U, and shows the foot of the large torii object 52t and the daimon object 53c. 25(D) is an example of a display image when viewed from behind the user avatar U, in which the user avatar U is moved backward from the position shown in FIG. 25(C), and a large torii gate object 52a and a private house object 51d corresponding to a private house are shown. In this way, by entering and participating in the spatial area ER5, the user can move within the spatial area ER5 in accordance with the user's operations and view the objects and scenery within the spatial area ER5, as well as purchase objects, make offerings, and participate in a live event held in the worship hall area on a scheduled date.

[0211] 25(A) may be displayed on the display device 310 by user operation, or may be an image corresponding to the line of sight of the user avatar U as shown in Figures 25(B) to (D). Furthermore, even if an image of a bird's-eye view of the user avatar U as shown in Figures 25(B) to (D) is displayed by user operation, the user avatar U operated by the user may not be displayed, but an image seen from the viewpoint of the user avatar U may be displayed.

[0212] In this embodiment, even during the pre-scheduled period, which is the period before the scheduled date on which the event content will be provided in the spatial area ER5, the user can enter and participate (also simply referred to as entering) in the spatial area ER5. For example, even during the pre-scheduled period, when a user logs in to the virtual space ER and enters and participates in the spatial area ER5, the virtual space generation program 120 transmits data to the viewer terminal 300 for displaying an image of the generated spatial area ER5 on the display device 310 of the viewer terminal 300. The pre-scheduled period refers to the days before the scheduled date on which the event content will be provided, and may be a predetermined period (e.g., one week) before the scheduled date, or may be all days before the scheduled date. In this embodiment, the user is allowed to enter the spatial area ER5 from one week before the scheduled date.

[0213] Only users who have the right to participate in the event content provided on the scheduled date (e.g., a ticket) are permitted to enter and participate in the spatial area ER5 during the period before the scheduled date and on the scheduled date. The right to participate is granted to users, for example, by purchasing a ticket to participate by paying a fee, or by completing a specified game or mission.

[0214] The spatial area ER5, which is a predetermined type of virtual space, includes, for example, a first virtual space formed by connecting multiple areas, allowing a viewer user to seamlessly move and enter from one area to another within the multiple areas, and a second virtual space consisting only of areas that share the same display mode as the other areas. The virtual space corresponding to the spatial area ER5 in this embodiment includes, as shown in Figure 24(A), a first virtual space formed by connecting areas ER51 to ER53, allowing a user to seamlessly move and enter between area ER51 and area ER52 and between area ER52 and area ER53, and a second virtual space consisting only of area ER53' that shares the same display mode as area ER53, as shown on the right side of Figure 24(B).

[0215] Furthermore, for example, until a specific period (for example, the day before) before the scheduled date of the event content, the first virtual space shown in Figure 24(A) is provided, and after the specific period before the scheduled date of the event content and the release conditions are met, the second virtual space shown in Figure 24(B) is provided in addition to the first virtual space, and movement from some of the areas (areas ER51, ER52) among the multiple areas (areas ER51 to ER53) in the first virtual space to other areas (area ER53) is impossible (for example, the gate of the gate object 53c leading to area ER53 is closed), and a portal P is provided at a predetermined position in some of the areas (a position in front of the gate object 53c in area ER52), and by moving the user avatar U to the portal P, it becomes possible to transition to the second virtual space consisting of only area ER53', for example, via the display of a predetermined screen (for example, a black screen).

[0216] In this embodiment, event content is provided in an area ER53' that has the same display format as the area ER53. The area ER53' is an area that cannot be entered until, for example, a release condition is met. A venue similar to the virtual live venue shown in FIG. 13 is constructed in the area ER53', and objects corresponding to a virtual stage for a live event and audience seats are placed therein. During the live event, performer avatars operate on the virtual stage, and the user watches from the audience seats via the user avatar U.

[0217] Meanwhile, during a specific period before the scheduled date, for example, objects corresponding to audience seats for the live event are gradually placed in the area ER53 in the first virtual space, and objects under construction are placed on the virtual stage, thereby reflecting the gradual construction of the virtual live venue, which the user can confirm through the user avatar U. For example, every predetermined time (e.g., every 24 hours), a virtual space update data distribution process is performed to update the displayed objects. This can inform the user that the event is approaching and enhance the sense of realism and interest.

[0218] Furthermore, a user who was in the area ER53 when the release condition was met is moved out of the area ER53. For example, the user avatar U is forcibly moved to a predetermined position outside the area ER53 (for example, in front of the gate object 53c in the area ER52). After that, the user is no longer able to enter the area ER53, but can enter the area ER53' via the portal P described above.

[0219] The area ER53 and the area ER53' share the same display mode, but the space in which the user avatar U can move is limited. For example, in the area ER53, the user avatar U can move freely within the area, whereas in the area ER53', the user avatar U can only move within the audience area 53'k. This minimizes the burden on the server to the minimum processing required to provide event content. Furthermore, the area ER53 and the area ER53' can be configured to use different servers (rooms) that perform processing to build and generate each area. This allows, for example, the area ER53 and the area ER53' to be managed by a server (room) that can handle the heavy load required to provide event content. Note that users who can enter the area ER53' may be limited to users who meet certain conditions for receiving event content.

[0220] (Changes in display mode in virtual space) In this embodiment, the display mode within the spatial area ER5 may change depending on events occurring within the spatial area ER5 during the period before the scheduled date. Events occurring within the spatial area ER5 during the period before the scheduled date include, for example, the user's actions during the period before the scheduled date, the actions of other users, lotteries within the spatial area ER5, and changes to settings in the virtual space performed by the administrator. User actions (or the actions of other users) include, for example, purchasing and placing specific objects (items, lantern objects, etc.) and playing games, such as completing specific missions. Display modes within the spatial area ER5 that may change depending on events occurring within the spatial area ER5 during the period before the scheduled date include, for example, changes in the display mode of specific objects (e.g., lantern objects, exhibition areas in which lantern objects are placed, etc.) placed within the spatial area ER5 and changes in the display mode of presentations during the provision of event content.

[0221] (Changes in display mode during the period before the scheduled date due to specific object placement) 26 to 32, examples will be described below in which the display mode within the spatial area ER5 during the period before the scheduled date can be changed in response to an event in which a user purchases and places a lantern object within the spatial area ER5 during the period before the scheduled date, for example, by placing a lantern object purchased within the spatial area ER5 in the exhibition area, or by switching a lantern object purchased by another user and placed in the exhibition area to another lantern object when a switching condition is met. Note that the lantern object can also be a type of tipping item (for example, a flower stand) from a user when providing event content, and therefore will be referred to as a flower stand FS below.

[0222] A flower stand FS can be purchased, for example, at a lantern shop 51s located along the approach to the shrine in area ER51 shown in Fig. 24. The user can move the user avatar U to the lantern shop 51s or select the lantern shop 51s, and the image displayed on the viewer terminal 300 will switch from a screen displaying the image in area ER51 to a screen for purchasing a flower stand FS. Fig. 26(A) is an example of the screen displayed when purchasing a flower stand FS.

[0223] There are several types of purchasable flower stands (FS), as shown in Figures 27(A) and (B). Figure 27(A) shows a table of flower stand (FS) attributes (motifs). Attributes (motifs) include "plain," "cherry blossom," "demon," "white fox," "black fox," and "gorgeous." Each attribute has a designated motif color, and the flower stand (FS) for each attribute uses the corresponding color and features a design related to the attribute. Of the attributes, "cherry blossom," "demon," "white fox," and "black fox" are the attribute colors associated with the performer avatars that appear as characters in the event content. In other words, the purchasable flower stand (FS) are prepared to match the image motif and image color assigned to the performer avatars that appear in the event content.

[0224] Additionally, multiple sizes of flower stands are available. The sizes and prices of flower stands vary depending on the attribute. For example, for the attribute "plain," only the "small" size is available, and it costs 500 coins. For the attribute "cherry blossom," two sizes, "large" and "small," are available, with the "large" size costing 2,500 coins and the "small" size costing 500 coins. Users select one of the motifs and sizes to purchase the desired flower stand FS. For example, users can enjoy purchasing a flower stand FS that matches the attribute and color, image motif, and image color of the performer avatar they are supporting (or recommending) from among the performer avatars that appear in event content.

[0225] FIG. 27(B) is a table of flower stand FS sizes. Users can decorate their flower stand FS (generate the display mode of the flower stand FS), for example, by adding text. Font types and font colors are determined for each size of flower stand FS, and users can select them at the time of purchase. In addition, an upper limit on the number of characters that can be displayed is determined for each size of flower stand FS. For example, for the "large" size, characters can be entered in two columns, with a limit of 15 characters for each. For the "small" size, there is a limit of 10 characters.

[0226] Each size of flower stand FS has a designated area in which it can be displayed (placed). When a user displays a purchased flower stand FS in the spatial area ER5, they can select (designate) an area from among the multiple display areas provided within the spatial area ER5 in which the flower stand FS can be displayed. For example, for the "large" size, the display area can be selected from the main street (west) area 51a, the main street (east) area 51b, or the large torii area 52a (the area where the large torii object 52t is located). For the "small" size, the display area can be selected from the temple grounds (west) area 52b, the temple grounds (east) area 52c, the front of the worship hall (west) area 53a, or the front of the worship hall (east) area 53b.

[0227] The purchase screen shown in FIG. 26(A) displays an image 411 of the flower stand FS selected by the user. Detailed information 412 about the selected flower stand FS is displayed below the flower stand FS image 411. The detailed information 412 includes information about the size and attributes (motif). The user can also add text to the flower stand FS to customize it to their preferred design. In the text input area 413, the user can input text to be displayed on the flower stand FS. The input text is reflected in the flower stand FS image 411, allowing the user to confirm the image when arranged. In addition, prohibited words that are restricted from being input are set for the text that can be displayed on the flower stand FS. Prohibited words include, for example, violent language and language that violates public order and morals. If a prohibited word is entered, the purchase icon 417 is grayed out, and the purchase operation cannot be performed.

[0228] As shown in the example purchase screen in Figure 26(A), the user selects the display area for the flower stand FS by operating the placement selection area 414. In addition, the coin-related area 415 displays the number of coins the user possesses, the number of coins consumed as the purchase price of the flower stand FS, and the number of coins remaining after the purchase. The user confirms the purchase and the billing process is carried out by operating the purchase icon 417. To cancel the purchase, the user operates the close icon 416.

[0229] After a flower stand FS is purchased, the display of the flower stand FS is presented as shown in FIG. 26(B). For example, in FIG. 26(A), if a user purchases a flower stand FS1 with the attribute "cherry blossoms," a size of "small," and the character decoration "the best," FS1 is displayed in the display area where the flower stand FS1 is placed, and the flower stand FS1 is surrounded by light (displayed and highlighted in a specific manner different from other flower stands). When a user purchases a flower stand FS and specifies the display area on the viewer terminal 300 side, the distribution server computer 100 determines a display position within the specified display area by lottery or other means, stores information including the display position of the flower stand FS, and transmits information specifying the display position to the viewer terminal 300 of the user who specified the display position. The viewer terminal 300 then performs a process of replacing the flower stand displayed in the display position specified from the received information with the flower stand purchased by the user. This allows users who enter or participate in the spatial area ER5 to move to the display area of ​​the flower stand FS that they themselves have placed, motivating them to go and see their own flower stand FS. It also provides an interesting experience for users to check the text on other users' flower stands FS. Furthermore, as shown in FIG. 24(A), display areas are provided in all of the areas ER51 to ER53 that make up the spatial area ER5. This allows users who enter or participate in the spatial area ER5 to be encouraged to move to all of the areas ER51 to ER53, allowing users to enjoy the entire spatial area ER5.

[0230] Next, the process of purchasing a flower FS executed by the delivery server computer 100 will be described with reference to the flow in FIG.

[0231] In step S101, it is determined whether or not the purchase period before the scheduled date is valid. The purchase period before the scheduled date may be a period that coincides with the period before the scheduled date, or may be a portion of the period before the scheduled date. If it is determined that the purchase period before the scheduled date is not valid, the process is terminated because a purchase is not possible. For example, on the scheduled date itself, the determination in step S101 is NO, and therefore the flower stand FS cannot be purchased. For this reason, it is possible to motivate the user to purchase a flower stand FS by having them enter spatial area ER5 at least once before the day of the event.

[0232] If it is determined in step S101 that the purchase period is before the scheduled date, it is determined in step S102 whether or not a shop selection operation has been performed. A shop selection operation is, for example, an operation (such as approaching a store clerk character or selecting a predetermined icon of a shop) on a flower shop in the spatial area ER5 (such as the lantern shops 51s and 53s in FIG. 24). Specifically, in step S102, it is determined whether or not information transmitted when a shop selection operation is performed on the viewer terminal 300 has been received.

[0233] If it is determined in step S102 that a shop selection operation has been performed, information for displaying a shop screen on the display device 310 is sent to the viewer terminal 300 that originated the shop selection operation in step S103. The shop screen may be, for example, a screen displaying a product list for selecting a flower stand FS to purchase, or the flower stand FS purchase screen shown in FIG. 26(A). This allows the viewer terminal 300 to display the shop screen and select a desired flower stand FS. After outputting the information for displaying the shop screen in step S103, processing ends. Note that the flower stand FS purchase operation is not limited to within the spatial area ER5, but may also be performed from a shop displayed in another space within the virtual space ER. A purchase operation performed on a website separate from the virtual space may be reflected (made available for use and display) in the virtual space.

[0234] On the other hand, if it is determined in step S102 that a shop selection operation has not been performed, then in step S104 it is determined whether a content editing operation has been performed. A content editing operation is a decoration operation, such as adding text to a flower stand FS. Specifically, in step S104, after a flower stand FS to be purchased is selected on the viewer terminal 300, it is determined whether information for identifying the text entered into the flower stand FS as a result of a decoration operation performed on the screen shown in FIG. 26(A) is received from the viewer terminal 300. If it is determined that a content editing operation has been performed, then in step S105 it is determined whether an NG word is included. If it is not determined that an NG word is included, the process ends. On the other hand, if it is determined in step S105 that an NG word is included, then in step S106 information to that effect (that an NG word is included) and that the item cannot be purchased is sent to the viewer terminal 300 that performed the content editing operation, and the process ends. As a result, the viewer terminal 300 performs, for example, a pop-up message stating "NG word is included" or a process to prevent the purchase icon 417 from being selected.

[0235] If it is not determined in step S104 that a content editing operation has been performed, then it is determined in step 107 whether or not a purchase confirmation operation has been performed. A purchase confirmation operation is, for example, an operation on the purchase icon 417 shown in FIG. 26(A). Specifically, in step 107, it is determined whether or not information transmitted when an operation on the purchase icon 417 is performed on the viewer terminal 300, which information is used to identify the type of flower stand FS purchased, the characters entered, the selected display area, etc., has been received. If it is not determined that a purchase confirmation operation has been performed, then the process ends.

[0236] On the other hand, if it is determined in step S107 that the purchase confirmation operation has been performed, purchase processing (billing processing) is performed in step S108. After the purchase processing has been performed, in step S109, a flower stand display presentation processing is performed, and the processing ends. For example, based on the information received when the purchase confirmation operation has been performed, a display position within the selected display area is determined by lottery or the like, and the user-related information (contained in the viewer user data 133) for the flower stand FS is updated. Information for specifying the display position is sent to the viewer terminal 300 of the purchasing user, and processing is performed to cause the viewer terminal 300 of the purchasing user to perform the display presentation exemplified in FIG. 26(B). Note that the display position within the display area is not limited to being determined by lottery; it may be selected by the purchasing user, allowing the display to be performed in a preferred position.

[0237] 27(C) is an example of a table storing information about a flower stand FS purchased by a user, among the user-related information stored in the viewer user data 133. For example, information identifying the purchased flower stand FS and information about the display location of the flower stand FS within the display area specified by the user are associated with each user ID. For example, the information stored includes a "flower stand ID" for individually identifying the flower stand FS, a "purchased flower stand" that is information about the attributes and size of the purchased flower stand FS, "characters" that is information about the decoration (inputted character) performed by the user, a "user-specified area" that is information about the display area specified by the user, "position" that is information about the display location within the display area, and a "purchase date and time" that is the date and time the user purchased the flower stand. During the flower stand display and presentation process in step S109, new information about the purchased flower stand FS is stored corresponding to the user who made the purchase. Furthermore, information about the purchased flower stand FS is transmitted to the viewer terminal 300 of the user who made the purchase, and the viewer terminal 300 performs a display and presentation process to display (display) the purchased flower stand FS in place of the flower stand FS already displayed in the display location. It should be noted that when a flower stand FS is purchased, it is not limited to an exhibition performance being carried out, but instead or in addition, it may be possible to simply be notified that the purchased flower stand FS has been displayed in the selected exhibition area.

[0238] Furthermore, when a user purchases a flower stand FS, the flower stand FS already on display in the display area is replaced with the purchased flower stand FS on that user's viewer terminal 300, as described above, but the purchase does not affect the flower stand FS in the display area of ​​other users' viewer terminals 300, and the same flower stand FS as before the purchase continues to be displayed. Therefore, the flower stand FS displayed in the display area of ​​the user who purchased the flower stand FS can be different from that of other users.

[0239] In step S101, it is determined whether or not the purchase period is before the scheduled date, but the purchase may be possible at any time, not just before the scheduled date. For example, depending on the timing of when the event content related to the flower stand FS to be purchased is provided, the purchase may be possible on or after the scheduled date when the event content is provided, but if it is not during the purchase period before the scheduled date in step S101, the flower stand FS may not be used in the presentation of the event content.

[0240] Furthermore, editing of the display mode of a flower star FS (such as inserting text or editing content) may be possible not only at the time of purchase, but also after purchase. For example, after purchase, the flower star FS may be saved in the user's item box, and the user may remove it from the item box and display or edit it at their convenience. Furthermore, the font type and color may be changeable after purchase, not just at the time of purchase. In addition to text, it may also be possible to edit colors, or to add decorations, for example, to add a luxurious display mode as an option.

[0241] In the above example, the display position (for example, display positions "A1," "A2," etc. in display area A described below) within the display area selected by the user is determined by lottery or the like based on the information received when the purchase confirmation operation is performed in step S107 of Figure 28. However, this is not limiting, and for example, the flower stand FS may be displayed at a time separate from the time of purchase, and the display position may be determined at the time of display.

[0242] (Changes in display format during the period before the scheduled date due to the fulfillment of switching conditions) Next, with reference to Figures 29 to 32, the transition of lantern objects arranged in the exhibition areas (display modes of the exhibition areas) will be described. In this embodiment, lantern objects are displayed in a plurality of exhibition areas provided within area ER5 (for example, main street (west) area 51a, main street (east) area 51b, large torii area 52a, etc.). An upper limit on the number of lantern objects that can be displayed in each exhibition area is set.

[0243] As mentioned above, the exhibition area will display not only flower arrangements FS purchased by the user himself (associated with the user himself) as described above with reference to Figures 26 to 28, but also flower arrangements FS purchased by other users (associated with other users), flower arrangements FS associated with the management (administrator), and flower arrangements FS associated with special users.

[0244] In this embodiment, the display area A corresponds to, for example, the shrine grounds (west) area 52b of the region ER52 in FIG. 24, which corresponds to the shrine grounds area, and is an area in which, for example, a "small" size flower stand FS, which is a lantern object, as shown in FIG. 27(B), can be displayed. FIG. 29(A) shows a portion of the display area A, which corresponds to the shrine grounds (west) area 52b. As shown in FIG. 29(A), multiple flower stands FS, which are lantern objects, are displayed in a row and column in the display area A. FIG. 31(A) is a table included in the object data 122, and is an example of a data table relating to information for identifying the flower stands FS and their display positions within the display area A. In FIG. 31(A), each display position (A1, A2, A3, etc.) within the display area A is associated with information for identifying the flower stand FS, such as a flower stand ID and displayed text information. 29(A), and is associated with a flower stand FS with a flower stand ID of "a1," an attribute of "cherry blossom," and displaying the letter "A." Display position A2 corresponds to the position immediately to the right of display position A1 in the same row, and is associated with a flower stand FS with a flower stand ID of "b1," an attribute of "demon," and displaying the letter "B."

[0245] FIG. 31(B) is a table included in the object data 122, and is an example of a data table relating to information for identifying a flower stand FS to be placed in the exhibition area B and its display position. The exhibition area B is an area in which a "large" flower stand FS shown in FIG. 27(B) can be displayed, and corresponds, for example, to the location of the large torii object 52t in the area ER52 (large torii area 52a). In FIG. 31(B), as in FIG. 31(A), each display position (B1, B2, B3, ...) within the exhibition area B is associated with information for identifying the flower stand FS, such as a flower stand ID and character information to be displayed. For example, a flower stand FS with a flower stand ID of "a1" and displaying the "letter A" is associated with the position corresponding to the exhibition position B1. A flower stand FS with a flower stand ID of "b1" and displaying the "letter B" is associated with the position corresponding to the exhibition position B2.

[0246] 31(A) and 31(B), the information on the flower stand FS associated with each exhibition area is switched to the information on another flower stand FS determined by random lottery or the like whenever a switching condition is met. The switching condition for the flower stand FS information for each exhibition area may include, for example, a condition that is met when a predetermined time has passed (e.g., every 30 minutes or every 2 hours), when a user enters or leaves the virtual space (e.g., logging in or re-logging in), or when the user reloads the display data (e.g., a reload operation, or when the user avatar U's viewpoint leaves a predetermined exhibition area and then returns to that exhibition area). The probability of winning an exhibition through random lottery is uniformly determined for each flower stand FS, but the probability is not limited to this and may vary depending on the characteristics of each flower stand FS, as will be described later.

[0247] Each time a switching condition is met, the distribution server computer 100 determines the flower stand FS to be displayed for each exhibition area, updates the table for each exhibition area (see, for example, Figures 31(A) and (B)) stored as object data 122 (sets this as a default common to all users), and transmits information for identifying the flower stand FS for each exhibition area to the viewer terminal 300 of the user who has entered the spatial area ER5. This allows the viewer terminal 300 to switch and display the flower stand FS for each exhibition area (flower stands FS of other users, etc., excluding the user's own flower stand FS) with another flower stand FS. Note that the switching of flower stands FS is performed up to the maximum number that can be displayed for each exhibition area. For example, if the maximum number of flower stands FS that can be displayed in exhibition area A is 100, the information on the flower stand FS for exhibition area A stored as object data 122 shown in Figure 31(A) is updated by randomly selecting 100 flower stands FS or the like each time a switching condition is met, and the information is switched to the data of the selected flower stand FS. Also, for example, when the display area is opened, the display area A, which can display 100 flower stands FS, may initially have 10 flower stands FS placed therein, and as users purchase and display them, the number may gradually increase to 100. The time when the display area is opened may be, for example, when a user purchases a flower stand FS and is able to display it in the display area. In this case, the random drawing may be held after the upper limit has been reached.

[0248] As mentioned above, the information about the flower stand FS placed in the virtual space changes each time a switching condition is met, but a flower stand FS purchased by a user himself can continue to be displayed in the exhibition area in the virtual space based on the information managed in FIG. 27(C). For example, FIG. 29 shows an example of the transition in the display mode of a flower stand FS in exhibition area A displayed on user 1's display device 310 when user 1 purchases a new flower stand FS. FIG. 30 shows an example of the transition in the display mode of a flower stand FS in exhibition area A (the same display position as shown in FIG. 29) displayed on user 2's display device 310 when user 1 purchases a new flower stand FS. FIGS. 29(A) and 30(A) show display examples in which a flower stand FS determined as the default for exhibition area A and identified from the flower stand placement information in FIG. 31(A) is placed. 29(A) and 30(A), the explanation will be given assuming that the flower stands FS purchased by neither user 1 nor user 2 are displayed in the display area A.

[0249] Figures 29(B) and 30(B) are display examples at the time when user 1 newly purchases flower stand FS1. The flower stand FS1 purchased by user 1 has the attribute "cherry blossoms" of flower stand ID "a3" shown in Figure 27(C), the size is "small", and the entered characters are "the best". Furthermore, user 1 selected "A" as the display area when purchasing, and the location "A1" within the display area is assumed to be associated with the flower stand FS1.

[0250] When user 1 purchases flower stand FS1, information about the purchased flower stand is distributed to user 1, and user 1's viewer terminal 300 switches the display of the flower stand FS placed at display position A1 in display area A to the flower stand FS1 purchased by user 1. Meanwhile, user 2's display device 301 continues to display the same flower stand FS as in Fig. 30(A), as shown in Fig. 30(B).

[0251] 29(C) and 30(C) are display examples when a predetermined time has elapsed since the previous switching and the switching condition has been met. On user 1's display device 301, as shown in FIG. 29(C), the flower stand FS1 that user 1 himself purchased and that is displayed in exhibition area A1 continues to be displayed in the same position as in FIG. 29(B), but the other flower stands FS have been switched to flower stands FS determined by lottery in response to the fulfillment of the switching condition. The other flower stands FS are flower stands FS that are not associated with user 1, but are associated with other users, etc. Note that the other flower stands FS may include flower stands FS prepared by the management that are not associated with any other users.

[0252] On the other hand, on user 2's display device 310, the display has been switched to a flower stand FS determined by lottery in response to the establishment of the switching condition, as shown in Figure 30(C). Figure 30(C) differs from user 1's Figure 29(C) in that a flower stand FS different from the flower stand FS1 associated with user 1 is displayed at display position A1 in exhibition area A, and a common flower stand FS based on the default data stored in object data 122 is displayed at all display positions within exhibition area A, including display position A1.

[0253] 29(D) and 30(D) show examples of the display when the switching conditions are met again after a predetermined time has elapsed and the flower stand FS in exhibition area A is switched. At this switching timing, the object data 122 for exhibition area A determined by lottery and stored happens to include the flower stand FS1 purchased by user 1, and its display position is A6 (the second position from the left on the bottom row in FIGS. 29(D) and 30(D)). In this case, for user 2, user 1's flower stand FS1 is displayed in A6 based on the default data, as shown in FIG. 30(D).

[0254] On the other hand, as shown in FIG. 29(D), the display device 310 of user 1 continues to display the flower FS1 at location A1 based on FIG. 27(C). That is, even if the object data 122 for the same display area includes the flower FS1 purchased by user 1, the viewer terminal 300 of user 1 switches to place the flower FS1 purchased by user 1 in the display position based on FIG. 27(C). Furthermore, the viewer terminal 300 of user 1 performs a process of replacing the flower FS (default flower FS) based on the object data 122 that was placed in the display position (A1) of the flower FS1 purchased by user 1 with the flower FS1 purchased by user 1 based on the object data 122. As a result, in place of the flower FS1, the flower FS (flower FS with the "letter O") that was associated with A1 by the default data is displayed at A6 of user 1. This prevents multiple identical flower FSs from being placed in the same display area.

[0255] Even if the object data 122 for the same display area includes a flower stand FS purchased by user 1, only the switching process for placing the flower stand FS purchased by user 1 in the display position based on Fig. 27(C) may be performed, and the flower stand FS purchased by user 1 based on the object data 122 may also be displayed as is. In this case, the user may feel a sense of exclusivity because multiple identical flower stands FS for user 1 are displayed.

[0256] 29 has been described as an example in which the flower stand FS1 purchased by user 1 is displayed fixed at position A1 within the display area A. However, this is not limiting, and the display position of the purchased flower stand FS may be switched within the display area A arranged by the user each time a switching condition is met. For example, at the timing shown in FIG. 29(C), the flower stand FS1 purchased by user 1 is displayed at position A1, but at the next switching timing, it may be displayed at position A4, which corresponds to the upper right of the display area A, and default data (data of the flower stand FS associated with A1 in FIG. 31(A)) may be displayed at A1.

[0257] Next, the switching process of the flower FS displayed in the exhibition area in the virtual space executed by the virtual space generating program 120 will be described with reference to FIG.

[0258] In step S201, it is determined whether or not the displayable period is before the scheduled date. The displayable period may be a period that matches the period before the scheduled date, or may be a part of the period before the scheduled date. If it is not determined that the displayable period is before the scheduled date, the switching process is terminated.

[0259] On the other hand, if it is determined in step S201 that the display period is before the scheduled date, it is determined in step S202 whether or not the switching condition is met. The switching condition in step S202 is, for example, when a predetermined time has elapsed (e.g., 30 minutes or 2 hours). If it is determined in step S202 that the switching condition is met, in step S203, a flower stand to be displayed in each exhibition area is randomly selected from all the flower stands FS that are the subject of the lottery, and the flower stand arrangement information (e.g., Figures 31(A) and 31(B)) for each exhibition area as object data 122 is updated. The updated flower stand arrangement information (including information identifying the flower stand FS (e.g., information identifying the display mode of the flower stand to be displayed on the viewer terminal)) is transmitted to the viewer terminal 300 of the user who has entered and is participating in the spatial area ER5. For example, in the case of exhibition area A, the flower stand arrangement information for exhibition area A shown in FIG. 31(A) is updated to the information of the randomly selected flower stand FS, and the updated information is stored in the database that stores object data 122. The updated flower arrangement information is sent from the database storing the object data 122 to the user's viewer terminal 300. This updates the information on the flower arrangement FS for each default exhibition area, and enables the flower arrangements for each exhibition area to be switched and displayed on the viewer terminal 300 of the user who has entered and is participating in the spatial area ER5.

[0260] The flower stands FS to be selected by lottery may be all flower stands FS stored as object data 122, excluding NG flower stands (for example, flower stands that have been set to be hidden by the administrator due to a report, etc.), or the flower stands FS may be divided into predetermined groups, and the flower stands FS selected by lottery from within the predetermined groups. For example, the groups may be divided by the time of purchase, the type of flower stand, etc.

[0261] On the other hand, if it is not determined in step S202 that the switching condition is met, it is determined in step S204 whether or not a new user has entered the spatial area ER5.

[0262] If it is not determined in step S204 that a new user has entered the room, the process ends. On the other hand, if it is determined in step S204 that a new user has entered the room, then in step S205, flower arrangement information for each exhibition area is sent to the viewer terminal 300 of that user. This allows the user to receive information for specifying the default flower arrangement FS determined for each exhibition area. For example, flower arrangement information for a predetermined range of exhibition areas including exhibition area A updated in step S203 is sent.

[0263] In step S206, it is determined whether the newly entering user has purchased a flower stand FS based on the information related to the purchased flower stand shown in FIG. 27(C). If it is determined that the newly entering user has purchased a flower stand FS, in step S207, purchased flower stand information for identifying the purchased flower stand FS, as well as information on the display location determined at the time of purchase, are transmitted to the viewer terminal 300 of that user. The purchased flower stand information is information on the flower stand FS purchased by each user, as shown in FIG. 27(C). For example, when processing user 1, if the timing for display area A is as shown in FIG. 29(C), the default data for display area A at the time of FIG. 29(C) is transmitted in step S205. Furthermore, in step S207, the purchased flower stand information for user 1 shown in FIG. 27(C) (flower stand ID "a3") and the display location information determined at the time of purchase ("A1", which is the placement information for "a3") are transmitted. As a result, as shown in FIG. 29(C), a flower stand FS1 with a flower stand ID "a3" is displayed at display position A1, and default flower stands FS are displayed at other display positions within display area A.

[0264] In step S201, an example has been described in which it is determined whether or not it is a displayable period before the scheduled date, but the present invention is not limited to this, and it may not be determined whether or not it is a displayable period before the scheduled date. For example, it may be applied to a spatial area ER in which a specific object can be placed, regardless of the date on which the event content is provided (for example, the date of a live performance).

[0265] In step S203, the example has been described in which the flower arrangement information is updated when the switching condition is met, and the updated flower arrangement information is transmitted to users who have entered and participated in the spatial area ER5. However, step S203 is not limited to this. It is also possible to perform only the process of updating the flower arrangement information when the switching condition is met, without transmitting the updated flower arrangement information to users who have entered and participated in the spatial area ER5. That is, the flower arrangement may not be switched in the viewer terminal 300 of a user who has already entered and participated when the switching condition is met. In step S203, the flower arrangement information may be updated when the switching condition is met, and the updated flower arrangement information may be transmitted only to users who have entered and participated in the spatial area ER5 and who meet a predetermined requirement. The predetermined requirement may be met, for example, when a longer time than the time required to meet the switching condition has elapsed since the user entered and participated, or when the user's individual settings allow switching when the switching condition is met. In addition, even if a user does not receive updated cluster placement information in step S203, when the user re-enters the room, the processing from step S205 onwards will be carried out and the latest cluster placement information (updated in step S203) will be sent.

[0266] 29 to 32, an example has been described in which, even if the switching condition is met, the flower arrangement FS purchased by the user himself continues to be displayed, while the flower arrangement FS associated with another user is switched and displayed. However, even if the flower arrangement FS is associated with another user, if the other user is a special user, the flower arrangement FS associated with the special user may continue to be displayed. As mentioned above, special users include performer users, sponsor users who sponsor events, and other celebrities, and users who are authenticated as special users by the management (administrator) side.

[0267] Next, a switching process 2 for the flower FS displayed in the exhibition area in the virtual space, which is executed by the virtual space generating program 120, will be described with reference to FIG.

[0268] FIG. 33 shows an example of the above-described flower arrangement switching process, in which processing is added when the desired information on the flower arrangement FS cannot be read from the database storing the information on the flower arrangement FS (the information on the flower arrangement FS cannot be identified). In this embodiment, a large number of flower arrangements are displayed, and each display mode may differ. In the flower arrangement switching process, information read from a database (e.g., a database server) storing information on many flower arrangement FSs is transmitted (distributed) to each user who enters the room. Therefore, when many users enter the room at once, the load on the distribution server computer 100 increases because the flower arrangement switching process must be performed for all users. For example, if access to the database server storing the flower arrangement FS information is concentrated, the database server may be overloaded, and the flower arrangement information may not be read. This could result in the information required to display the virtual space not being transmitted (distributed) to the login source (the viewer terminal of the user who has entered or participated in the virtual space), which could result in problems such as an inability to enter the room at all.

[0269] On the other hand, while the flower stands in the exhibition area are objects that enhance the virtual space, they are not essential objects for generating the virtual space (for example, objects that may cause a user to feel uncomfortable if they are missing depending on the content provided, such as the buildings and stage objects shown in FIG. 24, or objects that form the basis of the virtual space). If the data of essential objects cannot be read and transmitted (delivered), the virtual space itself cannot be generated and displayed (the content provided in the virtual space cannot be realized). However, even if the flower stands in the exhibition area cannot be displayed accurately, the virtual space itself can be generated and displayed. In other words, when the data of objects (first type objects) that are essential for generating the virtual space can be identified (read and transmitted / received), the virtual space can be generated and displayed regardless of whether the data of objects (second type objects) such as flower stands that are not essential for generating the virtual space have been identified. Furthermore, as described in steps S202 to S205 of FIG. 32, the flower stands in the exhibition area are updated and displayed with accurate flower stands each time the switching condition is met. In other words, if users can enter the virtual space, the flower arrangements in the exhibition area can be updated regularly, so the impact of a malfunction on both users and operators is greater if users are unable to enter the exhibition area due to this than if the flower arrangements in the exhibition area cannot be displayed accurately for a short period of time.

[0270] Therefore, in the cluster switching process 2 of this embodiment, the processes of steps S225 to S245 are performed following the process of step S215. Note that in Fig. 33, the processes within the dotted line box have been added to the processes in Fig. 32 described above. The same step numbers are used to describe the same processes as in Fig. 32, and the description will be simplified (or omitted). Furthermore, steps S213 and S223 in Fig. 33 more specifically describe the process in step S203 in Fig. 32, and steps S215 to S245 in Fig. 33 more specifically describe the process up to sending cluster arrangement information to the user in step S205 in Figs. 32 and 33.

[0271] If it is determined in step S202 that the switching condition is met, then in step S213, a flower stand to be displayed in each exhibition area is randomly selected from all the flower stands FS that are the subject of the lottery, and the flower stand placement information for each exhibition area (e.g., Figures 31(A), (B)) in the object data 122 is updated and stored. For example, in the case of exhibition area A, the flower stand placement information for exhibition area A shown in Figure 31(A) is updated to the information of the randomly selected flower stand FS and stored in the database that stores object data 122.

[0272] In step S214, the updated flower arrangement information (including information specifying the flower arrangement FS (such as information specifying the display mode of the flower arrangement to be displayed on the viewer terminal)) is read from the database that stores the updated flower arrangement information and sent to the viewer terminal 300 of the user who has entered and is participating in the spatial area ER5. This updates the information for the flower arrangement FS for each default exhibition area, and makes it possible to switch between and display the flower arrangements for each exhibition area on the viewer terminal 300 of the user who has entered and is participating in the spatial area ER5.

[0273] In step S204, it is determined whether a new user has entered the room. If it is not determined that a new user has entered the room, the process ends as in FIG. 32. On the other hand, if it is determined in step S204 that a new user has entered the room, in step S215, the updated flower arrangement information for each exhibition area (including information specifying the flower arrangement FS (such as information specifying the display mode of the flower arrangement to be displayed on the viewer terminal)) is read out. For example, the distribution server computer 100 performs a process of reading the flower arrangement information updated in step S213 and transmitted to the user who has entered and participated in step S223 from a database in which the information on the updated flower arrangement FS is stored as object data 122.

[0274] The range of flower FS information that the distribution server computer 100 reads from the database storing flower FS information (including placement information) as object data 122 in steps S223 and S215 may be, for example, flower placement information that can be displayed in all exhibition areas of the virtual space the user has entered (e.g., within spatial area ER5), or flower placement information that can be displayed in a portion of the exhibition area of ​​the virtual space the user has entered. The portion may be, for example, flower placement information for an exhibition area within a section in which the user avatar U is located within the area of ​​the virtual space the user has entered (e.g., an exhibition area within a section such as area ER51 or area ER52 in FIG. 24), or flower placement information for a range that can be displayed on the user screen as the user avatar U moves (e.g., an exhibition area within a predetermined 360-degree distance from the position of the user avatar U).

[0275] In step S225, it is determined whether all the flower arrangement information has been read. The state in which all the flower arrangement information has been read includes, for example, a state in which information specifying the flower arrangement FS to be read from the database is accurately returned from the database. If it is determined in step S225 that all the flower arrangement information has been read, the flower arrangement information for each exhibition area read in step S205 is sent to the viewer terminal 300 of the user.

[0276] On the other hand, if it is not determined in step S225 that all of the cluster arrangement information has been read, then in step S235 it is determined whether a predetermined time (e.g., 100 ms) has elapsed since reading in step S215 began. If it is not determined in step S235 that the predetermined time has elapsed, the process proceeds to step S215, where reading of the cluster arrangement information that has not been read (clusters to be placed in missing locations) continues, and then the process proceeds again to step S215. The determination of whether the predetermined time has elapsed may be made, for example, by the AP server starting a process to read cluster FS information from the database server and waiting for a response from the database server, or by determining whether a predetermined time has elapsed since the database server started a process to identify cluster FS information to be returned as cluster arrangement information, and returning information for which the predetermined time has elapsed (e.g., information that could not be identified) to the AP server.

[0277] On the other hand, if it is determined in step S235 that the predetermined time has elapsed, a predetermined substitute flower is identified in step S245 to be placed in the missing portion that could not be read. Once a flower is identified in step S245 to be placed in the missing portion, the process proceeds to step S205, where flower placement information for each exhibition area is transmitted to the viewer terminal 300 of that user. The substitute flower is information that requires a lighter processing load to be identified by the distribution server computer 100 than reading the flower placement information updated in step S213. For example, in a storage area (or previously updated cluster arrangement information temporarily stored as a cache) different from the database from which the cluster FS is read in steps S223, S215, etc. in storage 103 of distribution server computer 100, the cluster FS may be a cluster FS that is not updated (not displayed) when a switching condition is met, such as a cluster FS displayed in the form of a simple cluster FS (for example, a plain one) or a cluster FS predetermined by the administrator, but is not limited to this. The cluster FS may be a predetermined cluster FS among cluster FS that can be updated (displayed) when a switching condition is met, or a cluster FS included in the cluster arrangement information that has already been read. In step S235, if the desired cluster arrangement information cannot be read (identified) due to a load on the database, etc., information for displaying an alternative cluster FS that requires less processing to identify, in place of the data that could not be read, is distributed to viewer terminal 300.

[0278] Furthermore, if only a portion of the information in the flower FS that was read in step S215 was successfully read, steps S245 and S205 will supplement the missing portion excluding the portion that was successfully read. For example, if information on exhibition areas A and B was read, but only the information on exhibition area A was successfully read, processing will be performed to supplement the information on exhibition area B. Note that even if only a portion of the information in the flower FS that was read in step S225 was successfully read, all of it may be replaced with information on a substitute flower FS in step S245.

[0279] This allows the user to receive information on a flower FS that replaces the information on the flower FS of the default flower FS that could not be read due to a load on the database. This avoids problems such as being unable to enter a room because information for displaying the virtual space cannot be received. Specifically, a display priority is set for objects that can be displayed, and as long as a high-priority object that is essential for realizing the content provided by the virtual space is received, the virtual space is displayed regardless of whether or not a non-essential, low-priority object is received correctly. Furthermore, when data for a non-essential, low-priority object can be identified, the object is displayed in a display mode based on that data, while when data cannot be identified, a substitute object corresponding to the object is displayed.

[0280] FIG. 34 shows an example of the display example of display screen 310 for user 1 in FIG. 29, with a flower stand FST associated with a special user arranged in exhibition area A. The flower stand FST is a flower stand FS associated with a talent user related to the attribute "black fox," and is, for example, a special flower stand FST prepared or purchased by the special user. At the time shown in FIG. 34(A), the flower stand FST of the special user is displayed by default in exhibition position A4 in the upper right corner of exhibition area A. The flower stand FST prepared or purchased by the special user is displayed in the exhibition area, and even if the switching condition is met, the flower stand placement information of that flower stand FST will not be switched to another flower stand.

[0281] Next, in Figure 34(B), when user 1 purchases a flower stand FS1, the flower stand FS1 purchased by user 1 is displayed in display position A1 in display area A. When a user purchases a flower stand FS, as mentioned above, a display area is selected and the display position within that display area is determined, but as mentioned above, display positions where flower stands of special users are displayed are excluded from the display positions to be determined. This prevents a flower stand from being determined as a display position for a special user's flower stand, even if the user purchases one.

[0282] After that, even after the switching timing when the switching condition in Figure 34(C) is met, the special user's flower stand FST continues to be displayed in display position A4 in addition to the flower stand FS1 purchased by user 1. Similarly, at the next switching timing in Figure 34(D), the flower stand FS1 and flower stand FST continue to be displayed.

[0283] In addition, within the spatial area ER5, there may be an exhibition area (special exhibition area) where all the flower stands FS displayed are those of special users, or there may be a single area where the flower stands FS of special users are displayed individually as objects or photo spots. Furthermore, the flower stands displayed in the special exhibition area or single area may be switched from among the flower stands FS associated with the special user to flower stands FS associated with another special user when a switching condition is met.

[0284] In this embodiment, a user can purchase and own multiple flower stands FS (specific objects). Therefore, the more flower stands FS a user purchases, the higher the probability that one of them will be selected as the default flower stand FS when the switching condition is met, and the higher the probability that it will be displayed in the spatial area ER5 of another user's viewer terminal 300. For example, as shown in FIG. 27(C), user 1 owns three flower stands FS, while user 2 owns only one. Therefore, if the lottery is conducted at a uniform probability, the probability that one of user 1's flower stands FS will be selected as the default flower stand FS is three times higher than the probability that user 2's flower stand FS will be selected. This can motivate users to purchase more flower stands FS in order to appeal to other users.

[0285] On the other hand, even if a certain user owns a huge number of flower stands FS (for example, 10,000), if the greater the number owned, the more likely it is to be selected as the default flower stand FS, as described above, the probability that the flower stands FS of that user who owns a huge number of flower stands FS will be selected as the default flower stand FS and displayed will be extremely high, which could result in the display appearance of the flower stands FS displayed in the display areas of other users becoming less appealing, or being abused, or causing discomfort to other users. To prevent these problems, in this embodiment, for users who have purchased and owned a predetermined number of flower stands FS (for example, 100), the number of flower stands FS that they have purchased and owned is considered to be the predetermined number, regardless of whether the user is a user with more than the predetermined number, and a default flower stand FS is selected at the same rate (probability) as a user who has purchased and owned the predetermined number of flower stands FS. For example, if the predetermined number is 100, the percentage of a user who has purchased and owned 100 or more flower stems FS that will be determined as the default flower stem FS will be the same as the percentage of a user who has purchased and owned 100 flower stems FS that will be determined as the default flower stem FS, even if the actual number owned is 1,000, 10,000, etc. This makes it possible to prevent too many flower stems FS of a particular user from being displayed in the display area of ​​other users' display devices 300.

[0286] (Changes in display mode during event content provision) In this embodiment, while the event content is being provided on the scheduled date, the flower stand FS purchased by the user during the period before the scheduled date is displayed in the virtual space. Furthermore, the image (display mode) within the live event area ER53', which is the event content, changes depending on the event that occurs within the spatial area ER5 during the period before the scheduled date. An example of an event that occurs within the spatial area ER5 during the period before the scheduled date is when a user purchases a flower stand FS and displays and places it in the display area within the spatial area ER5. Hereinafter, changes in the display mode of the virtual space while the event content is being provided will be described with reference to FIGS. 35 to 37.

[0287] FIG. 35 shows an example of a scene from an event content (for example, a live concert in which the same types of performances as those in FIGS. 13 to 24 are performed) provided in the worship hall of the area ER53' in FIG. 24, which functions as the virtual stage G. The virtual stage G in FIG. 35 will hereinafter be referred to as virtual stage G2. Performer avatars 1a to 1d appear on the virtual stage G2. The performer avatars 1a to 1d are associated with the attributes "cherry blossom," "demon," "white fox," and "black fox," respectively. These attributes correspond to the attributes associated with the flower stand FS shown in FIG. 27(A).

[0288] While the event content is being provided, as shown in Fig. 35, a presentation is given in which performer avatars 1a to 1d hold and introduce a flower stand FS. In this embodiment, if a viewing user has purchased a flower stand FS during the period before the scheduled date, a presentation is given in which performer avatars 1a to 1d hold the flower stand FS purchased by that user. Fig. 36 is an example of a data table for identifying a flower stand FS used in the presentation of the event content of Fig. 35. Fig. 36(A) shows default event flower stand information common to all users, which is managed in the delivery server computer 100 (e.g., gift data 134, etc.). The flower stand FS displayed on each user's display device 310 while the event content is being provided is identified based on the event flower stand information in Fig. 36(A) and the purchased flower stand-related information for each user in Fig. 27(C).

[0289] In this embodiment, a total of nine flower stands FS are used to produce the event content: flower stands FS with the attributes "cherry blossom," "demon," "white fox," and "black fox" in sizes "large" and "small," as well as a flower stand FS with the attribute "gorgeous." The default flower stand FS shown in FIG. 36(A) is determined by random drawing for each attribute and size from among the flower stands FS purchased by any user during the pre-scheduled period between the end of the pre-scheduled period and the start of the event content. As shown in FIG. 36(A), information identifying the default flower stand FS used in the production is associated with each attribute and size of the flower stand FS. For example, a flower stand FS with the attribute "cherry blossom" and a size "large" is associated with a flower stand FS with a flower stand ID "a4" and characters displayed in "character A4." Note that not all types of flower stands FS available for purchase before the pre-scheduled date shown in FIG. 27(A) may be used in the production of the event content; only some of them may be used. For example, in this embodiment, the attribute "plain" is not used in the production of the event content.

[0290] The distribution server computer 100 transmits the event flower information of FIG. 36(A) and purchased flower-related information for each user of FIG. 27(C) to the viewer terminals 300 of participating users at the start of the event content (at login) or at a predetermined timing during the content provision.

[0291] In each user's viewer terminal 300, among the flowers identified from the received event flower information, those having the same attributes and sizes as the flowers identified from the user's purchased flower information are replaced with the flowers identified from the user's purchased flower information, and the event flower data shown in FIG. 36(B) is updated. In this embodiment, if a user has purchased and owns multiple flower FSs with the same attributes and sizes, the last (most recently purchased) flower FS is set as the event flower information (associated with the table). As shown in FIG. 27(C), user 1 owns one flower FS with the attribute "cherry blossom" and size "small," which is the flower ID "a3." Therefore, while the flower FS with the attribute "cherry blossom" and size "small" was associated with the flower ID "b4" by default in FIG. 36(A), "a3" is now associated with user 1's event flower information, as shown in FIG. 36(B). Furthermore, as shown in Figure 27(C), user 1 owns two flower stands FS with the attribute "luxurious," with flower stand IDs "b3" and "c3." Since "c3" was purchased later than "b3" and "c3," "c3" is associated with the attribute "luxurious" in Figure 36(B). As a result, for users who did not purchase a flower stand in the period before the scheduled date, the default event flower stand information is maintained, and for users who did purchase a flower stand in the period before the scheduled date, the default event flower stand information is updated to include a flower stand with the same attribute and size as the purchased flower stand.

[0292] Based on the set event flower arrangement information, the viewer terminal 300 of each user performs a presentation of the event content while it is being provided, as shown in FIG. 35. FIG. 35 shows an example of a display mode displayed on the display device 310 of user 1, which is displayed based on the event flower arrangement information stored in FIG. 36(B). FIG. 35(A) shows an example in which performer avatars 1a to 1d each have a flower arrangement FS of size "small" with an attribute corresponding to their respective attributes. The flower arrangement FS held by performer avatar 1a is a flower arrangement FS1 with a flower arrangement ID "a3" purchased by user 1. In addition, a flower arrangement FS with the attribute "gorgeous" is displayed in the center of FIG. 35(A), and a flower arrangement FS2 with a flower arrangement ID "c3" last purchased by user 1 is also displayed. In addition, in FIG. 35(B), performer avatars 1b and 1c each have a flower arrangement FS of size "large" with an attribute "demon." Since User 1 has not purchased a flower stand FS with the attribute "demon" and size "large," the flower stand FS with the default flower stand ID "g4" shown in Fig. 36(A) is displayed. Note that the display format of the virtual live venue is not limited to the set shown in Fig. 35, and various objects may be displayed.

[0293] 35 is achieved by transmitting, from the distribution server computer 100, production information including, for example, information for controlling the display behavior of the performer avatars 1a-1d and information for specifying the attributes and size of a flower stand to be held in the hand of each of the performer avatars 1a-1d or displayed in a predetermined location in the virtual space (hanging from the ceiling). Based on the production information, the viewer terminal 300 of each user controls the display mode in the virtual space including the performer avatars 1a-1d, and arranges a flower stand that matches the information for specifying the attribute and size of the flower stand from among the flower stands FS specified from the event flower stand information (see FIG. 36(B)) updated in each viewer terminal 300, thereby enabling the production illustrated in FIG.

[0294] Next, with reference to Fig. 37(A), the event flower arrangement determination process executed in the distribution server computer 100 will be described. In step S301, the flower arrangements to be used in the presentation of the event content are determined by random drawing for each of the flower arrangement attributes and sizes described above. In step S302, event display flower arrangement information (see Fig. 36(A)) that can identify the determination result is transmitted to the viewer terminal 300. For example, as shown in Fig. 36(A), event flower arrangement information that associates and stores information that identifies the flower arrangement FS determined by lottery for each attribute and size is transmitted to the viewer terminal 300 of a user who will be participating or is currently participating in the event content.

[0295] In step S303, based on the purchased flower stem related information for each user shown in Figure 27 (C), for users who have purchased flower stems, the purchased flower stem related information for each user is sent to each user's viewer terminal 300, and the event flower stem determination process is terminated.

[0296] Next, the event flasher identification process executed in the viewer terminal 300 will be described with reference to FIG.

[0297] In step S311, the event flower arrangement information (see FIG. 36(A)) transmitted and received from the delivery server computer 100 in step S302 of FIG. 37(A) is stored as default data for specifying a default flower arrangement FS to be used in the performance. In step S312, it is determined whether or not purchased flower arrangement related information (information about the user in FIG. 27(C) transmitted from the delivery server computer 100 in step S303 of FIG. 37(A)) has been received. If it is not determined in step S312 that purchased flower arrangement related information has been received, the event flower arrangement determination process ends.

[0298] On the other hand, if it is determined in step S312 that purchased flower stem related information has been received, then in step S313, information for identifying the flower stem FS purchased by the user for each attribute and size is stored as update data based on the received purchased flower stem related information. At this time, if multiple flowers with the same attribute and size are identified, the most recently purchased flower stem with that attribute and size is identified and stored based on the purchase date and time.

[0299] In step S314, for those clusters identified from the default data that have the same attributes and size as those identified from the update data, the information on the cluster to be used for the performance is rewritten to the cluster identified from the update data.

[0300] As described above, for a user who has already purchased a flower stand FS, the flower stand purchased by the user can be displayed in association with the performer avatar for the event display flower stand. Furthermore, in this embodiment, if there are multiple flower stands with the same attributes and size as the purchased flower stand, the most recently purchased flower stand FS is displayed, making it possible to display a more elaborate flower stand FS created by the scheduled date for the event content to be provided. Note that the flower stand FS to be used for the presentation is not limited to one that replaces the most recently purchased flower stand FS, and a flower stand with the same attributes and size may be selected by lottery.

[0301] 37(A) has been described as an example in which the event flower arrangement determination process is determined and stored in advance before the event content is provided, but is not limited to this. The process may be executed, for example, every predetermined time (e.g., every 10 minutes) while the event content is being provided to update the event flower arrangement information. Alternatively, if a singing part and an MC part are repeated while the event content is being provided, the event flower arrangement information for each part may be updated before the start of the next part. While the event content is being provided, the display mode of the presentation may be changed based on the event flower arrangement information updated while the event content is being provided.

[0302] Note that the flower stand FS to be selected by lottery, determined as the event flower stand information shown in Fig. 36(A), may exclude flower stand FS associated with special users. This allows the flower stand FS to be selected by lottery from among flower stand FS associated with fan users (general users) of the performer avatar, for example, and increases the consistency between the displayed flower stand FS and messages to fans, such as "Thank you for your support flower stand!", when presenting the event content.

[0303] (Regarding processing related to event content) The above describes an example in which the display mode within the spatial area ER5 can change depending on an event that occurs within the spatial area ER5 during the period before the scheduled date on which the event content is to be provided. However, instead of or in addition to this, in this embodiment, processing related to the event content may be performed depending on the degree to which an image within the spatial area ER5 is displayed on the display device 310 of the viewer terminal 300 by entering or participating in the spatial area ER5 during the period before the scheduled date on which the event content is to be provided in the virtual space ER.

[0304] The processing related to the event content includes, for example, a process for changing the display mode of the presentation during the provision of the event content and a process for granting the user an object that the user can use during the provision of the event content. The degree of display is, for example, the number of times the user entered the spatial area ER5 during the period before the scheduled date. The number of times the user entered the spatial area ER5 may be counted as one entry if multiple entries are made on the same day, or may be counted as one entry when the user has been in the spatial area ER5 for a predetermined period of time (e.g., 10 minutes). The degree of display is not limited to this, and may also be the length of time spent in the spatial area ER5 during the period before the scheduled date or the degree to which a specific area within the spatial area ER5 is displayed (such as the number of times it is displayed or the duration of the display). The specific area may be, for example, a predetermined area within the spatial area ER5, such as an exhibition area or an offering area.

[0305] Below, we will explain an example in which the ``degree'' of displaying an image within the spatial area ER5 is ``the number of times entered into the spatial area ER5 where event content may be held on the scheduled date (hereinafter simply referred to as the number of entries),'' and the ``processing related to the event content'' is ``processing to change the presentation content while the event content is being provided'' and ``processing to grant the user an object that the user can use while the event content is being provided.''

[0306] The delivery server computer 100 (for example, the event data 111 and the gift data 134) counts and stores the number of times each user entered the event room during the period before the scheduled date. Figure 38 shows an example of a data table for specifying the "items" granted according to the number of times each user entered the event room and the "performance details" that are changed during the provision of the event content according to the number of times each user entered the event room.

[0307] The "items" granted (made available) according to the number of times a user enters the room are objects that can be used by the user while the event content is being provided. For example, they may be limited items that can only be used in the event content (e.g., a live concert) held after the end of the pre-scheduled period, or they may be items that can be used not only in the event content held after the end of the pre-scheduled period but also in content other than the event content. Note that when used in content other than the event content held after the end of the pre-scheduled period, certain limitations may be placed on the item's functionality, effectiveness, etc. (e.g., certain functions may be unavailable or effects may be reduced). Alternatively, or in addition to these, the item may be a limited item based on, for example, the theme of the event content held after the end of the pre-scheduled period.

[0308] As shown in FIG. 38 , the “items” are items that can be used during the provision of event content to liven up the event, for example. For example, if a user enters the event room once during the period before the scheduled date, they are awarded limited edition cracker A, which can be used in the event content; if they enter twice, they are awarded limited edition cracker B; if they enter three times, they are awarded limited edition cracker C. If they enter four times, they are awarded limited edition fireworks; if they enter five times, they are awarded limited edition glow sticks; if they enter six times, they are awarded limited edition stamps; and if they enter seven times, they are awarded limited edition item sets. Stamps are stamps that can be used for chatting and messaging within the virtual space. An item set is a set containing multiple items. Note that the items shown in FIG. 38 are not limited to items that can be used during the provision of event content and that liven up the event, and may also be so-called tipping items. In addition to items corresponding to the actual number of times a user enters the event, items corresponding to a number of times less than the actual number of times a user enters the event may also be awarded.

[0309] As shown in FIG. 38, for example, if the number of times a user enters the room during the period before the scheduled date is one to three, the "performance content" is normal, and the performance content remains unchanged. If the number of times a user enters the room is four or more, the performance content can change; special room A is provided after four entries, special room B after five entries, and special room S after six entries. The provision of a special room means that the user is granted the right to participate in the event content in a virtual live venue animation (display mode) that is different from the normal performance. For example, an area ER53' may be prepared that can be accessed only by target users who have obtained the right to participate in the live performance in the special room, and the event content may be provided within the special room. Alternatively, the image of the live venue set that is distributed when the event content is provided may be replaced with an image distributed to the target user.

[0310] Additionally, in the seventh event, a performance featuring a secret costume will be provided. The secret costume is a costume (costume object) of the performer avatar that is displayed in correspondence with the performer avatar when the event content is provided. For users who have obtained the right to be featured in the performance featuring the secret costume, data that replaces the costume data of the performer avatar that is normally distributed to other users will be distributed.

[0311] An example of event content-related processing executed in the distribution server computer 100 according to the number of entries shown in Fig. 38 will be described with reference to Fig. 39. The event content-related processing is executed, for example, for each user who is scheduled to participate in the event content (for example, in ascending order of user ID), from the end of the period before the scheduled date until the start of the event content.

[0312] In step S401, it is determined whether the user has entered the room one or more times during the period before the scheduled date. If it is not determined that the user has entered the room one or more times during the period before the scheduled date, the process ends. For users determined in step S401 not to have entered the room one or more times during the period before the scheduled date, event content is delivered based on the data stored by default in event data 111.

[0313] On the other hand, if it is determined in step S401 that the user has entered the virtual space ER one or more times during the period before the scheduled date, an item is granted in step S402 according to the number of times the user has entered the virtual space ER. As a result, the granted item is displayed, for example, in an item box owned by the user in the virtual space ER. The item may be placed in the box before the start time of the event content, or may be grayed out and unavailable until the start time of the event content, or may be usable in the virtual live venue that is open from the start time of the event content.

[0314] In step S403, the effect content according to the number of times of entry is set for the user, and the process ends. For example, if the user has entered the room four times, limited fireworks will be displayed in the item box, and information for designing the virtual live venue as Special Room A will be stored in association with the target user.

[0315] (Regarding re-provision of content for the period before the scheduled date and for events) Examples of event content provided in the period before the scheduled date and on the scheduled date have been described with reference to FIGS. 24 to 39. However, content provided to users by distribution server computer 100 may be provided again (re-performed). While FIGS. 13 to 39 illustrate an example of content, such as a live event with performers at a virtual live venue on the scheduled date, in FIG. 40, the live event provided on the scheduled date and content provided in the period before the scheduled date before the live event (e.g., areas and activities available for a limited time in connection with the live event) are collectively referred to as event content. The content provided in the period before the scheduled date includes, for example, content related to the live event, such as spatial area ER5 that is opened in the period before the scheduled date before the live event described in FIGS. 24 to 39. Hereinafter, the spatial area ER5 that is opened in the period before the scheduled date and the live event provided in spatial area ER5 on the scheduled date will be collectively referred to as event content. The content in the period before the scheduled date may include activities (such as game content) that the user can use in the spatial area ER5 that is open in the period before the scheduled date, objects that can be displayed, and the like.

[0316] FIG. 40 is a diagram illustrating the period before the scheduled date and the re-provision of event content. For example, as shown in FIG. 40(a), a first scheduled period and a second scheduled period are set as a "scheduled period" including the scheduled date for providing live event content and the period before the scheduled date. The content for the period before the scheduled date described above is provided before the first scheduled date in the first scheduled period, and the content for the live event described above is provided on the first scheduled date. The second scheduled period for re-provision of the event content provided during the first scheduled period can be started after a predetermined period (e.g., two months) has elapsed since the end of the first scheduled period. The provision of the event content ends once the first scheduled period ends, but the distribution server computer 100 stores and retains information (re-provision data) for taking over and re-provisioning the content data at the end of the first scheduled period. The stored re-provision data is re-provisioned to users during the second scheduled period. The re-provision data includes, for example, information for generating a virtual space (e.g., FIGS. 24 and 25, etc.), information according to user actions (e.g., user-related information (related to purchased flower stands) in FIG. 27, flower stand placement information for each exhibition area shown in FIG. 31, etc.), performer information such as animation data and audio data including motion data of performer avatars in the live event (performer avatar information, performer audio, etc. distributed in FIG. 10), information on event flower stands used by performers in the live events exemplified in FIGS. 35 to 37, and data on games played in the first scheduled period (e.g., previous save data, ranking data, user level). Note that the spatial area ER5 may be opened for several days after the first scheduled date to set up a period after the first scheduled date, so that the content data at the end of the first scheduled period, including the period after the first scheduled date, is carried over.

[0317] At the start of the first scheduled period, the flower FS in the virtual space is displayed in its initial state (e.g., initially arranged with the initial settings of the flower FS), and is updated in accordance with the user's actions (e.g., purchases, etc.) during the period before the first scheduled date, as described above. At the start of the second scheduled period illustrated in FIG. 40(a) (e.g., when spatial area ER5 is reopened), information based on the user's actions during the first scheduled period is carried over and reflected in the virtual space, so that the flower FS for each display area is arranged based on the flower FS arrangement information at the end of the first scheduled period. As a result, when a user who purchased a flower FS during the first scheduled period enters the space during the second scheduled period, the flower FS purchased by that user will be arranged in the same position and in the same display mode as it was during the first scheduled period. Note that although the flower FS arrangement information is the flower FS arrangement information at the end of the first scheduled period, it may also be the flower FS arrangement information at the end of the first scheduled date or after the first scheduled date.

[0318] Furthermore, during the second pre-scheduled period in the second scheduled period, as in the first pre-scheduled period, the display mode in the virtual space can be changed and varied between users in response to user actions, and the processes shown in Figures 32 to 39 are also executed. For example, if a user who enters during the second pre-scheduled period purchases a flower stand FS, the flower stand will be displayed in the virtual space displayed on the viewer terminal 300 of that user in a specified area designated by the user in a display mode, such as the text style edited by the user, as shown in Figures 29 and 30. However, the purchased flower stand FS may not be reflected in the virtual spaces of other users, resulting in different flower stands FS being displayed between users. Furthermore, each time a switching condition is met, the displayed flower stands FS other than the flower stands FS purchased and placed by the user (including both purchases during the first scheduled period and the second scheduled period) can be changed or updated. Furthermore, data from games played during the first scheduled period is carried over to display rankings, and data such as the games cleared by each user is also carried over, so the game can be started from where it left off in the first scheduled period.

[0319] The re-provision data does not include location information and movement information (information for displaying the user avatars U of other users) of the user avatars U who entered the room during the first scheduled period. Therefore, during the second scheduled period, the user avatars U of the users who actually entered the room during the second scheduled period are displayed. However, this is not limiting, and the re-provision data carried over for re-enactment may include location information and movement information of the user avatars U of the users who entered the room during the first scheduled period, and a virtual avatar may be displayed based on the location information and movement information of the carried over user avatars U depending on the number of users who entered the spatial area ER5 during the second scheduled period (for example, when the number is less than a predetermined number).

[0320] Furthermore, on the second scheduled date in the second scheduled period, a live event featuring performers will be held, just as on the first scheduled date, and users who enter spatial area ER5 will be able to view the event from a viewpoint that corresponds to the user's operation. For the event on the second scheduled date, the most recent flower stand (the flower stand most recently purchased) for each user can be displayed in association with the performer avatar, just as in the examples in FIGS. 35 to 37. The default flower stand information in FIG. 36(A) may be the same as the flower stand FS for the first scheduled period, or may be different from the default for the first scheduled period based on the information on the flower stand FS purchased by the user for the second scheduled period.

[0321] While FIG. 40(a) shows an example in which the flower stand-related information for the first scheduled period is carried over to the second scheduled period, this is not limiting, and the flower stand-related information for the first scheduled period may not be carried over to the second scheduled period, as shown in FIG. 40(b). In the case shown in FIG. 40(b), the flower stand FS in the virtual space at the start of the second scheduled period is displayed in the same initial state as at the start of the first scheduled period, and is then updated according to the user's behavior during the period before the second scheduled period. Note that the initial state of the flower stand (displayed flower stand and display mode) at the start of the second scheduled period may be the same as the initial state of the flower stand at the start of the first scheduled period, or may be partially or entirely different (for example, the display mode of the flower stand FS in a predetermined initial position may be changed to a design for the second scheduled period).

[0322] Furthermore, on the second scheduled date in the second scheduled period, a live event featuring performers will be held, just like on the first scheduled date, and users who enter the spatial area ER5 will be able to watch the event from a viewpoint that corresponds to the user's operation, but the default flower stand information in Figure 36(A) may be different from the default for the first scheduled period, based on the information on the flower stand FS purchased by the user in the second scheduled period.

[0323] The re-provision data for a re-provisioned live event is identical in terms of the movements and sounds of the performer avatars based on the motion data and sound data from the previous time, but the display mode other than the movements of the performer avatars does not have to be the same as that from the previous time, and may be different between the previous time and the re-provision. For example, the costume of the performer avatar for the live event on the first scheduled date may be different from the costume of the performer avatar for the live event on the second scheduled date.

[0324] (Regarding audio and viewpoint special switching processing) Next, we will explain performers when the event content is provided again. During the period before the first scheduled date of the first scheduled period, performers from the live event on the first scheduled date (for example, a talent who has live-streamed the event) are generally not allowed to enter (will not enter) the space area ER5. However, during the second scheduled period, performers from the live event on the second scheduled date (i.e., the same live event as the first scheduled date) can also enter the space area ER5 as participants, both during the period before the second scheduled date and on the second scheduled date. Performer avatars who enter as participants during the second scheduled period are displayed in a display mode different from the display mode of performer avatars for the live event on the first scheduled date. For example, performer avatars who are proceeding with an event as performers are displayed as different three-dimensional humanoid models (e.g., performer avatar 1 in FIG. 13), whereas performer avatars who are participating as participants during the second scheduled period are displayed as the same user avatars as other general users. However, the performer's name is displayed in association with the same user avatar as the other general users (e.g., a user name and an official mark that identifies the performer together with the user name), allowing other users to recognize that it is the performer's avatar. Furthermore, user avatars for general users may be simply displayed avatars rather than humanoid. For example, a three-dimensional humanoid model requires a large amount of drawing information to be displayed in the virtual space, whereas a simply displayed avatar may be a three-dimensional model that can be displayed with a small amount of drawing information, such as a simple shape consisting of a circle, square, triangle, or the like (e.g., a triangular pyramid or a plain animal shape).

[0325] Furthermore, when a performer is participating as a participant in a live event on the second scheduled date, a performer avatar (an avatar that moves and is displayed based on motion data and audio data previously stored as re-provision data) as the performer proceeding with the live event and an avatar as the participant may be displayed. This allows other users participating in the event to simultaneously view (display) both avatars in a single virtual space, enhancing the enjoyment of the event. For example, a user may enjoy watching an avatar as the performer proceeding with the live event while listening to the voice of the performer as the participant talking about his or her feelings during the event. To facilitate such enjoyment, in this embodiment, processing is performed to switch the audio output from the viewer terminal 300 and the viewpoint displayed on the viewer terminal 300.

[0326] In principle, only the user avatars of users who are in the same room are displayed on the viewer terminal 300. Therefore, if a performer is in the virtual space as a participant, the performer's avatar as a participant will not be displayed on the viewer terminals 300 of users other than those in the same room as the performer. However, as an exception, for the user avatar of a special user account, even if the user has entered the room as a participant, it is possible to mirror the appearance and voice of the user avatar in other rooms (for example, duplicated rooms that provide the same content). This allows the avatar to be displayed as the performer's participant in the virtual space displayed on the viewer terminals 300 of users who are not in the same room as the performer.

[0327] 41 is a flow diagram showing an example of special audio / viewpoint switching processing for switching audio and viewpoint. The special audio / viewpoint switching processing is executed by each viewer terminal 300. The viewer terminal 300 displays an image in a virtual space along with an icon for selecting settings for the virtual space, and executes the special audio / viewpoint switching processing when it receives an operation on the icon for switching audio or viewpoint.

[0328] In step S411, it is determined whether or not an audio switching operation has been performed. If it is determined that an audio switching operation has not been performed, the process proceeds to step S413. On the other hand, if it is determined in step S411 that an audio switching operation has been performed, the process proceeds to step S412. If the current audio setting is normal audio, the audio is switched to special audio that enables output of the audio of special users. Conversely, if the current audio setting is special audio, the process switches to normal audio. The special audio is audio output from the virtual space, and only the audio of special users (e.g., accounts of talents, celebrities, etc., including performers) is extracted (or extracted so that it is easy to hear) and output from the viewer terminal 300. This allows the user to easily switch to the audio of the performer as a participant. The normal audio is audio corresponding to the location of the user's user avatar in the virtual space, and is audio occurring within a predetermined radius from that location. For example, if a user is located near the event stage, the voice of the performer proceeding with the event will be output at a louder volume than other voices, and if the user is located far from the event stage, the voice of other users who are near the user avatar of the user will be output at a louder volume than the voice of the performer proceeding with the event. Note that if there are multiple performers as participants, the user may be able to select which performer's voice to use. For example, the user may be able to select one particular favorite performer, or multiple performers.

[0329] Note that the operation to switch to the special audio is not limited to one in which the normal audio is no longer output, but may also be one in which the audio of the special user becomes audible in addition to the normal audio. For example, in addition to audio emitted from a user avatar located in the vicinity of the user avatar operated by the user, audio emitted from the user avatar of the special user may be output even if the user avatar is located at a distance from which audio cannot normally be heard.

[0330] Furthermore, since the sound on the stage is output from the sound data distributed to the viewer terminal 300 by the generated sound distribution process (FIG. 10), either normal sound or special sound may be selected and output from the viewer terminal 300. During live content distribution, normal sound cannot be selected in the first place (sounds such as voice chats by other users cannot be heard), but special sound may be output as secondary sound. Furthermore, special sound may be selectable and output only by users who have met certain conditions (for example, paying a fee or clearing a game). In this way, during live content distribution, the sound of performer avatars as participants may be output as secondary sound (narration) while watching the live performance (main sound).

[0331] Furthermore, the present invention is not limited to switching between audio signals, but may also be configured to switch between loud and soft audio signals. For example, when the current audio setting is normal audio, the normal audio signal may be output at a louder volume than the special audio signal, and when the current audio setting is special audio, the special audio signal may be output at a louder volume than the normal audio signal.

[0332] Next, in step S413, it is determined whether a viewpoint switching operation has been performed. If it is determined that a viewpoint switching operation has not been performed, the audio / viewpoint special switching process is terminated. On the other hand, if it is determined in step S413 that a viewpoint switching operation has been performed, the process proceeds to step S414, and if the current viewpoint setting is a normal viewpoint, the viewpoint is switched to a special viewpoint that focuses on the user avatar of a special user (for example, the avatar of a performer who has entered the virtual space as a participant), whereas if the current viewpoint setting is a special viewpoint, the viewpoint is switched to the normal viewpoint. This allows the user to easily switch to a viewpoint that focuses on the avatar of a performer who is a participant.

[0333] The normal viewpoint is the viewpoint toward which the user's user avatar U faces in the virtual space, and an image of the virtual space that can be seen from that viewpoint is displayed. For example, when the user faces the event stage, an image including the avatars of the performers who are conducting the event is displayed, and when the user faces the opposite side of the event stage, an image of the virtual space on the opposite side of the event stage is displayed.

[0334] On the other hand, a special viewpoint is an image captured by a virtual camera placed in the virtual space, capturing the user avatar of a special user from an angle that may differ from the normal viewpoint. For example, if the image is from a virtual camera that is fixedly placed in advance, an image acquired from the virtual camera capturing the user avatar of the special user (for example, the image may be selected by an administrator operation, or the virtual camera may be selected based on the location information of the special user) may be distributed to the viewer terminal 300. Alternatively, an image capturing an avatar of a performer as a participant, captured by an operator (for example, an administrator account) of a virtual camera (for example, drone photography in the virtual space), may be distributed to the viewer terminal 300. For example, the viewpoint may be a bird's-eye view of the avatar from diagonally above. Note that if multiple performers are present as participants, the viewer may be able to select which performer's avatar to use. For example, the viewer may be able to select one or more specific favorite performers.

[0335] In the audio / viewpoint special switching process, the operation of switching to the special audio / special viewpoint may be operable only by users who satisfy a predetermined condition, such as payment, etc. Also, either the special audio or the special viewpoint may be operable only by users who satisfy a predetermined condition.

[0336] (Special handling for entering rooms) In this embodiment, the virtual space is provided using multiple rooms to simultaneously provide the same content to multiple users. As a result, content such as the spatial area ER5 that constitutes the virtual live venue where event content for the period before the scheduled date and the scheduled date is provided, as described above with reference to FIG. 40, is provided using multiple rooms, making it possible to simultaneously distribute the content to many users. Note that, for example, one room can be defined per server, but multiple rooms may also be defined per server.

[0337] FIG. 42(a) is a diagram illustrating multiple rooms that make up the spatial area ER where predetermined content is provided (e.g., rooms corresponding to areas ER51-53 of the spatial area ER5 that constitutes a virtual live venue, or a room corresponding to area ER53' in FIG. 24 where a live event is held on a scheduled date with the same configuration as area ER53). The multiple rooms include a main room where the virtual space is constructed and where, for example, performers enter (are associated with) during the event, and multiple other rooms (room 1, room 2, room 3, etc.) where the virtual space within the main room (including the performers' avatars) is mirrored. A user wishing to enter the virtual live venue is assigned (associated) to a room designated by the user from among the multiple rooms, or to a room randomly assigned (associated) by the load balancing system if no room is designated, and an image of the same virtual live venue can be displayed. For example, this may be when entering a virtual space by logging in, and after logging in, a screen may be displayed that allows the user to select the content (e.g., area) they wish to enter. When the user selects the area they wish to enter, rather than specifying a room ID, they may be randomly assigned to one of the rooms as if no room had been specified.

[0338] On the other hand, user actions in the virtual space (voice, actions, comments, etc.) can be shared with users in the same room, but not with users in other rooms. For this reason, it is desirable for users to enter the same room in situations such as when multiple entertainers or celebrities wish to enter the same room to create a lively atmosphere for an event in the virtual space, or when a user wishes to enter the same virtual space because another user with a friend relationship has already entered.

[0339] However, each room has a preset upper limit (for example, 200) on the number of users who can enter the room, taking into consideration factors such as server processing capacity and load concentration. For this reason, if rooms are allocated based on a strict upper limit, it may not be possible for users to enter the same room under the circumstances described above, and users' requests may not be met. On the other hand, the upper limit is generally set to a value that allows for some leeway, taking into consideration the server's processing capacity, so that even when the load on the server is concentrated, delivery is not affected (such as an inability to deliver).

[0340] For this reason, in this embodiment, when a predetermined condition is met, a special process is performed that allows a user to enter the same room even if the maximum number of users would be exceeded if the user were allowed to enter the room. FIG. 42(b) is a flow diagram showing an example of the special room entry process. The special room entry process is executed by the delivery server computer 100. The delivery server computer 100 executes the special room entry process when it receives a request from a user to enter a room where predetermined content is provided (for example, constituting a spatial area ER that constitutes a virtual live venue). The request to enter the room may be made at the time of logging in to the virtual space (a room ID may be specified at this time), or may be made at the time when a screen for selecting the content (such as an area) to enter is displayed on a title screen after logging in, and the content is selected (a room ID may be specified at this time). Examples of the predetermined condition include, but are not limited to, when a special user specifies a room to enter the virtual space, or when a user related to the user attempting to enter the room is already in one of the rooms.

[0341] Special users include accounts of performers appearing as performers at live events (e.g., performer user IDs and accounts in FIG. 8), as well as entertainers, celebrities, and the like (all of which may also be performers). For example, they may be accounts of users designated as special users in advance by the administrator, and may be assigned in advance attribute numbers that can identify entertainers, celebrities, and the like, along with the user IDs and accounts of viewer user data stored in storage 103. Furthermore, special users in the room entry exception processing may include administrators who operate the virtual space and people related to entertainers, etc. (e.g., managers, etc.). Administrators include, for example, accounts of users who have the authority to operate a virtual camera. This makes it possible to capture video of the room in which the entertainer has entered using a virtual camera and display the video on the viewer screens of other users, or to transmit the video data to another computer (e.g., an external server for live streaming).

[0342] Examples of cases where a user is related to a user include, for example, when a follow function such as a friend function is provided in the virtual space provided by the distribution server computer 100, and the user is in a mutual follow relationship, or when the intimacy level is equal to or greater than a predetermined value. The intimacy level is calculated based on the user's behavioral history within the virtual space. For example, the intimacy level may be increased based on the number of chats, the number of cooperative games played, or the number of times the user has been within a predetermined range based on location information. Furthermore, between special users, special users with an intimacy level equal to or greater than a predetermined value, or special users who are scheduled to appear at the same live event and who need to enter the same room to progress in content created by the operator, are considered to be related users.

[0343] In step S421, it is determined whether a special user has entered the room. If it is determined in step S421 that a special user has entered the room, it is then determined in step S422 whether a room has been designated. For example, when a room ID is input into a terminal of the account of a talent who is a special user, a request to enter the room and a request to designate the room ID are sent to the distribution server computer 100. If it is determined in step S422 that a designation has been made, in step S423, a process is performed to associate the user with the designated room and allow the user to enter the room, regardless of the number of users currently in the designated room and the maximum number of users. The distribution server computer 100 determines whether the user who made the entry request is a special user based on the ID of the user, and if a room ID has been designated, allows the user to enter the room with the designated room ID. For example, a process is performed to associate the user ID of the special user who has entered the room with the designated room ID.

[0344] Note that the room ID that allows entry regardless of the upper limit may be predetermined by the administrator. That is, when a room ID other than the room ID that allows entry regardless of the predetermined upper limit is specified, if the number of people in the specified room has already reached the upper limit, entry to the room may be prohibited. Also, the user who entered in step S421 may be allowed to enter a room that already contains a special user who has a relationship with the special user.

[0345] On the other hand, if it is not determined that the user is a special user, or if the user is a special user but has not specified a room, in step S424, it is determined whether a user who is related to the user attempting to enter (for example, a friend relationship, a relationship where the intimacy level is equal to or greater than a predetermined value, etc.) has already entered any room. If it is determined in step S424 that a related user has already entered any room, in step S425, a process is performed in which the user is associated with the room they have entered and enters the room, regardless of the number of users currently in the room and the upper limit number. Note that if related users are distributed across multiple rooms, the user may be allowed to enter the room with the most related users. Alternatively, among the rooms in which related users are currently entering, priority may be given to rooms with the lowest level of congestion.

[0346] On the other hand, if it is determined in step S424 that the related user is not in any of the rooms, a process is performed in step S426 in which the user is associated with and allowed to enter one of the rooms whose number has not reached the upper limit. For example, a process of allocating the user by a normal load balancing process is performed.

[0347] (Regarding component reset of performer's humanoid avatar) Next, with reference to FIG. 43, a process for resetting abnormal display of an object that sways in conjunction with a character object will be described. As shown in FIGS. 13 and 20, the performer's humanoid avatar is associated with a human-shaped character object (a three-dimensional model including bones (skeleton)) and a costume object corresponding to the costume worn by the character object. Furthermore, associating components (functional parameters) with objects displayed in the virtual space enables various objects to be displayed and operated within the virtual space. Each character object and costume object is preset with various components (e.g., various parameters such as so-called colliders and rigid bodies) used for physical calculations (calculation processes for collision detection, gravity, movement, etc.). Object data associated with various components is included in the virtual space update data of FIG. 10 and distributed to the viewer terminal 300. Furthermore, the viewer terminal 300 performs processing for displaying the character object in motion based on the performer's motion data (performer avatar information included in the virtual space update data of FIG. 10) distributed by the distribution server computer 100. On the other hand, the clothing object is an object that displays a swaying motion (for example, cloth such as clothes or hair), and is displayed by performing physical calculations in conjunction with the motion of the character object (for example, calculation processing based on a component that performs calculations for swaying objects such as cloth that functions in conjunction with a skin mesh associated with the character object). In this way, the viewer terminal 300 performs physical calculations and processes to display the clothing object in motion (for example, swaying, bouncing, bending, etc.) in the same way as in real space in accordance with the motion of the character object.

[0348] In this way, the computational processing for displaying the movements of character objects and costume objects is performed by the viewer terminal 300 based on the virtual space update data streamed at predetermined intervals from the distribution server computer 100. When the movement display processing based on the previously received virtual space update data is completed, the movement display processing is executed based on the next received data.

[0349] Even if the data being delivered is the same, differences may occur between users depending on the processing power of the viewer terminal 300 and the communication environment (e.g., a slow frame rate). In particular, when the viewer terminal 300 has low processing power or the communication speed is below a certain level, calculations based on physics calculations take time (slow rendering speed), and there is a high risk that abnormal display modes of the clothing object will be calculated and displayed if the character's movement speed and range are large. For example, there may be a large discrepancy between the final movement position of the character object based on the previously received streaming data and the initial movement position of the next received streaming data. As a result, an object that should naturally move smoothly, such as a skirt calculated to follow the character object, will not move smoothly but will instead move in an extremely large motion. As an example, it is conceivable that as a result of an actor moving vigorously, the movement of the colliders of various objects may cause the hem of a skirt object to be calculated as sinking into the top of the skirt or the leg of a character object, causing the skirt to be displayed as if it is rolled up, or that the tip of a feather object may be calculated as sinking into the middle of the feather, causing the feather to be bent and unable to flap. In this embodiment, in order to prevent such abnormal display from continuing, a component reset process is performed in the distribution server computer 100 as a process for resetting the display state of the object to neutral.

[0350] 43 is a flow diagram showing an example of component reset processing. The component reset processing is executed by the delivery server computer 100. The delivery server computer 100 executes the component reset processing every time a predetermined time (e.g., 2 ms) elapses while delivering virtual space update data including data for operating a humanoid avatar. As an example, the following describes a case where the aforementioned live event is being provided (delivered).

[0351] In step S431, it is determined whether a series of actions by the performer avatar has ended. The timing when a series of actions has ended refers to the timing when the performer avatar's continuous actions have ceased, and the performer avatar's movement speed and range have decreased, resulting in a calmer movement. For example, in content in which a performer sings while dancing, this includes the timing when one song has been sung, the interval between songs before the start of the next song, and the start of the second song. Alternatively, in content in which a performer performs an attraction, this includes the timing when one attraction has ended, the interval before the start of the next second attraction, and the start of the second attraction. In this embodiment, any of these timings can be used as the timing when a series of actions has ended. The distribution server computer 100 determines whether the movement speed and range of movement have fallen below a predetermined amount. Whether the movement speed and range of movement have fallen below a predetermined amount can be determined when the acceleration becomes equal to or less than a predetermined value (or continues for a predetermined number of seconds).

[0352] If it is not determined in step S431 that the series of actions by the performer avatar has ended, the component reset process is terminated. On the other hand, if it is determined in step S431 that the series of actions by the performer avatar has ended, a component reset signal is delivered to the viewer terminal 300 in step S432, and the component reset process is terminated. The component reset signal is a signal for causing physical calculations for an object (e.g., a costume object) displayed corresponding to a character object to be performed from a predetermined initial state. In other words, this signal causes calculations that would normally be performed following the results of calculations based on the previously received streaming data to be performed from the initial state without being based on the results of the previous calculations. As a result, even if the display state of the costume object is abnormal, the display state is reset to neutral and physical calculations are performed.

[0353] In this way, the viewer terminal 300 performs physics calculations to display the costume object in the same manner as in real space in response to the character object's movement. For example, in the physics calculations, the current acceleration is calculated taking into account the acceleration of each part of the costume object at the previous calculation timing. However, when a component reset signal is received, the current acceleration is calculated from a predetermined initial state (e.g., zero acceleration) without taking into account the acceleration of each part at the previous calculation timing. This allows the costume object to be restored to a state calculated from the initial state (neutral state) even if an abnormal costume object state is calculated and displayed during a series of actions. For example, this can eliminate a state in which the skirt hem is turned up or wings are bent and unable to flap. As a result, there is a risk that an abnormal costume object state may be calculated, causing the costume object to be displayed in an abnormal manner for the character, etc. Even if this possibility is increased when the character's movement speed and range are large, the abnormal state can be eliminated.

[0354] The component reset signal may be any command that starts physical calculations from the initial parameters of the costume object (parameters for the state in which the character object is wearing the costume when in its initial posture, i.e., a neutral display state such as when no acceleration is applied), and may also be a command that sets the components of the costume object (parameters such as acceleration and gravity) to the same parameters as those in their initial positions (when the character object is in its initial posture).

[0355] <Examples of specific configurations and effects>

[0356] (1-1) In the above-described embodiment, as explained with reference to Figures 1 to 25, etc., the delivery server computer 100 performs processing to generate a virtual space ER and transmit information for displaying an image within the virtual space ER in response to a user operation, based on a stored program and a method for controlling a computer using the program (hereinafter simply referred to as the program), and the viewer terminal 300 performs processing to display an image in response to a user operation in response to information from the delivery server computer 100, based on the stored program. Also, as explained with reference to Figures 26 to 28, etc., the delivery server computer 100 performs processing to update the arrangement of objects, such as a flower FS, purchased in response to a user purchase operation, within the virtual space ER, based on the stored program, and the viewer terminal 300 performs processing to update the arrangement in the delivery server computer 100 and to update the arrangement of objects purchased in response to a user purchase operation, within the virtual space ER, based on the stored program. Furthermore, as explained with reference to Figures 13 to 23 and Figure 35, the distribution server computer 100 performs processing to construct a space in the spatial area ER5 within the virtual space ER for providing the event content on the scheduled date based on the stored program, and the viewer terminal 300 is able to provide the event content on the scheduled date in the spatial area ER5 constructed by the distribution server computer 100 based on the stored program.

[0357] Furthermore, in this embodiment, even during the period before the scheduled event date, the delivery server computer 100 and the viewer terminal 300 each perform processing based on their stored programs to enter the spatial area ER5 in response to a user's operation and display images within the spatial area ER5, and to arrange and display purchased objects within the spatial area ER5 in response to a purchase operation. Furthermore, as shown in Figures 26, 29, 30, 34, and 35, the delivery server computer 100 and the viewer terminal 300 each perform processing based on their stored programs to change the display mode within the spatial area ER5 in response to the arrangement and display of objects such as a flower stand FS within the spatial area ER5 during the period before the scheduled event date. This allows the spatial area ER5 in which the event content is provided and events that can change the display mode within the spatial area ER5 to be shared and provided to users during the period before the scheduled event date, thereby gradually increasing interest in the event content even before the event content is provided.

[0358] (1-2) Based on the programs stored therein, the distribution server computer 100 and the viewer terminal 300 each perform processing to change the display mode of each display area within the spatial area ER5 from the time of purchase to the end of the period before the scheduled date, as shown in Figures 26, 28, and 29, etc., depending on the user's purchase of flower stands FS during the period before the scheduled date, as shown in Figure 27(C) etc. This allows the user to focus on whether a flower stand FS will be purchased by the user during the period before the scheduled date, what attributes the purchased flower stand FS will have, what decorations it will have, where it will be displayed, and how the display mode of each display area within the spatial area ER5 will change as a result.

[0359] (1-3) The display mode of each display area within spatial area ER5 that can change during the period before the scheduled date can be different from the display mode displayed to other users depending on whether the user purchases and places a flower stand FS during the period before the scheduled date, as explained by comparing Figures 29 and 30. This makes it possible to customize the display mode of each display area within spatial area ER5 during the period before the scheduled date for each user, giving each user a sense of specialness.

[0360] (1-4) As shown in Figure 35 and other figures, the distribution server computer 100 and the viewer terminal 300 each perform processing based on the programs stored therein to change the display mode of the production of the live event taking place within the spatial area ER5 while the event content is being provided, in response to the user's purchase and placement of a flower stand FS during the period before the scheduled date. This allows the user to pay attention to whether the user will purchase a flower stand FS during the period before the scheduled date, what attributes and decorations will be applied to the purchased flower stand FS, and how the display mode of the production of the live event taking place within the spatial area ER5 while the event content is being provided will change as a result.

[0361] (1-5) The presentation of a live event taking place in spatial area ER5, which can change while the event content is being provided, may take on a display mode that differs from that displayed to other users depending on whether the user purchased and placed a flower stand FS during the period before the scheduled date, as explained in Figures 27(C), 35, and 36. This allows the display mode of the presentation of a live event taking place in spatial area ER5 while the event content is being provided to be customized for each user, giving each user a sense of exclusivity.

[0362] (1-6) An example of an event that changes the display mode within the spatial area ER5 is an action in response to a user's purchase of a flower stand FS, which is an action that reflects the purchased flower stand FS by displaying and placing it in an exhibition area within the spatial area ER5, such as an action in which a user purchases a flower stand FS in step S107 of Figure 28 and the flower stand FS is placed in a predetermined exhibition area A of the spatial area ER5 in step S109. This makes it possible to cause an event that changes the display mode within the spatial area ER5 through the user's own operation, thereby encouraging the user to operate and improving the user's sense of participation.

[0363] (1-7) As an example of an event that changes the display mode within the spatial area ER5, a purchase operation of a flower stand FS, which is an action in response to an operation from another user (e.g., user 1, who is another user for user 2 in FIGS. 29 and 30), is illustrated as an action that is reflected by displaying and placing the flower stand FS in the display area within the spatial area ER5, such as the action of another user 1 purchasing the flower stand FS. That is, as shown in an example in FIG. 30(D), on user 2's display device 310, a flower stand FS1 that would not be displayed unless purchased by other user 1 can be selected by random lottery as the default flower stand FS to be displayed and placed in the specified display area A due to the purchase by other user 1. In this way, because operations and actions from other users can also be events that change the display mode within the spatial area ER5, the changes in the display mode can be made more interesting and the enjoyment can be enhanced.

[0364] (1-8) The fulfillment of a switching condition is illustrated as an example of an event that changes the display mode within the spatial area ER5. Furthermore, the distribution server computer 100 and the viewer terminal 300 each perform processing based on a stored program to maintain the display of a flower stand FS associated with a special user within the spatial area ER5, even if an event that changes the display mode within the spatial area ER5 occurs. For example, the display position of a flower stand FS purchased by a user is determined by lottery from among positions other than the display position of the special user's flower stand FS. Furthermore, even when the switching condition is fulfilled, the display and display of the flower stand FS associated with the special user continues, as shown in FIG. 34. This allows the display mode associated with the special user to continue without change, thereby maintaining and improving the convenience and advantages of the special user. Furthermore, because objects such as the special user's flower stand can be used for advertising and promotion, for example, the operator can more easily solicit investments from sponsors who could be examples of special users.

[0365] (1-9) As shown in Figure 24, the spatial area ER5 is provided with an area ER53' of the second virtual space used to provide event content on the scheduled date, and an area ER53 which is part of the first virtual space and has a display mode in common with area ER53' (the same, similar, etc.). The distribution server computer 100 and the viewer terminal 300 each perform processing based on the programs stored therein, such that during the period before the scheduled date, for example, until the day before the scheduled event date, portal P is not displayed and entry into area ER53' is restricted, while entry into area ER53 is permitted and an image of area ER53 can be displayed in response to user operation. After the day before the scheduled event date arrives and the release conditions are met, the gate of the gate object 53c leading to area ER53 is closed, thereby restricting entry into area ER53, while portal P is displayed and entry into area ER53' of the second virtual space is permitted and an image of area ER53' can be displayed in response to user operation. This allows switching the area used depending on whether the release conditions are met, so that before the release conditions are met, a virtual space can be provided using an area that is suitable for the user's behavior before the event content is provided, and after the release conditions are met, a virtual space can be provided using an area that is suitable for providing the event content.

[0366] (1-10) As shown in Figure 24, areas ER51 and ER52, which are part of the first virtual space, are provided within the spatial area ER5, and it is possible to move seamlessly between areas ER51, ER52, and ER53 in Figure 24(A), which is the first virtual space (moving between these areas is possible by moving the user avatar from one area to the other by user operation), while area ER53' of the second virtual space and areas ER51 and ER52, which are part of the first virtual space, are areas formed separately, and as shown in Figure 24(B), it is possible to move between the first virtual space and the second virtual space via a blackout display from portals P in areas ER53' and ER52. This improves the convenience of moving between areas ER51, ER52, and ER53 in Figure 24(A), which is the first virtual space, before the release conditions are met, and after the release conditions are met, the display goes dark when moving to area ER53' in the second virtual space, giving the user a sense of specialness and tension, and increasing interest.

[0367] (1-11) The release condition can be met on the day before the event content is scheduled to be provided. This allows for a period before the release condition is met, a period after the release condition is met but before the event content is provided, and a period during which the event content is being provided, thereby gradually increasing interest.

[0368] (1-12) The display mode within spatial area ER5 that can be changed includes a flower stand FS displayed in the display area within spatial area ER5, and events that change the display mode within spatial area ER5 include an event in which a user purchases a flower stand FS during the period before the scheduled date and associates the flower stand FS with the user and places the flower stand FS in a display area selected by the user within spatial area ER5. In this way, by placing the flower stand FS purchased by the user in a display area selected by the user during the period before the scheduled date, the display mode of the display area can be changed, thereby increasing the user's interest.

[0369] (1-13) Events that change the display mode within the spatial area ER5 include events that generate the display mode (decoration such as text) of a flower FS in response to a user operation when placing the flower FS. This allows each user to customize the display mode of the flower FS to their own original display mode, enhancing the user's interest.

[0370] (1-14) The variable display modes within the spatial area ER5 include a flower star FS held by a performer avatar that is displayed and operates within the spatial area ER5 while the event content is being provided and that can progress through the event content, as shown in Fig. 35. This allows the flower star FS that can be displayed corresponding to the performer avatar to change depending on events that occur during the period before the scheduled date, thereby increasing interest in events that occur during the period before the scheduled date.

[0371] (1-15) As shown in Fig. 39, the distribution server computer 100 and the viewer terminal 300 each perform processing based on a stored program to change the display mode within the spatial area ER5 in accordance with the number of times the user has entered the spatial area ER5, which is an example of the degree to which the image within the spatial area ER5 was displayed during the period before the scheduled date. This allows the display mode within the spatial area ER5 to change depending on the number of times the user has entered the spatial area ER5 during the period before the scheduled date, thereby increasing and encouraging the user to enter the spatial area ER5 during the period before the scheduled date.

[0372] (1-16) Based on the programs stored in them, the distribution server computer 100 and the viewer terminal 300 each perform processing to make the event content available on the scheduled date to users who satisfy certain conditions, such as by purchasing a ticket to participate in the event content, and to allow users who satisfy the certain conditions to enter the spatial area ER5 during the period before the scheduled date and to display images within the spatial area ER5. This increases and encourages users to satisfy the certain conditions.

[0373] (2-1) In this embodiment, even during the period before the scheduled event date, the distribution server computer 100 and the viewer terminal 300 each perform processing based on their stored programs to allow users to enter the spatial area ER5 in response to user operations and display images within the spatial area ER5. Furthermore, as shown in Figures 38 and 39, the distribution server computer 100 and the viewer terminal 300 each perform processing related to the event content based on their stored programs during the period before the scheduled date, in accordance with the number of entries (this does not include the number of entries into other spatial areas ER within the virtual space ER other than the spatial area ER5, even if the user is logged in to the virtual space ER) which is an example of the degree to which users have entered the spatial area ER5 in which the event content is provided on the scheduled date and displayed images within the spatial area ER5. This allows the spatial area ER5 in which the event content is provided to be shared and provided to users during the period before the scheduled date, and processing related to the event content is performed in accordance with the number of entries into the spatial area ER5 during the period before the scheduled date. This increases the user's motivation to enter spatial area ER5 rather than other spatial areas within the virtual space ER and display images within spatial area ER5, thereby gradually increasing interest in the event content even before the event content is provided.

[0374] (2-2) The processing related to the event content includes a process of changing the display mode within the spatial area ER5 during the provision of the event content in accordance with the number of times the user enters the space during the period before the scheduled date, as shown in the production content of Fig. 38. This increases the user's motivation to enter the spatial area ER5 during the period before the scheduled date, and also draws the user's attention to how the display mode within the spatial area ER5 changes.

[0375] (2-3) The display mode in the spatial area ER5 during the provision of event content, which changes depending on the number of times a user enters the room due to processing related to the event content, can be different from the display mode displayed to other users depending on the number of times a user enters the room, as shown in the display content in Fig. 38. This makes it possible to customize the display mode in the spatial area ER5 during the provision of event content for each user, making each user feel special.

[0376] (2-4) The changing display modes within the spatial area ER5 during the provision of event content include secret costumes, which are costumes of performer avatars that are displayed in the spatial area ER5 during the provision of event content and correspond to the performer avatars that can appear and move within the spatial area ER5 and progress through the event content. In other words, the costumes of the performer avatars during the provision of event content can change depending on the number of times the user enters the spatial area ER5 during the period before the scheduled date. This can increase the user's motivation to enter the spatial area ER5 during the period before the scheduled date, thereby increasing the user's interest.

[0377] (2-5) The process related to the event content includes a process for granting the user items corresponding to the number of times the user has entered the space, from among items that are examples of objects that can be used while the event content is being provided, as shown in step S402 of Fig. 39. This increases the user's motivation to enter the spatial area ER5 during the period before the scheduled date, and also draws the user's attention to the granted items.

[0378] (2-6) The items granted to a user through processing related to the event content may differ from the items granted to other users because different items are set depending on the number of times the user enters the room, as shown in the items in Figure 38. This allows a variety of items to be used during the provision of the event content, thereby increasing the interest in the event content.

[0379] (3-1) In this embodiment, the distribution server computer 100 and the viewer terminal 300, based on the programs stored therein, each place in the display area within the spatial area ER5 the flower arrangement FS associated with a user through purchase, and for the flower arrangement FS shown in Fig. 29(A) that is associated with another user (e.g., other than user 1) and placed in the display area within the spatial area ER5, step S203 in Fig. 32 switches to another flower arrangement FS when a switching condition is met, while for the flower arrangement FS associated with the user himself (e.g., user 1), processing is performed to continue displaying it in the same display area even when the switching condition is met, as explained with reference to Fig. 27(C). This allows the flower arrangement FS to be appropriately displayed within the spatial area ER5 even when there are many flower arrangements FS to be displayed and the number of display positions available in the display area is limited. In addition, the flower arrangements FS associated with other users can be exhibited and displayed relatively evenly within the spatial area ER5, and the display mode of the exhibition area within the spatial area ER5 can be changed to increase interest, while the user can check the flower arrangements FS associated with themselves, thereby increasing satisfaction.

[0380] (3-2) The switching condition may be established when a predetermined time has elapsed, or when a user logs in or enters or leaves the spatial area ER5. This allows a flower FS associated with another user to be switched to another flower FS without the user needing prior knowledge (e.g., how to switch), thereby increasing the interest of all users in the flower FS that may be exhibited and displayed in the exhibition area within the spatial area ER5.

[0381] (3-3) As shown in Figure 27, multiple types of flower stands FS are provided with different attributes and sizes, and the display areas in which they can be placed and displayed within the spatial area ER5 are determined according to their type. This allows the appropriate type of flower stand FS to be placed in each display area in accordance with the design, taste, and worldview of the spatial area ER5. It also allows for a sense of unity in the types of flower stands FS placed in each display area.

[0382] (3-4) Flower stems FS can be exhibited and displayed up to the upper limit set in the exhibition area within the spatial area ER5, and the distribution server computer 100 and the viewer terminal 300 can, based on the programs stored therein, maintain the number of exhibited flower stems FS within the upper limit, as shown in Figures 29(C) to 29(D), etc., and can switch to displaying a flower stem FS associated with another user when a switching condition is met. This allows flower stems FS associated with other users to be evenly displayed in the exhibition area within the upper limit, and can increase interest by changing the display mode of the exhibition area and spatial area ER5.

[0383] (3-5) As shown in Fig. 24, the spatial area ER5 is provided with a plurality of display areas in which flower stands FS can be arranged and displayed, and the distribution server computer 100 and the viewer terminal 300 each perform processing based on a stored program to arrange and display the user's flower stand FS in an area of ​​the plurality of display areas designated by the user in response to an operation by the user, as shown in Fig. 26. This allows the user to arrange and display their own flower stand FS in the display area of ​​their choice, increasing interest.

[0384] (3-6) Based on the programs stored in them, the distribution server computer 100 and the viewer terminal 300 each perform processing to change the display mode of the flower star FS to be displayed by adding decorations such as letters to the flower star FS in response to user operations, as shown in Fig. 26. This allows the display mode of the displayed flower star FS to be customized to suit the user's preferences, thereby enhancing the user's interest.

[0385] (3-7) Based on the programs stored in them, the distribution server computer 100 and the viewer terminal 300 each display and display default flower FS at a higher rate for users who have purchased a larger number of flower FS (e.g., 11 rather than 10, 40 rather than 30) than for users who have purchased fewer. However, for users who have reached a predetermined number, default flower FS can be selected by lottery and displayed and displayed at the same rate (e.g., the same rate as for a predetermined number of users) regardless of whether they have purchased more than the predetermined number of flower FS. This encourages users to purchase a reasonable number of flower FS (less than the predetermined number), while preventing the proportion of default flower FS held by users who have purchased the predetermined number from increasing uncontrollably.

[0386] (4-1) In this embodiment, the virtual space includes a space ER5 in which multiple types of objects can be displayed, including first-type objects such as buildings and virtual stage G, which are essential objects for generating the virtual space, and second-type objects such as flower stands FS, which are an example of objects that enhance the virtual space but are not essential for creating the content. If information for displaying the required objects can be identified, steps S215 to S245 of FIG. 33 perform processing to display the specified space regardless of whether information for displaying the non-required flower stands FS, whose display mode can be changed, can be identified. If all the flower stand arrangement information has been read in step S225 of FIG. 33, the latest flower stand arrangement information is sent to the user in step S205. If a predetermined time has passed without all the flower stand arrangement information being read in step S235 of FIG. 33, a substitute flower stand is identified and sent to the user in step S245. With this configuration, the space ER5 can be displayed when information on the required objects has been identified, regardless of whether the flower stand arrangement information can be identified. If the flower stand arrangement information cannot be identified, a substitute object can be displayed. Therefore, even when some objects cannot be identified due to a heavy load on the server caused by concentrated access, the user can be allowed to enter the virtual space and the virtual space can be displayed.

[0387] (4-2) When the viewer terminal 300 displays a space for providing a live event or the like on a scheduled date in the spatial area ER5 in Fig. 24, the spatial area ER5 can be displayed even if the flower arrangement information has not been specified. As a result, because the spatial area ER5 is a virtual space for providing event content on a scheduled date, access to a distribution device such as a server may be concentrated on that scheduled date. However, regardless of whether the flower arrangement information can be specified, the virtual space can be displayed if the required object information has been specified.

[0388] (4-3) As illustrated in Figures 29 and 30, a flower star FS is an object whose display mode changes depending on user actions such as purchases, and even if it is not possible to identify flower star placement information corresponding to the current display mode updated in step S203 of Figure 32 or step S213 of Figure 33, an alternative flower star is identified in steps S225 to S245 of Figure 33, and information identifying the flower star FS is sent to the user in step S205. This allows the user to enter spatial area ER5 and display the image in spatial area ER5 when there is a surge in access to a distribution device such as the server of the latest updated flower star FS.

[0389] (4-4) Furthermore, the object that is replaced with an alternative object if it cannot be read in Figure 33 is a flower stand FS that the user can display in the exhibition area by purchasing it in Figure 28 or by entering text in step S104. Since there are many variations in the display format, the information identifying the flower stand FS can easily become heavy, and it may become impossible to read the flower stand placement information. However, in step S245 of Figure 33, for example, the flower stand can be replaced with an alternative object that has a lighter processing load.

[0390] (5-1) In this embodiment, objects placed in the virtual space include character objects such as performer avatars that move based on motion data, and costume objects such as skirts that are placed corresponding to the character objects. By performing a viewer-perspective video generation process and a viewer-perspective video output process based on the virtual space update data, it is possible to perform processing for displaying the costume objects in a manner corresponding to the movement of the character objects that move based on the motion data. Furthermore, a component reset signal is transmitted in step S432 of FIG. 43 to reset the display state of the costume objects to neutral, for example, when a series of actions in step S431 of FIG. 43 ends or between songs. This resets the display state of the costume objects to neutral at specific times when the amount of movement of the performer avatar may fall below a predetermined amount, allowing the reset to occur at a time that does not cause the viewer to feel extremely uncomfortable.

[0391] (5-2) In this embodiment, resetting the display state of a clothing object to neutral includes performing physical calculations associated with the clothing object (e.g., calculations of collision detection, acceleration, etc.) from a predetermined initial state by performing the calculations from the initial state without using the results of previous calculations. This allows the physical calculations associated with the linked object to be performed from the predetermined initial state at a timing that does not cause the viewer to feel extremely uncomfortable.

[0392] (5-3) In this embodiment, the process of resetting the display state of the clothing object to neutral in step S432 in Fig. 43 is performed when the series of actions in step S431 ends, and can be performed at any timing between the end of the first song, which is the first part sung by the performer avatar, the start of the second song, which is the second part, and the start of the second song, in a live event in which performer avatar 1 appears, such as in Fig. 13. This allows the component reset process to be performed between the first and second parts during the event, at a timing when the amount of movement of the character object, which is the performer avatar, may be less than a predetermined amount, so the viewer does not feel extremely uncomfortable even if the component is reset.

[0393] (6-1) In this embodiment, as described with reference to FIG. 40, event content (including a live event to be provided on the scheduled date and content to be provided in the period before the scheduled date before the live event) is provided within the spatial area ER5 during a first scheduled period, and the event content can be provided again within the spatial area ER5 during a second scheduled period after the first scheduled period has elapsed. Furthermore, as described with reference to FIG. 40(a), the display mode of the flower stand FS and the like within the spatial area ER5 at the start of the second scheduled period is determined by inheriting the flower stand-related information from the first scheduled period and changing it to a display mode according to the flower stand arrangement information for the first scheduled period (e.g., at the end of the scheduled period, the end of the scheduled date, or the end before the scheduled date). Furthermore, the display mode of the flower stand FS displayed within the spatial area ER5 and the flower stand FS used to produce the live event shown in FIG. 35 can be changed depending on user purchases during the second scheduled period. This can increase the interest of users who participated in the first scheduled period in the event content during the second scheduled period. Furthermore, since the display mode of the flower star FS displayed in the spatial area ER5 during the second scheduled period can be changed and shared among users, interest in the event content during the second scheduled period can be increased regardless of whether the user participated in the first scheduled period or not.

[0394] (6-2) In this embodiment, with regard to the re-provision of the event content described with reference to Fig. 40, as described in Fig. 40(b), the display mode of the flower stand FS and the like in the spatial area ER5 at the start of the second scheduled period can be set to a predetermined display mode such as an initial state without carrying over the flower stand arrangement information from the first scheduled period, and the display mode of the flower stand FS displayed in the spatial area ER5 and the flower stand FS used in the production of the live event in Fig. 35 can be changed depending on user purchases during the second scheduled period, etc. In this way, by setting the display mode within a predetermined type of virtual space at the start of the second scheduled period to a predetermined display mode, even users who participated in the first scheduled period can participate in the event content in the second scheduled period with a fresh feeling, thereby increasing interest in the event content.

[0395] (6-3) In this embodiment, performers (such as performer avatars 1a to 1d in FIG. 35, etc.) who are proceeding with the live event on the first scheduled date and the second scheduled date can participate as participant avatars in the event content for the second scheduled period described with reference to FIG. 40. Furthermore, since the performers can also participate in the live event on the second scheduled date, performer avatars on the virtual live stage, such as in FIG. 35, and avatars participating as performer participants can be displayed in the virtual space during the live event. This makes it possible to provide a live event with a different atmosphere and style from that of the first scheduled period, thereby increasing interest in the live event.

[0396] (6-4) Furthermore, the avatars of the performers displayed as participants on the second scheduled date are displayed as simple avatars, the same as those of general users, in a different display mode from the performer avatars at the live event. This allows the avatar objects of the performers as participants to be distinguished from the avatar objects of the performers, thereby preventing confusion among users.

[0397] (6-5) In this embodiment, as explained in steps S411 to S412 of the audio / viewpoint special switching process in Fig. 41, in a live event during the second scheduled period, if a performer in the live event also participates as a participant, it is possible to switch to special audio coming from the performer as a participant in response to an operation on the viewer terminal 300. This allows the user to switch to listening to audio coming from the performer as a participant in response to their will, thereby increasing interest in event content such as live content and increasing the variety of ways to enjoy it.

[0398] (6-6) In this embodiment, in steps S413 to S414 of the audio / viewpoint special switching process in Fig. 41, when a performer in a live event also participates as a participant in the live event during the second scheduled period, it is possible to switch the image displayed in the virtual space to an image of the performer's avatar object as a participant viewed from a predetermined viewpoint in response to an operation on the viewer terminal 300. This allows the user to switch to viewing the performer's avatar object as a participant from an image viewed from a predetermined viewpoint in response to their will, thereby increasing interest in event content such as a live event and increasing the variety of ways to enjoy it.

[0399] (6-7) In this embodiment, the display mode of performer avatars on the virtual live stage at the live event in the re-provision of the event content in Fig. 40 is displayed in the same display mode during the first scheduled period and the second scheduled period based on virtual space update data including information for displaying motion data and performer costumes on the first scheduled date. Meanwhile, the flower stand FS used in the production of the live event, as exemplified in Fig. 35 and other figures, can be updated to the latest version based on user purchases during the second scheduled period. This allows the quality of the live event during the second scheduled period to be similar to that of the live event during the first scheduled period, while the display mode of objects such as the flower stand FS used for production is displayed in the display mode for the second scheduled period, thereby increasing interest in the live event during the second scheduled period.

[0400] (7-1) In this embodiment, as described in steps S423, S425, and S426 of the room entry exception processing in Fig. 42(b), by accepting a request to enter a virtual space by logging in from a user, entering a room by selecting content, or specifying a room to enter, it is possible to perform processing to associate the user with one of multiple virtual space providing units. Furthermore, for each room, the upper limit of the number of users that can be associated with that room is set to a predetermined number, for example, 200. If the user who has requested entry is a non-specific user who does not satisfy specific conditions, such as a general user or a user who is not associated with other users, the non-specific user is not associated with a room whose number of associated users has reached the upper limit, and is not allowed to enter the room in step S426. On the other hand, when the entry request is from a specific user who meets specific conditions, such as a special user such as a celebrity account or an administrator account, or a user who has a relationship with other users, steps S421 to S423 and steps S424 to S425 in Fig. 42(b) make it possible to associate the specific user with a specific room regardless of whether the number of associated users has reached the upper limit. As a result, when the entry request is from a specific user, the restriction on entry to the virtual space based on the upper limit is exceptionally lifted, and the specific user is allowed to be associated with the specific room, improving convenience for the specific user.

[0401] (7-2) In this embodiment, in step S423 of Figure 42(b), the rooms that a user can enter regardless of the upper limit on the number of rooms are rooms with room IDs predetermined by the administrator. This allows a specific user to be associated with a specific room designated by the administrator, making it easier to change the settings of the room designated by the administrator, for example, and reducing the processing load on the distribution server computer 100.

[0402] (7-3) In this embodiment, if a room ID is specified as explained in step S422 of Fig. 42(b), the entry request includes information about the specified room ID. This allows the entry request to be associated with the room specified by the user, thereby reducing the processing load for allocating users to any room and further improving user convenience.

[0403] (7-4) In this embodiment, special users and users who have relationships with other users can enter rooms that are already associated with other users who appear in the same live content or who have relationships such as friend relationships or relationships where the intimacy level is equal to or greater than a predetermined value. This allows users to be associated with a specific room in consideration of the relationships between users, making it easier for users to act and communicate in the same virtual space provided by the same room and to improve the atmosphere in the virtual space.

[0404] (7-5) In this embodiment, the special users in the processing of steps S421 to S423 in Fig. 42(b) include performers appearing as performers in live events such as Fig. 35, and such performers can enter a predetermined room regardless of the room upper limit. This improves convenience for performers.

[0405] (7-6) In this embodiment, in the processing of steps S421 to S423 in Fig. 42(b), special users who are allowed to enter a predetermined room regardless of the upper limit on the number of rooms include users who have the authority to operate a virtual camera and are authorized to output images taken in the virtual space so that the images can be displayed on other computers. This improves convenience for users who have the authority to output images.

[0406] <Modification> Modifications of the embodiment (including changes and additions) described above with reference to FIGS. 1 to 43 will be listed below.

[0407] (Regarding re-provision of content for the period before the scheduled date and for events) In the above-described embodiment, an example in which event content is provided again in a second scheduled period has been described with reference to FIG. 40. FIG. 40(a) illustrates an example in which flower star-related information from the first scheduled period is carried over to the second scheduled period, and FIG. 40(b) illustrates an example in which flower star-related information from the first scheduled period is not carried over to the second scheduled period. However, this is not limiting, and the information carried over to the second scheduled period may differ depending on whether or not a user participated in the event content during the first scheduled period. For example, depending on whether or not a user participated in a live event of the event content during the first scheduled period or entered a virtual space such as the spatial area ER5 in which the event content is provided during the first scheduled period, the flower star-related information from the first scheduled period may not be carried over for users who participated or entered the virtual space, and the second scheduled period may start from an initial state different from that at the start of the first scheduled period. On the other hand, for users who did not participate in or enter the virtual space during the first scheduled period, the second scheduled period may start from the same initial state as the first scheduled period. In this case, for users who have purchased a flower star FS during the first scheduled period, the information on the flower star FS that they purchased may be carried over.

[0408] (Replay data related) In the above embodiment, a case where the event content is provided again (replayed) during the second scheduled period has been described with reference to Figure 40. However, the replay of the event content is not limited to being provided during a predetermined scheduled period, and may be provided in response to a request from a user at any time. For example, the distribution server computer 100 may store the data of the event content provided in this embodiment (event data 111) so that it can be provided again to the user, and may perform processing to enable the replay of the event content in response to a user request (e.g., an operation to purchase replay data, an operation to view the event content for a second time, etc.) even after the event content has been provided. For example, while providing the event content on the scheduled date, the distribution server computer 100 stores in the storage 103 information for displaying images in the area ER53' that include performer information such as animation data and audio data including motion data of the performer avatar (such as the performer avatar information and performer audio distributed in FIG. 10) in response to user operations, as well as the event flower star information exemplified in FIG. 36, and item and performance content information that can be set in FIG. 39, as replay data for the event data, and transmits it to the viewer terminal 300 of the requesting user.

[0409] The event flower stand information includes the default information of Fig. 36(A) drawn for each event content and the information of the flower stand FS purchased by the user who requested re-provision based on the user-related information of Fig. 27(C). The item and presentation content information includes information for specifying the items to be granted by the event content-related processing of Fig. 39 and the presentation content to be set, depending on the number of times the user who requested re-provision entered the room during the period before the scheduled date.

[0410] The viewer terminal 300 that received the replay data plays the event content provided on the scheduled date based on the replay data at the user's discretion. Furthermore, when playing the event content, in order to adapt the display mode to events that occurred during the period before the scheduled date, for example, a flower arrangement identified from the received event flower arrangement information and having the same attributes and size as a flower arrangement purchased by the user is switched to the flower arrangement purchased by the user, thereby providing the presentation of the event content. In other words, the display mode of the flower arrangement FS that can be displayed based on the replay data may differ for each user depending on the flower arrangement FS purchased during the period before the scheduled date. This allows the event content to be provided in a display mode that corresponds to events that occurred during the period before the scheduled date, even after the event content is provided on the scheduled date, thereby improving user convenience and interest. Specifically, a user who was unable to participate in the event content on the scheduled date can still participate in the event content even after the scheduled date, and if they purchased a flower arrangement FS during the period before the scheduled date, a presentation corresponding to that flower arrangement FS can be provided.

[0411] Furthermore, when playing back event content, processing related to the event content is performed according to the number of entries, which is an example of the degree to which the image in the spatial area ER5 was displayed during the period before the scheduled date. For example, the event content is set to a performance content specified by the received item / performance content information, and items specified by the received item / performance content information are assigned and made available during the replay. In other words, the display mode of the event content based on the replay data can be varied for each user depending on the number of entries the user made during the period before the scheduled date. This allows the event content to be provided in a display mode corresponding to the number of entries made during the period before the scheduled date, even after the event content is provided on the scheduled date, thereby improving user convenience and interest. Furthermore, processing is performed to allow users to use items from the event content based on the replay data that correspond to the number of entries the user made during the period before the scheduled date. This improves user convenience and interest.

[0412] (Right to enter the space area ER5) In the above embodiment, an example has been described in which only users who have the right (such as a ticket) to participate in the event content to be provided on the scheduled date are permitted to enter and participate in the spatial area ER5 during the period before the scheduled date. However, this is not limited to this. Even if a user does not have the right to participate in the event content to be provided on the scheduled date, they may be permitted to enter the spatial area ER5 during the period before the scheduled date and be able to freely act within the spatial area ER5, such as purchasing a flower stand FS or viewing the exhibition area. Participation in the event content itself is not possible unless the user has the right to participate (for example, entry to the area ER53' is restricted). However, by being permitted to enter the spatial area ER5 during the period before the scheduled date and strolling and experiencing the spatial area ER5, interest in the event content to be provided on the scheduled date can be heightened, and users may be motivated to acquire the right and participate in the event content. Note that a user who does not have the right to participate in the event content but is able to participate in the virtual space ER may be able to participate in the event content on the scheduled date and enter the spatial area ER5 during the period before the scheduled date.

[0413] (Regarding the display balance of flower stand attributes within the exhibition area) In the above embodiment, an example was described in which the flower stand FS to be switched when the switching condition is met in step S302 of FIG. 32 is determined by random lottery. However, this is not limited to this. Alternatively, the flower stand FS to be displayed within the spatial area ER5 may be determined by lottery so that the number of attributes associated with each flower stand FS is approximately equal among the attributes. As described above, the attributes "cherry blossom," "demon," "white fox," and "black fox" are attribute colors associated with the performer avatars that appear as progression characters when providing event content. For example, if the spatial area ER5 has 80,000 locations where flower stands with the attributes "cherry blossom," "demon," "white fox," and "black fox" can be displayed, the number of locations available for each attribute is calculated to be 20,000. Therefore, the flower stand FS to be switched when the switching condition is met may be determined by lottery, with 20,000 flower stands for each attribute. That is, as shown in FIG. 27, each flower stand FS is associated with one of the motifs (attributes), and the distribution server computer 100 and the viewer terminal 300 each perform a process based on a stored program to draw and determine a default flower stand FS so that the number of attributes associated with the displayed flower stands FS is approximately equal among the attributes, thereby ensuring that the flower stands of the four attributes are approximately equal throughout the entire spatial area ER5. This allows the attributes of the flower stands displayed within the spatial area ER5 to be displayed in a balanced manner, preventing bias toward any one attribute. Furthermore, even when focusing on each exhibition area, the number of attributes associated with the flower stands FS displayed within one exhibition area may be approximately equal among the attributes. In other words, the flower stands of the four attributes may be approximately equal in each exhibition area.

[0414] Alternatively, a predetermined number of display areas may be provided for each attribute, with each display area having a predetermined upper limit. Each attribute may be associated with a different display area. For example, the first display area may be selected by lottery from among only flower stands with the attribute "cherry blossom," the second display area may be selected by lottery from among only flower stands with the attribute "demon," the third display area may be selected by lottery from among only flower stands with the attribute "white fox," and the fourth display area may be selected by lottery from among only flower stands with the attribute "black fox." This allows the flower stands FS associated with each attribute (especially the attributes of performer avatars appearing when providing event content) to be displayed in a balanced manner within the spatial area ER5. Furthermore, by viewing the display area for flower stands related to the attribute of a favorite performer avatar, flower stands related to the attribute of the favorite performer avatar can be easily and efficiently viewed. While the above example illustrates an example in which only certain attributes (the attributes "cherry blossom," "demon," "white fox," and "black fox") are approximately evenly distributed, the present invention is not limited to this; all attributes, including solid colors and gorgeous designs, may be approximately evenly distributed. Note that by placing the flower stands FS purchased by the user, the number of attributes associated with the flower stands FS purchased by the user may increase in the virtual space. However, taking into consideration the attributes of the flower stands FS purchased by the user, a lottery may be held for each user to determine the display balance between attributes so as to be approximately equal within the upper limit of the number of flower stands FS that can be displayed in the exhibition area (or spatial area ER).

[0415] The ratio at which each attribute is selected by lottery and displayed may be predetermined. For example, the ratio at which the attribute "plain" shown in Fig. 27(A) is displayed within the spatial area ER5 may be 5%, while the ratios for "gorgeous" may be 15%, and the ratios for "cherry blossom," "demon," "white fox," and "black fox" may be 20% each.

[0416] (Regarding the probability of being selected as the default flower star) In the above embodiment, when the switching condition is met, the probability of a randomly selected default flower FS in step S203 of FIG. 32 is uniform across all flower FSs. However, the probability of a default flower FS being selected is not limited to this. It may be varied according to a parameter specific to the flower FS, or may not be selected as the default flower FS when the switching condition is met (e.g., excluded from the selection process). Hereinafter, with reference to FIG. 44, an example of varying the probability of a default flower FS being selected for each flower FS will be described. Each user may be allowed to perform a favorable impression action or a report action on a flower FS associated with another user displayed in the spatial area ER5. The favorable impression action is an action to express a favorable impression, such as by operating an icon such as a "like" (heart mark) to indicate a favorable impression of another user's flower FS. The report action is an action to express that a flower FS should not be displayed in the spatial area ER5. For example, it is an action to report to the management if offensive text (comments) is displayed on another user's flower FS.

[0417] FIG. 44 shows an example of a close-up image 510 of a flower stand FS. The close-up image 510 is displayed on the display device 310 based on information transmitted from the distribution server computer 100, triggered, for example, by the viewer terminal 300 approaching or interacting with a flower stand FS displayed in the display area. The close-up image 510 can display details of each flower stand FS. The close-up image 510 in FIG. 44 displays one of the flower stands FS arranged in the display area. Operating the left and right buttons 511 (511L, 511R) allows users to view other flower stands FS in the display area. The close-up image 510 displays a Like button 513 for performing a Like action, a Report button 514 for performing a Report action, and a Close button 516 for closing the close-up image 510. The close-up image 510 also displays creator information 512 (user information) as d...

Claims

1. A program executed by a computer to provide a virtual space to a user, The computer functioning as a display means for performing processing to display an image of the virtual space; the virtual space includes a predetermined space in which a plurality of types of objects including a first type of object and a second type of object can be displayed; The display means when first object information for displaying the first type of object can be identified, performing a process for displaying the predetermined space regardless of whether second object information for displaying the second type of object can be identified; when displaying the predetermined space, if the second object information can be identified within a predetermined period of time, the second type of object is displayed in a display mode based on the second object information, and if the second object information cannot be identified within the predetermined period of time, a process is performed to display a substitute object corresponding to the second type of object; The process for displaying the substitute object is executed when the predetermined space is displayed in response to a user newly entering the virtual space.

2. the computer is a user terminal that displays the provided virtual space; The program according to claim 1, wherein the display means displays a substitute object when the first object information can be identified, but when the second object information cannot be identified within the predetermined period at the time of requesting object information and receiving the second object information.

3. the computer is a distribution device that distributes information for providing the virtual space to a user terminal, 2. The program according to claim 1, wherein the display means, upon receiving a request for object information from the user terminal, identifies and distributes object information including the second object information, and distributes substitute object information for displaying the substitute object when the second object information cannot be identified.

4. The program according to claim 1 , wherein the predetermined space is a space for providing event content in the predetermined space on a scheduled date.

5. the second type of object is an object whose display mode can be changed, and when the second object information cannot be identified, the second type of object may be displayed in a different manner from the second type of object, and when the second type of object is displayed in a different manner from the second type of object, the second type of object may be displayed in a different manner from the second type of object.

2. The program according to claim 1, wherein the display means, when displaying the specified space, performs processing to display the second type of object in a display mode based on the display mode information when the display mode information can be identified, and to display the second type of object as the substitute object in a specified display mode when the display mode information cannot be identified.

6. The program according to claim 1 , wherein the second type of object is an object whose display state can be changed in accordance with an action of the user in the virtual space.

7. The program according to claim 6, wherein the user's actions include an operation by the user of placing the second type of object in the specified space, and a user operation of generating a display mode of the second type of object when placing it.

8. 1. A method for controlling a computer to provide a virtual space to a user, comprising: a step of performing processing for displaying an image of the virtual space, the virtual space includes a predetermined space in which a plurality of types of objects including a first type of object and a second type of object can be displayed; The step of performing processing to display an image of the virtual space includes: when first object information for displaying the first type of object can be identified, performing a process for displaying the predetermined space regardless of whether second object information for displaying the second type of object can be identified; when displaying the predetermined space, if the second object information can be identified within a predetermined period of time, the second type of object is displayed in a display mode based on the second object information, and if the second object information cannot be identified within the predetermined period of time, a process is performed to display a substitute object corresponding to the second type of object; The method, wherein the process for displaying the substitute object is executed when the predetermined space is displayed in response to a user newly entering a virtual space.

9. A system including a computer for providing a virtual space to a user, a display means for performing processing to display an image of the virtual space, the virtual space includes a predetermined space in which a plurality of types of objects including a first type of object and a second type of object can be displayed; The display means when first object information for displaying the first type of object can be identified, performing a process for displaying the predetermined space regardless of whether second object information for displaying the second type of object can be identified; when displaying the predetermined space, if the second object information can be identified within a predetermined period of time, the second type of object is displayed in a display mode based on the second object information, and if the second object information cannot be identified within the predetermined period of time, a process is performed to display a substitute object corresponding to the second type of object; The system wherein the process for displaying the substitute object is executed when the predetermined space is displayed in response to a user newly entering the virtual space.

Images