Program, method, and system

Abstract

To provide a program, a method, and a system that can increase the interest of a user who has participated in an event while enabling the event to be offered again.SOLUTION: It is possible to provide an event content in a predetermined type of virtual space among virtual spaces during a first planned period, to cause an event to occur in the predetermined type of virtual space during the first planned period, to display an image in the predetermined type of virtual space in response to operation from a user, and to change the display mode in the predetermined type of virtual space in response to the event caused in the predetermined type of virtual space. It is also possible to provide the event content again in the predetermined type of virtual space during a second planned period after the first planned period has elapsed, to set the display mode in the predetermined type of virtual space at the start of the second planned period to a display mode corresponding to the event caused in the first planned period, and to change the display mode in the predetermined type of virtual space in response to the event caused in the second planned period.SELECTED DRAWING: Figure 40

Description

[Technical field]

[0001] The present invention relates to a program, a method, and a system. [Background technology]

[0002] As a system for distributing content etc. via a network, for example, a distribution system is known in which performers hold events such as live performances in a virtual space on the web while providing content that enables viewers to participate in the event by controlling viewer avatars (moving, giving gifts, tipping, etc.) (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2012-120098 A Summary of the Invention [Problem to be solved by the invention]

[0004] The distribution system described in Patent Document 1 can increase interest in an event by livening up the event and increasing the sense of participation in the event in response to events that may occur due to performers, viewers, etc. during the event. However, after the event ends, the event is not resumed, and the space created by the performers, viewers, etc. cannot be provided again and is not utilized. Furthermore, even if the event could be resumed, there is a risk that the interest of performers, viewers, etc. who participated in the previous event could not be increased.

[0005] The present invention was devised in consideration of the above-mentioned situation, and provides a program, method, and system that can increase the interest of users who attended the event while making it possible to re-offer the event. [Means for solving the problem]

[0006] (1) A program according to an aspect of the present invention (e.g., a virtual space generation program 120, a program for viewers) controls a computer for providing a virtual space to a user (e.g., a distribution server computer 100, a viewer terminal 300, etc.) to: A means for displaying an image in the virtual space that is generated in response to an operation by the user (for example, a virtual space update data delivery process, a viewer viewpoint video output process, etc.); A means for generating an event in the virtual space (for example, a process for arranging an object purchased in the virtual space in response to a purchase operation by a user (a virtual space update data generation process), a process for arranging and updating the purchased object in the virtual space based on the virtual space update data (a virtual space update process), etc.); functioning as a means (for example, a virtual space update data distribution process using the event data 111, a viewer viewpoint video output process) for providing event content during a first scheduled period within a predetermined type of virtual space (for example, within a spatial area ER5) among the virtual spaces; During the first scheduled period, the generating means can cause an event to occur within the predetermined type of virtual space, and the display means can display an image within the predetermined type of virtual space in response to an operation from the user (for example, an image within spatial area ER5 can be displayed by entering spatial area ER5), and the display mode within the predetermined type of virtual space can be changed in response to the event caused within the predetermined type of virtual space (for example, arranging a flower stand FS purchased by the user within spatial area ER5 in steps S107 to S109 of FIG. 28, drawing a lottery for a flower stand FS to be displayed within spatial area ER5 in step S203 of FIG. 32, changing settings performed by an operation by the management, the display mode of a flower stand FS used in the production of a live event shown in FIG. 35 that can be changed by a user purchase in FIG. 37, etc.), The computer, functioning as a means for re-providing event content in the predetermined type of virtual space even during a second scheduled period after the first scheduled period has elapsed (for example, a virtual space update data distribution process using the event data 111, a viewer viewpoint video output process, see FIG. 40); The means for displaying is a program that sets the display mode within the specified type of virtual space at the start of the second scheduled period to a display mode that corresponds to an event that occurred during the first scheduled period, and is capable of changing the display mode within the specified type of virtual space according to the event that occurred within the specified type of virtual space during the second scheduled period (e.g., see Figure 40(a)).

[0007] According to this configuration, during the first scheduled period, the display mode in the predetermined type of virtual space in which the event content is provided can be shared among users, thereby improving interest in the event content. Also, the event content can be provided again during the second scheduled period, and the display mode in the predetermined type of virtual space at the start of the second scheduled period is set to a display mode corresponding to the event that occurred during the first scheduled period, thereby improving the interest in the event content during the second scheduled period for users who participated in the first scheduled period. Furthermore, since the display mode in the predetermined type of virtual space can be changed and shared among users according to the event that occurred in the predetermined type of virtual space during the second scheduled period, interest in the event content during the second scheduled period can be improved regardless of whether the user participated in the first scheduled period or not.

[0008] (2) A program according to an aspect of the present invention (e.g., a virtual space generation program 120, a program for viewers) controls a computer for providing a virtual space to a user (e.g., a distribution server computer 100, a viewer terminal 300, etc.) to: A means for displaying an image in the virtual space that is generated in response to an operation by the user (for example, a virtual space update data delivery process, a viewer viewpoint video output process, etc.); A means for generating an event in the virtual space (for example, a process for arranging an object purchased in the virtual space in response to a purchase operation by a user (a virtual space update data generation process), a process for arranging and updating the purchased object in the virtual space based on the virtual space update data (a virtual space update process), etc.); functioning as a means (for example, a virtual space update data distribution process using the event data 111, a viewer viewpoint video output process) for providing event content during a first scheduled period within a predetermined type of virtual space (for example, within a spatial area ER5) among the virtual spaces; During the first scheduled period, the generating means can cause an event to occur within the predetermined type of virtual space, and the display means can display an image within the predetermined type of virtual space in response to an operation from the user (for example, an image within spatial area ER5 can be displayed by entering spatial area ER5), and the display mode within the predetermined type of virtual space can be changed in response to the event caused within the predetermined type of virtual space (for example, arranging a flower stand FS purchased by the user within spatial area ER5 in steps S107 to S109 of FIG. 28, drawing a lottery for a flower stand FS to be displayed within spatial area ER5 in step S203 of FIG. 32, changing settings performed by an operation by the management, the display mode of a flower stand FS used in the production of a live event shown in FIG. 35 that can be changed by a user purchase in FIG. 37, etc.), The computer, functioning as a means for re-providing event content in the predetermined type of virtual space even during a second scheduled period after the first scheduled period has elapsed (for example, a virtual space update data distribution process using the event data 111, a viewer viewpoint video output process, see FIG. 40); The means for displaying is a program that sets the display mode within the specified type of virtual space at the start of the second scheduled period to a predetermined display mode regardless of an event that occurred during the first scheduled period, and is capable of changing the display mode within the specified type of virtual space depending on an event that occurred within the specified type of virtual space during the second scheduled period (e.g., see Figure 40(b)).

[0009] According to this configuration, during the first scheduled period, the display mode in the predetermined type of virtual space in which the event content is provided can be shared among users, thereby improving interest in the event content. Also, the event content can be provided again during the second scheduled period, and the display mode in the predetermined type of virtual space at the start of the second scheduled period can be a predetermined display mode, so that even users who participated in the first scheduled period can participate in the event content in the second scheduled period with a fresh feeling, thereby improving interest in the event content. Furthermore, during the second scheduled period, the display mode in the predetermined type of virtual space can be changed and shared among users according to an event generated in the virtual space, thereby improving interest in the event content in the second scheduled period, regardless of whether the user participated in the first scheduled period or not.

[0010] (3) A program according to an aspect of the present invention (e.g., a virtual space generation program 120, a program for viewers) controls a computer for providing a virtual space to a user (e.g., a distribution server computer 100, a viewer terminal 300, etc.) to: A means for displaying an image in the virtual space that is generated in response to an operation by the user (for example, a virtual space update data delivery process, a viewer viewpoint video output process, etc.); A means for generating an event in the virtual space (for example, a process for arranging an object purchased in the virtual space in response to a purchase operation by a user (a virtual space update data generation process), a process for arranging and updating the purchased object in the virtual space based on the virtual space update data (a virtual space update process), etc.); functioning as a means (for example, a virtual space update data distribution process using the event data 111, a viewer viewpoint video output process) for providing event content during a first scheduled period within a predetermined type of virtual space (for example, within a spatial area ER5) among the virtual spaces; During the first scheduled period, the causing means is capable of causing an event to occur within the predetermined type of virtual space, and the display means is capable of displaying an image within the predetermined type of virtual space in response to an operation by the user (for example, entering a spatial area ER5 and displaying an image within the spatial area ER5), and changing the display mode within the predetermined type of virtual space in response to the event caused within the predetermined type of virtual space, The computer, functioning as a means for re-providing event content in the predetermined type of virtual space even during a second scheduled period after the first scheduled period has elapsed (for example, a virtual space update data distribution process using the event data 111, a viewer viewpoint video output process, see FIG. 40); The means for displaying is a program that changes the display mode within the specified type of virtual space at the start of the second scheduled period depending on whether the user was a user who participated in the event content during the first scheduled period, and changes the display mode within the specified type of virtual space depending on an event that occurred within the specified type of virtual space during the second scheduled period (for example, see the modified example (Regarding re-provision of content for the period before the scheduled date and for the event)).

[0011] According to this configuration, during the first scheduled period, the display mode in the predetermined type of virtual space in which the event content is provided can be shared among users, thereby improving interest in the event content. Also, the event content can be provided again during the second scheduled period, and the display mode in the predetermined type of virtual space at the start of the second scheduled period can be set to a different display mode depending on whether the user participated in the event content during the first scheduled period, thereby giving each user a different sense of premium depending on whether the user participated in the first scheduled period, thereby improving interest in the event content during the second scheduled period. Furthermore, during the second scheduled period, the display mode in the predetermined type of virtual space can be changed depending on an event that occurred in the virtual space and shared among users, thereby improving interest in the event content during the second scheduled period, regardless of whether the user participated in the first scheduled period.

[0012] (4) In any one of (1) to (3) above, the event content during the first scheduled period and the second scheduled period includes a specific content proceeding with an avatar object that moves in response to the movement of a predetermined performer (for example, a live event proceeding with performer avatars 1a to 1d, etc., as shown in FIG. 35 ), The specific content during the second scheduled period is available for participation by users including the predetermined performer; When the specified performer participates in the specific content for the second scheduled period, the display means can display an avatar object of the specified performer as a participant in the specific content for the second scheduled period, separately from an avatar object of the specified performer in the first scheduled period, within a specified type of virtual space in the specific content for the second scheduled period (for example, a performer avatar on a virtual live stage and an avatar of the performer participating as a participant can be displayed).

[0013] According to this configuration, it is possible to display an avatar object as a specified performer and an avatar object as a participant of the specified performer who has participated separately from the avatar object within a specified type of virtual space in the specific content for the second scheduled period, so that it is possible to provide the specific content with a different atmosphere and style from the specific content for the first scheduled period, thereby increasing interest in the specific content.

[0014] (5) In (4) above, an avatar object of the specified performer as a participant that may be displayed in a specified type of virtual space in the specific content during the second scheduled period has a display manner different from an avatar object of the specified performer (for example, an avatar of the performer as a general user can be displayed separately from a performer avatar on a virtual live stage).

[0015] With this configuration, it is possible to distinguish between avatar objects representing a participant of a specified performer in a specified type of virtual space and avatar objects representing a specified performer, thereby preventing confusion for the user.

[0016] (6) In the above (4), the computer is a user terminal (e.g., a viewer terminal 300) that displays the provided virtual space, The computer, When the specified performer is participating in the specific content during the second scheduled period, the device functions as a means for enabling the user terminal to switch to audio coming from the specified performer as a participant in response to an operation on the user terminal (for example, steps S411 to S412 of the special audio / viewpoint switching process in Figure 41).

[0017] With this configuration, the user can switch to listening to the audio coming from a specific performer as a participant according to his / her wishes, thereby increasing interest in specific content and increasing the variety of ways to enjoy it.

[0018] (7) In the above (4), the computer is a user terminal (e.g., a viewer terminal 300) that displays the provided virtual space, The computer, When the specified performer is participating in the specific content during the second scheduled period, the display means can, in response to an operation on the user terminal, switch and display an avatar object of the specified performer as a participant from a specified viewpoint among images in a specified type of virtual space in the specific content (for example, steps S413 to S414 of the special audio / viewpoint switching process in Figure 41).

[0019] With this configuration, the user can switch to viewing an image of an avatar object of a specific performer as a participant from a specific viewpoint according to their wishes, thereby increasing interest in specific content and increasing the variety of ways to enjoy it.

[0020] (8) In the above (1), the event content during the first scheduled period and the second scheduled period includes a specific content (e.g., a live event such as that shown in FIG. 35) that progresses by an avatar object that moves in accordance with the movement of a predetermined performer; The display means can display, among the objects in the virtual space of a predetermined type in the specific content for the second planned period, the avatar objects in the same display manner as in the specific content for the first planned period (for example, a performer avatar on a virtual live stage in the same display manner as in the first planned period), while displaying a predetermined object different from the avatar object in a display manner different from that of the specific content for the first planned period (for example, a flower stand FS used in the production of a live event is displayed based on user purchase information in the second planned period, etc.).

[0021] According to this configuration, the quality of the specific content in the second scheduled period is made similar to that of the specific content in the first scheduled period, while certain objects are displayed in the display manner in the second scheduled period, thereby increasing interest in the specific content in the second scheduled period.

[0022] (9) In any of (1) to (3) above, the display mode within the specified type of virtual space, which may change depending on an event occurring during the second scheduled period, may be a display mode different from the display mode displayed to other users depending on an event occurring during the second scheduled period (for example, the flower star FS1 purchased by user 1 is displayed at a specified position A1 of a specified exhibition area A within the spatial area ER5 on the viewer terminal 300 of user 1, as shown in Figures 29 (B) to (D). On the other hand, on the viewer terminal 300 of user 2, the flower star FS1 purchased by user 1 is not displayed at the specified position A1 of the specified exhibition area A, as shown in Figures 30 (B) and (C)).

[0023] According to this configuration, the display mode within a predetermined type of virtual space during a scheduled period can be customized for each user, making each user feel special.

[0024] (10) In any one of (1) to (3) above, the event content in the first scheduled period and the second scheduled period includes specific content (e.g., a live event such as FIG. 35) to be provided from a predetermined timing of the first scheduled period to the end of the first scheduled period, The means for displaying changes the display mode (e.g., the display mode of a flower stand FS used in the production of a live event as shown in FIG. 35) within the specified type of virtual space during the provision of specific content corresponding to the specific content during the second scheduled period in accordance with an event that occurs between the start of the second scheduled period and a timing corresponding to the specified timing of the second scheduled period (e.g., step S303 in FIG. 37(A), step S313 and step S314 in FIG. 37(B), etc.).

[0025] With this configuration, it is possible to draw the user's attention to how the display state within a specified type of virtual space changes while specific content is being provided, depending on events that occur up until a specified timing.

[0026] (11) In (10) above, the display mode within the predetermined type of virtual space that may change during the provision of the specific content in the second scheduled period (for example, the display mode of a flower arrangement FS used to produce a live event as shown in FIG. 34) may be different from the display mode displayed to other users depending on an event that occurs between the start of the second scheduled period and a time corresponding to the predetermined timing of the second scheduled period (for example, based on the user-related information in FIG. 27(C), the flower arrangement FS used for the production may be the default flower arrangement FS in FIG. 36(A) or the flower arrangement in FIG. 36(B)).

[0027] According to this configuration, the display mode within a predetermined type of virtual space while specific content is being provided can be customized for each user, making each user feel special.

[0028] (12) In any one of (1) to (3) above, the display mode in the predetermined type of virtual space changed by the means for displaying during the second scheduled period includes a display mode of a specific object arranged in the predetermined type of virtual space (for example, a flower stand FS arranged in an exhibition area in the spatial area ER5), The event that changes the display mode within the predetermined type of virtual space includes an event in which the specific object is associated with a user and placed in a specified area within the predetermined type of virtual space during the second scheduled period (for example, an event in which information regarding a flower stand FS purchased by the user is associated with the user as user-related information in Figure 27(C) and placed in a specified exhibition area A as shown in Figure 29(B)).

[0029] According to such a configuration, by placing a specific object associated with a user in an area designated by the user during a scheduled period, it is possible to change the display mode within a predetermined type of virtual space, thereby increasing the user's interest.

[0030] (13) In the above (1), the event content in the first scheduled period includes specific content (e.g., a live event in FIG. 35) to be provided from a predetermined timing in the first scheduled period to the end of the first scheduled period, The display mode in the predetermined type of virtual space that is changed by the display means includes a display mode of a specific object (e.g., performer avatars 1a to 1d in FIG. 35 and a flower star FS held by an operator avatar) that is displayed in correspondence with a character that can be displayed and acted in the predetermined type of virtual space while the specific content is being provided and that progresses through the specific content (e.g., performer avatars 1a to 1d in FIG. 35 and the like) The display manner of the specific object in the specific content for the second scheduled period can be changed from the display manner of the specific object in the specific content for the first scheduled period in response to an event that occurs in the predetermined type of virtual space during the second scheduled period (for example, the latest flower star (the last purchased flower star) for each user can be displayed in association with a performer avatar).

[0031] According to this configuration, the display manner of a specific object that may be displayed corresponding to a progressing character may change depending on an event that occurs during the second scheduled period, thereby making it possible to increase interest through events that occur during the scheduled period.

[0032] (14) In the above (1), the event content in the first scheduled period includes specific content (e.g., a live event in FIG. 35) to be provided from a predetermined timing in the first scheduled period to the end of the first scheduled period, The means for displaying provides specific content to a user who satisfies a predetermined condition (e.g., who has purchased a ticket to participate in an event content) during a period from a timing corresponding to the predetermined timing of the second scheduled period after the start of the second scheduled period to an end of the second scheduled period; The means for displaying allows the display of images within the specified type of virtual space for a period up to the timing corresponding to the specified timing, regardless of whether the user satisfies the specified conditions (for example, a user can enter spatial area ER5 regardless of whether or not they have purchased a ticket allowing them to participate in event content; see variant example (Right to enter spatial area ER5)).

[0033] According to this configuration, even if a user does not satisfy the predetermined conditions, it is possible to display an image in a predetermined type of virtual space. This makes it possible to increase interest in a particular content by visually viewing an image in a predetermined type of virtual space, thereby increasing motivation to satisfy the predetermined conditions.

[0034] (15) A computer control method according to an aspect of the present invention is a method for controlling a computer (e.g., a distribution server computer 100, a viewer terminal 300, etc.) for providing a virtual space to a user, the method comprising: A step of displaying an image in the virtual space that is generated in response to an operation by the user (for example, a virtual space update data delivery process, a viewer viewpoint video output process, etc.); A step of generating an event in the virtual space (e.g., a process for arranging an object purchased in the virtual space in response to a purchase operation by a user (a virtual space update data generation process), a process for arranging and updating the purchased object in the virtual space based on the virtual space update data (a virtual space update process), etc.); a step of providing event content during a first scheduled period in a predetermined type of virtual space (e.g., in a spatial area ER5) among the virtual spaces (e.g., a virtual space update data distribution process using the event data 111, a viewer viewpoint video output process), During the first scheduled period, the generating step can cause an event to occur within the predetermined type of virtual space, and the display step can display an image within the predetermined type of virtual space in response to an operation from the user (for example, an image within spatial area ER5 can be displayed by entering spatial area ER5), and the display mode within the predetermined type of virtual space can be changed in response to the event caused within the predetermined type of virtual space (for example, arranging a flower stand FS purchased by the user within spatial area ER5 in steps S107 to S109 of FIG. 28, drawing a lottery for a flower stand FS to be displayed within spatial area ER5 in step S203 of FIG. 32, changing settings performed by an operation by the management, the display mode of a flower stand FS used in the production of a live event shown in FIG. 34 that can be changed by a user purchase in FIG. 37, etc.), a step of providing the event content again in the predetermined type of virtual space during a second scheduled period after the first scheduled period has elapsed (for example, a virtual space update data delivery process using the event data 111, a viewer viewpoint video output process, see FIG. 40 ); The step of displaying can set the display mode within the specified type of virtual space at the start of the second scheduled period to a display mode that corresponds to an event that occurred during the first scheduled period, and change the display mode within the specified type of virtual space according to the event that occurred within the specified type of virtual space during the second scheduled period (e.g., see Figure 40(a)).

[0035] According to this configuration, during the first scheduled period, the display mode in the predetermined type of virtual space in which the event content is provided can be shared among users, thereby improving interest in the event content. Also, the event content can be provided again during the second scheduled period, and the display mode in the predetermined type of virtual space at the start of the second scheduled period is set to a display mode corresponding to the event that occurred during the first scheduled period, thereby improving the interest in the event content during the second scheduled period for users who participated in the first scheduled period. Furthermore, since the display mode in the predetermined type of virtual space can be changed and shared among users according to the event that occurred in the predetermined type of virtual space during the second scheduled period, interest in the event content during the second scheduled period can be improved regardless of whether the user participated in the first scheduled period or not.

[0036] (16) A computer control method according to an aspect of the present invention is a method for controlling a computer (e.g., a distribution server computer 100, a viewer terminal 300, etc.) for providing a virtual space to a user, the method comprising: A step of displaying an image in the virtual space that is generated in response to an operation by the user (for example, a virtual space update data delivery process, a viewer viewpoint video output process, etc.); A step of generating an event in the virtual space (e.g., a process for arranging an object purchased in the virtual space in response to a purchase operation by a user (a virtual space update data generation process), a process for arranging and updating the purchased object in the virtual space based on the virtual space update data (a virtual space update process), etc.); a step of providing event content for a first scheduled period in a predetermined type of virtual space among the virtual spaces (e.g., in a spatial area ER5), and a means for providing the event content for a first scheduled period (e.g., a virtual space update data distribution process using the event data 111, a viewer viewpoint video output process), During the first scheduled period, the generating step can cause an event to occur within the predetermined type of virtual space, and the display step can display an image within the predetermined type of virtual space in response to an operation from the user (for example, an image within spatial area ER5 can be displayed by entering spatial area ER5), and the display mode within the predetermined type of virtual space can be changed in response to the event caused within the predetermined type of virtual space (for example, arranging a flower stand FS purchased by the user within spatial area ER5 in steps S107 to S109 of FIG. 28, drawing a lottery for a flower stand FS to be displayed within spatial area ER5 in step S203 of FIG. 32, changing settings performed by an operation by the management, the display mode of a flower stand FS used in the production of a live event shown in FIG. 34 that can be changed by a user purchase in FIG. 37, etc.), a step of providing the event content again in the predetermined type of virtual space during a second scheduled period after the first scheduled period has elapsed (for example, a virtual space update data delivery process using the event data 111, a viewer viewpoint video output process, see FIG. 40 ); The step of displaying can set the display mode within the specified type of virtual space at the start of the second scheduled period to a predetermined display mode regardless of an event that occurred during the first scheduled period, and change the display mode within the specified type of virtual space depending on an event that occurred within the specified type of virtual space during the second scheduled period (e.g., see Figure 40(b)).

[0037] According to this configuration, during the first scheduled period, the display mode in the predetermined type of virtual space in which the event content is provided can be shared among users, thereby improving interest in the event content. Also, the event content can be provided again during the second scheduled period, and the display mode in the predetermined type of virtual space at the start of the second scheduled period can be a predetermined display mode, so that even users who participated in the first scheduled period can participate in the event content in the second scheduled period with a fresh feeling, thereby improving interest in the event content. Furthermore, during the second scheduled period, the display mode in the predetermined type of virtual space can be changed and shared among users according to an event generated in the virtual space, thereby improving interest in the event content in the second scheduled period, regardless of whether the user participated in the first scheduled period or not.

[0038] (17) A computer control method according to one aspect of the present invention is a method for controlling a computer (e.g., a distribution server computer 100, a viewer terminal 300, etc.) for providing a virtual space to a user, the method comprising: A step of displaying an image in the virtual space that is generated in response to an operation by the user (for example, a virtual space update data delivery process, a viewer viewpoint video output process, etc.); A step of generating an event in the virtual space (e.g., a process for arranging an object purchased in the virtual space in response to a purchase operation by a user (a virtual space update data generation process), a process for arranging and updating the purchased object in the virtual space based on the virtual space update data (a virtual space update process), etc.); a step of providing event content during a first scheduled period in a predetermined type of virtual space (e.g., in a spatial area ER5) among the virtual spaces (e.g., a virtual space update data distribution process using the event data 111, a viewer viewpoint video output process), During the first scheduled period, the generating step can generate an event in the predetermined type of virtual space, and the display step can display an image in the predetermined type of virtual space in response to an operation by the user (for example, an image in a spatial area ER5 can be displayed when the user enters the spatial area ER5), and can change the display mode of the predetermined type of virtual space in response to the event generated in the predetermined type of virtual space. a step of re-providing event content in the predetermined type of virtual space even during a second scheduled period after the first scheduled period has elapsed (for example, a virtual space update data distribution process using event data 111, a viewer viewpoint video output process, see FIG. 40 ); The step of displaying can vary the display mode within the specified type of virtual space at the start of the second scheduled period depending on whether the user was a user who participated in the event content during the first scheduled period, and change the display mode within the specified type of virtual space depending on an event that occurred within the specified type of virtual space during the second scheduled period (for example, see the modified example (Regarding re-provision of content for the period before the scheduled date and for events)).

[0039] According to this configuration, during the first scheduled period, the display mode in the predetermined type of virtual space in which the event content is provided can be shared among users, thereby improving interest in the event content. Also, the event content can be provided again during the second scheduled period, and the display mode in the predetermined type of virtual space at the start of the second scheduled period can be set to a different display mode depending on whether the user participated in the event content during the first scheduled period, thereby giving each user a different sense of premium depending on whether the user participated in the first scheduled period, thereby improving interest in the event content during the second scheduled period. Furthermore, during the second scheduled period, the display mode in the predetermined type of virtual space can be changed depending on an event that occurred in the virtual space and shared among users, thereby improving interest in the event content during the second scheduled period, regardless of whether the user participated in the first scheduled period.

[0040] (18) A system according to an aspect of the present invention (a virtual space content delivery system) is a system including a computer (e.g., a delivery server computer 100, a viewer terminal 300, etc.) for providing a virtual space to a user, A means for displaying an image in the virtual space that is generated in response to an operation by the user (for example, a virtual space update data delivery process, a viewer viewpoint video output process, etc.); A means for generating an event in the virtual space (for example, a process for arranging an object purchased in the virtual space in response to a purchase operation by a user (a virtual space update data generation process), a process for arranging and updating the purchased object in the virtual space based on the virtual space update data (a virtual space update process), etc.); a means for providing event content during a first scheduled period in a predetermined type of virtual space (e.g., in a spatial area ER5) among the virtual spaces (e.g., a virtual space update data distribution process using the event data 111, a viewer viewpoint video output process), During the first scheduled period, the generating means can cause an event to occur within the predetermined type of virtual space, and the display means can display an image within the predetermined type of virtual space in response to an operation from the user (for example, an image within spatial area ER5 can be displayed by entering spatial area ER5), and the display mode within the predetermined type of virtual space can be changed in response to the event caused within the predetermined type of virtual space (for example, arranging a flower stand FS purchased by the user within spatial area ER5 in steps S107 to S109 of FIG. 28, drawing a lottery for a flower stand FS to be displayed within spatial area ER5 in step S203 of FIG. 32, changing settings performed by an operation by the management, the display mode of a flower stand FS used in the production of a live event shown in FIG. 34 that can be changed by a user purchase in FIG. 37, etc.), a means for re-providing event content in the predetermined type of virtual space even during a second scheduled period after the first scheduled period has elapsed (for example, a virtual space update data distribution process using event data 111, a viewer viewpoint video output process, see FIG. 40); The means for displaying can set the display mode within the specified type of virtual space at the start of the second scheduled period to a display mode that corresponds to an event that occurred during the first scheduled period, and can change the display mode within the specified type of virtual space depending on the event that occurred within the specified type of virtual space during the second scheduled period (e.g., see Figure 40(a)).

[0041] According to this configuration, during the first scheduled period, the display mode in the predetermined type of virtual space in which the event content is provided can be shared among users, thereby improving interest in the event content. Also, the event content can be provided again during the second scheduled period, and the display mode in the predetermined type of virtual space at the start of the second scheduled period is set to a display mode corresponding to the event that occurred during the first scheduled period, thereby improving the interest in the event content during the second scheduled period for users who participated in the first scheduled period. Furthermore, since the display mode in the predetermined type of virtual space can be changed and shared among users according to the event that occurred in the predetermined type of virtual space during the second scheduled period, interest in the event content during the second scheduled period can be improved regardless of whether the user participated in the first scheduled period or not.

[0042] (19) A system according to an aspect of the present invention (a virtual space content delivery system) is a system including a computer (e.g., a delivery server computer 100, a viewer terminal 300, etc.) for providing a virtual space to a user, A means for displaying an image in the virtual space that is generated in response to an operation by the user (for example, a virtual space update data delivery process, a viewer viewpoint video output process, etc.); A means for generating an event in the virtual space (for example, a process for arranging an object purchased in the virtual space in response to a purchase operation by a user (a virtual space update data generation process), a process for arranging and updating the purchased object in the virtual space based on the virtual space update data (a virtual space update process), etc.); a means for providing event content during a first scheduled period in a predetermined type of virtual space (e.g., in a spatial area ER5) among the virtual spaces (e.g., a virtual space update data distribution process using the event data 111, a viewer viewpoint video output process), During the first scheduled period, the generating means can cause an event to occur within the predetermined type of virtual space, and the display means can display an image within the predetermined type of virtual space in response to an operation from the user (for example, an image within spatial area ER5 can be displayed by entering spatial area ER5), and the display mode within the predetermined type of virtual space can be changed in response to the event caused within the predetermined type of virtual space (for example, arranging a flower stand FS purchased by the user within spatial area ER5 in steps S107 to S109 of FIG. 28, drawing a lottery for a flower stand FS to be displayed within spatial area ER5 in step S203 of FIG. 32, changing settings performed by an operation by the management, the display mode of a flower stand FS used in the production of a live event shown in FIG. 34 that can be changed by a user purchase in FIG. 37, etc.), a means for re-providing event content in the predetermined type of virtual space even during a second scheduled period after the first scheduled period has elapsed (for example, a virtual space update data distribution process using event data 111, a viewer viewpoint video output process, see FIG. 40); The means for displaying can set the display mode within the specified type of virtual space at the start of the second scheduled period to a predetermined display mode regardless of an event that has occurred during the first scheduled period, and can change the display mode within the specified type of virtual space depending on an event that has occurred within the specified type of virtual space during the second scheduled period (e.g., see Figure 40(b)).

[0043] According to this configuration, during the first scheduled period, the display mode in the predetermined type of virtual space in which the event content is provided can be shared among users, thereby improving interest in the event content. Also, the event content can be provided again during the second scheduled period, and the display mode in the predetermined type of virtual space at the start of the second scheduled period can be a predetermined display mode, so that even users who participated in the first scheduled period can participate in the event content in the second scheduled period with a fresh feeling, thereby improving interest in the event content. Furthermore, during the second scheduled period, the display mode in the predetermined type of virtual space can be changed and shared among users according to an event generated in the virtual space, thereby improving interest in the event content in the second scheduled period, regardless of whether the user participated in the first scheduled period or not.

[0044] (20) A system according to an aspect of the present invention (a virtual space content delivery system) is a system including a computer (e.g., a delivery server computer 100, a viewer terminal 300, etc.) for providing a virtual space to a user, A means for displaying an image in the virtual space that is generated in response to an operation by the user (for example, a virtual space update data delivery process, a viewer viewpoint video output process, etc.); A means for generating an event in the virtual space (for example, a process for arranging an object purchased in the virtual space in response to a purchase operation by a user (a virtual space update data generation process), a process for arranging and updating the purchased object in the virtual space based on the virtual space update data (a virtual space update process), etc.); a means for providing event content during a first scheduled period in a predetermined type of virtual space (e.g., in a spatial area ER5) among the virtual spaces (e.g., a virtual space update data distribution process using the event data 111, a viewer viewpoint video output process), During the first scheduled period, the generating means is capable of generating an event in the predetermined type of virtual space, and the display means is capable of displaying an image in the predetermined type of virtual space in response to an operation by the user (for example, entering a spatial area ER5 and displaying an image in the spatial area ER5), and changing a display mode in the predetermined type of virtual space in response to the event generated in the predetermined type of virtual space. a means for re-providing event content in the predetermined type of virtual space even during a second scheduled period after the first scheduled period has elapsed (for example, a virtual space update data distribution process using event data 111, a viewer viewpoint video output process, see FIG. 40); The means for displaying can change the display mode within the specified type of virtual space at the start of the second scheduled period depending on whether or not the user was a user who participated in the event content during the first scheduled period, and can change the display mode within the specified type of virtual space depending on an event that occurred within the specified type of virtual space during the second scheduled period (for example, see the modified example (Regarding re-provision of content for the period before the scheduled date and for the event)).

[0045] According to this configuration, during the first scheduled period, the display mode in the predetermined type of virtual space in which the event content is provided can be shared among users, thereby improving interest in the event content. Also, the event content can be provided again during the second scheduled period, and the display mode in the predetermined type of virtual space at the start of the second scheduled period can be set to a different display mode depending on whether the user participated in the event content during the first scheduled period, thereby giving each user a different sense of premium depending on whether the user participated in the first scheduled period, thereby improving interest in the event content during the second scheduled period. Furthermore, during the second scheduled period, the display mode in the predetermined type of virtual space can be changed depending on an event that occurred in the virtual space and shared among users, thereby improving interest in the event content during the second scheduled period, regardless of whether the user participated in the first scheduled period. [Brief description of the drawings]

[0046] [Figure 1] 1 is a block diagram showing an example of a system configuration of a virtual space content delivery system according to an embodiment of the present invention. [Diagram 2] 1 is a diagram illustrating an example of the configuration of a delivery server computer in a virtual space content delivery system according to an embodiment of the present invention. [Diagram 3] 2 is a diagram showing various data stored in a storage device of a delivery server computer according to an embodiment of the present invention; FIG. [Figure 4] 2 is a diagram illustrating an example of the configuration of a performer terminal in the virtual space content distribution system according to the embodiment of the present invention. FIG. [Diagram 5] 2 is a diagram illustrating an example of the configuration of a viewer terminal in the virtual space content delivery system according to the embodiment of the present invention. [Figure 6] 2 is a diagram illustrating an example of the configuration of an administrator terminal in the virtual space content delivery system according to the embodiment of the present invention. FIG. [Figure 7]3 is a diagram showing an example of a configuration of event data in the virtual space content delivery system according to the embodiment of the present invention; FIG. [Figure 8] 2 is a diagram showing an example of the configuration of performer user data in the virtual space content distribution system according to the embodiment of the present invention. FIG. [Figure 9] 2 is a diagram showing an example of the configuration of viewer user data in the virtual space content delivery system according to the embodiment of the present invention. FIG. [Figure 10] 2 is an explanatory diagram showing data exchanged between each terminal and a server computer constituting the virtual space content distribution system according to the embodiment of the present invention; FIG. [Figure 11] 1 is a schematic diagram showing studio facilities used by performer users in a virtual space content delivery system according to an embodiment of the present invention. FIG. [Figure 12] FIG. 2 is a diagram showing an overall image of a virtual space according to an embodiment of the present invention. [Figure 13] 1 is a diagram showing a virtual live venue, which is a virtual space used in a virtual space content distribution system according to an embodiment of the present invention. FIG. [Figure 14] 1A to 1C are diagrams illustrating examples of displays on a viewer terminal constituting a virtual space content delivery system according to an embodiment of the present invention. [Figure 15] 1A to 1C are diagrams illustrating examples of displays on a viewer terminal constituting a virtual space content delivery system according to an embodiment of the present invention. [Figure 16] 1A to 1C are diagrams illustrating examples of displays on a performer terminal constituting a virtual space content distribution system according to an embodiment of the present invention. [Figure 17] 1A to 1C are diagrams illustrating an example of a display by a zoom operation on a viewer terminal constituting the virtual space content delivery system according to an embodiment of the present invention. [Figure 18] 1A to 1C are diagrams illustrating an example of a display by a zoom operation on a viewer terminal constituting the virtual space content delivery system according to an embodiment of the present invention. [Figure 19] 1A to 1C are diagrams illustrating examples of displays on a viewer terminal constituting a virtual space content delivery system according to an embodiment of the present invention. [Figure 20]A figure showing an example of the display of a flying performance period on a viewer terminal constituting a virtual space content distribution system according to an embodiment of the present invention. [Figure 21] 11 is a flow diagram showing an example of a viewer viewpoint video control process executed in a viewer terminal constituting the virtual space content delivery system according to an embodiment of the present invention. FIG. [Figure 22] FIG. 13 is a diagram showing a virtual live concert venue in a modified example. [Figure 23] FIG. 13 shows a participation position selection screen for a virtual live concert venue in a modified example. [Figure 24] FIG. 2 is a diagram showing an example of an overhead view of a predetermined type of virtual space according to an embodiment of the present invention. [Diagram 25] FIG. 2 is a diagram showing an example of a display aspect of a predetermined type of virtual space according to an embodiment of the present invention. [Figure 26] FIG. 13 is a diagram showing an example of a display mode during a purchase process of an object displayed in a virtual space according to an embodiment of the present invention. [Figure 27] 11 is a table showing an example of object types and user-related information used in a purchasing process for an object displayed in a virtual space according to an embodiment of the present invention. [Figure 28] FIG. 11 is a flow diagram showing an example of a purchasing process for an object displayed in a virtual space according to an embodiment of the present invention. [Figure 29] 1A to 1C are diagrams illustrating an example of a transition of a display mode of an object displayed in a predetermined type of virtual space according to an embodiment of the present invention. [Diagram 30] 13A to 13C are diagrams illustrating another example of a transition of a display mode of an object displayed in a predetermined type of virtual space according to an embodiment of the present invention. [Diagram 31] 11 is a table showing an example of an association between an object displayed in a virtual space of a predetermined type and a predetermined area according to the embodiment of the present invention. [Diagram 32] FIG. 11 is a flowchart showing an example of a switching process of an object displayed in a predetermined type of virtual space according to an embodiment of the present invention. [Diagram 33]FIG. 11 is a flowchart showing an example of a switching process of an object displayed in a predetermined type of virtual space according to an embodiment of the present invention. [Diagram 34] 13A to 13C are diagrams illustrating another example of a transition of a display mode of an object displayed in a predetermined type of virtual space according to an embodiment of the present invention. [Diagram 35] FIG. 2 is a diagram showing an example of event content provided in a predetermined type of virtual space according to an embodiment of the present invention. [Diagram 36] 11 is a diagram showing an example of a table relating to objects displayed in event content provided in a predetermined type of virtual space according to an embodiment of the present invention. FIG. [Figure 37] 11A to 11C are diagrams illustrating an example of a process for determining an object to be displayed in event content provided in a predetermined type of virtual space according to an embodiment of the present invention. [Figure 38] 11 is a diagram showing an example of a table used in processing related to event content provided in a predetermined type of virtual space according to an embodiment of the present invention. FIG. [Figure 39] 11 is a flow diagram showing an example of processing related to event content provided in a predetermined type of virtual space according to an embodiment of the present invention. FIG. [Diagram 40] 11 is a diagram for explaining a period before the scheduled date and re-provision of event content according to an embodiment of the present invention. FIG. [Diagram 41] FIG. 4 is a flow chart showing an example of a special switching process of the present invention. [Diagram 42] FIG. 11 is a flow chart showing an example of a room entry exception process according to the present invention. [Diagram 43] FIG. 11 is a flow diagram illustrating an example of a component reset process according to the embodiment of the present invention. [Diagram 44] FIG. 13 is a diagram showing an example of a screen for performing an action on an object displayed in a predetermined type of virtual space according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0047] A description will be given below of an embodiment of a virtual space content distribution system for distributing various contents in a virtual space according to the present invention with reference to the drawings. Note that the same or similar components in the drawings are given the same reference numerals, and duplicated descriptions will be omitted. The distribution program executed in the virtual space content distribution system according to the present invention may be a program used in the entire system consisting of a server computer and each terminal that constitute the virtual space content distribution system, which will be described later, or may be a program that operates only on a part of the devices that constitute the virtual space content distribution system, such as the server computer or each terminal. EXAMPLES

[0048] FIG. 1 is a block diagram showing an example of the system configuration of a virtual space content distribution system in an embodiment which is one embodiment of the present invention. In the system of this embodiment shown in FIG. 1, a performer avatar 1 corresponding to a performer user is distributed as virtual space content that carries out events such as live performances, games, social gatherings, and movie screenings within the virtual space.

[0049] As shown in FIG. 1, the virtual space content distribution system of this embodiment is mainly composed of a distribution server computer 100 capable of executing various processes related to the virtual space and various processes related to the provision and distribution of the virtual space, an administrator terminal 150 used by an event manager K of an event management organization that operates and manages events in the virtual space to manage the distribution of events in the virtual space, a performer terminal 200 used by performer users, and a viewer terminal 300 that can be used by viewer users who enter and participate in the virtual space (e.g., log in to the virtual space) and view the event content in the virtual space, and the distribution server computer 100, administrator terminal 150, performer terminal 200 and viewer terminal 300 are connected to each other so that they can communicate data with each other via the Internet N, which is an open computer network.

[0050] In this embodiment, the administrator terminal 150 and the performer terminal 200 are also shown as being connected to the distribution server computer 100 via the Internet network N, but the present invention is not limited to this. For example, in a case where an event management organization provides studios to performer users and the distribution server computer 100 is installed in these studios, the administrator terminal 150 and the performer terminal 200 may be locally connected to the distribution server computer 100 for data communication, or may be connected for communication via a local area network LAN within the studio facility.

[0051] As shown in Fig. 1, there are multiple viewer users, such as viewer user A, viewer user B, viewer user C, etc., and viewer terminals 300 include viewer terminals 300a, 300b, 300c, etc. that can be used by each of viewer users A, B, C, etc. Although there are usually multiple viewer users, there may be one or four or more, and the number may be appropriately determined depending on the type of event content provided in the virtual space. Hereinafter, viewer user A, viewer user B, viewer user C, etc. may be collectively referred to as viewer users, and viewer terminals 300a, 300b, 300c, etc. may be collectively referred to as viewer terminals 300.

[0052] In addition, in this embodiment, an example is shown in which there is one performer user, but the present invention is not limited to this. The event content provided in the virtual space may be a joint event in which multiple performer users who are acting alone participate, or a group event in which multiple groups of people who are acting together participate. In this way, when multiple performers appear, performer terminal 200a, performer terminal 200b, performer terminal 200c, etc. may be provided for each performer user, or when a group of multiple people appears, one performer terminal 200 may be used by multiple people. Note that a performer user (also called a talent user) is a user who serves as a speaker, a host, a facilitator, a leading role, etc. in the event content. The event content is advanced by avatars who act as facilitators, such as a performer avatar corresponding to the actions of the performer user and an operator avatar corresponding to the operations of an operator (also called an operator user) who manages the event.

[0053] In addition, while FIG. 1 illustrates the distribution server computer 100 as a single unit, the present invention is not limited to this, and these distribution server computers 100 may be configured with multiple server computers, such as a first server computer that mainly performs virtual space processing and a second server computer that mainly performs distribution processing, or may be configured as a cloud server, etc., and the number of server computers may be changed appropriately depending on the scale of the event, the number of participating viewer users, etc.

[0054] Similarly, although the administrator terminal 150 is illustrated as a single unit in FIG. 1, the present invention is not limited to this, and it goes without saying that there may be multiple administrator terminals 150 depending on the number of performer users and viewer users participating in event content such as a live performance.

[0055] <Distribution server computer> Fig. 2 is a diagram showing the configuration of a distribution server computer 100 used in this embodiment. As described above, the distribution server computer 100 used in this embodiment is a normal server computer with relatively excellent processing power installed in a studio operated by an event management organization, and as shown in Fig. 2, it has a processor (CPU) 101 connected to a data bus 108, a memory (RAM) 102, a storage 103 such as a hard disk, a communication interface (I / F) 104 capable of two-way communication by TCP / IP protocol via the Internet, which is an open computer network, and an input / output interface (I / F) 105 to which an input device such as a keyboard can be connected.

[0056] In this embodiment, an input / output interface (I / F) 105 is provided to enable local operation, but if remote operation is possible via a communication interface (I / F) 104, the input / output interface (I / F) 105 may not be provided.

[0057] In addition to an operation system (server OS) for providing server functions (not shown), various data and programs are stored in storage 103 of distribution server computer 100 as shown in Fig. 3. Specifically, mainly stored are an event management program 110 for providing an event management function for managing various events, a virtual space generation program 120 for providing a virtual space for an event venue, a performer user management program 130 for providing a performer user management function for managing performer users, and a viewer user management program 132 for providing a viewer user management function for managing viewer users.

[0058] The event management program 110 is a program for managing events held at an event venue in cooperation with the administrator terminal 150, and is capable of managing the progress of the event by using event data 111 (see FIG. 7), time schedule data (TS data) 112, music data 113, etc., which are stored in the storage 103 together with the event management program 110.

[0059] The event data 111 used in this embodiment is illustrated in Fig. 7. The event data 111 stores information such as an event name, a file name of time schedule (TS) data, a performer ID uniquely assigned to a performer user who is a performer, a file name of a music list, etc., a file name of a participating viewer list in which information of special viewer users permitted to participate in virtual participation is registered in a third area of ​​a virtual audience area described later, and a file name of a participating viewer list in which information of viewer users who have reserved virtual participation is registered in a fourth area of ​​a virtual audience area described later. The event data also includes information for specifying the date and time when the event is held, and the event content is distributed at the date and time. The event data also includes information for specifying the date and time when the virtual space in which the event is held is released for content that users can enter by releasing the virtual space before the scheduled date of the event.

[0060] The time schedule data (TS data) 112 is data in which the order of progress of the virtual space live event to be held and the programs such as songs are described in chronological order, and the virtual space live event is managed so that it progresses based on the time schedule described in the time schedule data (TS data) 112. Moreover, the time schedule data (TS data) 112, event data 111, etc. can be changed, updated, or added by the event manager K operating the manager terminal 150.

[0061] Furthermore, the song data 113 is data for the performance parts (so-called karaoke) of each song sung by the performer user, and is played by the audio control program 124 (described later) based on the time schedule data (TS data) 112 by the event management program 110, and transmitted to the performer terminal 200 and the viewer terminal 300 (see FIG. 11).

[0062] The virtual space generation program 120 is a program for providing an event venue which is a virtual space, and has the function of providing an event venue in which performer avatars and viewer avatars are virtually participating, using virtual space data 121 describing the structure of the event venue etc. which is stored in storage 103 together with the virtual space generation program 120, object data 122 for placing various objects to be placed in the event venue (including star decorations 43 on the stage and star objects 50-52 in the sky) within the virtual space, and performer avatar data contained in performer user data 131 described below and viewer avatar data contained in viewer user data 133.

[0063] 13, viewpoint image control program 123 is a program for providing a function to generate viewpoint images from virtual cameras C1-C4 virtually set in the event venue and a virtual camera moving in the air (not shown), as well as a function to display images from the viewpoints of viewer avatars 11-14 virtually participating in the third area of ​​the event venue and viewer avatars 21-32 virtually participating in the fourth area on performer terminal 200 in cooperation with viewer terminal 300. Virtual camera C2 is a virtual camera set to provide an image from the viewpoint of performer avatar 1 on the stage of the event venue, and the viewpoint image from virtual camera C2 is projected onto a screen S installed in the studio by projector 211 (described later) connected to viewer terminal 300.

[0064] The audio control program 124 is a program for controlling the audio (including music) distributed during events in virtual space, and specifically provides a function for playing music data 113 and a function for synthesizing audio produced by a performer user with the played music and distributing it to the administrator terminal 150 and the viewer terminal 300.

[0065] The comment control program 125, in cooperation with a viewer comment control program stored in the viewer terminal 300 described below, provides a function for displaying in chronological order on the performer terminal 200 and the viewer terminal 300 various comments entered by each viewer user in the viewer terminal 300 during an event in a virtual space.

[0066] The gift control program 126 is a program for controlling gifts given from viewer users to performer users in cooperation with a viewer program stored in the viewer terminal 300 described below, and specifically provides a function for the viewer user to purchase gifts (e.g., purchase of objects, etc.) based on purchase price information set for various gifts stored in the gift data 134, a processing function for the viewer user to give to the performer user a gift purchased using the gift object data included in the gift data 134 (including processing of the presentation when giving the gift, etc.), and a processing function for changing the owner of a gift given from the viewer user to the performer user, etc.

[0067] The performer user management program 130 provides a management function for information relating to performer users, an authentication function, and the like, based on performer user data 131 shown in FIG. 8, which is stored in the storage 103 together with the performer user management program 130 .

[0068] The performer user data 131 used in this embodiment is illustrated in Fig. 8. The performer user data 131 stores various information, such as the performer user's account (email address), name, authentication information, the file name of the avatar data of the avatar used in the virtual space, and the file name of the item list in which the items owned are registered, in association with a performer user ID uniquely assigned to the performer user. Although not shown in Fig. 8, information on virtual value such as points owned by each performer user may also be stored as the performer user data 131.

[0069] Performer users can be authenticated by matching their performer user ID, account, and authentication information, and each performer user can identify from an item list the items (gifts) that they own as a result of being given to them by viewers.

[0070] The viewer / user management program 132 provides functions such as management of information relating to viewer / users and authentication based on viewer / user data 133 shown in FIG. 9 stored in the storage 103 together with the program.

[0071] The viewer user data 133 used in this embodiment is illustrated in Fig. 9. The viewer user data 133 stores various information, such as the viewer user's account (email address), authentication information, the file name of the avatar data of the avatar to be used in the virtual space, owned points which are the number of points that can be used in the virtual space, the file name of an item list in which items (gifts) purchased using points are registered, and personal information such as name, date of birth, and telephone number, in association with a viewer user ID uniquely assigned to the viewer user. Although not shown in Fig. 9, a nickname (comment name) to be displayed together with a comment is also registered in the viewer user data 133, and the nickname (comment name) is displayed together with the comment. In addition, points can be increased by purchasing points, for example, from a predetermined operating company.

[0072] <Performer terminal> Fig. 4 is a diagram showing an example of the configuration of a performer terminal 200 in the virtual space content delivery system of this embodiment. In this embodiment, as shown in Fig. 11, the performer terminal 200 is installed in a control room adjacent to a studio where a performer user performs his / her acting motion, and uses a normal computer with relatively excellent processing power, and as shown in Fig. 4, has a processor (CPU) 201 connected to a data bus 208, a memory (RAM) 202, a storage 203 such as a hard disk, a communication interface (I / F) 204 capable of two-way communication by the TCP / IP protocol via the Internet, which is an open computer network, an image processing unit 206 including a graphics processing unit (GPU) to which display devices A210 to C212 are connected, and an input / output interface (I / F) 205 to which various input / output devices are connected.

[0073] The input / output interface (I / F) 205 is connected with input devices such as a motion sensor 220 including multiple wearable sensors 220C1-220C5 (see FIG. 11) worn by the performer user on the left and right limbs and waist, a facial expression input device 221 consisting of an imaging camera for inputting the performer's facial expressions, a voice input device 222 consisting of a sound collecting microphone worn on the performer user's head, and an operation input device 224 such as a keyboard or touch panel operable by an assistant operator O who assists the performer user. Note that by providing a controller that can be held by the performer user to perform various operations as these input devices, the performer himself may be able to perform various operations without the assistance of the assistant operator O.

[0074] In this embodiment, since the performer user performs performance actions (music actions) in accordance with the music, an assistant operator O assists with operations during the performance. However, it is also possible to have multiple assistant operators O, or to set the operation content in advance in the performer terminal 200, for example, in a sequence program, thereby eliminating the need for an assistant operator O.

[0075] An audio output device 223 including high-performance earphones (in-ear monitors) worn by the performer user and speakers placed in the control room is connected to the input / output interface (I / F) 205 as an output device, so that the sound of the played music transmitted from the distribution server computer 100 is output to the performer user via the high-performance earphones (in-ear monitors), and the music audio is output from the speakers along with the performer's voice, allowing an assistant operator O, etc. to check the status of the music, including the voice produced by the performer user, in the control room.

[0076] In this embodiment, high-performance earphones (in-ear monitors) are used to avoid the inconvenience caused by the played music audio being input from the sound collection microphone worn by the performer user, but the present invention is not limited to this, and the music audio may be output from speakers in the studio, etc., as long as the inconvenience caused by the input of the music audio can be avoided.

[0077] In this embodiment, the sound collecting microphones are worn by the performers, but these sound collecting microphones may be fixed to the floor, wall, or ceiling of the studio.

[0078] Here, the motion sensor 220 used in the performer terminal 300 of this embodiment will be described. Any motion sensor can be used as long as it can properly detect (measure) the body movements (movements) of the performer user. In this embodiment, in order to enable more accurate and shorter periodic detection of the performer's movements, a number of wearable sensors 220C1 to 220C5 are used that are worn by the performer user on the body. Note that the motion sensor 220 may be of a type that does not require the performer to wear any equipment, such as LiDAR that uses laser light or the like.

[0079] In this embodiment, in order to reduce the burden on the performer user's head, particularly the burden on the performer user's head, caused by wearing sensors when performing movements, as described below, the performer user's head movements are detected by image recognition using images captured by the imaging camera constituting the facial expression input device 221, and movements other than the head are detected using five wearable sensors 220C1 to 220C5. However, for example, wearable sensors may also be provided on the performer user's head, or more wearable sensors (seven or more) may be worn to detect more detailed movements.

[0080] As shown in FIG. 11, the mounting sensors 220C1 to 220C5 detect their own positions and orientations in cooperation with base stations 220a and 220b installed in a studio room separated from the adjacent control room by a glass window.

[0081] Base station 220a and base station 220b may use, for example, a multi-axis laser emitter. Base station 220a may emit a flashing light for synchronization, and then scan the laser light around, for example, a vertical axis. Base station 220b may scan the laser light around, for example, a horizontal axis.

[0082] Each of the mounting sensors 220C1 to 220C5 may include a plurality of optical sensors that detect the incidence of blinking light and laser light from the base station 220a and the base station 220b.

[0083] Each of the wearing sensors 220C1 to 220C5 is capable of detecting its own position and orientation based on the time difference between the timing of the incidence of the flashing light and the timing of the incidence of the laser light, the light reception time at each optical sensor, the incidence angle of the laser light detected by each optical sensor, and other information as necessary. For example, the ViveTracker or base station provided by HTC CORPORATION can be suitably used.

[0084] Base station 220a and base station 220b emit blinking light and perform laser light scanning at regular intervals, so that the detection information of each of worn sensors 220C1-220C5 is updated at each interval. Detection information indicating the position and orientation of each motion sensor calculated in each of these worn sensors 220C1-220C5 is input to performer terminal 200 by short-range wireless communication and transmitted to distribution server computer 100 as performer avatar information together with facial motion information (see FIG. 10).

[0085] In this embodiment, an example is shown in which two base stations, base station 220a and base station 220b, but the present invention is not limited to this, and the number of base stations may be three or more.

[0086] In addition, the motion sensor 220 may be configured such that each of multiple motion sensors worn by the performer user is equipped with a number of infrared LEDs or visible light LEDs, and the position and orientation of each of the motion sensors is detected by detecting the light from these LEDs with an infrared camera installed on the floor or wall of the studio.

[0087] Also, in order to reduce the burden on the performer user, the motion sensor 220 may be replaced with a motion sensor using a lighter reflective marker instead of the wearable sensors 220C1-220C5. That is, the motion sensor may detect the motion of the performer user by capturing images of reflective markers attached to various parts of the performer user's body with adhesive tape or the like to generate image data, and then processing the captured image data to detect the positions and orientations of the reflective markers. In this case, a cameraman who captures the performer user may be placed in the studio to capture the performer user's motion from a direction suitable for detection, so that the motion of the performer user can be detected well.

[0088] In addition, the motion sensor 220 may be a suit with a built-in inertial sensor, such as a suit with a built-in inertial sensor for the MVN motion capture system marketed by Xsens.com, and the movements of the performer user may be detected by analyzing the sensor signal output from the inertial sensor.

[0089] Any facial expression input device 221 can be used as long as it can appropriately detect the movement of the head including the face of the performer user. In this embodiment, specifically, it is configured with an imaging camera (digital camera) arranged so as to be able to continuously capture head images including the face of the performer user, and the head movement and facial movement (facial expression) of the performer user captured by the imaging camera are detected by image recognition, and the facial motion information, which is the detected head movement and facial movement (facial expression), is transmitted to the delivery server computer 100 as performer avatar information together with body motion information, as shown in Fig. 10.

[0090] The facial expression input device 221 is not limited to the imaging camera (digital camera) used in this embodiment, and may be, for example, a 3D camera capable of detecting the depth of a person's face, or may be a mobile terminal such as a smartphone equipped with a LiDER device. In this case, the performer user may wear such a mobile terminal.

[0091] As described above, the performer terminal 200 of this embodiment has three display devices A210 to C212. Display device A210 is an LCD monitor or the like installed in a control room as shown in FIG. 11, display device B211 is a projector that projects images onto a screen S installed in the studio, and display device C212 is a large vertical display installed adjacent to the screen S in the studio.

[0092] Display device A210, which is placed in the adjustment room of the studio, displays images from each viewpoint of virtual cameras C1 to C4, viewpoint images from a virtual camera moving in the air during the flying performance period described below, the contents of comments, and a message input window into which assistant operator O inputs any message he or she wishes to convey to the performer user.

[0093] Meanwhile, on the screen S projected from a projector, which is a display device B211 installed in the studio, an image from the viewpoint of the virtual camera C2 (see Figure 13), which is the viewpoint of the performer, is displayed, for example, as shown in Figure 16, including avatars of viewers who are virtually participating in the live broadcast in the third and fourth areas, thereby enabling the performer user to check the status of the viewer users who are virtually participating in the virtual space live broadcast through the image.

[0094] In addition, comments from viewer users, as well as comments and messages entered by the assistant operator O, are displayed on a display device C212 installed in the studio, allowing the performer user to check the comments from viewer users and messages from the assistant operator O even during the performance.

[0095] In addition to an operating system (OS) for operating the computer that is the performer terminal 200, the storage 203 also stores performer programs that, when executed by the processor (CPU) 201 etc., work in cooperation with the distribution server computer 100 to provide various functions, including the function of allowing the performer user to control the movement of the performer avatar 1 in the virtual space live, which is the virtual space content.

[0096] As shown in FIG. 4, the performer programs include a performer avatar control program, a performer viewpoint image control program, a performer viewpoint image control program, a performer voice control program, a performer comment control program, performer authentication data, etc.

[0097] The performer avatar control program is a program that mainly provides the function of scanning the body motion of the performer user using the motion sensor 220 and scanning the facial motion (facial expression) of the performer user using the facial expression input device 221, generating performer avatar information for operating the performer avatar, and transmitting it to the distribution server computer 100.

[0098] The performer's viewpoint image control program is a program that provides a function for generating and outputting a viewpoint image of virtual camera C2, which is the performer's viewpoint, based on the virtual space update data distributed from distribution server computer 100.

[0099] The performer's audio control program is a program that provides the function of outputting the playback sound of a song based on the playback music data distributed from the distribution server computer 100 via the audio output device 223, converting the audio input from the audio input device 222 into data and transmitting it to the distribution server computer 100 as performer audio data, and generating and outputting monitor audio consisting of the playback sound of the song and the performer's audio.

[0100] The performer's comment control program is a program that provides a function for displaying each comment by an audience user that is distributed from the distribution server computer 100 .

[0101] The performer authentication data is data for authenticating the identity of the performer user in a communication connection with the distribution server computer 100 .

[0102] In addition, the performer avatar control program includes a motion parameter generation program capable of generating parameter information for the position and rotation angle of the bones that make up the rig data (sometimes called "skeleton data") that indicates the skeleton of the performer avatar contained in the performer avatar data, as well as an image recognition processing program for image-recognizing the position of the performer user's head and facial expression from images captured by an imaging camera.

[0103] In addition, in this embodiment, the performer terminal 200 is illustrated as a form in which a computer serving as performer terminal 200 installed in a studio operated by an event management organization is used jointly by multiple performer users to hold a live event, and each performer user can use the computer as their own performer terminal 200 by inputting performer authentication data; however, the present invention is not limited to this, and the performer terminal 200 may be used only by the performer user who owns it, such as when a performer user appears in a virtual space live event from their home or the like, and the performer terminal 200 is a computer installed in the performer user's home and dedicated to the performer user's own use, and in such cases, it is not necessarily necessary to store performer authentication data.

[0104] In this way, by having a performer user or the like use the performer terminal 200 that constitutes the virtual space content distribution system of this embodiment, the performer user can cause the performer avatar 1 placed on the virtual stage G at the event venue to move in conjunction with the performer user's own movements, can reflect his or her own facial expressions in the facial expressions of the performer avatar 1, and can distribute his or her own voice as the voice of the performer avatar 1 to viewers via the distribution server computer 100.

[0105] <Viewer device> Fig. 5 is a diagram showing an example of the configuration of a viewer terminal 300 in the virtual space content delivery system of this embodiment. In this embodiment, the viewer terminal 300 is a smartphone P carried by a viewer user or a regular desktop computer (PC) installed at a viewer user's home or the like, and as shown in Fig. 5, has a processor (CPU) 301 connected to a data bus 308, a memory (RAM) 302, a storage 303 such as a hard disk or non-volatile memory, a communication interface (I / F) 304 capable of two-way communication by TCP / IP protocol via the Internet, which is an open computer network, an image processing unit 306 including a graphics processing unit (GPU) to which a display device 310 is connected, and an input / output interface (I / F) 305 to which various input / output devices are connected.

[0106] The display device 310 may display each viewpoint video generated based on the virtual space data of the event venue, which is a virtual space updated by the virtual space update data (see FIG. 10) distributed from the distribution server computer 100, by the viewer viewpoint video control program included in the viewer program stored in the storage 303, as described later, and the flying viewpoint video distributed from the distribution server computer 100 during the flying performance period described later. If the viewer terminal 300 is a smartphone P, the display device 310 corresponds to the display device of the smartphone P, and if the viewer terminal 300 is a normal computer (PC), the display device 310 corresponds to the display device of the stationary type constituting the computer (PC). Note that these displays are not limited to those that display planar images (2D images), and may be, for example, those that can display stereoscopic images (3D images) by displaying right-eye images and left-eye images, such as a head-mounted display (HMD) that can be worn by the viewer.

[0107] The input / output interface (I / F) 305 is connected to an operation input device 321 consisting of one or more devices that allow the viewer to perform various operations as input devices, and an audio output device 322 such as earphones or speakers that can output live audio, etc., distributed from the distribution server computer 100.

[0108] It goes without saying that the audio output device 322 need not be an independent device, but may be integrated with the display device 310 like the above-mentioned head mounted display (HMD).

[0109] The operation input device 321 may be any device that allows the viewer to perform various operations such as motion operations including moving the viewer avatar, zoom operations, operations related to comments, operations related to gifts, etc., and may be composed of at least one of, for example, a transparent touch panel formed on the display surface of a smartphone, a keyboard constituting a computer, a game controller, etc.

[0110] In this embodiment, as described below, the virtual audience area at the event venue is divided into a third area near the virtual stage G in which only viewer users who have been specially permitted by the performer user can virtually participate, and a fourth area around the third area in which general viewer users can virtually participate, as shown in FIG. 13, and a viewer user who virtually participates in the fourth area may have an operation input device 321 such as a touch panel, keyboard, game controller, etc., as described above, but a viewer user who virtually participates in the third area possesses an operation input device 321 such as an MVN motion capture suit equipped with the above-mentioned inertial sensor, and is a viewer user who, like a performer user, can precisely move the viewer avatar with their own movements.

[0111] However, even viewer users who are permitted to virtually participate in the third area cannot change the facial expression of the viewer avatar, but the present invention is not limited to this, and the facial expressions of these viewer avatars may be changed, for example, as described above, by the viewer user using the camera function of a smartphone or a camera connected to a computer to recognize the facial expression of the viewer user, even if it is to a different level than the level of change made by the performer user.

[0112] The various input / output devices connected to the input / output interface (I / F) 305 may be built-in or external, and in the case of external devices, the connection form may be either wired or wireless.

[0113] In addition to an operating system (OS) for operating the viewer terminal 300, which is a smartphone or computer, the storage 303 also stores a viewer program as a viewing application that, when executed by a processor (CPU) 301 or the like, works in cooperation with the distribution server computer 100 to provide various functions, including a live viewing function for viewer users in the virtual space live content, which is virtual space content.

[0114] As shown in FIG. 5, the viewer program includes a viewer viewpoint image control program which provides the function of generating each viewpoint image of the virtual space live to be displayed on the display device 310, a viewer audio control program which provides the function of outputting live audio from the audio output device 322 based on the live audio (data) of the virtual space live distributed from the distribution server computer 100, a viewer comment control program which displays comments based on comment data distributed from the distribution server computer 100 and provides functions related to comments such as comments entered by the viewer and sending them to the distribution server computer 100, and viewer authentication data for authenticating the identity of the viewer user in a communication connection with the distribution server computer 100.

[0115] In addition to the above-mentioned programs, although not shown in Figure 5, the virtual space may include a gift control program that controls gifts and the placement of objects in the virtual space, a program for purchasing tickets for a viewer avatar to virtually participate in an event, and an area designation program for reserving an area (position) at the event venue where a viewer avatar will virtually participate in the event in advance, as shown in Figures 22 and 23, before the event starts, but other programs may also be included.

[0116] In this embodiment, the comments input by the viewer are short messages in text format, but are not limited to these short messages in text format and may be, for example, still image messages, video messages, or any other electronic message format. The comments are displayed on the display device 310, superimposed on each viewpoint video.

[0117] In this way, by using the viewer terminal 300 that constitutes the virtual space content distribution system of this embodiment, a viewer user can move and operate the viewer avatar that is virtually participating in the event venue, and by changing the viewpoint of the viewer avatar, the viewpoint image displayed on the display device 310 can be changed, and the zoom state (viewpoint state) can also be changed, allowing the viewer user to operate the viewer avatar to cheer on the performer avatar 1.

[0118] It should be noted that a viewer avatar who has virtually participated in the third area is only allowed to move within the third area, and cannot move to the fourth area. On the other hand, a viewer avatar who has virtually participated in the fourth area is only allowed to move within the fourth area, and cannot move to the third area. However, the present invention is not limited to this, and a viewer avatar who has virtually participated in three areas may be allowed to move to the fourth area. It should be noted that a viewer avatar cannot naturally move to the virtual stage G, etc., so the visibility of the performer avatar 1 is not obstructed by the viewer avatar moving onto the virtual stage G.

[0119] In addition, by displaying viewpoint images on these display devices 310 and outputting live audio, the user can enjoy a virtual space live event with the feeling that he or she is actually present at the event venue.

[0120] Although detailed explanations are omitted, the comment function provided by the viewer comment control program allows viewers to enjoy the virtual space live show while checking comments entered by themselves and other viewer users, and the gift function provided by the gift control program allows viewers to liven up the virtual space live show by giving items they own to the performer avatar 1.

[0121] <Administrator terminal> Fig. 6 is a diagram showing an example of the configuration of an administrator terminal 150 in the virtual space content delivery system of this embodiment. In this embodiment, the administrator terminal 150 uses a normal computer installed in a control room adjacent to the studio together with the performer terminal 200, and as shown in Fig. 6, has a processor (CPU) 151 connected to a data bus 158, a memory (RAM) 152, a storage 153 such as a hard disk, a communication interface (I / F) 154 capable of two-way communication by the TCP / IP protocol via the Internet, which is an open computer network, an image processing unit 156 including a graphics processing unit (GPU) to which a display device 160 is connected, and an input / output interface (I / F) 155 to which various input / output devices are connected.

[0122] As described below, the display device 150 is capable of individually displaying each viewpoint image of each of the virtual cameras C1 to C4 described below and each viewpoint image of the virtual camera moving in the air during the flying performance period, which are generated based on virtual space data of the event venue, which is a virtual space updated by virtual space update data (see Figure 10) distributed from the distribution server computer 100, by an administrator viewpoint image control program included in the administrator program stored in storage 153, and is also capable of displaying comments based on comment data distributed from the distribution server computer 100, and is composed of one or more stationary displays.

[0123] The input / output interface (I / F) 155 is connected to an operation input device 161 consisting of one or more devices that enable the administrator K to perform various operations as input devices, and an audio output device 162 such as earphones, headphones, or speakers that can output live audio, etc., distributed from the distribution server computer 100.

[0124] The operation input device 161 may be any device that allows the administrator K to execute various operations such as input and settings related to the virtual space live event, and may be composed of at least one of, for example, a keyboard constituting a computer, a transparent touch panel formed on the surface of a display, a viewpoint switching controller, etc.

[0125] The various input / output devices connected to the input / output interface (I / F) 155 may be connected in either a wired or wireless manner.

[0126] In addition to an operating system (OS) for operating the computer that is the administrator terminal 150, the storage 153 also stores an administrator program that, when executed by a processor (CPU) 151 or the like, works in cooperation with the distribution server computer 100 to provide various functions, including a distribution management function for the distribution of virtual space live content, which is virtual space content.

[0127] As shown in FIG. 6, the administrator programs include an administrator viewpoint video control program, an administrator audio control program, an administrator comment control program, an audience management program, a performer management program, and the like.

[0128] The viewpoint video control program for administrator is a program that provides a function for generating viewpoint videos from each virtual camera to be displayed on the display device 160, as well as a function for changing and switching each viewpoint.

[0129] The administrator audio control program is a program that provides a function for outputting live audio from the audio output device 162 based on the virtual space live audio data distributed from the distribution server computer 100 .

[0130] The administrator's comment control program is a program that displays comments based on comment data distributed from the distribution server computer 100, and provides comment-related functions such as prohibiting comments from being distributed and selecting viewers to prevent them from being distributed.

[0131] The viewer management program is a program for managing viewer users who virtually participate in the virtual space live, and the performer management program is a program for managing performer users who virtually participate in the virtual space live.

[0132] Although not shown in FIG. 6, the system includes an authentication program for authenticating whether the operator, that is, the administrator, is the actual person, and a schedule program for editing the time schedule and song order of the virtual space live performance, but may also include other programs.

[0133] In this way, by having administrator K operate administrator terminal 150 which constitutes the virtual space content distribution system of this embodiment, various settings for executing the event can be implemented, such as settings related to the program, order of songs, and performance, as well as the time schedule and the trajectory of the virtual camera moving in the air during the flying performance period, and the virtual space live performance can be managed based on the settings thus made.

[0134] <Overall image of virtual space> In the following, as an example of content, a content in which a performer holds a live event in a virtual live venue will be described. FIG. 12 shows an overall image of the virtual space provided by the system of this embodiment. The virtual space ER of this embodiment includes multiple types of space areas ER (spatial area ER1, spatial area ER2, etc.). Each spatial area ER can provide content of different genres and types. As the multiple types of space areas ER, for example, an entrance that functions as a lobby when a user logs into the virtual space ER, and areas corresponding to various contents such as a live venue, game content, and exhibition hall are provided. Note that various areas may be selected from a title screen that is displayed when a user logs into the virtual space ER. An event venue, which will be described later using FIG. 13, FIG. 24, and FIG. 25, etc., is constructed in the entirety of a predetermined space area ER or in a part of a predetermined space area ER.

[0135] Each spatial area ER has a plurality of rooms in which the same content is provided. Each room has a maximum number of people that can enter the room, and can accommodate up to 200 people. Each room is managed by, for example, a real-time synchronization server. Users who are in the same room can see each other's user avatars and communicate with each other. For example, they can play games together or have conversations by chatting. For example, if the spatial area ER1 is a space that imitates a city, the same city-imitating space is provided to the user in rooms ER1a, ER1b, etc. corresponding to the spatial area ER1, but the only avatars that can be displayed in the space are user avatars corresponding to users associated with the same room. For example, the user avatar 1 of a user associated with room ER1a is not displayed on the user screen of a user associated with room ER1b. However, it is possible to exceptionally display the user avatar of a special user (for example, a talent) not only in the room in which the user is actually present, but also in other rooms (also called mirroring).

[0136] The movement between each spatial area ER may be such that the user cannot move to another spatial area ER without passing through a spatial area ER that is defined as an area (for example, an entrance) that provides specific content after logging in to the virtual space, or may be such that the user can move between the spatial areas. For example, the user may not be able to move from the spatial area ER2 to the spatial area ER3 without passing through the spatial area ER1, or may be able to move directly between the spatial area ER2 and the spatial area ER3 without passing through the spatial area ER1. In addition, when moving between spatial areas ER, a switching performance may be performed. For example, when moving to another spatial area ER, the display screen may be switched to black (for example, a screen in which a message such as "Loading..." is displayed on a black screen). In addition, the user's access to each spatial area ER may be such that the user first enters the entrance area after logging in, or the user can select and enter the spatial area ER of his / her choice without passing through the entrance area, or the user may transition to a spatial area ER that is randomly determined by lottery. As for each room, the user may select a room of his / her choice and enter it, or may enter a room that is randomly determined by lottery.

[0137] <Virtual live venue> A virtual live venue, which is the virtual space used in this embodiment, is shown in Fig. 13. The virtual live venue shown in Fig. 13 is constructed in a predetermined spatial area ER of the spatial area ER shown in Fig. 12. As shown in Fig. 13, the virtual live venue, like a live venue in real space, is a virtual space having a virtual stage G where performer users appear as performer avatars 1, and a virtual audience area where viewer users who will be in the audience virtually participate as viewer avatars.

[0138] 13, virtual stage G has a relatively large trapezoidal floor surface, and performer avatar 1 can move on virtual stage G in the same way as in a live venue in real space. On the side of virtual stage G opposite the virtual audience seats, as shown in Fig. 13, a virtual stage wall is formed that is divided into three parts, a center part, a right part, and a left part, and virtual displays 40, 41, and 42 are provided in front of these virtual stage walls, and images and videos for performance are virtually displayed on these virtual displays 40, 41, and 42.

[0139] A star-shaped virtual arrangement object 43 related to the performer user is placed between the virtual displays 40, 41, 42, and large star-shaped virtual aerial objects 50-52 are placed in a second area, which is an area on the virtual stage G and is above a first area surrounded by the virtual stage walls, as shown in Fig. 13. The virtual aerial objects 50-52 are movable within the second area.

[0140] A virtual audience area where viewer users can virtually participate in the virtual live venue as viewer avatars is provided in front of the virtual stage G. As shown in Fig. 13, this virtual audience area is made up of a third area, which is a special area close to the center of the virtual stage G where the performer avatar 1 appears, and a fourth area, which is formed to surround the third area and is farther away from the center of the virtual stage G than the third area.

[0141] These third areas are available for virtual participation by special viewer users who are permitted to participate virtually, up to a predetermined upper limit. In this embodiment, as shown in FIG. 13, for example, viewer avatars 11 to 14 of four viewer users who have met a predetermined virtual participation record and have been permitted to participate virtually by the performer user are arranged.

[0142] In addition, the fourth area includes viewer avatars 21-32 of general viewer users who have reserved virtual participation before the start of the virtual space live. Note that, in Fig. 13, the viewer avatars 21-32 are shown in a simplified manner for the sake of convenience, but are the same avatars as the viewer avatars 11-14.

[0143] Furthermore, each viewer avatar 11-14 placed in the third area can be moved within the third area by the viewer user operating the viewer terminal, and each viewer avatar 21-32 placed in the fourth area can be moved within the fourth area by the viewer user operating the viewer terminal.

[0144] Four virtual cameras C1 to C4 are virtually arranged (set) in the virtual live performance venue, as shown in Fig. 13. Virtual camera C1 is virtually arranged in front of performer avatar 1 so as to face the performer avatar 1, and the viewpoint image captured by virtual camera C1 is a viewpoint image viewed from a position close to the front of the performer avatar 1, as shown in Fig. 14(a).

[0145] Virtual camera C2 is a camera virtually placed (set) above the head of performer avatar 1, and the viewpoint image captured by virtual camera C2 is a performer viewpoint image captured by viewing the virtual audience area from performer avatar 1, as shown in FIG.

[0146] Virtual camera C3 is a virtual camera virtually placed on the virtual display 41 diagonally behind the performer avatar 1, and the viewpoint image from virtual camera C3 is a viewpoint image looking at the virtual audience area from diagonally behind the performer avatar 1, as shown in Figure 14(c).

[0147] Virtual camera C4 is a virtual camera virtually placed on the virtual display 42 diagonally behind the performer avatar 1, and the viewpoint image from virtual camera C4 is a viewpoint image looking at the virtual audience area from diagonally behind the performer avatar 1, as shown in Figure 14(b).

[0148] In this embodiment, in addition to the fixedly placed (set) virtual cameras C1 to C4, an air-moving virtual camera (not shown) is virtually placed so as to be movable in the air within the virtual live venue space, which is a virtual space. The air trajectories along which these air-moving virtual cameras move and the viewpoint directions (angles) at each position on the air trajectory are preset by the administrator terminal 150, and during the flying performance period described later, the performer avatar 1 virtually flies so as to follow the air trajectory of the air-moving virtual camera, thereby generating a viewpoint image of the virtually flying performer avatar 1 captured by the air-moving virtual camera.

[0149] In this embodiment, as shown in FIG. 13, an example is given in which four virtual cameras C1 to C4 are virtually arranged as fixedly arranged (set) virtual cameras, but the present invention is not limited to this, and the number of these fixedly arranged (set) virtual cameras may be five or more, or conversely, without providing fixedly arranged (set) virtual cameras, only the viewpoint images seen from the viewpoints corresponding to each avatar virtually participating in the virtual live venue may be displayed on the performer terminal 200 and the viewer terminal 300.

[0150] In addition, while this embodiment illustrates an example in which there is one virtual camera moving through the air, the present invention is not limited to this, and it may also be possible to have a configuration in which there are multiple virtual cameras moving through the air, or conversely, a configuration in which no virtual camera moving through the air is virtually positioned.

[0151] <Studio> 11 is a diagram showing the studio used in this embodiment, and as described above, the studio is adjacent to the control room separated by a glass window, and the performer user performs each movement corresponding to singing in the studio, while the assistant operator O assists with the operation of the performer terminal 300 installed in the control room. Around the performer user wearing the wearable sensors 220C1 to 220C5, base stations 220a and 220b are mounted on a stand, and an imaging camera constituting the facial expression input device 221 is mounted on a stand in a position almost in front of the performer user.

[0152] A screen S is provided on the wall facing the performer user in the studio, and a projector (display device B211) installed on the ceiling of the studio projects the viewpoint image of virtual camera C2 onto screen S, so that the viewpoint image seen from performer avatar 1 as looking at the virtual audience area is displayed on screen S, as shown in Figure 16. This allows the performer user to proceed with the live performance while constantly keeping track of the behavior of the viewer avatars virtually participating in the virtual audience area (the viewer's reaction to the live performance).

[0153] A vertical large display is arranged to the side of the screen S as the display device C212, and comments from the audience and messages that the assistant operator O wants to convey to the performer users are displayed on the large display. The display device C212 may be configured to display information (performer support information) such as the lyrics of the song sung by the performer during the live performance and lines.

[0154] <Operation of virtual space content delivery system> FIG. 10 is an explanatory diagram illustrating the operation of the virtual space content delivery system of this embodiment, specifically, the flow of delivery of video and audio of a virtual live performance.

[0155] First, the video system will be described. As described above, the distribution server computer 100 is capable of providing a virtual space of a virtual live venue based on the virtual space generation program 120 and the avatar data of the performer users and the viewer users, and the actions of the avatars of the performer users and the viewer users are reflected in the actions of the performer avatar 1 and the viewer avatar 1 actions (operations) of the viewer users are reflected in the actions of the viewer avatar by updating the virtual space data in which the state of the virtual space is described based on the performer avatar information transmitted from the performer terminal 200 and the viewer avatar information transmitted from the viewer terminal 300.

[0156] Although not shown in Figure 10, when the performer terminal 200 and the viewer terminal 300 communicate with the distribution server computer 100 to virtually participate in the virtual space live performance, virtual space data of the virtual live venue is delivered to and stored in advance from the distribution server computer 100.As will be described later, the virtual space data stored in advance in this manner is successively updated by virtual space update data delivered successively from the distribution server computer 100, allowing the performer terminal 200 and the viewer terminal 300 to identify the latest state of the virtual live venue.

[0157] Specifically, the movements and facial expressions of the performer user in the studio are scanned at predetermined time intervals by the body motion scan and face motion scan functions of the performer avatar control program described above, and performer avatar information is generated and transmitted to the distribution server computer 100.

[0158] On the other hand, viewer users who are permitted to virtually participate in the third area use motion sensors, just like the performers, and are scanned at specified intervals using the body motion scan and face motion scan functions, and viewer avatar information is generated and transmitted to the distribution server computer 100.

[0159] Furthermore, a viewer user permitted to virtually participate in the fourth area can use the touch panel, keyboard, or controller of the viewer terminal 300 to perform various operations such as movement, changing the viewpoint direction, changing the viewpoint state (zoom), raising hands, clapping hands, jumping, etc., to make the viewer avatar perform the corresponding action. Then, of these operations, viewer avatar information is generated based on the operation related to the viewer avatar's action and transmitted to the delivery server computer 100.

[0160] In this way, based on the performer avatar information transmitted from the performer terminal 200 and the viewer avatar information transmitted from the viewer terminal 300, the distribution server computer 100 executes a virtual space update process that updates the virtual space data, thereby reflecting the actions (operations) of the performer user and the viewer user in each avatar virtually participating in the virtual live venue.

[0161] Then, after executing a virtual space update data generation process for generating virtual space update data based on the virtual space data before the update and the virtual space data after the update, the generated virtual space update data is distributed to the performer terminal 200 and the viewer terminal 300.

[0162] At the performer terminal 200 and viewer terminal 300 to which the virtual space update data has been delivered, as shown in FIG. 10, the pre-stored virtual space data is updated based on the delivered virtual space update data, and a performer perspective video generation process and a viewer perspective video generation process are executed using the updated virtual space data, thereby generating performer perspective video and viewer perspective video based on the updated virtual space data, and the generated performer perspective video and viewer perspective video are displayed on the performer terminal 200 and the viewer terminal 300 (viewer perspective video output process).

[0163] In this manner, in this embodiment, the viewpoint video of each viewer user who is virtually participating in the virtual live venue through a viewer avatar is generated and displayed on the viewer terminal 300 of each viewer user, and by generating the viewer avatar viewpoint video of each viewer user on the distribution server computer 100, it is possible to avoid a situation in which the processing load on the distribution server computer 100 becomes significantly large, which would result in many viewer users being unable to participate in the virtual space live, and it is also possible to avoid a situation in which distribution becomes difficult due to an increased processing load.

[0164] In this embodiment, a viewpoint image is generated and displayed on the display device 310 of the viewer terminal 300 of the viewer user of the viewer avatar 13 who is virtually participating in the third area close to the performer avatar 1 on the virtual stage G, in which a viewpoint image of almost the front of the performer avatar 1 is displayed large, as shown in Figure 14(d), which is a viewpoint image seen from the viewer avatar 13 close to the performer avatar 1, while a viewpoint image is generated and displayed on the display device 310 of the viewer terminal 300 of the viewer user of the viewer avatar 28 who is virtually participating in the fourth area far from the performer avatar 1 on the virtual stage G, for example, at a position behind the viewer avatar 13, in which a viewpoint image of almost the front of the performer avatar 1 appears relatively small through the viewer avatar 13 and viewer avatar 14 who are virtually participating in the third area, as shown in Figure 14(e).

[0165] In addition, the display device 310 of the viewer terminal 300 of the viewer user of the viewer avatar 32 who is virtually participating at the edge position of the virtual stage G in the fourth area, which is set up as a U-shape when viewed from above, displays a viewpoint image seen from the viewer avatar 32 positioned diagonally forward of the performer avatar 1, as shown in Figure 14(f), in which the performer avatar 1 appears relatively small through the viewer avatar 14 who is virtually participating in the third area.

[0166] Note that all of the display examples shown in Figure 14 are examples in which the viewer terminal 300 is a stationary computer (PC) and the display device 310 is a stationary display. However, for example, if the viewer terminal 300 is a smartphone P, tablet, etc., the viewpoint image of the virtual camera C1 is displayed as shown in Figure 15(a), and if the viewer terminal 300 is the viewer terminal 300 of the viewer avatar 13, it is displayed as shown in Figure 15(b).

[0167] Next, the audio system will be described. In the distribution server computer 100, music data 113 is played back by audio control program 124 based on time schedule data (TS data) 112, and transmitted to the performer terminal 200 as played music (data) (music playback process).

[0168] In the performer terminal 200, the music audio from the played music (data) transmitted from the distribution server computer 100 is output to the performer user through high-performance earphones (in-ear monitors) worn by the performer user (played music output process), and when the performer user sings along with the output played music, the performer voice input from the sound collection microphone (audio input device 222) is digitized and transmitted to the distribution server computer 100 as the performer voice (data).

[0169] The distribution server computer 100 generates distribution audio (data) from the performer audio (data) received from the performer terminal 200 and the played music played in the music playback process described above (distribution audio generation process), and distributes the generated distribution audio (data) to the viewer terminal 300 (generated audio distribution process).

[0170] In the viewer terminal 300, the distribution audio (data) distributed from the distribution server computer 100 is output from an audio output device 322 such as earphones or speakers, allowing the viewer to hear the live audio as if the performer avatar 1 were singing in the virtual live venue.

[0171] Furthermore, in the performer terminal 200, as described above, the performer's voice (data) is transmitted to the distribution server computer 100, and as shown in Figure 10, a monitor audio generation process and a monitor audio output process are executed, so that the music audio of the played music and the performer's voice are output from speakers placed in the control room, allowing an assistant operator O, etc. to check the singing status of the performer user in the control room.

[0172] <Viewer's viewpoint video control processing> Next, a viewer's viewpoint video control process executed in the viewer terminal 300 based on a viewer's viewpoint video control program included in the viewer's program will be described with reference to FIG.

[0173] In the viewer viewpoint video control process, first, it is determined whether or not the performer avatar 1 is in a flying performance period in which the performer avatar 1 is virtually flying, as shown in Fig. 20 (step S1). Whether or not the performer avatar 1 is in a flying performance period can be identified by performance status data indicating that the performer avatar 1 is in a flying performance period, which is sent from the delivery server computer 100. The delivery server computer 100 transmits performance status data indicating that the performer avatar 1 is in a flying performance period to the viewer terminal 300 when the performer avatar 1 is in a flying performance period based on the time schedule data.

[0174] If it is during the flying performance period (Y in step S1), proceed to step S21, whereas if it is not during the flying performance period (N in step S1), it is determined whether viewpoint-related operations including viewpoint movement operations (including changing the viewpoint by avatar movement operations and motion operations) and zoom operations are disabled (step S2).

[0175] If the viewpoint-related operation is invalid (Y in step S2), the process proceeds to step S7. If the viewpoint-related operation is not invalid (N in step S2), the process determines whether or not there is an operation that changes the viewpoint, such as an operation of moving an avatar or an operation of moving an avatar (step S3), and if there is an operation (Y in step S3), the viewer viewpoint is changed according to the operation, and if there is no operation (N in step S3), the process proceeds to step S5, and determines whether or not there is a zoom operation (step S5).

[0176] If a zoom operation is performed (Y in step S5), the image area displayed on the display device 310 is changed to an image area corresponding to the operation, and if a zoom operation is not performed (N in step S5), it is determined whether or not a motion tracking setting is present (step S7).

[0177] This motion tracking setting can be arbitrarily set by the viewer user on the viewer terminal 300, for example, before the start of a live performance or during a live performance, depending on the type of device used by the viewer user and his / her level of proficiency in the operation. Specifically, the motion tracking setting is set in cases where, for example, the viewer user is not familiar with operating the operation input device 321 such as a touch panel, keyboard, or game controller, or is not familiar with changing the viewpoint by operating the avatar to move or move, or, as will be described later, the virtual participation position of the viewer user's avatar is far from the performer avatar 1 and the viewer user is zoomed in and displayed in an enlarged manner, so that even a slight movement of the performer avatar 1 prevents the performer avatar 1 from being displayed appropriately, and so on, and the viewer user is unable to change the viewpoint in response to the movement or movement of the performer avatar 1.

[0178] If there is no motion following setting (N in step S7), the process proceeds to step S11. If there is a motion following setting (Y in step S7), it is further determined whether or not the motion following condition is satisfied (step S8).

[0179] In this embodiment, the motion tracking condition is a condition under which it is almost certain that the performer avatar 1 will no longer be displayed clearly on the display device 310. Specifically, when the head (or face) of the performer avatar 1 is within a specified range around the display area of ​​the display device 310, it is highly likely that the movement or motion of the performer avatar 1 will cause the head (face) to move outside the display area, causing it to no longer be displayed clearly, and therefore it is determined that the motion tracking condition is met.

[0180] In this way, in this embodiment, by determining that the motion tracking condition is met before the head (face) of the performer avatar 1 disappears from the display area, it is possible to significantly reduce the occurrence of the head (face) of the performer avatar 1 disappearing from the display area, but the present invention is not limited to this, and these motion tracking conditions may be the condition that the head (face) moves out of the display area, or other conditions may be used as the motion tracking conditions. In other words, any condition may be used as the motion tracking condition as long as it can prevent the performer avatar 1 from disappearing from the display area in a good manner.

[0181] If the action tracking condition is met (Y in step S8), after disabling the viewpoint-related operations (step S12), the viewpoint image displayed in the display area of ​​display device 310 is automatically changed to a motion tracking viewpoint in which the head (face) of performer avatar 1 is within a non-metable range surrounded by a predetermined range around the display area, and the viewpoint image seen from the motion tracking viewpoint is displayed in the display area of ​​display device 310 (step S13).

[0182] On the other hand, if the action tracking condition is not met (N in step S8), it is further determined whether or not the viewpoint-related operation is disabled (step S9). If the viewpoint-related operation is disabled (Y in step S9), the disabled viewpoint-related operation is enabled (step S10) and then the process proceeds to step S11. If the viewpoint-related operation is not disabled (N in step S9), the process proceeds to step S11 without going through step S10.

[0183] In step 11, since the motion tracking setting is not set or the motion tracking condition is not satisfied, the viewpoint video of the viewer avatar is continuously displayed in the display area of ​​display device 310 (step S11).

[0184] Also, as mentioned above, if the flying performance period in which the performer avatar 1 virtually flies during a live performance has begun, the answer in step S1 is determined to be Y, and the process proceeds to step S21, where it is determined whether or not it is the start timing of the flying performance period (step S21).

[0185] If it is the start timing of the flying performance period (Y in step S21), the flying viewpoint image distributed from the distribution server computer 100 is displayed (step S22) in place of the viewer avatar's viewpoint image or action-tracking viewpoint image that was displayed in the display area of ​​the display device 310 before the start of the flying performance period, and then viewpoint-related operations are disabled (step S23) and the process returns to step S1.

[0186] In this embodiment, during the flying performance period, the same flying viewpoint video is displayed on the viewer terminals 300 of all viewer users. Instead of generating the flying viewpoint video on each viewer terminal 300 side, as is the case with viewer avatar viewpoint videos which are different for each viewer user, the flying viewpoint video is generated on the distribution server computer 100 side and distributed to the viewer terminals 300. This allows the flying viewpoint video, which involves movement of the viewpoint in the air and therefore imposes a large rendering load on the viewer terminals 300, to be displayed well even on viewer terminals 300 with low processing capabilities. However, the present invention is not limited to this, and these flying viewpoint videos may be generated on the individual viewer terminals 300 side, in the same way as viewer avatar viewpoint videos.

[0187] On the other hand, if it is not the start timing of the flying effect period (N in step S21), it is further determined whether it is the end timing of the flying effect period (step S24).

[0188] Whether or not it is the end timing of the flying performance period may be determined based on data indicating the end contained in the flying viewpoint video data transmitted from the distribution server computer 100, or may be determined based on the aforementioned performance status data that is different from the flying viewpoint video.

[0189] If it is not the end of the flying performance period (N in step S24), that is, if it is during the flying performance period, proceed to step S26, update the flying viewpoint video, and then return to step 1; on the other hand, if it is the end of the flying performance period (Y in step S24), enable viewpoint-related operations (step S25), proceed to step S11, display the viewer avatar's viewpoint video in the display area of ​​display device 310 in place of the flying viewpoint video that was displayed in the display area of ​​display device 310 during the flying performance period, and then return to step S1.

[0190] The viewpoint videos displayed on the viewer terminal 300 as a result of the viewer viewpoint video control process shown in FIG. 21 being executed in the viewer terminal 300 of this embodiment will be described with reference to FIGS. 17 to 20. FIG.

[0191] Fig. 17 is a diagram showing the display contents of the display device 310 when a zoom operation is performed on the viewer terminal 300 of this embodiment, and in the default state where no zoom operation is performed, as shown in Fig. 17(a), a viewpoint video of the video area centered on the upper body of the performer avatar 1 is displayed. In this default state, when the viewer user performs a zoom-up operation, for example, by touching the "+" display (not shown) if the viewer terminal 300 is a smartphone P, or by operating the "+" key on the keyboard if the viewer terminal 300 is a computer (PC), for example, a viewpoint video of the video area centered on the head (face) of the performer avatar 1 is displayed as shown in Fig. 17(b).

[0192] On the other hand, if the viewer user performs a zoom-down operation, for example, by touching the "- " display (not shown) if the viewer terminal 300 is a smartphone P, or by operating the "- " key on the keyboard if the viewer terminal 300 is a computer (PC), a viewpoint image of the image area including the entire body of the performer avatar 1 will be displayed, as shown in Figure 17(c), for example.

[0193] In Figure 17, in order to make the zoom function easier to understand, the explanation was given using the viewpoint image of virtual camera C1 rather than the viewpoint of the viewer avatar, but as shown in Figure 18, zooming up and down can also be performed in the same way on the viewpoint of the viewer avatar.

[0194] Also, although not described in detail in the viewer viewpoint image control process of Figure 21, for example, when performer avatar 1 appears on virtual stage G for the first time when a live performance begins, the viewpoint of the viewer avatar will not be directed toward performer avatar 1, and there is a possibility that the appearing performer avatar 1 will not be displayed on the viewer terminal 300 for a long period of time. Therefore, the period when performer avatar 1 first appears may be designated as an appearance performance period, and during this performance period, the viewpoint image displayed on the viewer terminal 300 may be automatically switched to the viewpoint image of virtual camera C1, etc., instead of the viewpoint image of the viewer avatar, and individual viewer users may be allowed to perform zooming in, etc. on the viewpoint images of virtual camera C1.

[0195] 18 shows, as an example of a viewpoint image of a viewer avatar, the viewpoint image of viewer avatar 28 who is virtually participating in the fourth area. As shown in Fig. 18, the viewpoint image of viewer avatar 28 includes the heads of viewer avatar 13 and viewer avatar 14 who are virtually participating in the third area, and the image shows performer avatar 1 seen through the heads of viewer avatar 13 and viewer avatar 14.

[0196] Therefore, the viewer user of viewer avatar 28 can enjoy the live performance by, for example, performing a zoom-in operation to change the image area so that the upper body of performer avatar 1 is displayed primarily, as shown in Figure 18(b), thereby preventing viewer avatar 13 and viewer avatar 14 from being displayed.

[0197] However, in the zoomed-in state as shown in Figure 18(b), for example, as the live performance progresses and the performer avatar 1 begins to move and make large movements, if the viewer user is unable to properly change the viewpoint of the viewer avatar 28 to match the movements of the performer avatar 1, the performer avatar 1 may not be displayed properly, as shown in Figures 19(d)-(f).If the viewer user has to pay attention to adjusting the viewpoint, it may become difficult to concentrate on the live performance and they may not be able to enjoy it well.

[0198] However, in this embodiment, when the viewer user sets the motion tracking setting as described above, as shown in Figures 19(a) to (c), the head of the performer avatar 1 enters within a specified area surrounding the display area, the motion tracking condition is met, the viewpoint is automatically changed to the motion tracking viewpoint, and the viewpoint image of the motion tracking viewpoint is displayed. Therefore, the viewer user does not need to pay attention to operating the viewpoint, and can concentrate on the live performance and enjoy it to the fullest.

[0199] Then, as the live performance progresses and the flying performance period begins, as shown in Figure 20, the viewpoint images of the individual viewer avatars are automatically changed to flying viewpoint images seen from a virtual camera moving in the air, without any operation by the viewer user.

[0200] Specifically, before the performer avatar 1 takes off in virtual flight, an image is displayed in which a wing object grows on the back of the performer avatar 1. Then, the performer avatar 1 looks up at a virtual aerial star object 50 virtually placed in the second area of ​​the virtual live venue, and the viewpoint of the viewer avatar moves in the same way. At this time, light effects 61 appear around the performer avatar 1.

[0201] Thereafter, when the performer avatar 1 enters virtual flight, the viewpoint image displayed on the display device 310 automatically switches from the viewpoint image of the viewer avatar in FIG. 20(b) to a flying viewpoint image seen from a virtual camera moving in the air, as shown in FIG. 20(c).

[0202] During the flying performance period, the aerial moving virtual cameras move within the second area based on a pre-set aerial trajectory as described above, and the flying viewpoint images seen from these aerial moving virtual cameras moving in the air are displayed on the display device 310 as shown in Figure 20(d).

[0203] The specific configuration is not limited to the above-described embodiment, and the present invention includes modifications and additions that do not depart from the gist of the present invention.

[0204] For example, in the above embodiment, a viewer avatar is shown to be able to move freely within the third or fourth area in which it is virtually participating. However, doing so may result in problems such as errors in the virtual space data due to different viewer avatars participating in the fourth area colliding virtually with each other or overlapping in the same virtual position.

[0205] In order to solve such problems, for example, the modified examples shown in Figures 22 and 23 may be used. Specifically, the third and fourth areas are divided into smaller areas as shown in Figure 22, and the viewer user is asked in advance before the start of the live performance which of these areas he or she will participate in, as shown in Figure 23. When the viewer user virtually participates with a viewer avatar, he or she is only able to participate in the area selected in advance, and movement is restricted to within the selected area, thereby preventing virtual collisions between viewer avatars or overlapping in the same virtual position, which can cause errors in the virtual space data.

[0206] In addition, in the case where each viewer user is allowed to select the virtual participation position of the viewer avatar in advance as described above, for example, for a viewer user who selects areas A1 to C6 on the right side facing the virtual stage G in the fourth area, a viewpoint image from the right front position of the virtually flying performer avatar 1 is generated and displayed as the viewpoint image during the flying performance period, for a viewer user who selects areas D4 to H6 on the center facing the virtual stage G in the fourth area, a viewpoint image from the central front position of the virtually flying performer avatar 1 is generated and displayed as the viewpoint image during the flying performance period, and for a viewer user who selects areas I1 to K6 on the left side facing the virtual stage G in the fourth area, a viewpoint image from the left front position of the virtually flying performer avatar 1 is generated and displayed as the viewpoint image during the flying performance period. In this way, depending on the position selected by the viewer user, the viewpoint image during the virtual flight, which is a special action, may be a viewpoint image corresponding to the position (area) selected by each viewer user.

[0207] In the above embodiment, the viewpoint video from the viewer avatar is generated and displayed on the viewer terminal 200 side, but the present invention is not limited to this, and for example, in the case of a live event with few virtual participants, the viewpoint video from the viewer avatar may also be generated and distributed on the delivery server computer 100 side. Also, the viewer user may be allowed to select whether to generate the video on the viewer terminal 200 side or the delivery server computer 100 side depending on the processing capacity of the terminal he or she owns and the data communication environment, or the delivery server computer 100 may specify the processing capacity of the viewer terminal 200 with which it is connected for communication, and determine whether to generate the video on the viewer terminal 200 side or the delivery server computer 100 side based on the specified processing capacity.

[0208] In addition, in the above embodiment, the distribution server computer 100 is installed in a studio operated by an event management organization that hosts the virtual space live event, but the present invention is not limited to this. As the distribution server computer 100, a server computer owned in a data center or the like by a company that rents out the server computer may be used, or as described above, a server computer provided by a cloud service may be used. The installation form of these server computers may be any form that provides the functions of the distribution server computer 100.

[0209] In the above embodiment, a form in which a single performer user sings and performs is exemplified, but the present invention is not limited to this, and the performer users may be a group of multiple people, and when a virtual space live performance is performed by a group of multiple people, the multiple people may share one performer terminal 200, or a performer terminal 200 may be provided for each member of the group. When the performer users are a group of multiple members, for example, a viewpoint tracking target designation process may be executed by at least one of the distribution server computer 100 and the viewer terminal 300, so that the viewer user can select a member to be the target of the viewpoint tracking.

[0210] In addition, in the above embodiment, the singer who sings and the actor who performs the performance may be separate persons, in which case the singer's performer terminal and the actor's performer terminal may be separate, and the singer may sing in a location other than the studio where the actor performs the performance.

[0211] In addition, in the above embodiment, the Internet network is used as an example of the computer communication network connecting the distribution server computer 100, the administrator terminal 150, the performer terminal 200, and the viewer terminal 300, but the present invention is not limited to this, and these communication networks may be composed of local area networks that are capable of data communication only within a specific area, or may include a local area network and local data communication as part of them.

[0212] In addition, in the above embodiment, the performer user sings or performs singing actions (performance actions) in real time during the distribution of the virtual space live performance, allowing the performer user to proceed with the live performance while checking the reactions of the viewer users who are virtually participating in the virtual space live performance, but the present invention is not limited to this, and the performer user's singing or singing actions (performance actions) do not have to be done in real time, but may be performed in advance, and the singing audio and singing actions (performance actions) may be recorded in the distribution server computer 100 as performer avatar information, and the recorded singing audio and singing actions (performance actions) may be played back as the live performance progresses, thereby holding a virtual space live performance.

[0213] In addition, instead of the singing and singing actions (performance) of a performer user, the singing and singing actions (performance actions) of a virtual performer created using computer graphics, etc., can be recorded as performer avatar information on a distribution server computer, and the recorded singing audio and singing actions (performance actions) can be played back as the live performance progresses, thereby holding a virtual space live performance.

[0214] In this way, when singing or singing actions (performance actions) are performed in advance to record and play back performer avatar information on the distribution server computer 100 and distribute a virtual space live performance, the configuration of the virtual space content distribution system at the time of distribution will be composed of the distribution server computer 100, administrator terminal 150, and viewer terminal 200, and will not include the performer terminal 200, which is a performer user terminal that can be used by a performer user to perform operations to move the performer avatar 1 in the virtual space.

[0215] In addition, in the above embodiments, the viewer terminal 300 is exemplified as a smartphone P or a computer (PC), however, the present invention is not limited to this, and these computers may be portable notebook computers, tablet terminals, e-book readers, wearable computers, game consoles, and various other information processing devices capable of outputting at least 2D video and audio.

[0216] In addition, in the above embodiment, an example was given of a form in which a performer user performs in a studio, including singing, but the present invention is not limited to this. For example, a performer user may use a performer terminal 200 installed in a home or the like to appear in a virtual space live performance from a home or the like.

[0217] In the above-described embodiment, a virtual space live performance was given as an example of virtual space content, but the present invention is not limited to this, and such virtual space content may be any content that is beneficial to viewer users, such as a fan meeting where performer users gather with their fans, or a talk session, and that is related to a virtual space in which performer avatar 1 and viewer avatars virtually participate.

[0218] In the above embodiment, the general action (first action) is an action of the performer avatar 1 standing on the virtual stage G without moving, the special action (second action) is an action of the performer avatar 1 flying virtually, and the specific action (third action) is an action of the performer avatar 1 moving quickly sideways. However, the present invention is not limited to this, and the actions may be actions according to the content to be distributed. For example, the general action (first action) may be an action (normal action) that the performer avatar performs for the longest period in the content to be distributed, the special action (second action) may be an action that is performed in a special period that is the shortest period in the content to be distributed or an action that is performed least frequently, and the specific action (third action) may be an action that is performed for a shorter period than the general action (first action) but longer than the special action, or an operation that is performed less frequently than the general action (first action) but more frequently than the special action. The special action (second action) may include the specific action (third action).

[0219] In the above embodiment, an example was given of a form having both a function of switching the viewpoint corresponding to a special action (second action) and a function of following a specific action (third action), but the present invention is not limited to this, and the virtual space content distribution system may have only one of these functions.

[0220] In the above-described embodiment, an example is given of a form in which viewpoint switching of the four virtual cameras C1 to C4 as fixedly positioned (set) virtual cameras and the airborne moving virtual camera can be performed in advance by settings and operations on the administrator terminal 150, but the present invention is not limited to this. For example, these viewpoint switching may be performed in real time by the administrator K on the administrator terminal 150 using a viewpoint switching controller or the like constituting the operation input device 161.

[0221] In the above-described embodiment, an example is given of a form in which virtual cameras C1 to C4 are fixedly placed (set) in the virtual space as virtual cameras, but the present invention is not limited to this. For example, in addition to or instead of the virtual cameras C1 to C4, a movable virtual moving camera may be placed in the virtual live venue, and the position and imaging direction of the virtual moving camera in the virtual space may be controlled by an administrator K or a cameraman, etc., via operation of the administrator terminal 150, to produce the viewpoint image of the virtual moving camera.

[0222] In the above embodiment, a viewpoint image of the virtual camera C2 is displayed on the screen S so that the facial expression of the performer user can be detected and reflected in the facial expression of the performer avatar, but the present invention is not limited to this, and for example, if the performer user has a high-performance head-mounted display with a sensor function to detect the facial expression of the performer user, the performer user may wear such a high-performance head-mounted display to perform the performance, which may improve the performer user's immersive feeling in the virtual live performance. Also, if the facial expression of the performer user does not need to be reflected in detail in the facial expression of the performer avatar, the performer user may wear a normal head-mounted display to perform the performance.

[0223] In the above-described embodiment, an example was given of the viewer user's viewpoint being changed and following the movements of the performer avatar, but the present invention is not limited to this. For example, these viewpoint changes and following may be performed in response to specific effects such as smoke or fireworks (pillars of fire) devices, special lighting, or deformation of stage G, which are props on stage G.

[0224] <Event content related> (Event content summary) With reference to Figs. 13 to 23, an example of content has been described in which a live event is held by performers in a virtual live venue. The event content is distributed at a predetermined date and time (scheduled time on a scheduled date) according to the event data, for example, and a spatial area ER in which the event content is to be provided may be provided (distribution start, opening) before the start of the event so that viewer users can enter and participate in the virtual space in which the event is to be held. In this case, the event data may include information for specifying the date and time when the spatial area ER in which the event content is to be provided is provided (distribution start, opening) before the scheduled date.

[0225] In the following, an example will be described in which a virtual space in which the virtual live venue (event venue) shown in Fig. 13 is constructed as a predetermined type of virtual space is opened before the start of event content of a virtual live performance as shown in Fig. 13, and viewer users can enter and participate in the space, thereby gradually increasing the viewer user's interest in the event before the event starts. The predetermined type of virtual space is, for example, any of the virtual spaces in the space area ER in Fig. 12. In the following, an example of a predetermined type of virtual space will be described using the space area ER5 shown in Fig. 24.

[0226] FIG. 24 is an overall bird's-eye view of an event venue constructed in the spatial area ER5. In the spatial area ER5 in this embodiment, a virtual space is provided in which objects such as buildings imitating a shrine and a town in front of the shrine are arranged, for example. Note that the objects arranged in the spatial area ER5 are not limited to buildings imitating a shrine, and may be objects according to various themes such as the sea, a lake, a mountain, a school, etc. In addition, the spatial area ER5 is composed of a plurality of areas. For example, as shown in FIG. 24(A), the spatial area ER5 is composed of an area ER51 corresponding to a town area, an area ER52 corresponding to a temple grounds area, an area ER53 corresponding to a worship hall area, etc.

[0227] In the town area, for example, a plurality of house objects resembling private homes are arranged, and along the approach to the shrine grounds area, a plurality of exhibition areas are provided for displaying (setting up) lantern objects purchased by viewer users, etc. Lantern objects can be purchased, for example, in a lantern shop area in the town area. In the shrine grounds area, a plurality of objects corresponding to torii gates, gates, ornaments, etc. arranged in the grounds of a shrine are arranged, a game area where a predetermined game can be played, a fortune-telling area where fortune-telling can be performed, and a plurality of exhibition areas are provided. In the worship hall area, for example, a plurality of objects corresponding to a shrine worship hall and a stage object serving as a virtual live venue (event venue) are arranged, an offering area for offering money is provided, and a plurality of exhibition areas are provided.

[0228] In the exhibition area, lantern objects purchased by users, lantern objects associated with the management (administrator) (including initially set lantern objects), lantern objects associated with special users, etc. are placed. Special users include performer users, management users, sponsor users who are sponsoring the event, and other celebrities, and users who are authenticated as special users by the management (administrator). Information on these sponsor users and other celebrities is stored in the event data 111.

[0229] In addition, as described below, the lantern object displayed in the exhibition area is determined in advance by random drawing or the like as a default lantern object to be displayed commonly to all users on the distribution server computer 100 side each time a switching condition is met, and is transmitted to and positioned on the viewer terminal 300 of the user who has entered the spatial area ER5.By bringing the viewer avatar close to one of the exhibition areas, the lantern object displayed in that exhibition area can be displayed on the viewer terminal 300.

[0230] Various processes related to such spatial area ER5 (predetermined type of virtual space) and various processes related to the provision and distribution of the spatial area ER5 are performed by the distribution server computer 100, and a viewer user can enter and participate in the spatial area ER5 using a viewer terminal 300 and move a viewer avatar to display an image within the spatial area ER5 on the viewer terminal 300. Hereinafter, viewer users and viewer avatars (as well as performer avatars, etc.) are also simply referred to as users and user avatars (as well as performer avatars, etc.).

[0231] Fig. 25 is an example of an image of the spatial area ER5 displayed on the display unit 310 of the viewer terminal 300. Fig. 25(A) is an example of a display image when the area ER52 (temple grounds area) in Fig. 24 is viewed obliquely from within the area ER51 (town area). Fig. 25(B) is an example of a display image when the user avatar U operated by the user is moved to the vicinity of the boundary of the area ER53 in the area ER52 in Fig. 24, as viewed from behind the user avatar U, and a daimon object 53c corresponding to the daimon leading from the area ER52 to the area ER53 is shown. Fig. 25(C) is an example of a display image when the user avatar U is moved under a large torii object 52t corresponding to a large torii in the area ER52 in Fig. 24, as viewed from behind the user avatar U, and the foot of the large torii object 52t and the daimon object 53c are shown. Fig. 25(D) is an example of a display image when the user avatar U is moved backward from the position shown in Fig. 25(C), as viewed from behind the user avatar U, and shows a large torii gate object 52a and a private house object 51d corresponding to a private house. In this way, by entering and participating in the spatial area ER5, the user can move within the spatial area ER5 in response to operations from the user, view objects and scenery within the spatial area ER5, purchase objects, make offerings, and participate in a live event held in the worship hall area on a scheduled date.

[0232] 25(A) may be an image that can be displayed on the display device 310 by a user operation, or may be an image that corresponds to the line of sight of a user avatar U as in Figures 25(B) to (D). Even if an image that shows a bird's-eye view of a user avatar U by a user operation is displayed as in Figures 25(B) to (D), an image seen from the viewpoint of the user avatar U may be displayed without displaying the user avatar U operated by the user.

[0233] In this embodiment, even during the period before the scheduled date, which is the period before the scheduled date on which the event content is provided in the spatial area ER5, the user can enter and participate (also simply referred to as entering) in the spatial area ER5. For example, even during the period before the scheduled date, when the user logs in to the virtual space ER and enters and participates in the spatial area ER5, the virtual space generation program 120 transmits data to the viewer terminal 300 for displaying an image of the generated spatial area ER5 on the display device 310 of the viewer terminal 300. The period before the scheduled date is the day before the scheduled date on which the event content is provided, and may be a predetermined period (for example, one week) before the scheduled date, or may be all days before the scheduled date. In this embodiment, it is assumed that the user can enter the spatial area ER5 from one week before the scheduled date.

[0234] Only users who have the right (e.g., a ticket) to participate in the event content provided on the scheduled date are permitted to enter and participate in the spatial area ER5 during the period before the scheduled date and on the scheduled date. The right to participate is granted to users by, for example, purchasing a ticket for participation by paying a fee, or by completing a specified game or mission.

[0235] The spatial area ER5, which is a predetermined type of virtual space, includes, for example, a first virtual space formed by connecting a plurality of areas, in which a viewer user can seamlessly move and enter from one area to another among the plurality of areas, and a second virtual space consisting only of areas that have the same display mode as the other areas. The virtual space corresponding to the spatial area ER5 in this embodiment includes, as shown in Fig. 24(A), a first virtual space formed by connecting areas ER51 to ER53, in which a user can seamlessly move and enter between areas ER51 and ER52 and between areas ER52 and ER53, and a second virtual space consisting only of area ER53' that has the same display mode as area ER53, as shown on the right side of Fig. 24(B).

[0236] Furthermore, for example, until a specific period (e.g., the day before) before the scheduled date of the event content, the first virtual space shown in FIG. 24(A) is provided, and after the specific period before the scheduled date of the event content and the release condition is met, the second virtual space shown in FIG. 24(B) is provided in addition to the first virtual space, and movement from some of the areas (areas ER51, ER52) among the multiple areas (areas ER51 to ER53) in the first virtual space to other areas (area ER53) is impossible (for example, the gate of the daimon object 53c leading to area ER53 is closed), and a portal P is provided at a predetermined position in some of the areas (a position in front of the daimon object 53c in area ER52), and by moving the user avatar U to the portal P, it becomes possible to transition to the second virtual space consisting of only area ER53', for example, via the display of a predetermined screen (for example, a blackout screen).

[0237] In this embodiment, the event content is provided in an area ER53' that has the same display form as the area ER53. The area ER53' is an area that cannot be entered until, for example, a release condition is met. A venue similar to the virtual live venue shown in Fig. 13 is constructed in the area ER53', and objects corresponding to a virtual stage for a live event and audience seats are placed therein. During the live event, performer avatars operate on the virtual stage, and the user watches from the audience seats via the user avatar U.

[0238] On the other hand, a specific period before the scheduled date, for example, objects corresponding to spectator seats for a live event are gradually arranged in the area ER53 in the first virtual space, and objects under construction are arranged on the virtual stage, thereby reflecting the gradual construction of the virtual live venue, which the user can confirm through the user avatar U. For example, a virtual space update data distribution process is performed to update the displayed objects every predetermined time (e.g., every 24 hours). This makes it possible to inform the user that the event is approaching and to enhance the sense of realism and interest.

[0239] Furthermore, the user who was in the area ER53 when the release condition was met is moved out of the area ER53. For example, the user avatar U is forcibly moved to a predetermined position outside the area ER53 (for example, in front of the gate object 53c in the area ER52). After that, the user is no longer able to enter the area ER53, but can enter the area ER53' via the portal P described above.

[0240] The area ER53 and the area ER53' have the same display mode, but the space in which the user avatar U can move is limited. For example, in the area ER53, the user avatar U can move freely within the area, whereas in the area ER53', the user avatar U can move only within the audience area 53'k. This can reduce the burden on the server to the minimum processing load required for providing the event content. Also, the area ER53 and the area ER53' can be managed by different servers (rooms) that perform processing for constructing and generating each area. This can allow, for example, management by a server (room) that can handle a heavy load when providing the event content. Note that users who can enter the area ER53' may be limited to users who meet a predetermined condition for providing the event content.

[0241] (Changes in display mode in virtual space) In this embodiment, the display mode in the space area ER5 may change depending on an event that occurs in the space area ER5 in the period before the scheduled date. Events that occur in the space area ER5 in the period before the scheduled date include, for example, the user's behavior in the period before the scheduled date, the behavior of other users, a lottery in the space area ER5, and setting changes to the virtual space performed by the operation of the administrator. The user's behavior (or the behavior of other users) includes, for example, an operation of purchasing and placing a specific object (item, lantern object, etc.), playing a game such as completing a specific mission, etc. The display mode in the space area ER5 that may change depending on an event that occurs in the space area ER5 in the period before the scheduled date includes, for example, a change in the display mode of a specific object (for example, a lantern object, an exhibition area in which a lantern object is placed, etc.) placed in the space area ER5, and a change in the display mode of a performance during the provision of event content.

[0242] (Changes in display mode during the period before the scheduled date due to specific object placement) 26 to 32, examples will be described below in which the display mode in the spatial area ER5 during the period before the scheduled date can be changed in response to an event in which a user purchases and places a lantern object in the spatial area ER5 during the period before the scheduled date, for example, a lantern object purchased in the spatial area ER5 is placed in the exhibition area, or a lantern object purchased by another user and placed in the exhibition area is switched to another lantern object when a switching condition is met. Note that the lantern object can also be a type of tipping item (for example, a flower stand) from a user when providing event content, and is therefore also referred to as a flower stand FS below.

[0243] A flower stand FS can be purchased, for example, at a lantern shop 51s located along the approach to the shrine in the area ER51 shown in Fig. 24. The user moves the user avatar U to the lantern shop 51s or selects the lantern shop 51s, and the image displayed on the viewer terminal 300 changes from a screen displaying an image in the area ER51 to a screen for purchasing a flower stand FS. Fig. 26(A) is an example of the screen displayed when purchasing a flower stand FS.

[0244] As shown in Fig. 27(A) and (B), there are multiple types of purchasable flower stands FS. Fig. 27(A) shows a table of flower stand FS by attribute (motif). The attributes (motifs) are "plain", "cherry blossom", "demon", "white fox", "black fox", "gorgeous", etc. Each attribute has a motif color, and the flower stand FS for each attribute uses the corresponding color and has a design related to the attribute. Among the attributes, "cherry blossom", "demon", "white fox", and "black fox" are attribute colors related to the performer avatars that appear as progression characters when the event content is provided. In other words, the purchasable flower stand FS are prepared to match the image motif and image color defined for the performer avatars that appear when the event content is provided.

[0245] Also, multiple sizes of flower stand FS are available. The types of sizes and prices of flower stand FS are different depending on the attribute. For example, for the attribute "plain", only the size "small" is available and the price is set at 500 coins. For the attribute "cherry blossom", two sizes, "large" and "small", are available and the price of the "large" size is set at 2500 coins and the price of the "small" size is set at 500 coins. The user selects one of the motifs and sizes to purchase the desired flower stand FS. For example, it is possible to provide a way to enjoy the event content by purchasing a flower stand FS that matches the attribute color, image motif, and image color related to the performer avatar that the user supports (advocates) among the performer avatars that appear in the event content.

[0246] FIG. 27(B) is a table of different sizes of flower star FS. Users can decorate their flower star FS (generate the display mode of the flower star FS), for example by adding text. The type of font and the color of the font are determined for each size of flower star FS, and the user can select at the time of purchase. Also, an upper limit on the number of characters that can be displayed is determined for each size of flower star FS. For example, for the "large" size, characters can be entered in two columns, with a character limit of 15 characters for each. For the "small" size, there is a character limit of 10 characters.

[0247] The area in which the flower stand FS can be displayed (placed) is determined for each size. When the user wants to display the purchased flower stand FS in the spatial area ER5, the user can select (designate) and place the flower stand FS from among the multiple display areas provided in the spatial area ER5 in which the flower stand FS can be displayed. For example, for the size "large", the display area can be selected from the main street (west) area 51a, the main street (east) area 51b, and the large torii area 52a (the area in which the large torii object 52t is placed). For the size "small", the display area can be selected from the temple grounds (west) area 52b, the temple grounds (east) area 52c, the front of the worship hall (west) area 53a, and the front of the worship hall (east) area 53b.

[0248] The purchase screen shown in FIG. 26(A) displays an image 411 of a flower stand FS selected by the user. Detailed information 412 of the selected flower stand FS is displayed below the image 411 of the flower stand FS. The detailed information 412 includes information on the size and attributes (motif). The user can also decorate the flower stand FS to be purchased with text and customize it to a desired design. In the text input area 413, it is possible to input text to be displayed on the flower stand FS. The input text is reflected in the image 411 of the flower stand FS, and it is possible to check the image when the flower stand FS is arranged. In addition, NG words that are restricted from being input are set for the text that can be displayed on the flower stand FS. The NG words are, for example, violent words and words that violate public order and morals. When an NG word is input, the purchase icon 417 is displayed in gray, and the purchase operation cannot be performed.

[0249] As shown in the example purchase screen in Fig. 26(A), the user selects the display area for the flower star FS by operating the placement selection area 414. The number of coins the user possesses, the number of coins to be consumed as the purchase price of the flower star FS, and the number of coins remaining after the purchase are displayed in the coin-related area 415. The user confirms the purchase by operating the purchase icon 417, and the billing process is carried out. To cancel the purchase, the user operates the close icon 416.

[0250] After the flower stand FS is purchased, the display of the flower stand FS is performed as shown in Fig. 26(B). For example, in Fig. 26(A), if a user purchases a flower stand FS1 with the attribute "cherry blossom", the size "small", and the text decoration "the best", FS1 is displayed in the display area in which the flower stand FS1 is placed, and the flower stand FS1 is surrounded by light (displayed and highlighted in a specific manner different from other flower stands). When a user purchases a flower stand FS and specifies the display area on the viewer terminal 300 side, for example, the delivery server computer 100 determines the display position within the specified display area by lottery or the like, stores information including the display position of the flower stand FS, and transmits information for specifying the display position to the viewer terminal 300 of the user who specified it. The viewer terminal 300 performs a process of replacing the flower stand displayed at the display position specified from the received information with the flower stand purchased by the user and displaying it. This makes it possible to encourage a user who has entered or participated in spatial area ER5 to move to the exhibition area of ​​the flower stand FS that the user himself / herself has placed, and to be motivated to go and see the user's own flower stand FS. It also provides an interesting experience for the user, for example, to check the text on other users' flower stands FS. Moreover, as shown in FIG. 24(A), the exhibition area is provided in each of areas ER51 to ER53 that constitute spatial area ER5. This makes it possible to encourage a user who has entered or participated in spatial area ER5 to move to all of areas ER51 to ER53, allowing the user to enjoy the entire spatial area ER5.

[0251] Next, the process of purchasing a flower cluster FS executed by the delivery server computer 100 will be described with reference to the flow of FIG.

[0252] In step S101, it is determined whether or not it is a purchase-available period before the scheduled date. The purchase-available period before the scheduled date may be a period that coincides with the period before the scheduled date, or may be a part of the period before the scheduled date. If it is not determined that it is a purchase-available period before the scheduled date, the process ends since a purchase is not possible. For example, on the scheduled date itself, the result in step S101 is NO, and therefore the flower stand FS cannot be purchased. For this reason, it is possible to motivate the user to purchase a flower stand FS by having them enter the spatial area ER5 at least once before the day of the event.

[0253] When it is determined in step S101 that the purchase is possible during the period before the scheduled date, it is determined in step S102 whether or not a shop selection operation has been performed. The shop selection operation is, for example, an operation (such as performing an action such as approaching a store clerk character or performing a selection operation on a predetermined icon of a shop) on a flower shop in the spatial area ER5 (such as the lantern shops 51s and 53s in FIG. 24). Specifically, in step S102, it is determined whether or not information transmitted when a shop selection operation is performed on the viewer terminal 300 has been received.

[0254] If it is determined in step S102 that a shop selection operation has been performed, then in step S103, information for displaying a shop screen on the display device 310 is transmitted to the viewer terminal 300 that originated the shop selection operation. The shop screen may be, for example, a screen that displays a product list for selecting a flower stand FS to purchase, or a purchase screen for a flower stand FS as shown in FIG. 26(A). This allows the viewer terminal 300 to display the shop screen and select a desired flower stand FS. After outputting information for displaying the shop screen in step S103, the process ends. Note that the purchase operation for a flower stand FS is not limited to within the spatial area ER5, but may be an operation from a shop displayed in another space within the virtual space ER, and a purchase operation may be performed on a website separate from the virtual space so that it is reflected (available / displayable) in the virtual space.

[0255] On the other hand, if it is not determined in step S102 that a shop selection operation has been performed, it is determined in step S104 whether or not a content editing operation has been performed. The content editing operation is a decoration operation such as inserting text into the flower star FS. In step S104, specifically, after the flower star FS to be purchased is selected in the viewer terminal 300, it is determined whether or not information for identifying the text entered in the flower star FS by performing a decoration operation on the screen shown in FIG. 26(A) is received from the viewer terminal 300. If it is determined that a content editing operation has been performed, it is determined in step S105 whether or not an NG word is included. If it is not determined that an NG word is included, the process ends. On the other hand, if it is determined in step S105 that an NG word is included, information to notify that fact (that an NG word is included) and that the purchase is not possible is transmitted to the viewer terminal 300 that performed the content editing operation in step S106, and the process ends. As a result, in the viewer terminal 300, for example, a pop-up display of "NG word is included" or a process to make the purchase icon 417 unselectable is performed.

[0256] If it is not determined in step S104 that a content editing operation has been performed, then it is determined in step 107 whether or not a purchase confirmation operation has been performed. The purchase confirmation operation is, for example, an operation on the purchase icon 417 shown in Fig. 26(A). Specifically, in step 107, it is determined whether or not information has been received that is transmitted when an operation is performed on the purchase icon 417 in the viewer terminal 300, and that specifies the type of flower stand FS purchased, the characters entered, the selected display area, and the like. If it is not determined that a purchase confirmation operation has been performed, then the process ends.

[0257] On the other hand, when it is determined in step S107 that the purchase confirmation operation has been performed, a purchase process (charging process) is performed in step S108. After the purchase process is performed, a flower stand display production process is performed in step S109, and the process ends. For example, based on the information received when the purchase confirmation operation is performed, a display position within the selected display area is determined by lottery or the like, and the user-related information (contained in the viewer user data 133) regarding the flower stand FS is updated, and information for identifying the display position is transmitted to the viewer terminal 300 of the purchasing user, and the display production illustrated in FIG. 26(B) is performed in the viewer terminal 300 of the purchasing user. The display position within the display area is not limited to being determined by lottery, and may be selected by the purchasing user, so that the display is displayed in a preferred position.

[0258] FIG. 27(C) is an example of a table that stores information about a flower stand FS purchased by a user, among the user-related information stored in the viewer user data 133. For example, information for identifying the purchased flower stand FS and information about the display location of the flower stand FS in the display area designated by the user are associated with each user ID. As an example, information such as a "flower stand ID" for individually identifying a flower stand FS, "purchased flower stand" which is information about the attributes and size of the purchased flower stand FS, "characters" which is information about the decoration (inputted characters) performed by the user, a "user-designated area" as information about the display area designated by the user, "position" which is information about the display position in the display area, and "purchase date and time" which is the date and time when the user purchased the flower stand are stored. During the flower stand display and presentation process in step S109, information about the purchased flower stand FS corresponding to the purchasing user is newly stored. Furthermore, information about the purchased flower stand FS is transmitted to the viewer terminal 300 of the purchasing user, and the viewer terminal 300 performs a display and presentation process for displaying (displaying) the purchased flower stand FS in place of the flower stand FS already displayed in the display location. It should be noted that when a flower stand FS is purchased, it is not limited to an exhibition presentation being carried out; instead, or in addition, a notification may simply be displayed that the purchased flower stand FS has been displayed in the selected exhibition area.

[0259] Furthermore, when a user purchases a flower stand FS, the flower stand FS already on display in the display location is replaced with the purchased flower stand FS on that user's viewer terminal 300, as described above, but the purchase does not affect the flower stand FS in the display area of ​​the other users' viewer terminals 300, and the same flower stand FS as before the purchase continues to be displayed. Therefore, the flower stand FS displayed in the display area can be different between the user who purchased the flower stand FS and other users.

[0260] In step S101, it is determined whether or not the period before the scheduled date is available for purchase, but the period may be any time, not limited to before the scheduled date. For example, depending on the timing of the provision of event content related to the flower stand FS to be purchased, the flower stand FS may be available for purchase on or after the scheduled date when the event content is provided, but if the period before the scheduled date is not available in step S101, the flower stand FS may not be used in the presentation of the event content.

[0261] Furthermore, editing operations (text insertion operations, content editing operations) of the display mode of the flower star FS are not limited to being performed at the time of purchase, but instead or in addition to this, it may be possible to edit after purchase. For example, after a purchase operation, the flower star FS may be saved in the user's item box, and the user may be able to take it out of the item box and display it or perform editing operations at a time of their choosing. Furthermore, the font type and color may be operable after purchase, not limited to being performed at the time of purchase. It may also be possible to edit not only the text, but also the color, and to add decorations, for example, to make the display mode more luxurious as an option.

[0262] In the above example, the display position (for example, display positions "A1", "A2", etc. in display area A described below) within the display area selected by the user is determined by lottery or the like based on the information received when the purchase confirmation operation is performed in step S107 in Fig. 28. However, the present invention is not limited to this, and for example, the display position may be determined when the flower stand FS is displayed, allowing the display to be made at a time separate from the time the flower stand FS is purchased.

[0263] (Changes in display format during the period before the scheduled date due to the establishment of switching conditions) Next, the transition of lantern objects arranged in the exhibition areas (display mode of the exhibition areas) will be described with reference to Fig. 29 to Fig. 32. In this embodiment, lantern objects are displayed in a plurality of exhibition areas provided in the area ER5 (for example, the main street (west) area 51a, the main street (east) area 51b, the large torii gate area 52a, etc.). An upper limit on the number of lantern objects that can be displayed in each exhibition area is set.

[0264] As mentioned above, the exhibition area will display not only flower arrangement FS purchased by the user himself (associated with the user himself) as described above with reference to Figures 26 to 28, but also flower arrangement FS purchased by other users (associated with other users), flower arrangement FS associated with the management (administrator), and flower arrangement FS associated with special users.

[0265] In this embodiment, the display area A corresponds to, for example, the shrine grounds (west) area 52b of the area ER52 in FIG. 24 which corresponds to the shrine grounds area, and is an area in which, for example, a flower stand FS of size "small" shown in FIG. 27(B) can be displayed, which is a lantern object. FIG. 29(A) is a part of the display area A which corresponds to the shrine grounds (west) area 52b, and as shown in FIG. 29(A), a plurality of flower stands FS which are lantern objects are displayed in a row and columns in the display area A. FIG. 31(A) is a table included in the object data 122, and is an example of a data table relating to information for identifying the flower stand FS and the display position to be displayed in the display area A. In FIG. 31(A), for example, a flower stand ID and displayed text information are associated with each display position (A1, A2, A3, . . .) in the display area A as information for identifying the flower stand FS. 29(A), and is associated with a flower stand FS with a flower stand ID of "a1", an attribute of "cherry blossom" and displaying the "letter A". Display position A2 corresponds to the position immediately to the right of display position A1 in the same row, and is associated with a flower stand FS with a flower stand ID of "b1", an attribute of "demon" and displaying the "letter B".

[0266] FIG. 31(B) is a table included in the object data 122, and is an example of a data table relating to information for identifying a flower stand FS to be placed in the exhibition area B and the display position. The exhibition area B is an area in which a flower stand FS of size "large" shown in FIG. 27(B) can be displayed, and corresponds, for example, to the location of the large torii object 52t in the area ER52 (large torii area 52a). In FIG. 31(B), as in FIG. 31(A), each exhibition position (B1, B2, B3, ...) in the exhibition area B is associated with information for identifying the flower stand FS, such as a flower stand ID and displayed character information. For example, a flower stand FS with a flower stand ID of "a1" and displaying the "letter A" is associated with the position corresponding to the exhibition position B1. A flower stand FS with a flower stand ID of "b1" and displaying the "letter B" is associated with the position corresponding to the exhibition position B2.

[0267] As shown in Fig. 31(A) and Fig. 31(B), the information of the flower star FS associated with each exhibition area is switched to information of another flower star FS determined by random drawing or the like whenever a switching condition is met. The switching condition of the flower star FS information for each exhibition area may include conditions that are met, for example, when a predetermined time has passed (e.g., every 30 minutes or 2 hours), when a user performs an operation of entering or leaving the virtual space (logging in, re-logging in, etc.), or when the user reloads the display data (e.g., a reload operation, or when the viewpoint of the user avatar U returns to a predetermined exhibition area after the viewpoint of the user avatar U has left the exhibition area). The probability of winning an exhibition by random drawing is set to a uniform probability for each flower star FS, but is not limited to this, and may be varied according to the characteristics of each flower star FS, as described later.

[0268] The delivery server computer 100 determines the flower stand FS to be displayed for each exhibition area each time the switching condition is met, updates the table for each exhibition area (see, for example, Figures 31(A) and (B)) stored as object data 122 (sets it as a default common to all users), and transmits information for identifying the flower stand FS for each exhibition area to the viewer terminal 300 of the user who has entered the spatial area ER5. This makes it possible for the viewer terminal 300 to switch and display the flower stand FS for each exhibition area (flower stands FS of other users, etc., excluding the user's own flower stand FS) to another flower stand FS. The flower stand FS is switched to within the range of the upper limit number that can be displayed for each exhibition area. For example, if the upper limit number of flower stands FS that can be displayed in the exhibition area A is 100, the information on the flower stand FS for the exhibition area A stored as the object data 122 shown in Figure 31(A) is updated by switching 100 flower stands FS to the data of the determined flower stand FS each time the switching condition is met. Also, for example, when the display area is opened, 10 flower stands FS may be initially placed in display area A, which can display 100 flower stands FS, and as users purchase and display them, the number may gradually increase to 100. When the display area is opened, for example, it is when a user is able to purchase a flower stand FS and display it in the display area. In this case, the random drawing may be performed after the upper limit has been reached.

[0269] As described above, the information on the flower stand FS arranged in the virtual space is switched every time the switching condition is met, but the flower stand FS purchased by the user himself can continue to be displayed in the exhibition area in the virtual space based on the information managed in FIG. 27(C). For example, FIG. 29 shows an example of the transition of the display mode of the flower stand FS in exhibition area A displayed on the display device 310 of user 1 when user 1 purchases a new flower stand FS. FIG. 30 shows an example of the transition of the display mode of the flower stand FS in exhibition area A (at the same display position as shown in FIG. 29) displayed on the display device 310 of user 2 when user 1 purchases a new flower stand FS. FIGS. 29(A) and 30(A) show display examples in which a flower stand FS determined as a default corresponding to exhibition area A and identified from the flower stand arrangement information in FIG. 31(A) is arranged. It is assumed that at the timing of FIG. 29(A) and FIG. 30(A), the flower stand FS purchased by neither user 1 nor user 2 is displayed in the display area A.

[0270] Figures 29(B) and 30(B) are display examples at the time when user 1 newly purchases flower stand FS1. The flower stand FS1 purchased by user 1 has the attribute "cherry blossoms" of flower stand ID "a3" shown in Figure 27(C), the size is "small", and the input characters are "the best". Furthermore, user 1 selected "A" as the display area when purchasing, and it is associated with a location "A1" within the display area.

[0271] When user 1 purchases flower stand FS1, information about the purchased flower stand is distributed to user 1, and on user 1's viewer terminal 300, the flower stand FS placed in exhibition position A1 in exhibition area A is switched to the flower stand FS1 purchased by user 1. Meanwhile, on user 2's display device 301, as shown in Fig. 30(B), the same flower stand FS as in Fig. 30(A) is still displayed.

[0272] 29(C) and 30(C) are display examples when a switching condition is met a predetermined time after the previous switching. On user 1's display device 301, as shown in FIG. 29(C), the flower stand FS1 that user 1 himself purchased and that is displayed in exhibition area A1 continues to be displayed in the same position as in FIG. 29(B), but the other flower stands FS have been switched to flower stands FS determined by lottery in response to the establishment of the switching condition. The other flower stands FS are flower stands FS that are not associated with user 1, but are associated with other users, etc. It should be noted that the other flower stands FS may include flower stands FS prepared by the management that are not associated with any other users.

[0273] On the other hand, on user 2's display device 310, the display has been switched to a flower stand FS determined by lottery in response to the establishment of the switching condition, as shown in Fig. 30(C). Fig. 30(C) differs from Fig. 29(C) for user 1 in that a flower stand FS different from the flower stand FS1 associated with user 1 is displayed at exhibition position A1 in exhibition area A, and a common flower stand FS based on default data stored in object data 122 is displayed at all exhibition positions within exhibition area A, including exhibition position A1.

[0274] Figures 29(D) and 30(D) show examples of the display when the switching conditions are met again after a predetermined time has passed and the flower stand FS in exhibition area A is switched. At this switching timing, the object data 122 for exhibition area A determined by lottery and stored happens to include a flower stand FS1 purchased by user 1, and its display position is A6 (the second position from the left in the bottom row in Figures 29(D) and 30(D)). In this case, for user 2, user 1's flower stand FS1 is displayed in A6 based on the default data, as shown in Figure 30(D).

[0275] On the other hand, in the display device 310 of user 1, as shown in FIG. 29(D), the flower stand FS1 continues to be displayed in place A1 based on FIG. 27(C). That is, even if the object data 122 for the same exhibition area includes the flower stand FS1 purchased by user 1, the viewer terminal 300 of user 1 switches to place the flower stand FS1 purchased by user 1 in the exhibition position based on FIG. 27(C). Furthermore, the viewer terminal 300 of user 1 performs a process of replacing the flower stand FS (default flower stand FS) based on the object data 122 that was placed in the exhibition position (A1) of the flower stand FS1 purchased by user 1 with the flower stand FS1 purchased by user 1 based on the object data 122 and displaying it. As a result, in place of the flower stand FS1, the flower stand FS (flower stand FS with the "letter O") that was associated with A1 by the default data is displayed in A6 of user 1. This makes it possible to prevent the same flower stand from being placed multiple times in the same exhibition area.

[0276] Even if the object data 122 for the same display area includes a flower stand FS purchased by user 1, only the switching process is performed to place the flower stand FS purchased by user 1 in the display position based on Fig. 27(C), and the flower stand FS purchased by user 1 based on the object data 122 may be displayed as is. In this case, a sense of exclusivity can be given to the user since multiple identical flower stands FS for user 1 are displayed.

[0277] Also, in Fig. 29, an example has been described in which the flower stand FS1 purchased by user 1 is displayed fixed at position A1 within the exhibition area A. However, this is not limiting, and the display position of the purchased flower stand FS may be switched within the exhibition area A arranged by the user each time a switching condition is met. For example, at the timing of Fig. 29(C), the flower stand FS1 purchased by user 1 is displayed at position A1, but at the next switching timing, it may be displayed at position A4, which corresponds to the upper right of the exhibition area A, and default data (data of the flower stand FS associated with A1 in Fig. 31(A)) may be displayed at A1.

[0278] Next, the switching process of the flower FS displayed in the exhibition area in the virtual space executed by the virtual space generating program 120 will be described with reference to FIG.

[0279] In step S201, it is determined whether or not it is a displayable period before the scheduled date. The displayable period may be a period that matches the period before the scheduled date, or may be a part of the period before the scheduled date. If it is not determined that it is a displayable period before the scheduled date, the switching process is terminated.

[0280] On the other hand, when it is determined in step S201 that the display period is before the scheduled date, it is determined in step S202 whether or not the switching condition is satisfied. An example of the switching condition in step S202 is, for example, when a predetermined time has elapsed (for example, 30 minutes or 2 hours). When it is determined in step S202 that the switching condition is satisfied, in step S203, a flower stand to be displayed for each exhibition area is randomly selected from all the flower stands FS to be selected by lottery, the flower stand arrangement information for each exhibition area (FIGS. 31(A), (B), etc.) as object data 122 is updated, and the updated flower stand arrangement information (including information specifying the flower stand FS (information specifying the display mode of the flower stand to be displayed on the viewer terminal, etc.)) is transmitted to the viewer terminal 300 of the user who has entered and participated in the spatial area ER5. For example, in the case of the exhibition area A, the flower stand arrangement information for the exhibition area A illustrated in FIG. 31(A) is updated to the information of the randomly selected flower stand FS, and stored in the database that stores the object data 122. The updated flower arrangement information is sent from the database storing the object data 122 to the user's viewer terminal 300. This updates the information of the default flower arrangement FS for each exhibition area, and makes it possible to switch and display the flower arrangements of each exhibition area on the viewer terminal 300 of the user who has entered and is participating in the spatial area ER5.

[0281] The flower stands FS to be selected may be all flower stands FS stored as object data 122, excluding NG flower stands (for example, flower stands that have been set to be hidden by the administrator due to being reported, etc.), or the flower stands FS may be divided into predetermined groups and the flower stands FS to be selected from those in the predetermined groups. For example, the groups may be divided by purchase time, type of flower stand, etc.

[0282] On the other hand, when it is not determined in step S202 that the switching condition is satisfied, it is determined in step S204 whether or not a new user has entered the spatial area ER5.

[0283] If it is not determined in step S204 that a new user has entered the room, the process ends. On the other hand, if it is determined in step S204 that a new user has entered the room, then in step S205, flower arrangement information for each exhibition area is transmitted to the viewer terminal 300 of that user. This allows the user to receive information for identifying the default flower arrangement FS determined for each exhibition area. For example, flower arrangement information for a predetermined range of exhibition areas including exhibition area A updated in step S203 is transmitted.

[0284] In step S206, it is determined whether or not the newly entered user has a purchased flower stand FS based on the information related to the purchased flower stand shown in FIG. 27(C). When it is determined that the newly entered user has a purchased flower stand FS, in step S207, purchased flower stand information for identifying the purchased flower stand FS, display position information determined at the time of purchase, and the like are transmitted to the viewer terminal 300 of the user. The purchased flower stand information is information related to the purchased flower stand FS for each user, as exemplified in FIG. 27(C). For example, when processing is performed for user 1, if the timing for display area A is as shown in FIG. 29(C), default data for display area A at the time of FIG. 29(C) is transmitted in step S205. In addition, the purchased flower stand information for user 1 shown in FIG. 27(C) (flower stand ID "a3") and display position information determined at the time of purchase ("A1", which is the arrangement information for "a3") are transmitted in step S207. As a result, as shown in FIG. 29(C), a flower stand FS1 with a flower stand ID "a3" is displayed at the display position A1, and a default flower stand FS is displayed at the other display positions within the display area A.

[0285] In step S201, an example of judging whether or not it is a displayable period before the scheduled date has been described, but the present invention is not limited to this, and it may not be necessary to judge whether or not it is a displayable period before the scheduled date. For example, the present invention may be applied to a spatial area ER in which a specific object can be placed, regardless of the date on which the event content is provided (for example, the date of a live performance).

[0286] Also, in step S203, an example has been described in which the flower arrangement information is updated when the switching condition is satisfied, and the updated flower arrangement information is sent to the user who has entered and participated in the spatial area ER5. However, in step S203, the present invention is not limited to this, and only the process of updating the flower arrangement information when the switching condition is satisfied may be performed, and the process of sending the updated flower arrangement information to the user who has entered and participated in the spatial area ER5 may not be performed. In other words, the flower arrangement may not be switched when the switching condition is satisfied in the viewer terminal 300 of the user who has already entered and participated. Also, in step S203, the flower arrangement information may be updated when the switching condition is satisfied, and the updated flower arrangement information may be sent only to the user who has entered and participated in the spatial area ER5 and satisfies a predetermined requirement. The predetermined requirement may be satisfied, for example, when a time longer than the time for satisfying the switching condition has elapsed since entering and participating, or when the user's individual settings allow switching when the switching condition is satisfied. In addition, even if a user does not receive updated flower arrangement information in step S203, when re-entering the room, the processing from step S205 onwards is performed and the latest flower arrangement information (updated in step S203) is transmitted.

[0287] In the embodiment with reference to Figures 29 to 32, even if the switching condition is met, the flower star FS purchased by the user himself continues to be displayed, while the flower star FS associated with another user is switched and displayed. However, even if the flower star FS is associated with another user, if the other user is a special user, the flower star FS associated with the special user may continue to be displayed. As described above, special users include performer users, sponsor users who sponsor events, and other celebrities, and users who are authenticated as special users by the management (administrator) side.

[0288] Next, a switching process 2 for the flower FS displayed in the exhibition area in the virtual space executed by the virtual space generating program 120 will be described with reference to FIG.

[0289] FIG. 33 is an example of the above-mentioned flower star switching process, in which a process is added to be performed when the information on the flower star FS cannot be read out in a desired state from a database that stores the information on the flower star FS (the information on the flower star FS cannot be specified). There are a large number of flower stars displayed in this embodiment, and each display mode may be different. In the flower star switching process, information read out from a database (e.g., a database server) that stores information on many flower star FSs is transmitted (distributed) to each user who has entered the room. For this reason, when many users enter the room at once, the load on the distribution server computer 100 increases in order to perform the flower star switching process for many users. For example, if the database server that stores the information on the flower star FS is overloaded due to concentrated accesses, the database server cannot read out the flower star arrangement information, and therefore the information required to display the virtual space cannot be transmitted (distributed) to the login source (the viewer terminal of the user who has entered and participated in the virtual space), which may cause a problem such as not being able to enter the room at all.

[0290] On the other hand, the flower star in the exhibition area is an object that adds excitement to the virtual space, but is not an object essential for generating the virtual space (for example, an object that may cause a user to feel uncomfortable if it is missing depending on the content provided, such as the building and stage objects shown in FIG. 24, or an object that is the base of the virtual space). If the data of the essential object cannot be read and transmitted (delivered), the virtual space itself cannot be generated and displayed (the content provided in the virtual space cannot be established), whereas the virtual space itself can be generated and displayed even if the flower star in the exhibition area cannot be displayed accurately. In other words, when the data of the object (first type of object) essential for generating the virtual space can be specified (read and transmitted and received), the virtual space can be generated and displayed regardless of whether the data of the object (second type of object) such as the flower star that is not essential for generating the virtual space is specified. Also, the flower star in the exhibition area is updated and displayed to an accurate flower star every time the switching condition is established, as described in steps S202 to S205 of FIG. 32. In other words, if users are able to enter the virtual space, the flower chart in the exhibition area can be updated periodically, so the impact of a malfunction on both users and management is greater if users are unable to enter the exhibition area due to this than if the flower chart in the exhibition area cannot be displayed accurately temporarily.

[0291] Therefore, in the cluster switching process 2 in this embodiment, the processes of steps S225 to S245 are performed following the process of step S215. Note that in FIG. 33, mainly the processes within the dotted line frame have been added to the processes in FIG. 32 described above. The same steps as those in FIG. 32 are indicated by the same step numbers, and the explanations are simplified (and omitted). Also, steps S213 and S223 in FIG. 33 more specifically explain the process in step S203 in FIG. 32, and steps S215 to S245 in FIG. 33 more specifically explain the process up to sending the cluster arrangement information to the user in step S205 in FIG. 32 and FIG. 33.

[0292] If it is determined in step S202 that the switching condition is met, then in step S213, a flower stand to be displayed for each exhibition area is randomly selected from all the flower stands FS that are the subject of the lottery, and the flower stand arrangement information for each exhibition area in the object data 122 (Figures 31(A), (B), etc.) is updated and stored. For example, in the case of exhibition area A, the flower stand arrangement information for exhibition area A shown in Figure 31(A) is updated to the information of the randomly selected flower stand FS and stored in the database that stores object data 122.

[0293] In step S214, the updated flower arrangement information (including information identifying the flower arrangement FS (such as information identifying the display mode of the flower arrangement to be displayed on the viewer terminal)) is read from the database that stores the updated flower arrangement information and transmitted to the viewer terminal 300 of the user who has entered and is participating in the spatial area ER5. This updates the information for the flower arrangement FS for each default exhibition area, and makes it possible to switch between and display the flower arrangements of each exhibition area on the viewer terminal 300 of the user who has entered and is participating in the spatial area ER5.

[0294] In step S204, it is determined whether or not a new user has entered the room. If it is not determined that a new user has entered the room, the process ends as in FIG. 32. On the other hand, if it is determined in step S204 that a new user has entered the room, then in step S215, the updated flower arrangement information for each exhibition area (including information specifying the flower arrangement FS (such as information specifying the display mode of the flower arrangement to be displayed on the viewer terminal)) is read out. For example, the distribution server computer 100 performs a process of reading the flower arrangement information updated in step S213 and transmitted in step S223 to the user who has entered and participated from a database in which the information on the updated arrangement flower arrangement FS is stored as object data 122.

[0295] The range of the flower arrangement FS information that the distribution server computer 100 reads out from the database storing the flower arrangement FS information (including arrangement information) as the object data 122 in steps S223 and S215 may be, for example, flower arrangement information that can be displayed in all exhibition areas of the virtual space (for example, in the spatial area ER5) that the user has entered, or may be flower arrangement information that can be displayed in a part of the exhibition area of ​​the virtual space that the user has entered. The part may be, for example, the flower arrangement information of the exhibition area in the section in which the user avatar U is located in the area of ​​the virtual space that the user has entered (for example, the exhibition area in the section such as the area ER51 or the area ER52 in FIG. 24), or may be the flower arrangement information of the range that can be displayed on the user screen as the user avatar U moves (for example, the exhibition area within a predetermined 360-degree distance from the position of the user avatar U).

[0296] In step S225, it is determined whether or not all of the flower arrangement information has been read. The state in which all of the flower arrangement information has been read includes, for example, the state when information specifying the flower arrangement FS to be read from the database is accurately returned from the database. When it is determined in step S225 that all of the flower arrangement information has been read, the flower arrangement information for each exhibition area read in step S205 is transmitted to the viewer terminal 300 of that user.

[0297] On the other hand, if it is not determined in step S225 that all the cluster arrangement information has been read, then in step S235 it is determined whether or not a predetermined time (e.g., 100 ms) has elapsed since the reading in step S215 was started. If it is not determined in step S235 that the predetermined time has elapsed, the process proceeds to step S215 to continue reading the cluster arrangement information that has not been read (the clusters to be placed in the missing parts), and then proceeds to step S215 again. The determination of whether or not the predetermined time has elapsed may be made, for example, by the AP server starting a process to read the cluster FS information from the database server and determining whether or not a predetermined time has elapsed while waiting for a response from the database server, or by determining whether or not a predetermined time has elapsed since the database server started a process to identify the cluster FS information to be returned as the cluster arrangement information, and returning information for which the predetermined time has elapsed (e.g., information that could not be identified) to the AP server.

[0298] On the other hand, if it is determined in step S235 that the predetermined time has elapsed, a predetermined substitute flower stand is identified to be placed in the missing portion that could not be read in step S245. Once a flower stand to be placed in the missing portion has been identified in step S245, the process proceeds to step S205, and flower stand placement information for each exhibition area is transmitted to the viewer terminal 300 of that user. A substitute flower stand is information that requires a lighter processing load to be identified by the distribution server computer 100 than reading out the flower stand placement information updated in step S213. For example, in a storage area (or past updated flower arrangement information temporarily stored as a cache) in storage 103 of distribution server computer 100 different from the database from which the flower arrangement FS is read in steps S223, S215, etc., the flower arrangement FS may be a flower arrangement FS that is not updated (not displayed) when a switching condition is satisfied, such as a flower arrangement FS displayed in the form of a simple flower arrangement FS (for example, blank) or a flower arrangement FS predetermined by the administrator, but is not limited to this and may be a predetermined flower arrangement FS among the flower arrangement FS that may be updated (displayed) when a switching condition is satisfied, or may be a flower arrangement FS included in the flower arrangement information that has already been read. In step S235, if the desired flower arrangement information cannot be read (identified) due to a load on the database, etc., information for displaying an alternative flower arrangement FS that requires light processing when identifying, in place of the data that could not be read, is distributed to the viewer terminal 300.

[0299] Furthermore, if only a portion of the information on the flower star FS read in step S215 was successfully read, steps S245 and S205 will supplement the missing portion excluding the portion that was successfully read. For example, if information on exhibition areas A and B was read, but only the information on exhibition area A was successfully read, processing will be performed to supplement the information on exhibition area B. Note that even if only a portion of the information on the flower star FS read in step S225 was successfully read, all of it may be replaced with information on an alternative flower star FS in step S245.

[0300] This allows the user to receive information on a flower chart FS that replaces the information on the flower chart FS of the default flower chart that could not be read due to the load on the database. This makes it possible to avoid problems such as not being able to enter a room because information for displaying the virtual space cannot be received. In other words, a display priority is set for objects that can be displayed, and if an object with a high priority that was essential for establishing the content provided by the virtual space can be received, the virtual space is displayed regardless of whether an object that is not essential and has a low priority can be received normally. When data of an object that is not essential and has a low priority can be identified, the object is displayed in a display mode based on the data, while when data cannot be identified, an alternative object corresponding to the object is displayed.

[0301] FIG. 34 is an example in which a flower stand FST associated with a special user is arranged in the exhibition area A in addition to the display example of the display screen 310 of user 1 in FIG. 29. The flower stand FST is a flower stand FS associated with a talent user related to the attribute "black fox", and is, for example, a special flower stand FST prepared or purchased by the special user. At the timing of FIG. 34(A), the flower stand FST of the special user is displayed by default in the exhibition position A4 in the upper right corner of the exhibition area A. The flower stand FST prepared or purchased by the special user is displayed in the exhibition area, and even if the switching condition is met, the flower stand arrangement information of that flower stand FST will not be switched to another flower stand.

[0302] Next, in Figure 34(B), when user 1 purchases a flower stand FS1, the flower stand FS1 purchased by user 1 is displayed in display position A1 in display area A. When a user purchases a flower stand FS, as described above, a display area is selected and the display position within that display area is determined, but display positions where flower stands of special users are displayed as described above are excluded from the display positions to be determined. This makes it possible to prevent a flower stand from being determined as a display position for a special user's flower stand, even if the user purchases a flower stand.

[0303] After that, even after the switching timing when the switching condition in Fig. 34(C) is met, the special user's flower star FST continues to be displayed in display position A4 in addition to the flower star FS1 purchased by user 1 himself. Similarly, at the next switching timing in Fig. 34(D), the flower star FS1 and the flower star FST continue to be displayed.

[0304] In the spatial area ER5, an exhibition area (special exhibition area) may be provided in which all the flower stands FS are those of special users, or a single area may be provided in which the flower stands FS of special users are displayed individually as objects or photo spots. Also, the flower stands displayed in the special exhibition area or single area may be switched from among the flower stands FS associated with a special user to those associated with another special user when a switching condition is met.

[0305] In this embodiment, a user can purchase and own multiple flower stands FS (specific objects). Therefore, the more flower stands FS a user purchases, the higher the probability that the flower stand FS will be determined as the default flower stand FS when the switching condition is met, and the higher the possibility that the flower stand FS will be displayed in the spatial area ER5 of the viewer terminal 300 of another user. For example, as illustrated in FIG. 27(C), user 1 owns three flower stands FS, whereas user 2 owns one. Therefore, when a lottery is drawn with a uniform probability, the probability that any of the flower stands FS of user 1 will be determined as the default flower stand FS is three times higher than the probability that the flower stand FS of user 2 will be determined. This makes it possible to motivate users to purchase more flower stands FS in order to appeal to other users.

[0306] On the other hand, even if a user owns a huge number of flower stands FS (for example, 10,000), if the greater the number owned, as described above, the more likely it is to be determined as the default flower stand FS, the more likely it is that the flower stand FS of that user who owns a huge number of flowers will be determined as the default flower stand FS and displayed, which may result in the display state of the flower stands FS displayed in the display area of ​​other users becoming less appealing, or being misused, or causing other users to feel uncomfortable. To prevent these, in this embodiment, for users who have purchased and owned a predetermined number of flower stands FS (for example, 100), the number of flower stands FS they have purchased and owned is considered to be the predetermined number, regardless of whether the user is more than the predetermined number, and a default flower stand FS is determined at the same rate (probability) as a user who has purchased and owned the predetermined number of flower stands FS. For example, if the predetermined number is 100, the percentage of a user who has purchased and owns 100 or more that is determined to be the default flower stand FS will be the same as the percentage of a user who has purchased and owns 100 that is determined to be the default flower stand FS, even if the actual number owned is a thousand, ten thousand, etc. This makes it possible to prevent too many flower stands FS of a particular user from being displayed in the display area of ​​the display device 300 of other users.

[0307] (Changes in display mode during event content provision) In this embodiment, while the event content to be provided on the scheduled date is being provided, the flower stand FS purchased by the user during the period before the scheduled date is displayed in the virtual space. Also, the image (display mode) in the live area ER53', which is the event content, changes depending on the event that occurs within the spatial area ER5 during the period before the scheduled date. An example of an event that occurs within the spatial area ER5 during the period before the scheduled date is when a user purchases a flower stand FS and displays / places it in the display area within the spatial area ER5. Hereinafter, the change in the display mode of the virtual space while the event content is being provided will be described with reference to Figs. 35 to 37.

[0308] FIG. 35 shows an example of a scene from an event content (such as a live performance in which the same types of performances as those in FIGS. 13 to 24 are performed) provided in the worship hall of the area ER53' in FIG. 24 that functions as the virtual stage G. The virtual stage G in FIG. 35 will hereafter be referred to as virtual stage G2. Performer avatars 1a to 1d are on the virtual stage G2. The performer avatars 1a to 1d are associated with the attributes "cherry blossom," "demon," "white fox," and "black fox," respectively. These attributes correspond to the attributes associated with the flower stand FS shown in FIG. 27(A).

[0309] During the provision of the event content, as shown in Fig. 35, a performance is performed in which the performer avatars 1a to 1d introduce a flower stand FS while holding it in their hands. In this embodiment, if a viewing user has purchased a flower stand FS during the period before the scheduled date, a performance is performed in which the performer avatars 1a to 1d hold the flower stand FS purchased by the user. Fig. 36 is an example of a data table for identifying a flower stand FS used in the performance of the event content in Fig. 35. Fig. 36(A) is default event flower stand information common to all users, which is managed in the delivery server computer 100 (e.g., gift data 134, etc.). The flower stand FS displayed on the display device 310 for each user during the provision of the event content is identified based on the event flower stand information in Fig. 36(A) and the purchased flower stand related information for each user in Fig. 27(C).

[0310] In the present embodiment, a total of nine flower stands FS are used for the presentation of the event content, including flower stands FS of the attributes "cherry blossom", "demon", "white fox", and "black fox" with sizes "large" and "small", and a flower stand FS with the attribute "gorgeous". The default flower stand FS in FIG. 36(A) is determined by random drawing for each attribute and size from among the flower stands FS purchased by any user during the period before the scheduled date from the end of the period before the scheduled date to the start of the event content. As shown in FIG. 36(A), information specifying the default flower stand FS used for the presentation is associated with each attribute and size of the flower stand FS. For example, a flower stand FS with a flower stand ID "a4" and characters "character A4" is associated with a flower stand FS with a size "large" of the attribute "cherry blossom". Note that not all types of flower stands FS purchasable before the scheduled date illustrated in FIG. 27(A) may be used for the presentation of the event content, but only a part of them may be used. For example, in this embodiment, the attribute "plain" is not used for the presentation of the event content.

[0311] The distribution server computer 100 transmits the event flower information of FIG. 36(A) and purchased flower-list related information for each user of FIG. 27(C) to the viewer terminals 300 of participating users at the start of the event content (at login) or at a specified timing during the content provision.

[0312] In the viewer terminal 300 of each user, among the flowers identified from the received event flower information, a flower that has the same attribute and size as a flower identified from the purchased flower related information of the user is replaced with the flower identified from the purchased flower related information of the user, and the event flower data shown in FIG. 36(B) is updated. In this embodiment, if a user has purchased and owns a plurality of flower FSs with the same attribute and size, the last (most recently) purchased flower FS is set as the event flower information (associated with the table). As shown in FIG. 27(C), the number of flower FSs owned by user 1 with the attribute "cherry blossom" and size "small" is one, which is the flower ID "a3". Therefore, while the flower FS with the attribute "cherry blossom" and size "small" was associated with the flower ID "b4" in the default of FIG. 36(A), "a3" is associated with the event flower information of user 1 as shown in FIG. 36(B). Furthermore, as shown in Fig. 27(C), user 1 owns two flower stands FS with the attribute "luxury" with flower stand IDs "b3" and "c3." Since "c3" was purchased later than "b3" and "c3," "c3" is associated with the attribute "luxury" in Fig. 36(B). As a result, for users who did not purchase a flower stand in the period before the scheduled date, the default event flower stand information is maintained, and for users who purchased a flower stand in the period before the scheduled date, the default event flower stand information is updated to event flower stand information in which a flower stand with the same attribute and size has been replaced with the purchased flower stand.

[0313] Based on the set event flower arrangement information, the viewer terminal 300 of each user performs a performance during the provision of the event content as shown in FIG. 35. FIG. 35 shows an example of a display mode displayed on the display device 310 of the user 1, which is displayed based on the event flower arrangement information stored in FIG. 36(B). FIG. 35(A) shows an example in which the performer avatars 1a to 1d have a flower arrangement FS of size "small" with an attribute corresponding to each of their attributes. As the flower arrangement FS held by the performer avatar 1a, a flower arrangement FS1 with a flower arrangement ID "a3" purchased by the user 1 is displayed. In addition, in the center of FIG. 35(A), a flower arrangement FS with an attribute "splendor" is displayed, and a flower arrangement FS2 with a flower arrangement ID "c3" last purchased by the user 1 is displayed. In addition, in FIG. 35(B), the performer avatars 1b and 1c have a flower arrangement FS of size "large" with an attribute "demon". Since user 1 has not purchased a flower stand FS with the attribute "demon" and size "large", the flower stand FS with the default flower stand ID "g4" in Fig. 36(A) is displayed. Note that the display mode of the virtual live venue is not limited to the set exemplified in Fig. 35, and various objects may be displayed.

[0314] The production shown in Fig. 35 is performed by transmitting production information including, for example, information for controlling the display operation of the performer avatars 1a-1d and information for specifying the attributes and size of a flower stand to be held in the hand of each of the performer avatars 1a-1d or displayed at a predetermined position in the virtual space (hanging from the ceiling) from the distribution server computer 100. The viewer terminal 300 of each user controls the display mode in the virtual space including the performer avatars 1a-1d based on the production information, and arranges a flower stand that matches the information for specifying the attributes and size of the flower stand among the flower stands FS specified from the event flower stand information (see Fig. 36(B)) updated in each viewer terminal 300, thereby making it possible to perform the production shown in Fig. 35.

[0315] Next, with reference to Fig. 37(A), the event flower arrangement determination process executed in the distribution server computer 100 will be described. In step S301, the flower arrangements to be used in the presentation of the event content are determined by random drawing for each attribute and size of the flower arrangement described above. In step S302, event display flower arrangement information (see Fig. 36(A)) capable of identifying the determination result is transmitted to the viewer terminal 300. For example, as shown in Fig. 36(A), event flower arrangement information stored in association with information identifying the flower arrangement FS determined by drawing for each attribute and size is transmitted to the viewer terminal 300 of a user who is planning to participate or is currently participating in the event content.

[0316] In step S303, based on the purchased flower star related information for each user shown in Figure 27 (C), for users who have purchased flower stars, the purchased flower star related information for each user is transmitted to the viewer terminal 300 of each user, and the event flower star determination process is terminated.

[0317] Next, the event flag specification process executed in the viewer terminal 300 will be described with reference to FIG.

[0318] In step S311, the event flower stand information (see FIG. 36(A)) transmitted and received from the delivery server computer 100 in step S302 of FIG. 37(A) is stored as default data for identifying a default flower stand FS to be used in the performance. In step S312, it is determined whether or not purchased flower stand related information (information of the user in FIG. 27(C) transmitted from the delivery server computer 100 in step S303 of FIG. 37(A)) has been received. If it is not determined in step S312 that purchased flower stand related information has been received, the event flower stand determination process ends.

[0319] On the other hand, when it is determined in step S312 that purchased flower stem related information has been received, in step S313, information for identifying the flower stem FS purchased by the user for each attribute and size based on the received purchased flower stem related information is stored as update data. At this time, if multiple flowers with the same attribute and size have been identified, the last (most recently) purchased flower stem with that attribute and size is identified and stored based on the purchase date and time.

[0320] In step S314, for those flowers identified from the default data that have the same attributes and size as those identified from the update data, the information of the flowers to be used in the presentation is rewritten to the flowers identified from the update data.

[0321] As described above, for a user who has already purchased a flower stand FS, the flower stand purchased by the user himself can be displayed in association with the performer avatar for the event display flower stand. Furthermore, in this embodiment, if there are multiple flower stands with the same attributes and size as the purchased flower stand, the most recently purchased flower stand FS is displayed, making it possible to display a flower stand FS that has been created with a more elaborate design by the scheduled date for the provision of the event content. Note that the flower stand FS to be used is not limited to the one that replaces the most recently purchased flower stand FS, and a flower stand with the same attributes and size may be selected by lottery for use in the presentation.

[0322] 37(A) is described as an example in which the event flower star determination process is determined and stored in advance before the event content is provided, but is not limited thereto, and may be executed, for example, at predetermined time intervals (e.g., every 10 minutes) during the provision of the event content to update the event flower star information. Alternatively, if a singing part and an MC part are repeated during the provision of the event content, the event flower star information for each part may be updated before the start of the next part. During the provision of the event content, the display mode of the presentation may be changed based on the event flower star information updated during the provision of the event content.

[0323] Note that the flower stand FS to be selected by lottery determined as the event flower stand information shown in Fig. 36(A) may exclude flower stand FS associated with special users. This allows the flower stand FS to be selected by lottery from those associated with fan users (general users) of the performer avatar, for example, and increases the consistency of the displayed flower stand FS and messages to fans, such as "Thank you for your support with the flower stand!", in the presentation of the event content.

[0324] (Regarding processing related to event content) In the above, an example has been described in which the display mode in the spatial area ER5 may change depending on an event that occurs in the spatial area ER5 during the period before the scheduled date on which the event content is to be provided. However, instead of or in addition to this, in this embodiment, processing related to the event content may be performed depending on the degree to which an image in the spatial area ER5 is displayed on the display device 310 of the viewer terminal 300 by entering or participating in the spatial area ER5 during the period before the scheduled date on which the event content is to be provided in the virtual space ER.

[0325] The process related to the event content includes, for example, a process of changing the display mode of the presentation during the provision of the event content, and a process of giving the user an object that the user can use during the provision of the event content. The degree of display is, for example, the number of times the user entered the spatial area ER5 during the period before the scheduled date. The number of times the user entered the spatial area ER5 may be the number of days so that multiple entries on the same day are counted as one entry, or may be the number of times that the user entered the spatial area ER5 for a predetermined period (for example, 10 minutes) or more. The degree of display is not limited to this, and may be the duration of stay in the spatial area ER5 during the period before the scheduled date, or the degree to which a specific area in the spatial area ER5 is displayed (the number of times displayed, the time displayed, etc.). The specific area may be, for example, an area that is predetermined in the spatial area ER5, such as an exhibition area or an offering area.

[0326] Below, we will explain an example in which the "degree" of displaying an image within the spatial area ER5 is "the number of times entered into the spatial area ER5 where the event content may be held on the scheduled date (hereinafter simply referred to as the number of entries)" and the "processing related to the event content" is "processing to change the content of the presentation while the event content is being provided" and "processing to grant the user an object that the user can use while the event content is being provided."

[0327] The delivery server computer 100 (for example, the event data 111 and the gift data 134) counts and stores the number of times each user enters the room during the period before the scheduled date. Fig. 38 shows an example of a data table for specifying the "item" given according to the number of times the user enters the room and the "performance content" that is changed during the provision of the event content according to the number of times the user enters the room.

[0328] The "items" granted (made available) according to the number of times of entry are objects that can be used by the user while the event content is being provided. For example, they may be limited items that can only be used in the event content (e.g., live) held after the end of the period before the scheduled date, or they may be items that can be used not only in the event content held after the end of the period before the scheduled date, but also in content other than the event content. When used in content other than the event content held after the end of the period before the scheduled date, for example, the item may be limited in terms of performance such as its function and effectiveness (for example, a certain function may not be available, or the effect may be reduced), or instead of or in addition to these, they may be limited items related to, for example, the image theme of the event content held after the end of the period before the scheduled date.

[0329] As shown in FIG. 38, the "item" is, for example, an item that can be used during the provision of the event content to liven up the event. For example, if the number of times of entry during the period before the scheduled date is 1, a limited cracker A that can be used in the event content is given, if the number of times is 2, a limited cracker B is given, and if the number of times is 3, a limited cracker C is given. If the number of times is 4, a limited firework is given, if the number of times is 5, a limited glow stick is given, if the number of times is 6, a limited stamp is given, and if the number of times is 7, a limited item set is given. The stamp is a stamp that can be used for chatting in the virtual space and sending and receiving messages. The item set is an assortment set that includes a plurality of items. Note that the items shown in FIG. 38 are not limited to these, and may be so-called tip items, etc., as long as they can be used during the provision of the event content and liven up the event. In addition to the items that are given to the user, items that correspond to the actual number of times of entry may also be given corresponding to the number of times that is less than the actual number of times of entry.

[0330] As shown in FIG. 38, for example, if the number of times of entry during the period before the scheduled date is 1 to 3, the "production contents" are normal production and the production contents do not change. If the number of times of entry is 4 or more, the production contents can change, and special room A is provided for 4 times, special room B for 5 times, and special room S for 6 times. Providing a special room means obtaining the right to participate in the event content in a different virtual live venue animation (display mode) than the normal production. For example, an area ER53' that can be accessed only by target users who have obtained the right to participate in a live performance in a special room may be prepared, and the event content may be provided in the special room. Alternatively, an image of the live venue set distributed when the event content is provided may be replaced with an image distributed to the target user.

[0331] In addition, in the seventh episode, a performance in a secret costume will be provided. The secret costume is a costume (costume object) of the performer avatar that is displayed in correspondence with the performer avatar when the event content is provided. For the target users who have obtained the right to be subjected to the performance in the secret costume, costume data of the performer avatar will be delivered in place of the data normally delivered to other users.

[0332] An example of event content-related processing executed in the distribution server computer 100 according to the number of entries shown in Fig. 38 will be described with reference to Fig. 39. The event content-related processing is executed, for example, for each user who is scheduled to participate in the event content (for example, in ascending order of user ID), from the end of the period before the scheduled date to the start of the event content.

[0333] In step S401, it is determined whether the user has entered the room one or more times during the period before the scheduled date. If it is not determined that the user has entered the room one or more times during the period before the scheduled date, the process ends. For a user determined in step S401 not to have entered the room one or more times during the period before the scheduled date, event content is delivered based on the data stored by default in event data 111.

[0334] On the other hand, when it is determined in step S401 that the user has entered the room one or more times during the period before the scheduled date, an item is given to the user in step S402 according to the number of times the user has entered the room. As a result, for example, the given items are displayed in an item box owned by the user in the virtual space ER. The items may be placed in the box before the start time of the event content provision, may be displayed in gray until the start time of the provision and may not be usable until the start time of the provision, or may be usable in the virtual live venue that is open from the start time of the provision.

[0335] In step S403, the content of the performance according to the number of times of entry is set for the user, and the process ends. For example, if the user has entered the room four times, limited fireworks will be displayed in the item box, and information for making the design of the virtual live venue into special room A is stored in association with the target user.

[0336] (Regarding re-provision of content for pre-scheduled periods and events) Examples of event contents provided in the period before the scheduled date and on the scheduled date have been described with reference to Figs. 24 to 39, but the content provided to the user by the distribution server computer 100 may be provided again (re-performed). In Figs. 13 to 39, a live event by a performer at a virtual live venue on the scheduled date is illustrated as an example of content, but in Fig. 40, the live event provided on the scheduled date and the content provided in the period before the scheduled date before the live event is held (for example, an area that can be used for a limited time in relation to the live event to be held, an activity, etc.) are collectively referred to as event contents. The content provided in the period before the scheduled date is, for example, content related to the live event, and includes the spatial area ER5 that is opened in the period before the scheduled date before the live event is held as described in Figs. 24 to 39. Hereinafter, the spatial area ER5 that is opened in the period before the scheduled date and the live event provided in the spatial area ER5 on the scheduled date are collectively referred to as event contents. The content in the period before the scheduled date may include activities (such as game content) that the user can use in the spatial area ER5 that is open in the period before the scheduled date, objects that can be displayed, and the like.

[0337] FIG. 40 is a diagram for explaining the period before the scheduled date and the re-provision of the event content. For example, as shown in FIG. 40(a), a first scheduled period and a second scheduled period are provided as a "scheduled period" including the scheduled date on which the content of the live event is provided and the period before the scheduled date. The content for the period before the scheduled date described above is provided before the first scheduled date in the first scheduled period, and the content of the live event described above is provided on the first scheduled date. The second scheduled period for re-provision of the event content provided in the first scheduled period can be started after a predetermined period (for example, two months) has elapsed since the end of the first scheduled period. The provision of the event content ends once with the first scheduled period, but the delivery server computer 100 stores and holds information (re-provision data) for taking over and re-provisioning the content data at the end of the first scheduled period. The stored re-provision data is re-provisioned to the user in the second scheduled period. The re-provided data includes, for example, information for generating a virtual space (e.g., Figs. 24 and 25, etc.), information according to user actions (e.g., user-related information (related to purchased flower stars) in Fig. 27, flower star arrangement information for each exhibition area shown in Fig. 31, etc.), performer information such as animation data and voice data including motion data of performer avatars in a live event (performer avatar information, performer voice, etc. distributed in Fig. 10), information on event flower stars used by performers in the live events exemplified in Figs. 35 to 37, data of games played in the first scheduled period (e.g., previous save data, ranking data, user level), etc. Note that the spatial area ER5 may be opened for several days after the first scheduled date to provide a period after the first scheduled date, and the content data at the end of the first scheduled period including the period after the first scheduled date may be carried over.

[0338] At the start of the first scheduled period, the flower FS in the virtual space is displayed in an initial state (e.g., a state in which the flower FS is initially arranged with the initial settings), and is updated according to the user's actions (e.g., purchases, etc.) during the period before the first scheduled date, as described above. At the start of the second scheduled period illustrated in FIG. 40(a) (e.g., when the spatial area ER5 is reopened), information according to the user's actions during the first scheduled period is carried over and reflected in the virtual space, so that the flower FS for each exhibition area is arranged based on the flower FS arrangement information at the end before the first scheduled period. As a result, when a user who purchased a flower FS during the first scheduled period enters the second scheduled period, the flower FS purchased by the user is arranged in the same position and in the same display mode as it was arranged during the first scheduled period. Note that although the flower FS arrangement information is the flower FS arrangement information at the end before the first scheduled period, it may be the flower FS arrangement information at the end of the first scheduled date or the end after the first scheduled date.

[0339] Also, in the second pre-scheduled date period in the second scheduled date period, the display mode in the virtual space can be changed and made different for each user according to the user's actions, as in the first pre-scheduled date period, and the processes shown in Figs. 32 to 39 are also executed. For example, when a user who entered in the second pre-scheduled date period purchases a flower stand FS, the flower stand is displayed in a display mode such as the character state edited by the user in a specified area designated by the user in the virtual space that can be displayed on the viewer terminal 300 of the user, as shown in Figs. 29 and 30, while the purchased flower stand FS may not be reflected in the virtual spaces of other users, and the displayed flower stands FS will be different for each user. Also, each time a switching condition is established, the flower stands FS other than the flower stands FS purchased and placed by the user (including both purchases in the first scheduled date period and purchases in the second scheduled date period) among the displayed flower stands can be changed and updated. In addition, data from games played during the first scheduled period is carried over to display rankings, and data such as games cleared by each user is also carried over, so that the game can be started from where it was left off in the first scheduled period.

[0340] The re-provision data does not include location information and movement information (information for displaying user avatars U of other users) of the user avatar U who entered the room during the first scheduled period. Therefore, in the second scheduled period, the user avatar U of the user who actually entered the room during the second scheduled period is displayed. However, without being limited to this, the re-provision data carried over for replay may include location information and movement information of the user avatar U of the user who entered the room during the first scheduled period, and a virtual avatar may be displayed based on the location information and movement information of the carried over user avatar U according to the number of users who entered the spatial area ER5 during the second scheduled period (for example, when the number is less than a predetermined number).

[0341] Furthermore, on the second scheduled date in the second scheduled period, a live event by performers is held, as in the first scheduled date, and users who enter the spatial area ER5 can view the event from a viewpoint according to the user's operation. Furthermore, for the event on the second scheduled date, the latest flower stand (last purchased flower stand) for each user can be displayed in association with the performer avatar, as in the examples in Figs. 35 to 37. Note that the default flower stand information in Fig. 36(A) may be the same as the flower stand FS in the first scheduled period, but may be different from the default in the first scheduled period based on the information of the flower stand FS purchased by the user in the second scheduled period.

[0342] FIG. 40(a) shows an example in which the information related to the flower stand in the first scheduled period is carried over to the second scheduled period, but the present invention is not limited to this example. As shown in FIG. 40(b), the information related to the flower stand in the first scheduled period may not be carried over to the second scheduled period. In the case shown in FIG. 40(b), the flower stand FS in the virtual space at the start of the second scheduled period is displayed in the initial state as at the start of the first scheduled period, and is then updated according to the user's actions in the period before the second scheduled date. Note that the initial state of the flower stand (displayed flower stand and display mode) at the start of the second scheduled period may be the same as the initial state of the flower stand at the start of the first scheduled period, or may be partially different, or may be entirely different (e.g., the display mode of the flower stand FS in a predetermined initial position is changed to a design for the second scheduled period).

[0343] Furthermore, on the second scheduled date in the second scheduled period, as on the first scheduled date, a live event featuring performers will be held, and users who enter the spatial area ER5 will be able to watch the event from a viewpoint that corresponds to the user's operation, but the default flower stand information in Figure 36 (A) may be different from the default in the first scheduled period, based on the information on the flower stand FS purchased by the user in the second scheduled period.

[0344] In addition, the re-provision data of a re-provisioned live event is the same as the previously provided data in terms of the movement and voice of the performer avatar, based on the previously provided motion data and voice data, but the display mode other than the movement of the performer avatar is not limited to the same as the previously provided data, and may be different between the previously provided data and the re-provision data. For example, the costume of the performer avatar for the live event on the first scheduled date may be different from the costume of the performer avatar for the live event on the second scheduled date.

[0345] (Special audio / viewpoint switching processing) Next, a description will be given of performers when the event content is provided again. In the period before the first scheduled day of the first scheduled period, performers in the live event on the first scheduled day (for example, a talent who has live-streamed) are generally not allowed to enter (will not enter), whereas in the second scheduled period, performers in the live event on the second scheduled day (i.e., the same live event as the first scheduled day) can enter the spatial area ER5 as participants in both the period before the second scheduled day and the second scheduled day. A performer avatar who enters as a participant in the second scheduled period is displayed in a display mode different from that of a performer avatar in the live event on the first scheduled day. For example, a performer avatar who is proceeding with an event as a performer is displayed as a three-dimensional human model that differs from performer to performer (e.g., performer avatar 1 in FIG. 13), whereas a performer avatar who has entered the room as a participant during the second scheduled period is displayed as the same user avatar as other general users, but the performer's name is displayed corresponding to the same user avatar as the other general users (e.g., a user name and an official mark that can be recognized as a performer together with the user name), so other users can recognize that it is a performer's avatar. Furthermore, a user avatar for a general user may be an avatar with a simple display rather than a human shape. For example, a three-dimensional human model requires a large amount of drawing information to be displayed in the virtual space, but a three-dimensional avatar with a simple display may be a three-dimensional model that can be displayed with a small amount of drawing information, for example, a simple shape consisting of a circle, a square, a triangle, etc. (e.g., a triangular pyramid or a plain animal shape).

[0346] Also, when a performer is participating as a participant in a live event on the second scheduled date, a performer avatar (an avatar that moves and is displayed based on motion data and voice data stored in advance as re-provision data) as a performer proceeding with the live event and an avatar as a participant may be displayed. Therefore, other users participating in the event may view (display) both avatars at the same time in one virtual space, improving interest. For example, a way of enjoying the event may be provided in which the user watches an avatar as a performer proceeding with the live event while listening to the voice of the performer as a participant talking about his / her feelings during the event. In order to facilitate such a way of enjoying the event, in this embodiment, a process is performed to switch the voice output from the viewer terminal 300 and the viewpoint displayed on the viewer terminal 300.

[0347] In principle, only the user avatars of users who have entered the same room are displayed on the viewer terminal 300, so when a performer has entered the virtual space as a participant, the performer's avatar as a participant is not displayed on the viewer terminals 300 of users other than those who have entered the same room as the performer. However, for the user avatar of a special user account, it is exceptionally possible to mirror the appearance and voice of the user avatar in other rooms (for example, duplicated rooms with the same content provided) even if the user has entered the room as a participant. This allows the avatar to be displayed as a participant of the performer in the virtual space displayed on the viewer terminals 300 of users who are not in the same room as the performer.

[0348] 41 is a flow diagram showing an example of a special audio / viewpoint switching process for switching audio and viewpoint. The special audio / viewpoint switching process is executed by each viewer terminal 300. The viewer terminal 300 displays an icon for selecting settings for the virtual space together with an image in the virtual space, and executes the special audio / viewpoint switching process when an operation on the icon for switching audio or viewpoint is received.

[0349] In step S411, it is determined whether or not a voice switching operation has been performed. If it is not determined that a voice switching operation has been performed in step S411, the process proceeds to step S413. On the other hand, if it is determined that a voice switching operation has been performed in step S411, the process proceeds to step S412, where, when the current voice setting is normal voice, the voice is switched to a special voice that allows the voice of a special user to be output, whereas, when the current voice setting is special voice, a process of switching to normal voice is performed. The special voice is a voice output from within the virtual space, in which only the voice of a special user (for example, an account of a talent or a celebrity, including a performer) is extracted (or extracted so as to be easily heard) and output from the viewer terminal 300. This allows the user to easily switch to the voice of the performer as a participant. The normal voice is a voice corresponding to the position where the user's user avatar is present in the virtual space, and is a voice generated within a predetermined radius from the position. For example, when the user is located near the event stage, the voice of the performer proceeding with the event is output at a louder volume than other voices, and when the user is located far away from the event stage, the voice of other users present near the user avatar of the user is output at a louder volume than the voice of the performer proceeding with the event. Note that when there are multiple performers as participants, the user may be able to select which performer's voice to use. For example, the user may be able to select one particular favorite performer, or multiple performers.

[0350] Note that the operation of switching to the special sound is not limited to one in which the normal sound is not output, but may be one in which the voice of a special user becomes audible in addition to the normal sound. For example, in addition to the sound emitted from a user avatar located in the vicinity of the user avatar operated by the user, the sound emitted from the user avatar of a special user may be output even if the user avatar is located at a distance where the sound cannot normally be heard.

[0351] Furthermore, since the sound on stage is output from sound data distributed to the viewer terminal 300 by the generated sound distribution process (FIG. 10), either normal sound or special sound may be selected and output from the viewer terminal 300. During live content distribution, normal sound cannot be selected in the first place (sounds such as voice chats of other users cannot be heard), but special sound may be output as secondary sound. Furthermore, special sound may be selectable and output only by users who satisfy certain conditions (e.g., paying a fee or clearing a game). In this way, during live content distribution, the sound of the performer avatar as a participant may be output like secondary sound (narration) while watching the live performance (main sound).

[0352] In addition, the voice switching device is not limited to switching the voice, and may be, for example, switching between loud and soft voices. For example, when the current voice setting is the normal voice, the normal voice may be output at a louder volume than the special voice, and when the current voice setting is the special voice, the special voice may be output at a louder volume than the normal voice.

[0353] Next, in step S413, it is determined whether or not a viewpoint switching operation has been performed. If it is determined that a viewpoint switching operation has not been performed in step S413, the audio / viewpoint special switching process is terminated. On the other hand, if it is determined that a viewpoint switching operation has been performed in step S413, the process proceeds to step S414, where if the current viewpoint setting is a normal viewpoint, the viewpoint is switched to a special viewpoint that focuses on a user avatar of a special user (for example, an avatar of a performer who has entered the virtual space as a participant), whereas if the current viewpoint setting is a special viewpoint, a process of switching to a normal viewpoint is performed. This allows the user to easily switch to a viewpoint that focuses on an avatar of a performer who is a participant.

[0354] The normal viewpoint is the viewpoint toward which the user's user avatar U faces in the virtual space, and an image of the virtual space visible from that viewpoint is displayed. For example, when facing toward the event stage, an image including the avatars of the performers proceeding with the event is displayed, and when facing away from the event stage, an image of the virtual space on the opposite side of the event stage is displayed.

[0355] On the other hand, the special viewpoint is an image taken by a virtual camera arranged in the virtual space so as to capture the user avatar of the special user from an angle that may be different from the normal viewpoint. For example, if the image is taken from a virtual camera that is fixedly arranged in advance, an image obtained from the virtual camera in which the user avatar of the special user is captured (for example, the image may be selected by the administrator's operation, or the virtual camera may be selected based on the position information of the special user) may be delivered to the viewer terminal 300. Alternatively, an image in which the avatar of the performer as a participant is captured and taken by an operator (for example, an administrator account) of the virtual camera (for example, drone photography in the virtual space) is captured may be delivered to the viewer terminal 300. For example, the viewpoint may be a bird's-eye view of the avatar from diagonally above. Note that, when multiple performers are present as participants, it may be possible to select and set which performer's avatar to use. For example, it may be possible to select one specific favorite performer, or it may be possible to select multiple performers.

[0356] In the audio / viewpoint special switching process, the operation of switching to the special audio / special viewpoint may be available only to users who satisfy a predetermined condition such as payment. Also, either the special audio or the special viewpoint may be available only to users who satisfy a predetermined condition.

[0357] (Special handling of room entry) In this embodiment, the virtual space is provided using multiple rooms in order to provide the same content to multiple users at the same time. As a result, the content such as the spatial area ER5 constituting the virtual live venue where the event content for the period before the scheduled date and the scheduled date described above with reference to Fig. 40 is provided is provided using multiple rooms, so that it can be simultaneously distributed to many users. Note that, for example, one room can be defined for one server, but multiple rooms may be defined for one server.

[0358] FIG. 42(a) is a diagram for explaining a plurality of rooms constituting a spatial area ER where a predetermined content is provided (for example, rooms corresponding to areas ER51-53 of the spatial area ER5 constituting a virtual live venue, and a room corresponding to area ER53' of FIG. 24 where a live event is provided on a scheduled date with the same aspect as area ER53). The plurality of rooms include a main room where a virtual space is constructed and where, for example, a performer enters (is associated with) during an event, and a plurality of other rooms (room 1, room 2, room 3, etc.) where the virtual space (including the performer's avatar) in the main room is mirrored. A user who wishes to enter the virtual live venue is randomly assigned (associated) to a room designated by the user among the plurality of rooms by the load balancing system, or to one of the rooms if no designation is made, and an image of the same virtual live venue can be displayed. For example, this may be when entering a virtual space by logging in, and after logging in, a screen may be displayed that allows the user to select the content (e.g., area) they wish to enter. When the user selects the area they wish to enter, rather than specifying a room ID, they may be randomly assigned to one of the rooms as if no room had been specified.

[0359] On the other hand, user actions (voice, actions, comments, etc.) in the virtual space can be shared with users who are in the same room, but cannot be shared with users who are in other rooms. For this reason, it is desirable to have multiple entertainers or celebrities enter the same room in order to liven up the atmosphere of an event in the virtual space, or in situations where a user wishes to enter the same virtual space because another user with whom they are friends has already entered the room.

[0360] However, for each room, a maximum number of users that can enter the room (for example, 200 people) is set in advance, taking into consideration the server's processing capacity, load concentration, etc. For this reason, if the maximum number is strictly applied to allocate rooms, there is a risk that users will not be able to enter the same room under the circumstances described above, and their requests will not be met. On the other hand, the maximum number is generally set to a value that allows some leeway, taking into consideration the server's processing capacity, so that even when the load on the server is concentrated, it does not affect delivery (such as making delivery impossible).

[0361] For this reason, in this embodiment, when a predetermined condition is satisfied, a special process is performed that allows a user to enter the same room even if the number of users would exceed the upper limit if the user were allowed to enter the room. FIG. 42(b) is a flow diagram showing an example of the room entry special process. The room entry special process is executed by the distribution server computer 100. The distribution server computer 100 executes the room entry special process when it receives a request to enter a room to which predetermined content is provided from a user (for example, constituting a spatial area ER that constructs a virtual live venue). The request to enter the room may be made at the timing of logging in to the virtual space (a room ID may be specified at this time), or may be made at the timing when a screen for selecting the content (area, etc.) to enter is displayed on a title screen after logging in, and the content is selected (a room ID may be specified at this time). The predetermined condition includes, for example, when a special user specifies a room to enter the virtual space, or when a user related to the user who is trying to enter the room is in any room, but is not limited thereto.

[0362] The special user includes the account of a performer who appears as a performer in a live event (for example, the performer user ID and account in FIG. 8), a talent, a celebrity, etc. (all of them may also be performers). For example, it may be the account of a user who is determined in advance as a special user by the administrator, and an attribute number that can identify a talent, a celebrity, etc. may be assigned in advance along with the user ID and account of the viewer user data stored in the storage 103. Furthermore, the special user in the room entry exception process may include an administrator who manages the virtual space, and a related person of the talent, etc. (for example, a manager, etc.). The administrator includes, for example, an account of a user who has the authority to operate a virtual camera. This makes it possible to take an image of the room in which the talent has entered with a virtual camera and display it on the viewer screen of other users, or to transmit the image data to another computer (for example, an external server for live distribution, etc.).

[0363] The cases where a user is related to a user include, for example, a case where a follow function such as a friend function is provided in the virtual space provided by the distribution server computer 100, a case where the user is in a mutual follow relationship, and a case where the intimacy level is a predetermined value or more. The intimacy level is calculated based on the behavior history in the virtual space. For example, the intimacy level may be increased by the number of chats, the number of cooperative games, the number of times the user has been in a location within a predetermined range based on location information, and the like. In addition, between special users, special users with an intimacy level of a predetermined value or more, and special users who need to enter the same room in the content by the operator to progress, such as special users who are scheduled to appear in the same live event, are related users.

[0364] In step S421, it is determined whether or not a special user has entered the room. When it is determined in step S421 that a special user has entered the room, it is determined in step S422 whether or not a room has been designated. For example, a room ID is input on a terminal of an account of a talent who is a special user, and a request to designate a room ID is sent to the distribution server computer 100 together with a request to enter the room. When it is determined in step S422 that a designation has been made, a process is performed in step S423 to associate the designated room with the designated room and allow the user to enter the room, regardless of the number of users who have entered the designated room and the upper limit number. The distribution server computer 100 determines whether the user is a special user based on the ID of the user who has made the entry request, and if a room ID has been designated, allows the user to enter the room of the designated room ID. For example, a process is performed to associate the user ID of the special user who has entered the room with the designated room ID.

[0365] The room ID that allows entry regardless of the upper limit number may be determined in advance by the administrator. That is, when a room ID other than the room ID that allows entry regardless of the upper limit number is specified, if the number of people in the specified room has already reached the upper limit number, entry to the room may not be allowed. Also, the special user who entered in step S421 and has a relationship with the special user may be allowed to enter a room that is already in the room.

[0366] On the other hand, when it is not determined that the special user is entering the room, or when the special user is entering the room but the room is not specified, in step S424, it is determined whether or not a user having a relationship (for example, a friend relationship, a relationship with a degree of intimacy of a predetermined value or more) with the user who is about to enter the room has already entered any room. When it is determined in step S424 that the related user has already entered any room, in step S425, a process is performed in which the user is associated with the room that has already entered and enters the room, regardless of the number of users that have entered the room and the upper limit number. Note that, when related users are distributed in multiple rooms, the user may be allowed to enter the room in which the most related users are entering. Alternatively, the user may be allowed to enter the room with the least congestion level among the rooms in which related users are entering.

[0367] On the other hand, when it is determined in step S424 that the related user has not entered any of the rooms, a process is performed in step S426 to associate the related user with any of the rooms whose upper limit has not been reached and to allow the user to enter the room. For example, a process of allocating the user by a normal load balancing process is performed.

[0368] (Regarding component reset of performer's humanoid avatar) Next, referring to FIG. 43, a process for resetting abnormal display of an object that swings in conjunction with a character object at a predetermined timing will be described. As shown in FIG. 13, FIG. 20, etc., a costume object corresponding to a costume worn by a human-shaped character object (a three-dimensional model with bones (skeleton)) is associated with the human-shaped character object of the performer's human-type avatar. Also, by associating components (function parameters) with objects displayed in the virtual space, it becomes possible to display and operate various objects in the virtual space. Each of the character object and the costume object has various components (for example, various parameters such as so-called collider and rigid body) used for physical calculations (calculation processes such as collision detection, gravity, and movement) set in advance. The object data associated with the various components is included in the virtual space update data of FIG. 10 and distributed to the viewer terminal 300. Also, the viewer terminal 300 performs a process for displaying the character object in motion based on the performer's motion data (performer avatar information included in the virtual space update data of FIG. 10) distributed by the distribution server computer 100. On the other hand, the costume object is an object that displays a swaying motion (for example, cloth such as clothes or hair) and is displayed by performing physical calculations in conjunction with the motion of the character object (for example, calculation processing based on a component that performs calculations for swaying objects such as cloth that functions in conjunction with a skin mesh associated with the character object). In this way, the viewer terminal 300 performs processing to perform physical calculations and display the motion of the costume object (for example, swaying, bouncing, bending, etc.) in the same way as in real space in response to the motion of the character object.

[0369] In this way, the computational process for displaying the movements of the character objects and costume objects is performed by the viewer terminal 300 based on the virtual space update data streamed at a predetermined interval from the distribution server computer 100. When the movement display process based on the previously received virtual space update data is completed, the movement display process is executed based on the next received data.

[0370] Here, even if the data delivered is the same, differences may occur between users due to the processing power of the viewer terminal 300 and the communication environment (for example, a drop in frame rate). In particular, when the viewer terminal 300 has low processing power or the communication speed is below a certain level, for example, calculations by physical calculations take time (drawing speed is slow), and when the character's movement speed and movement range are large, there is a high possibility that an abnormal display mode of the clothing object will be calculated and displayed. For example, there may be a large deviation between the final movement position of the character object based on the previously received streaming data and the start movement position of the next received streaming data. As a result, an object that should naturally move smoothly, such as a skirt that is calculated to follow the character object, will not move smoothly, but will move in an extremely large manner. As an example, it is conceivable that as a result of an actor moving vigorously, the movement of the colliders of various objects may cause the hem of a skirt object to be calculated as sinking into the top of the skirt or into the character object's legs, causing the skirt hem to be displayed as if it is rolled up, or that for a wing object, the tip of the wing may be calculated as sinking into the middle of the wing, causing the wing to be bent and unable to flap. In this embodiment, in order to prevent such abnormal display from continuing, a component reset process is performed in the delivery server computer 100 as a process for resetting the display state of the object to neutral.

[0371] Fig. 43 is a flow diagram showing an example of the component reset process. The component reset process is executed by the delivery server computer 100. The delivery server computer 100 executes the component reset process every time a predetermined time (e.g., 2 ms) elapses while delivering virtual space update data including data for operating a humanoid avatar. Below, as an example, a case where the above-mentioned live event is being provided (distributed) will be described.

[0372] In step S431, it is determined whether or not a series of actions by the performer avatar has ended. The timing when a series of actions has ended is the timing when the performer avatar's action that can be continued ends once, and the performer avatar's movement speed and movement range become smaller and the movement settles down. For example, in the case of a content in which a performer sings while dancing, it includes the timing when one song is finished, the interval between songs until the start of the next second song, the start of the second song, and the like. Alternatively, in the case of a content in which a performer performs an attraction, it includes the timing when one attraction ends, the interval until the start of the next second attraction, the start of the second attraction, and the like. In this embodiment. Any of these timings can be applied as the timing when a series of actions has ended. In the distribution server computer 100, it is determined whether or not the movement speed and movement range have become less than a predetermined amount. It can be determined that the movement speed and movement range have become less than the predetermined amount when the acceleration becomes equal to or less than a predetermined value (or may continue for a predetermined second).

[0373] If it is not determined in step S431 that the series of actions by the performer avatar has ended, the component reset process is terminated. On the other hand, if it is determined in step S431 that the series of actions by the performer avatar has ended, a component reset signal is delivered to the viewer terminal 300 in step S432, and the component reset process is terminated. The component reset signal is a signal for performing physical calculations for an object (e.g., a costume object) displayed corresponding to a character object from a predetermined initial state. In other words, the component reset signal is a signal for performing calculations from an initial state not based on the result of the previous calculation, which would normally be performed following the result of calculation based on the streaming data received last time. As a result, even if the display state of the costume object is abnormal, the display state is reset to neutral and physical calculations are performed.

[0374] In this way, in the viewer terminal 300, in order to perform physical calculations and display the costume object in the same way as in the real space in response to the action of the character object, for example, in the physical calculations, the acceleration of each part of the costume object at the previous calculation timing is taken into consideration to calculate the current acceleration, etc. However, when a component reset signal is received, a process is performed to calculate the current acceleration, etc. from a predetermined initial state (for example, zero acceleration) without taking into consideration the acceleration of each part at the previous calculation timing. In this way, even if an abnormal state is calculated and displayed as the state of the costume object during a series of actions, the state of the costume object can be returned to the state calculated from the initial state (neutral state). For example, a state in which the hem of a skirt is rolled up or a state in which wings are bent and cannot flap can be eliminated. As a result, there is a risk that an abnormal state is calculated as the state of the costume object, causing the costume object to be displayed in an abnormal state for the character, etc., and even if this possibility is increased when the motion speed and motion range of the character are large, the abnormal state can be eliminated.

[0375] In addition, the component reset signal may be any command that starts physical calculations from the initial parameters of the costume object (parameters when the character object is wearing the costume when in its initial posture, i.e., a neutral display state such as a state in which no acceleration is applied), and may set the components of the costume object (parameters such as acceleration and gravity) to the same parameters as those in their initial positions (when the character object is in its initial posture).

[0376] <Examples of specific configurations and effects>

[0377] (1-1) In the above-mentioned embodiment, as described with reference to Figs. 1 to 25, the delivery server computer 100 performs processing for generating a virtual space ER and transmitting information for displaying an image in the virtual space ER according to a user's operation, based on a stored program or a method for controlling a computer by the program (hereinafter simply referred to as a program), and the viewer terminal 300 performs processing for displaying an image according to a user's operation according to information from the delivery server computer 100, based on the stored program. Also, as described with reference to Figs. 26 to 28, the delivery server computer 100 performs processing for updating the arrangement in the virtual space ER, such as a flower stand FS, purchased according to a user's purchase operation, based on the stored program, and the viewer terminal 300 performs processing for updating the arrangement in the delivery server computer 100 and displaying the object purchased according to the user's purchase operation, based on the stored program, in the virtual space ER. Furthermore, as explained with reference to Figures 13 to 23 and Figure 35, the distribution server computer 100 performs processing to construct a space in a spatial area ER5 within the virtual space ER for providing the event content on the scheduled date based on a stored program, and the viewer terminal 300 enables the event content to be provided on the scheduled date in the spatial area ER5 constructed by the distribution server computer 100 based on the stored program.

[0378] In this embodiment, even during the period before the scheduled date of the event, the delivery server computer 100 and the viewer terminal 300 each perform processing based on the stored program to enter the spatial area ER5 in response to a user's operation and to display an image in the spatial area ER5, and to arrange and display an object purchased in response to a purchase operation in the spatial area ER5. Furthermore, as shown in Figs. 26, 29, 30, 34, and 35, the delivery server computer 100 and the viewer terminal 300 each perform processing based on the stored program to change the display mode in the spatial area ER5 in response to arranging and displaying an object such as a flower star FS in the spatial area ER5 during the period before the scheduled date. As a result, the spatial area ER5 in which the event content is provided and events that can change the display mode in the spatial area ER5 can be shared and provided to the user during the period before the scheduled date, so that interest in the event content can be gradually increased before the event content is provided.

[0379] (1-2) Based on the programs stored therein, the distribution server computer 100 and the viewer terminal 300 each carry out processing to change the display mode of each exhibition area within the spatial area ER5 from purchase to the end of the period before the scheduled date, as shown in Figures 26, 28, and 29, etc., in accordance with the user's purchase status of flower stands FS during the period before the scheduled date as shown in Figure 27(C) etc. This allows the user to focus on whether a flower stand FS will be purchased by the user during the period before the scheduled date, what attributes the purchased flower stand FS will have, what decorations it will have, where it will be displayed, and how the display mode of each exhibition area within the spatial area ER5 will change as a result.

[0380] (1-3) The display mode of each display area in spatial area ER5 that may change during the period before the scheduled date may be different from the display mode displayed to other users depending on the user's purchase and placement of a flower stand FS during the period before the scheduled date, as explained by comparing Figures 29 and 30. This makes it possible to customize the display mode of each display area in spatial area ER5 during the period before the scheduled date for each user, giving each user a sense of exclusivity.

[0381] (1-4) As shown in Fig. 35 etc., the distribution server computer 100 and the viewer terminal 300 each perform processing based on a stored program for changing the display mode of the production of the live event taking place in the spatial area ER5 while the event content is being provided in response to the user purchasing and arranging a flower stand FS during the period before the scheduled date. This allows the user to pay attention to whether a flower stand FS will be purchased by the user during the period before the scheduled date, what attributes and what decoration will be applied to the purchased flower stand FS, and as a result, how the display mode of the production of the live event taking place in the spatial area ER5 while the event content is being provided will change.

[0382] (1-5) The presentation of the live event held in spatial area ER5 that can change while the event content is being provided can be displayed in a different manner from that displayed to other users depending on whether the user purchased and placed a flower stand FS during the period before the scheduled date, as explained in Figures 27(C), 35, and 36. This makes it possible to customize the display manner of the presentation of the live event held in spatial area ER5 while the event content is being provided for each user, making each user feel special.

[0383] (1-6) As an event that changes the display mode within the spatial area ER5, an action in response to a user's purchase operation of a flower stand FS, which reflects the purchased flower stand FS by displaying and arranging it in an exhibition area within the spatial area ER5, is exemplified, for example, an action in which a user purchases a flower stand FS in step S107 of Fig. 28 and the flower stand FS is arranged in a specified exhibition area A of the spatial area ER5 in step S109. This makes it possible to cause an event that changes the display mode within the spatial area ER5 by the user's own operation, thereby encouraging the user to operate and improving the user's sense of participation.

[0384] (1-7) As an example of an event that changes the display mode within the spatial area ER5, a purchase operation of a flower stand FS, which is an action in response to an operation from another user (for example, user 1 who is another user for user 2 in Figs. 29 and 30), is illustrated as an action reflected by displaying and arranging it in the exhibition area within the spatial area ER5, for example, an action of purchase by other user 1. That is, as shown in an example in Fig. 30(D), on the display device 310 of user 2, a flower stand FS1 that would not be displayed unless purchased by other user 1 can be randomly selected as a default flower stand FS to be displayed and arranged in a predetermined exhibition area A due to the purchase action of other user 1. In this way, since operations and actions from other users can also become events that change the display mode within the spatial area ER5, the change in the display mode can be made interesting and interest can be increased.

[0385] (1-8) As an example of an event that changes the display mode in the spatial area ER5, the establishment of a switching condition is illustrated. Furthermore, the distribution server computer 100 and the viewer terminal 300 each perform a process that enables the display of the flower star FS related to the special user in the spatial area ER5 to be maintained in accordance with the program stored therein, even if an event that changes the display mode in the spatial area ER5 occurs. For example, the display position of the flower star FS purchased by the user is determined by lottery from positions other than the display position of the flower star FS of the special user. Furthermore, even when the switching condition is established, the display and display of the flower star FST associated with the special user continues, as shown in FIG. 34. This allows the display mode related to the special user to continue without changing, so that the convenience and advantage of the special user can be maintained and improved. Furthermore, since it becomes possible to use objects such as the flower star of the special user for advertising and PR, for example, the management side can easily solicit investments from sponsors who may be an example of a special user.

[0386] (1-9) As shown in FIG. 24, within the spatial area ER5, there are provided an area ER53' of the second virtual space used to provide event content on the scheduled date, and an area ER53 which is a part of the first virtual space and has a common display mode (the same or similar, for example) with the area ER53'. The distribution server computer 100 and the viewer terminal 300 each perform processing based on the programs stored therein such that during the period before the scheduled date, for example, until the day before the scheduled date of the event, the portal P is not displayed and entry into the area ER53' is restricted, while entry into the area ER53 is permitted and an image of the area ER53 can be displayed in response to a user operation, and after the day before the scheduled date of the event and the release conditions are met, entry into the area ER53 is restricted by closing the gate of the main gate object 53c leading to the area ER53, while the portal P is displayed and entry into the area ER53' of the second virtual space is permitted and an image of the area ER53' can be displayed in response to a user operation. This allows the area used to be switched depending on whether the release condition is met, so that before the release condition is met, a virtual space can be provided using an area suitable for the user's behavior before the event content is provided, and after the release condition is met, a virtual space can be provided using an area suitable for providing the event content.

[0387] (1-10) As shown in FIG. 24, areas ER51 and ER52, which are part of the first virtual space, are provided within spatial area ER5, and areas ER51, ER52, and ER53 in FIG. 24(A), which are the first virtual space, can be moved seamlessly between (by moving the user avatar from one area to the other by user operation), while area ER53' of the second virtual space is formed separately from areas ER51 and ER52, which are part of the first virtual space, and as shown in FIG. 24(B), it is possible to move between the first virtual space and the second virtual space via portals P in areas ER53' and ER52 via a blackout display. As a result, before the release conditions are met, it is possible to improve the convenience of movement between areas ER51, ER52, and ER53 in Figure 24(A), which is the first virtual space, and after the release conditions are met, the display is darkened when moving to area ER53' in the second virtual space, making it possible to give the user a sense of exclusivity and tension, thereby increasing interest.

[0388] (1-11) The release condition can be satisfied on the day before the event content is scheduled to be provided. This allows for a period before the release condition is satisfied, a period after the release condition is satisfied but before the event content is provided, and a period during which the event content is being provided, so that interest can be increased in stages.

[0389] (1-12) The display mode within spatial area ER5 that can change includes a flower stand FS displayed in an exhibition area within spatial area ER5, and events that change the display mode within spatial area ER5 include an event in which a user purchases a flower stand FS during the period before the scheduled date and associates the flower stand FS with the user and places the flower stand FS in an exhibition area selected by the user within spatial area ER5. In this way, by placing the flower stand FS purchased by the user in an exhibition area selected by the user during the period before the scheduled date, the display mode of the exhibition area can be changed and the user's interest can be increased.

[0390] (1-13) The events that change the display mode within the spatial area ER5 include events that generate the display mode (decoration such as text) of a flower star FS in response to an operation by the user when placing the flower star FS. This allows each user to change the display mode of the flower star FS to an original display mode, thereby increasing the interest of the users.

[0391] (1-14) The display modes within the spatial area ER5 that can change include a flower star FS held by a performer avatar that is displayed and operates within the spatial area ER5 while the event content is being provided and can proceed with the event content, as shown in Fig. 35. This allows the flower star FS that can be displayed corresponding to the performer avatar to change depending on events that occur during the period before the scheduled date, thereby increasing interest due to events that occur during the period before the scheduled date.

[0392] (1-15) As shown in Fig. 39, the delivery server computer 100 and the viewer terminal 300 each perform processing based on a stored program to change the display mode within the spatial area ER5 according to the number of entries into the spatial area ER5, which is an example of the degree to which the image within the spatial area ER5 was displayed during the period before the scheduled date. This allows the display mode within the spatial area ER5 to change according to the number of entries into the spatial area ER5 during the period before the scheduled date, thereby improving and encouraging the user to enter the spatial area ER5 during the period before the scheduled date.

[0393] (1-16) Based on the programs stored in them, the distribution server computer 100 and the viewer terminal 300 each perform processing to provide the event content on the scheduled date to users who satisfy certain conditions, such as by purchasing a ticket to participate in the event content, and to allow users who satisfy the certain conditions to enter the spatial area ER5 during the period before the scheduled date and to display images within the spatial area ER5. This can improve and encourage users' motivation to satisfy the certain conditions.

[0394] (2-1) In this embodiment, even during the period before the scheduled date of the event, the delivery server computer 100 and the viewer terminal 300 each perform processing based on the stored program to allow the user to enter the spatial area ER5 and display the image in the spatial area ER5 in response to the user's operation. As shown in Fig. 38 and Fig. 39, the delivery server computer 100 and the viewer terminal 300 each perform processing related to the event content in the period before the scheduled date according to the number of entries (not including the number of entries into other spatial areas ER than the spatial area ER5 in the virtual space ER even if the user has logged in to the virtual space ER) which is an example of the degree to which the user enters the spatial area ER5 in the virtual space ER where the event content is provided on the scheduled date and displays the image in the spatial area ER5 in the virtual space ER in accordance with the stored program. As a result, the spatial area ER5 in which the event content is provided can be shared and provided to users during the period before the scheduled date, and processing related to the event content is performed according to the number of entries into the spatial area ER5 in the period before the scheduled date. This can increase the user's motivation to enter spatial area ER5 rather than other spatial areas within the virtual space ER to display images within spatial area ER5, thereby gradually increasing the user's interest in the event content even before the event content is provided.

[0395] (2-2) The process related to the event content includes a process of changing the display mode in the spatial area ER5 during the provision of the event content in accordance with the number of times the user enters the space in the period before the scheduled date, as shown in the production content in Fig. 38. This increases the user's motivation to enter the spatial area ER5 in the period before the scheduled date, and draws the user's attention to how the display mode in the spatial area ER5 changes.

[0396] (2-3) The display mode in the spatial area ER5 during the provision of event content, which changes depending on the number of times the user enters the room due to processing related to the event content, can be different from the display mode displayed to other users depending on the number of times the user enters the room, as shown in...

Claims

1. A computer for providing a virtual space to a user, a means for displaying an image in a virtual space that is generated in response to an operation by the user; means for generating an event in the virtual space; functioning as a means for providing event content within a predetermined type of virtual space among the virtual spaces during a first planned period; during the first scheduled period, the causing means is capable of causing an event to occur within the predetermined type of virtual space, the display means is capable of displaying an image within the predetermined type of virtual space in response to an operation by the user, and changing a display mode within the predetermined type of virtual space in response to the event caused within the predetermined type of virtual space, The computer, functioning as a means for re-providing event content in the predetermined type of virtual space during a second scheduled period after the first scheduled period has elapsed; The means for displaying is a program that sets the display mode within the specified type of virtual space at the start of the second planned period to a display mode that corresponds to an event that occurred during the first planned period, and is capable of changing the display mode within the specified type of virtual space according to the event that occurred within the specified type of virtual space during the second planned period.

2. A computer for providing a virtual space to a user, a means for displaying an image in a virtual space that is generated in response to an operation by the user; means for generating an event in the virtual space; functioning as a means for providing event content within a predetermined type of virtual space among the virtual spaces during a first planned period; during the first scheduled period, the causing means is capable of causing an event to occur within the predetermined type of virtual space, the display means is capable of displaying an image within the predetermined type of virtual space in response to an operation by the user, and changing a display mode within the predetermined type of virtual space in response to the event caused within the predetermined type of virtual space, The computer, functioning as a means for re-providing event content in the predetermined type of virtual space during a second scheduled period after the first scheduled period has elapsed; The means for displaying is a program that sets the display mode within the specified type of virtual space at the start of the second planned period to a predetermined display mode regardless of an event that occurred during the first planned period, and is capable of changing the display mode within the specified type of virtual space in accordance with an event that occurred within the specified type of virtual space during the second planned period.

3. A computer for providing a virtual space to a user, a means for displaying an image in a virtual space that is generated in response to an operation by the user; means for generating an event in the virtual space; functioning as a means for providing event content within a predetermined type of virtual space among the virtual spaces during a first planned period; during the first scheduled period, the causing means is capable of causing an event to occur within the predetermined type of virtual space, the display means is capable of displaying an image within the predetermined type of virtual space in response to an operation by the user, and changing a display mode within the predetermined type of virtual space in response to the event caused within the predetermined type of virtual space, The computer, functioning as a means for re-providing event content in the predetermined type of virtual space during a second scheduled period after the first scheduled period has elapsed; The means for displaying is a program that changes the display mode within the specified type of virtual space at the start of the second planned period depending on whether or not the user is a user who participated in the event content during the first planned period, and is capable of changing the display mode within the specified type of virtual space depending on an event that occurred within the specified type of virtual space during the second planned period.

4. the event contents in the first scheduled period and the second scheduled period include specific contents proceeding by an avatar object that moves in accordance with the movement of a predetermined performer; The specific content during the second scheduled period is available for participation by users including the predetermined performer; The program of any one of claims 1 to 3, wherein when the specified performer participates in the specific content for the second scheduled period, the display means is capable of displaying an avatar object of the specified performer as a participant in the specific content for the second scheduled period within a predetermined type of virtual space in the specific content for the second scheduled period, separate from an avatar object of the specified performer in the first scheduled period.

5. The program according to claim 4, wherein an avatar object as a participant of the specified performer that may be displayed in a predetermined type of virtual space in the specific content during the second scheduled period has a display manner different from an avatar object as the specified performer.

6. the computer is a user terminal that displays the provided virtual space; The computer, The program described in claim 4, which functions as a means for enabling the user terminal to switch to audio coming from a specified performer as a participant in response to an operation on the user terminal when the specified performer is participating in the specific content during the second scheduled period.

7. the computer is a user terminal that displays the provided virtual space; The computer, The program described in claim 4, wherein the means for displaying is capable of switching and displaying, in response to an operation on the user terminal, an image of an avatar object of the specified performer as a participant in the specific content during the second scheduled period, from an image of a specified type of virtual space in the specific content, viewed from a specified viewpoint.

8. the event contents in the first scheduled period and the second scheduled period include specific contents proceeding by an avatar object that moves in accordance with the movement of a predetermined performer; The program described in claim 1, wherein the display means is capable of displaying, among objects in a virtual space of a predetermined type in the specific content for the second scheduled period, the avatar objects in the same display manner as the specific content for the first scheduled period, while displaying predetermined objects other than the avatar objects in a display manner different from the specific content for the first scheduled period.

9. The program according to any one of claims 1 to 3, wherein the display mode within the specified type of virtual space that can change depending on an event occurring during the second scheduled period can be a display mode different from the display mode displayed to other users depending on an event occurring during the second scheduled period.

10. the event content in the first scheduled period and the second scheduled period includes specific content to be provided from a predetermined timing of the first scheduled period to the end of the first scheduled period; The program described in any one of claims 1 to 3, wherein the means for displaying changes the display mode within the specified type of virtual space during the provision of specific content corresponding to the specific content during the second scheduled period, in accordance with an event that occurs between the start of the second scheduled period and a timing corresponding to the specified timing of the second scheduled period.

11. The program of claim 10, wherein the display mode within the specified type of virtual space that may change during the provision of the specific content during the second scheduled period may be different from the display mode displayed to other users depending on an event that occurs between the start of the second scheduled period and a time corresponding to the specified timing of the second scheduled period.

12. the display mode in the predetermined type of virtual space changed by the means for displaying during the second scheduled period includes a display mode of a specific object placed in the predetermined type of virtual space, The program according to any one of claims 1 to 3, wherein the event that changes the display mode within the predetermined type of virtual space includes an event that associates the specific object with a user and places it in a specified area within the predetermined type of virtual space during the second planned period.

13. the event content in the first scheduled period includes specific content to be provided from a predetermined timing in the first scheduled period to the end of the first scheduled period; the display mode within the predetermined type of virtual space that is changed by the display means includes a display mode of a specific object that is a character that can be displayed and acted upon within the predetermined type of virtual space while the specific content is being provided, and that is displayed in response to a progressing character that progresses through the specific content; The program of claim 1, wherein the display manner of the specific object in the specific content for the second scheduled period can be changed from the display manner of the specific object in the specific content for the first scheduled period in response to an event that occurs in the predetermined type of virtual space during the second scheduled period.

14. the event content in the first scheduled period includes specific content to be provided from a predetermined timing in the first scheduled period to the end of the first scheduled period; the means for displaying provides specific content to a user who satisfies a predetermined condition during a period from a timing corresponding to the predetermined timing of the second scheduled period after the start of the second scheduled period to an end of the second scheduled period; The program according to claim 1 , wherein the means for displaying allows the display of an image in the virtual space of the specified type for a period until the timing corresponding to the specified timing, regardless of whether the user satisfies the specified condition.

15. A method for controlling a computer to provide a virtual space to a user, comprising: a step of displaying an image in the virtual space that is generated in response to an operation by the user; A step of generating an event in the virtual space; providing event content within a predetermined type of virtual space among the virtual spaces during a first scheduled period; during the first planned period, the causing step can cause an event to occur within the predetermined type of virtual space, and the display step can display an image within the predetermined type of virtual space in response to an operation by the user, and can change a display mode within the predetermined type of virtual space in response to the event caused within the predetermined type of virtual space, a step of re-providing the event content in the predetermined type of virtual space during a second scheduled period after the first scheduled period has elapsed; A method in which the step of displaying can set the display mode within the specified type of virtual space at the start of the second planned period to a display mode that corresponds to an event that occurred during the first planned period, and change the display mode within the specified type of virtual space depending on the event that occurred within the specified type of virtual space during the second planned period.

16. A method for controlling a computer to provide a virtual space to a user, comprising: a step of displaying an image in the virtual space that is generated in response to an operation by the user; A step of generating an event in the virtual space; providing event content within a predetermined type of virtual space among the virtual spaces during a first scheduled period; During the first planned period, the generating step can generate an event in the predetermined type of virtual space, and the display step can display an image in the predetermined type of virtual space in response to an operation by the user, and can change a display mode of the predetermined type of virtual space in response to the event generated in the predetermined type of virtual space. a step of re-providing the event content in the predetermined type of virtual space during a second scheduled period after the first scheduled period has elapsed; The method, wherein the step of displaying includes setting the display mode within the specified type of virtual space at the start of the second planned period to a predetermined display mode regardless of an event that has occurred during the first planned period, and changing the display mode within the specified type of virtual space depending on an event that has occurred within the specified type of virtual space during the second planned period.

17. A method for controlling a computer to provide a virtual space to a user, comprising: a step of displaying an image in the virtual space that is generated in response to an operation by the user; A step of generating an event in the virtual space; providing event content within a predetermined type of virtual space among the virtual spaces during a first scheduled period; During the first planned period, the generating step can generate an event in the predetermined type of virtual space, and the display step can display an image in the predetermined type of virtual space in response to an operation by the user, and can change a display mode of the predetermined type of virtual space in response to the event generated in the predetermined type of virtual space. a step of re-providing the event content in the predetermined type of virtual space during a second scheduled period after the first scheduled period has elapsed; The method, wherein the step of displaying can change the display mode within the specified type of virtual space at the start of the second planned period depending on whether the user was a user who participated in the event content during the first planned period, and can change the display mode within the specified type of virtual space depending on an event that occurred within the specified type of virtual space during the second planned period.

18. A system including a computer for providing a virtual space to a user, a means for displaying an image in a virtual space that is generated in response to an operation by the user; means for generating an event in the virtual space; means for providing event content within a predetermined type of virtual space among the virtual spaces during a first scheduled period; during the first scheduled period, the causing means is capable of causing an event to occur within the predetermined type of virtual space, the display means is capable of displaying an image within the predetermined type of virtual space in response to an operation by the user, and changing a display mode within the predetermined type of virtual space in response to the event caused within the predetermined type of virtual space, a means for re-providing event content in the predetermined type of virtual space during a second scheduled period after the first scheduled period has elapsed; The system is characterized in that the means for displaying sets the display mode within the specified type of virtual space at the start of the second planned period to a display mode that corresponds to an event that occurred during the first planned period, and is capable of changing the display mode within the specified type of virtual space depending on the event that occurred within the specified type of virtual space during the second planned period.

19. A system including a computer for providing a virtual space to a user, a means for displaying an image in a virtual space that is generated in response to an operation by the user; means for generating an event in the virtual space; means for providing event content within a predetermined type of virtual space among the virtual spaces during a first scheduled period; During the first planned period, the causing means is capable of causing an event to occur within the predetermined type of virtual space, the display means is capable of displaying an image within the predetermined type of virtual space in response to an operation by the user, and changing a display mode within the predetermined type of virtual space in response to the event caused within the predetermined type of virtual space, a means for re-providing event content in the predetermined type of virtual space during a second scheduled period after the first scheduled period has elapsed; The system, wherein the means for displaying is capable of setting the display mode within the specified type of virtual space at the start of the second planned period to a predetermined display mode regardless of an event that has occurred during the first planned period, and changing the display mode within the specified type of virtual space in accordance with an event that has occurred within the specified type of virtual space during the second planned period.

20. A system including a computer for providing a virtual space to a user, a means for displaying an image in a virtual space that is generated in response to an operation by the user; means for generating an event in the virtual space; means for providing event content within a predetermined type of virtual space among the virtual spaces during a first scheduled period; During the first planned period, the causing means is capable of causing an event to occur within the predetermined type of virtual space, the display means is capable of displaying an image within the predetermined type of virtual space in response to an operation by the user, and changing a display mode within the predetermined type of virtual space in response to the event caused within the predetermined type of virtual space, a means for re-providing event content in the predetermined type of virtual space during a second scheduled period after the first scheduled period has elapsed; The system is characterized in that the means for displaying can change the display mode within the specified type of virtual space at the start of the second planned period depending on whether or not the user is a user who participated in the event content during the first planned period, and can change the display mode within the specified type of virtual space depending on an event that occurred within the specified type of virtual space during the second planned period.

Images