Program, method, and system

Abstract

To provide a program, a method, and a system that can increase the interest of a user who has participated in an event while enabling the event to be offered again.SOLUTION: It is possible to provide an event content in a predetermined type of virtual space among virtual spaces during a first planned period, to cause an event to occur in the predetermined type of virtual space during the first planned period, to display an image in the predetermined type of virtual space in response to operation from a user, and to change the display mode in the predetermined type of virtual space in response to the event caused in the predetermined type of virtual space. It is also possible to provide the event content again in the predetermined type of virtual space during a second planned period after the first planned period has elapsed, to set the display mode in the predetermined type of virtual space at the start of the second planned period to a display mode corresponding to the event caused in the first planned period, and to change the display mode in the predetermined type of virtual space in response to the event caused in the second planned period.SELECTED DRAWING: Figure 40

Description

Technical Field

[0001] The present invention relates to a program, a method, and a system.

Background Art

[0002] As a system for distributing content etc. via a network, for example, in a virtual space on the web, while a performer holds an event such as a live performance, viewers can participate in the event by operating their viewer avatars (moving, gifting, tipping, etc.). There is known a distribution system that provides such content (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the distribution system described in Patent Document 1, the interest in the event can be improved by livening up the event and enhancing the participation awareness according to events that may occur by the performer or viewers during the event. However, after the event ends, the event cannot be restarted, and the space created by the performer or viewers cannot be re-provided and utilized. Also, even if the event can simply be restarted, there is a possibility that the interest of the performers or viewers who participated in the previous event cannot be improved.

[0005] The present invention has been conceived in view of such circumstances, and provides a program, a method, and a system that can re-provide an event while improving the interest of users who participated in the event.

Means for Solving the Problems

[0006] (1) A program according to an aspect of the present invention (for example, the virtual space generation program 120, the viewer program) causes a computer (for example, the distribution server computer 100, the viewer terminal 300, etc.) for providing a virtual space to a user to means for displaying an image in the generated virtual space that responds to an operation from the user (for example, virtual space update data distribution process, viewer perspective video output process, etc.), means for causing an event to occur in the virtual space (for example, a process for placing an object purchased in response to a purchase operation from the user in the virtual space (virtual space update data generation process), a process for updating the placement of the purchased object in the virtual space based on the virtual space update data (virtual space update process), etc.), function as means for providing event content in a predetermined type of virtual space (for example, within the space area ER5) of the virtual space for a first predetermined period (for example, virtual space update data distribution process using event data 111, viewer perspective video output process), During the first predetermined period, it is possible to cause an event to occur in the predetermined type of virtual space by the means for causing the event, and while displaying an image in the predetermined type of virtual space in response to an operation from the user by the means for displaying (for example, entering the space area ER5 and being able to display the image within the space area ER5), it is possible to change the display mode within the predetermined type of virtual space according to the event that occurred within the predetermined type of virtual space (for example, placing the frusta FS purchased by the user in steps S107 to S109 of FIG. 28 within the space area ER5, lottery of the frusta FS to be displayed within the space area ER5 in step S203 of FIG. 32, setting changes executed by the operation of the operator side, etc., the display mode of the frusta FS used for the production of the live event shown in FIG. 35 that can change due to user purchase such as in FIG. 37), the computer to Even in a second predetermined period after the first predetermined period has elapsed, it functions as means for re-providing event content in the virtual space of the predetermined type (for example, virtual space update data distribution processing using event data 111, viewer viewpoint video output processing, see FIG. 40). The means for causing the display is configured such that the display mode in the virtual space of the predetermined type at the start of the second predetermined period is a display mode corresponding to the event that occurred in the first predetermined period, and the display mode in the virtual space of the predetermined type can be changed according to the event that occurred in the virtual space of the predetermined type during the second predetermined period (for example, see FIG. 40(a)), program.

[0007] According to such a configuration, in the first predetermined period, since the display mode in the virtual space of the predetermined type that changes according to the event that occurred in the virtual space where the event content is provided can be shared among users, the interest in the event content can be improved. Also, the event content can be re-provided in the second predetermined period, and by setting the display mode in the virtual space of the predetermined type at the start of the second predetermined period to the display mode corresponding to the event that occurred in the first predetermined period, the interest of the users who participated in the first predetermined period in the event content in the second predetermined period can be improved. Furthermore, since the display mode in the virtual space of the predetermined type can be changed according to the event that occurred in the virtual space of the predetermined type during the second predetermined period and shared among users, the interest in the event content in the second predetermined period can be improved regardless of whether the user participated in the first predetermined period.

[0008] (2) A program (for example, virtual space generation program 120, viewer program) according to an aspect of the present invention causes a computer (for example, distribution server computer 100, viewer terminal 300, etc.) for providing a virtual space to a user, Means for displaying an image in the generated virtual space, which is an image according to an operation from the user (for example, virtual space update data distribution processing, viewer viewpoint video output processing, etc.), Means for causing an event to occur in the virtual space (for example, processing for arranging an object purchased according to a purchase operation from the user in the virtual space (virtual space update data generation processing), processing for updating the arrangement of the purchased object in the virtual space based on the virtual space update data (virtual space update processing), etc.), Function as means for providing event content in a predetermined type of virtual space (for example, within the space area ER5) in the virtual space for a first predetermined period (for example, virtual space update data distribution processing using event data 111, viewer viewpoint video output processing), During the first predetermined period, it is possible to cause an event to occur in the predetermined type of virtual space by the means for causing the event, and the means for displaying can display an image in the predetermined type of virtual space according to an operation from the user (for example, it is possible to enter the space area ER5 and display the image within the space area ER5), and it is possible to change the display mode within the predetermined type of virtual space according to the event that has occurred in the predetermined type of virtual space (for example, placing the flask FS purchased by the user in the space area ER5 in steps S107 to S109 of FIG. 28, lottery of the flask FS displayed in the space area ER5 in step S203 of FIG. 32, setting changes executed by the operation of the operation side, such as the display mode of the flask FS used for the production of the live event shown in FIG. 35 that can change due to user purchase in FIG. 37, etc.), The computer is made to, Even in a second predetermined period after the first predetermined period has elapsed, function as means for re - providing event content in the predetermined type of virtual space (for example, virtual space update data distribution processing using event data 111, viewer viewpoint video output processing, see FIG. 40), The means for causing the display is configured to set the display mode within the virtual space of the predetermined type when starting the second predetermined period to a predetermined display mode regardless of the events that occurred during the first predetermined period, and to be able to change the display mode within the virtual space of the predetermined type according to the events that occur within the virtual space of the predetermined type during the second predetermined period (see, for example, FIG. 40(b)), program.

[0009] According to such a configuration, during the first predetermined period, since the display mode within the virtual space of the predetermined type that changes according to the events that occur within the virtual space of the predetermined type where event content is provided can be shared among users, the interest in the event content can be improved. Also, during the second predetermined period, the event content can be re-provided, and by setting the display mode within the virtual space of the predetermined type when starting the second predetermined period to a predetermined display mode, even users who participated in the first predetermined period can participate in the event content during the second predetermined period with a fresh feeling, so the interest in the event content can be improved. Furthermore, since the display mode within the virtual space of the predetermined type can be changed according to the events that occur within the virtual space of the predetermined type during the second predetermined period and shared among users, regardless of whether the user participated in the first predetermined period, the interest in the event content during the second predetermined period can be improved.

[0010] (3) A program according to an aspect of the present invention (for example, virtual space generation program 120, viewer program) causes a computer (for example, distribution server computer 100, viewer terminal 300, etc.) for providing a virtual space to a user to means for displaying an image within the generated virtual space that is an image corresponding to an operation from the user (for example, virtual space update data distribution process, viewer viewpoint video output process, etc.), and Means for causing an event in the virtual space (for example, a process for arranging an object purchased in response to a purchase operation by the user in the virtual space (virtual space update data generation process), a process for updating the arrangement of the purchased object in the virtual space based on the virtual space update data (virtual space update process), etc.), and Means for providing event content in a predetermined type of virtual space (for example, within the space area ER5) in the virtual space for a first predetermined period (for example, virtual space update data distribution process using event data 111, viewer perspective video output process) to function as, During the first predetermined period, it is possible to cause an event in the predetermined type of virtual space by the means for causing the event, and the image in the predetermined type of virtual space is displayed according to the operation from the user by the means for displaying (for example, it is possible to enter the space area ER5 and display the image within the space area ER5), and it is possible to change the display mode within the predetermined type of virtual space according to the event caused in the predetermined type of virtual space, The computer is, Even in a second predetermined period after the first predetermined period has elapsed, means for re-providing event content in the predetermined type of virtual space (for example, virtual space update data distribution process using event data 111, viewer perspective video output process, see FIG. 40) to function as, The means for displaying makes the display mode within the predetermined type of virtual space at the start of the second predetermined period different according to whether the user participated in the event content during the first predetermined period, and it is possible to change the display mode within the predetermined type of virtual space according to the event caused in the predetermined type of virtual space during the second predetermined period (for example, refer to (the pre-scheduled period and the re-provision of content about the event) in the modified example), program.

[0011] According to such a configuration, during the first predetermined period, since the display mode within the virtual space of the predetermined type that changes according to the event generated within the virtual space of the predetermined type where event content is provided can be shared among users, the interest in the event content can be improved. Also, during the second predetermined period, the event content can be re-provided, and by setting the display mode within the virtual space of the predetermined type when starting the second predetermined period to be different according to whether the user participated in the event content during the first predetermined period, a different sense of premium can be given to each according to whether the user participated in the first predetermined period, and the interest in the event content during the second predetermined period can be improved. Furthermore, since the display mode within the virtual space of the predetermined type can be changed according to the event generated within the virtual space of the predetermined type during the second predetermined period and shared among users, the interest in the event content during the second predetermined period can be improved regardless of whether the user participated in the first predetermined period.

[0012] (4) In any of (1) to (3) above, the event content during the first predetermined period and the second predetermined period includes specific content (for example, a live event advanced by avatar objects that operate according to the movements of a predetermined performer, such as performer avatars 1a to 1d in FIG. 35), users including the predetermined performer can participate in the specific content during the second predetermined period, when the predetermined performer participates in the specific content during the second predetermined period, the means for causing the display can display, within the virtual space of the predetermined type in the specific content during the second predetermined period, an avatar object of the participating predetermined performer as a participant separately from the avatar object of the predetermined performer during the first predetermined period (for example, it is possible to display the performer avatar on the virtual live stage and the avatar of the performer participating as a participant).

[0013] According to such a configuration, within a predetermined type of virtual space in specific content during a second predetermined period, it is possible to display an avatar object as a predetermined performer and an avatar object as a participant of a predetermined performer who participated separately from the avatar object. Therefore, it is possible to provide the specific content with an atmosphere and taste different from that of the specific content during the first predetermined period, and it is possible to improve the interest in the specific content.

[0014] (5) In the above (4), the avatar object as a participant of the predetermined performer that can be displayed within a predetermined type of virtual space in the specific content during the second predetermined period has a different display mode from the avatar object as the predetermined performer (for example, it is possible to display an avatar as a general user of the performer separately from the performer avatar on the virtual live stage).

[0015] According to such a configuration, since it is possible to distinguish between the avatar object as a participant of a predetermined performer and the avatar object as a predetermined performer within a predetermined type of virtual space, it is possible to prevent confusing the user.

[0016] (6) In the above (4), the computer is a user terminal (for example, the viewer terminal 300) that displays the provided virtual space, the computer is, When the predetermined performer participates in the specific content during the second predetermined period, it functions as means for being able to switch to the voice emitted from the predetermined performer as a participant from the user terminal in response to an operation on the user terminal (for example, steps S411 to S412 of the voice and viewpoint special switching process in FIG. 41).

[0017] According to such a configuration, it is possible to switch and listen to the voice emitted from a predetermined performer as a participant according to the user's intention, improve the interest in the specific content, and increase the variations in the ways of enjoyment.

[0018] (7) In the above (4), the computer is a user terminal (for example, viewer terminal 300) that displays the provided virtual space, the computer, the means for causing the display is, when the predetermined performer participates in the specific content during the second predetermined period, in response to an operation on the user terminal, among the images in a predetermined type of virtual space in the specific content, it is possible to switch and display the image of the avatar object of the predetermined performer as a participant from a predetermined viewpoint (for example, steps S413 to S414 of the audio / video viewpoint special switching process in FIG. 41).

[0019] According to such a configuration, it is possible to switch and view the image of the avatar object of a predetermined performer as a participant from a predetermined viewpoint according to the user's intention, improve the interest in the specific content, and increase the variations in the ways of enjoyment.

[0020] (8) In the above (1), the event content in the first predetermined period and the second predetermined period includes specific content (for example, a live event such as FIG. 35) that progresses by an avatar object that operates according to the movement of a predetermined performer, the means for causing the display is, among the objects in a predetermined type of virtual space in the specific content during the second predetermined period, for the avatar object, it is displayed in the same display mode as the specific content in the first predetermined period (for example, the performer avatar on the virtual live stage is in the same display mode as in the first predetermined period), while for a predetermined object different from the avatar object, it is possible to display it in a display mode different from the specific content in the first predetermined period (for example, the frusta FS used for the production of the live event is displayed based on the user's purchase information, etc. in the second predetermined period).

[0021] According to such a configuration, while the quality of the specific content in the second predetermined period is made the same as that of the specific content in the first predetermined period, for a predetermined object, it is displayed in a display mode in the second predetermined period. Therefore, the interest in the specific content in the second predetermined period can be improved.

[0022] (9) In any of the above (1) to (3), the display mode in the virtual space of the predetermined type that can change according to the event that occurred in the second predetermined period can be a display mode different from the display mode displayed to other users according to the event that occurred in the second predetermined period (for example, the frusta FS1 purchased by user 1 are displayed at a predetermined position A1 in a predetermined display area A within the spatial area ER5 as shown in FIGS. 29(B) to (D) on the viewer terminal 300 of user 1. On the other hand, on the viewer terminal 300 of user 2, as shown in FIGS. 30(B) and (C), the frusta FS1 purchased by user 1 are not displayed at the predetermined position A1 in the predetermined display area A).

[0023] According to such a configuration, the display mode in the virtual space of the predetermined type in the predetermined period can be customized for each user, and a sense of specialness can be given to each user.

[0024] (10) In any of the above (1) to (3), the event content in the first predetermined period and the second predetermined period includes the specific content provided from a predetermined timing in the first predetermined period until the end of the first predetermined period (for example, a live event such as FIG. 35). The means for causing the display is configured to change the display mode (e.g., the display mode such as the frusta FS used for the production of the live event shown in FIG. 35) within the virtual space of the predetermined type during the provision of the specific content corresponding to the specific content in the second predetermined period in accordance with an event that has occurred from the start of the second predetermined period until the timing corresponding to the predetermined timing of the second predetermined period (e.g., step S303 in FIG. 37(A), step S313 in FIG. 37(B), step S314, etc.).

[0025] According to such a configuration, it is possible to draw the user's attention to how the display mode within the virtual space of the predetermined type during the provision of the specific content changes in accordance with an event that has occurred until the predetermined timing.

[0026] (11) In the above (10), the display mode (e.g., the display mode of the frusta FS used for the production of the live event shown in FIG. 34) within the virtual space of the predetermined type that can change during the provision of the specific content in the second predetermined period can be a display mode different from the display mode displayed to other users in accordance with an event that has occurred from the start of the second predetermined period until the timing corresponding to the predetermined timing of the second predetermined period (e.g., based on the user-related information in FIG. 27(C), the frusta FS used for the production becomes the default frusta FS in FIG. 36(A) or the frusta in FIG. 36(B)).

[0027] According to such a configuration, the display mode within the virtual space of the predetermined type during the provision of the specific content can be customized for each user, and a special feeling can be given to each user.

[0028] (12) In any of the above (1) to (3), the display mode within the virtual space of the predetermined type that is changed by the means for causing the display in the second predetermined period includes the display mode of a specific object arranged within the virtual space of the predetermined type (e.g., the frusta FS arranged in the exhibition area within the space area ER5). The event that changes the display mode within the virtual space of the predetermined type includes the event of associating the specific object with the user and arranging it in a designated area within the virtual space of the predetermined type during the second predetermined period (for example, the event of associating information about the frusta FS purchased by the user as user-related information in FIG. 27(C) with the user and arranging it in the predetermined display area A as shown in FIG. 29(B)).

[0029] According to such a configuration, during the predetermined period, by arranging the specific object associated with the user in the area designated by the user, the display mode within the virtual space of the predetermined type can be changed, and the user's interest can be improved.

[0030] (13) In the above (1), the event content in the first predetermined period includes specific content (for example, the live event in FIG. 35) provided from a predetermined timing in the first predetermined period until the end of the first predetermined period, The display mode within the virtual space of the predetermined type changed by the means for display includes a character (for example, the performer avatars 1a to 1d in FIG. 35, etc.) that can be displayed and operated within the virtual space of the predetermined type during the provision of the specific content, and a specific object (for example, the performer avatars 1a to 1d in FIG. 35, or the frusta FS held by the operation avatar) that is displayed corresponding to the progress character that progresses the specific content. The display mode is included, The display mode of the specific object in the specific content in the second predetermined period can be changed from the display mode of the specific object in the specific content in the first predetermined period according to the event that occurs within the virtual space of the predetermined type in the second predetermined period (for example, the latest frusta (the last purchased frusta) can be associated with the performer avatar and displayed for each user).

[0031] According to such a configuration, since the display mode of a specific object that can be displayed corresponding to the progressing character can change according to an event that occurs during the second predetermined period, the event that occurs during the predetermined period can improve the interest.

[0032] (14) In the above (1), the event content in the first predetermined period includes specific content (for example, the live event in FIG. 35) provided from a predetermined timing of the first predetermined period until the end of the first predetermined period. The means for causing the display provides specific content provided from a timing corresponding to the predetermined timing of the second predetermined period until the end of the second predetermined period to a user who satisfies a predetermined condition (for example, purchases a ticket that can participate in the event content). The means for causing the display allows the display of an image in the virtual space of the predetermined type until a timing corresponding to the predetermined timing regardless of whether the user satisfies the predetermined condition (for example, regardless of whether the user has purchased a ticket that can participate in the event content, the user can enter the space area ER5. Refer to the (right to enter the space area ER5) in the modified example).

[0033] According to such a configuration, even a user who does not satisfy the predetermined condition can be made to display an image in the virtual space of the predetermined type. Thereby, by visually recognizing the image in the virtual space of the predetermined type, the interest in the specific content can be enhanced, and as a result, the motivation to satisfy the predetermined condition can be improved.

[0034] (15) A control method of a computer according to an aspect of the present invention is a method of controlling a computer (for example, a distribution server computer 100, a viewer terminal 300, etc.) for providing a virtual space to a user, Steps for displaying an image in the generated virtual space that responds to an operation from the user (e.g., virtual space update data distribution processing, viewer perspective video output processing, etc.), Steps for causing an event to occur within the virtual space (e.g., processing for placing an object purchased in response to a purchase operation from the user within the virtual space (virtual space update data generation processing), processing for updating the placement of the purchased object within the virtual space based on virtual space update data (virtual space update processing), etc.), Steps for providing event content within a predetermined type of virtual space within the virtual space (e.g., within space area ER5) for a first predetermined period (e.g., virtual space update data distribution processing using event data 111, viewer perspective video output processing), and During the first predetermined period, it is possible to cause an event to occur within the predetermined type of virtual space by the steps for causing the event, and to display an image within the predetermined type of virtual space in response to an operation from the user by the steps for displaying (e.g., it is possible to enter space area ER5 and display the image within the space area ER5), and it is possible to change the display mode within the predetermined type of virtual space according to the event that has occurred within the predetermined type of virtual space (e.g., placing the flask FS purchased by the user in the space area ER5 in steps S107 to S109 of FIG. 28, lottery of the flask FS to be displayed within the space area ER5 in step S203 of FIG. 32, setting changes executed by the operation of the operation side, etc., the display mode of the flask FS used for the production of the live event shown in FIG. 34 that can change due to user purchase as shown in FIG. 37, etc.), Even during a second predetermined period after the first predetermined period has elapsed, there are steps for re-providing event content within the predetermined type of virtual space (e.g., virtual space update data distribution processing using event data 111, viewer perspective video output processing, see FIG. 40), The step for causing the display is to set the display mode in the virtual space of the predetermined type when starting the second predetermined period as the display mode corresponding to the event that occurred in the first predetermined period, and it is possible to change the display mode in the virtual space of the predetermined type according to the event that occurred in the virtual space of the predetermined type during the second predetermined period (for example, refer to Fig. 40(a)).

[0035] According to such a configuration, during the first predetermined period, the display mode in the virtual space of the predetermined type that changes according to the event that occurred in the virtual space of the predetermined type where event content is provided can be shared among users, so that the interest in the event content can be improved. Also, the event content can be re-provided during the second predetermined period, and by setting the display mode in the virtual space of the predetermined type when starting the second predetermined period as the display mode corresponding to the event that occurred in the first predetermined period, the interest of the users who participated in the first predetermined period in the event content during the second predetermined period can be improved. Furthermore, since the display mode in the virtual space of the predetermined type can be changed according to the event that occurred in the virtual space of the predetermined type during the second predetermined period and shared among users, the interest in the event content during the second predetermined period can be improved regardless of whether the user participated in the first predetermined period or not.

[0036] (16) A method for controlling a computer according to an aspect of the present invention is a method for controlling a computer (for example, a distribution server computer 100, a viewer terminal 300, etc.) for providing a virtual space to a user, comprising a step for displaying an image in the generated virtual space that is an image corresponding to an operation from the user (for example, a virtual space update data distribution process, a viewer viewpoint video output process, etc.), and Steps for causing an event to occur within the virtual space (for example, a process for arranging an object purchased in response to a purchase operation from a user within the virtual space (virtual space update data generation process), a process for updating the arrangement within the virtual space of the purchased object based on the virtual space update data (virtual space update process), etc.), and Steps for providing event content within a predetermined type of virtual space within the virtual space for a first predetermined period (for example, within the space area ER5) by means for providing event content for a first predetermined period (for example, virtual space update data distribution process using event data 111, viewer perspective video output process), and During the first predetermined period, it is possible to cause an event to occur within the predetermined type of virtual space by the steps for causing the event, and while displaying an image within the predetermined type of virtual space in response to an operation from the user by the steps for displaying (for example, it is possible to enter the space area ER5 and display an image within the space area ER5), it is possible to change the display mode within the predetermined type of virtual space according to the event that occurred within the predetermined type of virtual space (for example, placing the flask FS purchased by the user in steps S107 to S109 of FIG. 28 within the space area ER5, lottery of the flask FS displayed within the space area ER5 in step S203 of FIG. 32, setting changes executed by an operation on the operator side, etc., the display mode of the flask FS used for the production of the live event shown in FIG. 34 that can change due to a user purchase such as in FIG. 37), Even in a second predetermined period after the first predetermined period has elapsed, there are steps for re - providing event content within the predetermined type of virtual space (for example, virtual space update data distribution process using event data 111, viewer perspective video output process, see FIG. 40), and The step for causing the display is to set the display mode in the virtual space of the predetermined type when starting the second predetermined period as a predetermined display mode regardless of the event that occurred in the first predetermined period, and it is possible to change the display mode in the virtual space of the predetermined type according to the event that occurred in the virtual space of the predetermined type during the second predetermined period (for example, refer to FIG. 40(b)).

[0037] According to such a configuration, during the first predetermined period, since the display mode in the virtual space of the predetermined type that changes according to the event that occurred in the virtual space where event content is provided can be shared among users, the interest in the event content can be improved. Also, during the second predetermined period, the event content can be re-provided, and by setting the display mode in the virtual space of the predetermined type when starting the second predetermined period as a predetermined display mode, even a user who participated in the first predetermined period can participate in the event content in the second predetermined period with a fresh feeling, so the interest in the event content can be improved. Furthermore, since the display mode in the virtual space of the predetermined type can be changed according to the event that occurred in the virtual space of the predetermined type during the second predetermined period and shared among users, regardless of whether the user participated in the first predetermined period or not, the interest in the event content in the second predetermined period can be improved.

[0038] (17) A method for controlling a computer according to an aspect of the present invention is a method for controlling a computer (for example, a distribution server computer 100, a viewer terminal 300, etc.) for providing a virtual space to a user, and a step for displaying an image in the generated virtual space that is an image according to an operation from the user (for example, virtual space update data distribution process, viewer viewpoint video output process, etc.), and Steps for causing an event to occur within the virtual space (for example, processes for placing an object purchased in response to a purchase operation from a user within the virtual space (virtual space update data generation process), processes for updating the placement of the purchased object within the virtual space based on the virtual space update data (virtual space update process), etc.), and Steps for providing event content within a predetermined type of virtual space (for example, within spatial area ER5) of the virtual space for a first predetermined period (for example, virtual space update data distribution process using event data 111, viewer perspective video output process), and During the first predetermined period, it is possible to cause an event to occur within the predetermined type of virtual space by the steps for causing the event, and while displaying an image within the predetermined type of virtual space in response to an operation from the user by the steps for displaying (for example, it is possible to enter spatial area ER5 and display an image within the spatial area ER5), it is possible to change the display mode within the predetermined type of virtual space according to the event that occurred within the predetermined type of virtual space Even during a second predetermined period after the first predetermined period has elapsed, there are steps for re-providing event content within the predetermined type of virtual space (for example, virtual space update data distribution process using event data 111, viewer perspective video output process, refer to FIG. 40), and The steps for displaying make the display mode within the predetermined type of virtual space at the start of the second predetermined period a different display mode according to whether the user participated in the event content during the first predetermined period, and it is possible to change the display mode within the predetermined type of virtual space according to the event that occurred within the predetermined type of virtual space during the second predetermined period (for example, refer to (the pre-scheduled period and re-provision of content regarding the event) of the modified example).

[0039] According to such a configuration, in the first predetermined period, since the display mode in the virtual space of the predetermined type that changes according to the event generated in the virtual space where the event content is provided can be shared among users, the interest in the event content can be improved. Also, in the second predetermined period, the event content can be re-provided, and by setting the display mode in the virtual space of the predetermined type when starting the second predetermined period to be different according to whether the user participated in the event content in the first predetermined period, a different sense of premium can be given to each according to whether the user participated in the first predetermined period, and the interest in the event content in the second predetermined period can be improved. Further, since the display mode in the virtual space of the predetermined type can be changed according to the event generated in the virtual space of the predetermined type in the second predetermined period and shared among users, the interest in the event content in the second predetermined period can be improved regardless of whether the user participated in the first predetermined period.

[0040] (18) A system (virtual space content distribution system) according to an aspect of the present invention is a system including a computer (for example, a distribution server computer 100, a viewer terminal 300, etc.) for providing a virtual space to a user, means for displaying an image in the generated virtual space that responds to an operation from the user (for example, virtual space update data distribution processing, viewer viewpoint video output processing, etc.), means for generating an event in the virtual space (for example, processing for placing an object purchased in response to a purchase operation from the user in the virtual space (virtual space update data generation processing), processing for updating the placement of the purchased object in the virtual space based on the virtual space update data (virtual space update processing), etc.), and means for providing event content in the virtual space of a predetermined type (for example, within the space area ER5) in the first predetermined period (for example, virtual space update data distribution processing using event data 111, viewer viewpoint video output processing). During the first predetermined period, it is possible to cause an event to occur within the virtual space of the predetermined type by the means for causing it, and to display an image within the virtual space of the predetermined type in response to an operation from the user by the means for displaying (for example, it is possible to enter the space area ER5 and display an image within the space area ER5), and it is possible to change the display mode within the virtual space of the predetermined type according to the event that has occurred within the virtual space of the predetermined type (for example, placing the frusta FS purchased by the user in the space area ER5 in steps S107 to S109 of FIG. 28, lottery of the frusta FS displayed in the space area ER5 in step S203 of FIG. 32, setting changes executed by the operation of the operator side, etc., the display mode of the frusta FS used for the production of the live event shown in FIG. 34 that can be changed by the user purchase such as in FIG. 37), Even during a second predetermined period after the elapse of the first predetermined period, there are means for re-providing event contents within the virtual space of the predetermined type (for example, virtual space update data distribution processing using event data 111, viewer perspective video output processing, see FIG. 40), The means for displaying sets the display mode within the virtual space of the predetermined type at the start of the second predetermined period as the display mode corresponding to the event that occurred during the first predetermined period, and it is possible to change the display mode within the virtual space of the predetermined type according to the event that has occurred within the virtual space of the predetermined type during the second predetermined period (for example, see FIG. 40(a)).

[0041] According to such a configuration, in the first predetermined period, the display mode in the virtual space of the predetermined type that changes according to the event generated in the virtual space of the predetermined type where the event content is provided can be shared among users, so that the interest in the event content can be improved. Also, the event content can be re-provided in the second predetermined period, and by setting the display mode in the virtual space of the predetermined type when starting the second predetermined period to the display mode according to the event generated in the first predetermined period, the interest of the users who participated in the first predetermined period in the event content in the second predetermined period can be improved. Furthermore, since the display mode in the virtual space of the predetermined type can be changed according to the event generated in the virtual space of the predetermined type in the second predetermined period and shared among users, the interest in the event content in the second predetermined period can be improved regardless of whether the user participated in the first predetermined period or not.

[0042] (19) A system (virtual space content distribution system) according to an aspect of the present invention is a system including a computer (for example, a distribution server computer 100, a viewer terminal 300, etc.) for providing a virtual space to a user, means for displaying an image in the generated virtual space that responds to an operation from the user (for example, virtual space update data distribution processing, viewer viewpoint video output processing, etc.), means for generating an event in the virtual space (for example, processing for arranging an object purchased according to an operation from the user in the virtual space (virtual space update data generation processing), processing for arranging and updating the purchased object in the virtual space based on the virtual space update data (virtual space update processing), etc.), and means for providing event content in the virtual space of a predetermined type (for example, within the space area ER5) in the first predetermined period (for example, virtual space update data distribution processing using event data 111, viewer viewpoint video output processing). During the first predetermined period, it is possible to cause an event to occur within the virtual space of the predetermined type by the means for causing the event, and to display an image within the virtual space of the predetermined type in response to an operation from the user by the means for displaying (for example, it is possible to enter the space area ER5 and display an image within the space area ER5), and it is possible to change the display mode within the virtual space of the predetermined type according to the event that has occurred within the virtual space of the predetermined type (for example, placing the frustration FS purchased by the user within the space area ER5 in steps S107 to S109 of FIG. 28, lottery of the frustration FS to be displayed within the space area ER5 in step S203 of FIG. 32, setting changes executed by the operation of the operation side, such as the display mode of the frustration FS used for the production of the live event shown in FIG. 34 that can be changed by the user purchase in FIG. 37, etc.). Even during the second predetermined period after the first predetermined period has elapsed, there is means for re-providing event content within the virtual space of the predetermined type (for example, virtual space update data distribution processing using event data 111, viewer viewpoint video output processing, see FIG. 40). The means for displaying sets the display mode within the virtual space of the predetermined type at the start of the second predetermined period as a predetermined display mode regardless of the event that occurred during the first predetermined period, and it is possible to change the display mode within the virtual space of the predetermined type according to the event that has occurred within the virtual space of the predetermined type during the second predetermined period (for example, see FIG. 40(b)).

[0043] According to such a configuration, in the first predetermined period, since the display mode in the predetermined type of virtual space that changes according to the event generated in the virtual space where the event content is provided can be shared among users, the interest in the event content can be improved. Also, in the second predetermined period, the event content can be re-provided, and by setting the display mode in the predetermined type of virtual space when starting the second predetermined period to a predetermined display mode, even users who participated in the first predetermined period can participate in the event content in the second predetermined period with a fresh feeling, so the interest in the event content can be improved. Furthermore, since the display mode in the predetermined type of virtual space can be changed according to the event generated in the predetermined type of virtual space in the second predetermined period and shared among users, regardless of whether the user participated in the first predetermined period or not, the interest in the event content in the second predetermined period can be improved.

[0044] (20) A system (virtual space content distribution system) according to an aspect of the present invention is a system including a computer (for example, a distribution server computer 100, a viewer terminal 300, etc.) for providing a virtual space to a user, means for displaying an image in the generated virtual space that responds to an operation from the user (for example, virtual space update data distribution processing, viewer viewpoint video output processing, etc.), means for generating an event in the virtual space (for example, a process for arranging an object purchased according to a purchase operation from the user in the virtual space (virtual space update data generation process), a process for updating the arrangement of the purchased object in the virtual space based on the virtual space update data (virtual space update process), etc.), and means for providing event content in a predetermined type of virtual space (for example, within the space area ER5) in the virtual space for a first predetermined period (for example, virtual space update data distribution processing using event data 111, viewer viewpoint video output processing). During the first predetermined period, it is possible to cause an event to occur within the virtual space of the predetermined type by the means for causing it, and to display an image within the virtual space of the predetermined type in response to an operation from the user by the means for displaying it (for example, it is possible to enter the space area ER5 and display an image within the space area ER5), and it is possible to change the display mode within the virtual space of the predetermined type according to the event that has occurred within the virtual space of the predetermined type Even during a second predetermined period after the first predetermined period has elapsed, there is means for re-providing event content within the virtual space of the predetermined type (for example, virtual space update data distribution processing using event data 111, viewer perspective video output processing, see FIG. 40), The means for displaying makes the display mode within the virtual space of the predetermined type at the start of the second predetermined period a different display mode depending on whether the user participated in the event content during the first predetermined period, and it is possible to change the display mode within the virtual space of the predetermined type according to the event that has occurred within the virtual space of the predetermined type during the second predetermined period (for example, refer to (the period before the scheduled date and the re-provision of content about the event) of the modified example).

[0045] According to such a configuration, during the first predetermined period, since the display mode in the virtual space of the predetermined type that changes according to the event generated in the virtual space of the predetermined type where the event content is provided can be shared among users, the interest in the event content can be improved. Also, during the second predetermined period, the event content can be re-provided, and by setting different display modes depending on whether the user participated in the event content during the first predetermined period or not in the virtual space of the predetermined type when starting the second predetermined period, different senses of premium can be given to each according to whether the user participated in the first predetermined period or not, and the interest in the event content during the second predetermined period can be improved. Furthermore, since the display mode in the virtual space of the predetermined type can be changed according to the event generated in the virtual space of the predetermined type during the second predetermined period and shared among users, the interest in the event content during the second predetermined period can be improved regardless of whether the user participated in the first predetermined period or not.

Brief Description of the Drawings

[0046]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Figure 21

Figure 22

Figure 23

Figure 24

Figure 25

Figure 26

Figure 27

Figure 28

Figure 29

Figure 30

Figure 31

Figure 32

Figure 33

Figure 34

Figure 35

Figure 36

Figure 37

Figure 38

Figure 39

Figure 40

Figure 41

Figure 42

Figure 43

Figure 44

Embodiments for Carrying Out the Invention

[0047] A mode for implementing a virtual space content distribution system that distributes various contents in the virtual space of the present invention will be described below with reference to the drawings based on an embodiment. In a plurality of drawings, the same or similar components are denoted by the same reference numerals, and redundant explanations are omitted. Also, the distribution program to be executed in the virtual space content distribution system according to the present invention may be a program used for the entire system composed of a server computer and each terminal described later that constitute the virtual space content distribution system, or it may be a program that operates only on a part of the devices that constitute the virtual space content distribution system, for example, a server computer and each terminal.

Embodiment

[0048] FIG. 1 is a block diagram showing a system configuration example of a virtual space content distribution system in an embodiment that is one embodiment of the present invention. In the system of the present embodiment shown in FIG. 1, a performer avatar 1 corresponding to a performer user is distributed as virtual space content for holding events such as live shows, games, exchange meetings, and movie screenings in the virtual space.

[0049] As shown in FIG. 1, the virtual space content distribution system of the present embodiment mainly includes a distribution server computer 100 capable of executing various processes related to the virtual space and various processes related to the provision and distribution of the virtual space, and an event manager K of an event operation organization that operates and manages events in the virtual space. The administrator terminal 150 used for managing the distribution of events in the virtual space, the performer terminal 200 used by the performer user, and the viewer terminal 300 that can be used by a viewer user who enters and participates (for example, logs in to the virtual space) in the virtual space and views the event content in the virtual space. The distribution server computer 100, the administrator terminal 150, the performer terminal 200, and the viewer terminal 300 are connected to be able to communicate with each other via the Internet network N, which is an open computer network.

[0050] In the present embodiment, an example is shown in which the administrator terminal 150 and the speaker terminal 200 are also connected to the distribution server computer 100 via the Internet network N. However, the present invention is not limited to this. For example, in the case where an event management organization provides a studio to a speaker user and the distribution server computer 100 is installed in these studios, the administrator terminal 150 and the speaker terminal 200 may be locally data communication-connected to the distribution server computer 100, or may be communication-connected via a local area network LAN within the studio facility.

[0051] Also, as shown in FIG. 1, there are a plurality of viewer users, such as viewer user A, viewer user B, viewer user C, etc. As the viewer terminal 300, viewer terminals 300a, 300b, 300c,... that can be used by individual viewer users A, B, C,... are included. Note that the number of viewer users is usually plural, but may be one or four or more, and the number may be appropriately determined according to the type of event content provided in the virtual space. Hereinafter, viewer users A, B, C,... may be collectively referred to as viewer users, and viewer terminals 300a, 300b, 300c,... may be collectively referred to as viewer terminal 300.

[0052] In addition, in this embodiment, a form with one performer user is illustrated as an example. However, the present invention is not limited to this. The event content provided in the virtual space may be a co-starring event in which a plurality of performer users who are acting alone participate and proceed, or may be a group event in which a plurality of people who are acting together participate and proceed. Thus, when a plurality of performers appear, performer terminals 200a, 200b, 200c,... may be provided for each performer user, or when a plurality of people appear as a group, one performer terminal 200 may be used by a plurality of people. Note that a performer user (also referred to as a talent user) is a user who serves as a speaker, emcee / program host, lead actor, etc. within the event content. In the event content, it will be advanced by avatars such as a performer avatar corresponding to the actions of the performer user and an operation avatar corresponding to the operations of an operator (also referred to as an operation user) who operates the event.

[0053] Also, in FIG. 1, the distribution server computer 100 is illustrated as a single unit. However, the present invention is not limited to this. These distribution server computers 100 may be configured by a plurality of server computers such as a first server computer mainly performing virtual space processing and a second server computer mainly performing distribution processing, or may be configured by a cloud server or the like, and the number of server computers may be appropriately changed according to the scale of the event and the number of viewer users participating.

[0054] Similarly, regarding the administrator terminal 150, in FIG. 1, it is illustrated as a single unit. However, the present invention is not limited to this. Needless to say, these administrator terminals 150 may be plural according to the number of performer users and viewer users participating in event content such as a live event.

[0055] <Distribution server computer> FIG. 2 is a diagram showing the configuration of the distribution server computer 100 used in this embodiment. As described above, the distribution server computer 100 used in this embodiment is a normal server computer with relatively excellent processing capabilities installed in a studio operated by an event management organization. As shown in FIG. 2, it includes a processor (CPU) 101 connected to a data bus 108, a memory (RAM) 102, a storage 103 such as a hard disk, a communication interface (I / F) 104 capable of two-way communication using the TCP / IP protocol via the Internet, which is an open computer network, and an input / output interface (I / F) 105 capable of connecting input devices such as a keyboard.

[0056] In this embodiment, an input / output interface (I / F) 105 is provided to enable local operations. However, when remote operations via the communication interface (I / F) 104 are possible, it may be configured without the input / output interface (I / F) 105.

[0057] In addition to an operating system (server OS) for providing server functions (not shown) in the storage 103 of the distribution server computer 100, various data and programs are stored as shown in FIG. 3. Specifically, mainly, an event management program 110 for providing an event management function for managing various events, a virtual space generation program 120 for providing a virtual space of the event venue, a performer user management program 130 for providing a performer user management function for managing performer users, and a viewer user management program 132 for providing a viewer user management function for managing viewer users are stored.

[0058] The event management program 110 is a program for managing an event held at an event venue in cooperation with the administrator terminal 150. Using event data 111 (see FIG. 7), time schedule data (TS data) 112, music data 113, etc. stored in the storage 103 together with the event management program 110, the progress of the event can be managed.

[0059] The event data 111 used in this embodiment is illustrated in FIG. 7. The event data 111 is associated with an event ID uniquely assigned to the event, and includes an event name, a file name of time schedule (TS) data, a performer ID uniquely assigned to a performer user who is a performer, a file name of a music list, etc., a file name of a participating viewer list in which information of special viewer users permitted virtual participation is registered in the third area of the virtual audience area described later, and a file name of a participating viewer list in which information of viewer users who reserved virtual participation is registered in the fourth area of the virtual audience area described later. The event data also includes information for specifying the date and time when the event is held, and event content will be distributed at that date and time. Further, the event data includes information for specifying the date and time when the virtual space for holding the event is released to allow users to enter, for the content that releases the virtual space from before the scheduled date of the event.

[0060] The time schedule data (TS data) 112 is data in which the order of progress of the virtual space live event to be held and items such as music are described in time series, and the virtual space live event is managed to progress based on the time schedule described in the time schedule data (TS data) 112. Also, these time schedule data (TS data) 112, event data 111, etc. can be changed, updated, and added by the event administrator K operating the administrator terminal 150.

[0061] In addition, the music data 113 is data of the performance parts (so-called karaoke) of each music sung by the performer user. Based on the time schedule data (TS data) 112 by the event management program 110, it is reproduced by the voice control program 124 described later and transmitted to the performer terminal 200 and the viewer terminal 300 (see Fig. 11).

[0062] The virtual space generation program 120 is a program for providing an event venue that is a virtual space. Using the virtual space data 121 in which the structure of the event venue and the like described together with the virtual space generation program 120 are stored in the storage 103, the object data 122 for arranging various objects (including the star decorations 43 on the stage and the star objects 50 to 52 in the sky) arranged in the event venue in the virtual space, and the performer avatar data included in the performer user data 131 described later and the viewer avatar data included in the viewer user data 133, it has a function of providing an event venue in which the performer avatar and the viewer avatar virtually participate.

[0063] The viewpoint video control program 123 provides a function of generating viewpoint videos from the virtual cameras C1 to C4 and the aerial moving virtual camera (not shown) virtually set in the event venue, as shown in Fig. 13 for example. It is also a program for providing functions such as displaying videos from the viewpoints of the viewer avatars 11 to 14 virtually participating in the third area of the event venue and the viewer avatars 21 to 32 virtually participating in the fourth area on the performer terminal 200 in cooperation with the viewer terminal 300. Note that the virtual camera C2 is a virtual camera set to be the video from the viewpoint of the performer avatar 1 on the stage of the event venue, and the viewpoint video from the virtual camera C2 is projected onto the screen S provided in the studio by the projector 211 described later connected to the viewer terminal 300.

[0064] The voice control program 124 is a program for controlling voices (including music) distributed in events in the virtual space. Specifically, it provides functions such as a playback function of music data 113 and a function of synthesizing the music with the voices uttered by the performer user and distributing it to the administrator terminal 150 and the viewer terminal 300.

[0065] The comment control program 125, in cooperation with the viewer comment control program stored in the viewer terminal 300 described later, provides a function of displaying various comments input by each viewer user on the viewer terminal 300 in the event in the virtual space in chronological order on the performer terminal 200 and the viewer terminal 300.

[0066] The gift control program 126 is a program for controlling gifts given from viewer users to performer users in cooperation with the viewer program stored in the viewer terminal 300 described later. Specifically, it provides functions such as a function for viewer users to purchase gifts (for example, purchase of objects, etc.) based on the information on the purchase unit price set for various gifts stored in the gift data 134, a processing function for viewer users to give the gifts purchased using the object data of the gifts included in the gift data 134 to the performer users (including processing such as effects when giving), and a processing function for changing the owner of the given gift from the viewer user to the performer user, etc.

[0067] The performer user management program 130 provides a management function and an authentication function, etc. for information related to performer users based on the performer user data 131 shown in FIG. 8 stored in the storage 103 together with the performer user management program 130.

[0068] The performer user data 131 used in this embodiment is illustrated in FIG. 8. The performer user data 131 is associated with a performer user ID uniquely assigned to the performer user, and stores various information such as the account (email address) of the performer user, name, authentication information, the file name of avatar data of the avatar used in the virtual space, the file name of the item list in which the owned items are registered, and the like. Although not shown in FIG. 8, information on virtual values such as points owned by each performer user may be stored as the performer user data 131.

[0069] The performer user can be authenticated by verifying the performer user ID, account, and authentication information, and can identify an item (gift) that each performer user has come to own by being given by the viewer from the item list.

[0070] Based on the viewer user data 133 shown in FIG. 9 stored in the storage 103 together with the program, the viewer user management program 132 provides a management function and an authentication function for information related to the viewer user.

[0071] The viewer user data 133 used in this embodiment is illustrated in FIG. 9. The viewer user data 133 is associated with a viewer user ID uniquely assigned to the viewer user, and stores various information such as the account (email address) of the viewer user, authentication information, the file name of avatar data of the avatar used in the virtual space, the owned points which is the number of available points in the virtual space, the file name of the item list in which the items (gifts) purchased using the points are registered, personal information such as name, date of birth, and phone number. Although not shown in FIG. 9, the nickname (comment name) displayed together with the comment is also registered in the viewer user data 133, and the nickname (comment name) is displayed together with the comment. Also, the points can be increased, for example, by purchasing from a predetermined operating company.

[0072] <Performer Terminal> FIG. 4 is a diagram showing a configuration example of the performer terminal 200 in the virtual space content distribution system of the present embodiment. In the present embodiment, as shown in FIG. 11, the performer terminal 200 is provided in an adjustment room adjacent to the studio where the performer user performs acting operations, and uses a normal computer with relatively excellent processing capabilities. As shown in FIG. 4, it includes a processor (CPU) 201 connected to a data bus 208, a memory (RAM) 202, a storage 203 such as a hard disk, a communication interface (I / F) 204 capable of two-way communication by the TCP / IP protocol via the Internet, which is an open computer network, and an image processing unit 206 including a graphics processing unit (GPU) to which display devices A210 to C212 are connected, and an input / output interface (I / F) 205 to which various input / output devices are connected.

[0073] Connected to the input / output interface (I / F) 205 are, as input devices, a motion sensor 220 including a plurality of mounting sensors 220C1 to 220C5 (see FIG. 11) worn by the performer user on the left and right hands, feet, and waist, an expression input device 221 composed of an imaging camera for inputting the expression of the performer's face, a voice input device 222 composed of a sound collecting microphone worn on the head of the performer user, an operation input device 224 such as a keyboard or a touch panel on which an auxiliary operator O for assisting the performer user is operably provided, and the like. Incidentally, as these input devices, by providing a controller that enables various operations to be performed by the performer user holding it, the performer himself / herself may be able to perform various operations without the need for the auxiliary operator O.

[0074] Incidentally, in the present embodiment, in order for the performer user to perform a performance operation (music operation) in accordance with the music, the operation during the performance is assisted by the auxiliary operator O. However, it may be in a form where a plurality of these auxiliary operators O are provided, or the operation content may be set in advance in the performer terminal 200, for example, in a sequence program or the like, so that the auxiliary operator O is not provided.

[0075] The input / output interface (I / F) 205 is connected to an audio output device 223 including a high-function earphone (ear monitor) worn by the performer user as an output device and a speaker arranged in the adjustment room. Thus, the sound of the reproduced music transmitted from the distribution server computer 100 is output to the performer user via the high-function earphone (ear monitor), and the music sound is output from the speaker together with the voice of the performer, so that the auxiliary operator O and the like can confirm the situation of the music including the voice uttered by the performer user in the adjustment room.

[0076] In this embodiment, a high-function earphone (ear monitor) is used to avoid the inconvenience caused by the input of the reproduced music sound from the sound collection microphone worn by the performer user. However, the present invention is not limited to this. As long as the inconvenience caused by the input of the music sound can be avoided, the music sound may be output from a speaker in the studio or the like.

[0077] In this embodiment, the form in which the performer user wears the sound collection microphone is illustrated. However, these sound collection microphones may be of an installation type installed on the floor, wall, or ceiling of the studio.

[0078] Here, the motion sensor 220 used in the performer terminal 300 of this embodiment will be described. Any motion sensor 220 can be used as long as it can appropriately detect (measure) the movement (operation) of the body of the performer user. In this embodiment, a plurality of wearable sensors 220C1 to 220C5 worn on the body by the performer user are used to detect the motion of the performer more accurately and in a short cycle. Note that a motion sensor 220 of a type in which the performer does not wear a device, such as a LiDER using laser light or the like, may be used.

[0079] Further, in this embodiment, in order to reduce the operation burden caused by wearing sensors or the like when the performer user performs a performance operation, particularly the operation burden on the head, the operation of the head of the performer user is detected by image recognition using an image captured by an imaging camera constituting the expression input device 221 as described later. A form in which movements other than the head are detected using five wearable sensors 220C1 to 220C5 is illustrated. However, for example, a wearable sensor may be provided on the head or the like of the performer user, or more (seven or more) wearable sensors may be worn in order to detect more detailed movements.

[0080] As shown in FIG. 11, the wearable sensors 220C1 to 220C5 cooperate with a base station 220a and a base station 220b installed in a studio room that separates adjacent adjustment rooms and glass windows to detect their own positions and orientations.

[0081] As an example, these base stations 220a and 220b can use a multi-axis laser emitter. After emitting a blinking light for synchronization, the base station 220a scans the laser light around, for example, the vertical axis. The base station 220b scans the laser light around, for example, the horizontal axis.

[0082] Each of the wearable sensors 220C1 to 220C5 may include a plurality of optical sensors that detect the incidence of blinking light and laser light from the base station 220a and the base station 220b.

[0083] Each of the wearable sensors 220C1 to 220C5 can detect its own position and orientation based on the time difference between the incidence timing of the blinking light and the incidence timing of the laser light, the light reception time at each optical sensor, the incidence angle of the laser light detected by each optical sensor, and other information as necessary. For example, a ViveTracker provided by HTC CORPORATION or a base station can be preferably used.

[0084] Since base stations 220a and 220b emit blinking light and scan laser light at regular intervals, the detection information of each of the wearable sensors 220C1 to 220C5 is updated for each such interval. Then, the detection information indicating the position and orientation of each motion sensor calculated in each of these wearable sensors 220C1 to 220C5 is input to the performer terminal 200 by short-range wireless communication, and together with the face motion information, it is transmitted as performer avatar information to the distribution server computer 100 (see FIG. 10).

[0085] Note that, in this embodiment, a form using two base stations, base station 220a and base station 220b, is illustrated, but the present invention is not limited to this, and three or more of these base stations may be used.

[0086] Also, a large number of infrared LEDs or visible light LEDs may be mounted on each of a plurality of motion sensors worn by the performer user for the motion sensor 220, and the positions and orientations of each of these motion sensors may be detected by detecting the light from these LEDs with an infrared camera provided on the floor or wall of the studio.

[0087] Further, in order to reduce the burden on the performer user, instead of the wearable sensors 220C1 to 220C5, a motion sensor using a lighter reflective marker may be used for the motion sensor 220. That is, by photographing reflective markers attached to each part of the performer user's body with adhesive tape or the like to generate photographed data and performing image processing on this photographed data to detect the position and orientation of the reflective markers, the motion of the performer user may be detected. In this case, a cameraman for photographing the performer user may be arranged in the studio, and the cameraman may photograph the performer user so that the motion of the performer user can be photographed from a direction suitable for detection, thereby enabling good detection.

[0088] Also, as the motion sensor 220, a suit incorporating an inertial sensor, for example, a suit incorporating an inertial sensor for the MVN motion capture system marketed by Xsens.com, may be used, and the motion of the performer user may be detected by analyzing the sensor signal output from the inertial sensor.

[0089] As the expression input device 221, any device can be used as long as it can appropriately detect the motion of the head including the face of the performer user. In this embodiment, specifically, it is configured by an imaging camera (digital camera) arranged so as to be able to continuously capture an image of the head including the face of the performer user, and the motion of the head and the motion of the face (expression) of the performer user captured by the imaging camera are detected by image recognition, and the information of the face motion, which is the detected motion of the head and the motion of the face (expression), is transmitted to the distribution server computer 100 as performer avatar information together with the information of the body motion as shown in FIG. 10.

[0090] Note that the expression input device 221 is not limited to the imaging camera (digital camera) used in this embodiment. For example, the expression input device 221 may be a 3D camera capable of detecting the depth of a person's face, or for example, a mobile terminal such as a smartphone equipped with a LiDER device may be used. In this case, these mobile terminals may be worn by the performer user.

[0091] In the performer terminal 200 of this embodiment, as described above, it has three display devices A210 to display device C212. As shown in FIG. 11, the display device A210 is a liquid crystal monitor or the like provided in the adjustment room, the display device B211 is a projector that projects an image onto the screen S provided in the studio, and the display device C212 is a vertical large display provided adjacent to the screen S in the studio.

[0092] On the display device A210 placed in the adjustment room of the studio, images from the viewpoints of the virtual cameras C1 to C4, the viewpoint images from the aerial movement virtual camera during the flying effect period described later, the content of the commentary, and a message input window for inputting messages that the assistant operator O wants to convey to the performer user are displayed.

[0093] On the other hand, on the screen S projected from the projector which is the display device B211 provided in the studio, a viewpoint image of the virtual camera C2 (see Fig. 13) which is the viewpoint of the performer, for example, as shown in Fig. 16, an image including the avatars of the viewers virtually participating in the live event in the third area and the fourth area is displayed, so that the performer user can confirm the situation of the viewer users virtually participating in the virtual space live event through the image.

[0094] Also, on the display device C212 provided in the studio, comments from the viewer users, comments and messages input by the assistant operator O, etc. are displayed, so that the performer user can confirm the comments of the viewer users during the performance or the messages from the assistant operator O.

[0095] In the storage 203, in addition to the operation system (OS) for operating the computer which is the performer terminal 200, various functions including the operation control function of the performer avatar 1 by the performer user in the virtual space live event which is virtual space content are provided in cooperation with the distribution server computer 100 by the execution of the processor (CPU) 201 etc., and a performer program is stored.

[0096] As shown in Fig. 4, the performer program includes a performer avatar control program, a performer viewpoint image control program, a performer viewpoint image control program, a performer voice control program, a performer comment control program, performer authentication data, etc.

[0097] The performer avatar control program mainly scans the body motion of the performer user using the motion sensor 220 and scans the face motion (expression) of the performer user using the expression input device 221, and provides a function of generating performer avatar information for operating the performer avatar and transmitting it to the distribution server computer 100.

[0098] The performer perspective video control program is a program that provides a function of generating and outputting a perspective video of a virtual camera C2, which is the performer's perspective, based on the virtual space update data distributed from the distribution server computer 100.

[0099] The performer voice control program outputs the playback sound of a music piece based on the music piece playback data distributed from the distribution server computer 100 via the voice output device 223, digitizes the voice input from the voice input device 222, transmits it as performer voice data to the distribution server computer 100, and provides a function of generating and outputting a monitor voice composed of the playback sound of the music piece and the performer voice.

[0100] The performer comment control program is a program that provides a function of displaying comments and the like by the viewer user distributed from the distribution server computer 100.

[0101] The performer authentication data is data for authenticating that the performer user is the actual person in the communication connection with the distribution server computer 100.

[0102] In addition, the performer avatar control program includes a motion parameter generation program capable of generating parameter information on the positions and rotation angles of bones (bones) that make up rig data (sometimes referred to as "skeleton data") indicating the skeleton of the performer avatar included in the performer avatar data, and an image recognition processing program for image recognition of the position and expression of the head of the performer user from the image captured by the imaging camera.

[0103] In addition, in this embodiment, the performer terminal 200 is a computer that is the performer terminal 200 installed in a studio operated by an event management organization, and when a live event is held with multiple performer users jointly using it, each performer user can use it as the performer terminal 200 of that performer user by inputting performer authentication data. However, the present invention is not limited to this. For example, when a performer user appears in a virtual space live from home or the like, and the performer terminal 200 is a dedicated computer installed by the performer user at home, it may be a form used only by the owning performer user. In such a case, it is not always necessary to store the performer authentication data.

[0104] In this way, by the performer user or the like using the performer terminal 200 that constitutes the virtual space content distribution system of this embodiment, the performer user can operate the performer avatar 1 arranged on the virtual stage G in the event venue in conjunction with his or her own actions, reflect his or her own expression in the expression of the performer avatar 1, and distribute his or her voice as the voice of the performer avatar 1 to the viewers through the distribution server computer 100.

[0105] <Viewer terminal> FIG. 5 is a diagram showing a configuration example of the viewer terminal 300 in the virtual space content distribution system of this embodiment. In this embodiment, the viewer terminal 300 is a smartphone P carried by the viewer user or a stationary normal computer (PC) installed by the viewer user at home or the like. As shown in FIG. 5, a processor (CPU) 301 connected to a data bus 308, a memory (RAM) 302, a storage 303 such as a hard disk or a non-volatile memory, a communication interface (I / F) 304 capable of two-way communication by the TCP / IP protocol via the Internet which is an open computer network, an image processing unit 306 including a graphics processing unit (GPU) to which a display device 310 is connected, and an input / output interface (I / F) 305 to which various input / output devices are connected.

[0106] As will be described later, the display device 310 may be any device that can display each viewpoint video generated based on the virtual space data of the event venue, which is a virtual space updated by the virtual space update data (see FIG. 10) distributed from the distribution server computer 100 by the viewer viewpoint video control program included in the viewer program stored in the storage 303, and the flying viewpoint video distributed from the distribution server computer 100 during the flying effect period described later. When the viewer terminal 300 is the smartphone P, the display of the smartphone P is applicable. When the viewer terminal 300 is a normal computer (PC), the stationary display constituting the computer (PC) is applicable. Note that these displays are not limited to those that display a planar view image (2D image), and may be capable of displaying a stereoscopic view image (3D image) by displaying a right-eye image and a left-eye image, for example, like a head-mounted display (HMD) that the viewer can wear.

[0107] The input / output interface (I / F) 305 is connected to, as an input device, an operation input device 321 composed of one or more devices that enable a viewer to perform various operations, and an audio output device 322 such as earphones or speakers that can output live audio or the like distributed from the distribution server computer 100.

[0108] Needless to say, the audio output device 322 may not be a single device, but may be integrated with the display device 310 like the above-described head-mounted display (HMD).

[0109] The operation input device 321 can use any device as long as it can execute various operations such as operation operations including movement of the viewer avatar, zoom operation, operation related to comments, operation related to gifts, etc. For example, it is composed of at least one or more of a transparent touch panel formed on the display surface of a smartphone, a keyboard constituting a computer, a game controller, etc.

[0110] In addition, in this embodiment, as will be described later, as a viewer, the virtual audience area in the event venue is divided into, for example, as shown in FIG. 13, a third area near the virtual stage G where only viewer users specially permitted by the performer user can virtually participate, and a fourth area around the third area where general viewer users can virtually participate. The viewer user who virtually participates in the fourth area may be the operation input device 321 such as a touch panel, a keyboard, or a game controller as described above. However, the viewer user who virtually participates in the third area is a viewer user who can finely operate the viewer avatar by his / her own actions like the performer user by owning, for example, an MVN motion capture suit incorporating the above-described inertial sensor as the operation input device 321.

[0111] However, even for viewer users who are permitted virtual participation in the third region, they cannot change the expressions of the viewer avatars. However, the present invention is not limited to this, and the expressions of these viewer avatars can be changed, for example, as described above, by having the viewer user use the camera function of a smartphone or a camera connected to a computer to recognize the facial expressions of the viewer user, even at a level different from the change level of the performer user.

[0112] In addition, the various input / output devices connected to these input / output interfaces (I / F) 305 may be built-in or external. In the case of an external device, it may be connected in either a wired or wireless connection form.

[0113] In the storage 303, in addition to an operation system (OS) for operating a smartphone or a computer which is the viewer terminal 300, various functions including a live viewing function regarding the viewer user in the virtual space live which is virtual space content by being executed by a processor (CPU) 301 or the like are stored as a viewer program for providing in cooperation with the distribution server computer 100.

[0114] As shown in FIG. 5, the viewer program includes a viewer viewpoint video control program that provides a function of generating each viewpoint video of the virtual space live to be displayed on the display device 310, a viewer audio control program that provides a function of outputting live audio based on the live audio (data) of the virtual space live distributed from the distribution server computer 100 from the audio output device 322, a viewer comment control program that displays comments based on the comment data distributed from the distribution server computer 100 and provides functions related to comments such as transmitting the comments input by the viewer to the distribution server computer 100, and viewer authentication data for authenticating that the viewer user is the person himself / herself in the communication connection with the distribution server computer 100.

[0115] Although not shown in FIG. 5, in addition to the above-described program, there are a gift control program that controls gifts and object placement in a virtual space, a program for purchasing tickets for virtual participation of viewer avatars in an event, and, as shown in FIGS. 22 and 23, a region designation program for reserving a region (position) where a viewer avatar virtually participates in an event venue in advance before the start of the event. However, other programs may be included in addition to these.

[0116] In this embodiment, the comments input by the viewer are short text messages in text format. However, they are not limited to these short text messages in text format. For example, they may be messages in still image format, messages in video format, and any other electronic messages in other formats. The comments are displayed superimposed on each viewpoint video on the display device 310.

[0117] In this way, by using the viewer terminal 300 used by the viewer user who constitutes the virtual space content distribution system of this embodiment, it is possible to move and operate the viewer avatar virtually participating in the event venue, change the viewpoint video displayed on the display device 310 by changing the viewpoint by the viewer avatar, change the zoom state (state of the viewpoint), and operate the viewer avatar to cheer for the performer avatar 1.

[0118] In the case of a viewer avatar that has virtually participated in the third region, it is only possible to move within the third region and not to move to the fourth region. On the other hand, in the case of a viewer avatar that has virtually participated in the fourth region, it is only possible to move within the fourth region and not to move to the third region. However, the present invention is not limited to this, and in the case of a viewer avatar that has virtually participated in the third region, it may be possible to move to the fourth region. Of course, the viewer avatar cannot move to the virtual stage G or the like, so the visibility of the performer avatar 1 will not be hindered by the movement of the viewer avatar on the virtual stage G.

[0119] In addition, when the perspective video is displayed on these display devices 310 and the live audio is output, the virtual space live can be enjoyed with the feeling of being present at the event venue oneself.

[0120] Also, although detailed description is omitted, by the comment function provided by the viewer comment control program, the virtual space live can be enjoyed while checking the comments input by oneself and other viewer users. Moreover, by the gift function of the gift control program, the virtual space live can be livened up by giving the items one owns to the performer avatar 1.

[0121] <Administrator terminal> FIG. 6 is a diagram showing a configuration example of the administrator terminal 150 in the virtual space content distribution system of the present embodiment. In the present embodiment, the administrator terminal 150 uses a normal computer provided in an adjustment room adjacent to the studio together with the performer terminal 200. As shown in FIG. 6, it has a processor (CPU) 151 connected to a data bus 158, a memory (RAM) 152, a storage 153 such as a hard disk, a communication interface (I / F) 154 capable of two-way communication by the TCP / IP protocol via the Internet which is an open computer network, an image processing unit 156 including a graphics processing unit (GPU) to which a display device 160 is connected, and an input / output interface (I / F) 155 to which various input / output devices are connected.

[0122] As will be described later, the display device 150 is generated based on the virtual space data of the event venue, which is a virtual space updated by virtual space update data (see FIG. 10) distributed from the distribution server computer 100 by the administrator viewpoint video control program included in the administrator program stored in the storage 153. It is configured by one or more stationary displays that can individually display each perspective video of the virtual cameras C1 to C4 and the aerial movement virtual camera during the flying effect period described later, and can also display comments based on the comment data distributed from the distribution server computer 100.

[0123] Connected to the input / output interface (I / F) 155 are, as input devices, an operation input device 161 consisting of one or more devices that enable the administrator K to perform various operations, and an audio output device 162 such as earphones, headphones, or speakers that can output live audio or the like distributed from the distribution server computer 100.

[0124] The operation input device 161 can be any device as long as it enables the administrator K to perform various operations such as input and settings related to the event of the virtual space live. For example, it can be composed of at least one of a keyboard that constitutes a computer, a transparent touch panel formed on the display surface, a viewpoint switching controller, and the like.

[0125] Note that the various input / output devices connected to the input / output interface (I / F) 155 can be in any connection form, either wired or wireless.

[0126] Stored in the storage 153 is an administrator program for providing various functions including a distribution management function related to the distribution of the virtual space live, which is virtual space content, by the execution of the processor (CPU) 151 and the like, in cooperation with the distribution server computer 100, in addition to the operation system (OS) for operating the computer that is the administrator terminal 150.

[0127] As shown in FIG. 6, the program for the administrator includes a program for controlling the administrator's perspective video, a program for controlling the administrator's audio, a program for controlling the administrator's comments, a program for managing viewers, a program for managing performers, and the like.

[0128] The program for controlling the administrator's perspective video is a program that provides a function of generating perspective videos from each virtual camera to be displayed on the display device 160 and a function of changing and switching each perspective.

[0129] The program for controlling the administrator's audio is a program that provides a function of outputting live audio from the audio output device 162 based on the audio data of the virtual space live distributed from the distribution server computer 100.

[0130] The program for controlling the administrator's comments is a program that displays comments based on the comment data distributed from the distribution server computer 100 and provides functions related to comments such as prohibiting distribution and selecting viewers so that they are not distributed.

[0131] The viewer management program is a program for managing viewer users who virtually participate in the virtual space live, and the performer management program is a program for managing performer users who virtually participate in the virtual space live.

[0132] Although not shown in FIG. 6, it includes an authentication program for authenticating whether the administrator, who is the operator, is the person himself / herself, a schedule program for editing the time schedule, music order, etc. of the virtual space live, and other programs may be included.

[0133] In this way, by the administrator K operating the administrator terminal 150 that constitutes the virtual space content distribution system of this embodiment, various settings for executing events can be carried out, for example, settings related to programs, music order, production, time schedule, the trajectory of the virtual camera moving in the air during the flying production period, etc. And based on the content set in this way, the virtual space live is managed.

[0134] <Overall image of the virtual space> Hereinafter, as an example of content, content in which a live event is performed by a performer in a virtual live venue will be described. An overall image of the virtual space provided by the system of this embodiment is shown in FIG. 12. The virtual space ER of this embodiment includes a plurality of types of space areas ER (space area ER1, space area ER2...). In each space area ER, it is possible to provide content with different genres and types. As the plurality of types of space areas ER, for example, an entrance that functions as a lobby when a user logs in to the virtual space ER, a live venue, game content, an exhibition hall, and other areas corresponding to each of various contents are provided. Note that various areas may be selectable from the title screen displayed when the user logs in to the virtual space ER. The event venue described later using FIGS. 13, 24, and 25 is constructed in the whole of a predetermined space area ER or a part of a predetermined space area ER.

[0135] Each spatial area ER is provided with a plurality of rooms where the same content is provided. Each room has a determined maximum number of people who can enter the room, for example, it can accommodate up to 200 people. Each room is managed, for example, by a real-time synchronization server. Users who have entered the same room can view each other's user avatars and communicate with each other. For example, they can play games together or have conversations through chat, etc. For example, if the spatial area ER1 is a space imitating a city, in the rooms ER1a, ER1b... corresponding to the spatial area ER1, a space imitating the same city is provided to users, but the avatars that can be displayed within the space are only the user avatars corresponding to the users associated with the same room. For example, the user avatar 1 of the user associated with room ER1a is not displayed on the user screen of the user associated with room ER1b. However, exceptionally, for the user avatars of special users (for example, talents, etc.), it is possible to make them displayed not only in the room where they actually enter but also in other rooms (also called mirroring).

[0136] The movement between the respective spatial areas ER may be such that it is not possible to move to other spatial areas ER unless it is via a spatial area ER defined as an area (for example, an entrance) that provides specific content after the user logs in to the virtual space, or it may be possible to move back and forth between them. For example, it may be such that it is not possible to move from spatial area ER2 to spatial area ER3 without passing through spatial area ER1, or it may be possible to move directly back and forth between spatial area ER2 and spatial area ER3 without passing through spatial area ER1. Also, when moving between spatial areas ER, a switching effect may be performed. For example, when moving to another spatial area ER, the display screen may fade to black (for example, a screen where a message such as "Loading..." is displayed on a black screen) and then switch. Also, regarding the user's access to each spatial area ER, it may be such that the user first enters the entrance area after logging in, or there may be cases where the user can select and enter a preferred spatial area ER without passing through the entrance area, or it may be possible to transition to a randomly determined spatial area ER by lottery. For each room as well, the user may select and enter a preferred room, or may enter a randomly determined room by lottery.

[0137] <Virtual live venue> The virtual live venue, which is the virtual space used in this embodiment, is shown in FIG. 13. The virtual live venue shown in FIG. 13 is constructed in a predetermined spatial area ER among the spatial areas ER shown in FIG. 12. As shown in FIG. 13, the virtual live venue is a virtual space that, similar to a live venue in the real space, has a virtual stage G where a performer user appears as a performer avatar 1 and a virtual audience area where viewer users who are the audience virtually participate as viewer avatars.

[0138] As shown in FIG. 13, the virtual stage G has a trapezoidal floor surface with a relatively large area. Similar to the live venue in the real space, the performer avatar 1 can move on the virtual stage G. As shown in FIG. 13, on the side opposite to the virtual audience direction of the virtual stage G, a virtual stage wall divided into three parts, i.e., a central part, a right side part, and a left side part, is formed. On the front surfaces of these virtual stage walls, virtual displays 40, 41, and 42 are provided, and performance images and videos are virtually displayed on the virtual displays 40, 41, and 42.

[0139] In addition, between the virtual displays 40, 41, and 42, a virtual arrangement object 43 of stars related to the performer user is arranged. In the second area, which is an area on the virtual stage G above the first area surrounded by the virtual stage wall, as shown in FIG. 13, large virtual aerial objects 50 to 52 of stars are arranged. The virtual aerial objects 50 to 52 can move within the second area.

[0140] In front of the virtual stage G, a virtual audience area is provided where viewer users can virtually participate in the virtual live venue as viewer avatars. As shown in FIG. 13, this virtual audience area includes a third area, which is a special area close to the center of the virtual stage G where the performer avatar 1 takes the stage, and a fourth area formed to surround the third area and having a greater distance from the center of the virtual stage G than the third area.

[0141] In these third areas, within a predetermined upper limit number range, special viewer users who are permitted virtual participation can virtually participate. In this embodiment, as shown in FIG. 13, for example, viewer avatars 11 to 14 of four viewer users who meet a predetermined virtual participation record and are permitted virtual participation by the performer user are arranged.

[0142] In the fourth region, viewer avatars 21 to 32 of general viewer users who reserved virtual participation before the start of the virtual space live are arranged. In FIG. 13, the viewer avatars 21 to 32 are shown in a simplified manner for convenience, but they are the same avatars as the viewer avatars 11 to 14.

[0143] Each of the viewer avatars 11 to 14 arranged in the third region can move within the third region by the viewer user operating the viewer terminal. Similarly, each of the viewer avatars 21 to 32 arranged in the fourth region can move within the fourth region by the viewer user operating the viewer terminal.

[0144] In the virtual live venue, as shown in FIG. 13, four virtual cameras C1 to C4 are virtually arranged (set). The virtual camera C1 is a virtual camera that is virtually arranged in front of the performer avatar 1 so as to face the performer avatar 1. The viewpoint video by the virtual camera C1 is, as shown in FIG. 14(a), a viewpoint video of seeing the performer avatar 1 from a position near the front.

[0145] The virtual camera C2 is a camera that is virtually arranged above the performer avatar 1. The viewpoint video by the virtual camera C2 is, as shown in FIG. 16, a performer's viewpoint video of seeing the virtual audience area from the performer avatar 1.

[0146] The virtual camera C3 is a virtual camera that is virtually arranged on the virtual display 41 diagonally behind the performer avatar 1. The viewpoint video by the virtual camera C3 is, as shown in FIG. 14(c), a viewpoint video of seeing the virtual audience area from diagonally behind the performer avatar 1.

[0147] The virtual camera C4 is a virtual camera that is virtually arranged on the virtual display 42 diagonally behind the performer avatar 1. The viewpoint video by the virtual camera C4 is, as shown in FIG. 14(b), a viewpoint video of seeing the virtual audience area from diagonally behind the performer avatar 1.

[0148] In addition, in this embodiment, in addition to the virtual cameras C1 to C4 that are fixedly arranged (set), an airborne virtual camera (not shown) that is set to be able to move in the air within the space of the virtual live venue, which is a virtual space, is virtually arranged. The aerial trajectories along which these airborne virtual cameras move and the viewing directions (angles) at individual positions on the aerial trajectories are preset by the administrator terminal 150. During the flying effect period described later, the performer avatar 1 virtually flies so as to follow the aerial trajectory of the airborne virtual camera, and a viewpoint video capturing the virtually flying performer avatar 1 with the airborne virtual camera is generated.

[0149] In addition, in this embodiment, as shown in FIG. 13, an example is illustrated in which four virtual cameras C1 to C4 are virtually arranged as fixedly arranged (set) virtual cameras. However, the present invention is not limited to this, and the number of these fixedly arranged (set) virtual cameras may be five or more. Conversely, without providing fixedly arranged (set) virtual cameras, only the viewpoint videos seen from the viewpoints corresponding to the respective avatars virtually participating in the virtual live venue may be displayed on the performer terminal 200 and the viewer terminal 300.

[0150] In addition, in this embodiment, an example is illustrated in which there is one airborne virtual camera. However, the present invention is not limited to this, and a form in which there are a plurality of these airborne virtual cameras may be used. Conversely, a form in which no airborne virtual camera is virtually arranged may also be used.

[0151] <Studio> FIG. 11 is a diagram showing the studio used in this embodiment. In the studio, an adjustment room separated by a glass window is provided adjacent as described above. The performer user performs each operation corresponding to singing in the studio, and the auxiliary operator O assists in operating the performer terminal 300 installed in the adjustment room. Around the performer user wearing the mounting sensors 220C1 to 220C5, the base station 220a and the base station 220b are mounted and arranged on the stand, and at a position almost directly in front of the performer user, an imaging camera constituting the expression input device 221 is mounted and arranged on the stand.

[0152] A screen S is provided on the wall surface where the performer user confronts within the studio, and the perspective video of the virtual camera C2 is projected onto the screen S from the projector (display device B211) arranged on the ceiling of the studio. As shown in FIG. 16, the perspective video seen from the performer avatar 1 of the virtual audience area is displayed on the screen S. The performer user can proceed with the live while sequentially grasping the state of the viewer avatars virtually participating in the virtual audience area (the reactions of the viewers to the live).

[0153] Also, a vertical large display as the display device C212 is arranged at the side position of the screen S, and comments of the viewers and messages that the assistant operator O wants to convey to the performer user are displayed on the large display. Incidentally, lyrics of the song that the performer sings during the live, information such as lines (performer support information) may be displayed on the display device C212.

[0154] <Operation of the virtual space content distribution system> FIG. 10 is an explanatory diagram for explaining the operation of the virtual space content distribution system of the present embodiment, specifically, the flow in which the video and audio of the virtual live are distributed.

[0155] First, the video system will be described. As described above, the distribution server computer 100 can provide the virtual space of the virtual live venue based on the virtual space generation program 120 and avatar data of the performer user and viewer users. The operation state of each avatar of these performer users and viewer users is updated by the virtual space data in which the state of the virtual space is described by the performer avatar information transmitted from the performer terminal 200 and the viewer avatar information transmitted from the viewer terminal 300. Thus, the operation of the performer user is reflected in the operation of the performer avatar 1, and the operation (operation) of the viewer user is reflected in the operation of the viewer avatar.

[0156] Although not shown in FIG. 10, the performer terminal 200 and the viewer terminal 300 are communicatively connected to the distribution server computer 100 to virtually participate in the virtual space live. Along with this, virtual space data of the virtual live venue is pre-distributed and stored from the distribution server computer 100. As described later, the virtual space data pre-stored in this way is sequentially updated by virtual space update data sequentially distributed from the distribution server computer 100, so that the latest state of the virtual live venue can be specified by the performer terminal 200 and the viewer terminal 300.

[0157] Specifically, the actions and expressions of the performer user in the studio described above are scanned at predetermined time intervals by the functions of body motion scanning and face motion scanning by the performer avatar control program described above, and performer avatar information is generated and transmitted to the distribution server computer 100.

[0158] On the other hand, viewer users permitted to virtually participate in the third region use a motion sensor like the performer, so they are scanned at predetermined time intervals by the functions of body motion scanning and face motion scanning, and viewer avatar information is generated and transmitted to the distribution server computer 100.

[0159] In addition, viewer users permitted to virtually participate in the fourth region can perform various operations such as movement operations, viewpoint direction change operations, viewing situation (zoom) change operations, raising hand operations, clapping hand operations, jumping operations, etc. using the touch panel, keyboard, or controller of the viewer terminal 300, thereby making the avatar of the viewer perform corresponding actions. Then, based on the operations related to the actions of the viewer avatar among these operations, viewer avatar information is generated and transmitted to the distribution server computer 100.

[0160] Based on the performer avatar information transmitted from the performer terminal 200 and the viewer avatar information transmitted from the viewer terminal 300 in this way, the distribution server computer 100 executes a virtual space update process for updating the virtual space data, thereby reflecting the actions (operations) of the performer user and the viewer user on each avatar virtually participating in the virtual live venue.

[0161] Then, after executing a virtual space update data generation process for generating virtual space update data based on the virtual space data before the update and the virtual space data after the update, the generated virtual space update data is distributed to the performer terminal 200 and the viewer terminal 300.

[0162] In the performer terminal 200 and the viewer terminal 300 to which the virtual space update data is distributed, as shown in FIG. 10, based on the distributed virtual space update data, the pre-stored virtual space data is updated, and by executing a performer viewpoint video generation process and a viewer viewpoint video generation process using the updated virtual space data, a performer viewpoint video and a viewer viewpoint video based on the updated virtual space data are generated, and the generated performer viewpoint video and viewer viewpoint video are displayed on the performer terminal 200 and the viewer terminal 300 (viewer viewpoint video output process).

[0163] In this way, in this embodiment, the viewpoint videos of each viewer user who is virtually participating in the virtual live venue by the viewer avatar are generated and displayed on the viewer terminal 300 side of each viewer user, so that the processing load of the distribution server computer 100 is significantly increased by generating the viewer avatar viewpoint videos of these viewer users by the distribution server computer 100, and it is possible to avoid the situation where many viewer users cannot participate in the virtual space live, and it is also possible to avoid the situation where distribution becomes difficult due to an increase in the processing load.

[0164] In this embodiment, on the display device 310 of the viewer terminal 300 of the viewer user of the viewer avatar 13 virtually participating in the third region close to the performer avatar 1 on the virtual stage G, as shown in FIG. 14(d), a viewpoint video is generated and displayed in which the substantially front view of the performer avatar 1 as seen from the viewer avatar 13 close to the performer avatar 1 is largely displayed. On the other hand, in the fourth region far from the performer avatar 1 on the virtual stage G, for example, in the display device 310 of the viewer terminal 300 of the viewer user of the viewer avatar 28 virtually participating at a position behind the viewer avatar 13, as shown in FIG. 14(e), a viewpoint video is displayed in which the substantially front view of the performer avatar 1 appears relatively small through the viewer avatar 13 and the viewer avatar 14 virtually participating in the third region, which is a viewpoint video as seen from the viewer avatar 28 far from the performer avatar 1.

[0165] Also, on the display device 310 of the viewer terminal 300 of the viewer user of the viewer avatar 32 virtually participating at the end side position of the virtual stage G in the fourth region set in a U-shaped top view, as shown in FIG. 14(f), a viewpoint video is displayed in which the performer avatar 1 appears relatively small through the viewer avatar 14 virtually participating in the third region, which is a viewpoint video as seen from the viewer avatar 32 at the diagonally forward position of the performer avatar 1.

[0166] Note that the display examples shown in FIG. 14 all illustrate the case where the viewer terminal 300 is a stationary computer (PC) and the display device 310 is a stationary display. However, for example, when the viewer terminal 300 is a smartphone P or a tablet, etc., in the case of the viewpoint video of the virtual camera C1, it is displayed as shown in FIG. 15(a), and when the viewer terminal 300 is the viewer terminal 300 of the viewer avatar 13, it is displayed as shown in FIG. 15(b).

[0167] Next, the audio system will be described. In the distribution server computer 100, music data 113 is reproduced by the audio control program 124 based on the time schedule data (TS data) 112, and is transmitted to the performer terminal 200 as the reproduced music (data) (music reproduction process).

[0168] At the performer terminal 200, the music audio from the reproduced music (data) transmitted from the distribution server computer 100 is output to the performer user through the high - performance earphone (ear monitor) worn by the performer user (reproduced music output process). Along with this, as the performer user sings in accordance with the output reproduced music, the performer voice input from the sound - collecting microphone (voice input device 222) is digitized and transmitted to the distribution server computer 100 as the performer voice (data).

[0169] The distribution server computer 100 generates distribution audio (data) from the performer voice based on the performer voice (data) received from the performer terminal 200 and the reproduced music reproduced in the above - mentioned music reproduction process (distribution audio generation process), and distributes the generated distribution audio (data) to the viewer terminal 300 (generated audio distribution process).

[0170] At the viewer terminal 300, the distribution audio is output from the audio output device 322 such as an earphone or a speaker by the distribution audio (data) distributed from the distribution server computer 100, so that the viewer can listen to the live audio as if the performer avatar 1 is singing in a virtual live venue.

[0171] In addition, at the performer terminal 200, as described above, the performer voice (data) is transmitted to the distribution server computer 100, and as shown in FIG. 10, by executing the monitor voice generation process and the monitor voice output process, the music audio of the reproduced music and the performer voice are output from the speaker arranged in the adjustment room, so that the auxiliary operator O and others can confirm the singing situation of the performer user in the adjustment room.

[0172] <Viewer Perspective Video Control Process> Next, the viewer perspective video control process executed on the viewer terminal 300 based on the viewer perspective video control program included in the viewer program will be described with reference to FIG. 21.

[0173] In the viewer perspective video control process, first, it is determined whether or not the performer avatar 1 is in the flying production period of virtual flight as shown in FIG. 20 (step S1). Whether or not it is in the flying production period can be specified by production state data indicating that it is in the flying production period from the distribution server computer 100. Note that the distribution server computer 100 transmits production state data indicating that it is in the flying production period to the viewer terminal 300 when it is in the flying production period based on the time schedule data.

[0174] If it is in the flying production period (Y in step S1), the process proceeds to step S21. On the other hand, if it is not in the flying production period (N in step S1), it is determined whether or not viewpoint-related operations including a viewpoint movement operation (including a change in viewpoint by an avatar movement operation or an action operation) and a zoom operation are disabled (step S2).

[0175] If the viewpoint-related operations are disabled (Y in step S2), the process proceeds to step S7. If the viewpoint-related operations are not disabled (N in step S2), it is determined whether or not there is an operation that changes the viewpoint such as an avatar movement operation or an action operation (step S3). If there is an operation (Y in step S3), the viewer viewpoint is changed according to the operation. If there is no operation (N in step S3), the process proceeds to step S5 and it is determined whether or not there is a zoom operation (step S5).

[0176] If there is a zoom operation (Y in step S5), the video area displayed on the display device 310 is changed to the video area corresponding to the operation. If there is no zoom operation (N in step S5), it is determined whether or not there is motion following setting (step S7).

[0177] This operation following setting can be arbitrarily set on the viewer terminal 300, for example, before or during the live broadcast, according to the type of device used by the viewer user and their proficiency in operations. Specifically, for example, when not accustomed to operating an operation input device 321 such as a touch panel, keyboard, game controller, etc., or when not accustomed to changing the viewpoint by moving or operating the avatar, as will be described later, the virtual participation position of the viewer's own avatar is far from the performer avatar 1 and is enlarged and displayed in a zoomed-in state. Even with a slight movement of the performer avatar 1, the performer avatar 1 may not be properly displayed, etc. It is set in cases where the viewpoint cannot be changed well in response to the movement or operation of the performer avatar 1.

[0178] If there is no operation following setting (N in step S7), the process proceeds to step S11. On the other hand, if there is an operation following setting (Y in step S7), it is further determined whether the operation following condition is satisfied (step S8).

[0179] In this embodiment, the operation following condition is defined as a condition under which it is almost certain that the performer avatar 1 is not properly displayed on the display device 310. Specifically, when the head (or face) of the performer avatar 1 enters a predetermined range near the periphery of the display area of the display device 310, since the possibility that the head (or face) moves outside the display area and is no longer properly displayed due to the movement or operation of the performer avatar 1 is extremely high, it is determined that the operation following condition is satisfied.

[0180] Thus, in this embodiment, by determining that the motion tracking condition is satisfied before the head (face) of the performer avatar 1 disappears from the display area, it is possible to significantly reduce the situation where the head (face) of the performer avatar 1 disappears from the display area. However, the present invention is not limited to this. These motion tracking conditions may be based on the condition that the head (face) has moved outside the display area, or other conditions may be used as the motion tracking conditions. That is, as long as these motion tracking conditions can prevent the performer avatar 1 from being poorly displayed in the display area, any conditions can be used.

[0181] When the motion tracking condition is satisfied (Y in step S8), after invalidating the viewpoint-related operation (step S12), as the viewpoint video displayed in the display area of the display device 310, the viewpoint is automatically changed to the motion tracking viewpoint where the head (face) of the performer avatar 1 is within the non-establishment range surrounded by a predetermined range around the display area, and the viewpoint video seen from the motion tracking viewpoint is displayed in the display area of the display device 310 (step S13).

[0182] On the other hand, when the motion tracking condition is not satisfied (N in step S8), it is further determined whether the viewpoint-related operation has been invalidated (step S9). If the viewpoint-related operation has been invalidated (Y in step S9), the invalidated viewpoint-related operation is enabled (step S10) and then proceed to step S11. If the viewpoint-related operation has not been invalidated (N in step S9), it proceeds to step S11 without passing through step S10.

[0183] In step 11, due to the motion tracking setting not being set or the motion tracking condition not being satisfied, the viewpoint video of the viewer avatar continues to be displayed in the display area of the display device 310 (step S11).

[0184] Also, as described above, when it becomes the flying effect period in which the performer avatar 1 virtually flies during the live performance, it is determined as Y in step S1 and proceeds to step S21, and it is determined whether it is the start timing of the flying effect period (step S21).

[0185] If it is the start timing of the flying effect period (Y in step S21), instead of the viewer avatar's viewpoint video or the motion-following viewpoint video that was being displayed in the display area of the display device 310 before the start of the flying effect period, a flying viewpoint video distributed from the distribution server computer 100 is displayed (step S22), and then, the viewpoint-related operation is invalidated (step S23), and it returns to step S1.

[0186] Note that in this embodiment, during the flying effect period, since the same flying viewpoint video is displayed on the viewer terminals 300 of all viewer users, instead of generating the flying viewpoint video on each viewer terminal 300 side like different viewer avatar viewpoint videos for individual viewer users, it is generated on the distribution server computer 100 side and distributed to the viewer terminals 300, so that even for a viewer terminal 300 with low processing power, a flying viewpoint video with a large drawing load due to the aerial movement of the viewpoint can be displayed well. However, the present invention is not limited to this, and these flying viewpoint videos may be generated on each viewer terminal 300 side in the same way as the viewer avatar viewpoint videos.

[0187] On the other hand, if it is not the start timing of the flying effect period (N in step S21), it is further determined whether it is the end timing of the flying effect period (step S24).

[0188] Whether it is the end timing of the flying effect period may be specified based on the data indicating the end included in the data of the flying viewpoint video transmitted from the distribution server computer 100, or may be specified by the above-described effect state data different from the flying viewpoint video.

[0189] If it is not the end timing of the flying effect period (N in step S24), that is, if it is during the flying effect period, the process proceeds to step S26. After updating the flying perspective video, the process returns to step 1. On the other hand, if it is the end timing of the flying effect period (Y in step S24), after enabling the viewpoint-related operation (step S25), the process proceeds to step S11. Instead of the flying perspective video that was displayed in the display area of the display device 310 during the flying effect period, the perspective video of the viewer avatar is displayed in the display area of the display device 310, and then the process returns to step 1.

[0190] In this way, by executing the viewer perspective video control process shown in FIG. 21 in the viewer terminal 300 of this embodiment, each perspective video displayed on the viewer terminal 300 will be described with reference to FIGS. 17 to 20.

[0191] FIG. 17 is a diagram showing the display content of the display device 310 when a zoom operation is performed on the viewer terminal 300 of this embodiment. In the default state where no zoom operation is performed, as shown in FIG. 17(a), the perspective video of the video area centered on the upper body of the performer avatar 1 is displayed. In this default state, if the viewer user performs a zoom-in operation, for example, if the viewer terminal 300 is a smartphone P, an operation of touching the display of "+" (not shown), or if the viewer terminal 300 is a computer (PC), when the "+" key on the keyboard is operated, for example, as shown in FIG. 17(b), the perspective video of the video area centered on the head (face) of the performer avatar 1 is displayed.

[0192] On the other hand, if the viewer user performs a zoom-out operation, for example, if the viewer terminal 300 is a smartphone P, an operation of touching the display of "-" (not shown), or if the viewer terminal 300 is a computer (PC), when the "-" key on the keyboard is operated, for example, as shown in FIG. 17(c), the perspective video of the video area including the entire body of the performer avatar 1 is displayed.

[0193] Furthermore, in FIG. 17, for the sake of easier understanding of the zoom function, the explanation was given using the perspective video of the virtual camera C1 instead of the perspective of the viewer avatar. However, as shown in FIG. 18, zooming in and zooming out can also be performed in the same way for the perspective of the viewer avatar.

[0194] Also, in the viewer perspective video control process of FIG. 21, although not described in detail, for example, when the live broadcast starts and the performer avatar 1 makes its first appearance on the virtual stage G, since the perspective of the viewer avatar is not facing the performer avatar 1, there is a possibility that the period during which the appearing performer avatar 1 is not displayed on the viewer terminal 300 becomes long. Thus, the period when the performer avatar 1 first appears, etc. is set as the appearance performance period, etc. During these performance periods, the perspective video displayed on the viewer terminal 300 is automatically switched to the perspective video of the virtual camera C1, etc. instead of the perspective video of the viewer avatar, and zooming in, etc. can also be made possible for each viewer user to execute in these perspective videos of the virtual camera C1.

[0195] FIG. 18 shows, as an example of the perspective video of the viewer avatar, the perspective video of the viewer avatar 28 who virtually participates in the fourth area. As shown in FIG. 18, the perspective video of the viewer avatar 28 includes the heads of the viewer avatars 13 and 14 who virtually participate in the third area, and it becomes a video of seeing the performer avatar 1 over the heads of these viewer avatars 13 and 14.

[0196] Therefore, the viewer user of the viewer avatar 28 can enjoy the live broadcast by, for example, performing a zoom-in operation to change to a video area where the upper body of the performer avatar 1 is centrally displayed as shown in FIG. 18(b), so that the viewer avatars 13 and 14 are not displayed.

[0197] However, as shown in Fig. 18(b), when zoomed in, for example, if the live event progresses and the performer avatar 1 moves or makes large movements, and the viewer user cannot properly change the viewpoint of the viewer avatar 28 in accordance with the movements of these performer avatars 1, as shown in Figs. 19(d) to (f), there may be a situation where the performer avatar 1 is not displayed well. Therefore, by paying attention to the operation of the viewpoint, it becomes difficult to concentrate on the live event, and there may be a case where the live event cannot be enjoyed well.

[0198] However, in this embodiment, as described above, when the viewer user performs the motion tracking setting, as shown in Figs. 19(a) to (c), the motion tracking condition is satisfied when the head of the performer avatar 1 enters a predetermined area around the display area, and the viewpoint is automatically changed to the motion tracking viewpoint, and the viewpoint video of the motion tracking viewpoint is displayed. Therefore, the viewer user does not need to pay attention to the operation of the viewpoint, so that the viewer can concentrate on the live event and enjoy the live event well.

[0199] And when the live event progresses to the flying performance period, as shown in Fig. 20, the viewpoint video of each viewer avatar is automatically changed to the flying viewpoint video seen from the aerial movement virtual camera without the viewer user operating.

[0200] Specifically, before the performer avatar 1 makes a virtual flight, a video in which the object of the wings becomes large on the back of the performer avatar 1 is displayed. Then, by having the performer avatar 1 look up at the virtual aerial object 50 of the star that is virtually arranged in the second area of the virtual live venue, the viewpoint of the viewer avatar also moves in the same way. At this time, a light effect 61 appears around the performer avatar 1.

[0201] After that, when the performer avatar 1 moves to virtual flight, the viewpoint video displayed on the display device 310 automatically switches from the viewpoint video of the viewer avatar up to Fig. 20(b) to the flying viewpoint video seen from the aerial movement virtual camera as shown in Fig. 20(c).

[0202] And during the flying performance period, as described above, the virtual camera moving in the air moves within the second area based on a preset air trajectory, and the flying perspective video seen from these virtual cameras moving in the air is displayed on the display device 310 as shown in FIG. 20(d).

[0203] Note that the specific configuration is not limited to the above-described embodiments, and even if there are changes or additions without departing from the gist of the present invention, they are included in the present invention.

[0204] For example, in the above embodiment, the viewer avatar is exemplified in a form that can freely move within the third area or the fourth area where the virtual participation is taking place. However, in this case, for example, there may be problems such as errors in the virtual space data occurring due to virtual collisions or overlaps at the same virtual position between different viewer avatars participating in the fourth area.

[0205] In order to solve such problems, for example, it may be configured as shown in the modified examples shown in FIGS. 22 and 23. Specifically, the third area and the fourth area are divided into fine areas as shown in FIG. 22, and which of these areas to participate in the virtual live is received in advance from the viewer user before the live starts as shown in FIG. 23. When the viewer user participates virtually as a viewer avatar, participation is possible only in the area selected in advance, and by restricting movement only within the selected area, it is possible to prevent errors in the virtual space data from occurring due to virtual collisions or overlaps at the same virtual position between viewer avatars.

[0206] Also, when allowing each viewer user to pre-select the virtual participation position of the viewer avatar as described above, for example, for viewer users who select the area A1 to C6 on the right side towards the virtual stage G in the fourth area, as the viewpoint video during the flying effect period, a viewpoint video from the position in front of the right side of the virtual flying performer avatar 1 is generated and displayed. For viewer users who select the area D4 to H6 in the center towards the virtual stage G in the fourth area, as the viewpoint video during the flying effect period, a viewpoint video from the position in front of the center of the virtual flying performer avatar 1 is generated and displayed. For viewer users who select the area I1 to K6 on the left side towards the virtual stage G in the fourth area, as the viewpoint video during the flying effect period, a viewpoint video from the position in front of the left side of the virtual flying performer avatar 1 is generated and displayed. According to the position selected by the viewer user, the viewpoint video in the virtual flight, which is a special action, may be made to be the viewpoint video corresponding to the position (area) selected by each viewer user.

[0207] In the above embodiment, the form of generating and displaying the viewpoint video from the viewer avatar on the viewer terminal 200 side is exemplified, but the present invention is not limited to this. For example, in the case of a live event with few virtual participants, the viewpoint video from the viewer avatar may also be generated and distributed on the distribution server computer 100 side. Also, the viewer user may be able to select whether to generate on the viewer terminal 200 side or on the distribution server computer 100 side according to the processing ability and data communication environment of the terminal they own. Or the distribution server computer 100 may identify the processing ability of the viewer terminal 200 connected by communication and determine whether to generate on the viewer terminal 200 side or on the distribution server computer 100 side based on the identified processing ability.

[0208] In the above-described embodiment, the distribution server computer 100 is exemplified as being installed in a studio operated by an event management organization that hosts a virtual space live event. However, the present invention is not limited to this. As these distribution server computers 100, a server computer owned by a company that lends out server computers in a data center or the like may be used, or as described above, a server computer provided by a cloud service may be used. The installation form of these server computers may be any form as long as the functions of the distribution server computer 100 can be obtained.

[0209] In the above-described embodiment, the form in which a performer user performs singing and stage performance actions alone is exemplified. However, the present invention is not limited to this. These performer users may be a group consisting of a plurality of people. When performing a virtual space live event in a group consisting of a plurality of people, a plurality of people may share one performer terminal 200, or each member of the group may be provided with a performer terminal 200. Incidentally, when the performer user is a group consisting of a plurality of members, for example, by executing the viewpoint following target person designation process on at least one of the distribution server computer 100 and the viewer terminal 300, the viewer user may be able to select the member to be the target of following the viewpoint.

[0210] In the above-described embodiment, the singer who performs singing and the actor who performs stage performance actions may be separate individuals. In this case, the performer terminal of the singer and the performer terminal of the actor may be separate, and the singer may sing at a location other than the studio where the actor performs stage performance actions.

[0211] In the above-described embodiment, the Internet is exemplified as the computer communication network that connects the distribution server computer 100, the administrator terminal 150, the performer terminal 200, and the viewer terminal 300. However, the present invention is not limited to this, and these communication networks may be configured by a local area network capable of data communication only within a specific area, or may include a local area network or local data communication in part thereof.

[0212] Also, in the above-described embodiment, at the time of distributing the virtual space live, the performer user executes singing or singing actions (performance actions) in real time, so that the performer user can proceed with the live while confirming the reactions of viewer users virtually participating in the virtual space live. However, the present invention is not limited to this, and the singing or singing actions (performance actions) of the performer user are not in real time, but rather, singing or singing actions (performance actions) are executed in advance, and the voices of these songs or singing actions (performance actions) are recorded in the distribution server computer 100 as performer avatar information, and the virtual space live may be held by playing back the recorded singing voices and singing actions (performance actions) according to the progress of the live.

[0213] Alternatively, instead of the singing or singing actions (performance) of the performer user, singing or singing actions (performance actions) by a virtual performer created by computer graphics or the like are recorded in the distribution server computer as performer avatar information, and the virtual space live may be held by playing back the recorded singing voices and singing actions (performance actions) according to the progress of the live.

[0214] Thus, in the case of performing singing or singing actions (performance actions) in advance, recording the performer avatar information on the distribution server computer 100, and playing it back to distribute a virtual space live, the configuration of the virtual space content distribution system at the time of distribution is composed of the distribution server computer 100, the administrator terminal 150, and the viewer terminal 200, and does not include the performer terminal 200 which is a performer user terminal available to a performer user who performs an operation of operating the performer avatar 1 in the virtual space.

[0215] Also, in the above embodiment, the form in which the viewer terminal 300 is a smartphone P or a computer (PC) is exemplified, but the present invention is not limited to this, and these computers may be portable notebook computers, tablet terminals, e - book readers, wearable computers, game consoles, and various other information processing devices capable of outputting at least 2D video and audio.

[0216] Also, in the above embodiment, the form in which the performer user performs a performance including singing in a studio is exemplified, but the present invention is not limited to this. For example, the performer user may use the performer terminal 200 installed at home or the like to appear in a virtual space live from home or the like.

[0217] In the above - described embodiment, a virtual space live is exemplified as the virtual space content, but the present invention is not limited to this. These virtual space contents may be, for example, a fan meeting where the performer user gathers with his or her fans, a talk session, etc., which are contents beneficial to the viewer user, and any content may be used as long as it is content related to a virtual space in which the performer avatar 1 and the viewer avatar virtually participate.

[0218] In the above-described embodiments, the general operation (first operation) is an operation in which the performer avatar 1 stands without moving to the virtual stage G, the special operation (second operation) is an operation in which the performer avatar 1 performs virtual flight, and the specific operation (third operation) is an operation in which the performer avatar 1 makes a sudden lateral movement. However, the present invention is not limited to this, and the operation may be an operation according to the content to be distributed. For example, the general operation (first operation) may be an operation (normal operation) that the performer avatar executes for the longest period in the content to be distributed. The special operation (second operation) may be an operation executed in a special period that is the shortest period or an operation with the lowest frequency in the content to be distributed. The specific operation (third operation) may be an operation whose execution period is shorter than that of the general operation (first operation) but longer than that of the special operation, or an operation whose execution frequency is lower than that of the general operation (first operation) but higher than that of the special operation. Note that the special operation (second operation) may include the specific operation (third operation).

[0219] In the above-described embodiments, an example is given of a form having both functions, that is, a switching function to a viewpoint corresponding to the special operation (second operation) and a following function following the specific operation (third operation). However, the present invention is not limited to this, and it may be a virtual space content distribution system having only one of these functions.

[0220] In the above-described embodiments, an example is given of a form in which the viewpoint switching of the four virtual cameras C1 to C4 and the airborne virtual camera, which are fixed-positioned (set) virtual cameras, can be performed in advance by setting and operating on the administrator terminal 150. However, the present invention is not limited to this. For example, the administrator K on the administrator terminal 150 may perform these viewpoint switchings in real time using a viewpoint switching controller or the like constituting the operation input device 161.

[0221] In the above-described embodiments, a form is exemplified in which virtual cameras C1 to C4 fixedly arranged (set) in the virtual space are used as virtual cameras. However, the present invention is not limited to this. For example, in addition to or instead of virtual cameras C1 to C4, a movable virtual moving camera is arranged in the virtual live venue, and the position and imaging direction of the virtual moving camera in the virtual space are controlled by an administrator K, a cameraman, etc. on the administrator terminal 150 by operation to obtain a viewpoint video of the virtual moving camera.

[0222] In the above-described embodiments, a form is exemplified in which the viewpoint video of virtual camera C2 is displayed on screen S in order to detect the facial expression of the performer user so as to reflect it in the expression of the performer avatar. However, the present invention is not limited to this. For example, if it is a high-functional head-mounted display having a sensor function for detecting the facial expression of the performer user, the performer may perform wearing these high-functional head-mounted displays. By doing so, the immersion of the performer user in the virtual live can be improved. Also, when it is not necessary to reflect the facial expression of the performer user in detail in the expression of the performer avatar, the performer user may perform wearing a normal head-mounted display.

[0223] In the above-described embodiments, a form is exemplified in which the viewpoint of the viewer user is changed and followed according to the movement of the performer avatar. However, the present invention is not limited to this. For example, the change and following of these viewpoints may be executed according to specific effects such as the setup of smoke, fireworks (fire pillars), special lighting, and the transformation of stage G, which are effects on stage G.

[0224] <Related to event content> (Overview of event content) With reference to FIGS. 13 to 23, as an example of content, event content in which a live event is performed by a performer in a virtual live venue was described. The event content is distributed, for example, at a predetermined date and time (scheduled time of the scheduled date) according to event data. Further, before the start of the event, a space area ER where the event content is to be provided may be provided (distribution start, opening) so that viewer users can enter and participate in the virtual space where the event is held. In this case, the event data may include information for specifying the date and time for providing (distributing and opening) the space area ER where the event content is to be provided before the scheduled date.

[0225] Hereinafter, for example, from before the start of the event content of the virtual live shown in FIG. 13, a virtual space in which the virtual live venue (event venue) shown in FIG. 13 is constructed as a predetermined type of virtual space is opened so that viewer users can enter and participate. An example of gradually improving the viewers' interest in the event from before the start of the event will be described. The predetermined type of virtual space is, for example, any of the virtual spaces in the space area ER of FIG. 12. Hereinafter, as an example of the predetermined type of virtual space, the space area ER5 shown in FIG. 24 will be used for explanation.

[0226] FIG. 24 is an overall bird's-eye view of the event venue constructed in the space area ER5. In the space area ER5 in the present embodiment, as an example, a virtual space in which objects such as buildings imitating a shrine and the town in front of the shrine are arranged is provided. Note that the objects arranged in the space area ER5 are not limited to buildings imitating a shrine, and may be objects along various themes such as the sea, a lake, a mountain, and a school. Further, the space area ER5 is composed of a plurality of areas. The space area ER5 is composed of, for example, an area ER51 corresponding to a town area, an area ER52 corresponding to an inner shrine area, an area ER53 corresponding to a main shrine area, etc., as shown in FIG. 24(A).

[0227] In the town area, for example, there are multiple house objects imitating private houses, and there are multiple display areas provided at various locations for displaying (installing) lantern objects purchased, etc. by viewer users along the approach road leading to the precinct area. The lantern objects can be purchased, for example, at a lantern shop area within the town area. Also, in the precinct area, for example, there are many objects corresponding to torii gates, gates, statues, etc. placed in the precinct of a shrine, and a game area where a predetermined game can be played and an omikuji area where omikuji can be drawn are provided, and there are multiple display areas provided. In the main hall area, for example, there are many objects corresponding to the main hall of a shrine and a stage object serving as a virtual live venue (event venue) arranged, and an offering area for making offerings is provided, and there are multiple display areas provided.

[0228] In the display areas, there are placed lantern objects purchased by users, lantern objects associated with the operation (administrator) (including the initially set lantern objects), lantern objects associated with special users, etc. Special users include performer users, operation users, sponsor users who have sponsored an event, and other famous people, etc., who are authenticated as special users by the operation (administrator) side. Also, information on these sponsor users and other famous people, etc. is stored in the event data 111.

[0229] Also, as will be described later, the lantern objects displayed in the display areas are determined in advance by random selection, etc. each time the switching condition is satisfied as default lantern objects to be commonly displayed for all users on the distribution server computer 100 side, and are transmitted to and arranged on the viewer terminals 300 of users who have entered the space area ER5. By bringing the viewer avatar closer to any of the display areas, the lantern objects displayed in the corresponding display area can be displayed on the viewer terminal 300.

[0230] Various processes related to such a spatial area ER5 (a virtual space of a predetermined type) and various processes related to the provision and distribution of the spatial area ER5 are performed by the distribution server computer 100. The viewer user can use the viewer terminal 300 to enter and participate in the spatial area ER5, move the viewer avatar, and thereby display the image within the spatial area ER5 on the viewer terminal 300. Hereinafter, the viewer user and the viewer avatar (as well as the performer avatar, etc.) will be simply referred to as the user and the user avatar (as well as the performer avatar, etc.).

[0231] FIG. 25 is an example of an image of the spatial area ER5 displayed on the display unit 310 of the viewer terminal 300. FIG. 25(A) is an example of a display image when the area ER52 (the precinct area in FIG. 24) is viewed obliquely from within the area ER51 (the town area). FIG. 25(B) is an example of a display image when the user avatar U operated by the user is moved near the boundary of the area ER53 within the area ER52 in FIG. 24 and viewed from behind the user avatar U, and a gate object 53c corresponding to the gate leading from the area ER52 to the area ER53 is shown. FIG. 25(C) is an example of a display image when the user avatar U is moved under the torii object 52t corresponding to the large torii in the area ER52 in FIG. 24 and viewed from behind the user avatar U, and the base of the torii object 52t and the gate object 53c are shown. FIG. 25(D) is an example of a display image when the user avatar U is moved to the rear side from the position shown in FIG. 25(C) and viewed from behind the user avatar U, and the torii object 52a and the house object 51d corresponding to the house are shown. In this way, by entering and participating in the spatial area ER5, the user can move within the spatial area ER5 according to the operation from the user, visually recognize the objects and scenery within the spatial area ER5, purchase objects, offer money, and participate in the live event held in the worship hall area on the scheduled date.

[0232] Note that the image obtained by looking down at the virtual space as shown in FIG. 25(A) may be displayable on the display device 310 by a user operation, or may be an image corresponding to the line of sight of the user avatar U as shown in FIGS. 25(B) to (D). Further, by a user operation, even if it is an image obtained by looking down at the user avatar U as shown in FIGS. 25(B) to (D), instead of displaying the user avatar U that the user operates, an image seen from the viewpoint of the user avatar U may be displayed.

[0233] In this embodiment, even during a pre-scheduled period that is a period before the scheduled date when the event content is to be provided within the space area ER5, the user can enter and participate (simply referred to as enter) the space area ER5. For example, even during the pre-scheduled period, when the user logs in to the virtual space ER and enters and participates in the space area ER5, the virtual space generation program 120 transmits data for causing the display device 310 of the viewer terminal 300 to display an image of the generated space area ER5 to the viewer terminal 300. The pre-scheduled period may be a day before the scheduled date when the event content is to be provided, and may be a predetermined period (for example, one week) before the scheduled date, or may be all days before the scheduled date. In this embodiment, it is assumed that the user can enter the space area ER5 from one week before the scheduled date.

[0234] Only users who have the right (for example, a ticket) to participate in the event content to be provided on the scheduled date are allowed to enter and participate in the space area ER5 during the pre-scheduled period and on the scheduled date. The right to participate is given to the user, for example, by purchasing a ticket to participate by charging, or by clearing a predetermined game or mission.

[0235] A space area ER5, which is a virtual space of a specified type, is, for example, an area formed by a plurality of regions connected in a row. The space area ER5 includes a first virtual space in which a viewer user can seamlessly move and enter from a certain region in the plurality of regions to other regions, and a second virtual space consisting only of regions having a common (same) display mode as other regions. As shown in FIG. 24(A), the virtual space corresponding to the space area ER5 in the present embodiment is an area in which regions ER51 to ER53 are connected in a row, and the user can seamlessly move and enter between region ER51 and region ER52 and between region ER52 and region ER53. The first virtual space includes a second virtual space consisting only of a region ER53' having a common (same) display mode as region ER53, as shown on the right side of FIG. 24(B).

[0236] Also, for example, until a specific period (e.g., the day before) before the scheduled date of the event content, the first virtual space shown in FIG. 24(A) is provided. After the specific period before the scheduled date of the event content and when the release condition is satisfied, in addition to the first virtual space, the second virtual space shown in FIG. 24(B) is provided. Among the plurality of regions (regions ER51 to ER53) in the first virtual space, the movement from some regions (regions ER51, ER52) to other regions (region ER53) becomes impossible (for example, the gate of the large gate object 53c leading to region ER53 is closed), and a portal P is provided at a predetermined position in some regions (the position in front of the large gate object 53c within region ER52). By moving the user avatar U to the portal P, it is possible to transition to the second virtual space consisting only of region ER53' through the display of a predetermined screen (e.g., a fade-out screen), for example.

[0237] The event content in the present embodiment is provided in region ER53', which has a common display mode with region ER53. Region ER53' is, for example, an area that cannot be entered until the release condition is satisfied. In region ER53', a venue similar to the virtual live venue shown in FIG. 13 is constructed, and objects corresponding to a virtual stage and audience seats for a live event are arranged. During the live event, the performer avatar operates on the virtual stage, and the user will view from the audience seats via the user avatar U.

[0238] On the other hand, before a specific period of the scheduled date, in the area ER53 in the first virtual space, for example, objects corresponding to the seats for the live event audience are gradually arranged, or objects under construction for the virtual stage are arranged, so that the state of gradually constructing the virtual live venue is reflected, and the user can confirm it through the user avatar U. For example, virtual space update data distribution processing for updating the displayed objects is performed every time a predetermined time elapses (for example, 24 hours, etc.). This can convey that the event is approaching and enhance the sense of presence and interest.

[0239] Also, when the release condition is satisfied, the user staying in the area ER53 is taken out of the area ER53. For example, the user avatar U is forcibly moved and controlled to a predetermined position outside the area ER53 (for example, in front of the main gate object 53c in the area ER52). After that, entry into the area ER53 becomes impossible, while the user avatar U can be made to enter the area ER53' through the aforementioned portal P.

[0240] The area ER53 and the area ER53' have a common display mode, but restrictions are placed on the space where the user avatar U can move. For example, in the area ER53, the user avatar U can freely move within the area, while in the area ER53', only the audience area 53'k can be moved to. This can make the burden on the server the minimum burden for providing event content. Also, the area ER53 and the area ER53' can have different servers (rooms) for performing the processing for constructing and generating each area. This can be managed by a server (room) corresponding to the heavy load when event content is provided. Note that the users who can enter the area ER53' may be limited to those who meet the predetermined conditions for providing event content.

[0241] (Regarding changes in the display mode within the virtual space) In this embodiment, the display mode within the spatial area ER5 can change according to an event that occurs within the spatial area ER5 during the period prior to the scheduled date. The event that occurs within the spatial area ER5 during the period prior to the scheduled date includes, for example, the actions of the user during the period prior to the scheduled date, the actions of other users, and other events such as a lottery within the spatial area ER5 or a setting change to the virtual space executed by an operator's operation. The actions of the user (or the actions of other users) include, for example, an operation of purchasing and placing a predetermined object (an item, a lantern object, etc.) and playing a game such as completing a predetermined mission. The display mode within the spatial area ER5 that can change according to an event that occurs within the spatial area ER5 during the period prior to the scheduled date includes, for example, a change in the display mode of a specific object (for example, a lantern object, a display area for placing the lantern object, etc.) arranged within the spatial area ER5 and a change in the display mode of the production during the provision of event content.

[0242] (Regarding the change in the display mode during the period prior to the scheduled date due to the placement of a specific object) Hereinafter, with reference to FIGS. 26 to 32, an example in which the display mode within the spatial area ER5 during the period prior to the scheduled date can be changed will be described according to an event in which the user purchases and places a lantern object within the spatial area ER5. For example, the purchased lantern object within the spatial area ER5 is placed in the display area, or a lantern object purchased by another user and placed in the display area is switched to another lantern object according to the establishment of the switching condition. Note that since the lantern object can also be a type of item for which the user throws money during the provision of event content (for example, a flower stand), it is also referred to as the frusta FS hereinafter.

[0243] The frusta FS can be purchased, for example, at the lantern shop 51s provided along the approach road within the area ER51 shown in FIG. 24. The user can purchase the frusta FS by moving the user avatar U to the lantern shop 51s or by selecting the lantern shop 51s, etc., so that the image displayed on the viewer terminal 300 switches from the screen displaying the image within the area ER51 to the screen for purchasing the frusta FS. FIG. 26(A) is an example of the screen at the time of purchasing the frusta FS.

[0244] As shown in FIGS. 27(A) and (B), a plurality of types of purchasable frusta FS are provided. FIG. 27(A) shows a table by the attribute (motif) of the frusta FS. As the attribute (motif), "plain", "cherry blossom", "oni", "white fox", "black fox", "luxurious and gorgeous", etc. are defined. For each attribute, a motif color is defined, and for each frusta FS of each attribute, the corresponding color is used and a design related to the attribute is applied. Among each attribute, "cherry blossom", "oni", "white fox", "black fox" are the attributes and colors related to each of the performer avatars that appear as the progressing characters at the time of providing the event content. That is, as the purchasable frusta FS, those that match the image motif and image color defined for the performer avatars that appear at the time of providing the event content are prepared.

[0245] Also, for the frusta FS, a plurality of sizes are prepared. The frusta FS differs in the types of sizes prepared and the price according to the attribute. For example, for the attribute "plain", only the size "small" is handled, and the price is set at 500 coins. For the attribute "cherry blossom", two types of sizes, "large" and "small", are defined. The price of the size "large" is 2500 coins, and the price of the size "small" is 500 coins. The user selects any motif and size to purchase the desired frusta FS. For example, it is possible to provide an enjoyable way such as purchasing a frusta FS that matches the attribute, color, image motif, and image color related to the performer avatar that the user is supporting (pushing) among the performer avatars that appear at the time of providing the event content.

[0246] Figure 27(B) is a table by the size of the frusta FS. The user can decorate the frusta FS (generate the display mode of the frusta FS), for example, can perform character-insertion decoration. For each size of the frusta FS, the font type and the font color are determined and can be selected by the user at the time of purchase. Also, the upper limit of the number of characters that can be displayed for each size of the frusta FS is determined. For example, for the size "large", characters can be input in two columns, and there is a character limit of 15 characters each. For the size "small", there is a character limit of 10 characters.

[0247] For each size of the frusta FS, the display (placement) - possible area is determined. When the user displays the purchased frusta FS in the space area ER5, the user can select (specify) and place it from among the display areas provided in plurality within the space area ER5 where the frusta FS can be displayed. For example, for the size "large", the display area for placement can be selected from any of the areas such as the main street (west) area 51a, the main street (east) area 51b, and the large torii area 52a (the area where the large torii object 52t is placed). For the size "small", the display area for placement can be selected from any of the areas such as the precincts (west) area 52b, the precincts (east) area 52c, the area in front of the worship hall (west) area 53a, and the area in front of the worship hall (east) area 53b.

[0248] On the purchase screen shown in FIG. 26(A), an image 411 of the selected flask FS is displayed. Below the image 411 of the flask FS, detailed information 412 of the selected flask FS is displayed. The detailed information 412 includes information regarding size and attributes (motifs). Also, the user can apply lettering decoration to the flask FS to be purchased and customize it to a preferred design. In the letter input area 413, it is possible to input the letters to be displayed on the flask FS. The input letters are reflected in the image 411 of the flask FS, and it is possible to check the image when arranged. Also, there are defined NG words whose input is restricted for the letters that can be displayed on the flask FS. The NG words are, for example, violent language, language contrary to public order and good customs, etc. When an NG word is input, the purchase icon 417 is grayed out and the purchase operation cannot be performed.

[0249] As shown in the example of the purchase screen in FIG. 26(A), by operating on the placement location selection area 414, the user selects the display area of the flask FS. Also, in the coin-related area 415, the number of coins the user has, the number of coins consumed as the purchase price of the flask FS, and the remaining number of coins after purchase are displayed. The user operates the purchase icon 417 to finalize the purchase and the charging process is performed. When canceling the purchase, an operation on the close icon 416 is performed.

[0250] After purchasing the frusta FS, as shown in FIG. 26(B), a display performance of the frusta FS is carried out. For example, in FIG. 26(A), for a user who has purchased a frusta FS1 with the attribute of "cherry blossoms" and the size of "small" and with the character decoration of "sai kou", the frusta FS1 is displayed in the display area where the frusta FS1 is placed, and an effect such as the frusta FS1 being wrapped in light around it (displayed and highlighted in a specific manner different from other frusta) is carried out. When the user purchases the frusta FS and designates the display area on the viewer terminal 300 side, for example, in the distribution server computer 100, the display position is determined by lottery or the like from within the designated display area, and information including the display position of the frusta FS is stored, and at the same time, information for specifying the display position is transmitted to the viewer terminal 300 of the user who is the source of the designation. In the viewer terminal 300, a process of replacing and displaying the frusta displayed at the display position specified from the received information with the frusta purchased by the user is performed. Thereby, when the user enters and participates in the space area ER5, the user can be prompted to move to the display area of the frusta FS arranged by the user himself / herself, and the motivation to go and see the frusta FS of the user himself / herself can be activated. Also, it is possible to provide an interesting aspect such as checking the characters of the frusta FS of other users. Further, the display area is provided in any of the areas ER51 to ER53 that constitute the space area ER5 as shown in FIG. 24(A). Therefore, it is possible to prompt the user who has entered and participated in the space area ER5 to move to all of the areas ER51 to ER53, and the user can enjoy the entire space area ER5.

[0251] Next, the frusta purchase process of the frusta FS executed by the distribution server computer 100 will be described using the flow of FIG. 28.

[0252] In step S101, it is determined whether it is a purchasable period before the scheduled date. The purchasable period before the scheduled date may be a period that matches the period before the scheduled date or may be a partial period of the period before the scheduled date. When it is not determined that it is a purchasable period before the scheduled date, since it cannot be purchased, the process ends. For example, on the scheduled date itself, since it is determined as NO in step S101, the frusta FS cannot be purchased. Therefore, before the event date, the user can be motivated to enter the space area ER5 at least once to purchase the frusta FS.

[0253] In step S101, when it is determined that it is a purchasable period before the scheduled date, in step S102, it is determined whether a shop selection operation has been performed. The shop selection operation is, for example, an operation on a frusta shop (for example, the lantern shops 51s, 53s, etc. in FIG. 24) within the space area ER5 (including, for example, performing an action such as approaching a store clerk character or performing a selection operation on a predetermined icon of the shop). Specifically, in step S102, it is determined whether information transmitted when a shop selection operation is performed on the viewer terminal 300 has been received.

[0254] When it is determined in step S102 that a shop selection operation has been performed, in step S103, information for displaying a shop screen on the display device 310 is transmitted to the viewer terminal 300 that is the source of the shop selection operation. The shop screen is, for example, a screen for displaying a list of products for selecting the frusta FS to be purchased or a purchase screen of the frusta FS in FIG. 26(A). As a result, on the viewer terminal 300, the shop screen can be displayed to select a preferred frusta FS. After outputting the information for displaying the shop screen in step S103, the process ends. Note that the purchase operation of the frusta FS is not limited to within the space area ER5 and may be an operation from a shop displayed in another space within the virtual space ER. It may also be reflected (made available for use / display) within the virtual space by performing a purchase operation on a website separate from the virtual space.

[0255] On the other hand, in step S102, when it is not determined that a shop selection operation has been performed, it is determined in step S104 whether a content editing operation has been performed. The content editing operation is a decoration operation such as entering characters into the frusta FS. Specifically, in step S104, after a frusta FS to be purchased is selected on the viewer terminal 300, it is determined whether information for specifying the characters input into the frusta FS by performing a decoration operation on the screen shown in FIG. 26(A) has been received from the viewer terminal 300. When it is determined that a content editing operation has been performed, it is determined in step S105 whether an NG word is included. When it is not determined that an NG word is included, the process ends. On the other hand, when it is determined in step S105 that an NG word is included, in step S106, information for notifying that fact (that an NG word is included) and that purchase is not possible is transmitted to the viewer terminal 300 that is the source of the content editing operation, and the process ends. As a result, on the viewer terminal 300, for example, a pop-up display indicating that "an NG word is included" or a process of disabling the purchase icon 417 from being selected is performed.

[0256] In step S104, when it is not determined that a content editing operation has been performed, it is determined in step 107 whether a purchase confirmation operation has been performed. The purchase confirmation operation is, for example, an operation on the purchase icon 417 shown in FIG. 26(A). Specifically, in step 107, it is determined whether information for specifying the type of frusta FS purchased, the characters input, the selected display area, etc., which is information transmitted when an operation on the purchase icon 417 is performed on the viewer terminal 300, has been received. When it is not determined that a purchase confirmation operation has been performed, the process ends.

[0257] On the other hand, when it is determined in step S107 that a purchase confirmation operation has been performed, a purchase process (billing process) is performed in step S108. After the purchase process is performed, in step S109, a frusta display effect process is performed, and the process ends. For example, based on the information received when the purchase confirmation operation is performed, the display position is determined by lottery or the like from within the selected display area, and the user-related information regarding the frusta FS (included in the viewer user data 133) is updated. At the same time, information for specifying the display position is transmitted to the viewer terminal 300 of the user who is the purchaser, and processes such as causing the display effect illustrated in FIG. 26(B) to be performed on the viewer terminal 300 of the purchasing user are performed. Note that the display position within the display area is not limited to being determined by lottery, and the selection operation of the user who makes the purchase may be enabled so that the display is made at a preferred position.

[0258] FIG. 27(C) is an example of a table that stores information related to the frusta FS purchased by the user among the user-related information stored in the viewer user data 133. For example, for each user ID, information for identifying the purchased frusta FS, information regarding the display location of the frusta FS within the display area specified by the user, etc. are associated. As an example, the "frusta ID" for individually identifying the frusta FS, the "purchased frusta" which is information regarding the attributes and size of the purchased frusta FS, the "characters" which is information regarding the decoration (input characters) performed by the user, the "user-specified area" as information regarding the display area specified by the user, the "position" which is information regarding the display position within the display area, the "purchase date and time" which is the date and time when the user purchased the frusta, etc. are stored. During the frusta display effect process of step S109, information regarding the frusta FS purchased corresponding to the purchasing user is newly stored. Also, the information regarding the frusta FS purchased is transmitted to the viewer terminal 300 of the purchasing user, and in the viewer terminal 300, a display effect process is performed to display (exhibit) the purchased frusta FS instead of the frusta FS already displayed at the display location. Note that when the frusta FS is purchased, not only is a display effect performed, but instead of or in addition to this, it may be that only the fact that the purchased frusta FS is displayed in the selected display area is notified.

[0259] Also, when any user purchases the frusta FS, in the viewer terminal 300 of that user, as described above, the frusta FS already displayed at the display location is displayed instead of the purchased frusta FS. However, depending on the purchase, there is no impact on the frusta FS in the display area of the viewer terminals 300 of other users, and the same frusta FS as before the purchase continues to be displayed. Therefore, it is possible to make the frusta FS displayed in the display area different between the user who purchased the frusta FS and other users.

[0260] In step S101, it is determined whether it is a purchasable period before the scheduled date. However, it is not limited to the period before the scheduled date, and it may be purchasable at any time. For example, depending on the timing when event content related to the frusta FS to be purchased is provided, it may be purchasable on or after the scheduled date when the event content is provided. However, if it is not a purchasable period before the scheduled date in step S101, it may not be used for the production at the time of event content provision.

[0261] Also, the editing operations (character input operation, content editing operation) of the display mode of the frusta FS may be editable not only at the time of purchase, but also alternatively or additionally after purchase. For example, after the purchase operation, the frusta FS may be saved in the user's item BOX, and it may be possible to take it out from the item BOX for display or editing operation at the user's preferred timing. Also, regarding the type and color of the font, it may be operable not only at the time of purchase, but also after purchase. Not limited to characters, color editing or decoration for making a separately luxurious display mode as an option may be possible.

[0262] Note that, based on the information received when the purchase confirmation operation is performed in step S107 of FIG. 28, an example in which the display position (for example, the display positions "A1", "A2", etc. of the display area A described later) within the display area selected by the user is determined by lottery or the like has been described. However, it is not limited to this. For example, the frusta FS may be made displayable at a timing different from the frusta FS purchase timing, and the display position may be determined at the timing of display.

[0263] (Regarding the change in the display mode during the period before the scheduled date due to the switching condition being satisfied) Next, referring to FIGS. 29 to 32, the transition of the lantern object (display mode of the display area) arranged in the display area will be described. In the present embodiment, lantern objects are displayed in a plurality of display areas (for example, the main street (west) area 51a, the main street (east) area 51b, the big torii area 52a, etc.) provided in the area ER5. For each display area, the upper limit number of lantern objects that can be displayed is determined.

[0264] As described above, in the display area, not only the frusta FS purchased by the user himself / herself (associated with the user himself / herself) as described with reference to FIGS. 26 to 28, but also frusta FS purchased by other users (associated with other users), frusta FS associated with the operation (administrator), frusta FS associated with special users, etc. are arranged.

[0265] In the present embodiment, the display area A corresponds to, for example, the inner (west) area 52b of the area ER52 in FIG. 24 corresponding to the precinct area of the shrine, and is an area where, for example, among the frusta FS that are lantern objects, the size "small" shown in FIG. 27(B) can be displayed. FIG. 29(A) is a part of the display area A corresponding to the inner (west) area 52b. As shown in FIG. 29(A), in the display area A, a plurality of frusta FS that are lantern objects are arranged side by side vertically and horizontally. FIG. 31(A) is a table included in the object data 122, and is an example of a data table regarding information for specifying the frusta FS to be displayed in the display area A and the display positions. In FIG. 31(A), for each display position (A1, A2, A3,...) in the display area A, as information for specifying the frusta FS, for example, a frusta ID and character information to be displayed are associated. The display position A1 corresponds to, for example, the upper left of FIG. 29(A), and is associated with a frusta FS with a frusta ID "a1", an attribute of "cherry blossom", and "character A" displayed. The display position A2 corresponds to a position one right adjacent to the same row as the display position A1, and is associated with a frusta FS with a frusta ID "b1", an attribute of "demon", and "character B" displayed.

[0266] FIG. 31(B) is a table included in the object data 122 and is an example of a data table regarding the frusta FS arranged in the display area B and information for specifying the display positions. The display area B is an area capable of displaying the frusta FS of the size "large" shown in FIG. 27(B), and corresponds to, for example, the location (torii gate area 52a) where the large torii gate object 52t in the area ER52 is located. In FIG. 31(B), similar to FIG. 31(A), for each display position (B1, B2, B3, ···) in the display area B, information for specifying the frusta FS, such as frusta IDs and character information to be displayed, is associated. For example, a frusta FS with the frusta ID "a1" and displaying "Character A" is associated with the position corresponding to the display position B1. A frusta FS with the frusta ID "b1" and displaying "Character B" is associated with the position corresponding to the display position B2.

[0267] Also, as shown in FIGS. 31(A) and 31(B), etc., the information of the frusta FS associated for each display area is switched to the information of other frusta FS determined by random selection or the like every time the switching condition is satisfied. The switching conditions for the frusta FS information for each display area may include, for example, the elapse of a predetermined time (e.g., every 30 minutes, every 2 hours, etc.), the user performing a login / logout operation to / from the virtual space (login, re-login, etc.), and conditions satisfied by the user's reloading of the display data (e.g., a reload operation, or when the user avatar U's viewpoint returns to the relevant display area after the relevant display area has moved out of the user avatar U's viewpoint). The probability of being selected for display by random selection is determined to be the same probability for each frusta FS, but is not limited to this, and may be varied according to the characteristics of each frusta FS as described later.

[0268] Upon the fulfillment of the switching condition, the distribution server computer 100 determines the frusta FS to be displayed for each display area, updates the table for each display area (refer to FIGS. 31(A) and (B), etc.) stored as object data 122 (set as the default common to all users), and transmits to the viewer terminal 300 of the user who has entered the spatial area ER5 the information for specifying the frusta FS for each display area. As a result, on the viewer terminal 300, the frusta FS of each display area (the frusta FS of other users such as users other than the user's own frusta FS) can be switched and displayed to other frusta FS. Note that the switching of the frusta FS is performed within the range up to the upper limit number that can be displayed for each display area. For example, in display area A, when the upper limit number of frusta FS that can be displayed is 100, the information on the frusta FS of display area A stored as the object data 122 shown in FIG. 31(A) is switched and updated to the data of 100 frusta FS determined by random selection or the like each time the switching condition is fulfilled. Also, for example, when the display area is released, the frusta FS initially arranged in display area A where 100 frusta FS can be displayed may be set to 10, and may gradually increase up to 100 as the user purchases and displays them. The release of the display area means, for example, when the user can purchase and display the frusta FS in the display area. In this case, the random selection may be performed after reaching the upper limit.

[0269] Also, as described above, the information of the frusta FS arranged in the virtual space changes every time the switching condition is satisfied. However, for the frusta FS purchased by the user himself / herself, based on the information managed in FIG. 27(C), it can be continuously displayed in the display area in the virtual space. For example, FIG. 29 is an example of the transition of the display mode of the frusta FS in the display area A displayed on the display device 310 of user 1 when user 1 newly purchases a frusta FS. FIG. 30 is an example of the transition of the display mode of the frusta FS in the display area A (the same position as the display position illustrated in FIG. 29) displayed on the display device 310 of user 2 when user 1 newly purchases a frusta FS. FIGS. 29(A) and 30(A) are display examples of the frusta FS determined as the default corresponding to the display area A, in which the frusta FS specified from the frusta arrangement information in FIG. 31(A) is arranged. Note that at the timings of FIGS. 29(A) and 30(A), it is assumed that for neither user 1 nor user 2 is the frusta FS purchased by each user displayed in the display area A.

[0270] FIGS. 29(B) and 30(B) are display examples at the timing when user 1 newly purchases frusta FS1. The frusta FS1 purchased by user 1 has, for example, the size of the attribute "cherry blossom" of the frusta ID "a3" shown in FIG. 27(C) being "small" and the input character being "sai kou". Also, it is assumed that user 1 selects "A" as the display area at the time of purchase and the location "A1" within the display area is associated.

[0271] When user 1 purchases frusta FS1, the purchased frusta information is distributed to user 1, and on the viewer terminal 300 of user 1, the frusta FS arranged at the display position A1 in the display area A is switched to and displayed as the frusta FS1 purchased by user 1. On the other hand, on the display device 301 of user 2, as shown in FIG. 30(B), the display of the same frusta FS as in FIG. 30(A) is maintained.

[0272] FIG. 29(C) and FIG. 30(C) are display examples when the switching condition is satisfied after a predetermined time has elapsed since the previous switching. In the display device 301 of user 1, as shown in FIG. 29(C), for the frusta FS1 purchased by user 1 himself / herself displayed in the display area A1, the display continues at the same position as in FIG. 29(B), but for other frusta FS, they have switched to the frusta FS determined by lottery in response to the satisfaction of the switching condition. The other frusta FS are frusta FS not associated with user 1 and are frusta FS associated with other users or the like. Note that the other frusta FS may include frusta FS prepared by the operation that are not associated with any other users.

[0273] On the other hand, in the display device 310 of user 2, as shown in FIG. 30(C), it has switched to the frusta FS determined by lottery in response to the satisfaction of the switching condition. FIG. 30(C) is different from FIG. 29(C) of user 1 in that a frusta FS different from the frusta FS1 associated with user 1 is displayed at the display position A1 in the display area A of the display area, and a common frusta FS based on the default data stored in the object data 122 is displayed at all display positions in the display area A including the display position A1.

[0274] FIG. 29(D) and FIG. 30(D) show display examples when the frusta FS in the display area A are switched again due to the satisfaction of the switching condition after the predetermined time has elapsed. By chance, the frusta FS1 purchased by user 1 is included in the object data 122 of the display area A determined and stored by lottery at this switching timing, and the display position is A6 (the second position from the left in the lower row in FIGS. 29(D) and 30(D)). In this case, for user 2, as shown in FIG. 30(D), the frusta FS1 of user 1 is displayed at A6 based on the default data.

[0275] On the display device 310 of User 1, as shown in FIG. 29(D), the frusta FS1 are continuously displayed at location A1 based on FIG. 27(C). That is, even if the frusta FS1 purchased by User 1 are included in the object data 122 in the same exhibition area in the viewer terminal 300 of User 1, the frusta FS1 purchased by User 1 are switched to be arranged at the exhibition positions based on FIG. 27(C). Further, in the viewer terminal 300 of User 1, a process is performed to replace and display the frusta FS (default frusta FS) based on the object data 122 arranged at the exhibition position (A1) of the frusta FS1 purchased by User 1 with the frusta FS1 purchased by User 1 based on the object data 122. As a result, at A6 of User 1, instead of the frusta FS1, the frusta FS (frusta FS of "character O") associated with A1 with the default data is displayed. Thereby, it is possible to prevent a plurality of the same frusta from being arranged in the same exhibition area.

[0276] Note that, even if the frusta FS purchased by User 1 are included in the object data 122 in the same exhibition area, only the process of switching the frusta FS purchased by User 1 to be arranged at the exhibition positions based on FIG. 27(C) may be performed, and the frusta FS purchased by User 1 based on the object data 122 may also be displayed as they are. In this case, since a plurality of the same frusta FS of User 1 are displayed, a special feeling can be given to the user.

[0277] Also, in FIG. 29, an example was described in which the flask FS1 purchased by user 1 is displayed, fixed at position A1 within the display area A. However, it is not limited to this, and within the display area A arranged by the user, each time the switching condition is satisfied, the display position of the purchased flask FS may be switched. For example, at the timing of FIG. 29(C), the flask FS1 purchased by user 1 is displayed at position A1, but at the next switching timing, it is displayed at position A4 corresponding to the upper right of the display area A, and default data (data of the flask FS associated with A1 in FIG. 31(A)) may be displayed at A1.

[0278] Next, with reference to FIG. 32, the switching process of the flask FS to be displayed in the display area within the virtual space executed by the virtual space generation program 120 will be described.

[0279] In step S201, it is determined whether it is a displayable period before the scheduled date. The displayable period may be a period that matches the period before the scheduled date, or may be a partial period of the period before the scheduled date. When it is not determined that it is a displayable period before the scheduled date, the switching process ends.

[0280] On the one hand, in step S201, when it is determined that the displayable period is before the scheduled date, it is determined whether the switching condition is satisfied in step S202. The switching condition in step S202 will be described by taking an example where a predetermined time has elapsed (for example, 30 minutes, 2 hours, etc.). When it is determined in step S202 that the switching condition is satisfied, in step S203, the flasters to be displayed for each display area are randomly selected from all the flasters FS that are candidates for the lottery, and the flaster arrangement information (such as FIGS. 31(A) and (B)) for each display area as the object data 122 is updated. The updated flaster arrangement information (including information specifying the flaster FS (information specifying the display mode of the flaster to be displayed on the viewer terminal, etc.)) is transmitted to the viewer terminal 300 of the user who has entered and participated in the space area ER5. For example, in the case of display area A, the flaster arrangement information for display area A illustrated in FIG. 31(A) is updated with the information of the randomly selected flaster FS and stored in the database that stores the object data 122. The updated flaster arrangement information is transmitted from the database that stores the object data 122 to the viewer terminal 300 of the user. As a result, the information of the flaster FS for each default display area is updated, and it becomes possible to switch and display the flasters of each display area on the viewer terminal 300 of the user who has entered and participated in the space area ER5.

[0281] Note that the flasters FS that are candidates for the lottery may be all the flasters FS stored as the object data 122 excluding the NG flasters (for example, the flasters for which the non-display setting has been made by the operator due to a report, etc.), or the flasters FS may be divided into predetermined groups and selected from the flasters FS in a predetermined group. For example, the grouping may be based on the purchase time, the type of the flaster, etc.

[0282] On the other hand, in step S202, when it is not determined that the switching condition is satisfied, it is determined in step S204 whether a user has newly entered the space area ER5.

[0283] In step S204, when it is determined that the user has not newly entered the room, the process ends. On the other hand, in step S204, when it is determined that the user has newly entered the room, in step S205, the frusta arrangement information for each display area is transmitted to the viewer terminal 300 of the user. Thereby, the user can receive information for specifying the default frusta FS determined for each display area. For example, the frusta arrangement information of a predetermined range of display areas including the display area A updated in step S203 is transmitted.

[0284] In step S206, based on the information related to the purchased frusta shown in FIG. 27(C), it is determined whether there is a purchased frusta FS for the newly entered user. When it is determined that there is a purchased frusta FS, in step S207, the purchased frusta information for specifying the purchased frusta FS, the display position information determined at the time of purchase, etc. are transmitted to the viewer terminal 300 of the user. The purchased frusta information is information regarding the purchased frusta FS for each user exemplified in FIG. 27(C). For example, when processing is performed for user 1, for the display area A, assuming that it is the timing shown in FIG. 29(C), the default data of the display area A at the time of FIG. 29(C) is transmitted in step S205. Also, in step S207, the purchased frusta information (frusta ID "a3") of user 1 shown in FIG. 27(C) and the display position information determined at the time of purchase ( "A1", which is the arrangement information of "a3") are transmitted. Thereby, as shown in FIG. 29(C), a frusta FS1 with frusta ID "a3" is displayed at the position of display position A1, and the default frusta FS is displayed at the other display positions within the display area A.

[0285] In step S201, an example of determining whether it is within the displayable period before the scheduled date has been described. However, the present invention is not limited to this, and it may be such that the determination of whether it is within the displayable period before the scheduled date is not made. For example, it may be applied to a spatial area ER where a specific object can be arranged, regardless of the provision date of the event content (for example, the live event date).

[0286] Also, in step S203, an example has been described in which when the switching condition is satisfied, the frusta arrangement information is updated and the updated frusta arrangement information is transmitted to the users who have entered / participated in the spatial area ER5. However, in step S203, the present invention is not limited to this, and only the process of updating the frusta arrangement information when the switching condition is satisfied may be performed, and the process of transmitting the updated frusta arrangement information to the users who have entered / participated in the spatial area ER5 may not be performed. That is, the frusta switching associated with the satisfaction of the switching condition may not be performed on the viewer terminals 300 of the users who have already entered / participated. Also, in step S203, when the switching condition is satisfied, the frusta arrangement information may be updated and the updated frusta arrangement information may be transmitted only to the users who have entered / participated in the spatial area ER5 and who satisfy a predetermined requirement. The predetermined requirement may be, for example, that a time longer than the time from entry / participation until the switching condition is satisfied has elapsed, or that the user has set permission for switching due to the satisfaction of the switching condition in the individual settings. Note that even for users to whom the updated frusta arrangement information is not transmitted in step S203, when they re-enter, etc., the processes after step S205 are performed and the latest (updated in step S203) frusta arrangement information is transmitted.

[0287] In the embodiment with reference to FIGS. 29 to 32, an example was described in which even when the switching condition is satisfied, the frusta FS purchased by the user himself / herself are continuously displayed, while the frusta FS associated with other users are switched and displayed. However, even for the frusta FS associated with other users, if the other users are special users, the frusta FS associated with the special users may be continuously displayed. As described above, the special users include performer users, sponsor users who sponsor events, and other famous people, etc., who are authenticated as special users on the operation (administrator) side.

[0288] Next, the switching process 2 of the frusta FS to be displayed in the display area in the virtual space executed by the virtual space generation program 120 will be described with reference to FIG. 33.

[0289] FIG. 33 is an example in which a process to be performed when the information of the frusta FS cannot be read in a desired state (the information of the frusta FS cannot be specified) from the database that stores the information of the frusta FS in the above-described frusta switching process is added. The frusta displayed in this embodiment exist in large quantities and each display mode can be different. In the frusta switching process, the information read from the database (for example, a database server) that stores the information of many frusta FS is transmitted (distributed) for each user who has entered the room. Therefore, when the entry of many users is concentrated, etc., in order to perform the frusta switching process for many users, the load on the distribution server computer 100 increases. For example, due to the concentration of accesses to the database server that stores the information of the frusta FS, etc., the load on the database server becomes too high, and the frusta arrangement information cannot be read, so that the information necessary to display the virtual space on the login source (the viewer terminal of the user who has entered / participated in the virtual space) cannot be transmitted (distributed), and there is a risk of causing problems such as the inability to enter the room itself.

[0290] On the one hand, although the frusta in the display area are objects that liven up the virtual space, they are not essential objects for generating the virtual space (for example, objects such as the buildings and stage objects shown in FIG. 24, which may make the user feel uncomfortable if missing depending on the provided content, objects that form the basis of the virtual space, etc.). If the data of the essential objects cannot be read and sent (distributed), the virtual space itself cannot be generated and displayed (the content provided in the virtual space cannot be established). In contrast, even if the frusta in the display area cannot be accurately displayed, it is possible to generate and display the virtual space itself. That is, when the data of the objects essential for generating the virtual space (type 1 objects) can be specified (read and transmitted / received), the virtual space can be generated and displayed regardless of whether the data of objects such as frusta that are not essential for generating the virtual space (type 2 objects) are specified. Also, as described in steps S202 to S205 of FIG. 32, the frusta in the display area are updated and displayed as accurate frusta every time the switching condition is satisfied. That is, if entry into the virtual space is possible, the frusta in the display area can be updated regularly. Therefore, the impact of the inability to enter the virtual space due to the temporary inability to accurately display the frusta in the display area is greater for both the user and the operator than the impact of the temporary inability to accurately display the frusta.

[0291] Therefore, in the frustum switching process 2 in this embodiment, the processes of steps S225 to S245 are performed following the process of step S215. In FIG. 33, mainly the processes within the dotted frame are added to the processes in FIG. 32 described above. For the description of the same processes as in FIG. 32, the same step numbers are used and the description is simplified (and omitted). Also, steps S213 and S223 in FIG. 33 explain the process in step S203 in FIG. 32 in more detail, and steps S215 to S245 in FIG. 33 explain the process until the frustum arrangement information in step S205 in FIGS. 32 and 33 is transmitted to the user in more detail.

[0292] In step S202, when it is determined that the switching condition is satisfied, in step S213, the flasks to be displayed for each display area are randomly selected from all the flasks FS subject to the lottery, and the flask arrangement information (such as FIGS. 31(A) and (B)) for each display area in the object data 122 is updated and stored. For example, in the case of display area A, the flask arrangement information for display area A illustrated in FIG. 31(A) is updated with the information of the randomly selected flask FS and stored in the database that stores the object data 122.

[0293] In step S214, the updated flask arrangement information (including the information specifying the flask FS (such as the information specifying the display mode of the flask to be displayed on the viewer terminal)) is read from the database that stores the updated flask arrangement information and transmitted to the viewer terminal 300 of the user who has entered and participated in the space area ER5. As a result, the information of the flask FS for each default display area is updated, and it becomes possible to switch and display the flasks of each display area on the viewer terminal 300 of the user who has entered and participated in the space area ER5.

[0294] In step S204, it is determined whether a user has newly entered. When it is not determined that a user has newly entered, the process ends as in FIG. 32. On the other hand, when it is determined in step S204 that a user has newly entered, in step S215, the updated flask arrangement information (including the information specifying the flask FS (such as the information specifying the display mode of the flask to be displayed on the viewer terminal)) for each display area is read. For example, the distribution server computer 100 performs a process of reading the flask arrangement information updated in step S213 and transmitted to the user who has entered and participated in step S223 from the database in which the information of the updated arrangement flask FS is stored as the object data 122.

[0295] Note that in step S223 and step S215, the range of the frustum FS information read from the database in which the distribution server computer 100 stores the information (including the placement information) of the frustum FS as the object data 122 may be, for example, the frustum placement information that can be displayed in all the exhibition areas of the virtual space (e.g., within the space area ER5) where the user enters, or the frustum placement information that can be displayed in some of the exhibition areas of the entered virtual space. The part may be, for example, the frustum placement information of the exhibition areas (e.g., the exhibition areas within the sections such as the area ER51 and the area ER52 in FIG. 24) within the section where the user avatar U is located in the area of the virtual space where the user enters, or, along with the movement of the user avatar U, the frustum placement information of the range that can be displayed on the user screen (e.g., the exhibition area within a predetermined distance of 360 degrees from the position of the user avatar U).

[0296] In step S225, it is determined whether all the frustum placement information has been read out. The state where all the frustum placement information has been read out includes, for example, the state when the information specifying the frustum FS to be read from the database is accurately returned from the database. When it is determined in step S225 that all the frustum placement information has been read out, the frustum placement information for each exhibition area read in step S205 is transmitted to the viewer terminal 300 of the user.

[0297] On the other hand, when it is not determined in step S225 that all the frusta arrangement information has been read out, it is determined in step S235 whether or not a predetermined time (for example, 100 ms) has elapsed since the reading in step S215 was started. When it is not determined in step S235 that the predetermined time has elapsed, the process proceeds to step S215 to continue reading the frusta arrangement information that has not been read out (the frusta to be arranged at the missing location), and then proceeds to step S215 again. The determination of whether or not the predetermined time has elapsed may be made, for example, in the AP server, by determining whether or not the predetermined time has elapsed after starting the process of reading the information of the frusta FS from the database server and waiting for the response from the database server. It may also be made by determining whether or not the predetermined time has elapsed after starting the process of specifying the information of the frusta FS to be returned as the frusta arrangement information in the database server, and returning the information indicating that the predetermined time has elapsed (for example, the information that could not be specified, etc.) to the AP server.

[0298] On the other hand, when it is determined in step S235 that a predetermined time has elapsed, a predetermined alternative frusta to be arranged at the missing location that could not be read in step S245 is specified. When the frusta to be arranged at the missing location is specified in step S245, the process proceeds to step S205, and the frusta arrangement information for each display area is transmitted to the viewer terminal 300 of the user. The alternative frusta is information with a lighter processing load for specification in the distribution server computer 100 than reading the frusta arrangement information updated in step S213. For example, a storage area different from the database from which the frusta FS is read in steps S223, S215, etc. in the storage 103 of the distribution server computer 100 (or it may be past updated frusta arrangement information temporarily stored as a cache), such as a frusta FS displayed in a simple (e.g., plain) form of the frusta FS or a frusta FS predetermined by the operator side, is a frusta FS that is not updated (not displayed) depending on the establishment of the switching condition, but is not limited to this, and may be a predetermined frusta FS among the frusta FS that can be updated (displayed) depending on the establishment of the switching condition, or may be a frusta FS included in the already read frusta arrangement information. In step S235, if the desired frusta arrangement information cannot be read (specified) due to a load on the database, etc., information for displaying an alternative frusta FS with a lighter processing for specification is distributed to the viewer terminal 300 instead of the unreadable data.

[0299] Also, if only a part of the information of the frusta FS read in step S215 is read normally, steps S245 and S205 are used to supplement the missing locations excluding the part that could be read. For example, if the information of display areas A and B is being read but only the information of display area A can be read, a process for supplementing the information of display area B is performed. Note that even if only a part of the information of the frusta FS read in step S225 can be read, it may be replaced with the information of all alternative frusta FS in step S245.

[0300] As a result, the user can receive the information of the frustum FS that substitutes for the information of the default frustum FS that could not be read due to the load on the database. Therefore, it is possible to avoid problems such as being unable to enter the virtual space because the information for displaying the virtual space cannot be received. That is, a priority order for display is determined for the objects that can be displayed. If the objects with a high priority that were essential for establishing the content provided by the virtual space can be received, the virtual space is displayed regardless of whether the objects with a low priority that are not essential can be received normally. At the same time, when the data of the objects with a low priority that are not essential can be specified, the objects are displayed in a display mode based on the data. On the other hand, when the data cannot be specified, alternative objects corresponding to the objects are displayed.

[0301] FIG. 34 shows an example in which a frustum FST associated with a special user is further arranged in the display area A in the display example of the display screen 310 of user 1 in FIG. 29. The frustum FST is a frustum FS associated with a talent user related to the attribute "black fox", and is, for example, a special frustum FST prepared or purchased by the special user. At the timing of FIG. 34(A), the frustum FST of the special user is displayed at the upper right display position A4 in the display area A by default. The frustum FST prepared or purchased by the special user is displayed in the display area, and even if the switching condition is satisfied, the frustum arrangement information of the frustum FST will not be switched to other frustums.

[0302] Next, in FIG. 34(B), when user 1 purchases frusta FS1, the frusta FS1 purchased by user 1 are displayed at the display position A1 in the display area A. When a user purchases a frusta FS, as described above, a display area is selected and a display position within the display area is determined. However, the display positions where frusta of special users are displayed as described above are excluded from the display positions to be determined. This can prevent the display positions from being determined to be the display positions of frusta of special users even if a user purchases a frusta.

[0303] Thereafter, even after the switching timing when the switching condition in FIG. 34(C) is satisfied, in addition to the frusta FS1 purchased by user 1 himself / herself, the frusta FST of the special user continue to be displayed at the display position A4. Similarly, at the timing of FIG. 34(D) which is the next switching timing, the frusta FS1 and the frusta FST continue to be displayed.

[0304] Note that in the space area ER5, a display area (special display area) where all the frusta FS to be displayed are frusta FS of special users may be provided, or a single unit area where the frusta FS of special users are displayed individually in an object or photo spot manner may be provided. Further, the frusta to be displayed in the above-mentioned special display area or single unit area may be switched to frusta FS associated with other special users in accordance with the satisfaction of the switching condition among the frusta FS associated with the special users.

[0305] In this embodiment, the frusta FS (specific objects) can be purchased and owned in multiple numbers per user. Therefore, the greater the number of frusta FS purchased by a user, the higher the ratio of being determined as the default frusta FS when the switching condition is satisfied, and the higher the possibility of being displayed within the spatial area ER5 in the viewer terminals 300 of other users. For example, as illustrated in FIG. 27(C), user 1 owns three frusta FS, while user 2 owns only one frusta FS. Thus, when randomly selected with a uniform probability, the ratio of any one of user 1's frusta FS being determined as the default frusta FS is three times higher than the ratio of user 2's frusta FS being determined. Therefore, in order to appeal to other users, users can be motivated to purchase more frusta FS.

[0306] On the other hand, even if a certain user owns a huge number (e.g., 10,000) of frustas FS, if the default frustum FS is more likely to be determined as the number of owned frustas increases as described above, the ratio of the frustum FS of the user who owns a huge number being determined as the default frustum FS and being displayed will be extremely high. As a result, there is a risk that the display mode of the frustum FS displayed in the display area of other users will become less distinctive, or that it will be misused, or that it will cause discomfort to other users. To prevent these situations, in this embodiment, for a user whose number of purchased and owned frustas FS has reached a predetermined number (e.g., 100), regardless of whether the user has more than the predetermined number of frustas FS, the number of purchased and owned frustas FS is assumed to be the predetermined number, and the default frustum FS is determined so as to have the same ratio (probability) as that of a user whose number of purchased and owned frustas FS is the predetermined number. For example, when the predetermined number is 100, the ratio of the frustum FS of a user who purchases and owns 100 or more frustas FS being determined as the default frustum FS is the same as the ratio of the frustum FS of a user who purchases and owns 100 frustas FS being determined as the default frustum FS, even if the actual number of owned frustas is 1,000, 10,000, etc. This can prevent the frustum FS of a specific user from being displayed too much in the display area of other users' display devices 300.

[0307] (Regarding the change in the display mode during the provision of event content) In this embodiment, during the provision of event content provided on the scheduled date, the frustum FS purchased by the user during the period prior to the scheduled date is displayed in the virtual space. Also, according to an event that occurred in the space area ER5 during the period prior to the scheduled date, the image (display mode) in the live area ER53' which is the event content changes. The event that occurred in the space area ER5 during the period prior to the scheduled date is, for example, that the user purchases a frustum FS and displays / arranges it in the display area within the space area ER5. Hereinafter, with reference to FIGS. 35 to 37, the change in the display mode of the virtual space during the provision of event content will be described.

[0308] FIG. 35 shows an example of a scene of the production of event content (for example, a live performance in which the same type of production as that shown in FIGS. 13 to 24 is executed) provided in the main hall of the area ER53' of FIG. 24 that functions as a virtual stage G. The virtual stage G in FIG. 35 will hereinafter be described as the virtual stage G2. On the virtual stage G2, performer avatars 1a to 1d are on stage. Attributes "cherry blossom", "oni", "white fox", and "black fox" are respectively associated with the performer avatars 1a to 1d. These attributes correspond to the attributes associated with the frusta FS shown in FIG. 27(A).

[0309] During the provision of the event content, as shown in FIG. 35, a production is performed in which the performer avatars 1a to 1d hold the frusta FS and introduce them. In this embodiment, when the viewing user has purchased the frusta FS during the pre-scheduled period, a production is performed in which the performer avatars 1a to 1d hold the frusta FS purchased by the user. FIG. 36 is an example of a data table for specifying the frusta FS used in the production of the event content of FIG. 35. FIG. 36(A) shows the default event frusta information common to all users managed in the distribution server computer 100 (for example, gift data 134, etc.). The frusta FS during the provision of the event content displayed on each user's display device 310 is specified based on the event frusta information in FIG. 36(A) and the purchased frusta-related information for each user in FIG. 27(C).

[0310] For the production of event content in this embodiment, a total of nine frusta FS are used, namely the frusta FS of sizes "large" and "small" for each of the attributes "cherry blossom", "demon", "white fox", and "black fox", and the frusta FS of the attribute "luxurious and magnificent". The default frusta FS in Fig. 36(A) is determined by randomly selecting in advance for each attribute and size from among the frusta FS purchased by any user during the pre-scheduled period from after the end of the pre-scheduled period to the start of the event content. As shown in Fig. 36(A), information specifying the default frusta FS used for the production is associated with each attribute and size of the frusta FS. For example, as the frusta FS of size "large" for the attribute "cherry blossom", the frusta FS with the character "A4" displayed for frusta ID "a4" is associated. Note that not all types of frusta FS that can be purchased before the scheduled date exemplified in Fig. 27(A) need to be used for the production of event content, and even a part may be sufficient. For example, in this embodiment, it is assumed that the attribute "plain" is not used for the production during the provision of event content.

[0311] The distribution server computer 100 transmits the event frusta information in Fig. 36(A) and the purchased frusta-related information for each user in Fig. 27(C) to the viewer terminal 300 of the participating user at the start of the event content (login) or at a predetermined timing during the provision.

[0312] In the viewer terminal 300 of each user, among the flusters specified from the received event fluster information, the fluster having the same attributes and size as the fluster specified from the purchased fluster related information of the user is switched to the fluster specified from the purchased fluster related information of the user, and the event fluster data shown in Fig. 36(B) is updated. In this embodiment, when a user has purchased and owns multiple flusters FS of the same attribute and size, the last (most recent) purchased fluster FS is set (associated with the table) as the event fluster information. As shown in Fig. 27(C), for User 1, the number of owned flusters FS of size "small" with the attribute "sakura" is one with the fluster ID "a3". Therefore, by default in Fig. 36(A), the fluster FS of size "small" with the attribute "sakura" was associated with the fluster ID "b4", but as shown in Fig. 36(B), in the event fluster information of User 1, "a3" is associated. Also, as shown in Fig. 27(C), User 1 owns two flusters FS with the attribute "luxurious and gorgeous" with the fluster IDs "b3" and "c3". Since "c3" was purchased later than "b3", in Fig. 36(B), "c3" is associated with the attribute "luxurious and gorgeous". As a result, for users who did not purchase a fluster during the scheduled early period, the default event fluster information is maintained, and for users who purchased a fluster during the scheduled early period, the event fluster information is updated to replace the fluster with the same attributes and size in the default event fluster information with the purchased fluster.

[0313] On each viewer terminal 300 of each user, an effect during the provision of event content as illustrated in FIG. 35 is performed based on the set event flaster information. FIG. 35 is an example of a display mode displayed on the display device 310 of User 1 and is displayed based on the event flaster information stored in FIG. 36(B). FIG. 35(A) is an example in which the performer avatars 1a to 1d each have a "small" size of the flaster FS of the attribute corresponding to each attribute. As the flaster FS of the performer avatar 1a, the flaster FS1 of the flaster ID "a3" purchased by User 1 is displayed. Also, in the center of FIG. 35(A), a flaster FS of the attribute "luxurious and magnificent" is displayed, and the flaster FS2 of the flaster ID "c3" that User 1 last purchased is displayed. Further, in FIG. 35(B), the performer avatar 1b and the performer avatar 1c each have a flaster FS of the "large" size of the attribute "ghost". Since User 1 has not purchased a flaster FS of the "large" size of the attribute "ghost", the flaster FS of the flaster ID "g4" defined by default in FIG. 36(A) is displayed. Note that the display mode of the virtual live venue is not limited to the set illustrated in FIG. 35, and various objects may be displayed.

[0314] The effect illustrated in FIG. 35 is performed by transmitting, from the distribution server computer 100, effect information including, for example, information for controlling the display operations of the performer avatars 1a to 1d and information for specifying the attributes and sizes of the flasters to be held in the hands of or displayed (suspended from the ceiling) at predetermined positions in the virtual space of the performer avatars 1a to 1d. On each viewer terminal 300 of each user, based on the effect information, the display mode in the virtual space including the performer avatars 1a to 1d is controlled, and a flaster that matches the information for specifying the attributes and sizes of the flasters specified from the event flaster information (see FIG. 36(B)) updated on each viewer terminal 300 is arranged, whereby the effect illustrated in FIG. 35 can be executed.

[0315] Next, with reference to FIG. 37(A), the event flasta determination process executed in the distribution server computer 100 will be described. In step S301, a flasta to be used for the production during the provision of event content is determined by randomly selecting for each of the above-described flasta attributes and sizes. In step S302, event display flasta information (see FIG. 36(A)) that can identify the determination result is transmitted to the viewer terminal 300. For example, as shown in FIG. 36(A), for each attribute and size, event flasta information in which information identifying the flasta FS determined by the lottery is associated and stored is transmitted to the viewer terminal 300 of a user who plans to participate in or is participating in the event content.

[0316] In step S303, based on the purchased flasta-related information for each user shown in FIG. 27(C), for a user who has a purchased flasta, the purchased flasta-related information for each user is transmitted to the viewer terminal 300 of each user, and the event flasta determination process is terminated.

[0317] Next, with reference to FIG. 37(B), the event flasta identification process executed in the viewer terminal 300 will be described.

[0318] In step S311, the event flasta information (see FIG. 36(A)) received from the distribution server computer 100 in step S302 of FIG. 37(A) is stored as default data for identifying the default flasta FS to be used for the production. In step S312, it is determined whether or not purchased flasta-related information (the information of the user in FIG. 27(C) transmitted from the distribution server computer 100 in step S303 of FIG. 37(A)) has been received. When it is not determined in step S312 that the purchased flasta-related information has been received, the event flasta determination process is terminated.

[0319] On the one hand, when it is determined in step S312 that the purchased frusta-related information has been received, in step S313, based on the received purchased frusta-related information, for each attribute and size, information for identifying the frusta FS purchased by the user is stored as update data. At this time, when a plurality of frusta are identified as frusta having the same attribute and size, based on the purchase date and time, the frusta purchased last (most recently) is identified and stored as the frusta having the said attribute and size.

[0320] In step S314, for the frusta identified from the default data, among the frusta having the same attribute and size as the frusta identified from the update data, a process is performed to rewrite the information of the frusta used for the production to the frusta identified from the update data.

[0321] As described above, for a user who has purchased the frusta FS, for the event display frusta, the frusta purchased by the user himself / herself can be displayed in association with the performer avatar. Also, in this embodiment, when there are a plurality of frusta having the same attribute and size as the purchased frusta, since the frusta FS purchased last is displayed, it becomes possible to display the frusta FS for which a more elaborate frusta FS has been created by the scheduled date for providing the event content. Note that it is not limited to replacing with the frusta FS purchased last, and a frusta determined by lottery from among the frusta having the same attribute and size may be used for the production.

[0322] Also, although the event frusta determination process in FIG. 37(A) was described for an example where it is determined and stored in advance before the event content is provided, it is not limited to this. During the provision of the event content, for example, it may be executed every time a predetermined period elapses (e.g., every 10 minutes, etc.) to update the event frusta information. Alternatively, during the provision of the event content, if the singing part and the MC part are repeatedly performed, the event frusta information for each part may be updated before the start of the next part. During the provision of the event content, the display mode of the production may be changed based on the event frusta information updated during the provision of the event content.

[0323] Note that, as the frusta FS to be the lottery target determined as the event frusta information illustrated in FIG. 36(A), the frusta FS associated with special users may be excluded. Thereby, for example, it will be selected from among the frusta FS associated with fan users (ordinary users) of the performer avatar, and in the production of the event content, the consistency with the displayed frusta FS and the message production for fans such as "Thank you for the support frusta!" will increase.

[0324] (Regarding the processing related to the event content) In the above, an example where the display mode in the space area ER5 can change according to the event that occurred in the space area ER5 during the period before the scheduled date of providing the event content has been described. However, alternatively or in addition, in this embodiment, according to the degree of displaying the image in the space area ER5 on the display device 310 of the viewer terminal 300 when entering or participating in the space area ER5 during the period before the scheduled date of providing the event content in the virtual space ER, processing related to the event content may be performed.

[0325] Processing related to event content includes, for example, processing for changing the display mode of effects during the provision of event content, and processing for granting objects that can be used by the user to the user during the provision of event content. The degree of display is, for example, the number of times the user enters the space area ER5 during the period before the scheduled date. The number of times of entering the space area ER5 may be the number of days in order to count as 1 time when entering multiple times on the same day, or may be the number of times counted as 1 time when staying for a predetermined time (for example, 10 minutes) or more. Note that the degree of display is not limited to this, and may be the staying time in the space area ER5 during the period before the scheduled date, or the degree of displaying a specific area in the space area ER5 (the number of displays, the displayed time, etc.). The specific area may be a predetermined area in the space area ER5, such as an exhibition area or a donation area.

[0326] Hereinafter, an example will be described in which the "degree" of displaying an image in the space area ER5 is the "number of times of entering the space area ER5 (hereinafter also simply referred to as the number of entries) where event content can be held on the scheduled date", and the "processing related to event content" is "processing for changing the production content during the provision of event content" and "processing for granting objects that can be used by the user to the user during the provision of event content".

[0327] The distribution server computer 100 (for example, event data 111 and gift data 134) counts and stores the number of entries for each user during the period before the scheduled date. FIG. 38 is an example of a data table for specifying the "items" given according to the number of entries and the "production content" changed during the provision of event content according to the number of entries.

[0328] The "items" granted (made available) according to the number of room entries are objects that can be used by the user during the provision of event content. For example, they may be limited items that can only be used in event content (such as a live event) held after the end of the scheduled date period, or items that can be used not only in event content held after the end of the scheduled date period but also in content different from such event content. In the case of using in content different from the event content held after the end of the scheduled date period, for example, certain restrictions may be imposed on the performance aspects such as the functions and effects of the item (for example, a certain function cannot be used, the effect is reduced, etc.), or alternatively or in addition to these, they may be limited items related to, for example, the image theme of the event content held after the end of the scheduled date period.

[0329] As shown in FIG. 38, as "items", for example, items that liven up the event by being used during the provision of event content. For example, if the number of room entries during the scheduled date period is 1, limited cracker A that can be used in event content is granted, if it is 2, limited cracker B, if it is 3, limited cracker C, etc. If it is 4, limited fireworks, if it is 5, limited syruium, if it is 6, limited stamps, if it is 7, a limited item set, etc. are granted. The stamp is a stamp that can be used in chats within the virtual space and in message sending and receiving. The item set is a packed set containing a plurality of items. Note that the items shown in FIG. 38 are not limited to items that can be used during the provision of event content and liven up the event, and may be so-called coin-throwing items, etc. Also, as items granted to the user, in addition to items corresponding to the actual number of room entries, items corresponding to a number less than the actual number of room entries may also be granted.

[0330] As shown in FIG. 38, for example, if the number of room entries during the pre-scheduled period is 1 to 3 times, it is a normal performance and the performance content does not change. When the number of room entries reaches 4 or more, the performance content can change. For 4 times, Special Room A is provided, for 5 times, Special Room B is provided, and for 6 times, Special Room S is provided. The provision of a special room means obtaining the right to participate in event content in an animation (display mode) of a virtual live venue different from the normal performance. For example, an area ER53' that can only be accessed by target users who have obtained the right to participate in the live in the special room may be prepared, and event content may be provided within the special room. Alternatively, when providing event content, the image of the live venue set distributed may be replaced with a different image for the target users.

[0331] Also, for 7 times, a performance with a secret costume is provided. The secret costume is the costume (costume object) of the performer avatar that is displayed corresponding to the performer avatar when providing event content. For target users who have obtained the right to perform with the secret costume, data in which the costume data of the performer avatar is replaced with data different from that distributed to other normal users is distributed.

[0332] Regarding an example of event content-related processing to be executed according to the number of room entries illustrated in FIG. 38 in the distribution server computer 100, it will be described with reference to FIG. 39. The event content-related processing is executed, for example, for each user who plans to participate in the event content (for example, in ascending order of user ID number) from after the end of the pre-scheduled period until the start of the event content.

[0333] In step S401, it is determined whether the user has entered the room one or more times during the period before the scheduled date. When it is determined that the user has not entered the room one or more times during the period before the scheduled date, the process ends. For a user determined in step S401 not to be a user who has entered the room one or more times during the period before the scheduled date, event content is distributed based on the data stored by default in the event data 111.

[0334] On the other hand, when it is determined in step S401 that the user has entered the room one or more times during the period before the scheduled date, in step S402, an item corresponding to the number of room entries is assigned. As a result, for example, an item assigned to an item box or the like owned by the user in the virtual space ER will be displayed. It may be assumed that the item enters the box in advance until the start time of providing the event content, but it may be grayed out until the start time of providing the event content and may not be usable until the start time of providing the event content, or it may be usable in a virtual live venue that has been opened since the start time of providing the event content.

[0335] In step S403, production content corresponding to the number of room entries is set for the user, and the process ends. For example, for a user who has entered the room four times, limited fireworks will be displayed in the item box, and information for setting the design of the virtual live venue to the special room A is associated with and stored for the target user.

[0336] (Regarding the re - provision of content for the period before the scheduled date and the event) With reference to FIGS. 24 to 39, examples of event content provided during the pre-scheduled period and on the scheduled date have been described. However, the content provided to the user by the distribution server computer 100 may be re-provided (re-played). In FIGS. 13 to 39, as an example of content, a live event by a performer at a virtual live venue on the scheduled date was exemplified as event content. However, in FIG. 40, the live event provided on the scheduled date and the content provided during the pre-scheduled period before the live event is held (for example, an area that can be used for a limited period related to the live event to be held, an activity, etc.) are collectively referred to as event content. The content provided during the pre-scheduled period is, for example, content related to the live event, and includes the space area ER5 that is released during the pre-scheduled period before the live event described in FIGS. 24 to 39. Hereinafter, the space area ER5 released during the pre-scheduled period and the live event provided in the space area ER5 on the scheduled date will be collectively referred to as event content and described. Note that the content during the pre-scheduled period may include activities (such as game content) that can be used by the user in the space area ER5 released during the pre-scheduled period, objects that can be displayed, and the like.

[0337] FIG. 40 is a diagram for explaining the period before the scheduled date and the re - provision of event content. For example, as shown in FIG. 40(a), a first scheduled period and a second scheduled period are provided as the scheduled date on which the content of a live event is to be provided and the "scheduled period" including the period before the scheduled date. Before the first scheduled date in the first scheduled period, the content in the period before the scheduled date described above is provided, and on the first scheduled date, the content of the live event described above is provided. Also, the second scheduled period for re - providing the event content provided in the first scheduled period can be started after a predetermined period (for example, two months) has elapsed after the end of the first scheduled period. The provision of the event content once ends together with the first scheduled period, but the distribution server computer 100 stores and holds information (re - provision data) for re - providing by taking over the content data at the end of the first scheduled period. The stored re - provision data is re - provided to the user in the second scheduled period. The re - provision data includes, for example, information for generating a virtual space (for example, FIGS. 24 and 25), information according to the actions of the user (for example, the user - related information (related to the purchased frustration) in FIG. 27, the frustration arrangement information for each display area shown in FIG. 31), and performer information such as animation data and voice data including the motion data of the performer avatar in the live event (the performer avatar information distributed in FIG. 10, the performer voice, etc.), the information of the event frustration used for production by the performer in the live event illustrated in FIGS. 35 to 37, the data of the game played in the first scheduled period (for example, the previous save data, ranking data, user level), etc. Note that the space area ER5 may also be released for several days after the first scheduled date to provide a period after the first scheduled date, and the content data at the end of the first scheduled period including the period after the first scheduled date may be taken over.

[0338] At the start of the first scheduled period, the frusta FS in the virtual space are displayed in an initial state (for example, in a state where the frusta FS are initially arranged with initial settings), and are updated according to the user's actions (such as purchases) during the first pre-scheduled period as described above. At the start of the second scheduled period illustrated in FIG. 40(a) (for example, when the space area ER5 is re-released), since the information corresponding to the user's actions during the first scheduled period is carried over and reflected in the virtual space, the frusta FS for each display area are arranged based on the frusta arrangement information at the end before the end of the first scheduled period. As a result, when a user who has purchased a frusta FS during the first scheduled period enters the room during the second scheduled period, the frusta FS purchased by the user is arranged at the same position and in the same display mode as it was arranged during the first scheduled period. Note that the frusta arrangement information was the frusta arrangement information at the end before the end of the first scheduled period, but it may be the frusta arrangement information at the end of the first scheduled date or at the end after the first scheduled date.

[0339] Also, in the second pre-scheduled period and in the early stage of the second scheduled date, similar to the first pre-scheduled period, the display mode in the virtual space can be changed according to the actions of the user, and can be made different among users, and the processes shown in FIGS. 32 to 39 are also executed. For this reason, for example, when a user who enters the room in the second pre-scheduled period purchases the frusta FS, as shown in FIGS. 29 and 30, in the virtual space that can be displayed on the viewer terminal 300 of the user, the frusta is displayed in a display mode such as the character mode in which the user has performed an editing operation in a predetermined area designated by the frusta. On the other hand, the purchased frusta FS may not be reflected in the virtual space of other users, and the frusta FS to be displayed may be different among users. Also, every time the switching condition is satisfied, the frusta FS other than the frusta FS that the user has purchased (including both purchases in the first pre-scheduled period and purchases in the second pre-scheduled period) and arranged can be changed and updated. Also, since the data of the game performed in the first pre-scheduled period is inherited and ranking display etc. is performed, and the data such as the games cleared by each user is also inherited, the game can be started from the continuation of the first pre-scheduled period.

[0340] Note that the re-provided data does not include the position information and movement information of the user avatar U of the user who entered the room in the first pre-scheduled period (information for displaying the user avatar U of other users). For this reason, in the second pre-scheduled period, it is assumed that the user avatar U of the user who is actually in the room in the second pre-scheduled period is displayed. However, not limited to this, the re-provided data inherited for re-playing includes the position information and movement information of the user avatar U of the user who entered the room in the first pre-scheduled period, and according to the number of users who entered the space area ER5 in the second pre-scheduled period (for example, when it is less than a predetermined number), virtual avatars may be displayed based on the inherited position information and movement information of the user avatar U.

[0341] Also, on the second scheduled day within the second scheduled period, similar to the first scheduled day, a live event by the performer is held, and users who enter the space area ER5 can watch the event from a perspective corresponding to the operations from the users. Also, in the event on the second scheduled day, similar to the examples shown in FIGS. 35 to 37, the latest frusta (the last purchased frusta) for each user can be associated with the performer avatar and displayed. Note that the default frusta information in FIG. 36(A) may be the same as the frusta FS in the first scheduled period, but it may be made different from the default in the first scheduled period based on the information of the frusta FS purchased by the users in the second scheduled period.

[0342] In FIG. 40(a), an example of carrying over frusta-related information in the first scheduled period to the second scheduled period is shown, but it is not limited to this. As shown in FIG. 40(b), the frusta-related information in the first scheduled period may not be carried over to the second scheduled period. In the case shown in FIG. 40(b), the frusta FS in the virtual space at the start of the second scheduled period is displayed in the initial state similar to the start of the first scheduled period, and then is updated according to the actions of the users in the early stage of the second scheduled day. Note that the initial state of the frusta (the frusta to be displayed and the display mode) at the start of the second scheduled period may be the same as the initial state of the frusta at the start of the first scheduled period, partially different, or completely different (for example, the display mode of the frusta FS in the pre-determined initial arrangement is changed to the design for the second scheduled period).

[0343] Also, on the second scheduled day within the second scheduled period, similar to the first scheduled day, a live event by the performer is held, and users who enter the space area ER5 can watch the event from a perspective corresponding to the operations from the users. However, the default frusta information in FIG. 36(A) may be made different from the default in the first scheduled period based on the information of the frusta FS purchased by the users in the second scheduled period.

[0344] Note that for the re-provided data of the re-provided live event, regarding the actions and voices of the performer's performer avatar, they are the same as the motion data and voice data at the time of the previous provision. However, the display modes other than the actions of the performer avatar are not limited to the same as the previous provision, and may be different between the previous provision and the re-provision. For example, the costumes of the performer avatar at the live event on the first scheduled date and the costumes of the performer avatar at the live event on the second scheduled date may be different.

[0345] (Regarding audio and viewpoint special switching processing) Next, an explanation regarding the performer when the event content is re-provided will be given. During the first scheduled date period of the first scheduled period, the performer (for example, a talent who conducted a live stream, etc.) in the live event on the first scheduled date generally cannot (does not) enter the room. In contrast, during the second scheduled period, during both the second scheduled date period and the second scheduled date, the performer in the live event on the second scheduled date (that is, the same live event as the first scheduled date) can enter the space area ER5 as a participant. The performer avatar that enters as a participant during the second scheduled period is displayed in a display mode different from the display mode of the performer avatar in the live event on the first scheduled date. For example, the performer avatar that is conducting the event as a performer is displayed as a different humanoid three-dimensional model for each performer (for example, the performer avatar 1 in FIG. 13, etc.). In contrast, the performer avatar that enters as a participant during the second scheduled period is displayed as the same user avatar as other general users. However, since the name of the performer is displayed corresponding to the same user avatar as other general users (for example, the user name, an official mark that can be recognized as a performer together with the user name, etc.), other users can recognize that it is the avatar of the performer. Also, the user avatar of a general user may be a simple display avatar instead of a humanoid. For example, if it is a humanoid three-dimensional model, the amount of drawing information increases when displayed in the virtual space. However, a simple display avatar may be a three-dimensional model that can be displayed with a small amount of drawing information. For example, it may be a simple shape composed of a circle, a square, a triangle, etc. (for example, a triangular pyramid, a plain animal shape, etc.).

[0346] Also, when the performer participates as a participant in the live event on the second scheduled date, the performer avatar (an avatar that operates and is displayed based on the motion data and voice data pre-stored as re-provided data) as the performer who conducts the live event and the avatar as the participant can be displayed. Therefore, other users participating in the event can view (display) both avatars at the same time within one virtual space, which can enhance the interest. For example, it is possible to provide a way of enjoyment such as listening to the voice of the performer as a participant who is talking about the mood at the event while looking at the avatar as the performer who conducts the live event. In order to easily perform such a way of enjoyment, in this embodiment, the voice output from the viewer terminal 300 and the process for switching the viewpoint displayed on the viewer terminal 300 are performed.

[0347] In addition, since only the user avatars of the users who enter the same room in principle are displayed on the viewer terminal 300, when the performer enters the virtual space as a participant, the avatar of the performer as a participant is not displayed on the viewer terminal 300 other than the viewers who enter the same room as the performer. However, for the user avatars of the accounts of special users, even if they enter as participants, it is possible to reflect the appearance and voice of the user avatars in other rooms (for example, replicated rooms with the same provided content) by mirroring. As a result, the avatar of the performer as a participant is also displayed in the virtual space displayed on the viewer terminal 300 of the users who do not enter the same room as the performer.

[0348] FIG. 41 is a flowchart showing an example of the voice and viewpoint special switching process for switching the voice and viewpoint. The voice and viewpoint special switching process is executed on each viewer terminal 300. The viewer terminal 300 is configured to display an icon for selecting the setting of the virtual space together with the image in the virtual space, and execute the voice and viewpoint special switching process when an operation on the icon for switching the voice or viewpoint is received.

[0349] In step S411, it is determined whether a voice switching operation has been performed. When it is not determined that a voice switching operation has been performed, the process proceeds to step S413. On the other hand, when it is determined in step S411 that a voice switching operation has been performed, the process proceeds to step S412. When the current voice setting is the normal voice, it is switched to a special voice that enables the output of the voice of a special user. When the current voice setting is the special voice, a process of switching to the normal voice is performed. The special voice is obtained by extracting (or extracting so as to be easily audible) only the voice of a special user (for example, an account of a talent or a famous person including a performer) from the voices output from within the virtual space and outputting it on the viewer terminal 300. Thereby, the user can easily switch to the voice of the performer as a participant. Note that the normal voice is a voice corresponding to the position where the user avatar of the user exists within the virtual space and is a voice generated within a predetermined radius from that position. For example, when located near the event stage, the voice of the performer advancing the event is output at a louder volume than other voices. When located far from the event stage, the voice of another user existing near the user avatar of the user is output at a louder volume than the voice of the performer advancing the event. When a plurality of performers exist as participants, it may be possible to select and set which performer's voice to use. For example, it may be possible to select one specific favorite performer, or it may be possible to select a plurality of performers.

[0350] Note that, due to the operation of switching to the special voice, it is not limited to the case where the output of the normal voice stops, and it may be the case where, in addition to the normal voice, the voice of the special user can be heard. For example, in addition to the voice emitted from a user avatar located around the user avatar operated by the user, even a user avatar located at a distance where the voice cannot normally be heard may be output as long as it is the voice emitted from the user avatar of the special user.

[0351] Also, regarding the audio on the stage, since it is output based on the audio data distributed to the viewer terminal 300 by the generated audio distribution process (Figure 10), it may be output on the viewer terminal 300 regardless of whether normal audio or special audio is selected. During live content distribution, normal audio cannot be selected in the first place (voices such as other users' voice chats cannot be heard), but special audio may be output as secondary audio. Also, special audio may be selectable and output only by users who meet certain conditions (for example, payment or game clearance). Thus, during live content distribution, while enjoying the live (main audio), the voice of the performer avatar as a participant may be output like secondary audio (narration).

[0352] Also, it is not limited to switching audio. For example, it may be something that switches the volume relationship. For example, when the current audio setting is normal audio, normal audio may be output at a volume higher than that of special audio, and when it is special audio, special audio may be output at a volume higher than that of normal audio.

[0353] Next, in step S413, it is determined whether a viewpoint switching operation has been performed. When it is determined that the viewpoint switching operation has not been performed, the audio and viewpoint special switching process ends. On the other hand, when it is determined in step S413 that the viewpoint switching operation has been performed, the process proceeds to step S414. When the current viewpoint setting is the normal viewpoint, it switches to a special viewpoint that focuses on the user avatar of a special user (for example, the avatar of a performer who has entered the virtual space as a participant), while when the current viewpoint setting is the special viewpoint, a process of switching to the normal viewpoint is performed. Thus, the user can easily switch to a viewpoint that focuses on the avatar of the performer as a participant.

[0354] The normal viewpoint is the viewpoint that the user avatar U of the user in the virtual space is facing, and an image in the virtual space that can be visually recognized from this viewpoint is displayed. For example, when facing the event stage, an image including the avatar of the performer who is progressing the event is displayed, and when facing the side opposite to the event stage, an image in the virtual space on the side opposite to the event stage is displayed.

[0355] On the other hand, the special viewpoint is an image taken by a virtual camera arranged in the virtual space, which is taken from an angle that can be different from the normal viewpoint to capture the user avatar of the special user. For example, in the case of an image from a virtual camera that is fixedly arranged in advance, an image obtained from the virtual camera in which the user avatar of the special user is reflected (for example, it may be selected by the operator's operation, or the virtual camera may be selected based on the position information of the special user) may be distributed to the viewer terminal 300. Alternatively, an image in which the avatar of the performer as a participant being photographed by the operator (for example, the operator account) of the virtual camera (for example, drone photography in the virtual space) is reflected may be distributed to the viewer terminal 300. For example, it may be a viewpoint that captures the avatar from an obliquely upward overhead view. In addition, when there are a plurality of performers as participants, it may be possible to select and set which performer's avatar to use. For example, it may be possible to select one specific favorite performer, or it may be possible to select multiple performers.

[0356] Note that the switching operation to the special voice and special viewpoint in the voice and viewpoint special switching process may be operable only by users who satisfy a predetermined condition such as charging. Also, either the special voice or the special viewpoint may be operable only by users who satisfy a predetermined condition.

[0357] (Regarding the special processing for room entry) In this embodiment, the virtual space is provided using a plurality of rooms in order to provide the same content to a plurality of users simultaneously. As a result, for example, content such as the space area ER5 that constructs a virtual live venue where the event content of the scheduled date period and the scheduled date described above with reference to FIG. 40 is provided is provided using a plurality of rooms, so that it can be distributed to many users simultaneously. Note that, for example, one room can be defined for one server, but a plurality of rooms may be defined for one server.

[0358] FIG. 42(a) is a diagram for explaining a plurality of rooms that constitute a space area ER (for example, rooms corresponding to areas ER51 to ER53 of the space area ER5 that constructs a virtual live venue, or rooms corresponding to the area ER53' in FIG. 24 where a live event is provided on the scheduled date having the same mode as the area ER53) where predetermined content is provided. The plurality of rooms include a main room in which a virtual space is constructed and an actor enters (is associated) in an event, and a plurality of other rooms (room 1, room 2, room 3,...) in which the virtual space (including the actor's avatar) in the main room is mirrored. A user who wishes to enter the virtual live venue is randomly assigned (associated) to a room designated by the user among the plurality of rooms, or to any room by a load distribution system if no designation is made, and can display the same image of the virtual live venue. For example, it may be at the time of entering by logging in to the virtual space, or a screen for allowing the user to select the content (for example, area) to enter after logging in may be displayed, and when the user selects the area to enter instead of designating the room ID and no room is designated, it may be randomly assigned to any room.

[0359] On the one hand, actions from users in the virtual space (such as voice, actions, comments, etc.) can be shared with users who have entered the same room, but cannot be shared with users who have entered other rooms. Therefore, for example, in situations where talents, celebrities, etc. wish to enter the same room in order to liven up the atmosphere of an event in the virtual space, or in situations where other users in a friendship relationship already in the room wish to enter the same virtual space, it is desirable to allow them to enter the same room.

[0360] However, for each room, an upper limit number (for example, 200 people, etc.) is set in advance as the maximum number of users who can enter, taking into account the server's processing capacity and load concentration. Therefore, when strictly applying the upper limit number to allocate rooms, in the above-mentioned situations, it may not be possible to allow users to enter the same room, and there is a risk of not being able to meet the users' demands. On the other hand, the upper limit number is generally set to a value with a margin considering the server's processing capacity so that there is no impact on distribution (such as a state where distribution is impossible) even when the load on the server is concentrated.

[0361] Therefore, in this embodiment, when certain conditions are met, even if the upper limit is exceeded when entering a room, special processing is performed to allow entry into the same room. FIG. 42(b) is a flowchart showing an example of the special processing for room entry. The special processing for room entry is executed by the distribution server computer 100. The distribution server computer 100 is configured to execute the special processing for room entry when it receives a room entry request for a room where predetermined content is provided to a user (for example, constituting a spatial area ER that constructs a virtual live venue). The room entry request may be at the timing of logging in to the virtual space (a room ID may be specified at this time), or a screen for selecting content (such as an area) to enter may be displayed on the title screen or the like after logging in, and the special processing for room entry may be executed at the timing when the content is selected (a room ID may be specified at this time). Examples of the certain conditions include, but are not limited to, when a special user enters a room by specifying it in the virtual space, or when a user having a relationship with the user attempting to enter a room is already in any room.

[0362] The special user includes, for example, the account of a performer who performs as a performer in a live event (such as the performer user ID and account in FIG. 8), a talent, a famous person, etc. (any of which may also be a performer). For example, it may be an account of a user predetermined as a special user by an operator, or an attribute number or the like that can identify a talent, a famous person, etc. may be pre-assigned together with the user ID and account of the viewer user data stored in the storage 103. Further, the special user in the special processing for room entry may include an operator who operates the virtual space or a person related to a talent (such as a manager). Examples of the operator include an account of a user who has the authority to operate the virtual camera. This enables shooting the video in the room entered by the talent with the virtual camera and displaying it on the viewer screen of other users, or transmitting the video data to other computers (such as an external server for live distribution).

[0363] The case of having relevance with a user includes, for example, in the virtual space provided by the distribution server computer 100, providing a follow function such as a friend function, and being in a mutual follow relationship, or the intimacy being equal to or higher than a predetermined value. The intimacy is calculated based on the behavior history in the virtual space, etc. For example, it may be increased by factors such as a large number of chat times, a large number of co-op game times, and a large number of times of being present within a predetermined range from location information, etc. Also, among special users, special users with an intimacy equal to or higher than a predetermined value, or special users who are scheduled to appear in the same live event, etc., who need to be made to enter the same room in the content in progress by the operator, become users having relevance with each other.

[0364] In step S421, it is determined whether or not it is the entry of a special user. When it is determined in step S421 that it is the entry of a special user, it is determined in step S422 whether or not a room has been designated. For example, when a room ID is input on the terminal of the account of a talent who is a special user, a request for designating a room ID is transmitted to the distribution server computer 100 together with the request for entry into the room. When it is determined in step S422 that a designation has been made, in step S423, regardless of the number of users in the designated room and the upper limit number, a process of making the entry associated with the designated room is performed. In the distribution server computer 100, it is determined whether the user with the entry request is a special user based on the ID of the user, and if a room ID is designated, the user is made to enter the room with the designated room ID. For example, a process of associating the user ID of the entered special user with the designated room ID is performed.

[0365] Note that the room IDs that allow entry regardless of the upper limit number in advance may be determined by the operator in advance. That is, when a room ID other than the room ID that allows entry regardless of the predetermined upper limit number is specified, if the number of people entering the specified room has already reached the upper limit number, it may be considered that entry into the room is not possible. Also, in step S421, entry may be allowed into a room where a special user who has a relationship with the special user entering has already entered.

[0366] On the other hand, when it is not determined that the entry is of a special user, or when the entry is of a special user but no room is specified, in step S424, it is determined whether a user who has a relationship (for example, a friend relationship, a relationship where the intimacy is equal to or higher than a predetermined value, etc.) with the user attempting to enter has already entered any room. When it is determined in step S424 that a user having a relationship has already entered any room, in step S425, a process of allowing entry associated with the room where the user has already entered is performed regardless of the number of users in the room where the user has already entered and the upper limit number. Note that when users having a relationship are dispersed in a plurality of rooms, entry may be allowed into the room where the most users having a relationship have entered. Alternatively, among the rooms where users having a relationship have entered, entry may be preferentially allowed from the room with the lowest congestion level.

[0367] On the contrary, when it is determined in step S424 that a user having a relationship has not entered any room, in step S426, a process of allowing entry associated with any of the rooms that have not reached the upper limit number is performed. For example, a process of distribution by normal load distribution processing is performed.

[0368] (Regarding the component reset of the humanoid avatar of the performer) Next, with reference to FIG. 43, a process for resetting an abnormal display of an object that sways in conjunction with a character object will be described for a process executed at a predetermined timing. As shown in FIGS. 13 and 20, the humanoid avatar of the performer is associated with a character object in the form of a human (a three-dimensional model with bones (skeleton)), such as a clothing object corresponding to the clothing worn by the character object. In addition, components (function parameters) are associated with the objects displayed in the virtual space, enabling various objects to be displayed and operated in the virtual space. The character object and the clothing object are each preset with various components (for example, various parameters such as so-called colliders and rigid bodies) used for physical calculations (calculation processes such as collision detection, gravity, and movement). The object data associated with various components is included in the virtual space update data of FIG. 10 and distributed to the viewer terminal 300. Also, in the viewer terminal 300, based on the motion data of the performer (performer avatar information included in the virtual space update data of FIG. 10) distributed by the distribution server computer 100, a process for operating and displaying the character object is performed. On the other hand, the clothing object is an object that displays a swaying motion (for example, cloth such as clothes or hair), and physical calculations are performed in conjunction with the motion of the character object to display the motion (for example, calculation processing based on a component that performs calculations on swaying objects such as cloth that functions in conjunction with the skin mesh associated with the character object). In this way, in the viewer terminal 300, a process for performing physical calculations and operating and displaying the clothing object (for example, swaying, bouncing, bending, etc.) in the same way as the real space according to the motion of the character object is performed.

[0369] In this way, the arithmetic processing for operating and displaying character objects and clothing objects is performed on the viewer terminal 300 based on the virtual space update data streamed from the distribution server computer 100 at predetermined intervals. When the operation display process using the previously received virtual space update data is completed, the operation display process is executed based on the data received next.

[0370] Here, even if the data to be distributed is the same, differences may occur among users due to the processing capabilities and communication environments (e.g., frame rate reduction) of the viewer terminals 300. Particularly, in the case of viewer terminals 300 with low processing capabilities or communication speeds below a certain level, for example, because it takes time to calculate by physical operations (slow drawing speed), when the movement speed and movement range of characters are large, there is an increased risk of calculating and displaying abnormal display modes as the display modes of clothing objects. For example, it may occur that the final movement position of the character object based on the previously received streaming data and the starting movement position of the next received streaming data deviate greatly. Then, an object such as a skirt that is supposed to move smoothly following the character object will not move smoothly, but will move extremely wildly. As an example, as a result of the performer's intense movement, due to the movement of the colliders of various objects, for the skirt object, it is calculated that the hem of the skirt has entered the upper part of the skirt or the feet of the character object, and the skirt is displayed in a state where the hem is rolled up. Or for the wing object, it is calculated that the tip of the wing has entered a part around the middle of the wing, and the wing is displayed in a state where it is bent and cannot flap. In the present embodiment, in order to eliminate the continuation of such abnormal display modes, the distribution server computer 100 performs component reset processing as a process for resetting the display state of the object to neutral.

[0371] FIG. 43 is a flowchart showing an example of component reset processing. The component reset processing is executed by the distribution server computer 100. The distribution server computer 100 executes the component reset processing every time a predetermined time (for example, 2 ms) elapses when distributing virtual space update data including data for operating a humanoid avatar. Hereinafter, as an example, the case where the above-described live event is being provided (distributed) will be described.

[0372] In step S431, it is determined whether or not it is the timing at which a series of actions by the performer avatar has ended. The timing at which a series of actions has ended is the timing at which the action that the performer avatar can continue has once ended, and the movement speed and movement range of the performer avatar have become smaller and the movement has calmed down. For example, in the case of content where the performer sings while dancing, it includes the timing when one song has ended, the inter-song timing until the start of the next second song, the start timing of the second song, and the like. Alternatively, in the case of content where the performer performs an attraction, it includes the timing when one attraction has ended, the timing until the start of the next second attraction, the start timing of the second attraction, and the like. In the present embodiment, any of these timings can be applied as the timing at which a series of actions has ended. In the distribution server computer 100, it is determined whether the movement speed and movement range have become less than a predetermined amount. Whether or not it has become less than the predetermined amount can be determined when the acceleration has become less than or equal to a predetermined value (alternatively, it may be when it has continued for a predetermined second).

[0373] When it is not determined in step S431 that the timing is when a series of actions by the performer avatar has ended, the component reset process is terminated. On the other hand, when it is determined in step S431 that the timing is when a series of actions by the performer avatar has ended, in step S432, a component reset signal is distributed to the viewer terminal 300 to terminate the component reset process. The component reset signal is a signal for causing physical calculations for an object (for example, a clothing object) displayed corresponding to a character object to be performed from a predetermined initial state. That is, normally, it is a signal for causing the calculations following the result calculated based on the previously received streaming data to be calculated from the initial state without being based on the previously calculated result. As a result, even if the display state of the clothing object is in an abnormal mode, the display state is reset neutrally and then physical calculations are performed.

[0374] In this way, in the viewer terminal 300, in order to perform physical calculations and cause the clothing object to move and be displayed in the same way as in the real space according to the movement of the character object, for example, when calculating the current acceleration, etc., taking into account the acceleration of each part of the clothing object at the previous calculation timing in the physical calculation, when a component reset signal is received, the current acceleration, etc. is calculated from a predetermined initial state (for example, zero acceleration) without considering the acceleration of each part at the previous calculation timing. As a result, even if an abnormal state is calculated and displayed as the state of the clothing object during a series of actions, the state of the clothing object can be restored to the state calculated from the initial state (neutral state). For example, a state where the hem of a skirt is rolled up or a state where the wings are bent and cannot flutter can be eliminated. As a result, there is a risk of calculating and displaying a state that should not originally be possible as the state of the clothing object, and causing the clothing object, etc. to move and be displayed in an abnormal state with respect to the character, etc. Even if the possibility is higher when the movement speed and movement range of the character, etc. are large, the abnormal state can be eliminated.

[0375] Note that the component reset signal may be an instruction to start physical calculations from the initial parameters of the clothing object (parameters in the state of wearing when the character object is in the initial posture, and a neutral display state such as a state where no acceleration is applied), or may be to set the components (parameters such as acceleration and gravity) of the clothing object to the same parameters as the initial position (when the character object is in the initial posture).

[0376] <Examples of specific configurations and effects>

[0377] (1-1) In the above-described embodiments, as described with reference to FIGS. 1 to 25 and the like, the distribution server computer 100 generates a virtual space ER and transmits information for displaying an image in the virtual space ER that corresponds to an operation from the user based on the stored program and the method of controlling the computer by the program (hereinafter simply referred to as the program). The viewer terminal 300 performs a process for displaying an image corresponding to an operation from the user according to the information from the distribution server computer 100 based on the stored program. Also, as described with reference to FIGS. 26 to 28 and the like, the distribution server computer 100 performs a process for arranging and updating an object such as a frusta FS purchased in response to a purchase operation from the user in the virtual space ER based on the stored program. The viewer terminal 300 performs a process for arranging and displaying the object purchased in response to the arrangement update in the distribution server computer 100 and the purchase operation from the user in the virtual space ER based on the stored program. Further, as described with reference to FIGS. 13 to 23 and FIGS. 35 and the like, the distribution server computer 100 performs a process for constructing a space for providing event content on a scheduled date in a space area ER5 in the virtual space ER based on the stored program. The viewer terminal 300 enables the event content to be provided on the scheduled date in the space area ER5 constructed by the distribution server computer 100 based on the stored program.

[0378] Also, in this embodiment, even during the period before the event scheduled date, the distribution server computer 100 and the viewer terminal 300 each perform processing based on the stored program to enter the spatial area ER5 in response to an operation from the user and display an image within the spatial area ER5, and perform processing to be able to arrange and display the purchased object within the spatial area ER5 in response to a purchase operation. Further, as shown in FIGS. 26, 29, 30, 34, and 35, etc., the distribution server computer 100 and the viewer terminal 300 each perform processing to change the display mode within the spatial area ER5 in response to arranging and displaying an object such as a frusta FS within the spatial area ER5 during the period before the scheduled date based on the stored program. Thereby, during the period before the scheduled date, the spatial area ER5 where the event content is provided and the event that can change the display mode within the spatial area ER5 can be shared and provided to the user, so that the interest in the event content can be gradually improved from before the event content is provided.

[0379] (1-2) The distribution server computer 100 and the viewer terminal 300 each perform processing to change the display mode of each display area within the spatial area ER5 as shown in FIGS. 26, 28, and 29, etc., in response to the purchase status of the user's frusta FS during the period before the scheduled date shown in FIG. 27(C), etc., based on the stored program. Thereby, during the period before the scheduled date, the user can be made to pay attention to whether the frusta FS is purchased by the user, what attributes the purchased frusta FS has, what decorations are applied, where it is displayed, and as a result, how the display mode of each display area within the spatial area ER5 changes.

[0380] (1-3) In the pre-scheduled period, the display mode of each exhibition area within the spatial area ER5 that can change can, for example, as described by comparing FIGS. 29 and 30, become a display mode different from the display mode presented to other users than the user in question, in response to the user purchasing and placing the frusta FS during the pre-scheduled period. This enables the display mode of each exhibition area within the spatial area ER5 during the pre-scheduled period to be customized for each user, allowing each user to feel a sense of specialness.

[0381] (1-4) As shown in FIG. 35 etc., the distribution server computer 100 and the viewer terminal 300 each perform processing to change the display mode of the production of the live event held within the spatial area ER5 during the provision of event content, in response to the user purchasing and placing the frusta FS during the pre-scheduled period, based on the stored programs. This enables the user to be drawn attention to whether the frusta FS is purchased by the user during the pre-scheduled period, what attributes the purchased frusta FS has and what decorations are applied, and as a result, how the display mode of the production of the live event held within the spatial area ER5 during the provision of event content changes.

[0382] (1-5) The production of the live event held within the spatial area ER5 that can change during the provision of event content can, for example, as described by FIGS. 27(C), 35, and 36 etc., become a display mode different from the display mode presented to other users than the user in question, in response to the user having purchased and placed the frusta FS during the pre-scheduled period. This enables the display mode of the production of the live event held within the spatial area ER5 during the provision of event content to be customized for each user, allowing each user to feel a sense of specialness.

[0383] (1-6) As an event for changing the display mode in the spatial area ER5, it is an action in response to the purchase operation of the frusta FS from the user, and it is an action that reflects the purchased frusta FS by being displayed and arranged in the display area within the spatial area ER5. For example, it exemplifies the action of being arranged in a predetermined display area A of the spatial area ER5 in step S109 by the purchase operation of the frusta FS from the user in step S107 of FIG. 28. Thus, since an event for changing the display mode in the spatial area ER5 can be caused by the user's own operation, it is possible to improve the user's participation awareness while prompting the user to operate.

[0384] (1-7) As an example of an event for changing the display mode in the spatial area ER5, it is the purchase operation of the frusta FS, which is an action in response to the operation from another user (for example, user 1 who is another user for user 2 in FIGS. 29 and 30), and it is an action that is reflected by being displayed and arranged in the display area within the spatial area ER5. For example, it exemplifies the action of being purchased by another user 1. That is, as shown as an example in FIG. 30(D), on the display device 310 of user 2, the frusta FS1 that cannot be arranged and displayed unless another user 1 has purchased it can be arranged and displayed in a predetermined display area A by being randomly selected from the default frusta FS to be displayed due to the action of another user 1 having purchased it. Thus, since the display mode in the spatial area ER5 can also become an event for changing due to the operations and actions of other users, it is possible to make the change in the display mode interesting and improve the interest.

[0385] (1-8) As an example of an event that changes the display mode within the spatial area ER5, the satisfaction of the switching condition is illustrated. Also, even if an event that changes the display mode within the spatial area ER5 occurs, the distribution server computer 100 and the viewer terminal 300 each perform processing to enable the display of the frustration FS related to the special user within the spatial area ER5 based on the stored program. For example, the display position of the frustration FS purchased by the user is determined by lottery from positions other than the display position of the frustration FS of the special user. Also, even when the switching condition is satisfied, as shown in FIG. 34, the display and presentation of the frustration FST associated with the special user continue. As a result, the display mode related to the special user can be continued without change, so that the convenience and superiority of the special user can be maintained and improved. Also, since it becomes possible to use objects such as the frustration of the special user for advertising and PR, for example, it becomes easier for the operator to solicit sponsorship from sponsors who can be an example of special users.

[0386] As shown in FIG. 24, within the spatial area ER5, there are provided a region ER53' of the second virtual space used for providing event content on the scheduled date, and a region ER53 which is a part of the first virtual space having the same display mode (the same, similar, etc.) as the region ER53'. The distribution server computer 100 and the viewer terminal 300, respectively, based on the stored programs, until, for example, the day before the event scheduled date during the period before the scheduled date, the portal P is not displayed and entry into the region ER53' is restricted while entry into the region ER53 is permitted and an image of the region ER53 can be displayed in response to an operation by the user. After the day before the event scheduled date when the release condition is satisfied, by closing the gate of the large gate object 53c leading to the region ER53, entry into the region ER53 is restricted while the portal P is displayed and entry into the region ER53' of the second virtual space is permitted and processing is performed to enable an image of the region ER53' to be displayed in response to an operation by the user. Thereby, by switching the region used according to whether the release condition is satisfied, a virtual space can be provided using a region suitable for the user's actions before the event content is provided before the release condition is satisfied, and a virtual space can be provided using a region suitable for the provision of the event content after the release condition is satisfied.

[0387] (1-10) As shown in FIG. 24, in the spatial area ER5, areas ER51 and ER52, which are part of the first virtual space, are provided. The area ER51, area ER52, and area ER53 in FIG. 24(A), which is the first virtual space, can be seamlessly traveled between (it is possible to travel between them by moving the user avatar from one area to the other by user operation). On the other hand, the area ER53' of the second virtual space and the areas ER51 and ER52, which are part of the first virtual space, are formed separately. As shown in FIG. 24(B), the first virtual space and the second virtual space can travel between each other through a fade-out display from the portal P of area ER53' and area ER52. Thereby, before the liberation condition is satisfied, the convenience of traveling between the area ER51, area ER52, and area ER53 in FIG. 24(A), which is the first virtual space, can be improved. After the liberation condition is satisfied, when moving to the area ER53' of the second virtual space, a fade-out display can be given to give the user a sense of specialness and tension, etc., and the interest can be improved.

[0388] (1-11) The liberation condition can be satisfied by being the day before the scheduled date when the event content is to be provided. Thereby, a period before the liberation condition is satisfied, a period after the liberation condition is satisfied but before the event content is provided, and a period during the event content being provided can be formed, and the interest can be improved in a more step-by-step manner.

[0389] (1-12) The display mode in the variable spatial area ER5 includes the frusta FS displayed in the display area within the spatial area ER5. The event that changes the display mode in the spatial area ER5 includes the event that the user purchases a frusta FS during the pre-scheduled period and associates it with the user and arranges the frusta FS in the selected display area within the spatial area ER5. Thereby, during the pre-scheduled period, by arranging the frusta FS purchased by the user in the display area selected by the user, the display mode of the display area can be changed, and the interest of the user can be improved.

[0390] (1-13) Events that change the display mode within the spatial area ER5 include events that generate the display mode (such as decorations like characters) of the frusta FS in response to operations from the user when a...

Claims

1. A computer for providing a virtual space to a user, means for displaying an image in the generated virtual space, the image being responsive to an operation from the user, means for causing an event to occur in the virtual space, functioning as means for providing event content in a predetermined type of virtual space within the virtual space for a first predetermined period, during the first predetermined period, it is possible to cause an event to occur in the predetermined type of virtual space by the means for causing the event, and to display an image in the predetermined type of virtual space in response to an operation from the user by the means for displaying, and it is possible to change a display mode in the predetermined type of virtual space according to the event that has occurred in the predetermined type of virtual space, the computer, also functioning as means for re-providing event content in the predetermined type of virtual space in a second predetermined period after the first predetermined period has elapsed, the means for displaying sets the display mode in the predetermined type of virtual space at the start of the second predetermined period as the display mode corresponding to the event that occurred in the first predetermined period, and it is possible to change the display mode in the predetermined type of virtual space according to the event that has occurred in the predetermined type of virtual space during the second predetermined period. A program.

2. A computer for providing a virtual space to a user, means for displaying an image in the generated virtual space, the image being responsive to an operation from the user, means for causing an event to occur in the virtual space, functioning as means for providing event content in a predetermined type of virtual space within the virtual space for a first predetermined period, during the first predetermined period, it is possible to cause an event to occur in the predetermined type of virtual space by the means for causing the event, and to display an image in the predetermined type of virtual space in response to an operation from the user by the means for displaying, and it is possible to change a display mode in the predetermined type of virtual space according to the event that has occurred in the predetermined type of virtual space, the computer, also functioning as means for re-providing event content in the predetermined type of virtual space in a second predetermined period after the first predetermined period has elapsed, The means for causing the display is a program that sets the display mode in the virtual space of the predetermined type when starting the second predetermined period as a predetermined display mode regardless of the event that occurred during the first predetermined period, and can change the display mode in the virtual space of the predetermined type according to the event that occurred in the virtual space of the predetermined type during the second predetermined period.

3. A computer for providing a virtual space to a user, means for displaying an image in the generated virtual space that is an image according to an operation from the user, means for causing an event to occur in the virtual space, functioning as means for providing event content in a virtual space of a predetermined type in the virtual space for a first predetermined period, During the first predetermined period, it is possible to cause an event to occur in the virtual space of the predetermined type by the means for causing the event, and the means for causing the display can display an image in the virtual space of the predetermined type according to an operation from the user, and can change the display mode in the virtual space of the predetermined type according to the event that occurred in the virtual space of the predetermined type. The computer, Even during a second predetermined period after the first predetermined period has elapsed, functioning as means for re-providing event content in the virtual space of the predetermined type, The means for causing the display sets the display mode in the virtual space of the predetermined type when starting the second predetermined period as a different display mode according to whether the user participated in the event content during the first predetermined period, and can change the display mode in the virtual space of the predetermined type according to the event that occurred in the virtual space of the predetermined type during the second predetermined period. A program.

4. A method for controlling a computer for providing a virtual space to a user, comprising: a step of displaying an image in the generated virtual space that is an image according to an operation from the user; a step of causing an event to occur in the virtual space; and a step of providing event content in a virtual space of a predetermined type in the virtual space for a first predetermined period. In the first predetermined period, it is possible to cause an event to occur within the virtual space of the predetermined type by the step for causing the event, and to display an image within the virtual space of the predetermined type in response to an operation from the user by the step for displaying the image, and it is possible to change a display mode within the virtual space of the predetermined type according to the event caused within the virtual space of the predetermined type. Even in a second predetermined period after the first predetermined period has elapsed, there is a step for re-providing event content within the virtual space of the predetermined type. The step for displaying the image is to set the display mode within the virtual space of the predetermined type at the start of the second predetermined period as the display mode according to the event caused in the first predetermined period, and it is possible to change the display mode within the virtual space of the predetermined type according to the event caused within the virtual space of the predetermined type in the second predetermined period. A method.

5. A method for controlling a computer for providing a virtual space to a user, A step for displaying an image within the generated virtual space, the image being responsive to an operation from the user, A step for causing an event to occur within the virtual space, And a step for providing event content within a virtual space of a predetermined type within the virtual space for a first predetermined period, In the first predetermined period, it is possible to cause an event to occur within the virtual space of the predetermined type by the step for causing the event, and to display an image within the virtual space of the predetermined type in response to an operation from the user by the step for displaying the image, and it is possible to change a display mode within the virtual space of the predetermined type according to the event caused within the virtual space of the predetermined type Even in a second predetermined period after the first predetermined period has elapsed, there is a step for re-providing event content within the virtual space of the predetermined type. The step for displaying the image is to set the display mode within the virtual space of the predetermined type at the start of the second predetermined period as a predetermined display mode regardless of the event caused in the first predetermined period, and it is possible to change the display mode within the virtual space of the predetermined type according to the event caused within the virtual space of the predetermined type in the second predetermined period. A method.

6. A method for controlling a computer to provide a virtual space for a user, comprising: A step of displaying an image in the generated virtual space, the image being responsive to an operation from the user; A step of causing an event to occur in the virtual space; A step of providing event content in a virtual space of a predetermined type within the virtual space for a first predetermined period; During the first predetermined period, it is possible to cause an event to occur in the virtual space of the predetermined type by the step of causing the event, and to display an image in the virtual space of the predetermined type according to an operation from the user by the step of displaying the image, and it is possible to change a display mode in the virtual space of the predetermined type according to the event that has occurred in the virtual space of the predetermined type Even in a second predetermined period after the first predetermined period has elapsed, there is a step of re-providing event content in the virtual space of the predetermined type; The step of displaying the image sets the display mode in the virtual space of the predetermined type at the start of the second predetermined period to a different display mode depending on whether the user participated in the event content during the first predetermined period, and it is possible to change the display mode in the virtual space of the predetermined type according to the event that has occurred in the virtual space of the predetermined type during the second predetermined period. Claim 7 A system comprising a computer for providing a virtual space for a user, comprising: Means for displaying an image in the generated virtual space, the image being responsive to an operation from the user; Means for causing an event to occur in the virtual space; Means for providing event content in a virtual space of a predetermined type within the virtual space for a first predetermined period; During the first predetermined period, it is possible to cause an event to occur in the virtual space of the predetermined type by the means for causing the event, and to display an image in the virtual space of the predetermined type according to an operation from the user by the means for displaying the image, and it is possible to change a display mode in the virtual space of the predetermined type according to the event that has occurred in the virtual space of the predetermined type, Even in a second predetermined period after the first predetermined period has elapsed, it has means for re-providing event content within the virtual space of the predetermined type. The means for causing the display is such that the display mode within the virtual space of the predetermined type when starting the second predetermined period is a display mode corresponding to the event that occurred during the first predetermined period, and the display mode within the virtual space of the predetermined type can be changed according to the event that occurs within the virtual space of the predetermined type during the second predetermined period. A system. **Claim 8** A system comprising a computer for providing a virtual space to a user, means for displaying an image within the generated virtual space that corresponds to an operation from the user, means for causing an event to occur within the virtual space, and means for providing event content within a virtual space of a predetermined type within the virtual space for a first predetermined period, During the first predetermined period, it is possible to cause an event to occur within the virtual space of the predetermined type by the means for causing the event, and the means for causing the display displays an image within the virtual space of the predetermined type according to an operation from the user, and the display mode within the virtual space of the predetermined type can be changed according to the event that occurred within the virtual space of the predetermined type Even in a second predetermined period after the first predetermined period has elapsed, it has means for re-providing event content within the virtual space of the predetermined type. The means for causing the display is such that the display mode within the virtual space of the predetermined type when starting the second predetermined period is a predetermined display mode regardless of the event that occurred during the first predetermined period, and the display mode within the virtual space of the predetermined type can be changed according to the event that occurs within the virtual space of the predetermined type during the second predetermined period. A system. **Claim 9** A system comprising a computer for providing a virtual space to a user, means for displaying an image within the generated virtual space that corresponds to an operation from the user, means for causing an event to occur within the virtual space, and means for providing event content within a virtual space of a predetermined type within the virtual space for a first predetermined period, During the first predetermined period, it is possible to cause an event to occur within the virtual space of the predetermined type by the means for causing the event, and to display an image within the virtual space of the predetermined type in response to an operation from the user by the means for displaying, and it is possible to change the display mode within the virtual space of the predetermined type according to the event that has occurred within the virtual space of the predetermined type. Even during a second predetermined period after the first predetermined period has elapsed, it has means for re-providing event content within the virtual space of the predetermined type. The means for displaying makes the display mode within the virtual space of the predetermined type when starting the second predetermined period different according to whether the user participated in the event content during the first predetermined period, and it is possible to change the display mode within the virtual space of the predetermined type according to the event that has occurred within the virtual space of the predetermined type during the second predetermined period. A system.

Images