Information processing apparatus, information processing system, information processing method, and program

Abstract

To provide an information processing apparatus, an information processing system, an information processing method, and a program that can reflect, at a proper timing in a movie viewing period, a performance that a user desires.SOLUTION: An information processing apparatus includes: a movie display control unit which causes a display unit to display at least part a movie of in a virtual space where a character making a performance and an object corresponding to a user viewing the performance are arranged; a reservation reception unit which receives, from the user, a reserving operation for displaying a performance object in the movie when the performance satisfies predetermined conditions; and a performance object display control unit which displays the performance object in the movie when the performance has satisfied the predetermined conditions.SELECTED DRAWING: Figure 15

Description

[Technical Field]

[0001] The present invention relates to an information processing device, an information processing system, an information processing method, and a program. [Background technology]

[0002] It is already known that a video showing a performance such as singing or dancing is distributed to multiple users (viewers), data regarding the reactions of at least some of the users to the performance is obtained, and information corresponding to the reaction data is displayed within the video (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2023-53313 Summary of the Invention [Problem to be solved by the invention]

[0004] However, when reacting while watching a video, the desired effect may not be reflected at the appropriate time due to an incorrect operation or forgetting to operate the device, etc. Also, some users want to react while watching a video and reflect the desired effect, but find the operation burdensome because they want to concentrate on watching the video.

[0005] Therefore, one object of the present invention is to provide an information processing device, an information processing system, an information processing method, and a program that enable a user to reflect the desired effects at the appropriate timing while watching a video. [Means for solving the problem]

[0006] An information processing device according to one aspect of the present invention has a video display control unit that causes a display to display at least a portion of a video in a virtual space in which characters performing a performance and objects corresponding to users watching the performance are arranged, a reservation reception unit that receives a reservation operation from a user to display a performance object in the video when the performance satisfies predetermined conditions, and a performance object display control unit that causes a performance object to be displayed in the video when the performance satisfies the predetermined conditions. [Effects of the Invention]

[0007] According to one aspect of the present invention, a user can schedule an effect object to be displayed at any timing while watching a video, thereby allowing the effect desired by the user to be displayed at an appropriate timing while watching the video. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram showing an example of a display screen of a video showing at least a part of a virtual space according to an embodiment of the present invention. [Figure 2] FIG. 10 is a diagram showing an example of a screen on which a performance object is displayed within a video. [Figure 3] FIG. 10 is a diagram illustrating an example of a reservation screen that accepts a reservation operation. [Figure 4] FIG. 10 is a diagram showing an example of a reservation screen when a reservation operation is accepted from a timeline. [Figure 5] FIG. 10 is a diagram showing an example of a reservation screen displaying recommended performance objects. [Figure 6] FIG. 10 is a diagram showing an example of a reservation screen displaying recommended locations on a timeline. [Figure 7] FIG. 10 is a diagram showing an example of a reservation screen on which the contents of a reservation operation made from the timeline are reflected. [Figure 8] FIG. 10 is a diagram showing an example of a reservation screen on which the contents of a reservation operation made from lyrics are reflected. [Figure 9]FIG. 10 is a diagram showing an example of a reservation screen when a reservation operation is accepted based on the reservation contents of another user. [Figure 10] 1 is a diagram showing a configuration of an information processing system according to an embodiment of the present invention. [Figure 11] FIG. 10 is a diagram illustrating an example of user information. [Figure 12] FIG. 10 is a diagram showing an example of performance object information. [Figure 13] FIG. 10 is a diagram illustrating an example of reservation information. [Figure 14] FIG. 10 is a diagram illustrating an example of performance information. [Figure 15] FIG. 2 is an explanatory diagram illustrating functions of an information processing device according to an embodiment of the present invention. [Figure 16] FIG. 10 is a diagram showing an example of a screen after the display mode of a performance object has been changed in a video; [Figure 17] FIG. 10 is a diagram showing an example of a screen after the display position of a performance object has been changed within a video; [Figure 18] FIG. 2 is a diagram showing an information processing flow according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0009] The present invention will be described in detail below with reference to preferred embodiments (hereinafter referred to as the present embodiment) shown in the accompanying drawings. Note that the basic data processing technologies (communication / transmission technology, data acquisition technology, data recording technology, data processing / analysis technology, image processing technology, visualization technology, etc.) required to realize the contents of the present embodiment are well-known technologies, and therefore a description thereof will be omitted.

[0010] <Summary of the Invention> This embodiment relates to technology for generating, transmitting, and displaying video that can be viewed simultaneously by multiple users, and more specifically, to technology for using video that displays at least a portion of a virtual space. The virtual space is, for example, a virtual live venue, and includes a first area in which characters as performers performing a show are placed, and a second area in which objects corresponding to users watching the performance (hereinafter, audience objects) are placed. Note that in this embodiment, the virtual space is a three-dimensional space, but is not limited to this and may be a two-dimensional space.

[0011] The video is a video that displays a virtual live event held in the virtual space. In this embodiment, the video can be viewed while playing the game, and a user playing the game can view a video of the virtual live event as an in-game event. In the following description, "displaying a video" means expanding the video data distributed while playing the game, playing the video, and displaying it on a display device, and also includes playing back the audio included in the video.

[0012] The virtual live performance may be held at a time specified in a predetermined time schedule in real space, or may be held at a time arbitrarily set by one of multiple users who gather to watch a video of the virtual live performance.

[0013] In the virtual live performance, as shown in FIG. 1, a character C, who is a performer, performs singing, musical instrument playing, dancing, acting, acrobatics, MC talk, and other performances in a first area, a stage area Ar1. In this embodiment, one virtual live performance is made up of multiple performances, and each performance progresses according to a schedule (timeline) set in advance within the virtual live performance. Furthermore, if a performance includes, for example, a first performance (singing a first song a) performed in a first period and a second performance (singing a second song b) performed in a second period that follows the first period, the MC talk and other performances that take place between the first period and the second period are also included in the performance.

[0014] The character C may be, for example, a humanoid character that moves in a predetermined sequence, or may be an avatar that moves in response to the detected movements of an operator in real space detected by motion capture. The number of characters C performing in the stage area Ar1 may be one, or two or more. The characters C may be changed (switched) for each performance.

[0015] Users who are spectators of the virtual live performance (hereinafter referred to as "spectator users") can operate user terminals, which are devices owned by the spectator users, and watch videos of the virtual live performance on the display of the user terminals. Note that the term "spectator users" also includes users who are not actually watching the performance taking place in the virtual live performance, i.e., users who are waiting in the virtual live venue before the performance begins.

[0016] The display of the user terminal corresponds to an example of a display device, and may be provided in the user terminal itself, or may be connected to the user terminal via a wired or wireless connection. Note that displays connected to the user terminal may include general stationary displays as well as head-mounted displays (HMDs) such as VR goggles.

[0017] In this embodiment, multiple spectator users can watch the same virtual live performance simultaneously. Specifically, an audience seating area Ar2 is set as a second area in the virtual live performance venue, and each of the multiple spectator users is assigned a seat, with the location of the seat determined for each spectator user. The number of seats, i.e., the number of spectator users who can watch the same virtual live performance simultaneously, may be set to any number. Furthermore, the seats may be assigned randomly or based on the spectator users' attributes in the game, their game play history (e.g., game play time, number of points earned in the game), etc. Note that simultaneously watching the same virtual live performance may also include cases where the timing of the display of each scene in the video differs slightly between spectator users (causing a time lag) due to factors such as the communication environment.

[0018] As shown in Fig. 1, audience avatars A are placed at the audience seating locations as audience objects, and each audience user can watch the virtual live performance from the perspective of their own audience avatar A. In other words, each audience user is delivered a video of the venue as seen from the perspective of their corresponding audience avatar A. However, this is not limited to this, and a video showing a bird's-eye view of a wide area of the virtual live venue, including both the stage area Ar1 and the audience seating area Ar2, may also be delivered.

[0019] During the performance, audience users can use cheering goods G such as penlights and glow sticks by operating audience avatars A. The cheering goods G used by an audience user are one of the audience objects, and are displayed in the audience seating area Ar2 at a position corresponding to the audience user, more specifically, at the position of the audience seat assigned to the audience user, while the video is being displayed.

[0020] Furthermore, audience users can make a reservation operation for a performance before the start of the performance or during the performance, and when the performance satisfies a predetermined condition set by the audience user, a performance object (emote E) based on the reservation operation can be displayed in the video, as shown in Fig. 2. Note that there is no particular limit to the number of times that audience users can make a reservation operation or the number of times that a performance object can be displayed during one performance (for example, a singing performance of one song), but a limit may be placed on the number of times.

[0021] The reservation operation is an operation performed by audience users when they want to express their feelings when watching a performance or when they want to support character C, and is accepted by the user terminal. The performance objects are displayed in the video as a means for audience users to liven up the virtual live performance, and include, for example, text information such as a message to character C, images such as illustrations, images with animation, images called stamps consisting of decorative text and / or illustrations, and images that resemble character C. Note that in this embodiment, the reservation operation is described as an operation for displaying a performance object in the video, but audience users can also perform operations (reaction operations) to display performance objects in a timely manner each time they are watching a performance.

[0022] If the performance satisfies a predetermined condition during the performance, the effect object is displayed in the audience seating area Ar2 at a position corresponding to the audience user who made the reservation, more specifically, at a position corresponding to the audience seat where the audience object (audience avatar A, cheering goods G, etc.) corresponding to that audience user is located. Then, by displaying the effect object in the video, each of the multiple audience users, including the audience user who made the reservation, can watch the video with the effect object.

[0023] As the number of displayed performance objects increases and the virtual live performance becomes more exciting, the content of the performance may change, such as character C becoming more active or character C's costume changing. Furthermore, if the performer character C is the operator's avatar existing in real space, the operator can watch a video of the audience area Ar2 on a display device used by the operator during the performance. In this case, when the operator finds a performance object that catches their eye in the video, they may operate the avatar to react to the performance object (for example, by waving their hand in the direction of the performance object).

[0024] When making a reservation, the audience user displays a reservation screen such as that shown in Fig. 3 on the screen of the user terminal and inputs necessary information such as the type of production object to be displayed on the reservation screen. Specifically, the audience user selects the type of production object from among four options: message, stamp, illustration, and animation. For example, if a message is selected, the audience user inputs the content of the message (for example, WowWow).

[0025] Furthermore, the audience user can set predetermined conditions such as those exemplified below on the reservation screen and specify the timing at which the performance object is to be displayed within the video. (1) Time For example, a specific time such as XX:00, XX minutes, XX seconds (XX minutes) after the start of the video, or XX seconds (XX minutes) after the start of the performance can be set as the predetermined condition. (2) Song For example, if the performance is a song, any timing in the song can be set as the predetermined condition, such as when the chorus is reached, x seconds after the chorus begins, when the chorus is reached x times, or when the song ends. Furthermore, in the case of a group performance, the timing when a specific character C starts a solo can be set as the predetermined condition. Furthermore, if there is an MC talk period during the performance or between one performance and the next, the timing when the MC talk begins can be set as the predetermined condition. (3) Lyrics For example, if the performance is singing that includes lyrics, the timing at which any lyrics are sung can be set as the predetermined condition. (4) The excitement at the venue For example, the volume of character C or the excitement level in the venue when the cheers of the audience (volume in the venue) exceed a predetermined value (for example, ○ dB) can be set as the predetermined condition. Furthermore, the number, type, size, etc. of the effect objects to be displayed in the video can be set as predetermined conditions. In other words, the effect objects can be displayed at the same timing as other audience users.

[0026] If the performance is a piece of music, audience users can also reserve a performance object from the performance's timeline. For example, Figure 4 shows the reservation screen that appears when timeline reservation is selected from the reservation screen in Figure 3. As shown in the reservation screen of Fig. 4, when making a reservation from the timeline, the audience user operates the arrow cursor to specify a desired location in the timeline constituting the first performance, i.e., the timing at which the first effect object is to be displayed, for example, before the start of the first performance. Also, for example, during the period after the end of the first performance and before the start of the second performance, i.e., the MC talk period between the first and second periods, the audience user operates the arrow cursor to specify a desired location in the timeline constituting the second performance, i.e., the timing at which the second effect object is to be displayed. Even if the first performance (or the second performance) has already started, the audience user can specify a desired location in the timeline of the first performance (or the second performance) as long as it is a part that has not yet been reached.

[0027] Furthermore, when an audience member specifies a desired point on the timeline (for example, when the second chorus of the first performance is reached), candidate effect objects recommended for display at that timing are displayed, as shown in Fig. 5. For example, candidate effect objects that, when displayed in the video at the start of the second chorus, would match the music, raise the motivation of character C, and liven up the atmosphere in the venue are displayed in the recommended emote area 31. Note that, although stamps are recommended in the example of Fig. 5, messages and the like may also be recommended.

[0028] On the other hand, if an audience user first specifies the type of effect object (for example, a clapping stamp), candidates for the recommended timing (location on the timeline) for displaying that effect object are displayed as recommendations, as shown in FIG. 6. The display format of the recommendation (for example, the number of stars) can be changed depending on the degree of recommendation. In the example of FIG. 6, it is most recommended that the clapping stamp be displayed in the video at the start of the second chorus of the first performance. It is also somewhat recommended that it be displayed at the start of the first chorus of the first performance, and slightly recommended that it be displayed at the end of the grand chorus of the first performance.

[0029] Furthermore, as shown in Fig. 7, when an audience member completes a reservation for a performance object, the reservation details are reflected and displayed on the timeline. Specifically, the type of performance object reserved by the audience member and information indicating the timing at which the performance object will be displayed in the video are displayed. In the example of Fig. 7, the timeline indicates that a clapping stamp is scheduled to be displayed in the video at the start of the second chorus of the first performance.

[0030] If the performance is a song that includes lyrics, the audience user can reserve by specifying the timing at which the performance object will be displayed from the lyrics of the performance. For example, Fig. 8 shows the reservation screen that is transitioned to when "Reserve lyrics" is selected from the reservation screen of Fig. 3, with the reservation of the performance object completed. In lyrics reservation, as with the timeline reservation described above, the audience user operates the arrow cursor to specify the desired part in the lyrics of the first performance, i.e., the timing at which they want to display the first performance object, before the first performance begins. Then, as shown in Fig. 8, once the audience user has completed the reservation of the performance object, the reservation details are reflected and displayed in the lyrics. Note that in lyrics reservation, if the audience user specifies the desired part in the lyrics, candidates for performance objects recommended to be displayed at that timing are displayed, and if the type of performance object is specified first, candidates for the timing (part in the lyrics) at which it is recommended to display the performance object are displayed as recommendations.

[0031] Spectator users can also copy and reserve a rendering object reserved by another spectator user, for example, a specific user who has a mutually approved relationship with the user (hereinafter referred to as a friend), as their own rendering object. For example, Figure 9 shows the reservation screen that appears when "Friend Reservation" is selected from the reservation screen in Figure 3. As shown on the reservation screen in FIG. 9, the reservation details of a friend (e.g., XYZ) designated by the spectator user, i.e., the type and timing of the effect object (original object), are displayed on the timeline in a copyable state. By designating the original object on this reservation screen, the spectator user can copy and reserve the effect object corresponding to the original object. Note that the effect object corresponding to the original object is either the same effect object as the original object, or a effect object that is substantially the same as the original object except for some display content (e.g., the name of the spectator user who will display the effect object). Note that, although the example in FIG. 9 shows the display on the timeline, the effect objects reserved by the friend designated by the spectator user may also be displayed in a list format. Furthermore, the effect objects reserved by multiple friends may also be displayed in a list format.

[0032] Furthermore, when a spectator user makes a reservation to display a rendering object in a video, the spectator user may be required to pay a number of points equivalent to the price corresponding to the rendering object to be displayed. In this case, the number of points held by the spectator user who displayed the rendering object will be reduced by the amount of the price. The number of points held by each spectator user is managed, and each point has a predetermined value. Points can be earned by playing the game or increased by paying a fee, etc. Note that the value (predetermined value) displayed in conjunction with the display of a rendering object is not limited to points, but may also be money, electronic money, virtual currency, or in-game currency that can be used in the game.

[0033] The audience user can also cancel the effect objects that have been set by the reservation operation. In this case, the effect objects can be canceled individually, or, for example, all the effect objects can be canceled collectively on one screen. Furthermore, for audience users who have reserved a performance object, a notification action defined for the performance object is executed on the user terminal according to the timing at which the reserved performance object is displayed. For example, the user terminal vibrates, makes a sound, or emits light a few seconds before the performance object is displayed.

[0034] <Configuration of an information processing device according to one embodiment of the present invention> Next, a configuration example of the information processing system 100 according to this embodiment will be described. 10, the information processing system 100 is configured by connecting the user terminals 12 of a plurality of audience users and a server computer (hereinafter referred to as server 10) so that they can communicate with each other via a network 14. The network 14 is a communication network consisting of, for example, the Internet or a mobile communication network, and may include a LAN (Local Area Network), a WAN (Wide Area Network), an intranet, Ethernet (registered trademark), etc. The configurations of the user terminal 12 and the server 10 will be described below.

[0035] (user terminal) The user terminal 12 is a terminal operated by a user (more specifically, a spectator user when watching a video) to play a game and watch a virtual live video as an in-game event. That is, the user terminal 12 accepts a series of operations performed by the user to play the game, and these operations include operations performed by the spectator user to watch the virtual live video (hereinafter referred to as video viewing operations). Furthermore, when the spectator user performs a reservation operation to display the above-mentioned effect object in the video, the user terminal 12 accepts the reservation operation.

[0036] The user terminal 12 is configured by a personal computer, smartphone, mobile phone, tablet terminal, television receiver capable of inputting information, wearable terminal, or the like. As shown in FIG. 10, the user terminal 12 includes a processor 12a, memory 12b, and communication interface 12c. The configuration of these devices is similar to the processor 10a, memory 10b, and communication interface 10c, which are provided in the server 10 and will be described later. The user terminal 12 also includes an input device 12d including a touch panel, mouse, keyboard, etc., and an output device 12e including a display, speaker, etc. The input device 12d may include a microphone for collecting sound.

[0037] In addition, a program for an OS (Operating System) and an application program for a game (hereinafter referred to as an app) are installed on the user terminal 12. This app includes a program for watching videos. By starting the app on the user terminal 12, it becomes possible to play a game, and by executing the program for watching videos while playing a game, it becomes possible to watch videos of a virtual live performance.

[0038] Specifically, the user terminal 12 receives video data distributed from the server 10 via the network 14. The user terminal 12 then expands the received video data, and the video of the virtual live performance shown in Fig. 1, i.e., a video of a portion of the virtual live performance venue, is displayed on a display or other display device of the user terminal 12. The video displays a character C performing in the stage area Ar1, as well as an audience avatar A and cheering goods G placed in the audience seating area Ar2.

[0039] Furthermore, when an audience user performs a predetermined operation on the user terminal 12, a reservation screen such as those shown in FIGS. 3 to 9 is displayed, and the audience user can perform a reservation operation through the reservation screen. The reservation operation specifies the content of the effect object to be displayed in the video and the timing at which the effect object is to be displayed in the video. If the performance progresses according to a pre-set timeline, the reservation operation includes an operation of specifying the position on the performance timeline at which the effect object is to be displayed (including when selected from recommended positions). If the performance includes singing, the reservation operation includes an operation of specifying the position in the lyrics corresponding to the singing at which the effect object is to be displayed (including when selected from recommended positions). Furthermore, if recommended effect object candidates are displayed, the reservation operation includes an operation of specifying a desired effect object from the displayed candidates.

[0040] When the reservation operation is performed using the above steps and the performance meets the above-mentioned specified conditions, the performance object selected in the reservation operation will be displayed in the video, as shown in Figure 2, and more specifically, will be displayed at the position of the first user's audience seat in the audience seating area Ar2.

[0041] (server) The server 10 executes a series of processes related to game play, specifically generating, storing, transmitting and receiving data necessary for game progress and management. The game data processed by the server 10 includes the video data of the virtual live performance described above. That is, the server 10 generates video data of the virtual live performance and distributes the video data to the user terminals 12 of multiple spectator users who will be watching the virtual live performance simultaneously. Furthermore, when one or more spectator users perform a reservation operation and the performance satisfies the predetermined conditions set in the reservation operation, the server 10 generates video data incorporating the effect object described above as a process for displaying the effect object in the video, and distributes the data to the user terminals 12 of each spectator user.

[0042] The server 10 is an example of a computer, and in this embodiment, is configured by, for example, an SNS server or a server computer for cloud services. Server computers for cloud services include server computers for ASP (Application Service Provider), SaaS (Software as a Service), PaaS (Platform as a Service), or IaaS (Infrastructure as a Service). The server 10 may be a single computer or multiple computers distributed in parallel.

[0043] The configuration of the server 10 will be described. As shown in FIG. 10, the server 10 includes, as hardware devices, a processor 10a, a memory 10b, a communication interface 10c, and a storage 10d.

[0044] The processor 10a may be configured by a CPU (Central Processing Unit), an MPU (Micro-Processing Unit), an MCU (Micro Controller Unit), a GPU (Graphics Processing Unit), a DSP (Digital Signal Processor), a TPU (Tensor Processing Unit), or an ASIC (Application Specific Integrated Circuit), etc. The memory 10b may be configured by semiconductor memories such as a ROM (Read Only Memory) and a RAM (Random Access Memory).

[0045] The communication interface 10c may be configured by, for example, a network interface card, a communication interface board, etc. The standard of data communication by the communication interface 10c is not particularly limited, and examples include communication by a wireless LAN based on Wi-fi (registered trademark), communication by a 3G to 5G or later generation mobile communication system, or communication based on LTE (Long Term Evolution).

[0046] The storage 10d may be configured by a flash memory, a hard disc drive (HDD), a solid state drive (SSD), a flexible disc (FD), a magneto-optical disc (MO disc), a compact disc (CD), a digital versatile disc (DVD), a secure digital card (SD card), a universal serial bus memory (USB memory), etc. The storage 10d may be built into the server 10, may be attached to the server main body in an external format, or may be a network attached storage (NAS), etc. The storage 10d may also be configured by a third computer communicably connected to the server 10, such as a database server or online storage.

[0047] The storage 10d stores and accumulates various information related to game control, including the viewing of virtual live video. Of the information stored in the storage 10d, the information related to the viewing of virtual live video includes user information, effect object information, reservation information, performance information, etc.

[0048] As shown in FIG. 11, the user information is stored for each spectator user in the storage 10d, with various information linked to identification information (user ID) that identifies each spectator user. For example, user information includes the spectator user's account name, login password, and other personal information, whether or not there are other users linked as friends, and identification information (user ID) identifying those friends, a gameplay history indicating the spectator user's game progress, and the current number of points acquired in the game. User information also includes identification information (live ID) identifying the virtual live performance in which the spectator user will participate, location information of the spectator seats assigned to the spectator user at the venue of the virtual live performance, information on the spectator avatar, and information on cheering goods used with the spectator avatar. Furthermore, user information includes identification information (object ID) identifying candidate performance objects that the spectator user can display in the video of the virtual live performance, and, if the spectator user has made a reservation for a performance object, identification information (reservation information ID) identifying reservation information indicating the reservation details.

[0049] The performance object information is information about performance objects that the user can display within the video, and as shown in Figure 12, various information is linked to identification information (object ID) that identifies each performance object, and is stored for each performance object in storage 10d. For example, the effect object information includes information indicating the type and appearance of the effect object, whether or not a fee is charged for displaying the effect object in a video and the amount of the fee, information indicating the recommended scenes and genres for display, identification information (object ID) for identifying the related effect object, and the display mode when displayed in the video. Here, the display mode of the effect object refers to the size, color, shape, posture, sound, display position in the video, display time, and whether or not the effect object has any movement such as deformation, movement, or rotation. In addition, in this embodiment, as described below, the display mode of the effect object can be changed when certain conditions are met. Therefore, the effect object information includes the display mode before the change (normal) and the display mode after the change (special). It is preferable that the display mode after the change be more noticeable than the display mode before the change, for example, a display mode that is more likely to attract the attention of viewers of the video.

[0050] The performance information is information relating to the performances that make up the virtual live performance, and as shown in FIG. 13, various pieces of information are linked to identification information (performance ID) that identifies each performance, and are stored for each performance in the storage 10d. For example, the performance information includes information indicating the type of performance, identification information (live ID) that identifies the associated virtual live performance, identification information (character ID) that identifies the character that will be the performer, the content of the performance indicating the songs and required time, etc., a timeline showing the flow from the start time to the end time, the current progress status, and, if an audience member has made a reservation operation for a performance object for the performance, identification information (reservation information ID) that identifies the reservation information showing the reservation details, etc. The performance information is updated successively according to the number of reservation operations received from audience members and the progress of the performance.

[0051] The reservation information is generated for a spectator user who has performed a reservation operation for a performance object, and is information about the performance object that is displayed as a result of that reservation operation. As shown in Figure 14, for example, the reservation information is linked to identification information (reservation ID) that identifies each reservation information, and includes identification information (user ID) that identifies the audience user who performed the reservation operation, identification information (object ID) that identifies the content of the performance object to be displayed by the reservation operation, identification information (performance ID) that identifies the performance for which the performance object will be displayed, and specified conditions such as the timing for displaying the performance object.

[0052] Returning to the explanation of the configuration of the server 10, a program for an operating system (OS) and an information processing program for game progression are installed on the server 10. The information processing program for game progression includes a program related to video generation and distribution. The above programs correspond to the "programs" of the present invention and are programs for controlling the server 10. In other words, the execution of the above programs by the processor 10a causes the server 10 to function as the information processing device of the present invention.

[0053] The above-mentioned program for progressing the game may be obtained by reading it from a computer-readable recording medium, or may be obtained (downloaded) via a network such as the Internet or an intranet.

[0054] <Functions of an information processing device according to one embodiment of the present invention> Next, functions of the information processing device according to this embodiment (hereinafter, referred to as information processing device 20) will be described with reference to FIG. As described above, the information processing device 20 is configured by the server 10, and has functions related to the progress of the game. As shown in FIG. 15 , the information processing device 20 also has functional units related to the virtual live video, including an information acquisition unit 21, a reservation screen display control unit 22, a video display control unit 23, a performance object display control unit 24, an update unit 25, and a notification unit 26. These functional units are realized by cooperation between various hardware devices that configure the server 10 and programs installed on the server 10. Each functional unit will be described in detail below.

[0055] (Information acquisition department) When the user terminal 12 receives an operation from an audience user, the information acquisition unit 21 receives data indicating the operation content from the user terminal 12 and acquires input information related to the user operation. In particular, the information acquisition unit 21, which also corresponds to the reservation acceptance unit of the present invention, accepts input information from audience users regarding reservation operations for displaying a performance object in a video when the performance satisfies predetermined conditions. Specifically, the information acquisition unit 21 acquires input information based on reservation operations performed by audience users on a reservation screen displayed on a display by a reservation screen display control unit 22 (described later). At this time, the information acquisition unit 21 controls the system so that reservation operations can be accepted before the start of the performance. Furthermore, when a performance includes a first performance performed in a first period and a second performance performed in a second period, the information acquisition unit 21 controls the system so that reservation operations can be accepted for reserving a second performance object to be displayed for the second performance during the period between the first and second periods. The information acquired by the information acquisition unit 21 includes information based on video viewing operations for the virtual live performance, including the reservation operations described above, as well as information based on various selections, designations, instructions, requests, commands, permission or denial, registration, and other input operations performed by audience users.

[0056] (Reservation screen display control section) The reservation screen display control unit 22 displays on the display a reservation screen for accepting a reservation operation from an audience user to reserve a performance object. Specifically, the reservation screen display control unit 22 generates display data for the reservation screen and transmits the generated display data to the user terminal 12 of each audience user. In the user terminal 12 that receives the display data, a reservation screen such as those shown in Figs. 3 to 9 is displayed on the display.

[0057] The reservation screen display control unit 22 causes the display device to display, from before the start of the performance, a reservation screen for reserving a performance object to be displayed in the video after the performance starts. Furthermore, when the performance includes a first performance performed in a first period and a second performance performed in a second period, the reservation screen display control unit 22 causes the display device to display a reservation screen for reserving a second performance object to be displayed for the second performance in the period between the first period and the second period.

[0058] If the performance progresses according to a preset timeline and the audience user performs a reservation operation by specifying a predetermined point on the timeline on the reservation screen, the reservation screen display control unit 22 causes the display to display information indicating that a performance object based on the reservation operation will be displayed in association with the point on the timeline specified by the audience user through the reservation operation, as shown in Fig. 7. Also, if the performance includes singing and the audience user performs a reservation operation by specifying a predetermined point in the lyrics corresponding to the singing on the reservation screen, the reservation screen display control unit 22 causes the display to display information indicating that a performance object based on the reservation operation will be displayed in association with the point in the lyrics specified by the audience user through the reservation operation, as shown in Fig. 8.

[0059] When a performance progresses according to a preset timeline and an audience member specifies a predetermined location on the timeline on the reservation screen, the reservation screen display control unit 22 causes the display device to display, as designation candidates, information about one or more performance objects recommended for the location on the timeline specified by the audience member, as shown in Fig. 5. Also, when a performance progresses according to a preset timeline and an audience member specifies a performance object to be displayed on the reservation screen, the reservation screen display control unit 22 causes the display device to display, as designation candidates, information about one or more locations on the timeline recommended as timings for displaying the performance object specified by the audience member, as shown in Fig. 6.

[0060] 9, the reservation screen display control unit 22 displays on the display on the reservation screen a performance object (original object) that has already been reserved by another spectator user, such as a friend, who will be watching the same performance as the spectator user, in a state where it can be specified by the spectator user, i.e., in a state where the spectator user can copy and use the original object. When the spectator user specifies the original object in a reservation operation, a performance object (corresponding performance object) corresponding to the original object may be displayed in the video at the same timing as the original object, or the timing at which the corresponding performance object is displayed in the video may be freely specified for each spectator user. The reservation screen display control unit 22 may also display a list of performance objects that have been reserved by other spectator users specified by the spectator user.

[0061] (Video display control unit) The video display control unit 23 displays the video of the virtual live performance, i.e., a video of at least a portion of the virtual live performance venue (virtual space), on a display. Specifically, the video display control unit 23 generates display data for the video and transmits the generated display data to the user terminal 12 of each audience user. Upon receiving the display data, the user terminal 12 displays the video of the virtual live performance, i.e., a video showing at least a portion of the virtual live performance venue where character C, the performer who will be performing, and objects corresponding to multiple audience users watching the performance (more specifically, audience avatar A, cheering goods G, etc.) are placed.

[0062] (Direction object display control unit) When the information acquisition unit 21 acquires input information related to the reservation operation from the user terminal 12 that accepted the reservation operation from the audience user, and the target performance satisfies the predetermined conditions set by the reservation operation, the effect object display control unit 24 displays the effect object in the video based on the reservation operation. Specifically, the effect object display control unit 24 cooperates with the video display control unit 23 to generate display data for the video incorporating the effect object specified in the reservation operation and transmits the generated display data to the user terminal 12 of each audience user. As a result, as shown in FIG. 2 , the effect object is displayed in the video viewed by multiple audience users, including the audience user who made the reservation operation. At this time, the effect object display control unit 24 displays the effect object associated with the audience user who made the reservation operation at the position of the audience seat in the audience seat area Ar2 assigned to that audience user. In addition, in a case where a performance includes a first performance performed in a first period and a second performance performed in a second period, the performance object display control unit 24 controls the first performance object to be displayed in the video when the first performance satisfies a first predetermined condition, and controls the second performance object to be displayed in the video when the second performance satisfies a second predetermined condition.

[0063] When multiple spectator users perform reservation operations for a specific effect object and the number of times the specific effect object is designated or displayed based on the reservation operations for the specific effect object reaches a predetermined number or more (e.g., 100 or more), or when the number of spectator users who have performed reservation operations specifying the specific effect object reaches a predetermined number or more (e.g., 100 or more in total), the effect object display control unit 24 changes the display mode of the specific effect object (emotion E) in accordance with the number of times, etc., as shown in FIG. 16. Specifically, before the number of times, etc., for the specific effect object reaches a predetermined number, the effect object display control unit 24 displays the specific effect object in the pre-change display mode (normal) specified in the effect object information stored in the storage 10d of the server 10, as shown in FIG. 2. In contrast, when displaying the specific effect object after the number of times, etc., reaches a predetermined number or more, the effect object display control unit 24 displays the specific effect object in the post-change display mode (special) specified in the effect object information, as shown in FIG. 16. It should be noted that when calculating the above number of times, etc., it is not limited to completely identical performance objects, but the calculation may also include related performance objects that have roughly the same meaning but some display content that is different, such as "WowWow" and "WOWWOW!", standard characters and decorated characters, or the action of waving a penlight back and forth and the action of waving a penlight left and right, etc.

[0064] When multiple spectator users make reservations for a specific effect object (first effect object) and the timings at which the specific effect objects are displayed are the same or within a predetermined error range (for example, within 3 seconds), the effect object display control unit 24 displays a plurality of specific effect objects (e.g., emote E) in a partial area set in the virtual space according to the timings at which the specific effect objects (e.g., emote E) are displayed, as shown in Fig. 17. Specifically, as in this embodiment, when an object (e.g., spectator avatar A) corresponding to each spectator user is displayed in the position of the spectator seat assigned to each spectator user and an effect object is displayed in a position corresponding to the spectator avatar A associated with the spectator user who made the reservation, the effect object display control unit 24 controls the position of the spectator avatar A in the virtual space before the effect object is displayed in the video to be different from the position of the spectator avatar A when the effect object is displayed, i.e., the position in the partial area.

[0065] (Update section) When the number of points held by each spectator user increases or decreases, the update unit 25 updates the number of points held stored in the storage 10d of the server 10. Specifically, in a case where a spectator user makes a reservation operation to display a performance object in a video, and a fee is required for displaying the performance object, the update unit 25 updates the number of points held by the spectator user who made the reservation operation by subtracting the number of points equivalent to the fee.

[0066] (Notification Department) The notification unit 26 notifies the spectator user who reserved the performance object that the performance object they reserved will soon be displayed in the video when the performance object reserved by the spectator user is about to be displayed, i.e., when the performance is about to satisfy the predetermined conditions set by the spectator user. Specifically, the notification unit 26 generates notification data before the performance satisfies the predetermined conditions, and displays the notification data on the user terminal 12 of the spectator user who reserved the performance object, depending on the timing when the performance object reserved by the spectator user will be displayed. Then, when the user terminal 12 of the spectator user receives the notification data, the user terminal 12 executes a notification action set for the performance object, such as vibration, sound, or light emission.

[0067] <Information processing method according to one embodiment of the present invention> Next, the information processing flow of this embodiment, specifically the information processing flow relating to video distribution of a virtual live performance, will be described. The information processing flow of this embodiment employs the information processing method of the present invention and proceeds according to the flow shown in Fig. 18. In other words, each step in the information processing flow shown in Fig. 18 (specifically, each step) corresponds to a component of the information processing method of the present invention. The information processing flow described below is merely an example, and unnecessary steps may be deleted, new steps may be added, or the order in which steps are performed may be changed, without departing from the spirit of the present invention.

[0068] This information processing flow is a process executed by a processor 10a of a server 10 that constitutes an information processing device 20. At this time, data communication is carried out via a network 14 between the server 10 and a user terminal 12 operated by each audience user. In the following, we will explain an example in which an audience member makes a reservation through timeline reservation. The videos to be distributed also include videos from the period before the first performance actually starts, such as videos from the introductory period.

[0069] The information processing flow is initiated, for example, when the time in real space reaches the virtual live performance start time set in the time schedule. In the information processing flow, first, the processor 10a of the server 10 distributes video of the virtual live performance to each audience user (S101). Specifically, the processor 10a generates display data of a video showing at least a portion of the virtual live performance venue, including both the stage area Ar1 (where a character C acting as a performer may be located) and the audience seating area Ar2 (where audience objects such as audience avatars A and cheering goods G corresponding to multiple audience users may be located), and transmits the generated display data to the user terminal 12 of each audience user. Note that the user terminal 12 of each audience user receives and expands the display data to display the video on a display.

[0070] Next, when the processor 10a receives a request to display a reservation screen from the user terminal 12 operated by the audience user who is watching the video (S102: YES), it causes the user terminal 12 of the audience user to display a reservation screen for receiving a reservation operation for a performance object to be displayed in the video (S103). Specifically, the processor 10a transmits display data for the reservation screen to the user terminal 12 of the audience user. The user terminal 12 of the audience user receives and expands the display data, thereby displaying the reservation screen on the display.

[0071] Then, when the processor 10a acquires information based on the reservation operation performed by the spectator user and accepts a reservation for a performance object from the spectator user (S104), it displays on the reservation screen the performance object specified by the spectator user in the reservation operation, linked to the location on the timeline specified by the spectator user in the reservation operation (S105). Specifically, the processor 10a updates the display data of the reservation screen to reflect the contents of the reservation operation and transmits it to the user terminal 12 of the spectator user. Note that the user terminal 12 of the spectator user receives and expands the display data, thereby displaying on the display a reservation screen that reflects the reservation contents of the spectator user. On the other hand, if a request to display the reservation screen has not been received from the user terminal 12 operated by the audience user (S102: NO), the process proceeds to the next step.

[0072] Thereafter, for example, when the time in the real space reaches the start time of a performance set in the time schedule, the processor 10a starts the performance (S106). Specifically, the processor 10a generates display data of a video showing at least a part of a virtual live venue where a character C as a performer performing the performance, and a plurality of audience users and their corresponding audience avatars A, etc. are placed, and transmits the data to the user terminal 12 of each audience user. Note that the user terminal 12 of each audience user receives and expands the display data to display the video on a display.

[0073] Then, when the time has come to display the effect object reserved by the spectator user in the video and the processor 10a determines that the ongoing performance has satisfied the predetermined condition (S107: YES), the processor 10a displays the effect object in the video at the location of the spectator avatar A or the like of the spectator user in the spectator seating area Ar2, in accordance with the content reserved by the spectator user (S108). Specifically, the processor 10a generates display data for the video with the effect object and transmits it to the user terminal 12 of each spectator user. The user terminal 12 of each spectator user displays the video with the effect object on a display. In other words, the effect object is displayed in the video in a state viewable not only by the spectator user who displayed the effect object, but also by all spectator users watching the video, i.e., the performance.

[0074] If processor 10a determines that the predetermined condition is not satisfied (S107: NO), it proceeds to the next process without displaying the effect object, and repeats the processes from step S107 to S108 until the performance ends (S109). For example, if multiple audience users have made reservation operations to display effect objects in the video, processor 10a displays the effect objects of each audience user in the video, respectively, according to the predetermined conditions set in those reservation operations.

[0075] Thereafter, if processor 10a determines that the video has not yet ended (S110: NO), for example, if a second performance to be performed in a second period remains after the first performance to be performed in the first period, processor 10a continues the video distribution. In this case, a reservation screen for accepting a reservation operation for a second effect object to be displayed in the video in which the second performance is performed is displayed (S103) during the period between the first period and the second period (e.g., an MC talk period, etc.), and based on the reservation operation performed by the audience user (S104), after the second performance starts (S106), if the second performance satisfies a second predetermined condition (S107: YES), processor 10a displays the second effect object in the video (S108).

[0076] The processor 10a repeats the above series of steps until the video distribution is completed (S110), and ends the process when it determines that the virtual live performance has ended and all video distribution has been completed (S110: YES). The above is an example of the information processing flow of the present invention.

[0077] <Other Embodiments of the Present Invention> The information processing device, information processing method, program, and information processing system of the present invention have been described above using one specific example. However, the above-described embodiment is merely an example given to facilitate understanding of the present invention, and does not limit the present invention. Embodiments (modifications) different from the above-described embodiment may also be considered.

[0078] In the above embodiment, the server 10 functions as the information processing device 20, but some of the functions of the server 10 may be performed by the user terminal 12 of the audience user. In that case, the information processing device of the present invention is configured by the cooperation of the server 10 and the user terminal 12.

[0079] In the above embodiment, various information such as player information is stored in the storage 10d of the server 10, but a database server (not shown) may be provided separately and all information may be stored in the database server. In this case, the server 10, together with the database server, constitutes the information processing device of the present invention.

[0080] In the above embodiment, the audience users watch the video through the display of the user terminal 12. However, this is not limited to this, and for example, the audience users may go to a specific venue in real space and watch the video of the virtual live performance by displaying the video on a display device installed in the venue (for example, a large screen monitor used for public viewing or the like).

[0081] It should be noted that the elements and features of the above-described multiple embodiments may be combined as appropriate. That is, the configuration of any of the above-described multiple embodiments may be applicable to the other embodiments, and the effects brought about by the configuration may be similarly achieved. Furthermore, in addition to the embodiments described above, the present invention may be modified or improved from the embodiments described below without departing from the spirit of the present invention. Naturally, the present invention also includes equivalents. Furthermore, the content of information displayed on the screen of a terminal operated by a user, as well as the GUI (Graphical User Interface), can be freely designed and modified according to the system design specifications, user preferences, and other factors.

[0082] <Summary> [General-purpose assignment] One of the objects of the present invention is to reflect the user's desired effects at the appropriate timing while watching a video. One of the objects of the present invention is to prevent a user from forgetting to perform a performance operation or performing an erroneous operation while watching a video. One of the objects of the present invention is to reduce the operational burden on the user while watching a video.

[0083] Issues regarding [Appendix 1] One of the objects of the present invention is to enable a user to reserve and set a desired effect object to be displayed at any timing while watching a video. [Appendix 1] The information processing device has: a video display control unit that displays on a display at least a portion of a video in a virtual space in which characters performing and objects corresponding to users watching the performance are arranged; a reservation reception unit that receives a reservation operation from a user to display a performance object in the video when the performance satisfies predetermined conditions; and a performance object display control unit that displays the performance object in the video when the performance satisfies the predetermined conditions. According to the information processing device, a user can schedule the display of a desired effect object while watching a video at any timing. This allows the user's desired effect to be reflected at the appropriate timing while watching a video. It also prevents the user from forgetting to operate the effect or operating it incorrectly while watching a video. Furthermore, it reduces the operational burden on the user while watching a video.

[0084] Issues regarding [Appendix 2] One of the objects of the present invention is to enable, when a plurality of performances are to be performed, the reservation and setting of a performance object appropriate for each performance to be performed. [Appendix 2] The information processing device described in Appendix 1, wherein the performance includes a first performance performed in a first period and a second performance performed in a second period, and the performance object display control unit controls the first performance object to be displayed when the first performance satisfies a first predetermined condition and the second performance object to be displayed when the second performance satisfies a second predetermined condition so that they can each be displayed. According to the information processing device, a user can reserve and set the effect objects that he / she wants to display while watching a video for each performance at any timing. This allows the user to reserve and set the effect objects appropriate for each performance when multiple performances are being performed.

[0085] Issues regarding [Appendix 3] One of the goals of the present invention is to focus on the performance once it has begun. [Appendix 3] 2. The information processing device according to claim 1, wherein the reservation accepting unit controls the information processing device so that a reservation operation can be accepted before the start of the performance. According to the information processing device, the user can reserve and set the performance object that he / she wants to display while watching the image before the performance starts, rather than after the performance starts, which allows the user to concentrate on the performance once it has started.

[0086] Issues regarding [Appendix 4] One of the purposes of the present invention is to focus on each performance when multiple performances are being performed. [Appendix 4] An information processing device as described in Appendix 1, further comprising a reservation screen display control unit that displays a reservation screen for reserving a performance object, and when the performance includes a first performance performed in a first period and a second performance performed in a second period, the reservation screen display control unit displays a reservation screen for reserving a second performance object to be displayed for the second performance in the period between the first period and the second period. According to the information processing device, a user can reserve a performance object to be displayed in the next performance between performances, which allows the user to concentrate on each performance when multiple performances are being performed.

[0087] Issues regarding [Appendix 5] One of the objects of the present invention is to improve the convenience when reserving and setting a performance object. [Appendix 5] An information processing device as described in Appendix 1, further comprising a reservation screen display control unit that displays a reservation screen for reserving a performance object, wherein the reservation reception unit receives from the user a specification of a location on the timeline at which the performance object is to be displayed when the performance progresses according to a pre-set timeline, and the reservation screen display control unit displays the performance object on the reservation screen in association with the location on the timeline specified by the user. According to the information processing device, the effect object is displayed at a specified location on the timeline, making it easier for the user to specify the timing at which the effect object is displayed, thereby improving the convenience of reserving the effect object.

[0088] Issues regarding [Appendix 6] One of the objects of the present invention is to improve the convenience when reserving and setting a performance object. [Appendix 6] An information processing device as described in Appendix 1, further comprising a reservation screen display control unit that displays a reservation screen for reserving a performance object, wherein the reservation reception unit, when the performance includes singing, receives from the user a specification of the portion of the lyrics corresponding to the singing at which the performance object is to be displayed, and the reservation screen display control unit displays the performance object on the reservation screen in association with the portion of the lyrics specified by the user. According to the information processing device, the effect object is displayed at a specified point in the lyrics corresponding to the singing, making it easier for the user to specify an effect object appropriate to the lyrics, thereby improving the convenience of reserving effect objects.

[0089] Issues regarding [Appendix 7] One of the objects of the present invention is to improve the convenience when reserving and setting a performance object. [Appendix 7] An information processing device as described in Appendix 1, further comprising a reservation screen display control unit that displays a reservation screen for reserving performance objects, and when the performance progresses according to a pre-set timeline, the reservation screen display control unit displays candidates for performance objects recommended for a point specified by the user on the timeline. According to the information processing device, the recommended performance object candidates are displayed according to the specified location on the timeline, making it easier for the user to specify an appropriate performance object according to the timeline of the performance, thereby improving the convenience of reserving performance objects.

[0090] Issues regarding [Appendix 8] One of the objects of the present invention is to improve the convenience when reserving and setting a performance object. [Appendix 8] An information processing device as described in Appendix 1, further comprising a reservation screen display control unit that displays a reservation screen for reserving a performance object, and the reservation screen display control unit displays a recommended location on the timeline for the performance object specified by the user when the performance progresses according to a pre-set timeline. According to the information processing device, a recommended timeline location is displayed according to the designated effect object, making it easier for the user to specify an appropriate timing for displaying the designated effect object, thereby improving convenience when reserving effect objects.

[0091] Issues regarding [Appendix 9] One of the objects of the present invention is to improve the convenience when reserving and setting a performance object. [Appendix 9] An information processing device as described in Appendix 1, further comprising a reservation screen display control unit that displays a reservation screen for reserving performance objects, and the reservation screen display control unit displays performance objects that have been reserved by a specific user other than the user in a performance in a state that allows the user to specify them. According to the information processing device described above, a user can copy and use a rendering object that has been reserved by another user, thereby improving the convenience of reserving rendering objects.

[0092] Issues regarding [Appendix 10] One of the purposes of the present invention is to make videos more exciting. [Appendix 10] An information processing device described in Appendix 1, wherein the performance object display control unit changes at least one of the performance objects and the performance applied to the virtual space based on the number of mutually related performance objects reserved by one or more users. According to the information processing device, if a large number of users have reserved and set mutually related effect objects, the effect objects can be upgraded and displayed in accordance with the number of users, thereby further enhancing the excitement of the video.

[0093] Issues regarding [Appendix 11] One of the purposes of the present invention is to make videos more exciting. [Appendix 11] The information processing device described in Appendix 1 has a performance object display control unit that, when there are multiple users who have performed reservation operations for the first performance object, displays multiple first performance objects in a partial area set in the virtual space depending on the timing at which the first performance object is displayed. According to the information processing device, when multiple users have reserved the same effect object, the effect objects can be gathered in a certain area and displayed in a spectacular manner, thereby further enhancing the excitement of the video.

[0094] Issues regarding [Appendix 11] One of the objects of the present invention is to allow a user to view a reserved rendering object without missing it. [Appendix 11] An information processing device as described in Appendix 1, further comprising a notification unit that causes a display device to perform a notification action defined for a performance object depending on the timing at which the performance object reserved by the user is displayed. According to the information processing device, the user who made the reservation can be notified according to the timing when the reserved effect object is to be displayed, thereby enabling the user to view the reserved effect object without missing it.

[0095] Issues regarding [Appendix 13] One of the objects of the present invention is to enable a user to reserve and set a desired effect object to be displayed at any timing while watching a video. [Appendix 13] An information processing system including a user terminal operated by a user and a server computer capable of communicating with the user terminal via a network, the information processing system having: a video display control unit that causes a display to display at least a portion of a video in a virtual space in which characters performing and objects corresponding to users watching the performance are arranged; a reservation reception unit that receives a reservation operation from the user terminal to display a performance object in the video when the performance satisfies predetermined conditions; and a performance object display control unit that causes a performance object to be displayed in the video when the performance satisfies the predetermined conditions. According to the information processing system described above, a user can reserve and set a desired effect object to be displayed at any time while watching a video.

[0096] Issues regarding [Appendix 14] One of the objects of the present invention is to enable a user to reserve and set a desired effect object to be displayed at any timing while watching a video. [Appendix 14] This information processing method includes a processor displaying on a display at least a part of a video in a virtual space in which characters performing and objects corresponding to users watching the performance are arranged, the processor receiving from the user a reservation operation for displaying a performance object in the video when the performance satisfies a predetermined condition, and the processor displaying the performance object in the video when the performance satisfies the predetermined condition. According to the above information processing method, the user can reserve and set the desired effect object to be displayed at any timing while watching a video.

[0097] Issues regarding [Appendix 15] One of the objects of the present invention is to enable a user to reserve and set a desired effect object to be displayed at any timing while watching a video. [Appendix 15] The program causes a processor to display on a display at least a part of a video in a virtual space in which characters performing and objects corresponding to users watching the performance are arranged, causes the processor to accept a reservation operation from a user for displaying a performance object in the video when the performance satisfies a predetermined condition, and causes the processor to display the performance object in the video when the performance satisfies the predetermined condition. According to the above program, a user can reserve and set a desired effect object to be displayed at any time while watching a video. [Explanation of symbols]

[0098] 10 Servers 10a processor 10b memory 10c communication interface 10d Storage 12 User terminal (terminal) 12a processor 12b memory 12c communication interface 12d Input Device 12e output device 14 Network 20 Information processing equipment 21 Information Acquisition Department 22 Reservation screen display control section 23 Video display control unit 24. Production object display control section 25 Update section 26 Notification Department 31 Recommended Emote Area 100 Information Processing Systems A. Audience avatar C character E Emote G Support Goods Ar1 Stage Area Ar2 Spectator Area

Claims

1. a video display control unit that displays on a display at least a portion of a video in a virtual space in which a character performing a performance and an object corresponding to a user viewing the performance are arranged; a reservation receiving unit that receives from the user a reservation operation for displaying a performance object in the video when the performance satisfies a predetermined condition; and a performance object display control unit that displays the performance object in the video when the performance satisfies the predetermined condition. Information processing device.

2. the performances include a first performance performed in a first time period and a second performance performed in a second time period; the effect object display control unit controls to display a first effect object when the first performance satisfies a first predetermined condition and a second effect object when the second performance satisfies a second predetermined condition, respectively; The information processing device according to claim 1 .

3. the reservation accepting unit controls the reservation operation so as to be able to accept the reservation operation before the start of the performance; The information processing device according to claim 1 .

4. a reservation screen display control unit that displays a reservation screen for reserving the effect object; the reservation screen display control unit, when the performance includes a first performance performed in a first period and a second performance performed in a second period, displays a reservation screen for reserving a second performance object to be displayed for the second performance during a period between the first period and the second period; The information processing device according to claim 1 .

5. a reservation screen display control unit that displays a reservation screen for reserving the effect object; the reservation receiving unit receives, from the user, a designation of a position on the timeline at which the performance is to be displayed, when the performance progresses according to a preset timeline; the reservation screen display control unit displays the performance object on the reservation screen in association with a location on the timeline designated by the user, The information processing device according to claim 1 .

6. a reservation screen display control unit that displays a reservation screen for reserving the effect object; the reservation receiving unit, when the performance includes singing, receives from the user a designation of a portion of lyrics corresponding to the singing where the performance object is to be displayed; the reservation screen display control unit displays the performance object on the reservation screen in association with a part of the lyrics designated by the user; The information processing device according to claim 1 .

7. a reservation screen display control unit that displays a reservation screen for reserving the effect object; the reservation screen display control unit, when the performance progresses according to a preset timeline, displays candidates for the performance object recommended for a point on the timeline designated by the user; The information processing device according to claim 1 .

8. a reservation screen display control unit that displays a reservation screen for reserving the effect object; the reservation screen display control unit, when the performance progresses according to a preset timeline, displays a recommended position on the timeline for the performance object designated by the user; The information processing device according to claim 1 .

9. a reservation screen display control unit that displays a reservation screen for reserving the effect object; the reservation screen display control unit displays the performance object for which a specific user other than the user has performed the reservation operation in a state that the performance object can be designated by the user; The information processing device according to claim 1 .

10. the effect object display control unit changes at least one of the effect objects and the effect applied to the virtual space based on the number of the effect objects related to each other that are reserved by one or more users; The information processing device according to claim 1 .

11. the effect object display control unit, when a plurality of users have performed the reservation operation for a first effect object, displays a plurality of the first effect objects in a partial area set in the virtual space according to a timing at which the first effect object is displayed; The information processing device according to claim 1 .

12. The display device further includes a notification unit that causes the display device to execute a notification action determined for the effect object in accordance with a timing at which the effect object reserved by the user is displayed. The information processing device according to claim 1 .

13. An information processing system including a user terminal operated by a user and a server computer capable of communicating with the user terminal via a network, a video display control unit that displays on a display at least a portion of a video in a virtual space in which a character performing a performance and an object corresponding to a user viewing the performance are arranged; a reservation receiving unit that receives, from the user terminal, a reservation operation for displaying a performance object in the video when the performance satisfies a predetermined condition; and a performance object display control unit that displays the performance object in the video when the performance satisfies the predetermined condition. Information processing system.

14. The processor displays on a display device a moving image of at least a part of a virtual space in which a character performing a performance and an object corresponding to a user watching the performance are arranged; a processor receiving from the user a reservation operation for displaying a performance object in the video when the performance satisfies a predetermined condition; a processor, when the performance satisfies the predetermined condition, causing the effect object to be displayed in the video; Information processing methods.

15. causing the processor to display on a display device at least a part of a moving image in a virtual space in which a character performing a performance and an object corresponding to a user watching the performance are arranged; causing the processor to accept from the user a reservation operation for displaying a performance object in the video when the performance satisfies a predetermined condition; causing the processor to display the effect object in the video when the performance satisfies the predetermined condition; program.

Images