Entertainment viewing management system and program

Abstract

To provide an entertainment system that offers a unique viewing environment in a virtual space by changing or moving the viewing position itself, thereby providing a new style of viewing performances in a virtual space. [Solution] The server device 10 of this embodiment has the following configuration: it detects the movement of the performer character (object to be watched) 8 in the virtual space, controls the placement object 9 formed in the virtual space, changes the configuration of the placement object 9 based on the detected movement of the performer character 8 in the virtual space, controls the avatar (viewer character) 5 which functions as the viewpoint of the viewer watching the performer character 8, controls the actions of the avatar 5 in the virtual space, including actions using the placement object 9, generates an image of the virtual space formed from the position of the avatar 5 in the viewer's viewing direction, and provides the corresponding terminal device 20 with data to allow the viewer to view the generated image.

Description

Technical Field

[0001] The present invention relates to an entertainment viewing management system, a program, and the like.

Background Art

[0002] In recent years, live distribution technologies for concerts and other events held in virtual spaces have advanced rapidly, and along with this, interactive streaming viewing using a character as a gaze target that performs performances such as singing, playing music, or acting (hereinafter also referred to as "gaze target character") and the avatar of the viewer who views the gaze target (hereinafter also referred to as "viewer character") has become widespread.

[0003] In particular, when performing such streaming viewing, the viewing position is often fixed, similar to the case of viewing a performance in the real space, a viewer character is arranged at a specific position, and it is general that the viewer views the performance of the gaze target character via the arranged viewer character.

[0004] In particular, recently, there is also known a system capable of increasing the viewer's motivation for viewing the performance by changing the viewing environment by changing the arrangement position of the viewer character (that is, the viewer's viewing position) in response to various actions of the viewer using the viewer character during the performance. (For example, Patent Document 1).

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Summary of Invention

Problems to be Solved by the Invention

[0006] However, in the system described in Patent Document 1, although the viewer's viewing position is changed according to the actions of the viewer character, the viewing position itself does not change or move. Therefore, the viewing style itself is no different from when viewing a performance provided in real space, and further improvements are desired for viewing styles unique to virtual space.

[0007] The present invention was made to solve the above problems, and its purpose is to provide an entertainment system that can provide a viewing environment unique to virtual space by moving or transforming objects that constitute the viewing position, and to provide a new style of viewing performance in virtual space. [Means for solving the problem]

[0008] (1) In order to solve the above problems, the present invention is An entertainment viewing management system that works in conjunction with terminal devices owned by viewers connected via a network, and manages viewing so that viewers can view objects that are the target of their attention within a virtual space, A detection means for detecting the movement of the object being watched within the virtual space, Means for controlling placement objects formed within the virtual space, including object control means that execute an object configuration change process to change the configuration of the placement object based on the movement of the detected object under observation within the virtual space, Means for controlling a viewer character that functions as the viewpoint of a viewer viewing the object being watched, including viewer character control means for controlling the viewer character's actions within the virtual space, including actions using the placed object, Image generation means for generating an image of the virtual space formed in the viewing direction of the viewer from the position of the viewer character, A means for providing data to a terminal device to allow a viewer to view the generated image, It has a configuration that includes the following:

[0009] With this configuration, the present invention can change the shape of the virtual space, including the position where the viewing character is placed. In addition to being able to change the viewing position for viewing the object being watched, by changing the shape, position, number, or two or more of these elements of the placed objects in response to the movement of the object being watched, it is possible to provide a viewing experience unique to the virtual space, and a new viewing style that leaves the viewing position to the viewer's imagination.

[0010] Note that the "object being watched" includes (A1) Characters that are watched by viewers, such as characters who perform singing or acting in a virtual space (i.e., characters that are the focus of attention), and (A2) All objects on the stage, including the character being watched. This includes things like:

[0011] Furthermore, "the movement of the object being viewed within the virtual space" includes, for example, (B1) Movement within a virtual space, (B2) Movements of body parts such as raising a hand, smiling, waving, or coordinated movements of multiple body parts. (B3) The size increases, the arms become longer, and other parts are deformed, (B4) Actions such as singing, performing street acts, or transforming, This includes things like:

[0012] And, for example, the "object configuration change process" includes: (C1) Change the shape of the placed object (including its size and appearance), (C2) Changing the placement position of the object in question. (C3) Changes to the number of placed objects (including new additions and deletions), (C4) Rotation of the placed object, and, (C5) adding or deleting a motion of the placement object, and the like are included.

[0013] Further, the "action using the placement object" includes, for example, using the placement object as a reference when moving between placement objects (that is, using the placement object as a departure point and as an arrival point), and an action for setting a position as a viewing position so that a viewer character exists on the placement object.

[0014] For example, actions such as existing on the placement object, climbing the placement object, getting down from the placement object, moving the placement object, breaking the placement object, and creating the placement object are included.

[0015] Further, the "data for causing the viewer to view the generated image" may be image data (which may include sound data) or may be control data that can be imaged by a terminal device.

[0016] (2) Further, the present invention provides, the entertainment viewing management system according to claim 1, wherein a plurality of the placement objects can be placed in the virtual space, the object control means, controls the number of the placement objects based on the motion of the detected gaze target object in the virtual space.

[0017] With this configuration, according to the present invention, the viewing position can also be changed by changing the number of placement objects in accordance with the motion of the gaze target object, so that a new viewing style that is left to the viewer's idea can be provided.

[0018] (3) Further, the present invention provides, the viewer character control means, Based on a given instruction, it is configured to control movement between a plurality of the placement objects.

[0019] With this configuration, the present invention can, for example, change the viewing position using the placement objects based on the viewer's intention, and thus can provide a new viewing style that is left to the viewer's initiative.

[0020] Note that the "given instruction" includes, for example, a programmatic instruction executed during game execution and a player's operation instruction.

[0021] (4) Further, the present invention is A given usage condition related to the use of the viewer character is set for the placement object, The viewer character control means It is configured to control the action of the viewer character with respect to the placement object based on the usage condition.

[0022] With this configuration, the present invention can, for example, restrict the use of the placement object for each viewer character, such as the viewer character being present on the placement object or moving the placement object, or expand such use.

[0023] Accordingly, the present invention can incorporate game properties into the use of the placement object by the viewing character, and thus can improve the enjoyment of viewing.

[0024] Note that the "usage condition" includes, for example, (D1) A usage qualification condition that allows the corresponding placement object to be used when a predetermined condition such as a charged amount, a possessed item, a stay time in a virtual space, or a number of participations in a viewing event is cleared, and (D2) A usage number condition such as a settable maximum number of permitted users, and the like.

[0025] (5) Furthermore, the present invention is The object control means, As part of the object configuration change process, an object configuration change process is performed that modifies the configuration of the placed objects based on the movement of the object being watched within the virtual space, as well as the elapsed time from a given timing regarding viewing the object being watched. It has the structure to execute the logic.

[0026] With this configuration, the present invention can, for example, change the number or position of the placed objects, or change the movement of the placed objects (such as speeding up or stopping their movement), depending on the elapsed time since the start of a performance such as acting or singing of the object being watched. This allows for changes in how viewers use the placed objects during exciting or important scenes.

[0027] Therefore, the present invention enables viewing in a virtual space and can improve viewer satisfaction with the viewing experience.

[0028] Furthermore, the "given timing" includes: (E1) When the performance of the object under observation begins, (E2) In the case of singing, the timing when the encore singing begins, or in the case of acting, the timing when the final act begins, or the timing when the performance of the object of focus begins its final session, (E3) The moment the object being watched becomes larger, the moment the object being watched utters a predetermined line of dialogue, the moment the object's costume changes, or the moment the object being watched begins to perform a predetermined action, This includes things like:

[0029] (6) Furthermore, the present invention is The object control means, The system has a configuration that controls the placement of the placement object where the viewer character resides, or changes the configuration of the placement object, between the object to be watched and the viewing position of the viewer character located on the placement object, provided that a given object is placed in the direction from the viewing position to where the object to be watched is placed.

[0030] With this configuration, the present invention can control the position of the object on which the viewer character is located, so that, when other objects are present between the character being watched and the viewing position, those other objects are not present between the character being watched and the viewing position.

[0031] Therefore, the present invention allows for the placement of objects without affecting viewing, thus providing viewers with an appropriate viewing environment.

[0032] Furthermore, "a given object" includes not only other placed objects, but all objects that make up the virtual space.

[0033] (7) Furthermore, the present invention is The object control means, The system has a configuration that, between the object to be observed and the viewing position of the viewer character, prohibits the placement of the object in the direction from the viewing position to the object to be observed, and in the viewing direction of the viewer character.

[0034] This configuration allows the present invention to arrange objects without affecting viewing, thereby providing viewers with an appropriate viewing environment.

[0035] (8) Furthermore, the present invention is Regarding the viewing of the object to be focused on by the viewer character, and given viewing conditions based on the placed object, The image generation means, The system has a configuration that controls the viewing environment of the viewer character based on the aforementioned viewing conditions.

[0036] With this configuration, the present invention can change the viewing environment, for example, by incorporating a game-like element into the viewing experience. For instance, if the viewer is not present on a specific object at a predetermined timing, viewing of the object being watched will be interrupted, the frame rate will drop, or the sound will become monaural (or no longer surround sound).

[0037] The "viewing conditions" include, for example, being on a specific placement object at a predetermined time, being on a specific placement object by a predetermined time, or having used all placement objects by a predetermined time.

[0038] (9) Furthermore, the present invention is The aforementioned viewer character control means Depending on the viewing situation of the viewer or the viewer character, the parameters relating to the viewer character's use of the placement object are controlled as usage parameters. The system has a configuration that controls the actions of the viewer character regarding the use of the placed object, according to the usage parameters.

[0039] This configuration allows the present invention to change the viewer character's ability to use the placed objects according to the amount of money spent, the status of items owned, or their usage, thereby providing a game-like element to viewing the objects being watched.

[0040] Furthermore, "viewing circumstances" include, for example, the amount of money spent, the ownership or usage status of items, the time spent in the virtual space, or the number of times participants have attended viewing events.

[0041] Furthermore, "viewer character actions related to the use of placed objects" include the viewer character's ability to act within the virtual space, the ability to exist on a placed object, or the ability to use a placed object.

[0042] (10) Furthermore, the present invention is The image generation means, The configuration includes generating an image of the virtual space, including a display to allow the viewer to recognize the use of the aforementioned placed objects.

[0043] With this configuration, the present invention can include, when generating an image of the image space, an identification display of the placed object, or a display of the route to a specific placed object, or other displays related to the use of the placed object, thereby improving the convenience for viewers in using the placed object.

[0044] Furthermore, "displays intended for viewer recognition" include identification information of placement objects in which viewer characters can exist (use), and the distance from the current position to a specific placement object. This includes directions and guidance on the placement of objects to make them easier to view in relation to the target object.

[0045] (11) Furthermore, the present invention is The object control means, The object configuration change process includes a configuration in which the configuration of the placed objects is changed based on instructions from an operator operating the object being watched or from a program that controls the operation of the object being watched.

[0046] With this configuration, the present invention allows the arrangement of objects to be changed based on operation instructions from an operator manipulating the object being watched or instructions from the program, thereby enabling the arrangement of objects to be controlled in accordance with the performance.

[0047] Therefore, in exciting or important scenes, the present invention allows the operator who manipulates the object being watched to consciously change the viewing experience using the placed object, thereby highlighting the exciting points.

[0048] (12) Furthermore, the present invention is Depending on the type of the placed object, at least one of the following change elements is defined: the disappearance time of the placed object, the usage conditions of the placed object, and the movement conditions of the placed object. The object control means, The configuration includes executing an object configuration change process that modifies the configuration of the placement object based on the aforementioned change elements.

[0049] With this configuration, the present invention can change the shape within the virtual space or the viewer's viewing position in accordance with the changing elements of the placed objects, and can also provide various variations to the shape within the virtual space or the viewing position. This allows for viewing unique to the virtual space, and enables changes in viewing using placed objects during exciting or important scenes.

[0050] Furthermore, "disappearance time of placed objects" refers to the time elapsed since the start of viewing the object being watched, for example, causing the placed objects to disappear from the virtual space.

[0051] Furthermore, "usage conditions" refer to, for example, the number of people who can be on the placed object, or the attributes of viewers who can use the placed object (such as climbing on it or moving it).

[0052] (13) Furthermore, the present invention is The aforementioned placement object has parameters related to the use of the viewer character set as usage parameters. The object control means, The system has a configuration that executes the object configuration modification process of the placed object based on the aforementioned usage parameters.

[0053] With this configuration, the present invention can control the disappearance of placed objects or the movement of placed objects (such as changing the movement speed or movement path) based on the values ​​of the usage parameters, enabling viewing unique to the virtual space and allowing the viewing experience to be altered using placed objects during exciting or important scenes.

[0054] The "usage parameters" include, for example, the elapsed time until disappearance, the number of people who can be assigned, or the cumulative viewing time available to the assigned viewers relative to the number of people who can be assigned.

[0055] (14) Furthermore, the present invention is The object control means, The system has a configuration that controls the usage parameters based on the elapsed time from a given timing regarding viewing the object being watched, the number of viewer characters using the object, or the cumulative time regarding the use of the object.

[0056] With this configuration, the present invention can control the usage parameters for executing the object configuration modification process of a placed object based on the elapsed time from a given timing regarding viewing of the object to be noted, the number of viewer characters using the placed object, or the cumulative time regarding the use of the placed object, thereby enabling the placed object to be controlled in various variations.

[0057] (15) In order to solve the above problems, the present invention A program that works in conjunction with terminal devices owned by viewers connected via a network to manage viewing so that viewers can view objects that are the target of their attention within a virtual space, Detection means for detecting the movement of the object being watched within the virtual space, Means for controlling placement objects arranged in the virtual space, wherein object control means execute an object configuration change process that changes the configuration of the placement object based on the movement of the detected object under observation within the virtual space. Means for controlling a viewer character that functions as the viewpoint of a viewer viewing the object being watched, and viewer character control means for controlling the actions of the viewer character in the virtual space, including actions using the placed object. Image generation means for generating an image of the virtual space formed in the viewing direction of the viewer from the position of the viewer character, and A means for providing the generated image to the viewer via the terminal device. It has a configuration that allows it to function as a computer.

[0058] With this configuration, the present invention can change the shape of the virtual space, including the position where the viewing character is placed. In addition to being able to change the viewing position for viewing the object being watched, by changing the shape, position, number, or two or more of these elements of the placed objects in response to the movement of the object being watched, it is possible to provide a viewing experience unique to the virtual space, and a new viewing style that leaves the viewing position to the viewer's imagination. [Brief explanation of the drawing]

[0059] [Figure 1] This figure shows an example of a system configuration illustrating the configuration of a virtual space provisioning system in one embodiment. [Figure 2] This is a diagram illustrating the outline of a virtual space viewing event in one embodiment. [Figure 3] This diagram shows the functional block of a server device according to one embodiment. [Figure 4] This diagram shows the functional block of a terminal device according to one embodiment. [Figure 5] This diagram illustrates an event viewing control process in a virtual space, which is performed by a server device according to one embodiment and includes a process for changing the configuration of placed objects. [Figure 6] This diagram illustrates the process of changing the configuration of a deployed object, which is performed by a server device according to one embodiment. [Figure 7] This diagram illustrates the process of changing the configuration of a deployed object, which is performed by a server device according to one embodiment. [Figure 8] This diagram illustrates the process of changing the configuration of a deployed object, which is performed by a server device according to one embodiment. [Figure 9] This section describes the behavior control process for an avatar that is performed by a server device according to one embodiment. [Figure 10] This figure illustrates an image generation process (support display screen) performed by a server device according to one embodiment. [Figure 11] This flowchart shows the operation of the shared information object placement management process performed by a server device according to one embodiment. [Modes for carrying out the invention]

[0060] The following describes embodiments. The following embodiments are examples in which the entertainment viewing management system, etc., according to the present invention is applied to a virtual space viewing event management system that causes a character to perform entertainment such as acting or singing in a virtual space (a virtual 3D space).

[0061] The embodiments described below are not intended to unduly limit the scope of the present invention as described in the claims. Furthermore, not all of the configurations described in these embodiments are necessarily essential components of the present invention.

[0062] [1] Virtual space viewing event management system [1.1] Overview First, the overview and general configuration of the virtual space viewing event management system 1 of this embodiment will be described using Figure 1. Figure 1 is a diagram showing an example of the system configuration of the virtual space viewing event management system 1 of this embodiment.

[0063] The virtual space viewing event management system 1 of this embodiment has a configuration that provides viewing events themed around viewers watching a performance (specifically, a live singing performance) on stage 4 by a virtual 3D idol (a so-called character object that is watched by viewers and performs a predetermined performance in a virtual 3D space (hereinafter referred to as "acting character")) 8.

[0064] In particular, the virtual space viewing event management system 1 of this embodiment has a configuration in which a character (i.e., a viewer character, hereinafter referred to as "avatar") 5 appears for each viewer, and the viewer views viewing events through the avatar 5.

[0065] Specifically, as shown in Figure 1, the virtual space viewing event management system 1 is configured to connect to a network such as the Internet, and includes a server device 10 that performs various processes to realize viewing events in a virtual 3D space, and a plurality of terminal devices 20 (for example, terminal devices 20A, 20B, 20C) that allow viewers to view viewing events in the virtual 3D space.

[0066] The server device 10 is an information processing device that performs various processes to realize viewing events, for example, using an API (Application Programming Interface) or a predetermined platform.

[0067] Furthermore, the server device 10 may consist of one (device, processor) or multiple (devices, processors).

[0068] Furthermore, the billing information, viewer-related information, and other information stored in the storage area of ​​the server device 10 (storage unit 140 described later) may be stored in a database (broadly speaking, a storage device, memory) connected via a network (intranet or internet), or the viewing event information and other information stored in the storage area may be stored in a database (broadly speaking, a storage device, memory) connected via a network (intranet or internet).

[0069] In particular, the server device 10 receives input information based on the operations (viewer input) of the users of each terminal device 20 (i.e., viewers participating in the viewing event), and processes the received input information to realize the viewing event in a virtual 3D space.

[0070] The server device 10 then transmits to each terminal device 20 a three-dimensional image of the space for executing the viewing event (i.e., the event space) (including data for displaying the image) and various data related to the viewing event execution control process.

[0071] Each terminal device 20 is a device that displays an image of the viewing event space that has been virtually rendered as a 3D image, and allows users to view viewing events in a virtual 3D space that provide performances and other content within that virtual 3D space.

[0072] Furthermore, each terminal device 20 is composed of an information processing device such as a smartphone, mobile phone, PHS, computer, game device, PDA, portable game console, image generation device, or HMD (head-mounted display), and is capable of connecting to the server device 10 via a network such as the Internet (WAN) or LAN. The communication line between the terminal device 20 and the server device 10 may be wired or wireless.

[0073] Furthermore, each terminal device 20 is configured to have a communication control function for communicating with the server device 10, and a function for performing display control using data received from the server device 10, as well as a function for transmitting operation information entered by the viewer to the server device 10.

[0074] Each terminal device 20 is configured to provide viewing events to viewers based on the information transmitted from the server device 10.

[0075] [1.2] Description of virtual space viewing events Next, an overview of the viewing event realized by this embodiment will be explained using Figure 2. Figure 2 is a diagram illustrating the overview of the virtual space viewing event in this embodiment.

[0076] The virtual three-dimensional space is constructed as a virtual space (virtual three-dimensional space), as shown in Figure 2, for example. This virtual three-dimensional space includes a stage 4, which is a performance area for live performances, and a viewing space 6 where viewer avatars 5 are placed.

[0077] Then, one or more NPCs (non-avatar performer characters 8 (for example, idol characters)) perform on stage, such as singing or acting, and viewer 2 can watch performer character 8's performance through avatar 5.

[0078] In other words, Avatar 5 is a viewer character that can be controlled by each viewer placed in the virtual space and can be positioned at the viewing location desired by each viewer.

[0079] The live stage will include singing, playing instruments, dancing, street performances, and other live performances. This is a performance, and in this embodiment, for example, a live performance of singing a song with choreography is carried out.

[0080] Stage 4 can be set up as needed, for example, as an outdoor stage, concert hall, or live music venue. Depending on the event, it is also possible to set up situations such as a school gymnasium stage, a classroom podium, the back of a truck, or a deck.

[0081] Viewing Space 6 is a virtual viewing space provided as a viewing position (i.e., a viewing position) for watching the live stage. The layout of Viewing Space 6 can be appropriately set according to the design of Stage 4.

[0082] In addition, viewing space 6 is equipped with avatars 5 that represent fans of the idols, and viewers participate in the viewing event by associating themselves with at least one of the avatars 5 that has been configured with appearance, looks, or items.

[0083] Then, in the viewing space 6, one or more placement objects 9 are arranged and formed, which are modified based on the movements of the performer character 8 in the virtual space, such as movement, actions, or combinations thereof.

[0084] In particular, in the case of placement object 9, the configuration of placement object 9 (number, placement position, shape, etc.) is changed based on the movement of the performer character within the virtual space.

[0085] Performer character 8 may perform an acting performance based on input from the administrator of the viewing event (including the administrator managing the viewing event, the operator of the viewing event, or operators or broadcasters commissioned by the administrator or operator), or it may be automatically controlled by a program. Performer character 8 may also be managed by other server devices (not shown).

[0086] Each avatar 5 can move freely within the viewing space 6, as shown in Figure 2, for example, and is controlled based on operations input by the terminal device 20.

[0087] Furthermore, each viewer can perceive images in the virtual 3D space through the eyes of each of their avatars (5 in total).

[0088] Additionally, NPCs may be automatically placed in viewing space 6 as viewer characters and automatically controlled by a computer.

[0089] [2] Server equipment First, the overview and configuration of the server device 10 of this embodiment will be described using Figure 3. Figure 3 is a diagram showing the functional blocks of the server device 10 of this embodiment. Furthermore, the server device 10 of this embodiment may have a configuration in which some of the components (each part) shown in Figure 3 are omitted.

[0090] The server device 10 includes a processing unit 100 that performs processing to provide viewing events in a virtual three-dimensional space, an input unit 120 for use by administrators and others, a display unit 130 that displays predetermined information, a storage unit 140 that stores viewing event and data for each viewer, an information storage medium 180 in which predetermined information is stored, and a communication unit 196 that communicates with terminal devices 20 and others.

[0091] The input unit 120 is used by system administrators, etc., to set up viewing events and other necessary settings and input data. For example, the input unit 120 in this embodiment can be a mouse or keyboard. It is composed of boards, etc.

[0092] In particular, the input unit 120 receives operation input from the administrator. For example, the input unit 120 receives operation input for controlling the performer character 8.

[0093] The display unit 130 displays an operation screen for the system administrator. For example, the display unit 130 in this embodiment is composed of a liquid crystal display or the like.

[0094] The information storage medium 180 (a medium readable by a computer) stores programs, data, etc., and its function is comprised of optical discs (CDs, DVDs), magneto-optical discs (MOs), magnetic discs, hard disks, magnetic tapes, or memory (ROMs).

[0095] The communication unit 196 is a device that performs various controls for communicating with external parties (e.g., terminals, other servers, or other network systems), and its functions are comprised of hardware such as various processors or communication ASICs, as well as programs.

[0096] The memory unit 140 serves as the work area for the processing unit 100 and the communication unit 196, and its functions are comprised of RAM (VRAM), etc. The information stored in the memory unit 140 may be managed by a database.

[0097] Furthermore, in this embodiment, the storage unit 140 includes a main storage unit 142 used as a work area, a performance information storage unit 144 related to the performance in the viewing event provided, a viewer-related information storage unit 146 related to each viewer, a placement object control information storage unit 148 that stores information for controlling placement objects (hereinafter referred to as "placement object control information"), and an event image storage unit 149 that stores images related to the viewing event, such as images from the viewpoint of each virtual camera during the viewing event (hereinafter referred to as "virtual camera images") (hereinafter referred to as "viewing event images"). However, in addition to the above-mentioned information, the storage unit 140 also stores various types of information necessary for calculations related to the viewing event.

[0098] In particular, the viewer-related information storage unit 146 associates each viewer with a viewer ID. (A1) Viewer attributes such as name, age, gender, and account information for payment processing, and information about the viewer themselves, including information about their avatar (hereinafter referred to as "avatar information"), (A2) Information regarding viewers' behavior related to viewing events (hereinafter referred to as "viewer behavior") (A3) Information on the amount charged, (A4) Information on items you possess, (A5) Information on the time spent in the virtual space, and, (A6) Information on the number of times participants have attended viewing events. Information about viewers, such as the above, is stored.

[0099] The avatar information includes various details necessary to set up the avatar (character), such as the basic shape (basic form of a person, animal, or robot, including size), appearance (including color), hairstyle, and makeup), and owned items (clothing, accessories, possessions (towels, glow sticks, etc.)).

[0100] The placement object control information storage unit 148 contains: (B1) Information indicating the usage conditions of the placed object (hereinafter referred to as "usage conditions information"), and (B2) Based on the placement object, information such as information indicating viewing conditions that control the viewing environment in the defined avatar 5 (hereinafter referred to as "viewing condition information based on placement object") is stored.

[0101] The processing unit 100 performs various processes using the main memory unit 142 within the storage unit 140 as the work area. The functions of the processing unit 100 can be realized by hardware such as various processors (CPU, DSP, etc.) and ASICs (gate arrays, etc.) or by programs.

[0102] The processing unit 100 performs various processes of this embodiment based on the program (data) stored in the information storage medium 180. That is, the information storage medium 180 stores programs that cause the computer to function as each part of this embodiment (programs that cause the computer to execute the processing of each part).

[0103] For example, the processing unit 100 (processor) controls the entire server device 10 based on the program stored in the information storage medium 180, and also performs processing such as processing to control the execution of viewing events, special effects control processing, image generation processing, or sound generation processing.

[0104] Furthermore, the processing unit 100 controls the execution of the viewing event by performing the following processes: starting the viewing event when the event start conditions are met, progressing the viewing event, placing various objects such as characters and maps in the object space (3D space), displaying the objects, calculating the results of the viewing event, or terminating the viewing event when the event end conditions are met.

[0105] Specifically, the processing unit 100 of this embodiment includes at least a communication control unit 101, a viewer management unit 102, a display control unit 103, a virtual camera control unit 106, a sound generation unit 107, an image generation unit 108, a timer unit 110, an information provision unit 111, and an event control unit 115.

[0106] The communication control unit 101 performs processing to send and receive data with the terminal device 20 via the network. That is, the server device 10 performs various processing based on various information, including viewer operation information, received from the terminal device 20 etc. by the communication control unit 101.

[0107] The viewer management unit 102 handles processing related to viewer registration procedures (including login settings) and manages the storage of data linked to accounts (viewer IDs).

[0108] Specifically, the viewer management unit 102 controls the assignment of accounts when new viewers register, manages registration information to register and manage personal information about viewers, sets up and controls deposits and withdrawals to virtual accounts linked to accounts and used as the source of funds for payment related to the execution of billing elements, registers the billing history of billing elements by viewers of the said account, and stores and manages event progress information related to the progress of events linked to the account.

[0109] The display control unit 103 displays images related to the viewer's current viewing or viewing event on the display unit 130.

[0110] In particular, the display control unit 103 performs processing to overlay information about the virtual space of each viewer onto the image generated by the image generation unit 108 using the virtual camera for each viewer as the viewpoint, and display it on the display unit 130.

[0111] The virtual camera control unit 106 is located in object space (i.e., virtual space) and generates images that are visible from the position (viewing position) of each avatar 5, which functions as the viewer's viewpoint. This process controls the virtual camera (viewpoint, reference virtual camera) for this purpose.

[0112] Specifically, this involves processing to control the position (X, Y, Z) or rotation angle (rotation angle around the X, Y, Z axes) of the virtual camera (processing to control the viewpoint position, line of sight direction, or field of view).

[0113] The sound generation unit 107 generates background music or performance sounds, character voices (singing sounds), and ambient sounds in the virtual space in accordance with the progress of the viewing event or the performance of the performer character 8.

[0114] The sound generation unit 107 performs sound processing based on the results of various processes performed by the processing unit 100, generates event sounds such as background music, sound effects, or voices, and outputs them to the sound output unit 292.

[0115] The image generation unit 108 performs drawing processing based on the results of various processing related to the viewing event, including the image generated by the display control unit 103 and the image generated by the virtual camera control unit 106, thereby generating an image, and transmits the generated image data to the corresponding terminal device 20.

[0116] In particular, the image generation unit 108 generates an image for each viewer of the virtual space as seen from the avatar's viewing position.

[0117] Specifically, the image generation unit 108 performs geometry processing such as coordinate transformation (world coordinate transformation, camera coordinate transformation), clipping, perspective transformation, or light source processing, and based on the results of this processing, drawing data (position coordinates of primitive face vertices, texture coordinates, color data, normal vectors, or alpha values, etc.) is created. Then, based on this drawing data (primitive face data), the object (one or more primitive faces) after perspective transformation (after geometry processing) is drawn to a drawing buffer (a buffer that can store image information on a pixel-by-pixel basis, such as a frame buffer or work buffer) which is not shown. This generates an image that can be seen from a virtual camera (a given viewpoint) within the object space.

[0118] The drawing process performed in the image generation unit 108 can be implemented using vertex shader processing, pixel shader processing, and the like.

[0119] Furthermore, if the terminal device 20 is formed by an HMD, the image generation unit 108 generates parallax images (for the right eye and left eye) to enable stereoscopic viewing by allowing the viewer wearing the HMD to see an image of a virtual three-dimensional space with a predetermined amount of parallax in both eyes.

[0120] The timer unit 110 uses the system clock to perform timing for executing processes that measure timer values ​​such as the current date and time, time limits, and time management for event progress control.

[0121] The information provision unit 111 combines the image generated by the image generation unit 108 with the sound generated by the sound generation unit 107 to provide data (content data) for viewing viewing events to each terminal device 20, and provides this data to each viewer in association with the content data.

[0122] Furthermore, the information provision unit 111 provides the corresponding terminal device 20 with the information necessary for viewing the viewing event, tailored to each viewer.

[0123] The event control unit 115 performs various processes related to the execution management of viewing events. In this embodiment, the event control unit 115 communicates with the terminal device 20 and performs control to provide the data necessary for the event.

[0124] Specifically, the event control unit 115 includes at least an event management unit 116, an object control unit 117, and a motion detection unit 118.

[0125] The event management unit 116 performs various processes related to the execution of viewing events, including the start and end processes of viewing events, which include the performance of the acting characters, as well as the process of executing each viewing event.

[0126] In particular, when the event management unit 116 executes a viewing event that includes a performance by a character, it sets up a live stage in a virtual 3D space where the character performs based on the viewer's input, and also performs various controls such as music playback and lighting during the performance (i.e., while the character is performing) on ​​the set live stage.

[0127] The object control unit 117 performs configuration processing for multiple objects placed in the object space (a virtual 3D space which is a 3D virtual space).

[0128] For example, the object control unit 117 performs the process of placing various objects (objects composed of primitive surfaces such as polygons, freeform surfaces, or subdivision surfaces) that represent display items such as characters (people, animals, robots, etc.), maps (terrain), buildings, courses (roads), trees, walls, and water surfaces, including the avatar 5, performer character 8, and placement object 9, into the object space (virtual space).

[0129] In other words, the object control unit 117 determines the object's position and rotation angle (synonymous with orientation or direction) in the world coordinate system, and places the object at that position (X, Y, Z) with that rotation angle (rotation angle around the X, Y, Z axes).

[0130] Furthermore, the object control unit 117 performs movement calculations for each object in the virtual space, including the avatar 5, the performer character 8, and the placed object 9.

[0131] In other words, the object control unit 117 moves various objects, including the avatar 5, performer character 8, and placement object 9, within the virtual space, or performs processing to control the movement (motion, animation) of these various objects, based on the instructions of the viewer and the corresponding controls, or according to the program.

[0132] Specifically, the object control unit 117 of this embodiment performs simulation processing to sequentially obtain object movement information (direction of movement, amount of movement, speed of movement, position, rotation angle, or acceleration) and motion information (position or rotation angle of each part object) frame by frame.

[0133] A frame is a unit of time used for object movement processing, motion processing (simulation processing), and image generation processing. In this embodiment, the frame rate may be fixed or variable depending on the processing load.

[0134] The motion detection unit 118 detects predetermined movements of the performer character 8 within the virtual space during the viewing event.

[0135] [3] Terminal device Next, the terminal device 20 of this embodiment will be described using Figure 4. Figure 4 is a diagram showing the functional blocks of the terminal device 20 of this embodiment. Furthermore, the terminal device 20 of this embodiment may have a configuration in which some of the components (each part) in Figure 4 are omitted.

[0136] The input unit 260 is a device for receiving input information from viewers and outputs the viewer's input information to the processing unit 200.

[0137] The input unit 260 of this embodiment includes a detection unit 262 that detects viewer input information (input signals). For example, the input unit 260 is composed of a lever, buttons, steering wheel, microphone, touch panel display, keyboard, mouse, etc.

[0138] The memory unit 270 serves as the work area for the processing unit 200 and the communication unit 296, and its functions can be realized by RAM (VRAM) or the like. In this embodiment, the memory unit 270 includes a main memory unit 271 used as the work area and an image buffer 272 where the final display image and the like are stored. Note that some of these components may be omitted.

[0139] The information storage medium 280 (a medium readable by a computer) stores programs, data, etc., and its function can be realized by optical discs (CDs, DVDs), magneto-optical discs (MOs), magnetic discs, hard disks, magnetic tapes, or memory (ROMs).

[0140] The processing unit 200 performs various processes of this embodiment based on the program (data) stored in the information storage medium 280. The information storage medium 280 can store programs for causing the computer to function as each part of this embodiment (programs for causing the computer to execute the processing of each part).

[0141] In this embodiment, the server device 10 receives programs and various data for making the computer function as each part of this embodiment, which are stored in the information storage medium 180 and the storage unit 140, via the network, and stores the received programs and data in the information storage medium 280.

[0142] The program and data received from the server device 10 may be stored in the storage unit 270. The case where the network system functions by receiving such programs and data is also included within the scope of the present invention.

[0143] The display unit 290 outputs the image generated by this embodiment, and its function can be realized by a CRT, LCD, touch panel display, or HMD (head-mounted display), etc.

[0144] The sound output unit 292 outputs the sound generated by this embodiment, and this function can be realized by a speaker or headphones, etc.

[0145] The communication unit 296 performs various controls for communication with external devices (e.g., other terminals, servers), and its functions can be realized by hardware such as various processors or communication ASICs, or by programs.

[0146] The processing unit 200 (processor) performs processing such as display control, image generation processing, or sound generation processing based on various information obtained from the server device 10 via the communication unit 296, input information from the acquired input unit 260, or programs.

[0147] This processing unit 200 performs various processes using the main memory unit 271 within the storage unit 270 as the work area. The functions of the processing unit 200 can be realized by hardware such as various processors (CPU, DSP, etc.), ASICs (gate arrays, etc.), or by programs.

[0148] The processing unit 200 includes a communication control unit 210, a web browser 211, a display control unit 213, a drawing unit 220, and a sound processing unit 230. Note that some of these components may be omitted.

[0149] The communication control unit 210 performs data transmission and reception with each of the server devices 10. The communication control unit 210 also performs data storage in the storage unit 270, data analysis, and other control processing related to data transmission and reception.

[0150] Furthermore, the communication control unit 210 may store and manage the server's destination information (IP address, port number) in the information storage medium 280. The communication control unit 210 may also communicate with the server device 10 when it receives input information from a viewer to initiate communication.

[0151] In particular, the communication control unit 210 transmits viewer identification information and operation information to the server device 10, and processes information regarding avatars for acting in the virtual space and information regarding the results of said actions from the server device 10.

[0152] The communication control unit 210 may perform data transmission and reception with the server device 10 at predetermined intervals, or it may perform data transmission and reception with the server device 10 when it receives input information from the input unit 260. In particular, the communication control unit 210 in this embodiment performs processing to receive a screen related to the virtual space avatar from the server device 10.

[0153] The web browser 211 is an application program for viewing web pages (screens related to avatars in a virtual space). It downloads HTML files, image files, etc., from the web server (server device 10), analyzes the layout, and controls the display. The web browser 211 also sends data to the web server (server device 10) using input forms (links, buttons, text boxes, etc.).

[0154] The Web browser 211 in this embodiment may execute programs written in JavaScript®, FLASH, Java®, etc., that are received from a Web server (server device 10).

[0155] The terminal device 20 can display information from a web server specified by a URL via the internet using its web browser 211. For example, the terminal device 20 can display a screen (data such as HTML) related to a virtual space avatar received from the server device 10 using its web browser 211.

[0156] When the display control unit 213 receives image data (including sound data) transmitted from the server device 10 that pertains to an image in the virtual space as seen by the avatar 5, it executes display control processing based on the received image data and displays the image in the virtual space on the display unit 290.

[0157] Furthermore, if the data transmitted from the server device 10 is control data for image conversion in the terminal device 20, the display control unit 213 performs processing similar to the image generation processing performed in the processing unit 100 of the server device 10.

[0158] The drawing unit 220 performs drawing processing based on various processes (for example, display control processing) performed by the processing unit 200, thereby generating an image, which is then output to the display unit 290 by the display control unit 213.

[0159] The image generated by the drawing unit 220 may be a so-called two-dimensional image or a so-called three-dimensional image.

[0160] The sound processing unit 230 performs sound processing based on the results of various processes performed by the processing unit 200, generates various sounds such as background music, sound effects, or voices, and outputs them to the sound output unit 292.

[0161] [4] The method of this embodiment [4.1] Overview Next, using Figure 5, we will describe the processing performed by the server device 10 of this embodiment, which includes processing to change the configuration of the placement object 9 (hereinafter referred to as "placement object configuration change processing"), and the viewing control processing for viewing events in the virtual space (hereinafter referred to as "event viewing control processing").

[0162] Figure 5 is a diagram illustrating the process performed by the server device 10 of this embodiment, which includes the process of changing the configuration of the placed objects, and is used to explain the event viewing control process within the virtual space.

[0163] The server device 10 of this embodiment is a server device that allows viewers to view viewing events performed in a virtual space, and is configured to work in conjunction with terminal devices 20 owned by viewers connected via a network, and to manage viewing so that viewers can view performer characters 8 that are the target of the viewer's attention in the virtual space.

[0164] In particular, the server device 10 of this embodiment controls the performance of the performer character 8 on the stage 4, and changes the viewing position of the performer character 8 via an avatar 5 that can move freely around the viewing space 6, while also changing the configuration of the placement objects arranged in the viewing space 6 and usable by the avatar 5 based on the movements of the performer character 8.

[0165] Specifically, the server device 10 of this embodiment is as shown in Figure 5, (A1) Detect the movement of the performer character (object to be watched) 8 in the virtual space, (A2) Control the placement object 9 that is placed and formed in the virtual space, and execute a placement object configuration change process that changes the configuration of the placement object 9 based on the movement of the detected performer character 8 in the virtual space, (A3) Control the avatar (viewer character) 5, which functions as the viewpoint of the viewer watching the performer character 8, and control the actions of the avatar 5 in the virtual space, including actions using the placed object 9. (A4) Generate an image of a virtual space formed in the direction of the viewer's viewing from the position of avatar 5, and (A5) provide control data (hereinafter also referred to as "viewing control data") for the viewer to view the generated image to the corresponding terminal device 20. It has a structure.

[0166] Figure 5 shows an example of how a viewing event execution control process is executed while referring to the data in the storage unit 140. This process includes controlling the actions of the avatar 5 based on viewer operation instructions input from each terminal device 20, controlling the performer character 8 based on instructions from an administrator or the like input via the input unit 120, controlling the placement object 9, and executing event control to control the entire viewing event.

[0167] In particular, Figure 5 shows how the movements of performer character 8 during the viewing event refer to the memory unit 140. An example is shown of controlling the actions of the avatar 5 in the virtual space, including actions using the modified configuration of the placement object 9, when a predetermined movement is detected.

[0168] Figure 5 shows an example of how to visualize the virtual space from the perspective of avatar 5 during a viewing event, and how to provide the generated image to the terminal device 20 as viewing control data so that viewers can view it.

[0169] With this configuration, the server device 10 or the virtual space viewing event management system 1 of this embodiment can change the shape of the virtual space, including the position where the avatar 5 is placed. In addition to being able to change the viewing position for viewing the performer character 8, it is possible to change the shape, position, number, or two or more of these elements of the placed objects 9 in accordance with the movement of the performer character 8, thereby enabling viewing unique to the virtual space and providing a new viewing style that leaves the viewing position to the viewer's imagination.

[0170] [4.2] Motion detection process for performer characters Next, the process for detecting the movement of the performer character, which is performed by the server device 10 of this embodiment (hereinafter referred to as the "performer character movement detection process"), will be described.

[0171] The motion detection unit 118 detects the movement of the performer character 8 within the virtual space during the viewing event. In particular, the motion detection unit 118 works in conjunction with the object control unit 117 to detect the movement of the performer character 8 within the virtual space, as well as predetermined actions of the performer character 8, including the movement of each part of the performer character 8.

[0172] Specifically, the motion detection unit 118 detects the movement of the performer character 8 within the virtual space as follows: (A1) Movement within a virtual space, (A2) Movements of body parts such as raising a hand, smiling, waving, or coordinated movements of multiple body parts. (A3) The size increases, the arms become longer, and other parts are deformed, (A4) Actions such as singing, performing street acts, or transforming into a different form. These are some of the things that are detected.

[0173] [4.3] Processing to change the configuration of placed objects Next, the deployment object configuration change process performed by the server device 10 of this embodiment will be described using Figures 6 to 8.

[0174] Figures 6 to 8 are diagrams illustrating the placement object configuration change process performed by the server device 10 of this embodiment.

[0175] (Basic processing for placing objects and modifying the configuration of those objects) The object control unit 117 places the placement object 9 that can be used by the avatar 5 when a viewing event is executed.

[0176] Basically, as shown in Figure 2, the object control unit 117 places one or more placement objects having a predetermined shape in the viewing space 6 at the start of the event or during the viewing event, based on instructions from the administrator or according to a predetermined program.

[0177] Specifically, the object control unit 117 places a placement object 9 on its upper surface or having a surface or space inside in which an avatar 5 can reside, and also places a plurality of placement objects 9 that form a surface or space in which an avatar 5 can reside.

[0178] For example, the object control unit 117 places one or more placement objects 9 on their upper surfaces or within the space of the placement object 9 to form a viewing position for viewing the stage 4 of the performer character 8.

[0179] Furthermore, the object control unit 117 may arrange placement objects 9 that have a shape or structure that allows the avatar 5 to climb up or down, such as having a staircase or a ladder, or a shape or structure that allows the avatar 5 to move.

[0180] On the other hand, the object control unit 117 may perform an object configuration modification process during a viewing event to change the configuration of the placed object 9 based on the movement of the performer character 8 in the virtual space as detected above.

[0181] In particular, the object control unit 117 may perform a configuration change process that modifies the configuration of placement objects 9 already placed in the virtual space based on the detected movement of the performer character 8 in the virtual space, in order to provide a change in the viewing position by the avatar 5 and a new viewing style that accompanies it.

[0182] In this case, the object control unit 117 will (A1) Changes in shape (including size and appearance), (A2) Change of placement position, (A3) Changes to the number of items (including new additions and deletions), (A4) Rotation, and, (A5) Adding or deleting movements, Modify the configuration of the placement object 9, such as the one shown.

[0183] Then, the object control unit 117 executes the object configuration change process using, for example, table data stored in the performance information storage unit 144, which associates movement in the virtual space with the changes made in the object configuration change process.

[0184] (Specific example of changing the configuration of placed objects 1: Changing the number) The object control unit 117 controls the number of placement objects 9 based on the movement of the detected performer character 8 within the virtual space, if multiple placement objects 9 can be placed within the virtual space.

[0185] For example, as shown in Figure 6, if the object control unit 117 detects that the number of performer characters 8 has increased from one to two, it splits the placement object 9 formed in the viewing space 6 into two objects, changing them into two placement objects 9A and 9B.

[0186] Figure 6 shows an example where, as part of the movement detection of performer character 8, when the appearance of a new performer character is detected, the placement object configuration is changed to two objects in the viewing space 6.

[0187] (Specific example of changing the configuration of placed objects 2: Other changes) The object control unit 117 may change the configuration of the placed object 9, such as changing the shape of the placed object 9, changing its position, rotating it, or adding or deleting movement, based on the detected movement of the performer character 8 in the virtual space.

[0188] For example, as shown in Figure 7, if the object control unit 117 detects that the performer character 8 has moved from left to right on the stage 4, it moves the placement object 9, which is located on the left side at the rear of the viewing space 6, to the right in accordance with the movement of the performer character 8.

[0189] Furthermore, for example, as shown in Figure 8, if the object control unit 117 detects that the performer character 8 will become twice its current size on the stage 4, it moves the placement object formed at the rear of the viewing space 6 to the height of the performer character 8's face.

[0190] (For example, prohibiting the placement of objects.) The object control unit 117 may, in order to place the placement object 9 without affecting viewing, prohibit the placement of the placement object 9 between the performer object and the viewing position of the avatar 5, in the direction from the viewing position to where the performer object is placed, and in the viewing direction from the avatar 5, when placing the placement object 9 and when performing the placement object configuration change process for the placement object 9.

[0191] Furthermore, the object control unit 117 may control the placement of the placement object 9 where the avatar 5 is located, or change the configuration of the placement object 9, if, between the viewing position of the avatar 5 located on the placement object 9 and the performer character 8, other placement objects 9 or objects forming the virtual space are located in the direction from the viewing position to where the performer character 8 is located.

[0192] For example, the object control unit 117 may have a configuration that fires a "ray" from the performer character 8 towards the placement object 9 where the avatar 5 is located, and then places the placement object 9 at the position where the fired ray passes, moves it, or divides or destroys the configuration of the placement object 9.

[0193] [4.4] Action control processing for avatars Next, using Figure 9, we will explain the process related to behavioral control for the avatar 5 performed by the server device 10 of this embodiment (hereinafter referred to as "behavioral control process").

[0194] Figure 9 illustrates the process related to behavioral control for the avatar 5, which is performed by the server device 10 of this embodiment (hereinafter referred to as "behavioral control process").

[0195] (Basic processing for controlling the actions of avatars) The object control unit 117 is a control unit that controls the actions of avatar 5, which functions as the viewpoint of a viewer watching the performer character, within the virtual space (particularly within the viewing space 6), and executes action control processing to control the actions of avatar 5 within the virtual space, including actions using placed objects 9.

[0196] In particular, the object control unit 117, as an action control process, executes an action control process that controls actions to make the viewer character a viewing position by placing the viewer character on the placement object 9, such as on its top surface or in the internal space of the placement object 9, as an action using the placement object 9.

[0197] For example, the object control unit 117 controls various actions such as being present on a placed object, climbing onto the placed object, descending from the placed object, moving the placed object, destroying the placed object, and creating the placed object.

[0198] Furthermore, the object control unit 117 controls the movement between each of the placed objects 9 based on the viewer's instructions input into the terminal device 20 as part of its action control processing.

[0199] In other words, the object control unit 117 controls movement from one placement object 9 to another placement object 9 as an action control process in order to change the viewing position, based on the viewer's instructions input to the terminal device 20.

[0200] (Avatar behavior control processing based on terms of use) When the object control unit 117 controls the actions of the avatar 5 using the placed object 9, it may execute an action control process for the avatar 5 using the given usage conditions for the use of the placed object 9 that have been set in advance.

[0201] In particular, in this case, the object control unit 117 may restrict or expand the use of the placement object for each viewer character, thereby providing gameplay related to the use of the placement object by the viewer character. In this case, the avatar 5 may control the actions of the placement object 9 based on usage conditions set in advance for the placement object 9.

[0202] Specifically, the object control unit 117 has the following usage conditions: (A1) If you meet predetermined conditions such as the amount of money spent, items you possess, time spent in the virtual space, or number of times you have participated in viewing events, you will be eligible to use the corresponding placement object, or (A2) User capacity conditions are defined on the condition that the number of available users is set. Use things like these.

[0203] For example, as shown in Figure 9, if a usage condition is set for a particular placement object 9 such that only two avatars 5 can exist on that placement object 9, the object control unit 117 will execute a process to prevent the fourth avatar 5 from being on the placement object 9, such as causing the fourth avatar 5 to fall from the placement object 9, if a third avatar 5 arrives on the placement object 9.

[0204] Figure 9 shows an example where, if two avatars, avatar 5A and avatar 5B, are already present on the placement object 9, a third avatar, avatar 5C, climbs up, and depending on the usage conditions, avatar 5C is removed and falls in its current state.

[0205] Furthermore, the object control unit 117 may, in conjunction with the information provision unit 111, notify viewers that usage conditions have been set for the placement object 9 and to make them aware of the contents of those conditions, along with the placement object 9 itself.

[0206] (Avatar behavior control processing based on usage parameters) The object control unit 117 controls the parameters related to the use of the placement object 9 by the avatar 5 (hereinafter referred to as "usage parameters") according to the viewing status of the viewer or avatar 5 (hereinafter referred to as "viewing status"), and controls the actions of the avatar 5 regarding the use of the placement object 9 according to the usage parameters.

[0207] In particular, the object control unit 117 uses information such as the amount of money the viewer has paid, the status of items they own or use in the virtual space, the time the avatar 5 spends in the virtual space, or the number of times they have participated in viewing events as viewing status.

[0208] Furthermore, the object control unit 117 states that the actions of the avatar 5 regarding the use of the deployed object 9 include the avatar 5's ability to act within the virtual space, the ability to exist on the deployed object 9, or the ability to utilize the deployed object 9.

[0209] Specifically, the object control unit 117 determines the level required for the avatar 5 to exist on the placement object 9 (hereinafter referred to as "avatar level"), which is a usage parameter, according to the amount of money the viewer has paid, and determines the ability to exist on the placement object according to the determined avatar level.

[0210] For example, consider a scenario where the avatar level required for avatar 5 to exist on placement object 9 is set to five levels depending on the viewer's spending (total amount or spot payment), and only one avatar 5 can exist on placement object 9 at a time, and the avatar's actions are controlled based on its ability to exist on placement object 9.

[0211] In this case, if no avatars 5 exist on the placement object 9, or if there are avatars with a lower avatar level than the newly arrived avatar 5, the object control unit 117 executes control to place an avatar 5 with the newly arrived avatar level on the placement object 9.

[0212] At this time, if there is an avatar on the placement object 9 with a lower avatar level than the newly arrived avatar 5, the object control unit 117 will perform control to remove that avatar 5 from the placement object 9.

[0213] On the other hand, if there are avatars on the placement object 9 with the same or higher avatar level than the newly arrived avatar 5, the object control unit 117 executes control to remove the avatar 5 with the newly arrived avatar level from the placement object 9.

[0214] Furthermore, the object control unit 117 controls the avatar's ability to move within the virtual space, such as the movement speed between the avatar's placed objects, the jumping ability when standing on the placed objects 9, and the climbing speed when multiple placed objects are arranged in a staircase-like fashion, according to the avatar's level.

[0215] Furthermore, the object control unit 117 controls the avatar 5's ability to move its placed objects, for example, by having different sizes or ranks of placed objects that can be moved or destroyed, depending on the avatar level.

[0216] In this embodiment, the avatar level is used as the parameter, but it could also be the level of the items that avatar 5 possesses, the amount of charge that is charged at predetermined intervals, such as energy or life, or the number of specific items.

[0217] [4.5] Image generation process Next, the image generation process performed by the server device 10 of this embodiment will be described using Figure 10.

[0218] Figure 10 is a diagram illustrating the image generation process (support display screen) performed by the server device 10 of this embodiment.

[0219] The image generation unit 108 works in conjunction with the virtual camera control unit 106 and the sound generation unit 107 to generate an image of the virtual space formed in the viewer's direction from the position of the avatar 5 in the virtual space, and outputs the generated image to the information provision unit 111.

[0220] Furthermore, the image generation unit 108 may control the viewing environment of the avatar 5 based on viewing conditions determined in advance based on the placement objects 9.

[0221] In particular, the image generation unit 108 controls the viewing environment of the avatar 5 based on viewing conditions that have been set in advance based on the placement object 9, with respect to viewing the performer character 8 in the avatar 5.

[0222] Furthermore, the image generation unit 108 uses, for example, the viewing conditions such as the presence of an avatar 5 on a specific placement object at a predetermined timing, the presence of an avatar 5 on a specific placement object 9 by a predetermined timing, or the presence of all placement objects 9 by a predetermined timing.

[0223] The image generation unit 108 then modifies the viewing environment by taking measures such as interrupting viewing of the performer character 8, reducing the frame rate when generating images, or changing the sound to monaural (or no longer surround sound).

[0224] On the other hand, the image generation unit 108 may generate an image of the virtual space that includes a display to allow the viewer to recognize the use of the placed object 9.

[0225] Specifically, as shown in Figure 10, the image generation unit 108 includes, as a display screen (support display screen) to support the viewer, identification information of placement objects 9 in which the avatar 5 can exist (use), a route from the current position to a specific placement object 9, or guidance from the current position to a placement object 9 that is easy for the performer character 8 to view.

[0226] Figure 10 shows an example where there is a placement object 9 that is not being used by any viewer, and the route to it is displayed on the terminal device 20 as a support display screen.

[0227] [4.6] Provisioning process Next, the information provision process performed by the server device 10 of this embodiment will be described.

[0228] The information provision unit 111 provides the terminal device 20 with data (including sound data) that allows viewers to view images from a viewpoint in a virtual space, including images generated by the image generation unit 108.

[0229] Information provision unit 111, while providing virtual space provision services to viewers, The terminal device 20 is provided with information and data related to the processing required for the viewer to enjoy the virtual space service and the display necessary for the execution of said processing.

[0230] [4.7] Variant (Example 1: Object being focused on) In this embodiment, the performer character 8 was used as the object of attention that viewers focus on, but the entire stage 4, including the performer character 8, may also be used as the object of attention.

[0231] In this case, the motion detection unit 118 detects the movement of the stage 4, including the performer character 8, during the viewing event.

[0232] For example, in addition to detecting the movement of the performer character 8 as described in the above embodiment, the motion detection unit 118 also detects the rotation of the stage 4, the raising and lowering of a part of the stage 4's lift, the opening and closing of the curtain, changes in lighting, and changes in the set.

[0233] Then, the object control unit 117 executes an object configuration change process that modifies the configuration of the placed object 9 based on the movements of these stages 4.

[0234] (Modification 2: Processing to change the configuration of placed objects based on the elapsed time of the viewing event) In this embodiment, a configuration change process for placement objects is performed to change the configuration of placement objects based on the movements of the performer character 8, but the configuration change process for placement objects may also be performed based on the start of an event or the alert time from a given timing within a viewing event.

[0235] Therefore, the server device 10 of this modified example may have a configuration that allows for changes in viewing using placed objects during exciting or important scenes.

[0236] Specifically, the object control unit 117 performs an object configuration change process as a placement object configuration change process, which changes the configuration of the placement object 9 based on the movement of the performer character 8 in the virtual space and the elapsed time from a given timing related to viewing the performer character 8.

[0237] For example, the object control unit 117 executes control to increase the number of the arrangement objects 9, raise the arrangement positions of the arrangement objects 9, or move the movements of the arrangement objects 9 in synchronization with the movements of the performer character 8, when a certain period of time has elapsed since a performance such as acting or singing of the gaze target object started.

[0238] (Modification 3: Arrangement Object Configuration Change Processing by Administrator) In the present embodiment, control for changing the configuration of the arrangement objects 9 may be executed based on an instruction from the administrator of the performer character 8, or an instruction from a program that controls the virtual space including the performer character 8.

[0239] That is, in this case, the server device 10 has a configuration for changing the configuration of the arrangement objects, as object configuration change processing, based on an instruction from the administrator who operates the performer character 8 or an instruction from a program that controls the operation of the performer character 8.

[0240] In particular, in this case, the server device 10 has a configuration that allows the administrator of the performer character 8 to change the configuration of the arrangement objects 9 while grasping the arrangement position of each avatar 5 of the viewer, for example.

[0241] Specifically, the object control unit 117, as arrangement object configuration change processing, based on an instruction from the administrator, (A1) Change of shape (including size and appearance), (A2) Change of arrangement position, (A3) Change of arrangement number (including new addition and deletion), (A4) Rotation, (A5) Addition or deletion of movement, (A6) Change of movement path, and (A7) Change of use condition, and the like to change the configuration of the arrangement objects 9.

[0242] Note that the object control unit 117 changes, as the usage conditions, for example, the number of people allowed to be present on the placement object, or the attribute of viewers who are permitted to use the placement object (such as climbing or moving it).

[0243] Further, in this modified example, the server device 10 may be configured to be capable of executing special presentation processing (processing for presentation, or processing for granting a privilege) according to the number of avatars 5 that have performed an action corresponding to the configuration change, or whether an action corresponding to the configuration change has been performed.

[0244] Furthermore, in this case, the display control unit 103 may identify and display operable placement objects on the display screen provided to the administrator who operates the performer character 8 (that is, on the display unit 130). However, the display control unit 103 is configured to cause the display unit 130 to display a viewpoint different from the viewpoint provided to viewers, and screens such as a UI.

[0245] (Modified Example 4: Configuration change processing of placement object based on change element) In the present embodiment, control to change the configuration of the placement object 9 placed in the virtual space may be executed based on the change element defined for the corresponding placement object 9.

[0246] In particular, in this case, it is premised that placement object information in which at least one change element of the disappearance time of the placement object 9, the usage condition of the placement object 9, and the movement condition of the placement object 9 is defined according to the type of the placement object 9 is registered.

[0247] Then, the server device 10 of this modified example is configured to execute object configuration change processing for changing the configuration of the placement object 9 placed in the virtual space, based on the change element included in the registered placement object information.

[0248] In other words, the server device 10 can change the shape within the virtual space or the viewer's viewing position in accordance with the changing elements of the placed object 9, and can provide various variations to the shape within the virtual space or the viewing position. As a result, it is possible to view content in a way that is unique to the virtual space, and the device has a configuration that allows viewing to be changed using the placed object during exciting or important scenes.

[0249] Specifically, the placement object control information storage unit 148 stores information as placement object control information, which includes information on at least one of the following change elements: the disappearance time of the placement object 9, the usage conditions of the placement object 9, and the movement conditions of the placement object 9.

[0250] Then, the object control unit 117 performs an object configuration change process for the placement objects 9 located in the virtual space, changing the configuration of the corresponding placement object 9 based on the change elements of each placement object 9.

[0251] Furthermore, the object control unit 117 executes the object configuration change process using, for example, the time required to make the placed object disappear from the virtual space according to the elapsed time since the start of viewing the object being watched.

[0252] Furthermore, the object control unit 117 executes object configuration modification processing using, for example, the movement path or movement timing as the movement conditions for the placed objects.

[0253] Furthermore, the object control unit 117 executes object configuration modification processing using, for example, the number of people who can be on the placed object, or the attributes of viewers who can use the placed object (such as climbing on it or moving it), as usage conditions.

[0254] (Modification 5: Configuration modification process for placement objects based on usage parameters) In this embodiment, the object configuration modification process for the placement object 9 may be executed based on the parameters related to the use of viewer characters set for the placement object 9 (i.e., usage parameters).

[0255] In other words, assuming that the placement object 9 has usage parameters set regarding the use of viewer characters, the server device 10 has a configuration that executes object configuration modification processing of the placement object 9 based on the usage parameters.

[0256] Specifically, the object control unit 117 controls the disappearance of the placed object 9 or the movement of the placed object 9 (such as changing the movement speed or movement path) based on the values ​​of the usage parameters, and performs viewing unique to the virtual space, and changes the viewing using the placed object 9 in exciting or important scenes.

[0257] Furthermore, the object control unit 117 executes object configuration modification processing using parameters such as the elapsed time until disappearance, the number of people who can be assigned, or the cumulative viewing time available to the assigned viewers for the number of people who can be assigned.

[0258] On the other hand, the object control unit 117 may control the usage parameters based on the elapsed time from a given timing regarding the viewing of the performer character 8, the number of avatars 5 that have used the placement object 9, or the cumulative time regarding the use of the placement object 9.

[0259] For example, the object control unit 117 may use the parameters when performing control over the disappearance of the placed object 9 and the movement of the placed object 9. If many viewer avatars can be placed on the placed object, the unit may increase the movement speed, change the movement path, or move the performer character 8 to a position where it is easier to see.

[0260] (Modification 6: Another Configuration Example of Server Apparatus) Each function of the server apparatus 10 of the present embodiment is configured by a single server apparatus 10, but may be implemented by a plurality of server apparatuses.

[0261] [5] Operation in the Present Embodiment Next, the shared information object arrangement management process executed by the server apparatus 10 of the present embodiment will be described with reference to FIG. 11. The operation of the shared information object arrangement management process will be described.

[0262] Note that FIG. 11 is a flowchart showing the operation of the shared information object arrangement management process executed by the server apparatus 10 of the present embodiment.

[0263] In this operation, it is assumed that a plurality of viewers have already logged in to the virtual space providing service in order to wait for viewing of a viewing event, and the object control unit 117 controls the behavior of each avatar 5 in the virtual space based on the operation instruction of each viewer transmitted from the terminal apparatus 20 after the event starts.

[0264] First, when the event management unit 116 detects a viewing event start instruction from an administrator (step S101), the object control unit 116 starts event progress control including the movement of the performer character 8 (step S102), and starts executing a behavior control process including movement and motion of the avatar 5 based on the viewer's operation instruction transmitted from the terminal apparatus 20 (step S103).

[0265] Note that, when the execution of the event progress control and the behavior control process of the avatar 5 is started, the event management unit 116 starts various controls related to the viewing event in accordance with a program or the like, and starts the behavior control of the avatar 5 in accordance with the operation instruction of the viewer.

[0266] Next, the motion detection unit 118 starts detecting the movements of the performer character 8 during the viewing event (step S104), and the event management unit 116, in conjunction with the sound generation unit 107 and the image generation unit 108, starts generating an image (including sound) of the virtual space from the perspective of the avatar 5 (step S105).

[0267] When image generation begins, the information provision unit 111 transmits the generated virtual space image data, along with the sound data, as content data to the corresponding terminal device 20 via the communication control unit 101 until the viewing event ends.

[0268] Next, the motion detection unit 118 determines, based on the data stored in the performance information storage unit 144, whether or not the movements of the performer character 8 during the viewing event are predetermined movements (step S106).

[0269] At this time, if the motion detection unit 118 determines that the movement of the performer character 8 during the viewing event is a predetermined movement, it proceeds to the process of step S107. If it does not determine that the movement of the performer character 8 during the viewing event is a predetermined movement, it proceeds to the process of step S111.

[0270] Next, if the object control unit 117 determines that the movement of the performer character 8 during the viewing event is a predetermined movement, it identifies the type of movement of the performer character 8 during the detected viewing event based on the data stored in the performance information storage unit 144 (step S107).

[0271] Next, the object control unit 117 performs a configuration change process for the placed objects based on the type of movement of the performer character 8 during the identified viewing event, using the data stored in the performance information storage unit 144 (step S108).

[0272] On the other hand, if the motion detection unit 118 does not determine that the movement of the performer character 8 during the viewing event is a predetermined movement, the event management unit 116 determines whether or not the event has ended (step S111).

[0273] At this point, if the event management unit 116 determines that the viewing event has ended, it proceeds to the process in step S112; otherwise, it returns to the process in step S106.

[0274] Finally, if the event management unit 116 determines that the event has ended, it terminates the viewing event for the performer character 8, terminates the action control processing for the avatar 5, and terminates the generation of images (including sound) in the virtual space (step S112), thereby ending this operation.

[0275] [6] Others The present invention is not limited to the embodiments described above, and various modifications are possible. For example, terms cited as broad or synonymous in the specification or drawings may be replaced with broad or synonymous terms in other descriptions in the specification or drawings.

[0276] In this embodiment, each virtual space provision service may be provided to the terminal device 20 by a single server device 10, or a server system may be constructed by linking multiple server devices 10 together to provide each virtual space provision service to the terminal device.

[0277] Furthermore, in this embodiment, the server device 10 executes each process of the virtual space provision service. However, some functions of the processing unit 100 of the server device 10, and the program that executes those functions, may be executed on the terminal device 20, and the above processes may be executed in conjunction with the server device 10.

[0278] Furthermore, in this embodiment, it may be implemented by a single terminal device equipped with the functions of the server device 10, that is, a device that operates independently without relying on other devices such as server devices (standalone).

[0279] Furthermore, it is possible to connect multiple such terminal devices via wired or wireless connections, with one terminal device functioning as a server device 10, and to implement this using multiple terminal devices.

[0280] The present invention includes configurations that are substantially identical to those described in the embodiments (for example, configurations with the same function, method, and result, or configurations with the same purpose and effect). Furthermore, the present invention includes configurations in which non-essential parts of the configurations described in the embodiments are replaced. Furthermore, the present invention includes configurations that produce the same effects or achieve the same purpose as those described in the embodiments. Furthermore, the present invention includes configurations that add known technology to the configurations described in the embodiments.

[0281] As described above, embodiments of the present invention have been explained in detail, but it will be readily apparent to those skilled in the art that many modifications are possible without substantially departing from the novel aspects and effects of the present invention. Therefore, all such modifications are included within the scope of the present invention. [Explanation of Symbols]

[0282] 1: Virtual Space Viewing Event Management System 4: Stage 5: Avatar 6: Viewing space 8: Performer character 9: Placement Objects 10: Server device 20: Terminal device 100: Processing Unit 101: Communication Control Unit 102: Viewer Management Department 103: Display Control Unit 106: Virtual Camera Control Unit 107: Sound generation section 108: Image generation unit 110: Timer section 111: Information provision department 115: Event Control Unit 116: Event Management Department 117: Object Control Unit 118: Motion detection unit 120: Input section 130: Display section 140: Storage section 142: Main memory 144: Production Information Memory Unit 146: Viewer-related information storage unit 148: Placement Object Control Information Storage Unit 149: Event Image Storage Unit 180: Information storage medium 196: Communications Department 200: Processing Unit 210: Communication Control Unit 211: Web browser 213: Display Control Unit 220: Drawing section 230: Sound Processing Unit 260: Input section 262: Detection unit 270: Storage section 271: Main memory 272: Image buffer 280: Information storage medium 290:Display section 292: Sound output section 296: Communications Department

Claims

1. An entertainment viewing management system that works in conjunction with terminal devices owned by viewers connected via a network, and manages viewing so that viewers can view objects that are the target of their attention within a virtual space, A detection means for detecting the movement of the object being watched within the virtual space, Means for controlling placement objects formed within the virtual space, including object control means that execute an object configuration change process to change the configuration of the placement object based on the movement of the detected object under observation within the virtual space, Means for controlling a viewer character that functions as the viewpoint of a viewer viewing the object being watched, including viewer character control means for controlling the viewer character's actions within the virtual space, including actions using the placed object, Image generation means for generating an image of the virtual space formed in the viewing direction of the viewer from the position of the viewer character, A means for providing data to a terminal device to allow a viewer to view the generated image, An entertainment viewing management system characterized by having the following features.

2. In the entertainment viewing management system according to claim 1, Multiple of the aforementioned placement objects can be placed within the virtual space. The object control means, An entertainment viewing management system that controls the number of objects to be placed based on the movement of the detected object to be watched within the virtual space.

3. In the entertainment viewing management system according to claim 1, The aforementioned viewer character control means An entertainment viewing management system that controls movement between a plurality of the aforementioned placement objects based on a given instruction.

4. In the entertainment viewing management system according to claim 1, The aforementioned placement object has given usage conditions set regarding the use of the viewer character, The aforementioned viewer character control means An entertainment viewing management system that controls the actions of the viewer character toward the placement object based on the aforementioned usage conditions.

5. In the entertainment viewing management system according to claim 1, The object control means, An entertainment viewing management system that, as the object configuration change process, executes an object configuration change process that changes the configuration of the placed objects based on the movement of the object to be watched within the virtual space, as well as the elapsed time from a given timing related to viewing the object to be watched.

6. In the entertainment viewing management system according to claim 1, The object control means, An entertainment viewing management system that controls the placement of a placement object in which a viewer character resides, or changes the configuration of a placement object, between the aforementioned object to be watched and the viewing position of a viewer character present in the placement object, provided that a given object is placed in the direction from the viewing position to which the object to be watched is placed.

7. In the entertainment viewing management system according to claim 1, The object control means, An entertainment viewing management system that, between the object to be watched and the viewing position of the viewer character, prohibits the placement of the object in the direction from the viewing position to the object to be watched, and in the viewing direction of the viewer character.

8. In the entertainment viewing management system according to claim 1, Regarding the viewing of the object to be focused on by the viewer character, and given viewing conditions based on the placed object, The image generation means, An entertainment viewing management system that controls the viewing environment of the viewer character based on the aforementioned viewing conditions.

9. In the entertainment viewing management system according to claim 1, The aforementioned viewer character control means Depending on the viewing situation of the viewer or the viewer character, the parameters relating to the viewer character's use of the placement object are controlled as usage parameters. An entertainment viewing management system that controls the behavior of the viewer character regarding the use of the placement object according to the usage parameters.

10. In the entertainment viewing management system according to claim 1, The image generation means, An entertainment viewing management system that generates images of the virtual space, including a display to make the viewer aware of the use of the aforementioned placed objects.

11. In the entertainment viewing management system according to claim 1, The object control means, An entertainment viewing management system that, as the object configuration change process, changes the configuration of the arranged objects based on instructions from an operator who operates the object to be watched or instructions from a program that controls the operation of the object to be watched.

12. In the entertainment viewing management system according to claim 1, Depending on the type of the placed object, at least one of the following change elements is defined: the disappearance time of the placed object, the usage conditions of the placed object, and the movement conditions of the placed object. The object control means, An entertainment viewing management system that performs an object configuration change process to change the configuration of the arranged objects based on the aforementioned change elements.

13. In the entertainment viewing management system according to claim 1, The aforementioned placement object has parameters related to the use of the viewer character set as usage parameters. The object control means, An entertainment viewing management system that performs the object configuration modification process of the arranged object based on the aforementioned usage parameters.

14. In the entertainment viewing management system according to claim 13, The object control means, An entertainment viewing management system that controls the usage parameters based on the elapsed time from a given timing regarding the viewing of the object to be watched, the number of viewer characters using the placed object, or the cumulative time regarding the use of the placed object.

15. A program that works in conjunction with terminal devices owned by viewers connected via a network to manage viewing so that viewers can view objects that are the target of their attention within a virtual space, Detection means for detecting the movement of the object being watched within the virtual space, Means for controlling placement objects arranged in the virtual space, wherein object control means execute an object configuration change process that changes the configuration of the placement object based on the movement of the detected object under observation within the virtual space. Means for controlling a viewer character that functions as the viewpoint of a viewer viewing the object being watched, and viewer character control means for controlling the actions of the viewer character in the virtual space, including actions using the placed object. Image generation means for generating an image of the virtual space formed in the viewing direction of the viewer from the position of the viewer character, and A means for providing the generated image to the viewer via the terminal device. A program characterized by causing a computer to function as such.

Images