Information processing system, information processing method and information processing program

Abstract

To promote interaction between users in a virtual space via information processing.SOLUTION: An information processing system includes: a position management unit for positioning, in a virtual space, a first display medium associated with a first user and a second display medium associated with a second user; a first determination unit for determining whether or not at least one of the respective positions of the first display medium and the second medium in the virtual space, and a first relative positional relation of the first display medium and the second display medium in the virtual space satisfies a first prescribed condition; and an event generation unit for, when the first determination unit determines that the first prescribed condition is satisfied, generating a prescribed event that can be implemented in cooperation with a plurality of display media including the first display medium and the second display medium.SELECTED DRAWING: Figure 11

Description

[Technical Field]

[0001] The present disclosure relates to an information processing system, an information processing method, and an information processing program. [Background technology]

[0002] A technology is known in which each of a plurality of avatars corresponding to a plurality of users who share a video is rendered based on the 3D model of each avatar, and the movement of each of the plurality of avatars is controlled based on input information entered by each of the plurality of users, thereby generating a video corresponding to a virtual space containing these plurality of avatars. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2019-204244 Summary of the Invention [Problem to be solved by the invention]

[0004] Incidentally, when users are active in a virtual space through display media such as multiple avatars, it is useful to provide a mechanism that promotes interaction between users through the display media via information processing.

[0005] Therefore, in one aspect, an object of the present disclosure is to promote interaction between users in a virtual space through information processing. [Means for solving the problem]

[0006] On one side, a position management unit that positions a first display medium associated with a first user and a second display medium associated with a second user in a virtual space; an input acquisition unit that acquires various inputs from each user; a first image condition generation unit that generates a first display image including an image of the virtual space viewed from a first viewpoint associated with the first display medium, the first display image being viewable by the first user; a second image condition generation unit that generates a second display image including an image of the virtual space viewed from a second viewpoint associated with the second display medium, the second display image being viewable by the second user; and a first determination unit that determines whether or not at least one of the positions of the first display medium and the second display medium in the virtual space and a first relative positional relationship between the first display medium and the second display medium in the virtual space satisfies a first predetermined condition; an event generating unit that generates a predetermined event that can be realized in cooperation by a plurality of display media including the first display medium and the second display medium when the first determining unit determines that the first predetermined condition is satisfied, The position management unit further positions a specific display medium in the virtual space; a second determination unit that determines whether a second predetermined condition is satisfied based on a position of the first display medium in the virtual space and a position of the specific display medium in the virtual space; An information processing system is provided in which the event generation unit further associates predetermined information corresponding to the specific display medium with the first user or the first display medium when the second determination unit determines that the second predetermined condition is satisfied. [Effects of the Invention]

[0007] According to one aspect, the present disclosure makes it possible to promote interaction between users in a virtual space through information processing. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a block diagram of a virtual reality generation system according to an embodiment of the present invention. [Figure 2] FIG. 1 is an explanatory diagram of an example of two users using a virtual reality generation system. [Figure 3] FIG. 3 is a diagram schematically illustrating a state in which the two users shown in FIG. 2 are wearing head-mounted displays and viewing images in a virtual space. [Figure 4] FIG. 10 is a diagram illustrating an example of a terminal image. [Figure 5] FIG. 10 is an explanatory diagram of an example of a terminal image suitable for this embodiment. [Figure 6] FIG. 10 is an explanatory diagram of an example of a terminal image for a first user when four users share the same virtual space. [Figure 7] FIG. 1 is an explanatory diagram (part 1) of an image acquisition event. [Figure 8] FIG. 10 is an explanatory diagram (part 2) of an image acquisition event. [Figure 9] 10 is an explanatory diagram (part 1) of an item acquisition event. [Figure 10] This is an explanatory diagram (part 2) of an item acquisition event. [Figure 11] FIG. 2 is a functional block diagram of a server device related to an image acquisition event and an item acquisition event. [Figure 12] FIG. 10 is a functional block diagram of a terminal device related to an image acquisition event and an item acquisition event. [Figure 13] FIG. 2 is an explanatory diagram of data in a user database. [Figure 14] FIG. 2 is an explanatory diagram of data in an avatar database. [Figure 15] FIG. 1 is an explanatory diagram (part 1) of the photographing arrangement process. [Figure 16] FIG. 10 is an explanatory diagram (part 2) of the photographing arrangement process. [Figure 17] FIG. 10 is an explanatory diagram (part 1) of a method for calculating a first relative positional relationship. [Figure 18] FIG. 10 is an explanatory diagram (part 2) of a method for calculating the first relative positional relationship. [Figure 19] FIG. 10 is an explanatory diagram of a progressive mission mode. [Figure 20] 10 is an explanatory diagram of image generation conditions related to event image data stored in an image data storage unit. FIG. [Figure 21]10A and 10B are functional block diagrams of examples of server devices with different sharing patterns; [Figure 21A] 10A and 10B are functional block diagrams of examples of terminal devices with different sharing patterns; [Figure 21B] FIG. 10 is a functional block diagram of another example of a terminal device with a different sharing pattern. [Figure 22] FIG. 10 is a functional block diagram of another example of a server device with a different sharing pattern. [Figure 22A] FIG. 10 is a functional block diagram of another example of a terminal device with a different sharing pattern. [Figure 23] 10 is a timing chart showing an example of the operation of the virtual reality generation system regarding the occurrence of an image acquisition event. [Figure 24] 10 is a timing chart showing an example of the operation of the virtual reality generation system regarding the occurrence of an item acquisition event. [Figure 25] FIG. 10 is a functional block diagram of a server device according to a modified example. [Figure 26] FIG. 2 is an explanatory diagram of data in an advertisement information storage unit. [Figure 27] FIG. 10 is a functional block diagram of a terminal device according to a modified example. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, embodiments will be described with reference to the drawings.

[0010] (Overview of Virtual Reality Generation System) Figure 1 is a block diagram of a virtual reality generation system 1 according to this embodiment. The virtual reality generation system 1 includes a server device 10 and one or more terminal devices 20. For simplicity, three terminal devices 20 are shown in Figure 1, but the number of terminal devices 20 may be two or more.

[0011] The server device 10 is, for example, a server managed by an operator that provides one or more virtual realities. The terminal device 20 is a device used by a user, such as a mobile phone, a smartphone, a tablet terminal, a PC (Personal Computer), a head-mounted display, or a game device. A plurality of terminal devices 20 can be connected to the server device 10 via the network 3, typically in a different manner for each user.

[0012] The terminal device 20 is capable of executing a virtual reality application according to this embodiment. The virtual reality application may be received by the terminal device 20 from the server device 10 or a predetermined application distribution server via the network 3, or may be stored in advance in a storage device provided in the terminal device 20 or in a storage medium such as a memory card readable by the terminal device 20. The server device 10 and the terminal device 20 are communicatively connected via the network 3. For example, the server device 10 and the terminal device 20 cooperate to execute various processes related to virtual reality.

[0013] The network 3 may include a wireless communication network, the Internet, a Virtual Private Network (VPN), a Wide Area Network (WAN), a wired network, or any combination of these.

[0014] Here, an overview of virtual reality according to this embodiment will be described. The virtual reality according to this embodiment is a virtual reality for any reality, such as education, travel, role-playing, simulation, and entertainment such as games and concerts, and a virtual reality medium such as an avatar is used in executing the virtual reality. For example, the virtual reality according to this embodiment is realized by a three-dimensional virtual space, various virtual reality media appearing in the virtual space, and various contents provided in the virtual space.

[0015] Virtual reality media are electronic data used in virtual reality, and include any media, such as cards, items, points, in-service currency (or virtual reality currency), tokens (e.g., non-fungible tokens (NFTs)), tickets, characters, avatars, parameters, etc. Virtual reality media may also be virtual reality-related information, such as level information, status information, virtual reality parameter information (such as stamina and attack power), or ability information (such as skills, abilities, spells, and jobs). Virtual reality media are electronic data that can be acquired, owned, used, managed, exchanged, synthesized, enhanced, sold, discarded, or donated by users within virtual reality, but the manner of use of virtual reality media is not limited to those explicitly described in this specification. Hereinafter, among virtual reality media, media that can be rendered in virtual space may be referred to as display media.

[0016] (Server device configuration) The configuration of the server device 10 will be specifically described. The server device 10 is configured by a server computer. The server device 10 may be realized by a plurality of server computers working together. For example, the server device 10 may be realized by a server computer that provides various types of content, a server computer that functions as various authentication servers, and the like working together. The server device 10 may also include a web server. In this case, some of the functions of the terminal device 20, which will be described later, may be realized by a browser processing HTML documents and various programs (JavaScript (registered trademark)) associated with the HTML documents received from the web server.

[0017] The server device 10 includes a server communication unit 11, a server storage unit 12, and a server control unit 13.

[0018] The server communication unit 11 includes an interface for communicating with an external device wirelessly or via a wired connection to send and receive information. The server communication unit 11 may include, for example, a wireless LAN (Local Area Network) communication module or a wired LAN communication module. The server communication unit 11 is capable of sending and receiving information to and from the terminal device 20 via the network 3.

[0019] The server storage unit 12 is, for example, a storage device, and stores various information and programs necessary for various processes related to virtual reality. For example, the server storage unit 12 stores a virtual reality application.

[0020] For example, the server storage unit 12 stores drawing information of a user avatar M1 (an example of a display medium) as a virtual reality medium associated with each user. Note that a user is a user of the virtual reality generation system 1. In addition to general users, users may include administrative users who operate avatars in association with the administrator of the virtual reality generation system 1. The user avatar M1 is drawn in the virtual space based on the drawing information of the user avatar M1.

[0021] The server storage unit 12 also stores drawing information related to various objects different from the user avatar M1, such as various items or NPCs (Non-Player Characters), etc. The various objects in the virtual space are drawn based on the drawing information.

[0022] The server control unit 13 may include a dedicated microprocessor or a CPU (Central Processing Unit) that implements specific functions by loading specific programs, a GPU (Graphics Processing Unit), etc. For example, the server control unit 13 cooperates with the terminal device 20 to execute a virtual reality application in response to a user operation on the display unit 23 of the terminal device 20. The server control unit 13 also executes various processes related to virtual reality. Specific details of the processes performed by the server control unit 13 will be described later.

[0023] (Terminal Device Configuration) The following describes the configuration of the terminal device 20. As shown in Fig. 1, the terminal device 20 includes a terminal communication unit 21, a terminal storage unit 22, a display unit 23, an input unit 24, and a terminal control unit 25.

[0024] The terminal communication unit 21 includes an interface for communicating with an external device wirelessly or via a wired connection to transmit and receive information. The terminal communication unit 21 may include a wireless communication module, a wireless LAN communication module, or a wired LAN communication module that supports mobile communication standards such as LTE (Long Term Evolution) (registered trademark), LTE-A (LTE-Advanced), a fifth-generation mobile communication system, or UMB (Ultra Mobile Broadband). The terminal communication unit 21 can transmit and receive information to and from the server device 10 via the network 3.

[0025] The terminal storage unit 22 includes, for example, a primary storage unit and a secondary storage unit. For example, the terminal storage unit 22 may include a semiconductor memory, a magnetic memory, an optical memory, or the like. The terminal storage unit 22 stores various information and programs used in processing virtual reality received from the server device 10. The information and programs used in processing virtual reality may be acquired from an external device via the terminal communication unit 21. For example, a virtual reality application program may be acquired from a predetermined application distribution server. Hereinafter, the application program may also be simply referred to as an application. Furthermore, for example, some or all of the above-mentioned information about the user and information about other users' virtual reality media may be acquired from the server device 10.

[0026] The display unit 23 includes a display device such as a liquid crystal display or an organic EL (Electro-Luminescence) display. The display unit 23 is capable of displaying a variety of images. The display unit 23 is configured, for example, with a touch panel, and functions as an interface that detects a variety of user operations. The display unit 23 may also be in the form of a head-mounted display.

[0027] The input unit 24 includes an input interface including, for example, a touch panel provided integrally with the display unit 23. The input unit 24 is capable of accepting user input to the terminal device 20. The input unit 24 may include physical keys or may further include any input interface including a pointing device such as a mouse. The input unit 24 may also be capable of accepting non-contact user input such as voice input or gesture input. Note that a sensor (such as an image sensor, acceleration sensor, or distance sensor) for detecting the user's body movement may be used for gesture input. In this case, the input unit 24 may be realized by an acceleration sensor, gyro sensor, or the like built into the terminal device 20.

[0028] The terminal control unit 25 includes one or more processors and controls the overall operation of the terminal device 20.

[0029] The terminal control unit 25 transmits and receives information via the terminal communication unit 21. For example, the terminal control unit 25 receives various information and programs used for various processes related to virtual reality from at least one of the server device 10 and another external server. The terminal control unit 25 stores the received information and programs in the terminal storage unit 22. For example, the terminal storage unit 22 may store a browser (Internet browser) for connecting to a web server.

[0030] The terminal control unit 25 launches a virtual reality application in response to a user operation. The terminal control unit 25 cooperates with the server device 10 to execute various processes related to virtual reality. For example, the terminal control unit 25 causes an image of a virtual space to be displayed on the display unit 23. For example, a GUI (Graphical User Interface) that detects a user operation may be displayed on the screen. The terminal control unit 25 can detect a user operation on the screen via the input unit 24. For example, the terminal control unit 25 can detect a user's tap operation, long tap operation, flick operation, swipe operation, etc. A tap operation is an operation in which a user touches the display unit 23 with a finger and then releases the finger. The terminal control unit 25 transmits operation information to the server device 10.

[0031] (Example of virtual space) The server control unit 13, in cooperation with the terminal device 20, displays an image of the virtual space on the display unit 23 and updates the image of the virtual space in accordance with the progress of the virtual reality and the user's operations. In this embodiment, the server control unit 13, in cooperation with the terminal device 20, renders objects placed in the three-dimensional virtual space as if viewed from a virtual camera placed in the virtual space.

[0032] The drawing process described below is realized by the server control unit 13, but in other embodiments, part or all of the drawing process described below may be realized by the server control unit 13. In the following description, at least part of the image of the virtual space displayed on the terminal device 20 may be a web display that is displayed on the terminal device 20 based on data generated by the server device 10, and at least part of the image may be a native display that is displayed by a native application installed on the terminal device 20.

[0033] Fig. 2 is an explanatory diagram of an example of two users using the virtual reality generation system 1. Fig. 3 is a diagram schematically showing the two users shown in Fig. 2 wearing head-mounted displays 23A and viewing an image of a virtual space. Note that, although a mode in which two users share a virtual space is described here, the present invention is also applicable to a mode in which three or more users share a virtual space or a mode in which only one user has exclusive use of the virtual space.

[0034] 2 schematically shows two users in real space at different locations on the Earth. In this embodiment, these two users at different locations P1 and P2 in real space can interact with each other in the same virtual space.

[0035] In this embodiment, two users wearing head-mounted displays 23A can act in the virtual space in the form of user avatars M1. Fig. 3 schematically shows a state in which two users who are located apart in real space are viewing an image of a common virtual space 300. Note that in this embodiment, the head-mounted display 23A is used as a means for the users to view an image of the virtual space, but other display devices (for example, a PC display) may also be used.

[0036] 4 is an explanatory diagram of an image for the head-mounted display 23A (hereinafter also referred to as a "terminal image"), and is a diagram showing an example of the terminal image. In FIG. 4, a part of the virtual space is drawn together with a user avatar M1. A method for generating the terminal image will be described later.

[0037] In this embodiment, for example, a stereoscopic image may be generated by generating images G200 and G201 that are viewed by the left and right eyes, respectively, as shown in Fig. 4. Fig. 4 schematically shows images G200 and G201 that are viewed by the left and right eyes, respectively. Note that, hereinafter, unless otherwise specified, the image of the virtual space generated as the image for the terminal refers to the entire image represented by images G200 and G201.

[0038] Fig. 5 is an explanatory diagram of an example of a suitable terminal image in this embodiment. Note that the terminal image shown in Fig. 5 may be an image for one user (a terminal image viewed by one user via the head-mounted display 23A).

[0039] In this embodiment, the terminal image preferably includes a realistic image based on a photograph of real space or CG (computer graphics), as shown schematically in FIG. 5. For example, the terminal image is an image of a real place. This allows the user to have the illusion that they are actually in that place. As a result, the range of activities by each user in the virtual space can be expanded, and the activation of activities can be promoted.

[0040] In this embodiment, the image for the terminal is based on a real-world photograph or a realistic image based on CG (hereinafter referred to as a "real-world image"), and is formed in such a manner that an interface image functioning as a GUI, a user avatar M1, etc. are appropriately superimposed on the real-world image (for example, synthesized using JavaScript (registered trademark)). The real-world image may be acquired using, for example, the "Google Street View Image API" provided by Google or a similar API (Application Programming Interface). In this case, a Street View image acquired from specified latitude, longitude, Pano (panorama) ID, etc. can be imported as the real-world image.

[0041] However, in a modified example, instead of a real-space image, an image of a space that does not correspond in part or in whole to real space may be used. For example, an image of a virtual space in a game or a three-dimensional space in the Metaverse may be used. Furthermore, the real-space image may not only correspond to the real space at the present time, but may also correspond to a real space in the past or a real space based on a prediction of the future.

[0042] In this embodiment, when the real-space image of the terminal image viewed by a user is an image of a real place, the position of the user avatar M1 corresponding to the user is associated with the position information associated with the real-space image. For example, when the real-space image of the terminal image viewed by a user is an image of Tokyo Tower, the user avatar M1 corresponding to the user will be located at a location where Tokyo Tower is visible. Therefore, in the following description, when a user avatar M1 corresponding to a user moves to a certain location, this is essentially the same as when the terminal image corresponding to the user becomes an image related to the location. In this way, the user can go to various places in the virtual space via the user avatar M1.

[0043] FIG. 6 is an explanatory diagram of an example of a terminal image G600 for one user (hereinafter referred to as the first user) when four users share the same virtual space.

[0044] The terminal image G600 shown in Figure 6 includes, on a real-space image G601, an image G610 showing a user avatar M1 (hereinafter also referred to as the "first user avatar M1") corresponding to the first user (an example of a first display medium), user interfaces G611 and G612 which are GUIs that can be operated by the first user, a direction guidance image G614, a distance guidance image G615, and a friend guidance image G616.

[0045] Image G610 is an image that allows the first user to recognize his / her own user avatar M1. Note that image G610 may be omitted.

[0046] The user interface G611 includes various operation buttons B601 to B603 that can be operated by the first user. The operation button B601 is a button for turning on / off the display state of the friend introduction image G616. The operation button B602 is a shutter button, and is operated when taking a photograph (taking a photograph in a virtual space) such as a commemorative photograph, which will be described later. The operation button B603 is a button for viewing a photograph or video taken in the commemorative photograph. Hereinafter, unless otherwise specified, taking a photograph means taking a photograph in a virtual space, and a photograph is synonymous with image data based on an image for the terminal that is stored when the image is captured.

[0047] The user interface G612 includes buttons B605 to B609 for teleportation. Each of the buttons B605 to B609 may be associated with information indicating a destination (e.g., text information). For example, the button B605 is a button for teleporting to the entrance of a facility or the like where the first user avatar M1 is currently located.

[0048] The number and destinations of buttons B605 to B609 are arbitrary. However, the destinations may preferably include places that are extremely difficult to reach in real space (for example, the summit of Mount Everest or the rooftop of a high-rise building). In this case, the user can easily go to places that can only be reached in virtual space via the user avatar M1, and have a valuable experience. In addition, the destination for teleportation may be set by the user as appropriate.

[0049] The direction guidance image G614 is information that represents or suggests a direction as viewed from the first user avatar M1 (a relative direction based on the first user avatar M1), and is information that represents or suggests a direction to a specific destination position or a specific item. For example, if a game with a mission is played, the specific destination position may be a location specified in the mission (e.g., Tokyo Tower). In this case, the specific destination position may be set in a manner that has a certain range. The specific item (an example of a specific display medium) may be any virtual reality medium. For example, if a game with a mission is played, the specific item may be an acquisition target item (described later) specified in the mission. This allows the first user to easily grasp the direction to the specific destination position or specific item by looking at the direction guidance image G614, making it easier to move the first user's first user avatar M1 to the specific destination position or specific item as appropriate.

[0050] The direction guide image G614 may be associated with information (for example, text information) indicating a specific destination location or a specific item, which allows the first user to easily grasp the specific destination location or the specific item.

[0051] The direction guidance image G614 may be, for example, an image in the form of a compass that indicates the direction to a specific destination location or a specific item, as shown in Fig. 6. The direction guidance image G614 may be drawn in a planar view. In this case, the direction indicated by the pointed tip may correspond to the direction to the specific destination location or the specific item in a planar view (when viewed from a bird's-eye view).

[0052] The direction guide image G614 may be omitted, or the first user may be able to turn on / off the display.

[0053] The distance guide image G615 is information that represents or suggests the relative distance from the first user avatar M1, that is, the distance from the first user avatar M1 to a specific destination location or a specific item. The distance guide image G615 may be, for example, an image of numbers that represent the corresponding distance, as shown in FIG. 6. This allows the first user to easily understand the distance to a specific destination location or a specific item by looking at the distance guide image G615. The distance guide image G615 is preferably displayed together with the direction guide image G614, near the direction guide image G614.

[0054] The friend guide image G616 indicates the position information of each user avatar M1 (hereinafter also referred to as "second user avatar M1") (an example of a second display medium) corresponding to another user (hereinafter referred to as "second user"). Therefore, the first user can move the first user avatar M1 while understanding the positional relationship with the second user avatar M1 and the position of the second user avatar M1. This makes it easy for the first user to look at the friend guide image G616 and move their own first user avatar M1 close to the second user avatar M1. Note that a similar friend guide image is also displayed on the second user's terminal image. Therefore, each user can communicate with each other while understanding the positional relationship of each other's user avatars M1.

[0055] 6, the friend guide image G616 includes guide images G616-1 to G616-3 for each second user avatar M1, as well as images G616A to G616C showing each second user avatar M1. In this case, the friend guide image G616 includes guide images G616-1 to G616-3 corresponding to the three second users.

[0056] Guide images G616-1 to G616-3 are arranged in association with images G616A to G616C showing the corresponding second user avatar M1, respectively. For example, guide image G616-1 relating to one second user avatar M1 is arranged in association with image G616A showing that one second user avatar M1 (in FIG. 6, it is arranged below image G616A).

[0057] The guide image G616-1 (and the guide images G616-2 and G616-3 as well) associated with the corresponding second user avatar M1 includes a direction guide image G6161 and a distance guide image G6162.

[0058] The direction guide image G6161 is information that represents or suggests the direction as seen from the first user avatar M1 (the relative direction based on the first user avatar M1), and is information that represents or suggests the direction of a corresponding second user avatar M1. This allows the first user to see the direction guide image G6161 and grasp the direction of the desired second user avatar M1, making it easy to move the first user avatar M1 to the vicinity of the desired second user avatar M1 as needed.

[0059] The direction guidance image G6161 may be, for example, an image in the form of a compass that indicates the direction of a corresponding one of the second user avatars M1, as shown in Fig. 6. The direction guidance image G6161 may be drawn in a planar view, similar to the above-described direction guidance image G614. In this case, the direction indicated by the pointed tip may correspond to the direction of the corresponding one of the second user avatars M1 in a planar view (when viewed from a bird's-eye view).

[0060] The distance guide image G6162 is information that represents or suggests the relative distance from the first user avatar M1, that is, the distance from the first user avatar M1 to the second user avatar M1. Similar to the distance guide image G615 described above, the distance guide image G6162 may be, for example, an image of numbers that represent the corresponding distance, as shown in FIG. 6. This allows the first user to easily grasp the distance to the second user avatar M1 by looking at the distance guide image G6162. The distance guide image G6162 is preferably displayed in combination with the direction guide image G6161 associated with the same second user avatar M1, near the direction guide image G6161.

[0061] In this embodiment, a predetermined event occurs when at least one of the respective positions of the first user avatar M1 and the second user avatar M1 in the virtual space and the first relative positional relationship between the first user avatar M1 and the second user avatar M1 in the virtual space satisfies a first predetermined condition.

[0062] The first predetermined condition is arbitrary, but may be satisfied under a situation where there is a high possibility of interaction between the first user avatar M1 and the second user avatar M1. In this embodiment, the first predetermined condition is satisfied when the first user avatar M1 and the second user avatar M1 are close to each other. For example, the first predetermined condition is satisfied when the distance (relative distance in the virtual space) between the first user avatar M1 and the second user avatar M1 is within a predetermined distance. In this case, the predetermined distance corresponds to the distance when the first user avatar M1 and the second user avatar M1 are close to each other and may be adapted as appropriate. Alternatively, the first predetermined condition may be satisfied when the first user avatar M1 and the second user avatar M1 are within a predetermined distance of a common specific position.

[0063] The predetermined event is arbitrary, but is preferably an event that can be realized through cooperation between the first user avatar M1 and the second user avatar M1 that satisfy a first predetermined condition. In this case, interaction between the first user and the second user is promoted through the first user avatar M1 and the second user avatar M1.

[0064] For example, events that can be realized through cooperation between the first user avatar M1 and the second user avatar M1 may be, for example, the following events E1 to E5. Event E1: An event where you can instantly travel to a common room or a specific location Event E2: Expand the space you can move around in (the gate will open when you gather at the gate) Event E3: An event where everyone can play a mini game Event E4: An event where only the members can chat Event E5: An event where everyone works together to complete a mission (treasure hunt, puzzle solving game, etc.). Here, the common room is a space formed as a virtual space, and may be a space where specific content is provided. The specific content may be entertainment content that can be viewed. Alternatively, the common room may be a space where no specific content is provided, such as a chat room. In this case, event E1 may be the same as event E4. The chat may be voice chat and / or text chat. Furthermore, "everyone" refers to the first user avatar M1 and the second user avatar M1, but there may be two or more second user avatars M1.

[0065] Furthermore, the predetermined event may be an event set by the operator or an event based on UGC (User Generated Contents) that each user can generate. In this case, the predetermined event can be set based on a variety of content. The UGC can be created by a content designer (user) in tabular format (database). Such UGC can also be distributed in the content market. Furthermore, a user avatar (a user avatar related to the UGC content designer or a user involved in its creation) can act as a tour guide and directly guide users on "the journey they want to introduce" in connection with the predetermined event. Furthermore, by placing UGC related to various experience scenarios in a gallery, each user can relive the experience as a visitor through their user avatar. In this case, the UGC can be created by the content designer in tabular format (database). Furthermore, coordinates, viewpoints, events, items, messages, etc. can be easily converted into experience scenarios.

[0066] In the present embodiment, as an example, the predetermined event includes an image capture event such as a commemorative photo shoot. In this case, the image capture event may be an event in which an image including the first user avatar M1 and the second user avatar M1 is captured with the location as the background. Note that if the predetermined event includes multiple types of events (for example, the above-mentioned events E1 to E5), which event will occur may be selected by the first user or may be determined depending on the location.

[0067] In this case, the image acquisition event may occur at any location within the virtual space, or may occur only at a specific location (such as a scenic spot or a famous place). In the latter case, the first predetermined condition may be satisfied when the positions of the first user avatar M1 and the second user avatar M1 belong to the corresponding specific location. More specifically, the first predetermined condition may be satisfied when the positions of the first user avatar M1 and the second user avatar M1 are within a predetermined distance from a reference position (specific position) of the corresponding specific location.

[0068] 7 and 8 are diagrams illustrating an image capture event according to an example.

[0069] In this case, when the first predetermined condition is satisfied, the operation button B602 (see FIG. 6), which is the shutter button, is activated (set to an operable state) as a preparation process for an image capture event. When the first user operates the operation button B602, an image capture event occurs.

[0070] When an image acquisition event occurs, first, as shown schematically in FIG. 7, a first user avatar M1 and a second user avatar M1 (in FIG. 7, the first user avatar M1 and one second user avatar M1) that satisfy a first predetermined condition are drawn on the terminal image for the first user. At this time, the first user avatar M1 and the second user avatar M1 may each be drawn in a manner in which they are taking one of a plurality of poses. Which of the plurality of poses is taken may be determined randomly, may be determined according to the position of the image acquisition event, or may be selectable by the corresponding user. Alternatively, a unique pose may be prepared for each user (user avatar M1) as appropriate.

[0071] Then, the countdown begins (in FIG. 7, a countdown image G700 of "1" out of 3, 2, 1 is displayed), and finally, as shown in FIG. 8, a shutter sound is output along with text information G800 such as "Say cheese!", and a photo is taken. In this case, the photo is the image for the terminal at that time, but unnecessary parts (such as the user interface G611) may be removed as appropriate.

[0072] According to such an image acquisition event, the first user can interact with the second user through the first user avatar M1 and the second user avatar M1, and take commemorative photos in a manner similar to the real world, for example, at famous places or scenic spots.

[0073] In the examples shown in FIGS. 7 and 8, the first user avatar M1 and the second user avatar M1 appear in the commemorative photo (e.g., a photo of two people together). However, instead of the first user avatar M1 and the second user avatar M1, images of the first user and the second user in real space may be used. In this case, the images of the first user and the second user used may be prepared in advance or may be captured on the spot in real space. In this case, the first user and the second user are positioned in front of their respective cameras, and the images captured by the respective cameras are incorporated into the commemorative photo. In this case, only a portion (e.g., only the face portion) of the images of the first user and the second user in real space may be used. In this case, the other portion (e.g., the portion other than the face) may be an image of a predetermined character (e.g., a local character) or a portion of the corresponding user avatar M1. In addition, the clothing of the first user avatar M1 and / or the second user avatar M1 may change during the image acquisition event (e.g., the clothing may change to suit the location).

[0074] Furthermore, when taking a commemorative photo related to an image acquisition event, a special avatar such as an avatar of a celebrity or influencer may appear in response to a selection (request) by the user who generated the image acquisition event. This allows an image including the special avatar to be obtained at the image acquisition event. In this case, the location and time period in which a photo can be taken with the special avatar may be restricted.

[0075] Furthermore, when taking a commemorative photo related to an image acquisition event, other user avatars M1 who have previously been at the same location may appear, depending on the selection (request) of the user who generated the image acquisition event. This allows an image such as a group photo including many user avatars to be obtained at the image acquisition event. In this case, the other user avatars M1 with whom a photo can be taken, the location, the time period, etc. may be appropriately limited.

[0076] In this configuration in which a predetermined event can occur based on the relative positional relationship between user avatars M1 in the virtual space, it is desirable that the relative positional relationship between the user avatars M1 be easy for each user to understand.

[0077] In this regard, just as in the real world, each user can communicate with each other via chat or the like, and thereby grasp the relative positions of the user avatars M1; however, in unfamiliar locations, it may be difficult for users to meet in the same place.

[0078] In contrast, according to the present embodiment, as described above, the friend guide image G616 can be displayed, so each user can easily move their own user avatar M1 so that the first predetermined condition is satisfied while obtaining information related to the positions of other user avatars M1 from the friend guide image G616. As a result, the movement of the user avatar M1 in the virtual space is made more efficient, and the processing load can also be reduced.

[0079] This kind of friend guide image G616 is also suitable for a terminal device 20 (for example, a smartphone) that has a relatively small screen and a limited field of view. Even in the case of such a terminal device 20, the user can easily recognize the position (relative position) of the desired second user avatar M1, making it easier to move the user's own first user avatar M1 to the desired position.

[0080] Furthermore, in this embodiment, when it is determined that a second predetermined condition is satisfied based on the position of the first user avatar M1 in the virtual space and the position of the specific item in the virtual space, an event (hereinafter also referred to as an "item acquisition event") is generated that causes the first user or the first user avatar M1 to acquire the specific item (an example of the specific information). Note that instead of or in addition to causing the first user or the first user avatar M1 to acquire the specific item, the first user or the first user avatar M1 may acquire a virtual reality medium (another example of the specific information) corresponding to the specific item.

[0081] The specific item is arbitrary, but as described above, for example, if a game is played that includes a mission, it may be an acquisition target item specified in the mission. In this embodiment, the acquisition target item is an item that corresponds to the location and may be set as appropriate. For example, in a location where there is a flamingo object, the acquisition target item may be an item that resembles a flamingo egg.

[0082] The specific item may correspond to a real object. For example, if a statue of a frog is installed as a real object in a certain location, the specific item associated with the location may be a display medium that resembles the frog.

[0083] The virtual reality medium corresponding to the specific item may be any virtual reality medium as described above, but may preferably be a virtual reality medium directly or indirectly related to the specific item. For example, if the specific item is a target item to be acquired specified in a mission, the virtual reality medium corresponding to the specific item may be certificate information proving that the mission has been completed.

[0084] The second predetermined condition is arbitrary, but may be determined based on a positional relationship (distance) similarly to the first predetermined condition described above. In this embodiment, the second predetermined condition is satisfied when the first user avatar M1 and the specific item are close to each other. For example, the second predetermined condition is satisfied when the distance (relative distance in the virtual space) between the first user avatar M1 and the specific item is within a predetermined distance. In this case, the predetermined distance corresponds to the distance when the first user avatar M1 and the specific item are close to each other and may be adapted as appropriate. The predetermined distance related to the second predetermined condition may be the same as the predetermined distance related to the first predetermined condition described above.

[0085] In such a configuration that allows an item acquisition event to occur based on the relative positional relationship between the user avatar M1 and a specific item in the virtual space, it is desirable that the relative positional relationship between the user avatar M1 and the specific item be easy for each user to understand.

[0086] In this regard, according to the present embodiment, as described above with reference to Fig. 6, the direction guide image G614 and the distance guide image G615 can be displayed, and therefore each user can easily move their own user avatar M1 so that the second predetermined condition is satisfied while obtaining information from the direction guide image G614 and the distance guide image G615. As a result, the movement of the user avatar M1 in the virtual space is made more efficient, and the processing load can also be reduced.

[0087] Such direction guide image G614 and distance guide image G615 are also suitable for a terminal device 20 (for example, a smartphone) that has a relatively small screen and a limited field of view. Even in the case of such a terminal device 20, the user can easily recognize the position (relative position) of a desired specific item, making it easier to move the user's first user avatar M1 to the desired position.

[0088] 9 and 10 are explanatory diagrams of an item acquisition event according to an example.

[0089] As shown in Fig. 9, first, the first user may be presented with a mission related to the item acquisition event. In this case, the mission is to acquire a flamingo egg item as the acquisition target item. As shown in Fig. 9, the terminal image includes text information G900 indicating the mission, as well as a direction guide image G614 and a distance guide image G615 indicating the direction and position of the flamingo egg. This allows the first user to easily grasp the direction and position of the flamingo egg item and move the first user avatar M1 accordingly.

[0090] When the first user avatar M1 moves close to the flamingo egg item, as shown in FIG. 10, text information G1000 such as "Item Acquired!" is displayed, thereby notifying the user that the mission has been completed. In this case, the user is associated with the flamingo egg item as the acquisition target item. Note that a commemorative photograph may be automatically taken at the time of the item acquisition event. In this case, the photograph may be automatically taken after including the first user avatar M1 in a pose holding the acquisition target item in the terminal image. In this case, as with the image acquisition event described above, the photograph is the terminal image at that time itself, but unnecessary parts (such as the user interface G611) may be removed as appropriate.

[0091] Next, with reference to FIG. 11 and subsequent figures, an example of the configuration of the virtual reality generation system 1 will be described in order.

[0092] In the following, the server device 10 realizes an example of an information processing system, but as will be described later, each element of one terminal device 20 (see the terminal communication unit 21 to the terminal control unit 25 in FIG. 1) may realize an example of an information processing system, or a plurality of terminal devices 20 may cooperate to realize an example of an information processing system. Also, the server device 10 and one or more terminal devices 20 may cooperate to realize an example of an information processing system.

[0093] FIG. 11 is an example of a functional block diagram of the server device 10 related to the image acquisition event and item acquisition event described above. FIG. 12 is an example of a functional block diagram of the terminal device 20 related to the image acquisition event and item acquisition event described above. FIG. 13 is an explanatory diagram of data in the user database 130. FIG. 14 is an explanatory diagram of data in the avatar database 132. In FIGS. 13 and 14, "***" indicates that some information is stored, "-" indicates that no information is stored, and "·" indicates that no information is stored. " indicates a similar repetition.

[0094] Here, first, the functions of the server device 10 will be explained, and then the functions of the terminal device 20 will be explained.

[0095] (Server device functions) As shown in FIG. 11 , the server device 10 includes a user database 130, an avatar database 132, a user input acquisition unit 140 (an example of an input acquisition unit), a position management unit 142, an image condition generation unit 144, a first determination unit 146, an interface creation unit 148, a preparation processing unit 150, an event generation unit 152, a first relative relationship output unit 154, a second relative relationship output unit 156, a second determination unit 158, a movement processing unit 162, and an image data storage unit 172. Note that some or all of the functions of the server device 10 described below may be implemented by the terminal device 20 as appropriate (described later with reference to FIGS. 21 , 21A, and 21B). The division from the user input acquisition unit 140 to the movement processing unit 162 is for convenience of explanation, and some functional units may implement the functions of other functional units. The same applies to the division of user database 130, avatar database 132, and image data storage unit 172. For example, some or all of the data in user database 130 may be integrated with the data in avatar database 132, or may be stored in a separate database.

[0096] The user input acquisition unit 140 to the movement processing unit 162 can be realized by the server control unit 13 of the server device 10 executing one or more programs in the server storage unit 12 of the server device 10. The user database 130, the avatar database 132, and the image data storage unit 172 can be realized by the server storage unit 12 of the server device 10.

[0097] The user database 130 stores user information 600. In the example shown in FIG. 13, the user information 600 associates each user ID with a user name, a user avatar ID, position / orientation information, etc. The user name is a name registered by the user himself / herself and is arbitrary. The user avatar ID is an ID for identifying the user avatar. The position / orientation information includes position information and orientation information of the user avatar M1. The position information of the user avatar M1 may be managed in a coordinate system associated with the real-space image. The orientation information may be information representing the orientation of the user avatar M1. Note that the position / orientation information, etc. is information that can dynamically change in response to an operation input from the user. In addition to the position / orientation information, information representing the movement of the user avatar M1's limbs, etc., and information representing a facial expression, etc. may be included.

[0098] The avatar database 132 stores avatar information about the user avatar M1. In the example shown in FIG. 14, the user avatar information 700 associates each user avatar ID with a face, hairstyle, clothing, etc. Appearance information, such as the face, hairstyle, and clothing, is a parameter that characterizes a user avatar and may be set in advance or set by each user. For example, an ID may be assigned to each type of appearance information, such as the face, hairstyle, and clothing, of the avatar. Furthermore, for the face, a feature ID may be prepared for each type, such as face shape, eyes, mouth, and nose, and the face information may be managed as a combination of IDs for each feature constituting the face. In this case, the appearance information, such as the face, hairstyle, and clothing, can function as avatar drawing information. That is, each user avatar M1 can be drawn not only on the server device 10 but also on the terminal device 20, based on the appearance IDs associated with each user avatar ID.

[0099] In this manner, in this embodiment, basically, one user ID is associated with one user, and one user ID is associated with a user avatar ID. Therefore, a state in which certain information is associated with one user, a state in which the information is associated with the one user ID, and a state in which the information is associated with the user avatar ID associated with the one user ID are synonymous with each other. Note that one user ID may be associated with two or more user avatar IDs.

[0100] The user input acquisition unit 140 acquires various inputs by each user inputted via the input unit 24 of the terminal device 20 .

[0101] When a predetermined placement condition is met, the position management unit 142 positions various display media among the virtual reality media in the virtual space. The various display media may include a first user avatar M1 associated with the first user, a second user avatar M1 associated with the second user, and other display media (e.g., the specific items described above).

[0102] When positioning a display medium in a virtual space, the position management unit 142 may set position information of the display medium in a coordinate system associated with the above-mentioned real-space image. That is, the position management unit 142 may manage position information of various display media in a coordinate system associated with the above-mentioned real-space image.

[0103] The predetermined placement condition may be set for each display medium to be positioned. For example, the predetermined placement condition for the first user avatar M1 may be satisfied when a request to enter the virtual space is made by input from the first user. In this case, the position information (initial position information) of the first user avatar M1 in the virtual space may be specified by the first user or may be determined based on the position information of the first user in the real space. Similarly, the predetermined placement condition for the second user avatar M1 may be satisfied when a request to enter the virtual space is made by input from the second user. In this case, the position information (initial position information) of the second user avatar M1 in the virtual space may be specified by the second user or may be determined based on the position information of the second user in the real space. Note that when the position information of each user in the real space is used in the placement process by the position management unit 142, for example, when the first user and the second user are located at substantially the same position in the real space, the first user avatar M1 and the second user avatar M1 are located at substantially the same position in the virtual space. Alternatively, in another embodiment, the position information (initial position information) of the user avatar M1 in the virtual space when positioned by the position management unit 142 may correspond to the position information of the same user avatar M1 at the time of the previous exit.

[0104] Furthermore, the predetermined placement condition for a specific item may be satisfied when a mission for the corresponding item acquisition event is set. The positions (initial position information) at which various display media are positioned in the virtual space by the position management unit 142 may be specified in advance or may be randomly determined according to the attributes of the display media. For example, in the case of a specific item corresponding to an object in real space, the position information (initial position information) of the specific item in the virtual space may correspond to the position information of the object in real space. Furthermore, the predetermined placement condition for a specific item whose number of placements is limited may include that the number of placements does not reach an upper limit.

[0105] The position management unit 142 may virtually form separate virtual spaces for each group. That is, the position management unit 142 may position each user avatar M1 belonging to one group and each user avatar M1 belonging to another group in separate virtual spaces. In this case, the separate virtual spaces may appear the same (that is, only the user avatar M1 active there may be different spaces).

[0106] The image condition generating unit 144 generates the image generation conditions for the terminal image described above for each user. The image generation conditions may include, for example, the date and time, an ID associated with the point where the image was captured (a location ID described later), camera parameters (azimuth angle, angle of attack, angle of view, etc.), the ID of the user avatar to be drawn, the position of the user avatar to be drawn, etc. The image generation conditions may also include information indicating user avatar information 700 (see FIG. 14) of the user avatar to be drawn and the posture of the user avatar to be drawn, etc. The image generation conditions may also include information for drawing a user interface described later, information for drawing a direction guidance image G6161 and a distance guidance image G6162, etc.

[0107] The image condition generating unit 144 includes a first image condition generating unit 1441 and a second image condition generating unit 1442 .

[0108] The first image condition generating unit 1441 generates image generation conditions for a terminal image for the first user (an example of a first display image) that is viewable by the first user. Note that the terminal image for the first user may be viewable by the first user via the display unit 23 of the terminal device 20, as described above.

[0109] The first image condition generation unit 1441 generates image generation conditions for the terminal image for the first user so that the terminal image for the first user is drawn based on the real-space image, as described above. Specifically, the first image condition generation unit 1441 generates image generation conditions for drawing the real-space image for the terminal image for the first user using the API, as described above, based on the position information of the first user avatar M1 (see the position / orientation information in FIG. 13 ).

[0110] In this case, the orientation from the first viewpoint at which the real-space image is viewed may be determined according to the orientation of the first user avatar M1 (see the position / orientation information in FIG. 13). The orientation of the first user avatar M1 may be the orientation of the first user avatar M1 as a whole, or may be the orientation of a specific part of the first user avatar M1 (for example, the orientation of the face, the orientation of the body, the orientation of the eyes), etc.

[0111] Furthermore, the first image condition generation unit 1441 generates image generation conditions for drawing the second user avatar M1 on the terminal image for the first user. In this case, the first image condition generation unit 1441 may generate image generation conditions for drawing the second user avatar M1 on the terminal image for the first user according to position information of the second user avatar M1 (see the position / orientation information in FIG. 13 ). For example, if the position information of the second user avatar M1 belongs to a space indicated by the terminal image for the first user, the first image condition generation unit 1441 may generate image generation conditions for drawing the second user avatar M1 on the terminal image for the first user.

[0112] When generating image generation conditions for drawing the second user avatar M1, the first image condition generation unit 1441 may use the user avatar information 700 (see FIG. 14 ) associated with the corresponding user avatar ID in the avatar database 132. In addition, at this time, the first image condition generation unit 1441 may generate image generation conditions for expressing the orientation of the second user avatar M1 based on the position / orientation information of the corresponding user avatar ID in the user database 130.

[0113] Furthermore, the first image condition generation unit 1441 generates image generation conditions for drawing a specific item on the device image for the first user. In this case, the first image condition generation unit 1441 may generate image generation conditions for drawing a specific item on the device image for the first user according to position information of the specific item. For example, if the position information of the specific item belongs to a space portion indicated in the device image for the first user, the first image condition generation unit 1441 may generate image generation conditions for drawing the specific item on the device image for the first user.

[0114] Furthermore, the first image condition generation unit 1441 generates image generation conditions for drawing a terminal image for the first user related to the image acquisition event. In this case, as described above with reference to FIG. 7, when it is determined that the first predetermined condition is satisfied, the first image condition generation unit 1441 cooperates with the preparation processing unit 150 to select each pose from among a plurality of types of poses and generate image generation conditions for drawing the first user avatar M1 and the second user avatar M1 in the selected poses. Note that, if there are a plurality of second user avatars M1, poses may be selected separately for each second user avatar M1. The plurality of types of poses may be any pose, such as a peace sign that uses fingers or hands, or a pose that uses the whole body, such as jumping. The plurality of types of poses may also include types of facial expressions. Note that the pose selection method may be as described above.

[0115] When generating image generation conditions for drawing a device image for the first user related to an image acquisition event, the first image condition generation unit 1441 may generate image generation conditions for drawing the first user avatar M1 so that the first user avatar M1 is located at the center of the device image for the first user, or may generate image generation conditions for drawing the first user avatar M1 so that the first user avatar M1 and the second user avatar M1 are arranged in a randomly determined order, or may generate image generation conditions for drawing the first user avatar M1 so that the first user avatar M1 and the second user avatar M1 are arranged in a pre-specified order. In this case, the first image condition generation unit 1441 may make adjustments such as shifting the drawing position immediately before the second user avatar M1 in the device image for the first user. Such adjustments may be performed as part of the image placement process described below. Alternatively, the first image condition generation unit 1441 may generate image generation conditions for drawing the first user avatar M1 so that the previous drawing position of the second user avatar M1 in the terminal image for the first user is not changed (affected).

[0116] The second image condition generation unit 1442 generates image generation conditions for a terminal image for the second user that is viewable by the second user. Note that the terminal image for the second user may be viewable by the second user via the display unit 23 of the terminal device 20, as described above.

[0117] Similar to the first image condition generation unit 1441, the second image condition generation unit 1442 generates image generation conditions for a terminal image for the second user (an example of a second display image) so that the terminal image for the second user is drawn based on the real-space image, as described above. Specifically, the second image condition generation unit 1442 may acquire image generation conditions for drawing a real-space image for the terminal image for the second user using an API, as described above, based on position information of the second user avatar M1 (see the position / orientation information in FIG. 13 ). Then, the second image condition generation unit 1442 generates image generation conditions for drawing the terminal image for the second user based on the real-space image viewed from a second viewpoint associated with the second user avatar M1. In this case, the orientation from the second viewpoint at which the real-space image is viewed may be determined according to the orientation of the second user avatar M1 (see the position / orientation information in FIG. 13 ). The orientation of the second user avatar M1 may be the orientation of the second user avatar M1 as a whole, or may be the orientation of a specific part of the second user avatar M1 (for example, the orientation of the face, the orientation of the body, the orientation of the eyes), etc.

[0118] Furthermore, the second image condition generation unit 1442 for one second user generates image generation conditions for drawing the first user avatar M1 or another second user avatar M1 (second user avatar M1 associated with another second user different from the one second user) on the terminal image for the second user. In this case, the second image condition generation unit 1442 may generate image generation conditions for drawing the first user avatar M1 or another second user avatar M1 on the terminal image for the second user according to position information of the first user avatar M1 or another second user avatar M1 (see position / orientation information in FIG. 13 ).

[0119] Similarly to the first image condition generating unit 1441, the second image condition generating unit 1442 generates image generation conditions for drawing a specific item on a terminal image for the second user. Similarly to the first image condition generating unit 1441, the second image condition generating unit 1442 generates image generation conditions for drawing a terminal image for the second user related to the image acquisition event.

[0120] The first determination unit 146 determines whether a first predetermined condition is satisfied for each user. The first predetermined condition may be as described above. In this case, when determining whether the first predetermined condition is satisfied, the first determination unit 146 may use position information of the corresponding user avatar M1 in the user database 130. In this case, the first determination unit 146 can calculate a relative positional relationship (a first relative relationship described below), such as the distance between the user avatars M1, based on the position information of each user avatar M1.

[0121] Here, the position information of each user avatar M1 is initially determined by the position management unit 142 as described above, and is then updated by the movement processing unit 162, which will be described later. When the position information of each user avatar M1 is identified based on the position of each user in real space, as described above with respect to the position management unit 142 or as described later with respect to the movement processing unit 162, the first predetermined condition is determined based on the position of each user in real space. For example, a first predetermined condition that is satisfied when the distance (relative distance in virtual space) between a first user avatar M1 and a second user avatar M1 is within a predetermined distance may be satisfied when the distance between the users in real space is within a predetermined distance. Furthermore, for example, a first predetermined condition that is satisfied when the position of a first user avatar M1 is within a predetermined distance from a reference position (specific position) of a corresponding specific location may be satisfied when the user's position in real space is within a predetermined distance from the specific position.

[0122] The interface forming unit 148 forms a user interface on the terminal image. The user interface may include the user interfaces G611, G612, etc. described above with reference to Fig. 6. As will be described later, the interface forming unit 148 cooperates with the preparation processing unit 150 to perform processing to activate (make operable) the operation button B602 (see Fig. 6), which is the shutter button.

[0123] The preparation processing unit 150 performs preparation processing for enabling a predetermined event to occur when the first determination unit 146 determines that the first predetermined condition is satisfied. The preparation processing unit 150 performs preparation processing for each user depending on whether the first predetermined condition determined for each user is satisfied. For example, when it is determined that the first predetermined condition is satisfied for a first user, the preparation processing unit 150 performs preparation processing for enabling a predetermined event to occur for the first user.

[0124] The preparation process may differ for each predetermined event and may be omitted depending on the attributes of the predetermined event. For example, if the predetermined event is the above-mentioned event E1 (an event for teleporting to a common room or a specific location), the preparation process may be omitted, or may be a process for generating or activating a button for teleportation.

[0125] In this embodiment, as described above, the predetermined event is an image acquisition event, and the preparation process includes a process of activating (making operable) the operation button B602 (see FIG. 6), which is a shutter button, as an interface for generating the image acquisition event. Note that the preparation process is executed for a terminal image for a user for which it is determined that the first predetermined condition is satisfied.

[0126] Specifically, when the first determination unit 146 determines that the first predetermined condition is satisfied, the preparation processing unit 150 transitions the operation button B602 from an inactive state to an active state via the interface forming unit 148. Note that, in a modified example, when the first determination unit 146 determines that the first predetermined condition is satisfied, the preparation processing unit 150 may transition the operation button B602 from a hidden state to a displayed state via the interface forming unit 148. Alternatively, in another modified example, when the first determination unit 146 determines that the first predetermined condition is satisfied, the preparation processing unit 150 may transition the function of the operation button B602 from a normal photo-taking function to a commemorative photo-taking function via the interface forming unit 148. At this time, the operation button B602 (see FIG. 6 ), which is a shutter button, may change its form to a “Like” button or a share button. In this case, the normal photography function may be a function of taking a photo in a manner that does not include the first user avatar M1 (described later) (that is, a function of storing a terminal image for the first user).

[0127] As yet another modification, the determination by the first determination unit 146 of whether the first predetermined condition is satisfied and the preparation processing related to the operation button B602 by the preparation processing unit 150 may be omitted. In this case, the operation button B602 basically only needs to be constantly activated. Pressing the operation button B602 allows a commemorative photograph (two-shot photo) of user avatars M1 within a range where a photograph can be taken as a terminal image, even if the first predetermined condition is not satisfied. The omission of the determination by the first determination unit 146 and the preparation processing by the preparation processing unit 150 can be performed, for example, by constantly activating the operation button B602, by processing without going through the first determination unit 146 and the preparation processing unit 150, or by canceling or invalidating the first predetermined condition even if the processing goes through the first determination unit 146 and the preparation processing unit 150. Note that the omission of the determination by the first determination unit 146 and the preparation processing by the preparation processing unit 150 may also be employed in other embodiments disclosed herein (including the case where the determination by the second determination unit 158, described later, is omitted).

[0128] In this embodiment, the predetermined event is an image acquisition event as described above, and the preparation process may further include a process of drawing each user avatar M1 in a drawing style that resembles a commemorative photo.

[0129] Specifically, when the first determination unit 146 determines that the first predetermined condition is satisfied for the first user, the preparation processing unit 150 generates, via the first image condition generation unit 1441, image generation conditions for drawing a device image for the first user so that the first user avatar M1 and the second user avatar M1 are each included in the device image for the first user. Hereinafter, of the preparation processes performed by the preparation processing unit 150, the drawing preparation process performed in cooperation with the first image condition generation unit 1441 is also referred to as a "photography arrangement process." The photography arrangement process preferably generates image generation conditions for drawing a device image for the first user so that the first user avatar M1 and the second user avatar M1 are each included in an image facing forward.

[0130] Note that the process by the first image condition generation unit 1441 to generate image generation conditions for drawing the first user avatar M1 and the second user avatar M1 in selected poses during an image acquisition event may be executed after the above-described photographing arrangement process, or may be realized substantially simultaneously with the photographing arrangement process. In other words, the photographing arrangement process may be executed simultaneously in conjunction with the image acquisition event, or may be executed in synchronization with the process of activating (making operable) the operation button B602 (see FIG. 6), which is the shutter button.

[0131] Similarly, when the first judgment unit 146 determines that the first predetermined condition is satisfied with respect to the second user, the preparation processing unit 150 generates, via the first image condition generation unit 1441, image generation conditions for drawing a terminal image for the second user so that the second user avatar M1 and each of the other user avatars M1 that satisfy the first predetermined condition are included in the terminal image for the second user.

[0132] The photographing arrangement process will now be described with reference to Fig. 15 and Fig. 16. Here, the first image condition generating unit 1441 will be described, but the second image condition generating unit 1442 will be described in the same way.

[0133] 15 and 16 show a schematic side view of a first user avatar M1 (user avatar M1 associated with the first user) and a virtual camera 60 in a virtual space. An arrow R13 from the virtual camera 60 indicates the line of sight from the first viewpoint associated with the terminal image for the first user. FIG. 15 shows the state before the image acquisition event described above, and FIG. 16 shows the state during the image acquisition event described above. Note that in the state during the image acquisition event, a second user avatar M1 is located next to the first user avatar M1, but the second user avatar M1 is not shown in FIG. 16.

[0134] For the sake of explanation, a virtual camera 60 is used here. The position of the virtual camera 60 corresponds to a first viewpoint related to the terminal image for the first user, and the line of sight direction of the virtual camera 60 (the direction of the arrow R13) represents the line of sight direction (the direction in which the real space image is viewed) from the first viewpoint when generating the terminal image for the first user.

[0135] The state shown in FIG. 15 is the state before the image acquisition event and before the photographing arrangement process is executed. In this case, the first user avatar M1 is positioned behind the virtual camera 60, and the virtual camera 60 is located, for example, in front of the first user avatar M1 (for example, in front of the eyes). At this time, the line of sight of the virtual camera 60 corresponds to the direction of the first user avatar M1. In this case, the terminal image for the first user is a first-person perspective image, and the first user avatar M1 itself is not drawn as an avatar (a form other than image G610). However, image generation conditions may be generated such that a part of the body of the first user avatar M1, such as the hand, is drawn in the terminal image for the first user. For example, if the first user extends his or her left hand in front of his or her eye, the left hand of the first user avatar M1 may be included in the terminal image for the first user.

[0136] 16 is the state during an image acquisition event, after the photographing arrangement process has been executed. In this case, the first user avatar M1 is positioned in front of the virtual camera 60. At this time, the line of sight of the virtual camera 60 corresponds to the direction toward the first user avatar M1. In other words, the first user avatar M1 moves within the field of view of the virtual camera 60.

[0137] The photographing and positioning process thus includes substantially changing the position of the user avatar M1 so that the user avatar M1 is included in the terminal image for the first user. However, the actual process may be a process of generating image generation conditions such that the user avatar M1 is additionally drawn in the terminal image for the first user without changing the position information of the user avatar M1 itself.

[0138] The event generating unit 152 includes an image data acquiring unit 1521 and a variety of event generating unit 1522 .

[0139] The image data acquisition unit 1521 generates an image acquisition event. In this embodiment, the image data acquisition unit 1521 generates an image acquisition event when the above-described first predetermined condition is satisfied and an operation input (an example of a predetermined input) of the operation button B602 by the first user is acquired. In a modified example, the image data acquisition unit 1521 may automatically generate an image acquisition event (irrespective of the operation input of the operation button B602 by the first user) when the above-described first predetermined condition is satisfied. Alternatively, the image data acquisition unit 1521 may generate an image acquisition event when the above-described first predetermined condition is satisfied, other arbitrary conditions are established, and an operation input of the operation button B602 by the first user is acquired. Furthermore, other inputs (including voice input, etc.) may be used instead of or in addition to the operation input of the operation button B602.

[0140] The image data acquisition unit 1521 acquires image generation conditions (an example of image generation conditions for specific image data) for event image data (an example of specific image data) based on image generation conditions for a terminal image for the first user (a terminal image in which the first user avatar M1 and the second user avatar M1 are drawn) generated by the first image condition generation unit 1441 during an image acquisition event for the first user. The event image data may be the image generation conditions themselves for the terminal image for the first user generated by the first image condition generation unit 1441 during an image acquisition event for the first user, or may be image generation conditions for image data that has been processed thereon (for example, compressed data, or data from which the user interface or some display media has been removed). Furthermore, the image generation conditions for the event image data may be such that additional information selected by the user or predetermined additional information (such as the name of a place, a shooting time, or a frame picture) is added to the image generation conditions for the terminal image for the first user generated by the first image condition generation unit 1441.

[0141] The image generation conditions for the event image data are image generation conditions for generating an image for the event image data. The image generation conditions for the event image data may include, for example, the date and time of capturing the image, the name of the phase in which the image was captured, an ID associated with the location in which the image was captured (a location ID, which will be described later), and camera parameters (azimuth angle, angle of attack, angle of view, etc.). The phase name may be used to print a watermark. The image generation conditions for the event image data may also include user avatar information 700 (see FIG. 14) of the image to be drawn and information indicating the type of pose at the time of capturing the image.

[0142] For example, in the example described with reference to Fig. 8, the image data acquisition unit 1521 acquires image generation conditions related to the event image data based on the terminal image for the first user at or around the timing of outputting "Say cheese!" or the shutter sound in synchronization with that timing. Note that, in a modified example, the image data acquisition unit 1521 may acquire the event image data itself.

[0143] The image data acquisition unit 1521 functions for each user. In other words, in the case of the second user as well, the image data acquisition unit 1521 acquires image generation conditions for the event image data based on the image generation conditions for the terminal image for the second user generated by the second image condition generation unit 1442 when an image acquisition event for the second user occurs.

[0144] The various event generating unit 1522 generates various events in the virtual space. The various events may be events other than the predetermined events described above, such as the above-described item acquisition event or missions related to the various events. For example, in the above-described item acquisition event, the various event generating unit 1522 associates a specific item or a virtual reality medium corresponding to the specific item with a user who satisfies a second predetermined condition.

[0145] The first relative relationship output unit 154 outputs first relative relationship information that indicates or suggests the first relative positional relationship based on the relative positional relationship between the first user avatar M1 and the second user avatar M1 in the virtual space (hereinafter also referred to as "first relative positional relationship"). The first relative relationship information may be output via an image for device. That is, the first relative relationship information may be in the form of an image included in the image for device.

[0146] The relative positional relationship between the first user avatar M1 and the second user avatar M1 in the virtual space is a concept that includes relative distance, relative orientation, etc. In this embodiment, the first relative relationship information includes the direction guidance image G6161 and the distance guidance image G6162 as described above with reference to Fig. 6. However, in a modified example, the first relative relationship information may include either the direction guidance image G6161 or the distance guidance image G6162.

[0147] An example of a method for calculating the first relative positional relationship will now be described with reference to Figures 17 and 18. Figure 17 schematically shows a first user avatar M1 and a second user avatar M1 in a planar view (bird's-eye view). Figure 18 shows a local coordinate system (x1 axis, y1 axis, z1 axis) related to the orientation of facial features as an explanatory diagram of the orientation φ of the first user avatar M1.

[0148] In this embodiment, the direction α related to the direction guide image G6161 may be calculated based on the following calculation formula, for example. α=φ+θ

[0149]

number

[0150] Furthermore, the orientation φ of the first user avatar M1 may be defined as the orientation of a facial feature by the rotation angle around each of the x1, y1, and z1 axes. Note that the variable range of the rotation angle around each of the x1, y1, and z1 axes may be set according to the attribute of a specific feature. Alternatively, as described above, the orientation φ of the first user avatar M1 may be calculated based on the orientation of another feature (for example, the direction of the eyes, i.e., the gaze direction).

[0151] The second relative relationship output unit 156 outputs second relative relationship information that indicates or suggests the second relative positional relationship based on the relative positional relationship between the first user avatar M1 and the specific item in the virtual space (hereinafter also referred to as the "second relative positional relationship"). The second relative relationship information may be output via an image for device. That is, the second relative relationship information may be in the form of an image included in the image for device.

[0152] The relative positional relationship between the first user avatar M1 and a specific item in the virtual space is a concept that includes relative distance, relative orientation, and the like. In this embodiment, the second relative relationship information includes the direction guide image G614 and the distance guide image G615 as described above with reference to FIG. 6. However, in a modified example, the second relative relationship information may include either the direction guide image G614 or the distance guide image G615. The method of calculating the direction and distance related to the direction guide image G614 and the distance guide image G615 may be the same as the method of calculating the first relative positional relationship described above with reference to FIGS. 17 and 18.

[0153] The second determination unit 158 ​​determines whether a second predetermined condition is satisfied for each user. The second predetermined condition may be as described above. In this case, when determining whether the second predetermined condition is satisfied, the second determination unit 158 ​​may use the position information of the corresponding user avatar M1 in the user database 130. In this case, the first determination unit 146 can calculate the second relative positional relationship based on the position information of each user avatar M1 and the position information (known) of the specific item.

[0154] The movement processing unit 162 changes the position and orientation of each user avatar M1 based on various inputs from each user. The user's input for changing the position and orientation of the user avatar M1 may be diverse and may differ for each terminal device 20. The position information of the user avatar M1 associated with a user may be changed by operating a physical switch such as a specific key (e.g., the "WASD" keys) or by input indicating the user's movement based on motion capture technology. The position information of the user avatar M1 associated with a user may also be determined based on the user's position in real space. For example, when a first user and a second user are located in the same position in real space, the position information of the first user avatar M1 and the position information of the second user avatar M1 may be set to be the same. Hereinafter, a user input for changing the position information of the user avatar M1 will also be referred to as a "movement operation input," and a user input for changing the orientation information of the user avatar M1 will also be referred to as a "direction operation input."

[0155] The movement processing unit 162 includes a first movement processing unit 1621 that performs processing related to the movement of the first user avatar M1, and a second movement processing unit 1622 that performs processing related to the movement of the second user avatar M1. Note that the first movement processing unit 1621 and the second movement processing unit 1622 have substantially the same functions except for the user avatar M1 that they process, and therefore the following description will mainly focus on the first movement processing unit 1621. Therefore, in the following description, the second movement processing unit 1622 will essentially hold true if "first" is read as "second."

[0156] The first movement processing unit 1621 changes the position information and orientation information of the first user avatar M1 in the virtual space based on a movement operation input (an example of a first input) or a direction operation input from the first user acquired by the user input acquisition unit 140. In the present embodiment, as an example, the position information and orientation information of the first user avatar M1 in the virtual space are managed in a coordinate system associated with the real-space image forming the image for the device. Note that the position information of the first user avatar M1 in the virtual space basically corresponds to, but does not necessarily always match, the drawing position of the first user avatar M1 in the image generation conditions for the image for the device generated by the first image condition generation unit 1441. For example, as in the above-described photograph placement process, image generation conditions may be generated such that the drawing position of the first user avatar M1 in the image for the device changes without changing the position information of the first user avatar M1. The same applies to the orientation information.

[0157] The first movement processing unit 1621 may change the position information of the first user avatar M1 freely (without restriction) in the virtual space based on the movement operation input from the first user, but preferably may change the position information of the first user avatar M1 under a predetermined constraint condition. The predetermined constraint condition is arbitrary, but may be set so that, for example, movement that clearly contradicts physical phenomena in the real space (for example, movement that passes through the wall of a building) is prohibited.

[0158] Furthermore, the first movement processing unit 1621 may change the predetermined constraint conditions or eliminate the predetermined constraint conditions depending on the mode that can be set by the administrative user who manages the virtual space. For example, when an exploration mode is set, the predetermined constraint conditions may be substantially eliminated or may be significantly relaxed.

[0159] In this embodiment, an administrative user who manages the virtual space can set various modes, and the various modes include various mission modes. The various mission modes may include the mission mode in which the player searches for and obtains the specific item described above, or the mission mode in which the player travels to a specific location. In this embodiment, the various mission modes include a mission mode for a specific experience or learning, in which the player increases the depth of the experience or learning by sequentially clearing multiple tasks (sub-missions) (hereinafter also referred to as a "progressive mission mode").

[0160] Fig. 19 is an explanatory diagram of the progressive mission mode. In Fig. 19, the space sections in the virtual space are conceptually shown as pentagonal regions. Each of the space sections SP30 to SP35 is associated with a corresponding task (sub-mission).

[0161] In this case, the user can increase the depth of their experience and learning by completing multiple tasks (sub-missions) in order, moving around the spaces SP30 to SP35 in a clockwise direction (see arrow R19). In this case, the first movement processing unit 1621 may permit the first user avatar M1 to move to the next space (an example of a second area) when the first user completes a task (an example of a first movement condition) associated with one of the spaces SP30 to SP34 (an example of a first area). Alternatively, the movement to the next space may be forced, or may be realized in response to an instruction from the user who has been permitted to move.

[0162] In the example shown in Figure 19, a progressive mission mode that conceptually rotates is shown as an example, but the progressive mission mode is not limited to rotation and may be realized in a variety of ways, such as the so-called ``sugoroku'' game.

[0163] For example, a progressive mission mode for a trip to France may include sub-missions similar to actual actions, such as a sub-mission for traveling to Haneda Airport, a sub-mission for exchanging money at Haneda Airport, a sub-mission for checking in at a check-in counter, a sub-mission for baggage inspection, a sub-mission for going through customs and immigration, a sub-mission for boarding the plane, and a sub-mission for immigration in France. In this case, preparations can be made in advance, making it useful as a pre-experience for children traveling abroad for the first time. It can also be used to confirm meeting places in advance for school trips, company trips, and the like. It can also be used as pre-learning for meeting in stations with complex structures, such as large stations, or for dispersed activities such as independent travel or free group travel.

[0164] Furthermore, the first movement processing unit 1621 moves the first user avatar M1 to a corresponding location based on a movement operation input related to the buttons B605 to B609 for instantaneous transport described above with reference to Fig. 6. Furthermore, when realizing the above-described event E1 (an event in which users instantaneously transport to a common room or a specific location), the first movement processing unit 1621 may realize a similar instantaneous transport.

[0165] However, when a virtual space is similar to a real space by using a real-space image as in this embodiment, the range of movement (activity range) of each user avatar M1 may be relatively wide. Therefore, when multiple user avatars M1 are engaged in group activities (group behavior) under certain rules, there is a risk that the situation may become uncontrollable. In particular, when a mode such as an exploration mode is set, each user avatar M1 can move freely to various places, which may make it difficult to coordinate actions (such as gathering).

[0166] Therefore, in this embodiment, the movement processing unit 162 may move each user avatar M1 to a position corresponding to a gathering instruction input (an example of a third input) from an administrative user who manages the virtual space or a specific user of the same type (an example of a predetermined user). In this case, the specific user may be a user who receives instructions from the administrative user. Also, for example, when the progressive mission mode is set for multiple users who are students, the specific user may be a user who manages the students. In this case, the specific user may be registered in advance.

[0167] The position corresponding to the gathering instruction input may be a predefined position. In this case, a plurality of predefined positions may be prepared, and the predefined positions may be the positions closest to each user avatar M1. Furthermore, the predefined positions may be designated in advance by a specific user or the like. Furthermore, the gathering instruction input may include position information that designates the position corresponding to the gathering instruction input.

[0168] The user avatars M1 to be moved by the movement processing unit 162 may be all user avatars M1 in the same group, or may be limited to some of the user avatars M1 in the same group.

[0169] When a gathering instruction input from a specific user is acquired by the user input acquisition unit 140, the movement processing unit 162 may forcibly move each user avatar M1 to a position (e.g., a meeting place) corresponding to the gathering instruction input. Alternatively, the movement processing unit 162 may move each user avatar M1 to a position corresponding to the gathering instruction input based on a response input (approval input) from each user. In this case, the user may refuse, thereby realizing a configuration with a high degree of flexibility. Note that multiple types of gathering instruction input may be prepared, including a compulsory gathering instruction input and a refusable gathering instruction input. Note that the instruction content related to the gathering instruction input from a specific user may be transmitted in the form of a voice, a message, or the like prior to the forced movement.

[0170] The image data storage unit 172 stores image generation conditions related to the event image data acquired by the image data acquisition unit 1521. The image data storage unit 172 may have a storage area for each user. In this case, the image generation conditions related to the event image data acquired by the image data acquisition unit 1521 for each user are stored for each user. FIG. 20 is an explanatory diagram of image generation conditions related to the event image data stored in the image data storage unit 172. FIG. 20 relates to image generation conditions related to the event image data related to the first user. In the example shown in FIG. 20, the image generation conditions related to the event image data are assigned a location ID and include camera parameters, avatar information, position information, and date and time information for each location ID. In this case, a URL (Uniform Resource Locator) incorporating the camera parameters, avatar information, position information, and date and time information may be issued for each location ID. Storing image generation conditions related to the event image data can improve storage efficiency compared to storing the event image data. In a modified example, instead of storing image generation conditions related to the event image data, the event image data itself may be stored.

[0171] The location ID is an identifier assigned to each image acquisition event. The camera parameters are information about the first viewpoint during the image acquisition event, and may include, for example, the azimuth angle, the angle of attack, and the angle of view. The avatar information is information about the second user avatar M1 to be drawn in the corresponding event image data. The position information is position information of the real-space image related to the acquired event image data. The date and time information indicates the date and time of acquisition of the corresponding event image data.

[0172] Note that access to the image generation conditions related to the event image data in the storage area related to the first user may be possible only for the first user, or may be possible for a second user in the same group, or may be possible for other users. The access right to the image generation conditions related to the event image data in the storage area related to the first user may be set by the first user as appropriate. Also, the access right may be set for each event image data.

[0173] In this embodiment, the image data storage unit 172 stores image generation conditions related to the event image data acquired by the image data acquisition unit 1521, but in addition to this, image data acquired at other times or its image generation conditions may also be stored.

[0174] The access to the image generation conditions related to the event image data may be an access for drawing (reproducing) an image related to the event image data. In this case, for example, on a photo reproduction page, a user can view an image related to the event image data related to the image generation conditions based on the accessed image generation conditions. In this case, on the photo reproduction page, the image output unit 212 (described later) may parse the image generation conditions acquired through the access as query parameters, store them in variables, input them as arguments to a method of "Google Maps API" provided by Google or a similar API, and select avatar information, thereby generating (reproducing) an image related to the event image data.

[0175] (Terminal device functions) As shown in FIG. 12, the terminal device 20 includes an image generation condition receiving unit 210, an image output unit 212, a user input generating unit 214, and a user input transmitting unit 216.

[0176] The image generation condition receiving unit 210 receives image generation conditions for the terminal image generated by the image condition generating unit 144 of the server device 10 described above.

[0177] The image output unit 212 draws a terminal image based on the image generation conditions for the terminal image received by the image generation condition receiving unit 210, and outputs the drawn terminal image on the display unit 23. For example, the image output unit 212 may parse the image generation conditions for the terminal image as query parameters, store them in variables, input them as arguments to a method of "Google Maps API" provided by Google or a similar API, and select avatar information, thereby drawing the terminal image. Note that the server device 10 may generate image data (HTML document + image) based on the image generation conditions, and the terminal device 20 may draw a display screen including a captured image on the display unit 23 based on the image data (HTML document + image) received from the server device 10, rather than drawing an image directly from the image generation conditions themselves.

[0178] The user input generating unit 214 generates signals according to various inputs received via the input unit 24 described above.

[0179] The user input transmitting unit 216 transmits the signal received by the user input generating unit 214 to the server device 10. In this case, the server device 10 receives the signal and thereby acquires various inputs by the corresponding user.

[0180] The above-described division of functions between the server device 10 and the terminal device 20 is merely an example, and as described above, various changes are possible. That is, some or all of the functions of the server device 10 may be implemented by the terminal device 20 as appropriate.

[0181] For example, a sharing mode as shown in Figures 21 and 21A may be realized. In this case, too, the server device 10A and each user's terminal device 20A cooperate to realize functions similar to those in the case where the server device 10 and the terminal device 20 cooperate as described above. In the sharing mode as shown in Figures 21 and 21A, the functions of the first determination unit 146, the first image condition generation unit 1441 of the image condition generation unit 144, the event generation unit 152, the first relative relationship output unit 154, and the first movement processing unit 1621 of the movement processing unit 162 can be performed by each browser on the terminal device 20A, as described below.

[0182] In the terminal device 20A shown in FIG. 21A, for example, when the operation button B602 (see FIG. 6), which is the shutter button, is pressed, it is possible to generate and transmit the image generation conditions at that time to the server device 10, or to draw an image for the terminal image related to a photo (for example, a photo or video taken in a commemorative photo) using data such as avatar position information already received from the server device 10.

[0183] 21, server device 10A includes user database 130, avatar database 132, location information acquisition unit 166, location information transmission unit 167, and data update processing unit 168. Note that location information acquisition unit 166, location information transmission unit 167, and data update processing unit 168 can be realized by a server control unit (see server control unit 13 in FIG. 1) of server device 10A executing one or more programs in a server storage unit (see server storage unit 12 in FIG. 1) of server device 10A.

[0184] The position information acquisition unit 166 acquires the position / orientation information of each user avatar M1 by receiving it from each terminal device 20. When the position information acquisition unit 166 acquires the position / orientation information of each user avatar M1, it updates the stored data in the user database 130. The user database 130 may store the position / orientation information for each user avatar ID, as shown in FIG.

[0185] The position information transmission unit 167 transmits the position / orientation information of the user avatar M1 in the user database 130 to the terminal device 20A that is the transmission target. The terminal device 20A that is the transmission target for the position / orientation information of one user avatar M1 includes the terminal devices 20A of users associated with other user avatars M1 that belong to the same group as the one user avatar M1. This allows the terminal devices 20A associated with each user in the same group to obtain the position / orientation information of each user avatar M1 associated with the other users. In this case, the position / orientation information of unnecessary user avatars M1 that are not to be drawn is not transmitted, thereby reducing the communication load.

[0186] The data update processing unit 168 transmits update data to each user's terminal device 20A based on the data in the user database 130 and the avatar database 132. The timing of transmitting the update data may be set appropriately, and may include timing in response to a request from the terminal device 20A.

[0187] The terminal device 20A shown in Fig. 21A is suitable for use when the virtual reality application is in the form of a web application that can be used on a browser. The terminal device 20A includes an image output unit 212A, a user input generation unit 214A, and a user input transmission unit 216A. The image output unit 212A, the user input generation unit 214A, and the user input transmission unit 216A may be substantially similar to the image output unit 212, the user input generation unit 214, and the user input transmission unit 216 described above with reference to Fig. 12. The image output unit 212A draws a device image based on image generation conditions for a device image generated by a first image condition generation unit 2441A described later, and outputs the drawn device image on the display unit 23 described above.

[0188] Furthermore, in the example shown in FIG. 21A, the terminal device 20A includes a position information update unit 241A, a position management unit 242A, a first image condition generation unit 2441A, a first movement processing unit 2621A, a first judgment unit 246A, an interface formation unit 248A, a preparation processing unit 250A, an event generation unit 252A, a first relative relationship output unit 254A, a second relative relationship output unit 256A, a second judgment unit 258A, and a terminal memory unit 22A.

[0189] The following description will be given of the terminal device 20A associated with the first user, but the same is true for the terminal device 20A associated with the second user.

[0190] Each of the units from the location information update unit 241A to the second determination unit 258A can be realized by the terminal control unit (see terminal control unit 25 in FIG. 1) of the terminal device 20A executing a virtual reality application according to this embodiment, which is a program stored in the terminal storage unit (see terminal storage unit 22 in FIG. 1) of the terminal device 20A. Temporary storage of various data required by the terminal device 20A can be realized by a RAM (Random Access Memory) 221A in the terminal storage unit 22A. Various data is loaded into the RAM 221A as a temporary storage function. For example, various data is downloaded based on an HTML document created in the server device 10A, and the data is temporarily loaded into the RAM 221A and used for processing (drawing, etc.) in the browser. When the browser is closed, the data loaded into the RAM 221A is erased.

[0191] The RAM 221A may store only the data related to each user avatar M1 belonging to the same group as the first user avatar M1, among the data in the user database 130 of the server device 10 described above (see FIG. 13 ), or may store other data as well. Of the data in the RAM 221A, the position / orientation information data is updated by the position information update unit 241A based on the position / orientation information transmitted from the server device 10A. Note that the other data in the RAM 221A may be updated as appropriate based on the above-mentioned update data via communication with the server device 10A (for example, when the virtual reality application according to this embodiment is started, etc.).

[0192] The RAM 221A may store only the data related to each user avatar M1 belonging to the same group as the first user avatar M1, among the data in the avatar database 132 of the server device 10 described above (see FIG. 14), or may store other data as well. The data in the RAM 221A may be updated based on the above-described update data via communication with the server device 10A, for example, when a virtual reality application (e.g., a Web application) is started.

[0193] As described above, the position information update unit 241A updates the position / orientation information data among the data in the RAM 221A based on the data received from the server device 10A. Furthermore, the position information update unit 241A may update the position / orientation information data related to the first user among the data in the RAM 221A based on a movement operation input or a direction operation input from the first user.

[0194] The position management unit 242A realizes the same function as the position management unit 142 of the server device 10. However, the positioning of each user avatar M1 may be performed only for the user avatars M1 in the same group as the first user avatar M1, or may be performed for other user avatars M1.

[0195] The first image condition generating unit 2441A realizes the same function as the first image condition generating unit 1441 of the server device 10 described above. The first image condition generating unit 2441A may transmit the generated image generation conditions to the server device 10A. In this case, the image generation conditions can also be stored on the server device 10A side.

[0196] The first movement processing unit 2621A realizes the same function as the first movement processing unit 1621 of the server device 10 described above.

[0197] The first determination unit 246A realizes the same function as the first determination unit 146 of the server device 10 described above. However, the first determination unit 246A determines whether or not the first user avatar M1 satisfies a first predetermined condition.

[0198] The interface forming unit 248A realizes the same functions as the interface forming unit 148 of the above-described server device 10. However, the interface forming unit 148 performs processing related to the terminal image for the first user.

[0199] The preparation processing unit 250A realizes the same functions as the preparation processing unit 150 of the server device 10 described above. However, the preparation processing unit 250A executes the above-described preparation processing for the first user avatar M1 (i.e., based on the determination result by the first determination unit 246A) when the first predetermined condition is satisfied.

[0200] The event generation unit 252A realizes the same function as the event generation unit 152 of the server device 10 described above. However, the event generation unit 252A generates an event for the first user avatar M1. The event generation unit 252A includes an image data acquisition unit 2521A and a various event generation unit 2522A.

[0201] The first relative relationship output unit 254A realizes the same function as the first relative relationship output unit 154 of the server device 10 described above. However, the first relative relationship output unit 254A outputs the first relative relationship based on the first user avatar M1.

[0202] The second relative relationship output unit 256A realizes the same function as the second relative relationship output unit 156 of the server device 10 described above. However, the second relative relationship output unit 256A outputs the second relative relationship based on the first user avatar M1.

[0203] The second determination unit 258A realizes the same function as the second determination unit 158 ​​of the server device 10 described above. However, the second determination unit 258A determines whether or not the first user avatar M1 satisfies a second predetermined condition.

[0204] The RAM 221A realizes the same function as the image data storage unit 172 of the server device 10 described above. However, the RAM 221A stores image generation conditions related to the event image data acquired by the image data acquisition unit 2521A. In this case, too, on the photo reproduction page, the image output unit 212A may parse the image generation conditions acquired by access as query parameters, store them in variables, input them as arguments to a method of the "Google Maps API" provided by Google or a similar API, and select avatar information, thereby realizing generation (reproduction) of an image related to the event image data.

[0205] Fig. 21B is a functional block diagram of a terminal device 20B that may be implemented in place of the terminal device 20A shown in Fig. 21A. The configuration of Fig. 21B is suitable when the virtual reality application is in the form of a native application that is different from a web application that can be used on a browser. Note that the native application is downloaded to the terminal device 20B in advance and used.

[0206] 21B, terminal device 20B includes image output unit 212B, user input generation unit 214B, and user input transmission unit 216B. Image output unit 212B, user input generation unit 214B, and user input transmission unit 216B may be substantially similar to image output unit 212, user input generation unit 214, and user input transmission unit 216 described above with reference to FIG. 12. Note that image output unit 212B draws an image for a terminal based on image generation conditions for an image for a terminal generated by a first image condition generation unit 2441B described later, and outputs the drawn image for a terminal on display unit 23 described above.

[0207] Furthermore, in the example shown in FIG. 21B, the terminal device 20B includes a user database 230B, an avatar database 232B, a position information update unit 241B, a position management unit 242B, a first image condition generation unit 2441B, a first movement processing unit 2621B, a first judgment unit 246B, an interface formation unit 248B, a preparation processing unit 250B, an event generation unit 252B, a first relative relationship output unit 254B, a second relative relationship output unit 256B, a second judgment unit 258B, and an image data storage unit 272B.

[0208] The following description will be given of the terminal device 20B associated with the first user, but the same is true for the terminal device 20B associated with the second user.

[0209] Each of the units from the position information update unit 241B to the second determination unit 258B can be realized by the terminal control unit (see terminal control unit 25 in FIG. 1) of the terminal device 20B executing the virtual reality application according to this embodiment, which is a program stored in the terminal storage unit (see terminal storage unit 22 in FIG. 1) of the terminal device 20B. Furthermore, the user database 230B, the avatar database 232B, and the image data storage unit 272B can be realized by the terminal storage unit (see terminal storage unit 22 in FIG. 1) of the terminal device 20B.

[0210] The user database 230B may store only the data related to each user avatar M1 belonging to the same group as the first user avatar M1, among the data in the user database 130 of the server device 10 described above (see FIG. 13 ), or may store other data as well. Of the data in the user database 230B, the position / orientation information data is updated by the position information update unit 241B based on the position / orientation information transmitted from the server device 10A. Note that the other data in the user database 230B may be updated as appropriate based on the above-described update data via communication with the server device 10A (for example, when the virtual reality application according to this embodiment is started, etc.).

[0211] The avatar database 232B may store only the data related to each user avatar M1 belonging to the same group as the first user avatar M1, among the data in the avatar database 132 of the server device 10 (see FIG. 14), or may store other data as well. The data in the avatar database 232B may be updated based on the above-mentioned update data via communication with the server device 10A when a group is generated or when the configuration of the user avatars M1 forming the group is changed.

[0212] As described above, the position information update unit 241B updates the position / orientation information data among the data in the user database 230B based on the data received from the server device 10A. Furthermore, the position information update unit 241B may update the position / orientation information data related to the first user among the data in the user database 230B based on a movement operation input or a direction operation input from the first user.

[0213] The position management unit 242B realizes the same function as the position management unit 142 of the server device 10. However, the positioning of each user avatar M1 may be performed only for the user avatars M1 in the same group as the first user avatar M1, or may be performed for other user avatars M1.

[0214] The first image condition generating unit 2441B realizes the same function as the first image condition generating unit 1441 of the server device 10 described above. The first image condition generating unit 2441B may transmit the generated image generation conditions to the server device 10A. In this case, the image generation conditions can also be stored on the server device 10A side.

[0215] The first movement processing unit 2621B realizes the same function as the first movement processing unit 1621 of the server device 10 described above.

[0216] The first determination unit 246B realizes the same function as the first determination unit 146 of the server device 10 described above. However, the first determination unit 246B determines whether or not the first user avatar M1 satisfies a first predetermined condition.

[0217] The interface forming unit 248B realizes the same functions as the interface forming unit 148 of the above-described server device 10. However, the interface forming unit 148 performs processing related to the terminal image for the first user.

[0218] The preparation processing unit 250B realizes the same function as the preparation processing unit 150 of the server device 10 described above. However, the preparation processing unit 250B executes the above-described preparation processing for the first user avatar M1 (i.e., based on the determination result by the first determination unit 246B) when the first predetermined condition is satisfied.

[0219] The event generation unit 252B realizes the same function as the event generation unit 152 of the server device 10 described above. However, the event generation unit 252B generates an event for the first user avatar M1. The event generation unit 252B includes an image data acquisition unit 2521B and a various event generation unit 2522B.

[0220] The first relative relationship output unit 254B realizes the same function as the first relative relationship output unit 154 of the server device 10 described above. However, the first relative relationship output unit 254B outputs the first relative relationship based on the first user avatar M1.

[0221] The second relative relationship output unit 256B realizes the same function as the second relative relationship output unit 156 of the server device 10 described above. However, the second relative relationship output unit 256B outputs the second relative relationship based on the first user avatar M1.

[0222] The second determination unit 258B realizes the same function as the second determination unit 158 ​​of the server device 10 described above. However, the second determination unit 258B determines whether or not the first user avatar M1 satisfies a second predetermined condition.

[0223] The image data storage unit 272B realizes the same function as the image data storage unit 172 of the server device 10 described above. However, the image data storage unit 272B stores image generation conditions related to the event image data acquired by the image data acquisition unit 2521B. In this case, too, on the photo reproduction page, the image output unit 212B may parse the image generation conditions acquired by access as query parameters, store them in variables, input them as arguments to a method of "Google Maps BPI" provided by Google or a similar BPI, and select avatar information, thereby realizing generation (reproduction) of an image related to the event image data.

[0224] 22 and 22A may be realized. In this case, the server device 10C and the terminal device 20C of each user cooperate with each other to realize the same functions as those in the case where the server device 10 and the terminal device 20 cooperate with each other.

[0225] The server device 10C shown in FIG. 22 differs from the server device 10 shown in FIG. 11 in that a terminal image drawing unit 164 and a terminal image data transmission unit 165 are added.

[0226] The terminal image drawing unit 164 draws the terminal image based on the image generation conditions for the terminal image received by the image condition generation unit 144. For example, the image output unit 212 may parse the image generation conditions for the terminal image as query parameters, store them in variables, input them as arguments to a method of "Google Maps API" provided by Google or a similar API, and select avatar information, thereby drawing the terminal image.

[0227] The terminal image data transmission unit 165 transmits the image data for the terminal image drawn by the terminal image drawing unit 164 to the corresponding terminal device 20C.

[0228] Terminal device 20C shown in FIG. 22A differs from terminal device 20 shown in FIG. 12 in that image generation condition receiving unit 210 and image output unit 212 are replaced with image data receiving unit 211 and image output unit 212C, respectively.

[0229] The image data receiving unit 211 receives image data for a terminal image transmitted by the terminal image data transmitting unit 165 .

[0230] The image output unit 212C outputs the data of the image for the terminal received by the image data receiving unit 211 onto the display unit 23 described above.

[0231] Next, with reference to FIGS. 23 and 24, an example of some of the operations of the virtual reality generation system 1 will be described.

[0232] FIG. 23 is a timing chart showing an example of the operation of the virtual reality generation system 1 in relation to the occurrence of an image capture event.

[0233] 23 shows three terminal devices 20 as operating subjects: a terminal device 20-1 associated with a first user, a terminal device 20-2 associated with a second user, and a server device 10. For the sake of explanation, the second user is shown as one person, but there may be multiple second users. In this case, the terminal devices 20 associated with the multiple second users each operate in the same manner. This also applies to FIG. 24, which will be described later.

[0234] First, the first user and the second user launch the virtual reality application according to this embodiment (referred to as "virtual reality app" in FIG. 23) (step S230) and perform various initial inputs. The timing for launching the virtual reality app may be, for example, the same time period, or may be determined in advance by contact or the like. For example, the first user and the second user may communicate in advance via email or the like to coordinate the time period. The initial inputs may include input of a group name, a user name, etc., and input for determining each user avatar M1. In this case, the first user and the second user belong to the same group.

[0235] Next, the first user and the second user may move within the virtual space via their respective user avatars M1 (step S231). In the virtual space where the user avatars M1 of the first user and the second user move, the server device 10 monitors whether a first predetermined condition is met (step S232). Note that here, only two user avatars M1, the first user avatar M1 and one second user avatar M1, exist within the target virtual space. In this case, the server device 10 calculates a common first relative positional relationship between the two and outputs first relative relationship information, while monitoring whether the first predetermined condition is met. However, if the first user avatar M1 and multiple second user avatars M1 exist, the server device 10 monitors whether the first predetermined condition is met for each user avatar M1, using one user avatar M1 as a reference, as described above.

[0236] When the first predetermined condition is met, the operation button B602 (see FIG. 6), which is a shutter button, is activated (operable) as a preparation process (steps S233 and S234). When the operation button B602 is operated by the first user (step S235), the server device 10 transmits a shutter sound generation instruction to all terminal devices 20 associated with user avatars M1 around the first user avatar M1 (step S235A) and generates an image capture event for the first user (step S236). When the operation button B602 is operated by the second user (step S237), the server device 10 transmits a shutter sound generation instruction to all terminal devices 20 associated with user avatars M1 around the second user avatar M1 (step S237A) and generates an image capture event for the second user (step S238). In this case, the image generation conditions for the event image data acquired in the image acquisition event on the first user's side (step S236) and the image generation conditions for the event image data acquired in the image acquisition event on the second user's side (step S238) may differ due to differences between the first and second viewpoints. The poses, etc. may also differ. In this case, the exchange of event image data between the first and second users is promoted, and interaction between users can be promoted. However, in a modified example, the image generation conditions for the event image data acquired in the image acquisition event on the first user's side (step S236) and the image generation conditions for the event image data acquired in the image acquisition event on the second user's side (step S238) may be substantially the same. In this case, the processing load on the server device 10 can be reduced.

[0237] In steps S235A and S237A, the terminal device 20 that has received the shutter sound generation instruction outputs (plays) audio information that imitates the shutter sound of a camera. In this case, the user of the terminal device 20 can learn about image capture events held by other users. This can promote image capture events at the location.

[0238] 24 is a timing chart showing an example of the operation of the virtual reality generation system 1 in relation to the occurrence of an item acquisition event. In FIG. 24, three terminal devices 20 are shown as the operating subjects: a terminal device 20-1 associated with the first user, a terminal device 20-2 associated with the second user, a terminal device 20-3 associated with the administrative user, and the server device 10.

[0239] First, the first user and the second user launch the virtual reality application according to this embodiment (referred to as "virtual reality app" in FIG. 24) and perform various initial inputs. The timing at which the virtual reality app is launched may be, for example, the same time period, or may be determined in advance by contact or the like. For example, when the first user and the second user participate in an event hosted by the administrative user, the time period may be notified to them in advance by the administrative user. The initial input may include input of a group name, a user name, etc. Furthermore, when the first user and the second user participate in an event hosted by the administrative user, the initial input may include input of information identifying the event and information indicating eligibility to participate.

[0240] First, the administrative user sets the mission mode via the terminal device 20-3 (step S240). The administrative user may also be able to act in the virtual space via his or her own user avatar M1. The content of the mission mode may be configured in advance by the administrative user. The server device 10 notifies each user of a mission corresponding to the started mission mode (step S241), and the mission begins (step S242). The mission may be, for example, a search-type mission in which a specific item (acquisition target item) such as the flamingo egg described above is searched for and acquired, or a learning-type mission in which a virtual reality medium (e.g., completion information) corresponding to the specific item is acquired by viewing specific content and submitting an assignment. Here, it is assumed that the mission is a search-type mission in which a specific item is searched for and acquired.

[0241] Next, the first user and the second user may move within the virtual space via their respective user avatars M1 (step S243). In the virtual space where the user avatars M1 of the first user and the second user move, the server device 10 places a specific item and monitors whether a second predetermined condition is met (step S244). In this case, the server device 10 calculates a second relative positional relationship with respect to the common specific item for each user avatar M1 and outputs second relative relationship information, while monitoring whether the second predetermined condition is met.

[0242] When the second predetermined condition is met, the server device 10 generates an item acquisition event for the user avatar M1 who has met the second predetermined condition (step S245). Thereafter, the administrative user generates a gathering instruction input via the terminal device 20-3 as appropriate (step S246). In this case, for example, each user avatar M1 is forcibly moved to the corresponding predetermined gathering place in response to the gathering instruction input (step S247). Note that, as described above, instead of being forcibly moved, the user avatars M1 may be forcibly moved to the corresponding predetermined gathering place based on a response input (approval input) from each user. Then, when the mission completion condition is met (step S248), the server device 10 ends the mission (step S249). Note that the mission completion condition is arbitrary and may be set based on, for example, elapsed time.

[0243] Next, modifications of the above-described embodiment will be described with reference to FIG. 25 and subsequent figures.

[0244] 25 is a functional block diagram of the server device 10B according to a modified example. FIG. 26 is an explanatory diagram of data in the advertisement information storage unit 176.

[0245] The server device 10B according to this modified example includes, in addition to the server device 10 described above with reference to FIG. 11, an event history memory unit 174, a movement history memory unit 175, an advertisement information memory unit 176, an image evaluation unit 180, a popularity point detection unit 181, a photography prohibition point setting unit 182, an interaction promotion processing unit 183, an avatar detection unit 184, an application collaboration processing unit 185, a shutter sound generation unit 186, a user score calculation unit 187, an incentive granting unit 188, an advertisement setting unit 189, an advertisement evaluation unit 190, and an image processing unit 192.

[0246] In a further modification to this modification, some of the functions of the server device 10 described above with reference to FIG. 11 may be omitted, and some of the image processing unit 192 may be omitted from the event history storage unit 174.

[0247] The event history storage unit 174 stores the history of various events that occurred at each coordinate in the virtual space. The granularity of each coordinate for recording the event history is arbitrary, and may be, for example, facility-by-facility. Alternatively, the granularity of the coordinate for recording the event history may be set according to the attributes of the location. The various events to be stored in the history may be the image acquisition events described above, etc. The history data of various events in the event history storage unit 174 may be output (displayed) for a specific user as appropriate. The history data of various events in the event history storage unit 174 may be used as big data or collective intelligence.

[0248] The movement history storage unit 175 stores movement history data (history data related to movement within the virtual space) of each user avatar M1. The movement history data of each user avatar M1 may include information such as the coordinate trajectory related to movement, date and time, and stop time (stay time). Furthermore, history data of orientation information of each user avatar M1 may also be stored in association with the movement history data of each user avatar M1. In this case, information such as the line of sight direction of each user avatar M1 at each coordinate can be obtained.

[0249] The advertisement information storage unit 176 stores various information (hereinafter referred to as "advertisement information") related to advertisements placed as virtual reality media in the virtual space. In the example shown in Fig. 26, each advertisement ID is associated with various related information such as information identifying the advertiser (advertiser ID), advertisement content, advertisement location information, advertisement period, and performance information.

[0250] The advertisement content may be in the form of an image or video, an advertising avatar that operates in a virtual space, or an AR item such as an AR (Augmented Reality) signboard. The advertisement may also be realized in the form of an event in a virtual space. In either case, the advertisement content may be set based on information provided by the advertiser. The location information of the advertisement may be set in a coordinate system associated with a real-space image. Note that, if the advertisement content is in the form of an advertising avatar, the location information of the advertisement may be dynamically updated as the location information of the advertising avatar. The advertisement period is a period determined in advance according to a contract or the like. The performance information is information that indicates the performance of the advertisement. The performance information may be an index value that is widely known in the field of advertising (for example, CPI: Cost Per Install, CPA: Cost Per Acquisition, CTR: Click Through Rate) and similar (e.g. CPA: Cost Per Action, CPC: Cost Per Click, CPM (Cost Per Mille).

[0251] The image evaluation unit 180 evaluates / analyzes the image data acquired by each user or the image generation conditions thereof (for example, the image generation conditions related to the event image data acquired by the image acquisition event described above). In this case, the image evaluation unit 180 may digitize the number of times an image is captured for each coordinate, the number of user avatars M1 included in the image for each coordinate, etc.

[0252] Furthermore, the image evaluation unit 180 may detect such a rare event when an unusual object or user avatar M1 (for example, a celebrity user avatar M1) is captured in image data of the same location. Furthermore, for a location where an image was captured for the first time, the image evaluation unit 180 may generate information identifying the user who captured the image (hereinafter also referred to as the "first image capturing user").

[0253] Furthermore, the image evaluation unit 180 may generate various information in a manner that replaces the user's photographing action (operation of the operation button B602 (see FIG. 6) which is a shutter button) with a "vending machine" in the virtual space. For example, with regard to an apparel store selling avatar items, the image evaluation unit 180 may record which store the user avatar / user photographed or purchased and how attractive the item was. In this case, such information may be shared between users by the interaction promotion processing unit 183, which will be described later.

[0254] The popularity point detection unit 181 detects popular points (e.g., photogenic points) in the virtual space. Popular points are, for example, places that are frequently visited by each user avatar M1, and may be detected based on movement history data of each user avatar M1. Popular points may also be detected based on history data of various events in the event history storage unit 174. In this case, a place may be evaluated as more popular as the number of times an image acquisition event has occurred increases.

[0255] The popularity point detection unit 181 may also detect popular gaze directions at popularity points by evaluating the gaze direction of each user avatar M1. The gaze direction of each user avatar M1 may be evaluated based on the history data of the orientation information described above. In this case, an object or place that is frequently gazed at by each user avatar M1 may be evaluated as a more popular object or place.

[0256] In this way, the popularity points detected by the popularity point detection unit 181 can be used in various ways. For example, the popularity points may be ranked according to the degree of popularity, and the rank of each popularity point may be communicated to users in various ways. For example, the rank of each popularity point may be displayed as a predetermined number of the top spots as popularity ranking information. Also, popular spots that are gaining popularity may be highlighted. Furthermore, highly ranked popularity points may be presented to each user as recommendation information. In this case, for example, one of the above-mentioned teleportation buttons B605 to B609 may be the destination of the presented popularity point (location), enabling instantaneous teleportation to the popular spot. Furthermore, popular spots presented to each user as recommendation information may be extracted for each user based on the attributes, preferences, etc. of each user. For example, popular spots presented to a user may include popular spots frequently visited by other users who behave similarly to the user.

[0257] The photography prohibition point setting unit 182 sets prohibition points for image acquisition events and / or prohibition points for normal photography. At prohibition points for image acquisition events, the operation button B602 (see FIG. 6), which is the shutter button, may be deactivated or hidden. The photography prohibition point setting unit 182 may automatically set prohibition points, for example, from the perspective of confidentiality or privacy, or may set prohibition points in response to input from an administrative user.

[0258] When a predetermined transmission condition is satisfied, the interaction promotion processing unit 183 transmits an image (such as the event image data in FIG. 20 or the image generation conditions thereof) acquired by the user of one user avatar M1 via the operation of the operation button B602 (see FIG. 6) to another user (e.g., a user in the friend information). The predetermined transmission condition is arbitrary and may be set appropriately by each user. In this case, the interaction promotion processing unit 183 may generate a two-dimensional code such as a QR code (registered trademark) to enable other users to access the corresponding image or the location (place) where the image was acquired. In addition, in this case, the interaction promotion processing unit 183 may form a user interface via the interface forming unit 148 that allows the user avatar M1 of another user to teleport to the location where the image was acquired. In this case, various interactions between users can be effectively promoted, such as introducing a good photo spot to a friend user or taking photos with a friend and their user avatar M1.

[0259] When the avatar detection unit 184 detects movement of one user avatar M1 toward a specific detection target location, it generates a notification (hereinafter also referred to as a "detection notification") indicating that one user avatar M1 has been detected in the specific detection target location. The avatar detection unit 184 may generate a detection notification, for example, when one user avatar M1 enters the angle of view of a virtual camera installed in the specific detection target location. The detection notification may include information identifying the detected user avatar M1 (user avatar ID). The avatar detection unit 184 may also include image data of the detected user avatar M1 captured by the virtual camera in the detection notification. A destination (notification destination) of the detection notification may be set for each specific detection target location. The specific detection target location may be set by an administrative user or a specific user. For example, the administrative user may set a restricted area or the like as a specific detection target location. In this case, a destination (notification destination) of the detection notification may include the administrative user who set the specific detection target location.

[0260] Furthermore, when one user avatar M1 directs its gaze toward a specific detection target object, the avatar detection unit 184 generates a notification to that effect (hereinafter also referred to as a "gaze detection notification toward a specific detection target object"). Whether one user avatar M1 directs its gaze toward a specific detection target object may be determined in real time based on the orientation information of each user avatar M1 and the position information of the specific detection target object, or may be determined offline based on the history data of the orientation information described above. The destination (notification destination) of the gaze detection notification toward a specific detection target object may be set in the same manner as the specific detection target location described above.

[0261] When a user operates the operation button B602 (see FIG. 6 ), which is a shutter button, at a location in the virtual space, the shutter sound generation unit 186 outputs information (referred to as “image capture event occurrence information”) notifying a user associated with another user avatar M1 (a user different from the user) located at the location that the shutter button has been operated. The image capture event occurrence information may be output via audio information such as a shutter sound. For example, a shutter sound generation instruction (see steps S235A and S237A in FIG. 23 ) may be sent to the terminal device 20 associated with the other user, causing the shutter sound to be output (played). In this case, it is possible to indirectly and physically convey to the other user that “this location is worth taking a photo.” With this configuration, there is a high possibility that shutter sounds will be heard frequently at popular points. This allows each user to auditorily grasp each popular point in the virtual space.

[0262] The user score calculation unit 187 calculates various scores associated with each user (or each user avatar M1). The various scores may include a score that is an index of the degree of activity in the virtual space. Furthermore, the user score calculation unit 187 may award a special score (bonus score) to the user who caused the rare event described above and / or the first image capturing user described above, based on the evaluation result by the image evaluation unit 180 described above. Alternatively, in an event such as a photo session, a score may be awarded to each participating user based on the photographs (images acquired via the operation button B602) taken by each participating user. In this case, the arrangement (composition) of objects in the photographs may also be evaluated.

[0263] When an incentive granting condition is satisfied, the incentive granting unit 188 grants an incentive to each user avatar M1 (or each user) active in the virtual space. The incentive granting condition may be determined for each user avatar M1 (or each user). The incentive granting condition may also be granted for each incentive or for each attribute of the incentive. For example, the incentive may be the right to name a famous point. In this case, the naming right may be granted to the user avatar M1 that arrives at the famous point first or the user that takes the first photo at the famous point (the user who operates the operation button B602). In this case, an incentive may be granted each time a new famous point is created.

[0264] Furthermore, the incentive granting unit 188 may grant a specific incentive (for example, proof information that the point is the first to capture an image) to the user who caused the rare event to occur and / or the first image capturing user, similarly to or instead of the user score calculation unit 187. Furthermore, the incentive granting unit 188 may grant a specific incentive to a user whose score granted by the user score calculation unit 187 exceeds a threshold value.

[0265] The advertisement setting unit 189 sets an advertisement in the virtual space. When setting an advertisement, the advertisement setting unit 189 may assign a new advertisement ID and update the data in the advertisement information storage unit 176 (see FIG. 26).

[0266] The advertisement content related to the advertisement set by the advertisement setting unit 189 in this manner is presented to a user (user avatar M1) for whom a predetermined presentation condition is satisfied, during the advertisement period. The presentation of the advertisement content may be realized by the image condition generating unit 144 generating image generation conditions in a manner to be included in the terminal image for each user described above. In this case, the image condition generating unit 144 may superimpose an image or video of the advertisement content on the real-space image in a manner. For example, the first image condition generating unit 1441 determines whether the position information of one advertisement is located within the field of view of the first user avatar M1 based on the relationship between the position / orientation information of the first user avatar M1 and the position information of the one advertisement. Then, if the position information of the one advertisement is located within the field of view of the first user avatar M1, the first image condition generating unit 1441 may generate image generation conditions for drawing the corresponding advertisement content in the terminal image for the first user.

[0267] The predetermined presentation condition is optional, but a target demographic may be set for each advertisement ID. In this case, one advertisement content may be presented only to a user (user avatar M1) who matches the target demographic associated with the one advertisement content. Furthermore, if the advertisement content is an AR item, the predetermined presentation condition may be presented only to a user avatar M1 who has a tool that makes the AR item visible (for example, a smartphone as a virtual reality medium).

[0268] The advertisement setting unit 189 may set the cost required for the advertisement (the cost borne by the advertiser) according to the location information of the advertisement. In this case, the advertisement setting unit 189 may set the cost according to the location information of the advertisement in a manner that the cost is higher at the popular point detected by the popular point detection unit 181. For example, since many people like to take photos in a place such as in front of Hachiko in Shibuya, the cost of setting an advertisement in such a place will be relatively high.

[0269] The advertisement evaluation unit 190 generates the above-mentioned performance information for each advertisement ID. For example, for one advertisement ID, the advertisement evaluation unit 190 may use, as evaluation materials, the number of times the user avatar M1 has directed its gaze at the corresponding advertisement content (i.e., the number of users related to the terminal image on which the advertisement content is drawn), the cumulative value of the time the avatar M1 has directed its gaze, the number of times the advertisement content appears in image data resulting from an image acquisition event, etc. Furthermore, the advertisement evaluation unit 190 may set this for signboards in the real space and signboards in the virtual space and measure the advertisement effectiveness. This also applies to advertisements other than signboards.

[0270] The performance information generated by the advertisement evaluation unit 190 in this manner may be used to calculate advertising costs in the real space or to calculate land prices (such as real estate transactions). The same applies to the detection results by the popularity point detection unit 181 described above. The performance information generated by the advertisement evaluation unit 190 may also be used to set up real advertisements in the real space. For example, if the performance information for a certain location associated with a certain advertisement ID indicates a relatively high performance, a corresponding advertisement may be displayed on a digital signage or the like in the real space. In this way, the advertisement in the virtual space may be set as the primary advertisement and the secondary advertisement in the real space in accordance with the performance information of the advertisement in the virtual space.

[0271] Furthermore, the performance information generated by the advertisement evaluation unit 190 in this manner may be reflected in the price of each area (including the space area) in the corresponding virtual space. This is suitable when various transactions (sales, leases, etc.) of land (areas) are carried out in the virtual space.

[0272] In response to a request from a corresponding user, the image processing unit 192 performs various processing operations on the image generation conditions related to the image data stored in the image data storage unit 172 and associated with the user. The various processing operations are optional and may include, for example, embedding a two-dimensional code such as the QR code (registered trademark) for communication purposes described above. The various processing operations may also include linking information based on real space to an image or a URL, such as "taken at Roppongi Hills on Nth month, Nth day, NN time." The various processing operations may also include embedding rights information such as copyright. Some or all of the various processing operations may be automatically performed regardless of a request from the corresponding user. Some or all of the content of the various processing operations may be set (customized) by the user in advance.

[0273] The various processing processes may also include a process for automatically generating preview photos for real estate transactions. In this case, the process for automatically generating preview photos may include a process for removing only other user avatars from attractive photos and videos of places that people want to live or buy, which have been visited by user avatar M1.

[0274] Incidentally, traditional real estate photography of real spaces is often required to have the desired function of creating an impression of beauty, or of a property being larger and cleaner than it actually is, in order to attract the interest of potential renters / buyers and lead them to make inquiries to real estate agents. Specifically, images taken with a wide-angle lens are sometimes displayed to create an impression that is wider than the actual human field of vision. Furthermore, the view from the window and the camera orientation are sometimes photographed and generated at the photographer's discretion.

[0275] In contrast, real estate photos automatically generated by the image processing unit 192 according to this modification differ from images captured by a simple 360-degree camera in that they allow comparison of actual human sizes (e.g., narrow / wide, high / low ceilings) and simulation of multiple users in the same space. In other words, the user avatar M1 can reflect the actual size of a person, enhancing the sense of spaciousness. Furthermore, it is possible to save other users' viewpoints (e.g., what they focused on, whether they rated it high or low). This contrasts with typical 360-degree images, which do not save the angle of view or direction of view that others focused on. Real estate sellers can also record data such as "other users noticed this." In this way, images based on the image generation conditions stored in the image data storage unit 172 can be used as highly marketable shots on the personal screen. However, by displaying the user avatar M1 separately, it is possible to obtain photos or videos suitable for real estate transactions. As described above, the terminal image is based on a real-space image, and the display / hide of the user avatar can be dynamically controlled by combining the images using JavaScript (registered trademark), for example.

[0276] 27 is a functional block diagram of a terminal device 20B according to a modified example. The terminal device 20B according to this modified example differs from the terminal device 20 described above with reference to FIG. 12 in that an application cooperation processing unit 285 is added.

[0277] The application linking processor 285 links the virtual reality application according to this embodiment with other GPS-based applications and notifications in the terminal device 20B. The GPS-based application refers to an application that uses location information from the GPS function built into the terminal device 20B, and the type of application may be arbitrary. For example, if the terminal device 20B associated with the first user is equipped with a GPS-based application that generates a specific notification at a specific location in real space, when the first user avatar M1 is located at a corresponding specific location in virtual space, the specific notification may be generated via the GPS-based application.

[0278] Furthermore, the application cooperation processing unit 285 may link the position information of the first user avatar M1 in the virtual space based on the movement history of the first user in the real space (the history of position information of the GPS function built into the terminal device 20B). For example, the position information of the first user avatar M1 in the virtual space may be changed based on the movement history of the first user in the real space from M to L on M month, M day. In this case, the first user can look back in the virtual space on the past experiences in the real space from M to L on M month, M day, via the first user avatar M1.

[0279] 21A for the server device 10 and the terminal device 20, the allocation of functions between the server device 10B and the terminal device 20B according to this modification can be varied in various ways. For example, parts of the components ranging from the event history storage unit 174 to the image processing unit 192 may be implemented by the terminal device 20B.

[0280] The above has described the embodiments in detail with reference to the drawings, but the specific configurations are not limited to the various embodiments described above, and also include designs within the scope that do not deviate from the gist of the present invention.

[0281] For example, in the above-described embodiment, an image obtained by the occurrence of the above-described event (for example, a photograph or video taken in a commemorative photo) may be made circulatable as an NFT.

[0282] In addition, the following supplementary notes are disclosed regarding the above-described embodiments of the present invention (corresponding to the original claims of the original application).

[0283] [Appendix 1] a position management unit that positions a first display medium associated with a first user and a second display medium associated with a second user in a virtual space; an input acquisition unit that acquires various inputs from each user; a first image condition generation unit that generates a first display image including an image of the virtual space viewed from a first viewpoint associated with the first display medium, the first display image being viewable by the first user; a second image condition generation unit that generates a second display image including an image of the virtual space viewed from a second viewpoint associated with the second display medium, the second display image being viewable by the second user; and a first determination unit that determines whether or not at least one of the positions of the first display medium and the second display medium in the virtual space and a first relative positional relationship between the first display medium and the second display medium in the virtual space satisfies a first predetermined condition; An information processing system comprising an event generation unit that generates a predetermined event that can be realized in cooperation by multiple display media including the first display medium and the second display medium when the first judgment unit determines that the first predetermined condition is satisfied.

[0284] [Appendix 2] the predetermined event includes an image capture event; The information processing system described in Appendix 1, wherein the event generation unit includes an image data acquisition unit that acquires specific image data or image generation conditions for the virtual space, the image data including an image of the first user or the first display medium and an image of the second user or the second display medium.

[0285] [Appendix 3] 3. The information processing system according to claim 2, wherein the image data acquisition unit determines the specific image data based on the first display image.

[0286] [Appendix 4] each of the first display medium and the second display medium is in the form of an avatar; The information processing system described in Appendix 3, wherein the first image condition generation unit, when it is determined that the first predetermined condition is satisfied, selects two poses from a plurality of types of poses and draws the first display medium and the second display medium in the selected poses.

[0287] [Appendix 5] An information processing system described in any one of Appendices 2 to 4, further comprising an image data storage unit that stores the specific image data or the image generation conditions in a manner accessible by the first user, the second user, or other users.

[0288] [Appendix 6] An information processing system according to any one of appendices 1 to 5, further comprising a preparation processing unit that performs preparation processing to enable the specified event to occur when the first judgment unit determines that the first specified condition is satisfied.

[0289] [Appendix 7] further comprising an interface forming unit that forms a user interface on the first display image; the event generation unit further generates the predetermined event when the input acquisition unit acquires a predetermined input from the first user; The information processing system according to claim 6, wherein the preparation processing unit forms, as the preparation processing, a user interface for inputting the predetermined input via the interface forming unit.

[0290] [Appendix 8] The information processing system described in Appendix 6 or 7, wherein, as the preparatory processing, the preparation processing unit draws the first display image via the first image condition generation unit so that each of the first display medium and the second display medium is included in the first display image.

[0291] [Appendix 9] An information processing system described in any one of Appendices 1 to 8, wherein the first specified condition is satisfied when, in the virtual space, the respective positions of the first display medium and the second display medium are within a specified distance relative to a specific position, or when, in the virtual space, the relative distance between the first display medium and the second display medium in the virtual space is within a specified distance.

[0292] [Appendix 10] An information processing system described in any one of Appendices 1 to 9, further comprising a first relative relationship output unit that outputs first relative relationship information representing or suggesting the first relative positional relationship to each of the first display image and the second display image based on the first relative positional relationship.

[0293] [Appendix 11] An information processing system as described in Appendix 10, wherein the first relative relationship information includes at least one of an image in the form of a compass representing a direction related to the first relative positional relationship and an image of numbers representing a distance related to the first relative positional relationship.

[0294] [Appendix 12] The information processing system described in Appendix 11, wherein the first relative relationship output unit calculates the direction related to the first relative relationship information to be superimposed on the first display image based on the orientation of the first display medium in the virtual space and the respective positions of the first display medium and the second display medium in the virtual space, and calculates the direction related to the first relative relationship information to be superimposed on the second display image based on the orientation of the second display medium in the virtual space and the respective positions of the first display medium and the second display medium in the virtual space.

[0295] [Appendix 13] The position management unit further positions a specific display medium in the virtual space; a second determination unit that determines whether a second predetermined condition is satisfied based on the position of the first display medium in the virtual space and the position of the specific display medium in the virtual space; An information processing system described in any one of Appendices 1 to 12, wherein the event generation unit further associates predetermined information corresponding to the specific display medium with the first user or the first display medium when the second judgment unit determines that the second predetermined condition is satisfied.

[0296] [Appendix 14] The information processing system according to claim 13, wherein the predetermined information includes the specific display medium.

[0297] [Appendix 15] An information processing system described in Appendix 13 or 14, wherein the second specified condition is satisfied when, in the virtual space, the relative distance between the first display medium and the specific display medium is within a specified distance.

[0298] [Appendix 16] An information processing system described in any one of Appendices 13 to 15, further comprising a second relative relationship output unit that outputs second relative relationship information representing or suggesting the second relative positional relationship to the first display image based on a second relative positional relationship between the first display medium and the specific display medium in the virtual space.

[0299] [Appendix 17] The information processing system described in Appendix 16, wherein the second relative relationship information includes at least one of an image in the form of a compass representing a direction related to the second relative positional relationship and an image of numbers representing a distance related to the second relative positional relationship.

[0300] [Appendix 18] The information processing system described in Appendix 17, wherein the second relative relationship output unit calculates the direction related to the second relative relationship information to be superimposed on the first display image based on the orientation of the first display medium and the respective positions of the first display medium and the specific display medium in the virtual space.

[0301] [Appendix 19] a first movement processing unit that changes a position of the first display medium in the virtual space based on a first input from the first user acquired by the input acquisition unit; a second movement processing unit that changes a position of the second display medium in the virtual space based on a second input from the second user acquired by the input acquisition unit, the first movement processing unit permits movement of the first display medium from a first area to a second area in the virtual space when a first movement condition is satisfied; An information processing system described in any one of Appendices 13 to 18, wherein the second movement processing unit allows the second display medium to move from the first area to the second area in the virtual space when a second movement condition is met.

[0302] [Appendix 20] the first movement condition is satisfied when the predetermined information is associated with the first user or the first display medium; 20. The information processing system according to claim 19, wherein the second movement condition is satisfied when the predetermined information is associated with the second user or the second display medium.

[0303] [Appendix 21] The information processing system described in Appendix 19 or 20, wherein the first movement processing unit and the second movement processing unit move the positions of the first display medium and the second display medium in the virtual space to positions corresponding to a third input from a specified user acquired by the input acquisition unit.

[0304] [Appendix 22] The information processing system described in Appendix 21, wherein the first movement processing unit and the second movement processing unit forcibly move the positions of the first display medium and the second display medium in the virtual space to positions corresponding to the third input based on the third input.

[0305] [Appendix 23] 23. The information processing system according to any one of claims 1 to 22, wherein the virtual space is generated based on real image data relating to a real space.

[0306] [Appendix 24] An information processing system described in any one of Appendices 1 to 23, wherein the first determination unit identifies the position of the first display medium or the second display medium in the virtual space based on position information of the first user or the second user in real space.

[0307] [Appendix 25] positioning a first display medium associated with a first user and a second display medium associated with a second user in a virtual space; Obtain various inputs from each user, generating a first display image including an image of the virtual space viewed from a first viewpoint associated with the first display medium, the first display image being viewable by the first user; generating a second display image including an image of the virtual space viewed from a second viewpoint associated with the second display medium, the second display image being viewable by the second user; determining whether or not at least one of the positions of the first display medium and the second display medium in the virtual space and a first relative positional relationship between the first display medium and the second display medium in the virtual space satisfies a first predetermined condition; An information processing method executed by a computer, which includes, when it is determined that the first predetermined condition is met, generating a predetermined event that can be realized in cooperation by multiple display media including the first display medium and the second display medium.

[0308] [Appendix 26] positioning a first display medium associated with a first user and a second display medium associated with a second user in a virtual space; Obtain various inputs from each user, generating a first display image including an image of the virtual space viewed from a first viewpoint associated with the first display medium, the first display image being viewable by the first user; generating a second display image including an image of the virtual space viewed from a second viewpoint associated with the second display medium, the second display image being viewable by the second user; determining whether or not at least one of the positions of the first display medium and the second display medium in the virtual space and a first relative positional relationship between the first display medium and the second display medium in the virtual space satisfies a first predetermined condition; When it is determined that the first predetermined condition is satisfied, a predetermined event that can be realized in cooperation with a plurality of display media including the first display medium and the second display medium is generated. An information processing program that causes a computer to execute a process.

[0309] Furthermore, the following supplementary notes are disclosed (corresponding to the original claims of the original application):

[0310] [Appendix 1] a position management unit that positions a first display medium associated with a first user and a second display medium associated with a second user in a virtual space; an input acquisition unit that acquires various inputs from each user; a first image condition generation unit that generates a first display image including an image of the virtual space viewed from a first viewpoint associated with the first display medium, the first display image being viewable by the first user; a second image condition generation unit that generates a second display image including an image of the virtual space viewed from a second viewpoint associated with the second display medium, the second display image being viewable by the second user; and a first determination unit that determines whether or not at least one of the positions of the first display medium and the second display medium in the virtual space and a first relative positional relationship between the first display medium and the second display medium in the virtual space satisfies a first predetermined condition; an event generating unit that generates a predetermined event that can be realized in cooperation by a plurality of display media including the first display medium and the second display medium when the first determining unit determines that the first predetermined condition is satisfied, The position management unit further positions a specific display medium in the virtual space; a second determination unit that determines whether a second predetermined condition is satisfied based on a position of the first display medium in the virtual space and a position of the specific display medium in the virtual space; The event generation unit further associates predetermined information corresponding to the specific display medium with the first user or the first display medium when the second judgment unit determines that the second predetermined condition is satisfied.

[0311] [Appendix 2] The information processing system according to claim 1, wherein the predetermined information includes the specific display medium.

[0312] [Appendix 3] The information processing system described in Appendix 1 or 2, wherein the second specified condition is satisfied when, in the virtual space, the relative distance between the first display medium and the specific display medium is within a specified distance.

[0313] [Appendix 4] An information processing system described in any one of Appendices 1 to 3, further comprising a second relative relationship output unit that outputs second relative relationship information representing or suggesting the second relative positional relationship to the first display image based on a second relative positional relationship between the first display medium and the specific display medium in the virtual space.

[0314] [Appendix 5] The information processing system described in Appendix 4, wherein the second relative relationship information includes at least one of an image in the form of a compass representing a direction related to the second relative positional relationship and an image of numbers representing a distance related to the second relative positional relationship.

[0315] [Appendix 6] The information processing system described in Appendix 5, wherein the second relative relationship output unit calculates the direction related to the second relative relationship information to be superimposed on the first display image based on the orientation of the first display medium and the respective positions of the first display medium and the specific display medium in the virtual space.

[0316] [Appendix 7] a first movement processing unit that changes a position of the first display medium in the virtual space based on a first input from the first user acquired by the input acquisition unit; a second movement processing unit that changes a position of the second display medium in the virtual space based on a second input from the second user acquired by the input acquisition unit, the first movement processing unit permits movement of the first display medium from a first area to a second area in the virtual space when a first movement condition is satisfied; An information processing system described in any one of Appendices 1 to 6, wherein the second movement processing unit allows the second display medium to move from the first area to the second area in the virtual space when a second movement condition is met.

[0317] [Appendix 8] the first movement condition is satisfied when the predetermined information is associated with the first user or the first display medium; The information processing system according to claim 7, wherein the second movement condition is satisfied when the predetermined information is associated with the second user or the second display medium.

[0318] [Appendix 9] The information processing system described in Appendix 7 or 8, wherein the first movement processing unit and the second movement processing unit move the positions of the first display medium and the second display medium in the virtual space to positions corresponding to a third input from a specified user acquired by the input acquisition unit.

[0319] [Appendix 10] The information processing system described in Appendix 9, wherein the first movement processing unit and the second movement processing unit forcibly move the positions of the first display medium and the second display medium in the virtual space to positions corresponding to the third input based on the third input.

[0320] [Appendix 11] 11. The information processing system according to any one of claims 1 to 10, wherein the virtual space is generated based on real image data relating to a real space.

[0321] [Appendix 12] An information processing system described in any one of Appendices 1 to 11, wherein the first determination unit identifies the position of the first display medium or the second display medium in the virtual space based on position information of the first user or the second user in real space.

[0322] [Appendix 13] A first display medium associated with a first user and a second display medium associated with a second user are positioned in a virtual space, and various inputs are acquired from each user. generating a first display image including an image of the virtual space viewed from a first viewpoint associated with the first display medium, the first display image being viewable by the first user; generating a second display image including an image of the virtual space viewed from a second viewpoint associated with the second display medium, the second display image being viewable by the second user; determining whether or not at least one of the positions of the first display medium and the second display medium in the virtual space and a first relative positional relationship between the first display medium and the second display medium in the virtual space satisfies a first predetermined condition; generating a predetermined event that can be realized in cooperation with a plurality of display media including the first display medium and the second display medium when it is determined that the first predetermined condition is satisfied; Furthermore, positioning a specific display medium in the virtual space; further determining whether a second predetermined condition is satisfied based on the position of the first display medium in the virtual space and the position of the specific display medium in the virtual space; An information processing method executed by a computer, in which generating the specified event further includes associating specified information corresponding to the specific display medium with the first user or the first display medium when it is determined that the second specified condition is satisfied.

[0323] [Appendix 14] positioning a first display medium associated with a first user and a second display medium associated with a second user in a virtual space; Obtain various inputs from each user, generating a first display image including an image of the virtual space viewed from a first viewpoint associated with the first display medium, the first display image being viewable by the first user; generating a second display image including an image of the virtual space viewed from a second viewpoint associated with the second display medium, the second display image being viewable by the second user; determining whether or not at least one of the positions of the first display medium and the second display medium in the virtual space and a first relative positional relationship between the first display medium and the second display medium in the virtual space satisfies a first predetermined condition; when it is determined that the first predetermined condition is satisfied, causing a computer to execute a process of generating a predetermined event that can be realized in cooperation by a plurality of display media including the first display medium and the second display medium; Furthermore, positioning a specific display medium in the virtual space; further determining whether a second predetermined condition is satisfied based on the position of the first display medium in the virtual space and the position of the specific display medium in the virtual space; An information processing program that further includes, when it is determined that the second predetermined condition is satisfied, associating the first user or the first display medium with predetermined information corresponding to the specific display medium. [Explanation of symbols]

[0324] 1 Virtual reality generation system 3 Network 10, 10A, 10B Server equipment 11 Server Communication Unit 12 Server storage unit 13 Server control unit 20, 20A, 20B terminal equipment 21 Terminal communication unit 22 Terminal memory section 23 Display section 23A Head-mounted display 24 Input section 25 Terminal control unit 60 Virtual Camera 130 User Database 132 Avatar Database 140 User Input Acquisition Unit 142 Location Management Department 144 Image condition generation unit 1441 First image condition generation unit 1442 Second image condition generation unit 146 1st Judgment Department 148 Interface Formation Department 150 Preparatory Processing Section 152 Event Generation Section 1521 Image data acquisition unit 1522 Various Event Generation Section 154 First relative relationship output unit 156 Second relative relationship output unit 158 Second Judgment Section 162 Movement Processing Unit 1621 First Movement Processing Unit 1622 Second Movement Processing Unit 172 Image data storage unit 210 Image generation condition receiving unit 212 Image output unit 214 User Input Generation Unit 216 User Input Transmission Unit

Claims

[Claim 1] a position management unit that positions a first display medium associated with a first user and a second display medium associated with a second user in a virtual space; an input acquisition unit that acquires various inputs from each user; a first image condition generation unit that generates a first display image including an image of the virtual space viewed from a first viewpoint associated with the first display medium, the first display image being viewable by the first user; a second image condition generation unit that generates a second display image including an image of the virtual space viewed from a second viewpoint associated with the second display medium, the second display image being viewable by the second user; and a first determination unit that determines whether or not at least one of the positions of the first display medium and the second display medium in the virtual space and a first relative positional relationship between the first display medium and the second display medium in the virtual space satisfies a first predetermined condition; an event generating unit that generates a predetermined event that can be realized in cooperation by a plurality of display media including the first display medium and the second display medium when the first determining unit determines that the first predetermined condition is satisfied, The position management unit further positions a specific display medium in the virtual space; a second determination unit that determines whether a second predetermined condition is satisfied based on a position of the first display medium in the virtual space and a position of the specific display medium in the virtual space; The event generation unit further associates specified information corresponding to the specific display medium with the first user or the first display medium when the second determination unit determines that the second specified condition is satisfied.

Images