Information processing system, information processing method and information processing program

The information processing system enhances user interaction in virtual spaces by managing avatar positioning and generating events based on relative relationships, addressing the lack of effective interaction mechanisms in existing technologies.

JP2024161142AActive Publication Date: 2024-11-15GLEE HOLDINGS CO LTD
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
JP2024146042
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-08-27
Publication Date
2024-11-15
Estimated Expiration
2041-11-19

AI Technical Summary

Technical Problem

Existing technologies lack effective mechanisms to facilitate interaction between users in virtual spaces through display media, such as avatars, limiting the engagement and collaboration opportunities in virtual environments.

Method used

An information processing system that manages the positioning and interaction of multiple avatars in a virtual space, determining conditions for generating events based on relative positional relationships, and enabling users to interact through predetermined events such as image acquisition and item acquisition events.

Benefits of technology

Enhances user interaction and collaboration in virtual spaces by facilitating events that promote engagement and cooperation among users, improving the efficiency and ease of movement within the virtual environment.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024161142000001_ABST
    Figure 2024161142000001_ABST
Patent Text Reader

Abstract

To promote interaction between users in a virtual space via information processing.SOLUTION: An information processing system includes: a position management unit for positioning, in a virtual space, a first display medium associated with a first user and a second display medium associated with a second user; a first determination unit for determining whether or not at least one of the respective positions of the first display medium and the second medium in the virtual space, and a first relative positional relation of the first display medium and the second display medium in the virtual space satisfies a first prescribed condition; and an event generation unit for, when the first determination unit determines that the first prescribed condition is satisfied, generating a prescribed event that can be implemented in cooperation with a plurality of display media including the first display medium and the second display medium.SELECTED DRAWING: Figure 11
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to an information processing system, an information processing method, and an information processing program. [Background technology]

[0002] A technology is known in which each of a number of avatars corresponding to a number of users who share a video is rendered based on a 3D model of each avatar, and the movement of each of the multiple avatars is controlled based on input information input by each of the multiple users, thereby generating a video corresponding to a virtual space containing these multiple avatars. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2019-204244 A Summary of the Invention [Problem to be solved by the invention]

[0004] Incidentally, when users are active in a virtual space through display media such as multiple avatars, it is useful to provide a mechanism that promotes interaction between users through the display media via information processing.

[0005] Therefore, in one aspect, an object of the present disclosure is to promote interaction between users in a virtual space through information processing. [Means for solving the problem]

[0006] On one side, a position management unit that positions a first display medium associated with a first user and a second display medium associated with a second user in a virtual space; an input acquisition unit that acquires various inputs from each user; a first image condition generating unit configured to generate a first display image including an image of the virtual space viewed from a first viewpoint associated with the first display medium, the first display image being viewable by the first user; a second image condition generating unit configured to generate a second display image including an image of the virtual space viewed from a second viewpoint associated with the second display medium, the second display image being viewable by the second user; and a first determination unit that determines whether or not at least one of the positions of the first display medium and the second display medium in the virtual space and a first relative positional relationship between the first display medium and the second display medium in the virtual space satisfies a first predetermined condition; an event generating unit that generates a predetermined event that can be realized in cooperation with a plurality of display media including the first display medium and the second display medium when the first determining unit determines that the first predetermined condition is satisfied, The position management unit further positions a specific display medium in the virtual space; a second determination unit that determines whether a second predetermined condition is satisfied based on a position of the first display medium in the virtual space and a position of the specific display medium in the virtual space; An information processing system is provided in which the event generation unit further associates specified information corresponding to the specific display medium with the first user or the first display medium when the second judgment unit judges that the second specified condition is satisfied. Effect of the Invention

[0007] In one aspect, according to the present disclosure, it becomes possible to promote interaction between users in a virtual space through information processing. [Brief description of the drawings]

[0008] [Figure 1] 1 is a block diagram of a virtual reality generation system according to an embodiment of the present invention. [Diagram 2] FIG. 1 is an explanatory diagram of an example of two users using a virtual reality generation system. [Diagram 3] 3 is a diagram illustrating a schematic diagram of the state in which the two users shown in FIG. 2 are wearing head-mounted displays and viewing images in a virtual space. [Figure 4] FIG. 13 is a diagram showing an example of a terminal image. [Diagram 5] FIG. 11 is an explanatory diagram of an example of a terminal image suitable for this embodiment. [Figure 6] FIG. 2 is an explanatory diagram of an example of a terminal image for a first user when four users share the same virtual space. [Figure 7] FIG. 1 is an explanatory diagram (part 1) of an image acquisition event. [Figure 8] FIG. 2 is an explanatory diagram (part 2) of an image acquisition event. [Figure 9] 1 is an explanatory diagram (part 1) of an item acquisition event. [Figure 10] 13 is an explanatory diagram (part 2) of an item acquisition event. [Figure 11] FIG. 2 is a functional block diagram of a server device related to an image acquisition event and an item acquisition event. [Figure 12] FIG. 2 is a functional block diagram of a terminal device related to an image acquisition event and an item acquisition event. [Figure 13] FIG. 4 is an explanatory diagram of data in a user database. [Figure 14] FIG. 2 is an explanatory diagram of data in an avatar database. [Figure 15] FIG. 1 is an explanatory diagram (part 1) of the imaging arrangement process. [Figure 16] FIG. 2 is an explanatory diagram (part 2) of the imaging arrangement process. [Figure 17] FIG. 11 is an explanatory diagram (part 1) of a method for calculating a first relative positional relationship. [Figure 18] FIG. 11 is an explanatory diagram (part 2) of a method for calculating the first relative positional relationship. [Figure 19] FIG. 13 is an explanatory diagram of a progressive mission mode. [Figure 20] 11 is an explanatory diagram of image generating conditions related to event image data stored in an image data storage unit. FIG. [Figure 21]11A and 11B are functional block diagrams of an example of a server device with different sharing patterns; [Figure 21A] 11 is a functional block diagram of an example of a terminal device having a different sharing manner; FIG. [Figure 21B] FIG. 11 is a functional block diagram of another example of a terminal device having a different sharing manner. [Figure 22] FIG. 11 is a functional block diagram of another example of a server device having a different sharing manner. [Figure 22A] FIG. 13 is a functional block diagram of another example of a terminal device having a different sharing manner. [Diagram 23] 1 is a timing chart showing an example of the operation of the virtual reality generation system with respect to the occurrence of an image capture event. [Figure 24] 11 is a timing chart showing an example of the operation of the virtual reality generation system regarding the occurrence of an item acquisition event. [Diagram 25] FIG. 11 is a functional block diagram of a server device according to a modified example. [Figure 26] FIG. 4 is an explanatory diagram of data in an advertisement information storage unit. [Figure 27] FIG. 11 is a functional block diagram of a terminal device according to a modified example. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, an embodiment will be described with reference to the drawings.

[0010] (Overview of the Virtual Reality Generation System) Fig. 1 is a block diagram of a virtual reality generation system 1 according to this embodiment. The virtual reality generation system 1 includes a server device 10 and one or more terminal devices 20. For simplicity, three terminal devices 20 are illustrated in Fig. 1, but the number of terminal devices 20 may be two or more.

[0011] The server device 10 is, for example, a server managed by an operator that provides one or more virtual realities. The terminal device 20 is, for example, a device used by a user, such as a mobile phone, a smartphone, a tablet terminal, a PC (Personal Computer), a head-mounted display, or a game device. A plurality of terminal devices 20 can be connected to the server device 10 via the network 3, typically in a different manner for each user.

[0012] The terminal device 20 is capable of executing a virtual reality application according to this embodiment. The virtual reality application may be received by the terminal device 20 from the server device 10 or a predetermined application distribution server via the network 3, or may be stored in advance in a storage device provided in the terminal device 20 or a storage medium such as a memory card readable by the terminal device 20. The server device 10 and the terminal device 20 are communicatively connected via the network 3. For example, the server device 10 and the terminal device 20 cooperate to execute various processes related to virtual reality.

[0013] The network 3 may include a wireless communication network, the Internet, a Virtual Private Network (VPN), a Wide Area Network (WAN), a wired network, or any combination of these.

[0014] Here, an overview of the virtual reality according to the present embodiment will be described. The virtual reality according to the present embodiment is a virtual reality for any reality, such as education, travel, role-playing, simulation, entertainment such as games and concerts, and a virtual reality medium such as an avatar is used in conjunction with the execution of the virtual reality. For example, the virtual reality according to the present embodiment is realized by a three-dimensional virtual space, various virtual reality media appearing in the virtual space, and various contents provided in the virtual space.

[0015] The virtual reality medium is electronic data used in virtual reality, and includes any medium, such as cards, items, points, service currency (or virtual reality currency), tokens (e.g., Non-Fungible Token (NFT)), tickets, characters, avatars, parameters, etc. The virtual reality medium may be virtual reality-related information, such as level information, status information, virtual reality parameter information (stamina value and attack power, etc.), or ability information (skills, abilities, spells, jobs, etc.). The virtual reality medium is electronic data that can be acquired, owned, used, managed, exchanged, synthesized, enhanced, sold, discarded, or donated by a user in virtual reality, but the usage manner of the virtual reality medium is not limited to those specified in this specification. In the following, a medium that can be drawn in a virtual space among the virtual reality media may be referred to as a display medium.

[0016] (Server device configuration) The configuration of the server device 10 will be specifically described. The server device 10 is composed of a server computer. The server device 10 may be realized by a plurality of server computers working in cooperation with each other. For example, the server device 10 may be realized by a server computer that provides various contents, a server computer that realizes various authentication servers, and the like working in cooperation with each other. The server device 10 may also include a Web server. In this case, some of the functions of the terminal device 20 described later may be realized by a browser processing an HTML document received from the Web server and various programs (JavaScript (registered trademark)) associated therewith.

[0017] The server device 10 includes a server communication unit 11, a server storage unit 12, and a server control unit 13.

[0018] The server communication unit 11 includes an interface for communicating with an external device wirelessly or wiredly and transmitting and receiving information. The server communication unit 11 may include, for example, a wireless LAN (Local Area Network) communication module or a wired LAN communication module. The server communication unit 11 is capable of transmitting and receiving information to and from the terminal device 20 via the network 3.

[0019] The server storage unit 12 is, for example, a storage device, and stores various information and programs necessary for various processes related to virtual reality. For example, the server storage unit 12 stores a virtual reality application.

[0020] For example, the server storage unit 12 stores drawing information of a user avatar M1 (an example of a display medium) as a virtual reality medium associated with each user. The user is a user of the virtual reality generation system 1. In addition to general users, the users may include administrative users who operate avatars in association with the administrator of the virtual reality generation system 1. The user avatar M1 is drawn in the virtual space based on the drawing information of the user avatar M1.

[0021] The server storage unit 12 also stores drawing information related to various objects different from the user avatar M1, such as various items or NPCs (Non Player Characters), etc. Various objects are drawn in the virtual space based on the drawing information.

[0022] The server control unit 13 may include a dedicated microprocessor or a CPU (Central Processing Unit) that realizes a specific function by reading a specific program, a GPU (Graphics Processing Unit), etc. For example, the server control unit 13 cooperates with the terminal device 20 to execute a virtual reality application in response to a user operation on the display unit 23 of the terminal device 20. The server control unit 13 also executes various processes related to virtual reality. Specific details of the processes of the server control unit 13 will be described later.

[0023] (Terminal Device Configuration) The following describes the configuration of the terminal device 20. As shown in Fig. 1, the terminal device 20 includes a terminal communication unit 21, a terminal storage unit 22, a display unit 23, an input unit 24, and a terminal control unit 25.

[0024] The terminal communication unit 21 includes an interface for communicating with an external device wirelessly or wiredly and transmitting and receiving information. The terminal communication unit 21 may include a wireless communication module, a wireless LAN communication module, or a wired LAN communication module that supports mobile communication standards such as LTE (Long Term Evolution) (registered trademark), LTE-A (LTE-Advanced), a fifth generation mobile communication system, and UMB (Ultra Mobile Broadband). The terminal communication unit 21 is capable of transmitting and receiving information to and from the server device 10 via the network 3.

[0025] The terminal storage unit 22 includes, for example, a primary storage device and a secondary storage device. For example, the terminal storage unit 22 may include a semiconductor memory, a magnetic memory, an optical memory, or the like. The terminal storage unit 22 stores various information and programs used in the processing of virtual reality received from the server device 10. The information and programs used in the processing of virtual reality may be acquired from an external device via the terminal communication unit 21. For example, a virtual reality application program may be acquired from a predetermined application distribution server. Hereinafter, the application program is also simply referred to as an application. In addition, for example, some or all of the above-mentioned information about the user and information about the virtual reality media of other users may be acquired from the server device 10.

[0026] The display unit 23 includes a display device such as a liquid crystal display or an organic EL (Electro-Luminescence) display. The display unit 23 is capable of displaying a variety of images. The display unit 23 is configured with, for example, a touch panel, and functions as an interface that detects a variety of user operations. The display unit 23 may be in the form of a head-mounted display.

[0027] The input unit 24 includes an input interface including a touch panel provided integrally with the display unit 23, for example. The input unit 24 can accept user input to the terminal device 20. The input unit 24 may include physical keys, or may further include any input interface including a pointing device such as a mouse. The input unit 24 may also be capable of accepting non-contact user input such as voice input or gesture input. Note that a sensor (such as an image sensor, an acceleration sensor, or a distance sensor) for detecting the movement of the user's body may be used for the gesture input. In this case, the input unit 24 may be realized by an acceleration sensor, a gyro sensor, or the like built into the terminal device 20.

[0028] The terminal control unit 25 includes one or more processors. The terminal control unit 25 controls the operation of the entire terminal device 20.

[0029] The terminal control unit 25 transmits and receives information via the terminal communication unit 21. For example, the terminal control unit 25 receives various information and programs used for various processes related to virtual reality from at least one of the server device 10 and another external server. The terminal control unit 25 stores the received information and programs in the terminal storage unit 22. For example, the terminal storage unit 22 may store a browser (Internet browser) for connecting to a Web server.

[0030] The terminal control unit 25 starts a virtual reality application in response to a user's operation. The terminal control unit 25 cooperates with the server device 10 to execute various processes related to virtual reality. For example, the terminal control unit 25 causes the display unit 23 to display an image of a virtual space. For example, a GUI (Graphic User Interface) for detecting a user operation may be displayed on the screen. The terminal control unit 25 can detect a user operation on the screen via the input unit 24. For example, the terminal control unit 25 can detect a user's tap operation, a long tap operation, a flick operation, a swipe operation, and the like. A tap operation is an operation in which a user touches the display unit 23 with a finger and then releases the finger. The terminal control unit 25 transmits operation information to the server device 10.

[0031] (Example of virtual space) The server control unit 13 cooperates with the terminal device 20 to display an image of the virtual space on the display unit 23, and updates the image of the virtual space in response to the progress of the virtual reality and the user's operations. In this embodiment, the server control unit 13 cooperates with the terminal device 20 to render objects placed in the three-dimensional virtual space as viewed from a virtual camera placed in the virtual space.

[0032] The drawing process described below is realized by the server control unit 13, but in other embodiments, a part or all of the drawing process described below may be realized by the server control unit 13. In the following description, at least a part of the image of the virtual space displayed on the terminal device 20 may be a web display displayed on the terminal device 20 based on data generated by the server device 10, and at least a part of the image may be a native display displayed by a native application installed on the terminal device 20.

[0033] Fig. 2 is an explanatory diagram of an example of two users using the virtual reality generation system 1. Fig. 3 is a diagram showing a state in which the two users shown in Fig. 2 are wearing the head mounted displays 23A and viewing an image of a virtual space. Note that, although a mode in which two users share a virtual space will be described here, the present invention is also applicable to a mode in which three or more users share a virtual space, or a mode in which only one person has exclusive use of a virtual space.

[0034] 2 shows a schematic diagram of two users in real space at different positions on the earth. In this embodiment, the two users at positions P1 and P2 in real space can interact with each other in the same virtual space.

[0035] In this embodiment, two users wearing head mounted displays 23A can act in the virtual space in the form of user avatars M1. Fig. 3 shows a schematic diagram of two users at different positions in the real space viewing an image of a common virtual space 300. Note that, in this embodiment, the head mounted display 23A is used as a means for the users to view an image of the virtual space, but other display devices (for example, a PC display) may be used.

[0036] Fig. 4 is an explanatory diagram of an image for the head mounted display 23A (hereinafter also referred to as "terminal image"), and is a diagram showing an example of the terminal image. In Fig. 4, a part of the virtual space is drawn together with a user avatar M1. A method for generating the terminal image will be described later.

[0037] In this embodiment, for example, a stereoscopic image may be generated by generating images G200 and G201 that are respectively viewed by the left and right eyes, as shown in Fig. 4. In Fig. 4, images G200 and G201 that are respectively viewed by the left and right eyes are shown typically. In the following description, unless otherwise specified, the image of the virtual space generated as the image for the terminal refers to the entire image represented by the images G200 and G201.

[0038] Fig. 5 is an explanatory diagram of an example of a suitable terminal image in this embodiment. Note that the terminal image shown in Fig. 5 may be an image for one user (a terminal image viewed by one user through the head mounted display 23A).

[0039] In this embodiment, the image for the terminal preferably includes a realistic image based on a photograph of a real space or CG (computer graphics), as shown in FIG. 5. For example, the image for the terminal is an image of a real place. This allows the user to have the illusion of being in that place. As a result, the range of activities of each user in the virtual space can be expanded, and the activation of activities can be promoted.

[0040] In this embodiment, the image for the terminal is based on a real image based on a real-space photograph or CG (hereinafter referred to as a "real-space image"), and is formed in such a manner that an interface image functioning as a GUI, a user avatar M1, etc. are appropriately superimposed on the real-space image (for example, synthesized on JavaScript (registered trademark)). The real-space image may be acquired, for example, by using "Google Street View Image API" provided by Google Inc. or an API (Application Programming Interface) of the same kind. In this case, a street view image acquired from a specified latitude, longitude, Pano (panorama) ID, etc. can be imported as the real-space image.

[0041] However, in a modified example, instead of the real space image, an image of a space that does not correspond in part or in whole to the real space may be used. For example, an image of a virtual space of a game or a three-dimensional space of the metaverse may be used. In addition, the real space image may not only be an image corresponding to the real space at the present time, but may also be an image corresponding to a real space in the past or a real space based on a prediction of the future.

[0042] In this embodiment, when the real-space image of the terminal image viewed by a user is an image of a real place, the position of the user avatar M1 corresponding to the user is associated with the position information associated with the real-space image. For example, when the real-space image of the terminal image viewed by a user is an image of Tokyo Tower, the user avatar M1 corresponding to the user is located at a place where Tokyo Tower can be seen. Therefore, in the following description, when a user avatar M1 corresponding to a user moves to a certain place, this is essentially the same as the terminal image corresponding to the user becoming an image related to the place. In this way, the user can go to various places in the virtual space via the user avatar M1.

[0043] FIG. 6 is an explanatory diagram of an example of a terminal image G600 for one user (hereinafter, a first user) when four users share the same virtual space.

[0044] The terminal image G600 shown in Figure 6 includes, on a real-space image G601, an image G610 showing a user avatar M1 (hereinafter also referred to as the "first user avatar M1") corresponding to the first user (an example of a first display medium), user interfaces G611 and G612 which are GUIs that can be operated by the first user, a direction guidance image G614, a distance guidance image G615, and a friend guidance image G616.

[0045] Image G610 is an image for allowing the first user to recognize his / her own user avatar M1. Note that image G610 may be omitted.

[0046] The user interface G611 includes various operation buttons B601 to B603 that can be operated by the first user. The operation button B601 is a button for turning on / off the display state of the friend guide image G616. The operation button B602 is a shutter button, and is operated when taking a photograph such as a commemorative photograph (taking a photograph in a virtual space) described later. The operation button B603 is a button for viewing a photograph or a video taken in the commemorative photograph. Hereinafter, taking a photograph means taking a photograph in a virtual space, unless otherwise specified, and a photograph is synonymous with image data based on an image for the terminal stored at the time of capturing an image.

[0047] The user interface G612 includes buttons B605 to B609 for teleportation. Each of the buttons B605 to B609 may be associated with information (e.g., text information) indicating a destination. For example, the button B605 is a button for teleporting to the entrance of a facility or the like where the first user avatar M1 is currently located.

[0048] The number and destinations of the buttons B605 to B609 are arbitrary. However, the destinations may preferably include places that are very difficult to reach in real space (such as the top of Everest or the rooftop of a high-rise building). In this case, the user can easily go to places that can only be reached in virtual space via the user avatar M1, and can have a valuable experience. In addition, the destination for teleportation may be appropriately set by the user.

[0049] The direction guide image G614 is information that indicates or suggests a direction (relative direction based on the first user avatar M1) as viewed from the first user avatar M1, and is information that indicates or suggests a direction to a specific destination position or a specific item. The specific destination position may be a position (such as Tokyo Tower) specified in a mission when a game with a mission is played, for example. In this case, the specific destination position may be set in a manner having a certain range. The specific item (an example of a specific display medium) may be any virtual reality medium. The specific item may be an acquisition target item (described later) specified in a mission when a game with a mission is played, for example. This allows the first user to easily grasp the direction of the specific destination position or the specific item by looking at the direction guide image G614, and makes it easy to move the first user avatar M1 to the vicinity of the specific destination position or the specific item as appropriate.

[0050] The direction guide image G614 may be associated with information (for example, text information) indicating a specific destination location or a specific item, which allows the first user to easily grasp the specific destination location or the specific item.

[0051] The direction guide image G614 may be, for example, an image in the form of a compass showing the direction of a specific destination location or the direction of a specific item, as shown in Fig. 6. The direction guide image G614 may be drawn in a planar view. In this case, the direction of the pointed tip may correspond to the direction of the specific destination location or the direction of the specific item in a planar view (when viewed from a bird's-eye view).

[0052] The direction guide image G614 may be omitted, or the first user may be able to turn the display on and off.

[0053] The distance guide image G615 is information that indicates or suggests a relative distance from the first user avatar M1, and is information that indicates or suggests a distance from the first user avatar M1 to a specific destination position or a specific item. The distance guide image G615 may be, for example, an image of a number that indicates a corresponding distance, as shown in FIG. 6. This allows the first user to easily grasp the distance to a specific destination position or a specific item by looking at the distance guide image G615. The distance guide image G615 is preferably displayed in a set with the direction guide image G614 near the direction guide image G614.

[0054] The friend guide image G616 shows the position information of each user avatar M1 (hereinafter also referred to as "second user avatar M1") (an example of a second display medium) corresponding to another user (hereinafter referred to as "second user"). Therefore, the first user can move the first user avatar M1 while grasping the positional relationship with the second user avatar M1 and the position of the second user avatar M1. This makes it easy for the first user to move his / her first user avatar M1 close to the second user avatar M1 by looking at the friend guide image G616. Note that a similar friend guide image is also displayed on the second user's terminal image. Therefore, each user can communicate with each other while grasping the positional relationship of each other's user avatar M1.

[0055] 6, the friend guide image G616 includes guide images G616-1 to G616-3 for each second user avatar M1, along with images G616A to G616C showing the second user avatar M1. In this case, the friend guide image G616 includes guide images G616-1 to G616-3 corresponding to the three second users.

[0056] The guide images G616-1 to G616-3 are arranged in association with the images G616A to G616C showing the corresponding second user avatars M1, respectively. For example, the guide image G616-1 relating to one second user avatar M1 is arranged in association with the image G616A showing the one second user avatar M1 (in FIG. 6, it is arranged below the image G616A).

[0057] The guidance image G616-1 (and the guidance images G616-2, G616-3 as well) relating to the corresponding second user avatar M1 includes a direction guidance image G6161 and a distance guidance image G6162.

[0058] The direction guide image G6161 is information that indicates or suggests a direction when viewed from the first user avatar M1 (a relative direction based on the first user avatar M1) and is information that indicates or suggests the direction of a corresponding second user avatar M1. This allows the first user to see the direction guide image G6161 and grasp the direction of the desired second user avatar M1, making it easy to move the first user avatar M1 to the vicinity of the desired second user avatar M1 as appropriate.

[0059] The direction guide image G6161 may be, for example, an image in the form of a compass showing the direction of the corresponding one of the second user avatars M1, as shown in Fig. 6. The direction guide image G6161 may be drawn in a planar view, similar to the above-mentioned direction guide image G614. In this case, the direction of the pointed tip may correspond to the direction of the corresponding one of the second user avatars M1 in a planar view (when viewed from a bird's-eye view).

[0060] The distance guide image G6162 is information that indicates or suggests a relative distance from the first user avatar M1, and is information that indicates or suggests a distance from the first user avatar M1 to the second user avatar M1. The distance guide image G6162 may be, for example, an image of a number that indicates a corresponding distance, as shown in FIG. 6, similar to the above-mentioned distance guide image G615. This allows the first user to easily grasp the distance to the second user avatar M1 by looking at the distance guide image G6162. The distance guide image G6162 is preferably displayed in a set with the direction guide image G6161 in the vicinity of the direction guide image G6161 related to the same second user avatar M1.

[0061] In this embodiment, a specified event occurs when at least one of the respective positions of the first user avatar M1 and the second user avatar M1 in the virtual space and a first relative positional relationship between the first user avatar M1 and the second user avatar M1 in the virtual space satisfies a first specified condition.

[0062] The first predetermined condition is arbitrary, but may be satisfied under a situation where the first user avatar M1 and the second user avatar M1 have a high possibility of interaction. In this embodiment, the first predetermined condition is satisfied when the first user avatar M1 and the second user avatar M1 are close to each other. For example, the first predetermined condition is satisfied when the distance (relative distance in the virtual space) between the first user avatar M1 and the second user avatar M1 is within a predetermined distance. In this case, the predetermined distance corresponds to the distance when the first user avatar M1 and the second user avatar M1 are close to each other, and may be appropriately adapted. Alternatively, the first predetermined condition may be satisfied when the first user avatar M1 and the second user avatar M1 are within a predetermined distance from a common specific position.

[0063] The predetermined event is arbitrary, but is preferably an event that can be realized by cooperation between the first user avatar M1 and the second user avatar M1 that satisfy a first predetermined condition. In this case, communication between the first user and the second user is promoted through the first user avatar M1 and the second user avatar M1.

[0064] For example, events that can be realized in cooperation between the first user avatar M1 and the second user avatar M1 may be, for example, the following events E1 to E5. Event E1: An event where you can teleport to a common room or a specific location Event E2: The space available for movement expands (when people gather at the gate, the gate opens) Event E3: An event where everyone can play mini games Event E4: An event where only the members can chat Event E5: An event where everyone works together to complete a mission (treasure hunt, puzzle solving game, etc.). Here, the common room may be a space formed as a virtual space where specific content is provided. The specific content may be entertainment content that can be viewed. Alternatively, the common room may be a space where no specific content is provided, such as a chat room. In this case, the event E1 may be the same as the event E4. The chat may be a voice chat and / or a text chat. Also, "everyone" refers to the first user avatar M1 and the second user avatar M1, but there may be two or more second user avatars M1.

[0065] The predetermined event may be an event set by the management side, or may be an event based on UGC (User Generated Contents) that each user can generate. In this case, a predetermined event based on various contents can be set. The UGC can be created by a content designer (user) in a table format (database). Such UGC can also be distributed in the content market. A user avatar (a user avatar related to a content designer of UGC or a user involved in the creation of the UGC) may directly guide a "journey that the user wants to introduce" as a tour guide in relation to the predetermined event. By placing UGC related to various experience scenarios in a gallery, each user can relive the experience as a visitor through the user avatar. In this case, the UGC can be created by a content designer in a table format (database). Coordinates, viewpoints, events, items, messages, etc. can be easily converted into experience scenarios.

[0066] In the present embodiment, as an example, the predetermined event includes an image acquisition event such as commemorative photography. In this case, the image acquisition event may be an event in which an image including the first user avatar M1 and the second user avatar M1 is acquired with the location as the background. Note that, when the predetermined event includes multiple types of events (for example, the above-mentioned events E1 to E5), which event occurs may be selected by the first user or the like, or may be determined according to the location.

[0067] In this case, the image acquisition event may occur at any location in the virtual space, or may occur only at a specific location (e.g., a scenic spot or a famous place). In the latter case, the first predetermined condition may be satisfied when the positions of the first user avatar M1 and the second user avatar M1 belong to the corresponding specific location. More specifically, the first predetermined condition may be satisfied when the positions of the first user avatar M1 and the second user avatar M1 are within a predetermined distance from a reference position (specific position) of the corresponding specific location.

[0068] 7 and 8 are diagrams illustrating an image capture event according to an example.

[0069] In this case, when a first predetermined condition is satisfied, the operation button B602 (see FIG. 6), which is a shutter button, is made active (operable) as a preparation process for an image capture event. When the first user operates the operation button B602, an image capture event occurs.

[0070] When an image acquisition event occurs, first, as shown in FIG. 7, a first user avatar M1 and a second user avatar M1 (in FIG. 7, the first user avatar M1 and one second user avatar M1) that satisfy a first predetermined condition are drawn on the terminal image for the first user. At this time, the first user avatar M1 and the second user avatar M1 may each be drawn in a manner in which they take one of a plurality of types of poses. Which of the plurality of types of poses will be taken may be determined randomly, may be determined according to the position of the image acquisition event, or may be selectable by the corresponding user. Alternatively, a unique pose may be prepared for each user (user avatar M1) as appropriate.

[0071] Then, the countdown begins (in FIG. 7, a countdown image G700 of "1" out of 3, 2, 1 is displayed), and finally, as shown in FIG. 8, a shutter sound is output along with text information G800 such as "Say cheese!", and a picture is taken. In this case, the picture is the image for the terminal at that time, but unnecessary parts (such as the user interface G611) may be appropriately removed.

[0072] According to such an image acquisition event, a first user can interact with a second user through a first user avatar M1 and a second user avatar M1, and take commemorative photographs in a manner similar to the real space, for example, at a famous place or a scenic spot.

[0073] In the examples shown in FIG. 7 and FIG. 8, the first user avatar M1 and the second user avatar M1 appear in the photo taken in the commemorative photo (for example, a two-shot photo), but instead of the first user avatar M1 and the second user avatar M1, the image of the first user and the image of the second user in the real space may be used. In this case, the image of the first user and the image of the second user used may be prepared in advance or may be captured on the spot in the real space. In this case, the first user and the second user are positioned in front of their respective cameras, and the images captured by the respective cameras are incorporated into the photo taken in the commemorative photo. In this case, only a part (for example, only a face part) of the image of the first user and the image of the second user in the real space may be used. In this case, the other part (for example, a part other than the face) may be an image of a predetermined character (for example, a local character) or a part of the corresponding user avatar M1. In addition, the clothes of the first user avatar M1 and / or the second user avatar M1 may change during the image acquisition event (for example, the clothes may change according to the location).

[0074] In addition, when taking a commemorative photograph related to an image acquisition event, a special avatar such as an avatar of a celebrity or influencer may appear in response to a selection (request) by a user who generates the image acquisition event. This allows an image including the special avatar to be obtained at the image acquisition event. In this case, the place, time, etc. at which a photograph can be taken with the special avatar may be restricted.

[0075] In addition, when taking a commemorative photograph related to an image acquisition event, other user avatars M1 that were previously located at the same location may appear in response to a selection (request) by the user who generates the image acquisition event. This allows an image such as a group photo including many user avatars to be obtained at the image acquisition event. In this case, the other user avatars M1 with whom a photograph can be taken, the location, the time period, etc. may be appropriately restricted.

[0076] Incidentally, in such a configuration in which a predetermined event can occur based on the relative positional relationship between user avatars M1 in a virtual space, it is desirable for the relative positional relationship between the user avatars M1 to be easy for each user to understand.

[0077] In this regard, just as in the real world, each user can understand the relative positions of user avatars M1 by communicating with each other via chat, etc., but in unfamiliar locations, it may be difficult for users to meet in the same place.

[0078] In contrast, according to the present embodiment, as described above, the friend guide image G616 can be displayed, and each user can easily move their own user avatar M1 so that the first predetermined condition is satisfied while obtaining position-related information of other user avatars M1 from the friend guide image G616. As a result, the movement of the user avatar M1 in the virtual space is made more efficient, and the processing load can be reduced.

[0079] Such a friend guide image G616 is also suitable for a terminal device 20 (e.g., a smartphone) that has a relatively small screen and a limited field of view. Even in the case of such a terminal device 20, the user can easily recognize the position (relative position) of the desired second user avatar M1, and can easily move the user's first user avatar M1 to the desired position.

[0080] In the present embodiment, when it is determined that a second predetermined condition is satisfied based on the position of the first user avatar M1 in the virtual space and the position of a specific item in the virtual space, an event (hereinafter also referred to as an "item acquisition event") is generated that causes the first user or the first user avatar M1 to acquire a specific item (an example of specific information). Note that instead of or in addition to causing the first user or the first user avatar M1 to acquire the specific item, a virtual reality medium (another example of specific information) corresponding to the specific item may be caused to be acquired by the first user or the first user avatar M1.

[0081] The specific item is arbitrary, but as described above, for example, when a game with a mission is played, it may be an acquisition target item specified in the mission. In this embodiment, the acquisition target item is an item according to the location, and may be set appropriately. For example, in a location where there is a flamingo object, the acquisition target item may be an item reminiscent of a flamingo egg.

[0082] The specific item may correspond to a real object. For example, if a statue of a frog is installed as a real object in a certain place, the specific item associated with the place may be a display medium that resembles the frog.

[0083] The virtual reality medium corresponding to the specific item may be any virtual reality medium as described above, but may preferably be a virtual reality medium directly or indirectly related to the specific item. For example, if the specific item is an acquisition target item specified in a mission, the virtual reality medium corresponding to the specific item may be certificate information proving that the mission has been cleared.

[0084] The second predetermined condition is arbitrary, but may be determined based on a positional relationship (distance) similarly to the above-described first predetermined condition. In this embodiment, the second predetermined condition is satisfied when the first user avatar M1 and the specific item are close to each other. For example, the second predetermined condition is satisfied when the distance (relative distance in the virtual space) between the first user avatar M1 and the specific item is within a predetermined distance. In this case, the predetermined distance corresponds to the distance when the first user avatar M1 and the specific item are close to each other, and may be appropriately adapted. The predetermined distance related to the second predetermined condition may be the same as the predetermined distance related to the above-described first predetermined condition.

[0085] In such a configuration in which an item acquisition event can occur based on the relative positional relationship between the user avatar M1 and a specific item in the virtual space, it is desirable that the relative positional relationship between the user avatar M1 and the specific item be easy for each user to understand.

[0086] In this regard, according to the present embodiment, as described above with reference to Fig. 6, the direction guide image G614 and the distance guide image G615 can be displayed, so that each user can easily move his / her own user avatar M1 so that the second predetermined condition is satisfied while obtaining information from the direction guide image G614 and the distance guide image G615. As a result, the movement of the user avatar M1 in the virtual space is made more efficient, and the processing load can be reduced.

[0087] Such a direction guide image G614 and distance guide image G615 are also suitable for a terminal device 20 (e.g., a smartphone) that has a relatively small screen and a limited field of view. Even in the case of such a terminal device 20, the user can easily recognize the position (relative position) of a desired specific item, and can easily move the first user avatar M1 of the user to a desired position.

[0088] 9 and 10 are diagrams illustrating an item acquisition event according to an example.

[0089] As shown in FIG. 9, first, a mission related to the item acquisition event may be presented to the first user. In this case, the mission is to acquire a flamingo egg item as an acquisition target item. As shown in FIG. 9, the terminal image includes text information G900 indicating the mission, as well as a direction guide image G614 and a distance guide image G615 indicating the direction and position of the flamingo egg. This allows the first user to easily grasp the direction and position of the flamingo egg item and move the first user avatar M1 accordingly.

[0090] Then, when the first user avatar M1 moves close to the flamingo egg item, as shown in FIG. 10, text information G1000 such as "Item acquired!" is drawn to notify the user that the mission has been cleared. In this case, the flamingo egg item is associated with the user as the acquisition target item. Note that a commemorative photograph may be automatically taken at the time of the item acquisition event. In this case, the first user avatar M1 may be included in the terminal image in a pose holding the acquisition target item, and the photograph may be automatically taken. In this case, as in the image acquisition event described above, the photograph is the terminal image itself at that time, but unnecessary parts (such as the user interface G611) may be appropriately removed.

[0091] Next, a configuration example of the above-mentioned virtual reality generation system 1 will be described in order with reference to FIG. 11 and subsequent figures.

[0092] In the following, the server device 10 realizes an example of an information processing system, but as described later, each element of one terminal device 20 (see the terminal communication unit 21 to the terminal control unit 25 in FIG. 1) may realize an example of an information processing system, or a plurality of terminal devices 20 may cooperate to realize an example of an information processing system. Also, the server device 10 and one or more terminal devices 20 may cooperate to realize an example of an information processing system.

[0093] Fig. 11 is an example of a functional block diagram of the server device 10 related to the above-mentioned image acquisition event and item acquisition event. Fig. 12 is an example of a functional block diagram of the terminal device 20 related to the above-mentioned image acquisition event and item acquisition event. Fig. 13 is an explanatory diagram of data in the user database 130. Fig. 14 is an explanatory diagram of data in the avatar database 132. In Figs. 13 and 14, "***" indicates that some information is stored, "-" indicates that no information is stored, and "..." indicates a similar repetition.

[0094] Here, first, the functions of the server device 10 will be described, and then the functions of the terminal device 20 will be described.

[0095] (Server device functions) As shown in FIG. 11, the server device 10 includes a user database 130, an avatar database 132, a user input acquisition unit 140 (one example of an input acquisition unit), a position management unit 142, an image condition generation unit 144, a first determination unit 146, an interface formation unit 148, a preparation processing unit 150, an event generation unit 152, a first relative relationship output unit 154, a second relative relationship output unit 156, a second determination unit 158, a movement processing unit 162, and an image data storage unit 172. Note that some or all of the functions of the server device 10 described below may be appropriately realized by the terminal device 20 (described later with reference to FIG. 21, FIG. 21A, and FIG. 21B). Also, the division from the user input acquisition unit 140 to the movement processing unit 162 is for convenience of explanation, and some functional units may realize the functions of other functional units. The same applies to the division of user database 130, avatar database 132, and image data storage unit 172. For example, some or all of the data in user database 130 may be integrated with the data in avatar database 132, or may be stored in a separate database.

[0096] The user input acquisition unit 140 to the movement processing unit 162 can be realized by the server control unit 13 of the server device 10 executing one or more programs in the server storage unit 12 of the server device 10. In addition, the user database 130, the avatar database 132, and the image data storage unit 172 can be realized by the server storage unit 12 of the server device 10.

[0097] The user database 130 stores user information 600. In the example shown in FIG. 13, the user information 600 associates each user ID with a user name, a user avatar ID, position / orientation information, and the like. The user name is a name registered by the user himself / herself and is arbitrary. The user avatar ID is an ID for identifying the user avatar. The position / orientation information includes position information and orientation information of the user avatar M1. The position information of the user avatar M1 may be managed in a coordinate system associated with the real space image. The orientation information may be information representing the orientation of the user avatar M1. Note that the position / orientation information, and the like, are information that may dynamically change in response to an operation input from the user. In addition to the position / orientation information, information representing the movement of the limbs, etc. of the user avatar M1 and information representing a facial expression, etc. may be included.

[0098] The avatar database 132 stores avatar information on the user avatar M1. In the example shown in FIG. 14, in the user avatar information 700, face, hairstyle, clothes, etc. are associated with each user avatar ID. Information related to appearance such as face, hairstyle, clothes, etc. is a parameter that characterizes a user avatar, and may be set in advance or may be set by each user. For example, information related to appearance such as face, hairstyle, clothes, etc. of the avatar may be assigned an ID for each type. In addition, for the face, part IDs are prepared for each type such as face shape, eyes, mouth, nose, etc., and the information related to the face may be managed as a combination of IDs of each part constituting the face. In this case, information related to appearance such as face, hairstyle, clothes, etc. can function as drawing information of the avatar. That is, it is possible to draw each user avatar M1 not only on the server device 10 but also on the terminal device 20 side based on each ID related to appearance linked to each user avatar ID.

[0099] In this manner, in this embodiment, basically, one user ID is associated with one user, and one user ID is associated with a user avatar ID. Therefore, a state in which a certain piece of information is associated with one user, a state in which the information is associated with the one user ID, and a state in which the information is associated with the user avatar ID associated with the one user ID are synonymous with each other. Note that one user ID may be associated with two or more user avatar IDs.

[0100] The user input acquisition unit 140 acquires various inputs by each user inputted via the input unit 24 of the terminal device 20 .

[0101] When a predetermined placement condition is satisfied, the position management unit 142 positions various display media among the virtual reality media in the virtual space. The various display media may include a first user avatar M1 associated with the first user, a second user avatar M1 associated with the second user, and other display media (e.g., the specific items described above).

[0102] When positioning a display medium in a virtual space, the position management unit 142 may set position information of the display medium in a coordinate system associated with the above-mentioned real-space image. That is, the position management unit 142 may manage position information of various display media in a coordinate system associated with the above-mentioned real-space image.

[0103] The predetermined arrangement condition may be set for each display medium to be positioned. For example, the predetermined arrangement condition for the first user avatar M1 may be satisfied when an input by the first user is made and a request to enter the virtual space is made. In this case, the position information (initial position information) of the first user avatar M1 in the virtual space may be designated by the first user, or may be specified based on the position information of the first user in the real space. Similarly, the predetermined arrangement condition for the second user avatar M1 may be satisfied when an input by the second user is made and a request to enter the virtual space is made. In this case, the position information (initial position information) of the second user avatar M1 in the virtual space may be designated by the second user, or may be specified based on the position information of the second user in the real space. Note that, when the position information of each user in the real space is used in the arrangement process by the position management unit 142, for example, when the first user and the second user are substantially in the same position in the real space, the first user avatar M1 and the second user avatar M1 are positioned in substantially the same position in the virtual space. Alternatively, in another embodiment, the position information (initial position information) of the user avatar M1 in the virtual space when positioned by the position management unit 142 may correspond to the position information of the same user avatar M1 at the time of the previous exit.

[0104] Furthermore, the predetermined placement condition for a specific item may be satisfied when a mission for a corresponding item acquisition event is set. The positions (initial position information) at which various display media are positioned by the position management unit 142 in the virtual space may be specified in advance, or may be randomly determined according to the attributes of the display media. For example, in the case of a specific item corresponding to an object in the real space, the position information (initial position information) of the specific item in the virtual space may correspond to the position information of the same object in the real space. Furthermore, the predetermined placement condition for a specific item with a limited number of placements may include that the number of placements does not reach an upper limit value.

[0105] The position management unit 142 may virtually form separate virtual spaces for each group. That is, the position management unit 142 may position each user avatar M1 belonging to one group and each user avatar M1 belonging to another group in separate virtual spaces. In this case, the separate virtual spaces may appear the same (that is, only the user avatar M1 active there may be different spaces).

[0106] The image condition generating unit 144 generates the image generating conditions for the above-mentioned terminal image for each user. The image generating conditions may include, for example, a date and time, an ID associated with the point where the image was captured (a location ID described later), camera parameters (azimuth angle, angle of attack, angle of view, etc.), an ID of the user avatar to be drawn, a position of the user avatar to be drawn, etc. The image generating conditions may also include information indicating user avatar information 700 (see FIG. 14) of the user avatar to be drawn and a posture of the user avatar to be drawn, etc. The image generating conditions may also include information for drawing a user interface described later, information for drawing a direction guidance image G6161 and a distance guidance image G6162, etc.

[0107] The image condition generating section 144 includes a first image condition generating section 1441 and a second image condition generating section 1442 .

[0108] The first image condition generating unit 1441 generates image generating conditions for a terminal image for the first user (an example of a first display image) viewable by the first user. Note that the terminal image for the first user may be viewable by the first user via the display unit 23 of the terminal device 20, as described above.

[0109] The first image condition generating unit 1441 generates image generation conditions for the terminal image for the first user so that the terminal image for the first user is drawn based on the real space image, as described above. Specifically, the first image condition generating unit 1441 generates image generation conditions for drawing the real space image for the terminal image for the first user using the API, as described above, based on the position information of the first user avatar M1 (see the position / orientation information in FIG. 13).

[0110] In this case, the orientation from the first viewpoint at which the real space image is viewed may be determined according to the orientation of the first user avatar M1 (see the position / orientation information in FIG. 13). The orientation of the first user avatar M1 may be the orientation of the first user avatar M1 as a whole, or may be the orientation of a specific part of the first user avatar M1 (for example, the orientation of the face, the orientation of the body, the orientation of the eyes), etc.

[0111] Furthermore, the first image condition generating unit 1441 generates image generation conditions for drawing the second user avatar M1 on the image for terminal for the first user. In this case, the first image condition generating unit 1441 may generate image generation conditions for drawing the second user avatar M1 on the image for terminal for the first user according to position information of the second user avatar M1 (see position / orientation information in FIG. 13). For example, when the position information of the second user avatar M1 belongs to a space portion indicated by the image for terminal for the first user, the first image condition generating unit 1441 may generate image generation conditions for drawing the second user avatar M1 on the image for terminal for the first user.

[0112] When generating image generation conditions for drawing the second user avatar M1, the first image condition generating unit 1441 may use the user avatar information 700 (see FIG. 14) associated with the corresponding user avatar ID in the avatar database 132. In addition, at this time, the first image condition generating unit 1441 may generate image generation conditions for expressing the orientation of the second user avatar M1 based on the position / orientation information of the corresponding user avatar ID in the user database 130.

[0113] Furthermore, the first image condition generating unit 1441 generates an image generating condition for drawing a specific item on the terminal image for the first user. In this case, the first image condition generating unit 1441 may generate an image generating condition for drawing a specific item on the terminal image for the first user according to the position information of the specific item. For example, when the position information of the specific item belongs to a space portion indicated by the terminal image for the first user, the first image condition generating unit 1441 may generate an image generating condition for drawing a specific item on the terminal image for the first user.

[0114] Further, the first image condition generating unit 1441 generates an image generating condition for drawing a terminal image for the first user related to the image acquisition event. In this case, as described above with reference to FIG. 7, when it is determined that the first predetermined condition is satisfied, the first image condition generating unit 1441 cooperates with the preparation processing unit 150 to select each pose from among the multiple types of poses and generate an image generating condition for drawing the first user avatar M1 and the second user avatar M1 in the selected poses. Note that, when there are multiple second user avatars M1, a pose may be selected separately for each second user avatar M1. The multiple types of poses are arbitrary, such as a pose using fingers or hands such as a peace sign, or a pose using the whole body such as a jump. The multiple types of poses may also include types of facial expressions. Note that the method of selecting a pose may be as described above.

[0115] In addition, when generating image generation conditions for drawing a terminal image for the first user related to the image acquisition event, the first image condition generating unit 1441 may generate image generation conditions for drawing the first user avatar M1 so that the first user avatar M1 is located at the center of the terminal image for the first user, may generate image generation conditions for drawing the first user avatar M1 so that the first user avatar M1 and the second user avatar M1 are arranged in a randomly determined arrangement order, or may generate image generation conditions for drawing the first user avatar M1 so that the first user avatar M1 and the second user avatar M1 are arranged in a pre-specified arrangement order. In this case, the first image condition generating unit 1441 may perform adjustments such as shifting the drawing position immediately before the second user avatar M1 in the terminal image for the first user. Such adjustments may be performed as part of the shooting arrangement process described later. Alternatively, the first image condition generation unit 1441 may generate image generation conditions for drawing the first user avatar M1 so that the previous drawing position of the second user avatar M1 in the terminal image for the first user is not changed (affected).

[0116] The second image condition generating unit 1442 generates image generating conditions for a terminal image for the second user that is viewable by the second user. Note that the terminal image for the second user may be viewable by the second user via the display unit 23 of the terminal device 20, as described above.

[0117] The second image condition generating unit 1442, like the first image condition generating unit 1441, generates image generation conditions for a terminal image for the second user (an example of a second display image) so that the terminal image for the second user is drawn based on the real space image, as described above. Specifically, the second image condition generating unit 1442 may acquire image generation conditions for drawing a real space image for the terminal image for the second user using an API, as described above, based on position information of the second user avatar M1 (see position / orientation information in FIG. 13). Then, the second image condition generating unit 1442 generates image generation conditions for drawing the terminal image for the second user, based on the real space image viewed from the second viewpoint associated with the second user avatar M1. In this case, the orientation from the second viewpoint for viewing the real space image may be determined according to the orientation of the second user avatar M1 (see position / orientation information in FIG. 13). The orientation of the second user avatar M1 may be the orientation of the second user avatar M1 as a whole, or may be the orientation of a specific part of the second user avatar M1 (for example, the orientation of the face, the orientation of the body, the orientation of the eyes), etc.

[0118] Furthermore, the second image condition generating unit 1442 for one second user generates image generation conditions for drawing the first user avatar M1 or another second user avatar M1 (second user avatar M1 associated with another second user different from the one second user) in a terminal image for the second user. In this case, the second image condition generating unit 1442 may generate image generation conditions for drawing the first user avatar M1 or another second user avatar M1 in a terminal image for the second user according to position information (see position / orientation information in FIG. 13) of the first user avatar M1 or another second user avatar M1.

[0119] Moreover, the second image condition generating unit 1442 generates image generation conditions for drawing a specific item on a terminal image for the second user, similar to the first image condition generating unit 1441. Moreover, the second image condition generating unit 1442 generates image generation conditions for drawing a terminal image for the second user related to the image acquisition event, similar to the first image condition generating unit 1441.

[0120] The first determination unit 146 determines whether or not a first predetermined condition is satisfied for each user. The first predetermined condition may be as described above. In this case, the first determination unit 146 may use position information of the corresponding user avatar M1 in the user database 130 when determining whether or not the first predetermined condition is satisfied. In this case, the first determination unit 146 can calculate a relative positional relationship (a first relative relationship described below), such as a distance between each user avatar M1, based on the position information of each user avatar M1.

[0121] Here, the position information of each user avatar M1 is initially determined by the position management unit 142 as described above, and is then updated by the movement processing unit 162, which will be described later. When the position information of each user avatar M1 is specified based on the position of each user in the real space, as described above with respect to the position management unit 142 or as described below with respect to the movement processing unit 162, the first predetermined condition is determined based on the position of each user in the real space. For example, the first predetermined condition that is satisfied when the distance (relative distance in the virtual space) between the first user avatar M1 and the second user avatar M1 is within a predetermined distance may be satisfied when the distance between the users in the real space is within a predetermined distance. Also, for example, the first predetermined condition that is satisfied when the position of the first user avatar M1 is within a predetermined distance from a reference position (specific position) of a corresponding specific place may be satisfied when the user position in the real space is within a predetermined distance from the specific position.

[0122] The interface forming unit 148 forms a user interface on the terminal image. The user interface may include the user interfaces G611, G612, etc. described above with reference to Fig. 6. Note that the interface forming unit 148 cooperates with the preparation processing unit 150 to perform a process of making the operation button B602 (see Fig. 6), which is a shutter button, active (into an operable state), as described later.

[0123] The preparation processing unit 150 performs a preparation process for enabling a predetermined event to occur when the first determination unit 146 determines that the first predetermined condition is satisfied. The preparation processing unit 150 performs a preparation process for each user depending on whether the first predetermined condition determined for each user is satisfied. For example, when it is determined that the first predetermined condition is satisfied for the first user, the preparation processing unit 150 performs a preparation process for enabling a predetermined event to occur for the first user.

[0124] The preparation process may differ for each predetermined event, and may be omitted depending on the attributes of the predetermined event. For example, if the predetermined event is the above-mentioned event E1 (an event for teleporting to a common room or a specific location), the preparation process may be omitted, or may be a process for generating or activating a button for teleportation.

[0125] In this embodiment, as described above, the predetermined event is an image capture event, and the preparation process includes a process of activating (enabling operation of) the operation button B602 (see FIG. 6), which is a shutter button, as an interface for generating the image capture event. Note that the preparation process is executed for a terminal image for a user for which it is determined that the first predetermined condition is satisfied.

[0126] Specifically, when the first determination unit 146 determines that the first predetermined condition is satisfied, the preparation processing unit 150 transitions the operation button B602 from an inactive state to an active state via the interface forming unit 148. In a modified example, when the first determination unit 146 determines that the first predetermined condition is satisfied, the preparation processing unit 150 may transition the operation button B602 from a hidden state to a displayed state via the interface forming unit 148. Alternatively, in another modified example, when the first determination unit 146 determines that the first predetermined condition is satisfied, the preparation processing unit 150 may transition the function of the operation button B602 from a normal photo-taking function to a commemorative photo-taking function via the interface forming unit 148. At this time, the operation button B602 (see FIG. 6), which is a shutter button, may change in form to a "Like" button or a share button. In this case, the normal photographing function may be a function of taking a photograph in a manner that does not include the first user avatar M1 described below (that is, a function of storing an image for the terminal of the first user).

[0127] As another modified example, the determination by the first determination unit 146 as to whether the first predetermined condition is satisfied or not, and the preparation process related to the operation button B602 by the preparation processing unit 150 may be omitted. In this case, the operation button B602 may basically be activated at all times, and when the operation button B602 is pressed, a commemorative photograph (two-shot photo) of the user avatars M1 in a range where the photograph can be taken as an image for the terminal can be taken. The omission of the determination by the first determination unit 146 and the preparation process by the preparation processing unit 150 may be performed, for example, by processing without going through the first determination unit 146 and the preparation processing unit 150, or by canceling or invalidating the first predetermined condition even if the first determination unit 146 and the preparation processing unit 150 are used in other embodiments disclosed in this specification (including the case where the determination by the second determination unit 158 ​​described later is omitted).

[0128] In the present embodiment, the predetermined event is an image acquisition event as described above, and the preparation process may further include a process of drawing each user avatar M1 in a drawing style that resembles a commemorative photo.

[0129] Specifically, when the first determination unit 146 determines that the first predetermined condition is satisfied for the first user, the preparation processing unit 150 generates, via the first image condition generation unit 1441, image generation conditions for drawing an image for a terminal for the first user such that the first user avatar M1 and the second user avatar M1 are each included in the image for a terminal for the first user. Hereinafter, the drawing preparation process performed in cooperation with the first image condition generation unit 1441 among the preparation processes performed by the preparation processing unit 150 is also referred to as a "photography arrangement process." The photography arrangement process preferably generates image generation conditions for drawing an image for a terminal for the first user such that the first user avatar M1 and the second user avatar M1 are each included in an image facing forward.

[0130] Note that the process of generating image generation conditions for drawing the first user avatar M1 and the second user avatar M1 in selected poses at the time of an image acquisition event by the first image condition generating unit 1441 may be executed after the above-mentioned photographing arrangement process, or may be realized substantially simultaneously with the photographing arrangement process. In other words, the photographing arrangement process may be executed simultaneously in conjunction with the image acquisition event, or may be executed in synchronization with the process of activating (making operable) the operation button B602 (see FIG. 6), which is a shutter button.

[0131] Similarly, when the first judgment unit 146 judges that the first specified condition is satisfied with respect to the second user, the preparation processing unit 150 generates, via the first image condition generation unit 1441, image generation conditions for drawing an image for the terminal for the second user so that the second user avatar M1 as well as each of the other user avatars M1 that satisfy the first specified condition are included in the image for the terminal for the second user.

[0132] Here, the shooting arrangement process will be described with reference to Fig. 15 and Fig. 16. Here, the first image condition generating unit 1441 will be described, but the second image condition generating unit 1442 is similar.

[0133] 15 and 16 show a first user avatar M1 (user avatar M1 related to the first user) in a virtual space and a virtual camera 60 in a side view. An arrow R13 from the virtual camera 60 indicates the line of sight from the first viewpoint related to the terminal image for the first user. FIG. 15 shows a state before the above-mentioned image acquisition event, and FIG. 16 shows a state during the above-mentioned image acquisition event. Note that in the state during the image acquisition event, the second user avatar M1 is located next to the first user avatar M1, but the second user avatar M1 is omitted from FIG. 16.

[0134] Here, for the sake of explanation, a virtual camera 60 is used. The position of the virtual camera 60 corresponds to a first viewpoint related to the terminal image for the first user, and the line of sight direction of the virtual camera 60 (the direction of the arrow R13) represents the line of sight direction (the direction in which the real space image is viewed) from the first viewpoint when generating the terminal image for the first user.

[0135] The state shown in FIG. 15 is a state before an image acquisition event and before the photographing arrangement process is executed. In this case, the first user avatar M1 is positioned behind the virtual camera 60, and the virtual camera 60 is located in front of the first user avatar M1 (for example, in front of the eyes). At this time, the line of sight direction of the virtual camera 60 corresponds to the direction of the first user avatar M1. In this case, the terminal image for the first user becomes an image of a first person viewpoint, and the first user avatar M1 itself is not drawn as an avatar (a form other than the image G610). However, image generation conditions may be generated such that a part of the body of the first user avatar M1, such as the hand, is drawn in the terminal image for the first user. For example, when the first user puts out his / her left hand in front of his / her eyes, the left hand of the first user avatar M1 may be included in the terminal image for the first user.

[0136] 16 is a state during an image acquisition event, and is a state after the photographing arrangement process is executed. In this case, the first user avatar M1 is positioned in front of the virtual camera 60. At this time, the line of sight direction of the virtual camera 60 corresponds to a direction toward the first user avatar M1. In other words, the first user avatar M1 moves within the field of view of the virtual camera 60.

[0137] The photographing and positioning process thus includes substantially changing the position of the user avatar M1 so that the user avatar M1 is included in the terminal image for the first user. However, the actual process may be a process of generating image generation conditions such that the user avatar M1 is additionally drawn in the terminal image for the first user without changing the position information of the user avatar M1 itself.

[0138] The event generating unit 152 includes an image data acquiring unit 1521 and a variety of event generating unit 1522 .

[0139] The image data acquisition unit 1521 generates an image acquisition event. In this embodiment, the image data acquisition unit 1521 generates an image acquisition event when the above-mentioned first predetermined condition is satisfied and an operation input (one example of a predetermined input) of the operation button B602 by the first user is acquired. In a modified example, the image data acquisition unit 1521 may automatically generate an image acquisition event (irrespective of the operation input of the operation button B602 by the first user) when the above-mentioned first predetermined condition is satisfied. Alternatively, the image data acquisition unit 1521 may generate an image acquisition event when the above-mentioned first predetermined condition is satisfied, another arbitrary condition is established, and an operation input of the operation button B602 by the first user is acquired. Also, other inputs (including voice inputs, etc.) may be used instead of or in addition to the operation input of the operation button B602.

[0140] The image data acquisition unit 1521 acquires image generation conditions (one example of image generation conditions for specific image data) related to event image data (one example of image generation conditions for specific image data) based on image generation conditions for a terminal image for the first user (a terminal image in which the first user avatar M1 and the second user avatar M1 are drawn) generated by the first image condition generation unit 1441 at the time of an image acquisition event related to the first user. Note that the event image data may be the data of the image generation conditions for the terminal image for the first user generated by the first image condition generation unit 1441 at the time of an image acquisition event related to the first user, or may be image generation conditions for image data processed thereon (for example, compressed data, data from which a user interface or a part of a display medium has been removed). In addition, the image generation conditions related to the event image data may be added to the image generation conditions for the terminal image for the first user generated by the first image condition generation unit 1441 by adding additional information selected by the user or predetermined additional information (such as the name of a place, a shooting time, or a picture of a frame).

[0141] The image generation conditions related to the event image data are image generation conditions for generating an image related to the event image data. The image generation conditions related to the event image data may include, for example, the date and time of capturing the image, the name of the phase where the image was captured, an ID associated with the location where the image was captured (a location ID described below), and camera parameters (azimuth angle, angle of attack, angle of view, etc.). The phase name may be used for printing a watermark. The image generation conditions related to the event image data may also include user avatar information 700 (see FIG. 14) of the drawing target and information indicating the type of pose at the time of capturing the image.

[0142] For example, in the example described with reference to Fig. 8, the image data acquisition unit 1521 acquires image generation conditions related to the event image data based on the terminal image for the first user at or around the timing of outputting "Say cheese!" or a shutter sound in synchronization with that timing. Note that, in a modified example, the image data acquisition unit 1521 may acquire the event image data itself.

[0143] The image data acquisition unit 1521 functions for each user. In other words, in the case of the second user, the image data acquisition unit 1521 similarly acquires image generation conditions related to the event image data based on image generation conditions related to the terminal image for the second user generated by the second image condition generation unit 1442 at the time of the image acquisition event related to the second user.

[0144] The various event generating unit 1522 generates various events in the virtual space. The various events may be events other than the above-mentioned predetermined events, and may be, for example, the above-mentioned item acquisition event or a mission related to the various events. For example, the various event generating unit 1522 associates a specific item or a virtual reality medium corresponding thereto with a user who satisfies a second predetermined condition in the above-mentioned item acquisition event.

[0145] The first relative relationship output unit 154 outputs first relative relationship information that indicates or suggests the first relative positional relationship based on the relative positional relationship between the first user avatar M1 and the second user avatar M1 in the virtual space (hereinafter also referred to as the "first relative positional relationship"). The first relative relationship information may be output via an image for a terminal. That is, the first relative relationship information may be in the form of an image included in the image for a terminal.

[0146] The relative positional relationship between the first user avatar M1 and the second user avatar M1 in the virtual space is a concept that includes a relative distance, a relative orientation, and the like. In this embodiment, the first relative relationship information includes the direction guidance image G6161 and the distance guidance image G6162 as described above with reference to Fig. 6. However, in a modified example, the first relative relationship information may include either the direction guidance image G6161 or the distance guidance image G6162.

[0147] Here, an example of a method for calculating the first relative positional relationship will be described with reference to Fig. 17 and Fig. 18. Fig. 17 shows a schematic plan view (bird's-eye view) of the first user avatar M1 and the second user avatar M1. Fig. 18 shows a local coordinate system (x1 axis, y1 axis, z1 axis) related to the orientation of the facial features as an explanatory diagram of the orientation φ of the first user avatar M1.

[0148] In this embodiment, the direction α related to the direction guide image G6161 may be calculated based on the following calculation formula, for example. α=φ+θ

[0149]

number

[0150] Furthermore, the orientation φ of the first user avatar M1 may be defined as the orientation of the facial features by the rotation angles around each of the x1, y1, and z1 axes. The variable range of the rotation angles around each of the x1, y1, and z1 axes may be set according to the attributes of a specific feature. Alternatively, as described above, the orientation φ of the first user avatar M1 may be calculated based on the orientation of another feature (for example, the direction of the eyes, i.e., the line of sight).

[0151] The second relative relationship output unit 156 outputs second relative relationship information that indicates or suggests the second relative positional relationship based on the relative positional relationship between the first user avatar M1 and a specific item in the virtual space (hereinafter also referred to as the "second relative positional relationship"). The second relative relationship information may be output via an image for terminal. That is, the second relative relationship information may be in the form of an image included in the image for terminal.

[0152] The relative positional relationship between the first user avatar M1 and a specific item in the virtual space is a concept including a relative distance, a relative orientation, and the like. In this embodiment, the second relative relationship information includes the direction guide image G614 and the distance guide image G615 as described above with reference to FIG. 6. However, in a modified example, the second relative relationship information may include either the direction guide image G614 or the distance guide image G615. A method of calculating the direction and distance related to the direction guide image G614 and the distance guide image G615 may be the same as the method of calculating the first relative positional relationship described above with reference to FIG. 17 and FIG. 18.

[0153] The second determination unit 158 ​​determines whether or not the second predetermined condition is satisfied for each user. The second predetermined condition may be as described above. In this case, the second determination unit 158 ​​may use the position information of the corresponding user avatar M1 in the user database 130 when determining whether or not the second predetermined condition is satisfied. In this case, the first determination unit 146 can calculate the second relative positional relationship based on the position information of each user avatar M1 and the position information (known) of the specific item.

[0154] The movement processing unit 162 changes the position and orientation of each user avatar M1 based on various inputs from each user. The user's input for changing the position and orientation of the user avatar M1 may be various and may be different for each terminal device 20. The position information of the user avatar M1 related to one user may be changed by an operation input of a physical switch such as a specific key (e.g., the "WASD" key), or may be changed by an input indicating the movement of the one user based on a motion capture technology. In addition, the position information of the user avatar M1 related to one user may be specified based on the position of the one user in the real space. For example, when a first user and a second user are located at the same position in the real space, the position information of the first user avatar M1 and the position information of the second user avatar M1 may be set to be the same. Hereinafter, the user input for changing the position information of the user avatar M1 is also referred to as a "movement operation input", and the user input for changing the orientation information of the user avatar M1 is also referred to as a "direction operation input".

[0155] The movement processing unit 162 includes a first movement processing unit 1621 that performs processing related to the movement of the first user avatar M1, and a second movement processing unit 1622 that performs processing related to the movement of the second user avatar M1. Note that the first movement processing unit 1621 and the second movement processing unit 1622 have substantially the same functions except for the user avatar M1 to be processed, and therefore the following mainly describes the first movement processing unit 1621. Therefore, in the following description, the second movement processing unit 1622 will be substantially valid if "first" is read as "second."

[0156] The first movement processing unit 1621 changes the position information and orientation information of the first user avatar M1 in the virtual space based on a movement operation input (an example of a first input) and a direction operation input from the first user acquired by the user input acquisition unit 140. In the present embodiment, as an example, the position information and orientation information of the first user avatar M1 in the virtual space are managed in a coordinate system associated with a real space image forming an image for a terminal. Note that the position information of the first user avatar M1 in the virtual space basically corresponds to the drawing position of the first user avatar M1 in the image generation conditions for the image for a terminal generated by the first image condition generation unit 1441, but does not always need to match. For example, as in the above-mentioned shooting arrangement process, image generation conditions may be generated such that the drawing position of the first user avatar M1 in the image for a terminal changes without changing the position information of the first user avatar M1. The same applies to the orientation information.

[0157] The first movement processing unit 1621 may freely (without limit) change the position information of the first user avatar M1 in the virtual space based on the movement operation input from the first user, but preferably may change the position information of the first user avatar M1 under a predetermined constraint condition. The predetermined constraint condition is arbitrary, but may be set so that, for example, movement that clearly contradicts physical phenomena in the real space (for example, movement that penetrates the wall of a building) is prohibited.

[0158] In addition, the first movement processing unit 1621 may change the predetermined constraint conditions or eliminate the predetermined constraint conditions according to a mode that can be set by an administrative user who manages the virtual space. For example, when an exploration mode is set, the predetermined constraint conditions may be substantially eliminated or may be significantly relaxed.

[0159] In this embodiment, an administrative user who manages the virtual space can set various modes, and the various modes include various mission modes. The various mission modes may include a mission mode for searching for and obtaining a specific item as described above, a mission mode for moving to a specific location, and the like. In this embodiment, the various mission modes include a mission mode for a specific experience or learning, which increases the depth of experience or learning by clearing a plurality of tasks (sub-missions) in sequence (hereinafter also referred to as a "progressive mission mode").

[0160] Fig. 19 is an explanatory diagram of the progressive mission mode. In Fig. 19, the space parts in the virtual space are conceptually shown as pentagonal regions. Each of the space parts SP30 to SP35 is associated with a corresponding task (sub-mission).

[0161] In this case, the user can increase the depth of experience and learning by clearing a plurality of tasks (sub-missions) in order by going around the spaces SP30 to SP35 in a clockwise direction (see arrow R19). In this case, the first movement processing unit 1621 may permit the first user avatar M1 to move to the next space (an example of a second area) when the first user clears a task (an example of a first movement condition) associated with one of the spaces SP30 to SP34 (an example of a first area). Alternatively, the movement to the next space may be in the form of a forced movement, or may be realized in response to an instruction from the user who is permitted to move.

[0162] In the example shown in Figure 19, a progressive mission mode that conceptually rotates is shown as one example, but the progressive mission mode is not limited to rotation and may be realized in a variety of ways, such as a so-called ``sugoroku'' game.

[0163] For example, a progressive mission mode for a trip to France may include sub-missions similar to actual actions, such as a sub-mission to move to Haneda Airport, a sub-mission to exchange money at Haneda Airport, a sub-mission to check in at a check-in counter, a sub-mission to inspect baggage, a sub-mission to pass through customs / immigration, a sub-mission to board an airplane, and a sub-mission to complete immigration procedures in France. In this case, preparations can be made in advance, so it is useful as a pre-experience for children who are going on a trip abroad for the first time. It can also be used to confirm meeting places in advance for school trips, company trips, etc. It can also be used as pre-learning for dispersed actions such as meeting at a station with a complex structure such as a huge station, or for actions alone or in a group.

[0164] Furthermore, the first movement processing unit 1621 moves the first user avatar M1 to a corresponding location based on a movement operation input related to the buttons B605 to B609 for teleportation described above with reference to Fig. 6. Furthermore, when realizing the above-mentioned event E1 (an event for teleporting to a common room or a specific location), the first movement processing unit 1621 may realize a similar teleportation.

[0165] However, when the virtual space is close to the real space by using a real space image as in this embodiment, the range of movement (activity range) of each user avatar M1 may be relatively wide. Therefore, when a plurality of user avatars M1 are acting as a group (group behavior) under certain rules, there is a risk that the situation may become unmanageable. In particular, when a mode such as an exploration mode is set, each user avatar M1 can move freely to various places, so that coordinated behavior (for example, gathering, etc.) may be difficult.

[0166] Therefore, in this embodiment, based on a gathering instruction input (an example of a third input) from an administrative user who manages the virtual space or a specific user of the same type (an example of a predetermined user), the movement processing unit 162 may move each user avatar M1 to a position according to the gathering instruction input. In this case, the specific user may be a user who receives instructions from the administrative user. Also, for example, when a progressive mission mode is set for multiple users who are students, the specific user may be a user who manages the students. In this case, the specific user may be registered in advance.

[0167] The position according to the gathering instruction input may be a predefined position. In this case, a plurality of predefined positions may be prepared, and each predefined position may be the closest position to each user avatar M1. The predefined position may be designated in advance by a specific user or the like. The gathering instruction input may include position information that designates the position according to the gathering instruction input.

[0168] The user avatars M1 to be moved by the movement processing unit 162 may be all user avatars M1 in the same group, or may be limited to some of the user avatars M1 in the same group.

[0169] When a gathering instruction input from a specific user is acquired by the user input acquisition unit 140, the movement processing unit 162 may forcibly move each user avatar M1 to a position (for example, a gathering place) according to the gathering instruction input. Alternatively, the movement processing unit 162 may move each user avatar M1 to a position according to the gathering instruction input based on a response input (approval input) from each user. In this case, the user can refuse, and a configuration with a high degree of freedom can be realized. Note that, as the gathering instruction input, multiple types of inputs including a compulsory gathering instruction input and a refusable gathering instruction input may be prepared. Note that the instruction content related to the gathering instruction input from a specific user may be transmitted in the form of a voice, a message, or the like prior to the forced movement.

[0170] The image data storage unit 172 stores image generation conditions related to the event image data acquired by the image data acquisition unit 1521 described above. The image data storage unit 172 may have a storage area for each user, and in this case, the image generation conditions related to the event image data acquired by the image data acquisition unit 1521 for each user are stored for each user. FIG. 20 is an explanatory diagram of the image generation conditions related to the event image data stored in the image data storage unit 172. FIG. 20 relates to the image generation conditions related to the event image data related to the first user. In the example shown in FIG. 20, the image generation conditions related to the event image data are assigned a location ID, and include camera parameters, avatar information, position information, and date and time information for each location ID. In this case, a URL (Uniform Resource Locator) incorporating the camera parameters, avatar information, position information, and date and time information may be issued for each location ID. When the image generation conditions related to the event image data are stored, the storage capacity can be made more efficient than when the event image data is stored. In addition, in a modified example, instead of storing the image generation conditions related to the event image data, the event image data itself may be stored.

[0171] The location ID is an identifier assigned to each image acquisition event. The camera parameters are information about the first viewpoint during the image acquisition event, and may include, for example, an azimuth angle, an angle of attack, and an angle of view. The avatar information is information about the second user avatar M1 to be drawn in the corresponding event image data. The position information is position information of the real space image related to the acquired event image data. The date and time information indicates the date and time of acquisition of the corresponding event image data.

[0172] Note that access to the image generation conditions related to the event image data in the storage area related to the first user may be possible only for the first user, or may be possible for the second user in the same group, or may be possible for other users. The access right to the image generation conditions related to the event image data in the storage area related to the first user may be appropriately set by the first user. Also, the access right may be set for each event image data.

[0173] In this embodiment, the image data storage unit 172 stores image generation conditions related to the event image data acquired by the image data acquisition unit 1521, but in addition to this, image data acquired at other times or its image generation conditions may also be stored.

[0174] The access to the image generation conditions related to the event image data may be an access for drawing (reproducing) an image related to the event image data. In this case, for example, on a photo reproduction page, a user can view an image related to the event image data related to the image generation conditions based on the accessed image generation conditions. In this case, on the photo reproduction page, the image output unit 212 described later may parse the image generation conditions acquired by the access as query parameters, store them in variables, input them as arguments to a method of "Google Maps API" provided by Google Inc. or an API of the same type, and select avatar information, thereby generating (reproducing) an image related to the event image data.

[0175] (Terminal Device Functions) As shown in FIG. 12, the terminal device 20 includes an image generation condition receiving section 210, an image output section 212, a user input generating section 214, and a user input transmitting section 216.

[0176] The image generating condition receiving unit 210 receives image generating conditions for a terminal image generated by the image condition generating unit 144 of the server device 10 described above.

[0177] The image output unit 212 draws an image for a terminal based on the image generation conditions for an image for a terminal received by the image generation condition receiving unit 210, and outputs the drawn image for a terminal on the display unit 23. For example, the image output unit 212 may parse the image generation conditions for an image for a terminal as a query parameter, store the image in a variable, input the image as an argument to a method of "Google Maps API" provided by Google Inc. or an API of the same type, and select avatar information, thereby drawing the image for a terminal. Note that the server device 10 may generate image data (HTML document + image) based on the image generation conditions, and the terminal device 20 may draw a display screen including a captured image on the display unit 23 based on the image data (HTML document + image) received from the server device 10, without drawing an image directly from the image generation conditions themselves.

[0178] The user input generating unit 214 generates signals according to various inputs input via the input unit 24 described above.

[0179] The user input transmitting unit 216 transmits the signal received by the user input generating unit 214 to the server device 10. In this case, the server device 10 receives such a signal and thereby acquires various inputs by the corresponding user.

[0180] However, the above-mentioned division of functions between the server device 10 and the terminal device 20 is merely an example, and as described above, various changes are possible. That is, some or all of the functions of the server device 10 may be realized by the terminal device 20 as appropriate.

[0181] For example, a sharing mode as shown in Fig. 21 and Fig. 21A may be realized. In this case, the server device 10A and the terminal device 20A of each user cooperate with each other to realize the same functions as those in the case where the server device 10 and the terminal device 20 cooperate with each other as described above. In the case of the sharing mode as shown in Fig. 21 and Fig. 21A, each function of the first determination unit 146, the first image condition generation unit 1441 of the image condition generation unit 144, the event generation unit 152, the first relative relationship output unit 154, and the first movement processing unit 1621 of the movement processing unit 162 can be performed by each browser in the terminal device 20A, as described below.

[0182] In the terminal device 20A as shown in FIG. 21A, for example, when the operation button B602 (see FIG. 6), which is a shutter button, is pressed, it is possible to generate and transmit the image generation conditions at that time to the server device 10, and to draw an image for the terminal image related to a photo (for example, a photo or video taken in a commemorative photo) using data such as avatar position information already received from the server device 10.

[0183] 21, server device 10A includes user database 130, avatar database 132, position information acquisition unit 166, position information transmission unit 167, and data update processing unit 168. Note that position information acquisition unit 166, position information transmission unit 167, and data update processing unit 168 can be realized by a server control unit (see server control unit 13 in FIG. 1) of server device 10A executing one or more programs in a server storage unit (see server storage unit 12 in FIG. 1) of server device 10A.

[0184] The position information acquisition unit 166 acquires the position / orientation information of each user avatar M1 by receiving it from each terminal device 20. When the position information acquisition unit 166 acquires the position / orientation information of each user avatar M1, it updates the stored data in the user database 130. In the user database 130, the position / orientation information for each user avatar ID may be stored as shown in FIG.

[0185] The position information transmission unit 167 transmits the position / orientation information of the user avatar M1 in the user database 130 to the terminal device 20A to which the position / orientation information of one user avatar M1 is to be transmitted. The terminal device 20A to which the position / orientation information of one user avatar M1 is to be transmitted includes the terminal device 20A of the user related to the other user avatar M1 belonging to the same group as the one user avatar M1. In this way, the terminal device 20A related to each user in the same group can obtain the position / orientation information of each user avatar M1 related to the other users. In this case, the position / orientation information of unnecessary user avatars M1 that are not to be drawn is not transmitted, and the communication load can be reduced.

[0186] The data update processing unit 168 transmits update data to the terminal device 20A of each user based on the data in the user database 130 and the avatar database 132. The timing of transmitting the update data may be set appropriately, and may include timing in response to a request from the terminal device 20A.

[0187] The terminal device 20A shown in FIG. 21A is suitable for a case where the virtual reality application is in the form of a Web application that can be used on a browser. The terminal device 20A includes an image output unit 212A, a user input generation unit 214A, and a user input transmission unit 216A. The image output unit 212A, the user input generation unit 214A, and the user input transmission unit 216A may be substantially similar to the image output unit 212, the user input generation unit 214, and the user input transmission unit 216 described above with reference to FIG. 12. The image output unit 212A draws an image for a terminal based on image generation conditions for an image for a terminal generated by a first image condition generation unit 2441A described later, and outputs the drawn image for a terminal on the display unit 23 described above.

[0188] Furthermore, in the example shown in FIG. 21A, the terminal device 20A includes a position information update unit 241A, a position management unit 242A, a first image condition generation unit 2441A, a first movement processing unit 2621A, a first judgment unit 246A, an interface formation unit 248A, a preparation processing unit 250A, an event generation unit 252A, a first relative relationship output unit 254A, a second relative relationship output unit 256A, a second judgment unit 258A, and a terminal memory unit 22A.

[0189] Although the terminal device 20A related to the first user will be described below, the terminal device 20A related to the second user is substantially the same.

[0190] Each part from the position information update part 241A to the second determination part 258A can be realized by the terminal control part (see the terminal control part 25 in FIG. 1) of the terminal device 20A executing the virtual reality application according to this embodiment, which is a program in the terminal storage part (see the terminal storage part 22 in FIG. 1) of the terminal device 20A. In addition, temporary storage of various data required in the terminal device 20A can be realized by the RAM (Random Access Memory) 221A of the terminal storage part 22A. Various data is loaded in the RAM 221A as a temporary storage function, and for example, various data is downloaded based on an HTML document created in the server device 10A, and the data is temporarily loaded in the RAM 221A and used for processing (drawing, etc.) in the browser. When the browser is closed, the data loaded in the RAM 221A is erased.

[0191] The RAM 221A may store only data related to each user avatar M1 belonging to the same group as the first user avatar M1, among the data in the user database 130 of the server device 10 described above (see FIG. 13), or may further store other data. Among the data in the RAM 221A, the data on the position / orientation information is updated by the position information update unit 241A based on the position / orientation information transmitted from the server device 10A. Note that the other data in the RAM 221A may be updated based on the above-mentioned update data as appropriate through communication with the server device 10A (for example, when the virtual reality application according to this embodiment is started, etc.).

[0192] The RAM 221A may store only the data related to each user avatar M1 belonging to the same group as the first user avatar M1, among the data in the avatar database 132 of the server device 10 described above (see FIG. 14), or may further store other data. The data in the RAM 221A may be updated based on the above-mentioned update data via communication with the server device 10A when a virtual reality application (e.g., a Web application) is started, etc.

[0193] As described above, the position information update unit 241A updates the position / orientation information data among the data in the RAM 221A based on the data received from the server device 10A. Furthermore, the position information update unit 241A may update the position / orientation information data related to the first user among the data in the RAM 221A based on a movement operation input or a direction operation input from the first user.

[0194] The position management unit 242A realizes a function similar to that of the position management unit 142 of the server device 10 described above. However, the arrangement of each user avatar M1 may be performed only for the user avatars M1 in the same group as the first user avatar M1, or may be performed for the other user avatars M1.

[0195] The first image condition generating unit 2441A realizes a function similar to that of the first image condition generating unit 1441 of the above-mentioned server device 10. The first image condition generating unit 2441A may transmit the generated image generating conditions to the server device 10A. In this case, the image generating conditions can also be stored on the server device 10A side.

[0196] The first movement processing unit 2621A realizes a function similar to that of the first movement processing unit 1621 of the server device 10 described above.

[0197] The first determination unit 246A realizes a function similar to that of the first determination unit 146 of the above-described server device 10. However, the first determination unit 246A determines whether or not the first user avatar M1 satisfies a first predetermined condition.

[0198] The interface forming unit 248A realizes the same functions as the interface forming unit 148 of the above-mentioned server device 10. However, the interface forming unit 148 performs processing related to the terminal image for the first user.

[0199] The preparation processing unit 250A realizes the same function as the preparation processing unit 150 of the above-mentioned server device 10. However, the preparation processing unit 250A executes the above-mentioned preparation process for the first user avatar M1 (i.e., based on the determination result by the first determination unit 246A) when a first predetermined condition is satisfied.

[0200] The event generating unit 252A realizes the same function as the event generating unit 152 of the above-mentioned server device 10. However, the event generating unit 252A generates an event for the first user avatar M1. The event generating unit 252A includes an image data acquiring unit 2521A and a various event generating unit 2522A.

[0201] The first relative relationship output unit 254A realizes a function similar to that of the first relative relationship output unit 154 of the above-described server device 10. However, the first relative relationship output unit 254A outputs the first relative relationship based on the first user avatar M1.

[0202] The second relative relationship output unit 256A realizes a function similar to that of the second relative relationship output unit 156 of the above-described server device 10. However, the second relative relationship output unit 256A outputs the second relative relationship based on the first user avatar M1.

[0203] The second determination unit 258A realizes a function similar to that of the second determination unit 158 ​​of the above-described server device 10. However, the second determination unit 258A determines whether or not the first user avatar M1 satisfies a second predetermined condition.

[0204] The RAM 221A realizes the same function as the image data storage unit 172 of the server device 10 described above. However, the RAM 221A stores image generation conditions related to the event image data acquired by the image data acquisition unit 2521A. In this case, too, on the photo reproduction page, the image output unit 212A may parse the image generation conditions acquired by the access as query parameters, store them in variables, input them as arguments to a method of "Google Maps API" provided by Google Inc. or an API of the same kind, and perform selection of avatar information, etc., thereby generating (reproducing) an image related to the event image data.

[0205] Fig. 21B is a functional block diagram of a terminal device 20B that may be realized instead of the terminal device 20A shown in Fig. 21A. The configuration according to Fig. 21B is suitable for a case where the virtual reality application is in the form of a native application different from a Web application that can be used on a browser. Note that the native application is downloaded to the terminal device 20B in advance and used.

[0206] In the example shown in Fig. 21B, the terminal device 20B includes an image output unit 212B, a user input generation unit 214B, and a user input transmission unit 216B. The image output unit 212B, the user input generation unit 214B, and the user input transmission unit 216B may be substantially similar to the image output unit 212, the user input generation unit 214, and the user input transmission unit 216 described above with reference to Fig. 12. Note that the image output unit 212B draws an image for a terminal based on image generation conditions for an image for a terminal generated by a first image condition generation unit 2441B described later, and outputs the drawn image for a terminal on the display unit 23 described above.

[0207] Furthermore, in the example shown in FIG. 21B, terminal device 20B includes a user database 230B, an avatar database 232B, a position information update unit 241B, a position management unit 242B, a first image condition generation unit 2441B, a first movement processing unit 2621B, a first judgment unit 246B, an interface formation unit 248B, a preparation processing unit 250B, an event generation unit 252B, a first relative relationship output unit 254B, a second relative relationship output unit 256B, a second judgment unit 258B, and an image data storage unit 272B.

[0208] Although the terminal device 20B related to the first user will be described below, the terminal device 20B related to the second user is substantially the same.

[0209] Each of the units from the position information update unit 241B to the second determination unit 258B can be realized by the terminal control unit (see the terminal control unit 25 in FIG. 1) of the terminal device 20B executing the virtual reality application according to this embodiment, which is a program in the terminal storage unit (see the terminal storage unit 22 in FIG. 1) of the terminal device 20B. Also, the user database 230B, the avatar database 232B, and the image data storage unit 272B can be realized by the terminal storage unit (see the terminal storage unit 22 in FIG. 1) of the terminal device 20B.

[0210] The user database 230B may store only data related to each user avatar M1 belonging to the same group as the first user avatar M1 among the data in the user database 130 of the server device 10 described above (see FIG. 13), or may further store other data. Among the data in the user database 230B, the data of the position / orientation information is updated by the position information update unit 241B based on the position / orientation information transmitted from the server device 10A. Note that the other data among the data in the user database 230B may be appropriately updated based on the above-mentioned update data through communication with the server device 10A (for example, when the virtual reality application according to the present embodiment is started, etc.).

[0211] The avatar database 232B may store only the data related to each user avatar M1 belonging to the same group as the first user avatar M1, among the data in the avatar database 132 of the server device 10 described above (see FIG. 14), or may store other data in addition. The data in the avatar database 232B may be updated based on the above-mentioned update data via communication with the server device 10A when a group is generated or when the configuration of the user avatar M1 forming the group is changed.

[0212] As described above, the position information update unit 241B updates the position / orientation information data among the data in the user database 230B based on the data received from the server device 10A. Furthermore, the position information update unit 241B may update the position / orientation information data related to the first user among the data in the user database 230B based on a movement operation input or a direction operation input from the first user.

[0213] The position management unit 242B realizes a function similar to that of the position management unit 142 of the server device 10 described above. However, the arrangement of each user avatar M1 may be performed only for the user avatars M1 in the same group as the first user avatar M1, or may be performed for the other user avatars M1.

[0214] The first image condition generating unit 2441B realizes a function similar to that of the first image condition generating unit 1441 of the above-mentioned server device 10. The first image condition generating unit 2441B may transmit the generated image generating conditions to the server device 10A. In this case, the image generating conditions can also be stored on the server device 10A side.

[0215] The first movement processing unit 2621B realizes a function similar to that of the first movement processing unit 1621 of the server device 10 described above.

[0216] The first determination unit 246B realizes a function similar to that of the above-described first determination unit 146 of the server device 10. However, the first determination unit 246B determines whether or not the first user avatar M1 satisfies a first predetermined condition.

[0217] The interface forming unit 248B realizes the same function as the interface forming unit 148 of the above-mentioned server device 10. However, the interface forming unit 148 performs processing related to the terminal image for the first user.

[0218] The preparation processing unit 250B realizes the same function as the preparation processing unit 150 of the above-mentioned server device 10. However, the preparation processing unit 250B executes the above-mentioned preparation process for the first user avatar M1 (i.e., based on the determination result by the first determination unit 246B) when a first predetermined condition is satisfied.

[0219] The event generation unit 252B realizes the same function as the event generation unit 152 of the above-mentioned server device 10. However, the event generation unit 252B generates an event for the first user avatar M1. The event generation unit 252B includes an image data acquisition unit 2521B and a various event generation unit 2522B.

[0220] The first relative relationship output unit 254B realizes a function similar to that of the above-described first relative relationship output unit 154 of the server device 10. However, the first relative relationship output unit 254B outputs the first relative relationship based on the first user avatar M1.

[0221] The second relative relationship output unit 256B realizes a function similar to that of the second relative relationship output unit 156 of the above-described server device 10. However, the second relative relationship output unit 256B outputs the second relative relationship based on the first user avatar M1.

[0222] The second determination unit 258B realizes a function similar to that of the second determination unit 158 ​​of the above-described server device 10. However, the second determination unit 258B determines whether or not the first user avatar M1 satisfies a second predetermined condition.

[0223] The image data storage unit 272B realizes the same function as the image data storage unit 172 of the server device 10 described above. However, the image data storage unit 272B stores image generation conditions related to the event image data acquired by the image data acquisition unit 2521B. In this case, too, on the photo reproduction page, the image output unit 212B may parse the image generation conditions acquired by the access as query parameters, store them in variables, input them as arguments to a method of "Google Maps BPI" provided by Google or a similar BPI, and select avatar information, thereby generating (reproducing) an image related to the event image data.

[0224] Also, a sharing mode as shown in Fig. 22 and Fig. 22A may be realized. In this case, the server device 10C and the terminal device 20C of each user cooperate with each other to realize the same function as that in the case where the server device 10 and the terminal device 20 cooperate with each other.

[0225] The server device 10C shown in FIG. 22 differs from the server device 10 shown in FIG. 11 in that a terminal image drawing unit 164 and a terminal image data transmission unit 165 are added.

[0226] The terminal image drawing unit 164 draws the terminal image based on the image generation conditions for the terminal image received by the image condition generating unit 144. For example, the image output unit 212 may draw the terminal image by parsing the image generation conditions for the terminal image as query parameters, storing them in variables, inputting them as arguments to a method of "Google Maps API" provided by Google Inc. or an API of the same kind, and selecting avatar information.

[0227] The terminal image data transmission unit 165 transmits image data for the terminal image drawn by the terminal image drawing unit 164 to the corresponding terminal device 20C.

[0228] Terminal device 20C shown in FIG. 22A differs from terminal device 20 shown in FIG. 12 in that image generation condition receiving section 210 and image output section 212 are replaced with image data receiving section 211 and image output section 212C, respectively.

[0229] The image data receiving unit 211 receives image data for a terminal image transmitted by the terminal image data transmitting unit 165 .

[0230] The image output unit 212C outputs the data of the image for the terminal received by the image data receiving unit 211 onto the display unit 23 described above.

[0231] Next, some examples of the operation of the virtual reality generation system 1 will be described with reference to FIGS.

[0232] FIG. 23 is a timing chart showing an outline of an example of the operation of the virtual reality generation system 1 with respect to the occurrence of an image capture event.

[0233] In Fig. 23, three terminal devices 20 are shown as operating subjects: a terminal device 20-1 related to a first user, a terminal device 20-2 related to a second user, and a server device 10. For the sake of explanation, the second user is one person here, but there may be multiple people. In this case, the terminal devices 20 related to the multiple second users each operate in the same manner. This is also the case with Fig. 24 described later.

[0234] First, the first user and the second user launch the virtual reality application according to this embodiment (referred to as "virtual reality app" in FIG. 23) (step S230) and perform various initial inputs. The timing for launching the virtual reality app may be, for example, the same time period, or may be determined in advance by contact or the like. For example, the first user and the second user may communicate in advance by email or the like, and the time period may be determined after adjusting the schedule. The initial inputs may include input of a group name, a user name, etc., and input for determining each user avatar M1. In this case, the first user and the second user are considered to belong to the same group.

[0235] Next, the first user and the second user may move in the virtual space via their respective user avatars M1 (step S231). In the virtual space in which the user avatars M1 of the first user and the second user move, the server device 10 monitors whether the first predetermined condition is met (step S232). Here, only two user avatars M1, the first user avatar M1 and one second user avatar M1, exist in the target virtual space. In this case, the server device 10 calculates a common first relative positional relationship for the two and outputs first relative relationship information, while monitoring whether the first predetermined condition is met. However, when the first user avatar M1 and multiple second user avatars M1 exist, the server device 10 monitors whether the first predetermined condition is met for each user avatar M1, using one user avatar M1 as a reference, as described above.

[0236] When the first predetermined condition is satisfied, the operation button B602 (see FIG. 6) which is a shutter button is activated (operable state) as a preparation process (steps S233 and S234). Then, when the operation button B602 is operated by the first user (step S235), the server device 10 transmits a shutter sound generation instruction to the terminal devices 20 related to all user avatars M1 around the first user avatar M1 (step S235A) and generates an image acquisition event for the first user (step S236). Also, when the operation button B602 is operated by the second user (step S237), the server device 10 transmits a shutter sound generation instruction to the terminal devices 20 related to all user avatars M1 around the second user avatar M1 (step S237A) and generates an image acquisition event for the second user (step S238). In this case, the image generation conditions for the event image data acquired in the image acquisition event on the first user side (step S236) and the image generation conditions for the event image data acquired in the image acquisition event on the second user side (step S238) may differ due to the difference between the first and second viewpoints. In addition, the poses and the like may also be different. In this case, the exchange of event image data between the first and second users is promoted, and interaction between the users can be promoted. However, in a modified example, the image generation conditions for the event image data acquired in the image acquisition event on the first user side (step S236) and the image generation conditions for the event image data acquired in the image acquisition event on the second user side (step S238) may be substantially the same. In this case, the processing load of the server device 10 can be reduced.

[0237] Here, in regard to steps S235A and S237A, the terminal device 20 that has received the shutter sound generation instruction outputs (plays) audio information that imitates the shutter sound of a camera. In this case, the user of the terminal device 20 can learn about image capture events held by other users. This can promote the activation of image capture events at the location.

[0238] Fig. 24 is a timing chart showing an example of the operation of the virtual reality generation system 1 with respect to the occurrence of an item acquisition event. Fig. 24 shows three terminal devices 20 as the operating subjects, that is, a terminal device 20-1 related to a first user, a terminal device 20-2 related to a second user, a terminal device 20-3 related to an administrative user, and the server device 10.

[0239] First, the first user and the second user launch the virtual reality application according to this embodiment (referred to as "virtual reality app" in FIG. 24) and perform various initial inputs. The timing for launching the virtual reality app may be, for example, the same time period, or may be determined in advance by contact or the like. For example, when the first user and the second user participate in an event hosted by the administrative user, the time period may be notified to them in advance by the administrative user. The initial input may include input of a group name, a user name, and the like. Furthermore, when the first user and the second user participate in an event hosted by the administrative user, the initial input may include input of information identifying the event and information indicating eligibility to participate.

[0240] First, the administrative user sets the mission mode via the terminal device 20-3 (step S240). The administrative user may also be able to act in the virtual space via his / her own user avatar M1. The contents of the mission mode may be configured in advance by the administrative user. The server device 10 notifies each user of a mission corresponding to the started mission mode (step S241), and the mission is started (step S242). The mission may be, for example, a search-type mission in which a specific item (acquisition target item) such as a flamingo egg as described above is searched for and acquired, or a learning-type mission in which a virtual reality medium (for example, completion information) corresponding to the specific item is acquired by viewing specific content and submitting an assignment. Here, it is assumed that the mission is a search-type mission in which a specific item is searched for and acquired.

[0241] Next, the first user and the second user may move in the virtual space via their respective user avatars M1 (step S243). In the virtual space in which the respective user avatars M1 of the first user and the second user move, the server device 10 places a specific item and monitors whether or not a second predetermined condition is met (step S244). In this case, the server device 10 calculates a second relative positional relationship with respect to the common specific item for each user avatar M1 and outputs second relative relationship information while monitoring whether or not the second predetermined condition is met.

[0242] When the second predetermined condition is satisfied, the server device 10 generates an item acquisition event for the user avatar M1 who has satisfied the second predetermined condition (step S245). After that, the administrative user generates a gathering instruction input via the terminal device 20-3 as appropriate (step S246). In this case, for example, each user avatar M1 is forcibly moved to a corresponding predetermined gathering place in response to the gathering instruction input (step S247). Note that, instead of being forcibly moved, as described above, the user avatars M1 may be forcibly moved to the corresponding predetermined gathering place based on a response input (approval input) from each user. Then, when the mission completion condition is satisfied (step S248), the server device 10 ends the mission (step S249). Note that the mission completion condition is arbitrary and may be set based on, for example, an elapsed time or the like.

[0243] Next, modifications of the above-described embodiment will be described with reference to FIG. 25 onwards.

[0244] Fig. 25 is a functional block diagram of a server device 10B according to a modified example. Fig. 26 is an explanatory diagram of data in the advertisement information storage unit 176.

[0245] Compared to the server device 10 described above with reference to FIG. 11, the server device 10B according to this modified example includes an event history memory unit 174, a movement history memory unit 175, an advertisement information memory unit 176, an image evaluation unit 180, a popularity point detection unit 181, a photography prohibition point setting unit 182, an interaction promotion processing unit 183, an avatar detection unit 184, an application collaboration processing unit 185, a shutter sound generation unit 186, a user score calculation unit 187, an incentive granting unit 188, an advertisement setting unit 189, an advertisement evaluation unit 190, and an image processing unit 192.

[0246] In a further modification to this modification, some of the functions of the server device 10 described above with reference to FIG. 11 may be omitted, and some of the image processing unit 192 may be omitted from the event history storage unit 174.

[0247] The event history storage unit 174 stores the history of various events that occurred at each coordinate in the virtual space. The granularity of each coordinate for recording the event history is arbitrary, and may be, for example, a facility unit. Alternatively, the granularity of the coordinate for recording the event history may be set according to the attributes of the location. Various events to be stored in the history may be the image acquisition events described above. The history data of various events in the event history storage unit 174 may be output (displayed) for a specific user as appropriate. The history data of various events in the event history storage unit 174 may be used as big data or collective intelligence.

[0248] The movement history storage unit 175 stores movement history data (history data related to movement in the virtual space) of each user avatar M1. The movement history data of each user avatar M1 may include information such as coordinate trajectory related to movement, date and time, and stop time (stay time). In addition, history data of orientation information of each user avatar M1 may also be stored in association with the movement history data of each user avatar M1. In this case, information such as the line of sight direction of each user avatar M1 at each coordinate can be obtained.

[0249] The advertisement information storage unit 176 stores various information related to advertisements placed as virtual reality media in the virtual space (hereinafter referred to as "advertisement information"). In the example shown in Fig. 26, each advertisement ID is associated with various related information such as information identifying an advertiser (advertiser ID), advertisement content, advertisement position information, advertisement period, and performance information.

[0250] The advertisement contents may be in the form of an image or video, an advertising avatar active in a virtual space, or an AR item such as an AR (Augmented Reality) signboard. The advertisement may also be realized in the form of an event in a virtual space. In either case, the advertisement contents may be set based on information provided by the advertiser. The position information of the advertisement may be set in a coordinate system associated with a real-space image. In addition, when the advertisement contents are in the form of an advertising avatar, the position information of the advertisement may be dynamically updated as the position information of the advertising avatar. The advertisement period is a period that is determined in advance according to a contract or the like. The performance information is information that indicates the performance of the advertisement. The performance information may include index values ​​that are widely known in the field of advertising (e.g., CPI: Cost Per Install, CPA: Cost Per Acquisition, CTR: Click Through Rate) and the like (e.g., CPA: Cost Per Action, CPC: Cost Per Click, CPM: Cost Per Mille).

[0251] The image evaluation unit 180 evaluates / analyzes the image data acquired by each user or the image generation conditions thereof (for example, the image generation conditions related to the event image data acquired by the above-mentioned image acquisition event). In this case, the image evaluation unit 180 may digitize the number of times the image is captured for each coordinate, the number of user avatars M1 included in the image for each coordinate, etc.

[0252] Furthermore, the image evaluation unit 180 may detect a rare event when an unusual object or user avatar M1 (e.g., a celebrity user avatar M1) is captured in image data of the same location. Furthermore, the image evaluation unit 180 may generate information for identifying the user who captured the image (hereinafter, also referred to as the "first image capturing user") for a location where an image was captured for the first time.

[0253] Furthermore, the image evaluation unit 180 may generate various information in a manner that replaces the user's photographing action (operation of the operation button B602 (see FIG. 6) which is a shutter button) with a "vending machine" in the virtual space. For example, in regard to an apparel store selling avatar items, it may record how the user avatar / user photographed or purchased an item, in which store, and how attractive the item was. In this case, such information may be shared between users by the interaction promotion processing unit 183 described later.

[0254] The popularity point detection unit 181 detects popularity points (e.g. photogenic points) in the virtual space. Popularity points are, for example, places that are frequently visited by each user avatar M1, and may be detected based on movement history data of each user avatar M1. Also, popularity points may be detected based on history data of various events in the event history storage unit 174. In this case, a place may be evaluated as being more popular as the number of occurrences of image acquisition events increases.

[0255] The popularity point detection unit 181 may detect the popular gaze direction at the popularity point by evaluating the gaze direction of each user avatar M1. The gaze direction of each user avatar M1 may be evaluated based on the history data of the above-mentioned orientation information. In this case, an object or a place to which the gaze of each user avatar M1 is directed more frequently may be evaluated as a more popular object or place.

[0256] In this way, the popularity points detected by the popularity point detection unit 181 can be used in various ways. For example, the popularity points may be ranked according to the degree of popularity, and the rank of each popularity point may be communicated to the user in various ways. For example, the rank of each popularity point may be displayed as a predetermined number of the top popularity points as popularity ranking information. Also, popular spots that are increasing in popularity may be picked up. Also, popular points with high rankings may be presented to each user as recommended information. In this case, for example, any of the above-mentioned buttons B605 to B609 for teleportation may be the destination of the presented popularity point (place), and teleportation to the popular spot may be possible. Also, the popular spots presented to each user as recommended information may be extracted for each user based on the attributes, preferences, etc. of each user. For example, the popular spots presented to one user may include popular spots that are often visited by other users who behave similarly to the one user.

[0257] The photography prohibited point setting unit 182 sets prohibited points for an image acquisition event and / or prohibited points for normal photography. At prohibited points for an image acquisition event, the operation button B602 (see FIG. 6), which is a shutter button, may be deactivated or hidden. The photography prohibited point setting unit 182 may automatically set prohibited points from the viewpoint of confidentiality, privacy, etc., or may set prohibited points according to an input from an administrative user.

[0258] When a predetermined transmission condition is satisfied, the exchange promotion processing unit 183 transmits an image (event image data in FIG. 20 or its image generation condition, etc.) acquired by the user of one user avatar M1 through the operation of the operation button B602 (see FIG. 6) to another user (for example, a user of friend information). The predetermined transmission condition is arbitrary and may be set appropriately by each user. In this case, the exchange promotion processing unit 183 may generate a two-dimensional code such as a QR code (registered trademark) so that other users can access the corresponding image or the acquisition position (location) of the image. In addition, in this case, the exchange promotion processing unit 183 may form a user interface that allows the user avatar M1 of another user to teleport to the acquisition location of the image via the interface formation unit 148. In this case, various exchanges between users can be effectively promoted, such as introducing a good photography spot to a friend user, or taking a photo with a friend and his / her user avatar M1.

[0259] When the avatar detection unit 184 detects the movement of one user avatar M1 to a specific detection target location, the avatar detection unit 184 generates a notification (hereinafter, also referred to as a "detection notification") that one user avatar M1 has been detected in the specific detection target location. For example, the avatar detection unit 184 may generate a detection notification when one user avatar M1 enters the angle of view of a virtual camera installed in the specific detection target location. The detection notification may include information (user avatar ID) that identifies the detected user avatar M1. In addition, the avatar detection unit 184 may include image data of the detected user avatar M1 captured by the virtual camera in the detection notification. The destination (notification destination) of the detection notification may be set for each specific detection target location. The specific detection target location may be set by an administrative user or a specific user. For example, the administrative user may set a restricted area or the like as a specific detection target location. In this case, the destination (notification destination) of the detection notification may include the administrative user who set the specific detection target location.

[0260] Furthermore, when the gaze of one user avatar M1 is directed to a specific detection target object, the avatar detection unit 184 generates a notification to that effect (hereinafter also referred to as a "gaze detection notification to a specific detection target object"). Whether or not the gaze of one user avatar M1 is directed to a specific detection target object may be determined in real time based on the orientation information of each user avatar M1 and the position information of the specific detection target object, or may be determined offline based on the history data of the orientation information described above. The destination (notification destination) of the gaze detection notification to a specific detection target object may be set in the same manner as the specific detection target location described above.

[0261] When the operation button B602 (see FIG. 6), which is a shutter button, is operated by a user at a location in the virtual space, the shutter sound generating unit 186 outputs information (referred to as "image capture event occurrence information") notifying a user (other user different from the user) associated with another user avatar M1 located at the location that the shutter button has been operated. The image capture event occurrence information may be output via audio information such as a shutter sound. For example, a shutter sound generation instruction (see steps S235A and 237A in FIG. 23) may be transmitted to the terminal device 20 associated with the other user to output (play) the shutter sound. In this case, it is possible to physically and indirectly convey to the other users that "this place is a place worth taking a photo at". In such a configuration, there is a high possibility that the shutter sound will be heard a lot at popular points. This allows each user to auditorily grasp each popular point in the virtual space.

[0262] The user score calculation unit 187 calculates various scores associated with each user (or each user avatar M1). The various scores may include a score that is an index of the degree of activity in the virtual space. Furthermore, the user score calculation unit 187 may give a special score (bonus score) to the user who caused the rare event and / or the first image capturing user, based on the evaluation result by the image evaluation unit 180. Alternatively, in an event such as a photo session, a score may be given to each participating user based on a photo (an image acquired via the operation button B602) acquired by each participating user. In this case, the arrangement (composition) of objects in the photo, etc. may be evaluated.

[0263] When the incentive granting condition is satisfied, the incentive granting unit 188 grants an incentive to each user avatar M1 (or each user) active in the virtual space. The incentive granting condition may be determined for each user avatar M1 (or each user). The incentive granting condition may also be granted for each incentive or for each attribute of the incentive. For example, the incentive may be the right to name a famous point. In this case, the right to name may be granted to the user avatar M1 that arrives at the famous point first or the user (user that operates the operation button B602) that takes a photo at the famous point first. In this case, the incentive may be granted each time a new famous point is generated.

[0264] Furthermore, the incentive granting unit 188 may grant a specific incentive (for example, proof information that the point is the first to capture an image) to the user who has caused the above-mentioned rare event and / or the above-mentioned first image capturing user, similarly to or instead of the user score calculation unit 187. Furthermore, the incentive granting unit 188 may grant a specific incentive to a user whose score granted by the user score calculation unit 187 exceeds a threshold value.

[0265] The advertisement setting unit 189 sets an advertisement in the virtual space. When setting an advertisement, the advertisement setting unit 189 may assign a new advertisement ID and update the data in the advertisement information storage unit 176 (see FIG. 26).

[0266] The advertisement content related to the advertisement set by the advertisement setting unit 189 in this manner is presented to a user (user avatar M1) for whom a predetermined presentation condition is satisfied during the advertisement period. The presentation of the advertisement content may be realized by the image condition generating unit 144 generating image generation conditions in a manner in which the advertisement content is included in the terminal image for each user described above. In this case, the image condition generating unit 144 may superimpose an image or video of the advertisement content on the real space image in a manner. For example, the first image condition generating unit 1441 determines whether or not the position information of one advertisement is located within the field of view of the first user avatar M1 based on the relationship between the position / orientation information of the first user avatar M1 and the position information of the one advertisement. Then, when the position information of the one advertisement is located within the field of view of the first user avatar M1, the first image condition generating unit 1441 may generate image generation conditions for drawing the corresponding advertisement content on the terminal image related to the first user.

[0267] The predetermined presentation condition is arbitrary, but a target demographic may be set for each advertisement ID. In this case, one advertisement content may be presented only to a user (user avatar M1) who matches the target demographic associated with the one advertisement content. In addition, if the advertisement content is an AR item, the predetermined presentation condition may be presented only to a user avatar M1 who has a tool that makes the AR item visible (for example, a smartphone as a virtual reality medium).

[0268] The advertisement setting unit 189 may set the cost required for the advertisement (the cost borne by the advertiser) according to the position information of the advertisement. In this case, the advertisement setting unit 189 may set the cost according to the position information of the advertisement in such a manner that the cost is high at the popular point detected by the popular point detection unit 181. For example, since many people like to take pictures in a place such as in front of Hachiko in Shibuya, the cost is relatively high when an advertisement is set in such a place.

[0269] The advertisement evaluation unit 190 generates the above-mentioned performance information for each advertisement ID. For example, for one advertisement ID, the advertisement evaluation unit 190 may use, as evaluation materials, the number of times the user avatar M1 has directed its gaze at the corresponding advertisement content (i.e., the number of users related to the terminal image on which the advertisement content is drawn), the accumulated value of the time the avatar M1 has directed its gaze, the number of times the advertisement content appears in image data due to an image acquisition event, etc. Furthermore, the advertisement evaluation unit 190 may set this on signboards in the real space and on signboards in the virtual space to measure the advertisement effectiveness. This also applies to advertisements other than signboards.

[0270] The result information generated by the advertisement evaluation unit 190 in this manner may be used to calculate the advertising cost in the real space, or may be used to calculate the price of land (real estate transactions, etc.). This also applies to the detection result by the popularity point detection unit 181 described above. The result information generated by the advertisement evaluation unit 190 may also be used to set a real advertisement in the real space. For example, if the result shown in the result information in one location related to one advertisement ID is relatively high, the corresponding advertisement may be displayed on a digital signage or the like in the real space. In this manner, the advertisement in the virtual space may be set as the main advertisement and the advertisement in the real space as the secondary advertisement, and the advertisement in the real space may be set in conjunction with the result information of the advertisement in the virtual space.

[0271] The performance information thus generated by the advertisement evaluation unit 190 may be reflected in the price of each area (including the space) in the corresponding virtual space. This is preferable when various transactions (sales, rental, etc.) of land (areas) are carried out in the virtual space.

[0272] The image processing unit 192 performs various processing processes on the image generation conditions related to the image data in the image data storage unit 172 and associated with the user, in response to a request from the corresponding user. The various processing processes are arbitrary, but may include, for example, a process of embedding a two-dimensional code such as the above-mentioned QR code (registered trademark) for communication. The various processing processes may also include a process of linking information based on the real space to an image or a URL, such as "taken at Roppongi Hills on N month, N day, NN time". The various processing processes may also include a process of embedding rights information such as copyright. A part or all of the various processing processes may be realized automatically, regardless of a request from the corresponding user. A part or all of the contents of the various processing processes may be set (customized) by the user in advance.

[0273] The various processing processes may include an automatic generation process of interior viewing photos for real estate transactions. In this case, the automatic generation process of interior viewing photos may include a process of removing only other user avatars from photos and videos that the user avatar M1 has visited and that show the places where people want to live or buy.

[0274] By the way, traditional real estate photography of real space is required to have the function of giving the impression of beauty or of the property being larger and cleaner than it actually is, so that customers such as renters / buyers will be interested and inquire with real estate agents. Specifically, images taken with a wide-angle lens are sometimes displayed that make the property appear wider than the actual human field of vision. In addition, the view from the window and the direction of the camera are sometimes photographed and generated at the photographer's discretion.

[0275] In contrast to this, in the case of real estate photos using the automatic generation process of the image processing unit 192 according to this modified example, unlike images taken with a simple 360-degree camera, it is possible to compare the size of actual people (narrow / wide, high / low ceiling, etc.) and simulate the case where multiple users are in the same space. In other words, since the user avatar M1 can reflect the size of an actual person, the reality of the sense of spaciousness increases. In addition, it is possible to save the viewpoints of other users (points of interest, high / low evaluations, etc.). This is in contrast to general 360-degree images in which the angle of view and direction of interest of others are not saved. In addition, real estate sellers can record data such as "other users were interested in this point." In this way, images related to the image generation conditions in the image data storage unit 172 can be used as shots with high marketability on the name screen, but here, by displaying the user avatar M1 removed, a photo or video suitable for real estate transactions can be obtained. Note that the terminal image is based on a real space image as described above, and the display / non-display of the user avatar can be dynamically controlled by synthesizing the images on JavaScript (registered trademark) as described above.

[0276] 27 is a functional block diagram of a terminal device 20B according to a modified example. The terminal device 20B according to this modified example differs from the terminal device 20 described above with reference to FIG.

[0277] The application linking processing unit 285 links the virtual reality application according to this embodiment with other GPS-using applications and notifications in the terminal device 20B. The GPS-using application refers to an application that uses the location information of the GPS function built into the terminal device 20B, and the type of the application is arbitrary. For example, if a GPS-using application that generates a specific notification at a specific location in the real space is implemented in the terminal device 20B related to the first user, when the first user avatar M1 is located at a corresponding specific location in the virtual space, a specific notification may be generated via the GPS-using application.

[0278] Furthermore, the application linking processor 285 may link the position information of the first user avatar M1 in the virtual space based on the movement history of the first user in the real space (the history of the position information of the GPS function built into the terminal device 20B). For example, the position information of the first user avatar M1 in the virtual space may be changed based on the movement history of the first user in the real space from M o'clock to L o'clock on M month, M day. In this case, the first user can look back on his experience in the real space from M o'clock to L o'clock on M month, M day, in the virtual space via the first user avatar M1.

[0279] As described above with reference to Fig. 21 and Fig. 21A for the server device 10 and the terminal device 20, the allocation of functions between the server device 10B and the terminal device 20B according to this modification can be changed in various ways. For example, a part of the components from the event history storage unit 174 to the image processing unit 192 may be realized by the terminal device 20B.

[0280] Although the embodiments have been described in detail above with reference to the drawings, the specific configurations are not limited to the various embodiments described above, and also include designs within the scope of the gist of the present invention.

[0281] For example, in the above-described embodiment, an image obtained by the occurrence of the above-described event (e.g., a photograph or video taken in a commemorative photo) may be made circulatable as an NFT.

[0282] In addition, the following supplementary notes are disclosed regarding the above-described embodiments of the present invention (corresponding to the original claims of the original application).

[0283] [Appendix 1] a position management unit that positions a first display medium associated with a first user and a second display medium associated with a second user in a virtual space; an input acquisition unit that acquires various inputs from each user; a first image condition generating unit configured to generate a first display image including an image of the virtual space viewed from a first viewpoint associated with the first display medium, the first display image being viewable by the first user; a second image condition generating unit configured to generate a second display image including an image of the virtual space viewed from a second viewpoint associated with the second display medium, the second display image being viewable by the second user; and a first determination unit that determines whether or not at least one of the positions of the first display medium and the second display medium in the virtual space and a first relative positional relationship between the first display medium and the second display medium in the virtual space satisfies a first predetermined condition; An information processing system comprising an event generation unit that generates a predetermined event that can be realized in cooperation by multiple display media including the first display medium and the second display medium when the first judgment unit determines that the first predetermined condition is satisfied.

[0284] [Appendix 2] the predetermined event includes an image capture event; The information processing system described in Appendix 1, wherein the event generation unit includes an image data acquisition unit that acquires specific image data or image generation conditions for the virtual space, the image data including an image of the first user or the first display medium and an image of the second user or the second display medium.

[0285] [Appendix 3] 3. The information processing system according to claim 2, wherein the image data acquisition unit determines the specific image data based on the first display image.

[0286] [Appendix 4] each of the first display medium and the second display medium is in the form of an avatar; The information processing system described in Appendix 3, wherein the first image condition generation unit, when it is determined that the first predetermined condition is satisfied, selects two poses from a plurality of types of poses, and draws the first display medium and the second display medium in the selected poses.

[0287] [Appendix 5] An information processing system as described in any one of appendices 2 to 4, further comprising an image data storage unit that stores the specific image data or the image generation conditions in a manner accessible by the first user, the second user or other users.

[0288] [Appendix 6] The information processing system according to any one of claims 1 to 5, further comprising a preparation processing unit that performs preparation processing to enable the specified event to occur when the first judgment unit judges that the first specified condition is satisfied.

[0289] [Appendix 7] An interface forming unit that forms a user interface on the first display image, the event generation unit further generates the predetermined event when a predetermined input from the first user is acquired by the input acquisition unit; The information processing system according to claim 6, wherein the preparation processing unit forms a user interface for inputting the specified input via the interface forming unit as the preparation processing.

[0290] [Appendix 8] The information processing system described in Appendix 6 or 7, wherein, as the preparatory processing, the preparation processing unit draws the first display image via the first image condition generation unit so that each of the first display medium and the second display medium is included in the first display image.

[0291] [Appendix 9] An information processing system described in any one of Appendices 1 to 8, wherein the first specified condition is satisfied when, in the virtual space, the respective positions of the first display medium and the second display medium are within a specified distance relative to a specific position, or when, in the virtual space, the relative distance between the first display medium and the second display medium in the virtual space is within a specified distance.

[0292] [Appendix 10] An information processing system according to any one of appendices 1 to 9, further comprising a first relative relationship output unit that outputs first relative relationship information representing or suggesting the first relative positional relationship to each of the first display image and the second display image based on the first relative positional relationship.

[0293] [Appendix 11] The information processing system of claim 10, wherein the first relative relationship information includes at least one of an image in the form of a compass representing a direction related to the first relative positional relationship and an image of numbers representing a distance related to the first relative positional relationship.

[0294] [Appendix 12] The information processing system described in Appendix 11, wherein the first relative relationship output unit calculates the direction related to the first relative relationship information to be superimposed on the first display image based on an orientation of the first display medium in the virtual space and the respective positions of the first display medium and the second display medium in the virtual space, and calculates the direction related to the first relative relationship information to be superimposed on the second display image based on an orientation of the second display medium in the virtual space and the respective positions of the first display medium and the second display medium in the virtual space.

[0295] [Appendix 13] The position management unit further positions a specific display medium in the virtual space; a second determination unit that determines whether a second predetermined condition is satisfied based on a position of the first display medium in the virtual space and a position of the specific display medium in the virtual space; The information processing system of any one of appendices 1 to 12, wherein the event generation unit further associates specified information corresponding to the specific display medium with the first user or the first display medium when the second judgment unit judges that the second specified condition is satisfied.

[0296] [Appendix 14] The information processing system of claim 13, wherein the specified information includes the specific display medium.

[0297] [Appendix 15] The information processing system described in Appendix 13 or 14, wherein the second specified condition is satisfied when, in the virtual space, the relative distance between the first display medium and the specific display medium in the virtual space is within a specified distance.

[0298] [Appendix 16] An information processing system described in any one of Appendices 13 to 15, further comprising a second relative relationship output unit that outputs second relative relationship information representing or suggesting the second relative positional relationship to the first display image based on a second relative positional relationship between the first display medium and the specific display medium in the virtual space.

[0299] [Appendix 17] The information processing system of claim 16, wherein the second relative relationship information includes at least one of an image in the form of a compass representing a direction related to the second relative positional relationship and an image of numbers representing a distance related to the second relative positional relationship.

[0300] [Appendix 18] The information processing system described in Appendix 17, wherein the second relative relationship output unit calculates the direction related to the second relative relationship information to be superimposed on the first display image based on the orientation of the first display medium and the respective positions of the first display medium and the specific display medium in the virtual space.

[0301] [Appendix 19] a first movement processing unit that changes a position of the first display medium in the virtual space based on a first input from the first user acquired by the input acquisition unit; a second movement processing unit that changes a position of the second display medium in the virtual space based on a second input from the second user acquired by the input acquisition unit, the first movement processing unit permits movement of the first display medium from a first area to a second area in the virtual space when a first movement condition is satisfied; An information processing system described in any one of Appendices 13 to 18, wherein the second movement processing unit allows movement of the second display medium from the first area to the second area in the virtual space when a second movement condition is satisfied.

[0302] [Appendix 20] the first movement condition is satisfied when the predetermined information is associated with the first user or the first display medium; The information processing system according to claim 19, wherein the second movement condition is satisfied when the specified information is associated with the second user or the second display medium.

[0303] [Appendix 21] The information processing system described in Appendix 19 or 20, wherein the first movement processing unit and the second movement processing unit move the positions of the first display medium and the second display medium in the virtual space to positions corresponding to a third input from a specified user acquired by the input acquisition unit.

[0304] [Appendix 22] The information processing system described in Appendix 21, wherein the first movement processing unit and the second movement processing unit forcibly move the positions of the first display medium and the second display medium in the virtual space to positions corresponding to the third input based on the third input.

[0305] [Appendix 23] 23. The information processing system according to any one of claims 1 to 22, wherein the virtual space is generated based on real image data relating to a real space.

[0306] [Appendix 24] An information processing system described in any one of Appendixes 1 to 23, wherein the first determination unit identifies the position of the first display medium or the second display medium in the virtual space based on position information of the first user or the second user in real space.

[0307] [Appendix 25] A first display medium associated with a first user and a second display medium associated with a second user are positioned in a virtual space; Obtain various inputs from each user, generating a first display image including an image of the virtual space viewed from a first viewpoint associated with the first display medium, the first display image being viewable by the first user; generating a second display image including an image of the virtual space viewed from a second viewpoint associated with the second display medium, the second display image being viewable by the second user; determining whether or not at least one of the positions of the first display medium and the second display medium in the virtual space and a first relative positional relationship between the first display medium and the second display medium in the virtual space satisfies a first predetermined condition; An information processing method executed by a computer, which includes, when it is determined that the first predetermined condition is satisfied, generating a predetermined event that can be realized in cooperation by multiple display media including the first display medium and the second display medium.

[0308] [Appendix 26] A first display medium associated with a first user and a second display medium associated with a second user are positioned in a virtual space; Obtain various inputs from each user, generating a first display image including an image of the virtual space viewed from a first viewpoint associated with the first display medium, the first display image being viewable by the first user; generating a second display image including an image of the virtual space viewed from a second viewpoint associated with the second display medium, the second display image being viewable by the second user; determining whether or not at least one of the positions of the first display medium and the second display medium in the virtual space and a first relative positional relationship between the first display medium and the second display medium in the virtual space satisfies a first predetermined condition; When it is determined that the first predetermined condition is satisfied, a predetermined event that can be realized in cooperation with a plurality of display media including the first display medium and the second display medium is generated. An information processing program that causes a computer to execute processing.

[0309] Furthermore, the following supplementary notes are disclosed (corresponding to the original claims of the original application):

[0310] [Appendix 1] a position management unit that positions a first display medium associated with a first user and a second display medium associated with a second user in a virtual space; an input acquisition unit that acquires various inputs from each user; a first image condition generating unit configured to generate a first display image including an image of the virtual space viewed from a first viewpoint associated with the first display medium, the first display image being viewable by the first user; a second image condition generating unit configured to generate a second display image including an image of the virtual space viewed from a second viewpoint associated with the second display medium, the second display image being viewable by the second user; and a first determination unit that determines whether or not at least one of the positions of the first display medium and the second display medium in the virtual space and a first relative positional relationship between the first display medium and the second display medium in the virtual space satisfies a first predetermined condition; an event generating unit that generates a predetermined event that can be realized in cooperation with a plurality of display media including the first display medium and the second display medium when the first determining unit determines that the first predetermined condition is satisfied, The position management unit further positions a specific display medium in the virtual space; a second determination unit that determines whether a second predetermined condition is satisfied based on a position of the first display medium in the virtual space and a position of the specific display medium in the virtual space; The event generation unit further associates specified information corresponding to the specific display medium with the first user or the first display medium when the second judgment unit judges that the second specified condition is satisfied.

[0311] [Appendix 2] The information processing system according to claim 1, wherein the specified information includes the specific display medium.

[0312] [Appendix 3] The information processing system according to claim 1 or 2, wherein the second specified condition is satisfied when, in the virtual space, a relative distance between the first display medium and the specific display medium is within a specified distance.

[0313] [Appendix 4] An information processing system described in any one of Appendices 1 to 3, further comprising a second relative relationship output unit that outputs second relative relationship information representing or suggesting the second relative positional relationship to the first display image based on a second relative positional relationship between the first display medium and the specific display medium in the virtual space.

[0314] [Appendix 5] The information processing system of claim 4, wherein the second relative relationship information includes at least one of an image in the form of a compass representing a direction related to the second relative positional relationship and an image of numbers representing a distance related to the second relative positional relationship.

[0315] [Appendix 6] The information processing system described in Appendix 5, wherein the second relative relationship output unit calculates the direction related to the second relative relationship information to be superimposed on the first display image based on the orientation of the first display medium and the respective positions of the first display medium and the specific display medium in the virtual space.

[0316] [Appendix 7] a first movement processing unit that changes a position of the first display medium in the virtual space based on a first input from the first user acquired by the input acquisition unit; a second movement processing unit that changes a position of the second display medium in the virtual space based on a second input from the second user acquired by the input acquisition unit, the first movement processing unit permits movement of the first display medium from a first area to a second area in the virtual space when a first movement condition is satisfied; An information processing system described in any one of Appendixes 1 to 6, wherein the second movement processing unit allows movement of the second display medium from the first area to the second area in the virtual space when a second movement condition is satisfied.

[0317] [Appendix 8] the first movement condition is satisfied when the predetermined information is associated with the first user or the first display medium; The information processing system according to claim 7, wherein the second movement condition is satisfied when the specified information is associated with the second user or the second display medium.

[0318] [Appendix 9] The information processing system described in Appendix 7 or 8, wherein the first movement processing unit and the second movement processing unit move the positions of the first display medium and the second display medium in the virtual space to positions corresponding to a third input from a specified user acquired by the input acquisition unit.

[0319] [Appendix 10] The information processing system described in Appendix 9, wherein the first movement processing unit and the second movement processing unit forcibly move the positions of the first display medium and the second display medium in the virtual space to positions corresponding to the third input based on the third input.

[0320] [Appendix 11] 11. The information processing system according to any one of claims 1 to 10, wherein the virtual space is generated based on real image data relating to a real space.

[0321] [Appendix 12] An information processing system described in any one of Appendices 1 to 11, wherein the first determination unit identifies the position of the first display medium or the second display medium in the virtual space based on position information of the first user or the second user in real space.

[0322] [Appendix 13] A first display medium associated with a first user and a second display medium associated with a second user are positioned in a virtual space, and various inputs are acquired from each user. generating a first display image including an image of the virtual space viewed from a first viewpoint associated with the first display medium, the first display image being viewable by the first user; generating a second display image including an image of the virtual space viewed from a second viewpoint associated with the second display medium, the second display image being viewable by the second user; determining whether or not at least one of the positions of the first display medium and the second display medium in the virtual space and a first relative positional relationship between the first display medium and the second display medium in the virtual space satisfies a first predetermined condition; generating a predetermined event that can be realized in cooperation with a plurality of display media including the first display medium and the second display medium when it is determined that the first predetermined condition is satisfied; Furthermore, a specific display medium is positioned in the virtual space; Further determining whether a second predetermined condition is satisfied based on the position of the first display medium in the virtual space and the position of the specific display medium in the virtual space; An information processing method executed by a computer, in which generating the specified event further includes associating specified information corresponding to the specific display medium with the first user or the first display medium when it is determined that the second specified condition is satisfied.

[0323] [Appendix 14] A first display medium associated with a first user and a second display medium associated with a second user are positioned in a virtual space; Obtain various inputs from each user, generating a first display image including an image of the virtual space viewed from a first viewpoint associated with the first display medium, the first display image being viewable by the first user; generating a second display image including an image of the virtual space viewed from a second viewpoint associated with the second display medium, the second display image being viewable by the second user; determining whether or not at least one of the positions of the first display medium and the second display medium in the virtual space and a first relative positional relationship between the first display medium and the second display medium in the virtual space satisfies a first predetermined condition; when it is determined that the first predetermined condition is satisfied, causing a computer to execute a process of generating a predetermined event that can be realized in cooperation by a plurality of display media including the first display medium and the second display medium; Furthermore, a specific display medium is positioned in the virtual space; Further determining whether a second predetermined condition is satisfied based on the position of the first display medium in the virtual space and the position of the specific display medium in the virtual space; The information processing program further includes, when it is determined that the second predetermined condition is satisfied, associating the first user or the first display medium with predetermined information corresponding to the specific display medium. [Explanation of symbols]

[0324] 1 Virtual reality generation system 3. Network 10, 10A, 10B Server equipment 11 Server Communication Section 12 Server memory section 13 Server control unit 20, 20A, 20B Terminal equipment 21 Terminal communication unit 22 Terminal memory section 23 Display section 23A Head-mounted display 24 Input section 25 Terminal control unit 60 Virtual Camera 130 User Database 132 Avatar Database 140 User Input Acquisition Unit 142 Location Management Department 144 Image condition generation unit 1441 First image condition generation unit 1442 Second image condition generation unit 146 1st Judgment Department 148 Interface Formation Department 150 Preparation Processing Section 152 Event Generation Section 1521 Image data acquisition unit 1522 Various Event Generation Department 154 First relative relationship output unit 156 Second relative relationship output unit 158 Second Judgment Section 162 Movement Processing Unit 1621 First Movement Processing Unit 1622 Second Movement Processing Unit 172 Image data storage unit 210 Image generation condition receiving unit 212 Image output unit 214 User Input Generation Unit 216 User Input Transmission Unit

Claims

[Claim 1] a position management unit that positions a first display medium associated with a first user and a second display medium associated with a second user in a virtual space; an input acquisition unit that acquires various inputs from each user; a first image condition generating unit configured to generate a first display image including an image of the virtual space viewed from a first viewpoint associated with the first display medium, the first display image being viewable by the first user; a second image condition generating unit configured to generate a second display image including an image of the virtual space viewed from a second viewpoint associated with the second display medium, the second display image being viewable by the second user; and a first determination unit that determines whether or not at least one of the positions of the first display medium and the second display medium in the virtual space and a first relative positional relationship between the first display medium and the second display medium in the virtual space satisfies a first predetermined condition; an event generating unit that generates a predetermined event that can be realized in cooperation by a plurality of display media including the first display medium and the second display medium when the first determining unit determines that the first predetermined condition is satisfied, The position management unit further positions a specific display medium in the virtual space; a second determination unit that determines whether a second predetermined condition is satisfied based on a position of the first display medium in the virtual space and a position of the specific display medium in the virtual space; The event generation unit further associates specified information corresponding to the specific display medium with the first user or the first display medium when the second determination unit determines that the second specified condition is satisfied.

Citation Information

Patent Citations

  • Program executed by computer capable of communicating with head mounted device, information processing apparatus for executing that program, and method implemented by computer capable of communicating with head mounted device

    JP2018200678A

  • Advertising display system

    JP6956829B1

  • System for animated cartoon distribution, method, and program

    JP2019204244A