Program and information processing system

Abstract

To provide a program that improves the interest of a service. [Solution] A program capable of controlling multiple modes by a computer, including a virtual space mode that displays a virtual space according to the user's position in real space, and an augmented reality mode that displays an augmented reality in which virtual objects are placed in real space photographed by the user.When the user moves the computer to a specific position in real space, the augmented reality mode can start a specific event, and the augmented reality mode displays a specific image whose appearance changes depending on the distance to the specific position, while the virtual space mode functions as a display control means that hides the specific image.

Description

[Technical Field]

[0001] The present invention relates to a program and an information processing system. [Background technology]

[0002] BACKGROUND ART Conventionally, there are known techniques that can provide services according to a user's position in real space (for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 7497506 Summary of the Invention [Problem to be solved by the invention]

[0004] The present invention aims to improve the interest of the service. [Means for solving the problem]

[0005] In order to solve the above problems, the program of the present invention comprises: Computer, Virtual space mode displays a virtual space according to the user's position in real space. means of control, Augmented reality mode displays augmented reality with virtual objects placed in the real space captured by the user. a means for controlling the augmented reality mode to accept a specific user operation, and a means for controlling the augmented reality mode to accept a specific user operation, while disabling the specific user operation in the virtual space mode; Specific location in real space to User When a specific operation is accepted during the period in which It is now possible to start specific events in augmented reality mode. means to In the augmented reality mode, a specific image is displayed that changes depending on the distance to a specific position, while in the virtual space mode, the specific image is hidden. The virtual space mode can be switched to the augmented reality mode not only when the user is located at a specific position but also when the user is located at a predetermined position other than the specific position, and specific operations can be accepted in the augmented reality mode not only when the user is located at a specific position but also when the user is located at a predetermined position. [Effects of the Invention]

[0006] According to the present invention, the interest of the service is improved. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 2 is a diagram illustrating each configuration of the information processing system. [Figure 2] FIG. 1 is a hardware configuration diagram of an information processing system. [Figure 3] FIG. 2 is a functional block diagram of the information processing system. [Figure 4] FIG. 10 is a schematic diagram of a specific example in a virtual section mode. [Figure 5] FIG. 10 is a diagram for explaining a specific example of a map image. [Figure 6] FIG. 10 is a diagram for explaining a specific example of a method for generating hint information. [Figure 7] FIG. 10 is a diagram for explaining a specific example of an analysis range. [Figure 8] FIG. 10 is a diagram illustrating a specific example of a prompt according to the distance to the treasure. [Figure 9] FIG. 10 is a diagram for explaining a specific example in the AR mode. [Figure 10] FIG. 10 is a diagram for explaining specific examples of each selectable range of each item. [Figure 11] FIG. 10 is a diagram for explaining a specific example of a user's action. [Figure 12] 10A and 10B are diagrams for explaining specific examples of location attributes and user attributes; [Figure 13] FIG. 10 is a diagram for explaining another specific example in the AR mode. [Figure 14] 3 is a flowchart of each process in the information processing system. [Figure 15] FIG. 10 is a diagram for explaining a modified example. DETAILED DESCRIPTION OF THE INVENTION

[0008] Fig. 1 is a diagram illustrating the components of an information processing system 1000. The information processing system 1000 includes a terminal device 100, a server device 200, and an AI (Artificial Intelligence) system 300. As shown in Fig. 1, the terminal device 100, the server device 200, and the AI ​​(Artificial Intelligence) system 300 can communicate with each other via a network N. The network N may be, for example, the Internet.

[0009] The terminal device 100 is portable by a user, and may be, for example, a smartphone, a personal computer, or a portable game console. The terminal device 100 stores various programs including application programs. In reality, a plurality of terminal devices 100 communicate with the server device 200. However, for the sake of explanation, only one terminal device 100 is shown in FIG. 1 .

[0010] The terminal device 100 is configured to be able to acquire position information in real space. Specifically, the terminal device 100 is equipped with a GPS (Global Positioning System) receiving unit and is configured to be able to receive GPS signals. The GPS signals include position information indicating the position of the terminal device 100 on a horizontal plane. In this embodiment, the position of the terminal device 100 on the horizontal plane of the real space Sr may be referred to as a "user position Pr." It can be estimated that the user position Pr indicates the position of the user who owns the terminal device 100.

[0011] The server device 200 provides the terminal device 100 with various types of information that the terminal device 100 uses when executing an application program. Specifically, the terminal device 100 and the server device 200 work together to provide a service that uses the user's location information, such as a game that uses the user's location information (referred to as a location information game). Note that while FIG. 1 shows an example in which the server device 200 is configured as a single server device, the server device 200 may also be configured as a plurality of server devices (systems).

[0012] The AI ​​system 300 functions as an AI chatbot that has been trained by machine learning. Specifically, when a prompt (see FIG. 8 described later) is input to the AI ​​system 300, an answer to the prompt (hint information H described later) is generated. When a prompt is input from the server device 200 via an API (Application Programming Interface), the AI ​​system 300 of this embodiment replies with an answer corresponding to the prompt. The above AI system 300 may be configured to include multiple computers or may be configured to include a single computer.

[0013] The map system 400 is a system capable of providing, for example, a street view. Specifically, the map system 400 stores a real image Gx captured at each shooting position Px in the real space Sr in association with the position information of the shooting position Px. When the map system 400 receives an image request including the shooting position Px in the real space Sr from the server device 200, it returns the real image Gx corresponding to the shooting position Px included in the image request. The above map system 400 may be configured to include multiple computers or may be configured to include a single computer.

[0014] Although details will be described later, in this embodiment, a treasure hunt event can be progressed on the terminal device 100. In the above treasure hunt event, a treasure location Pt is determined by the server device 200, and the user can obtain a treasure item by moving to the treasure location Pt. However, the treasure location Pt is generally kept secret from the user, and the user moves to the treasure location Pt by referring to hint information H. The above hint information H is generated by the AI ​​system 300 analyzing a real image Gx related to the treasure location Pt (the surroundings of the treasure location Pt) (see Figure 6 described later).

[0015] Furthermore, the terminal device 100 can be controlled to an AR mode that can display augmented reality (AR). By switching the terminal device 100 to the AR mode at the treasure position Pt, a discovery event (see FIG. 9(b) described later) can be executed in the augmented reality (AR). In the discovery event, a treasure item is awarded to the user. The above configuration will be described in detail later.

[0016] Fig. 2 is a hardware configuration diagram of the information processing system 1000. As described above, the information processing system 1000 includes the terminal device 100 and the server device 200. As shown in Fig. 2, the terminal device 100 includes a processing device 101, a storage device 102, a communication device 103, a display device 104, a GPS receiving unit 105, an acceleration and direction sensor 106, and a camera 107. Each of the above components is connected to each other so as to be able to communicate with each other via a system bus.

[0017] The processing device 101 controls the entire terminal device 100. The processing device 101 may be configured with one or more processors. Specifically, the processing device 101 may be configured with one or more types of processors, such as a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a DSP (Digital Signal Processor), an FPGA (Field Programmable Gate Array), or an ASIC (Application Special Integrated Circuit).

[0018] The storage device 102 stores various programs including a basic program and an application program PGx. Well-known storage media such as semiconductor storage media and magnetic storage media can be used as the storage device 102. The storage device 102 may be configured as a single storage medium or multiple storage media. The application program PGx is downloaded in advance and installed on the terminal device 100. The storage device 102 also stores various game data used in the location-based game (such as data indicating items given to the user and data indicating the status of the user character).

[0019] The display device 104 includes a display panel 104a and a touch panel 104b. The display panel 104a is, for example, a flat display configured with organic EL (Electro Luminescence). The touch panel 104b is configured to be able to detect a touch operation by a user. Specifically, the touch panel 104b is provided over the display panel 104a and receives a touch operation on an image displayed on the display panel 104a.

[0020] The GPS receiver 105 receives GPS signals from GPS satellites. The acceleration and direction sensor 106 is composed of a combination of various sensors including a compass that detects direction, an acceleration sensor, and a gyro sensor. The communication device 103 communicates with the server device 200 via the network N. The camera 107 includes an image sensor and the like, and generates a captured image by converting incident light entering through a lens into an electrical signal.

[0021] The server device 200 includes a processing device 201, a storage device 202, and a communication device 203. These components are communicatively connected via a system bus. The processing device 201 controls the entire server device 200. The processing device 201 of the server device 200 may be configured with one or more processors, similar to the processing device 101 of the terminal device 100 described above. Specifically, the processing device 201 may be configured with one or more types of processors, such as a CPU, a GPU, a DSP, an FPGA, or an ASIC.

[0022] The storage device 202 stores various programs including a basic program and a game management program PGy. The storage device 202 of the server device 200 may be, for example, a known storage medium such as a semiconductor storage medium or a magnetic storage medium. The storage device 202 may be configured with a single storage medium or multiple storage media. The storage device 202 also stores various game data used in the location-based game (such as data indicating items given to the user and data indicating the status of the user character) in association with the user's identifier. The communication device 203 communicates with the terminal device 100 via the network N.

[0023] FIG. 3 is a functional block diagram of an information processing system 1. As shown in FIG. 3, the information processing system 1 of this embodiment is configured to include a terminal device 10, a management device 20, a machine learning model 30, and a map system 40. For example, the above-mentioned terminal device 100 functions as the terminal device 10 by executing an application program PGx. Furthermore, the above-mentioned server device 200 functions as the management device 20 by executing a game management program PGy. Similarly, the AI ​​system 300 functions as the machine learning model 30 by executing a program, and the map system 400 functions as the map system 40 by executing a program. Each of the above components can communicate via a network N.

[0024] The terminal device 10 includes a notification means 11, a display control means 12, a mode control means 13, and a reception means 14. However, the management device 20 may be configured to have the above components (functions).

[0025] The terminal device 10 of this embodiment allows a user at a first position (hereinafter referred to as "user position Pr") in the real space Sr to move to a second position (treasure position Pt) to progress a specific event (such as a treasure item discovery event) corresponding to the second position. Furthermore, the notification means 11 notifies the user at the first position of specific information (hint information H) according to the analysis result of the real image Gx showing the real space Sr related to the second position. The above configuration will be described in detail later using FIG. 6.

[0026] Furthermore, the notification means 11 notifies the user of specific information corresponding to the distance from the first position to the second position (Lt shown in FIG. 8). Specifically, the closer the distance from the first position to the second position, the more specific information the notification means 11 notifies the user that makes it easier to identify the second position. For example, when the distance from the first position to the second position is equal to or greater than a predetermined threshold (approximately 300 meters), the notification means 11 notifies the user of specific information corresponding to the analysis result of the real image Gx in a first range (analysis range Ra1) of the real space Sr, and when the distance from the first position to the second position is less than the threshold, the notification means 11 notifies the user of specific information corresponding to the analysis result of the real image Gx in a second range (analysis range Ra2) narrower than the first range. The above configuration will be described in detail later with reference to FIGS. 7(a) and 7(b).

[0027] Furthermore, the specific information (hint information H) is generated by inputting a prompt Dx including a real image Gx and an instruction string Sx into the machine learning model 30, and is generated using different instruction strings Sx depending on the distance from the first position to the second position (see FIG. 8 described later). Note that a configuration may be adopted in which a computer (terminal device 10) functions as a receiving means 14 that receives a predetermined specific operation (a search operation described later) by the user, and the specific information is generated depending on the number of times the specific operation has been received (the number of failures n described later). A specific example of the above configuration will be described in detail using FIGS. 15(a), (b-1), and (b-2) as a modified example.

[0028] In addition, the terminal device 10 of this embodiment can be switched between multiple modes, including a virtual space mode (see Figure 4 described below) that displays a virtual space Sv corresponding to the user's position (user position Pr) in the real space Sr, and an augmented reality mode (AR mode) that displays an augmented reality AR in which a virtual object (such as the treasure image Gt in Figure 9(b)) is placed in the real space Sr photographed by the user.

[0029] The display control means 12 of the terminal device 10 can start a specific event (item acquisition event) in the augmented reality mode when the user moves to a specific position (treasure position Pt) in the real space Sr, and displays a specific image (distance image Gd in FIG. 9(b)) whose appearance changes depending on the distance to the specific position in the augmented reality mode, while hiding the specific image in the virtual space mode. In addition, the mode control means 13 of the terminal device 10 can automatically switch to the virtual space mode after the specific event (treasure item acquisition event) in the augmented reality mode has ended. The above configuration will be described in detail later using FIG. 11.

[0030] The notification means 11 of the terminal device 10 notifies information about a specific position (such as a treasure position Pt) in the augmented reality mode based on attribute information (position attribute) associated with the specific position and attribute information of the user (such as an item possessed by the user). Specifically, when an object (ally character, item) corresponding to the attribute information of the specific position is associated with and possessed by the user, the notification means 11 notifies information about the specific position (such as the type of treasure item) in the augmented reality mode. Furthermore, the notification means 11 notifies information about the specific position in the augmented reality mode, even if the user is not located at the specific position, depending on the user's attribute information (whether or not the user possesses a character with a telephoto skill). For example, the display device 104 of the terminal device 100 functions as the notification means 11. The above configuration will be described in detail later with reference to FIG. 11.

[0031] The terminal device 10 can determine any position in the target range (Rt) of the real space Sr as a specific position (treasure position Pt), and can present the target range to the user (displaying a map image Gt, which will be described later) while keeping the specific position secret. With the above configuration, the user can enjoy discovering the treasure position Pt. The above configuration will be described in detail later with reference to FIG. 5(b).

[0032] When the user moves to a predetermined position (event spot ves) in the real space Sr, the terminal device 10 can start a predetermined event (an event to obtain a normal item) in the virtual space mode, but does not start the predetermined event in the augmented reality mode, and when the user moves to a specific position (treasure position Pt) in the real space Sr, the terminal device 10 can start a specific event (an event to obtain a treasure item) in the augmented reality mode, but does not start the specific event in the virtual space mode. The above configuration will be described in detail later using Figure 10(a).

[0033] When the user moves within a range of a predetermined first distance (approximately 50 meters) from a predetermined position (event spot res) in the real space Sr, the terminal device 10 can start a predetermined event (an event to obtain a normal item) in the virtual space mode, and when the user moves within a range of a second distance (approximately 10 meters) that is shorter than the first distance from a specific position (treasure position Pt), the terminal device 10 can start a specific event (an event to discover a treasure item) in the augmented reality mode. The above configuration will be described in detail later using FIG. 10(b-2).

[0034] 4 is a schematic diagram of a specific example of a map screen Mp displayed on the terminal device 10 (display panel 104a). The map screen Mp is displayed in the virtual space mode of the terminal device 10 (virtual space mode, AR mode). A virtual space Sv is displayed on the map screen Mp, and a location-based game progresses in the virtual space Sv. Specifically, in the location-based game, various events (such as obtaining items) can progress in the virtual space Sv as the user moves through the real space Sr.

[0035] The virtual space Sv is displayed based on map information in the real space Sr and the user position Pr. The above map information is provided to the terminal device 10 from the management device 20, for example. However, the management device 20 may acquire the map information from an external server and transfer the map information to the terminal device 10. The user position Pr is identified using the above-mentioned GPS signal.

[0036] As shown in Fig. 4, the map screen Mp is configured to include various objects. Specifically, the map screen Mp is configured to include a character image Gp, a ground image Gg, and an item image Gi (Giu, Gim). Note that the specific example in Fig. 4 shows only some of the objects displayed on the map screen Mp.

[0037] The ground surface image Gg in the virtual space Sv is displayed in an area corresponding to the ground surface in the real space Sr. The above ground surface image Gg is displayed based on map information in the real space Sr. Specifically, the ground surface image Gg displays road areas at positions corresponding to roads in the real space Sr. Furthermore, the ground surface image Gg displays an ocean area at a position corresponding to the ocean in the real space Sr, and a river area at a position corresponding to the river in the real space Sr. In other words, the above ground surface image Gg represents a map of the real space Sr.

[0038] The character image Gp represents the user character in the virtual space Sv. As shown in FIG. 4, the character image Gp is ​​displayed at the character position Pv. The character position Pv in the virtual space Sv corresponds to the user position Pr in the real space Sr. In other words, the character image Gp (character position Pv) above indicates the user position Pr on the map of the real space Sr represented by the ground image Gg. Specifically, the character position Pv in the virtual space Sv moves as the user position Pr identified from the GPS signal moves. In other words, the character image Gp moves in the virtual space Sv as the user moves in the real space Sr.

[0039] Each of the other objects on the map screen Mp is arranged in the virtual space Sv in a predetermined manner. Specifically, the position information of the event spot res in the real space Sr and the type of event that can be started at the event spot res are associated (linked) and stored. Note that the event spot res in this embodiment may be a "point" defined by a combination of latitude and longitude, or may be an "area" having an area. In other words, the "position" in the present invention is a concept that encompasses both a "point" and an "area" in real space.

[0040] For ease of explanation, a location in the virtual space Sv that corresponds to an event spot res in the real space Sr may be referred to as an "event spot ves." An event associated with an event spot res in the real space Sr is also associated with an event spot ves in the virtual space Sv that corresponds to the event spot res. An object corresponding to the event associated with the event spot ves is placed at each event spot ves in the virtual space Sv.

[0041] In this embodiment, an area within a predetermined distance (e.g., about 50 meters) from an event spot res in real space Sr is set as a selectable range rsa corresponding to the event spot res. When the user position Pr is located within the selectable range rsa, an event at the event spot res corresponding to the selectable range rsa can be started.

[0042] For example, assume that an item image Gi is displayed at an event spot ves in the virtual space Sv that corresponds to an event spot res in the real space Sr. In the above case, when the user position Pr is located within the selectable range rsa that corresponds to the event spot res, an item acquisition event is initiated by selecting (touching) the item image Gi. In the above acquisition event, the item corresponding to the selected item image Gi is granted to the user.

[0043] When an item image Gi is touched and an item is given, the item image Gi is hidden from the map screen Mp and cannot be selected. Note that every time a predetermined time (for example, about 24 hours) has passed, a new item image Gi is rearranged on the map screen Mp.

[0044] In this embodiment, various items including normal items and map items are granted to the user. Of the item images Gi, the normal item image Giu corresponds to a normal item. Furthermore, of the item images Gi, the map item image Gim corresponds to a map item. In the specific example of FIG. 4, it is assumed that, of the event spots ves, the map item image Gim is placed at event spot ves1, and the normal item image Giu is placed at event spot ves2. For example, when the normal item image Giu is selected, the normal item is granted to the user. The normal item may be, for example, in-game currency that can be used to purchase other items. However, the normal item is not limited to the above examples.

[0045] When the map item image Gim is selected, a map item is granted to the user. As will be described in detail later, once the map item is obtained, the user can start the treasure hunt event. Note that the configuration for granting the map item to the user is not limited to the above example. For example, the map item may be granted to the user as a reward for clearing another predetermined event. In the above configuration, the map item may not be obtained from the map screen Mp.

[0046] The appearance (display area and angle) of each of the above objects (such as the ground image Gg) changes as the character position Pv moves. That is, the appearance of each object in the virtual space Sv changes as the user moves through the real space Sr. Specifically, the map screen Mp displays the virtual space Sv in which the character position Pv (character image GP) is viewed from a predetermined viewing direction. The above viewing direction may be configured to be changeable in response to a user operation.

[0047] 4, in addition to each object in the virtual space Sv, buttons B1 and B2 and a map display button Bm are displayed on the map screen Mp. Each of the above buttons B (1, 2, m) is displayed at a predetermined position on the map screen Mp, and its appearance does not change even if the character position Pv moves.

[0048] When button B1 of the above buttons is selected, auto mode can be started. In auto mode, an item corresponding to the item image Gi is automatically acquired without touching the item image Gi. Specifically, when the user position Pr moves within the selectable range rsa during auto mode, an item image Gi placed at the event spot ves corresponding to the selectable range rsa is automatically selected, and an item corresponding to the item image Gi is automatically acquired.

[0049] According to the above configuration, by setting the terminal device 10 to auto mode, various events can be progressed in the virtual space Sv without visually checking the screen of the terminal device 10 (without operating the terminal device 10). This prevents the user from operating the terminal device 10 while moving and obstructing the passage of others. If the button B1 is selected again during the auto mode, the auto mode ends. Note that the auto mode cannot be set in the AR mode.

[0050] When button B2 of the buttons B is selected, the map screen Mp is switched to a menu screen. The user can use various items via the menu screen. For example, the user can use an item to restore the character's hit points via the menu screen.

[0051] When the map display button Bm is selected, a map screen Mm, described below, is displayed in place of the map screen Mp (see FIG. 5(b)). The map screen Mm is displayed on the map screen Mp during the period when the treasure hunt event described above is in progress. Note that the map display button Bm may also be configured to be displayed during periods when the treasure hunt event is not in progress. In the above configuration, when the map display button Bm is selected during periods when the treasure hunt event is not in progress, a message may be displayed indicating that the treasure hunt event can be started by obtaining a map item. As described above, in the treasure hunt event, a treasure position Pt is set, and a treasure item is awarded to the user when the user reaches the treasure position Pt.

[0052] However, the specific location of the treasure position Pt is concealed from the user in principle. For example, the specific example in FIG. 4 assumes a case where a treasure position Pt has been set. Specifically, it is assumed that an event spot res corresponding to a virtual treasure position Pvt on the far left side of the virtual space Sv when viewed from the front has been set as the treasure position Pt. For the sake of explanation, FIG. 4 shows the virtual treasure position Pvt, but the virtual treasure position Pvt is not actually displayed on the map screen Mp. In the treasure hunt event, the user guesses the treasure position Pt based on hint information H (see FIG. 5(b)), which will be described later.

[0053] Fig. 5(a) is a diagram illustrating a configuration for setting a treasure position Pt. Fig. 5(a) shows a map of a portion of the real space Sr. Fig. 5(a) also shows a user position Pr in the real space Sr.

[0054] In this embodiment, a predetermined distance (for example, about 1 kilometer) from the user position Pr is set as the target range Rt. Furthermore, any one of the event spots res located in the target range Rt is set as the treasure position Pt. Specifically, the management device 20 acquires word-of-mouth information for each event spot res from the map system 40. The word-of-mouth information for the event spot res includes each user's evaluation of the event spot res, etc. Based on the above word-of-mouth information, any one of the event spots res within the target range Rt is set as the treasure position Pt.

[0055] For example, whether an event spot res is where a real event is held, whether an event spot res is where many people gather during a specific time period, etc. are determined based on the word-of-mouth information. Based on the results of the above determination, the management device 20 sets one of the event spots res within the target range Rt as the treasure position Pt. Note that the above configuration may also employ a configuration in which the treasure position Pt is determined by a machine learning model that has been trained in advance. Specifically, the location information and word-of-mouth information of each event spot res within the target range Rt may be input into a machine learning model, and the treasure position Pt may be determined.

[0056] In this embodiment, when a map item is acquired, a predetermined confirmation image is displayed on the map screen Mp. A "Start button" and a "Stop button" are displayed on the confirmation image. When the "Start button" on the confirmation image is selected, the treasure hunt event begins. Specifically, when the "Start button" is selected, a range of approximately 1 kilometer from the user position Pr (the event spot res where the map item was placed) at the time the map item was acquired is set as the target range Rt, and the treasure position Pt is determined.

[0057] On the other hand, if the "Stop button" is selected, the treasure hunt event will not start and the treasure position Pt will not be determined. Note that when a treasure item on the map screen Mp is selected, the treasure item may be hidden from the map screen Mp (it cannot be selected again) regardless of whether the treasure hunt event will start (regardless of whether the Start button or the Stop button is selected). Also, when the Stop button is selected, the treasure item may not be hidden from the map screen Mp (it can be selected again). Also, the treasure hunt event may be automatically started immediately after the map item is obtained.

[0058] However, for example, if a user acquires a map item while riding a train, it may be difficult to progress through the treasure hunt event in the vicinity of the location where the map item was acquired. Taking the above circumstances into consideration, a configuration may be adopted in which the user can use the map item at any time after acquiring it. Furthermore, in the above configuration, a target range Rt may be set to approximately one kilometer from the user's position Pr at the time the map item was used. Furthermore, in a configuration in which the user can use the map item at any time, a target range Rt may be set to approximately one kilometer from the event spot ves where the map item was acquired, regardless of the user's position Pr at the time the map item was used.

[0059] 5(b) is a schematic diagram of a specific example of the map screen Mm. As described above, the map screen Mm is displayed when the map display button Bm (see FIG. 4) on the map screen Mp is selected. Various images including a map image Gm, a hint image Gh, an AR mode start button Ba, and a return button Bb are displayed on the map screen Mm.

[0060] The map image Gm is an image for displaying a map of the above-mentioned target range Rt (see FIG. 5(a)). The above map image Gm is displayed based on the above-mentioned map information. The above map image Gm allows the user to understand the target range Rt. However, as can be seen from FIG. 5(b), the treasure position Pt is not shown in the map image Gm. In a treasure hunt event, the user guesses the treasure position Pt in the target range Rt displayed in the map image Gm using hint information H, which will be described later. In the specific example of FIG. 5(b), a configuration is adopted in which the names of each facility (including stations and roads) in the target range Rt are not displayed in the map image Gm. However, a configuration in which the names of each facility are displayed in the map image Gm may also be adopted.

[0061] The hint image Gh displays hint information H. The above hint information H is a hint for estimating the treasure position Pt, and is generated by the machine learning model 30. As will be described in detail later with reference to FIG. 6, a prompt Dx including a real image Gx captured at a position related to the treasure position Pt (for example, around the treasure position Pt) is input to the machine learning model 30, and the hint information H is generated. For example, in the specific example of FIG. 5(b), it is assumed that a real image Gx including a "brick building" and a real image Gx including an "ocean" are input to the machine learning model 30. In the above case, as shown in FIG. 5(b), hint information H such as "Look for the brick building! The treasure is buried near the ocean!" may be generated.

[0062] When the AR mode start button Ba on the map screen Mm is selected, the AR mode that displays virtual reality AR is started. By switching to the AR mode, a discovery event in which a treasure item is obtained can be started. On the other hand, when the return button Bb is selected, the virtual space mode is started and the screen returns to the map screen Mp. Note that in this embodiment, a configuration is adopted in which it is not possible to switch directly from the virtual space mode (map screen Mp) to the AR mode. However, for example, an AR mode start button Ba may be provided on the map screen Mp, allowing direct switching from the virtual space mode to the AR mode.

[0063] 6 is a diagram illustrating a specific example of a configuration for generating hint information H. When the map screen Mm (including hint information H) is displayed (when the map display button Bm is selected), the management device 20 acquires a real image Gx related to the treasure position Pt from the map system 40 (Sa1 in FIG. 6). For example, the management device 20 acquires a real image Gx captured in the vicinity of the treasure position Pt. The management device 20 also creates a prompt Dx including the real image Gx acquired from the map system 40.

[0064] As shown in Fig. 6, the prompt Dx includes an instruction string Sx in addition to the above-mentioned real image Gx. The instruction string Sx is an instruction for causing the machine learning model 30 to generate hint information H using the real image Gx included in the prompt Dx. When the above prompt Dx is input to the machine learning model 30 (Sa2 in Fig. 6), the machine learning model 30 generates hint information H based on the prompt Dx (Sa3 in S6).

[0065] It should be noted that the prompt Dx includes more than the real image Gx and the instruction string Sx. For example, the prompt Dx may include word-of-mouth information about the location where the real image Gx was photographed (the photographing position Px shown in FIG. 7(a) described later) and the treasure location Pt. The above word-of-mouth information is acquired, for example, from the map system 40. With the above configuration, word-of-mouth information may be reflected in the hint information H. For example, assume that the prompt Dx includes word-of-mouth information that "the treasure location Pt gets crowded around noon." In this case, the hint information H may include a string that reads, "Let's go to a place where lots of people gather around noon."

[0066] According to the present embodiment described above, the hint information H is generated by the machine learning model 30 using the real image Gx acquired from the map system 40. Therefore, compared to a configuration in which all the hint information H is created by a developer himself, for example, there is an advantage that the work time required to create the hint information H is shortened.

[0067] As will be described in detail later, in this embodiment, the closer the distance from the user position Pr to the treasure position Pt (hereinafter simply referred to as "distance Lt"), the more likely it is that hint information H that allows the user to easily identify the treasure position Pt will be generated. Specifically, as will be described below, the type of real image Gx included in the prompt Dx changes depending on the distance Lt (see FIG. 7(b)). Also, the instruction string Sx included in the prompt Dx changes depending on the distance Lt (see FIG. 8).

[0068] 7(a) and 7(b) are diagrams for explaining a specific example of a real image Gx used when generating hint information H. In the above-described FIGS. 7(a) and 7(b), it is assumed that the real space Sr is looked down vertically. In FIGS. 7(a) and 7(b), a user position Pr and a treasure position Pt are shown. In addition, in FIGS. 7(a) and 7(b), each photographing position Px (1 to 5) is shown. The real image Gx photographed from the above-described photographing position Px can be acquired from the map system 40.

[0069] In this embodiment, the real image Gx used when generating the hint information H changes depending on the distance Lt from the user position Pr to the treasure position Pt. Specifically, a range (Ra1, Ra2, Ra3 described below) from the treasure position Pt to a predetermined distance is set as the analysis range Ra. In addition, a prompt Dx is created using the real image Gx at the shooting position Px inside the analysis range Ra, and the hint information H is generated.

[0070] In the above configuration, the closer the distance Lt at the time when the hint information H is generated, the narrower the analysis range Ra (changing in the order Ra1 (approximately 100 meters) → Ra2 (approximately 50 meters) → Ra3 (approximately 10 meters)). In other words, the closer the distance Lt from the user position Pr to the treasure position Pt, the more the real image Gx used when generating the hint information H is limited to the periphery of the treasure position Pt (the real image Gx of the shooting position Px far from the treasure position Pt is excluded).

[0071] Figure 7(a) assumes that the distance Lt from the user position Pr to the treasure position Pt is greater than approximately 300 meters. When the distance Lt is greater than approximately 300 meters (Lt>300 meters), the analysis range Ra1 is set to approximately 100 meters from the treasure position Pt. In the specific example of Figure 7(a), it is assumed that of the photographing positions Px, photographing positions Px1 and Px2 are located inside the analysis range Ra1, and photographing position Px5 is located outside the analysis range Ra1.

[0072] In the above cases, the real image Gx at the shooting position Px1 and the real image Gx at the shooting position Px2 can be used when creating the hint information H. On the other hand, the real image Gx at the shooting position Px5, which is far from the treasure position Pt, is not used when creating the hint information H. This will be described in detail using FIG. 7(b), but in this embodiment, the narrower the analysis range Ra (the shorter the distance Lt), the more hint information H is generated from the shot image Gx at the shooting position Px that is closer to the treasure position Pt, and therefore the more likely it is that hint information H that can identify the treasure position Pt will be generated.

[0073] In this embodiment, a predetermined number of photographing positions Px are randomly determined from the photographing positions Px located within the analysis range Ra, and hint information H is generated using the real image Gx at the photographing positions Px and the real image Gx at the treasure position Pt. However, the method for determining the photographing positions Px is not limited to the above example. For example, the photographing positions Px may be determined based on word-of-mouth information at each photographing position Px.

[0074] The hint information H generated using the real image Gx may include information suggesting the shooting position Px (part of the analysis range Ra) where the real image Gx was captured. Therefore, according to the above-described embodiment, the hint information H that allows the position (direction) of the analysis range Ra to be estimated is generated, and the user who is outside the analysis range Ra can be guided toward the analysis range Ra (treasure position Pt). However, even if the hint information H is generated from the real image Gx captured at the shooting position Px inside the analysis range Ra, the user may end up taking an unnecessary detour depending on the shooting position Px.

[0075] For example, FIG. 7(a) shows a range Rd in the direction (the direction of the treasure location Pt) that the user should move in to reach the treasure location Pt. The range Rd can be determined by bisectoring a line passing through the user location Pr and the treasure location Pt and defining an angle (e.g., a 45° angle) with the user location Pr as the vertex. In the specific example of FIG. 7(a), it is assumed that, of the image capture positions Px (1-4) in the analysis range Ra, image capture positions Px1 and Px2 are located inside the range Rd, while image capture position Px4 is located outside the range Rd. In this case, if hint information H were generated using image capture position Px4, the user would likely have to take a detour to reach the treasure location Pt.

[0076] Considering the above circumstances, this embodiment employs a configuration in which hint information H is generated from a captured image Gx at a capturing position Px located inside the range Rd of the analysis range Ra. For example, in the specific example of FIG. 7(a), the real image Gx captured at a capturing position Px4 among the capturing positions Px in the analysis range Ra is not used when generating hint information H. According to the above embodiment, it becomes difficult to generate hint information H in which the user moves to the treasure position Pt by taking a detour.

[0077] Also, let us assume a configuration in which hint information H can be generated from a real image Gx of a shooting position Px (for example, Px3 in FIG. 7(a)) that is located behind the treasure position Pt as seen from the user position Pr. With hint information H of the above configuration, some users may experience the inconvenience of passing over the treasure position Pt. Taking the above circumstances into consideration, this embodiment employs a configuration in which hint information H is generated from a real image Gx of a shooting position Px that is located in front of the treasure position Pt as seen from the user position Pr, among the shooting positions Px in the analysis range Ra.

[0078] Specifically, a configuration is adopted in which hint information H is generated from a real image Gx of a shooting position Px that is perpendicular to a line passing through the user position Pr and the treasure position Pt and is located on the side of the user position Pr as viewed from a line (line B in FIG. 7(a)) passing through the treasure position Pt. For example, in the specific example of FIG. 7(a), of the shooting positions Px in the analysis range Ra, shooting position Px3 is located further back than line B (treasure position Pt) as viewed from the user position Pr. Therefore, the real image Gx of shooting position Px3 is not used when generating hint information H. According to the above-described embodiment, the inconvenience of generating hint information H in which the user moves to the treasure position Pt by a detour is suppressed.

[0079] FIG. 7(b) is a diagram for explaining a detailed specific example of the real image Gx used when generating the hint information H. In this embodiment, the shorter the distance Lt from the user position Pr to the treasure position Pt, the easier the hint information H is generated for the user to identify the treasure position Pt. For example, in the specific example of FIG. 7(a) described above, it is assumed that the distance Lt from the user position Pr to the treasure position Pt is greater than approximately 300 meters. In this case, the analysis range Ra1 is approximately 100 meters from the treasure position Pt.

[0080] On the other hand, in the specific example of FIG. 7(b), it is assumed that the distance Lt from the user position Pr to the treasure position Pt is between 100 meters and 51 meters. In this case, the analysis range Ra3 is approximately 10 meters from the treasure position Pt. That is, as the user position Pr approaches the treasure position Pt, the analysis range Ra becomes narrower. Therefore, as the user position Pr approaches the treasure position Pt, the real image Gx used when generating the hint information H is limited to the real image Gx of the shooting position Px close to the treasure position Pt.

[0081] For example, in the specific example of FIG. 7(a) described above, it is assumed that both the shooting positions Px1 and Px2 are located inside the analysis range Ra1. In this case, both the real image Gx1 at the shooting position Px1 and the real image Gx2 at the shooting position Px2 can be used when generating the hint information H. On the other hand, in the specific example of FIG. 7(b), it is assumed that the shooting position Px2 is located inside the analysis range Ra3, and the shooting position Px1 is located outside the analysis range Ra3. In this case, the real image Gx2 at the shooting position Px2 is used when generating the hint information H, but the real image Gx1 at the shooting position Px1, which is farther from the treasure position Pt than the shooting position Px2, is not used.

[0082] 7(b) shows a schematic diagram of a specific example of a real image Gx1 at the shooting position Px1 and a real image Gx2 at the shooting position Px2. In the specific examples of FIGS. 7(a) and 7(b), it is assumed that the real image Gx1 at the shooting position Px1 includes a "brick building." It is also assumed that the real image Gx2 at the shooting position Px2 includes an "ocean."

[0083] In the above case, in the specific example of FIG. 7(a) where the distance Lt from the user position Pr to the treasure position Pt is greater than approximately 300 meters, the hint information H is generated from both the real image Gx1 and the real image Gx2, so for example, both the character string "brick building" and the phrase "ocean" may be included in the hint information H. With the above hint information H, it may not be possible to determine whether the treasure position Pt is near the "brick building" (photographing position Px1) or the "ocean" (photographing position Px2).

[0084] On the other hand, in the specific example of FIG. 7(b) where the distance Lt from the user position Pr to the treasure position Pt is shorter than approximately 100 meters, the hint information H is generated only from the real image Gx2 out of the real images Gx1 and Gx2. Therefore, for example, only the word "sea" out of the character string "brick building" and the word "sea" may be included in the hint information H. From the above hint information H, it is determined that the treasure position Pt is near the "sea" (photographing position Px2).

[0085] According to the present embodiment, the shorter the distance Lt from the user position Pr to the treasure position Pt, the easier it is to generate hint information H that can specifically identify the treasure position Pt. This prevents the user from moving away from the treasure position Pt after arriving near the treasure position Pt. In other words, the user can be appropriately guided to the treasure position Pt.

[0086] FIG. 8 is a diagram illustrating a specific example of a prompt Dx for causing the machine learning model 30 to generate hint information H. As described above, in this embodiment, a configuration is adopted in which the shorter the distance Lt from the user position Pr to the treasure position Pt, the more the analysis range Ra is limited to the vicinity of the treasure position Pt, making it easier to generate hint information H that can identify the treasure position Pt (see FIGS. 7(a) and 7(b) above). In addition to the above configuration, this embodiment also adopts a configuration in which the instruction string Sx of the prompt Dx is switched depending on the distance Lt from the user position Pr to the treasure position Pt. The above configuration will be described in detail below.

[0087] As shown in FIG. 8, when the distance Lt is longer than 300 meters, an analysis range Ra1 (approximately 100 meters) is set, and a prompt Dx is generated that includes a real image Gx at a shooting position Px in the range Rd (see FIG. 7(a) above) within the analysis range Ra1. The prompt Dx also includes, for example, an instruction string Sx such as, "Please use the real image Gx captured at the shooting position Px (position information) to generate a hint for getting to the treasure position Pt, which will tell you the direction of the treasure position Pt (position information) as seen from the user position Pr (position information)." While it is difficult to identify the specific location of the treasure position Pt from the prompt Dx (instruction string Sx), it is easy to generate hint information H that identifies the direction to go. For example, as shown in FIG. 8, hint information H such as, "It looks like it's in the direction of... (east, west, north, south)" can be generated.

[0088] 8, when the distance Lt is equal to or greater than 300 meters and equal to or less than 101 meters, an analysis range Ra2 (approximately 50 meters) is set, and a prompt Dx is created that includes a real image Gx at the shooting position Px in the range Rd of the analysis range Ra2. The prompt Dx also includes an instruction string Sx such as, "Using the real image Gx captured at the shooting position Px, please generate a hint for getting to the treasure position Pt that shows the direction of the treasure position Pt as seen from the user position Pr and the scenery that can be seen from the treasure position Pt or the shooting position Px."

[0089] From the above prompt Dx (instruction string Sx), hint information H that identifies the direction to go in order to reach the treasure position Pt is likely to be generated (similar to the prompt Dx when the distance Lt is greater than 300 meters). Furthermore, the above hint information H includes information about the scenery (e.g., the sea) that can be seen from the treasure position Pt or the shooting position Px (around the treasure position Pt), and the treasure position Pt may be identified from the scenery. Therefore, when the distance Lt is greater than or equal to 101 meters and less than 300 meters, hint information H that can identify the treasure position Pt is more likely to be generated than when the distance Lt is greater than 300 meters. For example, if the real image Gx at the treasure position Pt includes "the sea," hint information H that says, "...Let's go to a place where you can see the sea" may be generated.

[0090] 8, when the distance Lt is equal to or greater than 51 meters and equal to or less than 100 meters, an analysis range Ra3 (approximately 10 meters) is set, and a prompt Dx is created that includes a real image Gx at the shooting position Px in the range Rd of the analysis range Ra3. The prompt Dx also includes an instruction string Sx such as, "Using the real image Gx captured at the shooting position Px, please generate a hint for getting to the treasure position Pt that shows the direction of the treasure position Pt as seen from the user position Pr, the scenery visible from the treasure position Pt or the shooting position Px, and the facility where the treasure position Pt or the shooting position Px is located."

[0091] The above prompt Dx (instruction string Sx) is likely to generate hint information H that allows guessing the facility where the treasure location Pt or the photographing location Px is located, in addition to the direction to go to reach the treasure location Pt and the scenery visible from the treasure location Pt or the photographing location Px. Therefore, when the distance Lt is 51 meters or more and 100 meters or less, hint information H that allows identification of the treasure location Pt is more likely to be generated than when the distance Lt is greater than 100 meters. For example, if the real image Gx at the photographing location Px includes a "brick building," hint information H such as "...the brick building is the landmark" may be generated. According to the above prompt Dx (instruction string Sx), the effect of generating hint information H that allows identification of the treasure location Pt becomes particularly pronounced the closer the distance Lt from the user position Pr to the treasure location Pt is.

[0092] However, in a configuration in which hint information H is generated by the machine learning model 30, the possibility of generating hint information H that leads the user away from the treasure position Pt cannot be completely eliminated. For example, consider a configuration in which hint information H generated by the machine learning model 30 is notified to a user who has already reached the treasure position Pt. In the above configuration, there may be an inconvenience in that hint information H is generated that leads the user, who has taken the trouble to reach the treasure position Pt, away from the treasure position Pt.

[0093] In order to alleviate the above inconveniences, this embodiment employs a configuration in which, when the distance Lt to the treasure position Pt is equal to or less than a predetermined distance, predetermined hint information H is displayed instead of the hint information H generated by the machine learning model 30. Specifically, as shown in Fig. 8, when the distance Lt to the treasure position Pt is 50 meters or less, the hint information H saying "The treasure is right in front of you! Search for it in AR mode" is displayed.

[0094] That is, if an item image Gi is provided at an event spot ves corresponding to a treasure position Pt, when the user moves within the selectable range rsa (approximately 50 meters) of the item image Gi, the hint information H is notified, saying, "The treasure is right in front of you! Let's search for it in AR mode." The hint information H is not generated by the machine learning model 30 but is predetermined. The above configuration reduces the above-mentioned inconvenience. However, the distance Lt at which the hint information H is displayed is not limited to the above example (approximately 50 meters). For example, the hint information H may be notified when the distance Lt to the treasure position Pt is closer than 50 meters (for example, approximately 30 meters).

[0095] 9(a) is a schematic diagram of a specific example of an AR screen Mar displayed in AR mode. As shown in FIG. 9(a), the AR screen Mar includes each object Gr in the real space Sr captured by the camera of the terminal device 10.

[0096] When the AR mode is started, the terminal device 10 identifies the type of each object Gr included in the captured image. Specifically, the terminal device 10 segments (classifies) each object Gr included in the captured image. AI technology may be employed for the above segmentation. For example, each object in the captured image may be segmented using trained FCN (Fully Convolutional Networks) (for example, the technology described in Japanese Patent Application Laid-Open No. 2022-29169 may be employed). The specific example of FIG. 9(a) assumes a case where each object Gr including a floor object Grg and a wall object Grw is identified from each object Gr.

[0097] Immediately after switching to the AR mode, the process for identifying each object Gr (hereinafter referred to as the "identification process") has not been completed. Also, immediately after switching to the AR mode, the shooting range for identifying each object Gr may not be sufficient. In consideration of the above circumstances, a configuration may be adopted in which a message such as "Please take your time to photograph your surroundings" is displayed immediately after switching to the AR mode. The message is hidden when the identification process is completed. Note that in this embodiment, a search operation, which will be described later, is not accepted until the identification process is completed.

[0098] As shown in FIG. 9(a), a shovel image Gs is displayed as a virtual object on the AR screen Mar. The shovel image Gs is displayed in front of the user in the augmented reality AR. Also, a button Bd and a button Be are displayed on the AR screen Mar. When the button Be is selected, the AR mode ends, and the AR screen Mar (augmented reality AR) is switched to a map screen Mp (virtual space Sv).

[0099] When the button Bd on the AR screen Mar is selected (touched), the shovel image Gs digs up a floor object in the augmented reality AR. If the user position Pr is located at the treasure position Pt, selecting the button Bd starts a discovery event in which a treasure chest image Gt is excavated in the augmented reality AR (see FIG. 9(b) described below). On the other hand, if the user position Pr is not located at the treasure position Pt, selecting the button Bd displays a shovel image Gs being bounced off an object in the virtual reality AR. Hereinafter, the operation for starting the discovery event (selecting the button Bd in the specific example of FIG. 9(a)) may be referred to as a "search operation."

[0100] As shown in Fig. 9(a), a distance image Gd is displayed on the AR screen Mar. The distance image Gd is displayed in a manner that corresponds to the distance Lt from the user position Pr to the treasure position Pt. Specifically, as shown in Fig. 9(a), the distance image Gd includes an initial position Ta, a destination position Tb, and a character C. The display position of the character C in the distance image Gd changes depending on the distance Lt from the user position Pr to the treasure position Pt.

[0101] For example, if the distance Lt to the treasure position Pt is farther than about 50 meters, the character C is displayed at the initial position Ta in the distance image Gd. On the other hand, if the distance Lt is closer than 50 meters, the character C is displayed closer to the destination position Tb than the initial position Ta. Specifically, the character C moves in conjunction with changes in the distance Lt to the treasure position Pt, and the closer the distance Lt is, the closer the character C is displayed to the destination position Tb.

[0102] The distance image Gd described above makes it easier for the user to reach the treasure position Pt quickly in AR mode. Let us assume a configuration in which the distance image Gd is not displayed in AR mode. In this configuration, the user may have to travel for a long time while capturing images of the real space Sr in AR mode, which may be inconvenient for other passersby. This embodiment can prevent this inconvenience.

[0103] 9(b) is a schematic diagram of another specific example of the AR screen Mar displayed in AR mode. The specific example of FIG. 9(b) assumes that the user position Pr has reached the treasure position Pt, a search operation has been performed (button Bd has been selected), and a discovery event has started.

[0104] In this embodiment, even if the user position Pr and the treasure position Pt do not match, a discovery event can be started if the user position Pr is within a predetermined distance from the treasure position Pt. For example, a range of approximately 10 meters from the treasure position Pt is set as the selectable range rsa of the treasure position Pt. If the user position Pr is within the selectable range rsa of the treasure position Pt, a discovery event is started in response to a search operation.

[0105] Note that instead of the configuration in which the character C in the distance image Gd moves to the destination position Tb when the user reaches the treasure position Pt, a configuration in which the character C moves to the destination position Tb when the user reaches the selectable range rsa of the treasure position Pt may be adopted. As will be described in detail later, the selectable range rsa is set variably according to the position attribute assigned to the treasure position Pt (see FIG. 12(a)).

[0106] In a discovery event, various virtual objects (such as a treasure chest image Gt) are displayed in the augmented reality AR. For example, in the discovery event in the specific example of FIG. 9(b), a hole image Ga is displayed superimposed on a floor object Grg. In addition, in the above discovery event, a treasure chest image Gt emerging from the hole image Ga is displayed, and a message image Gm is displayed above the treasure chest image Gt. Note that, as will be described in detail later, in this embodiment, the type of discovery event (the type of virtual object displayed) changes depending on the position attribute of the treasure position Pt.

[0107] The message image Gm in a discovery event displays information about the treasure item that will be given to the user in the discovery event. Specifically, as shown in FIG. 9(b), the message image Gm displays the name of the treasure item that will be given to the user. In the specific example of FIG. 9(b), it is assumed that a "local item X" has been obtained. Treasure items that can be obtained in AR mode are limited items that cannot be obtained in virtual space mode (map screen Mp). Note that the information displayed in the message image Gm is not limited to the above examples. For example, instructions on how to use the treasure item that will be given to the user may be displayed in the message image Gm.

[0108] As shown in FIG. 9(b), after the discovery event starts, each button B (d, e) is displayed grayed out and cannot be selected. Specifically, after the discovery event starts and each object including the message image Gm is displayed for a predetermined time (for example, about 5 seconds), the AR mode ends and the AR screen Mar (virtual space AR) is automatically switched to the map screen Mp (virtual space Sv). With the above configuration, for example, compared to a configuration in which the AR mode must be manually ended after the discovery event ends, the time the user has to stop at the treasure location Pt is shortened. Therefore, there is an advantage in that the inconvenience of the user obstructing other passersby is suppressed.

[0109] Furthermore, as described above, in AR mode, the user needs to keep looking at the screen of the terminal device 10 in order to capture the real space Sr using the terminal device 10. Therefore, since the user cannot fully check the surroundings in AR mode, there is a situation where the user is likely to get in the way of other passersby when traveling long distances in AR mode. In consideration of the above, this embodiment employs a configuration in which the game is progressed in virtual space mode when the user travels long distances, and the game is progressed in AR mode limited to the vicinity of the treasure position Pt. The above configuration will be described in detail below.

[0110] 10 is a diagram illustrating specific examples of conditions for acquiring each item (normal item, treasure item). As described above, in this embodiment, the user can acquire various items, including normal items and treasure items. However, the items that can be acquired change depending on whether the mode is AR mode or virtual space mode.

[0111] For example, as shown in Fig. 10, among the items, normal items can be obtained in the virtual space mode. Specifically, normal items (normal item images Giu) are arranged on the map screen Mp (see Fig. 4 above) representing the virtual space Sr. Furthermore, when the user moves into the selectable range rsa of the normal item, the normal item can be obtained.

[0112] On the other hand, normal items cannot be acquired in AR mode. Specifically, normal items are hidden on the AR screen Mar in AR mode. That is, even if the augmented reality AR displayed on the AR screen Mar includes an event spot res where a normal item is placed, the normal item is not displayed on the AR screen Mar.

[0113] On the other hand, as shown in FIG. 10, among the items, the treasure item can be obtained in AR mode. Specifically, the treasure item can be obtained in a discovery event on the AR screen Mar representing the augmented reality AR (see FIG. 9(b) above). On the other hand, the treasure item cannot be obtained in virtual space mode. Specifically, the treasure item (treasure position Pt) is not displayed on the map screen Mp in virtual space mode. Furthermore, even if the user is located within the selectable range rsa of the treasure item (treasure position Pt), the discovery event does not start in virtual space mode, and the treasure item cannot be obtained.

[0114] With the above configuration, the user moves to the treasure location Pt while acquiring normal items in the virtual space mode, and then switches to the AR mode at the treasure location Pt to acquire the treasure item. This reduces the inconvenience of the user having to travel long distances in the AR mode.

[0115] However, if the selectable range rsa of normal items is narrow, it is necessary to pass close to the normal items (res). Therefore, if the selectable range rsa of normal items is narrow, the route to move to the treasure position Pt while obtaining the normal items is likely to be complicated. If the route to move to the treasure position Pt is complicated, there is the inconvenience that the user's movement line in the real space Sr is likely to become unnatural.

[0116] For example, FIG. 10(b-1) is a diagram illustrating a specific example of a route K to a treasure location Pt in a comparative example of this embodiment. In the comparative example above, it is assumed that the selectable range rsa of a normal item is substantially the same as the selectable range rsa of a treasure item (approximately 10 meters). Furthermore, the specific example of FIG. 10(b-1) assumes a route K that travels from the user location Pr to the treasure location Pt (selectable range rsa3) via the selectable range rsa1 and the selectable range rsa2. The route K in the comparative example above is complex, requiring the user to change direction multiple times before reaching the treasure location Pt. Therefore, the user's movement line in the real space Sr may become unnatural, which may cause inconvenience.

[0117] In order to prevent the above inconveniences, in this embodiment, the selectable range rsa of a normal item is wider than the selectable range rsa of a treasure item. Specifically, the selectable range rsa of a normal item is a range of approximately 50 meters from the event spot res where the normal item is placed. On the other hand, the selectable range rsa of a treasure item is a range of approximately 10 meters from the event spot res where the treasure item is placed (treasure position Pt) (however, as will be described later, the selectable range rsa of a treasure item may change depending on the position attribute of the treasure position Pt).

[0118] FIG. 10(b-2) is a diagram illustrating a specific example of a path K to a treasure location Pt in this embodiment. Similar to the specific example of FIG. 10(b-1) in the comparative example described above, the specific example of FIG. 10(b-2) assumes a path K that travels to a treasure location Pt(rsa3) via the selectable ranges rsa(1,2) of each normal item. As shown in FIG. 10(b-2), in this embodiment, the selectable range rsa(1,2) of the normal item is wider than the selectable range rsa3 of the treasure item, so the path K is a substantially straight line. As can be understood from the above explanation, this embodiment reduces the inconvenience of the user's movement line in the real space Sr becoming unnatural compared to the comparative example described above.

[0119] Note that the selectable range rsa for treasure items may be configured to be approximately 50 meters, similar to the selectable range rsa for normal items. Even with the above configuration, the inconvenience of the route required to move to the treasure location Pt while obtaining normal items becomes complicated is suppressed, as in this embodiment. However, with the above configuration, a new inconvenience arises in that the excitement of the treasure hunt event is diminished because treasure items can be easily found. According to this embodiment, the above inconvenience is suppressed. However, the present invention does not exclude a configuration in which the selectable range rsa for treasure items and the selectable range rsa for normal items are the same.

[0120] According to the present embodiment, when the user travels a long distance, the game proceeds in virtual space mode, and the game proceeds in AR mode limited to the area around the treasure location Pt. In addition to the above configuration, this embodiment also employs a configuration that makes it difficult to switch to AR mode more than necessary. Therefore, the effect of making it difficult for the user to obstruct other passersby is particularly noticeable. The above configuration will be described in detail below using FIG. 11.

[0121] FIG. 11 is a diagram for explaining a specific example of how a user discovers a treasure item. FIG. 11 shows the mode (such as the virtual space mode) at each point in time. For the sake of explanation, the mode in which the above-mentioned map screen Mm is displayed may be referred to as the "map screen mode." The above-mentioned map screen mode can also be described as a mode in which the virtual space Sv and the augmented reality AR are not displayed. Specifically, even if the user moves during the map screen mode, the screen of the terminal device 10 does not change in principle. FIG. 11 also shows the period in which the above-mentioned distance image Gd (see FIG. 9(a)) is displayed. Furthermore, FIG. 11 indicates the period in which the user U moves with an arrow.

[0122] In a treasure event, the user U predicts a treasure location Pt where a treasure item can be obtained. In the specific example of FIG. 11, it is assumed that the user U reaches the location predicted to be the treasure location Pt (hereinafter, simply referred to as the "predicted location") at time t1. In addition, in the specific example of FIG. 11, it is assumed that the user U moves in a virtual space mode in which a normal item can be obtained during the period up to time t1.

[0123] Treasure items can be obtained in AR mode. Also, by selecting the AR mode start button Ba (see FIG. 5(b) above) on the map screen Mm displayed in map screen mode, it is possible to switch to AR mode. Also, by selecting the map display button Bm (see FIG. 4 above) on the map screen Mp in virtual space mode, it is possible to display the map screen Mm (it is possible to switch to map screen mode). In the above configuration, a user U who has been playing the game in virtual space mode will first switch to map screen mode and then switch to AR mode in order to obtain a treasure item.

[0124] As described above, in the map screen mode, hint information H for guessing the treasure position Pt is displayed (see FIG. 5(b)). In the above configuration, the user U checks the hint information H in the map screen mode before switching to the AR mode. That is, the user U can check whether the treasure position Pt guessed from the hint information H actually matches the predicted position (current location) without switching to the AR mode. If the user U determines from the hint information H that the current location is not the treasure position Pt (the prediction was wrong), the user U can switch back to the virtual space mode without switching to the AR mode and move to another location.

[0125] 11, it is assumed that the user U realizes from the hint information H that the predicted position reached at time t1 is not the treasure position Pt. In the above case, without switching to the AR mode, another predicted position is determined from the hint information H, and the user U moves to the predicted position.

[0126] In the specific example of FIG. 11, it is assumed that the user U reaches another predicted position at a later time point t2. In this case, the user U switches from the virtual space mode to the map screen mode again. Also, in the specific example of FIG. 11, it is assumed that the user U determines, based on the hint information H in the map screen mode, that the current location at time point t2 may be the treasure position Pt. In this case, the map screen mode is switched to the AR mode, in which a treasure item can be obtained.

[0127] As shown in Figure 11, the distance image Gd described above is displayed in AR mode. Furthermore, the distance image Gd allows the user to immediately determine whether the distance from the user's current location to the treasure location Pt is greater than approximately 50 meters. Specifically, when the character C is located at the initial position Ta in the distance image Gd, it is determined that the distance from the user's current location to the treasure location Pt is greater than approximately 50 meters (see Figure 9(a)).

[0128] In the specific example of FIG. 11, it is assumed that the predicted position reached at time t2 is more than 50 meters away from the treasure position Pt. In this case, immediately after switching to AR mode, the user U will understand from the distance image Gd that the distance from the current location to the treasure position Pt is farther than 50 meters. Having realized that the distance from the current location to the treasure position Pt is farther than 50 meters, the user U will switch from AR mode back to virtual space mode and move to another predicted position. This configuration reduces the inconvenience of playing the game in AR mode for a long period of time far from the treasure position Pt, compared to a configuration in which the distance to the treasure position Pt cannot be determined immediately after switching to AR mode.

[0129] In the specific example of FIG. 11, it is assumed that the user U reaches another predicted position at a later time point t3. In this case, the user U switches from the virtual space mode to the map screen mode again. In addition, in the specific example of FIG. 11, it is assumed that the user U determines that the current location may be the treasure location Pt based on the hint information H in the map screen mode. In this case, the map screen mode is switched to the AR mode in which a treasure item can be obtained.

[0130] 11, it is assumed that the predicted position reached at time t3 is within a range of approximately 50 meters from the treasure position Pt. As described above, the user U can determine from the distance image Gd that the treasure position Pt is within a range of approximately 50 meters from the current location. Specifically, if the treasure position Pt is within a range of approximately 50 meters from the current location, the character C in the distance image Gd is displayed closer to the destination position Tb than the initial position Ta.

[0131] In AR mode, the user U moves in a direction that moves the character C in the distance image Gd closer to the destination position Tb. When the character C reaches the destination position Tb (when the user moves within the selectable range rsa of the treasure position Pt), the user U performs a search operation. A discovery event is initiated in response to the above search operation. When the discovery event is initiated in AR mode, a treasure item is given to the user U, and the mode is automatically switched to virtual space mode.

[0132] According to the present embodiment, the time during which the game is played in AR mode is likely to be minimized. Therefore, the inconvenience of the user disturbing other passersby is reduced. The distance image Gd may also be displayed in the virtual space mode. With the above configuration, the inconvenience of the AR mode being prolonged is reduced, as with the present embodiment.

[0133] However, if the distance image Gd is displayed even in the virtual space mode, the treasure position Pt can be easily predicted, which may cause a new inconvenience, reducing the excitement of the treasure hunt event. Furthermore, if the distance image Gd is displayed even in the virtual space mode, the user may be forced to focus on the distance image Gd while moving in the virtual space mode. This embodiment, in which the distance image Gd is displayed only in the AR mode out of the virtual space mode and the AR mode, has the advantage of being able to suppress the above-mentioned inconveniences while suppressing the inconvenience of the AR mode being extended for a long period of time.

[0134] 12(a) is a diagram illustrating a specific example of a condition for acquiring a treasure item in AR mode. As described above, a location attribute (such as a deep sea attribute) is assigned to the treasure location Pt. In this embodiment, depending on the combination of the user's attribute (such as an item possessed) and the location attribute of the treasure location Pt, the treasure item may or may not be acquired.

[0135] The location attributes assigned to the treasure location Pt include "no attribute," "deep sea attribute," "water attribute," "flight attribute," and "far attribute." The management device 20 determines the treasure location Pt from the target range Rt (see FIG. 5(a)) and determines the location attribute of the treasure location Pt based on the map information (land, sea, river, etc.) at the treasure location Pt. For example, if the treasure location Pt is on land, the location attribute of the treasure location Pt is determined to be "no attribute."

[0136] Furthermore, if the treasure location Pt is in the ocean, the location attribute of the treasure location Pt is determined to be a "deep sea attribute," and if the treasure location Pt is in a river, the location attribute of the treasure location Pt is determined to be a "water attribute." Furthermore, in some cases where the treasure location Pt is on land, the location attribute of the treasure location Pt is determined to be a "flight attribute" or a "distant attribute." For example, if the treasure location Pt is in a high-rise facility or near the top of a mountain, the location attribute of the treasure location Pt is determined to be a "distant attribute." Furthermore, if a predetermined event spot res (e.g., an airport) is determined to be the treasure location Pt, the location attribute of the treasure location Pt is determined to be a "flight attribute."

[0137] 12(a), it is assumed that the position attribute of treasure position Pt1 (X1, Y1) is "no attribute." It is also assumed that the position attribute of treasure position Pt2 (X2, Y2) is "deep sea attribute," the position attribute of treasure position Pt3 (X3, Y3) is "water attribute," the position attribute of treasure position Pt4 (X4, Y4) is "flying attribute," and the position attribute of treasure position Pt5 (X5, Y5) is "far attribute."

[0138] FIG. 12(a) shows the location attributes of each treasure location Pt as well as the user attributes required to acquire a treasure item at that treasure location Pt. As described above, the selectable range rsa of the treasure location Pt (the range in which a discovery event can be started) may change depending on the location attributes of the treasure location Pt. FIG. 12(a) shows the selectable range rsa of each treasure location Pt. Furthermore, the discovery event at that treasure location Pt changes depending on the location attributes of the treasure location Pt. FIG. 12(a) shows an overview of each discovery event that can be started at each treasure location Pt.

[0139] As shown in FIG. 12(a), if the position attribute of the treasure position Pt is "no attribute," when the user reaches the treasure position Pt, the user can obtain a treasure item regardless of the user's attributes. Also, in a discovery event when the position attribute is "no attribute," a treasure chest appears from the floor object in the augmented reality (AR), and the treasure item is given to the user. Note that FIG. 9(b) above shows a specific example of a discovery event when the position attribute is "no attribute." The selectable range rsa of a treasure position Pt with a position attribute of "no attribute" is set to a range of approximately 10 meters from the treasure position Pt.

[0140] Specifically, when the position attribute of the treasure position Pt is "no attribute," if the augmented reality AR captured by the terminal device 10 includes a floor object (if the ground is captured), a discovery event can be started. The configuration for determining whether the augmented reality AR captured by the terminal device 10 includes a floor object can be changed as appropriate. For example, it may be determined whether the floor object has been identified by the above-described identification process. Alternatively, it may be configured to determine whether the attitude of the terminal device 10 at the time the search operation is executed is such that the floor object can be captured, and to start a discovery event if the attitude is such that the floor object can be captured. The attitude of the terminal device 10 can be detected by the acceleration and direction sensor 106 described above.

[0141] If the position attribute of the treasure position Pt is "deep sea attribute," the selectable range rsa is set to a range of approximately 70 meters from the treasure position Pt. In other words, if the treasure position Pt is in the sea, the selectable range rsa is wider than if the treasure position Pt is on land (rsa = approximately 10 meters). This configuration prevents the user from getting too close to the sea. Note that the treasure position Pt will not be set to a position in the sea that is farther than 50 meters from the land. If the augmented reality AR captured by the terminal device 10 includes the sea, a discovery event can be started.

[0142] In this embodiment, a ship item is given to the user. The level of the ship item increases at a predetermined opportunity. For example, the level of the ship item increases according to the number of steps the user moves. If the location attribute of the treasure location Pt is "deep sea attribute," when the user reaches the treasure location Pt, the treasure item may or may not be obtainable depending on the level of the ship item possessed by the user (hereinafter simply referred to as "ship level").

[0143] Specifically, if the location attribute of the treasure location Pt is "deep sea attribute," and the ship level is at its maximum value, a discovery event will start and a treasure item will be awarded to the user. In this discovery event, a treasure chest (virtual object) will appear from the sea (see FIG. 13(c) below). On the other hand, if the ship level is lower than the maximum value, the discovery event will not start and no treasure item will be awarded even if the user reaches the treasure location Pt.

[0144] For example, if the ship level is less than the number N ("N" is a number smaller than the maximum ship level), no special event will be initiated at the treasure position Pt. On the other hand, if the ship level is smaller than the maximum but greater than the number N, a notification event will be initiated at the treasure position Pt in the augmented reality (AR). The notification event is an event for informing the user that treasure is hidden at the treasure position Pt (see FIG. 13(b) described below).

[0145] If the position attribute of the treasure position Pt is "water attribute," the selectable range rsa is set to approximately 70 meters from the treasure position Pt. In other words, if the treasure position Pt is a river, the selectable range rsa is wider than if the treasure position Pt is on land (rsa = approximately 10 meters). With the above configuration, it is possible to prevent the user from getting too close to a river. If the augmented reality AR captured by the terminal device 10 includes a river, a discovery event can be started.

[0146] In this embodiment, multiple types of ally characters can be assigned to the user. The ally characters include a swimming skill character, a flying skill character, a telephoto skill character, and a fire attribute character. The ally characters can be acquired by progressing through the game. When the position attribute of the treasure position Pt is "water attribute," if the user possesses a swimming skill character among the ally characters, a discovery event can be started. In the discovery event, a treasure chest (virtual object) floating in a river is displayed in augmented reality (AR).

[0147] Furthermore, even if the user possesses a swimming skill character, if the ship level is equal to or greater than the value N, or if the user possesses a special item, the above-mentioned discovery event can be started at a treasure location Pt whose location attribute is "water attribute," and a treasure item is granted to the user. The above-mentioned special item is granted to the user, for example, when a special event (e.g., a hint granting event, described below) is cleared. On the other hand, if the user possesses neither a swimming skill character nor a special item, and the ship level is less than the value N, the discovery event does not start and the treasure item cannot be obtained.

[0148] 12(a), when the position attribute of the treasure position Pt is "flight attribute," the selectable range rsa is set to approximately 50 meters from the treasure position Pt. Also, when the augmented reality AR captured by the terminal device 10 includes the sky, a discovery event can be started. Specifically, it is determined whether the attitude of the terminal device 10 is such that the sky can be captured, and when the attitude is such that the sky can be captured, a discovery event can be started.

[0149] If the location attribute of the treasure location Pt is "flight attribute," a discovery event can be initiated if the user has a flying skill character among their allied characters. In the discovery event, a flying skill character is displayed retrieving a treasure chest floating in the sky in augmented reality (AR). On the other hand, if the user does not have a flying skill character, the discovery event will not be initiated at the treasure location Pt.

[0150] When the position attribute of the treasure position Pt is "distant attribute," if the user possesses a character with telephoto skill among the ally characters, a discovery event can be started. Specifically, regardless of the user's position in the real space Sr, if the augmented reality AR captured by the terminal device 10 includes the treasure position Pt (high-rise facility, mountaintop), the discovery event can be started. In the discovery event described above, a treasure chest is enlarged and displayed at the treasure position Pt (e.g., mountaintop) in the augmented reality AR. On the other hand, if the user does not possess a character with telephoto skill, the discovery event will not be started. However, even if the user does not possess a character with telephoto skill, a smaller treasure chest compared to the treasure chest in the discovery event will be displayed at the treasure position Pt in the augmented reality AR.

[0151] Furthermore, if the user possesses a character with a telephoto skill among the ally characters, information regarding the treasure position Pt will be notified to the user in AR mode even if the position attribute of the treasure position Pt is other than the "far attribute." FIG. 12(b) is a specific example of a distance image Gd displayed on the AR screen Mar when the user possesses a character with a telephoto skill. The specific example of FIG. 12(b) assumes a case where the position attribute of the treasure position Pt is other than the "far attribute." The specific example of FIG. 12(b) also assumes a case where the user is not located within the selectable range rsa of the treasure position Pt. In the above cases, a notification image Gmt is displayed on the distance image Gd. The above notification image Gmt displays information regarding the treasure position Pt. For example, the name of the facility at the treasure position Pt is displayed in the notification image Gd.

[0152] The information displayed in the notification image Gd is not limited to the above examples. For example, the notification image Gd may display the type of treasure item that can be acquired at the treasure position Pt. Furthermore, if the user has a telephoto skill character, even if the user is not located within the selectable range rsa of the treasure position Pt, the notification image Gd may be displayed in AR mode and a discovery event may be started (a treasure item may be acquired).

[0153] Returning to FIG. 12(a), the explanation will be made in detail. In the treasure hunt event, the management device 20 of this embodiment may set a hint position Ph in addition to the treasure position Pt. At the hint position Ph, a hint granting event can be started in AR mode (augmented reality). In the hint granting event, a treasure item is not granted, but special hint information H is notified to the user. For example, in the hint granting event, hint information H (for example, the name of the facility where the treasure position Pt is set) that can directly identify the treasure position Pt is notified. Note that the hint information H notified in the hint granting event may be configured to be displayed on the map screen Mm (hint image Gh) in the subsequent treasure hunt event.

[0154] Specifically, the management device 20 sets a position other than the treasure position Pt in the target range Rt as the hint position Ph. When the user moves within a range of a predetermined distance (for example, about 10 meters) from the hint position Ph and a search operation is accepted in the AR mode, a hint granting event is started.

[0155] However, the hint giving event is started on the condition that the user possesses a fire attribute character. In the hint giving event described above, hint information H is displayed on a predetermined object (floor object, wall object). Specifically, a fire attribute character that uses flames to expose a character string indicating the hint information H is displayed on an object in augmented reality AR. Note that the hint giving event may be configured to be able to start regardless of the user's attribute (such as the ally character possessed).

[0156] FIG. 13(a) is a diagram illustrating another specific example of the AR screen Mar. FIG. 13(a) assumes that the treasure position Pt is set on the sea. In the above case, as explained in FIG. 12(a) above, the position attribute of the treasure position Pt becomes the "deep sea attribute." The specific example of FIG. 13(a) also assumes that the user is located at the treasure position Pt. As explained above, when the user is located at the treasure position Pt, the character C is located at the target position (right end) of the distance image Gd.

[0157] FIG. 13(a) assumes the period immediately after a search operation to start a discovery event is accepted. However, the specific example of FIG. 13(a) assumes a case where the user's attributes do not satisfy the conditions for starting the discovery event (see FIG. 12(a) above). Specifically, it assumes a case where the user's ship level is less than the value N. In such a case, the discovery event will not start even if the user is located at the treasure location Pt.

[0158] When a search operation is accepted during a period in which the conditions for starting a discovery event are not satisfied, a message image Gm0 is displayed on the AR screen Mar. For example, if the user has not reached the selectable range rsa of the treasure location Pt, the message image Gm0 is displayed in response to the search operation. Furthermore, if the location attribute of the treasure location Pt is the "deep sea attribute" and the user's ship level is less than the numerical value N, the message image Gm0 is displayed in response to the search operation. The message image Gm0 is displayed for a predetermined time (for example, approximately 3 seconds), and displays a message to the effect that the treasure item cannot be discovered. It is preferable that new search operations are not accepted during the period in which the message image Gm0 is displayed.

[0159] Fig. 13(b) is a diagram illustrating yet another specific example of the AR screen Mar. Similar to the specific example of Fig. 13(a), the specific example of Fig. 13(b) assumes that the location attribute of the treasure location Pt is "deep sea attribute" and that the user is located at the treasure location Pt. However, the specific example of Fig. 13(b) assumes that the user's ship level is equal to or greater than the numerical value N and less than the maximum value. In these cases, the above-described notification event is initiated in response to the search operation (see Fig. 12(a)).

[0160] The specific example in FIG. 13(b) assumes a period during a notification event. In a notification event where the location attribute of treasure location Pt is "deep sea attribute," a ship image Gs1 is displayed at the treasure location Pt, and a message image Gm1 is displayed above the ship image Gs1. The message image Gm1 displays a message to notify the treasure location Pt in augmented reality (AR). However, the message image Gm1 does not notify the specific name of the treasure item.

[0161] However, as mentioned above, if the user's ship level is below the maximum value, the discovery event will not start and the treasure item will not be acquired. The ship image Gs1 and message image Gm1 are displayed for a predetermined time (for example, about 5 seconds) and then become hidden. Note that the notification event may be configured to notify the user of the condition for starting the discovery event (reaching the maximum ship level).

[0162] FIG. 13(c) is a diagram illustrating yet another specific example of the AR screen Mar. Similar to the specific examples of FIGS. 13(a) and 13(b), FIG. 13(c) assumes that the location attribute of the treasure location Pt is "deep sea attribute" and the user is located at the treasure location Pt. However, the specific example of FIG. 13(c) assumes that the user's ship level is at its maximum. In these cases, the above-described discovery event is initiated in response to a search operation (see FIG. 12(a)).

[0163] FIG. 13(c) illustrates a period during a discovery event. In a discovery event where the location attribute of the treasure location Pt is "deep sea attribute," a ship image Gs2 pulling a treasure chest out of the sea is displayed at the treasure location Pt, and a message image Gm2 is displayed above the ship image Gs2. The message image Gm2 displays information about the treasure item assigned to the user. For example, the message image Gm2 displays the name of the treasure item. As described above, when the discovery event in the augmented reality (AR) ends, the AR mode automatically ends and switches to the virtual space mode (map screen Mp).

[0164] 14(a) is a flowchart of the AR mode processing executed by the terminal device 10. In the AR mode, the terminal device 10 executes the AR mode processing. Note that each step of the AR mode processing may be executed by the terminal device 10 and the management device 20 in cooperation with each other, or may be executed by the management device 20.

[0165] When the AR mode process starts, the terminal device 10 executes the above-described identification process and starts displaying the AR screen Mar including the distance image Gd (S101). Thereafter, the terminal device 10 determines whether or not a selection operation (search operation) of the button Bd has been accepted (S102). If a search operation has not been accepted (S102: Yes), the terminal device 10 determines whether or not a selection operation (operation to end the AR mode) of the button Be has been accepted (S103). The terminal device 10 repeatedly executes steps S102 and S103 until a search operation or an operation to end the AR mode is accepted.

[0166] If an operation to end the AR mode is accepted (S103: Yes), the terminal device 10 hides various images including the distance image Gd displayed on the AR screen Mar (S104), displays the map screen Mp (S105), and ends the AR mode processing. On the other hand, if a search operation is accepted (S102: No), the terminal device 10 transmits determination information to the management device 20 (S106). The above determination information includes various information for determining whether or not the start conditions for the discovery event are satisfied. For example, the determination information includes information identifying the user position Pr, the user's attributes (such as items held), and the attitude of the terminal device 10.

[0167] When the management device 20 receives the above-mentioned determination information, it determines whether the start conditions for the discovery event are satisfied, and transmits result information indicating the determination result to the terminal device 10. When the terminal device 10 receives the above-mentioned result information (S107), it determines whether the result information is "discovered" (the start conditions for the discovery event are satisfied) (S108). If the result information is not "discovered" (S108: No), the terminal device 10 displays the above-mentioned message image Gm0 (see FIG. 13(a)) or message image Gm1 (see FIG. 13(b)), and returns the process to step S102.

[0168] If the result information is "discovered" (S108: Yes), the terminal device 10 executes a discovery process (S109) and proceeds to step S104 described above. In the discovery process, a discovery event (see FIGS. 9(b) and 13(c) described above) is executed in AR mode, and a treasure item is awarded. When the discovery process ends, steps S104 and S105 described above are automatically executed, and the AR mode ends and the mode switches to virtual space mode.

[0169] 14(b) is a flowchart of the hint generation process executed by the management device 20. The management device 20 executes the hint generation process when the map screen Mm is displayed on the terminal device 10 (when the map display button Bm is selected). In the above hint generation process, hint information H is generated. Note that each step of the hint generation process may be executed by the terminal device 10 and the management device 20 in cooperation with each other, or may be executed by the terminal device 10.

[0170] When the hint generation process starts, the management device 20 calculates the above-mentioned distance Lt (S201). Specifically, the distance Lt is calculated from the position information (user position Pr) of the terminal device 10 and the treasure position Pt. Thereafter, the management device 20 determines the analysis range Ra (100 meters, 50 meters, 10 meters) according to the distance Lt calculated in the immediately preceding step S201 and the treasure position Pt (S202).

[0171] The management device 20 acquires from the map system 40 the real images Gx of the shooting positions Px in the analysis range Ra determined in the immediately preceding step S202 (S203). Specifically, one or more of the shooting positions Px in the analysis range Ra are randomly selected, and the real images Gx of the selected shooting positions Px are acquired. However, a configuration may also be adopted in which word-of-mouth information about each shooting position Px is acquired from the map system 40, and the shooting position Px from which the real image Gx is acquired (for example, a popular shooting position) is determined based on the word-of-mouth information.

[0172] The management device 20 acquires word-of-mouth information about the shooting position Px where the real image Gx was acquired and the treasure position Pt from the map system 40 (S204). The management device 20 creates a prompt Dx including the location information of the treasure position Pt, the real image Gx acquired in step S203, and the word-of-mouth information acquired in step S204, and transmits the prompt Dx to the machine learning model 30 (S205). As described above, the prompt Dx includes an instruction string Sx according to the distance Lt.

[0173] When the prompt Dx is sent to the machine learning model 30, the hint information H generated using the prompt Dx is received by the management device 20 (S206). Upon receiving the hint information H, the management device 20 sends the hint information H to the terminal device 10 (S207) and ends the hint generation process. The terminal device 10 displays the hint information H received from the management device 20 on the map screen Mm.

[0174] <Modification> The above embodiments can be modified in various ways. Specific modified embodiments are exemplified below. Two or more embodiments selected from the following examples can be combined as appropriate.

[0175] (1) In each embodiment, a specific example of the prompt Dx for causing the machine learning model 30 to generate hint information H is not limited to the example shown in Fig. 8. Fig. 15(a) is a diagram for explaining a specific example of the prompt Dx in a modified example.

[0176] In the embodiment shown in Fig. 8 above, a configuration is adopted in which the instruction string Sx of the prompt Dx is switched according to the distance Lt from the user position Pr to the treasure position Pt. On the other hand, in the modified example shown in Fig. 15(a), the instruction string Sx of the prompt Dx is switched according to the number of times the user has performed a specific operation, instead of the distance Lt. Specifically, a configuration is adopted in which the instruction string Sx of the prompt Dx is switched according to the number of search operations (operations to obtain a treasure item) other than the treasure position Pt in AR mode (hereinafter referred to as the "number of failures n").

[0177] If a treasure item is awarded, the number of failures n is reset to "0." Alternatively, the number of failures n may be reset when the AR mode ends, regardless of whether a treasure item is acquired. However, if a treasure item is not acquired, the number of failures n may not be reset when the AR mode ends.

[0178] For example, assume that the number of failures n is less than 10 (n<10). In this case, as shown in FIG. 15(a), the prompt Dx includes an instruction string Sx stating, "Please use the real image Gx captured at the shooting position Px (location information) to generate a hint for going to the treasure position Pt (location information) that shows the direction to the treasure position Pt (location information) as seen from the user position Pr (location information)." Also, if the number of failures n is 10 to 14 (10≦n≦14), the prompt Dx includes an instruction string Sx stating, "Please use the real image Gx captured at the shooting position Px to generate a hint for going to the treasure position Pt that shows the direction to the treasure position Pt as seen from the user position Pr and the scenery that can be seen from the treasure position Pt or the shooting position Px." Furthermore, if the number of failures n is between 15 and 20 (15≦n≦20), the prompt Dx contains an instruction string Sx stating, "Using the real image Gx taken at the shooting position Px, please generate a hint for getting to the treasure position Pt that shows the direction of the treasure position Pt as seen from the user position Pr, the scenery visible from the treasure position Pt or the shooting position Px, and the facility where the treasure position Pt or the shooting position Px is located."

[0179] According to the prompt Dx of the above modification, the more the number of failures n, the more the generated hint information H indicates that it is easier to identify the treasure location Pt. However, in a configuration in which the more the number of failures n, the more the generated hint information H indicates that it is easier to identify the treasure location Pt, there remains room for fraudulent behavior, such as repeating a search operation to increase the number of failures n, even though the user knows that the location is not the treasure location Pt. In consideration of the above circumstances, a configuration may be adopted in which the above fraudulent behavior is suppressed. For example, a configuration may be adopted in which, if a predetermined number of search operations (e.g., five times) are performed consecutively within a short period of time (e.g., about five minutes), no new search operations are accepted until a predetermined time (e.g., about 30 minutes) has elapsed.

[0180] 8, the analysis range Ra for acquiring the real image Gx is changed depending on the distance Lt from the user position Pr to the treasure position Pt. In contrast, in the modified example of FIG. 15(a), the analysis range Ra does not change regardless of the distance Lt or the number of failures n. Specifically, the analysis range Ra is fixed to a range of approximately 50 meters from the treasure position Pt.

[0181] 15(a), a configuration is adopted in which a prompt Dx is created from a common real image Gx regardless of the number of failures n. That is, a configuration is adopted in which only the instruction string Sx in the prompt Dx changes. According to the above-described configuration, multiple types of hint information H can be generated from a common real image Gx. Therefore, there is an advantage that multiple types of hint information H can be created while reducing the number of times the real image Gx is acquired from the map system 40.

[0182] However, in this modified example, the analysis range Ra may be configured to change depending on the number of failures n. For example, if the number of failures n is less than 10, the prompt Dx may be created from the real image Gx of the above-mentioned analysis range Ra1, if the number of failures n is 10 to 14, the prompt Dx may be created from the real image Gx of the above-mentioned analysis range Ra2, and if the number of failures n is 15 to 20, the prompt Dx may be created from the real image Gx of the above-mentioned analysis range Ra3.

[0183] Note that, in the embodiment shown in FIG. 8 described above, the analysis range Ra may be configured to be constant regardless of the distance Lt. Specifically, the prompt Dx may be created from a common real image Gx regardless of the distance Lt. Furthermore, in each embodiment (FIG. 8, FIG. 15(a)), the instruction string Sx in the prompt Dx may be fixed, while the analysis range Ra (real image Gx) may change depending on the distance Lt.

[0184] 15(a), when the number of failures n reaches a predetermined number (e.g., 21 times), information that specifically identifies the treasure position Pt may be notified to the user. As an example of the above configuration, a specific image (e.g., an image representing a treasure chest) may be displayed at a position corresponding to the treasure position Pt on the map screen Mp in the virtual space mode. Alternatively, a specific image may be displayed at the treasure position Pt in the augmented reality AR on the AR screen Mar in the AR mode.

[0185] 15(b-1) and 15(b-2) are diagrams for explaining specific examples of the distance image Gd in the above-described modified example. In this modified example, as in the above-described embodiment (see FIGS. 9(a) and 9(b)), the distance image Gd is displayed on the AR screen Mar, and the distance to the treasure position Pt is indicated to the user.

[0186] In this modified example, when the number of failures n reaches a predetermined number (for example, 10 times), a hint image Gmh is displayed on the distance image Gd. The hint image Gmh displays a hint for identifying the treasure position Pt. For example, if the distance Lt from the user position Pr to the treasure position Pt is greater than a predetermined distance (for example, about 50 meters), the hint image Gmh notifies the user to that effect.

[0187] The specific example in Figure 15(b-1) is a simulated diagram of the distance image Gd (hint image Gmh) when the distance Lt from the user position Pr to the treasure position Pt is greater than approximately 50 meters. In this case, as shown in Figure 15(b-1), the character C in the distance image Gd is displayed at the initial position Ta. Furthermore, when the distance Lt from the user position Pr to the treasure position Pt is greater than approximately 50 meters, a message (hint) saying "It's not nearby" is displayed in the hint image Gmh of the distance image Gd.

[0188] Furthermore, a message corresponding to the moving direction of the user (terminal device 10) is displayed in the hint image Gmh of the distance image Gd. For example, the specific example in FIG. 15(b-2) assumes that the user is moving in a direction different from the treasure position Pt. In this case, the message "Not that way!" is displayed in the hint image Gmh of the distance image Gd. Furthermore, if the user is moving in the direction of the treasure position Pt, the message "That direction seems suspicious" is displayed in the hint image Gmh of the distance image Gd. Note that the moving direction of the user can be determined, for example, by the change over time of the user position Pr (GPS compass). However, from the viewpoint of preventing the user from staring at the terminal device 10 while moving, it is preferable to fix the display of the hint image Gmh to "It's not nearby" when the distance Lt is greater than approximately 50 meters.

[0189] (2) In each embodiment, a search operation (number of failed attempts n) is used as an example of a "specific operation" that changes the prompt Dx. However, other user operations may also be used as the "specific operation." For example, the more operations to use a specific item (the number of items used), the more the prompt Dx (both the real image Gx and / or the instruction string Sx) may change to generate hint information H that makes it easier to identify the treasure location Pt. Also, the more operations to switch to AR mode (the operation of selecting the AR mode start button Ba) are performed, the more the prompt Dx may change to generate hint information H that makes it easier to identify the treasure location Pt.

[0190] (3) In each embodiment, the method for determining the treasure position Pt is not limited to the above example. For example, another user may be able to determine the treasure position Pt. Specifically, a configuration is assumed in which a user Ua who possesses a treasure item can start an event in which the user hides the treasure item at a position determined by the user. In the above configuration, the position where the treasure item is hidden can be set as the treasure position Pt. Furthermore, when another user Ub uses a map item, once the treasure position Pt is determined, hint information H regarding the treasure position Pt is generated. By reaching the treasure position Pt, the other user Ub can obtain the treasure item hidden by the user Ua.

[0191] Note that when user Ua hides a treasure item, the system may be configured so that one of a number of predetermined messages (or a message created by user Ua) can be set on the treasure item. In the above configuration, when user Ub discovers the treasure item, the message set by user Ua is displayed to user Ub.

[0192] (4) In each embodiment, the trigger for displaying the hint information H is not limited to the above-described example. For example, consider a configuration in which a hint request button is displayed on the map screen Mp in virtual space mode. In the above configuration, the hint information H may be displayed on the map screen Mp for a predetermined time (e.g., about one minute) when the hint request button is selected. Alternatively, the hint information H may be displayed when the distance Lt from the user position Pr to the treasure position Pt reaches a predetermined distance. For example, in the embodiment shown in FIG. 8 above, the hint information H may be automatically displayed on the map screen Mp for a predetermined time (e.g., about one minute) when the analysis range Ra is switched in accordance with the distance Lt.

[0193] In the variation of FIG. 15(a) described above, the hint information H may be displayed on the AR screen Mar for a predetermined time (for example, about one minute) when the number of failures n reaches a predetermined number (for example, the number of times the instruction string Sx switches). Furthermore, the hint information H may be displayed according to the positional relationship between the position where the search operation was performed in AR mode and the treasure position Pt. For example, if the distance from the position where the search operation was performed to the treasure position Pt is closer than a predetermined distance (for example, about 15 meters), the hint information H saying "Come on!" may be displayed on the hint image Gmh.

[0194] (5) In each embodiment, the hint information H may not be displayed immediately after the treasure hunt event starts, and may be displayed after a predetermined display condition is met. For example, the above-mentioned display condition may be that the number of failures n reaches a predetermined number (for example, 10 times).

[0195] Furthermore, the display condition for the hint information H may be that the number of steps the user has taken since the start of the treasure hunt event reaches a predetermined number (for example, 5,000 steps). Alternatively, a special item may be placed in the virtual space Sv (map screen Mp), and the display condition for the hint information H may be that the special item is acquired. In the above configuration, the display condition for the hint condition H may be that a predetermined number or more of special items are acquired.

[0196] For example, assume a configuration in which a stone tablet item displaying a predetermined character string is used as the special item. In the above configuration, by acquiring all stone tablet items and combining the character strings of each stone tablet item, one piece of hint information H is displayed. Furthermore, a configuration may be adopted in which a special item may be acquired when a search operation is performed at a predetermined position other than the treasure position Pt in AR mode.

[0197] (6) In each embodiment, the search operation is not limited to the above example (selection of button Bd). For example, a selection operation of an augmented reality (AR) object displayed on the AR screen Mar may be used as a search operation. As an example of the above configuration, a treasure item discovery event may be initiated when a selection operation (search operation) of an augmented reality (AR) object (e.g., a floor object, a wall object, an ocean object, etc.) at which the treasure position Pt is located is performed.

[0198] Also, a configuration is assumed in which an illuminance sensor capable of detecting ambient brightness in addition to the position information and orientation of the terminal device 10 is provided. The illuminance sensor is provided on the opposite side (back side) of each surface of the terminal device 10 from the front surface on which the display panel 104a is provided. Therefore, if the terminal device 10 is placed with its back surface in contact with the floor, the illuminance sensor will detect almost no light. In the above configuration, a discovery event may be started when the illuminance sensor detects almost no light at the treasure position Pt and then begins to detect light again. In the above configuration, the user's action of lifting the terminal device 10 after placing the terminal device 10 at the treasure position Pt is the search operation. Note that a configuration may also be adopted in which a predetermined image (e.g., an image Gs of a shovel digging in the ground) is displayed when the illuminance sensor detects almost no light in the AR mode.

[0199] (7) In each mode, the treasure items can be changed as appropriate. For example, items that can be obtained on the map screen Mp may be used as treasure items.

[0200] Furthermore, the type of treasure item granted to the user may be changed depending on the process (such as the time required to discover) of the user until the treasure item is discovered. For example, the shorter the time from the start of the treasure hunt event until the treasure item is discovered, the more advantageous treasure item the user may be granted. Also, the fewer the number of steps the user takes from the start of the treasure hunt event until the treasure item is discovered, the more advantageous treasure item the user may be granted. Note that the longer the time from the start of the treasure hunt event until the treasure item is discovered, the more advantageous treasure item the user may be granted, or the more steps the user takes from the start of the treasure hunt event until the treasure item is discovered, the more advantageous treasure item the user may be granted.

[0201] However, let us assume a configuration in which other events in the game cannot be progressed unless a treasure item is acquired. In this configuration, users who are not proficient in AR mode (e.g., young users) may be inconvenienced by being unable to progress through most events, including the treasure hunt event. In consideration of the above circumstances, a configuration in which other events can be progressed without acquiring a treasure item is preferable.

[0202] (8) In each embodiment, the virtual object displayed in the augmented reality (AR) is not limited to the above examples. For example, a predetermined character may be displayed as the virtual object. In the above configuration, hint information H may be displayed when the character is selected in AR mode. The character may appear when the number of failures n in AR mode reaches a predetermined number.

[0203] In the AR mode, a virtual object that assists in finding the treasure position Pt may be displayed. For example, in the AR mode, a predetermined virtual object (for example, an object representing footprints) may be displayed on the path along which the user has traveled. Furthermore, in the AR mode, a predetermined virtual object (a landmark object) may be displayed at a position where a search operation has been performed.

[0204] (9) In each embodiment, an image that assists in finding the treasure position Pt may be displayed in the map screen mode. For example, the user's movement route during the treasure hunt event may be displayed on the map image Gm. Also, the location where a search operation has been performed may be displayed on the map image Gm. Similarly, an image that assists in finding the treasure position Pt may be displayed in the virtual space mode. For example, the user's movement route during the treasure hunt event may be displayed on the map screen Mp. Also, the location where a search operation has been performed may be displayed on the map screen Mp.

[0205] (10) In each embodiment, the treasure hunt event may be configured to be interruptible. When the treasure hunt event is interrupted, the map item Mm may be consumed, or the map item Mm may not be consumed. Furthermore, when the treasure hunt event is resumed after being interrupted, a new treasure position Pt may be determined based on the user's current location, or the treasure position Pt before the interruption may be reset.

[0206] (11) In each embodiment, the position attribute of the treasure position Pt can be changed as appropriate. Furthermore, the method for determining the position attribute of the treasure position Pt is not limited to the above examples. For example, the position attribute of the treasure position Pt may be determined regardless of real-world map information (land, sea, river, etc.). For example, the position attribute of a treasure position Pt on land may be determined to be a "deep sea attribute." Furthermore, in the above configurations, an image corresponding to the position attribute of the treasure position Pt may be displayed on the map screen Mp (virtual space Sv) regardless of map information. For example, assume that the position attribute of a treasure position Pt on land is determined to be a "deep sea attribute." In the above cases, an image representing the sea may be displayed in the virtual space Sv corresponding to the treasure position Pt.

[0207] (12) In each embodiment, the treasure location Pt may be suggested in the virtual space mode (map screen Mp). For example, as described above, one of the event spots res in the target range Rt is determined as the treasure location Pt. In the above configuration, it is assumed that one or more of the event spots res in the target range Rt other than the treasure location Pt are determined as the candidate location Pk. In addition, it is assumed that a common candidate location icon is displayed at the event spot ves corresponding to the treasure location Pt and at each event spot ves corresponding to each candidate location Pk.

[0208] In the above configuration, the user refers to the hint information H to predict which of the event spots res corresponding to each candidate location icon has been set as the treasure location Pt. Furthermore, in the above configuration, the system may be configured to switch to AR mode, which allows for search operations, on the condition that the user is located within a selectable range rsa (approximately 50 meters) of the candidate location icon (candidate location Pk). In other words, the locations where the AR mode can be switched to via the map screen Mm may be limited to the vicinity of the candidate location Pk.

[0209] (13) In each embodiment, the timing at which the hint information H is generated can be changed as appropriate. For example, in the above-described embodiment, a configuration was adopted in which the hint information H was generated immediately before it was displayed. Instead of the above configuration, a configuration in which the hint information H is generated in advance may be used. For example, assume that the distance Lt is 301 meters or more immediately after the treasure hunt event starts. In the above case, the hint information H is generated immediately after the treasure hunt event starts using the real image Gx in the analysis range Ra1. In the above configuration, during the period in which the distance Lt is 301 meters or more, the hint information H generated immediately after the treasure hunt event starts is repeatedly displayed each time the map screen Mm is displayed.

[0210] According to the above configuration, there is no need to generate hint information H when displaying the map screen Mm, and therefore there is an advantage that the map screen Mm can be displayed immediately. Also, compared to a configuration in which new hint information H is generated each time the map screen Mm is displayed, the number of times the machine learning model 30 is made to generate hint information H is reduced. Furthermore, with the above configuration, when the distance Lt becomes 300 meters or less, hint information H is generated using the real image Gx in the analysis range Ra2, and when the distance Lt becomes 100 meters or less, hint information H is generated using the real image Gx in the analysis range Ra3.

[0211] (14) In each embodiment, a specific example of the present invention applied to a location-based game has been described. However, the present invention may be applied to other than location-based games. For example, the present invention may be applied to a map service that helps a user reach a predetermined location (e.g., a store), a service that measures a user's movement history (number of steps traveled, distance traveled) to enable management of the user's health, a matching service that matches users, and a pedometer point service that awards points according to the number of steps a user takes.

[0212] The above-described embodiments may be appropriately combined, replaced with other configurations, partially deleted, or partially modified. Furthermore, publicly known technologies at the time of filing that are not described in this specification may be appropriately adopted.

[0213] <Summary of the functions and effects of the exemplary embodiments of the present invention> <First aspect> The programs (PGx, PGy) of this embodiment are programs capable of controlling a computer (terminal device 10) in various modes, including a virtual space mode that displays a virtual space (Sr) corresponding to the user's position (user position Pr) in real space (Sr), and an augmented reality mode that displays an augmented reality (AR) in which a virtual object is placed in real space photographed by the user. When the user moves the computer to a specific position (treasure position Pt) in real space, a specific event (discovery event) can be started in the augmented reality mode, and the program functions as a display control means (12) that displays a specific image (distance image Gd) whose appearance changes depending on the distance (Lt) to the specific position, while hiding the specific image in the virtual space mode. This embodiment improves the interest of the service.

[0214] <Second mode> The program of this aspect causes a computer to function as a notification means (11) that notifies information about a specific location (the name of an obtainable treasure item, the location where a treasure item can be obtained) in the augmented reality mode based on attribute information (location attribute) associated with the specific location and attribute information of the user (items possessed by the user, etc.). According to this aspect, the interest of the service is improved.

[0215] <Third and Fourth Aspects> In the program of this aspect, the notification means notifies the user of information about a specific location when the user has an object (ally character, special item, ship item) that corresponds to the attribute information of the specific location. Furthermore, the notification means can notify the user of information about the specific location even when the user is not located at the specific location, depending on the user's attribute information (when the user has a telephoto skill character). According to this aspect, the interest of the service is improved.

[0216] <Fifth aspect> The program of this aspect enables a computer to determine any position in a target range (Rt) in real space as a specific position, and to present the target range to a user while concealing the specific position (see FIG. 5b). According to this aspect, the interest of the service is improved.

[0217] <Sixth aspect> In the program of this aspect, when a user moves to a predetermined position in real space (event spot ves for a normal item), the computer can start a predetermined event (an event for acquiring a normal item) in virtual space mode, but does not start the predetermined event in augmented reality mode, and when a user moves to a specific position in real space, the computer can start a specific event (a discovery event) in augmented reality mode, but does not start the specific event in virtual space mode (see FIG. 10). According to this aspect, the interest of the service is improved.

[0218] <Seventh aspect> The program of this aspect allows a computer to start a predetermined event in the virtual space mode when the user moves within a range of a predetermined first distance (approximately 50 meters) from a predetermined position in real space, and to start a specific event in the augmented reality mode when the user moves within a range of a second distance (approximately 10 meters) from the specific position that is shorter than the first distance. According to this aspect, the interest of the service is improved.

[0219] <Eighth aspect> The program of this aspect causes the computer to function as mode control means (13) that can automatically switch to the virtual space mode after a specific event in the augmented reality mode has ended. According to this aspect, the interest of the service is improved.

[0220] <Ninth aspect> The information processing system (1) of this aspect is an information processing system capable of controlling a computer to operate in various modes, including a virtual space mode that displays a virtual space corresponding to the user's position in real space, and an augmented reality mode that displays an augmented reality in which virtual objects are placed in real space photographed by the user, and includes display control means that enables a specific event to be started in the augmented reality mode when the user moves to a specific position in real space, and that displays a specific image whose appearance changes depending on the distance to the specific position in the augmented reality mode, while hiding the specific image in the virtual space mode. According to this aspect, the same effects as those of the first aspect can be achieved.

[0221] The problem-solving means configured by the above-mentioned program (for example, each configuration described in the appendix) can be appropriately diverted to an apparatus, a system, a method, an information recording medium, etc. [Explanation of symbols]

[0222] 1...information processing system, 10...terminal device, 11...event control means, 20...management device

Claims

1. A computer, a control means for switching to a virtual space mode that displays a virtual space according to the user's position in real space; a means for controlling the camera to an augmented reality mode in which an augmented reality in which a virtual object is provided in a real space photographed by a user is displayed; a means for enabling a specific operation of a user to be accepted in the augmented reality mode, while disabling the specific operation to be accepted in the virtual space mode; means for enabling a specific event to be started in the augmented reality mode when the specific operation is received during a period in which the user is located at a specific position in real space; a specific image whose appearance changes depending on the distance to the specific position in the augmented reality mode, and a specific image whose appearance changes depending on the distance to the specific position in the virtual space mode; The virtual space mode can be switched to the augmented reality mode not only when the user is located at the specific position but also when the user is located at a predetermined position other than the specific position; The specific operation can be accepted in the augmented reality mode not only when the user is located at the specific position but also when the user is located at the predetermined position. program.

2. The specific position is associated with one of a plurality of types of attribute information, In the specific event at the specific location, an object corresponding to the attribute information associated with the specific location is displayed in the augmented reality. The program according to claim 1.

3. The computer a notification means for notifying information relating to the specific position in the augmented reality mode based on attribute information corresponding to the specific position and attribute information of the user; The program according to claim 1, wherein the program functions as follows:

4. The notification means notifies the user of information about the specific location when the user has an object corresponding to the attribute information of the specific location. The program according to claim 3.

5. The computer: a means for enabling the specific position to be concealed in the virtual space mode regardless of the user's position in the real space; The program according to claim 1, wherein the program functions as follows:

6. The computer When the trigger for transitioning to the augmented reality mode is met, the device functions as a means for executing a process for identifying each object included in the real space photographed by the user; On the condition that the processing is completed, the specific operation is made available for acceptance. The program according to claim 1.

7. The computer a means for notifying the user of information for identifying the specific position on the condition that the control is switched to the augmented reality mode when the user is located at the specific position; The program according to claim 1, wherein the program functions as follows:

8. In the specific event, a predetermined benefit is given to the user, The benefit is not granted in an event that can be started in the virtual space mode. The program according to claim 1.

9. a control means for switching to a virtual space mode that displays a virtual space according to a user's position in real space; a control means for controlling the camera to an augmented reality mode in which an augmented reality image is displayed in which a virtual object is provided in a real space photographed by a user; a means for enabling a specific operation of a user to be accepted in the augmented reality mode and disabling the specific operation to be accepted in the virtual space mode; means for enabling a specific event to be started in the augmented reality mode when the specific operation is received during a period in which the user is located at a specific position in real space; a means for displaying a specific image whose appearance changes depending on the distance to the specific position in the augmented reality mode, and for hiding the specific image in the virtual space mode; The virtual space mode can be switched to the augmented reality mode not only when the user is located at the specific position but also when the user is located at a predetermined position other than the specific position; The specific operation can be accepted in the augmented reality mode not only when the user is located at the specific position but also when the user is located at the predetermined position. Information processing system.

Images