Programs and Information Processing Systems

Abstract

We will provide programs that enhance the appeal of the service. [Solution] A program that enables a user at a first location in real space to move to a second location and proceed with a specific event corresponding to that second location, wherein a computer functions as a notification means to notify the user at the first location of specific information corresponding to the results of analyzing a real image representing the real space related to the second location. Furthermore, the notification means notifies specific information according to the distance from the first location to the second location. Specifically, the closer the distance from the first location to the second location, the more specific information the notification means notifies that makes it easier for the user to identify the second location.

Description

Technical Field

[0001] The present invention relates to a program and an information processing system.

Background Art

[0002] Conventionally, a technique capable of providing a service according to the position of a user in the real space has been known (for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] The present invention aims to improve the interestingness of services.

Means for Solving the Problems

[0005] In order to solve the above problems, the program of the present invention is a program that enables a user at a first position in the real space to move to a second position and progress a specific event corresponding to the second position, and causes a computer to function as a notification means for notifying the user at the first position of specific information according to the analysis result of a real image showing the real space related to the second position.

Effects of the Invention

[0006] According to the present invention, the interestingness of services is improved.

Brief Description of the Drawings

[0007] [Figure 1] It is a diagram for explaining each configuration of the information processing system. [Figure 2] It is a hardware configuration diagram of the information processing system. [Figure 3] This is a functional block diagram of an information processing system. [Figure 4] This is a diagram illustrating a specific example of virtual interval mode. [Figure 5] This is a diagram to illustrate a specific example of a map image. [Figure 6] This diagram illustrates a specific example of how hint information is generated. [Figure 7] This is a diagram to illustrate a specific example of the analysis scope. [Figure 8] This diagram illustrates a specific example of a prompt that changes depending on the distance to the treasure. [Figure 9] This is a diagram illustrating a specific example of AR mode. [Figure 10] This diagram illustrates specific examples of the selectable ranges for each item. [Figure 11] This is a diagram to illustrate specific examples of user actions. [Figure 12] This diagram illustrates specific examples of location and user attributes. [Figure 13] This is a diagram illustrating other specific examples of AR mode. [Figure 14] This is a flowchart of each process in an information processing system. [Figure 15] This is a diagram illustrating a variation. [Modes for carrying out the invention]

[0008] Figure 1 is a diagram illustrating the various components of the information processing system 1000. The information processing system 1000 consists of a terminal device 100, a server device 200, and an AI (Artificial Intelligence) system 300. As shown in Figure 1, the terminal device 100, the server device 200, and the AI ​​(Artificial Intelligence) system 300 can communicate with each other via a network N. The network N is assumed to be, for example, the internet.

[0009] The terminal device 100 is portable by the user and may include, for example, a smartphone, a personal computer, or a portable game console. The terminal device 100 also stores various programs, including application programs. In practice, multiple terminal devices 100 communicate with the server device 200. However, for illustrative purposes, Figure 1 shows only one terminal device 100.

[0010] The terminal device 100 is configured to acquire location information in real space. Specifically, the terminal device 100 is equipped with a GPS (Global Positioning System) receiver and is configured to receive GPS signals. The GPS signals include location information indicating the position of the terminal device 100 in the horizontal plane. In this embodiment, the position of the terminal device 100 in the horizontal plane of real space Sr may be described as "user position Pr". The user position Pr can be presumed to indicate the position of the user possessing the terminal device 100.

[0011] The server device 200 provides the terminal device 100 with various information used when the terminal device 100 executes application programs. Specifically, the terminal device 100 and the server device 200 work together to enable the terminal device 100 to run services that utilize the user's location information, such as games that utilize the user's location information (referred to as location-based games). In Figure 1, an example is shown where the server device 200 is composed of a single server device, but the server device 200 may be composed of multiple server devices (systems).

[0012] The AI system 300 functions as a machine - learned AI chatbot. Specifically, when a prompt (see FIG. 8 described later) is input into the AI system 300, an answer (hint information H described later) to the prompt is generated. In the AI system 300 of the present embodiment, when a prompt is input from the server device 200 via an API (Application Programming Interface), an answer corresponding to the prompt is returned. The above - mentioned AI system 300 may be configured with a plurality of computers or may be configured with one computer.

[0013] The map system 400 is, for example, a system capable of providing a street view. Specifically, the map system 400 stores a real - world image Gx taken at each shooting position Px in the real - world space Sr in correspondence with the position information of the shooting position Px. When the map system 400 receives an image request including the shooting position Px in the real - world space Sr from the server device 200, it returns the real - world image Gx corresponding to the shooting position Px included in the image request. The above - mentioned map system 400 may be configured with a plurality of computers or may be configured with one computer.

[0014] Although it will be described in detail later, in the present embodiment, a treasure - hunting event can proceed on the terminal device 100. In the above - mentioned treasure - hunting event, the treasure position Pt is determined by the server device 200, and the user can obtain a treasure item by moving to the treasure position Pt. However, the treasure position Pt is generally kept secret from the user, and the user moves to the treasure position Pt by referring to the hint information H. The above - mentioned hint information H is generated by analyzing the real - world image Gx related to (around) the treasure position Pt by the AI system 300 (see FIG. 6 described later).

[0015] In addition, the terminal device 100 can be controlled to an AR mode capable of displaying augmented reality (AR). By switching the terminal device 100 to the AR mode at the treasure position Pt, a discovery event (see FIG. 9(b) described later) can be executed in the augmented reality AR. In the above discovery event, a treasure item is given to the user. The above configuration will be described in detail later.

[0016] FIG. 2 is a hardware configuration diagram of the information processing system 1000. As described above, the information processing system 1000 includes the terminal device 100 and the server device 200. As shown in FIG. 2, the terminal device 100 includes a processing device 101, a storage device 102, a communication device 103, a display device 104, a GPS receiver 105, an acceleration azimuth sensor 106, and a camera 107. Each of the above components is communicably connected via a system bus.

[0017] The processing device 101 controls the entire terminal device 100. The above processing device 101 can be composed of one or more processors. Specifically, the processing device 101 can be composed of one or more types of processors such as a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a DSP (Digital Signal Processor), an FPGA (Field Programmable Gate Array), or an ASIC (Application Specific Integrated Circuit).

[0018] The storage device 102 stores various programs, including the basic program and the application program PGx. As the storage device 102, known recording media such as semiconductor recording media and magnetic recording media may be used. Furthermore, the storage device 102 may consist of one recording media or multiple recording media. The application program PGx is downloaded in advance and installed on the terminal device 100. The storage device 102 also stores various game data used in location-based games (such as data indicating items assigned to the user and data indicating the status of the user character).

[0019] The display device 104 comprises a display panel 104a and a touch panel 104b. The display panel 104a is, for example, a flat display made of organic EL (Electro Luminescence). The touch panel 104b is configured to detect user touch operations. Specifically, the touch panel 104b is mounted on top of the display panel 104a and accepts touch operations on the image displayed on the display panel 104a.

[0020] The GPS receiver 105 receives GPS signals from GPS satellites. The acceleration direction sensor 106 is composed of a combination of various sensors, including a compass for detecting direction, an accelerometer, and a gyroscope. The communication device 103 communicates with the server device 200 via the network N. The camera 107 includes an image sensor and generates an image by converting incident light entering through the lens into an electrical signal.

[0021] The server device 200 comprises a processing unit 201, a storage device 202, and a communication device 203. Each of these components is connected via a system bus for communication. The processing unit 201 controls the entire server device 200. The processing unit 201 of the server device 200, like the processing unit 101 of the terminal device 100 described above, may consist of one or more processors. Specifically, the processing unit 201 may consist of one or more types of processors, such as a CPU, GPU, DSP, FPGA, or ASIC.

[0022] The storage device 202 stores various programs, including the basic program and the game management program PGy. For the storage device 202 of the server device 200, known recording media such as semiconductor recording media and magnetic recording media may be used. The storage device 202 may consist of one recording media or multiple recording media. Furthermore, the storage device 202 stores various game data used in location-based games (such as data indicating items assigned to the user and data indicating the status of the user character) in association with the user's identifier. The communication device 203 communicates with the terminal device 100 via the network N.

[0023] Figure 3 is a functional block diagram of the information processing system 1. As shown in Figure 3, the information processing system 1 of this embodiment is composed of a terminal device 10, a management device 20, a machine learning model 30, and a map system 40. For example, the terminal device 100 functions as a terminal device 10 by executing the application program PGx. Similarly, the server device 200 functions as a management device 20 by executing the game management program PGy. Likewise, the AI ​​system 300 functions as a machine learning model 30 by executing a program, and the map system 400 functions as a map system 40 by executing a program. Each of these components can communicate via the network N.

[0024] The terminal device 10 is configured to include notification means 11, display control means 12, mode control means 13, and reception means 14. However, the above configuration (functions) may also be provided by the management device 20.

[0025] The terminal device 10 of this embodiment allows a user at a first location in real space Sr (hereinafter referred to as "user location Pr") to move to a second location (treasure location Pt) and proceed with a specific event corresponding to the second location (such as a treasure item discovery event). The notification means 11 also notifies the user at the first location of specific information (hint information H) corresponding to the analysis results of the real image Gx representing real space Sr related to the second location. The above configuration will be described in detail later with reference to Figure 6.

[0026] Furthermore, the notification means 11 notifies specific information corresponding to the distance from the first position to the second position (Lt shown in Figure 8). Specifically, the closer the distance from the first position to the second position, the more easily the user can identify the second position. For example, if the distance from the first position to the second position is greater than or equal to a predetermined threshold (approximately 300 meters), the notification means 11 notifies specific information corresponding to the analysis results of the real image Gx in the first range (analysis range Ra1) of the real space Sr. If the distance from the first position to the second position is less than the threshold, the notification means 11 notifies specific information corresponding to the analysis results of the real image Gx in the second range (analysis range Ra2), which is narrower than the first range. The above configuration will be described in detail later using Figures 7(a) and 7(b).

[0027] Furthermore, specific information (hint information H) is generated by inputting a prompt Dx containing a real image Gx and an instruction string Sx into the machine learning model 30, and is generated using different instruction strings Sx depending on the distance from the first position to the second position (see Figure 8 below). Alternatively, a computer (terminal device 10) may be configured to function as a receiving means 14 for receiving predetermined specific operations from the user (search operations below), and the specific information may be generated according to the number of times the specific operation has been received (number of failures n below). Specific examples of the above configuration will be explained in detail using Figures 15(a), (b-1), and (b-2) as examples of modifications.

[0028] Furthermore, the terminal device 10 of this embodiment can switch between multiple modes, including a virtual space mode (see Figure 4 described later) that displays a virtual space Sv corresponding to the user's position (user position Pr) in the real space Sr, and an augmented reality mode (AR mode) that displays augmented reality AR in which a virtual object (such as the treasure image Gt in Figure 9(b)) is placed in the real space Sr that the user photographs.

[0029] The display control means 12 of the terminal device 10 enables a specific event (item acquisition event) to be initiated in augmented reality mode when the user moves to a specific location (treasure location Pt) in real space Sr. In augmented reality mode, a specific image (distance image Gd in Figure 9(b)) is displayed whose appearance changes according to the distance to the specific location, while in virtual space mode, the specific image is hidden. Furthermore, the mode control means 13 of the terminal device 10 can automatically switch to virtual space mode after the specific event (treasure item acquisition event) in augmented reality mode has ended. The above configuration will be described in detail later with reference to Figure 11.

[0030] The notification means 11 of the terminal device 10 notifies information about a specific location in augmented reality mode, based on attribute information (location attribute) associated with the specific location (such as treasure location Pt) and the user's attribute information (such as items possessed by the user). Specifically, if the user possesses an object (ally character, item) corresponding to the attribute information of the specific location, the notification means 11 notifies information about the specific location (such as the type of treasure item) in augmented reality mode. Furthermore, depending on the user's attribute information (whether or not they possess a telephoto skill character), the notification means 11 also notifies information about the specific location in augmented reality mode even if the user is not physically located at that location. For example, the display device 104 of the terminal device 100 functions as the notification means 11. The above configuration will be described in detail later using Figure 11.

[0031] The terminal device 10 can determine any location within the target area (Rt) of the real space Sr as a specific location (treasure location Pt), and while concealing the specific location, it can present the target area to the user (by displaying the map image Gt described later). With this configuration, the user can be given the enjoyment of discovering the treasure location Pt. This configuration will be described in detail later using Figure 5(b).

[0032] The terminal device 10 can initiate a predetermined event (a normal item acquisition event) in virtual reality mode when the user moves to a predetermined location (event spot ves) in real space Sr, but does not initiate the predetermined event in augmented reality mode. Similarly, when the user moves to a specific location (treasure location Pt) in real space Sr, it can initiate a specific event (a treasure item acquisition event) in augmented reality mode, but does not initiate the specific event in virtual space mode. The above configuration will be described in detail later using Figure 10(a).

[0033] The terminal device 10 enables the initiation of a predetermined event (an event to acquire a normal item) in virtual space mode when the user moves within a predetermined range of a first distance (approximately 50 meters) from a predetermined location (event spot res) in real space Sr, and enables the initiation of a specific event (a treasure item discovery event) in augmented reality mode when the user moves within a range of a second distance (approximately 10 meters) shorter than the first distance from a specific location (treasure location Pt). The above configuration will be described in detail later using Figure 10(b-2).

[0034] Figure 4 is a simulated example of a map screen Mp displayed on the terminal device 10 (display panel 104a). The map screen Mp is displayed in the virtual space mode, one of the various modes (virtual space mode, AR mode) of the terminal device 10. The virtual space Sv is displayed on the map screen Mp, and a location-based game is played in this virtual space Sv. Specifically, in the location-based game, various events (such as acquiring items) can be played in the virtual space Sv by the user moving in the real space Sr.

[0035] The virtual space Sv is displayed based on map information and user location Pr in the real space Sr. The map information is provided, for example, from the management device 20 to the terminal device 10. However, the management device 20 may also acquire map information from an external server and transfer that map information to the terminal device 10. The user location Pr is identified using the GPS signal described above.

[0036] As shown in Figure 4, the map screen Mp is composed of various objects. Specifically, the map screen Mp is composed of character images Gp, ground images Gg, and item images Gi (Giu, Gim). Note that in the specific example in Figure 4, only a selection of the objects displayed on the map screen Mp are shown.

[0037] The ground image Gg in the virtual space Sv is displayed in the area corresponding to the ground surface in the real space Sr. The ground image Gg is displayed based on map information in the real space Sr. Specifically, the ground image Gg displays road areas at locations corresponding to roads in the real space Sr. In addition, the ground image Gg displays ocean areas at locations corresponding to seas in the real space Sr, and river areas at locations corresponding to rivers in the real space Sr. In other words, the ground image Gg represents a map of the real space Sr.

[0038] The character image Gp represents the user character in the virtual space Sv. As shown in Figure 4, the character image Gp is ​​displayed at the character position Pv. The character position Pv in the virtual space Sv corresponds to the user position Pr in the real space Sr. In other words, the character image Gp (character position Pv) can also be described as representing the user position Pr on the map of the real space Sr represented by the ground image Gg. Specifically, as the user position Pr, identified from the GPS signal, moves, the character position Pv in the virtual space Sv moves. That is, as the user moves in the real space Sr, the character image Gp moves in the virtual space Sv.

[0039] Each other object on the map screen Mp is placed in the virtual space Sv in a predetermined manner. Specifically, the location information of the event spot res in the real space Sr and the type of event that can be started at that event spot res are associated (linked) and stored. In this embodiment, the event spot res may be a "point" defined by a combination of latitude and longitude, or it may be a "surface" having an area. In other words, the "location" in this invention is a concept that encompasses both "points" and "surfaces" in real space.

[0040] For explanatory purposes, the location in the virtual space Sv corresponding to the event spot res in the real space Sr may be referred to as "event spot ves". Events associated with event spot res in the real space Sr are also associated with event spot ves in the corresponding virtual space Sv. Each event spot ves in the virtual space Sv contains an object corresponding to the event associated with that event spot ves.

[0041] In this embodiment, the area from the event spot res in the real space Sr to a predetermined distance (for example, about 50 meters) is set as the selectable range rsa corresponding to the event spot res. When the user position Pr is located within the selectable range rsa, the event at the event spot res corresponding to the selectable range rsa becomes available for activation.

[0042] For example, consider a scenario where an item image Gi is displayed at an event spot ves in the virtual space Sv, corresponding to an event spot res in the real space Sr. In this case, if the user's position Pr is within the selectable range rsa corresponding to the event spot res, selecting (touching) the item image Gi will initiate an item acquisition event. In this acquisition event, the item corresponding to the selected item image Gi is assigned to the user.

[0043] When an item image Gi is touched and the item is added, that item image Gi disappears from the map screen MP and can no longer be selected. A new item image Gi will then be repositioned on the map screen MP after a predetermined period of time (for example, approximately 24 hours).

[0044] In this embodiment, various items, including regular items and map items, are granted to the user. Among the item images Gi, the regular item image Giu corresponds to a regular item. Also, among the item images Gi, the map item image Gim corresponds to a map item. In the specific example in Figure 4, we assume that among the event spots ves, the map item image Gim is placed at event spot ves1 and the regular item image Giu is placed at event spot ves2. For example, when the regular item image Giu is selected, the regular item is granted to the user. A regular item is thought to be, for example, in-game currency that can be used to purchase other items. However, regular items are not limited to the above example.

[0045] When the map item image Gim is selected, the map item is granted to the user. As will be explained in more detail later, once the user acquires the map item, they can start the treasure hunt event. Note that the configuration for granting the map item to the user is not limited to the example above. For example, the map item could be granted to the user as a reward for completing another predetermined event. In the above configuration, the map item may not be obtainable from the map screen Mp.

[0046] Furthermore, the appearance (display area and angle) of each of the above objects (such as the ground image Gg) changes as the character's position Pv moves. In other words, the appearance of each object in the virtual space Sv changes as the user moves in the real space Sr. Specifically, the map screen Mp displays the virtual space Sv as seen from a predetermined line of sight from the character's position Pv (character image GP). The line of sight may be configured to be changeable according to user operation.

[0047] As shown in Figure 4, in addition to each object in the virtual space Sv, buttons B1 and B2 and the map display button Bm are displayed on the map screen Mp. Each of these buttons B(1, 2, m) is displayed at a predetermined position on the map screen Mp, and its appearance does not change even if the character's position Pv moves.

[0048] When button B1 is selected, auto mode can be started. In auto mode, the item corresponding to the item image Gi is automatically acquired without the user touching the item image Gi. Specifically, when the user's position Pr moves within the selectable range rsa while in auto mode, the item image Gi placed in the event spot ves corresponding to the selectable range rsa is automatically selected, and the item corresponding to that item image Gi is automatically acquired.

[0049] With the above configuration, by setting it to auto mode, various events can proceed in the virtual space Sv without having to look at the screen of the terminal device 10 (without operating the terminal device 10). Therefore, the inconvenience of obstructing the passage of others by operating the terminal device 10 while moving is suppressed. If button B1 is selected again while in auto mode, auto mode will end. Note that auto mode cannot be set in AR mode.

[0050] When button B2 is selected, the map screen (MP) switches to the menu screen. The user can use various items through the menu screen. For example, items that restore a character's hit points can be used through the menu screen.

[0051] When the map display button Bm is selected, the map screen Mm, described below, is displayed instead of the map screen Mp (see Figure 5(b)). The map screen Mm is displayed on the map screen Mp during the period when the treasure hunt event described above is in progress. Alternatively, the map display button Bm may be displayed even when the treasure hunt event is not in progress. In the above configuration, if the map display button Bm is selected when the treasure hunt event is not in progress, a message may be displayed indicating that the treasure hunt event can be started by obtaining a map item. As described above, in the treasure hunt event, treasure location points are set, and treasure items are awarded to the user when they reach the treasure location points.

[0052] However, the specific location of the treasure location Pt is, in principle, kept secret from the user. For example, the example in Figure 4 assumes that a treasure location Pt has been set. Specifically, it assumes that the event spot res, which corresponds to the virtual treasure location Pvt on the far left side of the virtual space Sv when viewed from the front, is set as the treasure location Pt. In Figure 4, the virtual treasure location Pvt is shown for illustrative purposes, but the virtual treasure location Pvt is not displayed on the actual map screen Mp. In the treasure hunt event, the user will deduce the treasure location Pt based on the hint information H (see Figure 5(b)) described later.

[0053] Figure 5(a) is a diagram illustrating the configuration for setting the treasure location Pt. Figure 5(a) shows a map of a portion of the real-world space Sr. Figure 5(a) also shows the user's location Pr in the real-world space Sr.

[0054] In this embodiment, the target range Rt is set to a predetermined distance (for example, about 1 kilometer) from the user's location Pr. Furthermore, one of the event spots res located within the target range Rt is set as the treasure location Pt. Specifically, the management device 20 acquires user review information for each event spot res from the map system 40. This user review information includes each user's evaluation of the event spot res. Based on this user review information, one of the event spots res within the target range Rt is set as the treasure location Pt.

[0055] For example, word-of-mouth information determines whether an event spot res is where a real event is held, or whether it is an event spot res where many people gather during a specific time period. Based on the results of these determinations, the management device 20 sets one of the event spots res within the target range Rt as the treasure location Pt. In addition, a configuration in which the treasure location Pt is determined by a pre-trained machine learning model may be adopted. Specifically, the location information and word-of-mouth information of each event spot res within the target range Rt may be input into the machine learning model to determine the treasure location Pt.

[0056] In this embodiment, when a map item is acquired, a predetermined confirmation image is displayed on the map screen Mp. This confirmation image displays a "Start button" and a "Cancel button". When the "Start button" on the confirmation image is selected, the treasure hunt event begins. Specifically, when the "Start button" is selected, the target area Rt is set to an area of ​​approximately 1 kilometer from the user's location Pr (event spot res where the map item was placed) at the time the map item was acquired, and the treasure location Pt is determined.

[0057] On the other hand, if the "Cancel button" is selected, the treasure hunt event will not start, and the treasure location points will not be determined. Furthermore, if a treasure item is selected on the map screen (MP), regardless of whether the treasure hunt event starts or not (regardless of whether the start button or the cancel button is selected), the treasure item may be hidden from the map screen (and cannot be selected again). Also, if the cancel button is selected, the treasure item may not be hidden from the map screen (and can be selected again). Additionally, the treasure hunt event may be configured to start automatically immediately after acquiring a map item.

[0058] However, if a user acquires a map item while on a train, for example, it may be difficult to conduct a treasure hunt event in the vicinity of the location where the map item was acquired. Considering these circumstances, the system may be configured so that users can use the map item at any time after acquiring it. Furthermore, in the above configuration, the target range Rt may be set to extend approximately 1 kilometer from the user's location Pr at the time the map item is used. In addition, in the configuration where users can use the map item at any time, the target range Rt may be set to extend approximately 1 kilometer from the event spot ves where the map item was acquired, regardless of the user's location Pr at the time the map item is used.

[0059] Figure 5(b) is a simulated example of the map screen Mm. As mentioned above, the map screen Mm is displayed when the map display button Bm (see Figure 4) on the map screen Mp is selected. The map screen Mm displays various images, including the map image Gm, hint image Gh, AR mode start button Ba, and return button Bb.

[0060] The map image Gm is an image used to display a map of the target area Rt (see Figure 5(a)) described above. The map image Gm is displayed based on the map information described above. Based on the map image Gm, the user can understand the target area Rt. However, as can be seen from Figure 5(b), the treasure location Pt is not shown in the map image Gm. In the treasure hunt event, the user uses the hint information H described later to deduce the treasure location Pt in the target area Rt displayed in the map image Gm. Note that in the specific example in Figure 5(b), the map image Gm is configured so that the names of each facility (including stations and roads) in the target area Rt are not displayed. However, the map image Gm may also be configured to display the names of each facility.

[0061] The hint image Gh displays hint information H. This hint information H is a hint for inferring the treasure location Pt and is generated by the machine learning model 30. As will be explained in detail later using Figure 6, a prompt Dx containing a real image Gx taken at a location related to the treasure location Pt (for example, around the treasure location Pt) is input to the machine learning model 30, and hint information H is generated. For example, in the specific example in Figure 5(b), we assume that a real image Gx containing a "brick building" and a real image Gx containing the "sea" are input to the machine learning model 30. In this case, as shown in Figure 5(b), hint information H such as "Look for the brick building! The treasure is buried near the sea!" may be generated.

[0062] When the AR mode start button Ba on the map screen Mm is selected, AR mode, which displays virtual reality AR, is started. Switching to AR mode makes it possible to start a discovery event in which treasure items can be acquired. On the other hand, when the return button Bb is selected, virtual space mode is started and the screen returns to the map screen Mp. In this embodiment, a configuration is adopted in which it is not possible to switch directly from virtual space mode (map screen Mp) to AR mode. However, for example, an AR mode start button Ba could be provided on the map screen Mp, allowing direct switching from virtual space mode to AR mode.

[0063] Figure 6 illustrates a specific example of a configuration for generating hint information H. When the map screen Mm (containing hint information H) is displayed (when the map display button Bm is selected), the management device 20 obtains a real-world image Gx related to the treasure location Pt from the map system 40 (Sa1 in Figure 6). For example, the management device 20 obtains a real-world image Gx taken in the vicinity of the treasure location Pt. The management device 20 also creates a prompt Dx that includes the real-world image Gx obtained from the map system 40.

[0064] As shown in Figure 6, the prompt Dx includes the aforementioned real-world image Gx as well as an instruction string Sx. The instruction string Sx is an instruction to the machine learning model 30 to generate hint information H using the real-world image Gx included in the prompt Dx. When the above prompt Dx is input to the machine learning model 30 (Sa2 in Figure 6), the machine learning model 30 generates hint information H based on the prompt Dx (Sa3 in S6).

[0065] The prompt Dx includes information other than the real-world image Gx and the instruction string Sx. For example, the location where the real-world image Gx was taken (the shooting location Px shown in Figure 7(a) below) and word-of-mouth information about the treasure location Pt may be included in the prompt Dx. This word-of-mouth information is obtained, for example, from the map system 40. With the above configuration, word-of-mouth information may be reflected in the hint information H. For example, suppose the word-of-mouth information "The treasure location Pt gets crowded around noon" is included in the prompt Dx. In this case, the hint information H may include the string "Let's go to a place where lots of people gather around noon."

[0066] According to this embodiment, hint information H is generated by the machine learning model 30 using real-world images Gx acquired from the map system 40. Therefore, compared to a configuration in which, for example, the developer creates all hint information H on their own, there is an advantage in that the time required to create hint information H is reduced.

[0067] As will be explained in detail later, in this embodiment, the closer the distance from the user's position Pr to the treasure's position Pt (hereinafter simply referred to as "distance Lt"), the easier it is to generate hint information H that allows the user to easily identify the treasure's position Pt. Specifically, as explained below, the type of real image Gx included in prompt Dx changes according to the distance Lt (see Figure 7(b)). Also, the instruction string Sx included in prompt Dx changes according to the distance Lt (see Figure 8).

[0068] Figures 7(a) and 7(b) illustrate specific examples of real-world images Gx used when generating hint information H. Figures 7(a) and 7(b) assume a view looking vertically downwards from the real-world space Sr. Figures 7(a) and 7(b) show the user position Pr and the treasure position Pt. Figures 7(a) and 7(b) also show each shooting position Px (1-5). Real-world images Gx taken from these shooting positions Px can be obtained from the map system 40.

[0069] In this embodiment, the real-world image Gx used to generate hint information H changes depending on the distance Lt from the user position Pr to the treasure position Pt. Specifically, the range from the treasure position Pt to a predetermined distance (Ra1, Ra2, Ra3 described later) is set as the analysis range Ra. Furthermore, a prompt Dx is created using the real-world image Gx at the shooting position Px located inside the analysis range Ra, and hint information H is generated.

[0070] In the above configuration, the closer the distance Lt is at the time the hint information H is generated, the narrower the analysis range Ra becomes (changing in the order of Ra1 (approximately 100 meters) → Ra2 (approximately 50 meters) → Ra3 (approximately 10 meters)). In other words, the closer the distance Lt is from the user position Pr to the treasure position Pt, the more the real-world image Gx used to generate the hint information H is limited to the area around the treasure position Pt (real-world image Gx from shooting positions Px far from the treasure position Pt are excluded).

[0071] Figure 7(a) assumes a case where the distance Lt from the user position Pr to the treasure position Pt is greater than approximately 300 meters. When the distance Lt is greater than approximately 300 meters (Lt > 300 meters), the analysis range Ra1 is set to extend approximately 100 meters from the treasure position Pt. In the specific example in Figure 7(a), it is assumed that among the various shooting positions Px, shooting positions Px1 and Px2 are located inside the analysis range Ra1, while shooting position Px5 is located outside the analysis range Ra1.

[0072] In the above case, the real image Gx at shooting position Px1 and the real image Gx at shooting position Px2 can be used when creating hint information H. On the other hand, the real image Gx at shooting position Px5, which is far from the treasure location Pt, is not used when creating hint information H. As will be explained in detail using Figure 7(b), in this embodiment, the narrower the analysis range Ra (the closer the distance Lt), the more hint information H is generated from the captured image Gx at shooting position Px that is close to the treasure location Pt, making it easier to generate hint information H that can identify the treasure location Pt.

[0073] In this embodiment, a predetermined number of shooting positions Px are randomly selected from each shooting position Px located within the analysis range Ra, and hint information H is generated using the real image Gx of the shooting position Px and the real image Gx of the treasure position Pt. However, the method for determining the shooting position Px is not limited to the above example. For example, the shooting position Px may be determined based on word-of-mouth information at each shooting position Px.

[0074] The hint information H generated using the real image Gx may include information suggesting the shooting location Px (part of the analysis range Ra) where the real image Gx was taken. Therefore, according to the above-described embodiment, hint information H is generated that allows the location (direction) of the analysis range Ra to be inferred, and a user outside the analysis range Ra can be guided towards the analysis range Ra (treasure location Pt). However, even if the hint information H is generated from a real image Gx taken at a shooting location Px inside the analysis range Ra, depending on the shooting location Px, the user may end up taking an unnecessary detour.

[0075] For example, Figure 7(a) shows the range Rd in the direction the user should travel to reach the treasure location Pt (direction to treasure location Pt). The range Rd can be defined as the area inside each line segment that forms an angle (for example, an angle of 45°) with the user location Pr as the vertex, when the line passing through the user location Pr and the treasure location Pt is used as the bisector. In the specific example in Figure 7(a), among the shooting locations Px(1~4) in the analysis range Ra, shooting locations Px1 and Px2 are located inside the range Rd, but shooting location Px4 is located outside the range Rd. In this case, if hint information H is generated using shooting location Px4, it is likely that the user will have to take a detour to reach shooting location Px4 in order to get to the treasure location Pt, which would be inconvenient.

[0076] Considering the above circumstances, this embodiment employs a configuration in which hint information H is generated from the captured image Gx at the shooting position Px located inside the range Rd within the analysis range Ra. For example, in the specific example shown in Figure 7(a), the real image Gx captured at shooting position Px4 among the shooting positions Px within the analysis range Ra is not used when generating hint information H. According to this embodiment, it becomes less likely that hint information H will be generated that would cause the user to take a roundabout route to the treasure location Pt.

[0077] Furthermore, let's assume a configuration in which hint information H can be generated from the actual image Gx of a shooting position Px located behind the treasure position Pt from the user position Pr (for example, Px3 in Figure 7(a)). With the hint information H of the above configuration, some users may overshoot the treasure position Pt, which is inconvenient. Taking these circumstances into consideration, in this embodiment, a configuration is adopted in which hint information H is generated from the actual image Gx of a shooting position Px located in front of the treasure position Pt from the user position Pr among the shooting positions Px in the analysis range Ra.

[0078] Specifically, the system employs a configuration that generates hint information H from the actual image Gx of a shooting position Px that is perpendicular to the line passing through the user position Pr and the treasure position Pt, and is located on the user position Pr side when viewed from the line passing through the treasure position Pt (line B in Figure 7(a)). For example, in the specific example in Figure 7(a), among the shooting positions Px in the analysis range Ra, shooting position Px3 is located beyond line B (treasure position Pt) when viewed from the user position Pr. Therefore, the actual image Gx of shooting position Px3 is not used when generating hint information H. According to this embodiment, the inconvenience of generating hint information H that causes the user to take a roundabout route to reach the treasure position Pt is suppressed.

[0079] Figure 7(b) is a diagram illustrating a detailed example of the real image Gx used when generating hint information H. In this embodiment, the closer the distance Lt from the user's position Pr to the treasure's position Pt, the easier it is for the user to identify the treasure's position Pt, and thus the more effective the generated hint information H becomes. For example, in the specific example shown in Figure 7(a) above, it is assumed that the distance Lt from the user's position Pr to the treasure's position Pt is greater than approximately 300 meters. In this case, the analysis range Ra1 extends to approximately 100 meters from the treasure's position Pt.

[0080] On the other hand, in the specific example shown in Figure 7(b), we assume that the distance Lt from the user position Pr to the treasure position Pt is between 100 meters and 51 meters. In this case, the analysis range Ra3 extends to approximately 10 meters from the treasure position Pt. In other words, as the user position Pr approaches the treasure position Pt, the analysis range Ra narrows. Therefore, as the user position Pr approaches the treasure position Pt, the real image Gx used to generate the hint information H is limited to the real image Gx of the shooting position Px that is close to the treasure position Pt.

[0081] For example, in the specific example shown in Figure 7(a) above, we assume that both shooting positions Px1 and Px2 are located inside the analysis range Ra1. In this case, both the real image Gx1 at shooting position Px1 and the real image Gx2 at shooting position Px2 can be used when generating hint information H. On the other hand, in the specific example shown in Figure 7(b), we assume that shooting position Px2 is located inside the analysis range Ra3, and shooting position Px1 is located outside the analysis range Ra3. In this case, the real image Gx2 at shooting position Px2 is used when generating hint information H, but the real image Gx1 at shooting position Px1, which is further from the treasure location Pt than shooting position Px2, is not used.

[0082] Figure 7(b) shows a simulated example of a real-world image Gx1 at shooting position Px1 and a real-world image Gx2 at shooting position Px2. In the examples in Figures 7(a) and 7(b), it is assumed that the real-world image Gx1 at shooting position Px1 includes a "brick building". Also, it is assumed that the real-world image Gx2 at shooting position Px2 includes the "sea".

[0083] In the above case, in the specific example shown in Figure 7(a), where the distance Lt from the user's position Pr to the treasure's position Pt is greater than approximately 300 meters, hint information H is generated from both the real-world image Gx1 and the real-world image Gx2. Therefore, for example, both the string "brick building" and the word "sea" may be included in the hint information H. With the above hint information H, it may not be possible to determine whether the treasure's position Pt is near the "brick building" (shooting position Px1) or near the "sea" (shooting position Px2).

[0084] On the other hand, in the specific example shown in Figure 7(b), where the distance Lt from the user's position Pr to the treasure's position Pt is less than approximately 100 meters, hint information H is generated only from the real image Gx2 of the two real images Gx1 and Gx2. Therefore, for example, only the word "sea" from the string "brick building" and the word "sea" can be included in the hint information H. From the above hint information H, it can be determined that the treasure's position Pt is near the "sea" (shooting position Px2).

[0085] According to this embodiment, the closer the distance Lt from the user's position Pr to the treasure location Pt, the easier it is to generate hint information H that can specifically identify the treasure location Pt. Therefore, the situation in which the user reaches the vicinity of the treasure location Pt but then moves away from it is suppressed. In other words, the user can be appropriately guided to the treasure location Pt.

[0086] Figure 8 illustrates a specific example of a prompt Dx for generating hint information H in the machine learning model 30. As described above, in this embodiment, the closer the distance Lt from the user position Pr to the treasure position Pt, the more the analysis range Ra is limited to the vicinity of the treasure position Pt, and the easier it is to generate hint information H that can identify the treasure position Pt (see Figures 7(a) and 7(b) above). In addition to the above configuration, this embodiment also employs a configuration in which the instruction string Sx of the prompt Dx is switched according to the distance Lt from the user position Pr to the treasure position Pt. The above configuration will be described in detail below.

[0087] As shown in Figure 8, if the distance Lt is greater than 300 meters, an analysis range Ra1 (approximately 100 meters) is set, and a prompt Dx is created that includes a real image Gx at the shooting position Px within range Rd (see Figure 7(a) above) of the analysis range Ra1. Furthermore, the above prompt Dx includes an instruction string Sx such as, "Using the real image Gx taken at shooting position Px (location information), generate a hint to go to treasure position Pt (location information) so that the direction of treasure position Pt (location information) as seen from user position Pr (location information) can be determined." From the above prompt Dx (instruction string Sx), it is difficult to pinpoint the specific location of treasure position Pt, but it is easy to generate hint information H that specifies the direction to go. For example, as shown in Figure 8, hint information H such as "It seems to be in the direction of... (east, west, north, south)" may be generated.

[0088] As shown in Figure 8, when the distance Lt is 300 meters or more and 101 meters or less, an analysis range Ra2 (approximately 50 meters) is set, and a prompt Dx is created that includes a real image Gx at the shooting position Px within range Rd of the analysis range Ra2. Furthermore, the above prompt Dx includes an instruction string Sx such as, "Using the real image Gx taken at shooting position Px, generate hints to go to treasure position Pt that show the direction of treasure position Pt as seen from the user position Pr, and the scenery visible from treasure position Pt or shooting position Px."

[0089] The above prompt Dx (instruction string Sx) makes it easy to generate hint information H that identifies the direction to take to reach the treasure location Pt (similar to the prompt Dx when the distance Lt is greater than 300 meters). Furthermore, the above hint information H includes information about the scenery visible from the treasure location Pt or the shooting location Px (around the treasure location Pt) (for example, the sea), and it may be possible to identify the treasure location Pt from this scenery. Therefore, when the distance Lt is between 101 meters and 300 meters, it is easier to generate hint information H that can identify the treasure location Pt compared to when the distance Lt is greater than 300 meters. For example, if the real-world image Gx at the treasure location Pt contains "sea", hint information H such as "...Let's go to a place where we can see the sea." may be generated.

[0090] As shown in Figure 8, when the distance Lt is between 51 meters and 100 meters, an analysis range Ra3 (approximately 10 meters) is set, and a prompt Dx is created that includes a real image Gx at the shooting position Px within range Rd of the analysis range Ra3. Furthermore, the above prompt Dx includes an instruction string Sx such as, "Using the real image Gx taken at shooting position Px, generate hints to go to treasure position Pt that show the direction of treasure position Pt as seen from the user position Pr, the scenery visible from treasure position Pt or shooting position Px, and the facility where treasure position Pt or shooting position Px is located."

[0091] The above prompt Dx (instruction string Sx) makes it easy to generate hint information H that allows the user to infer the direction to head in order to reach the treasure location Pt, the scenery visible from the treasure location Pt or shooting location Px, and the facility where the treasure location Pt or shooting location Px is located. Therefore, when the distance Lt is between 51 meters and 100 meters, it is easier to generate hint information H that can identify the treasure location Pt compared to when the distance Lt is farther than 100 meters. For example, if the real-world image Gx at the shooting location Px includes a "brick building," hint information H such as "...the brick building is a landmark." may be generated. According to the above prompt Dx (instruction string Sx), the effect that hint information H that can identify the treasure location Pt is easier to generate is particularly pronounced when the distance Lt from the user's location Pr to the treasure location Pt is close.

[0092] However, in a configuration where hint information H is generated by the machine learning model 30, the possibility of generating hint information H that moves the user away from the treasure location Pt cannot be completely eliminated. For example, consider a configuration in which the hint information H generated by the machine learning model 30 is notified to a user who has already reached the treasure location Pt. In this configuration, the undesirable situation arises where hint information H is generated that moves a user who has just reached the treasure location Pt away from that location Pt.

[0093] To mitigate the above inconveniences, this embodiment employs a configuration in which, when the distance Lt to the treasure location Pt is less than or equal to a predetermined distance, a predetermined hint information H is displayed instead of the hint information H generated by the machine learning model 30. Specifically, as shown in Figure 8, when the distance Lt to the treasure location Pt is 50 meters or less, the hint information H "The treasure is right in front of you! Find it in AR mode." is displayed.

[0094] In other words, if an item image Gi is provided at an event spot ves corresponding to the treasure location Pt, then when the user moves to the selectable range rsa (approximately 50 meters) of the item image Gi, hint information H, "The treasure is right in front of you! Find it in AR mode," will be notified. This hint information H is not generated by the machine learning model 30, but is predetermined. With this configuration, the aforementioned inconveniences are suppressed. However, the distance Lt at which the above hint information H is displayed is not limited to the above example (approximately 50 meters). For example, the configuration may be such that the above hint information H is notified when the distance Lt to the treasure location Pt is closer than 50 meters (for example, approximately 30 meters).

[0095] Figure 9(a) is a simulated example of an AR screen Mar displayed in AR mode. As shown in Figure 9(a), the AR screen Mar includes each object Gr in the real space Sr captured by the camera of the terminal device 10.

[0096] When AR mode is started, the terminal device 10 identifies the type of each object Gr included in the captured image. Specifically, the terminal device 10 segments (divides) each object Gr included in the captured image. AI technology may be used for this segmentation. For example, each object in the captured image is segmented using a trained FCN (Fully Convolutional Network) (for example, the technology described in Japanese Patent Application Publication No. 2022-29169 may be used). In the specific example in Figure 9(a), it is assumed that each object Gr, including the floor object Grg and the wall object Grw, is identified from each object Gr.

[0097] Immediately after switching to AR mode, the process for identifying each object Gr (hereinafter referred to as "identification process") is not yet complete. Also, immediately after switching to AR mode, the shooting range may not be sufficient to identify each object Gr. Considering these circumstances, a configuration may be adopted in which a message such as "Please slowly photograph your surroundings" is displayed immediately after switching to AR mode. This message will disappear once the identification process is complete. In this embodiment, the search operation described later will not be accepted until the identification process is complete.

[0098] As shown in Figure 9(a), the shovel image Gs is displayed as a virtual object on the AR screen Mar. This shovel image Gs is displayed in front of the user in augmented reality (AR). Buttons Bd and Be are also displayed on the AR screen Mar. When button Be is selected, AR mode ends and the AR screen Mar (augmented reality AR) switches to the map screen Mp (virtual space Sv).

[0099] When button Bd on the AR screen Mar is selected (touched), the shovel image Gs performs the action of digging a floor object in augmented reality (AR). If the user's position Pr is at the treasure location Pt, selecting button Bd initiates a discovery event in augmented reality (AR) where the treasure chest image Gt is excavated (see Figure 9(b) below). On the other hand, if the user's position Pr is not at the treasure location Pt, selecting button Bd displays a shovel image Gs that is repelled by an object in virtual reality (AR). Hereafter, the operation to initiate the discovery event (selecting button Bd in the specific example in Figure 9(a)) may be referred to as an "exploration operation".

[0100] As shown in Figure 9(a), the AR screen Mar displays a distance image Gd. The distance image Gd is displayed in a manner corresponding to the distance Lt from the user position Pr to the treasure position Pt. Specifically, as shown in Figure 9(a), the distance image Gd consists of an initial position Ta, a target position Tb, and a character C. The display position of the character C in the distance image Gd changes according to the distance Lt from the user position Pr to the treasure position Pt.

[0101] For example, if the distance Lt to the treasure location Pt is greater than approximately 50 meters, character C will be displayed at the initial position Ta of the distance image Gd. On the other hand, if the distance Lt is closer than 50 meters, character C will be displayed closer to the target location Tb than the initial position Ta. Specifically, character C moves in conjunction with the change in distance Lt to the treasure location Pt, and the closer the distance Lt is, the closer character C will be displayed to the target location Tb.

[0102] The above distance image Gd makes it easier for the user to reach the treasure location Pt quickly in AR mode. Let's assume a configuration in which the distance image Gd is not displayed in AR mode. In this configuration, the user would have to move around for a long time while taking pictures of the real space Sr in AR mode, which would be inconvenient for other passersby. This embodiment can suppress the above inconvenience.

[0103] Figure 9(b) is a simulated diagram of another specific example of the AR screen Mar displayed in AR mode. The specific example in Figure 9(b) assumes that the user's location Pr reaches the treasure location Pt, a search operation is performed (button Bd is selected), and a discovery event is initiated.

[0104] In this embodiment, even if the user's location Pr and the treasure's location Pt do not coincide, a discovery event can be initiated if the user's location Pr is within a predetermined distance from the treasure's location Pt. For example, the selectable range rsa of the treasure's location Pt is set to a range of approximately 10 meters from the treasure's location Pt. If the user's location Pr is within the selectable range rsa of the treasure's location Pt, a discovery event is initiated in response to the search operation.

[0105] Alternatively, instead of the configuration in which the character C in the distance image Gd moves to the target position Tb when the user reaches the treasure position Pt, a configuration may be adopted in which the character C moves to the target position Tb when the user reaches the selectable range rsa of the treasure position Pt. As will be described in detail later, the selectable range rsa is set variably according to the position attribute assigned to the treasure position Pt (see Figure 12(a)).

[0106] In discovery events, various virtual objects (such as a treasure chest image Gt) are displayed in augmented reality (AR). For example, in the discovery event in the specific example shown in Figure 9(b), a hole image Ga is superimposed on the floor object Grug. In addition, in the discovery event described above, a treasure chest image Gt emerging from the hole image Ga is displayed, and a message image Gm is displayed above the treasure chest image Gt. As will be described in detail later, in this embodiment, the type of discovery event (the type of virtual object displayed) changes depending on the positional attributes of the treasure location Pt.

[0107] The message image Gm in a discovery event displays information about the treasure item awarded to the user in that discovery event. Specifically, as shown in Figure 9(b), the message image Gm displays the name of the treasure item awarded to the user. In the example in Figure 9(b), we assume that "Local Item X" has been acquired. Treasure items that can be acquired in AR mode are exclusive items that cannot be acquired in virtual space mode (map screen Mp). Note that the information displayed in the message image Gm is not limited to the above example. For example, the message image Gm could be configured to display instructions on how to use the treasure item awarded to the user.

[0108] As shown in Figure 9(b), after the discovery event begins, buttons B(d, e) are grayed out and cannot be selected. Specifically, once the discovery event begins and each object, including the message image Gm, is displayed for a predetermined time (for example, about 5 seconds), the AR mode ends, and the AR screen Mar (virtual space AR) automatically switches to the map screen Mp (virtual space Sv). With this configuration, for example, the time the user spends standing at the treasure location Pt is reduced compared to a configuration where the AR mode must be manually ended after the discovery event ends. Therefore, there is an advantage in that the inconvenience of the user obstructing other passersby is suppressed.

[0109] Furthermore, as mentioned above, in AR mode, the user needs to continuously look at the screen of the terminal device 10 in order to capture the real-world space Sr with the terminal device 10. Therefore, because the user cannot adequately check their surroundings in AR mode, there is a risk of obstructing other passersby when the user travels long distances in AR mode. Considering these circumstances, this embodiment adopts a configuration in which the game progresses in virtual space mode when the user travels long distances, and the game progresses in AR mode only around the treasure location Pt. This configuration will be explained in detail below.

[0110] Figure 10 is a diagram illustrating specific examples of the conditions for obtaining each item (normal items, treasure items). As described above, in this embodiment, the user can obtain various items, including normal items and treasure items. However, the items that can be obtained change depending on whether it is AR mode or virtual space mode.

[0111] For example, as shown in Figure 10, regular items can be acquired in virtual space mode. Specifically, regular items (regular item image Giu) are placed on the map screen Mp (see Figure 4 above) representing the virtual space Sr. Furthermore, by moving within the selectable range rsa of a regular item, the user can acquire that regular item.

[0112] On the other hand, regular items cannot be obtained in AR mode. Specifically, regular items are hidden in the AR screen Mar in AR mode. In other words, even if the augmented reality (AR) displayed in the AR screen Mar includes an event spot res where a regular item is placed, that regular item will not be displayed in the AR screen Mar.

[0113] On the other hand, as shown in Figure 10, treasure items can be obtained in AR mode. Specifically, treasure items can be obtained through a discovery event on the AR screen Mar, which represents augmented reality (AR) (see Figure 9(b) above). However, treasure items cannot be obtained in virtual space mode. Specifically, treasure items (treasure location Pt) are not displayed on the map screen Mp in virtual space mode. Furthermore, even if the user is located within the selectable range rsa of a treasure item (treasure location Pt), the discovery event will not start in virtual space mode, and the treasure item cannot be obtained.

[0114] With the above configuration, the user will acquire regular items in virtual space mode while moving to the treasure location point, and then switch to AR mode at the treasure location point to acquire the treasure item. Therefore, the inconvenience of the user having to travel long distances in AR mode is suppressed.

[0115] However, if the selectable range (rsa) for normal items is narrow, it becomes necessary to pass near the normal items (res). Therefore, when the selectable range (rsa) for normal items is narrow, the path to acquire the normal items while moving to the treasure location (Pt) tends to become complicated. When the path to the treasure location (Pt) is complicated, the user's movement in the real-world space (Sr) tends to become unnatural, which is a disadvantage.

[0116] For example, Figure 10(b-1) is a diagram illustrating a specific example of the path K to the treasure location Pt in the proportional relationship of this embodiment. In the proportional relationship described above, it is assumed that the selectable range rsa of a normal item is approximately the same as the selectable range rsa of a treasure item (approximately 10 meters). Furthermore, the specific example in Figure 10(b-1) assumes a path K from the user's position Pr to the treasure location Pt (selectable range rsa3) via selectable range rsa1 and selectable range rsa2. In the proportional relationship described above, the path K is complex because the user has to change direction multiple times before reaching the treasure location Pt. Therefore, an inconvenience may arise where the user's movement path in the real space Sr becomes unnatural.

[0117] To mitigate the aforementioned inconveniences, this embodiment employs a configuration in which the selectable range rsa for normal items is wider than that for treasure items. Specifically, the selectable range rsa for normal items is approximately 50 meters from the event spot res where the normal item is located. On the other hand, the selectable range rsa for treasure items is approximately 10 meters from the event spot res (treasure location Pt) where the treasure item is located (however, as described later, the selectable range rsa for treasure items may change depending on the location attribute of the treasure location Pt).

[0118] Figure 10(b-2) is a diagram illustrating a specific example of the path K to the treasure location Pt in this embodiment. The specific example in Figure 10(b-2) assumes a path K that moves to the treasure location Pt(rsa3) via the selectable ranges rsa(1,2) of each normal item, similar to the specific example in Figure 10(b-1) in the proportional relationship described above. As shown in Figure 10(b-2), according to this embodiment, since the selectable range rsa(1,2) of the normal item is wider than the selectable range rsa3 of the treasure item, the path K becomes approximately a straight line. As can be understood from the above explanation, according to this embodiment, the inconvenience of the user's movement path in the real space Sr becoming unnatural is suppressed compared to the proportional relationship described above.

[0119] Furthermore, the selectable range rsa for treasure items may be set to approximately 50 meters, similar to the selectable range rsa for normal items. Even with the above configuration, the inconvenience of the path to the treasure location Pt becoming complicated while acquiring normal items is suppressed, as in this embodiment. However, with the above configuration, a new inconvenience arises: treasure items can be easily found, which diminishes the appeal of the treasure hunt event. According to this embodiment, the above inconvenience is suppressed. However, the present invention does not exclude the configuration in which the selectable range rsa for treasure items and the selectable range rsa for normal items are the same.

[0120] According to this embodiment, when the user travels long distances, the game proceeds in virtual space mode, and the game proceeds in AR mode only around the treasure location Pt. In addition to the above configuration, this embodiment employs a configuration that makes it difficult to switch to AR mode unnecessarily. Therefore, the effect of making it difficult for the user to obstruct other passersby is particularly significant. The above configuration will be explained in detail below with reference to Figure 11.

[0121] Figure 11 is a diagram illustrating a specific example of how a user discovers a treasure item. Figure 11 shows the mode (such as virtual space mode) at each point in time. For the purposes of the explanation below, the mode in which the map screen Mm is displayed will sometimes be referred to as "map screen mode." The map screen mode described above can also be described as a mode in which the virtual space Sv and augmented reality AR are not displayed. Specifically, even if the user moves during map screen mode, the screen of the terminal device 10 will not change in principle. Figure 11 also shows the period in which the distance image Gd (see Figure 9(a)) is displayed. Furthermore, Figure 11 shows the period in which user U moves with arrows.

[0122] In the treasure event, user U predicts the treasure location points where they can obtain treasure items. In the specific example in Figure 11, we assume that user U reaches the location predicted to be the treasure location points (hereinafter sometimes simply referred to as the "predicted location") at time t1. Furthermore, in the specific example in Figure 11, we assume that user U moved in the virtual space mode where normal items can be obtained during the period leading up to time t1.

[0123] Treasure items can be obtained in AR mode. Additionally, it is possible to switch to AR mode by selecting the AR mode start button Ba (see Figure 5(b) above) on the map screen Mm displayed in map mode. Furthermore, the map screen Mm can be displayed (switching to map mode) by selecting the map display button Bm (see Figure 4 above) on the map screen Mp in virtual space mode. With this configuration, a user U who has been playing the game in virtual space mode will need to switch to map mode and then to AR mode in order to obtain treasure items.

[0124] As described above, in map screen mode, hint information H is displayed to help estimate the treasure location Pt (see Figure 5(b)). With this configuration, user U will check the hint information H in map screen mode before switching to AR mode. In other words, user U can check whether the treasure location Pt estimated from the hint information H actually matches the expected location (current location) without switching to AR mode. If user U realizes from the hint information H that their current location is not the treasure location Pt (the prediction was wrong), user U can switch back to virtual space mode and move to another location without switching to AR mode.

[0125] In the specific example shown in Figure 11, we assume that at time t1, user U realizes from hint information H that the predicted location reached is not the treasure location Pt. In this case, without switching to AR mode, another predicted location is determined from hint information H, and user U moves to that predicted location.

[0126] In the specific example in Figure 11, we assume that at a subsequent time t2, user U reaches another predicted location. In this case, user U switches back from virtual space mode to map screen mode. Also in the specific example in Figure 11, we assume that user U determines, based on the hint information H in map screen mode, that their current location at time t2 may be the treasure location Pt. In this case, the user switches from map screen mode to AR mode where the treasure item can be obtained.

[0127] As shown in Figure 11, the aforementioned distance image Gd is displayed in AR mode. Furthermore, the distance image Gd allows the user to immediately determine whether the distance from their current location to the treasure location Pt is greater than approximately 50 meters. Specifically, if character C is located at the initial position Ta in the distance image Gd, it is determined that the distance from the user's current location to the treasure location Pt is greater than approximately 50 meters (see Figure 9(a)).

[0128] In the specific example shown in Figure 11, we assume that at time t2, the predicted location reached is approximately 50 meters or more away from the treasure location Pt. In this case, immediately after switching to AR mode, user U understands from the distance image Gd that the distance from their current location to the treasure location Pt is more than approximately 50 meters. Having understood that the distance from their current location to the treasure location Pt is more than approximately 50 meters, user U switches back from AR mode to virtual space mode and moves to another predicted location. With this configuration, for example, compared to a configuration where the distance to the treasure location Pt cannot be determined immediately after switching to AR mode, the inconvenience of the game continuing in AR mode for a long time at a distance from the treasure location Pt is suppressed.

[0129] In the specific example in Figure 11, we assume that at a subsequent time t3, user U reaches yet another predicted location. In this case, user U switches back from virtual space mode to map screen mode. Also in the specific example in Figure 11, we assume that user U determines, based on hint information H in map screen mode, that their current location may be the treasure location Pt. In this case, the user switches from map screen mode to AR mode where the treasure item can be obtained.

[0130] Furthermore, in the specific example shown in Figure 11, we assume that the expected location reached at time t3 is within approximately 50 meters of the treasure location Pt. As mentioned above, user U can understand from the distance image Gd that the treasure location Pt is within approximately 50 meters of the current location. Specifically, if the treasure location Pt is within approximately 50 meters of the current location, the character C in the distance image Gd will be displayed on the target location Tb side from the initial location Ta.

[0131] In AR mode, user U moves in a direction that brings character C in the distance image Gd closer to the target location Tb. When character C reaches the target location Tb (when the user moves within the selectable range rsa of treasure location Pt), user U performs a search operation. A discovery event is initiated in response to these search operations. When a discovery event is initiated in AR mode, the treasure item is awarded to user U, and the system automatically switches to virtual space mode.

[0132] According to this embodiment, the period during which the game is played in AR mode is minimized. Therefore, the inconvenience of the user obstructing other passersby is suppressed. The distance image Gd may also be displayed in the virtual space mode. In this configuration, as in this embodiment, the inconvenience of the AR mode being prolonged is suppressed.

[0133] However, in a configuration where the distance image Gd is displayed even in virtual space mode, a new disadvantage may arise: the treasure location Pt can be easily predicted, reducing the excitement of the treasure hunt event. Also, in a configuration where the distance image Gd is displayed even in virtual space mode, a disadvantage may arise where the user stares at the distance image Gd while moving in virtual space mode. In this embodiment, where the distance image Gd is displayed only in AR mode among virtual space mode and AR mode, there is an advantage in that the disadvantage of AR mode being prolonged can be suppressed while suppressing each of the above disadvantages.

[0134] Figure 12(a) is a diagram illustrating a specific example of the conditions for obtaining treasure items in AR mode. As mentioned above, treasure location points are assigned location attributes (such as deep-sea attributes). In this embodiment, depending on the combination of the user's attributes (such as items possessed) and the location attributes of the treasure location points, there are cases where treasure items can be obtained and cases where they cannot.

[0135] The location attributes assigned to treasure location Pt include "no attribute," "deep sea attribute," "water attribute," "flying attribute," and "long-range attribute." The management device 20 determines the treasure location Pt from the target range Rt (see Figure 5(a)) described above, and determines the location attribute of the treasure location Pt based on the map information (land, sea, river, etc.) at that treasure location Pt. For example, if the treasure location Pt is on land, the location attribute of the treasure location Pt is determined to be "no attribute."

[0136] Furthermore, if the treasure location Pt is in the sea, its location attribute is determined to be "deep sea attribute," and if the treasure location Pt is in a river, its location attribute is determined to be "water attribute." In addition, in some cases where the treasure location Pt is on land, its location attribute is determined to be either "flying attribute" or "long-range attribute." For example, if the treasure location Pt is near a high-rise building or a mountaintop, its location attribute is determined to be "long-range attribute." Also, if a predetermined event spot res (for example, an airport) is determined to be the treasure location Pt, its location attribute is determined to be "flying attribute."

[0137] In the specific example in Figure 12(a), we assume that the location attribute of treasure location Pt1 (X1, Y1) is "no attribute". We also assume that the location attribute of treasure location Pt2 (X2, Y2) is "deep sea attribute", the location attribute of treasure location Pt3 (X3, Y3) is "water attribute", the location attribute of treasure location Pt4 (X4, Y4) is "flying attribute", and the location attribute of treasure location Pt5 (X5, Y5) is "long-range attribute".

[0138] Figure 12(a) shows the location attributes of each treasure location point, as well as the user attributes required to obtain the treasure item at that treasure location point. Furthermore, as mentioned above, the selectable range rsa (the range in which a discovery event can be initiated) of a treasure location point may change depending on its location attributes. Figure 12(a) shows the selectable range rsa of each treasure location point. Additionally, the discovery event at a treasure location point changes depending on its location attributes. Figure 12(a) shows an overview of each discovery event initiated at each treasure location point.

[0139] As shown in Figure 12(a), when the location attribute of a treasure location Pt is "no attribute," the user can acquire the treasure item regardless of the user's attributes when they reach the treasure location Pt. In the discovery event when the location attribute is "no attribute," a treasure chest appears from the augmented reality (AR) floor object, and the treasure item is given to the user. Figure 9(b) above shows a specific example of the discovery event when the location attribute is "no attribute." The selectable range rsa for a treasure location Pt with the location attribute "no attribute" is set to a range of approximately 10 meters from the treasure location Pt.

[0140] Specifically, if the location attribute of the treasure location Pt is "no attribute", and the augmented reality (AR) captured by the terminal device 10 includes a floor object (i.e., the ground is captured), the discovery event can be started. The configuration for determining whether or not the augmented reality (AR) captured by the terminal device 10 includes a floor object can be changed as appropriate. For example, it may be determined whether or not the floor object has been identified by the identification process described above. Alternatively, the configuration may be such that it is determined whether or not the orientation of the terminal device 10 at the time the search operation is performed is such that it can capture a floor object, and the discovery event can be started if it is in an orientation such that it can capture a floor object. The orientation of the terminal device 10 can be detected by the acceleration direction sensor 106 described above.

[0141] If the location attribute of the treasure location Pt is "deep sea attribute," the selectable range rsa is set to a range of approximately 70 meters from the treasure location Pt. In other words, the selectable range rsa is wider when the treasure location Pt is in the sea than when the treasure location Pt is on land (rsa = approximately 10 meters). With this configuration, situations where the user gets too close to the sea are suppressed. Note that the treasure location Pt will not be set to a location in the sea that is more than 50 meters from land. If the augmented reality (AR) captured by the terminal device 10 includes the sea, the discovery event can be started.

[0142] In this embodiment, a ship item is given to the user. The ship item levels up at predetermined triggers. For example, the ship item's level increases according to the number of steps the user takes. If the location attribute of a treasure location point is "deep sea attribute," when the user reaches the treasure location point, they may or may not be able to obtain the treasure item, depending on the level of the ship item they possess (hereinafter simply referred to as "ship level").

[0143] Specifically, if the location attribute of the treasure location point is "deep sea attribute," and the ship level is at its maximum, a discovery event will start and the treasure item will be awarded to the user. In this discovery event, a treasure chest (virtual object) will appear from the sea (see Figure 13(c) below). On the other hand, if the ship level is lower than the maximum, the discovery event will not start and the treasure item will not be awarded even if the user reaches the treasure location point.

[0144] For example, if the ship level is less than the value N (where "N" is a number less than the maximum ship level), no special event will start at the treasure location point. On the other hand, if the ship level is less than the maximum but greater than the value N, a notification event will start at the augmented reality (AR) treasure location point. These notification events are designed to inform the user that treasure is hidden at the treasure location point (see Figure 13(b) below).

[0145] If the location attribute of the treasure location Pt is "water attribute," the selectable range rsa is set to extend approximately 70 meters from the treasure location Pt. In other words, the selectable range rsa is wider when the treasure location Pt is on a river than when the treasure location Pt is on land (rsa = approximately 10 meters). With this configuration, situations where the user gets too close to the river are suppressed. If the augmented reality (AR) captured by the terminal device 10 includes a river, the discovery event can be started.

[0146] In this embodiment, multiple types of ally characters can be assigned to the user. These ally characters include swimming skill characters, flying skill characters, telephoto skill characters, and fire attribute characters. These ally characters can be acquired by progressing through the game. If the location attribute of the treasure location points is "water attribute," and the user possesses a swimming skill character among the ally characters, a discovery event can be started. In this discovery event, a treasure chest (virtual object) floating in a river is displayed in augmented reality (AR).

[0147] Furthermore, if the user possesses a swimming skill character, their ship level is N or higher, and they possess a special item, the aforementioned discovery event can be initiated at a treasure location Pt with the "Water" attribute, and the treasure item will be awarded to the user. These special items are awarded to the user, for example, when they clear a special event (for example, the hint-granting event described later). On the other hand, if the user does not possess either a swimming skill character or a special item, and their ship level is less than N, the discovery event will not be initiated, and the treasure item cannot be obtained.

[0148] As shown in Figure 12(a), if the location attribute of the treasure location Pt is "flying attribute", the selectable range rsa is set to approximately 50 meters from the treasure location Pt. In addition, if the augmented reality (AR) captured by the terminal device 10 includes the sky, the discovery event can be started. Specifically, it is determined whether the orientation of the terminal device 10 is such that it can capture the sky, and if it is, the discovery event can be started.

[0149] If the location attribute of the Treasure Location Points is "Flying," and the user possesses a character with the Flying skill among their allies, a discovery event can be initiated. In this discovery event, a character with the Flying skill will be displayed acquiring a treasure chest floating in the augmented reality (AR) sky. On the other hand, if the user does not possess a character with the Flying skill, the discovery event will not be initiated for the Treasure Location Points.

[0150] If the location attribute of the treasure location Pt is "far-range attribute," and the user possesses a telephoto skill character among their allies, the discovery event can be started. Specifically, regardless of the user's position in real space Sr, if the treasure location Pt (high-rise building, mountaintop) is included in the augmented reality (AR) image captured by the terminal device 10, the discovery event can be started. In this discovery event, the treasure chest is displayed enlarged at the treasure location Pt (e.g., mountaintop) in augmented reality (AR). On the other hand, if the user does not possess a telephoto skill character, the discovery event will not be started. However, even if the user does not possess a telephoto skill character, a smaller treasure chest will be displayed at the treasure location Pt in augmented reality (AR) compared to the treasure chest in the discovery event.

[0151] Furthermore, if the user possesses a telephoto skill character among their allies, information regarding the treasure location points will be notified to the user in AR mode, even if the location attribute of the treasure location points is not "long-range attribute". Figure 12(b) is a specific example of the distance image Gd displayed on the AR screen Mar when the user possesses a telephoto skill character. The specific example in Figure 12(b) assumes that the location attribute of the treasure location points is not "long-range attribute". Also, the specific example in Figure 12(b) assumes that the user is not located within the selectable range rsa of the treasure location points. In the above cases, a notification image Gmt will be displayed on the distance image Gd. The notification image Gmt will display information regarding the treasure location points. For example, the name of the facility of the treasure location points will be displayed on the notification image Gd.

[0152] The information displayed in the notification image Gd is not limited to the examples above. For example, the notification image Gd may be configured to display the types of treasure items that can be obtained at the treasure location Pt. Also, if the user possesses a telephoto skill character, the notification image Gd may be displayed in AR mode and the discovery event may be started (treasure items can be obtained) even if the user is not located within the selectable range rsa of the treasure location Pt.

[0153] Let's return to the explanation of Figure 12(a). In this embodiment, the management device 20 may set a hint location Ph in addition to the treasure location Pt during a treasure hunt event. At the hint location Ph, a hint-granting event can be started in AR mode (augmented reality). In the hint-granting event, no treasure item is awarded, but special hint information H is notified to the user. For example, in the hint-granting event, hint information H that can directly identify the treasure location Pt (for example, the name of the facility where the treasure location Pt is set) is notified. The hint information H notified in the hint-granting event may be configured to be displayed on the map screen Mm (hint image Gh) in subsequent treasure hunt events.

[0154] Specifically, the management device 20 sets all locations other than the treasure location Pt within the target range Rt as hint locations Ph. When the user moves within a predetermined distance (for example, about 10 meters) from hint location Ph and a search operation is accepted in AR mode, a hint granting event is initiated.

[0155] However, the hint-granting event will only begin if the user possesses a fire-attribute character. In this hint-granting event, hint information H will be displayed on predetermined objects (floor objects, wall objects). Specifically, a fire-attribute character will be displayed on an augmented reality (AR) object, burning out a string of characters indicating hint information H. It is also possible to configure the system so that the hint-granting event can be started regardless of the user's attributes (such as possessed allied characters).

[0156] Figure 13(a) is a diagram illustrating another specific example of the AR screen Mar. Figure 13(a) assumes that the treasure location Pt is set to the sea. In this case, as explained in Figure 12(a) above, the location attribute of the treasure location Pt becomes "deep sea attribute". Furthermore, the specific example in Figure 13(a) assumes that the user is located at the treasure location Pt. As mentioned above, when the user is located at the treasure location Pt, the character C is located at the target location (right edge) of the distance image Gd.

[0157] Figure 13(a) illustrates the period immediately following the acceptance of a search operation to initiate a discovery event. However, the specific example in Figure 13(a) assumes that the user's attributes do not meet the conditions for initiating a discovery event (see Figure 12(a) above). Specifically, it assumes that the user's ship level is less than the numerical value N. In this case, even if the user is located at the treasure location Pt, the discovery event will not be initiated.

[0158] If a search operation is accepted during a period when the conditions for starting a discovery event have not been met, a message image Gm0 will be displayed on the AR screen Mar. For example, if the user has not reached the selectable range rsa of the treasure location Pt, the message image Gm0 will be displayed in response to the search operation. Also, if the location attribute of the treasure location Pt is "deep sea attribute" and the user's ship level is less than the numerical value N, the message image Gm0 will be displayed in response to the search operation. The above message image Gm0 will be displayed for a predetermined time (for example, about 3 seconds) and will display a message indicating that the treasure item could not be found. It is preferable that new search operations are not accepted during the period when the message image Gm0 is displayed.

[0159] Figure 13(b) is a diagram illustrating yet another specific example of the AR screen Mar. Similar to the example in Figure 13(a), the example in Figure 13(b) assumes that the location attribute of the treasure location Pt is "deep sea attribute" and that the user is located at the treasure location Pt. However, the example in Figure 13(b) assumes that the user's ship level is greater than or equal to the numerical value N and less than the maximum value. In this case, the notification event described above is initiated in response to the search operation (see Figure 12(a)).

[0160] The specific example in Figure 13(b) assumes a period during a notification event. In a notification event where the location attribute of the treasure location Pt is "deep sea attribute," a ship image Gs1 is displayed at the treasure location Pt, and a message image Gm1 is displayed above the ship image Gs1. The above message image Gm1 displays a message to notify the treasure location Pt in augmented reality (AR). However, the specific name of the treasure item is not notified in the message image Gm1.

[0161] However, as mentioned above, if the user's ship level is below the maximum value, the discovery event will not start, and the treasure item will not be obtained. The ship image Gs1 and message image Gm1 shown above will be displayed for a predetermined time (for example, about 5 seconds), and then will disappear. In addition, the notification event may be configured to inform the user of the condition for starting the discovery event (reaching the maximum ship level).

[0162] Figure 13(c) illustrates yet another specific example of the AR screen Mar. Similar to the examples in Figures 13(a) and 13(b), Figure 13(c) assumes that the location attribute of the treasure location Pt is "deep sea attribute" and that the user is located at the treasure location Pt. However, the example in Figure 13(c) assumes that the user's ship level is at its maximum value. In this case, the discovery event described above is initiated in response to the exploration operation (see Figure 12(a)).

[0163] Figure 13(c) shows the duration of a discovery event. In a discovery event where the location attribute of the treasure location Pt is "deep sea attribute," a ship image Gs2 pulling up the treasure chest from the sea is displayed at the treasure location Pt, and a message image Gm2 is displayed above the ship image Gs2. The above message image Gm2 displays information about the treasure item assigned to the user. For example, the message image Gm2 displays the name of the treasure item. As mentioned above, when the discovery event in augmented reality (AR) ends, AR mode automatically ends and switches to virtual space mode (map screen Mp).

[0164] Figure 14(a) is a flowchart of the AR mode processing performed by the terminal device 10. The terminal device 10 performs AR mode processing in AR mode. Note that each step of the AR mode processing may be performed jointly by the terminal device 10 and the management device 20, or by the management device 20 alone.

[0165] When AR mode processing is started, the terminal device 10 performs the identification process described above and starts displaying the AR screen Mar which includes the distance image Gd (S101). Subsequently, the terminal device 10 determines whether or not a selection operation (search operation) for button Bd has been accepted (S102). If no search operation has been accepted (S102: Yes), the terminal device 10 determines whether or not a selection operation (operation to end AR mode) for button Be has been accepted (S103). The terminal device 10 repeats steps S102 and S103 until a search operation or an operation to end AR mode is accepted.

[0166] If an operation to terminate AR mode is received (S103: Yes), the terminal device 10 hides various images, including the distance image Gd, displayed on the AR screen Mar (S104), displays the map screen Mp (S105), and terminates the AR mode processing. On the other hand, if a search operation is received (S102: No), the terminal device 10 sends judgment information to the management device 20 (S106). The judgment information includes various pieces of information to determine whether or not the conditions for starting a discovery event have been met. For example, the judgment information includes information that identifies the user's position Pr, the user's attributes (such as items they possess), and the orientation of the terminal device 10.

[0167] When the management device 20 receives the above-mentioned determination information, it determines whether the conditions for starting a discovery event are met and sends result information indicating the determination result to the terminal device 10. When the terminal device 10 receives the above result information (S107), it determines whether the result information is "discovered" (the conditions for starting a discovery event are met) (S108). If the result information is not "discovered" (S108: No), the terminal device 10 displays the above-mentioned message image Gm0 (see Figure 13(a)) or message image Gm1 (see Figure 13(b)) and returns to step S102.

[0168] If the result information is "discovered" (S108: Yes), the terminal device 10 executes the discovery process (S109) and proceeds to step S104 described above. In the discovery process, a discovery event (see Figures 9(b) and 13(c) described above) is executed in AR mode, and a treasure item is awarded. When the discovery process is completed, steps S104 and S105 described above are automatically executed, AR mode ends, and the system switches to virtual space mode.

[0169] Figure 14(b) is a flowchart of the hint generation process performed by the management device 20. The management device 20 executes the hint generation process when the map screen Mm is displayed on the terminal device 10 (when the map display button Bm is selected). In the above hint generation process, hint information H is generated. Note that each step of the hint generation process may be performed jointly by the terminal device 10 and the management device 20, or may be performed by the terminal device 10 alone.

[0170] When the hint generation process is started, the management device 20 calculates the distance Lt mentioned above (S201). Specifically, the distance Lt is calculated from the location information (user location Pr) of the terminal device 10 and the treasure location Pt. Then, the management device 20 determines the analysis range Ra (100 meters, 50 meters, 10 meters) according to the distance Lt and treasure location Pt calculated in the previous step S201 (S202).

[0171] The management device 20 acquires the real image Gx of the shooting position Px in the analysis range Ra determined in the previous step S202 from the map system 40 (S203). Specifically, one or more of the shooting positions Px in the analysis range Ra are randomly selected, and the real image Gx of the selected shooting position Px is acquired. However, it is also possible to configure the system so that word-of-mouth information for each shooting position Px is acquired from the map system 40, and the shooting position Px from which the real image Gx is acquired (for example, a popular shooting position) is determined based on this word-of-mouth information.

[0172] The management device 20 obtains word-of-mouth information for the shooting location Px and treasure location Pt from the map system 40 where the real image Gx was acquired (S204). The management device 20 creates a prompt Dx that includes the location information of the treasure location Pt, the real image Gx acquired in step S203, and the word-of-mouth information acquired in step S204, and sends it to the machine learning model 30 (S205). As described above, the prompt Dx includes an instruction string Sx corresponding to the distance Lt.

[0173] When a prompt Dx is sent to the machine learning model 30, the hint information H generated using the prompt Dx is received by the management device 20 (S206). Upon receiving the hint information H, the management device 20 sends the hint information H to the terminal device 10 (S207) and terminates the hint generation process. The terminal device 10 displays the hint information H received from the management device 20 on the map screen Mm.

[0174] <Variation> Each of the above forms can be modified in various ways. Specific examples of modifications are given below. Two or more forms can be arbitrarily selected from the following examples and combined as appropriate.

[0175] (1) In each form, specific examples of prompt Dx for causing the machine learning model 30 to generate hint information H are not limited to the example shown in Figure 8 above. Figure 15(a) is a diagram illustrating specific examples of prompt Dx in modified forms.

[0176] In the embodiment shown in Figure 8 above, a configuration is adopted in which the instruction string Sx of prompt Dx is switched according to the distance Lt from the user position Pr to the treasure position Pt. On the other hand, in the modified example shown in Figure 15(a), instead of distance Lt, the instruction string Sx of prompt Dx is switched according to the number of times the user has performed a specific operation. Specifically, a configuration is adopted in which the instruction string Sx of prompt Dx is switched according to the number of search operations (operations to acquire treasure items) performed outside of the treasure position Pt in AR mode (hereinafter referred to as "number of failures n").

[0177] If a treasure item is awarded, the failure count n will be reset to "0". Alternatively, the failure count n may be reset when AR mode ends, regardless of whether a treasure item is obtained or not. However, if a treasure item is not obtained, the failure count n may not be reset when AR mode ends.

[0178] For example, consider the case where the number of failures n is less than 10 (n<10). In this case, as shown in Figure 15(a), the prompt Dx will contain the instruction string Sx which reads, "Use the real image Gx taken at shooting position Px (location information) to generate a hint to go to treasure location Pt (location information) that shows the direction of treasure location Pt (location information) from the user's position Pr (location information)." Also, if the number of failures n is between 10 and 14 (10≦n≦14), the prompt Dx will contain the instruction string Sx which reads, "Use the real image Gx taken at shooting position Px to generate a hint to go to treasure location Pt that shows the direction of treasure location Pt from the user's position Pr, and the scenery visible from treasure location Pt or shooting position Px." Furthermore, if the number of failures n is between 15 and 20 (15 ≤ n ≤ 20), the prompt Dx will contain an instruction string Sx that reads, "Using the real image Gx taken at shooting position Px, generate hints to get to treasure position Pt that show the direction of treasure position Pt from the user position Pr, the scenery visible from treasure position Pt or shooting position Px, and the facility where treasure position Pt or shooting position Px is located."

[0179] According to the prompt Dx in the above modified example, the more failures n there are, the more helpful hint information H is generated that makes it easier to identify the treasure location Pt. However, in a configuration where the more failures n there are, the more helpful hint information H is generated that makes it easier to identify the treasure location Pt, there remains room for cheating, such as repeating the search operation to increase the number of failures n, even though it is known that it is not the treasure location Pt. Considering these circumstances, a configuration that suppresses the above cheating may be adopted. For example, if a predetermined number of search operations (e.g., 5 times) are performed consecutively in a short period of time (e.g., about 5 minutes), a configuration may be adopted in which no new search operations are accepted until a predetermined time (e.g., about 30 minutes) has elapsed.

[0180] Furthermore, in the embodiment shown in Figure 8 above, a configuration is adopted in which the analysis range Ra from which the real image Gx is acquired is switched according to the distance Lt from the user position Pr to the treasure position Pt. On the other hand, in the modified example shown in Figure 15(a), the analysis range Ra does not change regardless of the distance Lt and the number of failures n. Specifically, the analysis range Ra is fixed to a range of approximately 50 meters from the treasure position Pt.

[0181] Furthermore, in the modified version shown in Figure 15(a), a configuration is adopted in which prompt Dx is created from a common real image Gx regardless of the number of failures n. That is, a configuration is adopted in which only the instruction string Sx of prompt Dx changes. According to the above modified version, multiple types of hint information H can be generated from a common real image Gx. Therefore, there is an advantage in that multiple types of hint information H can be created while suppressing the number of times real image Gx is acquired from the map system 40.

[0182] However, in the modified example, the analysis range Ra may be configured to change depending on the number of failures n. For example, if the number of failures n is less than 10, a prompt Dx may be created from the real image Gx of analysis range Ra1 as described above; if the number of failures n is between 10 and 14, a prompt Dx may be created from the real image Gx of analysis range Ra2 as described above; and if the number of failures n is between 15 and 20, a prompt Dx may be created from the real image Gx of analysis range Ra3 as described above.

[0183] In addition, in the embodiment shown in Figure 8 above, the analysis range Ra may be configured to be constant regardless of the distance Lt. Specifically, the prompt Dx may be created from a common real image Gx regardless of the distance Lt. Furthermore, in each form (Figure 8, Figure 15(a)), the instruction string Sx in the prompt Dx may be fixed, while the analysis range Ra (real image Gx) changes according to the distance Lt.

[0184] Furthermore, in the modified example shown in Figure 15(a), if the number of failures n reaches a predetermined number (for example, 21 times), the user may be notified of information that specifically identifies the treasure location Pt. As an example of such a configuration, a specific image (for example, an image representing a treasure chest) may be displayed at the position corresponding to the treasure location Pt on the map screen Mp in virtual space mode. Alternatively, in the AR screen Mar of AR mode, a specific image may be displayed at the treasure location Pt in augmented reality AR.

[0185] Figures 15(b-1) and 15(b-2) illustrate specific examples of the distance image Gd in the modified examples described above. In these modified examples as well, similar to the embodiments described above (see Figures 9(a) and 9(b)), the distance image Gd is displayed on the AR screen Mar, and the distance to the treasure location Pt is indicated to the user.

[0186] Furthermore, in this modified version, when the number of failures n reaches a predetermined number (e.g., 10 times), a hint image Gmh is displayed on the distance image Gd. The hint image Gmh displays hints for identifying the treasure location Pt. For example, if the distance Lt from the user's location Pr to the treasure location Pt is greater than a predetermined distance (e.g., approximately 50 meters), this fact is indicated by the hint image Gmh.

[0187] Figure 15(b-1) shows a specific example of the distance image Gd (hint image Gmh) when the distance Lt from the user's position Pr to the treasure's position Pt is greater than approximately 50 meters. In this case, as shown in Figure 15(b-1), the character C in the distance image Gd is displayed at the initial position Ta. Also, if the distance Lt from the user's position Pr to the treasure's position Pt is greater than approximately 50 meters, the hint image Gmh of the distance image Gd will display the message "It's not nearby" (hint).

[0188] Furthermore, a message corresponding to the user's (terminal device 10's) direction of travel is displayed in the hint image Gmh of the distance image Gd. For example, the specific example in Figure 15(b-2) assumes that the user is moving in a direction different from the treasure location Pt. In this case, the message "Not that way!" is displayed in the hint image Gmh of the distance image Gd. Also, if the user is moving in the direction of the treasure location Pt, the message "That direction looks suspicious" is displayed in the hint image Gmh of the distance image Gd. The user's direction of travel can be determined, for example, by the time change of the user's position Pr (GPS compass). However, from the viewpoint of suppressing the inconvenience of the user staring at the terminal device 10 while moving, it is preferable that the display of the hint image Gmh is fixed to "It's not nearby" when the distance Lt is farther than approximately 50 meters.

[0189] (2) In each form, a search operation (number of failures n) was adopted as an example of a "specific operation" that changes prompt Dx, but other user operations may also be adopted as "specific operations". For example, the more times the operation to use a given item is performed (number of times the item is used), the more prompt Dx (both or either of the real image Gx and the instruction string Sx) may change to generate hint information H that makes it easier to identify the treasure location Pt. Also, the more times the operation to switch to AR mode (selection operation of the AR mode start button Ba) is performed, the more prompt Dx may change to generate hint information H that makes it easier to identify the treasure location Pt.

[0190] (3) In each configuration, the method for determining the treasure location points is not limited to the examples described above. For example, the configuration may allow other users to determine the treasure location points. Specifically, consider a configuration in which user Ua, who possesses a treasure item, can initiate an event to hide the treasure item at a location of their choosing. In this configuration, the location where the treasure item is hidden can be set as the treasure location points. Furthermore, when another user Ub uses a map item, once the treasure location points are determined, hint information H regarding those treasure location points is generated. By reaching the treasure location points, the other user Ub can obtain the treasure item hidden by user Ua.

[0191] Furthermore, when User Ua hides a treasure item, it may be possible to configure the system to allow one of the predetermined messages (or a custom message created by User Ua) to be set for that treasure item. In this configuration, when User Ub discovers the treasure item, the message set by User Ua will be displayed to User Ub.

[0192] (4) In each configuration, the triggers for displaying hint information H are not limited to the examples described above. For example, consider a configuration in which a hint request button is displayed on the map screen Mp in virtual space mode. In the above configuration, the hint information H may be displayed on the map screen Mp for a predetermined time (for example, about 1 minute) when the hint request button is selected. Alternatively, the hint information H may be displayed when the distance Lt from the user's position Pr to the treasure position Pt reaches a predetermined distance. For example, in the embodiment shown in Figure 8 above, the hint information H may be automatically displayed on the map screen Mp for a predetermined time (for example, about 1 minute) when the analysis range Ra switches according to the distance Lt.

[0193] In the modified version of Figure 15(a) described above, the hint information H may be displayed on the AR screen Mar for a predetermined time (for example, about 1 minute) when the number of failures n reaches a predetermined number (for example, the number of times the instruction string Sx is switched). Furthermore, the hint information H may be displayed in AR mode according to the positional relationship between the position where the search operation was performed and the treasure location Pt. For example, if the distance from the position where the search operation was performed to the treasure location Pt is closer than a predetermined distance (for example, about 15 meters), the hint information H "Almost!" may be displayed on the hint image Gmh.

[0194] (5) In each form, the hint information H may not be displayed immediately after the treasure hunt event starts, and the hint information H may become available for display after predetermined display conditions are met. For example, the display conditions may include the number of failures n mentioned above reaching a predetermined number (e.g., 10 times).

[0195] Furthermore, the display condition for hint information H may be set as the number of steps the user has taken since the start of the treasure hunt event reaching a predetermined number of steps (for example, 5000 steps). Alternatively, special items may be placed in the virtual space Sv (map screen Mp), and the display condition for hint information H may be set as acquiring these special items. In the above configuration, the display condition for hint condition H may also be set as acquiring a predetermined number or more of special items.

[0196] For example, consider a configuration that uses a stone tablet item that displays a predetermined string as a special item. In this configuration, all stone tablet items are acquired, and by combining the strings of each stone tablet item, one piece of hint information H is displayed. Furthermore, in AR mode, if a search operation is performed at a predetermined location other than the treasure location Pt, a special item may be acquired.

[0197] (6) In each form, the search operation is not limited to the example described above (selection operation of button Bd). For example, the selection operation of an augmented reality (AR) object displayed on the AR screen Mar may be adopted as the search operation. One possible configuration is that when the object on which the treasure location Pt is located is selected (searched) among the augmented reality (AR) objects (e.g., floor object, wall object, sea object, etc.), the treasure item discovery event is started.

[0198] Furthermore, in addition to the position and orientation of the terminal device 10, a configuration is assumed in which an illuminance sensor capable of detecting ambient brightness is provided. The illuminance sensor is provided on the side of the terminal device 10 opposite to the surface on which the display panel 104a is provided (the back side). Therefore, if the terminal device 10 is placed with its back side in contact with the floor, the illuminance sensor will hardly detect any light. In the above configuration, the discovery event may be initiated when light is detected again after the illuminance sensor has almost stopped detecting any light at the treasure location Pt. In the above configuration, the user's action of picking up the terminal device 10 after placing it at the treasure location Pt becomes a search operation. In addition, in AR mode, if the illuminance sensor hardly detects any light, a predetermined image (for example, an image of a shovel digging in the ground Gs) may be displayed.

[0199] (7) In each form, the treasure items can be changed as appropriate. For example, items that can be obtained on the map screen MP may be used as treasure items.

[0200] Furthermore, the type of treasure item awarded to a user may change depending on the process the user goes through to find the treasure item (such as the time it takes to find it). For example, the shorter the time from the start of the treasure hunt event until the treasure item is found, the more advantageous the treasure item awarded to the user may be. Also, the fewer steps the user takes from the start of the treasure hunt event until the treasure item is found, the more advantageous the treasure item awarded to the user may be. In addition, the longer the time from the start of the treasure hunt event until the treasure item is found, the more advantageous the treasure item awarded may be, or the more steps the user takes from the start of the treasure hunt event until the treasure item is found, the more advantageous the treasure item awarded may be.

[0201] However, let's assume a configuration where other events in the game cannot be progressed without obtaining treasure items. In this configuration, users who cannot use AR mode effectively (for example, younger users) may face the inconvenience of being unable to progress through most events, including the treasure hunt event. Considering these circumstances, a configuration that allows other events to be progressed without obtaining treasure items is preferable.

[0202] (8) In each form, the virtual objects displayed in augmented reality (AR) are not limited to the examples described above. For example, a predetermined character may be displayed as a virtual object. In the above configuration, when the character is selected in AR mode, hint information H may be displayed. The above character may appear in AR mode when the number of failures n reaches a predetermined number.

[0203] In AR mode, the system may be configured to display virtual objects that assist in finding the treasure location Pt. For example, in AR mode, the system may be configured to display predetermined virtual objects (e.g., objects representing footprints) along the path the user has traveled. Furthermore, in AR mode, the system may be configured to display predetermined virtual objects (landmark objects) at locations where the search operation has already been performed.

[0204] (9) In each form, the map screen mode may be configured to display images that assist in finding the treasure location Pt. For example, the user's movement path during the treasure hunt event may be displayed on the map image Gm. Alternatively, the locations where the search operation has already been performed may be displayed on the map image Gm. Similarly, the virtual space mode may be configured to display images that assist in finding the treasure location Pt. For example, the user's movement path during the treasure hunt event may be displayed on the map screen Mp. Alternatively, the locations where the search operation has already been performed may be displayed on the map screen Mp.

[0205] (10) In each form, the treasure hunt event may be configured to be interruptible. If the treasure hunt event is interrupted, the map item Mm may be consumed, or the map item Mm may not be consumed. Furthermore, if the treasure hunt event is resumed after being interrupted, the new treasure location points may be determined according to the user's current location, or the treasure location points from before the interruption may be reset.

[0206] (11) In each form, the location attribute of the treasure location Pt can be changed as appropriate. Furthermore, the method for determining the location attribute of the treasure location Pt is not limited to the examples above. For example, the location attribute of the treasure location Pt may be determined independently of real-world map information (land, sea, rivers, etc.). For example, the location attribute of a treasure location Pt on land may be determined to be "deep sea attribute". Furthermore, in the above configuration, an image corresponding to the location attribute of the treasure location Pt may be displayed on the map screen Mp (virtual space Sv) independently of map information. For example, consider the case where the location attribute of a treasure location Pt on land is determined to be "deep sea attribute". In the above case, an image representing the sea may be displayed in the virtual space Sv corresponding to the treasure location Pt.

[0207] (12) In each form, the configuration may be such that the treasure location Pt is indicated in the virtual space mode (map screen Mp). For example, as described above, one of the event spots res in the target range Rt is determined to be the treasure location Pt. In the above configuration, it is assumed that one or more of the event spots res other than the treasure location Pt in the target range Rt are determined to be candidate locations Pk. Furthermore, in the above configuration, it is assumed that a common candidate location icon is displayed for the event spot ves corresponding to the treasure location Pt and for each event spot ves corresponding to each candidate location Pk.

[0208] In the above configuration, the user predicts which of the event spots res corresponding to each candidate location icon is set as the treasure location Pt, using hint information H as a reference. Furthermore, in the above configuration, it may be possible to switch to an AR mode that accepts search operations, provided that the user is located within the selectable range rsa (approximately 50 meters) of the candidate location icon (candidate location Pk). In other words, the location from which it is possible to switch to AR mode via the map screen Mm may be limited to the vicinity of the candidate location Pk.

[0209] (13) In each configuration, the timing of the generation of hint information H can be changed as appropriate. For example, in the above embodiment, a configuration was adopted in which hint information H is generated immediately before it is displayed. Instead of the above configuration, a configuration in which hint information H is generated in advance may be adopted. For example, suppose that immediately after the start of the treasure hunt event the distance Lt is 301 meters or more. In this case, hint information H is generated immediately after the start of the treasure hunt event using the real image Gx in the analysis range Ra1. In the above configuration, during the period when the distance Lt is 301 meters or more, the hint information H generated immediately after the start of the treasure hunt event is displayed repeatedly each time the map screen Mm is displayed.

[0210] With the above configuration, there is no need to generate hint information H when displaying the map screen Mm, which has the advantage of allowing the map screen Mm to be displayed immediately. In addition, compared to a configuration in which hint information H is newly generated each time the map screen Mm is displayed, the number of times the machine learning model 30 is made to generate hint information H is reduced. Furthermore, in the above configuration, when the distance Lt falls below 300 meters, hint information H is generated using the real image Gx in the analysis range Ra2, and when the distance Lt falls below 100 meters, hint information H is generated using the real image Gx in the analysis range Ra3.

[0211] (14) In each embodiment, specific examples of the present invention applied to location-based games have been described. However, the present invention may also be applied to things other than location-based games. For example, the present invention can be applied to a map service that helps users reach predetermined locations (e.g., stores), a service that measures a user's movement history (number of steps taken, distance traveled) to manage the user's health, a matching service for matching users together, and a pedometer point service that awards points according to the number of steps taken by the user.

[0212] The embodiments described above may be combined in any way as appropriate, replaced with other configurations, parts of the configuration may be deleted, or parts of the configuration may be modified. Furthermore, any publicly known technology at the time of filing that is not described herein may be adopted as appropriate.

[0213] <Note: Summary of the operation and effects of the embodiment> <First aspect> The program (PGx, PGy) in this embodiment is a program that enables a user at a first location (user location Pr) in real space to move to a second location (treasure location Pt) and proceed with a specific event (discovery event) corresponding to the second location. The program causes the computer to function as a notification means (11) that notifies the user at the first location of specific information (hint information H) according to the analysis results of a real image (Gx) that shows the real space related to the second location (shooting location Px in the analysis range Ra). According to this embodiment, the interest level of the service is improved.

[0214] <Second to fifth aspects> In this embodiment of the program, the notification means notifies specific information corresponding to the distance (Lt) from the first position to the second position. Specifically, the closer the distance from the first position to the second position, the more easily the user can identify the second position, as notified by the notification means (see Figure 8). For example, if the distance from the first position to the second position is greater than or equal to a predetermined threshold (approximately 301 meters), the notification means notifies specific information corresponding to the analysis results of the real image in the first range (Ra1) in real space, and if the distance from the first position to the second position is less than the threshold, it notifies specific information corresponding to the analysis results of the real image in the second range (Ra2), which is narrower than the first range.

[0215] According to this embodiment, for example, the entertainment value of the service is improved compared to a configuration in which the specific information does not change regardless of the distance from the first position to the second position. The specific information is generated by inputting a prompt (Dx) containing a real image and an instruction string (Sx) into a machine learning model (30), and may also be generated using different instruction strings depending on the distance from the first position to the second position (see Figure 15(a)).

[0216] <Appearances 2 to 5> In this embodiment, the program causes the computer to function as a receiving means (14) that accepts predetermined specific operations from the user, and specific information is generated according to the number of times the specific operation (search operation) has been accepted (see Figure 15(a)). According to this embodiment, the entertainment value of the service is improved.

[0217] <Sixth aspect> An information processing system that enables a user at a first location in real space to move to a second location, thereby enabling a specific event corresponding to the second location to proceed on a computer, comprising a notification means for notifying the user at the first location of specific information corresponding to the results of analyzing a real image representing the real space related to the second location. According to this embodiment, the same effects as the first embodiment are achieved.

[0218] Furthermore, the problem-solving means configured in the above-mentioned program (for example, the configurations described in the appendix) can be adapted as appropriate for use in devices, systems, methods, information recording media, etc. [Explanation of symbols]

[0219] 1... Information processing system, 10... Terminal device, 11... Notification means, 12... Display control means, 13... Mode control means, 14... Reception means, 20... Management device, 30... Machine learning model, 40... Map system.

Claims

1. A program that enables a user, who is at a first location in real space, to move to a second location, thereby enabling a specific event corresponding to the second location to proceed, Notification means for notifying a user at the first location of specific information corresponding to the analysis results of a real image showing the real space related to the second location. A program that makes a computer function.

2. The notification means notifies the specific information corresponding to the distance from the first position to the second position. The program according to claim 1.

3. The notification means notifies the user of the identification information that makes it easier to identify the second position the closer the distance from the first position to the second position is. The program according to claim 2.

4. The notification means is, If the distance from the first position to the second position is greater than or equal to a predetermined threshold, the specific information corresponding to the analysis result of the real image in the first range in real space is notified. If the distance from the first position to the second position is less than the threshold, the specific information corresponding to the analysis results of the real image in the second range, which is narrower than the first range, is notified. The program according to claim 3.

5. The aforementioned specific information is generated by inputting a prompt containing the real-world image and instruction string into a machine learning model, and is generated using different instruction strings depending on the distance from the first position to the second position. The program according to claim 4.

6. The computer is made to function as a means of receiving predetermined specific operations from the user, The aforementioned specific information is generated according to the number of times the aforementioned specific operation has been received. The program according to claim 5.

7. An information processing system that enables a specific event corresponding to a second location to proceed in a computer when a user at a first location in real space moves to a second location, Notification means for notifying a user at the first location of specific information corresponding to the analysis results of a real image showing the real space related to the second location. An information processing system equipped with the following features.

Images