Program and information processing system

The program enhances user engagement in augmented reality systems by allowing objects in virtual spaces to adapt their operability based on real-space interaction, creating dynamic and engaging experiences.

JP2025152049APending Publication Date: 2025-10-09COLOPL
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2024053757
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-03-28
Publication Date
2025-10-09

AI Technical Summary

Technical Problem

Existing augmented reality systems lack mechanisms to enhance user interest and engagement through dynamic interaction with real and virtual spaces.

Method used

A program that allows an object in a virtual space to be operated by a user, with its operable range changing based on whether the game is played with or without photographing real space, enabling interactive augmented reality experiences.

Benefits of technology

Enhances user interest and engagement by providing dynamic and interactive augmented reality experiences.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025152049000001_ABST
    Figure 2025152049000001_ABST
Patent Text Reader

Abstract

To enhance interest.SOLUTION: An object that can be operated by a user is placed in a virtual space in association with a position in a real space, and the operable range of the object is changed depending on whether a game is played by capturing the real space or a game is played without capturing the real space.SELECTED DRAWING: Figure 15
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present disclosure relates to a program and an information processing system. [Background technology]

[0002] Conventionally, information processing systems equipped with a function of arranging and displaying a virtual image on an image captured in real space, that is, a so-called augmented reality function, have been known. For example, Patent Document 1 discloses that the augmented reality function is used to provide an image in which a virtual character or the like exists in real space, thereby enhancing the realism of a game. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2018-200519 Summary of the Invention [Problem to be solved by the invention]

[0004] The aim is to increase interest. [Means for solving the problem]

[0005] A program according to one aspect of the present disclosure causes a computer to place an object in a virtual space that can be operated by a user, associated with a position in real space, and changes the operable range of the object depending on whether the game is played by photographing the real space or without photographing the real space. [Effects of the Invention]

[0006] According to the present disclosure, interest can be improved. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 is a diagram illustrating an overview of an information processing system. [Figure 2] FIG. 2 is a diagram illustrating an example of a module configuration of a terminal. [Figure 3] FIG. 3 is a diagram illustrating an example of a module configuration of a server. [Figure 4] FIG. 4 is a diagram showing an example of screen transitions on the terminal of FIG. [Figure 5] FIG. 5 is a diagram showing an example of the flow of processing for executing a game. [Figure 6] FIG. 6 is a diagram illustrating an example of a processing flow for starting the augmented reality function. [Figure 7] FIG. 7 is a diagram illustrating an example of a processing flow for terminating the augmented reality function. [Figure 8] FIG. 8 is a diagram illustrating an example of the flow of a process for permitting use of the augmented reality function. [Figure 9] FIG. 9 is a diagram illustrating an example of a process flow for executing an event. [Figure 10] FIG. 10 is a diagram showing an example of the flow of processing for determining whether the terminal has reached the event position when the augmented reality function is not being used. [Figure 11] FIG. 11 is a diagram showing an example of the flow of processing for determining whether the terminal has reached an event position when the augmented reality function is used. [Figure 12] FIG. 12 is a diagram showing an example of a movement screen displayed on the terminal of FIG. [Figure 13] FIG. 13 is a diagram showing an example of an augmented reality screen displayed on the terminal of FIG. [Figure 14] FIG. 14 is a diagram showing an example of an event screen displayed on the terminal of FIG. [Figure 15] FIG. 15 is a diagram showing a specific example of the operable range of an event object. [Figure 16] FIG. 16 is a diagram showing a specific example of the operable range of an event object when the augmented reality function is not used. [Figure 17]FIG. 17 is a diagram showing a specific example of the operable range of an event object when the augmented reality function is used. [Figure 18] FIG. 18 is a diagram showing a specific example of the operable range of an event object when the augmented reality function is used. [Figure 19] FIG. 19 is a diagram illustrating an example of a processing flow related to a specific notification. [Figure 20] FIG. 20 is a diagram showing an example of a moving screen when a specific notification is executed. [Figure 21] FIG. 21 is a diagram showing an example of the flow of a process for restricting operations on an event object when the augmented reality function is used. [Figure 22] FIG. 22 is a diagram showing an example of the augmented reality screen when restricting the operation of the event object. DETAILED DESCRIPTION OF THE INVENTION

[0008] An information processing system according to the present disclosure will be described with reference to the drawings. (First embodiment) [System Overview] As shown in FIG. 1, the information processing system 10 includes a network 20, a plurality of terminals 100, and one or more servers 200. The information processing system 10 is provided as a home system or a business system. Each terminal 100 is configured to be able to communicate with the server 200 via the network 20. As an example, the information processing system 10 is configured as a game system that provides a game to a user 11 of each terminal 100. In the following description, the term "game" simply refers to a game provided by the information processing system 10. Each terminal 100 can be used as a game terminal. The terminal 100 as a game terminal provides the user 11 with a function for playing a game (hereinafter referred to as a game function). The user 11 of each terminal 100 can be a player of the game. Each terminal 100 is an example of a computer (information processing device). The server 200 is an example of a computer (information processing device).

[0009] [network] For example, the network 20 includes the Internet and a mobile communication system including a wireless base station. For example, the mobile communication system may be realized as a 3G, 4G, or 5G mobile communication system, LTE (Long Term Evolution), or a wireless network connectable to the Internet via an access point.

[0010] [Device hardware configuration] As an example, each terminal 100 is a smartphone. Each terminal 100 may be a mobile terminal device such as a feature phone, a personal digital assistant (PDA), smart glasses, AR glasses, a wearable device, or a tablet computer. Each terminal 100 may be a fixed terminal device such as a personal computer (PC) or a workstation.

[0011] For example, the terminal 100 includes a processor 110, a memory 120, and a storage 130. The terminal 100 may include a communication interface 140 and an input / output interface 150. The terminal 100 may include a microphone 160, a speaker 165, a camera 170, a GNSS receiver 175, and a touch screen 180. Each component included in the terminal 100 is connected to a communication bus 190.

[0012] In response to a signal provided to the terminal 100 or in response to the establishment of a predetermined condition, the processor 110 executes a series of instructions included in a program stored in the memory 120 or the storage 130. For example, the processor 110 can be realized as a central processing unit (CPU), a graphics processing unit (GPU), a microprocessor unit (MPU), a field-programmable gate array (FPGA), or other computing device.

[0013] The memory 120 temporarily stores programs and data. For example, the programs are read from the storage 130. The data includes data transmitted to the terminal 100 and data generated by the processor 110. For example, the memory 120 can be implemented as a random access memory (RAM) or other volatile memory. The storage 130 permanently stores the programs and data. For example, the storage 130 can be implemented as a read-only memory (ROM), a hard disk drive, a flash memory, or other non-volatile storage device. The storage 130 may also be implemented as a removable storage device such as a memory card.

[0014] As an example, storage 130 stores a game program and a communication program. As an example, the game program realizes game functions. The game program provides an environment for user 11 to play the game. The game program realizes a function for executing an event within the game. In the following description, when simply referring to an "event," it means an event executed within the game. The communication program realizes a function for communicating with another computer. As an example, the other computer is server 200. Storage 130 may store an operating system, a simulation program, a user authentication program, and other programs.

[0015] For example, the data stored in storage 130 may include data for defining a virtual space, data specifying various objects, and user information. The data for defining a virtual space may include map data. As an example, the map data is 3D data including information on the latitude, longitude, and altitude of terrain and buildings in real space. The various objects may include electronic data of characters, equipment, and objects that constitute screens for various games. As an example, the user information may include a user ID, user name, gender, age, address, etc. The user information may include in-game currency owned by user 11, in-game items, data (save data) that stores game progress, and various rewards.

[0016] The communication interface 140 is connected to the network 20. The communication interface 140 communicates with other computers connected to the network 20. For example, the communication interface 140 can be implemented as a LAN (Local Area Network) or other wired communication interface. For example, the communication interface 140 can be implemented as Wi-Fi (registered trademark), Bluetooth (registered trademark), NFC (Near Field Communication), or other wireless communication interface. The communication interface 140 is not limited to the above.

[0017] The input / output interface 150 communicates with an external input device 300. For example, the input / output interface 150 can be implemented as a Universal Serial Bus (USB), a Digital Visual Interface (DVI), a High-Definition Multimedia Interface (HDMI®), or other wired communication interface. For example, the input / output interface 150 can be implemented as a Bluetooth® or other wireless communication interface.

[0018] As an example, the input device 300 is a controller. The controller has one or more operational components. For example, the one or more operational components may include a button, a key, a switch, a handle, a bar, a touchpad, or a stick. The controller transmits an output value to the terminal 100 based on an operation of the user 11 on the operational component. As an example, the controller may include a motion sensor such as an acceleration sensor and an angular velocity sensor. The controller may be configured to transmit an output value of the motion sensor to the terminal 100. The controller may be attachable to and detachable from the terminal 100.

[0019] The input device 300 is not limited to the above. For example, the input device 300 may be a camera. The camera may be configured to transmit a captured image of the user 11 to the terminal 100. For example, the input device 300 may be a distance measurement sensor. The distance measurement sensor may be configured to transmit an output value based on detection of the hand of the user 11, a marker, or the like to the terminal 100.

[0020] The microphone 160 converts speech from the user 11 into an audio signal (electrical signal) and transmits it to the processor 110. The speaker 165 converts the audio signal into sound and outputs it to the user 11. In addition to or instead of the speaker 165, the terminal 100 may be provided with an earphone or an earphone jack to which an earphone can be connected.

[0021] The camera 170 captures images of the scenery around the terminal 100. The camera 170 transmits the captured images to the processor 110. The images may include moving images and still images.

[0022] The GNSS receiver 175 receives positioning information transmitted from multiple positioning satellites constituting a Global Navigation Satellite System (GNSS) and acquires position information of the terminal 100 based on the received positioning information. As an example, the positioning information includes at least the position coordinates of the positioning satellites and the transmission time of the positioning information. Known examples of GNSS include the Global Positioning System (GPS), GLONASS, Galileo, and BeiDou. The GNSS receiver 175 may be configured to receive positioning information from augmenting satellites in a specific region. As an example, the position information may include the latitude, longitude, and altitude of the terminal 100. The GNSS receiver 175 may be used as a positioning device that acquires information for identifying the position information of the terminal 100. The GNSS receiver 175 may be a GLONASS receiver that receives position signals from GLONASS satellites, a Galileo receiver that receives position signals from Galileo satellites, or a BDS receiver that receives position signals from BDS satellites.

[0023] The positioning device is not limited to the above-described configuration. For example, if the positioning device is the input / output interface 150, the processor 110 identifies the current location of the terminal 100 based on a signal transmitted from an external input device 300. For example, if the input device 300 is a camera, the processor 110 identifies the photographing position based on a received photographed image, thereby identifying the current location of the terminal 100. Furthermore, the position information of the terminal 100 may be corrected based on the detection results of an acceleration sensor, a gyro sensor, and a magnetic sensor.

[0024] The touch screen 180 may include a monitor 181 and a touch sensor 182. The monitor 181 may be realized as a transmissive or non-transmissive display device. For example, the monitor 181 may be realized as a liquid crystal monitor, an organic electroluminescence (EL) monitor, or another display device. The monitor 181 displays various images. The images displayed on the monitor 181 include various objects such as backgrounds, characters, windows, buttons, menus, lists, and icons. The monitor 181 is not limited to those described above. For example, the monitor 181 may be a 3D monitor including a sub-monitor that displays an image for the left eye and a sub-monitor that displays an image for the right eye.

[0025] The touch sensor 182 transmits an output value based on an operation of the user 11 on the monitor 181 to the processor 110. As an example, the touch sensor 182 can be realized as a capacitive touch sensor, a resistive touch sensor, an ultrasonic touch sensor, or another type of touch sensor. The input surface of the touch sensor 182 is a part or all of the display surface of the monitor 181. The touch sensor 182 can be used as an operation device configured to accept an input operation of the user 11. For example, if the operation device is the touch sensor 182, the processor 110 accepts the user 11's physical contact operation with the input surface of the touch sensor 182 as the input operation of the user 11. For example, modes of input operation using the touch sensor 182 can include tapping, swiping, dragging, flicking, and other modes.

[0026] The operation device is not limited to the configuration described above. For example, if the operation device is the communication interface 140, the processor 110 receives a signal transmitted from an operation device (not shown) connected via the network 20 as an input operation by the user 11. For example, if the operation device is the input / output interface 150, the processor 110 receives a signal transmitted from an external input device 300 as an input operation by the user 11. For example, if the input device 300 is a camera and a distance measuring sensor, when the processor 110 detects the hand of the user 11 from a received captured image, the processor 110 receives a gesture detected based on the captured image and an output value as an input operation by the user 11. For example, if the input device 300 is a controller, the processor 110 receives an output value transmitted from the controller as an input operation by the user 11.

[0027] [Server hardware configuration] The server 200 may be a workstation or a general-purpose computer such as a PC. The server 200 includes a processor 210, a memory 220, a storage 230, a communication interface 240, and an input / output interface 250. The components of the server 200 are connected to a communication bus 290.

[0028] In response to a signal provided to the server 200 or in response to a predetermined condition being met, the processor 210 executes a series of instructions included in a program stored in the memory 220 or the storage 230. For example, the processor 210 can be implemented as a CPU, a GPU, an MPU, an FPGA, or other computing device.

[0029] The memory 220 temporarily stores programs and data. For example, the programs are read from the storage 230. The data may include data sent to the server 200 and data generated by the processor 210. For example, the memory 220 may be implemented as a RAM or other volatile memory.

[0030] The storage 230 permanently stores programs and data. For example, the storage 230 can be realized as a ROM, a hard disk drive, a flash memory, or other non-volatile storage device. The storage 230 may also be realized as a removable storage device such as a memory card. The server 200 may use programs stored in an external storage device instead of the storage 230. For example, in a situation where multiple information processing systems 10 are used, such as an amusement facility, programs and data can be updated collectively.

[0031] The storage 230 stores a game program and a communication program. For example, the game program implements a game function. The communication program implements a function for communicating with other computers. For example, the other computers are one or more terminals 100. The storage 230 may store a distribution program, an operating system, a simulation program, a user authentication program, and other programs. For example, the storage 230 stores data for defining a virtual space, data for specifying objects, and user information.

[0032] The communication interface 240 is connected to the network 20. The communication interface 240 communicates with other computers connected to the network 20. For example, the communication interface 240 can be implemented as a LAN or other wired communication interface. For example, the communication interface 240 can be implemented as Wi-Fi (registered trademark), Bluetooth (registered trademark), NFC, or other wireless communication interface. The communication interface 240 is not limited to the above.

[0033] The input / output interface 250 communicates with external input / output devices (not shown). For example, the input / output interface 250 can be implemented as a USB, DVI, HDMI, or other wired communication interface. For example, the input / output interface 250 can be implemented as a Bluetooth® or other wireless communication interface.

[0034] [Device Features] As shown in FIG. 2 , one or more of the components of the terminal 100 are combined to form a functional unit (module) having a cohesive function. As an example, the terminal 100 may include a game control unit 101, an image acquisition unit 102, a position acquisition unit 103, a display control unit 104, a memory unit 105, a communication unit 106, an input / output unit 107, and an imaging range determination unit 108. As an example, the game control unit 101, the display control unit 104, and the imaging range determination unit 108 can be realized by a processor 110. As an example, the image acquisition unit 102 can be realized by the processor 110 and a camera 170. As an example, the position acquisition unit 103 can be realized by the processor 110 and a GNSS receiver 175. As an example, the memory unit 105 can be realized by a memory 120 and a storage 130. As an example, the communication unit 106 can be realized by a communication interface 140. As an example, the input / output unit 107 can be realized by the processor 110 , the touch sensor 182 , and the input / output interface 150 .

[0035] The input / output unit 107 detects an input operation by the user 11 on the touch sensor 182 and an input operation by the user 11 on an external operating device via the input / output interface 150. As an example, the input / output unit 107 can identify the mode of the input operation based on the input operation by the user 11 on the touch sensor 182. For example, the modes of the input operation that the input / output unit 107 can identify may include tapping, swiping, dragging, flicking, and other modes. Hereinafter, touching the touch sensor 182 with the finger or the like of the user 11 will simply be referred to as "touch."

[0036] When a touch on the touch sensor 182 starts, the input / output unit 107 identifies the coordinates of the touch position (hereinafter referred to as the touch start position). When the touch on the touch sensor 182 stops, the input / output unit 107 identifies the coordinates of the last touch position (hereinafter referred to as the touch end position). While the touch on the touch sensor 182 continues, the input / output unit 107 identifies the coordinates of the touch position at each time (hereinafter referred to as the current touch position). The input / output unit 107 identifies the mode of the input operation by the user 11 based on the touch time from the start of the touch to the end of the touch and the change in the touch position.

[0037] The location acquisition unit 103 acquires location information of the terminal 100. As an example, the location information may be latitude, longitude, and altitude as coordinate values ​​of the terminal 100. As an example, the location acquisition unit 103 acquires location information at predetermined intervals. As an example, the predetermined interval is one second. The predetermined interval is not limited to this, and may be less than one second or more than one second. To improve the accuracy of the coordinate values, the location acquisition unit 103 may acquire location information in real time as much as possible. To avoid data load or data volume pressure, the predetermined interval for acquiring location information may be changed arbitrarily. In this specification, "real-space location" refers to the coordinate values ​​of the terminal 100 identified as location information. As an example, the real-space location is expressed by coordinate values ​​on the Earth (surface) in the real world. However, the real-space location may be a partial area on the Earth or outer space.

[0038] The image acquisition unit 102 acquires images captured by the camera 170. As an example, the image acquisition unit 102 acquires images captured by the camera 170 at predetermined intervals. As an example, the predetermined interval is 0.03 seconds. The predetermined interval is not limited to this, and may be shorter than 0.03 seconds or longer. To quickly reflect changes in the image captured by the camera 170, the image acquisition unit 102 may acquire images captured by the camera 170 or a camera provided in an external device in real time as much as possible. As an example, the image acquisition unit 102 may acquire images captured by a camera provided in an external device different from the terminal 100. As an example, the image acquisition unit 102 may acquire images captured by a camera provided in the external device by connecting to the external device via the communication interface 140 or the input / output interface 150. As an example, the camera provided in the external device may be a camera provided in a smartwatch, smart glasses, or the like, or a surveillance camera fixed at a predetermined location.

[0039] The communication unit 106 receives various types of information from one or more servers 200. As an example, the information that the communication unit 106 receives from the server 200 may include game progress information and user information. The game progress information is information for controlling the progress of the game. The game progress information may include various requests.

[0040] The communication unit 106 transmits various types of information to one or more servers 200. As an example, the information transmitted by the communication unit 106 to the server 200 may include game play information and user information. The game play information is information for reflecting input operations by the user 11 in the progress of the game. The game play information is output in response to input operations received by the input / output unit 107. The game play information is output in response to location information acquired by the location acquisition unit 103. The game play information may include various requests.

[0041] The game control unit 101 defines a virtual movement space in which the game is set. The virtual movement space is an example of a virtual space. The game control unit 101 places various objects in the virtual movement space. The various objects include field objects that make up a virtual field. As an example, the field objects are placed based on map data. In other words, the game control unit 101 constructs the virtual movement space based on map data of the real space.

[0042] As an example, field objects corresponding to various information contained in map data indicating the terrain, buildings, and the like of the real world are placed in the virtual movement space. Thus, a virtual field that can be recognized as a map corresponding to the real world is constructed in the virtual movement space by the field objects. Each position in the virtual field corresponds to a position in the real world.

[0043] The various objects include a user object corresponding to the user 11. As an example, the user object is a player character (avatar). The user object is not limited to a character and may be a symbol or icon. The user object is placed in the virtual movement space in association with a position in the real space of the terminal 100. In other words, the user object is information indicating the current location of the user 11 who owns the terminal 100. The various objects include an event object corresponding to an event. The event object is placed in association with a position in the real space of the virtual movement space. In the following description, placing an event object may simply be referred to as "placing an event." As an example, the event object is an object operated by the user 11 when starting an event. In other words, the event object is an example of an object that can be operated by the user 11. As an example, the game control unit 101 places an event at a predetermined position. As an example, the position at which the event is placed is determined by a prior setting by a game administrator. As an example, the game control unit 101 may place an event at a position determined by a predetermined lottery. As an example, the game control unit 101 may present the user with one or more candidate positions as candidates for the position where the event is to be placed, and place the event at one or more candidate positions selected by the user from among the candidate positions.Whether the position where the event is to be placed is determined by a pre-set setting by a game administrator, by a predetermined lottery, or by user selection may vary depending on the type of event.

[0044] As will be described in detail later, in a game, when a real-space position corresponding to the placement position of an event object in a virtual movement space (virtual field) and the real-space position of the terminal 100 have a predetermined relationship, an event corresponding to the event object can be executed. In the following description, the real-space position of the terminal 100 may be simply referred to as the "terminal position." In the following description, a real-space position corresponding to the placement position of an event in the virtual movement space may be simply referred to as the "event position." The terminal position and the event position are both positions in real space. As an example, the placement position of an event object in the virtual movement space can be understood as the placement position of the event in the virtual movement space. In this way, in a game, an event can be executed when a predetermined relationship exists between the terminal position and the event position. In the following description, an event object indicating an event associated with a position in the virtual movement space that corresponds to the event position may be simply referred to as the "event object corresponding to the event position."

[0045] As an example, the virtual movement space is defined by three-dimensional coordinates. As an example, field objects and event objects are placed in the virtual movement space in correspondence with three-dimensional spaces in real space. That is, the field objects and event objects are defined as three-dimensional solids in the virtual movement space. As an example, the event object may be placed in the virtual movement space in association with a point in real space. As an example, the user object is placed in the virtual movement space in association with a point in real space. That is, the user object is defined as a one-dimensional point in the virtual movement space.

[0046] The game control unit 101 identifies an instruction from the user 11 based on the game progress information, the touch position received by the input / output unit 107, the mode of the input operation, and the positions of the user object and the event object in the virtual movement space. As an example, the game control unit 101 can identify an instruction to execute an event based on the game progress information, the touch position received by the input / output unit 107, the mode of the input operation, and the positions of the user object and the event object in the virtual movement space. The game control unit 101 can make various determinations regarding the progress of the game. The game control unit 101 can perform various lotteries regarding the progress of the game.

[0047] The game control unit 101 defines a virtual event space where an event in the game takes place. The virtual event space is an example of a virtual space. The game control unit 101 places various objects in the virtual event space. The various objects in the virtual event space include objects that make up a field. The various objects in the virtual event space include a user object. The game control unit 101 identifies instructions from the user 11 based on the touch position received by the input / output unit 107, the manner of the input operation, and the coordinates of each object in the virtual event space. As an example, the game control unit 101 can identify an action instruction for the user object based on the touch position received by the input / output unit 107, the manner of the input operation, and the coordinates of each object in the virtual event space. The game control unit 101 can make various determinations regarding the progress of the event. The game control unit 101 can perform various lotteries regarding the progress of the event.

[0048] The game control unit 101 generates game play information in response to game progress information, instructions from the user 11, various judgment results, and various lottery results. The game play information generated by the game control unit 101 is transmitted to the server 200 by the communication unit 106. As an example, the processor 110, as the game control unit 101, may perform a function corresponding to a step by executing a step for receiving various information. As an example, the processor 110, as the game control unit 101, may perform a function corresponding to a step by executing a step for transmitting various information. As an example, the processor 110, as the game control unit 101, may perform a function corresponding to a step by executing a step for progressing the game.

[0049] The imaging range specifying unit 108 specifies a range of real space included in the image acquired by the image acquiring unit 102 (hereinafter referred to as the imaging range). As an example, the imaging range specifying unit 108 specifies the imaging range of the camera 170 by specifying the imaging position, imaging direction, and angle of view of the camera 170. As an example, the imaging range specifying unit 108 specifies the latitude and longitude in real space as the imaging position of the camera 170. As an example, the imaging range specifying unit 108 may specify the altitude in addition to the latitude and longitude in real space as the imaging position of the camera 170. As an example, the imaging range specifying unit 108 specifies the azimuth angle and the elevation / depression angle based on the imaging position of the camera 170 as the imaging direction of the camera 170. As an example, the imaging range specifying unit 108 specifies the horizontal angle of view and the vertical angle of view as the angle of view of the camera 170. As an example, the imaging range specifying unit 108 may specify the diagonal angle of view as the angle of view of the camera 170.

[0050] As an example, the imaging range determination unit 108 performs image recognition processing on an image captured by the camera 170 to determine the imaging position, imaging direction, and angle of view of the camera 170. As an example, the imaging range determination unit 108 may determine the imaging position, imaging direction, and angle of view of the camera 170 by comparing the result of the image recognition processing with data on terrain and buildings included in map data. As an example, the imaging range determination unit 108 determines the maximum imaging range that can be included in the imaging range of the camera 170 (hereinafter referred to as the maximum imaging range) from the imaging position, imaging direction, and angle of view of the camera 170. As an example, the imaging range determination unit 108 may define a predetermined distance from the imaging position as an upper limit imaging distance that is included in the maximum imaging range, and may exclude positions that are further away from the imaging position than the upper limit imaging distance from the maximum imaging range from being included in the maximum imaging range. In other words, the maximum imaging range may be defined by the imaging position, imaging direction, angle of view, and upper limit imaging distance of the camera 170. As an example, the upper limit imaging distance may be a distance corresponding to the angle of view of the camera 170. As an example, the shooting range specifying unit 108 defines a range in the virtual movement space that corresponds to the maximum shooting range as a virtual maximum shooting range. As an example, the shooting range specifying unit 108 defines, as the virtual shooting range, a range within the virtual maximum shooting range that is not blocked by a field object when viewed from a position in the virtual space that corresponds to the shooting position of the camera 170. As an example, the shooting range specifying unit 108 specifies, as the shooting range of the camera 170, a range in the real space that corresponds to the virtual shooting range.

[0051] As one example, the shooting range identification unit 108 identifies the contours of objects included in the image acquired by the image acquisition unit 102. As one example, the shooting range identification unit 108 identifies the contours of objects that correspond to the terrain and buildings included in the map data, among the objects included in the image acquired by the image acquisition unit 102. As one example, the shooting range identification unit 108 may identify the contours of the terrain and buildings included in the image acquired by the image acquisition unit 102 by comparing the result of the image recognition processing with the data of the terrain and buildings included in the map data.

[0052] For example, the shooting area identification unit 108 uses a method classified as rule-based artificial intelligence to identify various image information, such as the shooting position, shooting direction, and angle of view of the camera 170, as well as the contours of terrain and buildings included in the images acquired by the image acquisition unit 102. For example, the method classified as rule-based artificial intelligence may include a method that uses a feature extraction algorithm to extract feature points and determine the similarity between the target object and the terrain and buildings included in the map data based on the feature points. For example, the feature extraction algorithm may be SIFT (Scale-Invariant Feature Transform), SURF (Speeded Up Robust Features), or ORB (Oriented Fast and Rotated Brief). For example, the method classified as rule-based artificial intelligence may include a method that uses a color histogram or texture histogram to identify terrain and buildings similar in shape, color, and size to the target object, thereby identifying various image information.

[0053] For example, the shooting range identification unit 108 may identify various types of image information by linking information with an information processing system or application separate from the game system. The information processing system or application separate from the game system may be a map information system or application, or a road guidance system or application. For example, the shooting range identification unit 108 may identify various types of image information based on history information of images previously captured by the camera 170. For example, the shooting range identification unit 108 may identify the shooting position of the camera 170 based on location information of the terminal 100 acquired by the location acquisition unit 103. For example, the shooting range identification unit 108 may identify the shooting direction of the camera 170 based on detection results from an acceleration sensor, a gyro sensor, and a magnetic sensor. For example, the shooting range identification unit 108 may identify the angle of view of the camera 170 by acquiring information regarding the angle of view from the camera 170. The processor 110, as the shooting range identification unit 108, executes steps for identifying the shooting range captured by the camera 170, thereby performing functions corresponding to the steps.

[0054] The display control unit 104 creates an image to be displayed on the monitor 181. The display control unit 104 creates an image of the game screen according to game progress information received via the communication unit 106. The display control unit 104 creates an image of the game screen according to game play information generated by the game control unit 101. The display control unit 104 may create an image of the game screen by placing a virtual image on an image captured of real space. As an example, the display control unit 104 creates an image of the game screen by placing a virtual object on an image acquired by the image acquisition unit 102 according to the shooting range of the camera 170 identified by the shooting range identification unit 108. In other words, the display control unit 104 composites the virtual image on an image captured of real space. Note that the terms "placing" and "compositing" in this specification are not limited to simply overlaying a virtual object on an image acquired by the image acquisition unit 102, but are intended to include overlaying the image after applying some kind of correction to the image. As an example, the display control unit 104 may correct the color tone or shape of a virtual object when placing the virtual object in the image acquired by the image acquisition unit 102. The display control unit 104 displays an image of the game screen on the monitor 181. The display control unit 104 may be configured to display the image of the game screen on an external display device via the input / output interface 150. The display control unit 104 may be configured to display the image of the game screen on an external display device via the communication interface 140.

[0055] The display control unit 104 may control and draw objects (hereinafter referred to as UI objects) for constructing a user interface (hereinafter referred to as UI) required for input operations by the user 11. The UI objects are information for assisting the input operations of the user 11 required to progress through the game. For example, UI objects are icons, buttons, lists, windows, and menus. The various UI objects described in this disclosure are merely examples and are not limited to these aspects. As an example, the processor 110, as the display control unit 104, may execute steps for controlling the display content of the monitor 181, thereby performing functions corresponding to those steps.

[0056] The functions corresponding to each step in each terminal 100 can be realized by hardware and software (programs) executed by the processor 110. The software may be stored in advance in the storage 130. The software may be stored on a computer-readable non-volatile data storage medium, such as a CD-ROM, and distributed as a program product. The software may be provided as a downloadable program product by an information provider connected to a network, such as the Internet. The software is read from the data storage medium by a data reader or downloaded from another computer, such as the server 200, via the communication interface 140 and then stored in the storage 130. The software is read from the storage 130 by the processor 110 and stored in the memory 120 in the form of an executable program. The processor 110 executes the program.

[0057] [Server Features] As shown in FIG. 3 , one or more of the components of the server 200 are combined to form a functional unit (module) that is functionally cohesive. As an example, the server 200 may include a game control unit 201, a memory unit 205, a communication unit 206, and an input / output unit 207. The server 200 may also include a display control unit (not shown). The server 200 may also include a location information acquisition unit that acquires location information of the terminal 100. As an example, the game control unit 201 can be realized by the processor 210. As an example, the memory unit 205 can be realized by the memory 220 and the storage 230. As an example, the communication unit 206 can be realized by the communication interface 240. As an example, the input / output unit 207 can be realized by the processor 210 and the input / output interface 250.

[0058] The communication unit 206 receives various types of information from each terminal 100. For example, the information that the communication unit 206 receives from each terminal 100 includes game play information and user information. The communication unit 206 transmits various types of information to each terminal 100. For example, the information that the communication unit 206 transmits to each terminal 100 includes game progress information and user information. The input / output unit 207 may detect and accept input operations by the user 11 on an external input device via the input / output interface 250.

[0059] The game control unit 201 progresses the game in accordance with the game play information received by the communication unit 206 from the terminal 100. The game control unit 201 can make various determinations regarding the progress of the game. The game control unit 201 can conduct various lotteries regarding the progress of the game. The game control unit 201 progresses an event in accordance with the game play information received by the communication unit 206 from the terminal 100. The game control unit 201 can make various determinations regarding the progress of the event. The game control unit 201 can conduct various lotteries regarding the progress of the event. The game control unit 201 generates game progress information in accordance with the results of these processes. The game progress information is transmitted to the terminal 100 by the communication unit 206. As an example, the processor 210, as the game control unit 201, can perform a function corresponding to the step by executing a step for receiving various information. As an example, the processor 210, as the game control unit 201, can perform a function corresponding to the step by executing a step for transmitting various information. As an example, processor 210, as game control unit 201, can perform functions corresponding to steps by executing steps for progressing the game.

[0060] The functions corresponding to each step in the server 200 can be realized by hardware and software (programs) executed by the processor 210. The software may be stored in advance in the storage 230. The software may be stored on a computer-readable non-volatile data storage medium, such as a CD-ROM, and distributed as a program product. The software may be provided as a downloadable program product by an information provider connected to a network, such as the Internet. The software is read from the data storage medium by a data reading device or downloaded from another computer, such as an external storage device, via the communication interface 240, and then stored in the storage 230. The software is read from the storage 230 by the processor 210 and stored in the memory 220 in the form of an executable program. The processor 210 executes the program.

[0061] [Game Overview] As an example, a game according to the present disclosure is a game that uses position information of the terminal 100. As an example, in the game, various events occur based on the position information of the terminal 100. As an example, the game includes a movement part in which a user object moves through a virtual movement space. The game includes an event part in which various events associated with positions in the virtual movement space are executed.

[0062] The game according to the present disclosure can be played by photographing real space, or can be played without photographing real space. As an example, photographing real space and playing the game includes playing the game while photographing the real space. Also, as another example, photographing real space and playing the game includes playing the game after photographing the real space. That is, when photographing real space and playing the game, photographing the real space and playing the game may be performed in parallel at the same time, or may be performed at separate times.

[0063] [Overview of the movement part] An example of a specific specification of the moving part will be described. As an example, the user object is placed at a position in the virtual movement space that corresponds to the terminal position. When the terminal 100 moves in the real space, the user object is placed at a position in the virtual movement space that corresponds to the terminal position at that time, and the user object moves in the virtual movement space. In the movement part, when the terminal 100 reaches an event position in the real space, an event associated with the position corresponding to the event position in the virtual movement space can be progressed. In the movement part, the user 11 moves through the real space while holding the terminal 100, and moves to a position in the real space that corresponds to an event object placed on the virtual field. One of the objectives of the user 11 in the movement part is to move to the event position while holding the terminal 100 and execute the event.

[0064] [Event Part Overview] An example of a specific specification of the event part will be described. As an example, the event may include accomplishing a predetermined task. As an example, the task may be defeating an enemy object. As an example, the event may include the user 11 controlling a user object. As an example, the user object may be a character selected by the user 11 from among multiple characters.

[0065] As an example, an event is executed as a battle between a single user object and a single enemy object. As an example, the event employs a real-time system in which all objects operate according to the flow of time in real space. The condition for completing the event is for the enemy object to be rendered incapacitated before the time limit set for the event (hereinafter referred to as the event time limit) has elapsed. An enemy object becomes incapacitated when its hit points (hereinafter referred to as HP), which are one of its parameter values ​​(ability values), reach 0. The enemy object's HP decreases when it is attacked by a user object. The user object's parameter values ​​may or may not include HP. If the user object's parameter values ​​include HP, the user object becomes incapacitated when its HP reaches 0. The user object's HP decreases when it is attacked by an enemy object.

[0066] An event may involve a battle between multiple user objects and a single enemy object. An event may involve a battle between a single user object and multiple enemy objects. An event may involve a battle between multiple user objects and multiple enemy objects. When multiple user objects participate in an event, each user object may be controlled by a single user 11, or may be controlled by a different user 11. In other words, an event may be one in which multiple users 11 can participate. When multiple enemy objects participate in an event, the event may involve points being awarded when enemy objects are rendered unable to act. In this case, the conditions for achieving the event may be that one or more specific enemy objects are rendered unable to act, and that the total number of points reaches a specified value, etc.

[0067] Events are not limited to the above-mentioned content. For example, an event may be a sport such as soccer, tennis, table tennis, boxing, or basketball. For example, an event may be a race such as a car race, a yacht race, a ski race, or an airplane race. Events are not limited to competitive content. An event may be cooperative content in which multiple users or multiple groups cooperate to accomplish a task. In this case, the task may be content to develop a character or content to build a city or a building. An event may also be content aimed at learning for the user 11, such as arithmetic, reading, writing, and drawing.

[0068] [Overview of screen transitions on each device] An overview of screen transitions on the terminal 100 will be described. 4, various screens may be displayed on the monitor 181 of the terminal 100 depending on the progress of the game and instructions from the user 11. As an example, the various screens may include a movement screen 40, an augmented reality screen 50, and an event screen 60.

[0069] The movement screen 40 and the augmented reality screen 50 are displayed during the movement part. In particular, the movement screen 40 is displayed when playing the movement part without using the augmented reality function. The augmented reality screen 50 is displayed when playing the movement part with the augmented reality function. The augmented reality function is an example of a function that places and displays a virtual image on a photographed image of real space. The augmented reality function will be described in detail later. The movement screen 40 and the augmented reality screen 50 are displayed when an event is not being executed. The movement screen 40 and the augmented reality screen 50 can also be considered screens for instructing the display of the event screen 60. The movement screen 40 and the augmented reality screen 50 may include information indicating the event location. The event screen 60 is displayed during the event part. The event screen 60 is displayed while the event is being executed. The event screen 60 is a screen for displaying the progress of the event. The event screen 60 may include a screen for displaying the result of the event. The result of the event may include information indicating whether the event was completed.

[0070] [An example of the process flow for running a game] As shown in FIG. 5, in step S100, when a game program is launched, processor 110 of terminal 100 starts the game and transmits a game start notification to server 200, the game start notification including information that can identify the start of the game. As an example, the game start notification includes, as one piece of user information, a user ID assigned to user 11 who uses terminal 100. As an example, the game start notification includes location information of terminal 100. In step S101, processor 210 of server 200 receives the game start notification. As an example, based on the game start notification, processor 210 synchronizes location information and map information with the user ID, save data that records the progress of the game used by the user, and the like, thereby enabling the game using location information to be progressed.

[0071] In step S102, the processor 110 of the terminal 100 displays the movement screen 40 on the monitor 181. For example, the processor 110 defines a virtual movement space. As an example, the virtual movement space is defined based on map data. As an example, a virtual field is constructed in the virtual movement space. As an example, on the movement screen 40, field objects constituting the virtual field are displayed in an abstract manner, representing the terrain, buildings, etc. of the real space. For example, the field objects may be displayed as two-dimensional images that include latitude and longitude information but do not include altitude information for the terrain, buildings, etc. of the real space. As an example, a user object is placed in the virtual field in the virtual movement space. The user object is placed in a position in the virtual movement space that corresponds to the position of the terminal 100 in the real space. The processor 110 displays on the monitor 181 an area that can be captured by a virtual camera placed in the virtual movement space as part of the movement screen 40. As an example, the virtual camera may be placed in a position in the virtual movement space that overlooks the user object and the virtual field. In the following description, the range of the virtual movement space that is displayed on the movement screen 40 (the shooting range of the virtual camera) will be simply referred to as the "display range."

[0072] As an example, an event object is placed in a virtual movement space (virtual field). The event object is placed in association with a position in the virtual movement space that corresponds to a predetermined position in real space. As an example, the predetermined position may be a monument, public facility, store, scenic spot, etc. that exists in real space. The event object is placed in association with a position in the virtual movement space that corresponds to the event position, as information indicating the event position. As an example, one event object is placed in association with a position in the virtual movement space that corresponds to one event position. However, this is not limited to this, and multiple event objects may be placed in association with positions in the virtual movement space that correspond to one event position. The upper limit number of event objects that can be placed in the virtual movement space may be one or more.

[0073] In step S103, the processor 110 of the terminal 100 executes terminal-side main processing. The processor 110 transmits and receives various information to and from the server 200 via the communication interface 140. The processor 110 controls the game based on the various information received from the server 200. For example, the processor 110 acquires position information of the terminal 100 from the GNSS receiver 175 at predetermined time intervals. Based on the position information, the processor 110 places a user object in the virtual movement space at a position corresponding to the current terminal position. If the terminal position is moving, the processor 110 moves the user object on the virtual field so that it matches the current terminal position. For example, each time the processor 110 acquires position information, the processor 110 transmits play information indicating the acquired position information to the server 200. For example, the processor 110 receives progress information from the server 200. The processor 110 updates the virtual movement space according to the progress information. The progress information may include information for placing an event in the virtual movement space and information for identifying the position of the event in the virtual movement space. The processor 110 places the event object in the virtual movement space at a placement position indicated by the progress information. The progress information may include information that can specify removal of the event from the virtual movement space. The processor 110 removes the instructed event from the virtual movement space.

[0074] In step S104, the processor 210 of the server 200 executes server-side main processing. The processor 210 transmits and receives various information to and from the terminal 100 via the communication interface 240. The processor 210 controls the game based on the various information received from the terminal 100. As an example, the processor 210 receives play information from the terminal 100. The processor 210 determines the placement position of an event in the virtual movement space based on the play information. The processor 210 transmits progress information to the terminal 100 indicating that the event will be placed in the virtual movement space and the placement position of the event in the virtual movement space.

[0075] [Example of the process flow for starting the augmented reality function] As shown in FIG. 6, in step S200, the processor 110 of the terminal 100 receives an augmented reality function start operation that instructs the start of the augmented reality function. As an example, the augmented reality function start operation can be received when the processor 110 permits use of the augmented reality function. The process of permitting use of the augmented reality function will be described in detail later. In step S201, when the processor 110 of the terminal 100 receives the augmented reality function start operation, it starts the augmented reality function. The processor 110 transmits an augmented reality function start notification to the server 200, indicating the start of the augmented reality function.

[0076] In step S202, processor 110 of terminal 100 acquires an image captured by camera 170. In step S203, processor 110 of terminal 100 performs image recognition processing on the acquired image. In step S204, processor 110 of terminal 100 identifies the image capturing position, image capturing direction, and angle of view of camera 170 based on the result of the image recognition processing. As an example, processor 110 identifies the image capturing position, image capturing direction, and angle of view of camera 170 by comparing the result of the image recognition processing with data on terrain and buildings included in map data.

[0077] In step S205, processor 110 of terminal 100 identifies the maximum imaging range of camera 170. As an example, processor 110 identifies the space that can be included in the imaging range of camera 170 from the imaging position, imaging direction, and angle of view as the maximum imaging range of camera 170. As an example, processor 110 excludes positions that are further than the upper limit imaging distance from the imaging position from the maximum imaging range.

[0078] In step S206, the processor 110 of the terminal 100 identifies, as the camera 170's shooting range, a range of the maximum shooting range that is free of obstructions between the camera 170 and the shooting position of the camera 170. As an example, the processor 110 may identify, based on the relationship between the position in the virtual movement space corresponding to the camera 170's shooting position and the field object disposed in the virtual movement space, a range of the maximum shooting range that is free of obstructions between the camera 170 and the shooting position of the camera 170. For example, the processor 110 defines, as the virtual maximum shooting range, a range of the virtual maximum shooting range that is not obstructed by field objects when viewed from a position in the virtual space that corresponds to the shooting position in the real space. As an example, the processor 110 identifies, as the virtual shooting range, a virtual shooting position P1 that corresponds to the shooting position P0 in the real space and an arbitrary virtual position P2 within the virtual maximum shooting range. As one example, processor 110 identifies a virtual position P2 on a line connecting virtual shooting position P1 and virtual position P2, where no field object is located between virtual shooting position P1 and virtual position P2, as a specific virtual position P3. As one example, processor 110 identifies a set of specific virtual positions P3 as a virtual shooting range. As one example, processor 110 identifies a range in real space corresponding to the virtual shooting range as the shooting range of camera 170. In other words, processor 110 identifies a set of positions P4 in real space corresponding to specific virtual position P3 as the shooting range of camera 170 in real space.

[0079] As an example, the field object is arranged in correspondence with the terrain and buildings in real space based on map data. Therefore, position P4 in real space is a position within the maximum imaging range of camera 170 that is not obscured by the terrain and buildings in real space that correspond to the field object when viewed from imaging position P0. In other words, the imaging range of camera 170 identified as the set of positions P4 is a range within the maximum imaging range of camera 170 that is not obscured by the terrain and buildings in real space when viewed from imaging position P0.

[0080] In step S207, the processor 110 of the terminal 100 displays the augmented reality screen 50 on the monitor 181. The processor 110 renders the augmented reality screen 50 by placing a virtual object on the image acquired in step S202. As an example, the processor 110 displays an event object as information indicating the event location, superimposed on a position corresponding to the event location in the image acquired in step S202. As an example, the processor 110 performs image recognition processing on the image acquired in step S202 and identifies the contours of the terrain and buildings included in the image by comparing the results of the image recognition processing with the terrain and building data included in the map data. Furthermore, the processor 110 superimposes the contours of the identified terrain and buildings on the contours of the field object in the virtual movement space. As a result, the processor 110 identifies the positional relationship between the terrain and buildings included in the image and the event object placed in the virtual movement space. As an example, processor 110 displays, superimposed on the image acquired in step S202, portions of the event objects placed in the virtual space that are not obscured by field objects when viewed from virtual shooting position P1. On the other hand, processor 110 does not display portions of the event objects placed in the virtual space that are obscured by field objects when viewed from virtual shooting position P1. In this way, processor 110 displays the augmented reality screen 50 in a manner that makes it appear as if the event objects are partially or entirely obscured by terrain and buildings in real space.

[0081] In step S208, the processor 110 of the terminal 100 executes terminal-side augmented reality processing. The processor 110 transmits and receives various information to and from the server 200 via the communication interface 140. The processor 110 controls the game based on the various information received from the server 200. As an example, the processor 110 updates the augmented reality screen 50 displayed on the monitor 181 at predetermined time intervals. As an example, the processor 110 updates the augmented reality screen 50 by repeating the processes of steps S202 to S207 at predetermined time intervals. As an example, the processor 110 transmits play information indicating the acquired position information to the server 200 each time position information is acquired. As an example, the processor 110 receives progress information from the server 200. The processor 110 updates the virtual movement space according to the progress information. The progress information may include information indicating the placement of an event in the virtual movement space and information capable of identifying the placement position of the event in the virtual movement space. The processor 110 places an event object in the virtual movement space at the placement position indicated by the progress information. The progress information may include information that can specify the removal of an event from the virtual movement space. The processor 110 removes the instructed event from the virtual movement space.

[0082] In step S209, the processor 210 of the server 200 receives a notification that the augmented reality function has started. In step S210, the processor 210 of the server 200 executes server-side augmented reality processing. The processor 210 transmits and receives various information to and from the terminal 100 via the communication interface 240. The processor 210 controls the game based on the various information received from the terminal 100. As an example, the processor 210 receives play information from the terminal 100. The processor 210 determines the placement position of an event in the virtual movement space based on the play information. The processor 210 transmits progress information to the terminal 100 indicating that the event will be placed in the virtual movement space and the placement position of the event in the virtual movement space.

[0083] [Example of the process flow for terminating the augmented reality function] 7, in step S300, processor 110 of terminal 100 receives an augmented reality function termination operation that instructs termination of the augmented reality function. In step S301, when processor 110 of terminal 100 receives the augmented reality function termination operation, processor 110 terminates the augmented reality function. Processor 110 transmits an augmented reality function termination notification indicating termination of the augmented reality function to server 200.

[0084] In step S302, the processor 110 of the terminal 100 displays the moving screen 40 on the monitor 181. The specific processing in step S302 is the same as the processing in step S102, and therefore a description thereof will be omitted.

[0085] In step S303, processor 110 of terminal 100 executes terminal-side main processing. The specific processing in step S303 is the same as the processing in step S103, and therefore a description thereof will be omitted.

[0086] In step S304, processor 210 of server 200 receives the augmented reality function termination notification. In step S305, processor 210 of server 200 executes server-side main processing. The specific processing in step S305 is the same as the processing in step S104, and therefore description thereof will be omitted.

[0087] [An example of the process flow for allowing the use of augmented reality features] As shown in FIG. 8, in step S400, processor 110 of terminal 100 determines whether the terminal position is within a predetermined range from the position where the augmented reality function was last used. As an example, processor 110 stores end position information indicating the position where the augmented reality function termination operation was accepted in step S300 of the process of terminating the augmented reality function. As an example, the end position information is stored in memory 120. In step S400, processor 110 acquires position information and end position information of terminal 100. Based on the acquired position information and end position information, processor 110 determines whether the terminal position is within a predetermined range from the position where the augmented reality function was last used.

[0088] If the terminal location is not within a predetermined range from the location where the augmented reality function was last used, in step S401, processor 110 determines whether a predetermined time has passed since the last use of the augmented reality function. As an example, processor 110 stores end time information indicating the time when the augmented reality function end operation was accepted in step S300 of the process of terminating the augmented reality function. As an example, the end time information is stored in memory 120. In step S400, processor 110 acquires current time information and end time information. Based on the acquired time information and end time information, processor 110 determines whether a predetermined time has passed since the last use of the augmented reality function.

[0089] If it is not within a predetermined time since the last use of the augmented reality function, in step S402, the processor 110 determines whether the accumulated information regarding movement satisfies a predetermined condition. As an example, the processor 110 accumulates the movement distance by identifying, accumulating, and storing the distance traveled by the terminal 100 in real space for each predetermined time period as the information regarding movement. In this case, the processor 110 determines that the predetermined condition is satisfied if the accumulated movement distance in real space since the last use of the augmented reality function is equal to or greater than a predetermined distance. As an example, the processor 110 may accumulate the number of steps taken by the user in real space for each predetermined time period as the information regarding movement. In this case, the processor 110 determines that the predetermined condition is satisfied if the accumulated number of steps taken in real space since the last use of the augmented reality function is equal to or greater than a predetermined number. As an example, the processor 110 may accumulate information regarding places visited by the user by identifying and storing the route traveled by the terminal 100 as the information regarding movement. In this case, processor 110 determines that the predetermined condition is satisfied if the user has visited a predetermined location in real space since the last time the augmented reality function was used. The accumulated travel information is initialized in step S300 of the process of terminating the augmented reality function. This allows processor 110 to identify the travel information accumulated since the last time the augmented reality function was used.

[0090] If the accumulated movement information satisfies a predetermined condition, in step S403, the processor 110 permits the use of the augmented reality function. If the terminal location is within a predetermined range from the location where the augmented reality function was last used, processor 110 determines in step S404 whether a predetermined amount of consideration is to be paid. Similarly, if a predetermined amount of time has passed since the last use of the augmented reality function, or if the accumulated movement information does not satisfy a predetermined condition, processor 110 determines in step S404 whether a predetermined amount of consideration is to be paid. As an example, the predetermined amount of consideration may be a specified in-game currency or an in-game item.

[0091] If the predetermined fee has been paid, in step S403, processor 110 permits use of the augmented reality function. That is, even if the conditions specified in steps S400 to S402 are not satisfied, processor 110 permits use of the augmented reality function if the predetermined fee has been paid. Then, processor 110 ends the series of processes for permitting use of the augmented reality function. On the other hand, if the fee has not been paid, processor 110 ends the series of processes without permitting use of the augmented reality function.

[0092] As a result, the processor 110 accumulates information about the movement of the user 11 in real space, and enables the use of the augmented reality function when the accumulated information about the movement satisfies a predetermined condition. The processor 110 restricts the use of the augmented reality function when the user 11 is located within a predetermined range from the location where the augmented reality function was last used. The processor 110 restricts the use of the augmented reality function when a predetermined time has not passed since the last use of the augmented reality function.

[0093] Furthermore, processor 110 enables the augmented reality function when a predetermined fee is paid, even if the accumulated movement information does not satisfy a predetermined condition. Similarly, processor 110 enables the augmented reality function when a predetermined fee is paid, even if user 11 is located within a predetermined range from the location where the augmented reality function was last used. Processor 110 enables the augmented reality function when a predetermined fee is paid, even if a predetermined time has not passed since the last time the augmented reality function was used.

[0094] [Example of event execution process flow] As shown in FIG. 9 , in step S500, processor 110 of terminal 100 accepts an event start operation to instruct the start of an event. As an example, the event start operation is performed by tapping on a portion of monitor 181 where an event object is displayed during the movement part. As an example, the event start operation can be accepted when terminal 100 reaches an event position. In the following description, the phrase "the event object can be operated" refers to the ability to perform an event start operation to instruct the start of a corresponding event object. Also, in the following description, the phrase "the event object cannot be operated" refers to the inability to perform an event start operation to instruct the start of a corresponding event object. In other words, even if the portion of monitor 181 where an event object is displayed can be tapped, if terminal 100 has not reached the event position and the event start operation cannot be performed, the event object cannot be operated. The process of determining whether terminal 100 has reached the event position will be described in detail below.

[0095] In step S501, upon receiving an event start operation, processor 110 of terminal 100 starts the event. Processor 110 sends an event start notification indicating the start of the event to server 200. In step S502, processor 110 of terminal 100 displays event screen 60 on monitor 181. As an example, processor 110 defines a virtual event space. Processor 110 places a field object in the virtual event space. As an example, a user object and an enemy object are placed in the virtual event space. Processor 110 displays on monitor 181 the area that can be captured within the shooting range of a virtual camera placed in the virtual event space as part of event screen 60.

[0096] In step S503, the processor 110 of the terminal 100 executes terminal-side event processing. That is, the processor 110 enables an event arranged in the virtual movement space in association with a position in real space to progress. For example, the processor 110 transmits and receives various information to and from the server 200 via the communication interface 140. As an example, when the processor 110 receives an operation to instruct the action of a user object (hereinafter referred to as an action instruction operation), the processor 110 transmits play information indicating the content of the operation to the server 200. The processor 110 controls the event based on the various information received from the server 200. As an example, the processor 110 updates the virtual event space according to the progress information.

[0097] In step S504, the processor 210 of the server 200 receives the event start notification. In step S505, the processor 210 of the server 200 executes server-side event processing. That is, the processor 210 enables an event arranged in the virtual movement space in association with a position in real space to proceed. For example, the processor 210 transmits and receives various information to and from the terminal 100 via the communication interface 240. The processor 210 controls the event based on the various information received from the terminal 100. As an example, the processor 210 defines a virtual event space. The processor 210 places a field object in the virtual event space. The processor 210 places a user object of the user 11 and an enemy object in the virtual event space.

[0098] As an example, processor 210 may receive play information from terminal 100. Processor 210 manages the behavior of the user object in accordance with the play information. As an example, processor 210 determines whether an attack has hit an enemy object. If processor 210 determines that the attack has hit, it reduces the HP of the enemy object.

[0099] The processor 210 transmits progress information indicating the result of the action of the user object to the terminal 100. When the action of the user object ends, the processor 210 causes the enemy object to act. As an example, the processor 210 may determine whether an attack has hit the user object. If the processor 210 determines that the attack has hit, it reduces the HP of the user object. The processor 210 transmits progress information indicating the result of the action of the enemy object to the terminal 100.

[0100] In step S506, when the event termination condition is met, processor 210 of server 200 ends the event and transmits an event result notification indicating the result of the event to terminal 100. As an example, processor 210 determines that the event termination condition is met due to failure of the event when the avatar's HP is 0 after being reduced due to a successful attack. As an example, processor 210 determines that the event termination condition is met due to failure of the event when a withdrawal notification instructing the user to withdraw from the event is received from terminal 100. As an example, the event withdrawal notification is transmitted to server 200 when processor 110 of terminal 100 accepts an operation instructing the user to withdraw from the event. As an example, processor 210 determines that the event termination condition is met due to the success of the event when the enemy object's HP is 0 after being reduced due to a successful attack. As an example, processor 210 determines that the event termination condition is met due to failure of the event when the event time limit has elapsed.

[0101] In step S507, processor 110 of terminal 100 receives the event result notification. In step S508, processor 110 of terminal 100 displays the event result on monitor 181 on event screen 60. Thereafter, processor 110 of terminal 100 displays movement screen 40 on monitor 181, and ends the series of processes for executing the event.

[0102] [Processing related to reaching the event position] The processor 110 of the terminal 100 determines whether the terminal 100 has reached an event location based on different conditions for the terminal main processing executed when playing without using the augmented reality function and the terminal augmented reality processing executed when playing with the augmented reality function. That is, the processor 110 changes the operable range of the event object when using the augmented reality function and when not using the augmented reality function. As an example, the processor 110 determines whether the terminal 100 has reached the event location based on whether the event location is included within a first predetermined range defined based on the position of the terminal 100. In this case, the processor 110 changes the operable range of the event object by changing the first predetermined range when using the augmented reality function and when not using the augmented reality function. As an example, the processor 110 may determine whether the terminal 100 has reached the event location based on whether the position of the terminal 100 is included within a second predetermined range defined based on the event location. In this case, processor 110 changes the operable range of the event object by changing the second predetermined range when the augmented reality function is used and when the augmented reality function is not used. As an example, processor 110 may determine whether terminal 100 has reached the event location based on whether the first predetermined range and the second predetermined range at least partially overlap. In this case, processor 110 changes the operable range of the event object by changing at least one of the first predetermined range and the second predetermined range when the augmented reality function is used and when the augmented reality function is not used. In the following description, unless otherwise specified, the term "operable range" refers to the operable range of the event object.

[0103] [An example of the process flow for reaching an event location when the augmented reality function is not used] In the terminal-side main processing, the processor 110 performs processing to determine whether the terminal 100 has reached the event position.

[0104] As shown in FIG. 10 , in step S600, the processor 110 acquires location information of the terminal 100. In step S601, the processor 110 determines whether the event location is included within a specified range centered on the terminal 100. As an example, the specified range is a cylindrical space with a radius r1 and a height h1 centered on the terminal location. As an example, the radius r1 may be 50 meters. As an example, the height h1 may be 50 meters. If the event location is included within the specified range centered on the terminal location, in step S602, the processor 110 determines that the terminal 100 has reached the event location. In this case, the processor 110 enables reception of an event start operation that instructs the start of the event. Thereafter, the processor 110 ends the series of processes for determining whether the terminal 100 has reached the event location. On the other hand, if the event location is not included within the specified range centered on the terminal location, the processor 110 ends the series of processes without determining that the terminal 100 has reached the event location.

[0105] [An example of the process flow for reaching an event location when using the augmented reality function] In the terminal-side augmented reality processing, the processor 110 performs processing to determine whether the terminal 100 has reached the event position.

[0106] As shown in FIG. 11 , in step S700, processor 110 acquires the capture range of camera 170 identified in the processing of step S206. In step S701, processor 110 determines whether the event position is included in the capture range of camera 170. If the event position is included in the capture range of camera 170, in step S702, processor 110 determines that terminal 100 has reached the event position. In this case, processor 110 enables reception of an event start operation that instructs the start of the event. Thereafter, processor 110 ends the series of processes for determining whether terminal 100 has reached the event position. On the other hand, if the event position is not included in the capture range of camera 170, processor 110 ends the series of processes without determining that terminal 100 has reached the event position.

[0107] In this way, processor 110 determines whether terminal 100 has reached the event position under different conditions when the augmented reality function is not used and when the augmented reality function is used. As a result, processor 110 changes the operable range of event object 92 in the movement part when the augmented reality function is not used and when the augmented reality function is used.

[0108] [Example of display screen on device and processing flow related to display] [Move screen] As shown in FIG. 12 , when the augmented reality function is not used in the movement part, a movement screen 40 is displayed on the monitor 181 of the terminal 100. The movement screen 40 includes various objects. As an example, the movement screen 40 includes a field object 80 based on map data. As an example, the movement screen 40 includes a user object 91. The user object 91 is an object that indicates the terminal location. As an example, the movement screen 40 includes an event object 92. The event object 92 is an object that indicates a real location corresponding to a virtual location associated with a corresponding event. The event object 92 may be an object that indicates the content of the event. As an example, the event object 92 is an object that resembles an enemy object that appears in the event. As an example, when the user 11 moves through real space with the terminal 100, the user 11 can instruct the user object 91 to move to a corresponding position in the virtual movement space.

[0109] As an example, when the terminal 100 has reached the event location of a predetermined event, an event start operation can be performed by tapping on a portion of the monitor 181 where an event object 92 corresponding to the predetermined event is displayed. As an example, when the augmented reality function is not being used, the state in which the terminal 100 has reached the event location refers to a state in which the terminal 100 is located within a specified range centered on the event location. In other words, the state in which the terminal 100 has reached the event location refers to a state in which, when the terminal 100 is located at position a0, the event location is included within a range R1 centered on position a0. In other words, range R1 is the operable range of the event object 92 when the augmented reality function is not being used.

[0110] As an example, the moving screen 40 includes an event object 92 corresponding to an event position included in a range R1. In this example, the range R1 includes each of the event positions a1, a2, and a3. Therefore, in this example, an event start operation can be performed by tapping a portion of the monitor 181 where the first event object 92a corresponding to the event position a1 is displayed. Similarly, an event start operation can be performed by tapping a portion of the monitor 181 where the second event object 92b corresponding to the event position a2 or the third event object 92c corresponding to the event position a3 is displayed.

[0111] Also, as an example, the moving screen 40 includes an event object 92 corresponding to an event position that is not included in the range R1. In this example, the range R1 does not include the event position a4. Therefore, in this example, even if a tap operation is performed on a portion of the monitor 181 where the fourth event object 92d corresponding to the event position a4 is displayed, the event start operation cannot be performed.

[0112] As an example, the moving screen 40 includes an augmented reality function start icon 95. As an example, by tapping the portion where the augmented reality function start icon 95 is displayed, an augmented reality function start operation can be performed to instruct the start of the augmented reality function.

[0113] [Augmented reality screen] 13, when the augmented reality function is used in the movement part, an augmented reality screen 50 is displayed on the monitor 181 of the terminal 100. The augmented reality screen 50 includes an image captured by the camera 170 and various objects superimposed on the image. As an example, the augmented reality screen 50 includes an event object 92. The event object 92 is displayed superimposed at a position corresponding to the event position in the image captured by the camera 170.

[0114] As an example, when the terminal 100 has reached the event location of a predetermined event, an event start operation can be performed by tapping on a portion of the monitor 181 where an event object corresponding to the predetermined event is displayed. As an example, when the augmented reality function is being used, the state in which the terminal 100 has reached the event location means that the event location is included within range R2, which is the shooting range of the camera 170. In other words, range R2 is the operable range of the event object 92 when the augmented reality function is being used.

[0115] As an example, the augmented reality screen 50 includes an event object 92 corresponding to an event position included in range R2. In this example, range R2 includes event positions a1 and a4. Therefore, in this example, an event start operation can be performed by tapping a portion of the monitor 181 where the first event object 92a corresponding to event position a1 is displayed. Similarly, an event start operation can be performed by tapping a portion of the monitor 181 where the fourth event object 92d corresponding to event position a4 is displayed.

[0116] As an example, the augmented reality screen 50 does not include an event object 92 corresponding to an event position outside the range R2. As an example, the augmented reality screen 50 does not include an event object 92 corresponding to an event position outside the maximum capture range of the camera 170, which is determined based on the camera's 170 capture position, capture direction, and angle of view. As an example, the augmented reality screen 50 does not include an event object 92 corresponding to an event position that is determined to be outside the camera's 170 capture range due to an obstruction in real space, even if the event position is within the camera's 170 capture range. As an example, an obstruction in real space refers to a terrain and a building corresponding to a field object placed in the virtual travel space in association with the terrain and a building included in the map data. For example, the augmented reality screen 50 does not include an event object 92 corresponding to an event position located in a space obstructed by a building 900 corresponding to a field object placed in the virtual space, as viewed from the camera's 170 capture position. Therefore, in this example, the event object 92 corresponding to the event position outside the range R2 cannot be tapped, and an event start operation cannot be performed.

[0117] As an example, the augmented reality screen 50 is updated in response to changes in the range captured by the camera 170. As an example, the augmented reality screen 50 is updated at predetermined time intervals. The shorter the predetermined time, the more likely it is that when the range captured by the camera 170 changes, the shorter the time lag until the change in the range captured by the camera 170 is reflected on the augmented reality screen 50. As an example, the augmented reality screen 50 may be updated in real time as much as possible.

[0118] As an example, the augmented reality screen 50 includes an augmented reality function end icon 96. As an example, by tapping the portion where the augmented reality function end icon 96 is displayed, an augmented reality function end operation can be performed to instruct the user to end the augmented reality function.

[0119] [Event screen] As shown in FIG. 14, when an event starts, an event screen 60 is displayed. The event screen 60 includes various objects. As an example, the event screen 60 includes a field object 82 that forms the stage for the event. The event screen 60 includes a user object 91. The event screen 60 includes an enemy object 93. As an example, an operation to instruct an attack on the enemy object 93 can be performed by tapping the area where the enemy object 93 is displayed.

[0120] [A specific example of the operable range of an event object] As shown in FIG. 15 , for example, the terminal 100 is located at a position a0. For example, the event objects 92 include a first event object 92a, a second event object 92b, a third event object 92c, and a fourth event object 92d. For example, the first event object 92a is an object representing an event located in the virtual movement space at a position corresponding to an event position a1 in the real space. For example, the second event object 92b is an object representing an event located in the virtual movement space at a position corresponding to an event position a2 in the real space. For example, the third event object 92c is an object representing an event located in the virtual movement space at a position corresponding to an event position a3 in the real space. For example, the fourth event object 92d is an object representing an event located in the virtual movement space at a position corresponding to an event position a4 in the real space.

[0121] As an example, range R1 is the operable range of the event object 92 when the augmented reality function is not being used. As an example, range R1 is a cylindrical space with a radius r1 and a height h1 centered on position a0 of the terminal 100. In this example, range R1 includes event positions a1, a2, and a3. Therefore, in this example, when the augmented reality function is not being used, the first event object 92a, the second event object 92b, and the third event object 92c can be operated. On the other hand, in this example, range R1 does not include event position a4. Therefore, in this example, when the augmented reality function is not being used, the fourth event object 92d cannot be operated.

[0122] For example, when the augmented reality function is used, range R2 is the operable range of the event object 92 when an image is captured by the camera 170 from position a0 in direction Y1 at a field of view V1. For example, range R2 is the field of view captured by the camera 170. For example, range R3 is the maximum field of view that can be included in an image captured by the camera 170 when the camera 170 captures an image from position a0 in direction Y1 at a field of view V1. Range R2 is a part of range R3. For example, range R3 may not include positions that are further away from position a0 than the upper limit shooting distance. In this case, range R3 is a spherical space centered at position a0 and having a radius r2 equal to the upper limit shooting distance, the spherical space being included within field of view V1 with respect to direction Y1. For example, radius r2 is a distance longer than radius r1. For example, radius r2 may be 100 meters. For example, field of view V1 may have a horizontal field of view of 72 degrees and a vertical field of view of 56 degrees. For example, range R2 is a set of positions P among any positions P included in range R3, where there is no obstruction between the position corresponding to position P and the position corresponding to position a0, which is the shooting position, in the virtual movement space. As an example, the obstruction is a field object placed in the virtual movement space.

[0123] For convenience of explanation, ranges R1 to R3 are shown in two dimensions in Fig. 15, but in reality, each range is a three-dimensional space. In particular, for range R2, even if a position is not included in range R2 in the drawing, depending on the height of an obstruction, a position at the same latitude and longitude but at a different altitude may be included in range R2.

[0124] In this example, range R2 includes event position a1 and event position a4. Therefore, in this example, when an image is captured by camera 170 using the augmented reality function from position a0 in direction Y1 at angle of view V1, the first event object 92a and the fourth event object 92d can be operated.

[0125] On the other hand, in this example, range R2 does not include event position a2 and event position a3. In particular, in this example, a field object acting as an obstruction is placed in the virtual movement space between a position corresponding to event position a2 and a position corresponding to position a0, which is the shooting position. Therefore, the event position a2 is not included in the image captured by camera 170. As an example, the field object acting as an obstruction is an object placed in the virtual movement space in correspondence with building 900 in real space. Therefore, event position a2 is determined to be located in the shadow of building 900 when viewed from position a0, which is the shooting position, and is not included in range R2, which is the shooting range of camera 170.

[0126] Therefore, in this example, when an image is captured by the camera 170 from the position a0 in the direction Y1 at the angle of view V1 using the augmented reality function, the second event object 92b and the third event object 92c cannot be operated.

[0127] In this way, range R2, which is the operable range of the event object 92 when the augmented reality function is used, may include a position outside range R1, which is the operable range of the event object 92 when the augmented reality function is not used. Also, range R1, which is the operable range of the event object 92 when the augmented reality function is not used, may include a position outside range R2, which is the operable range of the event object 92 when the augmented reality function is used. In other words, the operable range of the event object 92 changes between when the augmented reality function is used and when the augmented reality function is not used, even if the position of the terminal 100 does not change.

[0128] 16, when the augmented reality function is not being used, the range R1 changes when the user 11 moves while carrying the terminal 100. For example, assume that the user 11 moves from position a0 to position a5 while carrying the terminal 100. In this case, the event position a4, which was not included in the range R1 when the user 11 was at position a0, is now included in the range R1.

[0129] 17, when the augmented reality function is being used, if the user 11 changes the shooting direction of the camera 170, the range R2 changes. For example, suppose that the user 11 changes the shooting direction of the camera 170 from direction Y1 to direction Y2 without moving from position a0. In this case, the event position a3, which was not included in the range R2 when shooting from position a0 in direction Y1 with an angle of view V1, is now included in the range R2.

[0130] 18, when the augmented reality function is being used, if the user 11 moves while carrying the terminal 100 and changes the shooting direction of the camera 170, the range R2 changes. For example, suppose that the user 11 moves from position a0 to position a6 while carrying the terminal 100 and changes the shooting direction of the camera 170 from direction Y1 to direction Y3. In this case, the event position a2, which was not included in the range R2 when shooting from position a0 toward direction Y1 with an angle of view V1, is now included in the range R2.

[0131] The effects of the present disclosure will be described. (1-1) The operable range of the event object 92 can be changed depending on whether the augmented reality function is used or not. This allows the user 11 to choose whether or not to use the augmented reality function depending on the event object 92 to be operated, thereby diversifying the ways in which the user 11 can enjoy the game. This can increase the interest of the user.

[0132] (1-2) When the augmented reality function is used, the operable range of the event object 92 changes depending on the shooting range of the camera 170, allowing the user 11 to enjoy adjusting the shooting position and shooting direction of the camera 170.

[0133] (1-3) When using the augmented reality function, the user 11 needs to approach the event position of the event object 92 while avoiding obstructions in the real space in order to include the event position within the shooting range of the camera 170. This can give the user 11 a sense of accomplishment that they have actually reached the event position, compared to when it is determined that the terminal 100 has reached the event position only if the terminal 100 is located within a specified range centered on the event position.

[0134] (1-4) By using the augmented reality function, the user 11 can include the event object 92, whose event location is not included in the operable range when the augmented reality function is not being used, within the operable range. This allows the augmented reality function to be positioned as a practical function in the game, thereby motivating the user 11 to use the augmented reality function.

[0135] (1-5) If the event location is located in an area in the real space that is inaccessible or difficult to access, the user 11 may feel disappointed that the event location cannot be included in the operable range of the event object. For example, an inaccessible area in the real space may include an area prohibited by the government or private property. For example, an inaccessible area in the real space may include an area that is physically difficult to access, such as the sea, a river, or a mountain. In contrast, when the augmented reality function of the event object is used, the operable range of the event object may include a position farther from the terminal position than the radius r1 of the operable range of the event object when the augmented reality function is not used. Therefore, even if the event location is located in an area in the real space that is inaccessible or difficult to access, the user 11 can operate the event object by including the event location in the capture range of the camera 170. This reduces the disappointment felt by the user 11 due to the event location not being included in the operable range of the event object.

[0136] (1-6) When event objects are placed in association with locations corresponding to monuments, public facilities, stores, and scenic spots in the real world, more event objects are likely to be placed in densely populated areas than in sparsely populated areas. On the other hand, when using the augmented reality function, the camera 170 is likely to have a wider capture range in sparsely populated areas with fewer obstructions such as buildings than in densely populated areas, making it easier to expand the operational range of the event objects. This reduces regional disparities in game play, thereby increasing interest regardless of the user's place of residence.

[0137] (1-7) If the terminal 100 is located within a predetermined range from the location where the augmented reality function was last used, the use of the augmented reality function is restricted, and the user 11 can be encouraged to move around with the terminal 100. This can increase interest by encouraging participation in an event corresponding to an event location that is now included in the operable range due to movement.

[0138] (1-8) If a predetermined time has passed since the last use of the augmented reality function, the use of the augmented reality function is restricted, which motivates the user 11 to continue playing the game until the predetermined time has passed. This allows the user 11 to enjoy the game for a long time.

[0139] (1-9) If the accumulated information about movement does not satisfy a predetermined condition, use of the augmented reality function is restricted. In this case, even if the user 11 does not intend to use the augmented reality function immediately, by accumulating information about movement in advance, the user 11 can use the augmented reality function whenever he or she wishes. Therefore, regardless of whether the user 11 intends to use the augmented reality function immediately or not, the user 11 can be encouraged to carry the terminal 100 and move around. This can more effectively encourage the user 11 to participate in an event corresponding to an event location that has been newly included in the operable range as a result of movement.

[0140] (1-10) Even if the conditions specified in steps S400 to S402 are not met, if the specified fee is paid, the use of the augmented reality function is permitted, thereby increasing the interest of the user 11 who has paid the specified fee.

[0141] (Second embodiment) A second embodiment will be described below. In the following description, the same configurations and the same controls as those in the already described embodiments will be denoted by the same reference numerals, and overlapping descriptions will be omitted or simplified.

[0142] [Specific notification] In the second embodiment, a specific notification is executed in the movement part to notify the user that an event object that can be operated by using the augmented reality function exists. An event object that can be operated by using the augmented reality function is an event object whose event position is included in the operable range of the event object when the augmented reality function is used. As an example, the specific notification is executed when the augmented reality function is not used. As an example, the specific notification is executed by displaying an image included in the movement screen 40. As an example, the specific notification may be executed by vibrating the terminal 100 or by outputting sound from the speaker 165.

[0143] [Example of processing flow for specific notifications] As shown in FIG. 19 , in step S800, processor 110 of terminal 100 determines whether or not there is an event object that can be operated using the augmented reality function. As an example, processor 110 identifies the maximum range in which the event object can be operated when using the augmented reality function (hereinafter referred to as the maximum operable range). As an example, processor 110 identifies, as the maximum operable range, the maximum range that can be included in the capture range of camera 170 when capturing images in all directions with the position of terminal 100 as the capture position of camera 170. As an example, processor 110 may exclude positions that are more than the upper limit capture distance from the capture position from the maximum operable range. In this case, the maximum operable range is a spherical space centered on the position of terminal 100 and with a radius equal to the upper limit capture distance.

[0144] For example, if there is an event object whose event position is within the maximum operable range and which is not within the operable range when the augmented reality function is not being used, processor 110 determines that there is an event object that can be operated by using the augmented reality function.

[0145] If it is determined that there is an event object that can be operated by using the augmented reality function, in step S801, the processor 110 executes a specific notification. As an example, the processor 110 executes the specific notification by including a specific notification image M1 on the moving screen 40. As an example, the processor 110 may execute the specific notification by vibrating the terminal 100. As an example, the processor 110 may execute the specific notification by outputting sound from the speaker 165. Thereafter, the processor 110 ends a series of processes related to the specific notification.

[0146] [Example of the movement screen when executing a specific notification] As shown in FIG. 20 , the movement screen 40 when a specific notification is executed includes a specific notification image M1. As an example, the specific notification image M1 may be displayed near the fourth event object 92d that can be operated by using the augmented reality function. As an example, when a specific notification is executed, the fourth event object 92d that can be operated by using the augmented reality function may be displayed in a manner different from when a specific notification is not executed. As an example, when a specific notification is executed, the fourth event object 92d that can be operated by using the augmented reality function may be displayed in a flashing manner.

[0147] [Type of event object that can be manipulated] In the second embodiment, the types of operable event objects differ between when the augmented reality function is used and when the augmented reality function is not used in the movement part. As an example, event objects are classified into different types depending on the content of the corresponding event. As an example, event objects are classified into different types depending on the importance of the corresponding event. As an example, a subjugation event object corresponding to an event in which a task of defeating an enemy object is set and a story event object corresponding to an event that progresses the story of the game are classified into different types. As an example, a story event object may be positioned as an event object of higher importance than a subjugation event object.

[0148] As one example, when the augmented reality function is not used, more types of event objects can be operated than when the augmented reality function is used. As one example, when the augmented reality function is not used, both subjugation event objects and story event objects can be operated. As one example, when the augmented reality function is used, subjugation event objects can be operated, but story event objects cannot be operated. As one example, when a specific event object is inoperable, a notification may be given that the event object is inoperable. As one example, the notification that the event object is inoperable may be given by displaying the event object in a specific display mode. As one example, the specific display mode may be a display mode in which the event object is displayed darker than other event objects. As one example, when a specific event object is inoperable, the event object may not be displayed.

[0149] [Process to identify the event object that can be manipulated] The processor 110 of the terminal 100 differentiates the types of event objects that are operable between the terminal main processing that is executed when the augmented reality function is not being used and the terminal augmented reality processing that is executed when the augmented reality function is being used. As an example, when the augmented reality function is not being used, the processor 110 makes event objects operable regardless of the type of event object. As an example, when the augmented reality function is being used, the processor 110 makes subjugation event objects operable among the event objects, but makes story event objects inoperable.

[0150] [An example of the process flow for restricting the operation of event objects when using the augmented reality function] The processor 110 of the terminal 100 performs processing to restrict operations on the event object in the terminal-side augmented reality processing.

[0151] As shown in FIG. 21 , in step S900, processor 110 identifies the type of event object whose event position is included in the range of photography by camera 170. In step S901, processor 110 restricts the operation of a predetermined type of event object. As an example, processor 110 makes story event objects inoperable. As an example, processor 110 displays the story event objects in a specific display mode. As an example, processor 110 displays the story event objects darker than other event objects. Thereafter, processor 110 ends the series of processes for restricting the operation of the event objects.

[0152] [An example of an augmented reality screen when restricting the operation of an event object] 22, when restricting the operation of an event object, operable event objects and inoperable event objects are displayed in different display modes on the movement screen 40. As an example, the fifth event object 92e, which is an inoperable story event object, is displayed darker than the fourth event object 92d, which is an operable subjugation event object.

[0153] The effects of the present disclosure will be described. (2-1) The user 11 is notified by a specific notification that an event object exists that can be operated using the augmented reality function, which prevents the user 11 from missing an event object that can be operated even though it exists.

[0154] (2-2) The specific notification is executed when the event location is within the maximum range in which the event object can be operated when the augmented reality function is used, and there is an event object that is not within the operable range when the augmented reality function is not used. Therefore, the specific notification allows the user 11 to recognize that an event object that is inoperable when the augmented reality function is not used can be operated by using the augmented reality function. This can encourage effective use of the augmented reality function, thereby increasing interest.

[0155] (2-3) Since the types of event objects that can be operated are different when the augmented reality function is used and when the augmented reality function is not used, different types of interest can be realized when the augmented reality function is used and when the augmented reality function is not used.

[0156] (2-4) When the augmented reality function is used, even if the event location is not within the operable range, the event location may be included in the operable range by changing the shooting direction of the camera 170 on the spot. On the other hand, when the augmented reality function is not used, if the event location is not within the operable range, the user 11 needs to carry the terminal 100 and move around to include the event location in the operable range. Therefore, when the augmented reality function is used, it may be easier to include the event location in the operable range compared to when the augmented reality function is not used. In contrast, in the second embodiment, when the augmented reality function is not used, more types of objects can be operated than when the augmented reality function is used. This can prevent the user 11 from using the game in a uniform way due to the augmented reality function being used exclusively.

[0157] (2-5) In particular, when the augmented reality function is used, story event objects that are considered to be highly important become inoperable. This more effectively prevents the augmented reality function from being used exclusively, leading to a uniform way of enjoying the game by the user 11.

[0158] The above embodiment can be modified as follows: The above embodiment and the following modifications can be combined with each other within the scope of technical compatibility. [Change Example 1] In the second embodiment, the types of event objects may be changed as appropriate. Furthermore, as an example, the types of operable event objects may be changed as appropriate between when the augmented reality function is used and when the augmented reality function is not used. For example, when the augmented reality function is used, the number of types of operable event objects may be increased compared to when the augmented reality function is not used. For example, the event objects may include an event object of a type that is inoperable when the augmented reality function is not used but is operable when the augmented reality function is used. For example, the event objects may not include an event object of a type that is inoperable when the augmented reality function is used but is operable when the augmented reality function is not used. Furthermore, as an example, the types of operable event objects may be different between when the augmented reality function is used and when the augmented reality function is not used, while the number of types of operable event objects may be the same. Furthermore, the types of event objects that are inoperable when either the augmented reality function is used or when the augmented reality function is not used but are operable when the other function is not used may be changed as appropriate.

[0159] [Change Example 2] The location where an event is to be placed in the virtual space may be determined by the user 11 operating the terminal 100. As an example, when the user 11 is prompted to determine the location where the event is to be placed, the processor 110 may present one or more candidate locations as candidates for the location where the event is to be placed. As an example, when the user 11 is prompted to determine the location where the event is to be placed, the processor 110 may display a candidate location icon on the movement screen 40. As an example, the processor 110 may display the candidate location icon on a position selection screen different from the movement screen 40. The position selection screen may be an image depicting the shooting range of a virtual camera placed in a position in the virtual movement space different from the position where the virtual camera is placed on the movement screen 40. As an example, the candidate location icon may be displayed in a different manner depending on whether the corresponding candidate location is within an operable range when the augmented reality function is not being used. As an example, when the corresponding candidate location is outside the operable range when the augmented reality function is not being used, the candidate location icon may be displayed in a different manner depending on whether the corresponding candidate location is within the maximum operable range when the augmented reality function is being used.

[0160] As another example, events may include user-located events whose placement locations can be determined by the user 11, and location-fixed events whose placement locations are predetermined. Location-fixed events may be placed at locations corresponding to specific monuments, public facilities, stores, scenic spots, and the like in real space. As another example, event objects corresponding to user-located events and event objects corresponding to location-fixed events may be defined as different types of event objects. In this example, event objects corresponding to user-located events are referred to as user-located objects, and event objects corresponding to location-fixed events are referred to as location-fixed objects. As another example, processor 110 may make a location-fixed object operable either when the augmented reality function is used or when the augmented reality function is not used, and inoperable in the other case. As another example, processor 110 may make a user-located object operable either when the augmented reality function is used or when the augmented reality function is not used, and inoperable in the other case.

[0161] For example, if a fixed-position object is made inoperable when the augmented reality function is not being used, user 11 must use the augmented reality function to include the corresponding event location within the range of camera 170 in order to operate the fixed-position object. That is, in order to operate the fixed-position object, user 11 must carry terminal 100 and move to a position where a specific monument, public facility, store, scenic spot, etc. corresponding to the fixed-position object can be seen. This gives user 11 the impression that, when operating the fixed-position object, he or she has actually arrived at the specific monument, public facility, store, scenic spot, etc., thereby increasing the interest.

[0162] Furthermore, for example, if a fixed-position object is made inoperable when the augmented reality function is used, the user 11 must not use the augmented reality function and must include the corresponding event location within a specified range from the location of the terminal 100 in order to operate the fixed-position object. That is, in order to operate the fixed-position object, the user 11 must move while holding the terminal 100 until a specific monument, public facility, store, scenic spot, etc. corresponding to the fixed-position object is included within a specified range from the location of the terminal 100. This prevents the user 11 from being satisfied with simply including a specific monument, public facility, store, scenic spot, etc. within the shooting range of the camera 170 from a long distance when operating the fixed-position object, and can encourage real-world movement.

[0163] [Change Example 3] The camera 170 may have a zoom function. As an example, the zoom function changes the angle of view of the camera 170. As an example, the zoom function may be an optical zoom function that is performed by changing the position of the lens of the camera 170 to change the focal length, or a digital zoom function that is performed by cutting out and enlarging a part of a captured image. As an example, the zoom function may be performed by the user 11 manipulating the position of the lens, or may be performed by processing by a processor included in the camera 170. Furthermore, the zoom function may be performed by processing by the processor 110 of the terminal 100 that has acquired the image captured by the camera 170.

[0164] For example, when the angle of view of camera 170 is changed using the zoom function, the upper limit shooting distance included in the maximum shooting range of camera 170 may be changed according to the changed angle of view. For example, the upper limit shooting distance may be set shorter as the angle of view becomes wider, and longer as the angle of view becomes narrower. In this case, when using the augmented reality function, user 11 can change the operable range not only by changing the shooting position and shooting direction, but also by changing the angle of view and the upper limit shooting distance using the zoom function. This can improve the enjoyment of capturing images of real space using the augmented reality function.

[0165] [Change Example 4] The maximum operable range may not include areas that are blocked by terrain and buildings as viewed from the position of the terminal 100. In other words, the maximum operable range may be a spherical space that is centered on the position of the terminal 100 and has a radius equal to the maximum shooting distance, excluding the space that is blocked by terrain and buildings as viewed from the position of the terminal 100. As an example, the space that is blocked by terrain and buildings may be specified based on the relationship between a position in the virtual movement space that corresponds to the position of the terminal 100 and a field object that is placed in the virtual movement space.

[0166] In this case, if the event position is in a position that is obstructed by terrain and buildings as viewed from the position of the terminal 100, and therefore the event position cannot be included in the shooting range of the camera 170 when using the augmented reality function, the specific notification will not be executed. This prevents the user 11 from being disappointed when using the augmented reality function in accordance with the specific notification because the event position is in a position that is obstructed by terrain and buildings as viewed from the position of the terminal 100 and the user is unable to operate the event object.

[0167] [Change Example 5] When the augmented reality function is being used, a shooting direction change suggestion notification may be executed to notify the user that an event object exists whose event position is within the operable range by changing the shooting direction of the camera 170. For example, the shooting direction change suggestion notification may be executed when the event position is within the maximum operable range and an event object that is not within the current operable range is present when the augmented reality function is being used. For example, the shooting direction change suggestion notification may be executed in a manner that displays an icon on the augmented reality screen 50 suggesting a direction in which an event object whose event position is within the operable range by changing the shooting direction of the camera 170 is present. For example, the shooting direction change suggestion notification may be executed in a manner that displays an arrow-shaped icon on the right or left edge of the augmented reality screen 50. This prevents the user 11 from overlooking an event object that becomes operable by changing the shooting direction of the camera 170. For example, the shooting direction change suggestion notification may be executed by vibrating the terminal 100 or by outputting sound from the speaker 165.

[0168] [Change Example 6] When the augmented reality function is being used, a special notification may be executed to notify the user that an event object exists that will become operable by terminating the augmented reality function. As an example, the special notification may be executed when the augmented reality function is being used. As an example, the special notification may be executed when the event location is not included in the operable range when the augmented reality function is being used, and an event object exists that is included in the operable range when the augmented reality function is not being used. In other words, the special notification may be executed when the event location is not included in the range captured by the camera 170, and an event object exists that is included within a specified range from the position of the terminal 100. This prevents the user 11 from overlooking an event object that will become operable by terminating the augmented reality function when the augmented reality function is being used.

[0169] [Change Example 7] The augmented reality screen 50 may display an event object whose event position is not within the operable range. As an example, the augmented reality screen 50 may display an event object whose event position is located in a position that is obscured by terrain and buildings as viewed from the shooting position of the camera 170. As an example, the augmented reality screen 50 may display an event object whose event position is located at a position farther away from the shooting position of the camera 170 than the upper limit shooting distance. As an example, an event object whose event position is not within the operable range may be displayed superimposed on a position corresponding to a line connecting the shooting position of the camera 170 and the event position in the image captured by the camera 170. As an example, an event object whose event position is not within the operable range may be displayed in a different manner from an event object whose event position is within the operable range. As an example, an event object whose event position is not within the operable range may be displayed darker than an event object whose event position is within the operable range. This allows the user 11 to recognize the direction in which an event object whose event position is not within the operable range is located when using the augmented reality function. This allows the user 11 to move around and enjoy the game.

[0170] [Change Example 7] If an object other than the terrain and buildings included in the map data is captured in an image captured by camera 170, the location obscured by the object may be excluded from the operable range when using the augmented reality function. In this example, an object corresponding to the terrain and buildings included in the map data is referred to as a first object, and an object not corresponding to the terrain and buildings included in the map data is referred to as a second object. For example, the second object may be a passerby, a vehicle, or a signboard temporarily placed on a road. For example, processor 110 determines whether the second object is included in the image captured by camera 170 through image recognition processing. For example, processor 110 identifies the contours of the first object and the second object included in the image captured by camera 170. Processor 110 identifies the positional relationship between the first object and the second object based on the relationship between the contour of the first object and the contour of the second object, thereby identifying the position of the second object. This allows the processor 110 to identify positions that are blocked by the second object when viewed from the shooting position of the camera 170, and to exclude them from the operable range when using the augmented reality function.

[0171] According to this, when a second object that is not included in the map data appears in the image captured by the camera 170, the event object included in the position where the event position is blocked by the second object becomes inoperable. Therefore, when the augmented reality function is used, it is possible to prevent the event object corresponding to the event position from becoming operable even though the event position is not visible to the user 11.

[0172] [Change Example 8] The operable range of the event object when playing using the augmented reality function may be changed as appropriate. Also, the operable range of the event object when playing without using the augmented reality function may be changed as appropriate. In this case, it is sufficient that at least a part of the operable range of the event object when playing using the augmented reality function differs from that when playing without using the augmented reality function.

[0173] [Change Example 9] When playing using the augmented reality function, the display content of the augmented reality screen 50 does not need to be updated in real time, and the frequency at which the display content of the augmented reality screen 50 is updated may be changed as appropriate. As an example, when playing using the augmented reality function, the augmented reality screen 50 may be updated in response to an update operation by the user. As an example, the update operation by the user may be an operation to instruct the camera 170 to take a picture.

[0174] [Change Example 10] When playing using the augmented reality function, the operable range of the event object may be set to be different from when playing without using the augmented reality function for a certain period of time after the real space was last photographed by the camera 170. In this case, as an example, even after the augmented reality function has been terminated, the operable range of the event object may be set to be different from when playing without using the augmented reality function for a certain period of time after the real space was last photographed by the camera 170.

[0175] [Change Example 11] The augmented reality function may enable operation of an event object placed within a range included in an image previously captured by the camera 170. In other words, the augmented reality function does not necessarily have to be a function for playing while capturing an image of the real space. As an example, the augmented reality function may change the operable range of the event object when playing after capturing an image of the real space compared to when playing without capturing an image of the real space.

[0176] As one example, the augmented reality function stores an image of a game screen created by placing an event object in an image captured by the camera 170. The augmented reality function then displays the stored image of the game screen on the monitor 181 of the terminal 100 at any timing, and makes it possible to operate the event object placed within the range included in the displayed image of the game screen. As one example, the stored image of the game screen may be displayed on the monitor 181 of the terminal 100 in response to a predetermined operation by the user. As one example, the stored image of the game screen may be deleted in response to a predetermined time having elapsed since it was captured by the camera 170. As one example, a predetermined number of game screen images may be stored up to an upper limit, and if the upper limit is exceeded, the images stored may be deleted in order starting with the oldest.

[0177] As another example, the augmented reality function allows an event object placed within a range included in an image previously captured by camera 170 to be operated by placing the event object at any timing in the image. As another example, the event object may be placed in an image previously captured by camera 170 in response to a predetermined operation by the user. As another example, the user may select, through a predetermined operation, which of the images previously captured by camera 170 the event object is to be placed in.

[0178] [Change Example 12] The conditions for starting the augmented reality function and the conditions for permitting use of the augmented reality function may be changed as appropriate. For example, a condition other than tapping on the area where the augmented reality function start icon 95 is displayed may be used as the condition for starting the augmented reality function. For example, a condition for starting the augmented reality function may be capturing an image of a specific object existing in real space using the camera 170 of the terminal 100. In this case, capturing an image of a specific object existing in real space using the camera 170 of the terminal 100 corresponds to an augmented reality function start operation that instructs the start of the augmented reality function. For example, the specific object existing in real space may be a specific building, famous place, scenic spot, or the like, or may be a one-dimensional or two-dimensional code image, or the like.

[0179] Furthermore, other conditions may be set as conditions for permitting use of the augmented reality function, instead of or in addition to the conditions shown in steps S400 to S402. As one example, the augmented reality function may be permitted to be used on the condition that a specific object existing in real space is photographed by the camera 170 of the terminal 100. That is, the augmented reality function may be permitted to be used on the condition that a specific object existing in real space is photographed by the camera 170 of the terminal 100 after an operation to start the augmented reality function is performed.

[0180] As another example, some or all of the conditions set forth in steps S400 to S402 may not be included in the conditions for permitting use of the augmented reality function. As another example, use of the augmented reality function may be permitted only when all of the conditions set forth in steps S400 to S402 are satisfied and the condition of step S404 is also satisfied. As another example, use of the augmented reality function may be permitted without any particular restrictions. In this case, as one example, if a predetermined condition is not satisfied, the event object may be made inoperable on the augmented reality screen 50. As the predetermined condition, for example, the conditions set forth in steps S400 to S402 may be adopted.

[0181] [Change Example 13] The above-described processes and the order of steps are merely examples and are not intended to be limiting. The order of steps and processes can be arbitrarily changed without departing from the scope of the embodiments and modifications.

[0182] [Change Example 14] One or more modules or functions provided in the terminal 100 and the server 200 may be realized by circuits such as an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), an FPGA (Field-Programmable Gate Array), or an MCU (Micro Control Unit).

[0183] [Change Example 15] One or more modules or functions of the terminal 100 and the server 200 may be implemented by software using a processor. The computer includes a processor, memory, and storage. The above programs and various data are recorded in the storage so that they can be read by the processor. The programs are deployed in the memory. The processor then reads and executes the programs from the storage, thereby realizing the functions of the present disclosure. As already explained, the storage can be implemented as a non-volatile storage device.

[0184] [Change Example 16] The program may be supplied to the computer via any transmission medium capable of transmitting the program (such as a communication network or broadcast waves).

[0185] [Change Example 17] The program may be recorded on a storage medium such as a magnetic disk (floppy disk, hard disk, etc.), an optical disk (CD-ROM, DVD, MO, etc.), or a semiconductor memory (ROM, RAM, flash memory, etc.).

[0186] [Change Example 18] The game program of the server 200 and the game program of the terminal 100 can be understood as one program, or they can be understood as separate programs. The server 200 may perform all processing, and the processing results may be displayed as images on the monitor 181 of the terminal 100.

[0187] [Change Example 19] In the above-described embodiment and modified examples, some or all of the processes and steps executed by the processor 210 of the server 200 as the game control unit 201 may be executed by the processor 110 of the terminal 100 as the game control unit 101. In the above-described embodiment and modified examples, some or all of the processes and steps executed by the processor 110 of the terminal 100 as the game control unit 101 may be executed by the processor 210 of the server 200 as the game control unit 201. In other words, all of the processes and steps described in the embodiment and modified examples may be executed by the processor 210 of the server 200 or by the processor 110 of the terminal 100.

[0188] [Change Example 20] Any specific process and step among the processes and steps described in the embodiment and modified examples may be executed by the processor 210 of the server 200, and any process and step other than the specific process and step may be executed by the processor 110 of the terminal 100. That is, in the information processing system 10, a computer may be configured with one or more terminals 100 and one or more servers 200. As an example, all of the various means and functions that can be implemented by the processor 210 of the server 200 may be implemented by the processor 110 of the terminal 100. As an example, any part of the various means and functions that can be implemented by the processor 210 of the server 200 may be implemented by the processor 210 of the server 200, and the remaining parts may be implemented by the processor 110 of the terminal 100.

[0189] [Change Example 21] The various functions that can be realized by the game control unit 201 are not limited to being configured by a single processor 210, but may be configured by multiple processors included in one server 200 or multiple servers 200. The various functions that can be realized by the game control unit 101 and the display control unit 104 are not limited to being configured by a single processor 110, but may be configured by multiple processors included in one terminal 100 or multiple terminals 100. Furthermore, the various functions may be configured by one or multiple processors included in one or multiple terminals 100 and one or multiple servers 200. In this way, a computer may be configured by one or more terminals 100, one or more servers 200, or may be configured to include one or more terminals 100 and one or more servers 200.

[0190] [Change Example 22] When the terminal 100 executes all of the processes and steps described in the embodiment and modified examples, the terminal 100 may be configured not to communicate with other devices when executing these processes and steps. Furthermore, the computer is not limited to being configured by one or both of the terminal 100 and the server 200. The computer may also be a device that does not communicate with other devices. As an example, the computer may be a stationary device for home or business use, or may be a portable device.

[0191] [Note] The present disclosure includes the following examples, in which reference numbers are provided to elements of the embodiments to aid understanding and not by way of limitation.

[0192] (Objective) For example, the objective is to improve interest. (Appendix 1) A program that causes a computer (100, 200) to place an object (92) in a virtual space that can be operated by a user, associated with a position in real space, and changes the operable range (R1, R2) of the object depending on whether the game is played by photographing the real space or without photographing the real space (S601, S602, S701, S702).

[0193] For example, the user can enjoy the game in a variety of ways, depending on whether the game is played by taking pictures of the real space or without taking pictures of the real space. This can increase the user's interest.

[0194] (Appendix 2) When playing by photographing real space, the program described in Appendix 1 makes it possible to operate the object (92) in the virtual space that is placed within a range (R2) included in the image of the real space (S701, S702).

[0195] For example, when playing by photographing real space, the operable range of the object changes depending on the range included in the image of the real space, allowing the user to enjoy adjusting the shooting position and direction.

[0196] (Appendix 3) When playing by photographing the real space, the program described in Appendix 2 allows the object (92) to be operated on the condition that there is no obstruction between the user's position in the real space and the position associated with the object (92) (S206, S701, S702).

[0197] For example, when a user takes a picture of the real world and plays the game, the user needs to take a picture of the object while avoiding obstacles in the real world in order to operate the object, which gives the user a sense of accomplishment in reaching the location where the object is actually located.

[0198] (Appendix 4) A program described in any one of Appendices 1 to 3, wherein the operable range (R2) of the object (92) when playing by photographing the real space includes a position outside the operable range (R1) of the object (92) when playing without photographing the real space.

[0199] For example, by taking a picture of the real world and playing, a user can include an object that is not included in the operable range when playing without taking a picture of the real world in the operable range. This allows playing by taking a picture of the real world to be positioned as a practical function, which can motivate users to take pictures of the real world and play.

[0200] (Appendix 5) The program according to appendix 1, wherein the type of the operable object (92) is made different when playing by photographing the real space and when playing without photographing the real space (S901).

[0201] For example, different interests can be realized when playing by taking pictures of the real space and when playing without taking pictures of the real space. (Appendix 6) A program as described in Appendix 4, in which when playing without photographing the real space, more types of the object (92) can be operated (S901) than when playing by photographing the real space.

[0202] When playing without taking pictures of the real space, more types of objects can be operated than when playing by taking pictures of the real space, which prevents users from choosing to play only in a way that takes pictures of the real space, and prevents users from becoming standardized in their way of enjoying the game.

[0203] (Appendix 7) The program according to appendix 1, which notifies the user that there is an object within the operable range when photographing real space and playing (S801). For example, the user is notified that there are objects that can be controlled by taking a picture of the real space and playing, which prevents the user from missing out on the existence of controllable objects.

[0204] (Appendix 8) A program as described in Appendix 1, which accumulates information about the user's movement in real space, and when the accumulated information about the movement satisfies a predetermined condition (S402), photographs the real space and makes it playable (S403).

[0205] By accumulating information about movement, users can take pictures of real space and play. This allows users who want to take pictures of real space and play to be encouraged to move around. This increases the interest by encouraging users to operate objects that are newly included in the operable range as a result of movement.

[0206] (Appendix 9) The program according to appendix 1, which takes a picture of the real space and makes it playable (S403) when a predetermined fee is paid (S404). For example, it is possible to increase the interest of users who have paid a predetermined fee.

[0207] (Appendix 10) The program according to appendix 1, which restricts play by photographing real space when the user is located within a predetermined range from the position where the real space is photographed and played (S400).

[0208] For example, if the user is located within a predetermined range from the position where the real space was photographed and played, the user is restricted from playing by photographing the real space, and the user is encouraged to move. This increases the interest by encouraging the user to operate an object that is now included in the operable range as a result of movement.

[0209] (Supplementary Note 11) The program according to Supplementary Note 1, which restricts play by photographing the real space if a predetermined time has not elapsed since the real space was photographed and play was performed (S401). For example, if a predetermined time has not elapsed since the user took a picture of the real world and started playing, the user is restricted from taking pictures of the real world and playing, which can motivate the user to wait until the predetermined time has passed. This allows the user to enjoy the game for a long time.

[0210] (Appendix 12) An information processing system that places an object in a virtual space that can be operated by a user in association with a position in real space, and changes the operable range of the object depending on whether the game is played by photographing the real space or without photographing the real space.

[0211] The configurations described in Supplementary Notes 1 to 12 may be appropriately applied to the fields of devices, systems, methods, and media. It will be apparent to those skilled in the art that the present invention may be embodied in other specific forms without departing from the spirit of the present invention. For example, some of the components described in the embodiment (or one or more aspects thereof) may be omitted, or some components may be combined. The same applies to procedures. The scope of the present invention should be determined with reference to the appended claims, along with the full scope of equivalents to which such claims are entitled. [Explanation of symbols]

[0212] M1...specific notification image 10...information processing system 11...user 20...network 40...movement screen 50...augmented reality screen 60...event screen 80, 82...field object 91...user object 92, 92a, 92b, 92c, 92d, 92e...event object 93...enemy object 95...augmented reality function start icon 96...augmented reality function end icon 100...terminal 101...game control unit 102...image acquisition unit 103...position acquisition unit 104...display control unit 105...storage unit 106...communication unit 107...input / output unit 108...shooting range identification unit 110...processor 120...memory 130...storage 140...communication interface 150...input / output interface 160...microphone 165...speaker 170...camera 175...GNSS receiver 180...touch screen 181...monitor 182...Touch sensor 190...Communication bus 200...Server 201...Game control unit 205...Memory unit 206...Communication unit 207...Input / output unit 210...Processor 220...Memory 230...Storage 240...Communication interface 250...Input / output interface 290...Communication bus 300...Input device 900...Building

Claims

1. On the computer, Place objects in the virtual space that can be manipulated by the user, associated with positions in the real world, The program changes the operable range of the object depending on whether the game is played by photographing the real space or without photographing the real space.

2. 2. The program according to claim 1, wherein, when playing by photographing a real space, the object arranged within a range included in an image of the real space in the virtual space can be operated.

3. The program according to claim 2, wherein when the real space is photographed and played, the object can be operated on the condition that there is no obstruction between the user's position in the real space and the position associated with the object.

4. The program according to any one of claims 1 to 3, wherein the operable range of the object when playing by photographing real space includes a position outside the operable range of the object when playing without photographing real space.

5. The program according to claim 1 , wherein the types of the operable objects are made different between when the game is played by taking a picture of the real space and when the game is played without taking a picture of the real space.

6. 5. The program according to claim 4, wherein when playing without taking a picture of the real space, more types of objects can be operated than when playing with taking a picture of the real space.

7. 2. The program according to claim 1, wherein the program notifies the user that there is an object within the operable range when the real space is photographed and played.

8. 2. The program according to claim 1, further comprising: storing information relating to a user's movement in real space; and photographing the real space and making it playable when the stored information relating to the movement satisfies a predetermined condition.

9. The program according to claim 1, wherein the program photographs the real space and makes it playable when a predetermined fee is paid.

10. 2. The program according to claim 1, wherein when the user is located within a predetermined range from a position where the real space is photographed and the game is played, the game is restricted from being played by photographing the real space.

11. 2. The program according to claim 1, wherein if a predetermined time has not elapsed since the real space was photographed and play was started, play by photographing the real space is restricted.

12. Place objects in the virtual space that can be manipulated by the user, associated with positions in the real world, The information processing system changes the operable range of the object depending on whether the game is played by photographing the real space or without photographing the real space.

Citation Information

Patent Citations

  • Augmented reality display system, program and method

    JP2018200519A