Computer programs and computer devices

The computer program integrates real and virtual spaces by overlaying virtual objects based on real-world conditions, addressing discrepancies and enhancing user immersion.

JP7869430B2Active Publication Date: 2026-06-03CAPCOM CO LTD

Patent Information

Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
CAPCOM CO LTD
Filing Date
2021-10-12
Publication Date
2026-06-03

AI Technical Summary

Technical Problem

Conventional XR technologies fail to integrate real and virtual spaces seamlessly, leading to discrepancies between the virtual world provided and the user's desired worldview.

Method used

A computer program that generates spatial images based on real-world environmental conditions and determines when to overlay virtual objects, using weather, user location, and other environmental factors to create a cohesive virtual-real experience.

Benefits of technology

The solution effectively merges the real and virtual worlds by ensuring virtual objects appear only when real-world conditions match the game's requirements, enhancing the user's immersion and experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007869430000001
    Figure 0007869430000001
  • Figure 0007869430000002
    Figure 0007869430000002
  • Figure 0007869430000003
    Figure 0007869430000003
Patent Text Reader

Abstract

To provide a computer program capable of further fusing a real space and a virtual space.SOLUTION: A computer program of the present invention executes the following steps. In a display step, information is generated for a user to visually recognize a space image corresponding to a predetermined position in a real space through a terminal device. In a determination step, it is determined whether conditions at least including environmental information on the predetermined position of the real space satisfy an appearance condition. In a control step, information is generated for displaying a virtual object by superimposing the virtual object, on the space image displayed in the terminal device when the appearance condition is satisfied.SELECTED DRAWING: Figure 5
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0006] , , ,

[0001] The present disclosure relates to a computer program and a computer device.

Background Art

[0002] In recent years, new entertainment using XR (Extended Reality) technology that combines the virtual world and the real world has been provided.

[0003] For example, the XR technology includes AR (Augmented Reality) technology that superimposes a virtual character or the like on a photographed image of the real space displayed on a smartphone (see, for example, Non-Patent Document 1).

[0004] In this conventional technology, a virtual monster is superimposed and displayed on a photographed image of the real space. As a result, the user can experience as if a monster exists in the real space where the user is.

Prior Art Documents

Non-Patent Documents

[0005]

Non-Patent Document 1

Disclosure of the Invention

Problems to be Solved by the Invention

[0006] However, the aforementioned conventional technology only superimposes images of monsters onto real-world images because the user has gone to a specific location, and there is a problem in that there is a discrepancy between the virtual space provided by the conventional technology and the worldview desired by the user.

[0007] The purpose of this disclosure is to provide a computer program that can further integrate the real and virtual spaces. [Means for solving the problem]

[0008] The first disclosure is, A computer program that causes a computer to perform the following steps: In the display step, information is generated for the user to view a spatial image corresponding to a predetermined location in real space via a terminal device. In the determination step, it is determined whether the condition that environmental information of a predetermined location in real space is included at least satisfies the predetermined appearance conditions. In the control step, if the appearance conditions are met, information is generated for overlaying a virtual object onto the spatial image displayed on the terminal device. It is a computer program.

[0009] Furthermore, in the first disclosure, The aforementioned environmental conditions are the weather conditions at the predetermined location and / or the conditions relating to surrounding users present in the vicinity of the predetermined location. It is possible.

[0010] Furthermore, in the first disclosure, A computer program that causes a computer to perform the next step, In the information acquisition step, location information of the real world where the user is located is acquired. The predetermined position is the user's location in real space. It is possible.

[0011] Also, in the first disclosure, the appearance condition includes that the virtual object and the user are in a predetermined relationship, which can be the case.

[0012] Also, in the first disclosure, the predetermined relationship is to be a predetermined positional relationship and / or to be a predetermined operational relationship, which can be the case.

[0013] Also, in the first disclosure, the virtual object is an object controlled in a game, and the appearance condition is a condition related to the characteristics of the virtual object within the game, which can be the case.

[0014] Also, in the first disclosure, in the control step, cause the terminal device to execute game content for the user to play, and the appearance condition includes a condition related to the play result of the game content, which can be the case.

[0015] Also, in the first disclosure, in the control step, when the appearance condition is satisfied, generate information for notifying the terminal device that the appearance condition is satisfied, which can be the case.

[0016] Also, in the first disclosure, a computer program for causing a computer to further execute the following step: In a communication step, transmit information sent from a related device operated by another user different from the user to the terminal device, where the transmitted information is information for assisting in satisfying the appearance condition, which can be the case.

[0017] Also, in the first disclosure, In the communication step, information for displaying an image identical to the image displayed on the terminal device is transmitted to the related device. This is possible.

[0018] Also, in the first disclosure, The virtual object is an object controlled in a game, In the control step, when the virtual object is displayed on the user's terminal device, setting information regarding the virtual object in the game is generated. This is possible.

[0019] The second disclosure is a computer device including a storage unit that stores the computer program of the first disclosure, and a control unit that executes the computer program. It is provided with a computer device.

Advantages of the Invention

[0020] [[ID=3i]] According to the present disclosure, it is possible to provide a computer program capable of further integrating the real space and the virtual space.

Brief Description of the Drawings

[0021] [Figure 1] It is a diagram showing the configuration of a game system in the first embodiment. [Figure 2] It is a diagram showing an example of the real space in the first embodiment. [Figure 3] It is a perspective view of a VR goggles constituting the game system in the first embodiment. [Figure 4] It is a diagram showing an example of a game screen of a game executed by the game system in the first embodiment. [Figure 5] It is a diagram showing an example of a game screen of a game executed by the game system in the first embodiment. [Figure 6]This figure shows an example of character occurrence data in the first embodiment. [Figure 7] This is a plan view showing an example of a field map in the first embodiment. [Figure 8] This figure shows an example of user data in the first embodiment. [Figure 9] This is a flowchart showing the search process in the first embodiment. [Figure 10] This figure shows an example of real space in the second embodiment. [Figure 11] This figure shows an example of user data in the second embodiment. [Figure 12] This is a flowchart showing the search process in the second embodiment. [Modes for carrying out the invention]

[0022] [First Embodiment] Game system 1 according to the embodiment of this disclosure will be described with reference to Figures 1 to 9.

[0023] Game system 1 comprises a server device 2, a user terminal device 3, and a VR goggle (head-mounted display) 4, as shown in Figures 1 to 3. Note that game system 1 and the processing procedure described below are examples, and the embodiments of this disclosure are not limited to these. Game system 1 and the processing procedure can be modified as appropriate without altering the gist of this disclosure.

[0024] <Game Description> Server device 2 provides the outdoor game described below, which is executed on user terminal device 3. Specifically, as shown in Figures 2 and 3, user P plays the outdoor game while wearing VR goggles 4.

[0025] The outdoor game of this embodiment is a game that combines the outdoors with video games, and progresses as the user moves through real space and explores virtual objects.

[0026] In this embodiment of the outdoor game, for example, as shown in Figure 2, a VR mode game is provided in which the user P explores an island IL in real space.

[0027] In VR mode, as shown in Figure 4, a computer graphics (CG) image (spatial image) of a field map (3D virtual space) that reproduces the actual terrain of Island IL is displayed as the game screen on the LCD screen 340 of the user terminal device 3.

[0028] The game screen displays an image of a field map corresponding to the real-world space included in the user P's field of view, based on the user P's current position and orientation (the orientation / posture of the VR goggles 4).

[0029] In other words, the LCD screen 340 displays an image of a field map corresponding to the real space included in the user P's field of view, following the user P's movement.

[0030] User P moves around the island IL while viewing the game screen displayed on the LCD screen 340, searching for virtual objects that appear on the field map. In this embodiment, the virtual objects are virtual characters.

[0031] For example, if user P discovers a character in the state shown in Figure 4, the character's image (character M in the example in Figure 5) will be displayed in conjunction with the CG image of the field map, as shown in Figure 5.

[0032] While there are multiple types of characters available, each character is not always present on the field map. Instead, they only appear on the field map when their appearance conditions are met (for example, only characters whose appearance conditions are met).

[0033] The conditions for a character's appearance include the environmental conditions of a specific location in real space.

[0034] In this embodiment, it is determined whether or not the conditions for a character's appearance are met, based on the user P's current position (an example of a predetermined position).

[0035] Environmental conditions are the environmental conditions at the user P's current location. In this embodiment, the environmental conditions for occurrence include weather (weather, wind speed, temperature, humidity, etc.), altitude, topography, and date and time (time of year, season).

[0036] Therefore, for example, if the weather in the real-world space where user P is located is "rainy," then characters whose appearance condition includes "sunny" weather will not appear.

[0037] Furthermore, in this embodiment, it is determined whether or not the appearance conditions are met for a character associated with the area containing the user P's current location.

[0038] In other words, each character has a designated appearance area, and if the conditions for a character's appearance are met, that character will appear within that area.

[0039] The appearance area is set for each character as shown in Figure 6. In this embodiment, as shown in Figure 7, one of the three areas A to C, which are divided into three sections on the field map, is set as the appearance area.

[0040] Therefore, for example, if user P is in area B, as shown in Figure 6, the success or failure of the appearance conditions for "character N," whose appearance area is B, is determined, but the success or failure of the appearance conditions for "character M" and "character O," whose appearance area is not B, is not determined.

[0041] Furthermore, the character data (for example, images) for the outdoor game uses data from virtual characters that appear in existing video games. The conditions for character appearance also reflect the ecosystem (settings) of virtual characters in existing video games.

[0042] For example, "Character M" in Figure 6 appears in existing video games as an enemy character (target to be defeated) of the player character.

[0043] Furthermore, in the video game, "Character M" is described as "living near water, such as mountain streams, in a relatively warm climate within a 3D virtual space."

[0044] Furthermore, the conditions for the appearance of "Character M" in the outdoor game include conditions that reflect the ecosystem in the video game, such as the terrain being near water and the temperature being relatively warm between 15°C and 25°C.

[0045] In this way, in outdoor games, the virtual characters from existing original games appear through VR goggles 4 (LCD screen 340) as part of the ecosystem (augmented reality) of the original game.

[0046] When the conditions for a character's appearance are met, that character will appear at one of the locations within the appearance area on the field map. The exact location within the appearance area where the character appears will vary depending on the character's type.

[0047] For example, larger characters will appear at a distance from the user within the appearance area. Conversely, smaller characters will appear at a distance from the user within the appearance area. In addition, certain characters will appear inside a sea (or river) within the appearance area, emerging from or emerging from it. Furthermore, characters capable of flight will appear in the air, flying into view.

[0048] In this embodiment, as shown in Figure 6, the appearance location and other factors are determined based on the appearance pattern set for each character. The appearance pattern, as mentioned above, refers to information such as where and how the character appears in the appearance area, and what kind of environment it inhabits.

[0049] Furthermore, after appearing, the character acts within the three-dimensional virtual space of the field map. For example, the character moves. Therefore, the image of the character displayed on the LCD screen 340 differs depending on the relationship between the character's position and orientation and the user P's position and orientation (the appearance of the character differs depending on the user P's position, etc.).

[0050] In this outdoor game, users can explore and observe characters while moving through real space, experiencing what it would be like for characters from existing video games to exist (live) in the real world. In other words, by playing this outdoor game, users can get a sense of the virtual world of existing video games merging with the real world.

[0051] <Hardware Configuration> Referring to Figure 1, the hardware and functional configurations of the server device 2, as well as the hardware and functional configurations of the user terminal device 3 (VR goggles 4) on which the outdoor game is run, will be described.

[0052] Furthermore, each user terminal device 3 is assigned a game-specific user account (user ID) associated with it. This user account is managed as user account information (user identification information).

[0053] When user terminal device 3 communicates with server device 2 via communication network 5, user terminal device 3 transmits a user ID. The transmitted user ID is then authenticated by server device 2. This enables communication between server device 2 and user terminal device 3.

[0054] <Hardware configuration of Server Device 2> As shown in Figure 1, the server device 2 comprises a control unit 20, a storage unit 21, and a network interface 22.

[0055] The storage unit 21 and the network interface 22 are connected to the control unit 20 of the server device 2 via the bus 29.

[0056] The control unit 20 consists of a CPU, memory (RAM), various input / output interfaces, etc., and controls the operation of the server device 2. Further details will be described later.

[0057] The memory unit 21 mainly consists of HDD (Hard Disk Drive), RAM (Random Access Memory), ROM (Read Only Memory), SSD (Solid State Drive), etc.

[0058] The memory unit 21 stores, for example, the computer program of this disclosure, as well as a distribution program and data for distributing a game program for running an outdoor game played on the user terminal device 3.

[0059] Furthermore, the memory unit 21 stores character appearance data as shown in Figure 6.

[0060] The character appearance data stores information such as the character's unique name, character identification information, appearance area, appearance conditions, and appearance pattern.

[0061] As mentioned above, the appearance area is identification information for the area where the character will appear. Each area is a portion of the field map corresponding to the island IL in real space, as shown in Figure 7. The range of each area is determined, for example, using the coordinates of the 3D virtual space (world coordinate system) of the field map. The data that determines this range is also stored in the memory unit 21.

[0062] As mentioned above, the appearance conditions are the conditions required for a character to appear in the virtual space. These conditions include altitude, weather, temperature, humidity, wind speed, terrain, and date and time. The success or failure of these conditions is determined by comparing them with the environmental information of the real world at the user P's current location, and the appearance conditions are considered to have been met only when all of these conditions are satisfied.

[0063] Environmental information includes at least one of the following as real-world information: altitude, weather, temperature, humidity, and wind speed. These are the elevation, current weather, current temperature, current humidity, and current wind speed at user P's current location, respectively.

[0064] Furthermore, environmental information includes topography as actual information from the real world. This topography is the relief or shape of the ground surface at the user P's current location. In this embodiment, the topography includes plains, forests, grasslands, deserts, rocky areas, mountains, hills, rivers, lakes, waterfalls, and the sea.

[0065] Furthermore, the environmental information includes the date and time as actual information from the real world. This date and time is the date and time at user P's current location.

[0066] The appearance method refers to the manner (method of appearance) of a character on the field map. For example, the appearance location and appearance action of a character within the appearance area on the field map are included in the appearance method.

[0067] The character's appearance location can be set to a location far from user P, a location that does not overlap with user P, or a specific location (such as in the sea, in a river, or in the air), as the location where the character will appear and inhabit.

[0068] A location far from user P is, for example, a location randomly selected from any location within the appearance area that is a predetermined distance away from user P (for example, a location with a radius of 1 km from user terminal device 3).

[0069] A location where user P does not exist is, for example, a randomly selected location within the appearance area that does not overlap with user P (for example, a location 2m away from user terminal device 3).

[0070] Thus, for "a position far from user P" and "a position that does not overlap with user P," it is sufficient to have multiple distance patterns set from user P (user terminal device 3).

[0071] The location in the sea (or river) is, for example, a randomly selected location within the spawn area, specifically one of the subsurface locations such as the sea on the field map.

[0072] The "air" refers to a location randomly selected from among several positions in the upper atmosphere (for example, 500m above ground) within the appearance area.

[0073] Appearance actions are the actions a character performs when it appears. For example, a character might stand still, surface, or fly and land.

[0074] Furthermore, the appearance animation can include changes in the character's facial expressions. For example, some characters may emerge from the water with an angry expression, while others may have a calm expression.

[0075] Furthermore, the appearance conditions for this embodiment described above are based on the ecosystem (settings) of virtual characters in existing video games, and are set assuming that this ecosystem (settings) is reproduced in real society. Therefore, the appearance conditions are defined so that a character appears when the actual environmental information in real society corresponds to the environmental settings in which virtual characters appear and inhabit existing video games.

[0076] Additionally, the user database 211 is stored in the memory unit 21.

[0077] User DB211 is a database that stores information about user P's games. For example, as shown in Figure 8, user data for each user P is stored in User DB211.

[0078] User data stores information such as user ID, location, orientation, environmental information, discovery history, play mode, and currently appearing characters. Of this information, location, orientation, environmental information, discovery history, play mode, and currently appearing characters can be changed sequentially based on user actions, progress in outdoor games, and actual weather changes in the real world.

[0079] The User ID is the account information (User ID) for user P in the game.

[0080] The location is the user P's current position in real space. For example, latitude and longitude information is used as the user's current location.

[0081] The orientation is the current orientation of user P. For example, the orientation / orientation information of VR goggles 4 is used as the user's orientation / orientation.

[0082] Environmental information refers to the environment at user P's current location and is used to determine the conditions for the appearance of the aforementioned characters. Environmental information includes, for example, altitude, weather, temperature, humidity, wind speed, terrain, date and time, etc.

[0083] The discovery history is a record of the characters discovered by user P (for example, character M in the example in Figure 5). The discovery history cumulatively stores, for example, the identification information of the discovered characters, associated with user P's identification information. This allows user P to view the characters they have discovered, for example, in their own character encyclopedia.

[0084] The Play Mode indicates the current game status. For example, if user P is playing VR mode, the Play Mode will be set to VR mode identification information (e.g., 01). If user P is not playing an outdoor game, the Play Mode will be set to non-play identification information (e.g., 00).

[0085] Appearing Characters is data used to control characters currently appearing on the field map. This data includes, for example, the character's identification information, its current position coordinates on the field map (world coordinate system), its orientation, and its current actions.

[0086] The network interface 22 is connected to the communication network 5 in order to send and receive data between the server device 2 and the user terminal device 3.

[0087] <Description of the functions of the control unit 20 of server device 2> The control unit 20 of the server device 2 functions as the following means and performs the following steps by executing the computer program of this disclosure.

[0088] <Explanation of information acquisition steps> The control unit 20 executes the information acquisition step by functioning as an information acquisition means. The following describes the processes performed by the control unit 20 as an information acquisition means.

[0089] The control unit 20 acquires location information of the real-world location where user P is located. Specifically, the control unit 20 periodically (for example, every 10 seconds) acquires location information from the user terminal device 3 based on the GPS (Global Positioning System) function provided by the user terminal device 3. In this embodiment, the case in which user P is carrying the user terminal device 3 is illustrated, and the current location of user P's user terminal device 3 is the current location of user P.

[0090] The control unit 20 acquires environmental information of the real-world space in which user P is located, in conjunction with obtaining user P's current location. Specifically, the control unit 20 acquires environmental information such as altitude, weather, temperature, humidity, wind speed, terrain, and date and time.

[0091] Weather, temperature, humidity, and wind speed are obtained, for example, from other server devices (not shown) that provide weather information, based on the user's current location; that is, weather information representing the actual weather, temperature, humidity, and wind speed at the user's current location.

[0092] Altitude and terrain information are obtained from the field map attribute information corresponding to the user P's current location. The field map data is generated, for example, by a SLAM (Simultaneous Localization and Mapping) method and stored in the storage unit 21. The data stored in this storage unit 21 also includes attribute information such as altitude and terrain in the field map. Since the SLAM method is a conventionally known technology, a detailed explanation will be omitted.

[0093] Furthermore, for example, server device 2 uses the clock function of user P's user terminal device 3 to obtain the date and time of user P's current location.

[0094] Furthermore, the control unit 20 updates the user data environment information with the newly acquired environment information.

[0095] <Explanation of display steps> The control unit 20 performs the display step by functioning as a display means. The following describes the processes performed by the control unit 20 as a display means.

[0096] The control unit 20 generates a spatial image (CG image) corresponding to the user P's current position in real space, as information (image generation information) for user P to view via the user terminal device 3. For example, information such as the position coordinates and orientation of the field map (world coordinate system) corresponding to user P's current position is generated. This image generation information is transmitted to the user terminal device 3.

[0097] <Explanation of the judgment step> The control unit 20 executes the determination step by functioning as a determination means. The following describes the processes performed by the control unit 20 as a determination means.

[0098] The control unit 20 determines whether the conditions, which include environmental information of user P's current location in real space, satisfy the appearance conditions for each character set in that area. For example, in the example in Figure 6, if user P's current location is area A, it is determined whether the appearance conditions for "character M" and "character O" are satisfied.

[0099] More specifically, the control unit 20 determines whether the environmental information of user P's current location satisfies the appearance conditions for each character set in that area. As shown in Figure 6, there may be multiple appearance conditions defined for each character, rather than just one.

[0100] In this case, the control unit 20 determines whether the environmental information of user P's current location applies to each of the conditions that constitute the appearance condition.

[0101] If the environmental information of user P's current location meets all of the individual conditions, the control unit 20 determines that the appearance conditions are met. On the other hand, if even one of the environmental information items of user P's current location does not meet any of the individual conditions, the control unit 20 determines that the appearance conditions are not met.

[0102] Furthermore, if there are multiple characters whose appearance area includes the current location of user P, the control unit 20 performs a determination for each character to determine whether the appearance conditions described above are met.

[0103] In this embodiment, the control unit 20 determines the appearance area and appearance conditions of character appearance data based on user data (location and environment).

[0104] <Description of control steps> The control unit 20 executes control steps by functioning as a control means. The following describes the processes performed by the control unit 20 as a control means.

[0105] If the conditions for a character's appearance are met, the control unit 20 generates information for overlaying the corresponding character onto the spatial image displayed on the user terminal device 3.

[0106] Specifically, the control unit 20 makes characters appear (places) on the field map if the appearance conditions are met, based on the appearance patterns of the character appearance data.

[0107] Furthermore, the control unit 20 controls the movement of the character that is appearing.

[0108] The control unit 20, for example, makes the appearing character act independently of the user. The control unit 20 makes the appearing character perform actions according to the elapsed time. Specifically, the character has actions pre-set to be performed at intervals of elapsed time, and the appearing character performs actions according to the elapsed time.

[0109] Furthermore, the control unit 20 makes the character move in response to user actions, for example. Specifically, if user P discovers a character that is currently appearing, the control unit 20 makes the character that is currently appearing notice user P and look at user P.

[0110] Furthermore, the control unit 20 updates the control information of the currently appearing character to the currently appearing character in the user data.

[0111] Furthermore, the control unit 20 includes information on the position and orientation of the appearing character in the image generation information and transmits it to the user terminal device 3.

[0112] Furthermore, when the conditions for a character's appearance are met, the control unit 20 generates information to notify the user terminal device 3 that the conditions for the appearance of that character have been met. For example, the text data "Character M has appeared." is displayed on the LCD screen of the user terminal device 3. This text data (notification information) is transmitted to the user terminal device 3 as image generation information.

[0113] Furthermore, the control unit 20 generates information for displaying an enlarged image of the character on the liquid crystal screen 340 based on user actions (for example, when an item such as a telescope is used in the game).

[0114] <Explanation of update steps> The control unit 20 executes the update step by functioning as an update means. The following describes the processes performed by the control unit 20 as an update means.

[0115] When a character that is currently appearing is displayed on the LCD screen 340, the control unit 20 updates the discovery history of the user data. As a result, for example, the character data of the discovered character will be displayed in the character encyclopedia associated with that user.

[0116] <Explanation of communication steps> The control unit 20 executes communication steps by functioning as a communication means. The following describes the processes performed by the control unit 20 as a communication means.

[0117] The control unit 20 transmits game data such as game programs and information regarding the progress of the game (for example, image generation information) to the user terminal device 3.

[0118] Furthermore, the control unit 20 receives user operation signals (for example, touch operation signals, posture change signals, etc.) from the user terminal device 3.

[0119] <Hardware configuration of user terminal device 3> As shown in Figure 1, the user terminal device 3 is a terminal device such as a smartphone, which has a built-in speaker 330, microphone 331, LCD screen 340, touchpad 350, and camera 360. On this user terminal device 3, the game progresses based on the game program and data related to the game distributed from the server device 2.

[0120] The user terminal device 3 can communicate data with the server device 2 via a communication network 5 such as the Internet or a LAN.

[0121] In this embodiment, as shown in Figure 3, the user terminal device 3 is used while attached to the VR goggles 4.

[0122] The user terminal device 3 comprises a control unit 30, a storage unit 31, a network interface 32, an audio processing unit 33, a graphics processing unit 34, an operation unit 35, an imaging unit 36, a satellite receiver 37, and a sensor unit 38.

[0123] The memory unit 31, network interface 32, audio processing unit 33, graphics processing unit 34, operation unit 35, imaging unit 36, satellite receiver 37, and sensor unit 38 are connected to the control unit 30 via the bus 39.

[0124] The control unit 30 consists of a CPU, memory (RAM), various input / output interfaces, etc., and controls the operation of the user terminal device 3.

[0125] The memory unit 31 mainly consists of an HDD, RAM, ROM, SSD, etc. The memory unit 31 stores game programs and data for running the game.

[0126] For example, the memory unit 31 stores data for generating a three-dimensional virtual space of the field map, model data for each character, and so on.

[0127] Furthermore, the memory unit 31 stores the user ID used by the server device 2.

[0128] The network interface 32 is connected to the communication network 5 to send and receive data between the user terminal device 3 and the server device 2. This allows the game program, game data, distribution application programs, and other data to be downloaded to the user terminal device 3.

[0129] The audio processing unit 33 plays and synthesizes digital game audio according to instructions from the control unit 30. A speaker 330 is also connected to the audio processing unit 33. Game audio is output from the speaker 330.

[0130] Furthermore, the audio processing unit 33 generates digital audio data (voice data) from the analog audio signal detected (recorded) by the microphone 331. For example, the audio processing unit 33 generates voice data when the user speaks.

[0131] The graphics processing unit 34 renders game images, including the virtual space of the field map and characters, in video format according to instructions from the control unit 30. The game images rendered in video format by the graphics processing unit 34 are displayed as the game screen on the LCD screen 340.

[0132] The graphics processing unit 34 provides the user with game images as three-dimensional images. For example, by detecting the tilt of the user terminal device 3 and assigning thickness to objects in the virtual space according to the direction the user is looking, stereoscopic vision can be provided.

[0133] The operation unit 35 receives operation signals from the user. In this embodiment, the operation unit 35 receives operation signals from the user P via the touchpad 350, which is an input position detection device. The user P performs operations such as using an item by touching the touchpad 350.

[0134] The imaging unit 36 ​​is connected to a camera 360, which includes an optical lens, a CCD image sensor (CCD), an imaging signal processing unit, etc., and generates captured image data. The imaging unit 36 ​​transmits the generated image data to the control unit 30.

[0135] The satellite receiver 37 receives radio signals from GPS satellites. As described later, the radio signals are used to determine the current location of user P (user terminal device 3).

[0136] The sensor unit 38 includes one or more sensors, such as a gyroscope, an accelerometer, and a geomagnetic sensor. These sensors allow the orientation of the user's head while wearing the VR goggles 4 to be determined from the detection signals.

[0137] <Description of the functions of the user terminal device's control unit> The control unit 30 functions as the following means and performs the following steps by executing the game program downloaded from the server device 2.

[0138] <Explanation of location identification steps> The control unit 30 performs the positioning step by functioning as a positioning means. The following describes the processes performed by the control unit 30 as a positioning means.

[0139] The control unit 30 determines the current location of the user terminal device 3. The control unit 30 determines the current location of user P (e.g., latitude, longitude, altitude) using, for example, information from radio signals received from GPS satellites (GPS information). The information of user P's current location is transmitted to the server device 20. Note that determining the current location using GPS functionality is a common configuration, so a detailed explanation is omitted.

[0140] <Explanation of posture identification steps> The control unit 30 performs the attitude identification step by functioning as an attitude identification means. The following describes the processes performed by the control unit 30 as an attitude identification means.

[0141] The control unit 30 identifies the current orientation of user P (user terminal device 3). The control unit 30 identifies the orientation of user P's head, who is wearing the VR goggles 4, using, for example, a detection signal received from the sensor unit 38. The current orientation information is transmitted to the server device 2. Note that the identification of orientation using a gyro sensor is a common configuration, so a detailed explanation is omitted.

[0142] <Explanation of execution steps> The control unit 30 executes execution steps by functioning as a game execution means. The following describes the processes performed by the control unit 30 as a game execution means.

[0143] The control unit 30 advances the game based on user P's actions and information transmitted from the control unit 20 of the server device 2 (for example, image generation information).

[0144] Furthermore, the control unit 30 uses the image generation information received from the server device 2 to generate information for displaying the field map as a game screen on the liquid crystal screen 340. According to this information, the graphics processing unit 34 draws the game image on the liquid crystal screen 340. The control unit 30 also outputs audio from the speaker 330 according to the audio information.

[0145] <Explanation of communication steps> The control unit 30 executes a communication step by functioning as a communication means. Hereinafter, the processing executed by the control unit 30 as a communication means will be described.

[0146] The control unit 30 receives, for example, information such as a game program related to the game and image generation information from the server device 2.

[0147] Also, the control unit 30 transmits, for example, the identification information (user ID) of the user P, download request information for new game data, an item use request, etc. to the server device 2 based on the operation of the user P.

[0148] <Hardware Configuration of VR Headset 4> As shown in FIG. 3, the VR headset 4 includes a holding unit 41 and a headband 42. The VR headset 4 is worn on the head of the user P with the holding unit 41 covering both eyes of the user.

[0149] The holding unit 41 is a goggle-shaped housing that holds the user terminal device 3 inside. Specifically, the user terminal device 3 is held by the holding unit 41 so that the liquid crystal screen 340 faces both eyes of the user P when the VR headset 4 is worn on the head of the user P.

[0150] The headband 42 is for enabling the VR headset 4 to be attached to and detached from the head of the user P, and fixes the VR headset 4 (holding unit 41) to the head of the user P.

[0151] Note that when the VR headset 4 is worn on the head, since the user terminal device 3 is covered by the holding unit 41, the user P cannot operate the touch pad 350 with a finger. Therefore, when the user P operates the touch pad 350, the user P removes the VR headset 4 from the head, and after the operation of the touch pad 350 is completed, wears the VR headset 4 on the head again.

[0152] <Explanation of Search Processing> The search process of this disclosure will be described below with reference to Figure 9. In this embodiment, the search process in VR mode by user P will be described.

[0153] First, the control unit 20 of the server device 2 acquires various types of information (location information, environmental information, etc.) (step S11).

[0154] Specifically, the user terminal device 3 transmits the user P's current location and orientation (direction) to the server device 2. In addition, environmental information of the real-world space where the user is located is obtained from other server devices, such as those providing weather information, based on the user P's current location.

[0155] Next, the control unit 20 of the server device 2 instructs the user terminal device 3 of user P to display a game screen (a spatial image corresponding to user P's current location) based on user P's current location (including audio output) (step S12).

[0156] Next, the control unit 20 of the server device 2 determines whether the conditions for character appearance are met (step S13). At this time, the appearance conditions for each character whose appearance area is set to the area where the user is located are determined.

[0157] If no character meets the appearance conditions (S13:NO), the process returns to step S11.

[0158] If there is a character whose appearance conditions are met (S13: YES), the control unit 20 of the server device 2 executes the appearance process for the character whose appearance conditions are met (step S14). In this case, the character whose appearance conditions are met appears on the field map (appearance area) via the VR of the user terminal device 3 according to the appearance pattern set for that character.

[0159] Next, the control unit 20 of the server device 2 executes the action processing for the appearing character (step S15). In this case, information is generated for the character to perform actions such as surfacing or flying.

[0160] Next, the control unit 20 of the server device 2 instructs user P (user terminal device 3) to display a character on the game screen (including sound output) according to the operation process (step S16). In this case, using the image generation information, sound data, etc. transmitted from the server device 2, a game screen like the one in Figure 5 is displayed on the LCD screen 340 of the user terminal device 3. If the image generation information includes notification information, a message indicating that a character has appeared is displayed on the game screen.

[0161] Next, the control unit 20 of the server device 2 updates the history of characters discovered by user P (step S17). In this case, the character identification information is added to the discovery history of the user data. Based on the above, the search process of this disclosure is executed.

[0162] In summary, this disclosure is: A computer program that causes server device 2 to perform the following steps: In the display step, information is generated for user P to view a spatial image corresponding to user P's current position in real space through the VR goggles 4. In the determination step, it is determined whether the condition that the environmental information of user P's current location in real space is included satisfies the character appearance conditions. In the control step, if the appearance conditions for any character are met, information is generated to overlay the character onto the spatial image displayed on the VR goggles 4. It is a computer program.

[0163] <Effects> According to this embodiment, a character that meets the appearance conditions, such as the weather in the real world where the user is located, appears in front of the user on the VR game screen.

[0164] Therefore, it is possible to prevent a discrepancy between the image of the real world in which the user is located and the image of the virtual world in which the character is expected to exist in existing video games, thereby further merging the real world and the virtual world.

[0165] Furthermore, by using this disclosure in areas such as towns, villages, remote islands, and facilities such as shopping malls, it becomes possible to create virtual objects in virtual space that are appropriate for those areas and facilities, thereby contributing to regional revitalization or attracting customers (increasing sales).

[0166] [Second Embodiment] The game system 1 according to the second embodiment of this disclosure has the same configuration as the first embodiment described above, and comprises a server device 2, a user terminal device 3, and VR goggles 4.

[0167] Since Game System 1 is basically configured the same as the first embodiment described above, the following description will mainly focus on the configurations that differ from the first embodiment.

[0168] <Game Description> In this embodiment, the server device 2 provides an outdoor game to be run on the user terminal device 3. Specifically, a VR mode (hereinafter referred to as "cooperative mode") of the outdoor game is provided.

[0169] In this embodiment, unlike the first embodiment described above, the cooperative mode is one in which the field map (3D virtual space) is shared among multiple users, and the game progresses through the cooperation of multiple users.

[0170] In other words, in this cooperative mode, multiple users work together to explore a virtual character on an island. For example, in cooperative mode, users can choose to play either the role of an explorer or an assistant (a related user with a predetermined relationship to the explorer user).

[0171] User P1, who is the explorer, performs the exploration while wearing VR goggles 4, similar to the first embodiment described above.

[0172] Furthermore, User P2, acting as an assistant, provides User P1 with information and other resources to help ensure that the conditions for character appearance are met, thereby assisting User P1.

[0173] In this embodiment, user P2, like user P1, runs the game while wearing VR goggles 4. However, since the same game screen is presented to user P2 as to user P1, user P2 does not need to move to explore and can remain in one place.

[0174] Related users who have a predetermined relationship with the investigator's user are, for example, users who are registered as friends. The investigator's user can also designate other users who do not have a predetermined relationship with the investigator's user as assistants.

[0175] The following describes the case where user P1 and user P2 play in cooperative mode.

[0176] In this embodiment as well, as shown in Figure 10, the search is performed in a three-dimensional field map (three-dimensional virtual space) of an island IL in real space, similar to the first embodiment described above.

[0177] User P1 explores the island while moving around the island. Meanwhile, User P2 stays inside the tent and provides advice to User P1.

[0178] For example, User P2 can advise User P1 on the direction User P1 should go, such as "Go a little further east!". User P2 can also advise User P1 on the distance User P1 should walk, such as "Walk another 500 meters!". Furthermore, User P2 can advise User P1 on hints to help them meet the conditions for appearance, such as "Wait there for another 20 minutes!".

[0179] On the LCD screen 340 of user P1's user terminal device 3, a CG image of a field map that reproduces the actual terrain of Island IL is displayed as a game screen, similar to the first embodiment described above (see Figure 4).

[0180] Furthermore, as mentioned above, the LCD screen 340 of user P2's user terminal device 3 also displays the same game screen as user P1, regardless of user P2's current location. In other words, an image of the field map corresponding to the real space included in user P1's field of view is presented to user P2 as the game screen.

[0181] This allows user P2 to feel as if they are in the same location as user P1 through VR goggles 4, even while remaining inside the tent.

[0182] Furthermore, user P1 and user P2 can engage in voice chat (voice call) via their respective user terminal devices 3 (microphone 331).

[0183] Therefore, user P2 can, for example, observe the game screen and give advice to user P1 that takes into account the environment surrounding user P1. For example, user P2 can advise user P1 via voice chat, for instance, to make character M appear, saying something like, "Move further south."

[0184] However, user P2 doesn't always need to give advice; for example, they can leave the exploration to user P1 and take other actions until a character appears.

[0185] In cooperative mode, the conditions for character appearance are determined based on the environmental conditions of the real-world space where user P1 is located. Since user P2 does not move, user P2's current location and environmental information do not need to be used.

[0186] Then, as shown in Figure 5, if a character (for example, character M) is displayed on user P1's game screen, the character (character M) will also be displayed on user P2's game screen.

[0187] <Hardware Configuration> The following describes only the differences or noteworthy points regarding the hardware and functional configuration of the server device 2 in this embodiment, and the hardware and functional configuration of the user terminal device 3 (VR goggles 4) on which the outdoor game is executed. The illustration of the hardware configuration is omitted.

[0188] <Server hardware configuration> As shown in Figure 11, the storage unit 21 (user DB 211) of the server device 2 stores user data for each user.

[0189] In this embodiment, the play mode is set to VR Collaboration, VR Support, and Collaborative User ID.

[0190] VR Co-op Explorer is identification information that identifies the explorer in cooperative mode. VR Co-op Assistant is identification information that identifies the assistant in cooperative mode.

[0191] The co-op user ID will be set to the user ID of the user playing co-op mode together.

[0192] For example, in the example shown in Figure 11, the play mode for user P1 (user ID: U-00001) is set to VR Cooperative, and the user ID (cooperative user ID) of the assistant user P2 (user ID: U-00003) is also set.

[0193] Furthermore, for example, the play mode for user P2 (user ID: U-00003) is set to be VR cooperating, and the user ID (cooperating user ID) of user P1 (user ID: U-00001), who is an explorer, is also set.

[0194] <Description of the functions of the control unit 20 of server device 2> The following describes only the differences or noteworthy points regarding the means by which the control unit 20 of the server device 2 functions, as described in the first embodiment.

[0195] <Explanation of information acquisition steps> In this embodiment, the control unit 20, which serves as an information acquisition means, acquires location information and environmental information of the real space where user P1 is located.

[0196] Furthermore, the control unit 20 acquires voice data of speech uttered by users P1 and P2. Specifically, the control unit 20 acquires voice data from the user terminal devices 3 of users P1 and P2 via the communication network 5.

[0197] Furthermore, the control unit 20 transmits the voice data acquired by user P1 (user P2)'s user terminal device 3 to user P2 (user P1)'s user terminal device 3.

[0198] <Explanation of display steps> The control unit 20, which serves as a display means in this embodiment, generates image generation information for viewing a spatial image corresponding to the user P1's current position in real space.

[0199] Furthermore, the control unit 20 transmits the image generation information to the user terminal devices 3 of users P1 and P2, respectively.

[0200] <Explanation of the judgment step> The control unit 20, which serves as the determination means in this embodiment, determines whether or not the conditions for character appearance are met at the current location of user P1.

[0201] <Description of control steps> In this embodiment, the control unit 20, as a control means, controls the operation of a character by making that character appear on the field map when the appearance conditions for the character are met at the current position of user P1, until the appearance conditions are no longer met.

[0202] Furthermore, the control unit 20 stores information about the currently appearing character as the currently appearing character control data in the user data of user P1.

[0203] Furthermore, the control unit 20 includes information on the position and orientation of the appearing character in the image generation information and transmits it to the user terminal device 3.

[0204] Furthermore, the control unit 20 transmits notification information such as "A character has appeared" as image generation information to the user terminal devices 3 of users P1 and P2.

[0205] <Description of the functions of the control unit 30 of the user terminal device 3> In the following, only the differences or noteworthy points regarding the control unit 30 of the user terminal device 3 compared to the first embodiment will be described.

[0206] <Explanation of location identification steps> In this embodiment, the control unit 30, which serves as a position acquisition means, transmits information about the current location of user P1 to the server device 2.

[0207] <Explanation of posture identification steps> In this embodiment, the control unit 30, which serves as the posture identification means, transmits information about the current posture of user P1 to the server device 2.

[0208] <Description of generation steps> The control unit 30 of the user terminal device 3 for users P1 and P2 executes the generation step by functioning as a generation means. The following describes the processing performed by the control unit 30 as a generation means.

[0209] The control unit 30 generates audio data from the analog audio signal detected (collected) by the microphone 331. This audio data is transmitted to the server device 2.

[0210] <Explanation of the search process> The search process of the present invention will be described below with reference to Figure 12. In this embodiment, the search process in cooperative mode by user P1 and user P2 will be described.

[0211] First, the control unit 20 of the server device 2 acquires (updates) various types of information (step S21).

[0212] Specifically, the current location and orientation (orientation) of user P1, as well as voice information of users P1 and P2, are transmitted from the user terminal device 3. In addition, based on user P1's current location, environmental information of the real space in which user P1 is located is obtained from other server devices that provide weather information.

[0213] Next, the control unit 20 of the server device 2 issues an instruction to each user terminal device 3 of users P1 and P2 to display a game screen (including audio output) based on user P1's current location (step S22). In this case, the control unit 20 also outputs audio data of the spoken voices of users P1 and P2 to the user terminal devices 3.

[0214] Next, the control unit 20 of the server device 2 determines whether the character appearance conditions are met for user P1 (step S23). In this case, the success or failure of the appearance conditions for each character, for which the area where user P1 is located is set as the appearance area, is determined.

[0215] If it is determined that the conditions for the character's appearance are not met (S23: NO), the process returns to step S21.

[0216] On the other hand, if the conditions for a character's appearance are met (S23: YES), the control unit 20 of the server device 2 executes the appearance process for the character whose appearance conditions are met (step S24). In this case, depending on the appearance pattern, the character whose appearance conditions are met appears on the field map (appearance area).

[0217] Next, the control unit 20 of the server device 2 executes the operation processing of the appearing character (step S25).

[0218] Next, the control unit 20 of the server device 2 issues instructions to the user terminal device 3 of user P1 and the user terminal device 3 of user P2 to display the field map game screen (including audio output) based on the operation process (step S26). In this case, the control unit 20 also outputs audio data of the spoken voices of users P1 and P2.

[0219] Next, the control unit 20 of the server device 2 updates the history of characters discovered by user P1 (step S27). In this case, the character data is added to the discovery history (character encyclopedia) of each user data for users P1 and P2. The search process of this disclosure is performed by following the steps described above.

[0220] <Effects> The computer program of this embodiment can achieve the same effects as those of the first embodiment described above.

[0221] Furthermore, this example shows that the explorer (user P1) can cooperate with other users to search for characters, with assistance from the assistant (user P2). In addition, user P2, who is not actively searching, can still see the characters that appear and enjoy the game together with user P1.

[0222] [Other embodiments] In the above embodiment, an example is described in which the user removes the VR goggles from their head and operates on the touchpad, but the user may also operate while wearing the VR goggles on their head.

[0223] Specifically, the user only needs to be able to operate a controller connected to the user terminal device via short-range wireless communication (e.g., Bluetooth®). In this case, the control screen is displayed on the LCD screen of the user terminal device, overlaid on the game screen.

[0224] In the above embodiment, a CG image corresponding to the real space is displayed as the game screen, but this disclosure is not limited thereto. For example, a game screen may be displayed in which a character (CG image) is superimposed on an image of the real space (captured image) (AR mode).

[0225] In this case, the game screen is generated by combining an image of the real world captured using the user terminal's camera with a character.

[0226] Furthermore, if both VR mode and AR mode are provided, the user may be able to switch between VR mode and AR mode based on their actions.

[0227] Furthermore, if AR mode is selected, the user does not need to wear VR goggles. In this case, the user can move around while holding the user terminal device in their hand.

[0228] Furthermore, when AR mode is selected, users can use smart glasses instead of VR goggles. In this case, users can view the actual real world through the lenses of the smart glasses, and characters are displayed on the lenses of the smart glasses.

[0229] In the above embodiment, the occurrence conditions include multiple conditions, and if all conditions are not met, the occurrence conditions are not met; however, this disclosure is not limited thereto.

[0230] For example, if the appearance conditions include multiple conditions, there may be a condition that must be absolutely satisfied among those conditions, and if that absolutely satisfied condition is met, the character may appear even if the other conditions are not met (for example, whether or not the character appears may be determined by a lottery).

[0231] Furthermore, if the appearance conditions include multiple factors, the user may be able to understand these conditions, for example, by displaying them on the game screen. In this case, the user may be able to select which of the multiple conditions must be met.

[0232] In the above embodiment, the appearance conditions are fixed, but they may vary. For example, appearance conditions may be added or removed depending on various factors (e.g., the progress of the existing video game, the completeness of the discovery history, etc.).

[0233] In the above embodiment, the appearance conditions differ for each type of character, but this disclosure is not limited thereto.

[0234] For example, characters may be classified into specific categories, and appearance conditions may be set for each category. Categories could include, for instance, characters that can fly, characters that can move underwater, character rarity, strength, etc.

[0235] Furthermore, for example, common appearance conditions may be set for all characters. And only characters whose appearance conditions are met may appear.

[0236] Furthermore, if the appearance conditions for multiple characters are met, the following can be done:

[0237] For example, all characters that meet the appearance conditions may appear, or the characters that appear may be determined by lottery from among the characters that meet the appearance conditions, or characters that the user has not yet seen (or has seen few times) from among the characters that meet the appearance conditions may be given priority for appearance, or characters selected by the user from among the characters that meet the appearance conditions may appear.

[0238] Furthermore, there may be a limit on the number of characters that can appear in a single appearance area at one time. If the number of characters that can appear exceeds the limit, the characters that appear should be determined by lottery, priority, user selection, etc., as described above.

[0239] Furthermore, the appearance conditions do not necessarily have to reflect the ecosystem (settings) of virtual characters in existing video games, as long as at least environmental conditions are included.

[0240] For example, in addition to environmental conditions, the appearance conditions may also include conditions related to the results of playing mini-games (game content) provided during the outdoor game. Specifically, the appearance conditions may be met when the user plays a mini-game and reaches predetermined conditions.

[0241] The predetermined conditions may include, for example, fulfilling the clear conditions of a mini-game, reaching a predetermined level during the mini-game, possessing, equipping, or using a virtual special item during the mini-game, or having a key character (a specific character) talk to the target character during the mini-game. All of these conditions may be met, any one of them may be met, or a combination of several may be the predetermined conditions.

[0242] Alternatively, the appearance conditions may be met, for example, when a predetermined relationship is established between the character and the user.

[0243] The predetermined relationship includes the character and the user having a predetermined positional relationship and / or a predetermined behavioral relationship.

[0244] The positional relationship means that the user's position in real space and the position in real space defined as the character's appearance location have a specific, defined relationship.

[0245] For example, a predetermined positional relationship might include the character and the user being within a specified distance, such as within 500m or 1km, or the user being located northeast of the character and within 100m of it.

[0246] The behavioral relationship means that the actions taken by the user in the real world and the behavioral actions of the virtual object upon its appearance are in a defined, specific relationship.

[0247] For example, one predetermined action relationship is when the character and the user are facing each other. In this case, it is determined whether the character and the user are in the predetermined action relationship based on, for example, the orientation of the character on the field map and the orientation of the user (or the orientation of the VR goggles).

[0248] In addition, for example, a state in which the actions of both the character and the user are synchronized constitutes a predetermined operational relationship.

[0249] Furthermore, the appearance conditions may include, for example, the use of an item acquired by the user within the outdoor game at a designated location in the real world. Specifically, after the user acquires an item within the outdoor game, the user moves to a designated location in the real world. Then, the user accesses the outdoor game at the designated location and uses the item acquired within the game. For example, the appearance condition is met when the user uses the acquired item, "tree sap," within the outdoor game (applies it to the surface of a tree) at a specific location in the real world where a tree is located.

[0250] In this case, the game screen displays virtual beetle objects gathering around the sap (applied area).

[0251] Furthermore, the conditions for appearance are not limited to weather, altitude, topography, date and time, as in the above embodiment.

[0252] The appearance conditions can also be conditions related to other users in the vicinity of a given location. For example, appearance conditions could include the absence of other users in the vicinity of the user's current location, or the presence of a predetermined number of other users in the vicinity of the user's current location.

[0253] Furthermore, the conditions for appearance can also be based on the user's heart rate, blood oxygen saturation, step count, and activity log. For example, the condition for appearance could be that the user's heart rate is below a predetermined value.

[0254] Furthermore, measurements such as heart rate can be obtained from, for example, a smartwatch worn by the user.

[0255] Furthermore, while the above embodiment describes an example in which the appearance conditions are determined based on the user's current location, this disclosure is not limited thereto.

[0256] For example, in the above embodiment, regardless of the user's current position, the appearance condition may be determined based on a specific position in the real space corresponding to each appearance area (for example, the mountaintop). In this case, no matter where the user is on the island, if the appearance condition is satisfied at the specific position, the character will appear.

[0257] In the above example, when the environmental information is included in the appearance condition, the environmental information can be applied, for example, to the environmental information of the real space corresponding to the position where the character appears, the environmental information of the real space corresponding to the appearance area, or the environmental information of the real space (for example, the entire island in the real space) corresponding to the field map (3D virtual space).

[0258] Also, when a character appears in an appearance area away from the user, the user can visually recognize the character by moving to the appearance area or using an item such as a telescope.

[0259] In addition, in the above embodiment, an example is described in which a character is placed on the field map when the appearance condition of the character is satisfied. However, the character can also be made to appear on the field map without determining the appearance condition.

[0260] Furthermore, in addition to the character with the appearance condition set, there may be another character without the appearance condition set. In this case, the character without the appearance condition set always exists on the field map and is displayed on the game screen. In this case, the problem that the user cannot find any character can be prevented.

[0261] In the above embodiment, the user is notified that the character has appeared by the display on the liquid crystal screen. However, for example, the notification may be made by voice output.

[0262] In the above embodiment, a virtual character appears as a virtual object, but any type of object may be used as long as it is a virtual object.

[0263] For example, the virtual object may be an object other than a character, such as an item. If the virtual object is a ghost object, the present invention can also be applied to haunted houses in theme parks, etc.

[0264] Furthermore, for example, the virtual object could be a fireworks object. For instance, if all of the following conditions are met—that there are 100 or more other users around the user, that the time is between 6 PM and 8 PM, that the weather is clear, and that the wind speed is between 0 and 5 km / s—the fireworks object will appear in the virtual space.

[0265] Furthermore, the invention is not limited to the second embodiment, and a tent with an assistant user present may be used as a screen through projection mapping, holograms, or the like.

[0266] In the above embodiment, an example is described in which, when a user discovers a character, that character is recorded in the history. However, when a user discovers a character, an event related to that character may be executed.

[0267] In this case, for example, a character discovered by a user could be played against by the user who discovered it. In this case, the user could view the character through VR goggles and play against a character the same size as in the game in a virtual space.

[0268] In the example above, the user may recruit a character as a companion by defeating the character they discovered in battle, or by interacting with the character. Furthermore, if the user has recruited this character, an event (special event) related to that character may occur.

[0269] Furthermore, the event may take place in an outdoor game or within another video game.

[0270] The following are examples of events in other video games. For example, the other video game could be an existing original game in which a character appears. In this case, the event is that a character discovered by the user in an outdoor game appears in the other video game, and the user (player character) is tasked with defeating that character.

[0271] For example, if a user acting as an explorer discovers a character, that character may appear as an enemy character in a video game running on the user terminal of a user acting as an assistant. In this case, the assistant user may be able to defeat the character in that video game.

[0272] In this case, the server device, for example, displays the character's authorization code on the user terminal device when the user discovers the character in an outdoor game.

[0273] By entering an authorization code when playing other video games, users will be able to perform the aforementioned subjugation event in those other video games.

[0274] The above is not limited to the above, and for example, an outdoor game account (user ID) and an account (user ID) with another video game may be linked based on user actions or automatically. In this case, an authorization code is sent from the outdoor game server to the other video game server, provided that the user has found their character.

[0275] Furthermore, if a character that appears in the above embodiment is found to be missing from the field map (virtual space), it will disappear (or be hidden). The disappearance condition is, for example, that the character is discovered by the user.

[0276] Also, the disappearance condition may be, for example, that after the appearance condition is satisfied, the appearance condition of the character in appearance is no longer satisfied. In this case, for example, the character in appearance disappears after performing an operation such that the character in appearance moves away from (runs away from) the user.

[0277] Also, when the character in appearance disappears, this fact may be notified to the user. Specifically, a text message saying "The character has left" is displayed on the liquid crystal screen of the user terminal device.

[0278] Also, in the cooperation mode of the second embodiment, although the case of one explorer and one assistant has been described, a plurality of assistants may be set for one explorer, or one assistant may assist a plurality of explorers.

[0279] Also, in the cooperation mode of the second embodiment, an example where the explorer and the assistant are on the same island is described, but the assistant may be in a place far away from the explorer.

[0280] Also, in the cooperation mode of the second embodiment, the user of the assistant may be able to confirm the appearance condition on the liquid crystal screen of his or her own user terminal device.

[0281] For example, the appearance condition is displayed by making a display request based on the operation of the assistant. Specifically, the contents of "Character", "Appearance Area", and "Appearance Condition" in the character appearance data of FIG. 6 are displayed on the user terminal device (liquid crystal screen) of the user of the assistant.

[0282] Thereby, the assistant can give advice to the explorer after grasping the appearance condition of each character, and can give more accurate advice to the explorer.

[0283] Furthermore, the user of the explorer may also be able to understand the appearance conditions in the same way as the assistant. Similarly, the user of the explorer in the first embodiment may also be able to understand the appearance conditions.

[0284] In the first and second embodiments described above, a mini-game may be provided to the user while they are exploring. By playing this mini-game to pass the time, the user's motivation may decrease due to having to wait for characters to appear.

[0285] As mini-games, for example, the following "gathering games," "errand quests," and "sightseeing tour quests" may be offered, utilizing the terrain of the real-world space where the user is located. These mini-games are executed when the user is in a specific area, for example, when the user chooses to play these mini-games, or when they win a lottery.

[0286] For example, the gathering game "Let's Gather Nuts!" (Gathering Game A) is played in a forest or similar location. In Gathering Game A, whether or not the clear conditions are met is determined by whether the user gathers nuts in the real world.

[0287] While the user is playing the gathering game A, the user can see real-world nuts and berries on the game screen, for example, in AR mode.

[0288] Additionally, while the user is playing gathering game A, events can occur that surprise the user, such as characters that are not part of the exploration target appearing.

[0289] In this gathering game A, for example, whether or not a berry has been collected is determined by whether or not an image of the berry being held in the user's hand is displayed on the game screen.

[0290] In addition, the gathering game "Let's Gather Strawberries!" (Gathering Game B) is held at locations such as strawberry farms. Users complete the game by actually picking strawberries in a real-world space (strawberry picking).

[0291] While the user is playing the harvesting game B, the user can see actual strawberries in the real world, for example, on the game screen in AR mode.

[0292] Furthermore, if both the user and another user attempt to pick the same strawberry simultaneously while the user is playing the gathering game B, an event can be triggered where a virtual bee object (a character that is not the target of the search) is displayed superimposed on the strawberry. This creates a gameplay element that makes the user hesitate before picking the strawberry.

[0293] The errand quest "Let's pick up trash!" is offered in locations such as beaches. In this errand quest, the user completes the quest by picking up a specified number of real-world pieces of trash.

[0294] While the user is playing a errand quest, they can see actual trash in the real world on the game screen in AR mode.

[0295] Furthermore, in this case, a virtual object of treasure may be overlaid on the display area of ​​the real-world trash. In this case, the user can use the collected treasure in the outdoor game.

[0296] The "Meet 3 Specific Individuals and Gather Information!" tour quest is conducted, for example, when you win a lottery. In this tour quest, the user completes the quest by meeting three specific individuals and gathering information.

[0297] While a user is playing a guided tour quest, they can perceive the real world on the game screen, for example, in AR mode.

[0298] At this time, an arrow object is displayed overlaid on the game screen. The user can meet specific people in order by moving in the direction indicated by this arrow object.

[0299] Furthermore, if a specific character appears on the game screen, that character will, for example, provide the user with information about the character.

[0300] Furthermore, the "specified person" may be a real person. In this case, it is sufficient for facial recognition technology or similar to determine whether the person displayed on the game screen is the specified person. If the person displayed on the game screen is the specified person, the necessary information will be displayed on the game screen.

[0301] Furthermore, although the above embodiments describe an example in which the computer device is a server device, the present invention is not limited to this. For example, a single user's game device may function as a server device.

[0302] Furthermore, although the above embodiments describe the game device as a terminal device such as a smartphone, the present invention is not limited thereto. The game device may be, for example, a stationary game device with an externally connected display and controller, or a personal computer. [Explanation of Symbols]

[0303] 1. Game System 2 Server devices 3. User terminal device 4 VR goggles 5. Communication Network

Claims

1. A computer program that causes a computer to perform the following steps: In the display step, information is generated for the user to view a spatial image of a virtual space corresponding to a predetermined location in real space via a terminal device. In the determination step, it is determined whether the condition that environmental information of a predetermined location in real space is included at least satisfies the predetermined appearance conditions. The aforementioned appearance condition includes a predetermined relationship between the virtual object and the user, In the control step, If the aforementioned appearance conditions are met, The terminal device generates information for overlaying the virtual object onto the spatial image displayed on the terminal device, and The placement position of the virtual object is determined by the parameters of the virtual object, or the positional relationship between the virtual object and the user. In the receiving step, at least information relating to the appearance conditions is received from another terminal operated by a user other than the aforementioned user. Computer program.

2. The appearance conditions are the weather conditions at the predetermined location and / or the conditions relating to surrounding users present around the predetermined location. The computer program according to claim 1.

3. A computer program that causes a computer to perform the next step, In the information acquisition step, location information of the real world where the user is located is acquired. The predetermined position is the user's location in real space. The computer program according to claim 1 or 2.

4. The aforementioned predetermined relationship is that it becomes a predetermined positional relationship and / or a predetermined operational relationship. The computer program according to claim 1.

5. The aforementioned virtual object is an object controlled by the game, The appearance conditions are conditions related to the characteristics of the virtual object within the game. A computer program according to any one of claims 1 to 4.

6. In the control step, the terminal device is made to execute the game content that the user is to play. The aforementioned appearance conditions include conditions relating to the game content play results, A computer program according to any one of claims 1 to 5.

7. In the control step, if the appearance condition is met, information is generated to notify the terminal device that the appearance condition has been met. A computer program according to any one of claims 1 to 6.

8. A computer program that causes a computer to perform the next step, In the communication step, information transmitted from a related device operated by a user other than the aforementioned user is transmitted to the terminal device. The transmitted information is information that helps to ensure the conditions for occurrence are met. A computer program according to any one of claims 1 to 7.

9. In the aforementioned communication step, information for displaying the same image as the one displayed on the terminal device is transmitted to the associated device. The computer program according to claim 8.

10. The aforementioned virtual object is an object controlled by the game, In the control step, when the virtual object is displayed on the user's terminal device, setting information regarding the virtual object in the game is generated. A computer program according to any one of claims 1 to 9.

11. A storage unit for storing a computer program according to any one of claims 1 to 10, A control unit that executes the aforementioned computer program, Equipped with, Computer device.