Program, method, and information processing device

Abstract

To provide a technology to further enhance memories of a user who has participated in an event.SOLUTION: There is provided a program for operating a computer for supporting progress of an event for a user to search for an object to be discovered installed in a fixed space in a real world. The program causes a processor of the computer to execute a step for receiving, by the user, an input operation according to a progress status of a task of the event for a terminal that the user operates, and a step for presenting, to the user, a result of progressing the task of the event by the user according to the end of the event.SELECTED DRAWING: Figure 18

Description

[Technical field]

[0001] The present disclosure relates to a program, a method, and an information processing device. [Background technology]

[0002] 2. Description of the Related Art Techniques for photographing passengers on attractions at theme parks and other facilities are known.

[0003] Patent Document 1 describes a technology in which, at a facility such as a theme park, an image is taken of the moment when a passenger boards an attraction such as a roller coaster, the coaster drops, an image of the passenger is extracted from the image, and an image is provided that is synthesized with a template. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2004-228637 A Summary of the Invention [Problem to be solved by the invention]

[0005] In the technology of Patent Document 1, passengers are automatically moved along a predetermined route, such as a roller coaster, and the passengers are photographed by a camera that photographs a predetermined position on the route. On the other hand, in the real world, there are events in which multiple users participate and each user freely explores within a geographical area that is somewhat fixed. In such exploration-type events, even if cameras are installed in advance within the geographical area to be explored, the number of cameras that need to be installed increases as the geographical area becomes larger, and the event operation costs increase, which may make it difficult to continue operating the event. Therefore, there is a need for technology that can further enhance the memories of users who participate in exploration-type events. [Means for solving the problem]

[0006] According to one embodiment, a program is provided for operating a computer to assist in the progress of an event in which a user searches for discovery objects placed within a certain space in the real world, the program causing a processor of the computer to execute the steps of accepting input operations by a user on a terminal operated by the user in accordance with the progress of the event task, and presenting to the user the results of the user's progress in the event task upon completion of the event. Effect of the Invention

[0007] According to the present disclosure, it is possible to provide a technology that further enhances the memories of users who participate in a search-type event. [Brief description of the drawings]

[0008] [Figure 1] FIG. 2 is a block diagram showing the overall configuration of the system 1. [Diagram 2] FIG. 2 is a diagram showing a functional configuration of a terminal device 10. [Diagram 3] FIG. 2 is a diagram showing the functional configuration of a server 20. [Figure 4] 1 shows the data structure of an event information database (DB) and a participant information DB stored in the storage unit of the server 20. [Diagram 5] 1 shows data structures of an object information DB, a hint information DB, and an event history DB stored in a storage unit of the server 20. [Figure 6] A flowchart showing a process in which some of a plurality of users capture images of other users working on tasks in an event, and in response to the plurality of users progressing through the event, content that extracts a portion of the first image is provided to the plurality of users. [Figure 7]A flowchart showing a process of obtaining images taken by some of a plurality of users of other users working on tasks in an event, determining the degree of progress of the event based on recognition of discovery objects contained in the captured images, and providing content extracted from a portion of the first image to the plurality of users in response to the plurality of users progressing through the event. [Figure 8] FIG. 1 is an overview of events provided by system 1. [Figure 9] 13 is a screen example showing an image captured by some of a plurality of users of another user working on a task in an event. [Figure 10] 13 is a screen example when an approval operation for a found object is performed. [Figure 11] 13 is an example of a screen displayed on a terminal used by a user when a time limit has expired in an event. [Figure 12] 13 is an example screen displayed when a hint as to where to place a discovery object is presented to a user in an image taken by some of a plurality of users of other users working on a task in an event. [Figure 13] This is a flowchart showing a process in which a camera equipped with a discovery object is used to obtain photographic images of a user within a certain space during a period in which the user is participating in an event and searching for the discovery object, and the obtained photographic images are provided to the user according to the progress of the event. [Figure 14] This is a flowchart showing a process in which a camera equipped with a discovery object is used to capture images of users within a certain space during a period in which users are participating in an event and searching for the discovery object, and images captured by some of a plurality of users of other users searching for the discovery object at the event, and the captured images and content extracted from some of the images are provided to users according to the progress of the event. [Figure 15] This is an example of a screen that presents to the user content that is extracted from the results of photography by a camera 401 attached to the discovery object, showing the user searching for the discovery object at the event. [Figure 16] This is an example screen that presents to the user content extracted from images captured by a camera 401 attached to the discovery object, such as images of the user searching for the discovery object at the event, together with information on the discovery objects that the user discovered at the event and the discovery objects that the user was unable to discover. [Figure 17] A screen example in which content extracted from the results of photographing by the camera 401 attached to the discovery object, such as the state of the user searching for the discovery object at the event, is presented to the user together with content extracted from a portion of an image photographed by the user of other users working on the event's tasks at the event. [Figure 18] 11 is a flowchart showing a process for accepting input operations from a user in response to the progress of an event task in an event held in the real world, and presenting the user with the results of the progress the user has made in completing the event task upon completion of the event. [Figure 19] 13 is an example of a screen that presents the user with information about discovery objects that the user has discovered and discovery objects that the user has not been able to discover upon the end of an event. [Figure 20] This is an example screen that presents the user with information regarding the discovery object that the user was unable to find upon the end of the event, along with information suggesting the area in which the discovery object is located, and content that extracts a portion of an image taken of the discovery object. [Figure 21] This is an example screen that presents the user with information regarding discovery objects that the user was unable to find upon the end of an event, along with information suggesting the area in which the discovery objects are located and information about the user's range of movement within that area. [Figure 22] This is an example screen that presents information to the user about discovery objects discovered by the user, as well as information about discovery objects that are scheduled to be added at the next event after a specified period of time has passed since the end of the event, new tasks for the next event, etc. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. In the following description, the same components are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated.

[0010] <First embodiment> <Summary> In the following embodiment, a technology is described in which, at an event held in the real world, multiple other users take images of a user working on a task in the event, and in response to the progress of the event, content extracted from the captured images is provided to the user. Here, the devices etc. that are used as appropriate during the progress of the event may be terminal devices such as a smartphone or tablet device owned by the user, or may be presented by terminal devices installed at the venue where the event is held.

[0011] Generally, in facilities such as theme parks, photos taken when riding an attraction or experiencing an event are often intended to capture a user's facial expression of surprise, fear, etc. Therefore, the user may end up with the same facial expression every time the photo is taken, which may make the experience boring and may not motivate the user to experience the experience again and again.

[0012] In the above case, the camera that photographs the user is mainly operated by the theme park, so there is a possibility that the image will not be captured at the timing or with the facial expression that the user desires. For example, the appearance of being engrossed in an event or the expression of joy that may be expressed when discovering something will not be captured, making it difficult to reminisce about the photo along with memories.

[0013] Therefore, system 1 provides a program for operating a computer to assist in the progress of an event in which a user searches for discovery objects placed within a certain space in the real world, and the program provides technology that causes the computer processor to execute the steps of accepting input operations by the user on the terminal operated by the user in accordance with the progress of the event task, and presenting to the user the results of the user's progress in the event task upon the end of the event.

[0014] (1) In a search-type event, images taken by some users of other users are extracted and presented to users according to the progress of the event, such as at the end of the event. The system 1 acquires images of the user working on the tasks of the event using a terminal device such as a smartphone owned by the user or a terminal (smartphone, tablet, etc.) lent to the user by the business operator running the event. For example, some of the multiple users take pictures of other users working on the tasks of the event. The system 1 provides the user with content that is a part of the acquired images extracted based on the acquired images and the progress of the event. This allows the user to obtain content based on images capturing various expressions while participating in the event, further enhancing the memories of the event and encouraging repeat participation in the event.

[0015] As described above, the system 1 provides a technique for further enhancing the memories of users who participated in an event.

[0016] The system 1 may be used, for example, at an event venue held in the real world. The event is, for example, a search-type event in which multiple users search for discovery objects in the real world. In the event, the geographical range to be searched includes grass, trees, walls, ground, buildings, water surfaces, props, etc., and multiple users search for discovery objects hidden in these natural objects and artificially installed objects. In the event, a certain geographical range is defined as an area, and multiple areas are explored in order, and multiple users search for discovery objects hidden in each area. Each user participating in the event searches for discovery objects in each area, referring to hints (information suggesting the location where the discovery object is hidden) distributed at the time of participating in the event, and sometimes consulting with multiple users. On the other hand, among the multiple users participating in the event, some users wish to film the way in which each user explores. For example, suppose that the object to be discovered represents a character that appears in an original content such as a novel or game, and a user who is a fan of the content wishes to participate in the event. In contrast, some users wish to participate in the event and record the exploring behavior of the fan. For example, if a child wishes to participate in an event, the child's parent wishes to record the way the child explores at the event. Therefore, some of the multiple users use their own terminal devices to take images of the other users working on the tasks of the event. Based on the images acquired from the user and the progress of the event, the system 1 presents the user with content that extracts a portion of the image, for example, photos that show the user's facial expressions at various times during the event. This allows the user to repeatedly look back on what happened at the event and what the user's facial expressions were, enhancing the memories of the event. In addition, users exploring at an event may take selfies with their smartphones or take pictures with a camera that can capture a wide range, such as a 360-degree camera, while exploring. (2) In exploration-type events, some users can use terminal devices to obtain information (such as hints) to assist in the progress of the event. The system 1 presents information to users participating in the event to assist them in finding the object to be found, which is the goal of the event, through the terminal device of the user. For example, some users participating in the event can obtain information about the object to be found (such as information suggesting a hidden location) on their smartphones while taking pictures of other users. This allows the user taking the photo to provide hints to other users searching for objects to be found at the event, and while taking photos of other users to leave memories, the user can participate in the event together in the role of a supporter who supports the other users, further enhancing the sense of unity that occurs when multiple users work on the event. For example, if the object to be found is a character that appears in the content, even if a user has a relatively low interest in the content compared to a user who enjoys exploring, the user can participate in the event motivated by wanting to take photos and record the users who enjoy exploring, and play a role in supporting the progress of the event.

[0017] <1 Overall system configuration> FIG. 1 shows the overall configuration of a system 1 according to the first embodiment.

[0018] As shown in Fig. 1, the system 1 includes a plurality of terminal devices (terminal device 10A and terminal device 10B are shown in Fig. 1. Hereinafter, they may be collectively referred to as "terminal device 10"), a server 20, and a plurality of discovery objects 40. The discovery objects 40 may be equipped with a camera 401 and a sensor 402. The terminal device 10, the camera 401 equipped in the discovery object 40, and the server 20 are communicatively connected via a network 80.

[0019] The terminal device 10 is a device operated by each user. The terminal device 10 is realized by a mobile terminal such as a smartphone or tablet compatible with a mobile communication system. In addition, the terminal device 10 may be, for example, a stationary PC (Personal Computer), a laptop PC, or a data terminal installed at an event venue. As shown as the terminal device 10B in FIG. 1, the terminal device 10 includes a communication IF (Interface) 12, an input device 13, an output device 14, a memory 15, a storage unit 16, and a processor 19. The server 20 includes a communication IF 22, an input / output IF 23, a memory 25, a storage 26, and a processor 29.

[0020] The terminal device 10 is communicatively connected to the server 20 via a network 80. The terminal device 10 is connected to the network 80 by communicating with communication devices such as a wireless base station 81 conforming to communication standards such as 5G and LTE (Long Term Evolution) and a wireless LAN router 82 conforming to wireless LAN (Local Area Network) standards such as IEEE (Institute of Electrical and Electronics Engineers) 802.11.

[0021] The communication IF 12 is an interface for inputting and outputting signals so that the terminal device 10 can communicate with an external device. The input device 13 is an input device (e.g., a touch panel, a touch pad, a pointing device such as a mouse, a keyboard, etc.) for receiving an input operation from a user. The output device 14 is an output device (a display, a speaker, etc.) for presenting information to a user. The memory 15 is for temporarily storing programs and data processed by the programs, etc., and is a volatile memory such as a DRAM (Dynamic Random Access Memory). The storage unit 16 is a storage device for saving data, and is, for example, a flash memory or a HDD (Hard Disc Drive). The processor 19 is hardware for executing an instruction set described in a program, and is composed of an arithmetic unit, a register, a peripheral circuit, etc.

[0022] The server 20 manages information related to the event and information related to the users participating in the event. The server 20 stores various information such as the area where the event is held, objects to be found that are placed, time limit, etc., various information such as the gender, age, and number of times of participation in the event of the users participating in the event, various information on objects to be found that are placed in the venue where the event is held, various information on hints presented to the users participating in the event, various history information recorded by the users participating in the event, etc.

[0023] The communication IF 22 is an interface for inputting and outputting signals so that the server 20 can communicate with an external device. The input / output IF 23 functions as an interface with an input device for receiving input operations from a user and an output device for presenting information to a user. The memory 25 is for temporarily storing programs and data processed by the programs, etc., and is a volatile memory such as a DRAM (Dynamic Random Access Memory). The storage 26 is a storage device for saving data, such as a flash memory or a HDD (Hard Disc Drive). The processor 29 is hardware for executing an instruction set described in a program, and is composed of an arithmetic unit, a register, a peripheral circuit, etc.

[0024] The discovery object 40 is an object that is the target of a user's search during an event. A plurality of discovery objects 40 are placed within an area that is to be searched by a user during an event. During an event, a user progresses the event by using the terminal device 10 to photograph the discovery object 40. In a certain aspect, the discovery object 40 may include a camera 401.

[0025] The camera 401 is a device provided in the discovery object 40 for receiving light by a light receiving element and outputting the light as a captured image. The camera 401 is, for example, a depth camera capable of detecting the distance from the camera 401 to the capture object. In a certain aspect, the camera 401 may capture a user participating in an event from the viewpoint of the discovery object. In a certain aspect, the camera 401 may have a function of detecting information on the user's emotions, such as the user's gaze and facial expression. For example, the server 20 may acquire and analyze the captured image output by the camera 401, thereby determining the type of the user's emotion (such as "surprise") based on the area of ​​the user's face in the captured image. The discovery object 40 may also be provided with a microphone or the like, and may detect the sound of the surroundings where the discovery object 40 is installed. For example, the server 20 may detect the sound emitted by the user based on the sound detected by the microphone of the discovery object 40, and determine the user's emotion based on the detected user's sound. As described above, by providing sensing means in the object to be found 40, the line of sight, facial expression, emotions, and the like of the user around the object to be found 40 may be detected.

[0026] In this embodiment, each device (terminal device, server, etc.) can also be regarded as an information processing device. That is, a collection of the devices can be regarded as one "information processing device", and the system 1 may be formed as a collection of multiple devices. The method of allocating multiple functions required to realize the system 1 according to this embodiment to one or multiple pieces of hardware can be appropriately determined in consideration of the processing capacity of each piece of hardware and / or the specifications required for the system 1.

[0027] <1.1 Configuration of the terminal device 10> FIG. 2 is a block diagram of the terminal device 10 constituting the system 1 of the first embodiment. As shown in FIG. 2, the terminal device 10 includes a plurality of antennas (antenna 111, antenna 112), wireless communication units (first wireless communication unit 121, second wireless communication unit 122) corresponding to the respective antennas, an operation reception unit 130 (including a touch-sensitive device 131 and a display 132), a voice processing unit 140, a microphone 141, a speaker 142, a position information sensor 150, a camera 160, a motion sensor 170, a storage unit 180, and a control unit 190. The terminal device 10 also has functions and configurations (for example, a battery for holding power, a power supply circuit for controlling the supply of power from the battery to each circuit, etc.) that are not particularly shown in FIG. 2. As shown in FIG. 2, each block included in the terminal device 10 is electrically connected by a bus or the like.

[0028] The antenna 111 emits a signal generated by the terminal device 10 as a radio wave. The antenna 111 also receives a radio wave from space and provides the received signal to the first wireless communication unit 121.

[0029] The antenna 112 radiates a signal generated by the terminal device 10 as a radio wave. The antenna 112 also receives the radio wave from space and provides the received signal to the second radio communication unit 122.

[0030] The first wireless communication unit 121 performs modulation and demodulation processing for transmitting and receiving signals via the antenna 111 so that the terminal device 10 can communicate with other wireless devices. The second wireless communication unit 122 performs modulation and demodulation processing for transmitting and receiving signals via the antenna 112 so that the terminal device 10 can communicate with other wireless devices. The first wireless communication unit 121 and the second wireless communication unit 122 are communication modules including a tuner, a Received Signal Strength Indicator (RSSI) calculation circuit, a Cyclic Redundancy Check (CRC) calculation circuit, a high-frequency circuit, and the like. The first wireless communication unit 121 and the second wireless communication unit 122 perform modulation and demodulation and frequency conversion of wireless signals transmitted and received by the terminal device 10, and provide the received signals to the control unit 190.

[0031] The operation reception unit 130 has a mechanism for receiving an input operation by a user. Specifically, the operation reception unit 130 is configured as a touch screen, and includes a touch-sensitive device 131 and a display 132. The touch-sensitive device 131 receives an input operation by a user of the terminal device 10. The touch-sensitive device 131 detects a touch position of the user on the touch panel, for example, by using a capacitive touch panel. The touch-sensitive device 131 outputs a signal indicating the touch position of the user detected by the touch panel to the control unit 190 as an input operation.

[0032] Display 132 displays data such as images, videos, and text under the control of control unit 190. Display 132 is realized by, for example, an LCD (Liquid Crystal Display) or an organic EL (Electro-Luminescence) display.

[0033] The audio processing unit 140 modulates and demodulates an audio signal. The audio processing unit 140 modulates a signal provided from the microphone 141 and provides the modulated signal to the control unit 190. The audio processing unit 140 also provides the audio signal to the speaker 142. The audio processing unit 140 is realized by, for example, a processor for audio processing. The microphone 141 accepts audio input and provides an audio signal corresponding to the audio input to the audio processing unit 140. The speaker 142 converts the audio signal provided from the audio processing unit 140 into audio and outputs the audio to the outside of the terminal device 10.

[0034] The position information sensor 150 is a sensor that detects the position of the terminal device 10, and is, for example, a GPS (Global Positioning System) module. The GPS module is a receiving device used in a satellite positioning system. In the satellite positioning system, signals from at least three or four satellites are received, and the current position of the terminal device 10 equipped with the GPS module is detected based on the received signals. For example, in the system 1, when the user's position information is made available for reference, a hint regarding the location of a discovery target object near the user can be presented to the user. In addition, the position information sensor 150 may be a transmitting / receiving device based on a communication standard used in a short-range communication system between information devices. Specifically, the position information sensor 150 receives a beacon signal from another information device equipped with a Bluetooth (registered trademark) module using the 2.4 GHz band such as a Bluetooth (registered trademark) module.

[0035] The camera 160 is a device that receives light with a light receiving element and outputs the received light as a captured image. The camera 160 is, for example, a depth camera that can detect the distance from the camera 160 to a subject being photographed.

[0036] The motion sensor 170 is configured with a gyro sensor, an acceleration sensor, etc., and detects the inclination of the terminal device 10.

[0037] Storage unit 180 is configured with, for example, a flash memory, and stores data and programs used by terminal device 10. In one aspect, storage unit 180 stores user information 181.

[0038] User information 181 is information such as the user's age, sex, user ID for the event, and the number of times the user has participated in the event. When participating in an event, the event organizer may grant the user the right to participate in the event based on the information. Also, on the day of participating in the event, the right to participate in the event may be granted by registering the user's information at the venue where the event is held using a terminal device installed at the venue. Note that registration of the information itself is not essential, and the right to participate in the event may be granted even if the user omits registering the information.

[0039] The control unit 190 reads a program stored in the storage unit 180 and executes instructions included in the program to control the operation of the terminal device 10. The control unit 190 is, for example, an application processor. The control unit 190 operates according to the program to fulfill the functions of an input operation reception unit 191, a transmission / reception unit 192, a data processing unit 193, and a notification control unit 194.

[0040] The input operation reception unit 191 performs a process of receiving a user's input operation on an input device such as the touch-sensitive device 131. The input operation reception unit 191 determines the type of operation, such as whether the user's operation is a flick operation, a tap operation, or a drag (swipe) operation, based on information on the coordinates where the user touches the touch-sensitive device 131 with a finger or the like.

[0041] The transmission / reception unit 192 performs processing for the terminal device 10 to transmit and receive data to and from an external device such as the server 20 in accordance with a communication protocol.

[0042] The data processing unit 193 performs a process of performing calculations on the data that the terminal device 10 accepts as input in accordance with a program, and outputs the calculation results to a memory or the like.

[0043] The data processing unit 193 receives from the user information on images of other users working on the tasks of the event, input information for approval of the discovery object, etc. The data processing unit 193 obtains the image information by, for example, taking an image of other users working on the tasks of the event using the camera 160, etc. In addition, the data processing unit 193 receives an input operation for approval from the user while, for example, an image of the discovery object is displayed on the display 132, etc. of the terminal device 10 using the camera 160, etc.

[0044] The notification control unit 194 performs processing for displaying a display image on the display 132, processing for outputting sound to the speaker 142, and processing for causing the camera 160 to generate vibrations.

[0045] <1.2 Functional configuration of server 20> 3 is a diagram showing a functional configuration of the server 20. As shown in FIG. 3, the server 20 fulfills the functions of a communication unit 201, a storage unit 202, and a control unit 203.

[0046] The communication unit 201 performs processing for the server 20 to communicate with external devices.

[0047] The storage unit 202 stores data and programs used by the server 20. The storage unit 202 stores an event information database 281, a participant information database 282, an object information database 283, a hint information database 284, an event history database 285, and the like.

[0048] The event information database 281 is a database for holding various types of information about events, the details of which will be described later.

[0049] The participant information database 282 is a database for holding various information about users who participate in the event, as will be described in detail later.

[0050] The object information database 283 is a database for holding various information about objects that are placed at specific locations during an event and that are targets for users to search for. Details will be described later.

[0051] The hint information database 284 is a database for holding various information related to hints regarding the locations of objects to be found that are presented to the user during an event, as will be described in detail later.

[0052] The event history database 285 is a database for storing the history of various actions of users who participated in an event, as will be described in detail later.

[0053] The reception control module 2041 controls the process in which the server 20 receives a signal from an external device in accordance with a communication protocol.

[0054] The transmission control module 2042 controls the process in which the server 20 transmits signals to external devices in accordance with a communication protocol.

[0055] The event information acquisition module 2043 acquires various information related to the event in which the user is about to participate.

[0056] The participant information acquisition module 2044 acquires various information about users who are going to participate in the event.

[0057] The object information acquisition module 2045 acquires information about discovered objects that will be placed in the event that the user is about to participate in.

[0058] The hint information acquisition module 2046 acquires hint information regarding the placement locations of discovery objects to be placed in the event in which the user is about to participate.

[0059] When a user photographs a discovery object at an event using the camera 160 or the like, the object display module 2047 acquires information about the discovery object, such as its name, ease of finding (rarity), and benefits to the user for finding it. This allows the user to check information about the discovery object he or she has discovered at the time of discovery, thereby increasing the interest of participating in the event.

[0060] The hint presentation module 2048 presents information on a hint regarding a location where a discovery object is located to the user when the user is searching for the discovery object in the event. In this case, the hint presentation module 2048 may present a hint to the user when the following conditions are met: When it is determined that the user is within a specific range based on the position of the discovery object, based on the user's position information and the position information of the discovery object, which are acquired from the position information sensor 150 of the terminal device 10A. For example, when the user's position and the position of the discovery object are within a certain distance. When the positional relationship between the position and direction of the camera 160 of the terminal device 10A taking a picture and the position of the object to be found within the range of the picture satisfies a certain condition. For example, the terminal device 10 may acquire the user's position within the geographical range in which the object to be found is searched and the direction in which the user is pointing the camera by using an acceleration sensor, a direction sensor, etc. of the terminal device 10. In addition, if the terminal device 10 has a LiDAR (Light Detection and Ranging) sensor and can detect the surrounding terrain by optically measuring the distance to the surrounding objects, the user can generate a 3D model by directing the emission direction of the laser light of the LiDAR sensor of the terminal device 10 toward the surrounding terrain. This allows the terminal device 10 to identify the user's position (the position of the terminal device 10) and the direction in which the camera 160 is taking a picture in the geographical range to be searched. For example, the above conditions are met when: (1) The location of the object to be found is included in the range of the camera 160. (2) The object is not included in the range of the camera 160, but by changing the range of the camera 160 by a predetermined angle, the object may be included in the range of the camera 160. This allows the user to recognize that a discovery target is located near him / her, and allows the user to feel a sense of tension as he / she explores his / her surroundings more carefully.

[0061] The approval receiving module 2049 accepts an input operation for approving a discovery object discovered at an event from a user. Specifically, the approval receiving module 2049 accepts an image of the discovery object photographed by the camera 160 or the like of the terminal device 10 owned by the user. At this time, the approval receiving module 2049 analyzes the image, and if the discovery object is included in the image, determines that the user has discovered the discovery object. This allows the user to receive approval for discovering a discovery object at an event in the real world by photographing a discovery object actually placed in the real world at an event in the real world with the camera 160 or the like of the terminal device 10. In addition, at this time, the approval receiving module 2049 may perform approval in combination with the user's position information acquired from the position information sensor 150 of the terminal device 10. Therefore, the event organizer can prevent fraudulent approval by, for example, creating a stuffed toy prepared in advance.

[0062] <2 Data Structure> 4 and 5 are diagrams showing the data structures of the event information database 281, the participant information database 282, the object information database 283, the hint information database 284, and the event history database 285 stored in the server 20. FIG.

[0063] As shown in FIG. 4, the event information database 281 includes an item “Event ID”, an item “Event area”, an item “Appearing objects”, an item “Recommended number of participants”, an item “Time limit”, an item “Hint information”, an item “Area”, an item “Notes”, etc.

[0064] The item "event ID" is information that identifies each event.

[0065] The item "Event area" is information that indicates the area that the event will be held in. For example, the event ID "I001" indicates that the event will be held in multiple areas such as "A", "B", and "C".

[0066] The item "Appearing Object" is information showing the identification information of each discovery object that appears in each area during the event. For example, in the event ID "I001", the objects that appear in the implementation area "A" are "P001, P002, ...", etc. Discovery objects are configured as follows, using characters that appear in original content such as manga, animation, novels, and games as motifs. · Objects that reproduce or deform the character itself (such as stuffed toys) Real-life objects that represent the character's characteristics (1) For example, if a character has attributes related to temperature, such as ice or fire, then objects with low or warm temperatures that are reminiscent of ice or fire, or objects with the texture of ice or fire, (2) For example, if the character has the attribute of magnetism, an object that is reminiscent of magnetism (such as a magnetic object). (3) For example, if the character has electrical attributes, an object that is reminiscent of electricity (such as a light-emitting object) Drawings of the character on buildings or other man-made objects (for example, a drawing of the character on a wall) Images in which the character appears (for example, images of the character projected onto a wall, plant, fountain, etc.) Natural objects with the character printed on them (for example, leaves with the character printed on them) Sounds that represent the character (for example, the character's unique cry, or footsteps that represent the character's movements)

[0067] The item "recommended number of participants" indicates information regarding the recommended number of participants in each area for the event. For example, for event ID "I001", the recommended number of participants in event area "A" is "6". The recommended number of participants is set by the operator of the event based on the time to search each area, the size of the search range of each area, etc. The server 20 may change the recommended number of participants for each area in response to changing the time limit for searching each area.

[0068] The "Time Limit" item shows information about the time limit for searching each area in the event. For example, for the event ID "I001," the time limit for the area "A" is "10 minutes."

[0069] The item "hint information" is information that indicates the identification information of each hint presented to the user in each area of ​​the event. For example, in the event ID "I001", the hint information in the implementation area "A" is "H001, H002, ...".

[0070] The item "area" is information about the area of ​​each area in the event. For example, in the event ID "I001", the area of ​​the implementation area "A" is "BBm2". The area of ​​each area is set by the operator who manages the event. The server 20 changes the area information of each area according to the operator's designation. For example, when an area is expanded or reduced (when the searchable range is expanded or reduced), the server 20 accepts the setting of the date and time at which participation in the event in the expanded or reduced area is accepted, and updates the area information of each area in response to the arrival of the date and time. For example, an area may be expanded by carrying out expansion work on the area to be searched in the event. In addition, an area may be reduced for maintenance or the like, or the use of an area may be prohibited due to the occurrence of a problem.

[0071] The item "Notes" is information that is stored when there are special notes for an event. Examples of special notes include the following: The event is limited to a specific date and time (for example, an event limited to the summer vacation period). The event is time-limited and time-limited (for example, an event that takes place after sunset) The user must meet certain requirements in order to participate in the event. (1) For example, the age group of the users must meet certain conditions. For example, the team must be comprised of users below a certain age and include parents or guardians. (2) For example, a certain requirement is that the area in which the user is based in the real world or the virtual world must satisfy certain conditions. For example, in a game, there may be an event offered to users based in a certain region. (3) For example, a certain requirement may be that a user's participation in an event must satisfy a certain condition. For example, an event may be provided to a user who has completed a certain number of tasks in the event. There are conditions on the number of times you can participate in the event (for example, you can only participate in the event a certain number of times) For example, the notes for the event ID "I002" indicate that it is an "event limited to after 5pm."

[0072] Based on the above various information, the event organizer may notify the user of the event outline, etc. This allows users who wish to participate in the event to know the time period when the event will be held, information on the discovery objects that can be found, etc., and they can select and participate in an event where they can find their favorite discovery objects. This is expected to further increase the motivation of users to participate in the event.

[0073] The participant information database 282 includes items such as "participation date and time", "participating group", "participant ID", "gender", "age", "role", "support target", "participation status", and "remarks". In real-world events disclosed in the present invention, users are made up of groups of multiple people, and participate in each event as a group. The database holds information on each user who makes up the group that participated in the event.

[0074] The item "Participation Date and Time" indicates information regarding the date and time when a group consisting of multiple users participated in an event. For example, a group identified as participating group "A" (described later) participated in an event at the participation date and time "2020 / 02 / 10 10:30:00". In some cases, the item may be stored by date and time, such as "2020 / 02 / 10", rather than by time period.

[0075] The item "participating group" indicates information for identifying a group that participated in the event at each participation date and time.

[0076] The item "Participant ID" indicates information for identifying multiple users who make up a group that participated in an event. For example, it indicates that the users who make up participating group "A" are "U001", "U002", etc.

[0077] The item "gender" indicates information that identifies the gender of each user associated with the participant ID. For example, the gender of the user ID "U001" in the participant group "A" is "male."

[0078] The item "age" indicates information that identifies the age of each user, linked to the participant ID. For example, the age of user ID "U001" in participant group "A" is "12."

[0079] The item "role" indicates information that identifies the role that each user plays in the event, linked to the participant ID. For example, the role of user ID "U001" in the participating group "A" is "search". In the real-world event disclosed in the present invention, each user is prompted to act according to the role. For example, a user with the role "search" is responsible for searching for discovery objects placed in each area, and a user with the role "support" is prompted to act by presenting hint information displayed on the user's terminal to a user with the role "search". The role of each user may be fixed during the event, or the roles of each user may be switched during the event. In the above example of the participant information database 282, a user associated with a participant ID is associated with a role that the user will play in the event. This is not a limitation, and there may be cases where the role is not linked to the participant ID. For example, information about the terminal used by the user at the event (or an identification number issued by the server 20 or the like when using an application running on the terminal) may be associated with the role and managed in the server 20. For example, the following situation may occur. The event operator lends one or more devices to each group of users participating in the event. The event proceeds without linking a participant ID to the device itself. Each device has a defined role, such as "search" or "support." In this case, users in a group can swap devices with different roles, allowing them to switch roles. In the case where a role is defined for each device as described above, when a group participates in an event using devices each corresponding to multiple roles, an operation to switch the roles of devices within the group may be accepted from the users. This allows users to switch roles within the group without having to switch devices. As described above, when swapping user roles within a group without users exchanging terminals, the terminal roles may be swapped in order to swap the roles of "search" and "support" played by users within the group by satisfying a certain condition in an event, regardless of user operation. The certain condition may include, for example, the following: (i) Temporal conditions, such as a certain amount of time having passed since the start of an event or a certain amount of time having passed since the start of exploring an area. (ii) Conditions according to the purpose of the event (discovering a discovery object), such as whether a user succeeded in discovering a discovery object in the event (an operation to report that the discovery object has been found has been accepted) or failed (a user with the role "search" failed to discover the discovery object within the search period of the area).

[0080] This allows parents to experience the progress of the event together with their children, for example, by providing hints to the child, rather than waiting outside while the child is engrossed in exploring. This not only contributes to the creation of memories between parents and children, but also has the effect of encouraging parents and children to participate again and again.

[0081] The item "support target" indicates a target that a user with the role of "support" supports in an event. Targets that a user with the role of "support" supports include the following: A specific user with the role "Explore" Groups that users join For example, this indicates that the participant ID "U002" whose role is "support" supports "U001."

[0082] The item "Participation Status" indicates detailed information about each user's participation in an event in each group. For example, participant ID "U001" indicates that the user attempted event area "A" "twice" in event ID "I001." In some situations, the event organizer may refer to the information and award the user a specific benefit, such as a sticker or other item depending on the number of attempts.

[0083] This allows users to enjoy the fun of trying events in the same area multiple times, which is expected to encourage repeat event participation.

[0084] The item "remarks" is information that is stored when there are special notes or the like for the user regarding the event.

[0085] As shown in FIG. 5, the object information database 283 includes an item "area ID", an item "object ID", an item "object name", an item "appearance position", an item "search time", an item "remarks", and the like.

[0086] The item "area ID" indicates information for identifying each area that the user will search during the event.

[0087] The item "Object ID" indicates information that identifies each discovery object placed in each area. For example, objects placed in area ID "A" are discovery objects identified by "P001", "P002", etc.

[0088] The item "object name" indicates information about the name of the discovered object identified by each object ID. For example, the object name of the discovered object ID "P001" is "Pikachu."

[0089] The item "appearance position" indicates the position information of the location where the discovery object is placed in each area during the event. For example, in area ID "A", the appearance position of discovery object "P001" is indicated to be coordinates of "AAA.AAA.AAA". In a certain aspect, the server 20 may use the user's position information acquired from the position information sensor 150 of the user's terminal device 10 and the information on the appearance position as a trigger for presenting the user with a hint regarding the placement of the discovery object.

[0090] The item "search time" indicates the time during which a user can search for a discovery object in an event. For example, the search time in area ID "A" is "10 minutes."

[0091] The item "Notes" is information that is stored when there are special notes or the like regarding an area in an event.

[0092] The hint information database 284 includes an item "area ID", an item "hint ID", an item "corresponding object", an item "hint content", an item "hint display position", an item "hint appearance time", an item "remarks", and the like.

[0093] The item "area ID" indicates information for identifying each area that the user will search during the event.

[0094] The item "hint ID" indicates information for identifying each hint presented to the user in each area. For example, the hints presented to the user in area ID "A" are identified by "H001", "H002", etc.

[0095] The item "Corresponding object" indicates information about the discovery object that each hint corresponds to. For example, the hint ID "H001" indicates that the discovery object that corresponds to "P001".

[0096] The item "hint content" indicates the content of each hint presented to the user. Hints presented to the user include: The type or name of the object to be discovered (for example, if the object to be discovered is a character, the name of the character, a silhouette of the character's shape, etc.) Information suggesting the location of the detected object (e.g., the direction in which the detected object is located, the distance to the detected object, etc.) Information about the time when the discoverable object appears (for example, if the discoverable object is placed and can be discovered for a limited time, information about that time, etc.) Information about the conditions necessary to find the discovery object (e.g., the discovery object can be found by activating a specific device in the area, or the discovery object can be found by a user wearing a specific device (e.g., glasses), etc.) For example, the hint content of the hint ID "H001" indicates that it is information about the "position" of the discovery object "P001".

[0097] The item "hint display position" indicates information about a position in an area that triggers displaying a hint to a user. For example, the hint display position for hint ID "H001" indicates the coordinates "AAA.AAA.AAA". Based on the user's position information acquired from the position information sensor 150 of the user's terminal device 10 and the information, the server 20 presents hint information to the user when the user is in a position around the coordinates.

[0098] The item "hint appearance time" indicates information regarding the timing of presenting hint information to the user. For example, the appearance time of the hint identified by the hint ID "H001" indicates "5 minutes" from the start of the search in the area. In a certain aspect, the time may be the elapsed time calculated from the start of the event, or a predetermined time during the event period, for example, 5 minutes from 2 minutes to 7 minutes after the start, etc.

[0099] The item "Notes" is information that is stored when there are special notes or the like in the hint for the event.

[0100] The event history database 285 includes an item "history ID", an item "participant ID", an item "role", an item "participation date and time", an item "search area", an item "arrival at area", an item "action history", an item "notes", and the like.

[0101] The item "history ID" indicates information for identifying each history acquired in an event. The server 20 may define a history ID for each group participating in the event, instead of defining a history ID for each participant.

[0102] The item "Participant ID" indicates information for identifying a participant that is linked to a history ID. For example, the participant IDs linked to the history ID "R001" are "U001", "U002", etc.

[0103] The item "role" indicates information that identifies the role that each user will play in the event, linked to the participant ID. For example, the role of the participant ID "U001" is "search."

[0104] The item "Participation Date and Time" indicates information related to the date and time when each user participated in the event linked to the event ID. For example, the participation date and time of each user linked to the event ID "R001" is "2020 / 02 / 10".

[0105] The item "Search area" indicates information related to the area searched by each user in the event, which is linked to the event ID. For example, the search area of ​​each user linked to the event ID "R001" indicates multiple areas such as "A".

[0106] The item "Arrival to Area" indicates information related to the time when each user associated with the event ID arrived at each area for the event. For example, it indicates that the time when each user associated with the event ID "R001" arrived at area "A" was "10:30:00". The arrival time can be the timing when the user started searching in the area.

[0107] The item "behavior history" indicates information related to the behavior history of each user in an event linked to the event ID. The behavior history is also divided into categories such as "type," "time," and "target," and holds information related to the details of the behavior of each user in the event. For example, an example of the behavior history of a user with user ID "U001" in an event ID "R001" indicates that the type is "discovery," the time of the discovery is "10:32:00," and the target of the discovery is "P001." In one aspect, the server 20 may hold the user's behavior history in the database each time a user participating in an event performs an action.

[0108] This allows the server 20 to record the actions taken by the user during the event at any time, allowing the event organizer to present related events and grant specific benefits based on the user's action history, which is expected to increase the user's interest in participating in the event and encourage repeat visits.

[0109] The item "Notes" is information that is stored when there are special notes in the event history.

[0110] <3 operations> Below, we will explain the process in which system 1 acquires images taken by some of a plurality of users of other users working on tasks in an event, and provides content that extracts a portion of the first image to the plurality of users in response to the plurality of users progressing through the event.

[0111] FIG. 6 is a flowchart showing a process in which images taken by some of a plurality of users of other users working on tasks in an event are obtained, and content extracted from portions of the images is provided to the plurality of users in response to the plurality of users progressing through the event.

[0112] In step S601, the control unit 190 of the terminal device 10A acquires a video or still image including other users working on the task of the event by a user in the user group. Specifically, for example, the terminal device 10A of a user whose role is "support" acquires an image of other users whose role is "search" working on the task of the event, for example, searching for a discovery object, by the operation of the user, using the camera 160 of the terminal device 10A or the like. The terminal device 10A transmits information on the acquired image to the server 20.

[0113] In step S651, the control unit 203 of the server 20 enables at least a part of the video or still image content to be provided to the terminal 10A operated by a user in the user group in response to the user group progressing the event. For example, the user to whom the part of the content is to be provided is a user whose role is "search." Here, the following are examples of triggers for the server 20 to enable the content to be provided to users who have participated in the event as the event progresses. The exploration period for one of the multiple areas that make up the event has ended. (1) Specifically, the period for searching an area may end when the time limit set for that area has elapsed. (2) Specifically, the period for searching an area may be considered to end when all discovery objects in that area have been found. A certain period of time has elapsed since the user began searching in each area. In each area, the user discovered a discovery object during the search period. In each area, provide users with hints to help them find objects to discover. The user completes exploration of all or part of multiple areas that constitute the event. The server 20 may determine that the user has ended the event based on the user's arrival time in the area, i.e., the start time of the event, acquired from the event history database 285 or the like, and the time limit set for each event. The server 20 creates content by extracting, for example, the state when the user in the role of searching discovered the discovery object, the state of searching for the discovery object, etc., from the images of other users working on the tasks of the event acquired in step S601, and provides it to the user. For example, it is assumed that the user's terminal device 10 accepts an operation to report that the discovery object has been discovered. In this case, the server 20 may specify a video image at the time when the user performing the search discovered the discovery object based on the video image captured by the terminal device 10 before the timing of accepting the operation.

[0114] Here, the process of the control unit 203 of the server 20 extracting a part from an image acquired from the terminal device 10A will be described. The control unit 203 of the server 20 may identify a person included in the image by image analysis or the like, and create content in which only the person is extracted. At this time, the image analysis process may be executed by any existing process, and is not limited to this. In addition, the server 20 may store in the storage unit 202 a trained model in which a plurality of images of a person are input, and images in which specific facial expressions, for example, a smiling face, a surprised face, an enthusiastic face, etc. are extracted from the input images, are trained as correct answers. The control unit 203 of the server 20 may provide the user with content in which only images of specific facial expressions of the user working on the task of the event are extracted based on the image acquired from the terminal device 10A and the trained model.

[0115] In step S602, the control unit 190 of the terminal device 10A presents the content provided by the server 20 to the user by displaying it on the display 132, for example.

[0116] This allows users to obtain content that captures various aspects of their time participating in an event, such as how absorbed they are in exploring, how happy they are after finding an object, etc. This allows users to look back on the event and keep a record, which is expected to not only enhance their memories but also encourage repeat visits.

[0117] FIG. 7 is a flowchart showing a process in which images taken by some of a plurality of users of other users working on tasks in an event are obtained, the degree of progress of the event is determined based on recognition of discovery objects contained in the captured images, and content extracted from portions of the images is provided to the plurality of users in response to their progress in the event.

[0118] In step S701, the control unit 190 of the terminal device 10A accepts an input operation for receiving an acknowledgement that a discovery object has been found on the terminal of any one of the multiple users, and transmits the information to the server 20. Specifically, the control unit 190 of the terminal device 10A causes the camera 160 of the terminal device 10A of the user whose role is "search" to display the discovery object on the display 132 or the like. Here, the terminal device 10A indicates the terminal device 10A used by the user whose role is to search for the discovery object in the event. At this time, the control unit 190 of the terminal device 10A may determine whether the current time displayed on the display 132 or the like is within the time limit of the event that is set in advance, based on the time from the start of the event. When the current time is within the time limit of the event, the control unit 190 of the terminal device 10A accepts an input operation for photographing the discovery object from the user. The control unit 190 of the terminal device 10A transmits the photographed image of the discovery object to the server 20. In one aspect, the control unit 190 of the terminal device 10A may not accept an input operation for approval from the user, but may instead accept information on a video or still image captured by the camera 160 of the terminal device 10A, as a substitute for the approval operation.

[0119] In step S751, the control unit 203 of the server 20 determines whether or not a discovery object is included in the image. The control unit 203 of the server 20 may determine whether or not a discovery object is included in the image by image analysis. The server 20 may store in the storage unit 202 a trained model that is trained by inputting an image including a plurality of discovery objects and outputting an image in which only the discovery objects are extracted as a correct answer. The control unit 203 of the server 20 may determine whether or not a discovery object is included in the image based on the image acquired from the terminal device 10A and the trained model.

[0120] In step S752, the control unit 203 of the server 20, in response to receiving an input operation for approval, specifies the degree of progress of the event by the user group. Specifically, in step S701, in response to an input operation for approval of the discovery object received from the terminal device 10A, the control unit 203 of the server 20 determines how many of the discovery objects placed in the search area have been discovered, and specifies the degree of progress of the event. Furthermore, when the control unit 203 of the server 20 determines that all of the discovery objects placed in the area have been discovered, it specifies that the event in the area has ended. In a certain aspect, the control unit 203 of the server 20 also specifies that the event has ended when the time limit of the event expires without the user discovering all of the discovery objects. In a certain aspect, the control unit 203 of the server 20 may, after specifying the degree of progress of the event, present to the user how many discovery objects remain to be placed. In addition, in a certain situation, the control unit 203 of the server 20 may award the user limited items, goods, etc., based on the time limit and the progress of the event, for example, if all of the discovery objects are discovered earlier than the expected time.

[0121] This allows the user to work on the event while checking the progress of the event, and gives the user a sense of tension as the time limit approaches and a sense of specialness and accomplishment by finishing the event quickly, thereby increasing the interest of participating in the event.

[0122] <4 Screen example> FIG. 8 is a diagram showing an overview of events in the real world disclosed in the present invention.

[0123] In FIG. 8, an event is held in a plurality of areas. In this case, the event may be held simultaneously in each area, or may be held so that each time an area is finished, the next area can be challenged. In FIG. 8, 801A, 801B, and 801C respectively indicate areas in which the event is held. The areas may be connected to each other by passages or the like, or may be divided into areas by providing partitions in the same space. In addition, each area may have an entrance, and users participating in the event may enter the area through the entrance.

[0124] Participating users 802A, 802B, and 802C indicate users who participated in the events in each area. At this time, users participate in each event in groups, and multiple users participate in the event with their respective roles assigned to them.

[0125] The discovery objects 803A, 803B, and 803C indicate discovery objects arranged in each area. The discovery objects may be changed depending on the aspect of the event. The discovery objects may be real-world objects such as stuffed toys, or may be objects defined by AR (Augmented Reality) that are discovered by the camera 160 of the terminal device 10A, etc.

[0126] FIG. 9 is an example of a screen showing an image captured by some of the multiple users of another user working on a task in an event.

[0127] In FIG. 9, terminal device 10A has the role of "support" and is used at the event by a user who takes pictures of other users working on the tasks of the event.

[0128] Discovery objects 901 and 902 respectively indicate discovery objects placed in each area during the event.

[0129] Users 903 and 904 respectively indicate users participating in the event. In the illustrated example, each user is holding a booklet such as a pamphlet distributed by a business operator running the event. In FIG. 9, users 903 and 904 have the role of "search" and search for discovery objects 901 and 902, etc. In FIG. 9, users 903 and 904 have found discovery objects 901 and 902, and the users take images of the discovery using the camera 160 of the terminal device 10A, etc. The control unit 190 of the terminal device 10A transmits the images to the server 20. The control unit 203 of the server 20 provides the user with content obtained by extracting a part of the acquired image. At this time, the user operating the terminal device 10A may take images of other users working on the tasks of the event using the camera 160 of the terminal device 10A or the like, and transmit the images to the server 20. The control unit 203 of the server 20 may provide the user with content obtained by extracting a part of the acquired images, including the images. At this time, when users 903 and 904 whose roles are "search" discover discovery objects 901 and 902, the control unit 160 of the terminal device 10A may present the users with a notification that it is time to take a picture.

[0130] In a certain aspect, the control unit 190 of the terminal device 10A may automatically capture images of the users 903 and 904 whose roles are "search" using the camera 160 or the like at the timing when the users discover the discovery objects 901 and 902. As described above, even without the operation of the user whose role is "support", the terminal device 10A of the user whose role is "support" may record video or still images for a certain period of time including the timing when the user whose role is "search" discovers the discovery objects 901 and 902, by satisfying a predetermined condition for the search performed by the user whose role is "search". The processing performed by the terminal device 10A of the user whose role is "support" may include the following. Detects whether or not a user with the role of "search" who appears as a subject in the photographed result photographed by the terminal device 10A of the user with the role of "support" has performed a specific action. For example, when a user with the role of "search" is present within the photographing range of the camera 160 or the like, the control unit 190 focuses on the user and identifies the action of the user. When the control unit 190 identifies that the action of the user is "discovery of a discovery object," the control unit 190 may automatically operate the camera 160 or the like to photograph the user. As described later, the terminal device 10 of the user with the role of "search" accepts an input operation from the user with the role of "search" that the discovery objects 901 and 902 have been found. Meanwhile, the terminal device 10A of the user with the role of "support" continues to take pictures, and extracts a part of the photographed results based on the timing when the user with the role of "search" made an input operation that the user had found the discovery objects 901 and 902. For example, the server 20 can generate a video before and after the user with the role of "search" discovered the discovery objects 901 and 902 by extracting the photographed results for a period including the timing. For example, the terminal device 10A of the user with the role of "support" continues to take pictures with the camera 160, and sequentially transmits the photographed results (video) to the server 20. The server 20 accepts an input operation from the terminal device 10 of the user with the role of "search". This allows a user with the role "support" to automatically generate a video or still image including the timing at which the user with the role "search" discovers the discovery objects 901, 902, without having to wait for the timing at which the user with the role "search" discovers the search objects 901, 902, and store the video or still image in the server 20.

[0131] This allows a user searching for a discovery object to share content extracted from an image of the user working on the event with the user who took the image. Therefore, even if the roles are divided between "search" and "support," the users can look back on what they did at the event while looking at the content, enhancing their memories. It is also expected that this will increase the motivation to exchange roles of "search" and "support" next time, encouraging repeat participation in the event.

[0132] The time display unit 905 is a screen for displaying the current time and the time limit for the event. The control unit 190 of the terminal device 10A sets the time when the user arrives in each area as the start time of the event, and starts counting down the time limit set for each event. For example, in FIG. 9, the current time is within the time limit, and the screen displays "5 minutes remaining." By checking the display, the user can carry out the event while checking the remaining time in the event.

[0133] The achievement display unit 906 is a screen for displaying achievements in the event. Specifically, the screen displays the discovered discovery object, the remaining discovery objects, whether or not hints are displayed, and the like. In a certain aspect, the achievement display unit 906 may be linked to the terminal device 10A used by a user whose role is "search". In that case, in response to the user whose role is "search" discovering a discovery object, the achievement display unit 906 is updated. This allows the user to progress through the event while sharing the situation in real time. In a certain aspect, the server 20 may set a difficulty level of discovery for each discovery object. When the user turns off the hint information for the discovery object, the server 20 may change the specific reward depending on whether or not the hint information is used, such as by granting a specific reward in response to the user discovering the discovery object.

[0134] This allows users to challenge themselves to explore without receiving any hints, and they can feel the tension of exploring while also enjoying the sense of accomplishment that comes from receiving special rewards. This is expected to encourage users to continue participating in the event.

[0135] FIG. 10 is an example of a screen displayed when an approval operation for a discovery object is performed on the terminal device 10A used by a user whose role is "search."

[0136] In Fig. 10, a time display unit 1001 is a screen for displaying the current time and the time limit for an event, similar to the time display unit 905 in Fig. 9. The control unit 190 of the terminal device 10A sets the time when the user arrives in each area as the start time of the event, and starts a countdown to the time limit set for each event. For example, in Fig. 10, the current time is within the time limit, and the screen displays "8 minutes remaining."

[0137] Discovery objects 1002 indicate discovery objects placed in each area.

[0138] The approval operation screen 1003 shows an operation screen for approving that the user has found the discovery object. For example, when the camera 160 or the like captures the discovery object within the shooting range, the control unit 190 of the terminal device 10A may present information such as the name of the discovery object to the user through image analysis or the like. When the discovery object is within the shooting range and within the time limit, the control unit 190 of the terminal device 10A accepts an operation of photographing the discovery object for approval from the user. The control unit 190 of the terminal device 10A transmits the photographed image of the discovery object to the server 20. In a certain aspect, the operation for approval may be accepted based on information acquired from the position information sensor 150 of the terminal device 10A. That is, the photographing operation for approval may be accepted only when it is determined that the user is at the location where the discovery object is located based on the user's position information acquired from the position information sensor 150 of the terminal device 10A and the position information of the location where the discovery object is located. Thereafter, the control unit 190 of the terminal device 10A may obtain a notification from the server 20 that the approval has been accepted, and present this to the user.

[0139] 9, the achievement display section 1004 is a screen for displaying achievements in an event, etc. Here, the control unit 190 of the terminal device 10A may not present information regarding the presence or absence of a hint display in the terminal device 10A used by a user whose role is "search". In a certain aspect, the control unit 190 of the terminal device 10A may execute a process of increasing the "discovery" value and decreasing the "remaining" value in the achievement display section 1004 in response to receiving an approval operation from the user on the approval operation screen 1003.

[0140] In addition, in a certain aspect, terminal device 10A used by multiple users may share information with each other through network 80, a short-range communication system using a Bluetooth (registered trademark) module, etc., and share in real time the users' track records of discovering discovery objects.

[0141] This allows users with different roles to always share the search status. Therefore, a user with the role of "support" can support a user with the role of "search" while checking the time limit, the number of remaining objects to be found, etc.

[0142] FIG. 11 is an example of a screen displayed on the display 132 or the like when the time limit expires in an event in the terminal device 10A used by a user whose role is "search".

[0143] In Fig. 11, a time display section 1101 is a screen for displaying the current time and the time limit for an event, similar to the time display section 1001 in Fig. 10. In Fig. 11, the current time has passed the time limit, and the screen displays "Time Out."

[0144] The approval operation screen 1102, like the approval operation screen 1003 in Fig. 10, shows an operation screen for the user to approve the discovery of a discovery object. For example, the control unit 190 of the terminal device 10A accepts an approval operation from the user on this screen when the discovery object is within the shooting range and within the time limit. In Fig. 11, since "time out", the control unit 190 of the terminal device 10A does not accept an operation to shoot the discovery object for approval from the user. At this time, the control unit 190 of the terminal device 10A may perform a process of deactivating the button for shooting along with a display such as "The character in this area has escaped..." on the approval operation screen 1102.

[0145] This allows the user to feel a sense of tension as they search for the object to be found within the time limit, making the event more interesting. In addition, if the user is unable to be authenticated due to the time limit having elapsed, this is expected to encourage the user to try again in the event.

[0146] FIG. 12 is an example of a screen on which a hint as to where to place a discovery object is presented to a user in an image captured by some of a plurality of users of other users working on a task in an event.

[0147] In FIG. 12, a hint display 1201 shows hint information on the location where the discovery object is located. For example, the control unit 203 of the server 20 acquires the user's location information from the location information sensor 150 of the terminal device 10A. The control unit 203 of the server 20 presents hint information on the location where the discovery object is located, etc. to the terminal device 10A based on the acquired location information and the location information of the location where the discovery object is located. The control unit 190 of the terminal device 10A presents the hint information acquired from the server 20 to the user by displaying it on the display 132, etc. At this time, as information included in the hint information, not only information on the location where the discovery object is located but also information on the time period when the discovery object appears, for example, information on the time period when authentication is possible by the camera 160 of the terminal device 10A, etc. may be presented to the user. In a certain aspect, the control unit 109 of the terminal device 10A may not present the hint information to the user if the time limit has elapsed when the user arrives at the location where the discovery object is located. In addition, in some situations, the time limit for displaying the hint does not necessarily have to match the time limit for the area, and a time limit for displaying the hint may be set separately, and hint information may be presented to the user based on that setting.

[0148] This allows the user to obtain hints about the location of a discovery object that is placed in a difficult-to-find location, thereby increasing the possibility of discovering the discovery object. Also, by searching the surroundings in detail based on the hints, the user can get the feeling of a treasure hunt or exploration, further increasing the interest of the event. In addition, by searching together based on the hints, users with the role of "exploration" and users with the role of "support" can foster a sense of unity in progressing through the event.

[0149] In one aspect, the control unit 230 of the server 20 may execute a process of transmitting content obtained by adding images and the like to the content provided to the user on the day of the event to the user's terminal device 10A after a predetermined period of time has passed since the end of the event. For example, several days after the end of the event, information on the discovery object that the user could not find on the day of the event is added to the content provided to the user on the day of the event and provided to the user. Here, the information on the discovery object that the user could not find is, for example, as follows. Silhouette of the object that could not be found Information about the area where the undiscovered object is located -Silhouettes of discovery objects added after the event -Information about the areas where discovery objects added after the event are located

[0150] Furthermore, the control unit 230 of the server 20 may present the content or the like to the user in the following manner, instead of the content itself to which an image or the like has been added. · URL of the web page to view images, content, etc. -Images of two-dimensional codes for viewing images, content, etc. The control unit 230 of the server 20 may present images, contents, etc. to the user in the above manner even on the day of the event, at the event venue, etc. This allows the user to avoid displaying image files, etc., which have a large communication load, even in a situation where there is no communication environment such as Wi-Fi (Wireless Fidelity). Furthermore, the control unit 203 may determine whether to directly display images and contents or to display them in the above manner, based on the communication environment of the user's terminal device 10A.

[0151] This is expected to stimulate the user's motivation to participate in the event, which is expected to encourage the user to participate in the event repeatedly.

[0152] <Second embodiment> <Summary> In the first embodiment, a technology was described in which, at an event held in the real world, multiple other users take images of a user working on a task in the event, and in response to the progress of the event, content extracted from the captured images is provided to the user. In the second embodiment, a technology is described in which a camera attached to a discovery object placed within a certain space at an event held in the real world is used to capture an image of a user who searches for or discovers the discovery object, and content extracted from the captured image is provided to the user in response to the progress of the event. The object to be found may be equipped with cameras with various shooting ranges, such as a camera capable of shooting at a predetermined angle of view, a 180-degree camera, a 360-degree camera, etc. For example, if the object to be found is a character, a camera with a field of view corresponding to the field of view of the object to be found may be equipped with the camera. This allows the user to experience the image as if it were shot from the viewpoint of the object to be found.

[0153] In the second embodiment, the user is photographed by a camera provided on the discovery object while working on the task of the event. The server 20 extracts from the photographed image, for example, a state in which the user is close to the discovery object but is unable to find it, and a state when the user finds the discovery object, and presents the extracted images to the user. This allows the user to look back on the expression of joy or surprise when the user finds the discovery object, along with memories. In addition, by looking back on the state in which the user is searching near the discovery object, the user can look back on his / her own actions in the event and plan his / her actions when participating in the next event.

[0154] <3 operations> Below, we will explain the process in which system 1 uses a camera attached to a discovery object placed within a certain space to capture an image of a user who searches for or discovers the discovery object, and provides the user with content that is extracted from the captured image in response to the progress of the event.

[0155] FIG. 13 is a flowchart showing a process in which a camera equipped with a discovery object is used to capture images of a user within a certain space during a period in which the user is participating in an event and searching for the discovery object, and the captured images are provided to the user according to the progress of the event. Here, the object to be found may be equipped with a camera, for example, in the following manner. · Cameras that are physically installed inside or outside the object to be discovered. For example, if the object to be found is a three-dimensional object such as a stuffed toy, a camera may be physically installed inside the object to be found by embedding it in the mouth, eyes, or body surface of the character embodied in the stuffed toy. For example, if the object to be found is a three-dimensional object such as a stuffed toy, the camera may be placed along its surface, thereby physically placing the camera outside the object to be found. Here, the server 20 or the like may manage the information specifying the discovery object and the information specifying the camera without associating them with each other. That is, the server 20 or the like may manage the camera physically installed at the discovery object and the discovery object without associating them as data. On the other hand, the server 20 may manage the information specifying the discovery object and the information specifying the camera in association with each other. A camera that is installed physically away from the objects to be discovered, but is managed as data in a server 20 or the like, linked to each object to be discovered. For example, if the object to be found is a three-dimensional object or a two-dimensional representation drawn on a wall or the like, a camera may be installed around the object to be found. In other words, even if a camera is not physically installed on the object to be found, it may be considered that the object to be found is equipped with a camera. This allows the camera to capture images of a user who is searching for the object to be found, or a user at the time of discovering the object to be found.

[0156] In step S1351, the control unit 203 of the server 20 acquires a result of photographing a user who is in a certain space during a period in which the user participates in an event and searches for the discovery object 40, using the camera 401 provided in the discovery object 40. In a certain aspect, the control unit 203 of the server 20 may extract a specific state of the user at the event based on the result acquired from the camera 401. The state of the user is, for example, as follows. - Expressions of surprise or delight when discovering an object - Searching for the object to be discovered while in the vicinity of the object

[0157] Here, a method of determining the user's state will be illustrated. The control unit 203 of the server 20 performs image analysis on the results acquired from the camera 401 to identify the user's emotion, such as surprise, joy, etc., and extracts an image of the user showing the identified emotion. This allows the server 20 to provide the user with content that extracts the moment when the user discovered the discovery object, which can contribute to improving memory creation. At this time, the control unit 203 of the server 20 may extract the result based not only on the result of the image analysis, but also on the result of the server 20's determination that the user discovered the discovery object. Specifically, for example, the control unit 203 of the server 20 may measure the distance between the discovery object and the user using the camera 401, and when the distance is within a predetermined range, may extract a part of the acquired result as the state when the user discovered the discovery object based on the result of the image analysis described above.

[0158] In addition, the control unit 203 of the server 20 may obtain the result based on another method, instead of obtaining the result by image analysis based on the state of the moment when the user found the discovery object. For example, the control unit 203 of the server 20 may obtain the result of shooting the surroundings of the discovery object as a video by the camera 401 in advance, and when the user finds the discovery object, extract the shooting results before and after a predetermined period based on that time point. In addition, the processing may not be performed when the user finds the discovery object, but may be performed after the event has elapsed for a predetermined period. The server 20 may generate a video including before and after the timing when the user found the search object by extracting a still image or a video from the shooting results shot by the camera 401 based on the timing when the user found the search object (the timing when the user found the search object may be specified by the detection result of the user's emotion, or the timing when the user found the search object by an input operation to the terminal device 10).

[0159] Furthermore, the control unit 203 of the server 20 may obtain information on the line of sight of the user by the camera 401. Specifically, for example, the camera 401 is provided at the position of the eyes of the discovery object, and the control unit 203 of the server 20 determines that the user's line of sight is directed toward the discovery object when the user discovers the discovery object based on the information. The control unit 203 of the server 20 may extract a part of the obtained results based on the result of the image analysis and the information on the line of sight as a state when the user discovered the discovery object.

[0160] In a certain aspect, the camera 401 may not be fixedly installed at a predetermined position, for example, inside the discovery object, near the discovery object, etc. Specifically, for example, the camera 401 may be installed on an autonomously controllable mobile object, for example, a drone, etc. In this case, the camera 401 installed on the mobile object may not be linked to a specific discovery object. For example, the server 20 may appropriately switch the discovery object linked to the camera 401 installed on the mobile object. Examples of the server 20 switching the link between the camera 401 installed on the mobile object and the discovery object may include the following. Depending on whether the discovery object is found, the association between the discovery object and the camera 401 may be switched. For example, the server 20 may switch the association between the camera 401 and the discovery object in response to receiving, from the user's terminal device 10, an operation (such as an input operation to the terminal device 10) for reporting that the user has found the discovery object. The association between the discovery object and the camera 401 may be switched depending on whether the period during which the user searches for a particular discovery object exceeds a certain period. For example, there may be a case where multiple users are each trying to search for different discovery objects. The camera 401 installed on a moving object moves while switching the discovery object to which it is associated at regular intervals, thereby capturing images of multiple users trying to search for the discovery object. Depending on the distance between the object to be discovered and the camera 401 installed on the mobile body, the association between the object to be discovered and the camera 401 may be switched. The camera 401 installed on the autonomously controllable mobile body is connected to each object to be discovered by short-range communication such as Bluetooth (registered trademark), and when the distance between the mobile body and the object to be discovered is within a predetermined distance, the camera 401 may be temporarily associated with the object to be discovered.

[0161] In one aspect, the object to be found may be equipped with a microphone (not shown) and may acquire a voice when the user discovers the object to be found. The control unit 203 of the server 20 may extract a part of the acquired result from the image analysis result and the voice as a state when the user discovered the object to be found.

[0162] This allows the server 20 to present to the user content that extracts the state when the user discovered the discovery object, and therefore the user can look back on the event along with the emotions they felt when they discovered the discovery object, stimulating their desire to participate in the event again, and is expected to encourage repeat participation.

[0163] In addition, in a certain aspect, the control unit 203 of the server 20 may extract not only the state when the user found the discovery object from the camera 401, but also the state when the user is searching for the discovery object near the discovery object. Specifically, for example, the control unit 203 of the server 20 determines that the user has not found the discovery object even though he is near the discovery object when the distance between the discovery object and the user measured by the camera 401 is a predetermined distance and the control unit 203 determines that the user has not found the discovery object based on information such as the user's line of sight. Alternatively, the control unit 203 of the server 20 may analyze the image captured by the camera 401 and determine that the user was near the discovery object when a person is included as a subject exceeding a predetermined size. When the camera 401 can measure the distance to an object using a depth sensor or the like, the control unit 203 of the server 20 may determine that the user was near the discovery object based on the measurement result of the distance. Based on the determination, the control unit 203 of the server 20 presents the user with content extracted from the state of the user. Furthermore, by storing the captured image and the object ID of the discovered object in association with each other, the captured image can be presented to the user together with the object name. This allows the user to reflect on the disappointment of not being able to find the object even though they were close by, and also fosters a desire to find it next time, which is expected to encourage continued participation in the event. Furthermore, the control unit 203 of the server 20 may present the user with the result of photographing the object by the camera 401 when the distance from the object to be found is equal to or greater than a certain value. If the user is unable to approach the object to be found, the location of the object to be found can be suggested to the user after the fact.

[0164] In a certain aspect, the control unit 203 of the server 20 may obtain information on the discovery object that the user was able to discover through the event and the discovery object that the user was unable to discover, and present the information to the user together with the content. Specifically, the server 20 accepts an input operation for accepting an acknowledgement that the user has discovered the discovery object from the user's terminal device 10A, and determines that the user has discovered the discovery object based on the acceptance. In addition, the control unit 203 of the server 20 judges a discovery object for which no input operation has been accepted from the user even after the time limit set for each event has elapsed as a discovery object that the user was unable to discover in the event. Thereafter, the control unit 203 of the server 20 presents information on the discovery object that the user discovered and information on the discovery object that the user was unable to discover together with the content to the user.

[0165] This allows users to grasp not only content extracted from some of the images taken during the event, but also information about discovered and undiscovered objects. This allows users to know how much they discovered in one participation, or how much they have left to discover, which is expected to increase their desire to return to the event. In addition, in a certain aspect, when presenting information on a discovery object that the user was unable to find to the user, the control unit 203 of the server 20 may present the user with information on the area in which the discovery object is located, for example, information suggesting which range of the area the discovery object is located in, as a hint. This allows the user to know where the discovery object that the user was unable to find in the event that day is located, and therefore allows the user to consider in advance how to move the next time they participate in the event.

[0166] In a certain aspect, the hint or other information may be presented to the user when the event ends, or may be presented to the user a predetermined period of time after the event ends, for example, several days later, etc. This allows the event organizer to provide the user with an opportunity to look back on the memories of the event not only at the end of the event, but also some time after the event ends, which is expected to encourage the user to participate in the event again.

[0167] In step S1352, the control unit 203 of the server 20 presents the captured results to the user's terminal device 10A according to the progress of the event. The progress of the event is, for example, the end of the event, and the end of the event is, for example, the following timing. - The timing when all events held on that day have ended -The timing when exploration in each area where the event is held ends Here, the timing when the search in each area ends is, for example, as follows. -When the event time limit ends During an event, when a user discovers all discovery targets placed in an area before the time limit expires

[0168] In step S1301, the control unit 190 of the terminal device 10A presents the provided content to the user by displaying it on the display 132, for example.

[0169] Figure 14 is a flowchart showing a process in which a camera equipped with a discovery object captures images of users within a certain space during a period in which users are participating in an event and searching for the discovery object, and images captured by some of the multiple users of other users searching for the discovery object at the event, and the captured images and content extracted from some of the images are provided to users according to the progress of the event.

[0170] In step S1401, the control unit 190 of the terminal device 10A acquires an image captured by some of the multiple users of the other users searching for a discovery object in the event, and transmits the image to the server. Specifically, for example, the terminal device 10A acquires an image of the other users working on a task of the event, for example, searching for a discovery object, by the camera 160 of the terminal device 10A or the like in response to an operation by the user. The terminal device 10A transmits information on the acquired image to the server 20.

[0171] In step S1451, the control unit 203 of the server 20 presents content obtained by extracting a part of the acquired image and the captured result according to the progress of the event. In a certain aspect, the control unit 203 of the server 20 may present to the user the image capturing time of the image acquired from the user's terminal device 10A and the image capturing time of the result acquired from the camera 401 in association with each other. This allows the user to look back as a memory on what the discovered object looked like when they were searching in the event.

[0172] <4 Screen example> FIG. 15 shows an example of a screen that presents to the user content that shows the user searching for a discovery object in an event, extracted from the results of photography by a camera 401 attached to the discovery object.

[0173] 15, content 1501 indicates content extracted by the control unit 203 of the server 20 showing a user searching for a discovery object near the discovery object at an event from the results of shooting by the camera 401. The control unit 190 of the terminal device 10A presents the content to the user by displaying it on the display 132, for example.

[0174] Users 1503 and 1504 are users whose role is "search" and who are searching for a discovery object in the event. In the content 1501, users 1503 and 1504 indicate a situation in which they have not found the discovery object and are searching nearby.

[0175] Content 1502 indicates content extracted by the control unit 203 of the server 20 of a state in which a user discovered a discovery object at an event from the results of photographing by the camera 401. The control unit 190 of the terminal device 10A presents the content to the user by displaying it on the display 132, for example.

[0176] User 1503 is a user whose role is "search", similar to user 1503 in content 1501. In content 1502, user 1503 discovers a discovery object. Control unit 203 of server 20 extracts, from the image captured by camera 401 provided on the discovery object, the state when user 1503 discovered the discovery object, as in content 1502.

[0177] FIG. 16 shows an example screen in which content extracted from images captured by a camera 401 attached to the discovery object, such as images of a user searching for a discovery object at an event, is presented to the user along with information on the discovery objects that the user discovered at the event and on discovery objects that the user was unable to discover.

[0178] 16, contents 1601 and 1602 indicate contents extracted by the control unit 203 of the server 20 from the results of photography by the camera 401, such as a state in which a user searches for a discovery object near a discovery object at an event and a state in which the user discovered the discovery object, together with information on the discovery object that the user discovered at the event and the discovery object that the user could not discover, etc. The control unit 190 of the terminal device 10A presents the content to the user by, for example, displaying it on the display 132.

[0179] The content 1601 presents to the user information about the discovery object that the user discovered and information about the discovery object that the user could not discover, together with content extracted from the state in which the user searches for the discovery object near the discovery object at the event and the state in which the user discovered the discovery object, etc. At this time, the control unit 190 of the terminal device 10A may obtain information about the discovery object that the user could not discover, such as the name and information suggesting the location, from the server 20, and present it to the user.

[0180] This allows the user to look back on which discovery objects the user has found, and which discovery objects the user has not found, through the event, together with the state of the user's search in the event. Therefore, the user can not only vividly look back on the memories of the event, but also improve his or her motivation to participate in the next event. Therefore, it is expected that the user will continue to participate in the event. Here, the content may be presented to the user upon the end of each area in the event, or upon the end of the entire event. In a certain aspect, the control unit 203 of the server 20 may transmit to the terminal device 10 only information on the discovery objects the user has found on the day of the event, and may transmit to the terminal device 10 information on the discovery objects the user has not found after a predetermined period of time has passed since the event. This allows the event organizer to provide the user with an opportunity to look back on the event even after the event has ended, and encourage the user to participate in the event again.

[0181] Content 1602 presents to the user information about the discovery object discovered by the user and information about the discovery object located in the next area, together with content extracted from the state in which the user searches for the discovery object near the discovery object in the event and the state in which the user discovered the discovery object. At this time, the control unit 190 of the terminal device 10A may obtain information about the discovery object located in the next area, such as a name, from the server 20 and present it to the user. At this time, the control unit 190 of the terminal device 10A may display the discovery object as a silhouette, etc.

[0182] This allows the user, for example, when only the silhouette of an object to be found located in the next area is displayed, to tackle the next area while predicting the details of the object to be found, making the event more interesting.

[0183] FIG. 17 shows an example screen in which content extracted from images captured by a camera 401 attached to the discovery object, such as the user searching for the discovery object at the event, is presented to the user along with content extracted from a portion of an image captured by the user showing other users working on the event's tasks.

[0184] In FIG. 17, the control unit 203 of the server 20 presents, for example, the following content 1701 to the user. Content extracted from the results of photographing by the camera 401, such as a state in which a user searches for a discovery object near the discovery object at an event, and a state in which the user discovers the discovery object Content that extracts a portion of an image taken by a user of another user working on a task at an event The control unit 190 of the terminal device 10A presents the content to the user by, for example, displaying it on the display 132. In a certain aspect, the control unit 190 of the terminal device 10A may obtain, from the server 20, information on a discovery object that the user discovered in an event or a discovery object that the user could not discover, as illustrated in Figs. 15 and 16, and present the information to the user together with the content.

[0185] This allows users to look back on various memories from the event from a single piece of content, which can lead to deeper memories of the event, such as the user having enjoyed it, and is expected to encourage repeat participation in the event, such as wanting to participate again.

[0186] <Third embodiment> In the second embodiment, a technology has been described in which a camera attached to a discovery object placed within a certain space at an event held in the real world is used to capture an image of a user who searches for or discovers the discovery object, and content extracted from the captured image is provided to the user in response to the progress of the event. In the third embodiment, a technology is described in which, at an event held in the real world, input operations are accepted from a user in accordance with the progress of the event tasks, and upon completion of the event, the results of the user's progress in the event tasks are presented to the user. In the third embodiment, the number of users participating in the event does not necessarily need to be multiple, and a single user may participate. Users may not only form a team of multiple users to tackle the event challenges, but also tackle the event challenges individually. This allows users to compete with other users in terms of how well they are tackling the challenges. In addition, the organizer of the event may present specific rewards, etc. (items that allow users to progress through the event with an advantage, etc.) to users who participate individually.

[0187] In the third embodiment, the terminal device 10A accepts a predetermined input operation from the user according to the progress of the task of the event. Specifically, for example, when the user discovers a discovery object in the event, the input operation is for accepting an acknowledgment of the discovery. By this operation, the user is acknowledged for discovering the discovery object in the event. The terminal device 10A transmits to the server 20 a notification that the input operation for the acknowledgment has been accepted. The server 20 stores in the storage unit 202, based on the acknowledgment information acquired from the terminal device 10A, that the user has discovered the discovery object. Thereafter, in response to the end of the event, the server 20 presents to the terminal device 10A the discovery objects for which the server 20 has received an input operation for approval from the user as discovery objects discovered by the user, and the discovery objects for which the server 20 has not received the input operation as discovery objects not discovered by the user. The terminal device 10A presents this information to the user.

[0188] This allows the user to check their performance in the event like a report card when the event ends. Therefore, the user can look back and see that the number of discoveries was less than the total number of discovery objects placed in the area, or that they were close to discovering all of the discovery objects, etc., which is expected to increase the user's motivation to participate in further events.

[0189] <3 operations> FIG. 18 is a flowchart showing a process for accepting input operations from a user in response to the progress of an event task held in the real world, and presenting the user with the results of the progress made in the event task upon completion of the event.

[0190] In step S1801, the control unit 190 of the terminal device 10A accepts an input operation for acknowledging the discovery of a discovery object by the user as an input operation according to the progress of the task of the event. The control unit 190 of the terminal device 10A transmits the accepted result to the server 20. Specifically, for example, the control unit 190 of the terminal device 10A photographs the discovery object by the camera 160 or the like, and transmits the photographed image to the server 20. The control unit 203 of the server 20 acknowledges that the user has discovered the discovery object based on the accepted image. The server 20 may determine a discovery object for which an input operation for the acknowledgement has been accepted as a discovery object discovered by the user, and a discovery object for which the operation has not been accepted within the time limit of the event as a discovery object that the user has not been able to discover.

[0191] In step S1851, the control unit 203 of the server 20 presents to the user, in response to the end of the event, information on discovery objects for which an input operation for approval from the user has been received as a result of the user's progress in the task of the event, and information on discovery objects for which an input operation for approval from the user has not been received. The end of the event occurs at the following timing. - The timing when all events held on that day have ended -The timing when exploration in each area where the event is held ends Here, the timing when the search in each area ends is, for example, as follows. -When the event time limit ends During an event, when a user discovers all discovery targets placed in an area before the time limit expires

[0192] In step S1802, the control unit 190 of the terminal device 10A presents the presented results to the user by displaying them on the display 132, for example.

[0193] In this way, the server 20 can allow the user to visually confirm the user's achievements in the event as the event ends, which allows the user to reflect on his or her own actions in the event and increase the desire to participate in the next event. In a certain aspect, the server 20 may present to the user images of the user working on the event task, images of the user discovering the discovery object, etc., captured by the camera 401 provided on another user or the discovery object, together with the user's achievements in the event. The server 20 may also present to the user information suggesting an area where the discovery object that the user was unable to discover is located, together with the user's achievements in the event.

[0194] <4 Screen example> FIG. 19 shows an example of a screen on which, upon completion of an event, information on discovery objects that the user has discovered and discovery objects that the user has not been able to discover is presented to the user.

[0195] In FIG. 19, content 1901 indicates content for the control unit 203 of the server 20 to present to the user information on discovery objects discovered by the user at the event and discovery objects that the user could not find in the event in response to the end of the event. The control unit 190 of the terminal device 10A presents the content to the user by displaying it on the display 132, etc. In a certain aspect, the server 20 may present information on discovery objects that the user discovered or could not find in the form of a list to the user, or may present the information to the user in a different display mode. The different display modes include, for example, displaying discovery objects discovered by the user and discovery objects that the user could not find in different tabs, windows, etc., displaying only discovery objects that the user could not find in silhouette, etc., and are not limited thereto.

[0196] This allows the user to grasp both the discovery objects that were found and those that were not found during the event, and therefore allows the user to know how many more discovery objects the user needs to find in order to find all of the discovery objects, which is expected to increase the user's motivation to participate in the next event.

[0197] Figure 20 shows an example screen that presents the user with information regarding a discovery object that the user was unable to find upon the end of an event, along with information suggesting the area in which the discovery object is located, and content that extracts a portion of an image captured by the discovery object.

[0198] 20, contents 2001 and 2002 indicate contents for the control unit 203 of the server 20 to present to the user, upon completion of the event, information regarding a discovery object that the user was unable to discover in the event, together with information suggesting the area in which the discovery object is located, and contents in which a portion of an image captured of the discovery object is extracted, etc. The control unit 190 of the terminal device 10A presents the content to the user by displaying it on the display 132, etc. For example, in content 2001, information on a discovery object that the user was unable to discover in an event is presented to the user along with information suggesting the area in which the discovery object is located. In content 2002, information on a discovery object that the user was unable to discover in an event is presented to the user along with information suggesting the area in which the discovery object is located and content that extracts a portion of an image captured by the discovery object. In a certain aspect, the content is not limited to being presented on the day the event is held, but may be presented to the user after a predetermined period has elapsed since the end of the event.

[0199] This allows users to look back on their actions during the day and guess where objects they were unable to find were located after the event has ended. This allows users to plan their movements in advance when participating in the next event, which is expected to promote continued participation in events.

[0200] FIG. 21 shows an example screen that presents the user with information regarding a discovery object that the user was unable to find upon the end of an event, together with information suggesting the area in which the discovery object is located and information regarding the user's range of movement within that area.

[0201] 21, content 2101 indicates content for the control unit 203 of the server 20 to present to the user, upon completion of the event, information on a discovery object that the user was unable to discover, together with information suggesting the area in which the discovery object is located and information on the user's range of movement in that area. The control unit 190 of the terminal device 10A presents the content to the user by displaying it on the display 132, etc. For example, the server 20 acquires information on the range where the user acted during the event from the position information sensor 150 of the terminal device 10A. After that, the control unit 203 of the server 20 may create content in which the user's range of action is superimposed on a map of the area of ​​the event based on the acquired position information, and present the content to the user.

[0202] This allows the user to compare the information about the area where the discovery object that the user was unable to find in the event is located with the user's own range of movement in that area, so that the user can plan to search in a different range of movement the next time they try, which encourages continuous participation in the event.

[0203] Figure 22 shows an example screen that presents information to the user about the discovery object discovered by the user, as well as information about discovery objects that are scheduled to be added at the next event after a specified period of time has passed since the end of the event, new tasks for the next event, etc.

[0204] 22, content 2201 indicates content for the control unit 203 of the server 20 to present to the user information on a discovery object discovered by the user, information on a discovery object to be added in the next event after a predetermined period has elapsed since the end of the event, information on a new task in the next event, etc. The control unit 190 of the terminal device 10A presents the content to the user by displaying it on the display 132, etc. Specifically, the control unit 203 of the server 20 presents the content based on information on a discovery object to be added in the next event, which is stored in the storage unit 202. Alternatively, the control unit 203 of the server 20 may present a stopped content to the user in response to, for example, the following operations: · The event manager adds information about the discoverable objects added in the new event to the database. An operation in which an event manager adds information about a new discovery object in an event stored in the storage unit 202 by operating a flag or the like. The control unit 203 of the server 20 presents the content including the information on the discovery object added by the above operation to the user.

[0205] In one aspect, the control unit 203 of the server 20 may notify a user who has previously participated in an event of the next event together with information on the progress of the user in the event in response to receiving an input operation for sending a notification to the user from the event manager. The notification may be sent not only on the day of the event, but also after a predetermined period of time has passed since the event. Furthermore, the control unit 203 of the server 20 may automatically send the notification to the user in response to the event manager performing the above-mentioned adding operation, without receiving an input operation for sending the notification from the event manager.

[0206] This allows the user to obtain information about the next event even after the event has ended, and to look back on the events of the day. This allows the user to relive the series of experiences that took place throughout the event over and over again. Furthermore, by obtaining information about objects to be discovered that will be added in the next event, and about the tasks that will be presented in the next event, the user's motivation to participate in the next event increases. This is expected to encourage continued participation in events.

[0207] <5. Variations> A modified example of this embodiment will be described below. That is, the following aspects may be adopted. (1) An information processing device in which the program may be pre-installed or may be installed later, such a program may be stored on an external non-transitory storage medium, or may be operated by cloud computing. (2) A method in which a computer functions as an information processing device, and the program may be pre-installed on the information processing device or may be installed later, such a program may be stored on an external non-transitory storage medium, or may be run by cloud computing.

[0208] In a series of embodiments, a method has been described in which the control unit of the server 20 uses existing image analysis or the like as a process for analyzing images, etc. acquired from the terminal device 10A or the camera 401 provided on the discovery object. However, the image analysis method is not limited to this. For example, the server 20 may have the storage unit 202 learn a predetermined trained model, and may create content in which a part of the image, etc. acquired from the terminal device 10 or the camera 401 is extracted based on the trained model. Here, the server 20 may have trained information on discovery objects arranged in an event, information associating the facial expressions, voices, gestures, etc. of multiple people with emotions, etc., and may extract a part of the image, etc. from the acquired image, etc. based on the trained model.

[0209] The content presented to the user may be a combination of the contents exemplified in the series of embodiments, and is not limited to the combination of the screen examples exemplified in each embodiment. For example, in the first embodiment, when an image of a user taking a picture of another user working on a task of an event by some of the multiple users is presented to the user, information on the user's range of movement, etc. may also be presented. In addition, the content presented to the user may be digital data displayed on the display of the terminal device, or may be printed and output on printing paper, etc. based on the information.

[0210] <6 Notes> The matters described in the above embodiments will be supplemented below.

[0211] (Appendix 1) A program for operating a computer 20 to assist in the progress of an event in which a user searches for discovery objects placed within a certain space in the real world, the program causing a processor 29 of the computer 20 to execute a step (S1801) of accepting an input operation by a user on a terminal operated by the user in accordance with the progress of the event task, and a step (S1851) of presenting to the user the results of the user's progress in the event task upon the end of the event.

[0212] (Appendix 2) The program according to appended claim 1, wherein in the step (S1801) of accepting an input operation, the program accepts an input operation for acknowledging that a discovery object has been discovered, as an input operation corresponding to a progress status of a task of the event on a terminal operated by the user. (Paragraphs 0189 to 0193)

[0213] (Appendix 3) The program according to appendix 2, wherein in the presenting step (S1851), the program presents to the user both information on discovery objects for which an input operation for approval from the user has been received as a result of the user's progress in the task of the event, and information on discovery objects for which an input operation for approval from the user has not been received (paragraphs 0194 to 0196).

[0214] (Appendix 4) The program according to appendix 2 or 3, wherein in the presenting step (S1851), the program presents to the user information on a discovery object that has not yet accepted an input operation for approval from the user as a result of the user's progress in the task of the event, together with information on an area in which the discovery object is installed (paragraphs 0197 to 0199).

[0215] (Appendix 5) The event is an event where a plurality of users gather and move around while searching for a discovery object placed within a certain space, and the program further causes the processor 29 to execute a step of acquiring user position information and a video or still image taken by the user of other users searching for a discovery object in the event, and in the step of presenting (S1851), as a result of the user progressing through the task of the event, a part of the taken video or still image related to the position information and information on the discovery object that has not accepted an input operation for approval from the user in the position information are presented to the user. (Paragraphs 0197 to 0199)

[0216] (Appendix 6) The program further causes the processor 29 to execute a step of acquiring user position information and identifying the user's action range in the event, and in the step of presenting (S1851), presents to the user both the information on the action range and information on discovered objects in the action range that have not accepted an input operation for approval from the user as a result of the user's progress in the task of the event. (Paragraphs 0200 to 0202)

[0217] (Appendix 7) The computer 20 stores, in the storage unit 202, information on discovery objects to be added in the event held after the event, and in the presenting step (S1851), the program presents to the user both the results of the task progress and the information on the discovery objects to be added in the event held after the event. (Paragraphs 0203 to 0206)

[0218] (Appendix 8) The program further causes the processor 29 to execute a step of accepting, from a user who manages the event, either information on a discovery object to be added in an event to be held after the event, or information on a new discovery object to be added in an existing event, and in the step of presenting, the program presents to the user both the result of the task progress and the accepted information on either the discovery object to be added in an event to be held after the event, or the new discovery object to be added in an existing event. (Paragraphs 0203 to 0206)

[0219] (Appendix 9) The program according to any one of appendices 1 to 8, further comprising causing the processor 29 to execute a step of identifying a predetermined task for an event to be held after the event based on the result of the task progress, and presenting both the result of the task progress and the predetermined task to the user in a presenting step (S1851). (Paragraphs 0203 to 0206)

[0220] (Appendix 10) A method for operating a computer 20 to assist in the progress of an event in which a user searches for discovery objects placed within a certain space in the real world, the method comprising the steps of causing a processor 29 of the computer 20 to execute the following steps: accepting an input operation by a user on a terminal operated by the user in accordance with the progress of the event task (S1801); and presenting to the user the results of the user's progress in the event task upon the end of the event (S1851).

[0221] (Appendix 11) An information processing device 20 having a control unit 203 for supporting the progress of an event in which a user searches for discovery objects placed within a certain space in the real world, wherein the control unit 203 executes a step (S1801) of accepting an input operation by the user on a terminal operated by the user in accordance with the progress of the event task, and a step (S1851) of presenting to the user the results of the user's progress in the event task upon the end of the event. [Explanation of symbols]

[0222] 10 terminal device, 12 communication interface, 13 input device, 14 output device, 15 memory, 16 storage unit, 19 processor, 20 server, 22 communication interface, 23 input / output interface, 25 memory, 26 storage, 29 processor, 40 discovered object, 80 network, 181 user information, 191 input operation reception unit, 192 transmission / reception unit, 193 data processing unit, 194 notification control unit, 132 display, 150 position information sensor, 160 camera, 281 event information database, 282 participant information database, 283 object information database, 284 hint information database, 285 event history database, 401 camera, 2041 reception control module, 2042 transmission control module, 2043 event information acquisition module, 2044 participant information acquisition module, 2045 object information acquisition module, 2046 hint information acquisition module, 2047 Object display module, 2048 hint presentation module, 2049 approval acceptance module.

Claims

1. A program for operating a computer to support the progress of an event in which a user searches for a discovery object placed within a certain space in the real world, comprising: The program causes a processor of the computer to: receiving an input operation by the user on a terminal operated by the user according to a progress status of a task of the event; and presenting to the user a result of the user's progress in completing the task of the event upon completion of the event.

2. In the step of receiving the input operation, the program 2 . The program according to claim 1 , further comprising: receiving an input operation by the user for acknowledging that the discovery object has been discovered as an input operation corresponding to a progress status of a task of the event on a terminal operated by the user.

3. In the presenting step, the program The program of claim 2, further comprising: presenting to the user, as a result of the user's progress in completing the task of the event, both information about the discovery objects for which an input operation for approval from the user has been received, and information about the discovery objects for which an input operation for approval from the user has not been received.

4. In the presenting step, the program The program of claim 2 or 3, wherein, as a result of the user's progress in completing the event task, information about the discovery object that has not accepted an input operation for approval from the user and information about the area in which the discovery object is located are presented to the user.

5. The event is an event in which a plurality of users gather and move around to search for discovery objects installed within a certain space, The program further causes the processor to acquiring location information of the user and video or still images taken by the user of other users searching for the discovery object at the event; In the presenting step, A program as described in any one of claims 2 to 4, which presents to the user, as a result of the user's progress in the event task, a portion of the captured video or still image related to the location information, and information about the discovered object at the location information that has not accepted an input operation for approval from the user.

6. The program further causes the processor to acquiring location information of the user and identifying a range of movement of the user during the event; In the presenting step, A program as described in any one of claims 2 to 5, which presents to the user, as a result of the user's progress in the event task, both information about the movement range and information about the discovered object within the movement range that has not accepted input operation for approval from the user.

7. the computer causes a storage unit to store information on the discovery object to be added in an event to be held next to the event; In the presenting step, the program 7. The program according to claim 1, further comprising: presenting to the user both the result of the progress of the task and information on the discovery object to be added in an event to be held next to the event.

8. The program further causes the processor to receiving, from a user who manages the event, either information on the discovery object to be added in an event to be held next to the event, or information on a new discovery object to be added in the existing event; In the presenting step, the program A program as described in any one of claims 1 to 6, which presents to the user the results of the progress of the task and information on either the discovery object that will be added to the event to be held next after the event that was accepted, or the discovery object that will be newly added to the existing event.

9. The program further causes the processor to Executing a step of identifying a predetermined task in an event to be held next to the event based on a result of the progress of the task; 9. The program according to claim 1, wherein in the presenting step, both the result of the task progress and the predetermined task are presented to the user.

10. A method for operating a computer to support a progress of an event in which a user searches for a discovery object placed in a certain space in the real world, comprising: The method further comprises the steps of: receiving an input operation by the user on a terminal operated by the user according to a progress status of a task of the event; and presenting to the user a result of the user's progress in completing a task of the event upon completion of the event.

11. An information processing device including a control unit for supporting the progress of an event in which a user searches for a discovery object installed in a certain space in the real world, The control unit: receiving an input operation by the user on a terminal operated by the user according to a progress status of a task of the event; and presenting to the user a result of the user's progress in completing a task of the event in response to the end of the event.

Images