Program, method, and information processing device

Abstract

To provide a technology that further enhances the memories of users who participate in an event. [Solution] A program for operating a computer to assist in the progress of an event in the real world in which a user group made up of multiple users participates, the program causing the computer's processor to perform the following steps: acquiring a first video or still image taken by a first terminal operated by a first user in the user group, the first video or still image including other users working on the event's tasks; and, in response to the user group progressing the event, making at least some of the content of the first video or still image available to a second terminal operated by a second user in the user group.

Description

[Technical Field]

[0001] The present disclosure relates to a program, a method, and an information processing device. [Background technology]

[0002] 2. Description of the Related Art Techniques for photographing passengers on attractions at theme parks and other facilities are known.

[0003] Patent Document 1 describes a technology that takes an image of a moment when a passenger rides an attraction such as a roller coaster at a theme park, extracts an image of the passenger from the image, and provides an image synthesized with a template. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2004-228637 Summary of the Invention [Problem to be solved by the invention]

[0005] In the technology of Patent Document 1, passengers are automatically moved along a predetermined route, such as a roller coaster, and the passengers are photographed by a camera that photographs a predetermined position on the route. On the other hand, in the real world, there are events in which multiple users participate and each user freely explores within a certain geographical area. In such exploration-type events, even if cameras are installed in advance within the geographical area to be explored, the larger the geographical area, the more cameras will need to be installed, which increases the event's operating costs and may make it difficult to continue operating the event. Therefore, there is a need for technology that can further enhance the memories of users who participate in search-based events. [Means for solving the problem]

[0006] According to one embodiment, a program is provided for operating a computer to assist in the progress of an event in the real world in which a user group consisting of multiple users participates, the program causing the computer's processor to perform the following steps: acquiring a first video or still image taken by a first terminal operated by a first user in the user group, the first video or still image including other users working on a task in the event; and, in response to the user group progressing the event, making at least some of the content of the first video or still image available to a second terminal operated by a second user in the user group. [Effects of the Invention]

[0007] According to the present disclosure, it is possible to provide a technology that further enhances the memories of users who participate in a search-based event. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a block diagram showing the overall configuration of a system 1. [Figure 2] FIG. 2 is a diagram illustrating a functional configuration of a terminal device 10. [Figure 3] FIG. 2 is a diagram showing the functional configuration of a server 20. [Figure 4] 1 shows the data structure of an event information database (DB) and a participant information DB stored in the storage unit of the server 20. [Figure 5] 1 shows the data structures of an object information DB, a hint information DB, and an event history DB stored in the storage unit of the server 20. [Figure 6] A flowchart showing a process in which some of a plurality of users acquire images of other users working on challenges in an event, and content extracted from a portion of the first image is provided to the plurality of users in response to the plurality of users progressing through the event. [Figure 7]A flowchart showing a process of acquiring images taken by some of a plurality of users of other users working on challenges in an event, determining the progress of the event based on approval of discovered objects contained in the captured images, and providing content extracted from a portion of the first image to the plurality of users in response to the plurality of users progressing through the event. [Figure 8] FIG. 1 is an overview of events provided by the system 1. [Figure 9] 10 is a screen example of an image captured by some of a plurality of users of another user working on a task in an event. [Figure 10] 10 is an example of a screen when an approval operation for a discovered object is performed. [Figure 11] 10 is an example of a screen displayed on a terminal used by a user when a time limit has expired in an event. [Figure 12] 10 is an example of a screen that shows a user a hint as to where to place a discovery object in an image taken by some of a plurality of users of another user working on a task in an event. [Figure 13] This is a flowchart showing a process in which a camera equipped with a discovery object is used to capture images of a user within a certain space during a period in which the user participates in an event and searches for the discovery object, and the captured images are provided to the user according to the progress of the event. [Figure 14] This is a flowchart showing a process in which a camera equipped with a discovery object captures images of users within a certain space during a period in which users participate in an event and search for the discovery object, and images captured by some of multiple users of other users searching for the discovery object at the event, and the acquired images and content extracted from some of the images are provided to users according to the progress of the event. [Figure 15] This is an example of a screen that presents to the user content extracted from the results of photography taken by a camera 401 attached to the discovery object, showing the user searching for the discovery object at the event. [Figure 16] This is an example screen that presents content extracted from images taken by a camera 401 attached to the discovery object, such as images of a user searching for a discovery object at an event, to the user, along with information about the discovery objects that the user discovered at the event and the discovery objects that the user was unable to find. [Figure 17] An example screen in which content extracted from the results of photographs taken by a camera 401 attached to the object to be discovered, such as a state in which a user is searching for an object to be discovered at an event, is presented to the user along with content extracted from a portion of an image taken by the user of other users working on the event's tasks. [Figure 18] This is a flowchart showing a process for accepting input operations from a user in accordance with the progress of the event tasks at an event held in the real world, and presenting the results of the user's progress in completing the event tasks to the user upon the end of the event. [Figure 19] 10 is an example of a screen that presents the user with information about discovery objects that the user has discovered and discovery objects that the user has not been able to discover, upon completion of the event. [Figure 20] This is an example screen that presents the user with information about the discovery object that the user was unable to find upon the end of the event, along with information suggesting the area in which the discovery object is located and content that extracts a portion of an image taken of the discovery object. [Figure 21] This is an example screen that presents the user with information about discovery objects that the user was unable to find upon the end of an event, along with information suggesting the area in which the discovery objects are located and information about the user's range of movement in that area. [Figure 22] This is an example screen that presents information to the user about the discovery object that the user has discovered, as well as information about discovery objects that are scheduled to be added in the next event after a specified period of time has passed since the end of the event, new tasks for the next event, etc. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. In the following description, the same components are denoted by the same reference numerals. The names and functions of the components are also the same. Therefore, detailed description thereof will not be repeated.

[0010] First Embodiment <Summary> The following embodiment describes a technology in which, at an event held in the real world, multiple other users take images of a user working on a task in the event, and, in response to the progress of the event, provide the user with content extracted from the captured images. Here, the devices etc. that are used as appropriate during the progress of the event may be terminal devices such as smartphones or tablet devices that the user owns, or they may be presented by terminal devices installed at the venue where the event is held.

[0011] Generally, in facilities such as theme parks, photos taken when riding an attraction or experiencing an event are often intended to capture a user's facial expression of surprise, fear, etc. Therefore, the user may end up with the same facial expression every time the photo is taken, which may make the photo boring and may prevent the user from maintaining motivation to experience the experience again and again.

[0012] In addition, in the above case, the camera that photographs the user is mainly operated by the theme park, and there is a possibility that the image will not be captured at the timing or with the desired facial expression of the user. For example, the state of being engrossed in an event or the expression of joy that may be expressed spontaneously when discovering something will not be captured, making it difficult to reminisce about the photo along with memories.

[0013] Therefore, System 1 provides a technology for operating a computer to support the progress of an event in the real world in which a user group made up of multiple users participates, the program causing the computer processor to execute the following steps: acquiring a first video or still image captured by a first terminal operated by a first user in the user group, the first video or still image including other users working on the event tasks; and making at least a portion of the content of the first video or still image available to a second terminal operated by a second user in the user group in response to the user group progressing the event.

[0014] (1) In a search-type event, images taken by some users of other users are extracted and presented to users according to the progress of the event, such as at breakpoints. System 1 acquires images of users working on tasks at an event using a terminal device such as a smartphone owned by the user or a terminal (smartphone, tablet, etc.) loaned to the user by the event organizer. For example, some users among multiple users take photos of other users working on tasks at an event. System 1 provides users with content extracted from the acquired images based on the progress of the event and the acquired images. This allows users to obtain content based on images capturing various expressions while participating in the event, further enhancing their memories of the event and encouraging repeat participation in the event.

[0015] As described above, the system 1 provides a technique that further enhances the memories of users who participate in an event.

[0016] System 1 can be used, for example, at an event venue held in the real world. The event is, for example, a search-type event in which multiple users search for discovery objects in the real world. In the event, the geographical area to be searched may include grass, trees, walls, ground, buildings, water surfaces, props, and the like, and the multiple users search for discovery objects hidden in these natural and artificially placed objects. In the event, a certain geographical area is defined as an area, and multiple areas are explored in sequence, with the multiple users searching for discovery objects hidden in each area. Each user participating in the event searches for discovery objects in each area, referring to hints (information suggesting where the discovery objects are hidden) distributed at the time of participation in the event, sometimes consulting with other users. On the other hand, among the multiple users participating in the event, some users wish to record their exploration. For example, suppose the object to be discovered represents a character that appears in content based on an original work, such as a novel or game, and a user who is a fan of that content wishes to participate in the event. In contrast, some users wish to participate in the event and record the exploration activities of the fan user. For example, if a child wishes to participate in the event, the child's parent may wish to record the child's exploration at the event. Therefore, some of the users use their own terminal devices to take images of other users working on the tasks of the event. System 1 presents content extracted from images acquired from the user's device and the progress of the event, such as photos showing the user's facial expressions at various times during the event, to the user's device. This allows the user to repeatedly look back on what happened at the event and what expressions the user had, enhancing the memories of the event. It is possible that users exploring the event may take selfies with their smartphones or take photos with a camera capable of capturing a wide range of images, such as a 360-degree camera, while exploring. (2) In exploration-type events, some users can use terminal devices to obtain information (such as hints) to assist in the progress of the event. System 1 presents information to users participating in an event to assist them in finding the object to be found, which is the goal of the event, via the terminal device of the user. For example, some users participating in the event can take pictures of other users with a smartphone or the like while obtaining information about the object to be found (such as information suggesting a hidden location) on the smartphone. This allows the user taking the photo to provide hints to other users searching for the object to be discovered at the event, and while taking photos of other users to preserve memories, the user can participate in the event together in the role of a supporter who supports the other users, further enhancing the sense of unity that occurs when multiple users participate in the event. For example, if the object to be discovered is a character that appears in content, even if a user has relatively less interest in the content than a user who enjoys exploring, the user can participate in the event motivated by wanting to take photos and record the users who enjoy exploring, and can play a role in supporting the progress of the event.

[0017] <1 Overall system configuration> FIG. 1 shows the overall configuration of a system 1 according to the first embodiment.

[0018] As shown in Fig. 1, the system 1 includes a plurality of terminal devices (Fig. 1 shows terminal device 10A and terminal device 10B; hereinafter, these may be collectively referred to as "terminal device 10"), a server 20, and a plurality of discovery objects 40. The discovery objects 40 may be equipped with a camera 401 and a sensor 402. The terminal devices 10, the cameras 401 equipped in the discovery objects 40, and the server 20 are communicatively connected via a network 80.

[0019] The terminal device 10 is a device operated by each user. The terminal device 10 is realized by a mobile terminal such as a smartphone or tablet compatible with a mobile communication system. Alternatively, the terminal device 10 may be, for example, a stationary personal computer (PC), a laptop PC, or a data terminal installed at an event venue. As shown as terminal device 10B in FIG. 1, the terminal device 10 includes a communication IF (Interface) 12, an input device 13, an output device 14, a memory 15, a storage unit 16, and a processor 19. The server 20 includes a communication IF 22, an input / output IF 23, a memory 25, a storage 26, and a processor 29.

[0020] The terminal device 10 is communicatively connected to the server 20 via a network 80. The terminal device 10 is connected to the network 80 by communicating with communication devices such as a wireless base station 81 conforming to communication standards such as 5G and LTE (Long Term Evolution), and a wireless LAN router 82 conforming to a wireless LAN (Local Area Network) standard such as IEEE (Institute of Electrical and Electronics Engineers) 802.11.

[0021] The communication IF 12 is an interface for inputting and outputting signals so that the terminal device 10 can communicate with external devices. The input device 13 is an input device (e.g., a touch panel, a touch pad, a pointing device such as a mouse, a keyboard, etc.) for receiving input operations from a user. The output device 14 is an output device (e.g., a display, a speaker, etc.) for presenting information to a user. The memory 15 is for temporarily storing programs and data processed by the programs, etc., and is a volatile memory such as a DRAM (Dynamic Random Access Memory). The storage unit 16 is a storage device for saving data, such as a flash memory or an HDD (Hard Disc Drive). The processor 19 is hardware for executing an instruction set written in a program, and is composed of an arithmetic unit, registers, peripheral circuits, etc.

[0022] The server 20 manages information related to the event and information related to the users participating in the event. The server 20 stores various information such as the event area, the objects to be found, the time limit, the gender, age, and number of times the users participating in the event have participated, various information about the objects to be found that are placed at the event venue, various information about hints presented to users participating in the event, and various history information recorded when users participate in the event.

[0023] The communication IF 22 is an interface for inputting and outputting signals so that the server 20 can communicate with external devices. The input / output IF 23 functions as an interface with an input device for receiving input operations from a user and an output device for presenting information to the user. The memory 25 is for temporarily storing programs and data processed by the programs, etc., and is a volatile memory such as a DRAM (Dynamic Random Access Memory). The storage 26 is a storage device for saving data, such as a flash memory or an HDD (Hard Disc Drive). The processor 29 is hardware for executing an instruction set written in a program, and is composed of an arithmetic unit, registers, peripheral circuits, etc.

[0024] The discovery object 40 is an object that the user searches for in the event. A plurality of discovery objects 40 are placed in the area that the user searches in the event. The user progresses the event by using the terminal device 10 to photograph the discovery object 40. In some aspects, the discovery object 40 may be equipped with a camera 401.

[0025] The camera 401 is a device provided in the discovery object 40, which receives light using a light-receiving element and outputs the light as a captured image. The camera 401 is, for example, a depth camera that can detect the distance from the camera 401 to the object being photographed. In some aspects, the camera 401 may photograph a user participating in an event from the viewpoint of the discovery object. In some aspects, the camera 401 may have a function to detect information about the user's emotions, such as the user's gaze and facial expression. For example, the server 20 may acquire and analyze the photographed image output by the camera 401 to determine the type of the user's emotion (e.g., "surprise") based on the area of ​​the user's face in the photographed image. The discovery object 40 may also be equipped with a microphone or the like to detect sounds around the discovery object 40. For example, the server 20 may detect the user's voice based on the sound detected by the microphone of the discovery object 40, and determine the user's emotion based on the detected user voice. As described above, by providing sensing means to the object to be found 40, the gaze, facial expression, emotions, etc. of the user around the object to be found 40 may be detected.

[0026] In this embodiment, each device (terminal device, server, etc.) can also be considered as an information processing device. That is, a collection of devices can be considered as one "information processing device," and system 1 can be formed as a collection of multiple devices. The way in which multiple functions required to realize system 1 according to this embodiment are allocated to one or multiple pieces of hardware can be determined appropriately in consideration of the processing capacity of each piece of hardware and / or the specifications required for system 1.

[0027] <1.1 Configuration of the terminal device 10> FIG. 2 is a block diagram of a terminal device 10 constituting the system 1 of the first embodiment. As shown in FIG. 2, the terminal device 10 includes a plurality of antennas (antenna 111, antenna 112), wireless communication units (first wireless communication unit 121, second wireless communication unit 122) corresponding to the respective antennas, an operation reception unit 130 (including a touch-sensitive device 131 and a display 132), an audio processing unit 140, a microphone 141, a speaker 142, a position information sensor 150, a camera 160, a motion sensor 170, a storage unit 180, and a control unit 190. The terminal device 10 also has functions and configurations (e.g., a battery for storing power, a power supply circuit for controlling the supply of power from the battery to each circuit, etc.) that are not specifically shown in FIG. 2. As shown in FIG. 2, the blocks included in the terminal device 10 are electrically connected by a bus or the like.

[0028] The antenna 111 emits a signal emitted by the terminal device 10 as a radio wave. The antenna 111 also receives a radio wave from space and provides the received signal to the first radio communication unit 121.

[0029] The antenna 112 emits a signal emitted by the terminal device 10 as a radio wave. The antenna 112 also receives a radio wave from space and provides the received signal to the second radio communication unit 122.

[0030] The first wireless communication unit 121 performs modulation / demodulation processing and the like for transmitting and receiving signals via the antenna 111 so that the terminal device 10 can communicate with other wireless devices. The second wireless communication unit 122 performs modulation / demodulation processing and the like for transmitting and receiving signals via the antenna 112 so that the terminal device 10 can communicate with other wireless devices. The first wireless communication unit 121 and the second wireless communication unit 122 are communication modules including a tuner, an RSSI (Received Signal Strength Indicator) calculation circuit, a CRC (Cyclic Redundancy Check) calculation circuit, a high-frequency circuit, etc. The first wireless communication unit 121 and the second wireless communication unit 122 perform modulation / demodulation and frequency conversion of wireless signals transmitted and received by the terminal device 10, and provide the received signals to the control unit 190.

[0031] Operation reception unit 130 has a mechanism for receiving input operations from the user. Specifically, operation reception unit 130 is configured as a touch screen and includes touch-sensitive device 131 and display 132. Touch-sensitive device 131 receives input operations from the user of terminal device 10. Touch-sensitive device 131 detects the user's touch position on the touch panel, for example, by using a capacitive touch panel. Touch-sensitive device 131 outputs a signal indicating the user's touch position detected by the touch panel to control unit 190 as an input operation.

[0032] Display 132 displays data such as images, videos, and text under the control of control unit 190. Display 132 is realized by, for example, an LCD (Liquid Crystal Display) or an organic EL (Electro-Luminescence) display.

[0033] The audio processing unit 140 modulates and demodulates audio signals. The audio processing unit 140 modulates a signal provided from the microphone 141 and provides the modulated signal to the control unit 190. The audio processing unit 140 also provides the audio signal to the speaker 142. The audio processing unit 140 is realized, for example, by a processor for audio processing. The microphone 141 accepts audio input and provides an audio signal corresponding to the audio input to the audio processing unit 140. The speaker 142 converts the audio signal provided from the audio processing unit 140 into audio and outputs the audio to the outside of the terminal device 10.

[0034] The location information sensor 150 is a sensor that detects the location of the terminal device 10, and is, for example, a GPS (Global Positioning System) module. The GPS module is a receiving device used in a satellite positioning system. The satellite positioning system receives signals from at least three or four satellites and detects the current location of the terminal device 10 equipped with the GPS module based on the received signals. For example, if the system 1 allows reference to the user's location information, it can provide the user with hints regarding the location of objects to be found near the user. The location information sensor 150 may also be a transmitting / receiving device based on a communication standard used in a short-range communication system between information devices. Specifically, the location information sensor 150 receives beacon signals from other information devices equipped with a Bluetooth (registered trademark) module using the 2.4 GHz band, such as a Bluetooth (registered trademark) module.

[0035] The camera 160 is a device that receives light with a light receiving element and outputs the received light as a captured image. The camera 160 is, for example, a depth camera that can detect the distance from the camera 160 to a subject being photographed.

[0036] The motion sensor 170 is configured with a gyro sensor, an acceleration sensor, etc., and detects the tilt of the terminal device 10.

[0037] Storage unit 180 is configured with, for example, a flash memory, and stores data and programs used by terminal device 10. In one aspect, storage unit 180 stores user information 181.

[0038] User information 181 includes information such as the user's age, gender, user ID for the event, and the number of times the user has participated in the event. When participating in an event, the event organizer may grant the user the right to participate in the event based on this information. Also, on the day of participation in the event, the right to participate in the event may be granted by registering the user's information using a terminal device installed at the venue where the event is held. Note that registration of this information itself is not required, and the right to participate in the event may be granted even if the user omits registering this information.

[0039] The control unit 190 reads a program stored in the storage unit 180 and executes instructions included in the program to control the operation of the terminal device 10. The control unit 190 is, for example, an application processor. By operating in accordance with the program, the control unit 190 fulfills the functions of an input operation reception unit 191, a transmission / reception unit 192, a data processing unit 193, and a notification control unit 194.

[0040] Input operation reception unit 191 performs processing to receive a user's input operation on an input device such as touch-sensitive device 131. Based on information about the coordinates where the user has touched touch-sensitive device 131 with a finger or the like, input operation reception unit 191 determines the type of operation, such as whether the user's operation is a flick operation, a tap operation, or a drag (swipe) operation.

[0041] The transmitting / receiving unit 192 performs processing for the terminal device 10 to transmit and receive data to and from an external device such as the server 20 in accordance with a communication protocol.

[0042] The data processing unit 193 performs calculations on data that the terminal device 10 has received as input in accordance with a program, and outputs the calculation results to a memory or the like.

[0043] The data processing unit 193 receives from the user information such as image information of other users working on the event tasks, input information for approving the discovery object, etc. The data processing unit 193 obtains the image information by, for example, using the camera 160 or the like to capture images of other users working on the event tasks. The data processing unit 193 also receives an input operation for approval from the user while, for example, using the camera 160 or the like to display an image of the discovery object on the display 132 or the like of the terminal device 10.

[0044] The notification control unit 194 performs processing for displaying a display image on the display 132, processing for outputting sound from the speaker 142, and processing for causing the camera 160 to generate vibrations.

[0045] <1.2 Functional configuration of server 20> 3 is a diagram showing the functional configuration of the server 20. As shown in FIG. 3, the server 20 functions as a communication unit 201, a storage unit 202, and a control unit 203.

[0046] The communication unit 201 performs processing for the server 20 to communicate with external devices.

[0047] The storage unit 202 stores data and programs used by the server 20. The storage unit 202 stores an event information database 281, a participant information database 282, an object information database 283, a hint information database 284, an event history database 285, and the like.

[0048] The event information database 281 is a database for storing various types of information about events, the details of which will be described later.

[0049] The participant information database 282 is a database for storing various information about users who will participate in the event, as will be described in detail later.

[0050] The object information database 283 is a database for storing various information about objects that are placed at specific locations during an event and that are targets for users to search for. Details will be described later.

[0051] The hint information database 284 is a database for storing various information related to hints about the locations of objects to be found that are presented to the user during an event. Details will be described later.

[0052] The event history database 285 is a database for storing the history of various actions of users who participated in an event, as will be described in detail later.

[0053] The reception control module 2041 controls the process by which the server 20 receives signals from external devices in accordance with a communication protocol.

[0054] The transmission control module 2042 controls the process in which the server 20 transmits signals to external devices in accordance with a communication protocol.

[0055] The event information acquisition module 2043 acquires various information related to the event in which the user is about to participate.

[0056] The participant information acquisition module 2044 acquires various information about users who are planning to participate in the event.

[0057] The object information acquisition module 2045 acquires information about discovered objects that will be placed in the event that the user is about to participate in.

[0058] The hint information acquisition module 2046 acquires hint information regarding the placement locations of objects to be found that will be placed in the event that the user is about to participate in.

[0059] When a user photographs a discovery object at an event using the camera 160 or the like, the object display module 2047 acquires information about the discovery object, such as its name, ease of finding it (rarity), and benefits to the user for finding it. This allows the user to check information about the discovery object they have discovered at the time of discovery, thereby increasing the interest of participating in the event.

[0060] The hint presentation module 2048 presents the user with information about hints regarding the location of a discovery object when the user is searching for the discovery object in an event. In this case, the hint presentation module 2048 may present the user with a hint when the following conditions are met: When it is determined that the user is within a specific range based on the position of the object to be found, based on the user's position information and the position information of the object to be found, both of which are acquired from the position information sensor 150 of the terminal device 10A. For example, when the user's position and the object to be found are within a certain distance. When the positional relationship between the position and direction of the camera 160 of the terminal device 10A capturing images and the position of the object to be found within the captured image satisfies certain conditions. For example, the terminal device 10A may acquire the user's position within the geographical area where the object to be found is searched and the direction in which the user is pointing the camera using the terminal device 10A's acceleration sensor, orientation sensor, etc. Furthermore, if the terminal device 10A has a LiDAR (Light Detection and Ranging) sensor and can optically measure the distance to surrounding objects to detect the surrounding terrain, the user can generate a 3D model by pointing the laser light emitted by the LiDAR sensor of the terminal device 10 toward the surrounding terrain. This allows the terminal device 10A to identify the user's position (the position of the terminal device 10) within the geographical area to be searched and the direction in which the camera 160 is capturing images. For example, the above-mentioned conditions are met when: (1) The position of the object to be discovered is included in the range of the camera 160. (2) The object is not included in the range of photography of the camera 160, but by changing the range of photography by a predetermined angle, the object may be included in the range of photography. This allows the user to recognize that an object to be found is located near the user, and allows the user to feel a sense of tension as they explore their surroundings more carefully.

[0061] The approval receiving module 2049 receives an input operation from a user to approve a discovery object discovered at an event. Specifically, the approval receiving module 2049 receives an image of the discovery object captured by the camera 160 or the like of the terminal device 10 owned by the user. At this time, the approval receiving module 2049 analyzes the image and, if the image contains the discovery object, determines that the user has discovered the discovery object. This allows a user to receive approval for discovering a discovery object at an event in the real world by capturing an image of the discovery object actually placed in the real world with the camera 160 or the like of the terminal device 10. Furthermore, at this time, the approval receiving module 2049 may perform approval in combination with the user's location information acquired from the location information sensor 150 of the terminal device 10. This allows the event organizer to prevent fraudulent approval, for example, by creating a stuffed toy prepared in advance.

[0062] <2 Data Structure> 4 and 5 are diagrams showing the data structures of the event information database 281, the participant information database 282, the object information database 283, the hint information database 284, and the event history database 285 stored in the server 20. FIG.

[0063] As shown in FIG. 4, the event information database 281 includes an item "Event ID," an item "Event area," an item "Featured objects," an item "Recommended number of participants," an item "Time limit," an item "Hint information," an item "Area," an item "Notes," etc.

[0064] The item "event ID" is information that identifies each event.

[0065] The "Event Area" field contains information indicating the area the event will be held in. For example, the event ID "I001" indicates that the event will be held in multiple areas, such as "A," "B," and "C."

[0066] The "Appearing Object" item is information that indicates the identification information of each discovery object that appears in each area of ​​the event. For example, in event ID "I001," in event area "A," the objects that appear are "P001, P002, ...," etc. Discovery objects are configured as follows, using characters that appear in content that has an original source, such as manga, animation, novels, or games, as motifs. · Objects that reproduce or deform the character itself (such as stuffed toys) Real-life objects that represent the character's characteristics (1) For example, if a character has temperature-related attributes, such as ice or fire, then objects with low or warm temperatures that are reminiscent of ice or fire, or objects with the texture of ice or fire, (2) For example, if the character has magnetic attributes, an object that is reminiscent of magnetism (such as a magnetic object). (3) For example, if the character has an electrical attribute, an object that is reminiscent of electricity (such as a light-emitting object) A drawing of the character on a building or other man-made object (for example, a drawing of the character on a wall) Videos in which the character appears (for example, video of the character projected onto a wall, plant, fountain, etc.) Natural objects with the character printed on them (for example, leaves with the character printed on them) Sounds that represent the character (for example, the character's unique cry, or sounds that reproduce the character's footsteps)

[0067] The "Recommended number of participants" item indicates information regarding the recommended number of participants for each area in the event. For example, for event ID "I001," the recommended number of participants for event area "A" is "6." The recommended number of participants is set by the event organizer based on the time to explore each area, the size of the search range of each area, and other factors. The server 20 may change the recommended number of participants for each area in response to a change in the time limit for exploring each area.

[0068] The "Time Limit" item indicates the time limit for searching each area in the event. For example, for event ID "I001," the time limit for area "A" is 10 minutes.

[0069] The "hint information" item is information that indicates the identification information of each hint presented to the user in each area of ​​the event. For example, for event ID "I001," the hint information for event area "A" is "H001, H002, ...."

[0070] The "Area" item is information about the area of ​​each area in the event. For example, for event ID "I001," the area of ​​event area "A" is "BBm2." The area of ​​each area is set by the operator running the event. The server 20 changes the area information for each area based on instructions from the operator. For example, when an area is expanded or reduced (when the searchable range is expanded or reduced), the server 20 accepts the setting of the date and time when participation in the event in the expanded or reduced area will be accepted, and updates the area information for each area in response to the arrival of that date and time. For example, an area may be expanded by carrying out expansion work on the area to be searched in the event. In addition, an area may be reduced for maintenance or the like, or the use of an area may be prohibited due to the occurrence of a problem.

[0071] The item "Notes" is information that is stored when there are special notes, etc., for an event. Examples of special notes include the following: The event is limited to a specific time and date (for example, an event limited to the summer vacation period). The event is time-limited and time-specific (for example, an event held after sunset). The user must meet certain requirements to participate in the event. (1) For example, the age group of users must meet certain requirements. For example, the team must be comprised of users below a certain age, including their parents. (2) For example, a certain requirement is that the region where the user is based in the real world or virtual world meets certain conditions. For example, in a game, there may be an event offered to users based in a certain region. (3) For example, a certain requirement is that a user's participation in an event must meet certain conditions. For example, an event may be offered to users who have completed a certain number of event challenges. There are restrictions on the number of times you can participate in the event (for example, you can only participate in the event a certain number of times). For example, the notes for the event ID "I002" indicate that it is an "event limited to after 5pm."

[0072] Based on the various types of information described above, the event organizer may notify users of the event's outline, etc. This allows users who wish to participate in the event to understand information such as the time of the event and information about the discovery objects that can be found, and they can select and participate in an event where they can find their favorite discovery objects. This is expected to further increase users' motivation to participate in the event.

[0073] The participant information database 282 includes items such as "Participation Date and Time," "Participating Group," "Participant ID," "Gender," "Age," "Role," "Support Target," "Participation Status," and "Remarks." In real-world events disclosed in the present invention, users are formed in groups of multiple people, and participate in each event as a group. The database stores information about each user who makes up the group that participated in the event.

[0074] The "Participation Date and Time" field indicates information about the date and time when a group of multiple users participated in an event. For example, a group identified as participating group "A," described below, participated in the event at the participation date and time "2020 / 02 / 10 10:30:00." In some cases, this field may be stored by date and time, such as "2020 / 02 / 10," rather than by time period.

[0075] The item "Participating Group" indicates information for identifying the group that participated in the event at each participation date and time.

[0076] The item "Participant ID" indicates information for identifying multiple users who make up a group that participated in an event. For example, the users who make up participating group "A" are "U001," "U002," etc.

[0077] The item "gender" indicates information that identifies the gender of each user, linked to the participant ID. For example, this indicates that the gender of user ID "U001" in participant group "A" is "male."

[0078] The item "age" indicates information that identifies the age of each user, linked to the participant ID. For example, this indicates that the age of user ID "U001" in participant group "A" is "12."

[0079] The "role" item indicates information associated with the participant ID that identifies the role that each user plays in the event. For example, the role of user ID "U001" in participant group "A" is "exploration." In real-world events disclosed in the present invention, each user is encouraged to act according to their role. For example, a user with the role "exploration" is responsible for searching for discovery objects located in each area, and a user with the role "support" is encouraged to provide hint information displayed on the user's device to a user with the role "exploration." The role of each user may be fixed during the event, or the roles of each user may be swapped during the event. In the example of the participant information database 282 described above, a user associated with a participant ID is associated with the role that the user will play in the event. However, there may be cases where the role is not linked to the participant ID. For example, information about the terminal used by the user at the event (or an identification number issued by the server 20 or the like when using an application running on the terminal) may be associated with the role and managed by the server 20. For example, the following situations may occur. The event organizer lends one or more devices to each group of users participating in the event. The event proceeds without the participant ID being associated with the device itself. Each device has a defined role, such as "search" or "support." In this case, users in a group can swap devices with different roles, allowing them to swap roles. In the case where a role is assigned to each device as described above, when a group participates in an event using devices that each have multiple roles, the system may accept an operation from a user to switch device roles within the group. This allows users to switch roles within the group without having to switch devices. As described above, when swapping user roles within a group without users exchanging devices, the device roles may be swapped by satisfying certain conditions in an event, without any user operation, to swap the roles of "search" and "support" played by users within the group. The certain conditions may include, for example, the following: (i) Temporal conditions, such as a certain amount of time having passed since the start of an event or a certain amount of time having passed since the start of area exploration. (ii) Conditions according to the purpose of the event (discovering the discovery object), such as whether the user succeeded in discovering the discovery object in the event (the operation to report that the discovery object was found was accepted) or failed (a user with the role "Search" failed to find the discovery object within the search period of the area).

[0080] This means that, for example, when parents and children participate in an event together, rather than waiting outside while the child is absorbed in exploring, the parent can experience the event together by providing hints to the child, etc. This not only contributes to the creation of memories between parents and children, but can also have the effect of encouraging parents and children to participate again and again.

[0081] The item "support target" indicates a target that a user with the role of "support" supports in an event. Targets that a user with the role of "support" supports include the following: A specific user with the role "Explore" Groups that users join For example, this indicates that the participant ID "U002" whose role is "support" supports "U001."

[0082] The "Participation Status" field indicates detailed information about each user's participation in an event in each group. For example, participant ID "U001" indicates that the user attempted event area "A" twice in event ID "I001." In some cases, the event organizer may refer to this information and award the user with a special benefit, such as a sticker or other item, depending on the number of attempts.

[0083] This allows users to enjoy the fun of trying events in the same area multiple times, which is expected to encourage repeat event participation.

[0084] The item "Notes" is information that is stored when there are special notes or the like for the user in the event.

[0085] As shown in FIG. 5, the object information database 283 includes an item "area ID," an item "object ID," an item "object name," an item "appearance position," an item "search time," an item "remarks," and the like.

[0086] The item "area ID" indicates information that identifies each area that the user will search in the event.

[0087] The "Object ID" field indicates information that identifies each of the discovered objects located in each area. For example, the objects located in area ID "A" are discovered objects identified by "P001," "P002," etc.

[0088] The item "Object Name" indicates information about the name of the discovered object identified by each object ID. For example, the object name of the discovered object ID "P001" is "Pikachu."

[0089] The "appearance location" item indicates the location information of the location where the discovery object is placed in each area during the event. For example, in area ID "A," the appearance location of discovery object "P001" is indicated as coordinates "AAA.AAA.AAA." In one aspect, the server 20 may trigger the user to present a hint regarding the placement of the discovery object based on the user's location information acquired from the location information sensor 150 of the user's terminal device 10 and the information on the appearance location.

[0090] The "search time" item indicates the time during which a user can search for a discovery object in an event. For example, the search time for area ID "A" is "10 minutes."

[0091] The item "Notes" is information that is stored when there are special notes or the like in an area in an event.

[0092] The hint information database 284 includes an item "area ID", an item "hint ID", an item "corresponding object", an item "hint content", an item "hint display position", an item "hint appearance time", an item "remarks", and the like.

[0093] The item "area ID" indicates information that identifies each area that the user will search in the event.

[0094] The item "Hint ID" indicates information that identifies each hint presented to the user in each area. For example, the hints presented to the user in area ID "A" are identified by "H001", "H002", etc.

[0095] The item "Corresponding object" indicates information about the discovery object corresponding to each hint. For example, the discovery object corresponding to the hint ID "H001" is "P001."

[0096] The item "hint content" indicates the content of each hint presented to the user. Hints presented to the user include: The type or name of the object to be discovered (for example, if the object to be discovered is a character, the name of the character, a silhouette of the character, etc.) Information suggesting the location of the detected object (e.g., the direction of the detected object, the distance to the detected object, etc.) Information about the time when the discoverable object appears (for example, if the discoverable object is placed and can be discovered for a limited time, information about that time) Information about the conditions necessary to find the object (e.g., the object can be found by activating a specific device in the area, or by wearing a specific device (e.g., glasses)). For example, the hint content of the hint ID "H001" indicates that it is information about the "position" of the discovery object "P001."

[0097] The item "Hint Display Position" indicates information about a position within an area that triggers the display of a hint to the user. For example, the hint display position for hint ID "H001" indicates the coordinates "AAA.AAA.AAA." Based on the user's location information acquired from the location information sensor 150 of the user's terminal device 10 and the information, the server 20 presents hint information to the user if the user is located in a position around the coordinates.

[0098] The item "Hint Appearance Time" indicates information regarding the timing of presenting hint information to the user. For example, the appearance time of the hint identified by the hint ID "H001" indicates "5 minutes" from the start of the search in the area. In some cases, the time may be the elapsed time calculated from the start of the event, or a predetermined time during the event, such as 5 minutes from 2 to 7 minutes after the start.

[0099] The item "Notes" is information that is stored when there are special notes or the like in the hint for the event.

[0100] The event history database 285 includes an item "history ID," an item "participant ID," an item "role," an item "participation date and time," an item "search area," an item "arrival at area," an item "behavior history," an item "notes," and the like.

[0101] The item "History ID" indicates information for identifying each history acquired in an event. The server 20 may define a history ID for each group that participates in the event, rather than defining a history ID for each participant.

[0102] The item "Participant ID" indicates information that identifies a participant, linked to a history ID. For example, the participant IDs linked to the history ID "R001" are "U001", "U002", etc.

[0103] The item "role" indicates information associated with the participant ID that identifies the role that each user plays in the event. For example, the role of participant ID "U001" is "search."

[0104] The "Participation Date and Time" field indicates information about the date and time when each user, associated with the event ID, participated in the event. For example, the participation date and time for each user associated with the event ID "R001" is "2020 / 02 / 10."

[0105] The "Search Area" field indicates information about the area that each user searched for in the event, linked to the event ID. For example, the search area for each user linked to the event ID "R001" indicates multiple areas, such as "A."

[0106] The "Arrival to Area" item indicates information about the time that each user associated with the event ID arrived at each area for the event. For example, it indicates that the time that each user associated with the event ID "R001" arrived at area "A" was "10:30:00." The arrival time can be the timing when the user started searching in the area.

[0107] The "Action History" item indicates information about the action history of each user in an event linked to the event ID. The action history is further divided into categories such as "Type," "Time," and "Target," and stores information about the details of the actions performed by each user in the event. For example, an example of the action history of a user with user ID "U001" in an event ID "R001" indicates that the type is "Discovery," the time of discovery is "10:32:00," and the target of the discovery is "P001." In some cases, the server 20 may store the user's action history in the database each time a user participating in an event performs an action.

[0108] This allows the server 20 to record the actions taken by the user at any time during the event, allowing the event organizer to present related events and grant specific benefits based on the user's action history, which is expected to increase the user's interest in participating in the event and encourage repeat participation.

[0109] The item "Notes" is information that is stored when there are special notes in the event history.

[0110] <3 operations> Below, we will explain the process in which system 1 acquires images taken by some of multiple users of other users working on event tasks, and provides content extracted from a portion of the first image to the multiple users in response to the multiple users progressing through the event.

[0111] Figure 6 is a flowchart showing a process in which some of a plurality of users acquire images of other users working on challenges in an event, and content extracted from portions of the images is provided to the plurality of users in response to the plurality of users progressing through the event.

[0112] In step S601, the control unit 190 of the terminal device 10A acquires, by a user in the user group, a video or still image including other users working on a task of the event. Specifically, for example, the terminal device 10A of a user whose role is "support" acquires, through an operation by the user, an image of other users whose role is "search" working on a task of the event, such as searching for a discovery object, using the camera 160 of the terminal device 10A or the like. The terminal device 10A transmits information about the acquired image to the server 20.

[0113] In step S651, in response to the user group progressing the event, the control unit 203 of the server 20 enables at least a portion of the content, such as moving images or still images, to be provided to the terminal 10A operated by a user in the user group. For example, the user to whom the portion of the content is to be provided is a user whose role is "search." Here, triggers for the server 20 to enable the provision of content to users who have participated in the event as the event progresses include the following: The exploration period for one of the multiple areas that make up the event has ended. (1) Specifically, the period for searching an area may be considered to have ended when the time limit set for that area has elapsed. (2) Specifically, the period for searching an area may be considered to have ended when all of the objects to be found in the area have been found. A certain period of time has passed since the user began searching in each area. In each area, the user has found the discovery object during the search period. In each area, provide users with hints to help them find the objects they want to discover. The user completes exploration of all or part of multiple areas that make up the event. The server 20 may determine that a user has finished an event based on the user's arrival time at the area, i.e., the start time of the event, acquired from the event history database 285 or the like, and the time limit set for each event. The server 20 creates content by extracting, from images of other users working on the event tasks acquired in step S601, scenes of the user in the role of explorer discovering a discovery object, scenes of the user searching for the discovery object, and the like, and provides the content to the user. For example, suppose the user's terminal device 10 accepts an operation to report that the discovery object has been discovered. In this case, the server 20 may identify, based on the timing at which the operation is accepted and the video captured by the terminal device 10 prior to the timing, a video of the user conducting the search discovering the discovery object.

[0114] Here, the process in which the control unit 203 of the server 20 extracts a portion from an image acquired from the terminal device 10A will be described. The control unit 203 of the server 20 may identify a person included in an image by image analysis or the like and create content in which only the person is extracted. In this case, the image analysis process may be performed by any existing process and is not limited to this. Furthermore, the server 20 may store in the storage unit 202 a trained model that receives multiple images of people as input and extracts specific facial expressions from the input images, such as a smile, a surprised face, or an engrossed face, as correct output. The control unit 203 of the server 20 may provide the user with content in which only images of specific facial expressions of the user working on a task in an event are extracted, based on the images acquired from the terminal device 10A and the trained model.

[0115] In step S602, the control unit 190 of the terminal device 10A presents the content provided by the server 20 to the user by displaying it on the display 132, for example.

[0116] This allows users to obtain content that captures various aspects of their time participating in the event, such as how absorbed they are in exploring, how happy they are when they find something, etc. This allows users to look back on the event and keep a record, which not only enhances their memories but is also expected to encourage repeat visits.

[0117] Figure 7 is a flowchart showing a process in which images taken by some of multiple users of other users working on challenges in an event are acquired, the degree of progress of the event is determined based on the recognition of discovered objects contained in the captured images, and content extracted from portions of the images is provided to the multiple users in response to their progress in the event.

[0118] In step S701, the control unit 190 of the terminal device 10A accepts an input operation for acknowledging that a discovery object has been found on the terminal of any of the multiple users, and transmits the information to the server 20. Specifically, the control unit 190 of the terminal device 10A causes the camera 160 of the terminal device 10A of the user whose role is "search" to display the discovery object on the display 132, etc. Here, the terminal device 10A refers to the terminal device 10A used by a user who plays the role of searching for a discovery object in the event. At this time, the control unit 190 of the terminal device 10A may determine whether the current time displayed on the display 132, etc. is within a preset time limit for the event, based on the time from the start of the event. If the current time is within the time limit for the event, the control unit 190 of the terminal device 10A accepts an input operation from the user to photograph the discovery object. The control unit 190 of the terminal device 10A transmits the photographed image of the discovery object to the server 20. In one aspect, the control unit 190 of the terminal device 10A may not accept an input operation for approval from the user, but may instead accept information about a video or still image taken by the camera 160 of the terminal device 10A, as an approval operation.

[0119] In step S751, the control unit 203 of the server 20 determines whether or not a discovery object is included in the image. The control unit 203 of the server 20 may determine whether or not a discovery object is included in the image by image analysis. The server 20 may also store in the storage unit 202 a trained model that is trained by inputting an image including multiple discovery objects and outputting an image in which only the discovery objects are extracted as the correct answer. The control unit 203 of the server 20 may determine whether or not a discovery object is included in the image based on the image acquired from the terminal device 10A and the trained model.

[0120] In step S752, the control unit 203 of the server 20, in response to receiving the input operation for approval, identifies the degree of progress of the event by the user group. Specifically, in step S701, in response to the input operation for approval of the discovery object received from the terminal device 10A, the control unit 203 of the server 20 determines how many of the discovery objects placed in the search area have been discovered, and identifies the degree of progress of the event. Furthermore, when the control unit 203 of the server 20 determines that all of the discovery objects placed in the area have been discovered, the control unit 203 of the server 20 identifies the event in the area as having ended. In some aspects, the control unit 203 of the server 20 may also identify the event as having ended if the event time limit expires without the user having discovered all of the discovery objects. In some aspects, after identifying the degree of progress of the event, the control unit 203 of the server 20 may present to the user how many discovery objects remain to be placed. In addition, in certain situations, the control unit 203 of the server 20 may award the user limited items, goods, etc. based on the time limit and progress of the event, for example, if all of the discovery targets are discovered earlier than expected.

[0121] This allows the user to work on the event while checking the progress of the event, and gives the user a sense of tension as the time limit approaches and a sense of specialness and accomplishment by finishing the event early, thereby increasing the interest of participating in the event.

[0122] <4 Screen example> FIG. 8 is a diagram showing an overview of events in the real world disclosed in the present invention.

[0123] In FIG. 8, an event is held in multiple areas. In this case, the event may be held simultaneously in each area, or may be held so that each time one area is completed, the next area can be challenged. In FIG. 8, 801A, 801B, and 801C indicate areas where the event is held. The areas may be connected by passages or the like, or may be separated by partitions within the same space. Each area may have an entrance, and users participating in the event may enter the area through the entrance.

[0124] Participating users 802A, 802B, and 802C indicate users who participated in the events in the respective areas. At this time, users participate in each event in groups, and multiple users participate in the event with each user having a role assigned to them.

[0125] Discovery objects 803A, 803B, and 803C indicate discovery objects located in each area. Discovery objects may be changed depending on the type of event. Discovery objects may be real-world objects such as stuffed toys, or may be objects defined by AR (Augmented Reality) that are discovered by the camera 160 of the terminal device 10A, etc.

[0126] FIG. 9 is an example of a screen showing an image captured by some of the multiple users of the event, showing other users working on a task in the event.

[0127] In FIG. 9, terminal device 10A has the role of "support" and is used at the event by a user who takes pictures of other users working on the tasks of the event.

[0128] Discovery objects 901 and 902 respectively indicate discovery objects placed in each area during the event.

[0129] Users 903 and 904 each represent a user participating in the event. In the illustrated example, each user is holding a pamphlet or other booklet distributed by the event organizer. In FIG. 9, users 903 and 904 have the role of "search" and search for discovery objects 901 and 902, etc. In FIG. 9, users 903 and 904 have discovered discovery objects 901 and 902, and the users have taken images or other images of the discovery using camera 160 or the like of terminal device 10A. Control unit 190 of terminal device 10A transmits the images or other images to server 20. Control unit 203 of server 20 provides content extracted from a portion of the acquired image to the user. At this time, the user operating the terminal device 10A may take an image or the like of the other users working on the tasks of the event using the camera 160 of the terminal device 10A or the like, and transmit the image or the like to the server 20. The control unit 203 of the server 20 may provide the user with content obtained by extracting a part of the acquired image, including the image. At this time, when users 903 and 904 whose role is "search" discover discovery objects 901 and 902, control unit 160 of terminal device 10A may present the users with a notification that it is time to take a photo.

[0130] In one aspect, control unit 190 of terminal device 10A may automatically capture images of users 903 and 904 whose roles are "search" using camera 160 or the like at the timing when the users discover discovery objects 901 and 902. As described above, without the operation of a user whose role is "support", terminal device 10A of a user whose role is "support" may record video or still images for a certain period of time including the timing when the user whose role is "search" discovers discovery objects 901 and 902, by satisfying a predetermined condition for the search performed by the user whose role is "search". Processes performed by terminal device 10A of a user whose role is "support" may include the following. The control unit 190 detects whether a user with the role of "search" who appears as a subject in the photograph taken by the terminal device 10A of the user with the role of "support" has performed a specific action. For example, when a user with the role of "search" is present within the photographing range of the camera 160 or the like, the control unit 190 focuses on the user and identifies the action of the user. When the control unit 190 identifies that the action of the user is "discovery of a discovery target," the control unit 190 may automatically operate the camera 160 or the like to photograph the user. As will be described later, the terminal device 10 of a user whose role is "search" accepts an input operation from the user whose role is "search" that the user has discovered the discovery objects 901 and 902. Meanwhile, the terminal device 10A of a user whose role is "support" continues to capture images, and extracts some of the captured images based on the timing when the user whose role is "search" made an input operation to notify the user that the user has discovered the discovery objects 901 and 902. For example, the server 20 extracts the captured images from a period before and after the timing, thereby generating a video of the time before and after the user whose role is "search" discovered the discovery objects 901 and 902. For example, the terminal device 10A of the user whose role is "support" continues to capture images with the camera 160, and sequentially transmits the captured images (video) to the server 20. The server 20 accepts an input operation from the terminal device 10 of the user whose role is "search." This allows a user with the role "support" to automatically generate a video or still image including the timing at which the user with the role "search" discovers the discovery objects 901, 902, without having to wait for the timing at which the user with the role "search" discovers the search objects 901, 902, and store the video or still image in the server 20.

[0131] This allows users searching for discovery targets to share content extracted from images of themselves working on the event with the user who took the image. Therefore, even if the roles are divided between "explorer" and "supporter," each user can look back on what they did at the event while viewing the content, enhancing their memories. It can also increase motivation to swap roles of "explorer" and "supporter" next time, which is expected to encourage repeat event participation.

[0132] The time display unit 905 is a screen for displaying the current time and the time limit for the event. The control unit 190 of the terminal device 10A sets the time when the user arrives in each area as the start time of the event, and starts counting down the time limit set for each event. For example, in FIG. 9, the current time is within the time limit, and the screen displays "5 minutes remaining." By checking this display, the user can carry out the event while checking the remaining time.

[0133] The achievement display unit 906 is a screen for displaying achievements in the event. Specifically, the screen displays the discovered discovery objects, the remaining discovery objects, whether or not a hint is displayed, and the like. In one aspect, the achievement display unit 906 may be linked to the terminal device 10A used by a user whose role is "search." In this case, the achievement display unit 906 is updated in response to the user's discovery of a discovery object whose role is "search." This allows the user to progress through the event while sharing the situation in real time. In one aspect, the server 20 may set a difficulty level for discovery for each discovery object. If a user turns off hint information for the discovery object, the server 20 may change the specific reward depending on whether or not the hint information is used, such as by granting a specific reward in response to the user discovering the discovery object.

[0134] This allows users to explore without receiving any hints, which allows them to feel the tension of exploration and the sense of accomplishment that comes from receiving special rewards. This is expected to encourage users to continue participating in events.

[0135] FIG. 10 shows an example of a screen when an approval operation for a discovery object is performed on the terminal device 10A used by a user whose role is "search."

[0136] 10, time display section 1001 is a screen for displaying the current time and the time limit for an event, similar to time display section 905 in FIG. 9. Control section 190 of terminal device 10A sets the time when the user arrives in each area as the start time of the event, and starts counting down the time limit set for each event. For example, in FIG. 10, the current time is within the time limit, and the screen displays "8 minutes remaining."

[0137] Discovery objects 1002 indicate discovery objects arranged in each area.

[0138] The approval operation screen 1003 shows an operation screen for the user to approve the discovery of a found object. For example, when the camera 160 or the like captures the found object within its imaging range, the control unit 190 of the terminal device 10A may present information such as the name of the found object to the user through image analysis or the like. When the found object is within the imaging range and within the time limit, the control unit 190 of the terminal device 10A accepts an operation from the user to photograph the found object for approval. The control unit 190 of the terminal device 10A transmits the photographed image of the found object to the server 20. In some aspects, the operation for approval may be accepted based on information acquired from the position information sensor 150 of the terminal device 10A. That is, the operation for approval may be accepted only when it is determined that the user is at the location where the found object is located based on the user's position information acquired from the position information sensor 150 of the terminal device 10A and the position information of the location where the found object is located. Thereafter, the control unit 190 of the terminal device 10A may obtain a notification from the server 20 that approval has been received, and present it to the user.

[0139] 9, the achievement display section 1004 is a screen for displaying achievements in an event, etc. Here, the control unit 190 of the terminal device 10A may not present information regarding the presence or absence of a hint display in the terminal device 10A used by a user whose role is "search." In one aspect, in response to receiving an approval operation from the user on the approval operation screen 1003, the control unit 190 of the terminal device 10A may execute a process of increasing the "discovery" value and decreasing the "remaining" value in the achievement display section 1004.

[0140] In addition, in a certain situation, terminal devices 10A used by multiple users may share information with each other via a network 80, a short-range communication system using a Bluetooth (registered trademark) module, etc., and share in real time the users' track records of discovering discovery targets.

[0141] This allows users with different roles to always share the search status. Therefore, a user with the "Support" role can support a user with the "Search" role while checking the time limit, the number of remaining objects to be found, etc.

[0142] FIG. 11 shows an example of a screen displayed on the display 132 or the like when the time limit expires in an event on the terminal device 10A used by a user whose role is "search."

[0143] In Fig. 11, a time display section 1101 is a screen for displaying the current time and the time limit for the event, similar to the time display section 1001 in Fig. 10. In Fig. 11, the current time has passed the time limit, and the screen displays "Time Out."

[0144] The approval operation screen 1102, like the approval operation screen 1003 in Fig. 10, shows an operation screen for the user to approve the discovery of a discovery object. For example, the control unit 190 of the terminal device 10A accepts an approval operation from the user on this screen when the discovery object is within the photographing range and within the time limit. In Fig. 11, since "time has expired," the control unit 190 of the terminal device 10A does not accept an operation from the user to photograph the discovery object for approval. At this time, the control unit 190 of the terminal device 10A may perform processing to deactivate the button for photographing the discovery object on the approval operation screen 1102, along with displaying a message such as "The character in this area has escaped..."

[0145] This allows users to feel a sense of tension as they search for the object to be found within the time limit, increasing the interest of the event. Also, if authentication fails due to the time limit having elapsed, it is expected that this will encourage users to try again and participate in the event.

[0146] FIG. 12 shows an example of a screen in which a hint as to where to place a discovery object is presented to a user in an image taken by some of the users of a plurality of users of the event, showing other users working on a task.

[0147] In FIG. 12 , hint display 1201 indicates hint information regarding the location where the discovery object is located. For example, the control unit 203 of the server 20 acquires user location information from the location information sensor 150 of the terminal device 10A. Based on the acquired location information and the location information of the location where the discovery object is located, the control unit 203 of the server 20 presents hint information regarding the location of the discovery object, etc., to the terminal device 10A. The control unit 190 of the terminal device 10A presents the hint information acquired from the server 20 to the user by, for example, displaying it on the display 132. At this time, the hint information may include not only information regarding the location where the discovery object is located, but also information regarding the time period when the discovery object appears, such as the time period during which authentication is possible using the camera 160 of the terminal device 10A, etc. In one aspect, the control unit 109 of the terminal device 10A may not present hint information to the user if the time limit has passed when the user arrives at the location where the discovery object is located. In addition, in certain situations, the time limit for displaying a hint does not necessarily have to match the time limit for the area, and a time limit for displaying a hint may be set separately, and hint information may be presented to the user based on that setting.

[0148] This allows users to obtain hints about the location of objects that are placed in hard-to-find locations, thereby increasing the chances of finding the objects. Furthermore, by searching the surrounding area in detail based on the hints, users can get the feeling of a treasure hunt or exploration, further increasing the excitement of the event. Additionally, by using the hints to search together, users with the role of "search" and users with the role of "support" can foster a sense of unity in progressing through the event.

[0149] In one aspect, the control unit 230 of the server 20 may execute a process of transmitting content, which is the content provided to the user on the day of the event with additional images and the like, to the user's terminal device 10A after a predetermined period of time has passed since the end of the event. For example, several days after the end of the event, information about discovery objects that the user was unable to discover on the day of the event may be added to the content provided to the user on the day of the event and provided to the user. Here, the information about discovery objects that the user was unable to discover may be, for example, as follows: Silhouette of the object that could not be found Information about the area where the undiscovered object is located -Silhouettes of discovery objects added after the event Information about the areas where discoverable objects added after the event are located

[0150] Furthermore, the control unit 230 of the server 20 may present the content etc. to the user in the following manner, instead of the content itself with images etc. added. -Web page URL for viewing images, content, etc. -Images of two-dimensional codes for viewing images, content, etc. The control unit 230 of the server 20 may present images, content, etc. to the user in the above manner even on the day of the event, at the event venue, etc. This allows the user to avoid displaying image files, etc., which impose a large communication load, even in a situation where a communication environment such as Wi-Fi (Wireless Fidelity) is not available. Furthermore, the control unit 203 may determine whether to directly display images and content or display them in the above manner, based on the communication environment of the user's terminal device 10A.

[0151] This is expected to stimulate users' motivation to participate in the event, which in turn is expected to encourage users to participate in the event repeatedly.

[0152] <Second embodiment> <Summary> In the first embodiment, a technology was described in which, at an event held in the real world, multiple other users take images of a user working on a task in the event, and in response to the progress of the event, content extracted from the taken images is provided to the user. In the second embodiment, a technology is described in which, at an event held in the real world, a camera attached to a discovery object placed within a certain space is used to capture images of a user who searches for or discovers the discovery object, and content extracted from the captured images is provided to the user in response to the progress of the event. The object to be discovered may be equipped with a camera capable of capturing images at a predetermined angle of view, a 180-degree camera, a 360-degree camera, or other cameras with various capture ranges. For example, if the object to be discovered is a character, a camera with a view angle according to the field of view of the object to be discovered may be equipped. This allows the user to experience the image as if it were captured from the point of view of the object to be discovered.

[0153] In the second embodiment, a camera attached to the discovery object captures a user's actions as they work on the event's tasks. The server 20 extracts from the captured images, for example, a state in which the user is near the discovery object but is unable to find it, or a state in which the user discovers the discovery object, and presents these images to the user. This allows the user to reminisce about the joy or surprise they felt when they discovered the discovery object. Furthermore, by reviewing their own search near the discovery object, the user can reflect on their actions in the event and plan their actions for the next event they participate in.

[0154] <3 operations> Below, we will explain the process in which system 1 uses a camera attached to a discovery object placed within a certain space to capture an image of a user who searches for or discovers the discovery object, and provides the user with content extracted from the captured image in response to the progress of the event.

[0155] FIG. 13 is a flowchart showing a process in which a camera equipped with a discovery object is used to capture images of a user within a certain space during a period in which the user participates in an event and searches for the discovery object, and the captured images are provided to the user according to the progress of the event. Here, the object to be found may be provided with a camera, for example, in the following manner. · Cameras that are physically installed inside or outside the object to be discovered. For example, if the object to be discovered is a three-dimensional object such as a stuffed toy, a camera may be physically installed inside the object by embedding it in the mouth, eyes, or body surface of the character embodied in the stuffed toy. For example, if the object to be found is a three-dimensional object such as a stuffed toy, the camera may be placed along its surface, thereby physically placing the camera outside the object to be found. Here, the server 20 or the like may manage information specifying a discovery object and information specifying a camera without associating them with each other. That is, the server 20 or the like may manage a camera physically installed at a discovery object and the discovery object without associating them as data. On the other hand, the server 20 may manage information specifying a discovery object and information specifying a camera in association with each other. A camera that is installed physically away from the object to be discovered, but is managed as data in the server 20 etc., linked to each object to be discovered. For example, if the object to be discovered is a three-dimensional object or a two-dimensional representation painted on a wall, etc., a camera may be installed around the object. In other words, even if a camera is not physically installed on the object to be discovered, it may be considered that the object to be discovered is equipped with a camera. This allows the camera to capture images of a user searching for the object to be discovered, a user at the time of discovering the object to be discovered, etc.

[0156] In step S1351, the control unit 203 of the server 20 acquires the results of an image of a user in a certain space taken by the camera 401 provided in the discovery object 40 during the period in which the user participates in the event and searches for the discovery object. In a certain aspect, the control unit 203 of the server 20 may extract a specific state of the user at the event based on the results acquired from the camera 401. The state of the user is, for example, as follows: - Expressions of surprise or delight when discovering an object - Searching for the object of discovery near the object of discovery

[0157] Here, an example of a method for determining a user's state will be described. The control unit 203 of the server 20 performs image analysis on the results acquired from the camera 401 to identify the user's emotions, such as surprise or joy, and extracts an image of the user showing the identified emotion. This allows the server 20 to provide the user with content capturing the moment the user discovered the discovery object, contributing to the creation of more memories. In this case, the control unit 203 of the server 20 may extract the result not only based on the image analysis result but also based on the result of the image analysis and the result of the server 20's determination that the user has discovered the discovery object. Specifically, for example, the control unit 203 of the server 20 may measure the distance between the discovery object and the user using the camera 401, and when the distance is within a predetermined range, extract a portion of the acquired results as the state of the user when they discovered the discovery object based on the image analysis result.

[0158] Alternatively, the control unit 203 of the server 20 may obtain results based on other methods rather than by image analysis based on the state of the moment the user discovered the discovery object. For example, the control unit 203 of the server 20 may obtain video images of the area around the discovery object captured by the camera 401 in advance, and extract video images taken a predetermined period of time from the time the user discovered the discovery object. This process may not necessarily be performed when the user discovered the discovery object, but may be performed after a predetermined period of time has elapsed since the event. The server 20 may extract still images or video images from the video images captured by the camera 401 based on the timing at which the user discovered the search object (the timing at which the user discovered the search object may be determined based on the detection result of the user's emotion, or the timing at which the user discovered the search object may be determined by an input operation on the terminal device 10), thereby generating a video including the time before and after the time at which the user discovered the search object.

[0159] Furthermore, the control unit 203 of the server 20 may acquire information regarding the user's line of sight from the camera 401. Specifically, for example, the camera 401 is provided at the position of the eyes of the object to be found, and the control unit 203 of the server 20 determines, based on the information, that the user's line of sight is directed toward the object to be found when the user finds the object to be found. The control unit 203 of the server 20 may extract a portion of the acquired results based on the image analysis result and the line of sight information, as a state of the user when he or she found the object to be found.

[0160] In a certain aspect, the camera 401 does not have to be fixedly installed at a predetermined position, for example, inside the discovery object, near the discovery object, etc. Specifically, for example, the camera 401 may be installed on an autonomously controllable mobile body, such as a drone. In this case, the camera 401 installed on the mobile body may not be linked to a specific discovery object. For example, the server 20 may appropriately switch the discovery object linked to the camera 401 installed on the mobile body. Examples of the server 20 switching the link between the camera 401 installed on the mobile body and the discovery object may include the following. Depending on whether or not the discovery object has been discovered, the association between the discovery object and the camera 401 may be switched. For example, the server 20 may switch the association between the camera 401 and the discovery object in response to receiving, from the user's terminal device 10, an operation (such as an input operation into the terminal device 10) to report that the user has discovered the discovery object. The association between a discovery object and the camera 401 may be switched depending on whether the time period during which a user searches for a specific discovery object exceeds a certain period. For example, there may be a case where multiple users are each trying to search for different discovery objects. The camera 401 installed on a moving object moves while switching the discovery object to which it is associated at regular intervals, thereby capturing images of multiple users trying to search for the discovery object. The association between a discovery object and a camera 401 installed on a mobile object may be switched depending on the distance between the discovery object and the camera 401. The camera 401 installed on an autonomously controllable mobile object is connected to each discovery object by short-range communication such as Bluetooth (registered trademark), and when the distance between the mobile object and the discovery object is within a predetermined distance, the camera 401 may be temporarily associated with the discovery object.

[0161] In some aspects, the object to be found may be equipped with a microphone (not shown) and may capture the sound of the user when he or she finds the object to be found. The control unit 203 of the server 20 may extract a portion of the image analysis result and the sound from the acquired result as a state of the user when he or she finds the object to be found.

[0162] This allows the server 20 to present to the user content extracted from the moment the user discovered the discovery object, allowing the user to look back on the event along with the emotions they felt when they discovered the discovery object, stimulating their desire to participate in the event again and encouraging repeat participation.

[0163] In addition, in a certain aspect, the control unit 203 of the server 20 may extract from the camera 401 not only the state when the user discovers the discovery object but also the state when the user searches for the discovery object near the discovery object. Specifically, for example, when the distance between the discovery object and the user measured by the camera 401 is a predetermined distance and when it is determined that the user has not discovered the discovery object based on information such as the user's line of sight, the control unit 203 of the server 20 determines that the user is near the discovery object but has not discovered it. Alternatively, the control unit 203 of the server 20 may analyze an image captured by the camera 401 and determine that the user is near the discovery object if a person exceeding a predetermined size is included as a subject. If the camera 401 can measure the distance to an object using a depth sensor or the like, the control unit 203 of the server 20 may determine that the user is near the discovery object based on the distance measurement result. Based on this determination, the control unit 203 of the server 20 presents content extracted from the state of the user to the user. Furthermore, by storing the photographed image and the object ID of the discovered object in association with each other, the photographed image can be presented to the user together with the object name. This allows users to reflect on the disappointment of not being able to find the object they were looking for despite being close by, and also fosters a desire to find it next time, which can lead to continued participation in the event. Furthermore, the control unit 203 of the server 20 may be configured to present the user with the image captured by the camera 401 when the distance from the object to be found is equal to or greater than a certain value. If the user is unable to approach the object to be found, the location of the object to be found can be suggested to the user after the fact.

[0164] In one aspect, the control unit 203 of the server 20 may acquire information about discovery objects that the user was able to discover throughout the event and discovery objects that the user was unable to discover, and present this information to the user along with the content. Specifically, the server 20 accepts an input operation from the user's terminal device 10A to acknowledge that the user has discovered the discovery object, and determines that the user has discovered the discovery object based on this acceptance. Furthermore, the control unit 203 of the server 20 determines that a discovery object for which no input operation has been accepted from the user even after the time limit set for each event has elapsed is a discovery object that the user was unable to discover during the event. Thereafter, the control unit 203 of the server 20 presents information about the discovery objects that the user discovered and information about the discovery objects that the user was unable to discover, along with the content, to the user.

[0165] This allows users to grasp not only content extracted from images taken during the event, but also information about discovered and undiscovered objects. This allows users to know how much they discovered in one participation, or how much they have left to discover, which is expected to increase their desire to return to the event. Furthermore, in a certain aspect, when presenting the user with information about a discovery object that the user was unable to find, the control unit 203 of the server 20 may present the user with information about the area in which the discovery object is located, such as information suggesting the extent of the area in which the discovery object is located, as a hint. This allows the user to know where the discovery object that the user was unable to find in the event that day is located, and thus allows the user to consider in advance how to move the next time they participate in the event.

[0166] In some cases, the hints and other information may be presented to the user upon completion of the event, or may be presented to the user a predetermined period of time after the event has ended, such as several days later. This allows the event organizer to provide the user with an opportunity to reminisce about the event not only at the end of the event, but also some time after it has ended, which is expected to encourage the user to participate in the event again.

[0167] In step S1352, the control unit 203 of the server 20 presents the captured results to the user's terminal device 10A according to the progress of the event. The progress of the event may be, for example, the end of the event, which may occur at the following times: - When all events held on that day have finished - When exploration in each area where the event is held is completed Here, the timing when the search in each area ends is, for example, as follows. -When the event time limit ends During an event, when the user discovers all of the objects placed in the area before the time limit expires.

[0168] In step S1301, the control unit 190 of the terminal device 10A presents the provided content to the user by displaying it on the display 132, for example.

[0169] Figure 14 is a flowchart showing a process in which a camera equipped with a discovery object captures images of users within a certain space during a period in which users participate in an event and search for the discovery object, and images captured by some of the multiple users of other users searching for the discovery object at the event, and the acquired images and content extracted from some of the images are provided to users according to the progress of the event.

[0170] In step S1401, the control unit 190 of the terminal device 10A acquires images taken by some of the multiple users of other users searching for a discovery target at the event, and transmits the images to the server. Specifically, for example, the terminal device 10A acquires images of other users working on a task of the event, such as searching for a discovery target, using the camera 160 of the terminal device 10A or the like, in response to an operation by the user. The terminal device 10A transmits information about the acquired images to the server 20.

[0171] In step S1451, the control unit 203 of the server 20 presents content extracted from the acquired images and a portion of the captured results according to the progress of the event. In one aspect, the control unit 203 of the server 20 may present to the user the image capture time of the image acquired from the user's terminal device 10A and the image capture time of the results acquired from the camera 401 in association with each other. This allows the user to look back on memories of what the discovered object looked like when they were searching in the event, for example.

[0172] <4 Screen example> FIG. 15 shows an example of a screen that presents to the user content extracted from the results of photography taken by a camera 401 attached to the discovery object, showing the user searching for the discovery object at the event.

[0173] 15, content 1501 indicates content extracted by control unit 203 of server 20 from the results of photography by camera 401, showing a user searching for a discovery object near the discovery object at an event. Control unit 190 of terminal device 10A presents the content to the user by displaying it on display 132, for example.

[0174] Users 1503 and 1504 are users whose role is "search" and who are searching for a discovery object in the event. In content 1501, users 1503 and 1504 have not found the discovery object and are searching nearby.

[0175] Content 1502 indicates content extracted by the control unit 203 of the server 20, showing the state when the user discovered a discovery object at an event, from the results of photographing by the camera 401. The control unit 190 of the terminal device 10A presents the content to the user by displaying it on the display 132, for example.

[0176] User 1503 is a user whose role is "search", similar to user 1503 in content 1501. In content 1502, user 1503 discovers a discovery object. Control unit 203 of server 20 extracts, from the results of photography by camera 401 attached to the discovery object, the state when user 1503 discovered the discovery object, as in content 1502.

[0177] Figure 16 shows an example screen in which content extracted from images captured by a camera 401 attached to the object to be discovered, such as images of a user searching for an object to be discovered at an event, is presented to the user along with information on the object to be discovered that the user discovered at the event and the object to be discovered that the user was unable to find.

[0178] 16, contents 1601 and 1602 indicate contents extracted by the control unit 203 of the server 20 from the results of photography by the camera 401, such as a state in which a user searches for a discovery object near a discovery object at an event, a state in which the user has discovered the discovery object, and the like, and presented to the user together with information on the discovery object that the user discovered at the event and the discovery object that the user was unable to find. The control unit 190 of the terminal device 10A presents the content to the user by, for example, displaying it on the display 132.

[0179] The content 1601 presents to the user information about the discovery object that the user discovered and information about the discovery object that the user could not find, along with content extracted from the event showing how the user searches for the discovery object near the discovery object and how the user discovered the discovery object. At this time, the control unit 190 of the terminal device 10A may obtain information about the discovery object that the user could not find from the server 20, such as the name and information suggesting the location, and present the information to the user.

[0180] This allows the user to look back on the event, not only to see which discovery objects the user discovered, but also to see which ones the user was unable to discover, along with the state of the user's search at the event. This not only allows the user to vividly recall their memories of the event, but also increases their motivation to participate in the next event. This is expected to encourage continued participation in the event. The content may be presented to the user upon completion of each area of ​​the event, or upon completion of the entire event. In one aspect, the control unit 203 of the server 20 may transmit to the terminal device 10 only information about discovery objects the user discovered on the day of the event, and may transmit information about discovery objects the user was unable to discover to the terminal device 10 after a predetermined period has elapsed since the event. This allows the event organizer to provide users with an opportunity to reflect on the event even after the event has ended, thereby encouraging users to participate in the event again.

[0181] Content 1602 presents to the user information about the discovery object discovered by the user and information about the discovery object located in the next area, along with content extracted from the event showing how the user searches for the discovery object near the discovery object and how the user discovered the discovery object. At this time, the control unit 190 of terminal device 10A may obtain information about the discovery object located in the next area, such as its name, from the server 20 and present this information to the user. At this time, the control unit 190 of terminal device 10A may display the discovery object as a silhouette or the like.

[0182] This allows the user to, for example, when only the silhouette of the object to be found located in the next area is displayed, to approach the next area while predicting the details of the object to be found, thereby increasing the interest of the event.

[0183] Figure 17 shows an example screen in which content extracted from images taken by a camera 401 attached to the object to be discovered, such as a user searching for the object to be discovered at an event, is presented to the user along with content extracted from a portion of an image taken by the user of other users at the event working on the event's tasks.

[0184] In FIG. 17, the control unit 203 of the server 20 presents the following content 1701 to the user, for example: Content extracted from the results of photographing by the camera 401, such as how a user searches for a discovery object near the discovery object at an event, or how a user discovers the discovery object. Content that extracts a portion of an image taken by a user of another user working on a task at an event The control unit 190 of the terminal device 10A presents the content to the user, for example by displaying it on the display 132. In one aspect, the control unit 190 of the terminal device 10A may obtain, from the server 20, information on the discovery objects that the user discovered at the event or the discovery objects that the user was unable to discover, as illustrated in Figs. 15 and 16, and present the information to the user together with the content.

[0185] This allows users to look back on various memories of the event from a single piece of content, which can lead to deeper memories of the event, such as the fact that the event was even more enjoyable, and is expected to encourage repeat participation in the event, such as wanting to participate again.

[0186] <Third embodiment> In the second embodiment, a technology was described in which, at an event held in the real world, a camera attached to a discovery object placed within a certain space is used to capture images of a user who searches for or discovers the discovery object, and content extracted from the captured images is provided to the user in response to the progress of the event. In the third embodiment, a technology is described in which, at an event held in the real world, input operations are accepted from a user in accordance with the progress of the event's tasks, and upon completion of the event, the results of the user's progress in completing the event's tasks are presented to the user. In the third embodiment, the number of users participating in the event does not necessarily need to be multiple, and a single user may participate. Users may not only form a team of multiple users to tackle the event challenges, but also tackle the event challenges individually. This allows users to compete with other users in terms of how well they are working on the challenges. The event organizer may also offer specific rewards, etc. (items that allow users to progress through the event with an advantage, etc.) to users who participate individually.

[0187] In the third embodiment, the terminal device 10A receives a predetermined input operation from the user according to the progress of the task of the event. Specifically, for example, when the user finds a discovery object in the event, the input operation is for receiving an acknowledgment of the discovery. By this operation, the user is acknowledged for having found the discovery object in the event. The terminal device 10A transmits to the server 20 a notification that the input operation for the acknowledgment has been received. The server 20 stores in the storage unit 202, based on the acknowledgment information acquired from the terminal device 10A, that the user has found the discovery object. Thereafter, in response to the end of the event, the server 20 presents to the terminal device 10A the discovery objects for which the server 20 has received an input operation for approval from the user as discovery objects that the user has discovered, and the discovery objects for which the server 20 has not received the input operation as discovery objects that the user has not discovered. The terminal device 10A presents this information to the user.

[0188] This allows users to check their achievements in the event like a report card at the end of the event, so users can look back and see if they discovered fewer objects than the total number of objects placed in the area, or if they were close to finding all of the objects, etc., which is expected to motivate them to participate in further events.

[0189] <3 operations> FIG. 18 is a flowchart showing a process for accepting input operations from a user in accordance with the progress of the event tasks at an event held in the real world, and presenting the results of the user's progress in completing the event tasks to the user upon completion of the event.

[0190] In step S1801, the control unit 190 of the terminal device 10A accepts an input operation by the user to acknowledge that the user has found a discovery object, as an input operation corresponding to the progress of the task of the event. The control unit 190 of the terminal device 10A transmits the accepted result to the server 20. Specifically, for example, the control unit 190 of the terminal device 10A photographs the discovery object using the camera 160 or the like and transmits the photographed image to the server 20. The control unit 203 of the server 20 acknowledges that the user has discovered the discovery object based on the accepted image. The server 20 may determine a discovery object for which the input operation for acknowledgement has been accepted as a discovery object discovered by the user, and may determine a discovery object for which the input operation for acknowledgement has not been accepted within the time limit of the event as a discovery object that the user has not discovered.

[0191] In step S1851, in response to the end of the event, the control unit 203 of the server 20 presents to the user information on discovery objects for which an input operation for approval from the user has been received as a result of the user's progress in the event task, and information on discovery objects for which an input operation for approval from the user has not been received. The event ends at the following times. - When all events held on that day have finished - When exploration in each area where the event is held is completed Here, the timing when the search in each area ends is, for example, as follows. -When the event time limit ends During an event, when the user discovers all of the objects placed in the area before the time limit expires.

[0192] In step S1802, the control unit 190 of the terminal device 10A presents the presented results to the user by displaying them on the display 132, for example.

[0193] As a result, the server 20 can allow the user to visually recognize the user's achievements in the event as the event ends, which allows the user to reflect on their own actions in the event and increase their motivation to participate in the next event. In one aspect, the server 20 may present to the user, together with the user's achievements in the event, images of the user working on the event task, images of the user discovering the discovery object, etc., taken by the camera 401 provided on another user or the discovery object. The server 20 may also present to the user, together with the user's achievements in the event, information suggesting an area where a discovery object that the user was unable to find is located.

[0194] <4 Screen example> FIG. 19 shows an example of a screen that presents the user with information about discovery objects that the user has discovered and discovery objects that the user has not been able to discover, upon completion of the event.

[0195] 19, content 1901 indicates content for the control unit 203 of the server 20 to present to the user, upon completion of the event, information regarding discovery objects that the user discovered and those that the user was unable to discover. The control unit 190 of the terminal device 10A presents the content to the user by, for example, displaying the content on the display 132. In one aspect, the server 20 may present to the user information regarding discovery objects that the user discovered and those that the user was unable to discover in the form of a list, or may present the information to the user in a different display format. The different display formats include, but are not limited to, displaying discovery objects that the user discovered and those that the user was unable to discover in different tabs, windows, etc., or displaying only discovery objects that the user was unable to discover in silhouette.

[0196] This allows the user to grasp both the discovery objects that they found and the discovery objects that they were unable to find during the event, which allows the user to know how many more discovery objects they needed to find in order to find all of the discovery objects, which is expected to increase their motivation to participate in the next event.

[0197] Figure 20 shows an example screen that presents the user with information about the discovery object that the user was unable to find upon the end of the event, along with information suggesting the area in which the discovery object is located and content that extracts a portion of an image captured by the discovery object.

[0198] 20, contents 2001 and 2002 indicate contents that the control unit 203 of the server 20 uses to present to the user, upon completion of the event, information about a discovery object that the user was unable to discover during the event, together with information suggesting the area where the discovery object is located and content that extracts a portion of an image captured of the discovery object, etc. The control unit 190 of the terminal device 10A presents the content to the user by, for example, displaying it on the display 132. For example, in content 2001, information about a discovery object that the user was unable to find during an event is presented to the user along with information suggesting the area where the discovery object is located. In addition, in content 2002, information about a discovery object that the user was unable to find during an event is presented to the user along with information suggesting the area where the discovery object is located and content that extracts a portion of an image captured by the discovery object. In some aspects, the content is not limited to being presented on the day the event is held, but may be presented to the user after a predetermined period of time has elapsed since the end of the event.

[0199] This allows users to look back on their actions during the day and guess where any objects they were unable to find are located after the event has ended. This allows users to plan their next event in advance, which is expected to encourage continued participation in events.

[0200] Figure 21 shows an example screen that presents the user with information about a discovery object that the user was unable to find, along with information suggesting the area in which the discovery object is located and information about the user's range of movement in that area, upon the end of an event.

[0201] 21, content 2101 indicates content that the control unit 203 of the server 20 presents to the user, upon completion of the event, information about a discovery object that the user was unable to discover, together with information suggesting the area in which the discovery object is located and information about the user's range of movement in that area. The control unit 190 of the terminal device 10A presents the content to the user by, for example, displaying it on the display 132. For example, the server 20 acquires information about the range of the user's activities at the event from the location information sensor 150 of the terminal device 10A. Thereafter, the control unit 203 of the server 20 may create content in which the user's range of activities is superimposed on a map of the area at the event or the like based on the acquired location information, and present the content to the user.

[0202] This allows the user to compare the information about the area where the discovery object that the user was unable to find in the event is located with the user's own range of movement in that area, allowing the user to plan a different range of movement the next time they try, encouraging continued participation in the event.

[0203] Figure 22 shows an example screen that presents information to the user about the discovery object discovered by the user, as well as information about discovery objects that are scheduled to be added in the next event after a specified period of time has passed since the end of the event, new tasks for the next event, etc.

[0204] 22, content 2201 indicates content that the control unit 203 of the server 20 adds information about a discovery object that the user has discovered to information about a discovery object that will be added in the next event after a predetermined period of time has elapsed since the end of the event, information about new tasks in the next event, and the like, and presents the content to the user. The control unit 190 of the terminal device 10A presents the content to the user by, for example, displaying it on the display 132. Specifically, the control unit 203 of the server 20 presents the content based on information about a discovery object that will be added to the next event, which is stored in the storage unit 202. Alternatively, the control unit 203 of the server 20 may present a stopped content to the user in response to, for example, the following operations: · Event administrators add information about discoverable objects added in new events to the database. An operation in which the event manager adds information about a newly discovered object in an event stored in the storage unit 202 by operating a flag or the like. The control unit 203 of the server 20 presents the content including the information on the discovery object added by the above operation to the user.

[0205] In one aspect, in response to receiving an input operation from an event administrator to send a notification to a user, the control unit 203 of the server 20 may notify a user who previously participated in an event about the next event, along with information about the user's progress in the event. The notification may be sent not only on the day of the event, but also after a predetermined period has elapsed since the event. Furthermore, the control unit 203 of the server 20 may automatically send the notification to the user in response to the event administrator performing the above-mentioned additional operation, without receiving an input operation to send the notification from the event administrator.

[0206] This allows users to obtain information about the next event even after the event has ended, allowing them to revisit the events of the day. This allows users to relive the entire event experience over and over again. Furthermore, by obtaining information about the objects to be discovered that will be added in the next event and the tasks that will be presented in the next event, users will be more motivated to participate in the next event. This is expected to encourage continued participation in events.

[0207] <5 Variations> A modification of this embodiment will be described below. That is, the following aspects may be adopted. (1) An information processing device in which the program may be pre-installed or may be installed later, or such a program may be stored on an external non-transitory storage medium or may be run using cloud computing. (2) A method in which a computer functions as an information processing device, and the program may be pre-installed on the information processing device or may be installed later, or such a program may be stored on an external non-transitory storage medium, or may be operated using cloud computing.

[0208] In the series of embodiments, a method has been described in which the control unit of the server 20 uses existing image analysis or the like as a process for analyzing images, etc. acquired from the terminal device 10A or the camera 401 provided on the discovery object. However, the image analysis method is not limited to this. For example, the server 20 may have the storage unit 202 trained with a predetermined trained model, and may create content by extracting a portion of the image, etc. acquired from the terminal device 10A or the camera 401 based on the trained model. Here, the server 20 may have trained information on discovery objects placed at the event, information associating the facial expressions, voices, gestures, etc. of multiple people with emotions, etc., and may extract a portion of the image, etc. from the acquired image, etc. based on the trained model.

[0209] The content presented to the user may be a combination of the contents exemplified in the series of embodiments, and is not limited to the combination of the screen examples exemplified in each embodiment. For example, in the first embodiment, when an image of one of a plurality of users photographing another user working on an event task is presented to the user, information on the user's range of activity may also be presented. Furthermore, the content presented to the user may be digital data displayed on the display of the terminal device, or may be printed on printing paper or the like based on the information.

[0210] <6 Notes> The matters described in the above embodiments will be supplemented below.

[0211] (Appendix 1) A program for operating a computer to assist in the progress of an event in the real world in which a user group made up of multiple users participates, the program causing a processor (29) of the computer (20) to execute the steps of: acquiring (S601) a first video or still image taken by a first terminal (10A) operated by a first user in the user group, the first video or still image including other users working on a task in the event; and making at least a portion of the content of the first video or still image available to a second terminal (10A) operated by a second user in the user group in response to the user group progressing the event (S651).

[0212] (Appendix 2) The program according to Supplementary Note 1, wherein the event is an event for executing a process of discovering at least one discovery object located in one or more specific spaces in the real world while a group of users gather and move through the specific spaces, and the step of enabling provision (S651) provides the content to the second terminal in response to the lapse of a time period for discovering the discovery object in the specific spaces (Paragraphs 0111 to 0118).

[0213] (Appendix 3) The program described in Appendix 2 further causes the processor 29 to execute the steps of: acquiring a second video or still image taken by a second terminal (S701); determining whether the second video or still image includes a discovery target (S751); and, depending on the determination result, identifying the degree of progress of the event by the user group (S752).

[0214] (Appendix 4) The program according to claim 2 or 3, further causing the processor 29 to execute, for the first terminal, a step of adding, to the content, information suggesting a location where at least one object to be found is located in a specific space (paragraphs 0146 to 0148).

[0215] (Appendix 5) In the determining step (S751), the program causes the processor 29 to execute a step (S701) of accepting an input operation from any user of the user group at the second terminal to acknowledge that the discovery object has been discovered, and in response to accepting the input operation for acknowledgement, execute a step (S752) of identifying the degree of progress of the event by the user group.

[0216] (Appendix 6) The program according to Supplementary Note 5 further causes processor 29 to execute a step (S701) of acquiring a second video or still image captured by the second terminal, and a step (S751) of determining whether the second video or still image includes a discovery target, and causes the result of the determination step (S751) and the result of receiving an input operation for approval to be presented on the terminals of some users. (Paragraph 0138)

[0217] (Appendix 7) The program according to Supplementary Note 4, wherein in the step of adding to the content, the program does not present to the first terminal information about the location of the object to be found in the specific space when a predetermined period of time has elapsed during which the user group stays in the specific space during the event (paragraph 0147).

[0218] (Appendix 8) The program according to claim 5 or 6, wherein in the step of adding the content, the program does not accept input operations for approval from some users when a period of time during which a user group stays in a specific space at an event has passed a predetermined period of time. (Paragraph 0144)

[0219] (Appendix 9) A method for operating a computer to assist in the progress of an event in the real world in which a user group made up of multiple users participates, the method comprising the steps of: a processor 29 of the computer 20 acquiring (S601) a first video or still image taken by a first terminal 10A operated by a first user in the user group, the first video or still image including other users working on a task in the event; and, in response to the user group progressing the event, making at least some of the content of the first video or still image available to a second terminal 10A operated by a second user in the user group (S651).

[0220] (Appendix 10) An information processing device (20) having a control unit (203) for supporting the progress of an event in the real world in which a user group formed of multiple users participates, wherein the control unit (203) executes the steps of: acquiring a first video or still image (S601) taken by a first terminal (10A) operated by a first user in the user group, the first video or still image including other users working on a task in the event; and making at least a portion of the content of the first video or still image available to a second terminal (10A) operated by a second user in the user group in response to the user group progressing the event (S651). [Explanation of symbols]

[0221] 10 terminal device, 12 communication interface, 13 input device, 14 output device, 15 memory, 16 storage unit, 19 processor, 20 server, 22 communication interface, 23 input / output interface, 25 memory, 26 storage, 29 processor, 40 discovered object, 80 network, 181 user information, 191 input operation acceptance unit, 192 transmission / reception unit, 193 data processing unit, 194 notification control unit, 132 display, 150 location information sensor, 160 camera, 281 event information database, 282 participant information database, 283 object information database, 284 hint information database, 285 event history database, 401 camera, 2041 reception control module, 2042 transmission control module, 2043 event information acquisition module, 2044 participant information acquisition module, 2045 object information acquisition module, 2046 hint information acquisition module, 2047 Object display module, 2048 hint presentation module, 2049 approval acceptance module.

Claims

1. A program for operating a computer to support the progress of an event in which a user participates in the real world, the program causing a processor of the computer to: setting a first object and a second object as search targets for the user among a plurality of objects imitating the shape of a character and arranged in a predetermined space in which the user moves in the real world; presenting silhouettes of the shapes of the first object and the second object to the user; determining whether the first object is included in a captured image captured by the user's terminal based on a capturing operation of the user; After determining that the first object is included in the photographed image, presenting a list of the discovered object and the undiscovered object on the terminal in a display mode in which the silhouette of the first object is removed as a discovered object and in a display mode in which the silhouette of the second object remains as an undiscovered object. A program that executes.

2. The program according to claim 1 , further comprising: a step of: presenting information about the first object on the terminal after determining that the captured image contains the first object.

3. 2. The program according to claim 1, wherein in the setting step, when all of the set search targets are found by the user, a new search target is set.

4. An information processing device owned by a user, the information processing device having a computer for supporting the progress of an event in which the user participates in the real world, the information processing device comprising: accepting, as search targets for the user, a first object and a second object among a plurality of objects imitating a shape of a character and arranged in a predetermined space in which the user moves in the real world; displaying silhouettes of the shapes of the first object and the second object; determining whether the first object is included in a photographing range based on a photographing operation by the user; When the first object is discovered by including the first object in the photographing range, the discovered object and the undiscovered object are displayed in a list in a display mode in which the silhouette of the first object is removed as a discovered object and the silhouette of the second object is displayed as an undiscovered object. An information processing device that executes the above.

5. The information processing apparatus according to claim 4 , wherein the processor executes a step of displaying information about the first object when the first object is found by including the first object in the photographing range.

6. 5. The information processing apparatus according to claim 4, wherein in the accepting step, a new search target is accepted when all of the accepted search targets have been found by the user.

Images