Server apparatus, method for controlling server apparatus, and storage medium

Abstract

To provide a server device for easily detecting a suspicious person in a facility such as a theme park used by many users.SOLUTION: The server device includes storage means and control means. The storage means stores an action history of each of a plurality of stayers staying in a predetermined area. The control unit detects, as a potentially suspicious person, a stayer for whom a predetermined time has elapsed since the last storage of the behavior history from among the plurality of stayers, using the behavior history of each of the plurality of stayers. The control means notifies a predetermined person of the presence of the detected potentially suspicious person.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a server device, a method for controlling a server device, and a program. [Background technology]

[0002] There is technology for detecting suspicious individuals.

[0003] For example, Patent Document 1 describes a surveillance system that can capture images of blind spots of fixed cameras. The surveillance system in Patent Document 1 includes a fixed camera that monitors a predetermined range, a movable camera that can move to capture images of the blind spots of the fixed camera, an analysis unit that detects suspicious individuals from images captured by the fixed camera, and a movement instruction unit. The movement instruction unit instructs the movable camera to move to the blind spot located in the direction of movement of the suspicious individual detected by the analysis unit. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Publication No. 2024-054532 Summary of the Invention [Problem to be solved by the invention]

[0005] In buildings that house corporate offices, etc., it is relatively easy to detect suspicious individuals using the technology disclosed in Patent Document 1. That is, a person hiding in a blind spot in a building can be detected as a suspicious individual.

[0006] On the other hand, it is difficult to detect suspicious individuals in facilities used by many people, such as theme parks and amusement parks. For example, it is difficult for security guards to distinguish, based on camera footage, between someone who has been sitting on a bench for a long time with the intention of committing fraud and someone who is just sitting on a bench for a rest.

[0007] The main object of the present invention is to provide a server device, a method for controlling a server device, and a program that contribute to facilitating the detection of suspicious individuals in facilities used by a large number of users, such as theme parks. [Means for solving the problem]

[0008] According to a first aspect of the present invention, a server device is provided which includes: a storage means for storing the behavioral history of each of a plurality of visitors who are staying in a specified area; and a control means for using the behavioral history of each of the plurality of visitors to detect as a potentially suspicious person any visitor among the plurality of visitors whose behavioral history has been last stored for a specified time period, and notifying a specified person of the presence of the detected potentially suspicious person.

[0009] According to a second aspect of the present invention, there is provided a control method for a server device, comprising: a storage step of storing the behavioral history of each of a plurality of visitors staying in a specified area; and a control step of using the behavioral history of each of the plurality of visitors to detect as a potentially suspicious person any visitor for whom a predetermined time has passed since the last time their behavioral history was stored, and notifying a specified person of the presence of the detected potentially suspicious person.

[0010] According to a third aspect of the present invention, there is provided a program for causing a computer mounted on a server device to execute a storage process for storing the behavioral history of each of a plurality of visitors who are staying in a specified area, and a control process for using the behavioral history of each of the plurality of visitors to detect as a potentially suspicious person any visitor for whom a predetermined time has elapsed since the last time their behavioral history was stored, and notifying a specified person of the presence of the detected potentially suspicious person. [Effects of the Invention]

[0011] According to each aspect of the present invention, a server device, a control method for a server device, and a program are provided that contribute to facilitating the detection of suspicious individuals in facilities used by many users, such as theme parks. Note that the effects of the present invention are not limited to those described above. The present invention may achieve other effects instead of or in addition to the effects described above. [Brief explanation of the drawings]

[0012] [Figure 1] FIG. 1 is a diagram for explaining an outline of an embodiment. [Figure 2] FIG. 2 is a flowchart for explaining an outline of the operation of one embodiment. [Figure 3] FIG. 3 is a diagram illustrating an example of a schematic configuration of an information processing system according to an embodiment of the present disclosure. [Figure 4] FIG. 4 is a diagram for explaining the operation of the information processing system according to the embodiment of the present disclosure. [Figure 5] FIG. 5 is a diagram for explaining the operation of the information processing system according to the embodiment of the present disclosure. [Figure 6] FIG. 6 is a diagram illustrating an example of a display on the security guard terminal according to an embodiment of the present disclosure. [Figure 7] FIG. 7 is a diagram illustrating an example of a processing configuration of a server device according to an embodiment of the present disclosure. [Figure 8] FIG. 8 is a diagram illustrating an example of a user management database according to an embodiment of the present disclosure. [Figure 9] FIG. 9 is a flowchart illustrating an example of the operation of the authentication unit according to an embodiment of the present disclosure. [Figure 10] FIG. 10 is a diagram illustrating an example of an attendee management database according to an embodiment of the present disclosure. [Figure 11] FIG. 11 is a flowchart showing an example of the operation of the suspicious person control unit according to the embodiment of the present disclosure. [Figure 12] FIG. 12 is a diagram for explaining the operation of the suspicious person control unit according to the embodiment of the present disclosure. [Figure 13]FIG. 13 is a sequence diagram illustrating an example of the operation of the information processing system according to an embodiment of the present disclosure. [Figure 14] 14A and 14B are diagrams for explaining the operation of the suspicious person control unit according to the modified example of the embodiment of the present disclosure. [Figure 15] FIG. 15 is a diagram illustrating an example of a hardware configuration of a server device according to the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0013] First, an overview of one embodiment will be described. Note that the reference numerals in the drawings are added to each element for convenience as an example to facilitate understanding, and the description of this overview is not intended to be limiting in any way. Furthermore, unless otherwise specified, the blocks shown in each drawing represent functional units, not hardware units. Connection lines between blocks in each drawing include both bidirectional and unidirectional lines. Unidirectional arrows are used to schematically indicate the flow of main signals (data) and do not exclude bidirectionality. Note that in this specification and drawings, elements that can be similarly described may be assigned the same reference numerals to avoid redundant explanation.

[0014] A server device 100 according to one embodiment includes a storage unit 101 and a control unit 102 (see FIG. 1). The storage unit 101 stores the behavioral history of each of a plurality of visitors who are staying in a predetermined area (step S1 in FIG. 2). The control unit 102 uses the behavioral history of each of the plurality of visitors to detect, as a potentially suspicious person, a visitor whose behavioral history has been stored for a predetermined time period (step S2). The control unit 102 notifies a predetermined person of the presence of the detected potentially suspicious person (step S3).

[0015] The server device 100 generates a behavior history of a visitor staying in a predetermined area using, for example, biometric authentication and stores the generated behavior history. If a visitor in a predetermined area does not perform any action for a predetermined period of time, the server device 100 detects the visitor as a potentially suspicious person. For example, visitors to a theme park are expected to perform certain actions, such as participating in attractions or purchasing merchandise at a convenience store. However, a visitor who does not perform any of the actions expected of a normal user has the potential to become a suspicious person in the future. The server device 100 detects potentially suspicious persons that are difficult for security guards to detect, using the behavior history of each visitor. The operation of the server device 100 allows security guards to easily detect suspicious persons in facilities used by many users, such as theme parks.

[0016] Specific embodiments will be described in more detail below with reference to the drawings.

[0017] [First embodiment] The first embodiment will be described in more detail with reference to the drawings.

[0018] An information processing system according to a first embodiment performs crime prevention, security, etc. for a predetermined area. In the first embodiment, the configuration, operation, etc. of the information processing system will be described using a theme park as an example of the predetermined area.

[0019] [System Configuration] 3 is a diagram illustrating an example of a schematic configuration of an information processing system according to an embodiment of the present disclosure. As shown in FIG. 3, the information processing system includes a server device 10, a plurality of authentication terminals 20-1 to 20-4, and a plurality of camera devices 30-1 and 30-2.

[0020] The server device 10 sells tickets for admission to a theme park, etc. The server device 10 also controls admission to the theme park, etc. Furthermore, the server device 10 controls security and crime prevention at the theme park.

[0021] The server device 10 may be installed in a theme park, or may be installed on a network (on the cloud).

[0022] The authentication terminal 20-1 is, for example, a gate-type device installed at the entrance to the entire theme park. The authentication terminal 20-1 allows passage to users who have the authority to enter the theme park and denies passage to users who do not have the authority.

[0023] The authentication terminal 20-2 is, for example, a gate-type device installed at the exit of the entire theme park. The authentication terminal 20-2 permits passage (exit from the theme park) of users who have entered the theme park with legitimate authority, and denies passage of users who do not have legitimate authority.

[0024] The authentication terminal 20-3 is, for example, a tablet or signage type terminal installed at the entrance of an attraction. The authentication terminal 20-3 detects users who wish to participate in the attraction. The authentication terminal 20-3 then settles the attraction fee for the detected users.

[0025] The authentication terminal 20-4 is, for example, a POS (Point of Sale) terminal installed in a shop, etc. The authentication terminal 20-4 performs payment for products, etc., purchased by the user at the shop.

[0026] In the following explanation, unless there is a particular reason to distinguish between authentication terminals 20-1 to 20-4, they will simply be referred to as "authentication terminal 20." Similarly, for other elements, the reference numeral to the left of the hyphen will represent that element.

[0027] The authentication terminal 20 is a touch point installed at various locations in the theme park. The authentication terminal 20 is a terminal or device that serves as an interface when a user (person to be authenticated) receives services.

[0028] Camera devices 30 are installed in various locations throughout the theme park. For example, camera devices 30 may be security cameras. Alternatively, camera devices 30 may be digital signage devices equipped with cameras that guide users through the theme park. Camera devices 30 capture images of a predetermined area and transmit the image data obtained by capturing the images to server device 10.

[0029] Additionally, a security management center (not shown in FIG. 3 etc.) is installed in the theme park, and security guards and others are on standby at the security management center. Image data captured by camera device 30 is also transmitted to the security management center. Security guards and others monitor the theme park using the image data captured by camera device 30.

[0030] A user carries a terminal 40. The user operates the terminal 40 to input various information into the server device 10. For example, the user operates the terminal 40 to access the server device 10 and purchase a ticket for admission to a theme park.

[0031] Each device shown in Fig. 3 is connected to a network. Specifically, the server device 10, authentication terminal 20, camera device 30, terminal 40, etc. are connected to the network by wired or wireless communication means. Note that in Fig. 3, connection lines showing the connection between the network and some devices, etc. are omitted.

[0032] The configuration of the information processing system shown in Fig. 3 is an example and is not intended to be limiting. For example, multiple server devices 10 may be included in the system. Load balancing and redundancy may be achieved by multiple server devices 10. Furthermore, the number of authentication terminals 20 and camera devices 30 included in the information processing system is not limited to that shown in Fig. 3, as a matter of course.

[0033] [General operation] Next, the general operation of the information processing system according to the first embodiment will be described.

[0034] <Create an account> A user visiting the theme park creates an account on the server device 10. For example, the user operates the terminal 40 to access a user registration page provided by the server device 10.

[0035] The user enters their name, gender, date of birth, address, login information (e.g., ID, password), biometric information, phone number, email address, account information (e.g., credit card information), etc. into the user registration page.

[0036] Examples of biometric information include data (features) calculated from physical characteristics unique to an individual, such as a face, fingerprint, voiceprint, veins, retina, or iris pattern. Alternatively, biometric information may be image data such as a face image or fingerprint image. Biometric information may be any information that includes an individual's physical characteristics. In the present disclosure, biometric information is defined as a person's face image or features generated from a face image.

[0037] When the server device 10 acquires the user's name, biometric information, etc., it stores this information in a user management database and creates an account for the user. The user management database will be described in detail later.

[0038] <Ticket Purchase> A user who has created an account purchases a ticket for admission to a theme park. For example, the user operates terminal 40 to log in to the account and purchase a ticket. Server device 10 stores information about the ticket purchased by the user (ticket information) in a user management database.

[0039] <Admission to the theme park> A user enters the theme park through authentication terminal 20-1 (gate device). When authentication terminal 20-1 detects a user (person to be authenticated), it transmits an authentication request including the biometric information and terminal ID of the person to be authenticated to server device 10 (see FIG. 4).

[0040] The terminal ID is an ID for identifying the authentication terminal 20. The MAC (Media Access Control) address or IP (Internet Protocol) address of the authentication terminal 20 can be used as the terminal ID.

[0041] The terminal ID is shared by any method between the server device 10 and the authentication terminal 20. For example, a system administrator determines a terminal ID and sets the determined terminal ID in the server device 10. The system administrator also sets the determined terminal ID in the authentication terminal 20.

[0042] When receiving the authentication request, the server device 10 identifies the sender of the authentication request using the terminal ID included in the authentication request. In this case, the server device 10 identifies the authentication terminal 20-1 set at the entrance of the theme park as the sender of the authentication request.

[0043] Furthermore, the server device 10 executes authentication processing (one-to-N authentication; N is a positive integer, the same applies below) using the biometric information included in the authentication request and the biometric information stored in the user management database.

[0044] If the person to be authenticated has a valid ticket (a ticket that is valid for the entry date), server device 10 notifies authentication terminal 20-1 of successful authentication. In this case, server device 10 transmits an affirmative response indicating successful authentication to authentication terminal 20-1.

[0045] The server device 10 also stores the fact that the user has entered the theme park in the visitor management data. Specifically, the server device 10 transcribes the entry of the user who entered the theme park from among the multiple entries stored in the user management database into the visitor management database. The visitor management database will be described in detail later.

[0046] If the person to be authenticated does not have a valid ticket, server device 10 notifies authentication terminal 20-1 of authentication failure. In this case, server device 10 transmits a negative response indicating authentication failure to authentication terminal 20-1.

[0047] The authentication terminal 20-1 receives the authentication result (authentication success, authentication failure). If authentication success is received, the authentication terminal 20-1 opens the gate and allows the person to be authenticated to pass. If authentication failure is received, the authentication terminal 20-1 closes the gate and denies the person to be authenticated from passing.

[0048] <Collection of behavioral history> When a user enters the theme park, they can participate in attractions or purchase merchandise at a shop. At this time, payment for the attraction fees and merchandise costs is processed at authentication terminals 20-3 and 20-4.

[0049] For example, when authentication terminal 20-3 installed in an attraction detects a user (person to be authenticated), it transmits to server device 10 an authentication request including the biometric information of the person to be authenticated and the terminal ID.

[0050] Based on the terminal ID, the server device 10 identifies that the sender of the authentication request is the authentication terminal 20-3 installed in the attraction. Furthermore, the server device 10 performs authentication processing (one-to-many authentication) using the biometric information included in the authentication request and the biometric information stored in the visitor management database. By performing the authentication processing, the server device 10 identifies the person to be authenticated from among the visitors in the theme park.

[0051] If the identified person to be authenticated successfully pays the attraction admission fee, the server device 10 notifies the authentication terminal 20-3 of successful authentication. In this case, the server device 10 sends an affirmative response indicating successful authentication to the authentication terminal 20-3. The server device 10 also stores the fact that the user has used the attraction in the visitor management database. That is, the server device 10 stores the behavior history of the attraction user in the visitor management database.

[0052] If the person to be authenticated fails to pay the attraction admission fee, server device 10 notifies authentication terminal 20-3 of the authentication failure. In this case, server device 10 transmits a negative response indicating the authentication failure to authentication terminal 20-3.

[0053] The authentication terminal 20-3 receives the authentication result (authentication success, authentication failure). The authentication terminal 20-3 notifies the authentication result to staff or the like waiting at the attraction. The staff provides guidance (service) according to the authentication result.

[0054] When a user purchases a product or the like at a shop, the payment process is carried out in the same way as for the admission fee for the attraction. Specifically, the authentication terminal 20-4 sends an authentication request including the biometric information of the person to be authenticated, payment information, and terminal ID to the server device 10. The payment information is detailed information about the purchased product or service, including the name and price of the purchased product, etc.

[0055] When the payment process for the purchased items using the account information of the person to be authenticated is successful, the server device 10 notifies the authentication terminal 20-4 of the successful authentication. At that time, the server device 10 stores the fact that the user purchased items at the shop (behavior history) in the visitor management database.

[0056] <Exiting the theme park> A visitor to the theme park passes through authentication terminal 20-2 installed at the exit to exit the park. Authentication terminal 20-2 transmits an authentication request to server device 10, which includes the biometric information and terminal ID of the person to be authenticated.

[0057] The server device 10 performs authentication processing (one-to-many authentication) using the biometric information of the person to be authenticated and the biometric information stored in the attendee management database. If the biometric information of the person leaving is registered in the attendee management database, the server device 10 notifies the authentication terminal 20-2 that the authentication has been successful. In this case, the server device 10 deletes the entry of the person leaving from the attendee management database.

[0058] If the biometric information of the person leaving the venue is not registered in the visitor management database, the server device 10 notifies the authentication terminal 20-2 of a failure in authentication.

[0059] The authentication terminal 20-2 receives the authentication result (authentication success, authentication failure). If authentication success is received, the authentication terminal 20-2 opens the gate and allows the authenticated person to pass (exit from the theme park). If authentication failure is received, the authentication terminal 20-2 closes the gate and denies the authenticated person from passing (exit from the theme park). In this case, the authentication terminal 20-2 may provide guidance to the user attempting to exit, such as instructing them to head to a security management center or the like.

[0060] <Detection of potentially suspicious individuals> The server device 10 detects potentially suspicious individuals in the theme park periodically or at a predetermined timing. That is, the server device 10 detects as potentially suspicious individuals individuals (visitors, visitors) who are not currently exhibiting any clearly suspicious behavior but who are likely to exhibit suspicious behavior in the future.

[0061] Specifically, the server device 10 accesses the visitor management database periodically or at a predetermined timing. The server device 10 refers to the behavioral history of each visitor and extracts as potentially suspicious persons those visitors whose last behavioral history has been stored a predetermined time (e.g., three hours). In other words, the server device 10 detects as potentially suspicious persons those visitors who enter a theme park but do not engage in any of the behaviors expected of a normal user, such as participating in an attraction or purchasing merchandise at a shop.

[0062] When a potentially suspicious person is detected, the server device 10 stores the fact in the visitor management database.

[0063] <Monitoring the behavior of potentially suspicious individuals> When a potential suspicious individual is detected, the server device 10 sets the detected potential suspicious individual as a monitoring target. More specifically, the server device 10 tracks the detected potential suspicious individual. The server device 10 starts the tracking at the timing when the potential suspicious individual is detected in the theme park.

[0064] Here, the camera device 30 installed in the theme park periodically or at a predetermined timing transmits image data to the server device 10. Specifically, the camera device 30 transmits the image data to the server device 10 together with a camera ID.

[0065] The camera ID is an ID for identifying each camera device 30 installed in the theme park. The MAC (Media Access Control) address or IP (Internet Protocol) address of the camera device 30 can be used as the camera ID.

[0066] The camera ID is shared by any method between the server device 10 and the camera device 30. For example, a system administrator determines a camera ID and sets the determined terminal ID in the server device 10. The system administrator also sets the determined camera ID in the camera device 30.

[0067] The server device 10 identifies the location where the image data was captured based on the camera ID notified from the camera device 30. Furthermore, if a person is captured in the acquired image data, the server device 10 identifies the person being photographed (the person photographed by the camera device 30) using the person's biometric information.

[0068] Specifically, the server device 10 determines whether a person appearing in the image data is a potentially suspicious person by performing a matching process using the biometric information of the person being photographed extracted from the image data and the biometric information of the potentially suspicious person stored in the visitor management database.

[0069] If the person to be photographed is not a potentially suspicious person (if the biometric information of the person to be photographed is not stored as biometric information of a potentially suspicious person), the server device 10 does not perform any particular process.

[0070] If the person being photographed is a potentially suspicious person (if the biometric information of the person being photographed is stored as biometric information of a potentially suspicious person), the server device 10 notifies a security guard waiting at a crime prevention management center or the like of the image data and the location where the image was taken.

[0071] Specifically, the server device 10 transmits a "potentially suspicious person detection notification" including the image data and the location where the image was taken to the security guard terminal 41 carried by the security guard (see FIG. 5).

[0072] The security guard terminal 41 displays the information included in the potentially suspicious person detection notification (see FIG. 6). The security guard checks the image data etc. displayed on the security guard terminal 41 and determines whether the person detected as a potentially suspicious person by the server device 10 is a genuine suspicious person. If the security guard determines that the potentially suspicious person is a suspicious person, he or she will head to the scene and speak to the person.

[0073] The server device 10 continues to transmit image data of the potential suspicious individual to the security guard terminal 41. As a result, the security guard can continuously check the behavior of the potential suspicious individual. In other words, the server device 10 and the camera device 30 can track and monitor the potential suspicious individual.

[0074] Next, details of each device included in the information processing system according to the first embodiment will be described.

[0075] [Server device] 7 is a diagram illustrating an example of a processing configuration (processing module) of the server device 10 according to the embodiment of the present disclosure. Referring to FIG. 7, the server device 10 includes a communication control unit 201, a user registration control unit 202, a ticket sales control unit 203, an authentication unit 204, a suspicious person control unit 205, and a storage unit 206.

[0076] The communication control unit 201 is a means for controlling communication with other devices. For example, the communication control unit 201 receives data (packets) from the authentication terminal 20. The communication control unit 201 also transmits data to the authentication terminal 20. The communication control unit 201 passes data received from other devices to other processing modules. The communication control unit 201 transmits data acquired from other processing modules to other devices. In this way, other processing modules transmit and receive data to and from other devices via the communication control unit 201. The communication control unit 201 has a function as a receiving unit that receives data from other devices and a function as a transmitting unit that transmits data to other devices.

[0077] The user registration control unit 202 is a means for controlling user registration. When a user operates the terminal 40 to perform a predetermined action on the user registration site (for example, pressing the account creation button), the user registration control unit 202 acquires information about the user.

[0078] For example, the user registration control unit 202 displays a GUI (Graphical User Interface) on the terminal 40 and acquires the user's name, gender, date of birth, address, login information (e.g., ID, password), biometric information, telephone number, email address, account information, etc.

[0079] When a face image is acquired as biometric information at the user registration site, the user registration control unit 202 generates feature amounts from the face image.

[0080] Since existing technology can be used for the feature generation process by the user registration control unit 202, a detailed description thereof will be omitted. For example, the user registration control unit 202 extracts the eyes, nose, mouth, etc. from the face image as feature points. Thereafter, the user registration control unit 202 calculates the position of each feature point and the distance between each feature point as feature amounts (generating a feature vector consisting of multiple feature amounts).

[0081] Furthermore, the user registration control unit 202 generates a user ID for identifying the user. The user ID may be any information that can uniquely identify the user. For example, the user registration control unit 202 may assign a unique value each time information about a user is acquired and use this as the user ID.

[0082] The user registration control unit 202 issues the generated user ID to the user (terminal 40 held by the user) as necessary.

[0083] The user registration control unit 202 stores the user ID, name, biometric information, account information, etc. in the user management database (see FIG. 8). The user management database shown in FIG. 8 is an example and is not intended to limit the items to be stored.

[0084] The ticket sales control unit 203 is a means for controlling ticket sales.

[0085] When a user who has logged in to an account wishes to purchase a ticket, the ticket sales control unit 203 sells the ticket to the user. The ticket sales control unit 203 stores information about the sold ticket (ticket information; for example, the date of visit to the theme park) in the user management database.

[0086] A detailed explanation of ticket sales will be omitted, as ticket sales are obvious to those skilled in the art and are not within the scope of the present disclosure.

[0087] The authentication unit 204 is a means for authenticating the person to be authenticated.

[0088] 9 is a flowchart showing an example of the operation of the authentication unit 204 according to an embodiment of the present disclosure. The operation of the authentication unit 204 when an authentication request is received from the authentication terminal 20-1 will be described with reference to FIG.

[0089] When receiving an authentication request, the authentication unit 204 identifies the sender of the authentication request based on the terminal ID included in the authentication request (step S101).

[0090] Specifically, the authentication unit 204 identifies the sender of the authentication request by referring to table information that stores the terminal ID and information about the authentication terminal 20 (for example, the type and installation location of the authentication terminal 20) in association with each other.

[0091] The authentication unit 204 executes processing according to the identified sender of the authentication request. In this example, authentication terminal 20-1 installed at the entrance to the theme park is identified as the sender of the authentication request. The authentication unit 204 executes control related to the authentication of users attempting to enter the theme park.

[0092] The authentication unit 204 performs a matching process using the biometric information included in the authentication request and the biometric information stored in the user management database (step S102).

[0093] Specifically, the authentication unit 204 generates features from the face image included in the authentication request. The authentication unit 204 sets the generated features as a matching target and performs matching processing (1:N matching) with features registered in the user management database.

[0094] The authentication unit 204 calculates the similarity between the feature to be matched and each of the multiple feature values ​​on the registration side. The similarity can be calculated using chi-square distance, Euclidean distance, or the like. Note that the greater the distance, the lower the similarity, and the closer the distance, the higher the similarity.

[0095] The authentication unit 204 determines that the matching process has failed if there is no feature among the multiple feature amounts registered in the user management database that has a similarity with the feature amount to be matched that is equal to or greater than a predetermined value.

[0096] The authentication unit 204 determines that the matching process is successful if there is a feature among the multiple feature amounts registered in the user management database that has a similarity with the feature amount to be matched that is equal to or greater than a predetermined value. In this case, the user of the entry corresponding to the feature amount with the highest similarity is identified as the person to be authenticated (a visitor entering the theme park).

[0097] If the matching process fails (step S103, No branch), the authentication unit 204 transmits a negative response indicating that the authentication of the authenticatee has failed to the authentication terminal 20 (step S104).

[0098] If the matching process is successful (step S103, Yes branch), the authentication unit 204 determines whether the person to be authenticated identified by the matching process has a valid ticket (ticket determination process; step S105). For example, if the processing date of the authentication request matches the entry date written in the ticket information field, the authentication unit 204 determines that the person to be authenticated has a valid ticket.

[0099] If the ticket is invalid (step S106, No branch), the authentication unit 204 transmits a negative response indicating authentication failure to the authentication terminal 20 (step S104).

[0100] If the ticket is valid (step S106, Yes branch), the authentication unit 204 transmits an affirmative response indicating successful authentication to the authentication terminal 20 (step S107).

[0101] Furthermore, the authentication unit 204 adds a new entry to the visitor management database and stores in the added entry all or part of the information set in the entry of the person to be authenticated who has been determined to have been successfully authenticated. For example, the authentication unit 204 transcribes the entry of the person to be authenticated who has been determined to have been successfully authenticated (entry in the user management database) to the visitor management database (transcribe entry; step S108).

[0102] Fig. 10 is a diagram showing an example of a visitor management database. As shown in Fig. 10, the visitor management database stores the user ID, biometric information, etc. of visitors staying at the theme park, as well as a flag (suspicious person flag) indicating whether the visitor is a potentially suspicious person and their behavioral history.

[0103] The authentication unit 204 stores the user's behavior history in the visitor management database (step S109). Specifically, the authentication unit 204 stores the user's entry into the theme park in the behavior history field of the transcribed entry. For example, the authentication unit 204 stores information such as "August 1, 2024, 8:00: Entry" in the behavior history field.

[0104] In this way, authentication unit 204 receives biometric information of a first person to be authenticated who is attempting to enter a predetermined area from a first authentication terminal (authentication terminal 20-1) installed at the entrance to the predetermined area. Authentication unit 204 authenticates the first person to be authenticated using the received biometric information of the first person to be authenticated and the biometric information of each of multiple users stored in the user management database (second database). Authentication unit 204 stores the fact that the first person to be authenticated who has been successfully authenticated has entered the predetermined area as a behavior history in the first database (entry person management database).

[0105] A detailed description of the operation of authentication unit 204 when an authentication request is received from authentication terminals 20-2 to 20-4 will be omitted here because the operation of authentication unit 204 when an authentication request is received from authentication terminal 20-1 will be clear to those skilled in the art who have read the above description of authentication unit 204 when an authentication request is received from authentication terminal 20-1.

[0106] For example, when an authentication request is received from authentication terminal 20-3 or 20-4, authentication unit 204 executes a matching process using the biometric information stored in the visitor management database. If payment (payment for attraction admission fees or merchandise purchases) using the account information of the person to be authenticated identified by the matching process is successful, authentication unit 204 notifies authentication terminal 20 of successful authentication.

[0107] If the matching process fails or if payment (payment for attraction fees or product purchase prices) using the account information of the person to be authenticated identified by the matching process fails, the authentication unit 204 notifies the authentication terminal 20-3 or 20-4 of the authentication failure.

[0108] If the authentication is successful, the authentication unit 204 stores information related to the authentication terminal 20 that sent the authentication request as the behavior history of the person to be authenticated in the visitor management database. For example, the authentication unit 204 stores information such as "August 1, 2024, 10:30: Attended attraction A" and "August 1, 2024, 11:00: Purchased a product" in the visitor management database.

[0109] In this way, authentication unit 204 receives the biometric information of the second person to be authenticated from a second authentication terminal (authentication terminal 20-3 or 20-4) installed in a predetermined area. Authentication unit 204 authenticates the second person to be authenticated using the received biometric information of the second person to be authenticated and the biometric information of each of the multiple visitors stored in the visitor management database (first database). Authentication unit 204 stores information related to the second authentication terminal in the first database as the behavior history of the second person to be authenticated who has been successfully authenticated.

[0110] Furthermore, when an authentication request is received from authentication terminal 20-2, if the matching process is successful, authentication unit 204 notifies authentication terminal 20-2 of authentication success. On the other hand, if the matching process is unsuccessful, authentication unit 204 notifies authentication terminal 20 of authentication failure.

[0111] In addition, if the authentication request from the authentication terminal 20-2 installed at the exit of the theme park is successfully processed (if the person to be authenticated is successfully authenticated), the authentication unit 204 deletes the entry in the visitor management database identified by the matching process.

[0112] In this way, authentication unit 204 receives the biometric information of the third person to be authenticated from a third authentication terminal (authentication terminal 20-2) installed at the exit of the specified area. Authentication unit 204 authenticates the third person to be authenticated using the received biometric information of the third person to be authenticated and the biometric information of each of the multiple visitors stored in the visitor management database (first database). Authentication unit 204 deletes the entry in the first database corresponding to the third person to be authenticated who has been successfully authenticated.

[0113] As described above, when a user enters a theme park, the authentication unit 204 transcribes the user's entry into the visitor management database, and when the user leaves the theme park, the authentication unit 204 deletes the user's entry from the visitor management database. As a result, the visitor management database functions as a list of visitors staying at the theme park.

[0114] The suspicious person control unit 205 is a means for controlling suspicious people (potentially suspicious people) in the theme park.

[0115] The suspicious person control unit 205 uses the behavioral history of each of the multiple visitors to detect as a potentially suspicious person any visitor whose behavioral history has been last stored for a predetermined time from the multiple visitors. The suspicious person control unit 205 notifies a predetermined person (e.g., a security guard) of the presence of the detected potentially suspicious person.

[0116] 11 is a flowchart showing an example of the operation of the suspicious person control unit 205 according to the embodiment of the present disclosure. The operation of the suspicious person control unit 205 will be described with reference to FIG.

[0117] The suspicious person control unit 205 attempts to detect a potentially suspicious person (step S201).

[0118] Specifically, the suspicious person control unit 205 accesses the visitor management database periodically or at a predetermined timing.

[0119] The suspicious person control unit 205 reads out the latest behavior history recorded in the behavior history field of each entry in the visitor management database. The suspicious person control unit 205 compares the current time with the storage time of the latest behavior history read out, and if there is an entry whose behavior history has been stored for a predetermined time, it determines that a potentially suspicious person has been detected.

[0120] If no such entry is detected, the suspicious individual control unit 205 determines that a potentially suspicious individual has not been detected.

[0121] More specifically, the suspicious person control unit 205 calculates the difference between the current time and the storage time of the latest behavior history, and performs threshold processing on the difference to determine whether or not the above entry exists. The suspicious person control unit 205 determines whether or not there is an entry whose behavior history has not been stored for a predetermined period of time (e.g., 3 hours).

[0122] For example, in the example of Figure 10, if the current time is "11:10" and the above-mentioned specified period is 3 hours, the time when the last behavior of the visitor with user ID "ID12" was stored is "8:00", so the visitor is detected as a potentially suspicious person.

[0123] If no potentially suspicious individual is detected (step S202, No branch), the suspicious individual control unit 205 ends the process.

[0124] When a potentially suspicious person is detected (step S202, Yes branch), the suspicious person control unit 205 stores the fact that a potentially suspicious person has been detected in the visitor management database. Specifically, the suspicious person control unit 205 sets a suspicious person flag in the entry (step S203). In the example of Fig. 10, "○" is set in the suspicious person flag field of the second entry from the top.

[0125] Furthermore, the suspicious individual control unit 205 starts tracking the potentially suspicious individual (step S204).

[0126] Specifically, the suspicious person control unit 205 extracts image data in which a potentially suspicious person is captured from the image data received from each camera device 30 installed in the theme park.

[0127] More specifically, the suspicious person control unit 205 attempts to extract at least one face image (face area) from each image data.

[0128] Note that the facial image extraction process by the suspicious person control unit 205 can use existing technology, and therefore detailed description thereof will be omitted. For example, the suspicious person control unit 205 may extract a facial image (face region) from image data using a learning model trained by a CNN (Convolutional Neural Network). Alternatively, the suspicious person control unit 205 may extract a facial image using a method such as template matching.

[0129] The suspicious person control unit 205 discards image data from which a face image cannot be extracted.

[0130] When at least one or more face images are extracted from the image data, the suspicious person control unit 205 determines whether or not the extracted one or more face images include a face image of a potentially suspicious person.

[0131] Specifically, the suspicious person control unit 205 executes a matching process (one-to-one matching) using a face image extracted from the image data and the biometric information of a potentially suspicious person stored in the visitor management database.

[0132] The suspicious person control unit 205 generates features from the face image extracted from the image data, and calculates the similarity between the generated features and the features stored in the entry in the visitor management database for which the suspicious person flag is set.

[0133] If the similarity is smaller than a predetermined value, the suspicious person control unit 205 determines that the face image extracted from the image data is not a face image of a potentially suspicious person. In this case, the suspicious person control unit 205 performs the same process on other face images extracted from the same image data, and determines whether the face images shown in the image data are face images of a potentially suspicious person.

[0134] If the facial image of a potentially suspicious person is not included in at least one facial image extracted from the image data, the suspicious person control unit 205 determines whether the next image data (image data different from the processing target) includes a facial image of a potentially suspicious person.

[0135] If the similarity is equal to or greater than a predetermined value, the suspicious person control unit 205 determines that the facial image extracted from the image data is a facial image of a potentially suspicious person. In this case, the suspicious person control unit 205 determines that a potentially suspicious person is captured in the image data to be processed.

[0136] For example, consider a case in which three visitors 51-1 to 51-3 appear in image data as shown in Fig. 12. In this case, the suspicious person control unit 205 extracts a facial image of each visitor 51 from the image data. The suspicious person control unit 205 determines whether each of the three facial images substantially matches the facial image of a potential suspicious person. For example, if the similarity between the feature amount generated from the facial image of visitor 51-1 and the feature amount of a person set as a potential suspicious person in the visitor management database is equal to or greater than a predetermined value, visitor 51-1 is determined to be a potential suspicious person.

[0137] In this way, the suspicious person control unit 205 uses the biometric information of the potential suspicious person stored in the visitor management database (first database) to extract image data that shows the potential suspicious person from the image data received from each of the camera devices 30 installed in the specified area. More specifically, the suspicious person control unit 205 extracts image data that shows the potential suspicious person by performing a matching process using the biometric information of the potential suspicious person and biometric information obtained from at least one or more received image data.

[0138] When image data in which a potentially suspicious individual is photographed is identified, the suspicious individual control unit 205 notifies a security guard or the like of the presence of the potentially suspicious individual.

[0139] Specifically, the suspicious person control unit 205 identifies the location where the image data showing the potentially suspicious person was taken, based on the camera ID of the camera device 30 that acquired the image data. For example, the suspicious person control unit 205 identifies the location where the image data was taken, by referring to table information that stores the camera ID and the installation location (photography location) of the camera device 30 in association with each other.

[0140] Thereafter, the suspicious person control unit 205 transmits a "potentially suspicious person detection notification" including the image data and the location where the image data was taken to the security guard terminal 41 (step S205).

[0141] In this way, the suspicious person control unit 205 transmits the extracted image data showing the potentially suspicious person to a terminal (e.g., security guard terminal 41) carried by a predetermined person (e.g., a security guard). At that time, the suspicious person control unit 205 may transmit information about the location where the potentially suspicious person was photographed and the extracted image data to the terminal carried by the predetermined person.

[0142] Here, the suspicious person control unit 205 may execute the tracking process (detection process) of the potentially suspicious person for each image data received from the camera device 30. Alternatively, the suspicious person control unit 205 may thin out the received image data and execute the detection process on the thinned image data. For example, the suspicious person control unit 205 may execute the detection process on several frames of image data per second for each camera device 30.

[0143] As explained above, every time image data showing a potentially suspicious person is detected, the suspicious person control unit 205 transmits the image data to the security guard terminal 41. As a result, the security guard terminal 41 continues to display the image data showing the potentially suspicious person.

[0144] The storage unit 206 is a means for storing information necessary for the operation of the server device 10. The storage unit 206 stores the behavior history of each of a plurality of visitors staying in a predetermined area. The storage unit 206 stores the behavior history of each of the plurality of visitors in association with their biometric information using a first database (visitor management database). The storage unit 206 stores the biometric information of each of a plurality of users who have the authority to enter the predetermined area using a second database (user management database).

[0145] [Authentication terminal] Examples of the authentication terminal 20 include a gate device equipped with a camera, a tablet, signage, a POS terminal, etc. The configuration of the authentication terminal 20 is clear to those skilled in the art, so detailed explanation will be omitted. For example, the authentication terminal 20 detects the person to be authenticated in front of it using a sensor, etc. The authentication terminal 20 takes a picture of the detected person to acquire biometric information (e.g., a facial image) of the person to be authenticated. The authentication terminal 20 transmits an authentication request including the biometric information (facial image) and a terminal ID to the server device 10. The authentication terminal 20 may then perform processing according to the response (positive response, negative response) from the server device 10.

[0146] [Camera equipment] The configuration of the camera device 30 is clear to those skilled in the art, and therefore a detailed description thereof will be omitted. For example, the camera device 30 captures an image of a predetermined area using a camera module including a lens. The camera device 30 is any device or terminal that has the function of transmitting the obtained image data and a camera ID to the server device 10.

[0147] [Device] Examples of the terminal 40 include a smartphone, a mobile phone, a game console, a mobile terminal device such as a tablet, a computer (personal computer, laptop computer), etc. The terminal 40 can be any equipment or device that can accept user operations and communicate with the server device 10, etc. Furthermore, the configuration of the terminal 40 is clear to those skilled in the art, so a detailed description thereof will be omitted.

[0148] [Security guard terminal] Examples of the security guard terminal 41 include smartphones, mobile phones, game consoles, tablets, and other portable terminal devices, as well as computers (personal computers, laptop computers), etc. The security guard terminal 41 can be any equipment or device that can accept operations by security guards and communicate with the server device 10, etc. The configuration of the security guard terminal 41 will be clear to those skilled in the art, so a detailed description will be omitted.

[0149] Next, the operation of the information processing system according to the first embodiment will be described with reference to the drawings. Fig. 13 is a sequence diagram showing an example of the operation of the information processing system according to the embodiment of the present disclosure.

[0150] When authentication terminal 20 detects a person to be authenticated, it transmits an authentication request including biometric information of the person to be authenticated to server device 10 (step S01).

[0151] The server device 10 executes authentication processing using the biometric information included in the authentication request and the biometric information stored in the database (user management database, visitor management database). The server device 10 transmits the authentication result to the authentication terminal 20 (step S02).

[0152] If the authentication of the person to be authenticated is successful, server device 10 stores the behavior history of the person to be authenticated in the visitor management database (step S03).

[0153] The server device 10 periodically or at a predetermined timing executes a process for detecting a potentially suspicious individual (step S11).

[0154] When a potentially suspicious individual is detected, the server device 10 transmits a potentially suspicious individual detection notification including image data showing the potentially suspicious individual to the security guard terminal 41 (step S12).

[0155] The security guard terminal 41 notifies the security guard of the presence of the potentially suspicious individual by displaying a screen such as that shown in Fig. 6 (step S13). If necessary, the security guard may head to the scene where the potentially suspicious individual was photographed while still carrying the security guard terminal 41.

[0156] Next, a modified example of the first embodiment will be described.

[0157] <Variation 1> When image data showing a potential suspicious person also shows a person other than the potential suspicious person, the server device 10 may transmit image data that allows the security guard to distinguish between the potential suspicious person and the other person to the security guard terminal 41. In other words, when image data showing a potential suspicious person also shows a person other than the potential suspicious person, the suspicious person control unit 205 may transmit image data that allows the security guard to distinguish between the potential suspicious person and the person other than the potential suspicious person to the security guard terminal 41.

[0158] For example, the suspicious person control unit 205 generates image data in which all or part of the potential suspicious person is surrounded by a frame (see FIG. 14A). Alternatively, the suspicious person control unit 205 may display a message near the potential suspicious person indicating that the person is a potential suspicious person (see FIG. 14B). Alternatively, the suspicious person control unit 205 may paint the entire body of people other than the potential suspicious person appearing in the image data white or black, thereby substantially erasing the other people from the image data.

[0159] <Variation 2> Even if the authentication of the person to be authenticated fails, the server device 10 may store the behavior history of the person to be authenticated in the visitor management database. More specifically, the server device 10 may store the behavior history of the person to be authenticated in the visitor management database if the payment fails when processing an authentication request sent by an authentication terminal 20 installed in the theme park, such as authentication terminal 20-3 or authentication terminal 20-4.

[0160] For example, the authentication unit 204 may store information such as "August 1, 2024, 10:15: Payment of attraction A usage fee failed" in the visitor management database.

[0161] In this case, the suspicious person control unit 205 also treats the behavior history obtained from the authentication failure as the user's behavior within the theme park. In other words, a visitor whose behavior history obtained from the authentication failure is stored will not be treated as a potentially suspicious person until a predetermined period has passed.

[0162] <Variation 3> If the image data captured by the camera device 30 shows a visitor or theme park staff member whose entry is stored in the visitor management database, that person may be treated as a potential suspicious person or suspect, since such a person has not entered the theme park through the proper procedures.

[0163] Here, it is assumed that information (such as names and biometric information) of staff working at the theme park is also stored in the visitor management database.

[0164] In this case, the server device 10 extracts a facial image from image data obtained from the camera device 30. The server device 10 (suspicious person control unit 205) generates features from the extracted facial image. The suspicious person control unit 205 sets the generated features on the verification side and multiple features registered in the visitor management database on the registration side, and performs one-to-many authentication verification.

[0165] If the matching process is successful, the suspicious person control unit 205 does not perform any special process.

[0166] If the matching process fails, the suspicious person control unit 205 sets the person corresponding to the face image extracted from the image data as a potential suspicious person or a suspicious person, and notifies the security guard of the presence of the suspicious person (potential suspicious person). The suspicious person control unit 205 transmits image data in which the suspicious person appears and the location where the suspicious person was photographed to the security guard terminal 41.

[0167] <Variation 4> If the server device 10 fails to match the person to be authenticated using the visitor management database (if the biometric information of the person to be authenticated is not stored in the visitor management database), the server device 10 may set the person to be authenticated as a potential suspicious person or a suspicious person.

[0168] The visitor management database stores the biometric information of visitors who have entered the theme park after going through the authentication procedure at authentication terminal 20-1. Therefore, when processing an authentication request received from authentication terminals 20-2 to 20-4, the matching process will generally be successful. In other words, a person who fails the matching process is likely to be a suspicious person who has not entered the theme park after going through the proper procedure.

[0169] In this case, the suspicious person control unit 205 may transmit the face image received from the authentication terminal 20-3 or the like to the security guard terminal 41 as the face image of the suspicious person.

[0170] As described above, the server device 10 according to the first embodiment generates a behavioral history of each visitor by processing an authentication request received from the authentication terminal 20. The server device 10 detects a visitor who stays in a theme park for a predetermined period of time without performing any action as a potential suspicious person. For example, visitors to a theme park are expected to take certain actions, such as participating in attractions or purchasing merchandise at a convenience store. However, a visitor who does not take any of these actions may become a suspicious person in the future. Therefore, the server device 10 uses the behavioral history of each visitor to detect potential suspicious persons who are difficult for security guards to detect. When a potential suspicious person is detected, the server device 10 provides image data or the like of the potential suspicious person to the security guard. The security guard reviews the image data, determines whether the potential suspicious person is a suspicious person, and takes necessary action. For example, if the potential suspicious person is carrying suspicious luggage, the security guard will interview the potential suspicious person. Alternatively, if the potential suspicious person is determined to be in poor health, the security guard will provide rescue operations or the like.

[0171] Next, the hardware of each device constituting the information processing system will be described. Fig. 15 is a diagram showing an example of the hardware configuration of the server device 10.

[0172] The server device 10 can be configured by an information processing device (so-called computer), and has the configuration exemplified in Fig. 15. For example, the server device 10 includes a processor 311, a memory 312, an input / output interface 313, and a communication interface 314. The components such as the processor 311 are connected by an internal bus or the like, and are configured to be able to communicate with each other.

[0173] However, the configuration shown in Fig. 15 is not intended to limit the hardware configuration of the server device 10. The server device 10 may include hardware not shown, and may not include the input / output interface 313 as necessary. Furthermore, the number of processors 311 and the like included in the server device 10 is not intended to be limited to the example shown in Fig. 15, and for example, the server device 10 may include multiple processors 311.

[0174] The processor 311 is a programmable device such as a central processing unit (CPU), a micro processing unit (MPU), or a digital signal processor (DSP). Alternatively, the processor 311 may be a device such as a field programmable gate array (FPGA) or an application specific integrated circuit (ASIC). The processor 311 executes various programs including an operating system (OS).

[0175] The memory 312 is a random access memory (RAM), a read only memory (ROM), a hard disk drive (HDD), a solid state drive (SSD), etc. The memory 312 stores an OS program, application programs, and various data.

[0176] The input / output interface 313 is an interface for a display device and an input device (not shown). The display device is, for example, a liquid crystal display. The input device is, for example, a keyboard, a mouse, a touch panel, or the like that accepts user operations.

[0177] The communication interface 314 is a circuit, module, etc. that communicates with other devices. For example, the communication interface 314 includes a network interface card (NIC).

[0178] The functions of the server device 10 are realized by various processing modules. The processing modules are realized, for example, by the processor 311 executing a program stored in the memory 312. The program can be recorded on a computer-readable storage medium. The storage medium can be a non-transitory medium such as a semiconductor memory, a hard disk, a magnetic recording medium, or an optical recording medium. That is, the present invention can also be embodied as a computer program product. The program can be downloaded via a network or updated using a storage medium storing the program. The processing modules can also be realized by semiconductor chips.

[0179] The authentication terminal 20 and the like can also be configured by an information processing device, similar to the server device 10, and the basic hardware configuration is the same as that of the server device 10, so a description thereof will be omitted.

[0180] The server device 10 is equipped with a computer, and the computer executes a program to realize the functions of the server device 10. The server device 10 also executes a control method for the server device 10 by the program.

[0181] [Variations] The configuration, operation, etc. of the information processing system described in the above embodiment are merely examples, and are not intended to limit the configuration, etc. of the system.

[0182] In the above embodiment, the configuration, operation, etc. of the information processing system have been described using a theme park as an example of a predetermined area. However, the predetermined area is not limited to a theme park and may be, for example, an airport. The server device 10 may treat a user who does not complete check-in procedures or baggage check-in procedures at an airport for a predetermined period of time as a potentially suspicious person.

[0183] In the above embodiment, the configuration, operation, etc. of the information processing system have been described using the authentication terminal 20-3 installed in an attraction or a shop as an example of the authentication terminal 20 installed in a theme park. However, the authentication terminal 20 installed in a theme park may be a different type of terminal. For example, the authentication terminal 20 may be a vending machine for drinks or the like.

[0184] In the above embodiment, the authentication terminal 20-1 equipped with a gate authenticates visitors to a predetermined area. However, authentication of visitors to a predetermined area may be achieved by gateless authentication, which does not require physical access control means such as a gate. In this case, the server device 10 authenticates the person to be authenticated using image data obtained from a camera device 30 installed so as to be able to capture images of the theme park entrance. Furthermore, if authentication fails, the server device 10 notifies a staff member of this fact. The staff member stops the person to be authenticated who has been determined to have failed authentication and requests payment of the ticket price, etc.

[0185] The server device 10 may determine whether a potentially suspicious person is a suspicious person. For example, the suspicious person control unit 205 may input an image (still image, video) in which a potentially suspicious person appears into a learning model obtained by machine learning, thereby determining whether the potentially suspicious person is a suspicious person. The learning model is obtained by machine learning using a large amount of training data in which images (images in which a suspicious person appears) are assigned labels (determination results: suspicious person, non-suspicious person). Any algorithm such as a support vector machine, boosting, or neural network can be used to generate the learning model. Note that known techniques can be used for the algorithms such as the support vector machine, and therefore a description thereof will be omitted.

[0186] It is also possible that multiple potential suspicious persons are detected within a theme park. In this case, the server device 10 may determine a security guard (security guard terminal 41) to be notified of each potential suspicious person. For example, if potential suspicious person A and potential suspicious person B are detected, the suspicious person control unit 205 may send information about potential suspicious person A to the security guard terminal 41 carried by security guard A, and may send information about potential suspicious person B to the security guard terminal 41 carried by security guard B.

[0187] In the above embodiment, the server device 10 stores the behavioral history of each visitor in the visitor management database. However, the server device 10 may store only the most recent behavioral history (behavioral data) of each visitor in the visitor management database.

[0188] The server device 10 may record the movement history of the potential suspicious individual. The server device 10 may record the history of the locations where the potential suspicious individual was photographed as the movement history of the potential suspicious individual, using the camera ID of the camera device 30 that captured the image data containing the potential suspicious individual.

[0189] The server device 10 may use artificial intelligence (AI) or the like to analyze the movement history (behavior history) of a potentially suspicious individual and calculate their characteristics, etc. The calculated characteristics may be provided to a security officer or the like of the theme park. The security officer may use the provided characteristics to take better crime prevention measures.

[0190] The server device 10 may change the threshold (predetermined time; for example, 3 hours) for determining a person as a potentially suspicious person depending on the time of day or the degree of congestion in the theme park. For example, when the theme park is crowded, a threshold may be used that allows a person to be determined as a potentially suspicious person earlier.

[0191] The server device 10 may transmit a potentially suspicious person detection notification to a display (terminal) installed in the security management center. The display installed in the security management center may display a screen such as that shown in FIG.

[0192] If a visitor who has been determined to be a potentially suspicious person is authenticated at authentication terminal 20-3 or authentication terminal 20-4, server device 10 may treat the visitor as a normal user (the setting of the visitor as a potentially suspicious person may be canceled).

[0193] The server device 10 may send a predetermined message or the like to the terminal 40 carried by a visitor who has been determined to be a potentially suspicious person. For example, the suspicious person control unit 205 may send a message or the like to the email address of the potentially suspicious person, encouraging them to use the attractions in the theme park. Alternatively, the suspicious person control unit 205 may send a message to the email address of the potentially suspicious person, informing them that they may be treated as a suspicious person if they do not take any action in the theme park.

[0194] In the above embodiment, a case has been described in which a user creates an account on the server device 10 before purchasing a theme park ticket. However, the account does not have to be created before purchasing a ticket. When selling a ticket to a user, the server device 10 may acquire biometric information of the user and store it in the user management database. Alternatively, the server device 10 may sell attraction tickets in advance in addition to theme park tickets.

[0195] In the above embodiment, it has been described that authentication processing using biometric information is performed when a user enters a theme park or the like. However, authentication of the person to be authenticated may be performed using other methods. For example, the server device 10 may issue an ID to the ticket purchaser and obtain the issued ID from the authentication terminal 20. For example, the server device 10 may generate a two-dimensional barcode into which the ticket purchaser's ID has been converted and transmit the generated two-dimensional barcode to the terminal 40. The terminal 40 displays the two-dimensional barcode in response to a user's operation. The authentication terminal 20 reads the displayed two-dimensional barcode and obtains the ticket purchaser's ID. The authentication terminal 20 transmits an authentication request including the obtained ID to the server device 10. The server device 10 may identify the person to be authenticated using the ID and determine whether the person to be authenticated possesses a valid ticket.

[0196] In the above embodiment, the case where the user management database and visitor management database are configured inside the server device 10 has been described, but these databases may also be configured on an external database server or the like. That is, some of the functions of the server device 10 may be implemented in another device. More specifically, the above-described "suspicious person control unit (suspicious person control means)" and the like may be implemented in any of the devices included in the system.

[0197] In the flow charts (flowcharts, sequence diagrams) used in the above explanation, multiple steps (processes) are described in order, but the execution order of the steps executed in the embodiments is not limited to the order described. In the embodiments, the order of the illustrated steps can be changed to the extent that the content is not affected, such as by executing each process in parallel.

[0198] The above-described embodiments have been described in detail to facilitate understanding of the present disclosure, and it is not intended that all of the above-described configurations are required. Furthermore, when multiple embodiments are described, each embodiment may be used alone or in combination. For example, it is possible to replace part of the configuration of one embodiment with the configuration of another embodiment, or to add the configuration of another embodiment to the configuration of one embodiment. Furthermore, it is possible to add, delete, or replace part of the configuration of one embodiment with another configuration.

[0199] From the above explanation, it is clear that the present invention has industrial applicability, and the present invention can be suitably applied to an information processing system that provides security for a predetermined area such as a theme park.

[0200] Some or all of the above embodiments can be described as, but are not limited to, the following supplementary notes.

[0201] [Appendix 1] a storage means for storing the behavioral history of each of a plurality of visitors staying in a predetermined area; a control means for detecting, as a potentially suspicious person, a visitor whose behavior history has last been stored for a predetermined time period, from among the plurality of visitors, using the behavior history of each of the plurality of visitors, and notifying a predetermined person of the presence of the detected potentially suspicious person; A server device comprising:

[0202] [Appendix 2] the storage means stores the behavior history and biometric information of each of the plurality of visitors in association with each other using a first database; The server device described in Appendix 1, wherein the control means uses the biometric information of the potentially suspicious person stored in the first database to extract image data showing the potentially suspicious person from at least one image data set received from at least one camera device installed in the specified area, and transmits the extracted image data to a terminal carried by the specified person.

[0203] [Appendix 3] The server device described in Appendix 2, wherein the control means extracts image data in which the potentially suspicious person appears by performing a matching process using the biometric information of the potentially suspicious person and biometric information obtained from the at least one or more pieces of received image data.

[0204] [Appendix 4] The server device according to claim 3, wherein the control means transmits information regarding the location where the potentially suspicious individual was photographed and the extracted image data to a terminal carried by the specified person.

[0205] [Appendix 5] The server device described in Appendix 4, wherein, when the image data showing the potentially suspicious person also shows a person other than the potentially suspicious person, the control means transmits image data that allows the specified person to distinguish between the potentially suspicious person and the person other than the potentially suspicious person to a terminal carried by the specified person.

[0206] [Appendix 6] the storage means uses a second database to store biometric information of each of a plurality of users who have the authority to enter the predetermined area; The server device according to any one of appendices 2 to 5, further comprising an authentication means for receiving biometric information of a first person to be authenticated who is attempting to enter the specified area from a first authentication terminal installed at an entrance to the specified area, authenticating the first person to be authenticated using the received biometric information of the first person to be authenticated and the biometric information of each of multiple users stored in the second database, and storing in the first database as the behavioral history the fact that the first person to be authenticated who has been successfully authenticated has entered the specified area.

[0207] [Appendix 7] The server device described in Appendix 6, wherein the authentication means receives biometric information of a second person to be authenticated from a second authentication terminal installed in the specified area, authenticates the second person to be authenticated using the received biometric information of the second person to be authenticated and the biometric information of each of multiple visitors stored in the first database, and stores information related to the second authentication terminal in the first database as a behavioral history of the second person to be successfully authenticated.

[0208] [Appendix 8] The server device described in Appendix 7, wherein the authentication means receives biometric information of a third person to be authenticated from a third authentication terminal installed at the exit of the specified area, authenticates the third person to be authenticated using the received biometric information of the third person to be authenticated and the biometric information of each of multiple visitors stored in the first database, and deletes the entry in the first database corresponding to the third person to be authenticated who has been successfully authenticated.

[0209] [Appendix 9] a storage step of storing the behavioral history of each of a plurality of visitors staying in a predetermined area; a control process for detecting, as a potentially suspicious person, a visitor whose behavior history has last been stored for a predetermined time period from among the plurality of visitors, using the behavior history of each of the plurality of visitors, and notifying a predetermined person of the presence of the detected potentially suspicious person; A method for controlling a server device, comprising:

[0210] [Appendix 10] the storing step uses a first database to store the behavior history and biometric information of each of the plurality of visitors in association with each other; The control method of a server device described in Appendix 9, wherein the control step uses biometric information of the potentially suspicious person stored in the first database to extract image data showing the potentially suspicious person from at least one image data received from at least one camera device installed in the specified area, and transmits the extracted image data to a terminal carried by the specified person.

[0211] [Appendix 11] The control method for a server device described in Appendix 10, wherein the control step extracts image data in which the potentially suspicious person appears by performing a matching process using the biometric information of the potentially suspicious person and biometric information obtained from the at least one or more pieces of received image data.

[0212] [Appendix 12] The control method for a server device described in Appendix 11, wherein the control step transmits information regarding the location where the potentially suspicious individual was photographed and the extracted image data to a terminal carried by the specified person.

[0213] [Appendix 13] The control method for a server device described in Appendix 12, wherein the control step, when the image data showing the potentially suspicious person also shows a person other than the potentially suspicious person, sends image data that allows the specified person to distinguish between the potentially suspicious person and the person other than the potentially suspicious person to a terminal carried by the specified person.

[0214] [Appendix 14] the storing step uses a second database to store biometric information of each of a plurality of users who have authority to enter the predetermined area; A control method for a server device described in any one of Appendices 10 to 13, further comprising an authentication step of receiving biometric information of a first person to be authenticated who is attempting to enter the specified area from a first authentication terminal installed at an entrance to the specified area, authenticating the first person to be authenticated using the received biometric information of the first person to be authenticated and the biometric information of each of multiple users stored in the second database, and storing the fact that the first person to be authenticated who has been successfully authenticated has entered the specified area as the behavioral history in the first database.

[0215] [Appendix 15] The control method for a server device described in Appendix 14, wherein the authentication process includes receiving biometric information of a second person to be authenticated from a second authentication terminal installed in the specified area, authenticating the second person to be authenticated using the received biometric information of the second person to be authenticated and the biometric information of each of a plurality of visitors stored in the first database, and storing information related to the second authentication terminal in the first database as a behavioral history of the second person to be successfully authenticated.

[0216] [Appendix 16] A control method for a server device described in Appendix 15, wherein the authentication process receives biometric information of a third person to be authenticated from a third authentication terminal installed at the exit of the specified area, authenticates the third person to be authenticated using the received biometric information of the third person to be authenticated and the biometric information of each of multiple visitors stored in the first database, and deletes the entry in the first database corresponding to the third person to be authenticated who has been successfully authenticated.

[0217] [Appendix 17] The computer installed in the server device A storage process for storing the behavioral history of each of a plurality of visitors staying in a predetermined area; a control process for detecting, as a potentially suspicious person, a visitor whose behavior history has last been stored for a predetermined time period from among the plurality of visitors, using the behavior history of each of the plurality of visitors, and notifying a predetermined person of the presence of the detected potentially suspicious person; A program to execute.

[0218] [Appendix 18] the storage process uses a first database to store the behavior history and biometric information of each of the plurality of visitors in association with each other; The program described in Appendix 17, wherein the control process uses biometric information of the potentially suspicious person stored in the first database to extract image data showing the potentially suspicious person from at least one image data set received from at least one camera device installed in the specified area, and transmits the extracted image data to a terminal carried by the specified person.

[0219] [Appendix 19] The program described in Appendix 18, wherein the control process extracts image data showing the potentially suspicious person by performing a matching process using the biometric information of the potentially suspicious person and biometric information obtained from the at least one or more pieces of received image data.

[0220] [Appendix 20] The program described in Appendix 19, wherein the control process transmits information regarding the location where the potentially suspicious individual was photographed and the extracted image data to a terminal carried by the specified person.

[0221] [Appendix 21] The program described in Appendix 20, wherein the control process, when the image data showing the potentially suspicious person also shows a person other than the potentially suspicious person, sends image data that allows the specified person to distinguish between the potentially suspicious person and the person other than the potentially suspicious person to a terminal carried by the specified person.

[0222] [Appendix 22] the storage process uses a second database to store biometric information of each of a plurality of users who have authority to enter the predetermined area; The program described in any one of appendices 18 to 21 further executes an authentication process, which receives biometric information of a first person to be authenticated who is attempting to enter the specified area from a first authentication terminal installed at the entrance of the specified area, authenticates the first person to be authenticated using the received biometric information of the first person to be authenticated and the biometric information of each of multiple users stored in the second database, and stores the fact that the first person to be authenticated who has been successfully authenticated has entered the specified area as the behavioral history in the first database.

[0223] [Appendix 23] The program described in Appendix 22, wherein the authentication process receives biometric information of a second person to be authenticated from a second authentication terminal installed in the specified area, authenticates the second person to be authenticated using the received biometric information of the second person to be authenticated and the biometric information of each of multiple visitors stored in the first database, and stores information related to the second authentication terminal in the first database as a behavioral history of the second person to be successfully authenticated.

[0224] [Appendix 24] The program described in Appendix 23, wherein the authentication process receives biometric information of a third subject from a third authentication terminal installed at the exit of the specified area, authenticates the third subject using the received biometric information of the third subject and the biometric information of each of multiple visitors stored in the first database, and deletes the entry in the first database corresponding to the third subject who has been successfully authenticated.

[0225] Furthermore, some or all of the configurations described in Supplementary Notes 2 to 8, which are dependent on Supplementary Note 1, may also be dependent on Supplementary Notes 9 and 17 in the same dependent relationship as Supplementary Notes 2 to 8. Furthermore, not limited to Supplementary Notes 1, 9, and 17, but within the scope of each of the above-mentioned embodiments, some or all of the configurations described as Supplements may also be dependent on various hardware, software, various recording means for recording software, or systems.

[0226] The disclosures of the above-cited prior art documents are incorporated herein by reference. Although the embodiments of the present invention have been described above, the present invention is not limited to these embodiments. Those skilled in the art will understand that these embodiments are merely illustrative and that various modifications are possible without departing from the scope and spirit of the present invention. In other words, the present invention naturally includes various modifications and alterations that may be made by those skilled in the art in accordance with the entire disclosure, including the claims, and the technical concepts thereof. [Explanation of symbols]

[0227] 10 Server device 20 Authentication Terminal 20-1 Authentication terminal 20-2 Authentication terminal 20-3 Authentication Terminal 20-4 Authentication Terminal 30 Camera equipment 30-1 Camera equipment 30-2 Camera equipment 40 terminals 41 Security guard terminal 51 visitors 51-1 Residents 51-2 Residents 51-3 Residents 100 Server device 101 Memory means 102 Control means 201 Communication control unit 202 User registration control unit 203 Ticket Sales Control Unit 204 Authentication Department 205 Suspicious Person Control Unit 206 Memory section 311 processor 312 memory 313 Input / Output Interface 314 Communication Interface

Claims

1. a storage means for storing the behavioral history of each of a plurality of visitors staying in a predetermined area; a control means for detecting, as a potentially suspicious person, a visitor whose behavior history has last been stored for a predetermined time period from among the plurality of visitors, using the behavior history of each of the plurality of visitors, and notifying a predetermined person of the presence of the detected potentially suspicious person; A server device comprising:

2. the storage means stores the behavior history and biometric information of each of the plurality of visitors in association with each other using a first database; The server device according to claim 1, wherein the control means uses the biometric information of the potential suspicious person stored in the first database to extract image data showing the potential suspicious person from at least one image data set received from at least one camera device installed in the specified area, and transmits the extracted image data to a terminal carried by the specified person.

3. The server device according to claim 2, wherein the control means extracts image data showing the potentially suspicious individual by performing a matching process using the biometric information of the potentially suspicious individual and biometric information obtained from the at least one image data received.

4. 4. The server device according to claim 3, wherein the control means transmits information about a location where the potentially suspicious individual was photographed and the extracted image data to a terminal carried by the predetermined person.

5. The server device of claim 4, wherein the control means, when the image data showing the potential suspicious person also shows a person other than the potential suspicious person, transmits image data to a terminal carried by the specified person that allows the specified person to distinguish between the potential suspicious person and the person other than the potential suspicious person.

6. the storage means uses a second database to store biometric information of each of a plurality of users who have the authority to enter the predetermined area; 6. The server device according to claim 2, further comprising an authentication means for receiving biometric information of a first person to be authenticated who is attempting to enter the specified area from a first authentication terminal installed at an entrance to the specified area, authenticating the first person to be authenticated using the received biometric information of the first person to be authenticated and the biometric information of each of a plurality of users stored in the second database, and storing in the first database as the behavioral history the fact that the first person to be authenticated who has been successfully authenticated has entered the specified area.

7. 7. The server device according to claim 6, wherein the authentication means receives biometric information of a second person to be authenticated from a second authentication terminal installed in the specified area, authenticates the second person to be authenticated using the received biometric information of the second person to be authenticated and the biometric information of each of a plurality of visitors stored in the first database, and stores information related to the second authentication terminal in the first database as a behavioral history of the second person to be authenticated who has been successfully authenticated.

8. 8. The server device according to claim 7, wherein the authentication means receives biometric information of a third person to be authenticated from a third authentication terminal installed at an exit of the specified area, authenticates the third person to be authenticated using the received biometric information of the third person to be authenticated and the biometric information of each of a plurality of visitors stored in the first database, and deletes an entry in the first database corresponding to the third person to be authenticated who has been successfully authenticated.

9. a storage step of storing the behavioral history of each of a plurality of visitors staying in a predetermined area; a control process for detecting, as a potentially suspicious person, a visitor whose behavior history has last been stored for a predetermined time period from among the plurality of visitors, using the behavior history of each of the plurality of visitors, and notifying a predetermined person of the presence of the detected potentially suspicious person; A method for controlling a server device, comprising:

10. The computer installed in the server device A storage process for storing the behavioral history of each of a plurality of visitors staying in a predetermined area; a control process for detecting, as a potentially suspicious person, a visitor whose behavior history has last been stored for a predetermined time period from among the plurality of visitors, using the behavior history of each of the plurality of visitors, and notifying a predetermined person of the presence of the detected potentially suspicious person; A program to execute.

Images