Retrieval system and retrieval method

Abstract

To efficiently retrieve a protection object person, such as a dementia patient who is wandering or straying or the like.SOLUTION: A user of services for searching for a registration person uses a registration terminal 20 to photograph (S1) a face image of a registration person suffering from a disease such as dementia, and transmits (S2) registration-person data containing the photographed face image, contact addresses and the like, to a registration-person retrieval server 10. The registration-person retrieval server 10 receiving the registration-person data stores (S3) the received data in the registration-person data. Further, if a registration person has been protected by police due to wandering behavior or the like, the police photographs (S4) a face image of the registration person by using a retrieval terminal 30, and the photographed face image is transmitted (S5) to the registration-person retrieval server 10. The registration-person retrieval server 10 receiving the face image uses the received face image to search (S6) in the registration-person data, and notifies (S7) the retrieval terminal 30 of a search result.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a search system and a search method that can efficiently detect wandering or getting lost by dementia patients. [Background technology]

[0002] In the past, dementia patients wandering around and getting lost have been a social problem, and even when those in need of care are found and contacted by the police, it can be difficult to confirm their identity, which can result in delays in contacting the guardians.

[0003] For this reason, there are known identity confirmation systems that can confirm the identity of the protected person. For example, Patent Document 1 discloses a technology in which information including biometric information, the means of going out, and search history or protection history of a system registrant is registered in advance in a database of a server, and when the protected person is protected, the database is searched from a reference terminal to inquire about the identity of the protected person. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2016-042282 A Summary of the Invention [Problem to be solved by the invention]

[0005] However, the problem with the above-mentioned Patent Document 1 is who will make an inquiry about the identity of the person using the inquiry terminal. For example, even if a person is a wandering dementia patient, it is difficult to determine whether or not the person is a wandering dementia patient based on appearance alone, so even if a person has an inquiry terminal, they may not necessarily make an inquiry about the database. For this reason, how to efficiently search the database for the person to be protected is an important issue.

[0006] The present invention has been made to solve the problems of the conventional technology described above, and aims to provide a search system and search method that can efficiently search for people requiring care, such as dementia patients who have wandered away or become lost. [Means for solving the problem]

[0007] In order to solve the above problems, the present invention provides a search system having a management device that manages the biometric information of registrants registered as persons to be protected, and a portable terminal that is configured to communicate with the management device and carried by a police officer or an associate, wherein the management device is characterized in that it comprises: a storage means that, when a registration request for registrant information including the biometric information of the registrant is received, stores the registrant information in correspondence with the registrant's identification information; an authentication means that authenticates whether the operator of the portable terminal is the police officer or associate; an identification means that, when the operator is authenticated as the police officer or associate by the authentication means and a search request including the biometric information of the person to be protected is received from the portable terminal, compares the biometric information included in the search request with the biometric information included in the registrant information stored in the storage means to identify the registrant information corresponding to the person to be protected; and a notification means that notifies the portable terminal of the registrant information identified by the identification means.

[0008] In addition, in the above invention, the present invention is characterized in that the biometric information is a facial image and / or an ear image, and the identification means performs a comparison process between the facial image and / or ear image included in the search request and the facial image and / or ear image included in the registered person information stored in the storage means, to identify the registered person information corresponding to the protected person.

[0009] In addition, in the above invention, the present invention is characterized in that the management device further includes a recruiter registration means for registering recruiters who recruit the registrants, an issuing means for issuing a two-dimensional code to the recruiter, and a registration acceptance means for accepting the registration of a new user using the two-dimensional code.

[0010] The present invention also provides a search method executed in a search system having a management device that manages the biometric information of registrants registered as persons to be protected, and a mobile terminal that is configured to communicate with the management device and carried by a police officer or an associate, the search method including the following steps: a storage step, when the management device receives a request to register registrant information including the biometric information of the registrant, storing the registrant information in a memory unit in correspondence with the registrant's identification information; an authentication step, when the operator of the mobile terminal is authenticated as the police officer or associate by the authentication step and a search request including the biometric information of the person to be protected is received from the mobile terminal, a determination step, when the operator ..., comparing the biometric information included in the search request with the biometric information included in the registrant information stored in the memory unit to identify the registrant information corresponding to the person to be protected; and a notification step, when the mobile terminal is notified of the registrant information identified by the determination step. Effect of the Invention

[0011] According to the present invention, it is possible to efficiently search for people requiring protection, such as dementia patients who have wandered away or become lost. [Brief description of the drawings]

[0012] [Figure 1] FIG. 1 is an explanatory diagram of an overview of a search system according to the first embodiment. [Diagram 2] FIG. 2 is a diagram showing a system configuration of the search system according to the first embodiment. [Diagram 3] FIG. 3 is a functional block diagram showing the configuration of the registrant search server shown in FIG. [Figure 4] FIG. 4 is a diagram showing an example of the agent data and the user data shown in FIG. [Diagram 5] FIG. 5 is a diagram showing an example of the registrant data shown in FIG. [Figure 6] FIG. 6 is an explanatory diagram of an overview of ear authentication according to the first embodiment. [Figure 7]FIG. 7 is an explanatory diagram of an overview of registration and charging in the search system according to the first embodiment. [Figure 8] FIG. 8 is a diagram showing a first example of a display on the registration screen of a registrant according to the first embodiment. [Figure 9] FIG. 9 is a diagram showing a second example of a display on the registration screen of a registrant according to the first embodiment. [Figure 10] FIG. 10 is a flowchart illustrating a process for registering a registrant according to the first embodiment. [Figure 11] FIG. 11 is a flowchart illustrating a process for searching for a registrant according to the first embodiment. [Figure 12] FIG. 12 is an explanatory diagram of an outline of a search system according to the second embodiment. [Figure 13] FIG. 13 is a functional block diagram showing the configuration of the registrant search server according to the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] [Embodiment 1] Hereinafter, a search system and a search method according to the first embodiment will be described in detail with reference to the drawings.

[0014] <Outline of Search System According to First Embodiment> First, an outline of the search system according to the present embodiment 1 will be described. Fig. 1 is an explanatory diagram of the outline of the search system according to the present embodiment 1. The search system according to the present embodiment 1 provides a service (hereinafter, referred to as a "registered person search service") for searching for a registrant who has been registered in advance, using a facial image or the like of a person who has been taken into police custody.

[0015] In this search system, for subjects who need protection, such as elderly people wandering due to dementia or young children, a user such as a family member subscribes to the registrant search service and registers the subject using a registration terminal 20. Specifically, as shown in Fig. 1(a), the user uses the registration terminal 20 to take a facial image of the registrant (S1), and transmits registrant data including the photographed facial image and contact information to the registrant search server 10 (S2). Having received the registrant data, the registrant search server 10 stores the received data in the registrant data (S3).

[0016] After a target person is registered in the registered person search service in this way, if the target person wanders around a city, he or she will eventually be protected by a police officer or a collaborator who cooperates with the police in protecting the target person, such as a security guard from a security company or a supporter from a local government (hereinafter collectively referred to as "police officer"). For example, if a pedestrian finds a registered person wandering around a city, the pedestrian will notify a police officer of the presence of the registered person even if he or she does not have the time to protect the registered person himself or herself. In response, the police officer will rush to the location where the registered person is and protect the registered person.

[0017] Thereafter, as shown in Fig. 1(b), the police officer takes a photograph of the registrant's face using the search terminal 30 (S4), and transmits the photographed face image to the registrant search server 10 (S5). Having received the face image, the registrant search server 10 searches the registrant data using the received face image (S6), and notifies the search terminal 30 of the search results (S7). For example, the search results include contact information for the registrant, and the police officer can take appropriate action against the protected registrant by contacting the notified contact information.

[0018] In this way, in the search system of this embodiment 1, the facial image of the registrant is registered in the registrant search server, and if the registrant is taken into police custody, the facial image of the registrant is used to identify the contact information, making it possible to efficiently search for those requiring protection, such as dementia patients who have wandered off or become lost.

[0019] At this time, the police officer can access the registrant search server 10 by reading the two-dimensional code notified by the registrant search server 10 using the search terminal 30 that the police officer possesses. The police officer can also access the registrant search server 10 by selecting a URL notified by the registrant search server 10. Furthermore, the police officer can also access the registrant search server 10 by installing an app downloaded from the registrant search server 10 on the search terminal 30 that the police officer possesses and activating this app.

[0020] In addition, registered persons who need protection, such as elderly people and small children who wander due to dementia, may be victims of violence, mischief, etc. by third parties before being protected by police officers, but the focus on protecting the registered persons tends to be so great that damage suffered by the registered persons before being protected is overlooked. For example, even if an elderly person's wallet is stolen by a third party, it is only determined that the elderly person dropped the wallet. Also, even if a young girl is victim of mischief while wandering, this fact is not recognized. For this reason, in this embodiment, by identifying and aggregating images of the registered person included in the images of surveillance cameras located on the possible route from the starting point of the movement of the registered person to the protection place where the registered person is protected by the police, an index can be obtained for determining whether the registered person has suffered any damage while wandering.

[0021] <System configuration of search system according to embodiment 1> Next, a description will be given of the system configuration of the search system according to the present embodiment 1. Fig. 2 is a diagram showing the system configuration of the search system according to the present embodiment 1.

[0022] As shown in FIG. 2, the registrant search server 10 is communicably connected to a registration terminal 20, a search terminal 30, and a payment server 40 via the Internet.

[0023] The registrant search server 10 is a device that performs the registrant search service. When the registrant search server 10 receives data related to a agent, including contact information and a credit card number, it notifies the payment server 40 of the credit card number and agent registration fee as payment request information. Then, when the registrant search server 10 receives payment completion information from the payment server 40, it issues a unique agent ID and a QR code (registered trademark) and notifies the agent's contact information.

[0024] Furthermore, when the registrant search server 10 receives user registration data from the registration terminal 20, it notifies the payment server 40 of the credit card number and user registration fee included in the user registration data as payment request information. Then, when it receives payment completion information from the payment server 40, it issues a unique user ID and transmits this user ID to the registration terminal 20, and notifies the payment server 40 of the credit card number and registration fee related to the agent ID included in the user registration data as payment request information.

[0025] Furthermore, the registrant search server 10 notifies the payment server 40 of the credit card number and monthly fee associated with the registered user ID as payment request information on a predetermined day each month.

[0026] Furthermore, when the registrant search server 10 receives search request data from the search terminal 30, it performs face authentication and ear authentication using the face image and both ears image included in the search request data. Then, the following process is performed according to each authentication result.

[0027] If the face authentication and the ear authentication are each successful and the extracted user IDs are the same, the registrant data related to this user ID is transmitted as search result data to the search terminal 30. If the face authentication and the ear authentication are each successful and the extracted user IDs are not the same, or if the face authentication or the ear authentication fails, "no match" is transmitted as search result data to the search terminal 30.

[0028] The registration terminal 20 is a terminal for registering information related to users and registrants. When the registration terminal 20 uses its own camera to read a QR code (registered trademark) printed on a pamphlet soliciting users of the registrant search service, it extracts a salesperson ID from the QR code (registered trademark). Then, when input of data including the user's name, contact information, and credit card number is accepted, the salesperson ID is added to the accepted data and transmitted to the registrant search server 10 as user registration data.

[0029] Furthermore, when the registration terminal 20 receives a user ID from the registrant search server 10, it stores the user ID. The registration terminal 20 captures an image of the face and left and right ears of the registrant, and when it receives input of the registrant's name, address, contact information, etc., it adds the user ID to the captured image and input data to create registrant data and transmits it to the registrant search server 10.

[0030] The search terminal 30 is a terminal device such as a mobile phone, smartphone, or tablet terminal that is possessed by a police officer and used to search for registrants. This search terminal 30 is either personally owned by the police officer or loaned from the institution to which the police officer belongs (such as a police station). As already explained, the registrant search server 10 can be accessed using a two-dimensional code or URL notified from the registrant search server 10, and the registrant search server 10 can also be accessed via an app downloaded from the registrant search server 10.

[0031] The search terminal 30 has an authentication means such as biometric authentication, and allows operation to a police officer who has been successfully authenticated by this authentication means. The search terminal 30 takes an image of the face and both ears of the registrant, and transmits search request data including the taken images to the registrant search server 10. When the search terminal 30 receives the search result data from the registrant search server 10, it displays the search result data.

[0032] The payment server 40 is a device that performs payment related to the registrant search service. When the payment server 40 receives payment request information from the registrant search server 10, the payment server 40 performs a payment process using the fee and credit card number included in the payment request information. Then, the payment server 40 notifies the registrant search server 10 of payment completion information.

[0033] Furthermore, when the settlement server 40 receives payment request information from the registrant search server 10, it performs a settlement process for refund using the fee and credit card number included in the payment request information, and notifies the registrant search server 10 of payment completion information.

[0034] <Configuration of the registrant search server 10> Next, a description will be given of the configuration of the registrant search server 10 shown in Fig. 2. Fig. 3 is a functional block diagram showing the configuration of the registrant search server 10 shown in Fig. 2. As shown in Fig. 3, the registrant search server 10 has a display unit 11, an input unit 12, a communication unit 14, a storage unit 15, and a control unit 16.

[0035] The display unit 11 is a display device such as a liquid crystal panel or a display device. The input unit 12 is an input device such as a keyboard or a mouse. The communication unit 14 is an interface unit for data communication with the registration terminal 20, the search terminal 30, and the payment server 40 via the Internet.

[0036] The storage unit 15 is a storage device such as a hard disk drive or a non-volatile memory, and stores agent data 15a, user data 15b, and registrant data 15c.

[0037] The agent data 15a is data related to an agent who is recruiting users of the registrant search service. The user data 15b is data related to users of the registrant search service. The registrant data 15c is data related to registrants who are targets of the registrant search service.

[0038] The control unit 16 is a control unit that performs overall control of the registrant search server 10, and has a sales agent management unit 16a, a QR code issuing unit 16b, a user management unit 16c, a payment processing unit 16d, a registrant management unit 16e, a search unit 16f, a face authentication unit 16g, and an ear authentication unit 16h. In practice, by loading these programs into a CPU (Central Processing Unit) and executing them, the sales agent management unit 16a, the QR code issuing unit 16b, the user management unit 16c, the payment processing unit 16d, the registrant management unit 16e, the search unit 16f, the face authentication unit 16g, and the ear authentication unit 16h will execute the processes corresponding to them.

[0039] The agent management unit 16a is a processing unit that manages the agent data 15a. When the agent management unit 16a receives data related to the agent, including the name, contact information, and credit card number, from the input unit 12, it passes the credit card number to the payment processing unit 16d as the agent card number. Then, when it receives payment completion information from the payment server 40, it issues a unique agent ID and stores it in the agent data 15a in association with the data related to the agent.

[0040] The QR code issuing unit 16b is a processing unit that issues a QR code (registered trademark) related to the agent. When the agent data 15a is updated by the agent management unit 16a, the QR code issuing unit 16b encodes the agent ID related to the newly updated agent and issues it as a QR code (registered trademark). The QR code (registered trademark) and agent ID that have been issued are then sent to the contact information of the newly updated agent. Upon receiving the QR code (registered trademark), the agent prints this QR code (registered trademark) on a pamphlet that is used to recruit users of the registrant search service, and recruits users.

[0041] The user management unit 16c is a processing unit that manages the user data 15b. When the user management unit 16c receives user registration data from the registration terminal 20, it passes the credit card number included in the user registration data to the payment processing unit 16d as the user card number. Then, when the user management unit 16c receives payment completion information from the payment server 40, it issues a unique user ID, associates it with the received user registration data, stores it in the user data 15b, and transmits the user ID to the registration terminal 20.

[0042] The settlement processing unit 16d is a processing unit that performs settlement processing related to collection of the usage fee for the registrant search service and payment of the registration fee. When the settlement processing unit 16d receives the agent card number from the agent management unit 16a, it notifies the settlement server 40 of the credit card number indicated by the agent card number and the agent registration fee (e.g., 2200 yen) as settlement request information.

[0043] Furthermore, upon receiving the user card number from the user management unit 16c, the payment processing unit 16d notifies the payment server 40 of the credit card number indicated by the user card number and the user registration fee (for example, 1100 yen) as payment request information.

[0044] In addition, when user data 15b is updated by the user management unit 16c, the payment processing unit 16d extracts the agent ID related to the newly updated user, identifies the credit card number related to this agent ID from the agent data 15a, and notifies the payment server 40 of this credit card number and a registration fee (e.g., 1,000 yen) as payment request information.

[0045] Furthermore, on a predetermined day of each month (for example, the end of the month), the payment processing unit 16d notifies the payment server 40 of the credit card number and monthly fee (for example, 550 yen) stored in the user data 15b as payment request information.

[0046] Management unit 16e is a processing unit that manages registrant data 15c. When management unit 16e receives registrant data from registration terminal 20, management unit 16e stores the received registrant data in registrant data 15c.

[0047] The search unit 16f is a processing unit that searches for a registrant. When the search unit 16f receives search request data from the search terminal 30, the search unit 16f passes the face image included in the search request data to the face authentication unit 16g and the images of both ears to the ear authentication unit 16h.

[0048] In addition, the search unit 16f receives a user ID from the face authentication unit 16g and the ear authentication unit 16h, and if the received user IDs are identical, it extracts the registrant's name, date of birth, address, characteristics and contact details associated with this user ID from the registrant data 15c and transmits them to the search terminal 30 as search result data.

[0049] Furthermore, the search unit 16f receives user IDs from the face authentication unit 16g and the ear authentication unit 16h, and if the received user IDs are not identical, transmits "no match" to the search terminal 30 as search result data.

[0050] Furthermore, when the search unit 16f receives authentication failure information from the face authentication unit 16g or the ear authentication unit 16h, it transmits "no match" to the search terminal 30 as search result data.

[0051] The face authentication unit 16g is a processing unit that performs face authentication using a face image. When the face authentication unit 16g receives a face image from the search unit 16f, it uses the face image to perform authentication with all face images stored in the registrant data 15c. If the authentication is successful, the corresponding user ID is passed to the search unit 16f, and if the authentication is unsuccessful, authentication failure information is passed to the search unit 16f.

[0052] The ear authentication unit 16h is a processing unit that performs ear authentication using images of both ears. When the ear authentication unit 16h receives images of both ears from the search unit 16f, it uses the images of both ears to perform authentication with all right ear images and left ear images stored in the registrant data 15c. If the authentication is successful, the corresponding user ID is passed to the search unit 16f, and if the authentication is unsuccessful, authentication failure information is passed to the search unit 16f.

[0053] Next, an example of data stored in the storage unit 15 of the registrant search server 10 shown in Fig. 3 will be described. Fig. 4 and Fig. 5 are diagrams showing examples of the recruiter data 15a, the user data 15b, and the registrant data 15c shown in Fig. 3.

[0054] The agent data 15a shown in FIG. 4(a) associates the name "Shohei Tokkai", the contact information "08087654321", and the credit card number "10234567..." with the agent ID "BS1234".

[0055] User data 15b shown in FIG. 4(b) associates a user ID of "HK1023" with a name of "Tokkyo Jiro," contact information of "09012345678," credit card number of "10456789...," and agent ID of "BS1234."

[0056] The registrant data 15c shown in FIG. 5 associates, for a user ID "HK1023," the registrant name "TOKYO TARO," the date of birth "January 1, 1950," the address "Shinjuku Ward, Tokyo," the characteristics "burn on the right ankle, large mole on the back of the neck," contact information 1 "TOKYO Jiro 09012345678," contact information 2 "TOKYO Saburo 09023456789," contact information 3 "KAIHATSU Hanako 08034567890," the face image "hk102301.jpg," the right ear image "hk102302.jpg," and the left ear image "hk102303.jpg."

[0057] <Outline of ear authentication according to embodiment 1> Next, an overview of ear authentication according to the present embodiment 1 will be described. Fig. 6 is an explanatory diagram of the overview of ear authentication according to the present embodiment 1.

[0058] As shown in Figure 6, ear authentication is a technology that identifies individuals based on the shape of their ears, and identifies individuals by analyzing the contours and irregularities of the ear, the shape of the earlobe, etc. For example, it is possible to identify individuals by analyzing the shapes of the outer edge of the ear shown at A, the inner edge of the ear shown at B, and the outer edge of the concha shown at C.

[0059] Ear authentication is non-invasive, can be recognized from a long distance, and is advantageous in terms of privacy protection. In addition, there are few cases where the shape of the ear changes suddenly due to growth, so it can provide highly secure authentication.

[0060] Invasive means disrupting the homeostasis of the body through some harmful factor, and ear authentication is relatively non-invasive compared to other biometric authentication technologies such as fingerprints and retina.

[0061] The pinna remains relatively stable even with age and changes in condition, which allows ear recognition to maintain high recognition accuracy.

[0062] Unlike faces and fingerprints, ears can be recognized from a relatively long distance. In addition, privacy concerns regarding ears are relatively tolerant, so ear recognition is considered to be able to protect personal privacy compared to privacy-sensitive methods such as face recognition and fingerprint recognition.

[0063] <Overview of registration and billing in the search system according to the first embodiment> Next, an overview of registration and billing in the search system according to the embodiment 1 will be described. Fig. 7 is an explanatory diagram of the overview of registration and billing in the search system according to the embodiment 1.

[0064] As shown in Fig. 7(a), when a agent registers as a agent and pays the agent registration fee to the registrant search server 10 (S11), the registrant search server 10 collects the agent registration fee in cooperation with the settlement server 40 and registers the agent as a agent (S12).Then, a agent ID and a QR code (registered trademark) for the agent are issued and notified to the agent (S13).

[0065] As shown in FIG. 7(b), the agent creates a recruitment pamphlet for the registrant search service on which a QR code (registered trademark) for the agent is printed, and distributes the pamphlet to the customers (S14).

[0066] As shown in FIG. 7(c), the recruiter uses the recruiter's QR code (registered trademark) printed in the recruitment pamphlet to register as a user of the registrant search service and pay the user registration fee and monthly usage fee (S15).

[0067] The registrant search server 10 cooperates with the settlement server 40 to collect the user registration fee and monthly usage fee, and registers the user as a user (S16). Then, it issues a user ID and notifies the recruiter (S17). Then, it cooperates with the settlement server 40 to pay the registration fee to the recruiter (S18).

[0068] <Example of display on registration screen of registrant according to embodiment 1> Next, a description will be given of an example of display on the registration screen of a registrant according to the present embodiment 1. Fig. 8 and Fig. 9 are diagrams showing an example of display on the registration screen of a registrant according to the present embodiment 1.

[0069] As shown in Fig. 8, the registration screen for a registrant allows the registrant's face image, images of both ears, and information related to the registrant to be registered. Specifically, the name (in kanji and furigana), gender, date of birth, characteristics, contact information 1, contact information 2, contact information 3, and address are registered.

[0070] For example, in the characteristics section, you might register "burn on right ankle, large mole on back of neck," and in the contact section, you might register the name and phone number of a contact person.

[0071] As shown in Figure 9(a), the registrant search service displays a screen to prompt the user to agree to the terms of use, since personal information about the registrant may be provided to the police. Specifically, the terms of use are displayed, and an approval button is displayed to obtain approval.

[0072] As shown in Figure 9(b), in order to use the registrant search service, a registration fee and a monthly fee must be paid, so a screen is displayed for paying the registration fee and monthly fee by credit card. Specifically, the registration fee (e.g., 1,100 yen) and monthly fee (e.g., 550 yen) are displayed, and a space for entering a credit card number is displayed. Then, a payment button for executing the payment is displayed.

[0073] <Processing procedure for registering a registrant according to the first embodiment> Next, a description will be given of a processing procedure for registering a registrant according to the present embodiment 1. Fig. 10 is a flowchart showing a processing procedure for registering a registrant according to the present embodiment 1.

[0074] As shown in FIG. 10, when the registrant search server 10 receives user registration data from the registration terminal 20 (step S101; Yes), the registrant search server 10 notifies the payment request information related to the user registration to the payment server 40 (step S102).

[0075] If payment completion information is received from the payment server 40 (step S103; Yes), a user ID is issued and stored in the user data 15b in association with the received user registration data (step S104). Then, the user ID is notified to the registration terminal 20 (step S105).

[0076] If the registrant data is received from the registration terminal 20 (step S106; Yes), the received registrant data is stored in the registrant data 15c (step S107), and the process ends.

[0077] <Processing procedure for searching for registered users according to the first embodiment> Next, a description will be given of a process procedure for searching for a registrant according to the present embodiment 1. Fig. 11 is a flowchart showing a process procedure for searching for a registrant according to the present embodiment 1.

[0078] As shown in FIG. 11, when the registrant search server 10 receives search request data from the search terminal 30 (step S201; Yes), it performs face authentication and ear authentication using the face image and both ear images included in the search request data.

[0079] If face authentication is successful and a user ID is extracted (Step S202; Yes), and if ear authentication is successful and a user ID is extracted (Step S203; Yes), and the extracted user IDs are identical (Step S204; Yes), data on the registrant related to the user ID is extracted from the registrant data 15c and transmitted to the search terminal 30 as search result data (Step S205), and the process then ends.

[0080] If face authentication fails (step S202; No) or ear authentication fails (step S203; No), a search result indicating that there is no match is transmitted to the search terminal 30 (step S206), and the process ends.

[0081] If face authentication is successful and a user ID is extracted (step S202; Yes), and if ear authentication is successful and a user ID is extracted (step S203; Yes), and the extracted user ID is not the same (step S204; No), a search result indicating no match is sent to the search terminal 30 (step S206), and the process ends.

[0082] As described above, in the search system of this embodiment 1, the facial image of the registrant is registered in the registrant search server, and if the registrant is taken into police custody, the facial image of the registrant is used to identify the contact information, making it possible to efficiently search for those requiring protection, such as wandering dementia patients or lost children.

[0083] [Embodiment 2] Incidentally, in the above embodiment 1, a configuration has been described in which authentication is performed using a facial image taken when the registrant is in police custody in addition to the facial image registered at the time of registration. However, the present invention is not limited to this.

[0084] If a registrant goes missing after registering a facial image, it is not possible to update the registered facial image to the latest one. If the person is missing for a long period of time, the face will change over time, making it difficult to authenticate the face when the registrant is rescued. For this reason, it is possible to configure the system to predict facial changes over time using AI based on the facial image registered at the time of registration, and to authenticate the predicted facial image using a facial image taken when the registrant is rescued by the police.

[0085] In this second embodiment, we will describe a search system that uses AI to predict facial changes over time based on the facial image registered at the time of registration, and can authenticate the registrant against this predicted facial image using a facial image taken when the registrant was in police custody.

[0086] <Outline of Search System According to Second Embodiment> An overview of the search system according to the second embodiment will be described below. Fig. 12 is an explanatory diagram of the overview of the search system according to the second embodiment.

[0087] As shown in FIG. 12, in this search system, a registered face image will not change unless a new face image is re-registered, so an AI (e.g., a face change prediction model trained using machine learning) is used to predict the latest face image at predetermined intervals (e.g., every five years for adults, and every year for minors), and this face image is stored and updated in the registrant data.

[0088] <Configuration of the registrant search server 100> Next, the configuration of the registrant search server 100 according to the present embodiment 2 will be described. Fig. 13 is a functional block diagram showing the configuration of the registrant search server 100 according to the present embodiment 2. As shown in Fig. 13, the registrant search server 100 has a display unit 11, an input unit 12, a communication unit 14, a storage unit 15, and a control unit 110. Note that a description of functional units similar to those in the configuration of the registrant search server 10 shown in Fig. 3 will be omitted.

[0089] The control unit 110 is a control unit that performs overall control of the registrant search server 100, and has a sales agent management unit 16a, a QR code issuing unit 16b, a user management unit 16c, a payment processing unit 16d, a registrant management unit 16e, a search unit 16f, a face authentication unit 16g, an auricular authentication unit 16h, and a face change prediction unit 111. In practice, by loading these programs into a CPU and executing them, the sales agent management unit 16a, the QR code issuing unit 16b, the user management unit 16c, the payment processing unit 16d, a registrant management unit 16e, a search unit 16f, a face authentication unit 16g, an auricular authentication unit 16h, and a face change prediction unit 111 will each execute a process corresponding thereto.

[0090] The facial change prediction unit 111 is a processing unit that predicts changes over time in a facial image registered in the registrant data 15c. If a predetermined period (e.g., five years for an adult, one year for a minor) has passed since the most recent update of the facial image registered in the registrant data 15c, the facial change prediction unit 111 predicts a current facial image from the registered facial image using a facial change prediction model. Then, the predicted facial image is stored in the corresponding facial image item of the registrant data 15c and updated.

[0091] As described above, the search system according to the second embodiment is configured to use AI to predict facial changes over time based on the facial image registered at the time of registration, and to authenticate this predicted facial image using a facial image taken when the registrant was taken into police custody. This makes it possible to efficiently search for people to be protected, such as wandering dementia patients or lost children.

[0092] [Variations] Meanwhile, registered individuals who need protection, such as elderly people with dementia who wander around or young children, may be victims of violence or vandalism by third parties on the way to their protection by police officers. However, in focusing too much on protecting registered individuals, the harm they suffer on the way to their protection tends to be overlooked.

[0093] For example, if an elderly person's wallet is stolen by a third party, it is simply deemed that the elderly person dropped the wallet. Similarly, even if a young girl is the victim of a vandal while wandering around, this fact is not recognized.

[0094] For this reason, a possible route is identified from the location where the registrant started moving to the location where the registrant was protected by the police. At this time, the possible route is identified using the time that the registrant was wandering (the difference between the time when the wandering started and the time when the registrant was protected), the time when the pedestrian notified the police, location information, etc. If the registrant has a GPS (Global Positioning System; registered trademark) terminal, the possible route can also be identified using location information for each time.

[0095] Then, by collecting images captured by surveillance cameras located along the registrant's possible movement route, extracting images of the registrant while performing biometric authentication of the registrant, and inputting these images into a trained model, it is possible to output the probability that the registrant was victimized while wandering around. Such a trained model can be generated by performing deep learning on a multi-layer neural network such as CNN using training data (training images and correct answer data).

[0096] When a police officer operates the search terminal 30 to obtain information on a registered person, the police officer can be informed of the possibility that the registered person may have been harmed while wandering around, enabling the police officer to take prompt action.

[0097] Note that the configurations illustrated in the above embodiments are merely functional schematics and do not necessarily have to be physically configured as illustrated. In other words, the form of distribution and integration of each device is not limited to that illustrated, and all or part of the devices can be functionally or physically distributed and integrated in any unit according to various loads, usage conditions, etc. [Industrial Applicability]

[0098] The search system and search method according to the present invention are suitable for efficiently searching for persons requiring care, such as wandering dementia patients or lost children. [Explanation of symbols]

[0099] 10. Registrant Search Server 11 Display section 12 Input section 14 Communications Department 15 Storage section 15a Recruitment Data 15b User data 15c Registrant Data 16 Control section 16a Recruiter Management Department 16b QR Code Issuer 16c User Management Department 16d Payment Processing Unit 16e Registration Management Department 16f Search section 16g Face recognition unit 16h Ear authentication section 20 Registered terminals 30 Search Terminal 40 Payment Server 100 Registrant Search Server 110 Control section 111 Face Change Prediction Department

Claims

1. A search system having a management device that manages biometric information of a person registered as a person to be protected, and a mobile terminal that is configured to be able to communicate with the management device and is carried by a police officer or a collaborator, The management device includes: a storage means for storing, when a request for registration of registrant information including biometric information of the registrant is received, the registrant information in association with identification information of the registrant; an authentication means for authenticating whether the operator of the mobile terminal is the police officer or an associate; an identification means for, when the authentication means authenticates the operator as the police officer or an associate and a search request including biometric information of the person to be protected is received from the mobile terminal, performing a comparison process between the biometric information included in the search request and the biometric information included in the registered person information stored in the storage means to identify the registered person information corresponding to the person to be protected; a notification means for notifying the mobile terminal of the registrant information identified by the identification means; A search system comprising:

2. the biometric information is a face image and / or an ear image, The identification means is The search system described in claim 1, characterized in that the facial image and / or ear image included in the search request is compared with the facial image and / or ear image included in the registered person information stored in the memory means to identify the registered person information corresponding to the protected person.

3. The management device includes: A recruiter registration means for registering a recruiter who recruits the registrants; An issuing means for issuing a two-dimensional code to the recruiter; a registration acceptance means for accepting registration of a new user using the two-dimensional code; The search system according to claim 1, further comprising:

4. A search method executed in a search system having a management device that manages biometric information of a person registered as a person to be protected, and a mobile terminal that is configured to be able to communicate with the management device and is carried by a police officer or a collaborator, comprising: a storage step of storing, in a storage unit, the registrant information including the biometric information of the registrant when the management device receives a request for registration of the registrant information, in association with the registrant's identification information; an authentication step of authenticating whether the operator of the mobile terminal is the police officer or an associate; a step of identifying, when the operator is authenticated as the police officer or an associate by the authentication step and a search request including biometric information of the person to be protected is received from the mobile terminal, comparing the biometric information included in the search request with the biometric information included in the registered person information stored in the storage unit to identify registered person information corresponding to the person to be protected; a notification step of notifying the mobile terminal of the registrant information identified by the identification step; A search method comprising:

Images