Management server and computer program

Abstract

This system provides a management server that registers user information using user information from an external system, without including authentication information used by the management server itself. [Solution] The control unit of the management server 1, which manages the biometric information of users 300, acquires external user information IF1, which does not include authentication information for identifying the user, from an external system that is common to at least some users and users whose biometric information is managed by the management server, and stores it in the data storage unit 13. When the user cannot be identified from the authentication information acquired from the user's body and the authentication information included in the stored user information, the acquired authentication information is merged with the stored external user information to generate and store new user information that includes authentication information. When biometric information is acquired from the user, the user is identified by comparing the user's authentication information with the authentication information included in the new user information, and the biometric information is stored as data for the identified user.

Description

Technical Field

[0001] The present disclosure relates to a management server and a computer program.

Background Art

[0002] For example, Japanese Unexamined Patent Application Publication No. 2020-046962 (hereinafter, Patent Document 1) discloses a measurement system that measures vital information of a subject non-contact using a measurement terminal, transmits the measurement result to a management server, and manages it in association with the subject as data of the subject. In such a system, the management server identifies that the subject is a registered user using authentication information such as a face image of the subject. Then, the management server stores the obtained biological information as information of the identified user.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

[0004] Thus, in a management server that needs to identify users, it is necessary to register authentication information of each user in advance. Here, when there is an external system in which at least some users are common, it may be desired to register users in the management system using the user information registered in this external system. For example, when a new system is introduced into a facility such as a hospital, a nursing facility, or a sports gym, it is assumed that there may be a case where the external user information of an external system constructed previously is registered in the management server of the newly introduced system.

[0005] However, if the user information in an external system does not include user authentication information, for example, because user identification is not required in the external system, then the user information in the external system cannot be used directly on the management server. Therefore, a management server and computer program are desired that can register user information using user information from an external system that does not include authentication information used on the management server.

[0006] According to one embodiment, the management server is a management server that manages users' biometric information and comprises a control unit and a data storage unit. The control unit acquires external user information, which does not include authentication information for identifying users, from an external system that is common to at least some users and users whose biometric information is managed by the management server, and stores it in the data storage unit. When a user cannot be identified by comparing the authentication information acquired from the user's body with the authentication information included in the user information stored in the data storage unit, the control unit generates new user information including the authentication information acquired from the user's body by merging the authentication information acquired from the user's body with the external user information stored in the data storage unit and stores it in the data storage unit. When biometric information is acquired from a user, the control unit identifies the user by comparing the authentication information acquired from the user's body with the authentication information included in the new user information stored in the data storage unit, and stores the biometric information in the data storage unit as data for the identified user.

[0007] According to one embodiment, the computer program is a computer program that causes the computer to function as a management server for managing users' biometric information. The computer program causes the computer to obtain external user information, which does not include authentication information for identifying users, from an external system that is common to at least some users and users whose biometric information is managed by the management server, and store it in the data storage unit. When the user cannot be identified by comparing the authentication information obtained from the user's body with the authentication information contained in the user information stored in the data storage unit, the computer program generates new user information, which includes the authentication information obtained from the user's body, by merging the authentication information obtained from the user's body with the external user information stored in the data storage unit, and stores it in the data storage unit. When biometric information is obtained from the user, the computer program identifies the user by comparing the authentication information obtained from the user's body with the authentication information contained in the new user information stored in the data storage unit, and stores the biometric information in the data storage unit as data for the identified user.

[0008] Further details will be described in the embodiments below. [Brief explanation of the drawing]

[0009] [Figure 1] Figure 1 is a schematic diagram of the management system according to an embodiment. [Figure 2] Figure 2 is a schematic diagram of the management server configuration. [Figure 3] Figure 3 is a schematic diagram of the sensor terminal configuration. [Figure 4] Figure 4 is a diagram illustrating the workflow within the management system. [Figure 5] Figure 5 illustrates the flow of user information generated by the operation of the management system. [Figure 6] Figure 6 is a schematic diagram of the display screen of the sensor terminal. [Figure 7] Figure 7 is a flowchart illustrating an example of the operation of the management server. [Figure 8]Figure 8 is a flowchart illustrating a modified version of the management server's operation. [Figure 9] Figure 9 is a schematic diagram of the display screen of the sensor terminal in a modified example. [Modes for carrying out the invention]

[0010] <1. Overview of the Management Server and Computer Programs> (1) The management server according to the embodiment is a management server for managing users' biometric information, and comprises a control unit and a data storage unit. The control unit acquires external user information, which does not include authentication information for identifying users, from an external system that is common to at least some users and users whose biometric information is managed by the management server, and stores it in the data storage unit. When a user cannot be identified by comparing the authentication information acquired from the user's body with the authentication information included in the user information stored in the data storage unit, the control unit generates new user information, which includes the authentication information acquired from the user's body, by merging the authentication information acquired from the user's body with the external user information stored in the data storage unit, and stores it in the data storage unit. When biometric information is acquired from a user, the control unit identifies the user by comparing the authentication information acquired from the user's body with the authentication information included in the new user information stored in the data storage unit, and stores the biometric information in the data storage unit as data for the identified user.

[0011] External user information that does not include authentication information cannot be used by the management server to identify users. In this regard, the management server according to the embodiment generates new user information that includes authentication information by merging the external user information that does not include authentication information with the authentication information. The new user information includes both the external user information and the authentication information. As a result, the management server, which identifies users using authentication information, can register new user information that includes authentication information using external user information that does not include authentication information.

[0012] (2) In the management server of (1), preferably, if multiple external user information is stored in the data storage unit, the system determines the display priority of the multiple external user information using the information contained in each of the multiple external user information and the authentication information obtained from the user's body, and causes the instruction device, which accepts the selection of external user information to be merged with the authentication information obtained from the user's body, to display options corresponding to each of the multiple external user information based on priority. As a result, the more likely it is that the stored external user information will be selected as external user information to be merged with the authentication information, the higher the priority it will be displayed on the instruction device. Therefore, it becomes easier for the operator of the instruction device to select external user information using the instruction device. In addition, the operator of the instruction device is less likely to make the wrong selection of external user information.

[0013] (3) The management server of (1) and (2) preferably stores in the data storage unit the correspondence between the identification information assigned to the new user information and the identification information assigned to the external user information in the external system, which is read from the external user information. This enables access between the external system and the management server based on the correspondence between the new user information stored in the data storage unit and the external user information registered in the external system.

[0014] (4) The management server according to (1) to (3), preferably, the authentication information is the user's facial image. This allows external user information that does not have an authentication facial image to be used for registering user information in the management server that identifies users using the authentication information facial image. Therefore, the management server can identify users using external user information that does not have an authentication facial image.

[0015] (5) The computer program according to the embodiment is a computer program that causes a computer to function as a management server for managing users' biometric information. The computer program causes the computer to obtain external user information, which does not include authentication information for identifying users, from an external system that is common to at least some users and users whose biometric information is managed by the management server, and store it in the data storage unit. When a user cannot be identified by comparing the authentication information obtained from the user's body with the authentication information contained in the user information stored in the data storage unit, the computer program generates new user information, which includes the authentication information obtained from the user's body, by merging the authentication information obtained from the user's body with the external user information stored in the data storage unit, and stores it in the data storage unit. When biometric information is obtained from a user, the computer program identifies the user by comparing the authentication information obtained from the user's body with the authentication information contained in the new user information stored in the data storage unit, and stores the biometric information in the data storage unit as data for the identified user.

[0016] External user information from an external system, which does not include authentication information, cannot be used by the management server to identify users. In this regard, the computer program according to the embodiment causes the computer to merge the external user information without authentication information with the authentication information. Therefore, the new user information generated by the merge includes both the external user information and the authentication information. As a result, the management server, which identifies users using authentication information, can register user information including authentication information using external user information that does not include authentication information.

[0017] <2. Examples of management servers and computer programs> (Overview of the management system) Figure 1 is a schematic diagram of the management system 100 according to an embodiment. The management system 100 is a management system for biometric information obtained using the sensor terminal 3. The management system 100 is introduced in facilities such as hospitals, nursing homes, and sports gyms.

[0018] The management system 100 includes a management server 1. The management server 1 acquires biometric information of a person registered as a user of the management system 100 (hereinafter referred to as a registered user) from the sensor terminal 3 and stores (registers) it in the data storage unit 13. "Biometric information" is information obtained from a user's human body for managing, for example, the user's health condition, exercise condition, etc. in the management system 100, and includes information representing a person's vital activities. Also, in order to prevent the biometric information of each user from being mismanaged as data of other users, before storing the biometric information in the data storage unit 13, authentication information of the user is acquired from the sensor terminal 3 to identify the user. Then, when it can be confirmed that the identified user is a registered user, the biometric information of that user is stored in the data storage unit 13. Note that the authentication information is information obtained from the user's body and used to distinguish and identify the user from other users. Details will be described later.

[0019] The management server 1 can communicate with the instruction device 7 via a communication network such as the Internet. The instruction device 7 is, for example, a general computer, a smartphone, a tablet, etc. The instruction device 7 performs an instruction input to the management server 1.

[0020] The management server 1 can communicate with the external system 200. The external system 200 is, for example, an existing system constructed in the above facility. The external system 200 stores information of users of the facility as external user information IF1.

[0021] The user information registered in the management server 1 includes records for each registered user. Each record includes fields such as user identification information (hereinafter referred to as user ID), authentication information, name, gender, date of birth, biometric information or the estimated result of biometric information described later. The user ID is automatically assigned as a unique ID for each user by the management server 1 when a user is newly registered in the management system 100.

[0022] Authentication information is used to identify registered users. Identifying a registered user only needs to be sufficient to distinguish them from other registered users. Obtaining identification information from the registered user's body may be done non-contactually or by contact with the registered user's body. Authentication information may include facial images, palm prints, fingerprints, iris scans, vein patterns, etc., and in the following explanation, we will use facial images obtained from images of registered users. Therefore, in the following explanation, each registered user's facial image is registered in the management server 1.

[0023] Sensor terminal 3 is a terminal device equipped with a camera 35, which is an example of a sensor that senses the user 300 without contact. The facial image of the user 300 captured by the camera 35 is input to the management server 1. Sensor terminal 3 is also an example of an instruction device that provides instructions to the management server 1.

[0024] (Overview of biometric information management operations on the management server) The management server 1 analyzes the captured image input from the sensor terminal 3 to detect the user's face image. The management server 1 identifies the registered user by comparing the user's face image with the face image included in the user information stored in the data storage unit 13.

[0025] The management server 1 stores the biometric information of user 300 obtained from the sensor terminal 3 in the data storage unit 13 as data of the identified registered user. The biometric information may be the sensing result of user 300 from the sensor terminal 3 itself, or it may be data estimated from the sensing result of user 300. Here, "biometric information" refers to information obtained from the human body and includes information representing a person's life activities. Information representing a person's life activities includes information representing the state of the body and information representing the load on the body. Information representing life activities includes, for example, information representing the state of user 300's blood vessels, which quantifies the load on the blood vessels (hereinafter referred to as "vascular information"), and information related to the user's heart rate, which quantifies the speed of blood flow from the heart (hereinafter referred to as "heart rate information"). "Estimation" refers to obtaining biometric information by processing information obtained non-contactually from the body, and as an example, it refers to obtaining a value by processing the image captured by the camera 35. The obtained value is an estimated value representing the state of user 300's blood vessels, or an estimated value representing the state of the heart rate.

[0026] In addition to biometric information estimated from captured images, biometric information may also be estimated from sensing results of other sensors. For example, sensor terminal 3 has a temperature sensor 36 (Figure 3), and information related to the user's temperature (hereinafter referred to as temperature information) may be estimated from the surface temperature of the user 300, which is the sensing result of the temperature sensor 36.

[0027] For example, the estimation of biological information may be performed by the management server 1, or by a computing device (not shown) and input to the management server 1. Vascular information and heart rate information are estimated by analyzing captured images and performing statistical processing using, for example, known techniques. Temperature information is estimated from the surface temperature of the user 300 using, for example, known techniques.

[0028] (Overview of user registration on the management server) In facilities such as hospitals, nursing homes, and sports gyms, a new management system 100 is introduced, and it is envisioned that at least some of the registered users of the existing systems operating in these facilities (referred to as "external systems 200") will also begin using the management system 100. In this embodiment, it is possible to register users in the management system 100 using the user information of registered users that has already been registered in the external systems 200. Note that in the external systems 200, the user information of registered users does not include authentication information (in this case, a facial image) to identify the registered user, but in the management system 100, a facial image of the user is required when registering the user.

[0029] Based on the above premise, when the management system 100 is installed in the facility, the first thing that happens is that user information (external user information IF1) regarding registered users of the external system 200 is input from the external system 200 to the management server 1 of the management system 100. The management server 1 stores the input external user information IF1 in the data storage unit 13. As mentioned above, the external user information IF1 input from the external system 200 does not include facial images of each registered user.

[0030] Each time a user of the management system 100 visits the facility (each time they use the management system 100), their face is captured by the sensor terminal 3. The management server 1 compares the face image captured by the user with the user information of registered users of the management system 100 registered in the data storage unit 13 to determine whether the user is a registered user of the management system 100. Even if a user is a registered user of the external system 200, if they have not yet registered with the management system 100, their user information, including their face image, is not registered in the data storage unit 13, and therefore they are not determined to be a registered user of the management system 100. In this case, the management server 1 merges the face image of the user read by the sensor terminal 3 with the external user information IF1 of the user, which is input from the external system 200 and stored in the data storage unit 13, to generate new user information IF3, which includes the face image of the user. The new user information IF3 includes the external user information IF1 of the external system 200 and the face image read by the sensor terminal 3. As a result, when a registered user of the external system 200 uses the management system 100 for the first time, new user information IF3, including the facial image read by the sensor terminal 3, is registered in the data storage unit 13, and that user is registered as a registered user of the management system 100.

[0031] (Management server configuration) Management Server 1 consists of a computer, or a single computer and its peripheral devices. Alternatively, Management Server 1 may be implemented by multiple computers working together. Figure 2 is a schematic diagram of Management Server 1. Management Server 1 includes a control unit 11, such as a CPU (Central Processing Unit), a memory 12, such as a ROM (Read Only Memory) or RAM (Random Access Memory), and a communication unit 14, such as a communication module for communicating with other devices. The memory 12 stores the program 121 executed by the control unit 11. Management Server 1 also includes a data storage unit 13. The data storage unit 13 is, for example, an HDD (Hard Disk Drive) or an SSD (Solid State Drive).

[0032] (Sensor terminal configuration) Sensor terminal 3 is, for example, a terminal device held in the hand of the operator of sensor terminal 3, with its sensing range directed towards the user 300. Sensor terminal 3 may be a terminal device dedicated to sensing, or the functions of sensor terminal 3 may be integrated into a terminal device such as a smartphone.

[0033] The operator of sensor terminal 3 may be different from user 300, for example, a reception staff member at the facility, or it may be user 300 themselves. Furthermore, the operator of sensor terminal 3 may be the same as the operator of indicator device 7, or they may be different. The operator of indicator device 7 may be a specific staff member, for example, the administrator of management system 100, or it may be the same as the operator of sensor terminal 3, such as a reception staff member at the facility. Also, the operator of indicator device 7 may be user 300 themselves. Additionally, sensor terminal 3 may be installed at the entrance of a room, etc., without any operator intervention, and sense people entering the room as users 300.

[0034] Figure 3 is a schematic diagram of the sensor terminal 3. The sensor terminal 3 has a camera 35 and a temperature sensor 36. The camera 35 and temperature sensor 36 are sensors that acquire information necessary to estimate the biometric information of the user 300 in a non-contact manner. The camera 35 is further used to acquire a facial image, which is authentication information. The sensor terminal 3 has a touch panel 34 as an example of a display device and input device. The sensor terminal 3 may also have a microphone 37 and a speaker 38. The sensor terminal 3 has a control device 30 that is connected to the touch panel 34, camera 35, temperature sensor 36, microphone 37, and speaker 38 and controls them. The control device 30 has a control unit 31, which is a CPU or the like, a memory 32, which is a ROM, RAM or the like, and a communication unit 33, which is a communication module or the like for communicating with other devices. The memory 32 stores the program 321 that is executed by the control unit 31.

[0035] (Details of user registration process on the management server) Figure 4 is a diagram illustrating the flow of operations in the management system 100. Figure 5 is a diagram illustrating the flow of user information registered by the user information registration operation on the management server 1. Using Figures 4 and 5, we will explain an example of registering new user information IF3 for a registered user named "AAA" (hereinafter referred to as "registered user AAA") from the external system 200 to the management server 1. Registered user AAA is not registered as a user in the management system 100, and no data regarding registered user AAA is stored in the management system 100.

[0036] Prior to the use of the management system 100 by registered user AAA, the external user information IF1 of registered user AAA is input from the external system 200 to the management server 1 (step S11 in Figure 4). In step S11, the external user information IF1 is input to the management server 1 when the operator of the external system 200 performs an operation to the external system 200 to input the external user information IF1 of registered user AAA to the management server 1. The management server 1 stores the external user information IF1 of registered user AAA, which was input from the external system 200 in step S11, in the data storage unit 13 (step S12).

[0037] As shown in Figure 5, the external user information IF1 of the external system 200 includes, as an example, the user ID (ID1) assigned by the external system 200, name "AAA", date of birth "Y / M / D", gender "male", and contact information "XXX". The external user information IF1 may include other information, but it does not include the facial image which is authentication information for the management server 1.

[0038] After the external user information IF1 is input to the management server 1 and registered, the registered user AAA of the external system 200 uses the management system 100. At this time, the registered user AAA is photographed for the first time by the sensor terminal 3. Specifically, when the operator of the sensor terminal 3 performs an operation to photograph the registered user AAA (step S13), the control unit 31 of the sensor terminal 3 causes the camera 35 to perform a shooting operation according to the operation in step S13 (step S14), and transmits the captured image to the management server 1 according to the program 321 (step S15). When the camera 35 is pointed at the face of the registered user AAA by the operator of the sensor terminal 3, the face image of the registered user AAA is transmitted to the management server 1 in step S15.

[0039] Since registered user AAA was captured by sensor terminal 3 for the first time, in step S15, the face image of registered user AAA is input to management server 1 for the first time. The control unit 11 of management server 1 compares the face image of registered user AAA with the face image included in the user information stored in data storage unit 13, according to program 121. At the time when the face image of registered user AAA is first input to management server 1, neither the face image of registered user AAA nor the user information containing the face image of registered user AAA is stored in data storage unit 13. Also, the external user information IF1 of registered user AAA, which was stored in data storage unit 13 in step S12, does not include the face image of registered user AAA, as shown in Figure 5. Therefore, at the time when the face image of registered user AAA is first input to management server 1, even if the face image of registered user AAA input from sensor terminal 3 is compared with the face image included in the user information stored in data storage unit 13, registered user AAA cannot be identified as a registered user of management server 1.

[0040] If registered user AAA is not identified as a registered user of management server 1, the control unit 11 performs a process to merge the face image of registered user AAA, input from sensor terminal 3, with external user information IF1, which is stored in data storage unit 13 before the input of registered user AAA's face image. Therefore, if registered user AAA is not identified as a registered user of management server 1 using the face image, the control unit 11 continues to perform a process to merge the face image of registered user AAA with external user information IF1.

[0041] The control unit 11 executes a candidate display process (step S19) according to the program 121. The candidate display process in step S19 is a process for determining the external user information IF1 stored in the data storage unit 13, which will merge the face images of registered user AAA. In step S19, the control unit 11 determines the external user information IF1, which was input from the external system 200 in step S11 and stored in the data storage unit 13 in step S12, as the candidate external user information, which is a candidate for external user information IF1. If multiple external user information is stored in the data storage unit 13, in step S19 the control unit 11 determines the above multiple external user information as candidate external user information.

[0042] If multiple candidate external user information is determined, in step S19 the control unit 11 determines the display priority of the multiple candidate external user information so that the candidate external user information that is more likely to be selected has a higher priority.

[0043] The control unit 11 may determine priority based on the information contained in each candidate external user information. For example, the control unit 11 may give higher priority to candidate external user information that has been input from the external system 200 more recently, or to candidate external user information that has been assigned a newer user ID. This is because it is considered that there is a high probability that a face image will be added to the external user information that has been newly input from the external system 200.

[0044] The control unit 11 may determine priority based on the information contained in each candidate external user information and the facial image of registered user AAA. For example, if the control unit 11 analyzes the facial image of registered user AAA and estimates that the user is male and in their 30s, it may read the gender and age contained in each candidate external user information and give higher priority to candidate external user information that matches the gender estimated from the facial image of registered user AAA and is close in age.

[0045] The control unit 11 instructs the sensor terminal 3 to display candidate external user information (step S20). As a result, the candidate external user information is displayed on the touch panel 34 of the sensor terminal 3 (step S21). If there are multiple candidate external user information entries, in step S20 the control unit 11 instructs the display of the multiple candidate external user information entries based on the determined priority order. As a result, in step S21, the multiple candidate external user information entries are displayed on the touch panel 34 of the sensor terminal 3 based on the priority order.

[0046] Figure 6 is a schematic diagram of the display screen 202 of the sensor terminal 3 for instructing the external user information IF1 to be merged with the facial image of registered user AAA. The screen 202 includes a display 25 of candidate external user information options. If there are multiple candidate external user information options, the display 25 includes options for each of the multiple candidate external user information options, as shown in Figure 6.

[0047] Preferably, screen 202 displays the candidate external user information options using the information contained in the candidate external user information. In the example in Figure 6, the candidate external user information options are displayed using the names contained in the candidate external user information.

[0048] The operator of sensor terminal 3 selects external user information IF1 of registered user AAA from among the multiple candidate external user information on screen 202 as the external user information to be merged with the face image of registered user AAA (step S22). As shown in Figure 6, when the candidate user information is displayed using names, the operator of sensor terminal 3 can easily select external user information IF1.

[0049] Preferably, screen 202 has a button 26 that instructs the user to register user information using the facial image of registered user AAA as a user other than the candidate external user information shown on display 25. When button 26 is operated, the control unit 31 of the sensor terminal 3 may update display 25 to show the next priority selection of candidate external user information.

[0050] When button 26 is operated, the control unit 31 of the sensor terminal 3 may request the management server 1 to generate and register a new user registration using the face image of registered user AAA, without merging the face image of registered user AAA with the external user information IF1. As a result, user information for registered user AAA, without using the external user information IF1 of registered user AAA from the external system 200, is registered in the management server 1.

[0051] When the external user information IF1 for registered user AAA is selected from the candidate external user information on screen 202, the sensor terminal 3 notifies the management server 1 that external user information IF1 has been selected (step S23). Before notifying the management server 1 of the selected external user information IF1 in step S23, the sensor terminal 3 may accept a confirmation operation from the operator. This prevents erroneous operation.

[0052] When the management server 1 performs the candidate display process (step S19), candidate external user information is displayed on the sensor terminal 3. This makes the selection process easier for the operator than if they had to select external user information IF1 to merge with the face image of registered user AAA from all the user information stored in the data storage unit 13. Furthermore, the management server 1 displays candidate external user information that is most likely to be selected at the top. Therefore, even when there are multiple candidate external user entries, the operator of the sensor terminal 3 can more easily find the external user information IF1 of registered user AAA, making the selection process easier. In particular, since the sensor terminal 3 is assumed to be a mobile device, the display screen size is small. Therefore, the candidate display process makes it easier for the operator to make a selection.

[0053] When the control unit 11 of the management server 1 receives the selection result of the external user information to be merged with the face image of registered user AAA from the sensor terminal 3, it executes a merge process (step S24) according to the program 121. The merge process in step S24 refers to the process of merging the face image of registered user AAA input from the sensor terminal 3 with the selected external user information IF1 of registered user AAA.

[0054] Figure 7 is a flowchart illustrating an example of the operation of the management server 1 in the operation of the management system 100 shown in Figure 4. When the control unit 11 of the management server 1 receives external user information IF1 of registered user AAA from the external system 200 (YES in step S101), it assigns a new user ID (ID2) to registered user AAA in the management system 100 according to program 121 and stores it in the data storage unit 13 as new user information IF3 (step S103). In step S103, the control unit 11, as an example, places the information from each field of the external user information IF1 into the corresponding field of the user information in the management system 100. As shown in Figure 5, the new user information IF3 stored in the data storage unit 13 in step S103 does not include the face image of registered user AAA.

[0055] Furthermore, the control unit 11 stores in the data storage unit 13 the correspondence between the user ID (ID2) of the management system 100 assigned to registered user AAA in step S103 and the user ID (ID1) of registered user AAA in the external system 200, which is read from the external user information IF1 (step S104). As a result, as shown in Figure 5, the correspondence between the user ID (ID2) of the management system 100 and the user ID (ID1) of the external system 200 for registered user AAA is stored in the data storage unit 13. Steps S103 and S104 are the registration process of step S12 in Figure 4.

[0056] When the sensor terminal 3 receives input of a facial image of registered user AAA (YES in step S105), the control unit 11, in accordance with the program 121, compares the facial image of registered user AAA with the facial images included in the user information stored in the data storage unit 13 to determine whether or not registered user AAA is a registered user of the management server 1.

[0057] If user information for registered user AAA, including a facial image of registered user AAA, is stored in the data storage unit 13, the control unit 11 identifies registered user AAA as a registered user of the management server 1 (YES in step S107). In this case, the control unit 11 performs normal data management processing according to program 121 (step S109). In step S109, the control unit 11 processes the facial image input from the sensor terminal 3 in step S105 to estimate the biometric information of the captured user. The control unit 11 then stores the estimated biometric information in the data storage unit 13 as data for the registered user identified in step S107.

[0058] If user information, including the facial image of registered user AAA, is not stored in the data storage unit 13, registered user AAA will not be identified as a registered user of the management server 1 (NO in step S107). Registered user AAA is captured for the first time by the sensor terminal 3, and the facial image is input to the management server 1 for the first time, so registered user AAA will not be identified as a registered user of the management server 1. In this case, the control unit 11 executes steps S111 and later.

[0059] The control unit 11 determines whether candidate external user information for merging the face image of registered user AAA is stored in the data storage unit 13. New user information generated from external user information and stored in the data storage unit 13, which has not been merged with a face image, does not include a face image, as shown in Figure 5. Therefore, the control unit 11 determines that candidate external user information is stored in the data storage unit 13 if user information that does not include a face image is stored in the data storage unit 13 (YES in step S111).

[0060] In this case, the control unit 11 extracts user information that does not include a face image from the data storage unit 13 as candidate external user information and displays it on the sensor terminal 3 (step S113). When multiple candidate external user information is extracted from the data storage unit 13, the control unit 11 further determines the display priority of the multiple candidate external user information so that the candidate external user information that is more likely to be selected has a higher priority, as described above, and displays them according to the priority in step S113. As a result, screen 202 is displayed on the sensor terminal 3. Steps S111 and S113 are the candidate display process of step S19 in Figure 4.

[0061] The control unit 11 receives the selection result of the external user information to be merged with the face image of registered user AAA from the sensor terminal 3 (YES in step S115). In this example, the external user information IF1 of registered user AAA is selected at the sensor terminal 3. The control unit 11 adds the face image of registered user AAA input from the sensor terminal 3 to the new user information IF3 of registered user AAA, which is generated from the selected external user information IF1, according to the program 121 (step S117). Step S117 is the merge process of step S14 in Figure 4.

[0062] As a result of the processing in step S117, the new user information IF3 is a merge of the external user information IF1 of registered user AAA and the facial image of registered user AAA read by the sensor terminal 3. Therefore, as shown in Figure 5, as a result of the processing in step S117, the new user information IF3 includes the name "AAA", date of birth "Y year M month D day", gender "male", and contact information "XXX" that were included in the external user information IF1 of registered user AAA, as well as the facial image of registered user AAA input from the sensor terminal 3.

[0063] Furthermore, the sensor terminal 3 may request that, without receiving a selection result (NO in step S115), a new user registration be generated and registered using the facial image of registered user AAA, for example, when button 26 is operated on screen 202 in Figure 6.

[0064] In this case, the control unit 11 generates user information including the face image of registered user AAA read by the sensor terminal 3, assigns a user ID, and stores it in the data storage unit 13 according to program 121 (step S119). Also, if candidate external user information is not stored in the data storage unit 13 (NO in step S111), the control unit 11 executes step S119. Step S119 is a normal user registration process using the face image read by the sensor terminal 3. The control unit 11 receives input of information other than the face image of registered user AAA from the sensor terminal 3 and generates new user information including this information.

[0065] As a comparative example, consider the case where external user information, which does not include a facial image for authentication, is registered to a server that identifies registered users using facial images. In this case, the operator of the instruction device 7 must use the instruction device 7 to request the server to add a facial image for authentication to the external user information in the external system 200 before registering the external user information. If the operator of the instruction device 7 does not have the authority to operate on the external user information in the external system 200, a facial image cannot be added to the external user information. In this case, the operation of the operator of the instruction device 7 will not register the external user information to the server. Furthermore, the operation of the operator of the instruction device 7 is cumbersome because it is necessary to perform the operation of adding a facial image for authentication to the external user information in the external system 200.

[0066] In contrast, the management server 1 according to this embodiment stores external user information IF1 in the data storage unit 13 when it is input from the external system 200. If registered user AAA is not identified as a registered user by the face image read by the sensor terminal 3, the management server 1 generates new user information IF3 including the face image of registered user AAA by merging the external user information IF1 of registered user AAA with the face image of registered user AAA read by the sensor terminal 3. Thus, in this embodiment, the management server 1 only needs to register the external user information IF1 of registered user AAA from the external system 200 that it wants to register with the management server 1, and then when the face image of registered user AAA is taken by the sensor terminal 3, new user information IF3 including the face image of registered user AAA is registered with the management server 1. For this reason, when registering registered user AAA from the external system 200 with the management server 1, it is not necessary to register information already registered in the external user information IF1, such as the name "AAA" and date of birth "Y year M month D day", with the management server 1. This eliminates the need to input duplicate information, prevents input errors, and facilitates the registration of registered user AAA of the external system 200 to the management server 1.

[0067] (Examples of using correspondence relationships) The management server 1 can manage data by using the correspondence between the user ID assigned to the new user information IF3 stored in the data storage unit 13 and the user ID assigned to the external user information by the external system 200. For example, the management server 1 receives the user ID (ID1) of registered user AAA, from the external system 200, from which biometric information is to be obtained.

[0068] The management server 1 reads the user ID (ID2) in the management system 100 corresponding to the user ID (ID1) from the correspondence relationships stored in the data storage unit 13. The management server 1 transmits the estimated result of the biometric information stored in the data storage unit 13 as data for registered user AAA, whose user ID (ID2), to the external system 200.

[0069] As a result, the operator of the external system 200 can obtain the estimated biometric information of registered user AAA from the management server 1 by entering the user ID (ID1) in the external system 200, without having to identify and enter the user ID (ID2) in the management server 1. In other words, the management server 1 can provide the estimated biometric information of registered users in the external system 200, who are registered in the management system 100 installed at facilities such as hospitals, nursing homes, and sports gyms, to the external system 200 in response to requests from the existing external system 200, without requiring the operator of the external system 200 to perform complicated operations.

[0070] (Examples of how user information is used) When registered user AAA of the external system 200 uses the management system 100 for the first time, the facial image of registered user AAA captured by the sensor terminal 3 is added to the new user information IF3 of registered user AAA. Therefore, when registered user AAA of the external system 200 uses the management system 100 for the second time or later, they are determined to be a registered user of the management server 1 based on the facial image captured by the sensor terminal 3. As a result, registered user AAA of the external system 200 can register data related to that registered user in the management server 1 of the management system 100 as a registered user of the management server 1. For example, when registered user AAA is photographed for the second time by the sensor terminal 3, biometric information estimated by image processing of that facial image is stored in the data storage unit 13 as data of registered user AAA identified by that facial image.

[0071] (Variation 1) The management server 1 may further register registered user AAA to the management server using the facial image of registered user AAA input from the sensor terminal 3 and user information containing a facial image stored in the data storage unit 13. For example, the management server 1 may further register registered user AAA to the management server using the facial image of registered user AAA input from the sensor terminal 3 and user information stored in the data storage unit 13 that includes a facial image with a high degree of similarity (similar) to the facial image of registered user AAA.

[0072] Figure 8 is a flowchart illustrating a modified version of the operation of the management server 1 in the management system 100 shown in Figure 4. Figure 9 is a schematic diagram of the screen of the sensor terminal 3 when registering a face image in this modified version. The modified version of the operation of the management server 1 differs from the process shown in the flowchart of Figure 7 in that it includes steps S201 to S207. Figure 8 shows the process from step S105 onwards in Figure 7.

[0073] In the modified version, the management server 1 uses the facial image of registered user AAA input from the sensor terminal 3 to determine whether the facial image of registered user AAA is highly similar to the facial image of registered user AAA if registered user AAA is not identified as a registered user of the management server 1 (NO in step S107).

[0074] The control unit 11 determines, for example, that the facial features calculated from the facial image included in the user information are highly similar to those of registered user AAA if the difference between the facial features calculated from the facial image of registered user AAA and those calculated from the facial image of registered user AAA is below a predetermined threshold. Facial features include, for example, numerical values ​​representing the positions of feature points such as eyes, nose, mouth, and facial contours obtained from the facial image.

[0075] If user information containing a face image that is highly similar to the face image of registered user AAA is stored in the data storage unit 13 (YES in step S201), the process in steps S203 to S207 is performed to merge the user information containing the face image that is highly similar to the face image of registered user AAA with the face image of registered user AAA.

[0076] The control unit 11 extracts user information from the data storage unit 13, including face images with a high similarity to the face image of registered user AAA, as candidate user information to be merged with the face image of registered user AAA, and outputs it to the sensor terminal 3 (step S203). As a result, screen 203 in Figure 9 is displayed on the sensor terminal 3.

[0077] Screen 203 includes a display 27 of candidate user information options to merge with the face image of registered user AAA, and a button 28 that instructs the user not to merge the face image of registered user AAA with the candidate user information shown in display 27.

[0078] If multiple candidate user information entries are extracted from the data storage unit 13, the control unit 11 may determine the display priority of the multiple candidate user information entries, similar to the candidate display processing (step S19 in Figure 4), so that candidate user information entries that are more likely to be selected have a higher priority, and display them on the sensor terminal 3. In this case, the control unit 11 gives a higher priority to candidate user information entries whose included face images have a high degree of similarity to the face image of registered user AAA. As a result, user information entries containing face images that are more similar to the face image of registered user AAA are displayed at the top.

[0079] When the control unit 11 receives the selection result of user information to be merged with the face image of registered user AAA from the sensor terminal 3 (YES in step S205), it adds the face image of registered user AAA input from the sensor terminal 3 to the selected user information (step S207). At this time, the face images included in the selected user information are overwritten with the face image of registered user AAA.

[0080] If user information containing a face image with a high similarity to the face image of registered user AAA is not stored in the data storage unit 13 (NO in step S201), the control unit 11 does not perform the processing in steps S203 to S207 and proceeds with the processing from step S111 onwards. Also, if button 28 is operated on screen 203 in Figure 9, the control unit 11 does not perform the processing in steps S203 to S207 and proceeds with the processing from step S111 onwards. In this case, the screen of the sensor terminal 3 switches from screen 203 in Figure 9 to screen 202 in Figure 6.

[0081] In this modified example, if registered user AAA is not identified as a registered user on the management server 1 using the facial image read by the sensor terminal 3, prior to merging with external user information IF1, user information from the data storage unit 13 that includes a similar facial image is designated as candidate user information to be merged with registered user AAA's facial image. This allows registered user AAA to be registered on the management server 1 using user information of registered users similar to registered user AAA.

[0082] In the modified example, the process for merging user information, which includes a face image highly similar to the face image of registered user AAA and is stored in the data storage unit 13 (steps S201 to S207), may be performed after the process for merging with external user information (steps S111 to S119).

[0083] (Modification 2) The correspondence between registered user AAA's user ID (ID1) in external system 200 and user ID (ID2) in management server 1 may be stored in external system 200 instead of, or in addition to, the data storage unit 13 of management server 1. Alternatively, the correspondence may be stored in a device other than management server 1 and external system 200. In this case, when external system 200 reads the biometric information estimation results from management server 1, it reads the user ID (ID2) in management server 1 that corresponds to registered user AAA's user ID (ID1) in external system 200 from the stored correspondence. External system 200 then requests the biometric information estimation results from management server 1 using user ID (ID2). This allows external system 200 to easily access management server 1 using the user ID of the user information generated by management server 1.

[0084] <3. Addendum> The present invention is not limited to the above embodiments, and various modifications are possible. For example, in the above embodiment, the management system 100 is an example of a system that estimates the biometric information of a subject from information obtained by non-contact scanning of the subject and manages that data. The data managed by the management system 100 is not limited to the results of biometric information estimation, and may be any data that is managed by performing user authentication using user identification information obtained from information obtained by non-contact scanning of the subject. [Explanation of Symbols]

[0085] 1: Management server, 3: Sensor terminal (indicator), 7: Indicator, 13: Data storage unit, 35: Camera, 200: External system, 300: User, IF1: External user information, IF3: New user information

Claims

1. A management server that manages users' biometric information, It comprises a control unit and a data storage unit, The control unit, At least some users obtain external user information, which does not include authentication information for identifying the user, from an external system that is common to users whose biometric information is managed by the management server, and store it in the data storage unit. When the user cannot be identified by comparing the authentication information obtained from the user's body with the authentication information contained in the user information stored in the data storage unit, new user information including the authentication information obtained from the user's body is generated and stored in the data storage unit by merging the authentication information obtained from the user's body with the external user information stored in the data storage unit. When biometric information is obtained from the user, the user is identified by comparing the authentication information obtained from the user's body with the authentication information included in the new user information stored in the data storage unit, and the biometric information is stored in the data storage unit as data of the identified user. Management server.

2. If multiple external user information is stored in the data storage unit, the display priority of the multiple external user information is determined using the information contained in each of the multiple external user information and the authentication information obtained from the user's body. An instruction device that accepts the selection of external user information to be merged with the authentication information obtained from the user's body displays options corresponding to each of the multiple pieces of external user information, based on the priority order. The management server according to claim 1.

3. The data storage unit stores the correspondence between the identification information assigned to the new user information and the identification information assigned to the external user information in the external system, which is read from the external user information. The management server according to claim 1.

4. The aforementioned authentication information is the user's facial image. The management server according to claim 1.

5. A computer program that makes a computer function as a management server for managing users' biometric information, At least some users obtain external user information, which does not include authentication information for identifying the user, from an external system that is common to users whose biometric information is managed by the management server, and store it in the data storage unit. When the user cannot be identified by comparing the authentication information obtained from the user's body with the authentication information contained in the user information stored in the data storage unit, new user information including the authentication information obtained from the user's body is generated and stored in the data storage unit by merging the authentication information obtained from the user's body with the external user information stored in the data storage unit. When biometric information is obtained from the user, the computer is instructed to identify the user by comparing the authentication information obtained from the user's body with the authentication information included in the new user information stored in the data storage unit, and then to store the biometric information in the data storage unit as data of the identified user. Computer program.

Images