Management server and computer program

Abstract

This system provides a management server that registers user information using user information from an external system, without including authentication information used by the management server itself. [Solution] The control unit of the management server 1, which manages the biometric information of users 300, obtains external user information IF1, which does not include authentication information for identifying users, from an external system 200 that is common to at least some users and users whose biometric information is managed by the management server. It obtains authentication information to identify the user from the user's body, generates and stores provisional user information IF2 that includes the authentication information, and generates and stores new user information that includes the authentication information by merging the external user information and the provisional user information. When biometric information is obtained from the user, the user is identified by comparing the authentication information obtained from the user's body with the authentication information included in the provisional user information, and the biometric information is stored as data for the identified user.

Description

Technical Field

[0001] The present disclosure relates to a management server and a computer program.

Background Art

[0002] For example, Japanese Patent Application Laid-Open No. 2020-046962 (hereinafter, Patent Document 1) discloses a measurement system that measures vital information of a subject non-contact using a measurement terminal, transmits the measurement result to a management server, and manages it in association with the subject as data of the subject. In such a system, the management server uses authentication information such as a face image of the subject to identify that the subject is a registered user. Then, the management server stores the obtained biological information as information of the identified user.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

[0004] As described above, in a management server that needs to identify users, it is necessary to register authentication information of each user in advance. Here, when there is an external system in which at least some of the users are common, it may be desired to register users in the management system using the user information registered in this external system. For example, when a new system is introduced into a facility such as a hospital, a nursing facility, or a sports gym, it is assumed that there may be a case where the external user information of an already constructed external system is registered in the management server of the newly introduced system.

[0005] However, if the user information in an external system does not include user authentication information, for example, because user identification is not required in the external system, then the user information in the external system cannot be used directly on the management server. Therefore, a management server and computer program are desired that can register user information using user information from an external system that does not include authentication information used on the management server.

[0006] According to one embodiment, the management server is a management server that manages users' biometric information and comprises a control unit and a data storage unit. The control unit obtains external user information, which does not include authentication information for identifying users, from an external system that is common to at least some users and users whose biometric information is managed by the management server. The control unit obtains authentication information for identifying users from the users' bodies, generates provisional user information including authentication information and stores it in the data storage unit. The control unit generates new user information including authentication information by merging the external user information and the provisional user information and stores it in the data storage unit. When biometric information is obtained from a user, the control unit identifies the user by comparing the authentication information obtained from the user's body with the authentication information included in the provisional user information, and stores the biometric information in the data storage unit as data for the identified user.

[0007] According to one embodiment, the computer program is a computer program that causes the computer to function as a management server for managing users' biometric information. The computer program causes the computer to perform the following actions: obtain external user information, which does not include authentication information for identifying the user, from an external system that is common to at least some users and users whose biometric information is managed by the management server; obtain authentication information for identifying the user from the user's body; generate provisional user information including the authentication information and store it in the data storage unit; generate new user information including the authentication information by merging the external user information and the provisional user information and store it in the data storage unit; and when biometric information is obtained from the user, identify the user by comparing the authentication information obtained from the user's body with the authentication information included in the provisional user information, and store the biometric information in the data storage unit as data for the identified user.

[0008] Further details will be described in the embodiments below. [Brief explanation of the drawing]

[0009] [Figure 1] Figure 1 is a schematic diagram of the management system according to an embodiment. [Figure 2] Figure 2 is a schematic diagram of the management server configuration. [Figure 3] Figure 3 is a schematic diagram of the sensor terminal configuration. [Figure 4] Figure 4 is a diagram illustrating the workflow within the management system. [Figure 5] Figure 5 illustrates the flow of user information generated by the operation of the management system. [Figure 6] Figure 6 is a schematic diagram of the display screen for provisional user information registered on the management server. [Figure 7] Figure 7 is a schematic diagram of the display screen for selecting external user information to which facial images will be added. [Figure 8] Figure 8 is a flowchart illustrating an example of the operation of the management server. [Figure 9]Figure 9 is a schematic diagram of the screen displayed on the indicator device in step S21 of Figure 4, in the first modified example. [Modes for carrying out the invention]

[0010] <1. Overview of the Management Server and Computer Programs> (1) The management server according to the embodiment is a management server that manages the biometric information of users and comprises a control unit and a data storage unit. The control unit acquires external user information, which does not include authentication information for identifying users, from an external system that is common to at least some users and users whose biometric information is managed by the management server, acquires authentication information for identifying users from the user's body, generates provisional user information including authentication information and stores it in the data storage unit, generates new user information including authentication information by merging the external user information and the provisional user information and stores it in the data storage unit, and when biometric information is acquired from a user, identifies the user by comparing the authentication information acquired from the user's body with the authentication information included in the provisional user information, and stores the biometric information in the data storage unit as data of the identified user.

[0011] External user information that does not include authentication information cannot be used by the management server to identify users. In this regard, the management server according to the embodiment generates new user information that includes authentication information by merging the external user information that does not include authentication information with the provisional user information that includes authentication information. The new user information includes the authentication information contained in the external user information and the provisional user information. As a result, the management server, which identifies users using authentication information, can register new user information that includes authentication information using external user information that does not include authentication information.

[0012] (2) The management server of (1), preferably, stores in its data storage unit the correspondence between the identification information assigned to the new user information and the identification information assigned to the external user information in the external system, which is read from the external user information. This enables access between the external system and the management server based on the correspondence between the new user information stored in the data storage unit and the external user information registered in the external system.

[0013] (3) The management server of (1) and (2) preferably stores external user information in the data storage unit, and determines user information from the external user information stored in the data storage unit that does not contain at least authentication information as candidate user information for external user information to be merged with provisional user information. User information that does not contain at least authentication information is highly likely to be merged with user information. As a result, the determined user information that is highly likely to be merged with provisional user information can be displayed as candidate user information on the instruction device that indicates external user information to be merged with provisional user information.

[0014] (4)(3) The management server, preferably, when there are multiple determined candidate user information, uses the information contained in each of the multiple determined candidate user information and the information contained in the provisional user information to be merged to determine the priority of the multiple candidate user information, and displays the multiple determined candidate user information on the instruction device, which accepts the selection of external user information to be merged with the provisional user information, based on the priority. The priority may be, for example, the order in which the operator of the instruction device is most likely to select. As a result, the more likely the multiple determined candidate user information is to be selected as external user information to be merged with the provisional user information, the higher the priority it will be displayed on the instruction device. Therefore, it becomes easier for the operator of the instruction device to select external user information using the instruction device. In addition, the error of the operator of the instruction device selecting external user information is suppressed.

[0015] (5) The management server according to (1) to (4) preferably displays the provisional user information stored in the data storage unit on the instruction device along with an icon for receiving instructions to merge it with external user information. The icon is, for example, a button provided on the display screen of the instruction device for instructing to merge with external user information. This allows the operator of the instruction device to easily instruct the merging of the displayed provisional user information with external user information through operation.

[0016] (6) The management server according to (1) to (5), preferably, the authentication information is the user's facial image. This allows external user information that does not have an authentication facial image to be used for registering user information in the management server that identifies users using facial images. Therefore, the management server can identify users using external user information that does not have an authentication facial image.

[0017] (7) The computer program according to the embodiment is a computer program that causes a computer to function as a management server for managing users' biometric information. The computer program causes the computer to perform the following actions: obtain external user information, which does not include authentication information for identifying the user, from an external system that is common to at least some users and users whose biometric information is managed by the management server; obtain authentication information for identifying the user from the user's body; generate provisional user information including the authentication information and store it in the data storage unit; generate new user information including the authentication information by merging the external user information and the provisional user information and store it in the data storage unit; and when biometric information is obtained from the user, identify the user by comparing the authentication information obtained from the user's body with the authentication information included in the provisional user information, and store the biometric information in the data storage unit as data of the identified user.

[0018] External user information of an external system, which does not include authentication information, cannot be used by the management server to identify users. In this regard, the computer program according to the embodiment causes the computer to merge the external user information that does not include the authentication information with the user information that includes the authentication information and has been registered. Therefore, the newly generated user information obtained by the merge includes the external user information and the authentication information of the user information. As a result, in the management server that identifies users using the authentication information, it is possible to register user information that includes authentication information using external user information that does not include authentication information.

[0019] <2. Examples of the management server and the computer program> (Configuration of the management system) FIG. 1 is a schematic configuration diagram of a management system 100 according to an embodiment. The management system 100 is a management system for biometric information obtained using the sensor terminal 3. The management system 100 is introduced into facilities such as hospitals, nursing homes, and sports gyms, for example.

[0020] The management system 100 includes a management server 1. The management server 1 acquires biometric information of a person registered as a user of the management system 100 (hereinafter referred to as a registered user) from the sensor terminal 3 and stores (registers) it in the data storage unit 13 (FIG. 2). "Biometric information" is information obtained from a user's human body in order to manage, for example, the user's health status and exercise status in the management system 100, and includes information representing a person's vital activities. In addition, in order to prevent the biometric information of each user from being mismanaged as data of other users, before storing the biometric information in the data storage unit 13, authentication information of the user is acquired from the sensor terminal 3 to identify the user. When it is confirmed that the identified user is a registered user, the biometric information of the user is stored in the data storage unit 13. The authentication information is information obtained from a user's body and used to identify the user separately from other users. Details will be described later.

[0021] The management server 1 can communicate with the instruction device 7 via a communication network such as the internet. The instruction device 7 is, for example, a general computer, smartphone, or tablet. The instruction device 7 inputs instructions to the management server 1.

[0022] Management server 1 can communicate with external system 200. External system 200 is, for example, an existing system built in the facility mentioned above. External system 200 stores information about the facility's users as external user information IF1.

[0023] The user information registered on management server 1 includes a record for each registered user. Each record includes fields such as user identification information (hereinafter referred to as user ID), authentication information, name, gender, date of birth, and biometric information or estimated biometric information as described below. The user ID is automatically assigned by management server 1 as a unique ID for each user when a new user is registered in management system 100.

[0024] Authentication information is used to identify registered users. Identifying a registered user only needs to be sufficient to distinguish them from other registered users. Obtaining identification information from the registered user's body may be done non-contactually or by contact with the registered user's body. Authentication information may include facial images, palm prints, fingerprints, iris scans, vein patterns, etc., and in the following explanation, we will use facial images obtained from images of registered users. Therefore, in the following explanation, each registered user's facial image is registered in the management server 1.

[0025] Sensor terminal 3 is a terminal device equipped with a camera 35, which is an example of a sensor that senses the user 300 without contact. The facial image of the user 300 captured by camera 35 is input to management server 1.

[0026] (Overview of biometric information management operations on the management server) The management server 1 analyzes the captured image input from the sensor terminal 3 to detect the user's face image. The management server 1 identifies the registered user by comparing the user's face image with the face image included in the user information stored in the data storage unit 13.

[0027] The management server 1 stores the biometric information of user 300 obtained from the sensor terminal 3 in the data storage unit 13 as data of the identified registered user. The biometric information may be the sensing result of user 300 from the sensor terminal 3 itself, or it may be data estimated from the sensing result of user 300. Here, "biometric information" refers to information obtained from the human body and includes information representing a person's life activities. Information representing a person's life activities includes information representing the state of the body and information representing the load on the body. Information representing life activities includes, for example, information representing the state of user 300's blood vessels, which quantifies the load on the blood vessels (hereinafter referred to as "vascular information"), and information related to the user's heart rate, which quantifies the speed of blood flow from the heart (hereinafter referred to as "heart rate information"). "Estimation" refers to obtaining biometric information by processing information obtained non-contactually from the body, and as an example, it refers to obtaining a value by processing the image captured by the camera 35. The obtained value is an estimated value representing the state of user 300's blood vessels, or an estimated value representing the state of the heart rate.

[0028] In addition to biometric information estimated from captured images, biometric information may also be estimated from sensing results of other sensors. For example, sensor terminal 3 has a temperature sensor 36 (Figure 3), and information related to the user's temperature (hereinafter referred to as temperature information) may be estimated from the surface temperature of the user 300, which is the sensing result of the temperature sensor 36.

[0029] For example, the estimation of biological information may be performed by the management server 1, or by a computing device (not shown) and input to the management server 1. Vascular information and heart rate information are estimated by analyzing captured images and performing statistical processing using, for example, known techniques. Temperature information is estimated from the surface temperature of the user 300 using, for example, known techniques.

[0030] (Overview of user registration on the management server) When the sensor terminal 3 reads a user's face image and determines from that face image that the user is not a registered user of the management system 100, the management server 1 first generates a provisional user information IF2 containing only the user's face image and provisionally stores it in the data storage unit 13. At this time, the management server 1 may also generate the provisional user information IF2 and store it in the data storage unit 13 after receiving a registration request from the sensor terminal 3. The provisional user information IF2 generated at this time includes at least the face image input from the sensor terminal 3 and the user ID assigned at the time of registration, but does not include other information such as name, date of birth, gender, and contact information. Information such as name may be added after the provisional user information IF2 is registered, by instruction from the instruction device 7 or the like.

[0031] The management server 1 may accept a request from the instruction device 7 for registration of provisional user information IF2 along with the input of a facial image for authentication. In this case as well, the management server 1 generates provisional user information IF2 including the facial image input from the instruction device 7 and stores it in the data storage unit 13. If the instruction device 7 inputs the name, date of birth, gender, and contact information at this time, the generated provisional user information IF2 may include the name, date of birth, gender, and contact information input from the instruction device 7, in addition to the facial image input from the sensor terminal 3 and the user ID assigned at registration.

[0032] On the other hand, when a sensor terminal 3 or instruction device 7 requests the registration of new user information IF3 using external user information IF1 which does not include an authentication face image, the management server 1 merges the external user information IF1 and the provisional user information IF2 which includes an authentication face image to generate new user information IF3 which includes the face images of both the external user information IF1 and the provisional user information IF2, and registers it in the data storage unit 13. Here, the provisional user information IF2 that is merged is generated using an authentication face image before the registration of new user information IF3 and is stored in the data storage unit 13. Once new user information IF3 is registered, the management server 1 may delete the provisional user information IF2 from the data storage unit 13 according to instructions from the instruction device 7, or it may automatically delete the provisional user information IF2 from the data storage unit 13 without instructions from the instruction device 7, or it may not delete the provisional user information IF2 from the data storage unit 13 at all.

[0033] (Management server configuration) Management Server 1 consists of a computer, or a single computer and its peripheral devices. Alternatively, Management Server 1 may be implemented by multiple computers working together. Figure 2 is a schematic diagram of Management Server 1. Management Server 1 includes a control unit 11, such as a CPU (Central Processing Unit), a memory 12, such as a ROM (Read Only Memory) or RAM (Random Access Memory), and a communication unit 14, such as a communication module for communicating with other devices. The memory 12 stores the program 121 executed by the control unit 11. Management Server 1 also includes a data storage unit 13. The data storage unit 13 is, for example, an HDD (Hard Disk Drive) or an SSD (Solid State Drive).

[0034] (Sensor terminal configuration) Sensor terminal 3 is, for example, a terminal device held in the hand of the operator of sensor terminal 3, with its sensing range directed towards the user 300. Sensor terminal 3 may be a terminal device dedicated to sensing, or the functions of sensor terminal 3 may be integrated into a terminal device such as a smartphone.

[0035] The operator of sensor terminal 3 may be different from user 300, for example, a reception staff member at the facility, or it may be user 300 themselves. Furthermore, the operator of sensor terminal 3 may be the same as the operator of indicator device 7, or they may be different. The operator of indicator device 7 may be a specific staff member, for example, the administrator of management system 100, or it may be the same as the operator of sensor terminal 3, such as a reception staff member at the facility. Also, the operator of indicator device 7 may be user 300 themselves. Additionally, sensor terminal 3 may be installed at the entrance of a room, etc., without any operator intervention, and sense people entering the room as users 300.

[0036] Figure 3 is a schematic diagram of the sensor terminal 3. The sensor terminal 3 has a camera 35 and a temperature sensor 36. The camera 35 and temperature sensor 36 are sensors that acquire information necessary to estimate the biometric information of the user 300 in a non-contact manner. The camera 35 is further used to acquire a facial image, which is authentication information. The sensor terminal 3 has a touch panel 34 as an example of a display device and input device. The sensor terminal 3 may also have a microphone 37 and a speaker 38. The sensor terminal 3 has a control device 30 that is connected to the touch panel 34, camera 35, temperature sensor 36, microphone 37, and speaker 38 and controls them. The control device 30 has a control unit 31, which is a CPU or the like, a memory 32, which is a ROM, RAM or the like, and a communication unit 33, which is a communication module or the like for communicating with other devices. The memory 32 stores the program 321 that is executed by the control unit 31.

[0037] (Details of user registration process on the management server) Figure 4 is a diagram illustrating the flow of operations in the management system 100. Figure 5 is a diagram illustrating the flow of user information registered by the user information registration operation on the management server 1. Using Figures 4 and 5, we will explain an example of registering the external user information IF1 of a registered user with the name "AAA" (hereinafter referred to as "registered user AAA") from the external system 200 to the management server 1.

[0038] The external user information IF1 of registered user AAA in the external system 200 is input from the external system 200 to the management server 1 (step S11 in Figure 4). In step S11, the external user information IF1 is input to the management server 1 when the operator of the external system 200 performs an operation to input the external user information IF1 of registered user AAA to the management server 1.

[0039] As shown in Figure 5, the external user information IF1 of the external system 200 includes, as an example, the user ID (ID1) assigned by the external system 200, name "AAA", date of birth "Y / M / D", gender "male", and contact information "XXX". The external user information IF1 may include other information, but it does not include the facial image which is authentication information for the management server 1.

[0040] When requesting the registration of new user information IF3 for registered user AAA using external user information IF1, the operator of sensor terminal 3 takes a picture of registered user AAA with the camera 35 of sensor terminal 3 (step S13).

[0041] The control unit 31 of the sensor terminal 3 causes the camera 35 to perform a shooting operation according to the operation in step S13 (step S14), and transmits the captured image to the management server 1 according to the program 321 (step S15). When the camera 35 is pointed at the face of registered user AAA by the operator of the sensor terminal 3, the face image of registered user AAA is transmitted in step S15.

[0042] When a facial image of registered user AAA is input from the sensor terminal 3, the control unit 11 of the management server 1 generates provisional user information IF2 for registered user AAA, including the input facial image of registered user AAA, according to program 121, and registers it with the management server 1 (step S16). Details of the registration process in step S16 will be described later.

[0043] Provisional User Information IF2 is user information generated using the facial image of registered user AAA that was entered. Therefore, as shown in Figure 5, Provisional User Information IF2 does not include name, date of birth, gender, or contact information, but includes the facial image of registered user AAA that was entered. Provisional User Information IF2 also includes the user ID (ID3) assigned to the user during registration in the management system 100.

[0044] When requesting the registration of new user information IF3 for registered user AAA using external user information IF1, the operator of instruction device 7 requests management server 1 to merge the external user information IF1 of registered user AAA with the provisional user information IF12 of registered user AAA that has been registered (step S17).

[0045] In step S20, the management server 1 displays the registered user information on the instruction device 7 according to the operator's operation on the instruction device 7. In step S22, the instruction device 7 accepts the selection of a provisional user information IF2, which includes the facial image of registered user AAA, to be added to the external user information IF1, on the display screen.

[0046] Figure 6 is a schematic diagram of the display screen 201 of the provisional user information IF2 registered in the management server 1. The screen 201 includes the display of the user ID 21, the display of the name, date of birth, gender, and contact information 22, and the display of the face image 23. This allows the operator of the instruction device 7 to confirm the provisional user information IF2 registered in the management server 1. Since the provisional user information IF2 registered in step S16 only contains the user ID and the face image of registered user AAA, the display 21 of the display screen 201 shows ID 3, the display 23 shows the face image of registered user AAA, and the display 22 is left blank.

[0047] Screen 201 also has a button 25 that instructs the user to edit the provisional user information IF2. When button 25 is pressed, the instruction device 7 displays an editing screen and accepts input of editing content from the operator of the instruction device 7. The instruction device 7 sends the editing request along with the received editing content to the management server 1. The management server 1 updates the provisional user information IF2 according to the request from the instruction device 7. This allows the operator of the instruction device 7 to add or change information such as name, date of birth, and gender to the registered provisional user information IF2.

[0048] Screen 201 also has a button 26 for instructing the deletion of the provisional user information IF2. When button 26 is operated, the instruction device 7 requests the management server 1 to delete the provisional user information IF2. The management server 1 deletes the provisional user information IF2 from the data storage unit 13 in accordance with the deletion request.

[0049] Screen 201 further includes a button 24 that instructs the addition of a face image to the external user information IF1. Button 24 is an example of an icon that accepts an instruction to merge the displayed provisional user information IF2 with the external user information IF1. The operator of the instruction device 7 confirms on screen 201 that the display 23 is the face image of registered user AAA, and then operates button 24 to instruct the merging with the external user information IF1.

[0050] Preferably, when the management server 1 displays the provisional user information IF2 on the instruction device 7, it displays the button 24 for user information that includes at least a face image among the user information stored in the data storage unit 13. As an alternative, the management server 1 may display the button 24 for all user information stored in the data storage unit 13, or for user information that does not include at least one of the following: name, date of birth, gender, and contact information, or for user information that does not include any of the following: name, date of birth, gender, and contact information, but includes only a face image.

[0051] In step S17 of Figure 4, when button 24 is operated, the instruction device 7 requests the management server 1 to merge the provisional user information IF2 of registered user AAA, which is displayed on the instruction device 7, with the external user information IF1 entered in step S11 (step S18). The management server 1 may also allow only specific operators to request the merge, for example, by authenticating whether the operator of the instruction device 7 is a specific operator that has been predetermined. As an example, the management server 1 accepts authentication information for operation from the operator of the instruction device 7 on an authentication screen (not shown), and if authentication is successful, displays a screen 201 on the instruction device 7 that shows the registered provisional user information IF2.

[0052] When the instruction device 7 requests that the provisional user information IF2 and the external user information IF1 be merged, the control unit 11 of the management server 1 may further accept the selection of the external user information IF1 to be merged with the provisional user information IF2. The control unit 11 executes a candidate display process (step S19) according to the program 121. The candidate display process in step S19 is a process to display candidate user information, which is a candidate for the external user information IF1 to be merged with the provisional user information IF2, on the instruction device 7.

[0053] In step S19, the control unit 11 determines that the external user information IF1 input from the external system 200 in step S11 is candidate user information. If multiple external user information entries are input from the external system 200 in step S11, the control unit 11 determines the multiple external user information entries as candidate user information in step S19. Preferably, the control unit 11 determines the display priority of the multiple candidate user information entries so that the candidate user information entries that are more likely to have a face image added by the operator of the instruction device 7 are given a higher priority. As an example, the control unit 11 determines the priority based on the information contained in each candidate user information entry. For example, the control unit 11 may give a higher priority to candidate user information entries that have been input from the external system 200 more recently, or to candidate user information entries with a newer assigned user ID. This is because it is considered that there is a high possibility that a face image will be added to user information entries that have been newly input from the external system 200.

[0054] When the control unit 11 executes the candidate display process (step S19), it outputs a control signal to the instruction device 7 to display the candidate user information, instructing it to display (step S20). As a result, the determined candidate user information is displayed on the instruction device 7 (step S21). If there are multiple determined candidate user information items, in step S20 the control unit 11 outputs a control signal to the instruction device 7 to display the multiple candidate user information items based on the determined priority order. As a result, in step S21, the multiple candidate user information items are displayed on the instruction device 7 based on the priority order.

[0055] Figure 7 is a schematic diagram of display screen 202 for instructing the external user information IF1 to be merged with provisional user information IF2. Screen 202 is displayed (pop-up display) superimposed on screen 201 in Figure 6, for example. Screen 202 includes the display of candidate user information. If multiple candidate user information is extracted, screen 202 includes a list display of the multiple candidate user information, as shown in Figure 7, for example.

[0056] Preferably, the candidate user information is displayed on screen 202 using the information contained in the candidate user information. In the example in Figure 7, the candidate user information is displayed using the name and age contained in the candidate user information. The operator of the instruction device 7 selects, from among the multiple candidate user information on screen 202, the external user information IF1 of registered user AAA of the external system 200, which includes the name "AAA", as the external user information to be merged with the provisional user information IF2 which includes the facial image of registered user AAA (step S22). Therefore, as shown in Figure 7, when the candidate user information is displayed using the name, it is easier for the operator of the instruction device 7 to select the external user information IF1 of registered user AAA.

[0057] As another example, if the candidate user information includes biometric information or estimated biometric information, the screen 202 may also display the biometric information or estimated biometric information. This makes it easier for the operator of the instruction device 7 to identify the candidate user information. It also prevents erroneous operation by the operator of the instruction device 7.

[0058] The instruction device 7 notifies the management server 1 of the selected external user information IF1 (step S23). Alternatively, before notifying the management server 1 of the selected external user information IF1 in step S23, the instruction device 7 may accept confirmation from the operator of the instruction device 7. This prevents erroneous operation.

[0059] The management server 1 performs the candidate display process (step S19), which makes it easier for the operator of the instruction device 7 to select the external user information IF1 to merge with the provisional user information IF2. Furthermore, even if there is a limit to the number of user information that can be displayed on screen 202 due to, for example, the size of the display, candidate user information that is most likely to be selected is displayed first, making the selection process easier for the operator of the instruction device 7.

[0060] In the candidate display process in step S19, the management server 1 may determine the user information stored in the data storage unit 13 as candidate user information, in addition to the external user information input from the external system 200. For example, if a new user information IF3 is registered with an incorrect face image added to the external user information IF1, or if the operator of the instruction device 7 wants to add a new face image to already registered user information that includes a face image, the operator may want to add (overwrite) a face image to the already registered user information that includes a face image.

[0061] In this case, during the candidate display process in step S19, the control unit 11 may prioritize user information stored in the data storage unit 13 based on the date the face image was added. This is because it is considered highly likely that a user will re-add a face image immediately after mistakenly adding one. In addition to displaying the information according to priority, the control unit 11 may also display a button to clear the priority display, such as "Show all user information."

[0062] When the control unit 11 of the management server 1 receives the selection result of the external user information IF1 to be merged with the provisional user information IF2 from the instruction device 7, it executes a merge process (step S24) according to the program 121. The merge process in step S24 refers to the process of merging the external user information IF1 and the provisional user information IF2. After the provisional user information IF2 is merged with the external user information IF1, it is automatically deleted from the data storage unit 13. Alternatively, after the provisional user information IF2 is merged with the external user information IF1, a delete instruction button (not shown) may be displayed on the provisional user information IF2, allowing the operator of the instruction device 7 to choose whether or not to delete the provisional user information IF2.

[0063] Figure 8 is a flowchart illustrating an example of the operation of the management server 1 in the management system 100 shown in Figure 4. When the control unit 11 of the management server 1 receives external user information IF1 of registered user AAA from the external server 200 (YES in step S101), it assigns a new user ID (ID2) to registered user AAA in the management system 100 according to program 121 and stores it in the data storage unit 13 as new user information IF3 (step S103). In step S103, the control unit 11, as an example, places the information from each field of the external user information IF1 into the corresponding fields of the user information in the management system 100. As shown in Figure 5, the new user information IF3 stored in the data storage unit 13 in step S103 does not include the face image of registered user AAA.

[0064] Furthermore, the control unit 11 stores in the data storage unit 13 the correspondence between the user ID (ID2) of the management system 100 assigned to registered user AAA in step S103 and the user ID (ID1) of registered user AAA in the external system 200, which is read from the external user information IF1 (step S105). As a result, as shown in Figure 5, the correspondence between the user ID (ID2) of the management system 100 and the user ID (ID1) of the external system 200 for registered user AAA is stored in the data storage unit 13. Steps S103 and S105 are the registration process of the external user information IF1, which is performed after step S11 in Figure 4.

[0065] When the control unit 11 receives a request from the sensor terminal 3 or the like to register provisional user information IF2, which includes the face image of registered user AAA (YES in step S107), the control unit 11 generates provisional user information IF2, which includes the input face image of registered user AAA, according to the program 121 (step S109). In step S109, the control unit 11 places the face image of registered user AAA in the face image field of the user information in the management system 100, as an example. The control unit 11 assigns a new user ID (ID3) in the management system 100 to the provisional user information IF2 (step S111) and stores it in the data storage unit 13 (step S113). Steps S109 to S113 are the registration process shown in step S16 of Figure 4.

[0066] When the control unit 11 receives a request from the instruction device 7 to register new user information IF3 using the external user information IF1 of registered user AAA of the external system 200 (YES in step S115), it reads the face image of registered user AAA from the provisional user information IF2 selected in step S22 of Figure 4 according to the program 121 and adds it to the new user information IF3 generated from the external user information IF1 of registered user AAA (step S117). Step S117 is the merge process of step S24 in Figure 4.

[0067] As a result of the processing in step S117, the new user information IF3 is a merge of the external user information IF1 of registered user AAA and the facial image of registered user AAA from the provisional user information IF2. Therefore, as shown in Figure 5, as a result of the processing in step S117, the new user information IF3 includes the name "AAA", date of birth "Y / M / D", gender "Male", and contact information "XXX" that were included in the external user information IF1 of registered user AAA, as well as the facial image of registered user AAA that was included in the provisional user information IF2.

[0068] Preferably, the control unit 11 outputs a control signal to the instruction device 7 to display the result of the merge process, and instructs it to display the result. This allows the operator who instructed the addition of the face image using the instruction device 7 to confirm that the face image of registered user AAA has been added to the external user information IF1 of registered user AAA, and that a new user information IF3 has been registered.

[0069] As a comparative example, consider the case where external user information, which does not include a facial image for authentication, is registered to a server that identifies registered users using facial images. In this case, the operator of the instruction device 7 must use the instruction device 7 to request the server to add a facial image for authentication to the external user information in the external system 200 before registering the external user information. If the operator of the instruction device 7 does not have the authority to operate on the external user information in the external system 200, a facial image cannot be added to the external user information. In this case, the operation of the operator of the instruction device 7 will not register the external user information to the server. Furthermore, the operation of the operator of the instruction device 7 is cumbersome because it is necessary to perform the operation of adding a facial image for authentication to the external user information in the external system 200.

[0070] In contrast, in the management server 1 according to this embodiment, when a request is made to register new user information using external user information, the new user information IF3, which includes the face image of registered user AAA, is registered using the external user information IF1 by merging the external user information IF1, which does not include the face image of registered user AAA for authentication, with the provisional user information IF2, which includes the face image of registered user AAA as instructed by the operator of the instruction device 7. Therefore, when registering registered user AAA of the external system 200 to the management server 1, the operator of the instruction device 7 does not need to re-enter information contained in the external user information IF1, such as the name "AAA" and the date of birth "Y year M month D day," into the management server 1. This makes it easier to register registered user AAA of the external system 200 to the management server 1.

[0071] (Examples of using correspondence relationships) The management server 1 can manage data by using the correspondence between the user ID assigned to the new user information IF3 stored in the data storage unit 13 and the user ID assigned to the external user information by the external system 200. For example, the management server 1 receives the user ID (ID1) of registered user AAA, from the external system 200, from which biometric information is to be obtained.

[0072] The management server 1 reads the user ID (ID2) in the management system 100 corresponding to the user ID (ID1) from the correspondence relationships stored in the data storage unit 13. The management server 1 transmits the estimated result of the biometric information stored in the data storage unit 13 as data for registered user AAA, whose user ID (ID2), to the external system 200.

[0073] As a result, the operator of the external system 200 can obtain the estimated biometric information of registered user AAA from the management server 1 by entering the user ID (ID1) in the external system 200, without having to identify and enter the user ID (ID2) in the management server 1. In other words, the management server 1 can provide the external system 200 with the estimated biometric information of registered users in the external system 200, which is included in the user information registered in the management system 100 installed at facilities such as hospitals, nursing homes, and sports gyms, in response to requests from the external system 200, without requiring the operator of the external system 200 to perform complicated operations.

[0074] (Examples of how user information is used) Furthermore, registered users of the external system 200, such as users of facilities like hospitals, nursing homes, and sports gyms, can register data related to them on the management server 1 of the management system 100 installed at the facility. For example, when registered user AAA is sensed by the sensor terminal 3, the biometric information obtained from the sensing result is identified as data of registered user AAA using the facial image captured by the sensor terminal 3, and is stored in the data storage unit 13 as data of registered user AAA.

[0075] (Variation 1) The management server 1 may accept the selection of a provisional user information IF2, which includes the face image of registered user AAA, from among the user information stored in the data storage unit 13, to be merged with the external user information IF1. As an example, in the candidate display processing (step S19), the control unit 11 of the management server 1 further determines a candidate for the provisional user information IF2 to be merged with the external user information IF1 (hereinafter also referred to as a face image candidate) from among the user information stored in the data storage unit 13.

[0076] In the candidate display process according to the first modification, the control unit 11, as an example, determines user information stored in the data storage unit 13 that includes only a face image and a user ID, and does not include other information such as a name, as a face image candidate. As another example, the control unit 11 may determine all user information that includes a face image as a face image candidate, or it may determine user information that does not include at least one piece of information other than a face image and a user ID as a face image candidate.

[0077] Figure 9 is a schematic diagram of the screen displayed on the indicator device 7 in step S21 of Figure 4 in the first modified example. The screen 203 in Figure 9 has a display area 204 for face image candidates and a display area 205 for the candidate user information described above. If multiple face image candidates are determined, multiple face image candidates are displayed in the display area 204. In the example of Figure 9, multiple face image candidates 23A to 23D are displayed for selection.

[0078] In the first modified example, the instruction device 7 accepts the selection of one of the multiple face image candidates 23A to 23D in the display area 204 on the screen 203, and accepts the selection of an external user information IF1 to which the face image of the selected face image candidate will be added. If multiple face image candidates are determined, the operation of selecting a face image candidate and the operation of selecting an external user information IF1 to which the face image of the selected face image candidate will be added are repeated each time a face image candidate is selected.

[0079] Another possible method of operation is a so-called drag-and-drop operation, in which one face image candidate is selected in display area 204 and then moved to the external user information IF1 to be selected in display area 205. In step S23, the instruction device 7 notifies the management server 1 of the selected face image candidate and the external user information IF1 to which the face image will be added.

[0080] Note that screen 203 is an example of a screen displayed on the instruction device 7 in step S21. As another example, instead of the display area 205, a screen displaying candidates for external user information IF1 to which face images will be added may be superimposed on screen 203 (pop-up display), similar to screen 202 in Figure 7. Also, the display area 205 may be updated each time a face image candidate is selected in the display area 204. In this case, each time a face image candidate is selected, the control unit 11 determines a candidate for external user information IF1 to merge the selected face image candidates and displays it in the display area 205.

[0081] Preferably, the display area 204 displays the face image candidates in a way that is easily recognizable to the operator of the instruction device 7. In the example in Figure 9, face images are displayed as options for face image candidates. In this example, the operator of the instruction device 7 can select an option represented by the face image of the user to be registered. As another example, if the face image candidates include estimated results of names, ages, or biometric information, at least one of these may also be displayed as an option for face image candidates.

[0082] In this way, in the first modified example, the operator of the instruction device 7 can select the external user information to merge for each of the multiple face image candidates with a single screen operation. For example, when registering multiple registered users of the external system 200 to the management server 1 at once, or when introducing the management system 100 to a facility where the external system 200 is already built, it becomes possible to register multiple user information at once, reducing the operational burden on the operator of the instruction device 7.

[0083] (Modification 2) In the candidate display process in step S19 of Figure 4, when determining priority, the management server 1 may also use the information from the selected provisional user information IF2. For example, the control unit 11 analyzes the facial image of registered user AAA included in the selected provisional user information IF2 to estimate that the user is male and in their 30s. Based on the gender, date of birth, etc., included in each of the multiple candidate user information, the control unit 11 can give higher priority to user information that matches the gender obtained from the facial image of the selected provisional user information IF2 and is closer to the age range.

[0084] Furthermore, if biometric information of registered user AAA is estimated from the facial image of registered user AAA included in the selected provisional user information IF2, and if each of the multiple candidate user information also includes biometric information or the result of biometric information estimation, the control unit 11 can give a higher priority to candidate user information whose biometric information or the result of biometric information estimation is closer to the biometric information estimated from the facial image of registered user AAA in provisional user information IF2.

[0085] Furthermore, the operator of the instruction device 7 may specify the information used to determine the display priority. In that case, in the candidate display process of step S19, the control unit 11 uses the information specified by the operator of the instruction device 7 to determine the display priority of the candidate user information.

[0086] As a result, when multiple candidate user information entries are determined, the candidate user information that the operator of the instruction device 7 is more likely to select is displayed at the top of screen 202. In this example, the external user information IF1 of registered user AAA from the external system 200 is displayed at the top. This makes it easier for the operator of the instruction device 7 to select the external user information IF1 to merge with the provisional user information IF2.

[0087] (Variation 3) The correspondence information may be stored in the external system 200 instead of, or in addition to, the data storage unit 13 of the management server 1. Alternatively, the correspondence information may be stored in a device other than the management server 1 and the external system 200. In this case, when the external system 200 reads the biometric information estimation results from the management server 1, it reads the stored correspondence information and reads the user ID (ID2) on the management server 1 that corresponds to the user ID (ID1) of the registered user of the external system 200 from the correspondence information. The external system 200 uses the user ID (ID2) to request the biometric information estimation results from the management server 1. This allows the external system 200 to easily access the management server 1 using the user ID of the user information generated on the management server 1.

[0088] (Modification 4) External user information IF1 may include a facial image. In this case, the above process may overwrite the facial image included in external user information IF1 with the authentication facial image included in provisional user information IF2, or an authentication facial image included in provisional user information IF2 may be added to external user information IF1.

[0089] If the face image included in the external user information IF1 does not meet the requirements for a face image used for authentication by the management server 1, such as resolution, size, or subject orientation, or if it is unsuitable for authentication due to being old, the above process will be performed so that a new user information IF3 containing a face image suitable for user identification is registered on the management server 1 using the external user information IF1.

[0090] Furthermore, if the external user information IF1 includes a facial image, the management server 1 may use that facial image when determining candidate user information in the candidate display process (step S19). For example, the control unit 11 may determine external user information that includes a facial image highly similar to the facial image included in the selected provisional user information IF2 as candidate user information, or it may determine external user information that includes a facial image highly similar to the facial image included in the selected provisional user information IF2 and has a resolution below a predetermined level as candidate user information. As a result, user information that the operator of the instruction device 7 is likely to select as the external user information IF1 to merge with the provisional user information IF2 is displayed on screen 202 as candidate user information. Therefore, it becomes easier for the operator of the instruction device 7 to make a selection.

[0091] (Variation 5) Before registering the provisional user information IF2, the management server 1 may accept input of external user information IF1 from the external system 200, which does not include the facial image of registered user AAA, and provisionally store it in the data storage unit 13. In this case, even if the sensor terminal 3 inputs the facial image of registered user AAA, the management server 1 will not identify it as registered user AAA using the external user information IF1 stored in the data storage unit 13. As a result, the biometric information of registered user AAA obtained from the sensor terminal 3 will not be added to the external user information IF1 of registered user AAA.

[0092] In this case, the management server 1 determines that the external user information IF1, which does not contain a face image and is stored in the data storage unit 13, is a candidate user information for the external user information to be merged with the provisional user information IF2. As a result, the external user information IF1, which does not contain a face image and is stored in the data storage unit 13, is merged with the face image contained in the provisional user information IF2 to become the new user information IF3.

[0093] Furthermore, regarding the external user information IF1, which does not include facial images and is stored in the data storage unit 13, the management server 1 may accept input and editing of information from the instruction device 7. For example, the operator may use the instruction device 7 to write the biometric information of registered user AAA obtained from the sensor terminal 3 to the external user information IF1 of registered user AAA of the external system 200, which is stored in the data storage unit 13. As a result, the external user information IF1, which does not include facial images and is stored in the data storage unit 13, is used in the management system 100 to register information about registered users of the external system 200.

[0094] <3. Addendum> The present invention is not limited to the above embodiments, and various modifications are possible. For example, in the above embodiments, the management system 100 is an example of a system that estimates the user's biometric information from the user's sensing results and manages that data. The data managed by the management system 100 is not limited to the estimated biometric information results, but can be any data that identifies and manages the user using authentication information obtained from the user. [Explanation of Symbols]

[0095] 1: Management server, 2: User ID (identification information assigned to user information), 3: Sensor terminal (terminal device), 7: Indicator, 13: Data storage unit, 35: Camera, 121: Program, 200: External system, IF1: External user information, IF2: Provisional user information, IF3: New user information

Claims

1. A management server that manages users' biometric information, It comprises a control unit and a data storage unit, The control unit, At least some users obtain external user information, which does not include authentication information for identifying the user, from an external system that is common to users whose biometric information is managed by the management server. Authentication information to identify the user is obtained from the user's body, provisional user information including the authentication information is generated and stored in the data storage unit. By merging the aforementioned external user information and the aforementioned provisional user information, new user information including authentication information is generated and stored in the data storage unit. When biometric information is obtained from a user, the user is identified by comparing the authentication information obtained from the user's body with the authentication information included in the provisional user information, and the biometric information is stored in the data storage unit as data of the identified user. Management server.

2. The data storage unit stores the correspondence between the identification information assigned to the new user information and the identification information assigned to the external user information in the external system, which is read from the external user information. The management server according to claim 1.

3. The external user information is stored in the data storage unit. User information from the external user information stored in the data storage unit that does not include at least authentication information is determined to be candidate user information for the external user information to be merged with the provisional user information. The management server according to claim 1.

4. If there are multiple candidate user information items that have been determined, the priority order of the multiple candidate user information items is determined using the information contained in each of the multiple candidate user information items and the information contained in the provisional user information. The instruction device, which accepts the selection of external user information to be merged with the provisional user information, displays the selected plurality of candidate user information based on the priority order. The management server according to claim 3.

5. The provisional user information stored in the data storage unit is displayed on the instruction device along with an icon indicating that the instruction is to merge it with the external user information. The management server according to claim 1.

6. The aforementioned authentication information is the user's facial image. The management server according to claim 1.

7. A computer program that makes a computer function as a management server for managing users' biometric information, At least some users obtain external user information, which does not include authentication information for identifying the user, from an external system that is common to users whose biometric information is managed by the management server. Authentication information to identify the user is obtained from the user's body, provisional user information including the said authentication information is generated and stored in the data storage unit. By merging the aforementioned external user information and the aforementioned provisional user information, new user information including authentication information is generated and stored in the data storage unit. When biometric information is obtained from a user, the computer is instructed to identify the user by comparing the authentication information obtained from the user's body with the authentication information included in the provisional user information, and to store the biometric information in the data storage unit as data of the identified user. Computer program.

Images