Server and measurement terminal

Abstract

To provide a server or the like capable of easily registering a face image in the server and improving accuracy of face authentication.SOLUTION: The server (200) receives the measured value of the vital information of the subject from the measuring terminal (100) and manages the vital information. When a server receives a face photograph for identification as a subject face image which is a face image of a subject from a measuring terminal 1 (S2), the server performs face identification, and registers the received face photograph for identification as a new registrant face image when the face photograph is not registered (S3). The server subsequently records the measured values of the subject received from the measuring terminal 1 in association with the new registrant face image (S5). The server notifies the measuring terminal of information indicating that the user has been registered as a new registrant (S6).SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to a measurement terminal and a server that measure vital information of a subject in a non-contact manner. [Background technology]

[0002] Conventionally, there is known a measurement system that uses a measurement terminal to measure vital information of a person to be measured in a non-contact manner, transmits the measurement results to a server, and manages the results in association with the person as data of the person to be measured (for example, Patent Document 1).

[0003] In such measurement systems, the subject's facial image is also used to identify them. In this case, when the subject is measured for the first time, a facial registration process must be performed in addition to the measurement process. In the facial registration process, a measurement terminal is used to photograph the subject's face from the front, and the facial image is registered on the server (face registration process). After that, the server is accessed from a PC or other device, and information such as the subject's name and age that will be linked to the registered facial image is entered (management console process). [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Publication No. 2020-046962 Summary of the Invention [Problem to be solved by the invention]

[0005] As mentioned above, conventional techniques require a time-consuming face registration process before and after the measurement process. Furthermore, there is also the problem that the accuracy of face recognition decreases if there is a difference between the environment in which the face image is taken during the face registration process and the environment in which the actual daily measurement is performed.

[0006] One aspect of the present invention has been made in consideration of the above-mentioned problems, and aims to provide a server and a measurement terminal that allow facial images to be easily registered in the server and also improve the accuracy of facial authentication. [Means for solving the problem]

[0007] In order to solve the above problem, a server according to one aspect of the present invention is a server that receives measurement values ​​of vital information of a person being measured from a measurement terminal and manages the vital information, and is equipped with: a registration processing unit that, when a face image of the person being measured is received from the measurement terminal, performs facial authentication with a face image of a previously registered person that is a face image of a person already registered, and if it is determined that the person is not registered, registers the face image of the person being measured as a face image of a newly registered person; a measurement value recording processing unit that records the measurement values ​​of the person being measured received from the measurement terminal following the face image of the person being measured registered in the face image of the newly registered person, in correspondence with the face image of the newly registered person; and a notification processing unit that notifies the measurement terminal of information indicating that the person has been registered as a newly registered person.

[0008] In order to solve the above problems, a measurement terminal according to one embodiment of the present invention is a measurement terminal that photographs the person being measured, measures the vital information of the person being measured based on the photographed image, and transmits the measurement value to a server, and is equipped with a measurement processing unit that photographs the person being measured and transmits a facial recognition image that is an image of the person's face and the measurement value to the server, and a display processing unit that, when information indicating that the person has been registered as a new registrant is received from the server, displays a screen indicating that the person has been registered under the name of new registrant. [Effects of the Invention]

[0009] According to one aspect of the present invention, it is possible to provide a server and a communication terminal that can easily register a face image in a server and also improve the accuracy of face authentication. [Brief explanation of the drawings]

[0010] [Figure 1]1 is a block diagram showing an example of the configuration of a measurement system including a server and a measurement terminal according to a first embodiment of the present invention. [Figure 2] 3 is an example of a sequence diagram in the measurement system according to the first embodiment. [Figure 3] FIG. 10 is a diagram showing an example of a screen displayed on the measurement terminal, indicating that a user has been registered under the name of a new registrant. [Figure 4] 10 is an example of a sequence diagram in the measurement system according to the second embodiment. [Figure 5] 10 is an example of a sequence diagram in a first modified example of the measurement system according to the second embodiment. [Figure 6] 10 is an example of a sequence diagram in Modification 2 of the measurement system according to Embodiment 2. [Figure 7] 10 is an example of a sequence diagram in a third modification of the measurement system according to the second embodiment. [Figure 8] 10 is an example of a sequence diagram in a measurement system according to a third embodiment. [Figure 9] 10 is an example of a sequence diagram in a modified example of the measurement system according to the third embodiment. [Figure 10] 10 is an example of a sequence diagram in a measurement system according to a fourth embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0011] [Embodiment 1] Hereinafter, one embodiment of the present invention will be described in detail.

[0012] (1. Measurement System) The configuration of a measurement system 1 including a server 200 and a measurement terminal 100 according to the first embodiment will be described with reference to Fig. 1. Fig. 1 is a block diagram showing an example of the configuration of the measurement system 1 including the server 200 and the measurement terminal 100 according to the first embodiment.

[0013] 1, the measurement system 1 includes a measurement terminal 100 and a server 200, and the measurement terminal 100 and the server 200 can be connected via a network N. The server 200 can also be connected to an input terminal 400 via the network N.

[0014] The measurement terminal 100 is a device used to measure vital information of a person being measured based on a captured image of the person being measured (i.e., without contact). The vital information includes the person's temperature, blood vessel information, heart rate information, etc. The measurement terminal 100 may also be capable of acquiring biological information other than vital information. The measurement terminal 100 may be any device that has the function of acquiring and displaying images, and may be, for example, a smartphone or tablet terminal.

[0015] The measurement worker measures the vital information of the person being measured by photographing the person being measured while checking an image including the person being measured displayed on the screen using the measurement terminal 100. Such a measurement terminal 100 is used, for example, in a care setting when a caregiver (measurement worker) measures the vital information of a person being cared for (person being measured).

[0016] The functions of the measurement terminal 100 described below can also be realized by installing a program on a general-purpose computer. The program can also be called application software. In the following, an example will be described in which the measurement terminal 100 is a smartphone on which the program is installed.

[0017] The server 200 is a device that receives measurement values ​​of vital information of the subject from the measurement terminal 100 and manages the vital information. The measurement terminal 100 and the server 200 constitute a measurement system.

[0018] The input terminal 400 is a personal computer or the like on the user side of the measurement terminal 100, and is a device used for management console operations to register the subject's information, such as the subject's name, in the server 200, as will be described later.

[0019] The vital information measured by the measurement terminal 100 is managed in the server 200 in association with the facial photograph of the registered subject. Subject information such as the subject's name entered from the input terminal 400 during management console operations is also registered in association with the subject's facial photograph.

[0020] In the measurement system 1, simply by performing a measurement operation, a facial photograph can be registered in the server 200. Specifically, the facial photograph for authentication sent from the measurement terminal 100 is registered as the facial photograph of the person being measured.

[0021] Therefore, it is easy to register the face photo (face image of the person being measured) in the server. Moreover, since the face photo of the person being measured at the time of actual measurement is registered, it is possible to register a face photo that is closer to the state at the time of measurement than a face photo taken during the face registration process, which also improves the accuracy of face authentication.

[0022] (2. Measurement terminal) As shown in FIG. 1, the measurement terminal 100 includes a control unit 10, an image capturing device 2, an input device 3, a display device 4, a communication device 5, a storage device 6, a temperature measuring device 7, a microphone 8, a speaker 9, and the like.

[0023] The control unit 10 controls each unit of the measurement terminal 100 in an integrated manner. The photographing device 2 photographs images. The input device 3 accepts input operations to the measurement terminal 100. The display device 4 displays images photographed by the photographing device 2. The input device 3 may be a touch panel, in which case the input device 3 is configured integrally with the display device 4. The communication device 5 transmits and receives various data between an external communication device and the control unit 10. The memory device 6 stores various data handled by the measurement terminal 100. The temperature measurement device 7 detects the temperature of the person being measured without contact.

[0024] <Control unit of measurement terminal> The control unit 10 includes a measurement processing unit 12 and a display processing unit 13 .

[0025] The measurement processing unit 12 photographs the person being measured and transmits an authentication facial photograph (image for facial authentication), which is a facial image of the person being measured, and the measurement value to the server 200. The measurement processing unit 12 accepts the measurement worker taking an authentication facial photograph of the person being measured on the measurement operation screen D1 (see FIG. 2). The measurement processing unit 12 accepts the measurement worker taking an image of the person being measured for measuring their vital information on the measurement operation screen D1. The temperature of the person being measured is measured based on the photographed image taken by the temperature measuring device 7.

[0026] The display processing unit 13 controls the display device 4 to display various screens for operation input on the display device 4 and accepts operation input from the measurement operator. During the measurement operation, the display processing unit 13 displays a measurement operation screen D1 that accepts the measurement operation.

[0027] The display processing unit 13 displays a measurement result screen when it receives a measurement result based on the measurement value from the server 200. The measurement result screen contains information such as a facial photograph for authentication, the name and ID of the person being measured, the current measurement value, and the judgment result comparing the current measurement value with past measurement values.

[0028] When the display processing unit 13 receives information indicating that the user has been registered as a new registrant from the server 200, the display processing unit 13 displays a screen indicating that the user has been registered under the name of new registrant. In this embodiment, when the display processing unit 13 receives measurement results based on measurement values ​​from the server 200, the display processing unit 13 displays a measurement result screen D2 (see FIG. 2) indicating that the user has been registered under the name of new registrant.

[0029] (3. Server) 1, the server 200 includes a control unit 20, a communication device 31, and a storage device 32. The control unit 20 controls each unit of the server 200. The storage device 32 stores various data handled by the server 200. The communication device 31 transmits and receives various data between an external communication device and the control unit 20.

[0030] <Server control section> The control unit 20 includes a registration processing unit 21, a measurement value recording processing unit 22, and a notification processing unit 23. When the registration processing unit 21 receives an authentication face photograph (measurement subject face image), which is a face image of the person being measured, from the measurement terminal 100, it performs face authentication with an already registered person face photograph (already registered person face image), which is a face image of a person who has already been registered. When it is determined that the person is not registered, the registration processing unit 21 registers the authentication face photograph received from the measurement terminal 100 as a new registrant face photograph (new registrant face image).

[0031] The measurement value recording processing unit 22 records the measurement values ​​of the person being measured received from the measurement terminal 100 following the facial photograph for authentication registered in the facial photograph of the new registrant, in association with the facial photograph of the new registrant.

[0032] Furthermore, when the registration processing unit 21 receives information about a new registrant, it registers the received information in association with the face image of the new registrant.

[0033] The notification processing unit 23 notifies the measurement terminal 100 of information indicating that the person has been registered as a new registrant. In this embodiment, the notification processing unit 23 notifies the measurement terminal 100 of the information indicating that the person has been registered as a new registrant, together with the measurement results based on the measurement values ​​recorded in association with the face image of the new registrant.

[0034] (4. Sequence) Fig. 2 is an example of a sequence diagram in the measurement system 1 according to the first embodiment. As shown in Fig. 2, the measurement operator performs a measurement operation using the measurement terminal 100 (S1). Specifically, the measurement operator displays the measurement operation screen D1 and takes a facial photograph of the subject A for authentication. The measurement terminal 100 transmits the taken facial photograph of the subject A for authentication to the server 200 (S2).

[0035] The server 200 performs facial authentication on the authentication facial photograph received from the measurement terminal 100 against stored facial photographs of registered persons, and determines which has the highest degree of match in facial authentication. Since person A is not registered, there is no facial photograph of a registered person that has a high degree of match. Therefore, it is determined that person A is not registered, and the server 200 registers the authentication facial photograph of person A received from the measurement terminal 100 as a facial photograph of a new registrant (S3). As a result, the received authentication facial photograph of person A is registered in the server 200 as a facial photograph of a "new registrant."

[0036] If the person in the face photo for authentication is already registered, a face photo of an already registered person with a high degree of match exists, and the normal measurement processing routine is performed.

[0037] The server 200 receives the measurement values ​​of the vital information from the measurement terminal 100 following the facial photograph for authentication (S4), and records the received measurement values ​​in association with the facial photograph of the registered "new registrant" (S5).

[0038] Thereafter, the server 200 transmits the measurement results based on the received measurement values ​​to the measurement terminal 100 together with information indicating that the terminal has been registered as a new registrant (S6).

[0039] When the measurement terminal 100 receives the measurement result with information indicating that the user has been registered as a new registrant, it displays the measurement result screen D2 with "New Registrant" in the name field (S7: processing of the display processing unit 13). Thereafter, the measurement operator performs management console operations using the input terminal 400, and registers the subject information, such as the name and date of birth of subject A, who has been registered as a "new registrant," in the server 200 (S8). As a result, the information about subject A required for the measurement system 1 is registered in the server 200.

[0040] The measurement terminal 100 may be equipped with a function for accepting management console operations, and S8 may be configured to perform management console operations using the measurement terminal 100. In other words, the display processing unit 13 may display an input screen for inputting information about a new registrant, and the measurement terminal 100 may further include an input information transmission processing unit that transmits the information input on the input screen to the server 200.

[0041] 2, the notification processing unit 23 of the server 200 transmits information indicating that the user has been registered as a new registrant together with the measurement results in S6, but this information may also be notified to the measurement terminal 100 separately from the measurement results. The display processing unit 13 of the measurement terminal 100 may then display a notification screen D3 indicating that the user has been registered under the name "new registrant," as shown in Fig. 3. Fig. 3 is a diagram showing an example of the notification screen D3 displayed on the measurement terminal 100, indicating that the user has been registered under the name "new registrant."

[0042] (5. Description of effects) With the above configuration, face registration is not required, and if the person being measured is unregistered, face registration is performed in the server 200 as part of the measurement process. Even if the person being measured is unregistered, the measurement operation is not wasted and the measurement value is recorded as the measurement value of a newly registered person. Furthermore, since a facial photograph taken in the measurement environment is registered as the facial photograph of the person being measured, there is no difference between the environment in which measurements are taken on a daily basis, and it is possible to prevent a decrease in authentication accuracy due to differences in the shooting environment.

[0043] [Embodiment 2] Another embodiment of the present invention will be described below. For ease of explanation, the same reference numerals will be used to designate components having the same functions as those described in the above embodiment, and the description thereof will not be repeated. For convenience, the description will be made using the block diagram of FIG.

[0044] In this embodiment, when the registration processing unit 21 of the server 200 receives an authentication facial photograph and performs facial authentication during normal measurement operations, it records the facial authentication result (score). If the result of facial authentication of the authentication facial photograph indicates that the subject may be a registered person, but the facial authentication match is too low to determine that the subject is a registered person, the registration processing unit 21 transmits the name of the possible registered person to the measurement terminal 100 and prompts the measurement operator to select whether to register the subject as a new registrant or the person named. Then, when the registration processing unit 21 receives a selection result indicating that the subject is a new registrant from the measurement terminal 100, it registers the authentication facial photograph (the subject's facial photograph) as a facial photograph of a new registrant. Note that, hereinafter, "select" may also be expressed as "confirm" or "inquire."

[0045] When the display processing unit 13 of the measurement terminal 100 receives information including a person's name from the server 200, it displays a selection screen D4 (see FIG. 4) that prompts the user to select whether to register the person as a new registrant or to register the person with the received name. The measurement terminal 100 further includes a selection result transmission processing unit 14 that transmits the selection result received on the selection screen D4 to the server 200.

[0046] Fig. 4 is an example of a sequence diagram in the measurement system 1A according to embodiment 2. The processes of S1, S2, S4, and S5 to S8 in Fig. 4 are the same as S1, S2, S4, and S5 to S8 in Fig. 2. The differences are that S10 is performed instead of S3, and that if the face recognition score is low, the processes of S11 to S16 are performed between S4 and S5.

[0047] 4, the server 200 determines that the person is Mr. B, who is already registered, as a result of facial authentication, but if the facial authentication score is lower than usual, it suspends registration of the authentication facial photograph (S10). If the score is low, the server 200 also temporarily suspends registration of the measurement value received in S4 (S11). The server 200 transmits information requesting confirmation, including the name of Mr. B, who is already registered, to the measurement terminal 100, and has the measurement operator confirm (S12).

[0048] When the measurement terminal 100 receives a result including the name of a registered person with a low score, it displays a selection screen D4 with the content, such as "Do you want to register as a new registrant, or do you want to register as the measurement value of person B?" (S13). A message indicating that the facial recognition score is lower than a predetermined value may be displayed on the selection screen D4.

[0049] When the measurement operator operates the selection screen D4 to select "New registrant" (S14), the measurement terminal 100 transmits the selection result to the server 200 (S15). When the server 200 receives the selection result of new registrant from the measurement terminal 100, it registers the authentication facial photograph of subject A received from the measurement terminal 100 as the facial photograph of the new registrant (S16). Then, proceeding to S5, the server 200 records the measurement values ​​of the vital information received from the measurement terminal 100 in S4 in association with the facial photograph of the "new registrant" (S5).

[0050] Although not shown in the figure, if the person being measured in the authentication facial photograph is a registered person, Mr. B, and the measurement operator operates selection screen D4 and selects "It is Mr. B," the system will proceed to the normal measurement processing routine, identifying the person being measured as a registered person, Mr. B.

[0051] (Description of effects) According to the above configuration, if there is a registered person who resembles an unregistered person A, the measurement values ​​of person A can be prevented from being mistakenly registered as the measurement values ​​of this registered person, and person A can be registered as a new registrant.

[0052] Here, the registration processing unit 21 of the server 200 is configured to record the result of face authentication (score value) in a normal measurement operation, but this is not limiting. For example, it is possible to set two thresholds for face authentication, and if the higher threshold is exceeded, determine that the person in the face photo for authentication is already registered and proceed to the normal measurement processing routine, but if only the lower threshold is exceeded, perform S10.

[0053] (Variation 1) Furthermore, if the registration processing unit 21 of the server 200 finds that the subject may be a registered person after performing face authentication on the face photo for authentication, but the degree of match in the face authentication is too low to determine that the subject is a registered person, the registration processing unit 21 may register the subject as a face image of a new registrant.

[0054] Fig. 5 is an example of a sequence diagram in Modification 1 of the measurement system 1A according to Embodiment 2. The processes of S1, S2, S4, and S5 to S8 in Fig. 5 are the same as S1, S2, S4, and S5 to S8 in Fig. 2. The difference is that S20 is performed instead of S3.

[0055] In S20, the server 200 determines that the person is Mr. B, who is already registered, as a result of face authentication, but if the face authentication score is lower than usual, it registers the received face photo for authentication as a face photo of a new registrant.

[0056] Even with the above configuration, if there is a registered person who resembles unregistered person A, it is possible to register person A as a new registrant while preventing the measurement values ​​of person A from being mistakenly registered as the measurement values ​​of this registered person. In this case, if the facial recognition score is low, person A is directly registered as a new registrant and selection screen D4 etc. is not displayed, making the measurement operation easier.

[0057] (Variations 2 and 3) Furthermore, if the result of facial authentication of the face photo for authentication indicates that the person being measured may be a registered person, but the degree of match in the facial authentication is too low to determine that the person is a registered person, the registration processing unit 21 of the server 200 may compare the measurement values ​​of the person being measured received from the measurement terminal following the face image of the person being measured with past measurement values ​​of possible registered people, and may take the following action depending on the result.

[0058] 1) When the measured value is out of a predetermined range, the registration processing unit 21 transmits the name of a possibly registered person to the measurement terminal and allows the subject to select whether to register the subject as a new registrant or the person named. When the registration processing unit 21 receives a selection result indicating a new registrant from the measurement terminal, it registers the face image of the subject as a face image of a new registrant (Variation 2).

[0059] 2) Alternatively, if the measurement values ​​deviate beyond a predetermined range, registration processing unit 21 registers the face image of the subject as a face image of a newly registered person (Modification 3).

[0060] Fig. 6 is an example of a sequence diagram in Modification 2 of the measurement system 1A according to Embodiment 2. The processes of S1, S2, S4 to S8, and S10 to S16 in Fig. 6 are the same as S1, S2, S4 to S8, and S10 to S16 in Fig. 4. The difference is that S21 is performed between S11 and S12.

[0061] In S21, the server 200 compares the past measurement values ​​of registered person B, who has a low score as a result of face authentication, with the measurement values ​​reserved in S11. If the measurement values ​​deviate beyond a predetermined range, the server 200 proceeds to S12 and sends a query to the measurement terminal 100 requesting confirmation, including the name of registered person B, to have the measurement operator confirm.

[0062] According to the above configuration, the frequency with which the measurement operator is required to check suitability can be reduced compared to the measurement system 1 of the second embodiment.

[0063] Fig. 7 is an example of a sequence diagram in Modification 3 of the measurement system 1A according to Embodiment 2. The processes of S1, S2, S4 to S8, S10, S11, and S21 in Fig. 7 are the same as S1, S2, S4 to S8, S10, S11, and S21 in Fig. 6. The difference is that the processes of S12 to S15 are not performed between S21 and S16.

[0064] In other words, if the comparison in S21 shows that the measurement values ​​are outside the specified range, the server 200 proceeds to S16 without asking the measurement operator for confirmation, and registers the authentication facial photograph of subject A received from the measurement terminal 100 as the facial photograph of a new registrant.

[0065] According to the above configuration, as with the first modification of the measurement system 1 of the second embodiment, if the facial recognition score is low, the subject is directly registered as a new registrant, which simplifies the measurement operation. Moreover, by comparing the measurement values, the accuracy of classifying the subject in the authentication face photograph as either a new registrant or an already registered person can be improved compared to the first modification.

[0066] Although not shown, in the measurement system 1A of the third modification, a facial photograph of registered person B is sent as a facial photograph for authentication in S2, and if the facial authentication result in S10 determines that the score is low, registration of the measurement value is temporarily suspended in S11. After that, S21 is performed to compare the measurement value, and if there is no difference with the previous or past measurement value, the measurement value is registered as the measurement value of registered person B.

[0067] [Embodiment 3] Another embodiment of the present invention will be described below. For ease of explanation, the same reference numerals will be used to designate components having the same functions as those described in the above embodiment, and the description thereof will not be repeated. For convenience, the description will be made using the block diagram of FIG.

[0068] In this embodiment, when the facial authentication result indicates that the subject is already registered, the registration processing unit 21 compares the subject's facial image and the measurement values ​​received from the measurement terminal 100 with the past measurement values ​​of the previously registered subject. If the measurement values ​​deviate by more than a predetermined range, the registration processing unit 21 transmits the name of the previously registered subject to the measurement terminal, prompting the operator of the measurement terminal to select whether to register the subject as a new registrant or the person named. When the registration processing unit 21 receives a selection result indicating a new registrant from the measurement terminal, it registers the subject's facial image as a newly registrant's facial image.

[0069] Figure 8 is an example of a sequence diagram in the measurement system 1B according to embodiment 3. The processes of S1, S2, S4, S5 to S8, and S12 to S16 in Figure 8 are the same as the processes of S1, S2, S4, S5 to S8, and S12 to S16 in Figure 6. The differences are that S22 is performed instead of S10, and that S21 is performed after S4, and if there is a difference from the previous or previous measurement value, S11 is performed and the process proceeds to S12.

[0070] As shown in Fig. 8, as a result of face authentication, the server 200 identifies the received authentication facial photo as that of registered person B (S22). Next, the server 200 compares the measurement value received in S4 with the previous or past measurement value of registered person B identified in S22 (S21). If the measurement value in S21 deviates beyond a predetermined range, the server 200 temporarily suspends registration of the measurement value received in S4 as the value of registered person B identified in S22 (S11) and proceeds to S12. In other words, a query requesting confirmation, including the name of registered person B, is sent to the measurement terminal 100, and the measurement operator is asked to confirm.

[0071] With the above configuration, even if twins or other individuals are identified as the same person through facial recognition, if their vital information differs, the measurement operator can select whether to register the individual, and if the individual is not registered, the individual can be registered as a new individual. This makes it possible to take advantage of the advantage of being performed together with the measurement operation and handle twins or other individuals who are identified as the same person through facial recognition. It also prevents the measurement values ​​of one twin from being mistakenly recorded for the other twin.

[0072] Although not shown, in the measurement system 1B of embodiment 3, when the selection result indicating that the person being measured is registered person B is sent in S14 and S15, the measurement value that was reserved in S11 proceeds to the normal measurement processing routine in which the person being measured is identified as registered person B.

[0073] (Variation) Furthermore, if the registration processing unit 21 of the server 200 determines that the person is a registered person as a result of facial authentication of the face photo for authentication, it compares the measurement values ​​of the person being measured received from the measurement terminal following the face image of the person being measured with the past measurement values ​​of the person being determined to be a registered person, and if the measurement values ​​deviate by more than a predetermined range, it registers the face image of the person being measured as the face image of a new registrant.

[0074] Figure 9 is an example of a sequence diagram in a modified example of measurement system 1B according to embodiment 3. The processes of S1, S2, S4, S5 to S8, S22, S21, and S11 in Figure 9 are the same as the processes of S1, S2, S4, S5 to S8, S22, S21, and S11 in Figure 8. The difference is that after the measurement value is reserved in S11, S16 is skipped and S12 to S15 are not performed.

[0075] With the above configuration, even if twins, for example, are identified as the same person through facial recognition, if their vital information differs, they can be registered as new registrants. This makes it possible to take advantage of the advantage of being performed together with the measurement operation and handle twins, for example, who are identified as the same person through facial recognition. It also prevents the measurement values ​​of one twin from being mistakenly recorded for the other twin.

[0076] [Embodiment 4] Another embodiment of the present invention will be described below. For ease of explanation, the same reference numerals will be used to designate components having the same functions as those described in the above embodiment, and the description thereof will not be repeated. For convenience, the description will be made using the block diagram of FIG.

[0077] In this embodiment, when the result of face authentication of the authentication face photo indicates that the subject may be a registered person, but the degree of match is too low to determine that the subject is a registered person, the registration processing unit 21 of the server 200 acquires obtainable information related to the measurement operation that measured the measurement value, which can be acquired from the measurement terminal 100. When the obtainable information is different from normal, the registration processing unit 21 transmits the name of a possible registered person to the measurement terminal 100 and allows the operator to select whether to register the subject as a new registrant or the person with that name. When the registration processing unit 21 receives a selection result indicating a new registrant from the measurement terminal 100, it registers the subject's facial image as a newly registrant's facial image.

[0078] The obtainable information includes, for example, staff information about the measurement operator operating the measurement terminal 100. Staff are usually assigned to each floor or room and do not change for each measurement. Therefore, if the staff information is different, there is a possibility that multiple births may have occurred.

[0079] Figure 10 is an example of a sequence diagram in the measurement system 1C according to embodiment 4. The processes of S1, S2, S4, S5 to S8, S12 to S16, and S22 in Figure 10 are the same as the processes of S1, S2, S4, S5 to S8, S12 to S16, and S22 in Figure 8. The difference is that following S4, staff information is acquired from the measurement terminal 100 as available information (S23), and instead of S21, the staff information is compared (S24), and if the staff information is different from the previous or past staff information, S11 is performed and the process proceeds to S12.

[0080] As shown in Figure 10, the server 200 identifies the received authentication facial photo as being that of a registered person, Mr. B, as a result of facial authentication (S22). The server 200 acquires staff information from the measurement terminal 100 (S23) and compares it with the previous or past staff information (S24). If the server 200 determines in S24 that the person is not a regular staff member, it temporarily suspends registration of the measurement value received in S4 as the value of registered person Mr. B identified in S22 (S11) and proceeds to S12. In other words, it sends a query to the measurement terminal 100 requesting confirmation, including the name of registered person Mr. B, to have the measurement operator confirm.

[0081] With the above configuration, even if multiple births (multiple fetuses) such as twins are determined to be the same person by facial recognition, if the obtainable information such as staff information is different, the person being measured can be registered as a new registrant by having the measurement operator check. In other words, if one pair of twins is already registered and the other is not, a new person being measured can be registered as a new registrant by making an inquiry focusing on the difference in the staff performing the measurement.

[0082] This makes it possible to take advantage of the advantage of being performed together with the measurement operation, and to handle twins who are identified as the same person using face recognition. It also prevents the measurement values ​​of one twin from being mistakenly recorded for the other twin.

[0083] In addition to staff information, the obtainable information includes, for example, terminal information for identifying the measurement terminal 100, location information of the measurement terminal 100, and information on the time when the measurement operation was performed.

[0084] The measurement terminal 100 is also usually determined for each floor or room and does not change every time a measurement is performed. Therefore, if the terminal information for identifying the measurement terminal 100 is different, there is a possibility of multiple births, just like the staff information.

[0085] Similarly, the location information of the measurement terminal 100 (location information during measurement operation) is usually near the location of the bed where the subject is present or lying down, and does not change every time a measurement is performed. Therefore, if the location information of the measurement terminal 100 is different, there is a possibility of multiple births, just like the staff information.

[0086] Similarly, the information on the time when the measurement was performed is usually fixed, such as a specific time in the morning, and does not change each time a measurement is performed. Therefore, if the information on the measurement time is different, there is a possibility of multiple births, just like the staff information.

[0087] Although multiple children are given as an example of subjects who are determined to be the same person in face recognition, false resemblances of other people are also acceptable. Also, as in the second embodiment, the score of the face recognition result may be recorded, and if the score is low, obtainable information may be acquired, compared with the previous / past information, and if there is a difference, an inquiry may be made.

[0088] [Software implementation example] The functions of the measurement terminal 100 and the server 200 (hereinafter referred to as "devices") can be realized by a program that causes a computer to function as the device, and a program that causes a computer to function as each control unit of the device.

[0089] In this case, the device includes a computer having at least one control device (e.g., a processor) and at least one storage device (e.g., a memory) as hardware for executing the program. The control device and storage device execute the program, thereby realizing the functions described in each of the above embodiments.

[0090] The program may be non-transitory and may be recorded on one or more computer-readable recording media. The recording media may or may not be included in the device. In the latter case, the program may be supplied to the device via any wired or wireless transmission medium.

[0091] Furthermore, some or all of the functions of the control blocks can be realized by logic circuits. For example, an integrated circuit in which a logic circuit that functions as each of the control blocks is formed is also included in the scope of the present invention. In addition, the functions of the control blocks can also be realized by, for example, a quantum computer.

[0092] Furthermore, each process described in each of the above embodiments may be executed by AI (Artificial Intelligence). In this case, the AI ​​may run on the control device or on another device (for example, an edge computer or a cloud server).

[0093] 〔summary〕 The server according to aspect 1 of the present disclosure is a server that receives measurement values ​​of vital information of a person being measured from a measurement terminal and manages the vital information, and is equipped with: a registration processing unit that, when a face image of the person being measured is received from the measurement terminal, performs facial authentication with a face image of a previously registered person that is a face image of a person already registered, and if it is determined that the person being measured is not registered, registers the face image of the person being measured as a face image of a newly registered person; a measurement value recording processing unit that records the measurement values ​​of the person being measured received from the measurement terminal following the face image of the person being measured registered in the face image of the newly registered person, in association with the face image of the newly registered person; and a notification processing unit that notifies the measurement terminal of information indicating that the person has been registered as a newly registered person.

[0094] In the server according to aspect 2 of the present disclosure, in aspect 1 above, the notification processing unit may notify information indicating that the person has been registered as a new registrant, along with measurement results based on the measurement values ​​recorded in correspondence with the face image of the new registrant.

[0095] In the server according to aspect 3 of the present disclosure, in the above aspect 1 or 2, when the subject may be a registered person but the degree of match in facial recognition is too low to determine that the subject is a registered person, the registration processing unit may send the name of the possible registered person to the measurement terminal and allow the subject to select whether to register the subject as a new registrant or the person with that name, and when the registration processing unit receives a selection result from the measurement terminal that the subject is a new registrant, it may register the subject's facial image as a new registrant's facial image.

[0096] In the server according to aspect 4 of the present disclosure, in aspect 1 or 2 above, the registration processing unit may register the subject as a face image of a new registrant if the subject may be a person already registered but the degree of match in facial recognition is too low to determine that the subject is already registered.

[0097] In the server according to aspect 5 of the present disclosure, in aspect 1 or 2 above, if the person being measured may be a registered person but the degree of match in facial recognition is too low to determine that the person is a registered person, the registration processing unit compares the measurement values ​​of the person being measured received from the measurement terminal following the face image of the person being measured with past measurement values ​​of the possible registered person, and if the measurement values ​​differ by more than a predetermined range, sends the name of the possible registered person to the measurement terminal to allow the person being measured to select whether to register the person as a new registrant or the person with that name, and if the registration processing unit receives a selection result from the measurement terminal that the person is a new registrant, it may register the face image of the person being measured as the face image of the new registrant.

[0098] In the server according to aspect 6 of the present disclosure, in aspect 1 or 2 above, if the person being measured may be a registered person but the degree of match in facial recognition is too low to determine that the person is a registered person, the registration processing unit may compare the measurement values ​​of the person being measured received from the measurement terminal following the face image of the person being measured with past measurement values ​​of the possibly registered person, and if the measurement values ​​differ by more than a predetermined range, may register the face image of the person being measured as a face image of a newly registered person.

[0099] In the server according to aspect 7 of the present disclosure, in any of aspects 1 to 6 above, when the facial authentication results in a determination that the person is already registered, the registration processing unit compares the measurement values ​​of the person being measured received from the measurement terminal following the facial image of the person being measured with past measurement values ​​of the person being determined to be already registered, and if the measurement values ​​differ by more than a predetermined range, sends the name of the already registered person to the measurement terminal to allow the operator of the measurement terminal to select whether to register the person as a new registrant or the person with that name, and when the registration processing unit receives a selection result from the measurement terminal that the person is already registered, it may register the facial image of the person being measured as the facial image of the new registrant.

[0100] In any of the above aspects 1 to 6, if the facial authentication results in a determination that the person is already registered, the server according to aspect 8 of the present disclosure may compare the facial image of the person being measured with the measurement values ​​of the person being measured received from the measurement terminal subsequently with the past measurement values ​​of the person already registered, and if the measurement values ​​differ by more than a predetermined range, may register the facial image of the person being measured as the facial image of a newly registered person.

[0101] In the server according to aspect 9 of the present disclosure, in aspect 1 or 2 above, if the person being measured may be a registered person but the degree of match in facial recognition is too low to determine that the person is a registered person, or if the person is determined to be a registered person, the registration processing unit acquires obtainable information regarding the measurement operation that measured the measurement value, which can be obtained from the measurement terminal, and if the obtainable information is different from normal, sends the name of the possible registered person or the name of the registered person to the measurement terminal, allowing the operator of the measurement terminal to select whether to register the person as a new registrant or the person with the name, and if the registration processing unit receives a selection result from the measurement terminal that the person is a new registrant, it may register the face image of the person being measured as the face image of the new registrant.

[0102] In the server of aspect 10 of the present disclosure, in aspect 9 above, the obtainable information may be staff information of the measurement worker operating the measurement terminal, terminal information for identifying the measurement terminal, location information of the measurement terminal, or information on the time when the measurement operation was performed.

[0103] In a server according to aspect 11 of the present disclosure, in any of aspects 1 to 10 above, the registration processing unit may, when receiving information about the new registrant, register the received information in association with a facial image of the new registrant.

[0104] A measurement terminal according to aspect 12 of the present disclosure is a measurement terminal that photographs a person being measured, measures the vital information of the person being measured based on the photographed image, and transmits the measurement value to a server, and is equipped with a measurement processing unit that photographs the person being measured and transmits a facial recognition image, which is an image of the person's face, and the measurement value to the server, and a display processing unit that, when information indicating that the person has been registered as a new registrant is received from the server, displays a screen indicating that the person has been registered under the name of new registrant.

[0105] In a measurement terminal according to aspect 13 of the present disclosure, in aspect 12 above, the display processing unit may, when receiving from the server a measurement result based on the measurement value including information indicating that the user has been registered as a new registrant, display a measurement result screen indicating that the user has been registered under the name of a new registrant.

[0106] A measurement terminal according to aspect 14 of the present disclosure may be such that, in aspect 12 or 13 above, the display processing unit, when receiving information including a person's name from the server, displays a selection screen allowing the user to choose whether to register the person as a new registrant or as the person with the name, and the measurement terminal may further include a selection result transmission processing unit that transmits the selection result received on the selection screen to the server.

[0107] A measurement terminal according to aspect 15 of the present disclosure may be such that, in aspects 12, 13, or 14 above, the display processing unit displays an input screen for allowing the user to input information about the new registrant, and the measurement terminal further includes an input information transmission processing unit that transmits the information entered on the input screen to the server.

[0108] The measurement terminal according to each aspect of the present invention may be realized by a computer. In this case, the control program of the measurement terminal that realizes the measurement terminal on a computer by causing the computer to operate as each part (software element) of the measurement terminal, and the computer-readable recording medium on which it is recorded, also fall within the scope of the present invention.

[0109] The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope of the claims. Embodiments obtained by appropriately combining the technical means disclosed in different embodiments are also included in the technical scope of the present invention. Furthermore, new technical features can be formed by combining the technical means disclosed in each embodiment. [Explanation of symbols]

[0110] 1, 1A, 1B, 1C measurement system 10, 20 Control unit 12 Measurement processing section 13 Display processing section 14 Selection result transmission processing unit 21 Registration processing section 22 Measurement value recording processing section 23 Notification processing section 100 measurement terminals 200 servers D1 Measurement operation screen D2 Measurement result screen D4 Selection Screen

Claims

1. A server that receives measurement values ​​of vital information of a subject from a measurement terminal and manages the vital information, a registration processing unit that, when receiving a face image of the subject from the measurement terminal, performs face authentication with a face image of a previously registered person, and if it is determined that the face image is not registered, registers the face image of the subject as a face image of a newly registered person; a measurement value recording processing unit that records the measurement values ​​of the subject received from the measurement terminal subsequent to the face image of the subject registered in the face image of the newly registrant in association with the face image of the newly registrant; a notification processing unit that notifies the measurement terminal of information indicating that the measurement terminal has been registered as a new registrant.

2. The server according to claim 1 , wherein the notification processing unit notifies information indicating that the user has been registered as a new registrant, together with a measurement result based on the measurement value recorded in association with the face image of the new registrant.

3. When the subject may be a registered person but the degree of coincidence of the facial recognition is too low to determine the subject as a registered person, the registration processing unit transmits the name of the possibly registered person to the measurement terminal and allows the subject to select whether to register the subject as a new registrant or the person with the name, The server according to claim 1 , wherein the registration processing unit registers the face image of the subject as a face image of a new registrant when a selection result indicating that the subject is a new registrant is received from the measurement terminal.

4. The server according to claim 1 , wherein the registration processing unit registers the face image of the subject as a new registrant face image when the subject may be a registered person but the degree of match in face authentication is too low to determine that the subject is a registered person.

5. When the subject may be a registered person, but the degree of match in face authentication is too low to determine that the subject is a registered person, the registration processing unit compares the measurement values ​​of the subject received from the measurement terminal following the face image of the subject with past measurement values ​​of the possible registered person, and when the measurement values ​​deviate by more than a predetermined range, transmits the name of the possible registered person to the measurement terminal and allows the subject to select whether to register the subject as a new registrant or the person with that name, The server according to claim 1 , wherein the registration processing unit registers the face image of the subject as a face image of a new registrant when a selection result indicating that the subject is a new registrant is received from the measurement terminal.

6. The server of claim 1, wherein, when the subject may be a registered person but the degree of match in facial authentication is too low to determine that the subject is a registered person, the registration processing unit compares the measurement values ​​of the subject received from the measurement terminal following the subject's facial image with past measurement values ​​of the possibly registered person, and if the measurement values ​​differ by more than a predetermined range, registers the subject's facial image as a newly registered person's facial image.

7. When the result of the face authentication indicates that the person is a registered person, the registration processing unit compares the measurement values ​​of the person being measured received from the measurement terminal following the face image of the person being measured with past measurement values ​​of the person being determined to be a registered person, and when the measurement values ​​deviate by more than a predetermined range, transmits the name of the registered person to the measurement terminal and allows the operator of the measurement terminal to select whether to register the person as a new registrant or the person with that name, The server according to claim 1 , wherein the registration processing unit registers the face image of the subject as a face image of a new registrant when a selection result indicating that the subject is a new registrant is received from the measurement terminal.

8. The server of claim 1, wherein, if the facial authentication results in a determination that the subject is a registered person, the measurement values ​​of the subject received from the measurement terminal following the facial image of the subject are compared with past measurement values ​​of the determined registered person, and if the measurement values ​​differ by more than a predetermined range, the facial image of the subject is registered as the facial image of a newly registered person.

9. The registration processing unit acquires obtainable information relating to the measurement operation that measured the measurement value, which can be acquired from the measurement terminal, when the degree of match of the face authentication is too low to determine that the person being measured is a registered person, or when the person being measured is determined to be a registered person, and when the obtainable information is different from normal, transmits the name of the possible registered person or the name of a registered person to the measurement terminal, and allows the operator of the measurement terminal to select whether to register the person as a new registrant or the person with the name, The server according to claim 1 , wherein the registration processing unit registers the face image of the subject as a face image of a new registrant when a selection result indicating that the subject is a new registrant is received from the measurement terminal.

10. The server of claim 9, wherein the obtainable information is staff information of the measurement worker operating the measurement terminal, terminal information for identifying the measurement terminal, location information of the measurement terminal, or information on the time when the measurement operation was performed.

11. The server according to claim 1 , wherein, when the registration processing unit receives information about the new registrant, the registration processing unit registers the received information in association with a face image of the new registrant.

12. A measurement terminal that photographs a person to be measured, measures vital information of the person to be measured based on the photographed image, and transmits the measurement value to a server, a measurement processing unit that photographs the subject and transmits a facial image for face authentication, which is a facial image of the subject, and the measurement values ​​to the server; The measurement terminal is equipped with a display processing unit that, when receiving information from the server including information indicating that the measurement terminal has been registered as a new registrant, displays a screen indicating that the measurement terminal has been registered under the name of new registrant.

13. The measurement terminal of claim 12, wherein the display processing unit displays a measurement result screen indicating that the user has been registered under the name of a new registrant when the display processing unit receives from the server measurement results based on the measurement values ​​including information indicating that the user has been registered as a new registrant.

14. when receiving information including a person's name from the server, the display processing unit displays a selection screen for allowing the user to select whether to register the person as a new registrant or the person with the name; The measurement terminal according to claim 12 or 13, further comprising a selection result transmission processing unit that transmits the selection result accepted on the selection screen to the server.

15. the display processing unit displays an input screen for inputting information about the new registrant; The measurement terminal according to claim 12 or 13, further comprising an input information transmission processing unit that transmits information input on the input screen to the server.

Images