Image information provision system, face authentication system, information processing method, and program

Abstract

To provide an image information provision system capable of supporting the registration of a face image used for face authentication processing.SOLUTION: An image information provision system 40 is provided with an information processing unit 42 for acquiring first image information of an image showing a human face, which is the first image information used for face authentication processing, and a communication unit 41 for transmitting, to each of one or more face authentication systems 20, second image information corresponding to the face authentication system 20 based on the acquired first image information.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an image information providing system, a face authentication system, an information processing method, and a program. [Background technology]

[0002] Various devices and systems using face recognition technology have been proposed. As a device using face recognition technology, Patent Document 1 discloses an entrance / exit management device that can permit first-time visitors to use a managed area. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] International Publication No. 2018-229873 Summary of the Invention [Problem to be solved by the invention]

[0004] The present invention provides an image information providing system and the like that can assist in the registration of face images used in face authentication processing. [Means for solving the problem]

[0005] An image information providing system according to one embodiment of the present invention includes an information processing unit that acquires first image information used in facial recognition processing, the first image information being an image showing a human face, and a communication unit that transmits second image information corresponding to each of one or more facial recognition systems to each of the facial recognition systems based on the acquired first image information.

[0006] A facial recognition system according to one embodiment of the present invention is a facial recognition system that communicates with the image information providing system, and includes an imaging unit that captures an original image of the first image information, a communication unit that transmits the first image information to the image information providing system, and an authentication processing unit that performs facial recognition processing based on an image of a human face captured by the imaging unit and registration information based on the first image information.

[0007] A facial authentication system according to one embodiment of the present invention is a facial authentication system that communicates with the image information providing system, and includes a communication unit that receives the second image information, an imaging unit that captures an image showing a human face, and an authentication processing unit that performs facial authentication processing based on the captured image and registration information based on the received second image information.

[0008] An information processing method according to one embodiment of the present invention is an information processing method executed by a computer system, and includes the steps of acquiring first image information used in facial recognition processing, the first image information being an image showing a human face, and transmitting second image information corresponding to one or more facial recognition systems to each of the facial recognition systems based on the acquired first image information.

[0009] An information processing method according to one embodiment of the present invention is an information processing method executed by a computer system communicating with the image information providing system, and includes the steps of capturing an original image of the first image information, transmitting the first image information to the image information providing system, capturing an image containing a human face, and performing facial recognition processing based on the captured image and registration information based on the first image information.

[0010] An information processing method according to one embodiment of the present invention is an information processing method executed by a computer system communicating with the image information providing system, and includes the steps of receiving the second image information, capturing an image containing a human face, and performing facial recognition processing based on the captured image and registration information based on the received second image information.

[0011] A program according to one aspect of the present invention is a program for causing the computer system to execute the information processing method. Effect of the Invention

[0012] The image information providing system etc. of the present invention can assist in the registration of face images to be used in face authentication processing. [Brief description of the drawings]

[0013] [Figure 1] FIG. 1 is a block diagram illustrating a functional configuration of a linkage system according to an embodiment. [Diagram 2] FIG. 2 is a diagram showing an overview of a face authentication system according to an embodiment. [Diagram 3] FIG. 3 is a sequence diagram of a first operation example of the linkage system according to the embodiment. [Figure 4] FIG. 4 is a sequence diagram of a second operation example of the linkage system according to the embodiment. [Diagram 5] FIG. 5 is a sequence diagram of a third operation example of the linkage system according to the embodiment. [Figure 6] FIG. 6 is a sequence diagram of a fourth operation example of the linkage system according to the embodiment. [Figure 7] FIG. 7 is a sequence diagram of a fifth operation example of the linkage system according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0014] Hereinafter, the embodiments will be described in detail with reference to the drawings. Note that the embodiments described below are all comprehensive or specific examples. The numerical values, shapes, materials, components, component arrangement and connection forms, steps, and order of steps shown in the following embodiments are merely examples and are not intended to limit the present invention. In addition, among the components in the following embodiments, components that are not described in the independent claims will be described as optional components.

[0015] In addition, each drawing is a schematic diagram and is not necessarily a precise illustration. In each drawing, the same reference numerals are used for substantially the same configurations, and duplicated explanations may be omitted or simplified.

[0016] (Embodiment) [composition] The configuration of the linkage system according to the embodiment will be described below: Fig. 1 is a block diagram showing the functional configuration of the linkage system according to the embodiment.

[0017] The linked system 10 shown in FIG. 1 includes a plurality of face authentication systems 20, an information terminal 30, and an image information providing system 40.

[0018] The face authentication system 20 is a system that performs face authentication by comparing the features of a person's face obtained from an image captured by an imaging unit 21 with registration information (registered features) stored in a storage unit 24. FIG. 2 is a diagram showing an outline of the face authentication system 20. The face authentication system 20 performs face authentication processing to manage, for example, the entry and exit of people into and out of a facility, or the entry and exit of people into and out of a certain area (such as a floor) within the facility. Specifically, the management of the entry and exit into a facility or area means managing the locking and unlocking of a door 50 for entering and exiting the facility or area. The face authentication system 20 includes an imaging unit 21, a communication unit 22, an authentication processing unit 23, and a storage unit 24.

[0019] The imaging unit 21 is a camera that captures (obtains) an image showing a person's face. The imaging unit 21 is realized by an image sensor, a lens, etc. The imaging unit 21 can also capture an image for generating registration information.

[0020] The communication unit 22 is a communication circuit for the face authentication system 20 to communicate with the image information providing system 40. The communication unit 22 may be a communication circuit for performing communication through a wide area communication network such as the Internet, or may be a communication circuit for performing communication through a local communication network. The communication unit 22 may perform wired communication or wireless communication. The communication standard of the communication performed by the communication unit 22 is not particularly limited.

[0021] The authentication processing unit 23 performs face authentication processing by comparing the features of a person's face obtained from the image captured by the imaging unit 21 with registration information (registered features) stored in the storage unit 24. The authentication processing unit 23 is realized by, for example, a microcomputer, but may also be realized by a processor. The function of the authentication processing unit 23 is realized by, for example, the microcomputer or processor constituting the authentication processing unit 23 executing a computer program stored in the storage unit 24.

[0022] The storage unit 24 is a storage device that stores registration information, a computer program executed by the authentication processing unit 23, etc. The storage unit 24 is realized by, for example, a semiconductor memory.

[0023] The information terminal 30 is a portable information terminal such as a personal computer, a tablet terminal, or a smartphone, and is used for capturing images for generating registration information in the linkage system 10. The information terminal 30 includes an imaging unit 31, a communication unit 32, an information processing unit 33, and a storage unit 34.

[0024] The imaging unit 31 is a camera that captures (obtains) an image. The imaging unit 31 is realized by an image sensor, a lens, and the like.

[0025] The communication unit 32 is a communication circuit for the information terminal 30 to communicate with the image information providing system 40. The communication unit 32 is a communication circuit for communicating with the image information providing system 40 through a wide area communication network such as the Internet. The communication unit 32 may perform, for example, wireless communication or wired communication. The communication standard of the communication performed by the communication unit 32 is not particularly limited.

[0026] The information processing unit 33 performs processing such as transmitting image information of an image captured by the imaging unit 21 to the image information providing system 40. The information processing unit 33 is realized, for example, by a microcomputer, but may also be realized by a processor. The functions of the information processing unit 33 are realized, for example, by the microcomputer or processor constituting the information processing unit 33 executing a computer program stored in the storage unit 34.

[0027] The storage unit 34 is a storage device that stores computer programs and the like executed by the information processing unit 33. The storage unit 34 is realized by, for example, a semiconductor memory.

[0028] The image information providing system 40 provides image information for generating registration information to one or more face authentication systems 20. The image information providing system 40 is realized by, for example, one or more server devices. The image information providing system 40 includes a communication unit 41, an information processing unit 42, and a storage unit 43.

[0029] The communication unit 41 is a communication circuit for the image information providing system 40 to communicate with the multiple face authentication systems 20 and the information terminal 30. The communication unit 41 may be a communication circuit for performing communication through a wide area communication network such as the Internet, or may be a communication circuit for performing communication through a local communication network. The communication unit 41 may perform wired communication or wireless communication. The communication standard of the communication performed by the communication unit 41 is not particularly limited.

[0030] The information processing unit 42 performs processing such as providing image information for generating registration information to the multiple face authentication systems 20. The information processing unit 42 is realized, for example, by a microcomputer, but may also be realized by a processor. The functions of the information processing unit 42 are realized, for example, by the microcomputer or processor constituting the information processing unit 42 executing a computer program stored in the storage unit 43.

[0031] The storage unit 43 is a storage device that stores computer programs and the like executed by the information processing unit 42. The storage unit 43 is realized by, for example, a semiconductor memory.

[0032] Although the image information providing system 40 is a system that does not perform face recognition processing, it will be described as a system that performs face recognition processing (similar to the face recognition system 20) in the following Operation Example 3. In this case, the image information providing system 40 includes an imaging unit 44, and the information processing unit 42 can perform face recognition processing.

[0033] [Example 1] In the operation example 1, an example will be described in which the image information providing system 40 provides image information of an image captured by the information terminal 30 to a plurality of face authentication systems 20.

[0034] There are cases where multiple face authentication systems 20 are installed in the same facility. Specifically, when the facility is an office building, one face authentication system 20 is a system for managing entrance and exit to the office building, and another face authentication system 20 is a system for managing entrance and exit of tenants in the office building to an area (private area) used by the tenants. In other words, there are cases where one face authentication system 20 is installed at the entrance (common area) of the office building, and another face authentication system 20 is installed in the private area of ​​the tenants.

[0035] In such a case, generally, the employee of the tenant needs to register a face image (store registration information) in one face authentication system 20, and also register the face image in other face authentication systems 20. In other words, there is a problem that the procedure for registering a face image is complicated. More specifically, a face image means a feature amount obtained from a face image.

[0036] Therefore, in the operation example 1, the image information providing system 40 simplifies the registration procedure of the face image by providing image information of an image showing the user's face to the multiple face authentication systems 20. Fig. 3 is a sequence diagram of the operation example 1 of the linked system 10. Note that in the following embodiment, the multiple face authentication systems 20 may be divided into a face authentication system 20a and a face authentication system 20b.

[0037] First, the user captures an image showing the user's own face using the information terminal 30. In other words, the imaging unit 31 of the information terminal 30 captures an image showing the user's own face (S11). The information processing unit 33 transmits first image information of the captured image (actual data of the image) to the image information providing system 40 using the communication unit 32 (S12).

[0038] The communication unit 41 of the image information providing system 40 receives the first image information. The information processing unit 42 acquires the received first image information and stores the acquired first image information in the storage unit 43 (S13). The information processing unit 42 also generates (acquires) second image information A by performing information processing A (in other words, pre-processing) including processing for cutting out a face image from the acquired first image information (S14). The information processing unit 42 may store the generated second image information A in the storage unit 43 as necessary.

[0039] The information processing unit 42 issues common identification information (identification number) (S15), and transmits a registration request including the second image information A generated in step S14 and the common identification information issued in step S15 to the face authentication system 20a using the communication unit 41 (S16). In other words, the communication unit 41 transmits the second image information A and the common identification information to the face authentication system 20a. The information processing unit 42 may store the generated common identification information in the storage unit 43 as necessary. For example, the common identification information is stored in the storage unit 43 in association with the first image information.

[0040] The communication unit 22 of the face authentication system 20a receives the registration request (the second image information A and the common identification information). The authentication processing unit 23 extracts the feature amount A of the user's face from the second image information A, associates the extracted feature amount A with the common identification information, and stores it as registration information in the storage unit 24 (S17). Note that the above-mentioned information processing A is, for example, information processing suitable for the face authentication system 20a to extract the feature amount A.

[0041] When the storage of the registration information is completed, the authentication processing unit 23 transmits a completion notification using the communication unit 22 (S18). The communication unit 41 of the image information providing system 40 receives the completion notification.

[0042] Furthermore, the information processing unit 42 generates (acquires) second image information B by performing information processing B (in other words, preprocessing) including processing for cutting out a face image from the first image information acquired in step S13 (S19). The information processing unit 42 transmits a registration request including the generated second image information B and the common identification information issued in step S15 to the face authentication system 20b using the communication unit 41 (S20). In other words, the communication unit 41 transmits the second image information B and the common identification information to the face authentication system 20b. The information processing unit 42 may store the generated second image information B in the storage unit 43 as necessary.

[0043] The communication unit 22 of the face authentication system 20b receives the registration request (second image information B and common identification information). The authentication processing unit 23 extracts the feature amount B of the user's face from the second image information B, associates the extracted feature amount B with the common identification information, and stores it as registration information in the storage unit 24 (S21). Note that the feature amount B is different from the feature amount A, and the above-mentioned information processing B is, for example, information processing suitable for the face authentication system 20b to extract the feature amount B. The feature amount B may be the same as the feature amount A, and in this case, the information processing B may be the same processing as the information processing A.

[0044] When the authentication processing unit 23 completes storing the registration information, it transmits a completion notification using the communication unit 22 (S22). The communication unit 41 of the image information providing system 40 receives the completion notification.

[0045] When the information processing unit 42 receives completion notifications from all the face authentication systems 20 that transmitted the second image information (in the operation example 1, the face authentication systems 20a and 20b), the information processing unit 42 uses the communication unit 41 to transmit a registration success notification to the information terminal 30 (S23). In other words, the communication unit 41 transmits the registration success notification to the information terminal 30. Note that the communication unit 41 may transmit the registration success notification to all the face authentication systems 20 that transmitted the second image information instead of or in addition to the information terminal 30.

[0046] Furthermore, the information processing unit 42 deletes the first image information stored in the storage unit 43 in step S13 from the storage unit 43 (S24). Note that the first image information does not need to be deleted in preparation for a case where a face authentication system 20 is added later.

[0047] As described above, in operation example 1, the image information providing system 40 acquires from the information terminal 30 first image information used in facial recognition processing, which is first image information of an image showing the face of a user (person), and transmits second image information corresponding to each of the multiple facial recognition systems 20 to the facial recognition systems 20 based on the acquired first image information.

[0048] This makes it possible to register facial images to multiple facial recognition systems 20 (in other words, store registration information or register features) using a single image (first image information), thereby enabling the image information providing system 40 to simplify the facial image registration procedure.

[0049] In addition, the image information providing system 40 transmits to each of the face authentication systems 20 common identification information for associating the second image information transmitted to each of the face authentication systems 20.

[0050] Such common identification information makes it possible to identify that the feature amount A and the feature amount B are features of the same user. In addition, when the common identification information is associated with the first image information, it can be said that the common identification information is information for associating the second image information transmitted to each of the multiple face authentication systems 20 with the first image information.

[0051] Furthermore, the feature amount registered by the face authentication system 20 as the registration information may differ for each face authentication system 20. Here, the content of information processing A suitable for the face authentication system 20a to extract feature amount A and the content of information processing B suitable for the face authentication system 20b to extract feature amount B are set in advance in the image information providing system 40, and the image information providing system 40 provides the face authentication system 20 with second image information in which the information processing A or the information processing B is applied to the first image information. In this way, the image information providing system 40 can provide each of the face authentication systems 20 with the second image information in a form (format) that makes it easy for each of the multiple face authentication systems 20 to extract feature amounts.

[0052] [Example 2] In the second operation example, an example will be described in which the image information providing system 40 provides image information of an image captured by the face authentication system 20a to the face authentication system 20b. FIG.

[0053] First, the user captures an image showing the user's own face using the face authentication system 20a. In other words, the imaging unit 21 of the face authentication system 20a captures an image showing the user's own face (S31).

[0054] The authentication processing unit 23 acquires first image information of the captured image and stores the acquired first image information in the storage unit 24 (S32). The authentication processing unit 23 also generates (acquires) second image information A by performing information processing A (in other words, pre-processing) including processing for cutting out a face image into the first image information (S33). The authentication processing unit 23 also issues shared identification information (identification number) (S34).

[0055] The authentication processing unit 23 extracts the facial feature A of the user from the second image information A, associates the extracted feature A with the common identification information, and stores the associated feature A as registration information in the storage unit 24 (S35). Note that the above-mentioned information processing A is, for example, information processing suitable for the face authentication system 20a to extract the feature A.

[0056] When the storage of the registration information is completed, the authentication processing unit 23 transmits a completion notification using the communication unit 22 (S36). The completion notification includes the first image information and the shared identification information.

[0057] The communication unit 41 of the image information providing system 40 receives the completion notification. The information processing unit 42 acquires the first image information included in the received completion notification, and stores the acquired first image information in the storage unit 43 (S37). The information processing unit 42 also generates (acquires) second image information B by performing information processing B (in other words, preprocessing) including processing for cutting out a face image from the first image information acquired in step S37 (S38).

[0058] The information processing unit 42 transmits a registration request including the generated second image information B and the common identification information included in the completion notification to the face authentication system 20b using the communication unit 41 (S39). In other words, the communication unit 41 transmits the second image information B and the common identification information to the face authentication system 20b. The information processing unit 42 may store the generated second image information B in the storage unit 43 as necessary.

[0059] The communication unit 22 of the face authentication system 20b receives the registration request (second image information B and common identification information). The authentication processing unit 23 extracts the feature amount B of the user's face from the second image information B, associates the extracted feature amount B with the common identification information, and stores it as registration information in the storage unit 24 (S40). Note that the feature amount B is different from the feature amount A, and the above-mentioned information processing B is, for example, information processing suitable for the face authentication system 20b to extract the feature amount B. The feature amount B may be the same as the feature amount A, and in this case, the information processing B may be the same processing as the information processing A.

[0060] When the authentication processing unit 23 completes storing the registration information, it transmits a completion notification using the communication unit 22 (S41). The communication unit 41 of the image information providing system 40 receives the completion notification.

[0061] When the information processing unit 42 receives completion notifications from all the face authentication systems 20 (face authentication system 20b in the second operation example) that transmitted the second image information, the information processing unit 42 transmits a registration success notification to the face authentication system 20a using the communication unit 41 (S42). In other words, the communication unit 41 transmits the registration success notification to the face authentication system 20a. Note that the communication unit 41 may transmit the registration success notification to the face authentication system 20b that transmitted the second image information B instead of the face authentication system 20a or in addition to the face authentication system 20a.

[0062] Furthermore, the information processing unit 42 deletes the first image information stored in the storage unit 43 in step S37 from the storage unit 43 (S43). Note that the first image information does not need to be deleted in preparation for a case where a new face authentication system 20 is added later.

[0063] As described above, in operation example 2, the image information providing system 40 acquires first image information from the facial recognition system 20a, and transmits second image information B corresponding to the facial recognition system 20b to the facial recognition system 20b based on the acquired first image information.

[0064] This makes it possible to register facial images (storage of registration information) in multiple facial authentication systems 20 using a single image (first image information), and therefore the image information providing system 40 can simplify the facial image registration procedure.

[0065] In the second operation example, the authentication processing unit 23 of the face authentication system 20a may determine whether the first image information acquired in step S32 is suitable for the registered information (suitability for extracting a feature amount), and when it is determined that the first image information is not suitable for the registered information, may cause the imaging unit 21 to capture another image. That is, the face authentication system 20a may recapture an image before transmitting the first image information to the image information providing system 40.

[0066] For example, when the feature amount A cannot be extracted in step S35, the authentication processing unit 23 determines that the first image information is not suitable for the registered information. The authentication processing unit 23 may determine whether the first image information is suitable for the registered information by performing a predetermined process on the first image information before step S35.

[0067] [Example 3] In the operation example 3, the image information providing system 40 itself is a system that performs face recognition processing (a system similar to the face authentication system 20), and an example will be described in which the image information providing system 40 provides image information of an image captured by the image information providing system 40 to the face authentication system 20. Fig. 5 is a sequence diagram of the operation example 3 of the linkage system 10.

[0068] First, the user captures an image showing the user's own face using the image information providing system 40. In other words, the imaging unit 44 of the image information providing system 40 captures an image showing the user's own face (S51).

[0069] The information processing unit 42 acquires first image information of the captured image and stores the acquired first image information in the storage unit 43 (S52). The information processing unit 42 generates (acquires) second image information A by performing information processing A (in other words, pre-processing) including processing for cutting out a face image from the acquired first image information (S53). The information processing unit 42 also issues shared identification information (identification number) (S54).

[0070] The information processing unit 42 extracts the feature amount A of the user's face from the second image information A, associates the extracted feature amount A with the common identification information, and stores it as registration information in the storage unit 43 (S55). Note that the above-mentioned information processing A is, for example, information processing suitable for the image information providing system 40 (information processing unit 42) to extract the feature amount A.

[0071] When the information processing unit 42 has completed storing the registration information, it generates (acquires) second image information B by performing information processing B (in other words, preprocessing) that includes processing for cutting out a facial image from the first image information acquired and stored in step S52 (S56).

[0072] The information processing unit 42 transmits a registration request including the generated second image information B and the common identification information issued in step S54 to the face authentication system 20 using the communication unit 41 (S57). In other words, the communication unit 41 transmits the second image information B and the common identification information to the face authentication system 20. The information processing unit 42 may store the generated second image information B in the storage unit 43 as necessary.

[0073] The communication unit 22 of the face authentication system 20 receives the registration request (second image information B and common identification information). The authentication processing unit 23 extracts the feature amount B of the user's face from the second image information B, associates the extracted feature amount B with the common identification information, and stores it as registration information in the storage unit 24 (S58). Note that the feature amount B is different from the feature amount A, and the above-mentioned information processing B is, for example, information processing suitable for the face authentication system 20 to extract the feature amount B. The feature amount B may be the same as the feature amount A, and in this case, the information processing B may be the same processing as the information processing A.

[0074] When the authentication processing unit 23 completes storing the registration information, it transmits a completion notification using the communication unit 22 (S59). The communication unit 41 of the image information providing system 40 receives the completion notification.

[0075] When the information processing unit 42 receives the completion notification from all the face authentication systems 20 to which the second image information has been transmitted, the information processing unit 42 notifies the user of the successful registration (S60). Note that the communication unit 41 may transmit the successful registration notification to all the face authentication systems 20 to which the second image information has been transmitted.

[0076] Furthermore, the information processing unit 42 deletes the first image information stored in the storage unit 43 in step S52 from the storage unit 43 (S61). Note that the first image information does not need to be deleted in preparation for a case where a face authentication system 20 is added later.

[0077] As described above, in operation example 3, the image information providing system 40 acquires first image information of an image captured by the imaging unit 44, and transmits second image information corresponding to the facial recognition system 20 to the facial recognition system 20 based on the acquired first image information.

[0078] As a result, since it is possible to register a facial image (storage of registration information) in the image information providing system 40 and the facial authentication system 20 using a single image (first image information), the image information providing system 40 can simplify the facial image registration procedure.

[0079] [Example 4: When face image registration fails (1)] In the above embodiment, the face authentication system 20, which has received the second image information from the image information providing system 40, transmits a completion notification to the image information providing system 40 when the face authentication system 20 stores the registration information in the storage unit 24. Here, if the face authentication system 20 fails to store the registration information in the storage unit 24 due to a reason such as failure to extract features from the second image information, it transmits an error notification to the image information providing system 40 instead of a completion notification. Hereinafter, an operation example (operation example 4) in the case where registration of a face image fails in this way will be described. FIG. 6 is a sequence diagram of operation example 4 of the linkage system 10.

[0080] The processes in steps S11 to S16 are the same as those in operation example 1 (FIG. 3), and therefore detailed description thereof will be omitted. In step S16, the communication unit 22 of the face authentication system 20a receives a registration request (second image information A and shared identification information). If the authentication processing unit 23 fails to extract feature amount A from the second image information A (S17a), it transmits an error notification using the communication unit 22 (S18a).

[0081] The communication unit 41 of the image information providing system 40 receives the error notification. In response to the receipt of the error notification, the information processing unit 42 performs information processing C (in other words, preprocessing) including processing for cutting out a face image from the first image information acquired in step S13, thereby generating (acquiring) second image information C (S19a). The information processing C is information processing different from the information processing A.

[0082] The information processing unit 42 transmits a registration request including the generated second image information C and the common identification information issued in step S15 to the face authentication system 20a using the communication unit 41 (S20a). In other words, the communication unit 41 transmits the second image information C and the common identification information to the face authentication system 20a. The information processing unit 42 may store the generated second image information C in the storage unit 43 as necessary.

[0083] The communication unit 22 of the face authentication system 20a receives the registration request (the second image information C and the common identification information). This enables the authentication processing unit 23 to extract the feature amount A from the second image information C.

[0084] In this way, when an error notification is received, the communication unit 41 of the image information providing system 40 can assist the facial recognition system 20a in storing the registration information by transmitting second image information C obtained by applying information processing C different from information processing A to the first image information to the facial recognition system 20a.

[0085] In addition, in the operation example 4, an example has been described in which, when the image information providing system 40 receives an error notification from the face authentication system 20a in the operation example 1, the image information providing system 40 transmits the second image information that has been subjected to another information processing to the face authentication system 20a. Although not shown, in the operation example 2, when the image information providing system 40 receives an error notification from the face authentication system 20b, the image information providing system 40 may transmit the second image information that has been subjected to another information processing to the face authentication system 20b. Also, in the operation example 3, when the image information providing system 40 receives an error notification from the face authentication system 20, the image information providing system 40 may transmit the second image information that has been subjected to another information processing to the face authentication system 20.

[0086] In addition, in operation example 4, when an error notification is received from one of the multiple facial recognition systems 20, other second image information may be sent only to the facial recognition system 20 that sent the error notification, or other second image information may be sent not only to the facial recognition system 20 that sent the error notification but also to the facial recognition systems 20 that did not send the error notification, and the registration of the facial image of the facial recognition systems 20 that did not send the error notification may be re-done.

[0087] [Example 5: When face image registration fails (2)] Another operation example (operation example 5) when registration of a face image fails will be described below. Fig. 7 is a sequence diagram of operation example 5 of the linkage system 10.

[0088] The processes of steps S11 to S16 and S17a to S18a are similar to those in the operation example 4 (FIG. 6), and therefore detailed description thereof will be omitted.

[0089] In step S18a, the communication unit 41 of the image information providing system 40 receives the error notification. When the error notification is received, the information processing unit 42 transmits an imaging request to the information terminal 30 using the communication unit 41 (S19b).

[0090] The communication unit 32 of the information terminal 30 receives the imaging request. The information processing unit 33 causes the imaging unit 31 to capture an image showing the user's face again based on the received imaging request (S20b). The information processing unit 33 transmits first image information of the captured image (hereinafter also referred to as other first image information) to the image information providing system 40 using the communication unit 32 (S21b).

[0091] The communication unit 41 of the image information providing system 40 receives the other first image information. The information processing unit 42 acquires the received other first image information and stores the acquired other first image information in the storage unit 43 (S22b). The information processing unit 42 also generates (acquires) other second image information A by performing information processing A on the acquired other first image information (S23b). The information processing unit 42 may store the generated other second image information A in the storage unit 43 as necessary.

[0092] The information processing unit 42 transmits a registration request including the other second image information A generated in step S23b and the common identification information issued in step S15 to the face authentication system 20a using the communication unit 41 (S24b).

[0093] The communication unit 22 of the face authentication system 20a receives the registration request (the other second image information A and the common identification information). This allows the authentication processing unit 23 to extract the feature amount A from the other second image information A.

[0094] In this way, when an error notification is received by the communication unit 41, the information processing unit 42 of the image information providing system 40 transmits an imaging request to the information terminal 30 to obtain other first image information different from the first image information, and transmits the other second image information A to the face authentication system 20a. This can assist the face authentication system 20a in storing the registration information.

[0095] In addition, in the operation example 5, an example has been described in which, when the image information providing system 40 receives an error notification from the face authentication system 20a in the operation example 1, the image information providing system 40 acquires other first image information from the information terminal 30. Although not shown, in the operation example 2, when the image information providing system 40 receives an error notification from the face authentication system 20b, the image information providing system 40 may acquire other first image information from the face authentication system 20a. Also, in the operation example 3, when the image information providing system 40 receives an error notification from the face authentication system 20, the image information providing system 40 may acquire other first image information by having the imaging unit 44 capture an image showing the user's face again.

[0096] In addition, in operation example 5, when an error notification is received from one of the multiple facial recognition systems 20, other second image information may be sent only to the facial recognition system 20 that sent the error notification, or other second image information may be sent not only to the facial recognition system 20 that sent the error notification but also to the facial recognition systems 20 that did not send the error notification, and the registration of the facial image may be re-done in the facial recognition systems 20 that did not send the error notification.

[0097] [Designation of the face recognition system that should provide the second image information] Incidentally, one or more face authentication systems 20 to which the image information providing system 40 should provide the second image information are designated in advance, and identification information of the designated face authentication systems 20 is stored in advance in the storage unit 43. Here, the designation of the one or more face authentication systems 20 to which the second image information should be provided is performed, for example, by the system that transmitted the first image information. That is, the communication unit 41 of the image information providing system 40 receives information indicating the one or more face authentication systems 20 to which the second image information is to be transmitted, from the system that transmitted the first image information. The system that transmitted the first image information is the information terminal 30 in the first operation example, and is the face authentication system 20a in the second operation example.

[0098] Furthermore, the one or more face recognition systems 20 to which the second image information should be provided may be designated by a system different from the system that transmitted the first image information. That is, the communication unit 41 of the image information providing system 40 may receive information indicating the one or more face recognition systems 20 to which the second image information is to be transmitted from a system different from the system that transmitted the first image information.

[0099] For example, in the operation example 1, when identification information of one or more face authentication systems 20 is registered based on a command from an information terminal other than the information terminal 30, it can be said that the communication unit 41 receives information indicating one or more face authentication systems 20 to which the second image information is to be transmitted from a system other than the system that transmitted the first image information. Also, in the operation example 2, when identification information of one or more face authentication systems 20 is registered based on a command from the information terminal 30, it can be said that the communication unit 41 receives information indicating one or more face authentication systems 20 to which the second image information is to be transmitted from a system other than the system that transmitted the first image information.

[0100] [Variations] In the above embodiment, it has been described that the image information providing system 40 converts the first image information into the second image information by performing information processing on the first image information and provides the second image information to the face authentication system 20, but the image information providing system 40 may provide the first image information as it is to the face authentication system 20. In other words, the second image information may be information obtained by performing information processing on the first image information, or may be the first image information itself.

[0101] In the above embodiment, the registration information (feature amount) stored in each of the face authentication systems 20 is assigned with a common identification information (same number). However, the registration information (feature amount) stored in each of the face authentication systems 20 may be assigned with different identification information. In this case, if the correspondence between the identification information is managed in the image information providing system 40, the registration information of the same user can be identified.

[0102] Specifically, if first identification information is assigned to registration information A of facial authentication system 20a, and second identification information is assigned to registration information B of facial authentication system 20b, and both the first identification information and the second identification information are managed to indicate user A, it is possible to identify that registration information A and registration information B are registration information for the same user.

[0103] In operation example 1, operation example 4, and operation example 5 of the above embodiment, information terminal 30 is used to capture an image showing the user's face, but instead of information terminal 30, a standalone camera device (a device whose main function is to capture images) may be used.

[0104] In operation examples 1 to 5 of the above embodiment, the image information providing system 40 transmits a registration request to the face authentication system 20, and the face authentication system 20 responds, but the opposite may also be true, where the face authentication system 20 transmits a registration request to the image information providing system 40, and the image information providing system 40 responds.

[0105] In the above embodiment, as an example of a case where multiple face authentication systems 20 are installed in the same facility, one face authentication system 20 is installed in a common area of ​​the facility, and other face authentication systems 20 are installed in private areas of the facility. When multiple face authentication systems 20 are installed in the same facility, another case is also conceivable where one face authentication system 20 is installed in a private area of ​​the facility, and other face authentication systems 20 are installed in other private areas of the facility. The image information providing system 40 can also be used in such a case.

[0106] [Effects, etc.] Hereinafter, examples of inventions that can be obtained from the disclosure of this specification will be given, and the effects and the like that can be obtained from the inventions will be described.

[0107] Invention 1 is an image information providing system 40 comprising an information processing unit 42 that acquires first image information used in facial recognition processing, the first image information being an image showing a human face, and a communication unit 41 that transmits second image information corresponding to one or more facial recognition systems 20 to each of the facial recognition systems 20 based on the acquired first image information.

[0108] Such an image information providing system 40 can support the registration of face images by transmitting second image information to each of one or more face authentication systems 20.

[0109] Invention 2 is an image information providing system 40 of Invention 1, in which the communication unit 41 further receives first image information from another face recognition system different from the one or more face recognition systems 20, and the information processing unit 42 acquires the first image information received by the communication unit 41.

[0110] Such an image information providing system 40 can assist in the registration of facial images by transmitting second image information to each of one or more facial recognition systems 20 based on first image information acquired from another facial recognition system.

[0111] Invention 3 is an image information providing system 40 of Invention 1 or 2, in which the communication unit 41 transmits common identification information for associating the second image information transmitted to each of the one or more facial recognition systems 20, to each of the one or more facial recognition systems 20.

[0112] According to such an image information providing system 40, it is possible to identify that the second image information transmitted to each of the one or more face authentication systems 20 is second image information of the same user based on the common identification information.

[0113] Invention 4 is the image information providing system 40 of Invention 3, in which the common identification information is information for associating the second image information transmitted to each of the one or more face authentication systems 20 with the first image information.

[0114] According to such an image information providing system 40, it is possible to determine, based on the common identification information, that the second image information transmitted to each of one or more face authentication systems 20 and the original first image information are image information of the same user.

[0115] Invention 5 is the image information providing system 40 of any of Inventions 1 to 4, in which the communication unit 41 receives information indicating one or more face recognition systems to which the second image information is to be sent from the system that is the source of the first image information.

[0116] Such an image information providing system 40 can transmit the second image information to one or more face recognition systems 20 designated by the system that transmitted the first image information.

[0117] Invention 6 is an image information providing system 40 of any of Inventions 1 to 4, in which the communication unit 41 receives information indicating one or more face recognition systems to which the second image information is to be sent from a system other than the system that sent the first image information.

[0118] Such an image information providing system 40 can transmit second image information to one or more face recognition systems 20 designated by a system different from the system that transmitted the first image information.

[0119] Invention 7 is the image information providing system 40 of any of Inventions 1 to 6, wherein the communication unit 41 receives registration success / failure information indicating whether or not registration information for face recognition processing has been successfully stored from one or more face recognition systems that have received the second image information. The registration success / failure information is, for example, the completion notification or error notification of the above-mentioned embodiments.

[0120] Such an image information providing system 40 can grasp whether or not the face image has been registered (registration information has been acquired) in the face authentication system 20 that has transmitted the second image information.

[0121] Invention 8 is an image information providing system 40 of Invention 7, in which the second image information is information obtained by subjecting the first image information to a first information processing, and when the received registration possibility information indicates that registration is not possible, the communication unit 41 transmits other second image information obtained by subjecting the first image information to a second information processing different from the first information processing to one or more face recognition systems 20.

[0122] When the face authentication system 20 that transmitted the second image information is unable to register a face image, such an image information providing system 40 can transmit other second image information that has been subjected to other information processing on the first image information, thereby enabling the face image to be registered.

[0123] A ninth aspect of the present invention is the image information providing system 40 of the seventh aspect, in which the information processing unit 42 acquires other first image information different from the first image information when the received registration propriety information indicates that registration is not permitted.

[0124] When the face authentication system 20 that transmitted the second image information is unable to register a face image, such an image information providing system 40 can transmit other second image information that has been subjected to information processing on other first image information, thereby enabling the face image to be registered.

[0125] Invention 10 is the image information providing system 40 of Invention 7, wherein the communication unit 41 transmits information regarding successful registration when registration possibility information indicating that registration is possible is received from all of the one or more face authentication systems 20 that received the second image information. The registration possibility information indicating that registration is possible is, for example, the completion notification of the above embodiment, and the information regarding successful registration is, for example, the registration success notification of the above embodiment.

[0126] Such an image information providing system 40 can notify that all of the face authentication systems 20 to which the second image information has been transmitted have successfully registered the face image.

[0127] An eleventh aspect of the present invention is the image information providing system 40 of any one of the first to tenth aspects of the present invention, comprising a storage unit 43 that stores the first image information.

[0128] Such an image information providing system 40 can store the first image information.

[0129] A twelfth aspect of the present invention is the image information providing system 40 of any one of the first to eleventh aspects of the present invention, which includes a storage unit 43 that stores the second image information.

[0130] Such an image information providing system 40 can store the second image information.

[0131] Invention 13 is a facial recognition system 20 that communicates with an image information providing system 40 of any of Inventions 1 to 12, and includes an imaging unit 21 that captures an original image of the first image information, a communication unit 22 that transmits the first image information to the image information providing system 40, and an authentication processing unit 23 that performs facial recognition processing based on an image of a human face captured by the imaging unit 21 and registration information based on the first image information.

[0132] The face authentication system 20 can transmit (provide) the first image information acquired for registering a face image in the face authentication system 20 to the image information providing system 40.

[0133] Invention 14 is the face authentication system 20 of Invention 13, wherein the authentication processing unit 23 causes the imaging unit 21 to capture another image when it is determined that the first image information does not match the registration information.

[0134] Such a face authentication system 20 can reacquire the first image information.

[0135] Invention 15 is a facial recognition system 20 that communicates with an image information providing system 40 of any one of Inventions 1 to 12, and includes a communication unit 22 that receives second image information, an imaging unit 21 that captures an image showing a human face, and an authentication processing unit 23 that performs facial recognition processing based on the captured image and registration information based on the received second image information.

[0136] The face authentication system 20 described above can register a face image based on the second image information received from the image information providing system 40.

[0137] Invention 16 is an information processing method executed by a computer system, the information processing method including the steps of acquiring first image information used in facial recognition processing, the first image information being an image showing a human face, and transmitting second image information corresponding to one or more facial recognition systems to each of the facial recognition systems based on the acquired first image information.

[0138] Such an information processing method can assist in the registration of face images by transmitting second image information to each of one or more face authentication systems 20.

[0139] Invention 17 is an information processing method executed by a computer system communicating with an image information providing system 40 of any of Inventions 1 to 12, and includes the steps of capturing an original image of first image information, transmitting the first image information to the image information providing system, capturing an image showing a person's face, and performing face recognition processing based on the captured image and registration information based on the first image information.

[0140] In this information processing method, the first image information acquired for registering a face image in the face authentication system 20 can be transmitted to the image information providing system 40.

[0141] Invention 18 is an information processing method executed by a computer system communicating with any one of the image information providing systems 40 of Inventions 1 to 12, and includes the steps of receiving second image information, capturing an image showing a human face, and performing face recognition processing based on the captured image and registration information based on the received second image information.

[0142] In this information processing method, a face image can be registered based on the second image information received from the image information providing system 40.

[0143] Invention 19 is a program for causing a computer system to execute the information processing method of any one of Inventions 16 to 18.

[0144] Such a program allows a computer system to assist in the registration of facial images.

[0145] (Other embodiments) Although the embodiment has been described above, the present invention is not limited to the above embodiment.

[0146] For example, in the above embodiment, an example in which the face recognition system is installed in an office building has been described, but the face recognition system may be installed in facilities other than an office building. For example, the face recognition system may be installed in an apartment building, a factory, a research facility, a medical facility, a lodging facility, or the like.

[0147] In the above embodiment, the image information providing system is realized by one or more server devices. Thus, in this specification, a "system" may be composed of a single device or may be composed of multiple devices. When a system is composed of multiple devices, the components (especially functional components) of the system may be distributed in any manner among the multiple devices.

[0148] Furthermore, the method of communication between the devices in the above-described embodiment is not particularly limited. In addition, a relay device (such as a broadband router) (not shown) may be involved in the communication between the devices.

[0149] In the above embodiment, the processes executed by a specific processing unit may be executed by another processing unit. The order of multiple processes may be changed, or multiple processes may be executed in parallel.

[0150] In the above embodiment, each component may be realized by executing a software program suitable for each component. Each component may be realized by a program execution unit such as a CPU or a processor reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory.

[0151] Furthermore, each component may be realized by hardware. For example, each component may be a circuit (or an integrated circuit). These circuits may form a single circuit as a whole, or each may be a separate circuit. Furthermore, each of these circuits may be a general-purpose circuit, or a dedicated circuit.

[0152] Furthermore, the general or specific aspects of the present invention may be realized as a system, an apparatus, a method, an integrated circuit, a computer program, or a computer-readable recording medium such as a CD-ROM, or may be realized as any combination of a system, an apparatus, a method, an integrated circuit, a computer program, and a recording medium.

[0153] For example, the present invention may be realized as a method executed by a computer system such as an image information providing system or a face authentication system, or as a program for causing a computer system to execute the method. Furthermore, the present invention may be realized as a computer-readable non-transitory recording medium having such a program recorded thereon.

[0154] In addition, the present invention also includes forms obtained by applying various modifications to each embodiment that a person skilled in the art may think of, or forms realized by arbitrarily combining the components and functions of each embodiment within the scope that does not deviate from the spirit of the present invention. [Explanation of symbols]

[0155] 10 Collaborative Systems 20, 20a, 20b Face Recognition System 21, 31, 44 Imaging unit 22, 32, 41 Communications Department 23 Authentication processing section 24, 34, 43 storage section 30 Information terminal 33, 42 Information Processing Section 40 Image information provision system 50 Doors

Claims

1. an information processing unit that acquires first image information used in face recognition processing, the first image information being an image showing a human face; and a communication unit that transmits, to each of one or more face recognition systems, second image information corresponding to the face recognition system based on the acquired first image information. Image information provision system.

2. The communication unit further receives the first image information from another face authentication system different from the one or more face authentication systems, The information processing unit acquires the first image information received by the communication unit.

2. The image information providing system according to claim 1.

3. The communication unit transmits common identification information for associating the second image information transmitted to each of the one or more face authentication systems to each of the one or more face authentication systems.

3. The image information providing system according to claim 1 or 2.

4. The common identification information is information for associating the second image information transmitted to each of the one or more face authentication systems with the first image information.

4. The image information providing system according to claim 3.

5. The communication unit receives information indicating the one or more face recognition systems to which the second image information is to be transmitted from a system that is a source of the first image information.

3. The image information providing system according to claim 1 or 2.

6. The communication unit receives information indicating the one or more face recognition systems as a destination of the second image information from a system different from a system as a source of the first image information.

3. The image information providing system according to claim 1 or 2.

7. The communication unit receives registration success / failure information indicating whether registration information for face authentication processing has been successfully stored from the one or more face authentication systems that have received the second image information.

3. The image information providing system according to claim 1 or 2.

8. the second image information is information obtained by performing a first information processing on the first image information, When the received registration possibility information indicates that registration is not possible, the communication unit transmits, to the one or more face authentication systems, other second image information obtained by performing a second information processing on the first image information that is different from the first information processing.

8. The image information providing system according to claim 7.

9. When the received registration possibility information indicates that registration is impossible, the information processing unit acquires another first image information different from the first image information.

8. The image information providing system according to claim 7.

10. When the communication unit receives the registration possibility information indicating that the registration is possible from all of the one or more face authentication systems that have received the second image information, the communication unit transmits information regarding successful registration.

8. The image information providing system according to claim 7.

11. A storage unit for storing the first image information 3. The image information providing system according to claim 1 or 2.

12. A storage unit for storing the second image information 3. The image information providing system according to claim 1 or 2.

13. A face recognition system communicating with the image information providing system according to claim 1, an imaging unit that captures an original image of the first image information; a communication unit that transmits the first image information to the image information providing system; an authentication processing unit that performs face authentication processing based on an image showing a human face captured by the imaging unit and registration information based on the first image information; Facial recognition system.

14. When the authentication processing unit determines that the first image information does not have suitability for the registration information, the authentication processing unit causes the imaging unit to capture another image. The face authentication system according to claim 13.

15. A face recognition system communicating with the image information providing system according to claim 1, A communication unit for receiving the second image information; An imaging unit that captures an image showing a person's face; an authentication processing unit that performs face authentication processing based on the captured image and registration information based on the received second image information; Facial recognition system.

16. 1. An information processing method executed by a computer system, comprising: acquiring first image information used in face recognition processing, the first image information being an image showing a human face; and transmitting, to each of the one or more facial recognition systems, second image information corresponding to the facial recognition system based on the acquired first image information. Information processing methods.

17. 2. An information processing method executed by a computer system in communication with the image information providing system according to claim 1, comprising: capturing an original image of the first image information; transmitting the first image information to the image information providing system; Taking an image showing a person's face; performing face authentication processing based on the captured image and registration information based on the first image information. Information processing methods.

18. 2. An information processing method executed by a computer system in communication with the image information providing system according to claim 1, comprising: receiving the second image information; Taking an image showing a person's face; and performing face authentication processing based on the captured image and registration information based on the received second image information. Information processing methods.

19. A program for causing the computer system to execute the information processing method according to any one of claims 16 to 18.

Images