Information processing system, information processing device, information processing method, and recording medium

Abstract

An information processing system (10) comprises: an image acquisition means (110) for acquiring face images and iris images of a registration subject; a score calculation means (120) for calculating quality scores indicating the quality of the face images and iris images; and a selection means (130) for selecting a face image and an iris image to be registered on the basis of the quality scores. This information processing system makes it possible to register a face image and an iris image of high quality.

Description

[Technical field]

[0001] The present disclosure relates to the technical fields of an information processing system, an information processing device, an information processing method, and a recording medium. [Background technology]

[0002] As this type of system, a system that evaluates the quality of an image used for biometric authentication is known. For example, Patent Document 1 discloses that, among a plurality of eye images, an eye image that is evaluated as the best by an eye image evaluation unit is stored as registered authentication information. Patent Document 2 discloses that, if the face or eye area cannot be extracted from the image, False is returned as the image capture quality, and, if both the face area and the eye area can be extracted, True is returned as the image capture quality. Patent Document 3 discloses that an image including at least the eyes of a person to be authenticated is repeatedly captured, and an image that is determined to have good image quality by an image quality determination unit is output. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2007-159610 A [Patent Document 2] JP 2019-191898 A [Patent Document 3] JP 2006-163683 A Summary of the Invention [Problem to be solved by the invention]

[0004] This disclosure is intended to improve upon the techniques disclosed in the prior art documents. [Means for solving the problem]

[0005] One aspect of the information processing system disclosed herein includes an image acquisition means for acquiring a facial image and an iris image to be registered, a score calculation means for calculating a quality score indicating the quality of the facial image and the iris image, and a selection means for selecting the facial image and the iris image to be registered based on the quality score.

[0006] One aspect of the information processing device disclosed herein comprises an image acquisition means for acquiring a facial image and an iris image to be registered, a score calculation means for calculating a quality score indicating the quality of the facial image and the iris image, and a selection means for selecting the facial image and the iris image to be registered based on the quality score.

[0007] One aspect of the information processing method disclosed herein is an information processing method executed by at least one computer, which acquires a facial image and an iris image to be registered, calculates a quality score indicating the quality of the facial image and the iris image, and selects the facial image and the iris image to be registered based on the quality score.

[0008] One aspect of the recording medium of this disclosure is a computer program recorded on at least one computer to execute an information processing method, which includes acquiring a facial image and an iris image to be registered, calculating a quality score indicating the quality of the facial image and the iris image, and selecting the facial image and the iris image to be registered based on the quality score. [Brief description of the drawings]

[0009] [Figure 1] 1 is a block diagram showing a hardware configuration of an information processing system according to a first embodiment. [Diagram 2] 2 is a perspective view showing a configuration of an authentication terminal included in the information processing system according to the first embodiment. FIG. [Diagram 3] 1 is a block diagram showing a functional configuration of an information processing system according to a first embodiment. [Figure 4] FIG. 13 is a block diagram showing a functional configuration of a modified example of the information processing system according to the first embodiment. [Diagram 5]5 is a flowchart showing the flow of a registration operation by the information processing system according to the first embodiment. [Figure 6] 5 is a flowchart showing the flow of an imaging operation by the information processing system according to the first embodiment. [Figure 7] FIG. 11 is a block diagram showing a functional configuration of an information processing system according to a second embodiment. [Figure 8] 13 is a flowchart showing the flow of a registration operation by an information processing system according to a second embodiment. [Figure 9] FIG. 13 is a block diagram showing a functional configuration of an information processing system according to a third embodiment. [Figure 10] 13 is a flowchart showing the flow of an authentication operation by an information processing system according to a third embodiment. [Figure 11] FIG. 13 is a plan view showing an example of order display by an information processing system according to a third embodiment. [Figure 12] FIG. 13 is a block diagram showing a functional configuration of an information processing system according to a fourth embodiment. [Figure 13] 13 is a flowchart showing the flow of an iris imaging operation by the information processing system according to the fourth embodiment. [Figure 14] FIG. 13 is a block diagram showing a functional configuration of an information processing system according to a fifth embodiment. [Figure 15] 13 is a flowchart showing the flow of an authentication operation by an information processing system according to a fifth embodiment. [Figure 16] FIG. 13 is a block diagram showing a functional configuration of an information processing system according to a sixth embodiment. [Figure 17] 13 is a flowchart showing the flow of an authentication operation by an information processing system according to a sixth embodiment. [Figure 18] FIG. 13 is a block diagram showing a functional configuration of an information processing system according to a seventh embodiment. [Figure 19] FIG. 23 is a plan view showing a specific example of an authentication operation by the information processing system according to the eighth embodiment. [Figure 20] FIG. 13 is a block diagram showing a functional configuration of an information processing system according to a ninth embodiment. [Figure 21] FIG. 13 is a plan view (part 1) showing a display example in an information processing system according to a ninth embodiment. [Figure 22] FIG. 23 is a plan view (part 2) showing a display example in the information processing system according to the ninth embodiment. [Diagram 23] FIG. 23 is a block diagram showing the functional configuration of an information processing system according to a tenth embodiment. [Figure 24] 23 is a flowchart showing the flow of operations performed by a first registration control unit in the information processing system according to the tenth embodiment. [Diagram 25] 23 is a flowchart showing the flow of operations performed by a second registration control unit in the information processing system according to the tenth embodiment. [Figure 26] FIG. 23 is a block diagram showing the functional configuration of an information processing system according to an eleventh embodiment. [Figure 27] FIG. 23 is a plan view showing an example of a spoofing detection operation by the information processing system according to the 11th embodiment. [Figure 28] FIG. 23 is a block diagram showing the functional configuration of an information processing system according to a twelfth embodiment. [Figure 29] 23 is a flowchart showing the flow of an authentication method determination operation by the information processing system according to the twelfth embodiment. [Diagram 30] FIG. 23 is a block diagram showing the functional configuration of an information processing system according to a thirteenth embodiment. [Diagram 31] FIG. 23 is a block diagram showing the functional configuration of an information processing system according to a fourteenth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, embodiments of an information processing system, an information processing device, an information processing method, and a recording medium will be described with reference to the drawings.

[0011] First Embodiment An information processing system according to a first embodiment will be described with reference to FIGS. 1 to 6. FIG.

[0012] (Hardware configuration) First, the hardware configuration of the information processing system according to the first embodiment will be described with reference to Fig. 1. Fig. 1 is a block diagram showing the hardware configuration of the information processing system according to the first embodiment.

[0013] As shown in Fig. 1, the information processing system 10 according to the first embodiment includes a processor 11, a RAM (Random Access Memory) 12, a ROM (Read Only Memory) 13, and a storage device 14. The information processing system 10 may further include an input device 15 and an output device 16. The information processing system 10 may also include a first camera 18 and a second camera 19. The above-mentioned processor 11, RAM 12, ROM 13, storage device 14, input device 15, output device 16, first camera 18, and second camera 19 are connected via a data bus 17.

[0014] The processor 11 reads a computer program. For example, the processor 11 is configured to read a computer program stored in at least one of the RAM 12, the ROM 13, and the storage device 14. Alternatively, the processor 11 may read a computer program stored in a computer-readable recording medium using a recording medium reading device (not shown). The processor 11 may acquire (i.e., read) a computer program from a device (not shown) disposed outside the information processing system 10 via a network interface. The processor 11 controls the RAM 12, the storage device 14, the input device 15, and the output device 16 by executing the computer program that has been read. In particular, in this embodiment, when the processor 11 executes the computer program that has been read, a functional block that executes a process when registering a target image is realized in the processor 11. That is, the processor 11 may function as a controller that executes each control in the information processing device 10.

[0015] The processor 11 may be configured as, for example, a central processing unit (CPU), a graphics processing unit (GPU), a field-programmable gate array (FPGA), a demand-side platform (DSP), or an application specific integrated circuit (ASIC). The processor 11 may be configured as one of these, or may be configured to use a plurality of these in parallel.

[0016] The RAM 12 temporarily stores a computer program executed by the processor 11. The RAM 12 temporarily stores data that is temporarily used by the processor 11 when the processor 11 is executing the computer program. The RAM 12 may be, for example, a D-RAM (Dynamic RAM).

[0017] The ROM 13 stores computer programs executed by the processor 11. The ROM 13 may also store other fixed data. The ROM 13 may be, for example, a programmable ROM (P-ROM).

[0018] The storage device 14 stores data that is to be stored long-term by the information processing system 10. The storage device 14 may operate as a temporary storage device for the processor 11. The storage device 14 may include, for example, at least one of a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and a disk array device.

[0019] The input device 15 is a device that receives an input instruction from a user of the information processing system 10. The input device 15 may include, for example, at least one of a keyboard, a mouse, and a touch panel. The input device 15 may be configured as a mobile terminal such as a smartphone or a tablet.

[0020] The output device 16 is a device that outputs information related to the information processing system 10 to the outside. For example, the output device 16 may be a display device (e.g., a display) that can display information related to the information processing system 10. The output device 16 may also be a speaker or the like that can output information related to the information processing system 10 as audio. The output device 16 may be configured as a mobile terminal such as a smartphone or a tablet.

[0021] The first camera 18 and the second camera 19 are cameras installed at positions capable of capturing an image of a target. The target here is not limited to humans, and may include animals such as dogs and snakes, robots, and the like. The first camera 18 and the second camera 19 may be configured as cameras capturing different parts of a target. For example, the first camera 18 may capture an image including the face of the target (hereinafter, appropriately referred to as a "face image"), while the second camera 19 may be configured to capture an image including the iris of the target (hereinafter, appropriately referred to as an "iris image"). The first camera 18 and the second camera 19 may be cameras capturing still images, or may be cameras capturing videos. The first camera 18 and the second camera 19 may be configured as visible light cameras, or may be configured as near-infrared cameras. The first camera 18 and the second camera 19 may be configured as depth cameras, or may be configured as thermal cameras. A plurality of the first cameras 18 and the second cameras 19 may be provided. Also, the first camera 18 and the second camera 19 may be configured as one common camera. The first camera 18 and the second camera 19 may be cameras mounted on a terminal (for example, a smartphone) owned by the subject. The first camera 18 and the second camera 19 may have a function of automatically turning off the power when no image is captured. In this case, for example, a liquid lens, a motor, or the like with a short life span may be turned off preferentially. In the following, an example will be described in which the first camera 18 is configured as a face camera that captures a face image, and the second camera 19 is configured as an iris camera that captures an iris image (hereinafter, a common reference symbol will be used to refer to the face camera as an example of the first camera 18, such as "face camera 18", and the iris camera as an example of the second camera 19, such as "iris camera 19").

[0022] 1 shows an example of an information processing system 10 including a plurality of devices, but all or a part of the functions may be realized by one device (information processing device). This information processing device may be configured to include only the above-mentioned processor 11, RAM 12, and ROM 13, and the other components (i.e., the storage device 14, the input device 15, the output device 16, the face camera 18, and the iris camera 19) may be provided by an external device connected to the information processing device. Also, the information processing device may have some of its calculation functions realized by an external device (e.g., an external server, a cloud, etc.).

[0023] (Authentication terminal configuration) Next, the configuration of the authentication terminal included in the information processing system 10 according to the first embodiment will be described with reference to Fig. 2. Fig. 2 is a perspective view showing the configuration of the authentication terminal included in the information processing system according to the first embodiment.

[0024] As shown in FIG. 2, the information processing system 10 according to the first embodiment is configured to include an authentication terminal 30 including the face camera 18 (i.e., the first camera 18) and the iris camera 19 (i.e., the second camera 19) described above. The housing of the authentication terminal 30 is made of, for example, resin or metal. A display 40 is provided on the front part of the authentication terminal. This display may display various information related to the authentication terminal, messages for the user, and images and videos captured by the face camera 18 and the iris camera 19. The face camera 18 and the iris camera 19 are installed inside a camera installation part 35 (part surrounded by a dashed line in the figure) located at the bottom of the display 40. The camera 18 and the iris camera 19 may be installed so as to be visible from the outside of the housing, or may be installed so as not to be visible from the outside. For example, when the first camera 18 and the second camera 19 are configured as visible light cameras, the visible light cameras may be provided so as to be exposed to the outside in order to capture external visible light (for example, an opening may be provided near the visible light cameras). When the first camera 18 and the second camera 19 are configured as near-infrared cameras, the near-infrared cameras may be provided so as not to be exposed to the outside (for example, it may be covered with a visible light blocking film or the like). Furthermore, when the first camera 18 is configured as a visible light camera and the second camera 19 is configured as a near-infrared camera, the first camera 18 may be exposed to the outside (for example, an opening may be provided near the first camera 18), and the second camera 19 may be provided so as not to be exposed to the outside (for example, it may be covered with a visible light blocking film or the like).

[0025] (Functional configuration) Next, the functional configuration of the information processing system 10 according to the first embodiment will be described with reference to Fig. 3. Fig. 3 is a block diagram showing the functional configuration of the information processing system according to the first embodiment.

[0026] The information processing system 10 according to the first embodiment is configured as a system capable of executing processes related to biometric authentication (particularly, face authentication and iris authentication). The information processing system 10 may be configured as a system that registers a registration image (i.e., an image of a registered user that is registered in advance) used for biometric authentication, for example. The information processing system 10 may also be configured as a system that executes authentication processing. The information processing system 10 may be installed in, for example, a facility that performs biometric authentication. For example, the information processing system 10 may be installed in a residential facility such as an apartment building, a store facility such as a retail store, a corporate office, an airport, a bus terminal, an event space, etc. The facility is not limited to indoors, but includes outdoor facilities.

[0027] 3, the information processing system 10 according to the first embodiment is configured to include, as components for realizing its functions, a face camera 18 which is an example of the first camera 18 already described, an iris camera 19 which is an example of the second camera 19, an image acquisition unit 110, a score calculation unit 120, and a selection unit 130. Each of the image acquisition unit 110, the score calculation unit 120, and the selection unit 130 may be a processing block realized by, for example, the above-mentioned processor 11 (see FIG. 1).

[0028] The image acquisition unit 110 is configured to be able to acquire a face image captured by the face camera 18 and an iris image captured by the iris camera 19. The image acquisition unit 110 may be configured to be able to acquire a face image and an iris image as candidates for a registration image used for biometric authentication. Specifically, the image acquisition unit 110 may be configured to be able to acquire a face image and an iris image of a user (hereinafter, appropriately referred to as a "registration target") who is about to register biometric information (here, face information and iris information). Also, the image acquisition unit 110 may be configured to be able to acquire a face image and an iris image as an authentication image (i.e., an image acquired when authenticating) used for biometric authentication. Specifically, the image acquisition unit 110 may be configured to be able to acquire a face image and an iris image of a user (hereinafter, appropriately referred to as a "authentication target") who is about to perform biometric authentication (here, face authentication and iris authentication).

[0029] The score calculation unit 120 is configured to be able to calculate a quality score indicating the quality of the face image and the iris image, which are candidates for the registered image acquired by the image acquisition unit 110. The score calculation unit 120 may calculate the quality score in consideration of a plurality of factors that may affect the biometric authentication. For example, the score calculation unit 120 may calculate the quality score based on the degree of blurring of the image, the direction of the eyes, the direction of the face, the degree of opening of the eyes, the degree of hiding of the iris, the luminance value, the presence or absence of a shadow, the degree of illumination, and the like. When a plurality of images are acquired by the image acquisition unit 110, the score calculation unit 120 may calculate a quality score for each of the plurality of images. In this case, the score calculation unit 120 may calculate the quality score by comparing the plurality of images with each other. That is, the score calculation unit 120 may be configured to calculate a score indicating relative quality. Note that, when comparing a plurality of images, the score calculation unit 120 may select the image with the best quality (for example, the image with the least blur and the best image of the iris) from the plurality of images without calculating the quality score. For example, when comparing three images, the score calculation unit 120 may first compare the first and second images to select the image with the higher quality, and then compare the selected image with the third image to select the image with the highest quality. The quality score calculated by the score calculation unit 120 is configured to be output to the selection unit 130.

[0030] The selection unit 130 selects a face image and an iris image to be registered as a registration image based on the quality score calculated by the score calculation unit 120. The selection unit 130 may select, for example, the image with the highest quality score from among a plurality of images whose scores have been calculated. Alternatively, the selection unit 130 may select an image with a quality score equal to or greater than a preset threshold. When the selection unit 130 selects an image to be registered, the selection unit 130 may output an instruction to the image acquisition unit 110 not to acquire any more images. Alternatively, when the selection unit 130 selects an image to be registered, the selection unit 130 may output an instruction to the face camera 18 and the iris camera 19 not to capture any more images.

[0031] (Modification) Here, a modified example of the information processing system 10 according to the first embodiment will be described with reference to Fig. 4. Fig. 4 is a block diagram showing a functional configuration of the modified example of the information processing system according to the first embodiment. In Fig. 4, the same elements as those shown in Fig. 3 are denoted by the same reference numerals.

[0032] As shown in Fig. 4, the modified information processing system 10 according to the first embodiment is configured to include, as components for realizing its functions, a face camera 18, an iris camera 19, an image acquisition unit 110, a target position detection unit 115, a rotation control unit 116, a score calculation unit 120, and a selection unit 130. That is, the information processing system 10 according to the modified example is configured to further include a target detection unit 115 and a rotation control unit 116 in addition to the configuration of the first embodiment (see Fig. 3). Each of the target position detection unit 115 and the rotation control unit 116 may be a processing block realized by, for example, the above-mentioned processor 11 (see Fig. 1).

[0033] The target position detection unit 115 is configured to obtain images captured by the face camera 18 and the iris camera 19, and detect the position of the user captured from at least one of these images (hereinafter, appropriately referred to as the "target position"). The target position may be, for example, the position where the target's face is present, or the position where the target's eyes are present. Furthermore, the target position may not only be a position in the height direction, but also a position in the depth direction corresponding to the distance to the camera, or a position in the left-right direction.

[0034] The rotation control unit 116 is configured to be able to perform rotation control of the face camera 18 and the iris camera 19 based on the position of the target detected by the target position detection unit 115. The rotation control of the face camera 18 and the iris camera 19 may be realized by, for example, a motor or the like. Furthermore, the face camera 18 and the iris camera 19 may be rotationally controlled around a common rotation axis. The rotation control unit 116 is configured to be able to determine, for example, the rotation direction and rotation amount of the face camera 18 and the iris camera 19 and execute control according to the determined parameters. Specifically, the rotation control unit 116 controls the rotation operation of the face camera 18 and the iris camera 19 so that the face and iris of the user can be captured by each of the face camera 18 and the iris camera 19 (in other words, so that the face and iris of the user are within the imaging ranges of each of the face camera 18 and the iris camera 19). Note that there are cases where the imaging ranges of face camera 18 and iris camera 19 are different (for example, the imaging range of the face camera is wider). In such cases, the target position may be detected first by face camera 18, which has a wider imaging range, and then the rotation may be controlled so that the iris can be imaged by iris camera 19, which has a narrower imaging range.

[0035] The position detection by the target position detection unit 115 and the rotation operation by the rotation control unit 116 may be performed simultaneously in parallel. In this case, the target position may be detected while capturing images with the face camera 18 and the iris camera 19, and a rotation operation based on the detected position may be performed at the same time.

[0036] (Registration action) Next, a flow of an operation of registering an image used for authentication by the information processing system 10 according to the first embodiment (hereinafter, appropriately referred to as a "registration operation") will be described with reference to Fig. 5. Fig. 5 is a flowchart showing the flow of the registration operation by the information processing system according to the first embodiment.

[0037] 5, when the registration operation by the information processing system 10 according to the first embodiment is started, first, the image acquisition unit 110 acquires a face image and an iris image of a registration target (step S110). The face image and the iris image may be captured simultaneously or at different times.

[0038] Next, the score calculation unit 120 calculates quality scores of the face image and the iris image acquired by the image acquisition unit 110 (step S102). Then, the selection unit 130 selects the face image and the iris image to be registered based on the quality scores calculated by the score calculation unit 120 (step S103).

[0039] In the above example, a configuration in which a face image and an iris image are registered simultaneously has been given, but the face image and the iris image may be registered separately. For example, a face image may be acquired, the face image to be registered may be selected, and then an iris image may be acquired, and the iris image to be registered may be selected. An example of the operation when capturing a face image and an iris image (hereinafter, appropriately referred to as an "imaging operation") will be described below with reference to Fig. 6. Fig. 6 is a flowchart showing the flow of the imaging operation by the information processing system according to the first embodiment.

[0040] As shown in FIG. 6, when the imaging operation by the information processing system 10 according to the first embodiment is started, the face camera 18 first captures an image of the target (step S151). The image of the target may be, for example, an image including the whole body of the target or an image including the upper body. Then, the face detection unit specifies the position of the target's face from the image of the target (step S152). The face detection unit can detect the position of the target's face (for example, the position of an area including the target's face), and may be configured, for example, as a part included in the image acquisition unit 110 (i.e., one function of the image acquisition unit 110). After that, the face camera 18 captures the target's face image based on the identified position of the target's face (step S153). The face camera 18 may capture the face image at a timing when the position of the target's face is included in the imaging range, for example.

[0041] Next, the iris detection unit identifies the position of the target from the facial image of the target (step S154). The iris detection unit can detect the position of the target's iris (for example, the position of an area including the target's iris), and may be configured, for example, as a component of the image acquisition unit 110 (i.e., one function of the image acquisition unit 110). Thereafter, the iris camera 19 captures an iris image of the target based on the identified iris position of the target (step S155). The iris camera 19 may capture the iris image, for example, when the iris position is included in the imaging range or when the iris overlaps the prayer position.

[0042] (Technical effect) Next, technical effects obtained by the information processing system 10 according to the first embodiment will be described.

[0043] As described in Fig. 1 to Fig. 6, in the information processing system 10 according to the first embodiment, face images and iris images to be registered are selected based on the quality score. In this way, it is possible to register face images and iris images of high quality. As a result, it is possible to improve the authentication accuracy of, for example, face authentication and iris authentication.

[0044] <Second embodiment> An information processing system 10 according to the second embodiment will be described with reference to Figures 7 and 8. The second embodiment differs from the first embodiment described above only in some configurations and operations, and other parts may be the same as the first embodiment. Therefore, hereinafter, parts that differ from the first embodiment already described will be described in detail, and other overlapping parts will be omitted as appropriate.

[0045] (Functional configuration) First, the functional configuration of the information processing system 10 according to the second embodiment will be described with reference to Fig. 7. Fig. 7 is a block diagram showing the functional configuration of the information processing system according to the second embodiment. In Fig. 7, the same elements as those shown in Fig. 3 are denoted by the same reference numerals.

[0046] As shown in Fig. 7, the information processing system 10 according to the second embodiment is configured to include, as components for realizing its functions, a face camera 18, an iris camera 19, an image acquisition unit 110, a score calculation unit 120, a selection unit 130, a mode switching unit 140, and a threshold value changing unit 150. That is, the information processing system 10 according to the second embodiment further includes the mode switching unit 140 and the threshold value changing unit 150 in addition to the configuration of the first embodiment (see Fig. 3). Each of the mode switching unit 140 and the threshold value changing unit 150 may be a processing block realized by, for example, the above-mentioned processor 11 (see Fig. 1).

[0047] The mode switching unit 140 is configured to be able to switch the mode of the registration operation. Specifically, the mode switching unit 140 is configured to be able to switch between a first mode in which imaging of a face image and an iris image and calculation of a quality score are performed in parallel, and a second mode in which imaging of a face image and an iris image is performed and then calculation of a quality score is performed. The mode switching unit 140 switches between the first mode and the second mode based on the size of the eye of the registration target. Alternatively, the mode switching unit 140 may switch between the first mode and the second mode based on the state of the iris (for example, whether the iris is hidden by the eyelid, whether the iris is hidden by the reflection of the light, etc.). For example, the mode switching unit 140 may switch to the first mode when the eye of the registration target is relatively small, and switch to the second mode when the eye of the registration target is relatively large. In this case, the mode switching unit 140 may switch between the first mode and the second mode using a threshold value preset for the size of the eye.

[0048] The threshold change unit 150 is configured to be able to change the threshold used by the selection unit 230 when selecting the face image and iris image to be registered. The threshold change unit 150 may be configured to, for example, increase the threshold as the eyes of the registration target become larger. In this case, the threshold becomes higher when the eyes of the registration target become larger, so that the face image and iris image to be registered are less likely to be selected for the registration target with large eyes. On the other hand, the threshold becomes lower when the eyes of the registration target become small, so that the face image and iris image to be registered are more likely to be selected for the registration target with small eyes. In addition, the threshold change unit 150 may be configured to, for example, decrease the threshold as the eyes of the registration target become larger. In this case, the threshold becomes lower when the eyes of the registration target become large, but since there is a high possibility that a high-quality image can be obtained for the registration target with large eyes, it is possible to register an appropriate image even if the threshold is lowered (in other words, even if there is some blurring or lighting is reflected in the iris). On the other hand, the threshold becomes higher when the eyes of the registration target become small, so that a higher-quality image can be obtained for the registration target with small eyes (for example, a high-quality image can be obtained by having the person take the image again and again). The threshold change unit 150 may be configured to change the threshold based on the state of the iris. For example, the threshold change unit 150 may set a higher threshold as the iris is captured better. Alternatively, the threshold change unit 150 may set a lower threshold as the iris is captured better. The threshold change unit 150 may also have a function of detecting glasses or color contact lenses, and may change the threshold depending on the detection result. For example, when glasses or color contact lenses are detected, the threshold may be set higher than when glasses or color contact lenses are not detected (for example, when glasses are worn, images may be captured more times than when glasses are not worn).

[0049] (Registration action) Next, the flow of the registration operation by the information processing system 10 according to the second embodiment will be described with reference to Fig. 8. Fig. 8 is a flowchart showing the flow of the registration operation by the information processing system according to the second embodiment. In Fig. 8, the same processes as those described in Fig. 5 are denoted by the same reference numerals.

[0050] 8, when the registration operation by the information processing system 10 according to the second embodiment is started, first, the size of the eyes to be registered is acquired (step S201). The eye size may be acquired, for example, from an image of the registration target (for example, a face image or an iris image). After that, the mode switching unit 140 determines whether the eye size is smaller than a predetermined value (step S202).

[0051] If the eye size is smaller than the predetermined value (step S202: YES), the mode switching unit 140 switches to the first mode (step S203). That is, the mode switches to a mode in which the capture of the face image and the iris image and the calculation of the quality score are performed in parallel. On the other hand, if the eye size is larger than the predetermined value (step S202: NO), the mode switching unit 140 switches to the second mode (step S204). That is, the mode switches to a mode in which the capture of the face image and the iris image is followed by the calculation of the quality score.

[0052] Next, the threshold change unit 150 changes the threshold used by the selection unit 130 according to the size of the eye to be registered (step S205). Then, the selection unit 130 selects the face image and iris image to be registered using the changed threshold (step S206).

[0053] (Technical effect) Next, technical effects obtained by the information processing system 10 according to the second embodiment will be described.

[0054] As described in FIG. 7 and FIG. 8, in the information processing system 10 according to the second embodiment, the mode of the registration operation is switched and the threshold value is changed based on the size of the eyes. Here, it is particularly difficult to obtain an image with a high quality score for a registration target with small eyes. Therefore, by performing the registration operation in the first mode, an image with a high quality score can be obtained more appropriately. For example, an image with a high quality score can be obtained by repeating imaging until an image with a high quality score can be obtained. In addition, for a registration target with small eyes, by changing the threshold value to a low value, even if an image with a high quality score is difficult to obtain, a face image and an iris image to be registered can be easily selected. On the other hand, for a registration target with large eyes, an image with a high quality score can be easily obtained. Therefore, by performing the registration operation in the second mode, the registration operation can be performed more efficiently. For example, by completing imaging of a face image and an iris image in advance, the time required for imaging (i.e., the time for the registration target to wait in front of the camera) can be shortened. In addition, for a registration target with large eyes, by changing the threshold value to a high value, a face image and an iris image with higher quality can be selected.

[0055] <Third embodiment> An information processing system 10 according to the third embodiment will be described with reference to Fig. 9 to Fig. 11. The third embodiment differs from the first and second embodiments in part of its configuration and operation, and other parts may be the same as the first and second embodiments. Therefore, hereinafter, parts that differ from the embodiments already described will be described in detail, and other overlapping parts will be omitted as appropriate.

[0056] (Functional configuration) First, the functional configuration of the information processing system 10 according to the third embodiment will be described with reference to Fig. 9. Fig. 9 is a block diagram showing the functional configuration of the information processing system according to the third embodiment. In Fig. 9, the same elements as those shown in Fig. 3 are denoted by the same reference numerals.

[0057] As shown in FIG. 9, the information processing system 10 according to the third embodiment includes, as components for realizing its functions, a face camera 18, an iris camera 19, an image acquisition unit 110, a score calculation unit 120, a selection unit 130, a registration information database (DB) 210, an order output unit 220, and an authentication unit 230. That is, the information processing system 10 according to the third embodiment further includes the registration information database 210, the order output unit 220, and the authentication unit 230 in addition to the configuration of the first embodiment (see FIG. 3). The registration information database 210 may be realized by, for example, the storage device 14 described above. Moreover, each of the order output unit 220 and the authentication unit 230 may be a processing block realized by, for example, the processor 11 described above (see FIG. 1).

[0058] The registration information database 210 is a database configured to be able to store a registration image used for authentication. The registration information database 210 stores a face image and an iris image selected by the selection unit 130. Alternatively, the registration information database 210 may store features extracted from the face image and the iris image selected by the selection unit 130. The registration information database 210 may be configured to be able to store a face image and an iris image in association with each other. However, the registration information database 210 may be configured to be able to store only one of a face image and an iris image. An expiration date may be set for the information stored in the registration information database 210. For example, information about a temporary guest may be automatically deleted after a predetermined period of time (for example, one week) has elapsed since registration. The information stored in the registration information database 210 may be configured to be able to be confirmed by a user having a predetermined authority (for example, a system administrator, a registered user, etc.). The face image and the iris image stored in the registration information database 210 can be read out as appropriate by the authentication unit 230 described later.

[0059] The order output unit 220 is configured to be able to output information on the order of authentication (hereinafter, appropriately referred to as "order information") when at least one of the face image and the iris image acquired during authentication includes a plurality of authentication targets. More specifically, the order output unit 220 is configured to be able to output the order information so as to superimpose it on a screen on which a plurality of authentication targets are shown. The order of authentication may be determined, for example, based on the size of the authentication target in the image. For example, the order may be determined so that the authentication target that appears the largest is the first to be the order, and the authentication target that appears the smallest is the last to be the order. Alternatively, the authentication may be performed in the order of proximity to the camera using an image of the eye distance or a depth camera. However, the order of authentication may be determined randomly. The order information may be output to a plurality of authentication targets. The order information may be displayed as an image using a display or the like, or may be output as an audio using a speaker or the like. A specific example of output of the order information will be described in detail later.

[0060] The authentication unit 230 is configured to be able to execute authentication processing (i.e., face authentication and iris authentication) by comparing the face image and iris image of the authentication target acquired during authentication with the face image and iris image of the registration target registered in the registration information database 210. The authentication unit 230 may be configured to be able to execute authentication processing using face feature amounts extracted from the face image and iris feature amounts extracted from the iris image. The authentication unit 230 may execute face authentication and iris authentication separately and output an authentication result that integrates the results. For example, the authentication unit 230 may output the authentication result as a success when both the iris authentication and the iris authentication are successful, and may output the authentication result as a failure when at least one of the iris authentication and the iris authentication is unsuccessful. Alternatively, the authentication unit 230 may output the authentication result as a success when at least one of the iris authentication and the iris authentication is successful, and may output the authentication result as a failure when both the iris authentication and the iris authentication are unsuccessful.

[0061] Furthermore, the authentication unit 230 according to the third embodiment performs authentication in accordance with the order information output by the order output 220. For example, when the order output unit 220 outputs order information indicating that the order of target A is "1" and the order of target B is "2", the authentication unit 230 first performs authentication processing for target A, and then performs authentication processing for target B. Note that the order here indicates the order in which the target is to be authenticated; for example, "1" indicates that the target is to be authenticated first, and order "2" indicates that the target is to be authenticated second.

[0062] (Authentication Action) Next, a flow of operations (hereinafter, appropriately referred to as "authentication operations") when performing authentication using a face image and an iris image by the information processing system 10 according to the third embodiment will be described with reference to Fig. 10. Fig. 10 is a flowchart showing the flow of authentication operations by the information processing system according to the third embodiment.

[0063] 10, when the authentication operation by the information processing system 10 according to the third embodiment is started, first, the image acquisition unit 110 acquires a face image and an iris image of an authentication target (step S301). After that, the sequence output unit 220 judges whether or not a plurality of authentication targets are present (i.e., whether or not they are captured) in at least one of the face image and the iris image acquired by the image acquisition unit 110 (step S302).

[0064] If there are multiple authentication targets (step S302: YES), the order output unit 220 determines the order of authentication for the multiple authentication targets and outputs the order information (step S304). In this case, the authentication unit 230 executes authentication processing in the order according to the order information (step S305).

[0065] On the other hand, if there are no multiple authentication targets (step S302: NO), the order output unit 220 does not output order information (i.e., the process of step S303 is omitted). In this case, the authentication unit 230 performs authentication processing as usual for the authentication targets in the image (step S305).

[0066] (Example of order display) Next, an example of displaying the order in the information processing system 10 according to the third embodiment (i.e., an example of outputting information related to the order by the order output unit 220) will be described with reference to Fig. 11. Fig. 11 is a plan view showing an example of displaying the order by the information processing system according to the third embodiment.

[0067] As shown in FIG. 11, the order information may be output as information that displays, for example, a number indicating the order of authentication on an image. In this case, the number indicating the order of authentication may be displayed on each face of a plurality of authentication targets. Alternatively, the order information may be output as information that displays the faces of the authentication targets other than the authentication targets in the order of authentication in a blurred manner. For example, when the order of target A is "1", the order of target B is "2", and the order of target C is "3", the face of target A is displayed normally, and the faces of the other targets are displayed blurred. After that, when the authentication process of target A is completed, the face of target B is displayed normally, and the faces of the other targets are displayed blurred. After that, when the authentication process of target B is completed, the face of target C is displayed normally, and the faces of the other targets are displayed blurred. Note that, when the target whose turn has come is not in the center of the screen (i.e., the appropriate authentication position) but is, for example, on the edge of the screen, in addition to the information indicating the order described above, information for guiding the target to an appropriate position may be output. For example, when authenticating target A and then authenticating target B, if target B is on the edge of the screen, a message such as "Please move a little further to the left" or "Please move in the direction of the arrow on the screen (displaying an arrow pointing in the direction you want the target to move)" may be output to target B while blurring the faces of all other targets. This message may be displayed on the screen or may be output as audio via a speaker or the like.

[0068] (Technical effect) Next, technical effects obtained by the information processing system 10 according to the third embodiment will be described.

[0069] As described in Fig. 9 to Fig. 11, in the information processing system 10 according to the third embodiment, when multiple authentication subjects are photographed, sequence information is output. In this way, the authentication subjects can be informed of the authentication sequence, so that the authentication process can be performed appropriately even when there are multiple authentication subjects. For example, each of the multiple authentication subjects can be guided to an appropriate location at an appropriate time to perform highly accurate authentication process.

[0070] <Fourth embodiment> An information processing system 10 according to the fourth embodiment will be described with reference to Fig. 12 and Fig. 13. The fourth embodiment differs from the first to third embodiments in part of its configuration and operation, and other parts may be the same as the first to third embodiments. Therefore, hereinafter, parts that differ from the embodiments already described will be described in detail, and other overlapping parts will be omitted as appropriate.

[0071] (Functional configuration) First, the functional configuration of the information processing system 10 according to the fourth embodiment will be described with reference to Fig. 12. Fig. 12 is a block diagram showing the functional configuration of the information processing system according to the fourth embodiment. In Fig. 12, the same elements as those shown in Fig. 9 are denoted by the same reference numerals.

[0072] As shown in FIG. 12, the information processing system 10 according to the fourth embodiment includes a face camera 18, an iris camera 19, an image acquisition unit 110, a score calculation unit 120, a selection unit 130, a registration information database 210, an authentication unit 230, an iris position prediction unit 310, and an iris camera adjustment unit 320 as components for realizing the functions of the information processing system 10. That is, the information processing system 10 according to the third embodiment further includes the registration information database 210, the authentication unit 230, the iris position prediction unit 310, and the iris camera adjustment unit 320 in addition to the configuration of the first embodiment (see FIG. 3). The registration information database 210 and the authentication unit 230 may be the same as those of the third embodiment described above. Each of the iris position prediction unit 310 and the iris camera adjustment unit 320 may be a processing block realized by, for example, the above-mentioned processor 11 (see FIG. 1).

[0073] The iris position prediction unit 310 is configured to be capable of predicting the position of the iris of the authentication target when the iris image is captured, based on the distance from the authentication target to the iris camera 19 and the speed of the authentication target. Alternatively, the iris position prediction unit 310 may be configured to be capable of predicting the position of the iris of the authentication target when the iris image is captured, based on the current position of the authentication target. For example, the iris position prediction unit 310 may be configured to be capable of predicting the height of the iris of the authentication target at the focal point of the iris camera 19. The distance from the authentication target to the iris camera 19 and the speed of the authentication target may be acquired using various sensors or may be acquired from the image of the authentication target. The iris position predicted by the iris position prediction unit 310 is configured to be output to the iris camera adjustment unit 320.

[0074] The iris camera adjustment unit 320 is configured to be able to adjust the angle of view of the iris camera 19 based on the position of the iris predicted by the iris position prediction unit 310. The angle of view of the iris camera 19 may be adjusted, for example, by changing the height, left and right position, angle, etc. of the iris camera. For example, the iris camera adjustment unit 320 may adjust the height of the iris camera 19 so that the iris of the target is included in the iris image captured at the focusing point. In this case, the iris camera adjustment unit 320 may adjust the height, for example, by moving the iris camera 19 itself. Alternatively, the iris camera adjustment unit 320 may adjust the height by selecting one iris camera 19 to be used for imaging from among a plurality of iris cameras 19 with different heights. Similarly, the iris camera adjustment unit 320 may adjust the left and right position of the iris camera 19 so that the iris of the target is included in the iris image captured at the focusing point. In this case, the iris camera adjustment unit 320 may adjust the left and right position, for example, by moving the iris camera 19 itself. Alternatively, the iris camera adjustment unit 320 may adjust the left-right position by selecting one iris camera 19 to be used for imaging from among multiple iris cameras 19 with different left-right positions. Similarly, the iris camera adjustment unit 320 may adjust the angle of the iris camera 19 so that the iris of the target is included in the iris image captured at the focus point. In this case, the iris camera adjustment unit 320 may adjust the angle by, for example, moving the iris camera 19 itself. Alternatively, the iris camera adjustment unit 320 may adjust the angle by selecting one iris camera 19 to be used for imaging from among multiple iris cameras 19 with different angles. Note that the iris camera adjustment unit 320 may change any one parameter of the height, left-right position, and angle of the iris camera 19, or may change multiple parameters.

[0075] (Iris imaging operation) Next, a flow of an operation for capturing an iris image by the information processing system 10 according to the fourth embodiment (hereinafter, appropriately referred to as an "iris imaging operation") will be described with reference to Fig. 13. Fig. 13 is a flowchart showing the flow of the iris imaging operation by the information processing system according to the fourth embodiment.

[0076] 13, when the information processing system 10 according to the fourth embodiment starts an iris imaging operation, the iris position prediction unit 310 first acquires the distance between the target and the iris camera 19 (step S401). The iris position prediction unit 310 also acquires the speed of the target (step S402). Note that the processes of steps S401 and S402 may be executed simultaneously in parallel, or may be executed one after the other.

[0077] Next, iris position prediction unit 310 predicts the iris position at the image capture point based on the distance between the acquired target and iris camera 19 and the speed of the target (step S403). Then, iris camera adjustment unit 320 adjusts the angle of view of iris camera 19 based on the iris position predicted by iris position prediction unit 310 (step S404). After that, an iris image of the target is captured by iris camera 19 (step S405).

[0078] (Technical effect) Next, technical effects obtained by the information processing system 10 according to the fourth embodiment will be described.

[0079] 12 and 13, in the information processing system 10 according to the fourth embodiment, the angle of view of the iris camera 19 is adjusted based on the predicted iris position. This makes it possible to more appropriately acquire an iris image. For example, since the angle of view of the iris camera 19 can be adjusted before the subject arrives at the imaging point, it is possible to shorten the time required for authentication and the time required to acquire an iris image.

[0080] <Fifth embodiment> An information processing system 10 according to the fifth embodiment will be described with reference to Fig. 14 and Fig. 15. The fifth embodiment differs from the first to fourth embodiments in part of its configuration and operation, and other parts may be the same as the first to fourth embodiments. Therefore, hereinafter, parts that differ from the embodiments already described will be described in detail, and other overlapping parts will be omitted as appropriate.

[0081] (Functional configuration) First, the functional configuration of the information processing system 10 according to the fifth embodiment will be described with reference to Fig. 14. Fig. 14 is a block diagram showing the functional configuration of the information processing system according to the fifth embodiment. In Fig. 14, the same elements as those shown in Fig. 9 are denoted by the same reference numerals.

[0082] As shown in FIG. 14, the information processing system 10 according to the fifth embodiment includes a face camera 18, an iris camera 19, an image acquisition unit 110, a score calculation unit 120, a selection unit 130, a registration information database 210, an authentication unit 230, and an iris image specification unit 240 as components for realizing the functions of the information processing system 10. That is, the information processing system 10 according to the fifth embodiment further includes the registration information database 210, the authentication unit 230, and the iris image specification unit 240 in addition to the configuration of the first embodiment (see FIG. 3). The registration information database 210 and the authentication unit 230 may be the same as those of the above-mentioned embodiments. The iris image specification unit 240 may be a processing block realized by, for example, the above-mentioned processor 11 (see FIG. 1).

[0083] The iris image specifying unit 240 is configured to be able to specify an iris image in which eyelashes are not covering the iris from among a plurality of iris images. It is possible to appropriately adopt existing technology as a method for determining whether eyelashes are not covering the iris. The iris image specifying unit 240 further outputs an image in which eyelashes are not covering the iris as an iris image to be used for authentication. In other words, the iris image specifying unit 240 does not output an image in which eyelashes are covering the iris as an iris image to be used for authentication. It is to be noted that, when there are a plurality of images in which eyelashes are not covering the iris, the iris image specifying unit 240 may select and output one of them. For example, the iris image specifying unit 240 may select and output the highest quality image from among the images in which eyelashes are not covering the iris. Furthermore, if there are no images in which the eyelashes do not overlap the iris (i.e., the eyelashes overlap the iris in all images), the iris image specification unit 240 may output an instruction to the image acquisition unit 110 to acquire further images.

[0084] (Authentication Action) Next, a flow of an authentication operation by the information processing system 10 according to the fifth embodiment will be described with reference to Fig. 15. Fig. 15 is a flowchart showing a flow of an authentication operation by the information processing system according to the fifth embodiment. In Fig. 15, the same processes as those shown in Fig. 10 are denoted by the same reference numerals.

[0085] 15, when an authentication operation by the information processing system 10 according to the fifth embodiment is started, the image acquisition unit 110 first acquires a face image and an iris image of an authentication target (step S301). In particular, in the fifth embodiment, a plurality of images are acquired, at least for the iris image.

[0086] Next, the iris image specification unit 240 specifies an image in which eyelashes do not cover the iris from among the multiple iris images, and outputs the image as an image to be used for authentication (step S501).Then, the authentication unit 230 executes authentication processing using the iris image output from the iris image specification unit 240 (step S303).

[0087] (Technical effect) Next, technical effects obtained by the information processing system 10 according to the fifth embodiment will be described.

[0088] 14 and 15, in the information processing system 10 according to the fifth embodiment, an iris image in which eyelashes do not overlap the iris is specified from among a plurality of iris images and used for authentication. In this way, it is possible to suppress a decrease in authentication accuracy caused by eyelashes.

[0089] Sixth Embodiment An information processing system 10 according to the sixth embodiment will be described with reference to Fig. 16 and Fig. 17. The sixth embodiment differs from the fifth embodiment described above only in part of its configuration and operation, and other parts may be the same as the first to fifth embodiments. Therefore, hereinafter, parts that differ from the embodiments already described will be described in detail, and other overlapping parts will be omitted as appropriate.

[0090] (Functional configuration) First, the functional configuration of the information processing system 10 according to the sixth embodiment will be described with reference to Fig. 16. Fig. 16 is a block diagram showing the functional configuration of the information processing system according to the sixth embodiment. In Fig. 16, the same elements as those shown in Fig. 14 are denoted by the same reference numerals.

[0091] 16, the information processing system 10 according to the sixth embodiment includes, as components for realizing its functions, a face camera 18, an iris camera 19, an image acquisition unit 110, a score calculation unit 120, a selection unit 130, a registration information database 210, an authentication unit 230, and an iris image complementation unit 245. That is, the information processing system 10 according to the sixth embodiment includes an iris image complementation unit 245 instead of the iris image specification unit 240 in the configuration of the fifth embodiment (see FIG. 14). The iris image complementation unit 245 may be a processing block realized by, for example, the above-mentioned processor 11 (see FIG. 1).

[0092] The iris image complementing unit 245 is configured to be able to synthesize a plurality of iris images in which eyelashes are covering, and complement the area in which the eyelashes are covering. For example, when there are a plurality of images in which eyelashes are covering the iris, the area in which the eyelashes are covering the eyelashes (i.e., the iris area that is hidden by the eyelashes) differs for each image. Therefore, by synthesizing a plurality of iris images, the area in which the eyelashes are covering the respective images can be complemented. When synthesizing a plurality of iris images, for example, a process of masking the eyelashes portion and adding the images together may be performed. The iris image complementing unit 245 may output the iris image complemented by the synthesis as an iris image to be used for authentication. Note that, when there is an image in which the eyelashes are not covering the iris, the iris image complementing unit 245 may omit the process of synthesizing the iris images. In addition, if the area where the eyelashes are present cannot be complemented even after combining multiple images (i.e., there is insufficient information to complement), the iris image complement unit 245 may output an instruction to the image acquisition unit 110 to acquire further images.

[0093] (Authentication Action) Next, a flow of an authentication operation by the information processing system 10 according to the sixth embodiment will be described with reference to Fig. 17. Fig. 17 is a flowchart showing a flow of an authentication operation by the information processing system according to the sixth embodiment. In Fig. 17, the same processes as those shown in Fig. 15 are denoted by the same reference numerals.

[0094] 17, when the authentication operation by the information processing system 10 according to the sixth embodiment is started, the image acquisition unit 110 first acquires a face image and an iris image of an authentication target (step S301). In particular, in the fifth embodiment, a plurality of images are acquired, at least for the iris image.

[0095] Next, the iris image complementing unit 245 combines a plurality of iris images to complement the area where the eyelashes overlap the iris (step S601). Then, the authentication unit 230 executes the authentication process using the iris image combined by the iris image complementing unit 245 (step S303).

[0096] (Technical effect) Next, technical effects obtained by the information processing system 10 according to the sixth embodiment will be described.

[0097] 16 and 17, in the information processing system 10 according to the sixth embodiment, a plurality of iris images are synthesized to complement the area covered by eyelashes. In this way, it is possible to suppress a decrease in authentication accuracy caused by eyelashes.

[0098] Seventh embodiment An information processing system 10 according to the seventh embodiment will be described with reference to Fig. 18. The seventh embodiment differs from the first to sixth embodiments described above only in part of the configuration and operation, and other parts may be the same as the first to sixth embodiments. Therefore, hereinafter, parts that differ from the embodiments already described will be described in detail, and explanations of other overlapping parts will be omitted as appropriate.

[0099] (Functional configuration) First, the functional configuration of the information processing system 10 according to the seventh embodiment will be described with reference to Fig. 18. Fig. 18 is a block diagram showing the functional configuration of the information processing system according to the seventh embodiment. In Fig. 18, the same elements as those shown in Fig. 9 are denoted by the same reference numerals.

[0100] 18, the information processing system 10 according to the seventh embodiment includes, as components for implementing its functions, a face camera 18, an iris camera 19, an image acquisition unit 110, a score calculation unit 120, a selection unit 130, a registration information database 210, and an authentication unit 230. In particular, the authentication unit 230 according to the seventh embodiment includes a first authentication application 231 and a second authentication application 232.

[0101] The first authentication application 231 and the second authentication application 232 are configured as applications capable of executing authentication processing. The first authentication application 231 and the second authentication application 232 are configured to be capable of executing authentication processing for different authentication targets. For example, the first authentication application 231 is configured to be capable of executing authentication processing for a first authentication target, and the second authentication application 232 is configured to be capable of executing authentication processing for a second authentication target. The first authentication application 231 and the second authentication application each have functions necessary for authentication, such as a process for detecting a face or iris, a process for extracting features from a face image or iris image, and a process for performing authentication using the extracted features. In particular, the first authentication application 231 and the second authentication application 232 are configured to be capable of running in parallel. For example, while the first authentication application 231 is executing authentication processing for target A, the second authentication application 232 is capable of executing authentication processing for target B. Note that, although an example in which the authentication unit 230 includes two authentication applications is described here, the authentication unit 230 may be configured to include, for example, three or more authentication applications. In this case, the three or more applications may be configured to run in parallel. A plurality of applications including the first authentication application 231 and the second authentication application 232 may be configured to run on one terminal.

[0102] (Technical effect) Next, technical effects obtained by the information processing system 10 according to the seventh embodiment will be described.

[0103] As described in Fig. 18, in the information processing system 10 according to the seventh embodiment, the first authentication application 231 and the second authentication application 232 can run in parallel. This allows authentication processes for multiple authentication targets to be executed simultaneously in parallel, making it possible to perform authentication more efficiently. Furthermore, by running multiple applications on one terminal, it is possible to perform authentication using the faces and irises of multiple targets on one terminal (i.e., without using multiple terminals).

[0104] Eighth embodiment An information processing system 10 according to the eighth embodiment will be described with reference to Fig. 19. The eighth embodiment differs from the seventh embodiment described above only in some operations, and other parts may be the same as the first to seventh embodiments. Therefore, hereinafter, parts that differ from the embodiments already described will be described in detail, and other overlapping parts will be omitted as appropriate.

[0105] (Authentication Action) First, an authentication operation by the information processing system 10 according to the eighth embodiment will be described with reference to Fig. 19. Fig. 19 is a plan view showing a specific example of the authentication operation by the information processing system according to the eighth embodiment.

[0106] 19, in the authentication operation by the information processing system 10 according to the eighth embodiment, authentication processing is performed using a face image and an iris image in which a plurality of authentication targets are captured. Specifically, the authentication unit 230 according to the eighth embodiment is capable of performing authentication processing using a face image of the authentication target and an image of one eye of the authentication target.

[0107] For example, the authentication process for target A is performed using a portion of the face image shown in FIG. 19(a) that includes target A and a portion of the iris image shown in FIG. 19(b) that includes the left eye of target A. This authentication process may be executed by, for example, the first authentication application 231 (see FIG. 18). Moreover, the authentication process for target B is performed using a portion of the face image shown in FIG. 19(a) that includes target B and a portion of the iris image shown in FIG. 19(b) that includes the right eye of target B. This authentication process may be executed by, for example, the second authentication application 231 (see FIG. 18).

[0108] (Technical effect) Next, technical effects obtained by the information processing system 10 according to the eighth embodiment will be described.

[0109] As described in FIG. 19, in the information processing system 10 according to the eighth embodiment, the authentication process is performed for multiple authentication targets using a face image and a single-eye image. In this way, even if multiple authentication targets are captured in one image, it is possible to perform the authentication process appropriately. In addition, by running multiple applications on one terminal, it is possible to perform authentication using the faces and irises of multiple targets simultaneously on one terminal (i.e., without using multiple terminals).

[0110] <Ninth embodiment> An information processing system 10 according to the ninth embodiment will be described with reference to Fig. 20 to Fig. 22. The ninth embodiment differs from the first to eighth embodiments described above only in part of the configuration and operation, and other parts may be the same as the first to eighth embodiments. Therefore, hereinafter, parts that differ from the embodiments already described will be described in detail, and explanations of other overlapping parts will be omitted as appropriate.

[0111] (Functional configuration) First, the functional configuration of the information processing system 10 according to the ninth embodiment will be described with reference to Fig. 20. Fig. 20 is a block diagram showing the functional configuration of the information processing system according to the ninth embodiment. In Fig. 20, the same elements as those shown in Fig. 3 are denoted by the same reference numerals.

[0112] 20, the information processing system 10 according to the ninth embodiment is configured to include, as components for realizing its functions, a face camera 18, an iris camera 19, an image acquisition unit 110, a score calculation unit 120, a selection unit 130, a superimposed display unit 330, and an imaging control unit 340. That is, the information processing system 10 according to the ninth embodiment further includes the superimposed display unit 330 and the imaging control unit 340 in addition to the configuration of the first embodiment (see FIG. 3). Each of the superimposed display unit 330 and the imaging control unit 340 may be a processing block realized by, for example, the above-mentioned processor 11 (see FIG. 1).

[0113] The superimposed display unit 330 is configured to be able to superimpose and display a first mark around the eye of the registration target after capturing a face image of the registration target. The first mark may be displayed, for example, as a frame surrounding the eye of the registration target. For example, when the position of the eye in the image changes, the first mark is displayed so as to follow the eye. The superimposed display unit 330 is also configured to be able to superimpose and display a second mark indicating a size of the eye area suitable for capturing an iris image. The second mark is displayed, for example, as a mark having a shape that overlaps with the first mark. For example, when the first mark is in the shape of a frame surrounding the eye area as described above, the second mark may also be in the shape of a frame. The size of the second mark may be set in advance. For example, the second mark may be set to a size that allows capturing an iris image with a sufficient number of pixels for iris authentication.

[0114] Imaging control unit 340 is configured to be able to control iris camera 19. Specifically, imaging control unit 340 controls iris camera 19 to capture an iris image when the first mark overlaps with the second mark.

[0115] (Example) Next, a display example by the information processing system 10 according to the ninth embodiment will be described with reference to Fig. 21 and Fig. 22. Fig. 21 is a plan view (part 1) showing a display example in the information processing system according to the ninth embodiment. Fig. 22 is a plan view (part 2) showing a display example in the information processing system according to the ninth embodiment. Note that, below, an example will be described in which the face camera 18 and the iris camera 19 are a single common camera (for example, a camera mounted on a smartphone).

[0116] As shown in FIG. 21, when the information processing system 10 according to the sixth embodiment operates, first, a face image of a registration target is captured. After that, the superimposed display unit 330 displays a first mark (a frame surrounding the eye periphery) around the eye of the registration target. Then, the superimposed display unit 220 further displays a second mark (a frame shown by a dashed line in the figure) indicating the size of the eye periphery suitable for capturing an iris image in a superimposed manner. At this time, a message such as "Please bring your face closer so that the frames overlap" may be output to prompt the target to take action. This message may be displayed in the image, for example, or may be output as audio.

[0117] As the face of the registration target approaches, the captured face of the registration target is displayed larger in the display area. Accordingly, the first marks superimposed around the eyes also become larger. Meanwhile, the size of the second marks does not change. Thereafter, when the first mark overlaps the second mark (i.e., when the first mark and the second mark become the same size), an iris image of the registration target is captured.

[0118] As shown in Fig. 22, if the first mark and the second mark do not overlap, a message may be output to the registration target to allow the iris image to be captured properly. For example, as shown in Fig. 22, if the eye position is shifted downward, a message may be output saying, "Point the terminal (camera) downward so that the frames overlap." This message may be displayed in the image, or may be output as audio, for example.

[0119] (Technical effect) Next, technical effects obtained by the information processing system 10 according to the ninth embodiment will be described.

[0120] As described in FIG. 20 to FIG. 22, in the information processing system 10 according to the ninth embodiment, the first mark and the second mark guide the user to an appropriate positional relationship between the registration target and the camera. In this way, after capturing a face image, an iris image can be captured appropriately. For example, it is possible to capture an iris of an appropriate size while keeping the iris within the capture range. Furthermore, when the appropriate distance to the camera and the capture range differ between the face image and the iris image, it is possible to obtain an image of an appropriate size for each image.

[0121] Tenth embodiment An information processing system 10 according to the tenth embodiment will be described with reference to Fig. 23 to Fig. 25. The tenth embodiment differs from the first to ninth embodiments described above only in part of the configuration and operation, and other parts may be the same as the first to ninth embodiments. Therefore, hereinafter, parts that differ from the embodiments already described will be described in detail, and explanations of other overlapping parts will be omitted as appropriate.

[0122] (Functional configuration) First, the functional configuration of the information processing system 10 according to the tenth embodiment will be described with reference to Fig. 23. Fig. 23 is a block diagram showing the functional configuration of the information processing system according to the tenth embodiment. In Fig. 23, the same elements as those shown in Fig. 9 are denoted by the same reference numerals.

[0123] As shown in FIG. 23, the information processing system 10 according to the tenth embodiment includes a face camera 18, an iris camera 19, an image acquisition unit 110, a score calculation unit 120, a selection unit 130, a registration information database 210, an authentication unit 230, a first registration control unit 250, and a second registration control unit 260 as components for realizing the functions of the information processing system 10. That is, the information processing system 10 according to the tenth embodiment further includes the registration information database 210, the authentication unit 230, the first registration control unit 250, and the second registration control unit 260 in addition to the configuration of the first embodiment (see FIG. 3). The registration information database 210 and the authentication unit 230 may be the same as those of the above-mentioned embodiments. Each of the first registration control unit 250 and the second registration control unit 260 may be a processing block realized by, for example, the above-mentioned processor 11 (see FIG. 1).

[0124] The first registration control unit 250 is configured to be capable of performing control so as to register only the face image captured by the first terminal when the quality score of the iris image captured by the first terminal is equal to or lower than a predetermined threshold (for example, when the performance of the camera mounted on the first terminal is low and an appropriate iris image cannot be captured, etc.). In addition, the first registration control unit 250 is configured to be capable of performing control so as to register (i.e., store in the registration information database 210) only the face image captured by the first terminal when the iris image cannot be captured by the first terminal (for example, when the first terminal is not equipped with a camera capable of capturing an iris image, etc.). An example of the first terminal is a terminal with a relatively low camera performance such as a smartphone, or a terminal not equipped with a camera capable of capturing an iris image.

[0125] The second registration control unit 260 is configured to be capable of executing control to capture and register an iris image of the authentication target at the second terminal (i.e., store it in the registration information database 210) if the iris image of the authentication target is not registered (i.e., only the face image is registered by the first registration control unit 250) when authentication using a face image is performed at the second terminal. An example of the second terminal is a terminal with a relatively high camera performance, such as a dedicated authentication terminal.

[0126] (Operation of the first registration control unit) Next, the operation of the first registration control unit 250 in the information processing system 10 according to the tenth embodiment will be described with reference to Fig. 24. Fig. 24 is a flowchart showing the flow of the operation by the first registration control unit of the information processing system according to the tenth embodiment.

[0127] 24, when the registration operation by the information processing system 10 according to the tenth embodiment is started, first, the image acquisition unit 110 acquires a face image and an iris image captured by the first terminal (step S1001). Note that if the iris image cannot be captured by the first terminal, the image acquisition unit 110 may acquire only the face image.

[0128] Next, the score calculation unit 120 calculates the scores of the face image and the iris image acquired by the image acquisition unit 110 (step S1002). Then, the first registration control unit 250 determines whether or not there is an iris image whose quality score is equal to or greater than a predetermined threshold (step S1003). If an iris image has not been acquired, it may be determined that there is no iris image whose quality score is equal to or greater than the predetermined threshold.

[0129] If there is an iris image whose quality score is equal to or greater than the predetermined threshold (step S1003: YES), the first registration control unit 250 outputs an instruction to the selection unit 130 to select and register face images and iris images whose quality scores are equal to or greater than the predetermined threshold (step S1004). On the other hand, if there is no iris image whose quality score is equal to or greater than the predetermined threshold (step S1003: NO), the first registration control unit 250 outputs an instruction to the selection unit 130 to select and register only face images whose quality scores are equal to or greater than the predetermined threshold (step S1005). That is, in this case, the iris image is not registered.

[0130] (Operation of the second registration control unit) Next, the operation of the second registration control unit 260 in the information processing system 10 according to the tenth embodiment will be described with reference to Fig. 25. Fig. 25 is a flowchart showing the flow of the operation by the second registration control unit of the information processing system according to the tenth embodiment.

[0131] 25, when the authentication operation by the information processing system 10 according to the tenth embodiment is started, first, the image acquisition unit 110 acquires a face image captured by the second terminal (step S1101). Note that, although it is sufficient to acquire at least a face image here, an iris image may also be acquired.

[0132] Next, the authentication unit 230 performs face authentication using the face image acquired by the image acquisition unit 110 (step S1012). Here, the second registration control unit 260 determines whether or not the iris image of the authenticated authentication target is unregistered (i.e., whether or not it is not stored in the registration information database 210) (step S1013).

[0133] If the iris image is not registered (step S1013: YES), the second registration control unit 260 proceeds to a phase of registering the iris image to be authenticated (step S1014). That is, a process is performed in which an iris image is acquired, its quality score is calculated, and an iris image to be registered is selected based on the calculated quality score. Note that iris authentication may be performed after the iris image is registered.

[0134] On the other hand, if the iris image is registered (step S1013: NO), the second registration control unit 260 outputs an instruction to the authentication unit 230 to acquire an iris image and perform iris authentication (step S1015). Note that if an iris image is also acquired when acquiring a face image, an instruction may be given to perform iris authentication using the iris image acquired at that time.

[0135] (Technical effect) Next, technical effects obtained by the information processing system 10 according to the tenth embodiment will be described.

[0136] As described in Fig. 23 to Fig. 25, in the information processing system 10 according to the tenth embodiment, only a face image is registered in the first terminal, and an iris image is registered in the second terminal. In this way, even if it is not possible to register both a face image and an iris image in one terminal, it is possible to register an iris image when authentication is performed in another terminal. Note that, since the registration of an iris image is performed after authentication using an already registered face image, the identity of the target is also guaranteed.

[0137] <Eleventh embodiment> An information processing system 10 according to an eleventh embodiment will be described with reference to Fig. 26 and Fig. 27. The eleventh embodiment differs from the first to tenth embodiments in part of its configuration and operation, and other parts may be the same as the first to tenth embodiments. Therefore, hereinafter, parts that differ from the embodiments already described will be described in detail, and explanations of other overlapping parts will be omitted as appropriate.

[0138] (Functional configuration) First, the functional configuration of the information processing system 10 according to the 11th embodiment will be described with reference to Fig. 26. Fig. 26 is a block diagram showing the functional configuration of the information processing system according to the 11th embodiment. In Fig. 26, the same reference numerals are used to designate the same elements as those shown in Fig. 9.

[0139] As shown in FIG. 26, the information processing system 10 according to the 11th embodiment includes a face camera 18, an iris camera 19, an image acquisition unit 110, a score calculation unit 120, a selection unit 130, a registration information database 210, an authentication unit 230, and a spoofing detection unit 270 as components for realizing the functions of the information processing system 10. That is, the information processing system 10 according to the 11th embodiment further includes the registration information database 210, the authentication unit 230, and the spoofing detection unit 270 in addition to the configuration of the first embodiment (see FIG. 3). The registration information database 210 and the authentication unit 230 may be the same as those of the above-mentioned embodiments. The spoofing detection unit 270 may be a processing block realized by the above-mentioned processor 11 (see FIG. 1), for example.

[0140] The spoofing detection unit 270 is configured to be able to detect spoofing of a target (for example, spoofing using an image, video, mask, etc.). The spoofing detection unit 270 may perform spoofing detection, for example, during a registration operation. That is, the spoofing detection may be performed using a face image and an iris image of a registration target. The spoofing detection unit 270 may also perform spoofing detection during an authentication operation. That is, the spoofing detection may be performed using a face image and an iris image of an authentication target. A more specific operation of the spoofing detection unit 270 will be described in detail below.

[0141] (Spoofing detection operation) Next, an operation of detecting spoofing (hereinafter referred to as "spoofing detection operation") by the information processing system 10 according to the 11th embodiment (specifically, the spoofing detection unit 270) will be specifically described with reference to Fig. 27. Fig. 27 is a plan view showing an example of the spoofing detection operation by the information processing system according to the 11th embodiment.

[0142] As shown in FIG. 27, the spoofing detection unit 270 detects spoofing when a difference of a predetermined amount or more is detected by comparing an iris area (i.e., an area in which the iris is shown) included in a face image with an iris image. The "difference of a predetermined amount or more" here is a preset threshold for detecting spoofing, and may include, for example, a difference in the feature amount of the iris as well as a difference in the color or pattern of the iris. The difference between the iris area and the iris image may be detected using, for example, eye color, eyelash length, wrinkles around the eyes, etc. In this case, there is a possibility that the subject whose face image was captured and the subject whose iris image was captured are different persons (i.e., one of them is spoofing). For example, a situation is assumed in which a mask (e.g., a 3D mask expressing the facial features of another person) is worn to spoof when capturing a face image, and then the iris image is captured with the mask removed. Note that, when the spoofing detection unit 270 detects spoofing, it may stop the registration operation or the authentication operation. Alternatively, the spoofing detection unit 270 may be configured to output an alert when spoofing is detected.

[0143] (Technical effect) Next, technical effects obtained by the information processing system 10 according to the eleventh embodiment will be described.

[0144] As described in Figures 26 and 27, according to the information processing system 10 of the 11th embodiment, impersonation can be appropriately detected using a face image (specifically, the iris area contained in the face image) and an iris image.

[0145] <Twelfth embodiment> An information processing system 10 according to the twelfth embodiment will be described with reference to Fig. 28 and Fig. 29. The twelfth embodiment differs from the first to eleventh embodiments in part of its configuration and operation, and other parts may be the same as the first to eleventh embodiments. Therefore, hereinafter, parts that differ from the embodiments already described will be described in detail, and explanations of other overlapping parts will be omitted as appropriate.

[0146] (Functional configuration) First, the functional configuration of the information processing system 10 according to the 12th embodiment will be described with reference to Fig. 28. Fig. 28 is a block diagram showing the functional configuration of the information processing system according to the 12th embodiment. In Fig. 28, the same elements as those shown in Fig. 9 are denoted by the same reference numerals.

[0147] As shown in FIG. 28, the information processing system 10 according to the 12th embodiment includes a face camera 18, an iris camera 19, an image acquisition unit 110, a score calculation unit 120, a selection unit 130, a registration information database 210, an authentication unit 230, an information provision unit 280, and an authentication method determination unit 290 as components for realizing the functions of the information processing system 10. That is, the information processing system 10 according to the 12th embodiment further includes the registration information database 210, the authentication unit 230, the information provision unit 280, and the authentication method determination unit 290 in addition to the configuration of the first embodiment (see FIG. 3). The registration information database 210 and the authentication unit 230 may be the same as those of the above-mentioned embodiments. Each of the information provision unit 280 and the authentication method determination unit 290 may be a processing block realized by, for example, the above-mentioned processor 11 (see FIG. 1).

[0148] The information providing unit 280 is configured to be able to provide (i.e., output to the outside of the system) information on the authentication target based on the authentication result of the authentication unit 230. The information on the authentication target may include information such as name, address, telephone number, age, occupation, job title, and account number. In addition, the information on the authentication target may include passport information, as described in other embodiments described later. The passport information may include a plurality of pieces of information. For each of various pieces of information included in the passport information (e.g., name, address, age, etc.), a plurality of layers may be set according to, for example, importance and confidentiality. In addition, the information on the authentication target may include a ticket number, vaccination information, information on whether or not a PCR test has been performed, and the like. These pieces of information may be stored together in, for example, a terminal (e.g., a smartphone) owned by the target. The information providing unit 280 may be configured to provide a plurality of pieces of information. The information provided by the information providing unit 280 may be set in advance, or may be set by the authentication target, a user to whom the information is provided, or the like.

[0149] The authentication method determination unit 290 is configured to be able to determine the authentication method in the authentication unit 230 based on the type of information provided by the information providing unit 280. Specifically, the authentication method determination unit 290 is configured to be able to determine whether authentication is performed using only a face image (face authentication), only an iris image (iris authentication), or both a face image and an iris image (face authentication + iris authentication). It is only necessary that which image is used for authentication is set in advance for each type of information. For example, a first group that performs authentication using only a face image, a second group that performs authentication using only an iris image, and a third group that performs authentication using both a face image and an iris image may be set in advance. It is to be noted that for information in which multiple layers are set, such as the passport information described above, a group may be set for each layer. For example, the "name" included in the passport information may be divided into separate groups, such as the first group, the "age" into the second group, and the "address" into the third group.

[0150] (Authentication method determination operation) Next, an operation of determining an authentication method (hereinafter referred to as an "authentication method determination operation") by the information processing system 10 (specifically, the authentication method determination unit 290) according to the 12th embodiment will be specifically described with reference to Fig. 29. Fig. 29 is a plan view showing an example of the authentication method determination operation by the information processing system according to the 12th embodiment.

[0151] 29, when the authentication method determination operation by the information processing system 10 according to the 12th embodiment starts, the authentication method determination unit 290 first acquires the type of information to be provided (step S1201). Then, the authentication method determination unit 290 determines the group to which the type of information to be provided belongs (step S1202).

[0152] When the type of information to be provided is the first group, the authentication method determination unit 290 sets the authentication method to "face authentication" (step S1203). In this case, if the face authentication is successful (regardless of the result of the iris authentication), information on the authentication target is provided by the information providing unit 280. When the type of information to be provided is the second group, the authentication method determination unit 290 sets the authentication method to "iris authentication" (step S1204). In this case, if the iris authentication is successful (regardless of the result of the face authentication), information on the authentication target is provided by the information providing unit 280. When the type of information to be provided is the third group, the authentication method determination unit 290 sets the authentication method to "face authentication + iris authentication" (step S1205). In this case, if both the iris authentication and the iris authentication are successful, information on the authentication target is provided by the information providing unit 280.

[0153] (Technical effect) Next, technical effects obtained by the information processing system 10 according to the twelfth embodiment will be described.

[0154] 28 and 29, in the information processing system 10 according to the 12th embodiment, the authentication method is determined based on the type of information to be provided. In this way, it is possible to provide information by performing appropriate authentication processing according to the quality and content of the information.

[0155] <Thirteenth embodiment> An information processing system 10 according to the thirteenth embodiment will be described with reference to Fig. 30. The thirteenth embodiment differs from the twelfth embodiment described above only in part of the configuration and operation, and other parts may be the same as the first to twelfth embodiments. Therefore, hereinafter, parts that differ from the embodiments already described will be described in detail, and explanations of other overlapping parts will be omitted as appropriate.

[0156] (Functional configuration) First, the functional configuration of the information processing system 10 according to the 13th embodiment will be described with reference to Fig. 30. Fig. 30 is a block diagram showing the functional configuration of the information processing system according to the 13th embodiment. In Fig. 30, the same elements as those shown in Fig. 28 are denoted by the same reference numerals.

[0157] As shown in FIG. 30, the information processing system 10 according to the 13th embodiment includes a face camera 18, an iris camera 19, an image acquisition unit 110, a score calculation unit 120, a selection unit 130, a registration information database 210, an authentication unit 230, and a passport information provision unit 285 as components for realizing the functions of the information processing system 10. That is, the information processing system 10 according to the 13th embodiment includes a passport information provision unit 285 instead of the information provision unit 280 and the authentication method determination unit 290 in the configuration of the 12th embodiment (see FIG. 28). The passport information provision unit 285 may be a processing block realized by, for example, the above-mentioned processor 11 (see FIG. 1). The passport information provision unit 285 may be configured as a part of the information provision unit 280 (see FIG. 28) in the 12th embodiment. The information processing system 10 according to the 13th embodiment may also include the authentication method determination unit 290 (see FIG. 28) described in the 12th embodiment.

[0158] The passport information providing unit 285 is configured to be able to provide (i.e., output to the outside of the system) information on the passport to be authenticated based on the authentication result of the authenticating unit 230. The passport information providing unit 285 is further configured to be able to provide, in addition to the passport information, information on the issuance certificate of the passport issuer (for example, information proving that the passport was issued by the Ministry of Foreign Affairs of Japan) and information on the face of the person to be authenticated (for example, a facial image or features extracted from the facial image, etc.). In addition, the passport information providing unit 285 may be configured to be able to provide information on the validity period of the passport, etc.

[0159] (Technical effect) Next, technical effects obtained by the information processing system 10 according to the thirteenth embodiment will be described.

[0160] 30, in the information processing system 10 according to the thirteenth embodiment, in addition to passport information, information on the issuance certificate and information on the face of the authentication target are provided. In this way, it is possible to appropriately provide passport information and information that may be used in conjunction with the passport information.

[0161] <Fourteenth embodiment> An information processing system 10 according to the fourteenth embodiment will be described with reference to Fig. 31. The fourteenth embodiment differs from the thirteenth embodiment described above only in part of the configuration and operation, and other parts may be the same as the first to thirteenth embodiments. Therefore, hereinafter, parts that differ from the embodiments already described will be described in detail, and explanations of other overlapping parts will be omitted as appropriate.

[0162] (Functional configuration) First, the functional configuration of the information processing system 10 according to the 14th embodiment will be described with reference to Fig. 31. Fig. 31 is a block diagram showing the functional configuration of the information processing system according to the 14th embodiment. In Fig. 31, the same elements as those shown in Fig. 3 are denoted by the same reference numerals.

[0163] As shown in FIG. 31, the information processing system 10 according to the 14th embodiment is configured to include a face camera 18, an iris camera 19, an image acquisition unit 110, a score calculation unit 120, a selection unit 130, an illumination 51, a display 52, and an illumination control unit 350 as components for realizing the functions of the information processing system 10. That is, the information processing system 10 according to the 14th embodiment further includes an illumination 51, a display 52, and an illumination control unit 350 in addition to the configuration of the first embodiment (see FIG. 3). Note that it is not necessary to include both the illumination 51 and the display 52, and it is sufficient that at least one of them is provided. The illumination control unit 350 may be a processing block realized by, for example, the above-mentioned processor 11 (see FIG. 1).

[0164] Illumination 51 is configured to be capable of emitting illumination light when imaging is performed by face camera 18 and iris camera 19. Illumination 51 may be provided in a terminal equipped with at least one of face camera 18 and iris camera 19, for example, or may be configured as an independent lighting device. Note that the brightness (amount of light) and direction of illumination 51 according to this embodiment are controllable.

[0165] The display 52 displays an image (for example, an image being captured) to a target when capturing an image by the face camera 18 and the iris camera 19. The display 52 may be, for example, a display provided in a terminal equipped with at least one of the face camera 18 and the iris camera 19, or may be configured as an independent display device. Note that the display 52 according to this embodiment is capable of controlling the amount of light to be irradiated from the screen to the target. The display 52 may be capable of controlling the amount of light for each region, for example.

[0166] The illumination control unit 350 is configured to be able to control at least one of the illumination 51 and the display 52. ​​Specifically, the illumination control unit 350 is configured to be able to control at least one of the illumination 51 and the display 52 so that the light irradiated around the target's eyes changes. The illumination control unit 350 according to this embodiment is particularly configured to be able to control the light irradiated around the target's eyes according to the distance to the target's eyes (specifically, the distance between the terminal equipped with the face camera 18 and the iris camera 19 and the target's eyes). For example, the illumination control unit 350 may control so that the light irradiated around the target's eyes is reduced when the distance to the target's eyes is close. In this case, the illumination control unit 350 may execute at least one of the following: control to reduce the amount of light of the illumination 51, control to change the direction of the illumination 51 in a direction away from the target's eyes, control to reduce the overall amount of light of the display 52, and control to reduce the amount of light in an area of ​​the display 52 close to the eye area. Furthermore, the illumination control unit 350 may control so that the light irradiated around the target's eyes is increased when the distance to the target's eyes is far. In this case, the lighting control unit 350 may execute at least one of the following: control to increase the light amount of the lighting 51, control to change the direction of the lighting 51 in a direction to approach the eye of the target, control to increase the light amount of the display 52 as a whole, and control to increase the light amount of the display 52 in an area close to the periphery of the eye. The lighting control unit 350 may control at least one of the lighting 51 and the display 52 in consideration of the moving direction and speed of the target, or the direction and speed of moving the terminal, in addition to the distance to the eye of the target. For example, when the distance between the eye of the target and the terminal is changing in a direction away due to the movement of the target or the terminal, the lighting control unit 350 may control so that more light is irradiated to the periphery of the eye of the target. On the other hand, when the distance between the eye of the target and the terminal is changing in a direction toward the approach, the lighting control unit 350 may control so that less light is irradiated to the periphery of the eye of the target. Also, when the speed of the target or the terminal is high and the distance between the eye of the target and the terminal changes rapidly, the lighting control unit 350 may control so that the light irradiated to the periphery of the eye of the target changes more quickly.On the other hand, when the speed of the subject or the terminal is slow and the distance between the subject's eyes and the terminal changes gradually, the lighting control unit 350 may control the light irradiated around the subject's eyes to change gradually.

[0167] (Technical effect) Next, technical effects obtained by the information processing system 10 according to the fourteenth embodiment will be described.

[0168] 31, in the information processing system 10 according to the fourteenth embodiment, the light irradiated around the target's eye is controlled according to the distance between the target and the eye. In this way, it is possible to reduce the glare felt when capturing an image (especially when capturing an iris image).

[0169] The scope of each embodiment also includes a processing method in which a program that operates the configuration of each embodiment to realize the functions of the above-mentioned embodiments is recorded on a recording medium, the program recorded on the recording medium is read as code, and the program is executed on a computer. That is, a computer-readable recording medium is also included in the scope of each embodiment. Furthermore, not only the recording medium on which the above-mentioned program is recorded, but also the program itself is included in each embodiment.

[0170] Examples of recording media that can be used include floppy disks, hard disks, optical disks, magneto-optical disks, CD-ROMs, magnetic tapes, non-volatile memory cards, and ROMs. In addition, the scope of each embodiment is not limited to programs recorded on the recording media that execute processes by themselves, but also includes programs that operate on an OS in cooperation with other software and functions of an extension board to execute processes. Furthermore, the program itself may be stored in a server, and part or all of the program may be downloaded from the server to a user terminal.

[0171] <Additional Notes> The above-described embodiment may be further described as follows, but is not limited to the following.

[0172] (Appendix 1) The information processing system described in Appendix 1 is an information processing system comprising an image acquisition means for acquiring a facial image and an iris image to be registered, a score calculation means for calculating a quality score indicating the quality of the facial image and the iris image, and a selection means for selecting the facial image and the iris image to be registered based on the quality score.

[0173] (Appendix 2) The information processing system described in Appendix 2 is the information processing system described in Appendix 1, further comprising: a mode switching means for switching between a first mode in which imaging of the face image and the iris image and calculation of the quality score are performed in parallel based on the size of the eyes of the target to be registered, and a second mode in which calculation of the quality score is performed after imaging of the face image and the iris image, and a threshold changing means for changing a threshold of the quality score used when the selection means selects the face image and the iris image to be registered based on the size of the eyes of the target to be registered.

[0174] (Appendix 3) The information processing system described in Appendix 3 is the information processing system described in Appendix 1 or 2, further comprising an order output means for outputting information indicating the order in which the authentication subjects are to be authenticated in a manner superimposed on a screen showing the multiple authentication subjects when multiple authentication subjects are included in at least one of a face image and an iris image used for authentication.

[0175] (Appendix 4) The information processing system described in Appendix 4 is the information processing system described in any one of Appendixes 1 to 3, further comprising a prediction means for predicting the position of the iris of the authentication subject when capturing the iris image based on the distance from the authentication subject to an iris camera and the speed of the authentication subject, and an iris camera adjustment means for adjusting the angle of view of the iris camera based on the predicted iris position.

[0176] (Appendix 5) The information processing system described in Appendix 5 is the information processing system described in any one of Appendixes 1 to 4, further comprising an iris image identification means for identifying an iris image in which eyelashes do not cover the iris from among the multiple iris images, and outputting the iris image as the iris image to be used for authentication.

[0177] (Appendix 6) The information processing system described in Appendix 6 is the information processing system described in any one of Appendixes 1 to 5, further comprising an iris image completion means for synthesizing a plurality of iris images in which eyelashes are present, completing the areas in which the eyelashes are present, and outputting the completed image as an image to be used for authentication.

[0178] (Appendix 7) The information processing system described in Appendix 7 is the information processing system described in any one of claims 1 to 6, wherein the image acquisition means acquires a facial image and iris image of a first authentication subject and a facial image and iris image of a second authentication subject, and further includes a first application that performs authentication using the facial image and iris image of the first authentication subject, a second application that performs authentication using the facial image and iris image of the second authentication subject, and a parallel authentication means that runs the first application and the second application in parallel and controls authentication of the first authentication subject and the second authentication subject, respectively.

[0179] (Appendix 8) The information processing system described in Appendix 8 is the information processing system described in Appendix 7, wherein the parallel authentication means authenticates a first authentication subject using a face image and one-eye image of the first authentication subject, and authenticates the second authentication subject using a face image and one-eye image of the second authentication subject.

[0180] (Appendix 9) The information processing system described in Appendix 9 is the information processing system described in Appendix 1 to 8, further comprising: a superimposition display means for superimposing a first mark around the eye of the registration target after capturing the face image of the registration target, and a second mark indicating a size of the eye area suitable for capturing the iris image, and an imaging control means for controlling the imaging of the iris image of the registration target when the first mark overlaps the second mark.

[0181] (Appendix 10) The information processing system described in Appendix 10 is the information processing system described in any one of Appendixes 1 to 9, further comprising a first registration control means for controlling to register only a facial image captured by the first terminal when the quality score of the iris image captured by the first terminal is below a predetermined threshold or when the iris image cannot be captured, and a second registration control means for controlling to capture and register the iris image at the second terminal when authentication using the facial image is performed at the second terminal and the iris image of the authentication target is not registered.

[0182] (Appendix 11) The information processing system described in Appendix 11 is the information processing system described in any one of Appendixes 1 to 10, further comprising an impersonation detection means for comparing an iris area included in the face image with the iris image and detecting impersonation if a difference equal to or greater than a predetermined value is detected.

[0183] (Appendix 12) The information processing system described in Appendix 12 is the information processing system described in any one of Appendixes 1 to 11, further comprising an information providing means for providing information regarding the authentication subject based on a result of authentication using the face image and the iris image, and a decision means for deciding, based on the type of information to be provided, whether to use only the face image, only the iris image, or both the face image and the iris image for the authentication.

[0184] (Appendix 13) The information processing system described in Appendix 13 is an information processing system described in any one of Appendixes 1 to 12, further comprising a passport information providing means for providing information regarding the passport of the subject to be authenticated based on the result of authentication using the face image and the iris image, and the passport information providing means provides information regarding the passport together with information regarding the passport issuance certificate and information regarding the face of the subject to be authenticated.

[0185] (Appendix 14) The information processing system described in Appendix 14 is the information processing system described in any one of Appendixes 1 to 13, further comprising a lighting control means for controlling at least one of the lighting and the display of the terminal depending on the distance between the terminal and the eyes and the moving speed of the registration subject, the authentication subject or the terminal when capturing the face image and the iris image with the terminal.

[0186] (Appendix 15) The information processing device described in Appendix 15 is an information processing device comprising an image acquisition means for acquiring a facial image and an iris image to be registered, a score calculation means for calculating a quality score indicating the quality of the facial image and the iris image, and a selection means for selecting the facial image and the iris image to be registered based on the quality score.

[0187] (Appendix 16) The information processing method described in Appendix 16 is an information processing method executed by at least one computer, which acquires a face image and an iris image to be registered, calculates a quality score indicating the quality of the face image and the iris image, and selects the face image and the iris image to be registered based on the quality score.

[0188] (Appendix 17) The recording medium described in Appendix 17 is a recording medium having recorded thereon a computer program for causing at least one computer to execute an information processing method of acquiring a facial image and an iris image to be registered, calculating a quality score indicating the quality of the facial image and the iris image, and selecting the facial image and the iris image to be registered based on the quality score.

[0189] (Appendix 18) The computer program described in Appendix 18 is a computer program that causes at least one computer to execute an information processing method of acquiring a facial image and an iris image to be registered, calculating a quality score indicating the quality of the facial image and the iris image, and selecting the facial image and the iris image to be registered based on the quality score.

[0190] This disclosure may be modified as appropriate within the scope that does not contradict the gist or idea of ​​the invention that can be read from the claims and the entire specification, and information processing systems, information processing devices, information processing methods, and recording media that involve such modifications are also included in the technical ideas of this disclosure. [Explanation of symbols]

[0191] 10. Information Processing Systems 11 Processors 18 Face Camera 19. Iris Camera 30 Authentication terminal 35 Camera installation section 40 Display 51 Lighting 52 Display 110 Image acquisition unit 115 Target position detection unit 116 Rotation control section 120 Score Calculation 130 Selection section 140 Mode switching section 150 Threshold change unit 210 Registration Information Database 220 Sequential output section 230 Authentication Department 231 First Authentication App 232 Secondary Authentication App 240 Iris image identification unit 245 Iris Image Completion Unit 250 First registration control unit 260 Second registration control unit 270 Spoofing Detection Unit 280 Information Provision Department 285 Passport Information Section 290 Authentication method determination unit 310 Iris position prediction unit 320 Iris Camera Adjustment Unit 330 Overlay display section 340 Imaging control section 350 Lighting control unit

Claims

1. An image acquisition means for acquiring a face image and an iris image of a registration target; a score calculation means for calculating a quality score indicating a quality of the face image and the iris image; a mode switching means for switching between a first mode in which the facial image and the iris image are captured and the quality score is calculated in parallel, and a second mode in which the facial image and the iris image are captured and then the quality score is calculated, based on the size of the eyes of the registration target; a selection means for selecting the face image and the iris image to be registered based on a comparison of the quality score with a threshold; a threshold value changing means for changing the threshold value based on the size of the eye of the object to be registered; An information processing system comprising:

2. An image acquisition means for acquiring a face image and an iris image of a registration target; a score calculation means for calculating a quality score indicating a quality of the face image and the iris image; a selection means for selecting the face image and the iris image to be registered based on the quality score; an order output means for outputting information indicating an order of authenticating the authentication subjects in a case where a plurality of authentication subjects are included in at least one of a face image and an iris image used for authentication, so as to superimpose and display the information on a screen on which the plurality of authentication subjects are captured and which is presented to the authentication subjects; An information processing system comprising:

3. An image acquisition means for acquiring a face image and an iris image of a registration target; a score calculation means for calculating a quality score indicating a quality of the face image and the iris image; a selection means for selecting the face image and the iris image to be registered based on the quality score; a superimposition display means for superimposing a first mark on the periphery of the eye of the target person to be registered after capturing the face image of the target person to be registered and for superimposing a second mark indicating a size of the periphery of the eye suitable for capturing the iris image; an imaging control means for controlling to capture the iris image of the registration target when the first mark overlaps the second mark; An information processing system comprising:

4. a mode switching means for switching between a first mode in which the facial image and the iris image are captured and the quality score is calculated in parallel, and a second mode in which the facial image and the iris image are captured and then the quality score is calculated, based on the size of the eyes of the registration target; a threshold changing means for changing a threshold of the quality score used when the selecting means selects the face image and the iris image to be registered based on a size of the eye of the registration target; The information processing system according to claim 2 or 3, further comprising:

5. The information processing system according to claim 1 or 3, further comprising an order output means for outputting information indicating the order in which the authentication subjects are to be authenticated in a manner superimposed on a screen showing the multiple authentication subjects when at least one of a face image and an iris image used for authentication includes multiple authentication subjects.

6. A superimposing display means for superimposing a first mark around the eye of the target to be registered after capturing the face image of the target to be registered and for superimposing a second mark indicating a size around the eye suitable for capturing the iris image; an imaging control means for controlling to capture the iris image of the registration target when the first mark overlaps the second mark; The information processing system according to claim 1 or 2, further comprising:

7. a prediction means for predicting a position of the iris of the authentication target when capturing the iris image based on a distance from the authentication target to an iris camera and a speed of the authentication target; an iris camera adjustment means for adjusting an angle of view of the iris camera based on the predicted position of the iris; The information processing system according to claim 1 , further comprising:

8. The information processing system according to claim 1 , further comprising an iris image identification means for identifying an iris image in which eyelashes do not cover the iris from among the plurality of iris images, and outputting the iris image as the iris image to be used for authentication.

9. The information processing system according to any one of claims 1 to 8, further comprising an iris image completion means for synthesizing a plurality of iris images in which eyelashes are present, completing the areas in which the eyelashes are present, and outputting the completed image as an image to be used for authentication.

10. the image acquisition means acquires a face image and an iris image of a first authentication subject and a face image and an iris image of a second authentication subject; a first application for performing authentication using a face image and an iris image of a first authentication subject; a second application for performing authentication using a face image and an iris image of a second authentication subject; a parallel authentication means for running the first application and the second application in parallel and controlling authentication of a first authentication subject and a second authentication subject, respectively; Further comprising: the parallel authentication means performs authentication of a first authentication target using a face image and one-eye image of the first authentication target, and performs authentication of the second authentication target using a face image and one-eye image of the second authentication target; The information processing system according to any one of claims 1 to 9.

11. 1. An information processing method executed by at least one computer, comprising: Acquire a face image and an iris image to be registered; calculating a quality score indicative of a quality of the face image and the iris image; switching between a first mode in which the facial image and the iris image are captured and the quality score is calculated in parallel, and a second mode in which the facial image and the iris image are captured and then the quality score is calculated, based on the size of the eyes of the registration target; selecting the face images and the iris images for enrollment based on a comparison of the quality scores to a threshold; changing the threshold value based on the size of the eye of the registration target; Information processing methods.

12. An information processing method executed by at least one computer, comprising: Acquire a face image and an iris image to be registered; calculating a quality score indicative of a quality of the face image and the iris image; selecting the face image and the iris image for enrollment based on the quality score; When at least one of a face image and an iris image used for authentication includes a plurality of authentication targets, information indicating an order in which the authentication targets are to be authenticated is output so as to be superimposed on a screen on which the plurality of authentication targets are captured and which is presented to the authentication targets. Information processing methods.

13. An information processing method executed by at least one computer, comprising: Acquire a face image and an iris image to be registered; calculating a quality score indicative of a quality of the face image and the iris image; selecting the face image and the iris image for enrollment based on the quality score; After capturing the face image of the registration target, a first mark is superimposed around the eye of the registration target, and a second mark indicating a size around the eye suitable for capturing the iris image is superimposed on the first mark, controlling the camera to capture the iris image of the registration target when the first mark overlaps the second mark; Information processing methods.

14. At least one computer Acquire a face image and an iris image to be registered; calculating a quality score indicative of a quality of the face image and the iris image; switching between a first mode in which the facial image and the iris image are captured and the quality score is calculated in parallel, and a second mode in which the facial image and the iris image are captured and then the quality score is calculated, based on the size of the eyes of the registration target; selecting the face images and the iris images for enrollment based on a comparison of the quality scores to a threshold; changing the threshold value based on the size of the eye of the registration target; A computer program for executing an information processing method.

15. At least one computer, Acquire a face image and an iris image to be registered; calculating a quality score indicative of a quality of the face image and the iris image; selecting the face image and the iris image for enrollment based on the quality score; When at least one of a face image and an iris image used for authentication includes a plurality of authentication targets, information indicating an order in which the authentication targets are to be authenticated is output so as to be superimposed on a screen on which the plurality of authentication targets are captured and which is presented to the authentication targets. A computer program for executing an information processing method.

16. At least one computer, Acquire a face image and an iris image to be registered; calculating a quality score indicative of a quality of the face image and the iris image; selecting the face image and the iris image for enrollment based on the quality score; After capturing the face image of the registration target, a first mark is superimposed around the eye of the registration target, and a second mark indicating a size around the eye suitable for capturing the iris image is superimposed on the first mark, controlling the camera to capture the iris image of the registration target when the first mark overlaps the second mark; A computer program for executing an information processing method.

Images