Information processing system, information processing method, and recording medium

Abstract

An information processing system (10) is provided with: an acquisition means (110) for acquiring an eye image including an eye of a subject; a determination means (120) for determining whether the eye image is an image suitable for storing; a detection means (130) for detecting the opening degree of the eye of the subject in the eye image when the eye image is determined to be unsuitable for storing; and an output means (140) for outputting guide information for the subject to open the eye using fingers on the basis of the opening degree of the eye. According to this information processing system, a high-quality eye image can be obtained by having the subject open an eye.

Description

Information processing system, information processing method, and recording medium

[0001] The present disclosure relates to the technical fields of an information processing system, an information processing method, and a recording medium.

[0002] Known systems of this type output information for improving image quality when capturing an image of the eye. For example, Patent Document 1 discloses a system that determines whether the degree of eyelid opening is equal to or greater than a predetermined value and issues guidance instructions if the degree of eyelid opening is insufficient. Patent Document 2 discloses a system that detects the state of the eyelids of the subject's eye (eyelid opening state) and notifies the examiner if the eyelid state is insufficient.

[0003] International Publication No. 2021 / 245823 Japanese Patent Application Laid-Open No. 2009-131591

[0004] This disclosure aims to improve upon the techniques disclosed in the prior art documents.

[0005] One aspect of the information processing system disclosed herein comprises an acquisition means for acquiring an eye image including the eyes of a subject, a determination means for determining whether the eye image is suitable for registration, a detection means for detecting the degree to which the subject's eyes are open in the eye image when it is determined that the eye image is not suitable for registration, and an output means for outputting guide information to the subject to open their eyes using their fingers based on the degree to which the eyes are open.

[0006] One aspect of the information processing method disclosed herein involves using at least one computer to obtain an eye image including the eyes of a subject, determine whether the eye image is suitable for registration, and if it is determined that the eye image is not suitable for registration, detect the degree to which the subject's eyes are open in the eye image, and output guide information to prompt the subject to open their eyes using their fingers based on the degree to which the eyes are open.

[0007] One aspect of the recording medium of this disclosure is a computer program recorded on at least one computer to execute an information processing method, which includes acquiring an eye image including the eyes of a subject, determining whether the eye image is suitable for registration, and if it is determined that the eye image is not suitable for registration, detecting the degree to which the subject's eyes are open in the eye image, and outputting guide information to encourage the subject to open their eyes using their fingers based on the degree to which the eyes are open.

[0008] 1 is a block diagram showing a hardware configuration of an information processing system according to a first embodiment. FIG. 2 is a block diagram showing a functional configuration of the information processing system according to the first embodiment. FIG. 3 is a flowchart showing an operation flow of the information processing system according to the first embodiment. FIG. 4 is a plan view showing an example of guide information in the information processing system according to the first embodiment. FIG. 5 is a flowchart showing an operation flow of the information processing system according to the second embodiment. FIG. 6 is a plan view showing an example of guide information in the information processing system according to the second embodiment. FIG. 7 is a flowchart showing an operation flow of the information processing system according to the third embodiment. FIG. 8 is a flowchart showing an example of guide information in the information processing system according to the third embodiment. FIG. 9 is a flowchart showing an operation flow of the information processing system according to the fourth embodiment. FIG. 10 is a block diagram showing a functional configuration of an information processing system according to a fifth embodiment. FIG. 11 is a flowchart showing an operation flow of the information processing system according to the fifth embodiment. FIG. 12 is a plan view showing an example of guide information in the information processing system according to the fifth embodiment.

[0009] Hereinafter, embodiments of an information processing system, an information processing method, and a recording medium will be described with reference to the drawings.

[0010] First Embodiment An information processing system according to a first embodiment will be described with reference to FIGS. 1 to 4. FIG.

[0011] (Hardware Configuration) First, the hardware configuration of the information processing system according to the first embodiment will be described with reference to Fig. 1. Fig. 1 is a block diagram showing the hardware configuration of the information processing system according to the first embodiment.

[0012] 1 , an information processing system 10 according to the first embodiment includes a processor 11, a RAM (Random Access Memory) 12, a ROM (Read Only Memory) 13, and a storage device 14. The information processing system 10 may further include an input device 15 and an output device 16. The processor 11, RAM 12, ROM 13, storage device 14, input device 15, and output device 16 are connected via a data bus 17.

[0013] The processor 11 loads a computer program. For example, the processor 11 is configured to load a computer program stored in at least one of the RAM 12, the ROM 13, and the storage device 14. Alternatively, the processor 11 may load a computer program stored in a computer-readable storage medium using a storage medium reading device (not shown). The processor 11 may acquire (i.e., load) the computer program from a device (not shown) located outside the information processing system 10 via a network interface. The processor 11 controls the RAM 12, the storage device 14, the input device 15, and the output device 16 by executing the loaded computer program. In particular, in this embodiment, when the processor 11 executes the loaded computer program, a functional block for outputting guide information when capturing an eye image is realized within the processor 11. That is, the processor 11 may function as a controller that executes each control in the information processing system 10.

[0014] The processor 11 may be configured as, for example, a central processing unit (CPU), a graphics processing unit (GPU), a field-programmable gate array (FPGA), a demand-side platform (DSP), an application-specific integrated circuit (ASIC), or a quantum processor. The processor 11 may be configured as one of these, or may be configured to use multiple processors in parallel.

[0015] The RAM 12 temporarily stores computer programs executed by the processor 11. The RAM 12 temporarily stores data that the processor 11 temporarily uses while it is executing the computer programs. The RAM 12 may be, for example, a dynamic random access memory (D-RAM) or a static random access memory (SRAM). Alternatively, other types of volatile memory may be used instead of the RAM 12.

[0016] The ROM 13 stores computer programs executed by the processor 11. The ROM 13 may also store fixed data. The ROM 13 may be, for example, a programmable read-only memory (PROM) or an erasable read-only memory (EPROM). Alternatively, other types of non-volatile memory may be used instead of the ROM 13.

[0017] The storage device 14 stores data that is to be saved long-term by the information processing system 10. The storage device 14 may operate as a temporary storage device for the processor 11. The storage device 14 may include, for example, at least one of a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and a disk array device.

[0018] The input device 15 is a device that receives input instructions from a user of the information processing system 10. The input device 15 may include, for example, at least one of a keyboard, a mouse, and a touch panel. The input device 15 may be configured as a mobile terminal such as a smartphone or a tablet. The input device 15 may also be, for example, a device that includes a microphone and is capable of voice input.

[0019] The output device 16 is a device that outputs information related to the information processing system 10 to the outside. For example, the output device 16 may be a display device (e.g., a display) that can display information related to the information processing system 10. The output device 16 may also be a speaker or the like that can output information related to the information processing system 10 as audio. The output device 16 may be configured as a mobile terminal such as a smartphone or a tablet. The output device 16 may also be a device that outputs information in a format other than an image. For example, the output device 16 may be a speaker that outputs information related to the information processing system 10 as audio.

[0020] 1 illustrates an example of an information processing system 10 including multiple devices, but all or some of the functions may be realized by a single device (information processing device). In this case, the information processing device may be configured to include only the processor 11, RAM 12, and ROM 13 described above, and the other components (i.e., the storage device 14, input device 15, and output device 16) may be provided by an external device connected to the information processing device. Furthermore, some of the calculation functions of the information processing device may be realized by an external device (e.g., an external server, a cloud, etc.).

[0021] (Functional Configuration) Next, the functional configuration of the information processing system 10 according to the first embodiment will be described with reference to Fig. 2. Fig. 2 is a block diagram showing the functional configuration of the information processing system according to the first embodiment.

[0022] 2, the information processing system 10 according to the first embodiment is configured to include, as components for realizing its functions, an image acquisition unit 110, a quality determination unit 120, an opening degree detection unit 130, and a guide information output unit 140. Each of the image acquisition unit 110, the quality determination unit 120, the opening degree detection unit 130, and the guide information output unit 140 may be a processing block realized by, for example, the above-mentioned processor 11 (see FIG. 1).

[0023] The image acquisition unit 110 is configured to be able to acquire an eye image including the subject's eyes. This eye image is registered as an image showing the subject's eyes. For example, the eye image may be an image registered as a registered image for iris authentication (i.e., an eye image showing the iris of a registered user). The eye image acquired by the image acquisition unit 110 is configured to be output to the quality determination unit 120.

[0024] The quality determination unit 120 is configured to be able to determine whether the eye image acquired by the image acquisition unit 110 is an image suitable for registration. Whether an image is suitable for registration may be determined, for example, based on a score indicating the quality of the eye image. In this case, the quality determination unit 120 may be configured to determine, for example, whether the score indicating the quality of the eye image is equal to or greater than a predetermined threshold. The determination result by the quality determination unit 120 is configured to be output to the eye opening degree detection unit 130.

[0025] The eye opening degree detection unit 130 is configured to detect the eye opening degree of the subject in the eye image when the quality determination unit 120 determines that the eye image is not suitable for registration. For example, the eye opening degree detection unit 130 may detect the degree to which the eyelids overlap the iris or the degree to which the iris is hidden by the eyelids as the eye opening degree. Note that a specific method for detecting the eye opening degree can be appropriately adopted from existing technologies, and therefore a detailed description thereof will be omitted here. The detection result by the eye opening degree detection unit 130 is configured to be output to the guide information output unit 140.

[0026] The guide information output unit 140 is configured to output guide information to prompt the subject to open their eyes using their fingers, based on the degree of eye opening detected by the eye opening degree detection unit 130. For example, the guide information may include information that prompts the subject to open their eyes using their fingers. The guide information may be displayed as an image using a display, for example. Alternatively, the guide information may be output as audio using a speaker. The guide information may be output to a device installed in the vicinity of the subject, or may be output to a terminal or the like held by the subject. Specific examples of guide information will be described in detail later.

[0027] (Operation Flow) Next, the operation flow of the information processing system 10 according to the first embodiment will be described with reference to Fig. 3. Fig. 3 is a flowchart showing the operation flow of the information processing system according to the first embodiment.

[0028] As shown in FIG. 3 , when the operation of the information processing system 10 according to the first embodiment is started, the image acquisition unit 110 first acquires an eye image including the subject's eyes (step S101). Then, the quality determination unit 120 determines whether the eye image acquired by the image acquisition unit 110 is suitable for registration (step S102). If the eye image is determined to be suitable for registration (step S102: YES), the subsequent processes are omitted, and the series of operations ends. In this case, the information processing system 10 may register the eye image determined to be suitable for registration (i.e., store the eye image as the subject's eye image).

[0029] On the other hand, if the eye image is determined to be unsuitable for registration (step S102: NO), the eye opening degree detection unit 130 detects the eye opening degree of the subject in the eye image (step S103). Then, the guide information output unit 140 outputs guide information based on the eye opening degree detected by the eye opening degree detection unit 130 (step S104). This allows the subject to be prompted to open their eyes using their fingers.

[0030] After outputting the guide information, the image acquisition unit 110 may acquire an eye image of the subject with their eyes open using a finger, and then may execute a process of registering the newly acquired eye image (i.e., the eye image whose quality has been improved by opening the eyes) as the eye image of the subject.

[0031] (Example of guide information) Next, a specific example of guide information in the information processing system 10 according to the first embodiment will be described with reference to Fig. 4. Fig. 4 is a plan view showing an example of guide information in the information processing system according to the first embodiment.

[0032] 4, the guide information output by the information processing system 10 according to the first embodiment may be information that prompts the user to push up or down the eyelid that overlaps the iris. For example, when the lower eyelid overlaps the iris (i.e., when the lower side of the iris is hidden), the guide information may include a message such as "Please push down your eyelid with your finger." Also, when the upper eyelid overlaps the iris (i.e., when the upper side of the iris is hidden), the guide information may include a message such as "Please push up your eyelid with your finger."

[0033] The guide information may include an image of a finger or an arrow (i.e., an arrow indicating the direction in which to move the finger) to clearly convey the action to the subject. In this case, the image of the finger or the arrow may be displayed so as to move. For example, when encouraging the subject to press down on their eyelid with their finger, the image of the finger may move downward or the arrow may move so as to extend downward.

[0034] (Technical Effects) Next, technical effects obtained by the information processing system 10 according to the first embodiment will be described.

[0035] As described with reference to FIGS. 1 to 4 , in the information processing system 10 according to the first embodiment, when it is determined that the eye image of a subject is not suitable for enrollment, guide information corresponding to the degree to which the subject's eyes are open (specifically, information prompting the subject to open their eyes using their finger) is output. This allows the subject to be prompted to open their eyes using their finger. As a result, it becomes possible to capture an eye image with the eyes fully open, thereby obtaining a high-quality eye image (e.g., an image in which the entire iris is clearly visible). This makes it possible to improve the accuracy of biometric authentication using, for example, enrolled eye images.

[0036] The effects of this embodiment are particularly pronounced when the subject's eyelids are droopy, swollen with fat, or weak eyelid muscles, or when the motor nerves in the brain that open the eyelids are not functioning properly. Even when guide information such as "open your eyes wide" is output, subjects like those described above are unable to open their eyes wide enough, making it difficult to obtain an appropriate eye image. However, the information processing system 10 according to this embodiment can prompt the subject to open their eyes using their finger, making it possible to obtain an appropriate eye image even from subjects who have difficulty opening their eyes wide.

[0037] Second Embodiment An information processing system 10 according to a second embodiment will be described with reference to Figures 5 and 6. Note that the second embodiment differs from the first embodiment described above only in some of its operations, and other parts may be the same as the first embodiment. Therefore, the following will describe in detail the parts that differ from the first embodiment already described, and will omit a description of other overlapping parts as appropriate.

[0038] (Operation Flow) First, the operation flow of the information processing system 10 according to the second embodiment will be described with reference to Fig. 5. Fig. 5 is a flowchart showing the operation flow of the information processing system according to the second embodiment. Note that in Fig. 5, the same processes as those shown in Fig. 3 are denoted by the same reference numerals.

[0039] 5, when the operation of the information processing system 10 according to the second embodiment starts, the image acquisition unit 110 first acquires an eye image including the subject's eyes (step S101). Then, the quality determination unit 120 determines whether the eye image acquired by the image acquisition unit 110 is suitable for registration (step S102). If it is determined that the eye image is suitable for registration (step S102: YES), the subsequent processes are omitted and the series of operations ends.

[0040] On the other hand, if the eye image is determined to be unsuitable for registration (step S102: NO), the eye opening degree detection unit 130 detects the eye opening degree of the subject in the eye image (step S103). In the second embodiment, the eye opening degree detection unit 130 further detects the eyelid that overlaps with the iris of the subject (step S201). For example, the eye opening degree detection unit 130 detects whether the eyelid that overlaps with the iris is the upper eyelid or the lower eyelid.

[0041] Thereafter, the guide information output unit 140 outputs guide information based on the eye opening degree detected by the eye opening degree detection unit 130 and the eyelid on the side overlapping the iris (step S202). In the guide information according to the second embodiment, in particular, a predetermined highlighting is performed on the eyelid on the side overlapping the iris. The form of highlighting is not particularly limited, and may be, for example, a different display color, a different size or thickness of characters, or a movement (animation).

[0042] (Example of guide information) Next, a specific example of guide information in the information processing system 10 according to the second embodiment will be described with reference to Fig. 6. Fig. 6 is a plan view showing an example of guide information in the information processing system according to the second embodiment.

[0043] As shown in Fig. 6, the guide information output by the information processing system 10 according to the second embodiment highlights the eyelid that overlaps the iris as described above. Specifically, when the iris is hidden by the lower eyelid, the lower eyelid is highlighted. When the iris is hidden by the upper eyelid, the upper eyelid is highlighted. When the iris is hidden by both the upper and lower eyelids, both the upper and lower eyelids may be highlighted. Alternatively, the eyelid that overlaps the iris more than the lower eyelid may be highlighted.

[0044] The highlighting may be applied to the entire upper or lower eyelid, or only to the portion overlapping the iris. In the example shown in FIG. 6 , a thick line in a conspicuous color (e.g., red or fluorescent color) is superimposed on the portion of the eyelid overlapping the iris and flashes at a predetermined interval. In other words, the eyelid that is causing the iris to be obscured (in other words, the eyelid that needs to be opened with a finger) can be made to stand out. The highlighting may also be applied to a portion other than the eyelid. For example, if the iris is obscured by the lower eyelid, the lower half of the eye may be highlighted, and if the iris is obscured by the upper eyelid, the upper half of the eye may be highlighted.

[0045] (Technical Effects) Next, technical effects obtained by the information processing system 10 according to the second embodiment will be described.

[0046] 5 and 6, in the information processing system 10 according to the second embodiment, the eyelid that overlaps with the iris is highlighted in a predetermined manner. In this way, it is possible to properly inform the subject which eyelid to open with the finger.

[0047] Third Embodiment An information processing system 10 according to a third embodiment will be described with reference to Figures 7 and 8. Note that the third embodiment differs from the second embodiment described above only in some of its operations, and other parts may be the same as the first and second embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0048] (Operation Flow) First, the operation flow of the information processing system 10 according to the third embodiment will be described with reference to Fig. 7. Fig. 7 is a flowchart showing the operation flow of the information processing system according to the third embodiment. Note that in Fig. 7, the same processes as those shown in Fig. 5 are denoted by the same reference numerals.

[0049] 7 , when the operation of the information processing system 10 according to the third embodiment is started, the image acquisition unit 110 first acquires an eye image including the eyes of a subject (step S101). Then, the quality determination unit 120 determines whether the eye image acquired by the image acquisition unit 110 is suitable for registration (step S102). If it is determined that the eye image is suitable for registration (step S102: YES), the subsequent processes are omitted and the series of operations ends.

[0050] On the other hand, if it is determined that the eye image is not suitable for registration (step S102: NO), the eye opening degree detection unit 130 detects the eye opening degree of the subject in the eye image (step S103).The eye opening degree detection unit 130 also detects the eyelid that overlaps with the iris of the subject (step S201).

[0051] In the third embodiment, the eye opening degree detection unit 130 further calculates the eye opening force from the eye opening degree (step S301). That is, the eye opening degree calculation unit 130 calculates how much force should be applied to the finger to open the eyes and capture an appropriate image. The eye opening force may be calculated to be weak when the eye opening degree is large and strong when the eye opening degree is small.

[0052] Thereafter, the guide information output unit 140 outputs guide information based on the eye opening degree detected by the eye opening degree detection unit 130, the eyelid overlapping with the iris, and the force for opening the eyes (step S302). In particular, in the guide information according to the third embodiment, the highlighting mode is changed depending on the force for opening the eyes. That is, different highlighting is performed when the force for opening the eyes is strong and when the force for opening the eyes is weak.

[0053] (Example of guide information) Next, a specific example of guide information in the information processing system 10 according to the third embodiment will be described with reference to Fig. 8. Fig. 8 is a plan view showing an example of guide information in the information processing system according to the third embodiment.

[0054] As shown in Fig. 8 , the guide information output by the information processing system 10 according to the third embodiment is highlighted in accordance with the force used to open the eyes. Specifically, when the iris is only slightly hidden (in other words, when a small force is sufficient to open the eyes), the highlighting is performed in blue. On the other hand, when a large portion of the iris is hidden (in other words, when a large force is required to open the eyes), the highlighting is performed in red. Furthermore, when a large portion of the iris is hidden, the image of the finger and the arrow are displayed relatively larger than when the iris is only slightly hidden. Note that the above-described highlighting mode is merely an example, and the display mode may be changed as appropriate so that the strength of the force can be intuitively understood.

[0055] (Technical Effects) Next, technical effects obtained by the information processing system 10 according to the third embodiment will be described.

[0056] 7 and 8, in the information processing system 10 according to the third embodiment, the highlighting mode is changed depending on the strength of the force required to open the eyes with the fingers. In this way, it is possible to appropriately inform the subject of the amount of force required to open the eyelids.

[0057] Fourth Embodiment An information processing system 10 according to a fourth embodiment will be described with reference to Fig. 9. Note that the fourth embodiment differs from the first to third embodiments described above only in some of its operations, and other parts may be the same as the first to third embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0058] (Operation Flow) First, the operation flow of the information processing system 10 according to the fourth embodiment will be described with reference to Fig. 9. Fig. 9 is a flowchart showing the operation flow of the information processing system according to the fourth embodiment. Note that in Fig. 9, the same processes as those shown in Fig. 3 are denoted by the same reference numerals.

[0059] 9 , when the operation of the information processing system 10 according to the fourth embodiment starts, the image acquisition unit 110 first acquires an eye image including the eyes of a subject (step S101). Then, the quality determination unit 120 determines whether the eye image acquired by the image acquisition unit 110 is suitable for registration (step S102). If it is determined that the eye image is suitable for registration (step S102: YES), the subsequent processes are omitted and the series of operations ends.

[0060] On the other hand, if the eye image is determined to be unsuitable for registration (step S102: NO), the eye opening degree detection unit 130 detects the eye opening degree of the subject in the eye image (step S103), and the guide information output unit 140 outputs guide information based on the eye opening degree detected by the eye opening degree detection unit 130 (step S104).

[0061] In the fourth embodiment, the image acquisition unit 110 then acquires an image captured while the subject holds their eyes open with their fingers (hereinafter, appropriately referred to as an "eye-open image") (step S401). The quality determination unit 120 then determines whether the quality of the eye-open image (more specifically, the quality of the iris in the eye-open image) is equal to or exceeds a predetermined quality (step S402). The determination criteria here may be the same as or different from the criteria used to determine whether an image is suitable for registration (i.e., the determination criteria in step S102). For example, the determination criteria in step S402 may be slightly stricter or slightly looser than the determination criteria in step S102.

[0062] If it is determined that the quality of the eye-opening image is equal to or higher than the predetermined quality (step S402: YES), the subsequent processes are omitted and the series of operations ends. At this time, the information processing system 10 may execute a process of registering the eye-opening image as an eye image of the subject.

[0063] On the other hand, if it is determined that the quality of the eye-opening image is lower than the predetermined quality (step S402: NO), the guide information output unit 140 further outputs second guide information for improving the quality of the eye-opening image (step S403). The second guide information may be the same as the initially output guide information (i.e., the guide information output in step S104). Alternatively, the second guide information may be different from the initially output guide information. For example, the second guide information may include information for fine-tuning the subject's eye-opening action, such as "Please push up your eyelids with a little more force." Furthermore, the second guide information may include information other than information for prompting the subject to open their eyes with their fingers. For example, the second guide information may include a message such as "Please move your eyes a little closer to the camera."

[0064] (Technical Effects) Next, technical effects obtained by the information processing system 10 according to the fourth embodiment will be described.

[0065] 9, in the information processing system 10 according to the fourth embodiment, if the image after the output of the guide information is below a predetermined quality, the second guide information is further output. In this way, even if the initially output guide information is not enough to open the eyes, the second guide information can prompt the user to take an action to further improve the quality of the eye image.

[0066] Fifth Embodiment An information processing system 10 according to a fifth embodiment will be described with reference to Figures 10 to 12. The fifth embodiment differs only in part of the configuration and operation from the first to fourth embodiments described above, and other parts may be the same as the first to fourth embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0067] (Functional Configuration) First, the functional configuration of the information processing system 10 according to the fifth embodiment will be described with reference to Fig. 10. Fig. 10 is a block diagram showing the functional configuration of the information processing system according to the fifth embodiment. Note that in Fig. 10, the same elements as those shown in Fig. 2 are denoted by the same reference numerals.

[0068] 10 , the information processing system 10 according to the fifth embodiment is configured to include, as components for realizing its functions, an image acquisition unit 110, a quality determination unit 120, an opening degree detection unit 130, a guide information output unit 140, and a left / right identification unit 150. That is, the information processing system 10 according to the fifth embodiment further includes the left / right identification unit 150 in addition to the configuration of the first embodiment described above (see FIG. 2 ). The left / right identification unit 150 may be a processing block realized by, for example, the processor 11 described above (see FIG. 1 ).

[0069] The left / right identification unit 150 is configured to be able to identify whether the subject is holding a device for capturing an eye image (e.g., a smartphone with a camera) in the right hand or the left hand. The left / right identification unit 150 may determine in which hand the subject is holding the device, for example, based on the output of various sensors (e.g., a tilt sensor, a gyro sensor, etc.) mounted on the device. Alternatively, the left / right identification unit 150 may determine in which hand the subject is holding the device, based on the eye image acquired by the image acquisition unit 110. More specifically, the left / right identification unit 150 may determine in which hand the subject is holding the device, based on the angle of view of the eye image, etc. The identification result by the left / right identification unit 150 is configured to be output to the guide information output unit 140.

[0070] The guide information output unit 140 according to the fifth embodiment is configured to output guide information based on the identification result of the left / right identification unit 150 (i.e., whether the subject is holding the terminal in their right hand or their left hand) in addition to the eye opening degree detected by the eye opening degree detection unit 140. Specific examples of guide information will be described in detail later.

[0071] (Operation Flow) Next, the operation flow of the information processing system 10 according to the fifth embodiment will be described with reference to Fig. 11. Fig. 11 is a flowchart showing the operation flow of the information processing system according to the fifth embodiment. Note that in Fig. 11, the same processes as those shown in Fig. 3 are denoted by the same reference numerals.

[0072] 11 , when the operation of the information processing system 10 according to the fifth embodiment starts, the image acquisition unit 110 first acquires an eye image including the eyes of a subject (step S101). Then, the quality determination unit 120 determines whether the eye image acquired by the image acquisition unit 110 is suitable for registration (step S102). If it is determined that the eye image is suitable for registration (step S102: YES), the subsequent processes are omitted and the series of operations ends.

[0073] On the other hand, if it is determined that the eye image is not suitable for registration (step S102: NO), the eye opening degree detection unit 130 detects the eye opening degree of the subject in the eye image (step S103). Furthermore, in the fifth embodiment, the left / right identification unit 150 further identifies whether the hand holding the terminal is the left or right hand (step S501).

[0074] Thereafter, the guide information output unit 140 outputs guide information based on the eye opening degree detected by the eye opening degree detection unit 130 and information about the hand holding the terminal identified by the left / right identification unit 150 (step S502). The content of the guide information according to the fifth embodiment changes depending in particular on whether the subject is holding the terminal in their right hand or their left hand.

[0075] (Example of guide information) Next, a specific example of guide information in the information processing system 10 according to the fifth embodiment will be described with reference to Fig. 12. Fig. 12 is a plan view showing an example of guide information in the information processing system according to the fifth embodiment.

[0076] 12 , in the information processing system 10 according to the fifth embodiment, when a subject holds a terminal in his / her left hand, guide information is output instructing the subject to open his / her eyes using the fingers of his / her right hand. For example, the guide information may include a message specifying the hand to be used, such as "Please press down your eyelids with the fingers of your right hand." Alternatively, an image of the right hand may be displayed to indicate the hand to be used.

[0077] On the other hand, if the subject is holding the device in their right hand, guide information is output to encourage them to open their eyes using the fingers of their left hand. For example, the guide information may include a message such as "Please push down your eyelids with the fingers of your left hand." An image of a left hand may also be displayed to indicate which hand to use.

[0078] 10 to 12 , the information processing system 10 according to the fifth embodiment outputs guide information that prompts the subject to open their eyes using the fingers of the hand opposite to the hand holding the terminal. In this way, the subject holding the terminal can be prompted to open their eyes in a more easily understandable manner.

[0079] The scope of each embodiment also includes a processing method in which a program that operates the configuration of each embodiment to realize the functions of the above-described embodiments is recorded on a recording medium, the program recorded on the recording medium is read as code, and the program is executed on a computer. In other words, a computer-readable recording medium is also included in the scope of each embodiment. Furthermore, each embodiment includes not only a recording medium on which the above-described program is recorded, but also the program itself.

[0080] Examples of recording media that can be used include floppy disks, hard disks, optical disks, magneto-optical disks, CD-ROMs, magnetic tapes, non-volatile memory cards, and ROMs. Furthermore, the scope of each embodiment is not limited to programs that execute processes by themselves, but also includes programs that execute processes by operating on an OS in conjunction with other software or expansion board functions. Furthermore, the program itself may be stored on a server, and part or all of the program may be downloadable from the server to a user terminal. The program may be provided to the user in, for example, a SaaS (Software as a Service) format.

[0081] <Supplementary Notes> The above-described embodiment may be further described as in the following supplementary notes, but is not limited to the following.

[0082] (Supplementary Note 1) The information processing system described in Supplementary Note 1 is an information processing system including an acquisition means for acquiring an eye image including the eyes of a subject, a determination means for determining whether the eye image is suitable for registration, a detection means for detecting the degree of opening of the subject's eyes in the eye image when it is determined that the eye image is not suitable for registration, and an output means for outputting guide information for encouraging the subject to open their eyes using their finger based on the degree of opening of the eyes.

[0083] (Appendix 2) The information processing system described in Appendix 2 is the information processing system described in Appendix 1, in which the detection means detects the eyelid that overlaps with the iris of the subject, and the output means outputs the guide information with a predetermined highlighting on the eyelid that overlaps with the iris.

[0084] (Appendix 3) The information processing system described in Appendix 3 is the information processing system described in Appendix 2, in which the output means changes the manner of the predetermined highlighting depending on the strength of force required when using a finger to open the eye.

[0085] (Appendix 4) The information processing system described in Appendix 4 is the information processing system described in any one of Appendices 1 to 3, wherein the acquisition means acquires an open-eye image including the eye held open by a finger after outputting the guide information, the determination means determines whether the quality of the iris of the subject in the open-eye image is equal to or higher than a predetermined quality, and the output means further outputs second guide information that improves the quality of the iris if the quality of the iris is less than the predetermined quality.

[0086] (Appendix 5) The information processing system described in Appendix 5 is the information processing system described in any one of Appendices 1 to 3, further comprising an identification means for identifying whether the subject is holding the terminal for capturing the eye image in their right hand or their left hand, and the output means outputs guide information for opening the eyes using the fingers of the hand opposite to the hand holding the terminal.

[0087] (Supplementary Note 6) The information processing method described in Supplementary Note 6 is an information processing method that, by at least one computer, acquires an eye image including the eyes of a subject, determines whether the eye image is suitable for registration, and, if it is determined that the eye image is not suitable for registration, detects the degree to which the subject's eyes are opened in the eye image, and outputs guide information that prompts the subject to open their eyes using their fingers based on the degree to which the eyes are opened.

[0088] (Supplementary Note 7) The recording medium described in Supplementary Note 7 is a recording medium having recorded thereon a computer program for causing at least one computer to execute an information processing method, which includes acquiring an eye image including the eyes of a subject, determining whether the eye image is suitable for registration, and, if it is determined that the eye image is not suitable for registration, detecting the degree to which the eyes of the subject are opened in the eye image, and outputting guide information for prompting the subject to open their eyes using their fingers based on the degree to which the eyes are opened.

[0089] (Supplementary Note 8) The computer program described in Supplementary Note 8 is a computer program that causes at least one computer to execute an information processing method, which acquires an eye image including the eyes of a subject, determines whether the eye image is suitable for registration, and if it is determined that the eye image is not suitable for registration, detects the degree to which the eyes of the subject are opened in the eye image, and outputs guide information to prompt the subject to open their eyes using their fingers based on the degree to which the eyes are opened.

[0090] This disclosure may be modified as appropriate within the scope that does not contradict the gist or idea of ​​the invention that can be read from the claims and the entire specification, and information processing systems, information processing methods, and recording media that involve such modifications are also included in the technical idea of ​​this disclosure.

[0091] REFERENCE SIGNS LIST 10 Information processing system 11 Processor 110 Image acquisition unit 120 Quality determination unit 130 Opening degree detection unit 140 Guide information output unit 150 Left / right identification unit

Claims

1. An acquisition means for acquiring an eye image including an eye of a subject; a determination means for determining whether the eye image is suitable for registration; a detection means for detecting an open state of the subject's eyes in the eye image when the eye image is determined to be unsuitable for registration; an output means for outputting guide information for instructing the subject to open his / her eyes using a finger based on the degree of eye opening; An information processing system comprising:

2. The detection means detects an eyelid that overlaps with an iris of the subject, the output means outputs the guide information with a predetermined emphasis on the eyelid that overlaps with the iris. The information processing system according to claim 1 .

3. the output means changes the manner of the predetermined highlighting in accordance with the strength of force required when opening the eyes with a finger; The information processing system according to claim 2 .

4. the acquiring means acquires an open-eye image including the eye opened by a finger after outputting the guide information, the determining means determines whether or not a quality of the iris of the subject in the open-eye image is equal to or higher than a predetermined quality; The output means further outputs second guide information for improving a quality of the iris when the quality of the iris is lower than a predetermined quality. The information processing system according to claim 1 .

5. The device further includes a determination unit for determining whether the subject holds the terminal for capturing the eye image in the right hand or the left hand, the output means outputs guide information for instructing the user to open his / her eyes using the fingers of the hand opposite to the hand holding the terminal. The information processing system according to claim 1 .

6. by at least one computer, acquiring an eye image including an eye of the subject; determining whether the eye image is suitable for enrollment; if it is determined that the eye image is not suitable for registration, detecting an opening degree of the subject's eyes in the eye image; outputting guide information to the subject to prompt the subject to open his / her eyes using a finger based on the degree of eye opening; Information processing methods.

7. At least one computer acquiring an eye image including an eye of the subject; determining whether the eye image is suitable for enrollment; if it is determined that the eye image is not suitable for registration, detecting an opening degree of the subject's eyes in the eye image; outputting guide information to the subject to prompt the subject to open his / her eyes using a finger based on the degree of eye opening; A computer program for executing an information processing method.