Information processing system, information processing method, and recording medium

Abstract

An information processing system (10) is provided with: an acquisition means (110) for acquiring an eye image including an eye of a subject; a determination means (120) for determining whether the eye image is an image suitable for storing; a detection means (130) for detecting the opening degree of the eye of the subject in the eye image when the eye image is determined to be unsuitable for storing; and an output means (140) for outputting guide information for the subject to open the eye using fingers on the basis of the opening degree of the eye. According to this information processing system, a high-quality eye image can be obtained by having the subject open an eye.

Description

[Technical Field]

[0001] The present disclosure relates to the technical fields of an information processing system, an information processing method, and a recording medium. [Background technology]

[0002] As a system of this kind, there is known a system that outputs information for improving the quality of an image when capturing an image of an eye. For example, Patent Document 1 discloses a system that determines whether the degree of eyelid opening is equal to or greater than a predetermined value, and issues a guidance instruction if the degree of eyelid opening is insufficient. Patent Document 2 discloses a system that detects the state of the eyelids of the subject's eye (eyelid opening state), and notifies the examiner if the eyelid state is insufficient. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] International Publication No. 2021 / 245823 [Patent Document 2] Japanese Patent Application Laid-Open No. 2009-131591 Summary of the Invention [Problem to be solved by the invention]

[0004] This disclosure aims to improve upon the techniques disclosed in the prior art documents. [Means for solving the problem]

[0005] One aspect of the information processing system disclosed herein comprises an acquisition means for acquiring an eye image including the eyes of a subject, a determination means for determining whether the eye image is suitable for registration, a detection means for detecting the degree to which the subject's eyes are open in the eye image when it is determined that the eye image is not suitable for registration, and an output means for outputting guide information to the subject to open their eyes using their fingers based on the degree to which the eyes are open.

[0006] One aspect of the information processing method disclosed herein involves using at least one computer to obtain an eye image including the eyes of a subject, determine whether the eye image is suitable for registration, and if it is determined that the eye image is not suitable for registration, detect the degree to which the subject's eyes are open in the eye image, and output guide information to prompt the subject to open their eyes using their fingers based on the degree to which the eyes are open.

[0007] One aspect of the recording medium of this disclosure is a computer program recorded on at least one computer to execute an information processing method, which includes acquiring an eye image including the eyes of a subject, determining whether the eye image is suitable for registration, and if it is determined that the eye image is not suitable for registration, detecting the degree to which the subject's eyes are open in the eye image, and outputting guide information to encourage the subject to open their eyes using their fingers based on the degree to which the eyes are open. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a block diagram showing a hardware configuration of an information processing system according to a first embodiment. [Figure 2] 1 is a block diagram showing a functional configuration of an information processing system according to a first embodiment. [Figure 3] 4 is a flowchart showing the flow of operations of the information processing system according to the first embodiment. [Figure 4] FIG. 2 is a plan view showing an example of guide information in the information processing system according to the first embodiment. [Figure 5] 10 is a flowchart showing the flow of operations of the information processing system according to the second embodiment. [Figure 6] FIG. 10 is a plan view showing an example of guide information in the information processing system according to the second embodiment. [Figure 7] 10 is a flowchart showing the flow of operations of the information processing system according to the third embodiment. [Figure 8] FIG. 11 is a plan view showing an example of guide information in the information processing system according to the third embodiment. [Figure 9] 10 is a flowchart showing the flow of operations of the information processing system according to the fourth embodiment. [Figure 10] FIG. 11 is a block diagram showing the functional configuration of an information processing system according to a fifth embodiment. [Figure 11] 10 is a flowchart showing the flow of operations of the information processing system according to the fifth embodiment. [Figure 12] FIG. 13 is a plan view showing an example of guide information in an information processing system according to a fifth embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, embodiments of an information processing system, an information processing method, and a recording medium will be described with reference to the drawings.

[0010] First Embodiment An information processing system according to a first embodiment will be described with reference to FIGS.

[0011] (Hardware configuration) First, the hardware configuration of the information processing system according to the first embodiment will be described with reference to Fig. 1. Fig. 1 is a block diagram showing the hardware configuration of the information processing system according to the first embodiment.

[0012] 1, an information processing system 10 according to the first embodiment includes a processor 11, a RAM (Random Access Memory) 12, a ROM (Read Only Memory) 13, and a storage device 14. The information processing system 10 may further include an input device 15 and an output device 16. The processor 11, RAM 12, ROM 13, storage device 14, input device 15, and output device 16 are connected via a data bus 17.

[0013] The processor 11 loads a computer program. For example, the processor 11 is configured to load a computer program stored in at least one of the RAM 12, the ROM 13, and the storage device 14. Alternatively, the processor 11 may load a computer program stored in a computer-readable storage medium using a storage medium reading device (not shown). The processor 11 may acquire (i.e., load) the computer program from a device (not shown) located outside the information processing system 10 via a network interface. The processor 11 controls the RAM 12, the storage device 14, the input device 15, and the output device 16 by executing the loaded computer program. In particular, in this embodiment, when the processor 11 executes the loaded computer program, a functional block for outputting guide information when capturing an eye image is realized within the processor 11. That is, the processor 11 may function as a controller that executes each control in the information processing system 10.

[0014] The processor 11 may be configured as, for example, a central processing unit (CPU), a graphics processing unit (GPU), a field-programmable gate array (FPGA), a demand-side platform (DSP), an application-specific integrated circuit (ASIC), or a quantum processor. The processor 11 may be configured as one of these, or may be configured to use multiple processors in parallel.

[0015] The RAM 12 temporarily stores computer programs executed by the processor 11. The RAM 12 temporarily stores data that the processor 11 temporarily uses while the processor 11 is executing the computer programs. The RAM 12 may be, for example, a dynamic random access memory (DRAM) or a static random access memory (SRAM). Alternatively, other types of volatile memory may be used instead of the RAM 12.

[0016] The ROM 13 stores computer programs executed by the processor 11. The ROM 13 may also store fixed data. The ROM 13 may be, for example, a programmable read-only memory (P-ROM) or an erasable read-only memory (EPROM). Alternatively, the ROM 13 may be replaced by another type of non-volatile memory.

[0017] The storage device 14 stores data that is to be saved long-term by the information processing system 10. The storage device 14 may operate as a temporary storage device for the processor 11. The storage device 14 may include, for example, at least one of a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and a disk array device.

[0018] The input device 15 is a device that receives input instructions from a user of the information processing system 10. The input device 15 may include, for example, at least one of a keyboard, a mouse, and a touch panel. The input device 15 may be configured as a mobile terminal such as a smartphone or a tablet. The input device 15 may also be, for example, a device that includes a microphone and is capable of voice input.

[0019] The output device 16 is a device that outputs information related to the information processing system 10 to the outside. For example, the output device 16 may be a display device (e.g., a display) that can display information related to the information processing system 10. The output device 16 may also be a speaker or the like that can output information related to the information processing system 10 as audio. The output device 16 may be configured as a mobile terminal such as a smartphone or a tablet. The output device 16 may also be a device that outputs information in a format other than an image. For example, the output device 16 may be a speaker that outputs information related to the information processing system 10 as audio.

[0020] 1 shows an example of information processing system 10 including a plurality of devices, but all or some of the functions may be realized by a single device (information processing device). In this case, the information processing device may be configured to include only processor 11, RAM 12, and ROM 13 described above, and the other components (i.e., storage device 14, input device 15, output device 16) may be provided by an external device connected to the information processing device. Furthermore, the information processing device may have some of its calculation functions realized by an external device (e.g., an external server, a cloud, etc.).

[0021] (Functional configuration) Next, the functional configuration of the information processing system 10 according to the first embodiment will be described with reference to Fig. 2. Fig. 2 is a block diagram showing the functional configuration of the information processing system according to the first embodiment.

[0022] 2, the information processing system 10 according to the first embodiment is configured to include, as components for realizing its functions, an image acquisition unit 110, a quality determination unit 120, an opening degree detection unit 130, and a guide information output unit 140. Each of the image acquisition unit 110, the quality determination unit 120, the opening degree detection unit 130, and the guide information output unit 140 may be a processing block realized by, for example, the above-mentioned processor 11 (see FIG. 1).

[0023] The image acquisition unit 110 is configured to be able to acquire an eye image including the eyes of a subject. This eye image is registered as an image showing the eyes of the subject. For example, the eye image may be an image registered as a registered image for iris authentication (i.e., an eye image showing the iris of a registered user). The eye image acquired by the image acquisition unit 110 is configured to be output to the quality determination unit 120.

[0024] The quality determination unit 120 is configured to be able to determine whether the eye image acquired by the image acquisition unit 110 is an image suitable for registration. Whether an image is suitable for registration may be determined, for example, based on a score indicating the quality of the eye image. In this case, the quality determination unit 120 may be configured to determine, for example, whether the score indicating the quality of the eye image is equal to or greater than a predetermined threshold. The determination result by the quality determination unit 120 is configured to be output to the eye opening degree detection unit 130.

[0025] The eye opening degree detection unit 130 is configured to detect the eye opening degree of the subject in the eye image when the quality determination unit 120 determines that the eye image is not suitable for registration. For example, the eye opening degree detection unit 130 may detect the degree to which the eyelids overlap the iris or the degree to which the iris is hidden by the eyelids as the eye opening degree. Note that a specific method for detecting the eye opening degree can be appropriately adopted from existing technologies, and therefore a detailed description thereof will be omitted here. The detection result by the eye opening degree detection unit 130 is configured to be output to the guide information output unit 140.

[0026] The guide information output unit 140 is configured to output guide information to prompt the subject to open their eyes using their fingers, based on the degree of eye opening detected by the eye opening degree detection unit 130. For example, the guide information may include information that prompts the subject to open their eyes using their fingers. The guide information may be displayed as an image using a display, for example. Alternatively, the guide information may be output as audio using a speaker. The guide information may be output to a device installed in the vicinity of the subject, or may be output to a terminal or the like held by the subject. Specific examples of guide information will be described in detail later.

[0027] (Operation flow) Next, the flow of operations performed by the information processing system 10 according to the first embodiment will be described with reference to Fig. 3. Fig. 3 is a flowchart showing the flow of operations performed by the information processing system according to the first embodiment.

[0028] As shown in FIG. 3, when the operation of the information processing system 10 according to the first embodiment starts, the image acquisition unit 110 first acquires an eye image including the eyes of the subject (step S101). Then, the quality determination unit 120 determines whether the eye image acquired by the image acquisition unit 110 is suitable for registration (step S102). If the eye image is determined to be suitable for registration (step S102: YES), the subsequent processes are omitted and the series of operations ends. In this case, the information processing system 10 may execute a process of registering the eye image determined to be suitable for registration (i.e., a process of storing the eye image as the eye image of the subject).

[0029] On the other hand, if the eye image is determined to be unsuitable for registration (step S102: NO), the eye opening degree detection unit 130 detects the eye opening degree of the subject in the eye image (step S103). Then, the guide information output unit 140 outputs guide information based on the eye opening degree detected by the eye opening degree detection unit 130 (step S104). This makes it possible to prompt the subject to open their eyes using their fingers.

[0030] Note that, after outputting the guide information, the image acquiring unit 110 may acquire an eye image of the subject with their eyes open using a finger, and then may execute a process of registering the newly acquired eye image (i.e., the eye image whose quality has been improved by opening the eyes) as the eye image of the subject.

[0031] (Example of guide information) Next, a specific example of guide information in the information processing system 10 according to the first embodiment will be described with reference to Fig. 4. Fig. 4 is a plan view showing an example of guide information in the information processing system according to the first embodiment.

[0032] 4, the guide information output by the information processing system 10 according to the first embodiment may be information that prompts the user to push up or down the eyelid that overlaps the iris. For example, when the lower eyelid overlaps the iris (i.e., when the lower side of the iris is hidden), the guide information may include a message such as "Please push down your eyelid with your finger." Also, when the upper eyelid overlaps the iris (i.e., when the upper side of the iris is hidden), the guide information may include a message such as "Please push up your eyelid with your finger."

[0033] The guide information may include an image of a finger or an arrow (i.e., an arrow indicating the direction in which to move the finger) to clearly convey the action to the subject. In this case, the image of the finger or the arrow may be displayed so as to move. For example, when encouraging the subject to press down on their eyelid with their finger, the image of the finger may move downward or the arrow may move so as to extend downward.

[0034] (Technical Effects) Next, the technical effects obtained by the information processing system 10 according to the first embodiment will be described.

[0035] As described with reference to FIGS. 1 to 4, in the information processing system 10 according to the first embodiment, when it is determined that the eye image of the subject is not suitable for registration, guide information according to the degree to which the subject's eyes are open (specifically, information prompting the subject to open their eyes using their finger) is output. This allows the subject to be prompted to open their eyes using their finger. As a result, it becomes possible to capture an eye image with the eyes fully open, and to acquire a high-quality eye image (e.g., an image in which the entire iris is clearly visible). This makes it possible to improve the accuracy of biometric authentication using, for example, registered eye images.

[0036] The effects of this embodiment are particularly pronounced when the subject's eyelids are droopy, swollen with fat, or weak eyelid muscles, or when the motor nerves in the brain that open the eyelids are not functioning properly. Even when guidance information such as "open your eyes wide" is output, subjects like those described above are unable to open their eyes wide enough, making it difficult to obtain an appropriate eye image. However, the information processing system 10 according to this embodiment can prompt the subject to open their eyes using their finger, making it possible to obtain an appropriate eye image even from subjects who have difficulty opening their eyes.

[0037] Second Embodiment An information processing system 10 according to the second embodiment will be described with reference to Figures 5 and 6. Note that the second embodiment differs from the first embodiment described above only in some of its operations, and other parts may be the same as the first embodiment. Therefore, the following will describe in detail the parts that differ from the first embodiment already described, and will omit a description of other overlapping parts as appropriate.

[0038] (Operation flow) First, the flow of operations performed by the information processing system 10 according to the second embodiment will be described with reference to Fig. 5. Fig. 5 is a flowchart showing the flow of operations performed by the information processing system according to the second embodiment. Note that in Fig. 5, the same processes as those shown in Fig. 3 are denoted by the same reference numerals.

[0039] 5, when the operation of the information processing system 10 according to the second embodiment starts, the image acquisition unit 110 first acquires an eye image including the eyes of a subject (step S101). Then, the quality determination unit 120 determines whether the eye image acquired by the image acquisition unit 110 is suitable for registration (step S102). If it is determined that the eye image is suitable for registration (step S102: YES), the subsequent processes are omitted and the series of operations ends.

[0040] On the other hand, if it is determined that the eye image is not suitable for registration (step S102: NO), the eye opening degree detection unit 130 detects the eye opening degree of the subject in the eye image (step S103). In the second embodiment, the eye opening degree detection unit 130 further detects the eyelid that overlaps with the iris of the subject (step S201). For example, the eye opening degree detection unit 130 detects whether the eyelid that overlaps with the iris is the upper eyelid or the lower eyelid.

[0041] Thereafter, the guide information output unit 140 outputs guide information based on the eye opening degree detected by the eye opening degree detection unit 130 and the eyelid on the side overlapping the iris (step S202). In the guide information according to the second embodiment, in particular, a predetermined highlighting is performed on the eyelid on the side overlapping the iris. The mode of highlighting is not particularly limited, and may be, for example, a different display color, a different size or thickness of characters, or a movement (animation).

[0042] (Example of guide information) Next, a specific example of guide information in the information processing system 10 according to the second embodiment will be described with reference to Fig. 6. Fig. 6 is a plan view showing an example of guide information in the information processing system according to the second embodiment.

[0043] As shown in FIG. 6, the guide information output by the information processing system 10 according to the second embodiment highlights the eyelid that overlaps the iris as described above. Specifically, when the iris is hidden by the lower eyelid, the lower eyelid is highlighted. When the iris is hidden by the upper eyelid, the upper eyelid is highlighted. When the iris is hidden by both the upper and lower eyelids, both the upper and lower eyelids may be highlighted. Alternatively, the side of the upper or lower eyelid that overlaps the iris more may be highlighted.

[0044] The highlighting may be applied to the entire upper or lower eyelid, or only to the portion overlapping the iris. In the example shown in FIG. 6, a thick line in a conspicuous color (e.g., red or fluorescent color) is superimposed on the portion of the eyelid overlapping the iris and flashes at a predetermined interval. In other words, the eyelid that is causing the iris to be hidden (in other words, the eyelid that needs to be opened with a finger) can be made to stand out. The highlighting may also be applied to a portion other than the eyelid. For example, if the iris is hidden by the lower eyelid, the lower half of the eye may be highlighted, and if the iris is hidden by the upper eyelid, the upper half of the eye may be highlighted.

[0045] (Technical Effects) Next, the technical effects obtained by the information processing system 10 according to the second embodiment will be described.

[0046] 5 and 6, in the information processing system 10 according to the second embodiment, a predetermined highlighting is performed on the eyelid that overlaps with the iris. In this way, it is possible to properly inform the subject which eyelid to open with the finger.

[0047] <Third embodiment> An information processing system 10 according to the third embodiment will be described with reference to Figures 7 and 8. The third embodiment differs from the second embodiment described above only in some of its operations, and other parts may be the same as the first and second embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0048] (Operation flow) First, the flow of operations performed by the information processing system 10 according to the third embodiment will be described with reference to Fig. 7. Fig. 7 is a flowchart showing the flow of operations performed by the information processing system according to the third embodiment. Note that in Fig. 7, the same processes as those shown in Fig. 5 are denoted by the same reference numerals.

[0049] 7, when the operation of the information processing system 10 according to the third embodiment starts, the image acquisition unit 110 first acquires an eye image including the eyes of a subject (step S101). Then, the quality determination unit 120 determines whether the eye image acquired by the image acquisition unit 110 is suitable for registration (step S102). If it is determined that the eye image is suitable for registration (step S102: YES), the subsequent processes are omitted and the series of operations ends.

[0050] On the other hand, if the eye image is determined to be unsuitable for registration (step S102: NO), the eye opening degree detection unit 130 detects the eye opening degree of the subject in the eye image (step S103). The eye opening degree detection unit 130 also detects the eyelid that overlaps with the iris of the subject (step S201).

[0051] In the third embodiment, the eye opening degree detection unit 130 further calculates the eye opening force from the eye opening degree (step S301). That is, the eye opening degree calculation unit 130 calculates how much force should be applied to the fingers to open the eyes and capture an appropriate image. The eye opening force may be calculated to be weak when the eye opening degree is large and strong when the eye opening degree is small.

[0052] Thereafter, the guide information output unit 140 outputs guide information based on the eye opening degree detected by the eye opening degree detection unit 130, the eyelid overlapping with the iris, and the force for opening the eyes (step S302). In particular, in the guide information according to the third embodiment, the manner of highlighting is changed according to the force for opening the eyes. That is, different highlighting is performed when the force for opening the eyes is strong and when the force for opening the eyes is weak.

[0053] (Example of guide information) Next, a specific example of guide information in the information processing system 10 according to the third embodiment will be described with reference to Fig. 8. Fig. 8 is a plan view showing an example of guide information in the information processing system according to the third embodiment.

[0054] As shown in FIG. 8, the guide information output by the information processing system 10 according to the third embodiment is highlighted in accordance with the force used to open the eyes. Specifically, when the iris is only slightly hidden (in other words, when a small force is sufficient to open the eyes), the highlighting is performed in blue. On the other hand, when a large portion of the iris is hidden (in other words, when a large force is required to open the eyes), the highlighting is performed in red. Furthermore, when a large portion of the iris is hidden, the image of the finger and the arrow are displayed relatively larger than when the iris is only slightly hidden. Note that the above-described highlighting mode is merely an example, and the display mode may be changed as appropriate so that the strength of the force can be intuitively understood.

[0055] (Technical Effects) Next, the technical effects obtained by the information processing system 10 according to the third embodiment will be described.

[0056] 7 and 8, in the information processing system 10 according to the third embodiment, the manner of highlighting is changed depending on the strength of the force required to open the eyes with the fingers. In this way, it is possible to appropriately inform the subject of the amount of force required to open the eyelids.

[0057] <Fourth embodiment> An information processing system 10 according to the fourth embodiment will be described with reference to Fig. 9. Note that the fourth embodiment differs from the first to third embodiments described above only in some of its operations, and other parts may be the same as the first to third embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0058] (Operation flow) First, the flow of operations performed by the information processing system 10 according to the fourth embodiment will be described with reference to Fig. 9. Fig. 9 is a flowchart showing the flow of operations performed by the information processing system according to the fourth embodiment. Note that in Fig. 9, the same processes as those shown in Fig. 3 are denoted by the same reference numerals.

[0059] 9, when the operation of the information processing system 10 according to the fourth embodiment starts, the image acquisition unit 110 first acquires an eye image including the eyes of a subject (step S101). Then, the quality determination unit 120 determines whether the eye image acquired by the image acquisition unit 110 is suitable for registration (step S102). If it is determined that the eye image is suitable for registration (step S102: YES), the subsequent processes are omitted and the series of operations ends.

[0060] On the other hand, if the eye image is determined to be unsuitable for registration (step S102: NO), the eye opening degree detection unit 130 detects the eye opening degree of the subject in the eye image (step S103).Then, the guide information output unit 140 outputs guide information based on the eye opening degree detected by the eye opening degree detection unit 130 (step S104).

[0061] Thereafter, particularly in the fourth embodiment, the image acquisition unit 110 acquires an image captured while the subject is holding their eyes open with their fingers (hereinafter referred to as an "open-eye image" as appropriate) (step S401). Then, the quality determination unit 120 determines whether the quality of the open-eye image (more specifically, the quality of the iris in the open-eye image) is equal to or higher than a predetermined quality (step S402). Note that the determination criteria here may be the same as the criteria used to determine whether an image is suitable for registration (i.e., the determination criteria in step S102), or may be different. For example, the determination criteria in step S402 may be slightly stricter than the determination criteria in step S102, or conversely, slightly looser.

[0062] If it is determined that the quality of the eye-open image is equal to or higher than the predetermined quality (step S402: YES), the subsequent processes are omitted and the series of operations ends. At this time, the information processing system 10 may execute a process of registering the eye-open image as an eye image of the subject.

[0063] On the other hand, if it is determined that the quality of the eye-opening image is lower than the predetermined quality (step S402: NO), the guide information output unit 140 further outputs second guide information for improving the quality of the eye-opening image (step S403). The second guide information may be the same as the initially output guide information (i.e., the guide information output in step S104). Alternatively, the second guide information may be different from the initially output guide information. For example, the second guide information may include information for fine-tuning the subject's eye-opening action, such as "Please push up your eyelids with a little more force." Furthermore, the second guide information may include information other than information for having the subject open their eyes with their fingers. For example, the second guide information may include a message such as "Please bring your eyes a little closer to the camera."

[0064] (Technical Effects) Next, the technical effects obtained by the information processing system 10 according to the fourth embodiment will be described.

[0065] 9, in the information processing system 10 according to the fourth embodiment, if the image after outputting the guide information is below a predetermined quality, the second guide information is further output. In this way, even if the initially output guide information is not enough to open the eyes, the second guide information can prompt the user to take an action to further improve the quality of the eye image.

[0066] Fifth Embodiment An information processing system 10 according to the fifth embodiment will be described with reference to Figures 10 to 12. The fifth embodiment differs only in part of the configuration and operation from the first to fourth embodiments described above, and other parts may be the same as the first to fourth embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0067] (Functional configuration) First, the functional configuration of the information processing system 10 according to the fifth embodiment will be described with reference to Fig. 10. Fig. 10 is a block diagram showing the functional configuration of the information processing system according to the fifth embodiment. Note that in Fig. 10, the same elements as those shown in Fig. 2 are denoted by the same reference numerals.

[0068] 10, the information processing system 10 according to the fifth embodiment is configured to include, as components for realizing its functions, an image acquisition unit 110, a quality determination unit 120, an opening degree detection unit 130, a guide information output unit 140, and a left / right identification unit 150. That is, the information processing system 10 according to the fifth embodiment further includes the left / right identification unit 150 in addition to the configuration of the first embodiment described above (see FIG. 2). The left / right identification unit 150 may be a processing block realized by, for example, the processor 11 described above (see FIG. 1).

[0069] The left / right identification unit 150 is configured to be able to identify whether the subject is holding a terminal (e.g., a smartphone with a camera) for capturing an eye image in the right hand or the left hand. The left / right identification unit 150 may determine in which hand the subject is holding the terminal, for example, based on the output of various sensors (e.g., a tilt sensor, a gyro sensor, etc.) mounted on the terminal. Alternatively, the left / right identification unit 150 may determine in which hand the subject is holding the terminal, based on the eye image acquired by the image acquisition unit 110. More specifically, the left / right identification unit 150 may determine in which hand the subject is holding the terminal, based on the angle of view of the eye image, etc. The identification result by the left / right identification unit 150 is configured to be output to the guide information output unit 140.

[0070] The guide information output unit 140 according to the fifth embodiment is configured to output guide information based on the identification result of the left / right identification unit 150 (i.e., whether the subject holds the terminal in the right hand or the left hand) in addition to the eye opening degree detected by the eye opening degree detection unit 140. Specific examples of guide information will be described in detail later.

[0071] (Operation flow) Next, the flow of operations performed by the information processing system 10 according to the fifth embodiment will be described with reference to Fig. 11. Fig. 11 is a flowchart showing the flow of operations performed by the information processing system according to the fifth embodiment. In Fig. 11, the same processes as those shown in Fig. 3 are denoted by the same reference numerals.

[0072] 11, when the operation of the information processing system 10 according to the fifth embodiment starts, the image acquisition unit 110 first acquires an eye image including the eyes of a subject (step S101). Then, the quality determination unit 120 determines whether the eye image acquired by the image acquisition unit 110 is suitable for registration (step S102). If it is determined that the eye image is suitable for registration (step S102: YES), the subsequent processes are omitted and the series of operations ends.

[0073] On the other hand, if it is determined that the eye image is not suitable for registration (step S102: NO), the eye opening degree detection unit 130 detects the eye opening degree of the subject in the eye image (step S103). Furthermore, in the fifth embodiment, the left / right identification unit 150 further identifies whether the hand holding the terminal is the left or right hand of the subject (step S501).

[0074] Thereafter, the guide information output unit 140 outputs guide information based on the eye opening degree detected by the eye opening degree detection unit 130 and information about the hand holding the terminal identified by the left / right identification unit 150 (step S502). The content of the guide information according to the fifth embodiment changes depending in particular on whether the subject is holding the terminal in their right hand or their left hand.

[0075] (Example of guide information) Next, a specific example of guide information in the information processing system 10 according to the fifth embodiment will be described with reference to Fig. 12. Fig. 12 is a plan view showing an example of guide information in the information processing system according to the fifth embodiment.

[0076] As shown in Fig. 12, in the information processing system 10 according to the fifth embodiment, when a subject holds a terminal in his / her left hand, guide information is output instructing the subject to open his / her eyes using the fingers of his / her right hand. For example, the guide information may include a message specifying the hand to be used, such as "Please press down your eyelids with the fingers of your right hand." Alternatively, an image of the right hand may be displayed to indicate the hand to be used.

[0077] On the other hand, if the subject is holding the device in their right hand, guide information is output to encourage them to open their eyes using the fingers of their left hand. For example, the guide information may include a message such as "Please push down your eyelids with the fingers of your left hand." An image of a left hand may also be displayed to indicate which hand to use.

[0078] 10 to 12, the information processing system 10 according to the fifth embodiment outputs guide information that prompts the subject to open their eyes using the fingers of the hand opposite to the hand holding the terminal. In this way, the subject holding the terminal can be prompted to open their eyes in a more easily understandable manner.

[0079] The scope of each embodiment also includes a processing method in which a program that operates the configuration of each embodiment to realize the functions of the above-described embodiments is recorded on a recording medium, the program recorded on the recording medium is read as code, and the program is executed on a computer. In other words, a computer-readable recording medium is also included in the scope of each embodiment. Furthermore, each embodiment includes not only a recording medium on which the above-described program is recorded, but also the program itself.

[0080] Examples of recording media that can be used include floppy disks, hard disks, optical disks, magneto-optical disks, CD-ROMs, magnetic tapes, non-volatile memory cards, and ROMs. The scope of each embodiment is not limited to programs recorded on the recording media that execute processes by themselves, but also includes programs that run on an OS in conjunction with other software or expansion board functions to execute processes. Furthermore, the program itself may be stored on a server, and part or all of the program may be downloadable from the server to a user terminal. The program may be provided to users in the form of, for example, SaaS (Software as a Service).

[0081] <Additional Notes> The above-described embodiment may be further described as follows, but is not limited to the following.

[0082] (Appendix 1) The information processing system described in Appendix 1 is an information processing system including an acquisition means for acquiring an eye image including the eyes of a subject, a determination means for determining whether the eye image is suitable for registration, a detection means for detecting the degree of opening of the subject's eyes in the eye image when it is determined that the eye image is not suitable for registration, and an output means for outputting guide information for encouraging the subject to open their eyes using their finger based on the degree of opening of the eyes.

[0083] (Appendix 2) The information processing system described in Appendix 2 is the information processing system described in Appendix 1, in which the detection means detects the eyelid that overlaps with the iris of the subject, and the output means outputs the guide information with a predetermined highlighting on the eyelid that overlaps with the iris.

[0084] (Appendix 3) The information processing system described in Appendix 3 is the information processing system described in Appendix 2, wherein the output means changes the manner of the specified highlighting depending on the strength of force required when using a finger to open the eye.

[0085] (Appendix 4) The information processing system described in Appendix 4 is the information processing system described in any one of Appendixes 1 to 3, wherein the acquisition means acquires an open-eye image including the eye held open by a finger after outputting the guide information, the determination means determines whether the quality of the iris of the subject in the open-eye image is equal to or higher than a predetermined quality, and the output means further outputs second guide information that improves the quality of the iris if the quality of the iris is less than the predetermined quality.

[0086] (Appendix 5) The information processing system described in Appendix 5 is an information processing system described in any one of Appendixes 1 to 3, further comprising an identification means for identifying whether the subject is holding the terminal for capturing the eye image in their right hand or their left hand, and the output means outputs guide information to open the eyes using the fingers of the hand opposite to the hand holding the terminal.

[0087] (Appendix 6) The information processing method described in Appendix 6 is an information processing method that uses at least one computer to acquire an eye image including the eyes of a subject, determine whether the eye image is suitable for registration, and if it is determined that the eye image is not suitable for registration, detect the degree to which the subject's eyes are open in the eye image, and output guide information that prompts the subject to open their eyes using their fingers based on the degree to which the eyes are open.

[0088] (Appendix 7) The recording medium described in Appendix 7 is a recording medium having recorded thereon a computer program for causing at least one computer to execute an information processing method, which includes acquiring an eye image including the eyes of a subject, determining whether the eye image is suitable for registration, and if it is determined that the eye image is not suitable for registration, detecting the degree of opening of the subject's eyes in the eye image, and outputting guide information for encouraging the subject to open their eyes using their fingers based on the degree of opening of the eyes.

[0089] (Appendix 8) The computer program described in Appendix 8 is a computer program that causes at least one computer to execute an information processing method of acquiring an eye image including the eyes of a subject, determining whether the eye image is suitable for registration, and if it is determined that the eye image is not suitable for registration, detecting the degree to which the subject's eyes are opened in the eye image, and outputting guide information to prompt the subject to open their eyes using their fingers based on the degree to which the eyes are opened.

[0090] This disclosure may be modified as appropriate within the scope that does not contradict the gist or idea of ​​the invention that can be read from the claims and the entire specification, and information processing systems, information processing methods, and recording media that involve such modifications are also included in the technical idea of ​​this disclosure. [Explanation of symbols]

[0091] 10 Information Processing Systems 11 processors 110 Image acquisition unit 120 Quality Judgment Department 130 Opening degree detection unit 140 Guide information output unit 150 Left and right identification section

Claims

1. an acquisition means for acquiring an eye image including the subject's eye; a determination means for determining whether the eye image is suitable for registration; a detection means for detecting an opening degree of the subject's eyes in the eye image when the eye image is determined to be unsuitable for registration; an output means for outputting guide information to the subject to open their eyes using their fingers based on the degree of eye opening; An information processing system comprising:

2. the detection means detects an eyelid that overlaps with the iris of the subject; the output means outputs the guide information with a predetermined emphasis on the eyelid that overlaps with the iris. The information processing system according to claim 1 .

3. the output means changes the manner of the predetermined highlighting in accordance with the strength of force required when opening the eye with a finger; The information processing system according to claim 2 .

4. the acquiring means acquires an open-eye image including the eye opened by a finger after outputting the guide information, the determining means determines whether or not the quality of the iris of the subject in the eye-open image is equal to or higher than a predetermined quality; The output means further outputs second guide information for improving the quality of the iris when the quality of the iris is lower than a predetermined quality. The information processing system according to claim 1 .

5. further comprising a determination means for determining whether the subject is holding the terminal for capturing the eye image in his / her right hand or left hand; the output means outputs guide information to open the eyes using the fingers of the hand opposite to the hand holding the terminal. The information processing system according to claim 1 .

6. by at least one computer, acquiring an eye image including the subject's eye; determining whether the eye image is suitable for enrollment; If the eye image is determined to be unsuitable for registration, detecting the degree of opening of the subject's eyes in the eye image; outputting guide information to the subject to open their eyes using their fingers based on the degree of eye opening; Information processing methods.

7. At least one computer acquiring an eye image including the subject's eye; determining whether the eye image is suitable for enrollment; If the eye image is determined to be unsuitable for registration, detecting the degree of opening of the subject's eyes in the eye image; outputting guide information to the subject to open their eyes using their fingers based on the degree of eye opening; A computer program that executes an information processing method.

Images