Information processing device, information processing method, and computer program
By using a rear camera and auxiliary means to output guidance information, the challenge of capturing high-quality iris images without display reference is addressed, ensuring effective and display-free iris image capture.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- NEC CORP
- Filing Date
- 2022-11-29
- Publication Date
- 2026-05-19
AI Technical Summary
Existing technologies face challenges in capturing high-quality iris images without requiring the subject to check a display for guidance, particularly when using rear cameras on devices with displays on the front.
The implementation of a rear camera and auxiliary means to output guidance information, allowing the capture of iris images without the subject needing to refer to the display, by providing auxiliary information to adjust imaging parameters such as range, resolution, brightness, and reflections.
Enables high-resolution and high-quality iris image capture without the subject needing to check the display, ensuring appropriate imaging conditions and effective guidance for optimal iris capture.
Smart Images

Figure 0007861862000001 
Figure 0007861862000002 
Figure 0007861862000003
Abstract
Description
Technical Field
[0001] This disclosure relates to the technical field of information processing apparatuses, information processing methods, and recording media.
Background Art
[0002] Patent Document 1 describes a technique for outputting guidance information for guiding a subject to move their head while gazing at a predetermined position, and for acquiring an image including the subject's iris after the output of the guidance information. Patent Document 2 describes a technique for operating an iris photographing camera to photograph an iris depending on the brightness of illumination when iris recognition is selected. Patent Document 3 describes that a viewing distance estimation unit calculates a first value indicating the number of pixels of the size of an iris detected by an iris detection processing unit, and that the viewing distance estimation unit acquires the resolution of a color image. Patent Document 4 describes that a mobile device may include, for example, a mobile phone such as a smartphone, a tablet, and may include sensors for determining the characteristics of the current environment of the mobile device, and that the sensors may include a front or rear camera having a movable or fixed lens, a flash, an image sensor, and an image processor, and that the camera may be a megapixel camera capable of capturing details for face and / or iris recognition. Patent Document 5 describes that a backlight displays a frame in a range where both eyes should be reflected in the mirror surface of a magic mirror panel. Patent Document 6 describes guiding a user by display on a display or by voice, or controlling an external device in order to obtain a good iris. Patent Document 7 describes acquiring an eye image from a person image of a photographed person confirmed to be in an iris photographing space, measuring the quality of the acquired eye image, and acquiring an iris recognition image satisfying a reference quality level. Patent Document 8 describes a method for determining a general iris size from the size of a face region, using this formula to determine the general iris size from the size of the face region, moving a circular pattern of the general iris size over the area where the eye is located within the face region to perform matching, and detecting the iris as the part with the highest similarity to the pattern that exceeds a predetermined threshold. Patent Document 9 describes displaying a first indicator, which is a vertical straight line for aligning the bridge of the nose, and a second indicator, which is a horizontal straight line for aligning the eyes, at a fixed position equivalent to the position of the user's mirror image in human visual perception. Patent Document 10 describes a technique in which the eye image of a subject captured by the imaging unit of an imaging device is evaluated, the imaging device determines whether or not the subject is within the focus range, and based on the result, the display unit displays different information depending on whether the subject is within the focus range or not, and guides the subject in any direction, both in the distance direction from the device and in the up, down, left, and right directions. Patent document 11 describes how to display various information on the liquid crystal display unit of the guidance display unit based on the results of distance measurement and environmental judgment. [Prior art documents] [Patent Documents]
[0003] [Patent Document 1] International Publication No. 2021 / 245823 [Patent Document 2] Special Publication No. 2022-510462 [Patent Document 3] Japanese Patent Publication No. 2022-99129 [Patent Document 4] Special Publication No. 2021-507557 [Patent Document 5] Japanese Patent Publication No. 2018-151838 [Patent Document 6] Japanese Patent Publication No. 2018-124733 [Patent Document 7] Special Publication No. 2017-503276 [Patent Document 8] Japanese Patent Publication No. 2014-67090 [Patent Document 9] Japanese Patent Publication No. 2013-145323 [Patent Document 10] Japanese Patent Publication No. 2007-236668 [Patent Document 11] Japanese Patent Publication No. 2007-209646 [Overview of the project] [Problems that the invention aims to solve]
[0004] This disclosure aims to provide an information processing device, an information processing method, and a recording medium that improve upon the technologies described in prior art documents. [Means for solving the problem]
[0005] One aspect of an information processing device comprises a display, an imaging means for imaging an object located on a side opposite to the display, and an auxiliary means for outputting auxiliary information to assist imaging when the imaging means captures an image including the iris of the object in response to an imaging instruction from the object.
[0006] One aspect of the information processing method involves outputting auxiliary information to assist in imaging when an imaging means, which images an object located on a side different from the side facing the display, captures an image including the iris of the object in response to an imaging instruction from the object.
[0007] One embodiment of a recording medium contains a computer program that causes a computer to execute an information processing method that outputs auxiliary information to assist in imaging when an imaging means, which images an object in response to an imaging instruction from the object located on a side different from the side facing the display, captures an image including the iris of the object. [Brief explanation of the drawing]
[0008] [Figure 1]FIG. 1 is a block diagram showing the configuration of the information processing apparatus according to the first embodiment. [Figure 2] FIG. 2 is a diagram showing the appearance of the information processing apparatus according to the second embodiment. [Figure 3] FIG. 3 is a block diagram showing the configuration of the information processing apparatus according to the second embodiment. [Figure 4] FIG. 4 is a flowchart showing the flow of the information processing operation of the information processing apparatus according to the second embodiment. [Figure 5] FIG. 5 is a block diagram showing the configuration of the information processing apparatus according to the third embodiment. [Figure 6] FIG. 6 is a block diagram showing the configuration of the information processing apparatus according to the fourth embodiment. [Figure 7] FIG. 7 is a block diagram showing the configuration of the information processing apparatus according to the fifth embodiment. [Figure 8] FIG. 8 is a block diagram showing the configuration of the information processing apparatus according to the sixth embodiment. [Figure 9] FIG. 9 is a block diagram showing the configuration of the information processing apparatus according to the seventh embodiment. [Figure 10] FIG. 10 is a block diagram showing the configuration of the information processing apparatus according to the eighth embodiment. [Figure 11] FIG. 11 is a flowchart showing the flow of the information processing operation of the information processing apparatus according to the eighth embodiment. [Figure 12] FIG. 12 is a block diagram showing the configuration of the information processing apparatus according to the ninth embodiment. [Figure 13] FIG. 13 is a block diagram showing the configuration of the information processing apparatus according to the tenth embodiment. [Figure 14] FIG. 14 is a flowchart showing the flow of the information processing operation of the information processing apparatus according to the tenth embodiment. [Figure 15] FIG. 15 is a block diagram showing the configuration of the information processing apparatus according to the eleventh embodiment. [Figure 16] FIG. 16 is a flowchart showing the flow of the information processing operation of the information processing apparatus according to the eleventh embodiment. [Figure 17] Figure 17 is a block diagram showing the configuration of the information processing device in the twelfth embodiment. [Figure 18] Figure 18 is a flowchart showing the flow of information processing operations of the information processing device in the 12th embodiment. [Modes for carrying out the invention]
[0009] The following describes embodiments of the information processing device, information processing method, and recording medium with reference to the drawings. [1: First Embodiment]
[0010] A first embodiment of the information processing device, information processing method, and recording medium will be described below. In the following, the first embodiment of the information processing device, information processing method, and recording medium will be described using information processing device A1 to which the first embodiment of the information processing device, information processing method, and recording medium is applied. [1-1: Configuration of Information Processing Device A1]
[0011] Figure 1 is a block diagram showing the configuration of the information processing device A1 in the first embodiment. As shown in Figure 1, the information processing device A1 comprises a display D, an imaging unit RC, and an auxiliary unit 11.
[0012] The rear camera RC captures an image of an object that is on a side different from the side facing the display D. The imaging unit RC may be mounted on the side of the information processing device A1 that does not have the display D. If the display D is mounted on the front of the information processing device A1, the imaging unit RC may be mounted on the back of the information processing device A1. The auxiliary unit 11 outputs auxiliary information to assist in imaging when the imaging unit RC captures an image including the iris of an object in response to an imaging instruction from the object. [1-2: Technical effects of information processing device A1]
[0013] In the first embodiment, the information processing device A1 outputs auxiliary information to assist in imaging when the rear camera RC captures an image including the iris of the object being imaged in response to an imaging instruction from the object being imaged. As a result, the object being imaged can capture an image that appropriately includes its iris without having to check the display D. [2: Second Embodiment]
[0014] Next, a second embodiment of the information processing device, information processing method, and recording medium will be described. In the following, the second embodiment of the information processing device, information processing method, and recording medium will be described using information processing device A2 to which the second embodiment of the information processing device, information processing method, and recording medium is applied.
[0015] In the second embodiment, the information processing device A2 may be a mobile terminal such as a smartphone, tablet, or notebook PC (personal computer). Figure 2 is an external view illustrating the external appearance of the information processing device A2 in the second embodiment. The information processing device A2 has a side on which the display D, illustrated in Figure 2(a), is mounted, and a side on which the display D is not mounted, illustrated in Figure 2(b). As shown in Figure 2(b), the rear camera RC is mounted on the side of the information processing device A2 on which the display D is not mounted. If the display D is mounted on the front of the information processing device A2, the rear camera RC may be mounted on the back of the information processing device A2. The rear camera RC captures an image of an object that is on a side different from the side facing the display D. The information processing device A2 may have a front camera FC mounted on the front side on which the display D is mounted. The rear camera RC may be able to capture images with higher resolution and higher quality compared to the front camera FC.
[0016] [2-1: Configuration of Information Processing Device A2]
[0017] Figure 3 is a block diagram showing the configuration of the information processing device A2 in the second embodiment. As shown in Figure 3, the information processing device A2 includes an arithmetic unit 21 and a storage device 22. Furthermore, the information processing device A2 may also include a communication device 23, an input device 24, and an output device 25. However, the information processing device A2 does not have to include at least one of the communication device 23, the input device 24, and the output device 25. The arithmetic unit 21, the storage device 22, the communication device 23, the input device 24, and the output device 25 may be connected via a data bus 26.
[0018] The arithmetic unit 21 includes, for example, at least one of a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), and an FPGA (Field Programmable Gate Array). The arithmetic unit 21 reads a computer program. For example, the arithmetic unit 21 may read a computer program stored in the storage device 22. For example, the arithmetic unit 21 may read a computer program stored in a computer-readable and non-temporary recording medium using a recording medium reading device (not shown) provided by the information processing device A2 (for example, an input device 24 described later). The arithmetic unit 21 may obtain a computer program from a device (not shown) located outside the information processing device A2 via a communication device 23 (or other communication device) (i.e., it may download or read the program). The arithmetic unit 21 executes the read computer program. As a result, logical functional blocks for performing the operations that the information processing device A2 should perform are realized within the arithmetic unit 21. In other words, the arithmetic unit 21 can function as a controller for realizing logical functional blocks necessary for the information processing device A2 to perform its operations (in other words, processes).
[0019] Figure 3 shows an example of a logical functional block implemented within the arithmetic unit 21 to perform information processing operations. As shown in Figure 3, the arithmetic unit 21 implements an auxiliary control unit 211, an imaging control unit 212, and an authentication unit 213, which are specific examples of the "auxiliary means" described in the appendix later. However, the arithmetic unit 21 does not necessarily have to have either the imaging control unit 212 or the authentication unit 213. The auxiliary control unit 211 may have a guidance unit 211A and an image evaluation unit 211B, which are specific examples of the "guidance means" described in the appendix later. However, the auxiliary control unit 211 does not necessarily have to have either the guidance unit 211A or the image evaluation unit 211B. Details of the operation of the auxiliary control unit 211, the imaging control unit 212, and the authentication unit 213 will be explained later with reference to Figure 4.
[0020] The storage device 22 is capable of storing desired data. For example, the storage device 22 may temporarily store computer programs executed by the arithmetic unit 21. The storage device 22 may temporarily store data that the arithmetic unit 21 uses temporarily when it is executing a computer program. The storage device 22 may store data that the information processing device A2 stores long-term. The storage device 22 may include at least one of the following: RAM (Random Access Memory), ROM (Read Only Memory), hard disk drive, magneto-optical disk drive, SSD (Solid State Drive), and disk array device. In other words, the storage device 22 may include non-temporary recording media.
[0021] The communication device 23 can communicate with devices outside the information processing device 2 via a communication network (not shown). The communication device 23 may have a communication interface based on standards such as Ethernet (registered trademark), Wi-Fi (registered trademark), Bluetooth (registered trademark), or USB (Universal Serial Bus).
[0022] The input device 24 is a device that receives information input to the information processing device A2 from outside the information processing device A2. For example, the input device 24 may include an operating device (for example, at least one of a keyboard, mouse, and touch panel) that can be operated by an operator of the information processing device A2. For example, the input device 24 may include a reading device that can read information recorded as data on a recording medium that can be attached externally to the information processing device 2.
[0023] The output device 25 is a device that outputs information to the outside of the information processing device A2. For example, the output device 25 may output information as an image. That is, the output device 25 may include a display device (so-called display) capable of displaying an image that shows the information to be output. In other words, in the second embodiment, the information processing device A2 includes a display D as the output device 25. For example, the output device 25 may output information as sound. That is, the output device 25 may include an audio device (so-called speaker) capable of outputting sound. For example, the output device 25 may output information onto paper. That is, the output device 25 may include a printing device (so-called printer) capable of printing desired information onto paper. [2-2: Information processing operations performed by information processing device A2]
[0024] The information processing operations performed by the information processing device A2 in the second embodiment will be explained with reference to Figure 4. Figure 4 is a flowchart showing the flow of information processing operations performed by the information processing device A2 in the second embodiment.
[0025] As shown in Figure 4, the rear camera RC captures an image of the target object (step S20). The rear camera RC is controlled by the image capture control unit 212 based on an image capture instruction from the target object, and captures an image of the target object. The rear camera RC captures an image of the target object that is on a side different from the side facing the display D.
[0026] The image evaluation unit 211B evaluates the image (step S21). The image evaluation by the image evaluation unit 211B may include evaluation of the image acquisition range, evaluation of the resolution of the iris included in the image, evaluation of the brightness of the image, and evaluation of reflections included in the image. The image evaluation by the image evaluation unit 211B will be described in other embodiments described later.
[0027] The image evaluation unit 211B determines whether each of the values related to the evaluation of the imaging range, the evaluation of the resolution, the evaluation of the brightness, and the evaluation of reflections is below the corresponding threshold (step S22). If any of the values related to the evaluation of the imaging range, the evaluation of the resolution, the evaluation of the brightness, and the evaluation of reflections is below the threshold (step S22: Yes), it determines whether it is necessary to guide the object to be imaged (step S23).
[0028] If it is necessary to guide the object to be imaged (step S23: Yes), the guidance unit 211A guides the object to be imaged (step S24). Guidance of the object to be imaged by the guidance unit 211A may also be the output of auxiliary information to the object to be imaged to assist in imaging. The auxiliary information may include at least one of the following: information regarding the imaging range of the image, information regarding the resolution of the iris included in the image, information regarding the brightness of the image, and information regarding reflections on the iris region included in the image. The guidance unit 211A may guide the object to be imaged by outputting at least one of the following to the object to be imaged: information regarding the imaging range of the image, information regarding the resolution of the iris included in the image, information regarding the brightness of the image, and information regarding reflections on the iris region included in the image. The auxiliary control unit 211 may assist in improving at least one of the imaging range, resolution, brightness, and reflections.
[0029] The auxiliary information may include information regarding at least one of the movement of the object being imaged and the orientation of the object being imaged. The information regarding at least one of the movement of the object being imaged and the orientation of the object being imaged may include the direction in which the object should move, the orientation of the object's face, the positional relationship between the object being imaged and the information processing device A2, the distance between the object being imaged and the rear camera RC, etc. The guidance unit 211A may guide the object being imaged by outputting information regarding at least one of the movement of the object being imaged and the orientation of the object being imaged to the object being imaged. Guidance of the object being imaged by the guidance unit 211A will be described in other embodiments described later.
[0030] If it is not necessary to guide the object to be imaged (step S23: No), the auxiliary control unit 211 adjusts the imaging operation of the rear camera RC (step S25). The auxiliary control unit 211 may output auxiliary information to the imaging control unit 212 to assist in imaging in order to adjust the imaging operation of the rear camera RC. Cases where it is not necessary to guide the object to be imaged may include, for example, cases where only a change in focus is necessary, or cases where the issue can be resolved by turning on the rear light RL, or other cases where the issue can be resolved by the internal control of the information processing device A2 without moving the object to be imaged.
[0031] After step S24 is performed, the process may proceed to step S25. That is, when the rear camera RC captures an image including the iris of the object to be captured in response to an imaging instruction from the object, the auxiliary control unit 211 outputs auxiliary information to assist in the imaging. After step S25, the process proceeds to step S20.
[0032] If all of the values related to the evaluation of the imaging range, the evaluation of the resolution, the evaluation of the brightness, and the evaluation of reflections are above the threshold (Step S22: No), the authentication unit 213 authenticates the imaging target using the iris information of the imaging target included in the image (Step S26). [2-3: Technical effects of information processing device A2]
[0033] In the second embodiment, when the rear camera RC takes an image based on an imaging instruction from the object to be imaged, the information processing device A2 can assist the object to be imaged by outputting auxiliary information including at least one of the following: information regarding the image imaging range, information regarding the resolution of the iris included in the image, information regarding the brightness of the image, and information regarding reflections in the iris region included in the image. The information processing device A2 can appropriately capture an image including the iris of the object to be imaged without the object to check the display D. If the rear camera RC can capture a high-resolution and high-quality image compared to the front camera FC, the information processing device A2 can capture a high-resolution and high-quality image including the iris of the object to be imaged without the object to check the display D. The information processing device A2 can capture an image with appropriate imaging range, resolution, brightness, and reflections without referring to the display D. Furthermore, the information processing device A2 outputs information to the object to be imaged regarding at least one of the operation of the object to be imaged and the orientation of the object to be imaged, so that the object to be imaged can be appropriately guided. [3: Third Embodiment]
[0034] Next, a third embodiment of the information processing device, information processing method, and recording medium will be described. In the following, the third embodiment of the information processing device, information processing method, and recording medium will be described using an information processing system S3 to which the third embodiment of the information processing device, information processing method, and recording medium is applied. [3-1: Configuration of Information Processing System S3]
[0035] As shown in Figure 5, the information processing system S3 in the third embodiment includes a calculation unit 21 and a storage device 22, similar to the information processing device A2 in the second embodiment. Furthermore, the information processing system S3 in the third embodiment may also include a communication device 23, an input device 24, and an output device 25, similar to the information processing device A2 in the second embodiment. However, the information processing system S3 does not have to include at least one of the communication device 23, the input device 24, and the output device 25. The information processing system S3 in the third embodiment differs from the information processing device A2 in the second embodiment in that the guidance unit 311A has at least one of the following: an audio output control unit 311A1, an instruction transmission unit 311A2, a vibration stimulation control unit 311A3, an electrical stimulation control unit 311A4, and a light control unit 311A5. Other features of the information processing system S3 may be the same as other features of the information processing device A2 in the second embodiment. Therefore, the following will provide a detailed explanation of the parts that differ from the embodiments already described, while other overlapping parts will be omitted as appropriate.
[0036] The guidance unit 311A uses at least one of the following to output auxiliary information to the imaging target and guide the imaging target: the audio output control unit 311A1, the instruction transmission unit 311A2, the vibration stimulation control unit 311A3, the electrical stimulation control unit 311A4, and the light control unit 311A5. The guidance unit 311A may also use two or more of the following to output auxiliary information to the imaging target and guide the imaging target: the audio output control unit 311A1, the instruction transmission unit 311A2, the vibration stimulation control unit 311A3, the electrical stimulation control unit 311A4, and the light control unit 311A5. [3-2-1: Audio output control unit 311A1]
[0037] The audio output control unit 311A1 controls the output of auxiliary information as audio. The audio output control unit 311A1 may also control the output of auxiliary information as audio that indicates the direction in which the imaging target enters the imaging range. The audio output control unit 311A1 may, for example, control the earphones worn by the imaging target. The audio output control unit 311A1 may also control the speaker mounted on the information processing device A3. The audio output control unit 311A1 may control the earphones to use a surround sound function to guide the direction in which the imaging target enters the imaging range. The audio output control unit 311A1 may control the earphones so that the volume heard from the left and right earphones becomes the same as the imaging target approaches the imaging range.
[0038] Alternatively, the audio output control unit 311A1 may be controlled to output audio corresponding to the position of the imaging target. The audio output control unit 311A1 may be controlled to output auxiliary information indicating the direction in which the imaging target is entering the imaging range, for example, by changing the audio interval. For example, the audio output control unit 311A1 may control the audio output so that the audio interval becomes narrower as the imaging target approaches the imaging range. [3-2-2: Instruction transmitter 311A2]
[0039] The instruction transmission unit 311A2 may also transmit an instruction to output auxiliary information as an image to a device other than the information processing system S3. For example, the instruction transmission unit 311A2 may cause an image showing the auxiliary information to be displayed on a smartwatch worn by the object being imaged, a display device located near the object being imaged, etc. [3-2-3: Vibration Stimulation Control Unit 311A3]
[0040] The vibration stimulation control unit 311A3 may control the application of vibration stimulation. The vibration stimulation control unit 311A3 may control the vibration function of a smartphone carried by the imaging target, a smartwatch worn by the imaging target, etc. The vibration stimulation control unit 311A3 may, for example, change the vibration according to the distance between the imaging target and a suitable location for imaging. The vibration stimulation control unit 311A3 may, for example, change the vibration as the imaging target approaches the suitable location. [3-2-4: Electrical stimulation control unit 311A4]
[0041] The electrical stimulation control unit 311A4 may control the application of electrical stimulation. The electrical stimulation control unit 311A4 may, for example, apply electrical stimulation to the imaging target via a device attached to the body of the imaging target. The electrical stimulation control unit 311A4 may, for example, change the electrical stimulation according to the distance between the imaging target and a location suitable for imaging. The electrical stimulation control unit 311A4 may, for example, change the electrical stimulation as the imaging target approaches a location suitable for imaging. [3-2-5: Light control unit 311A5]
[0042] The information processing system S3 may further include a rear light RL on the same side as the rear camera RC. The light control unit 311A5 may turn on the rear light RL and output auxiliary information. The light control unit 311A5 may change the illumination intensity of the rear light RL according to the distance between the imaging target and the imaging range, for example. The light control unit 311A5 may, for example, control the illumination intensity to increase as the imaging target approaches a suitable location for imaging. [3-3: Technical Effects of Information Processing System S3]
[0043] In the third embodiment, the information processing system S3 can guide the target to be imaged so that its iris can be properly imaged by the rear camera RC, by utilizing at least one of the functions installed in the information processing system S3 that can guide the target to be imaged, and a function that the information processing system S3 can control that can guide the target to be imaged. Furthermore, the information processing system S3 can guide the target to be imaged so that its iris can be properly imaged by the rear camera RC by changing the illumination pattern of the rear light RL. [4: Fourth Embodiment]
[0044] Next, a fourth embodiment of the information processing device, information processing method, and recording medium will be described. In the following, the fourth embodiment of the information processing device, information processing method, and recording medium will be described using an information processing system S4 to which the fourth embodiment of the information processing device, information processing method, and recording medium is applied. [4-1: Configuration of Information Processing System S4]
[0045] As shown in Figure 6, the information processing system S4 in the fourth embodiment includes a computing device 21 and a storage device 22, similar to the information processing device A2 in the second embodiment and the information processing system S3 in the third embodiment. Furthermore, the information processing system S4 in the fourth embodiment may also include a communication device 23, an input device 24, and an output device 25, similar to the information processing device A2 in the second embodiment and the information processing system S3 in the third embodiment. However, the information processing system S4 does not have to include at least one of the communication device 23, the input device 24, and the output device 25. The information processing system S4 in the fourth embodiment differs from the information processing device A2 in the second embodiment and the information processing system S3 in the third embodiment in that the image evaluation unit 411B has an imaging range evaluation unit 411B1. Other features of the information processing system S4 may be the same as other features of the information processing device A2 in the second embodiment or the information processing system S3 in the third embodiment. Therefore, the following will provide a detailed explanation of the parts that differ from the embodiments already described, while other overlapping parts will be omitted as appropriate. [4-2: Information processing operations performed by information processing system S4]
[0046] The imaging range evaluation unit 411B1 evaluates the imaging range of the image. The imaging range may also be referred to as the field of view of the rear camera RC. The imaging range evaluation unit 411B1 determines whether the iris of the subject to be imaged is included in the image. The imaging range evaluation unit 411B1 may evaluate the imaging range of the image according to the iris of the subject to be imaged included in the image. The imaging range evaluation unit 411B1 may output an image imaging range evaluation value according to the iris of the subject to be imaged included in the image.
[0047] Referring to Figure 4, the information processing operations performed by the information processing system S4 in the fourth embodiment will be described. In S22, the image evaluation unit 411B may determine whether the imaging range evaluation value is less than a threshold. If the imaging range evaluation value is less than a threshold (step S22: Yes), the image evaluation unit 411B determines whether it is necessary to guide the imaging target (step S23). If it is necessary to guide the imaging target (step S23: Yes), the guidance unit 411A may guide the imaging target so that its iris is included in the image (step S24). The guidance unit 411A may output auxiliary information to the imaging target to help ensure that its iris is included in the image. [4-3: Technical Effects of Information Processing System S4]
[0048] In the fourth embodiment, the information processing system S4 determines whether the image contains the iris of the subject to be captured and guides the system to include the iris of the subject to be captured in the image, thereby enabling the image to include the iris of the subject to be captured. [5: Fifth Embodiment]
[0049] Next, a fifth embodiment of the information processing device, information processing method, and recording medium will be described. In the following, the fifth embodiment of the information processing device, information processing method, and recording medium will be described using an information processing system S5 to which the fifth embodiment of the information processing device, information processing method, and recording medium is applied. [5-1: Configuration of Information Processing System S5]
[0050] As shown in Figure 7, the information processing system S5 in the fifth embodiment includes a arithmetic unit 21 and a storage device 22, similar to the information processing devices A2 in the second embodiment to the information processing system S4 in the fourth embodiment. Furthermore, the information processing system S5 in the fifth embodiment may also include a communication device 23, an input device 24, and an output device 25, similar to the information processing devices A2 in the second embodiment to the information processing system S4 in the fourth embodiment. However, the information processing system S5 does not have to include at least one of the communication device 23, the input device 24, and the output device 25. The information processing system S5 in the fifth embodiment differs from the information processing system S4 in the second embodiment to the information processing device A2 to the fourth embodiment in that the arithmetic unit 21 further includes a selection unit 514, and the image evaluation unit 511B has a resolution evaluation unit 511B2. Other features of the information processing system S5 may be the same as at least one other feature of the information processing system S4 in the second embodiment to the information processing device A2 to the fourth embodiment. Therefore, the following will provide a detailed explanation of the parts that differ from the embodiments already described, while other overlapping parts will be omitted as appropriate. [5-2: Information processing operations performed by information processing system S5]
[0051] The resolution evaluation unit 511B2 evaluates the resolution of the iris included in the image. The resolution evaluation unit 511B2 determines whether the iris of the subject being captured is included in the image at a predetermined resolution. The resolution evaluation unit 511B2 may make this determination based on at least one of the position of the subject's eye in the image, the interpupillary distance of the subject in the image, and the iris diameter of the subject in the image. The resolution evaluation unit 511B2 may evaluate the resolution of the image depending on whether the iris of the subject being captured is included in the image at a predetermined resolution. The resolution evaluation unit 511B2 may output an image resolution evaluation value depending on whether the iris of the subject being captured is included in the image at a predetermined resolution.
[0052] Referring to Figure 4, the information processing operations performed by the information processing system S5 in the fifth embodiment will be described. In S22 in the fifth embodiment, the image evaluation unit 511B may determine whether the resolution evaluation value is less than a threshold. If the resolution evaluation value is less than a threshold (step S22: Yes), the image evaluation unit 511B determines whether it is necessary to guide the imaging target (step S23). If it is necessary to guide the imaging target (step S23: Yes), the guidance unit 511A may guide the imaging target so that its iris is included in the image at a predetermined resolution (step S24). The guidance unit 511A may output auxiliary information to the imaging target to assist in including its iris in the image at a predetermined resolution.
[0053] Furthermore, in step S24 of the fifth embodiment, the guidance unit 511A may guide the information processing system S5 to move so that the distance between the imaging target and the rear camera RC changes. In this case, in the subsequent step S20, the imaging control unit 512 may capture images at multiple different distances. The selection unit 514 may select a desired image from multiple images. In this case, in the subsequent step S26, the authentication unit 513 may authenticate the imaging target using the iris information of the imaging target included in the selected image. [5-3: Technical Effects of Information Processing System S5]
[0054] In the fifth embodiment, the information processing system S5 determines whether the iris of the target to be captured is included in the image at a predetermined resolution, and guides the system to include the iris of the target to be captured at a predetermined resolution, thereby enabling the capture of an iris image with appropriate resolution. Furthermore, the information processing system S5 is guided to move in such a way that the distance between the target to be captured and the rear camera RC changes, and a desired image is selected from multiple images captured at multiple different distances, thereby enabling the capture of an iris image with appropriate resolution for iris authentication. [6: Sixth Embodiment]
[0055] Next, a sixth embodiment of the information processing device, information processing method, and recording medium will be described. In the following, the sixth embodiment of the information processing device, information processing method, and recording medium will be described using an information processing system S6 to which the sixth embodiment of the information processing device, information processing method, and recording medium is applied. [6-1: Configuration of Information Processing System S6]
[0056] As shown in Figure 8, the information processing system S6 in the sixth embodiment includes a arithmetic unit 21 and a storage device 22, similar to the information processing devices A2 in the second embodiment to the information processing system S5 in the fifth embodiment. Furthermore, the information processing system S6 in the sixth embodiment may also include a communication device 23, an input device 24, and an output device 25, similar to the information processing devices A2 in the second embodiment to the information processing system S5 in the fifth embodiment. However, the information processing system S6 does not have to include at least one of the communication device 23, the input device 24, and the output device 25. The information processing system S6 in the sixth embodiment differs from the information processing devices A2 in the second embodiment to the information processing system S5 in the fifth embodiment in that the image evaluation unit 611B has a brightness evaluation unit 611B3. Other features of the information processing system S6 may be the same as at least one other feature of the information processing devices A2 in the second embodiment to the information processing system S5 in the fifth embodiment. Therefore, the following will provide a detailed explanation of the parts that differ from the embodiments already described, while other overlapping parts will be omitted as appropriate. [6-2: Information processing operations performed by information processing system S6]
[0057] The brightness evaluation unit 611B3 determines the brightness of the image. The brightness evaluation unit 611B3 may also determine whether the brightness of the image is the desired brightness. The brightness evaluation unit 611B3 may determine whether the brightness of the image is the desired brightness according to the luminance of the iris region of the image. The brightness evaluation unit 611B3 may evaluate the brightness of the image according to whether the brightness of the image is the desired brightness. The brightness evaluation unit 611B3 may output an image brightness evaluation value according to whether the brightness of the image is the desired brightness.
[0058] Referring to Figure 4, the information processing operations performed by the information processing system S6 in the sixth embodiment will be described. In S22 in the sixth embodiment, the image evaluation unit 611B may determine whether the brightness evaluation value is less than a threshold. If the brightness evaluation value is less than a threshold (step S22: Yes), the image evaluation unit 611B determines whether it is necessary to guide the imaging target (step S23). If it is necessary to guide the imaging target (step S23: Yes), the guidance unit 611A may guide the image so that the brightness of the image becomes the desired brightness (step S24). The guidance unit 611A may output auxiliary information to the imaging target to help the image brightness become the desired brightness.
[0059] Furthermore, in step S24 of the sixth embodiment, the brightness evaluation unit 611B3 may detect an illumination device that is at a predetermined distance from the object to be imaged. The brightness evaluation unit 611B3 may detect an illumination device that is at a predetermined distance from the object to be imaged based on the image. The brightness evaluation unit 611B3 may determine the position of the illumination device based on the image. The brightness evaluation unit 611B3 may detect an illumination device within the image. In addition, the brightness evaluation unit 611B3 may determine the position of the object to be imaged based on the image. The brightness evaluation unit 611B3 may detect the object to be imaged within the image. The brightness evaluation unit 611B3 may determine the positional relationship between the illumination device detected in the image and the object to be imaged.
[0060] In this case, the guidance unit 611A may guide the system to change the positional relationship between the illumination device and the imaging target. The guidance unit 611A may output auxiliary information instructing the system to change the positional relationship between the illumination device and the imaging target. [6-3: Technical Effects of Information Processing System S6]
[0061] In the sixth embodiment, the information processing system S6 determines whether the brightness of the image is the desired brightness and guides the system to adjust the image brightness to the desired brightness, thereby enabling the capture of an image with the desired brightness. Furthermore, the information processing system S6 detects an illumination device that is at a predetermined distance from the object to be captured and guides the system to change the positional relationship between the illumination device and the object to be captured, thereby enabling the system to guide the object to be captured to a location where an image with the desired brightness can be captured. [7: Seventh Embodiment]
[0062] Next, a seventh embodiment of the information processing device, information processing method, and recording medium will be described. In the following, the seventh embodiment of the information processing device, information processing method, and recording medium will be described using an information processing system S7 to which the seventh embodiment of the information processing device, information processing method, and recording medium is applied.
[0063] In the seventh embodiment, the information processing system S7 differs from the information processing system S6 in the sixth embodiment in the operation of the induction unit 711A and the brightness evaluation unit 711B3. Other features of the information processing system S7 may be the same as other features of the information processing system S6 in the sixth embodiment. For this reason, the following will describe in detail the parts that differ from each embodiment already described, and will omit explanations of other overlapping parts as appropriate. [7-1: Information processing operations performed by information processing system S7]
[0064] The information processing operation performed by the information processing system S7 in the seventh embodiment may be performed before imaging, that is, before step S20. Alternatively, the information processing operation performed by the information processing system S7 in the seventh embodiment may be performed in step S24, that is, when the determination in step S23 is Yes.
[0065] In the information processing operation performed by the information processing system S7 in the seventh embodiment, the brightness evaluation unit 711B3 determines whether the object to be imaged is indoors or outdoors. The brightness evaluation unit 711B3 may determine whether the object to be imaged is indoors or outdoors depending on the light reception state of the rear camera RC. The brightness evaluation unit 711B3 may determine whether the image is being captured indoors or outdoors. The brightness evaluation unit 711B3 may determine whether the image is being captured indoors or outdoors depending on the light conditions. Before image capture, or if the image evaluation unit 711B determines in step S22 that the brightness evaluation value is less than a threshold, the brightness evaluation unit 711B3 may determine the environment in which the image is being captured.
[0066] If it is determined that the image was captured indoors, the guidance unit 711A may guide the user to move outdoors. The guidance unit 711A may output auxiliary information instructing the user to move outdoors. If the brightness evaluation unit 711B3 determines the environment in which the image was captured before the image was captured, the guidance unit 711A may display auxiliary information on the display D instructing the user to move outdoors. [7-2: Technical Effects of Information Processing System S7]
[0067] In many cases, capturing an iris image suitable for iris authentication is possible outdoors rather than indoors. In the seventh embodiment, if the information processing system S7 determines that the image was captured indoors, the guidance unit 711A guides the system to move outdoors, thereby enabling the capture of an iris image suitable for iris authentication. [8: Eighth Implementation]
[0068] Next, an eighth embodiment of the information processing device, information processing method, and recording medium will be described. In the following, the eighth embodiment of the information processing device, information processing method, and recording medium will be described using an information processing system S8 to which the eighth embodiment of the information processing device, information processing method, and recording medium is applied. [8-1: Configuration of Information Processing System S8]
[0069] As shown in Figure 10, the information processing system S8 in the eighth embodiment includes a arithmetic unit 21 and a storage device 22, similar to the information processing devices A2 in the second embodiment to the information processing system S7 in the seventh embodiment. Furthermore, the information processing system S8 in the eighth embodiment may also include a communication device 23, an input device 24, and an output device 25, similar to the information processing devices A2 in the second embodiment to the information processing system S7 in the seventh embodiment. However, the information processing system S8 does not have to include at least one of the communication device 23, the input device 24, and the output device 25. The information processing system S8 in the eighth embodiment differs from the information processing devices A2 in the second embodiment to the information processing system S7 in the seventh embodiment in that the arithmetic unit 21 further implements the lighting control unit 815. Other features of the information processing system S8 may be the same as at least one other feature of the information processing system S7 in the second embodiment to the information processing system S7 in the fifth embodiment. Therefore, the following will provide a detailed explanation of the parts that differ from the embodiments already described, while other overlapping parts will be omitted as appropriate. [8-2: Information processing operations performed by information processing system S8]
[0070] The brightness evaluation unit 811B3 determines the brightness of the image. The brightness evaluation unit 811B3 may also determine whether the brightness of the image is the desired brightness. The brightness evaluation unit 811B3 may also determine whether the brightness is darker than the desired brightness. The brightness evaluation unit 811B3 may evaluate the brightness of the image depending on whether the brightness of the image is the desired brightness. The brightness evaluation unit 811B3 may output an image brightness evaluation value depending on whether the brightness of the image is the desired brightness.
[0071] Referring to Figure 11, the information processing operations performed by the information processing system S8 in the eighth embodiment will be described. In S22 in the eighth embodiment, the image evaluation unit 811B may determine whether the brightness evaluation value is less than a threshold. If the brightness evaluation value is less than a threshold (step S22: Yes), the image evaluation unit 811B determines whether it is necessary to guide the object to be imaged (step S23). If the brightness of the image can be adjusted to the desired brightness by controlling the illumination without guiding the object to be imaged (step S23: No), the information processing system S8 controls the illumination to the object to be imaged (step S80). [8-2-1: Lighting control by the lighting control unit 815]
[0072] In step S80, the illumination control unit 815 controls the illumination operation by the illumination device. The illumination control unit 815 may search for an illumination device that can illuminate the object to be imaged. The illumination control unit 815 may detect an illumination device that is at a predetermined distance from the object to be imaged.
[0073] The lighting control unit 815 may determine the positional relationship between the lighting device and the imaging target, which are previously linked via wireless communication. Alternatively, the lighting control unit 815 may determine the position of the imaging target using a position detection mechanism, such as a global positioning system. The lighting control unit 815 may also determine which lighting device to control according to the positional relationship between the lighting device and the imaging target.
[0074] Furthermore, the brightness evaluation unit 811B3 may detect lighting devices that are at a predetermined distance from the image target based on the image. The brightness evaluation unit 811B3 may determine the position of the lighting devices based on the image. The brightness evaluation unit 811B3 may determine the direction of the lighting devices based on the image. The brightness evaluation unit 811B3 may detect lighting devices within the image. The brightness evaluation unit 811B3 may determine whether something is a lighting device based on its shape within the image.
[0075] Furthermore, the brightness evaluation unit 811B3 may identify the position of the object to be captured based on the image. The brightness evaluation unit 811B3 may detect the object to be captured within the image. The brightness evaluation unit 811B3 may determine the positional relationship between the illumination device detected within the image and the object to be captured.
[0076] The lighting control unit 815 outputs instruction information to the lighting device instructing it to adjust the brightness of the image to the desired level. The lighting control unit 815 may also output instruction information to the lighting device instructing it to increase or decrease the intensity of the light it outputs. The lighting device controlled by the lighting control unit 815 may be a lighting device that is not powered on, or a lighting device that can emit stronger light. [8-2-2: Lighting control by the light control unit 811A5]
[0077] In step S80, the light control unit 811A5 controls the illumination of the rear light RL. The light control unit 811A5 controls the illumination of the rear light RL so that the brightness of the image reaches the desired brightness. [8-3: Technical Effects of Information Processing System S8]
[0078] In the eighth embodiment, the information processing system S8 determines whether the brightness of the image is the desired brightness and outputs an instruction to the lighting device so that the brightness of the image becomes the desired brightness, thereby enabling the capture of an image with the desired brightness. Furthermore, the information processing system S8 detects lighting devices that are at a predetermined distance from the object to be captured and outputs an instruction to the lighting device so that the brightness of the image becomes the desired brightness, thereby enabling the output of an instruction to the lighting device appropriate for achieving the desired brightness. In addition, if the information processing system S8 determines that the brightness is darker than the desired brightness, it turns on the back light RL, thereby supplementing the desired brightness and enabling the capture of an image with the desired brightness. [9: Ninth Embodiment]
[0079] Next, a ninth embodiment of the information processing device, information processing method, and recording medium will be described. In the following, the ninth embodiment of the information processing device, information processing method, and recording medium will be described using an information processing system S9 to which the ninth embodiment of the information processing device, information processing method, and recording medium is applied. [9-1: Configuration of Information Processing System S9]
[0080] As shown in Figure 12, the information processing system S9 in the ninth embodiment includes an arithmetic unit 21 and a storage device 22, similar to the information processing devices A2 in the second embodiment to the information processing system S8 in the eighth embodiment. Furthermore, the information processing system S9 in the ninth embodiment may also include a communication device 23, an input device 24, and an output device 25, similar to the information processing devices A2 in the second embodiment to the information processing system S8 in the eighth embodiment. However, the information processing system S9 does not have to include at least one of the communication device 23, the input device 24, and the output device 25. The information processing system S9 in the ninth embodiment differs from the information processing devices A2 in the second embodiment to the information processing system S8 in the eighth embodiment in that the image evaluation unit 911B has a reflection evaluation unit 911B4. Other features of the information processing system S9 may be the same as at least one other feature of the information processing devices A2 in the second embodiment to the information processing system S8 in the eighth embodiment. Therefore, the following will provide a detailed explanation of the parts that differ from the embodiments already described, while other overlapping parts will be omitted as appropriate. [9-2: Information processing operations performed by information processing system S9]
[0081] The reflection evaluation unit 911B4 determines whether or not reflections are present in the image. The reflection evaluation unit 911B4 may also determine whether or not reflections are present in the iris region included in the image. Reflections in the iris region may be reflections from the iris region. The reflection evaluation unit 911B4 may, for example, determine whether or not reflections are present in the iris region included in the image according to the brightness distribution. The reflection evaluation unit 911B4 may evaluate the reflections in the image according to the reflections present in the iris region included in the image. The reflection evaluation unit 911B4 may output an image reflection evaluation value according to the reflections present in the iris region included in the image.
[0082] Referring to Figure 4, the information processing operations performed by the information processing system S9 in the ninth embodiment will be described. In step S22 of the ninth embodiment, the image evaluation unit 911B may determine whether the reflection evaluation value is less than a threshold. If the reflection evaluation value is less than a threshold (step S22: Yes), the image evaluation unit 911B determines whether it is necessary to guide the imaging target (step S23). If it is necessary to guide the imaging target (step S23: Yes), the guidance unit 911A may guide the object so that reflections are not included in the iris region (step S24). The guidance unit 911A may output auxiliary information to the imaging target to help prevent reflections from being included in the iris region. [9-3: Technical Effects of Information Processing System S9]
[0083] In the ninth embodiment, if the information processing system S9 determines that there is a reflection in the iris region, it guides the system to prevent the reflection from being included in the iris region, thereby enabling the capture of an image without reflections in the iris region. [10: Tenth Embodiment]
[0084] Next, a tenth embodiment of the information processing device, information processing method, and recording medium will be described. In the following, the tenth embodiment of the information processing device, information processing method, and recording medium will be described using an information processing system S10 to which the tenth embodiment of the information processing device, information processing method, and recording medium is applied.
[0085] In the tenth embodiment, the operation of the induction unit 1011A in the information processing system S10 differs from that of the information processing system S9 in the ninth embodiment. Other features of the information processing system S10 may be the same as other features of the information processing system S9 in the ninth embodiment. For this reason, the following will describe in detail the parts that differ from each embodiment already described, and will omit explanations of other overlapping parts as appropriate. [10-1: Information processing operations performed by information processing system S10]
[0086] The information processing operation performed by the information processing system S12 in the tenth embodiment may be performed in step S24, that is, when the determination in step S23 is Yes.
[0087] The information processing operations performed by the information processing system S10 in the tenth embodiment will be described with reference to Figure 14. Figure 14 is a flowchart showing the flow of information processing operations performed by the information processing system S10 in the tenth embodiment.
[0088] The brightness evaluation unit 1011B3 determines the brightness distribution in the image (step S100). The guidance unit 1011A may provide predetermined guidance to the image target if the brightness distribution in the image is a predetermined distribution. The predetermined brightness distribution in the image may be a brightness distribution in an image where there is a lot of reflection, making it difficult to capture an iris image suitable for iris authentication.
[0089] The reflection evaluation unit 1011B4 estimates the reflection area according to the brightness distribution in the image (step S101). The guidance unit 1011A guides the camera so that it faces the direction in which the estimated reflection area is relatively small (step S102). For example, if there is a lot of reflection on one side of the image, the guidance unit 1011A may guide the camera so that it faces the other side, opposite to the one side. For example, if there is a lot of reflection on the right side of the image, the guidance unit 1011A may guide the camera so that it faces the right side of the camera. The guidance unit 1011A may also guide the camera so that there is no reflection in the iris area of the camera in the image. [10-2: Technical Effects of Information Processing System S10]
[0090] In the tenth embodiment, the information processing system S10 provides predetermined guidance to the imaging target when the brightness distribution in the image is a predetermined distribution, thereby preventing reflections from being included in the iris region. Furthermore, the information processing system S10 estimates the reflection region according to the brightness distribution in the image and guides the imaging target so that the estimated reflection region is relatively small, thereby appropriately guiding the imaging target so that reflections are not included in the iris region. [11: Eleventh Embodiment]
[0091] Next, an eleventh embodiment of the information processing device, information processing method, and recording medium will be described. In the following, the eleventh embodiment of the information processing device, information processing method, and recording medium will be described using an information processing system S11 to which the eleventh embodiment of the information processing device, information processing method, and recording medium is applied.
[0092] In the 11th embodiment, the operation of the guidance unit 1111A and the reflection evaluation unit 1111B4 of the information processing system S11 differs from that of the information processing system S9 in the 9th embodiment and the information processing system S10 in the 10th embodiment. Other features of the information processing system S11 may be the same as other features of the information processing system S9 in the 9th embodiment or the information processing system S10 in the 10th embodiment. For this reason, the following will describe in detail the parts that differ from each embodiment already described, and will omit explanations of other overlapping parts as appropriate. [11-1: Information processing operations performed by information processing system S11]
[0093] In step S23 of Figure 4, the reflection evaluation unit 1111B4 determines whether or not there is a reflection of a first predetermined amount or more in the iris region included in the image. That is, in the 11th embodiment, if there is a reflection of a first predetermined amount or more in the iris region included in the image, the guidance unit 1111A outputs auxiliary information to the imaging target to guide the imaging target. The guidance unit 1111A may perform the guidance operation in the first case or the third case described below. [11-1-1: Case 1]
[0094] Referring to Figure 16(a), the first information processing operation performed by the information processing system S11 in the 11th embodiment will be described. Figure 16(a) is a flowchart showing the flow of the first information processing operation performed by the information processing system S11 in the 11th embodiment.
[0095] The guidance unit 1111A guides the imaging target so that it holds the information processing system S11 over its eyes to minimize reflections (step S110). Guiding the imaging target so that it holds the information processing system S11 over its eyes to minimize reflections may be referred to as the first guidance. The guidance unit 1111A may also guide the imaging target so that the shadow of the information processing system S11 falls on the iris of the imaging target. The guidance unit 1111A may also guide the imaging target so that it shields the reflections of the ceiling. The guidance unit 1111A may also guide the imaging target by outputting auxiliary information to indicate that it should hold the information processing system S11 over its eyes to minimize reflections.
[0096] The reflection evaluation unit 1111B4 determines whether or not there is a reflection of a first predetermined amount or more in the iris region included in the image (step S111). If there is no reflection of a first predetermined amount or more in the iris region included in the image (step S111: No), the first information processing operation performed by the information processing system S11 in the 11th embodiment is terminated.
[0097] If there is a first predetermined amount or more of reflection in the iris region included in the image (step S111: Yes), the guidance unit 1111A guides the imaging target to face a flat object without a pattern (step S112). Guiding the imaging target to face a flat object without a pattern may be called the second guidance. The reflection evaluation unit 1111B4 may detect textureless objects from the background in the image. The reflection evaluation unit 1111B4 may estimate textureless areas such as walls, chests of drawers, and refrigerators from the background in the image. The guidance unit 1111A may guide the imaging target to face a textureless area. The guidance unit 1111A may guide the imaging target by outputting auxiliary information to the imaging target indicating that it should face a textureless object. [11-1-2: Second case]
[0098] Referring to Figure 16(b), the second information processing operation performed by the information processing system S11 in the 11th embodiment will be described. Figure 16(b) is a flowchart showing the flow of the second information processing operation performed by the information processing system S11 in the 11th embodiment.
[0099] The reflection evaluation unit 1111B4 determines whether or not there is a reflection of a second predetermined amount or more, which is greater than a first predetermined amount, in the iris region included in the image (step S113). If there is a reflection of a second predetermined amount or more in the iris region included in the image (step S113: Yes), the guidance unit 1111A guides the imaging target to face a flat object without a pattern (step S114). If there is no reflection of a second predetermined amount or more in the iris region included in the image (step S113: No), the guidance unit 1111A guides the imaging target to hold the information processing system S11 over the eye in a way that reduces the reflection (step S115). [11-1-3: Third case]
[0100] Referring to Figure 16(c), the third information processing operation performed by the information processing system S11 in the 11th embodiment will be described. Figure 16(c) is a flowchart showing the flow of the third information processing operation performed by the information processing system S11 in the 11th embodiment.
[0101] The guidance unit 1111A guides the imaging target so that it faces a flat object without a pattern (step S116). The reflection evaluation unit 1111B4 determines whether or not there is a first predetermined amount or more of reflection in the iris region included in the image (step S117). If there is a first predetermined amount or more of reflection in the iris region included in the image (step S117: Yes), the guidance unit 1111A guides the imaging target so that it holds the information processing system S11 over the eye to reduce the reflection (step S118).
[0102] In other words, the guidance unit 1111A performs at least one of the following: guidance to hold the information processing device over the eye to minimize reflections, and guidance to face a flat object without patterns. [11-2: Technical Effects of Information Processing System S11]
[0103] In the 11th embodiment, the information processing system S11 performs at least one of the following: guidance to hold the information processing device over the eye to reduce reflections, and guidance to face a flat object without patterns, thereby suppressing reflections onto the iris region included in the image. [12: Twelfth Embodiment]
[0104] Next, a twelfth embodiment of the information processing device, information processing method, and recording medium will be described. In the following, a tenth embodiment of the information processing device, information processing method, and recording medium will be described using an information processing system S12 to which the twelfth embodiment of the information processing device, information processing method, and recording medium is applied. [12-1: Configuration of Information Processing System S12]
[0105] As shown in Figure 17, the information processing system S12 in the 12th embodiment includes a calculation unit 21 and a storage device 22, similar to the information processing devices A2 in the second embodiment to the information processing system S11 in the 11th embodiment. Furthermore, the information processing system S12 in the 12th embodiment may also include a communication device 23, an input device 24, and an output device 25, similar to the information processing devices A2 in the second embodiment to the information processing system S11 in the 11th embodiment. However, the information processing system S12 does not have to include at least one of the communication device 23, the input device 24, and the output device 25. The information processing system S12 in the 12th embodiment differs from the information processing system S11 in the 11th embodiment in that the auxiliary control unit 1211 includes an imaging instruction unit 1211C and an estimation unit 1211D. Other features of the information processing system S12 may be the same as at least one other feature of the information processing device A2 in the second embodiment to the information processing system S11 in the eleventh embodiment. For this reason, the following will describe in detail the parts that differ from each embodiment already described, and will omit explanations of other overlapping parts as appropriate. [12-2: Information processing operations performed by information processing system S12]
[0106] The information processing operation performed by the information processing system S12 in the 12th embodiment may be performed before imaging, that is, before step S20. Alternatively, the information processing operation performed by the information processing system S12 in the 12th embodiment may be performed in step S24, that is, when the determination in step S23 is Yes.
[0107] The information processing operations performed by the information processing system S12 in the 12th embodiment will be described with reference to Figure 18. Figure 18 is a flowchart showing the flow of information processing operations performed by the information processing system S12 in the 12th embodiment.
[0108] The imaging instruction unit 1211C outputs an instruction to the object to be imaged to take images from multiple different directions (step S120). The imaging instruction unit 1211C may output an instruction to the object to be imaged to take images from multiple different directions from the position of the object to be imaged. The imaging instruction unit 1211C may output an instruction to the object to be imaged to take images in all directions, 360 degrees, from the position of the object to be imaged. The imaging instruction unit 1211C may output an instruction to the object to be imaged to take images using the rear camera RC. In addition to the rear camera RC, or instead, the imaging instruction unit 1211C may output an instruction to the object to be imaged to take images using the front camera FC.
[0109] The estimation unit 1211D estimates the appropriate positional relationship between the target to be captured and the rear camera RC based on images captured from multiple different directions (step S121). The estimation unit 1211D may also estimate a location where an iris image suitable for iris authentication can be captured based on images captured from multiple different directions.
[0110] The guidance unit 1211A guides the vehicle to an appropriate positional relationship (step S121). The guidance unit 1211A may output auxiliary information indicating the appropriate positional relationship. The guidance unit 1211A may guide the vehicle to a location where an iris image suitable for iris authentication can be captured. The guidance unit 1211A may output auxiliary information indicating a location where an iris image suitable for iris authentication can be captured. [12-3: Technical Effects of Information Processing System S12]
[0111] In the 12th embodiment, the information processing system S12 estimates the appropriate positional relationship between the target to be imaged and the rear camera RC based on images captured from multiple different directions, and guides the system to achieve this appropriate positional relationship, thereby enabling imaging in the appropriate positional relationship. [13: Addendum]
[0112] The following additional information is disclosed regarding the embodiments described above. [Note 1] The display and An imaging means for capturing an object that is on a side different from the side facing the display, When the imaging means captures an image including the iris of the object to be captured in response to an imaging instruction from the object to be captured, an auxiliary means outputs auxiliary information to assist in the imaging process. An information processing device equipped with the following features. [Note 2] The auxiliary information includes at least one of the following: information regarding the imaging range of the image, information regarding the resolution of the iris included in the image, information regarding the brightness of the image, and information regarding reflections on the iris region included in the image. The information processing device described in Appendix 1. [Note 3] The auxiliary information includes information relating to at least one of the movement of the object being imaged and the posture of the object being imaged. The auxiliary means includes guidance means for guiding the target to be imaged by outputting the auxiliary information to the target to be imaged. The information processing device described in Appendix 1 or 2. [Note 4] The auxiliary means includes an audio output means for outputting the auxiliary information in audio, a transmission means for transmitting an instruction to output the auxiliary information in image form to an information processing device other than the information processing device, and a guidance means including at least one of a stimulus control means for outputting the auxiliary information in at least one of a vibration stimulus and an electrical stimulus. The guidance means outputs the auxiliary information to the object to be imaged to guide the object to be imaged. The information processing device described in Appendix 1 or 2. [Note 5] The illumination is further provided on the same side as the imaging means, The induction means turns on the light and outputs the auxiliary information. The information processing system described in Appendix 3. [Note 6] The auxiliary means includes an imaging range evaluation means for evaluating the imaging range of the image, The imaging range evaluation means determines whether the image includes the iris of the object to be imaged, The guidance means guides the image so that the iris of the object to be captured is included in the image. The information processing device described in Appendix 3. [Note 7] The auxiliary means includes a resolution evaluation means for evaluating the resolution of the iris included in the image, The resolution evaluation means determines whether the iris of the object to be captured is included in the image at a predetermined resolution. The guidance means guides the image so that the iris of the object to be captured is included in the image at a predetermined resolution. The information processing device described in Appendix 3. [Note 8] The guidance means guides the information processing device to move such that the distance between the object to be imaged and the imaging means changes. The imaging means captures the image at a plurality of different distances, The system further comprises selection means for selecting a desired image from the plurality of images. The information processing device described in Appendix 3. [Note 9] The auxiliary means includes a brightness evaluation means for determining the brightness of the image, The brightness evaluation means determines whether the brightness of the image is the desired brightness, The guidance means guides the brightness of the image to a desired brightness. The information processing device described in Appendix 3. [Note 10] The brightness evaluation means detects an illumination means that is at a predetermined distance from the imaging target, The guidance means guides the illumination means to change the positional relationship between it and the object being imaged. The information processing device described in Appendix 9. [Note 11] The brightness evaluation means determines whether the image was captured indoors or outdoors. If it is determined that the image was taken indoors, the guidance means will guide the user to move outdoors. The information processing device described in Appendix 9. [Note 12] The auxiliary means includes a brightness evaluation means for determining the brightness of the image, The brightness evaluation means determines whether the brightness of the image is the desired brightness, The auxiliary means includes an instruction output means that outputs instruction information to the lighting means instructing the brightness of the image to become a desired brightness. The information processing device described in Appendix 1 or 2. [Note 13] The brightness evaluation means detects an illumination means that is located at a predetermined distance from the imaging target, The instruction output means outputs instruction information to the lighting means that instructs the brightness of the image to become a desired brightness. The information processing device described in Appendix 12. [Note 14] The illumination is further provided on the same side as the imaging means, If the brightness evaluation means determines that the brightness is darker than the desired brightness, The auxiliary means turns on the light. The information processing device described in Appendix 12. [Note 15] The auxiliary means includes reflection evaluation means for determining whether or not reflections are included in the iris region included in the image. If the reflection evaluation means determines that a reflection is included in the iris region, The guidance means guides the iris so that no reflections are included in the iris region. The information processing device described in Appendix 3. [Note 16] The brightness evaluation means determines the brightness distribution in the image, The guidance means provides predetermined guidance to the imaging target when the distribution is a predetermined distribution. The information processing device described in Appendix 9. [Note 17] The reflection evaluation means estimates the reflection area according to the brightness distribution in the image, The guidance means guides the object so that the area estimated to be the reflection area is relatively small. The information processing device described in Appendix 15. [Note 18] If the reflection evaluation means determines that there is a predetermined or greater amount of reflection in the iris region included in the image, The aforementioned induction means is Guidance to hold the information processing device over the eye to minimize reflections, and Guidance towards flat, patternless objects. Perform at least one of the following: The information processing device described in Appendix 15. [Note 19] The aforementioned auxiliary means is An instruction to image from multiple different directions is output to the object to be imaged. Based on images captured from multiple different directions, the appropriate positional relationship between the object to be captured and the imaging means is estimated. The auxiliary means guides the object to achieve the appropriate positional relationship. The information processing device described in Appendix 3. [Note 20] When an imaging means captures an image of an object located on a side different from the side facing the display, based on an imaging instruction from the object, and captures an image including the iris of the object, it outputs auxiliary information to assist in the imaging process. Information processing methods. [Note 21] On the computer, A recording medium on which a computer program is stored that causes an information processing method to be executed to assist in imaging when an imaging means, which images an object located on a side different from the side facing the display, captures an image including the iris of the object. [Note 22] The resolution evaluation means makes a determination based on at least one of the position of the eye of the subject being captured in the image, the inter-eye distance of the subject in the image, and the iris diameter of the subject in the image. The information processing device described in Appendix 7.
[0113] This disclosure may be modified as appropriate, insofar as it does not contradict the technical idea that can be inferred from the claims and the entire specification. Information processing devices, information processing methods, and recording media that include such modifications are also included in the technical idea of this disclosure. [Explanation of symbols]
[0114] A1, A2 Information Processing Devices S3, S4, S5, S6, S7, S8, S9, S10, S11, S12 Information Processing System D Display 11 Auxiliary part RC rear camera FC front camera RL Rear Light 211,1211 Auxiliary Control Unit 211A, 311A, 411A, 511A, 611A, 711A, 811A, 911A, 1011A, 1111A, 1211A Induction section 311A1 Audio Output Control Unit 311A2 Instruction transmitter 311A3 Vibration Stimulation Control Unit 311A4 Electrical Stimulation Control Unit 311A5, 811A5 Light Control Unit 211B, 411B, 511B, 611B, 711B, 811B, 911B, 1011B, 1111B, 1211B Image Evaluation Unit 411B1 Imaging range evaluation unit 511B2 Resolution Evaluation Unit 611B3, 711B3, 811B3, 1011B3 Brightness evaluation unit 911B4, 1011B4, 1111B4 Reflection evaluation unit 212,512 Imaging Control Unit 213,513 Authentication Department 514 Selection Section 815 Lighting Control Unit 1211C Imaging Indicator 1211D Estimation part
Claims
1. The display and An imaging means for capturing an object that is on a side different from the side facing the display, An input means that accepts input from an external source, When the imaging means captures an image including the iris of the object to be captured in response to an imaging instruction from the object to be captured received by the input means, the auxiliary means outputs auxiliary information to assist in the imaging process. An information processing device equipped with the following features.
2. The auxiliary information includes at least one of the following: information regarding the imaging range of the image, information regarding the resolution of the iris included in the image, information regarding the brightness of the image, and information regarding reflections on the iris region included in the image. The information processing apparatus according to claim 1.
3. The auxiliary information includes information relating to at least one of the movement of the object being imaged and the posture of the object being imaged. The auxiliary means includes guidance means for guiding the target to be imaged by outputting the auxiliary information to the target to be imaged. The information processing apparatus according to claim 1 or 2.
4. The auxiliary means includes an audio output means for outputting the auxiliary information in audio, a transmission means for transmitting an instruction to output the auxiliary information in image form to an information processing device other than the information processing device, and a guidance means including at least one of a stimulus control means for outputting the auxiliary information in at least one of a vibration stimulus and an electrical stimulus. The guidance means outputs the auxiliary information to the object to be imaged to guide the object to be imaged. The information processing apparatus according to claim 1 or 2.
5. The illumination is further provided on the same side as the imaging means, The induction means turns on the light and outputs the auxiliary information. The information processing apparatus according to claim 3.
6. The auxiliary means includes an imaging range evaluation means for evaluating the imaging range of the image, The imaging range evaluation means determines whether the image includes the iris of the object to be imaged, The guidance means guides the image so that the iris of the object to be captured is included in the image. The information processing apparatus according to claim 3.
7. The auxiliary means includes a resolution evaluation means for evaluating the resolution of the iris included in the image, and the resolution evaluation means determines whether the iris of the subject being captured is included in the image at a predetermined resolution. The guidance means guides the image so that the iris of the object to be captured is included in the image at a predetermined resolution. The information processing apparatus according to claim 3.
8. The guidance means guides the information processing device to move such that the distance between the object to be imaged and the imaging means changes. The imaging means captures the image at a plurality of different distances, The system further comprises selection means for selecting a desired image from a plurality of images captured at a plurality of different distances. The information processing apparatus according to claim 3.
9. The input means accepts input from an external source, When the imaging means receives an imaging instruction from an object that is located on a side different from the side facing the display, and the imaging means captures an image including the iris of the object, it outputs auxiliary information to assist in imaging. The information processing method performed by computers.
10. On the computer, The input method accepts input from an external source. When the imaging means receives an imaging instruction from an object that is located on a side different from the side facing the display, and the imaging means captures an image including the iris of the object, it outputs auxiliary information to assist in imaging. A computer program that executes an information processing method.