Information processing device, information processing method, and recording medium

Abstract

This information processing device comprises a visible light camera for capturing an image of a subject, a near-infrared camera for capturing an image of the subject, a change means that changes the imaging range of the near-infrared camera, and a control means that, on the basis of a visible light image captured by the visible light camera, if a predetermined condition is satisfied, controls the change means such that the imaging range of the near-infrared camera is set higher than when the predetermined condition is not satisfied.

Description

Information processing device, information processing method, and recording medium

[0001] The present disclosure relates to the technical fields of an information processing device, an information processing method, and a recording medium.

[0002] For example, a device has been proposed that, when performing user authentication using an infrared image, displays an infrared image if both eyes of a person are included in the infrared image, but does not display an infrared image if both eyes of a person are not included in the infrared image (see Patent Document 1).Other prior art documents related to this disclosure include Patent Document 2.

[0003] International Publication No. 2018 / 003336 Japanese Patent Application Laid-Open No. 2005-077778

[0004] An object of this disclosure is to provide an information processing device, an information processing method, and a recording medium that aim to improve upon the techniques described in prior art documents.

[0005] One aspect of an information processing device includes a visible light camera that captures an image of an object, a near-infrared camera that captures an image of the object, a change means that changes the image capture range of the near-infrared camera, and a control means that controls the change means so that, when predetermined conditions are satisfied based on a visible light image captured by the visible light camera, the image capture range of the near-infrared camera is set higher than when the predetermined conditions are not satisfied.

[0006] One aspect of the information processing method is an information processing device that includes a visible light camera that captures an image of an object and a near-infrared camera that captures an image of the object, and when a predetermined condition is met based on a visible light image captured by the visible light camera, the imaging range of the near-infrared camera is set higher than when the predetermined condition is not met.

[0007] One aspect of the recording medium has recorded thereon a computer program for causing a computer constituting an information processing device having a visible light camera that captures an image of an object and a near-infrared camera that captures an image of the object to execute an information processing method in which, when predetermined conditions are satisfied based on a visible light image captured by the visible light camera, the imaging range of the near-infrared camera is set higher than when the predetermined conditions are not satisfied.

[0008] Fig. 1 is a block diagram showing an example of an information processing device; Fig. 2 is a diagram showing an example of an imaging range of a near-infrared camera; Fig. 3 is a block diagram showing another example of an information processing device; Fig. 4 is a diagram showing an example of a near-infrared camera; Fig. 5 is a diagram showing another example of a near-infrared camera; Fig. 6 is a block diagram showing another example of an information processing device.

[0009] An information processing device, an information processing method, and a recording medium according to an embodiment will be described with reference to the accompanying drawings.

[0010] First Embodiment A first embodiment of an information processing device, an information processing method, and a recording medium will be described with reference to Fig. 1. In the following, the first embodiment of the information processing device, the information processing method, and the recording medium will be described using an information processing device 1.

[0011] 1, the information processing device 1 includes a visible light camera 11, a near-infrared camera 12, a change unit 13, and a control unit 14. The visible light camera 11 is a camera having a light receiving element capable of receiving visible light. The near-infrared camera 12 is a camera having a light receiving element capable of receiving near-infrared light. Since various existing aspects can be applied to the visible light camera 11 and the near-infrared camera 12, detailed explanations thereof will be omitted. The visible light camera 11 and the near-infrared camera 12 may be housed in different housings or in the same housing.

[0012] The change unit 13 is configured to be able to change the imaging range of the near-infrared camera 12. The change unit 13 may change the imaging range of the near-infrared camera 12 by changing the optical axis direction of the near-infrared camera 12. For example, the change unit 13 may change the imaging range of the near-infrared camera 12 by rotating the near-infrared camera 12 around a predetermined rotation axis. When near-infrared light reflected by a mirror is incident on the near-infrared camera 12, the change unit 13 may change the imaging range of the near-infrared camera 12 by changing the angle of the mirror.

[0013] The control unit 14 controls the change unit 13 so that, when a predetermined condition is satisfied based on the visible light image captured by the visible light camera 11, the imaging range of the near-infrared camera 12 is set higher than when the predetermined condition is not satisfied. Note that "upper" refers to the upper side in the vertical direction. In FIG. 2, the dotted line represents the imaging range of the near-infrared camera 12 when the predetermined condition is not satisfied. "When the predetermined condition is satisfied, the imaging range of the near-infrared camera 12 is set higher than when the predetermined condition is not satisfied" may mean shifting the imaging range of the near-infrared camera 12 above the head of the target (see the human figure in FIG. 2).

[0014] In the information processing device 1 equipped with the visible light camera 11 and the near-infrared camera 12, it can be said that an information processing method is performed in which, when predetermined conditions are met based on the visible light image captured by the visible light camera 11, the imaging range of the near-infrared camera 12 is set higher than when the predetermined conditions are not met.

[0015] The information processing device 1 may be realized by a computer reading a computer program recorded on a recording medium. In this case, it can be said that the recording medium stores a computer program for causing the computer constituting the information processing device 1, which includes the visible light camera 11 and the near-infrared camera 12, to execute an information processing method in which, when a predetermined condition is satisfied based on a visible light image captured by the visible light camera 11, the imaging range of the near-infrared camera 12 is set higher than when the predetermined condition is not satisfied.

[0016] (Technical Effect) The images captured by the visible light camera 11 and the near-infrared camera 12 may be used for biometric authentication. For example, the visible light image captured by the visible light camera 11 may be used for facial authentication. The near-infrared image captured by the near-infrared camera 12 may be used for iris authentication. However, when the clothing of a subject (e.g., a person to be biometrically authenticated) is captured by the near-infrared camera 12, the subject's clothing may be visible through the near-infrared image. This may increase the number of subjects who are resistant to biometric authentication or who are resistant to being photographed for biometric authentication.

[0017] In the information processing device 1, when a predetermined condition is satisfied based on the visible light image captured by the visible light camera 11, the control unit 14 controls the change unit 13 to set the imaging range of the near-infrared camera 12 higher than when the predetermined condition is not satisfied. For example, the predetermined condition may be that "clothing of a subject (e.g., a person to be biometric authentication) is included in the imaging range of the near-infrared camera 12." If the imaging range of the near-infrared camera 12 is changed to an upper position when this predetermined condition is satisfied, it is possible to prevent the inclusion of the subject's clothing in the imaging range of the near-infrared camera 12. Therefore, the information processing device 1 can reduce resistance to biometric authentication using near-infrared images captured by the near-infrared camera 12 and resistance to photographing for biometric authentication.

[0018] Second Embodiment A second embodiment of an information processing device, an information processing method, and a recording medium will be described with reference to Fig. 3 to Fig. 5. In the following, the second embodiment of the information processing device, the information processing method, and the recording medium will be described using an information processing device 2.

[0019] 3 , the information processing device 2 includes a calculation device 21, a storage device 22, a communication device 23, a visible light camera 26, and a near-infrared camera 27. The information processing device 2 may include an input device 24 and an output device 25. The information processing device 2 does not have to include at least one of the input device 24 and the output device 25. In the information processing device 2, the calculation device 21, the storage device 22, the communication device 23, the input device 24, the output device 25, the visible light camera 26, and the near-infrared camera 27 may be connected via a data bus 28. The visible light camera 26 and the near-infrared camera 27 may be housed in different housings or in the same housing.

[0020] The arithmetic device 21 may include, for example, at least one of a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an FPGA (Field Programmable Gate Array), a TPU (Tensor Processing Unit), and a quantum processor.

[0021] The storage device 22 may include, for example, at least one of a RAM (Random Access Memory), a ROM (Read Only Memory), a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and an optical disk array. In other words, the storage device 22 may include a non-transitory recording medium. The storage device 22 is capable of storing desired data. For example, the storage device 22 may temporarily store a computer program executed by the arithmetic device 21. The storage device 22 may temporarily store data that is temporarily used by the arithmetic device 21 when the arithmetic device 21 is executing a computer program.

[0022] The communication device 23 may be capable of communicating with devices external to the information processing device 2. The communication device 23 may perform wired communication or wireless communication. Wired communication is not limited to communication via a network, but also includes communication via a cable such as a USB (Universal Serial Bus) cable. Wireless communication is not limited to communication via a network, but also includes short-range wireless communication such as Bluetooth (registered trademark).

[0023] The input device 24 is a device capable of accepting information input to the information processing device 2 from outside. The input device 24 may include an operation device (e.g., a keyboard, a mouse, a touch panel, etc.) that can be operated by an operator of the information processing device 2. The input device 24 may include a recording medium reading device that can read information recorded on a recording medium that is detachable from the information processing device 2, such as a USB memory. Note that when information is input to the information processing device 2 via the communication device 23 (in other words, when the information processing device 2 obtains information via the communication device 23), the communication device 23 may function as an input device.

[0024] The output device 25 is a device capable of outputting information to the outside of the information processing device 2. The output device 25 may output visual information such as text or images, auditory information such as sound, or tactile information such as vibration, as the information. The output device 25 may include, for example, at least one of a display, a speaker, a printer, and a vibration motor. The output device 25 may be capable of outputting information to a recording medium detachable from the information processing device 2, such as a USB memory. Note that when the information processing device 2 outputs information via the communication device 23, the communication device 23 may function as the output device.

[0025] The arithmetic device 21 may have, as logically realized functional blocks or physically realized processing circuits, an image acquisition unit 211, a face detection unit 212, a person detection unit 213, a clothing determination unit 214, a direction control unit 215, an eye detection unit 216, a face authentication unit 217, an iris authentication unit 218, and an integrated authentication unit 219. Note that at least one of the image acquisition unit 211, the face detection unit 212, the person detection unit 213, the clothing determination unit 214, the direction control unit 215, the eye detection unit 216, the face authentication unit 217, the iris authentication unit 218, and the integrated authentication unit 219 may be realized in a form in which a logical functional block and a physical processing circuit (i.e., hardware) are mixed. If at least a portion of the image acquisition unit 211, face detection unit 212, person detection unit 213, clothing determination unit 214, orientation control unit 215, eye detection unit 216, face authentication unit 217, iris authentication unit 218, and integrated authentication unit 219 are functional blocks, at least a portion of the image acquisition unit 211, face detection unit 212, person detection unit 213, clothing determination unit 214, orientation control unit 215, eye detection unit 216, face authentication unit 217, iris authentication unit 218, and integrated authentication unit 219 may be realized by the calculation device 21 executing a predetermined computer program.

[0026] The arithmetic device 21 may acquire (in other words, read) the predetermined computer program from the storage device 22. The arithmetic device 21 may read the predetermined computer program stored in a computer-readable, non-transitory recording medium using a recording medium reading device (not shown) included in the information processing device 2. The arithmetic device 21 may acquire (in other words, download or read) the predetermined computer program from a device (not shown) external to the information processing device 2 via the communication device 23. Note that the recording medium for recording the predetermined computer program executed by the arithmetic device 21 may be at least one of an optical disk, a magnetic medium, a magneto-optical disk, a semiconductor memory, and any other medium capable of storing a program.

[0027] The image acquisition unit 211 acquires a visible light image captured by the visible light camera 26. The face detection unit 212 detects a facial region of a person included in the visible light image. The detection result of the face detection unit 212 may be output to at least one of the orientation control unit 215, the eye detection unit 216, and the face authentication unit 217. Note that existing technology can be applied to the method of detecting a facial region of a person included in the visible light image, and therefore detailed description thereof will be omitted.

[0028] The person detection unit 213 detects people included in the visible light image. Here, the person detection unit 213 detects people whose head regions are included in the visible light image. Note that the face regions of people detected by the person detection unit 213 do not have to be included in the visible light image. The detection result of the person detection unit 213 may be output to the clothing determination unit 214.

[0029] The clothing determination unit 214 identifies clothing worn by a person included in the visible light image. The clothing determination unit 214 may identify clothing worn by a person included in the visible light image, for example, by pattern recognition. The clothing determination unit 214 may identify clothing worn by a person included in the visible light image using a computational model that, when a visible light image is input, outputs clothing worn by the person included in the visible light image. An example of such a computational model is a computational model using a neural network (e.g., a convolutional neural network (CNN)). Note that information about clothing worn by a person included in the visible light image (in other words, information about clothing identified by the clothing determination unit 214) can be considered to be information indicating the status of the person (e.g., a subject of biometric authentication).

[0030] The clothing determination unit 214 determines whether the clothing worn by the person included in the visible light image is specific clothing. Here, the specific clothing may be a swimsuit. The specific clothing may also be clothing that is opaque to visible light but transparent to near-infrared light (for example, clothing of a relatively dark color). The determination result of the clothing determination unit 214 is output to the orientation control unit 215.

[0031] The orientation control unit 215 changes the imaging range of the near-infrared camera 27. As shown in FIG. 4 , if the near-infrared camera 27 is supported by a support member 27a that is rotatable about a rotation axis AX1, the orientation control unit 215 may change the imaging range of the near-infrared camera 27 by rotating the support member 27a about the rotation axis AX1 using a motor (not shown). As shown in FIG. 5 , if the mirror M that guides near-infrared light to the near-infrared camera 27 is rotatable about a rotation axis AX2, the orientation control unit 215 may change the imaging range of the near-infrared camera 27 by rotating the mirror M about the rotation axis AX2 using a motor (not shown). The orientation control unit 215 corresponds to an example of the control unit 14 in the first embodiment described above.

[0032] The angle of rotation may be determined based on the result of person detection. For example, if a face has been detected, the angle at which the face is captured at the very bottom of the near-infrared image by the near-infrared camera may be calculated from the size of the face detected in the visible light image and its position on the image, and the rotation angle may be determined by calculating the difference from the current angle. If a head or person region is detected instead of a face, the region of the body may be estimated from the size of the detected head or person region, and the angle at which the body region below the neck is outside the screen of the near-infrared image may be calculated by calculating the difference from the current angle.

[0033] If the clothing determination unit 214 determines that the clothing of the person included in the visible light image is not a specific clothing, the orientation control unit 215 changes the imaging range of the near-infrared camera 27 so that the imaging range of the near-infrared camera 27 becomes the initial setting range. In this case, if the imaging range of the near-infrared camera 27 is the initial setting range before the imaging range of the near-infrared camera 27 is changed, the orientation control unit 215 does not need to change the imaging range of the near-infrared camera 27.

[0034] If the clothing determination unit 214 determines that the clothing of the person included in the visible light image is specific clothing, the orientation control unit 215 changes the imaging range of the near-infrared camera 27 so that the clothing of the person included in the visible light image is not included in the imaging range of the near-infrared camera 27. As a result, the imaging range of the near-infrared camera 27 moves upward from the initial setting range. In this case, the orientation control unit 215 may change the imaging range of the near-infrared camera 27 so that the clothing of the person included in the visible light image is not included in the imaging range of the near-infrared camera 27 and the eyes of the person included in the visible light image are included in the imaging range of the near-infrared camera 27. Note that information (e.g., calibration information) indicating the relationship between the imaging range of the visible light camera 26 and the imaging range of the near-infrared camera 27 is assumed to be known. Based on the information and the visible light image, the orientation control unit 215 may change the imaging range of the near-infrared camera 27 so that the clothing of the person included in the visible light image is not included in the imaging range of the near-infrared camera 27 and the eyes of the person included in the visible light image are included in the imaging range of the near-infrared camera 27.

[0035] After the processing of the orientation control unit 215 is completed (for example, after the imaging range of the near-infrared camera 27 is changed by the orientation control unit 215), the near-infrared camera 27 captures an image. The image acquisition unit 211 acquires a near-infrared image captured by the near-infrared camera 27. The eye detection unit 216 detects the eye region of a person included in the near-infrared image. The eye detection unit 216 may detect the eye region of a person included in the near-infrared image based on the detection result of the face detection unit 212. The detection result of the eye detection unit 216 may be output to the iris authentication unit 218. Since existing technology can be applied to the method of detecting the eye region of a person included in the near-infrared image, detailed description thereof will be omitted.

[0036] The face authentication unit 217 performs face authentication using the visible light image. The face authentication unit 217 may identify a face region of a person (e.g., a person to be subjected to face authentication) included in the visible light image based on the detection result of the face detection unit 212. For example, the face authentication unit 217 may extract, from the visible light image, feature amounts related to the face region of the person (e.g., a person to be subjected to face authentication). The face authentication unit 217 may compare the extracted feature amounts with feature amounts included in the feature amount data 221 to calculate a face matching score.

[0037] The iris authentication unit 218 performs iris authentication using the near-infrared image. The iris authentication unit 218 may identify the eye region of a person (e.g., a subject of iris authentication) included in the near-infrared image based on the detection result of the eye detection unit 216. For example, the iris authentication unit 218 may extract, from the near-infrared image, feature amounts related to the eye region of the person (e.g., a subject of iris authentication) included in the near-infrared image. The iris authentication unit 218 may compare the extracted feature amounts with feature amounts included in the feature amount data 221 to calculate an iris matching score.

[0038] The integrated authentication unit 219 may calculate an integrated score based on, for example, the face matching score calculated by the face authentication unit 217 and the iris matching score calculated by the iris authentication unit 218. If the integrated score is equal to or greater than a threshold, the integrated authentication unit 219 may determine that the subject (i.e., a person who is a subject of face authentication and also a subject of iris authentication) is a registrant. If the integrated score is less than the threshold, the integrated authentication unit 219 may determine that the subject is not a registrant.

[0039] (Technical Effect) In the information processing device 2, when the clothing determination unit 214 determines that the clothing of a person included in the visible light image is specific clothing, the orientation control unit 215 changes the imaging range of the near-infrared camera 27 so that the clothing of the person included in the visible light image is not included in the imaging range of the near-infrared camera 27. Therefore, the information processing device 2 can reduce resistance to biometric authentication using near-infrared images captured by the near-infrared camera 27 and to photographing for biometric authentication. As a result, biometric authentication can be introduced even in places where the person to be authenticated is likely to be wearing a swimsuit, such as pools and beaches. This makes it possible to introduce biometric authentication payments to pools, beaches, and the like, and to realize entrance and exit management for paid swimming areas using biometric authentication, for example.

[0040] When the clothing determination unit 214 determines that the clothing of the person included in the visible light image is specific clothing, the orientation control unit 215 may change the imaging range of the near-infrared camera 27 so that the imaging range of the near-infrared camera 27 does not include the clothing of the person included in the visible light image and includes the eyes of the person. Therefore, the information processing device 2 can capture a near-infrared image that can be used for iris authentication while avoiding the clothing of the person being included in the imaging range.

[0041] (First Modification) When the person detection unit 213 detects multiple people from the visible light image, the near-infrared camera 27 may not capture an image. In this case, if multiple people are not detected in the visible light image captured by the visible light camera 26 after the person detection unit 213 detects multiple people from the visible light image, the near-infrared camera 27 may resume capturing an image. In other words, when a person other than the subject of biometric authentication is included in the visible light image, the near-infrared camera 27 may temporarily stop capturing an image.

[0042] When the person detection unit 213 detects multiple people from the visible light image (for example, when multiple head regions are detected), the orientation control unit 215 may change the imaging range of the near-infrared camera 27 so that the clothing of the person determined by the clothing determination unit 214 to be wearing specific clothing is not included in the imaging range of the near-infrared camera 27. Alternatively, when the person detection unit 213 detects multiple people from the visible light image (for example, when multiple head regions are detected), the orientation control unit 215 may change the imaging range of the near-infrared camera 27 based on the multiple head regions corresponding to the multiple people respectively so that body parts (for example, parts below the neck or torso parts) of all of the multiple people included in the visible light image are not included in the imaging range of the near-infrared camera 27. In this case, when the area of ​​the person to be biometrically authenticated occupying the imaging range of the near-infrared camera 27 becomes smaller than a predetermined size as a result of changing the imaging range of the near-infrared camera 27, the orientation control unit 215 may control the output device 25 to issue a warning. The orientation control unit 215 may, for example, control the output device 25 to display a visible light image captured by the visible light camera 26 while issuing a warning message indicating that only the subject of biometric authentication is captured in the image.

[0043] Even if multiple people are detected, it is not necessary to exclude people who are far away from the focal distance of the near-infrared camera 27. To do this, it is necessary to know the distance from the camera to each person, but since the approximate distance can be estimated from the size of the detection result, it is sufficient to determine whether or not to exclude a person based on the estimated distance.

[0044] (Second Modification) The information processing device 2 may acquire information about the environment surrounding the information processing device 2 (in other words, the environment surrounding the biometric authentication subject). The information about the environment may include at least one of information about the installation location of the information processing device 2 and information about the weather. If the information about the environment indicates that the biometric authentication subject is in an environment where there is a possibility that they may get wet (for example, if the information about the environment indicates that the information processing device 2 is installed by a pool or at a beach, or if it indicates that it is raining), the orientation control unit 215 may change the imaging range of the near-infrared camera 27 so that the clothing of the biometric authentication subject is not included in the imaging range of the near-infrared camera 27. In this case, the clothing determination unit 214 may not make a determination.

[0045] (Third Modification) The clothing determination unit 214 does not have to determine whether the clothing of a person included in the visible light image is specific clothing. In this case, the clothing determination unit 214 may identify the position in the visible light image of the clothing of the person included in the visible light image. In other words, the clothing determination unit 214 may identify the position of the clothing of the person within the imaging range of the visible light camera 26. Based on the position of the clothing identified by the clothing determination unit 214, the orientation control unit 215 may change the imaging range of the near-infrared camera 27 so that the clothing of the person included in the visible light image is not included in the imaging range of the near-infrared camera 27, regardless of the type of clothing the person is wearing.

[0046] Third Embodiment A third embodiment of an information processing device, an information processing method, and a recording medium will be described with reference to Fig. 6. Hereinafter, the third embodiment of an information processing device, an information processing method, and a recording medium will be described using an information processing device 3. Note that in the third embodiment, descriptions that overlap with the second embodiment will be omitted as appropriate, and common parts in the drawings will be indicated by the same reference numerals.

[0047] In FIG. 5, the arithmetic unit 21 of the information processing device 3 has a water droplet detection unit 311 and a guidance presentation unit 312 as logically realized functional blocks or as physically realized processing circuits.

[0048] The water droplet detection unit 311 detects water droplets on the face of a person (e.g., a subject of biometric authentication) included in a visible light image captured by the visible light camera 26, based on the visible light image. The water droplet detection unit 311 may detect water droplets on the face of a person included in the visible light image, for example, by using a computational model that, when a visible light image is input, outputs a determination result as to whether or not water droplets are attached to the person's face. An example of such a computational model is a computational model using a neural network (e.g., CNN).

[0049] When water droplets are detected by the water droplet detection unit 311, the guidance presentation unit 312 controls the output device 25 so that information that guides the behavior of a person (e.g., a person being biometrically authenticated) is presented, such as "Please wipe off the water droplets from your face."

[0050] (Technical Effect) When water droplets are attached to the face of a person to be subjected to facial authentication, the accuracy of facial authentication may be reduced. In the information processing device 3, when water droplets are detected on the face by the water droplet detection unit 311, information such as "Please wipe off any water droplets from your face" is displayed. Therefore, the information processing device 3 can prevent a reduction in the accuracy of facial authentication due to water droplets.

[0051] (Modification) In addition to water droplets on the face, the water droplet detection unit 311 may detect an article covering the person's eyes, such as goggles. When the water droplet detection unit 311 detects an article covering the person's eyes, the guidance presentation unit 312 may control the output device 25 to present information that guides the person (e.g., the subject of biometric authentication) to take action, such as "Please remove the article."

[0052] <Supplementary Notes> The following supplementary notes are further disclosed regarding the above-described embodiment.

[0053] (Supplementary Note 1) An information processing device comprising: a visible light camera that captures an image of an object; a near-infrared camera that captures an image of the object; a change means that changes an image capturing range of the near-infrared camera; and a control means that, when a predetermined condition is satisfied based on a visible light image captured by the visible light camera, controls the change means so that the image capturing range of the near-infrared camera is set higher than when the predetermined condition is not satisfied.

[0054] (Supplementary Note 2) The information processing device according to Supplementary Note 1, further comprising: an estimation means for estimating a situation based on the visible light image; and the control means controls the change means such that, when the situation satisfies the predetermined condition, the imaging range of the near-infrared camera is set higher than when the situation does not satisfy the predetermined condition.

[0055] (Supplementary Note 3) The information processing device according to Supplementary Note 2, wherein the situation includes information about the subject's clothing, and the control means controls the change means so that the subject's clothing is not included in the imaging range of the near-infrared camera when the situation satisfies the predetermined condition.

[0056] (Supplementary Note 4) The information processing device described in Supplementary Note 3, wherein the predetermined condition includes that the subject's clothing is a swimsuit, and the control means controls the change means so that the subject's clothing is not included in the imaging range of the near-infrared camera when the situation satisfies the predetermined condition that the subject's clothing is a swimsuit.

[0057] (Supplementary Note 5) The information processing device described in any one of Supplementary Notes 2 to 4, wherein the situation includes information about the environment surrounding the subject, the predetermined condition includes an environment in which the subject may get wet, and the control means controls the change means so that no body part of the subject is included in the imaging range of the near-infrared camera when the situation satisfies the predetermined condition of an environment in which the subject may get wet.

[0058] (Supplementary Note 6) The information processing device according to any one of Supplementary Notes 1 to 5, further comprising: an estimation means for estimating head regions of the target and other people when the visible light image includes, in addition to the target, other people present around the target; and the control means controls the modification means based on the estimated head regions so that body parts of the target and other people are not included in the imaging range of the near-infrared camera.

[0059] (Supplementary Note 7) The information processing device according to Supplementary Note 6, further comprising an alarm means for issuing a warning when the control means controls the change means based on the estimated head region so that the object and the other person's body parts are not included in the imaging range of the near-infrared camera, and as a result, the object occupies less than a predetermined size in the imaging range of the near-infrared camera.

[0060] (Supplementary Note 8) The information processing device according to any one of Supplementary Notes 1 to 7, further comprising: a notification unit that, when water droplets are detected on the face of the subject based on the visible light image, outputs information to the subject requesting the subject to remove the water droplets.

[0061] (Supplementary Note 9) The information processing device according to any one of Supplementary Notes 1 to 8, further comprising: a notification unit that, when an attachment covering the subject's eyes is detected based on the visible light image, outputs information to the subject requesting the subject to remove the attachment.

[0062] (Supplementary Note 10) An information processing method comprising: an information processing device including a visible light camera that captures an image of an object; and a near-infrared camera that captures an image of the object; and when a predetermined condition is satisfied based on a visible light image captured by the visible light camera, the imaging range of the near-infrared camera is set higher than when the predetermined condition is not satisfied.

[0063] (Supplementary Note 11) A recording medium having recorded thereon a computer program for causing a computer constituting an information processing device including a visible light camera that captures an image of an object and a near-infrared camera that captures an image of the object to execute an information processing method, the information processing method comprising: setting an imaging range of the near-infrared camera to an upper position when a predetermined condition is satisfied based on a visible light image captured by the visible light camera compared to when the predetermined condition is not satisfied.

[0064] This disclosure is not limited to the above-described embodiments, but may be modified as appropriate within the scope of the claims and the gist or idea of ​​the invention as can be read from the entire specification, and information processing devices, information processing methods, and recording media that involve such modifications are also included in the technical scope of this disclosure.

[0065] 1, 2, 3 Information processing device 11, 26 Visible light camera 12, 27 Near-infrared camera 21 Arithmetic unit 211 Image acquisition unit 212 Face detection unit 213 Person detection unit 214 Clothing determination unit 215 Orientation control unit 216 Eye detection unit 217 Face authentication unit 218 Iris authentication unit 219 Integrated authentication unit 311 Water droplet detection unit 312 Guidance presentation unit

Claims

1. a visible light camera that captures an image of the target; a near-infrared camera that captures an image of the target; A change unit for changing the imaging range of the near-infrared camera; an estimation means for estimating a situation based on a visible light image captured by the visible light camera; a control means for controlling the change means so that, when the situation satisfies a predetermined condition, the imaging range of the near-infrared camera is set higher than when the situation does not satisfy the predetermined condition; Equipped with The situation includes information about clothing worn by the subject. Information processing device.

2. When the situation satisfies the predetermined condition, the control means controls the change means so that the clothing of the subject is not included in the imaging range of the near-infrared camera. The information processing device according to claim 1 .

3. the predetermined condition includes that the subject is wearing a swimsuit; When the situation satisfies the predetermined condition that the subject's clothing is a swimsuit, the control means controls the change means so that the subject's clothing is not included in the imaging range of the near-infrared camera. The information processing device according to claim 2 .

4. the context includes information about the subject's surrounding environment; the predetermined condition includes an environment in which the object may get wet; When the situation satisfies the predetermined condition that the environment is one in which the object may get wet, the control means controls the change means so that a body part of the object is not included in the imaging range of the near-infrared camera. The information processing device according to claim 1 .

5. an estimation means for estimating head regions of the target and other people when the visible light image includes, in addition to the target, other people around the target; The control means controls the change means based on the estimated head region so that the imaging range of the near-infrared camera does not include body parts of the target and the other person. The information processing device according to claim 1 .

6. The control means controls the change means based on the estimated head region so that the object and the body parts of the other person are not included in the imaging range of the near-infrared camera, and as a result, the object occupies a smaller area than a predetermined area in the imaging range of the near-infrared camera. The information processing device according to claim 5 .

7. and a notification means for outputting information to the subject requesting the subject to remove water droplets when water droplets are detected on the subject's face based on the visible light image. The information processing device according to claim 1 .

8. and a notification means for outputting information to the subject requesting the subject to remove an attachment covering the subject's eyes when the attachment covering the subject's eyes is detected based on the visible light image. The information processing device according to claim 1 .

9. An information processing device including a visible light camera that captures an image of an object and a near-infrared camera that captures an image of the object, Estimating a situation based on the visible light image captured by the visible light camera; When the situation satisfies a predetermined condition, the imaging range of the near-infrared camera is set higher than when the situation does not satisfy the predetermined condition; The situation includes information about clothing worn by the subject. Information processing methods.

10. A computer constituting an information processing device including a visible light camera that captures an image of an object and a near-infrared camera that captures an image of the object, Estimating a situation based on the visible light image captured by the visible light camera; When the situation satisfies a predetermined condition, the imaging range of the near-infrared camera is set higher than when the situation does not satisfy the predetermined condition; The situation includes information about clothing worn by the subject. A recording medium on which a computer program for executing an information processing method is recorded.