Information processing device, information processing method, and recording medium

Abstract

The present invention provides an information processing device and an information processing method that can reduce resistance to biometric authentication using images captured by a near-infrared camera, as well as resistance to taking images for biometric authentication. [Solution] The information processing device includes a visible light camera for imaging an object, a near-infrared camera for imaging an object, a changing means for changing the imaging range of the near-infrared camera, and a control means for controlling the changing means based on a visible light image captured by the visible light camera, such that when predetermined conditions are met, the imaging range of the near-infrared camera is set higher than when the predetermined conditions are not met.

Description

Technical Field

[0001] This disclosure relates to the technical field of information processing apparatuses, information processing methods, and recording media.

Background Art

[0002] For example, when performing user authentication using an infrared image, there has been proposed an apparatus that displays the infrared image when both eyes of a person are included in the infrared image, and does not display the infrared image when both eyes of a person are not included in the infrared image (see Patent Document 1). In addition, Patent Document 2 is cited as a prior art document related to this disclosure.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0004] This disclosure aims to provide an information processing apparatus, an information processing method, and a recording medium for improving the technologies described in the prior art documents.

Means for Solving the Problems

[0005] One aspect of the information processing apparatus includes a visible light camera that images a target, a near-infrared camera that images the target, a changing means that changes the imaging range of the near-infrared camera, and a control means that controls the changing means such that when a predetermined condition is satisfied based on a visible light image imaged by the visible light camera, the imaging range of the near-infrared camera is set higher than when the predetermined condition is not satisfied.

[0006] One aspect of the information processing method is an information processing device comprising a visible light camera for imaging an object and a near-infrared camera for imaging the object, wherein, based on the visible light image captured by the visible light camera, if predetermined conditions are met, the imaging range of the near-infrared camera is set to a position higher than when the predetermined conditions are not met.

[0007] One embodiment of a recording medium contains a computer program that causes a computer comprising an information processing device equipped with a visible light camera for imaging an object and a near-infrared camera for imaging the object to execute an information processing method in which, based on a visible light image captured by the visible light camera, the imaging range of the near-infrared camera is set to a position higher than when the predetermined conditions are not met, if those conditions are met. [Brief explanation of the drawing]

[0008] [Figure 1] This is a block diagram showing an example of an information processing device. [Figure 2] This figure shows an example of the imaging range of a near-infrared camera. [Figure 3] This is a block diagram showing another example of an information processing device. [Figure 4] This figure shows an example of a near-infrared camera. [Figure 5] This figure shows another example of a near-infrared camera. [Figure 6] This is a block diagram showing another example of an information processing device. [Modes for carrying out the invention]

[0009] Embodiments of an information processing device, an information processing method, and a recording medium will be described based on the drawings.

[0010] <First Embodiment> A first embodiment of the information processing device, information processing method, and recording medium will be described with reference to Figure 1. Hereinafter, the first embodiment of the information processing device, information processing method, and recording medium will be described using the information processing device 1.

[0011] In Figure 1, the information processing device 1 comprises a visible light camera 11, a near-infrared camera 12, a change unit 13, and a control unit 14. The visible light camera 11 is a camera having a light-receiving element capable of receiving visible light. The near-infrared camera 12 is a camera having a light-receiving element capable of receiving near-infrared light. Since various existing configurations can be applied to the visible light camera 11 and the near-infrared camera 12, a detailed explanation of these configurations will be omitted. The visible light camera 11 and the near-infrared camera 12 may be housed in different enclosures or in the same enclosure.

[0012] The modification unit 13 is configured to change the imaging range of the near-infrared camera 12. The modification unit 13 may change the imaging range of the near-infrared camera 12 by changing the optical axis direction of the near-infrared camera 12. For example, the modification unit 13 may change the imaging range of the near-infrared camera 12 by rotating the near-infrared camera 12 around a predetermined rotation axis. When near-infrared light reflected by a mirror is incident on the near-infrared camera 12, the modification unit 13 may change the imaging range of the near-infrared camera 12 by changing the angle of the mirror.

[0013] The control unit 14 controls the modification unit 13 based on the visible light image captured by the visible light camera 11, so that the imaging range of the near-infrared camera 12 is set higher than when the predetermined conditions are not met, if the predetermined conditions are met. Note that "higher" means the upper part in the vertical direction. In Figure 2, the dotted line represents the imaging range of the near-infrared camera 12 when the predetermined conditions are not met. "When the predetermined conditions are met, the imaging range of the near-infrared camera 12 is set higher than when the predetermined conditions are not met" may mean shifting the imaging range of the near-infrared camera 12 upwards above the head of the target (see the human figure in Figure 2).

[0014] In the information processing device 1, which includes a visible light camera 11 and a near-infrared camera 12, an information processing method is performed in which, based on the visible light image captured by the visible light camera 11, if predetermined conditions are met, the imaging range of the near-infrared camera 12 is set higher than when the predetermined conditions are not met.

[0015] The information processing device 1 may be implemented by a computer reading a computer program recorded on a recording medium. In this case, the recording medium contains a computer program that causes the computer constituting the information processing device 1, which includes a visible light camera 11 and a near-infrared camera 12, to execute an information processing method in which, based on a visible light image captured by the visible light camera 11, the imaging range of the near-infrared camera 12 is set to a higher position than when the predetermined conditions are not met, if certain conditions are met.

[0016] (Technical effects) Images captured by the visible light camera 11 and the near-infrared camera 12 may be used for biometric authentication. For example, the visible light image captured by the visible light camera 11 may be used for facial recognition. The near-infrared image captured by the near-infrared camera 12 may be used for iris recognition. However, when the clothing of a subject (for example, a person subject to biometric authentication) is captured by the near-infrared camera 12, the clothing of the subject may appear transparent in the near-infrared image. This could potentially increase the number of people who feel uncomfortable with biometric authentication or who feel uncomfortable being photographed for biometric authentication.

[0017] In the information processing apparatus 1, when a predetermined condition is satisfied based on the visible light image captured by the visible light camera 11, the control unit 14 controls the changing unit 13 so that the imaging range of the near-infrared camera 12 is set higher than when the predetermined condition is not satisfied. For example, the predetermined condition may be that "the clothing of the subject (e.g., the subject for biometric authentication) is included in the imaging range of the near-infrared camera 12". If the imaging range of the near-infrared camera 12 is changed upward when this predetermined condition is satisfied, it is possible to suppress the clothing of the subject from being included in the imaging range of the near-infrared camera 12. Therefore, according to the information processing apparatus 1, it is possible to reduce the sense of resistance to biometric authentication using the near-infrared image captured by the near-infrared camera 12 and the sense of resistance to shooting for biometric authentication.

[0018] <Second Embodiment> The second embodiment of the information processing apparatus, the information processing method, and the recording medium will be described with reference to FIGS. 3 to 5. Hereinafter, the second embodiment of the information processing apparatus, the information processing method, and the recording medium will be described using the information processing apparatus 2.

[0019] In FIG. 3, the information processing apparatus 2 includes an arithmetic unit 21, a storage unit 22, a communication unit 23, a visible light camera 26, and a near-infrared camera 27. The information processing apparatus 2 may include an input device 24 and an output device 25. Note that the information processing apparatus 2 may not include at least one of the input device 24 and the output device 25. In the information processing apparatus 2, the arithmetic unit 21, the storage unit 22, the communication unit 23, the input device 24, the output device 25, the visible light camera 26, and the near-infrared camera 27 may be connected via a data bus 28. Note that the visible light camera 26 and the near-infrared camera 27 may be stored in different housings or in the same housing.

[0020] The arithmetic unit 21 may include, for example, at least one of a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an FPGA (Field Programmable Gate Array), a TPU (Tensor Processing Unit), and a quantum processor.

[0021] The storage device 22 may include, for example, at least one of a RAM (Random Access Memory), a ROM (Read Only Memory), a hard disk drive, a magneto-optical disk drive, a SSD (Solid State Drive), and an optical disk array. That is, the storage device 22 may include a non-temporary recording medium. The storage device 22 can store desired data. For example, the storage device 22 may temporarily store a computer program executed by the arithmetic unit 21. The storage device 22 may temporarily store data temporarily used by the arithmetic unit 21 when the arithmetic unit 21 is executing a computer program.

[0022] The communication device 23 may be capable of communicating with a device outside the information processing device 2. Note that the communication device 23 may perform wired communication or wireless communication. Note that wired communication is not limited to communication via a network and includes, for example, communication via a cable such as a USB (Universal Serial Bus) cable. Wireless communication is not limited to communication via a network and includes, for example, short-range wireless communication such as Bluetooth (registered trademark).

[0023] The input device 24 is a device capable of receiving information input to the information processing device 2 from an external source. The input device 24 may include an operating device (e.g., a keyboard, mouse, touch panel, etc.) that can be operated by an operator of the information processing device 2. The input device 24 may also include a recording medium reader capable of reading information recorded on a recording medium that can be attached to or detached from the information processing device 2, such as a USB memory stick. When information is input to the information processing device 2 via the communication device 23 (in other words, when the information processing device 2 acquires information via the communication device 23), the communication device 23 may function as an input device.

[0024] The output device 25 is a device capable of outputting information to the outside of the information processing device 2. The output device 25 may output visual information such as characters and images, auditory information such as sounds, or tactile information such as vibrations. The output device 25 may include, for example, at least one of a display, speaker, printer, and vibration motor. The output device 25 may also be capable of outputting information to a recording medium that can be attached to or detached from the information processing device 2, such as a USB memory stick. When the information processing device 2 outputs information via the communication device 23, the communication device 23 may function as an output device.

[0025] The arithmetic unit 21 may have an image acquisition unit 211, a face detection unit 212, a person detection unit 213, a clothing determination unit 214, an orientation control unit 215, an eye detection unit 216, a face authentication unit 217, an iris authentication unit 218, and an integrated authentication unit 219, either as logically implemented functional blocks or as physically implemented processing circuits. At least one of the image acquisition unit 211, face detection unit 212, person detection unit 213, clothing determination unit 214, orientation control unit 215, eye detection unit 216, face authentication unit 217, iris authentication unit 218, and integrated authentication unit 219 may be implemented in a form that combines a logical functional block and a physical processing circuit (i.e., hardware). If at least a portion of the image acquisition unit 211, face detection unit 212, person detection unit 213, clothing determination unit 214, orientation control unit 215, eye detection unit 216, face authentication unit 217, iris authentication unit 218, and integrated authentication unit 219 are functional blocks, then at least a portion of the image acquisition unit 211, face detection unit 212, person detection unit 213, clothing determination unit 214, orientation control unit 215, eye detection unit 216, face authentication unit 217, iris authentication unit 218, and integrated authentication unit 219 may be realized by the arithmetic unit 21 executing a predetermined computer program.

[0026] The arithmetic unit 21 may obtain (in other words, read) the predetermined computer program from the storage device 22. The arithmetic unit 21 may also read the predetermined computer program stored on a computer-readable and non-temporary recording medium using a recording medium reader (not shown) provided by the information processing device 2. The arithmetic unit 21 may also obtain (in other words, download or read) the predetermined computer program from an external device (not shown) of the information processing device 2 via the communication device 23. The recording medium used to record the predetermined computer program executed by the arithmetic unit 21 may be at least one of an optical disc, a magnetic medium, a magneto-optical disc, a semiconductor memory, and any other medium capable of storing a program.

[0027] The image acquisition unit 211 acquires a visible light image captured by the visible light camera 26. The face detection unit 212 detects the face region of a person included in the visible light image. The detection result of the face detection unit 212 may be output to at least one of the orientation control unit 215, the eye detection unit 216, and the face recognition unit 217. Note that existing technologies can be applied to the method for detecting the face region of a person included in the visible light image, so a detailed explanation of that method is omitted.

[0028] The person detection unit 213 detects a person included in the visible light image. Here, the person detection unit 213 detects a person whose visible light image includes at least the head region. Note that the face region of the person detected by the person detection unit 213 does not need to be included in the visible light image. The detection result of the person detection unit 213 may be output to the clothing determination unit 214.

[0029] The clothing determination unit 214 identifies the clothing of a person included in the visible light image. The clothing determination unit 214 may identify the clothing of a person included in the visible light image by, for example, pattern recognition. The clothing determination unit 214 may also identify the clothing of a person included in the visible light image using a computational model that outputs the clothing of a person included in the visible light image when a visible light image is input. An example of such a computational model is a computational model using a neural network (e.g., CNN: Convolutional Neural Network). It should be noted that the information regarding the clothing of a person included in the visible light image (in other words, the information regarding the clothing identified by the clothing determination unit 214) can be said to be information that indicates the status of the person (e.g., the subject of biometric authentication).

[0030] The clothing determination unit 214 determines whether the clothing worn by a person in the visible light image is a specific type of clothing. Here, the specific clothing may be a swimsuit. The specific clothing may also be clothing that is not transparent in visible light but is transparent in near-infrared light (for example, relatively dark-colored clothing). The determination result of the clothing determination unit 214 is output to the orientation control unit 215.

[0031] The orientation control unit 215 changes the imaging range of the near-infrared camera 27. As shown in Figure 4, if the near-infrared camera 27 is supported by a support member 27a that is rotatable around a rotation axis AX1, the orientation control unit 215 may change the imaging range of the near-infrared camera 27 by rotating the support member 27a around the rotation axis AX1 with a motor (not shown). As shown in Figure 5, if the mirror M that guides near-infrared light to the near-infrared camera 27 is rotatable around a rotation axis AX2, the orientation control unit 215 may change the imaging range of the near-infrared camera 27 by rotating the mirror M around the rotation axis AX2 with a motor (not shown). Note that the orientation control unit 215 corresponds to an example of the control unit 14 in the first embodiment described above.

[0032] The rotation angle may be determined based on the results of person detection. For example, if a face is detected, the angle at which the face appears just below the bottom edge of the near-infrared image can be determined from the size and position of the face detected in the visible light image using the near-infrared camera, and the rotation angle can be determined by calculating the difference between this angle and the current angle. If a head or a person region is detected instead of a face, the region of the body can be estimated from the size of the detected head or person region, the angle at which the part of the body below the neck is outside the screen of the near-infrared image can be determined, and the rotation angle can be determined by calculating the difference between this angle and the current angle.

[0033] If the clothing determination unit 214 determines that the clothing of a person included in the visible light image is not a specific type of clothing, the orientation control unit 215 changes the imaging range of the near-infrared camera 27 so that the imaging range of the near-infrared camera 27 is within the initial setting range. In this case, if the imaging range of the near-infrared camera 27 is already within the initial setting range before changing the imaging range of the near-infrared camera 27, the orientation control unit 215 does not need to change the imaging range of the near-infrared camera 27.

[0034] If the clothing determination unit 214 determines that the clothing of a person included in the visible light image is a specific type of clothing, the orientation control unit 215 changes the imaging range of the near-infrared camera 27 so that the clothing of the person included in the visible light image is not included in the imaging range of the near-infrared camera 27. As a result, the imaging range of the near-infrared camera 27 moves upward from the initial setting range. In this case, the orientation control unit 215 may change the imaging range of the near-infrared camera 27 so that the clothing of the person included in the visible light image is not included in the imaging range of the near-infrared camera 27, but the person's eyes are included in the imaging range of the near-infrared camera 27. It is assumed that information indicating the relationship between the imaging range of the visible light camera 26 and the imaging range of the near-infrared camera 27 (e.g., calibration information) is known. Based on this information and the visible light image, the orientation control unit 215 may change the imaging range of the near-infrared camera 27 so that the clothing of the person included in the visible light image is not included in the imaging range of the near-infrared camera 27, but the person's eyes are included in the imaging range of the near-infrared camera 27.

[0035] After the orientation control unit 215 has finished processing (for example, after the orientation control unit 215 has changed the imaging range of the near-infrared camera 27), the near-infrared camera 27 performs imaging. The image acquisition unit 211 acquires the near-infrared image captured by the near-infrared camera 27. The eye detection unit 216 detects the eye region of a person included in the near-infrared image. Alternatively, the eye detection unit 216 may detect the eye region of a person included in the near-infrared image based on the detection result of the face detection unit 212. The detection result of the eye detection unit 216 may be output to the iris authentication unit 218. Note that existing technologies can be applied to the method of detecting the eye region of a person included in the near-infrared image, so a detailed explanation of that method is omitted.

[0036] The facial recognition unit 217 performs facial recognition using a visible light image. The facial recognition unit 217 may also identify the face region of a person (for example, the person to be facially recognized) included in the visible light image based on the detection result of the face detection unit 212. For example, the facial recognition unit 217 may extract feature quantities related to the face region of a person (for example, the person to be facially recognized) included in the visible light image from the visible light image. The facial recognition unit 217 may calculate a face matching score by comparing the extracted feature quantities with the feature quantities included in the feature quantity data 221.

[0037] The iris authentication unit 218 performs iris authentication using a near-infrared image. The iris authentication unit 218 may also identify the eye region of a person (for example, the subject of iris authentication) included in the near-infrared image based on the detection result of the eye detection unit 216. For example, the iris authentication unit 218 may extract feature quantities related to the eye region of a person (for example, the subject of iris authentication) included in the near-infrared image from the near-infrared image. The iris authentication unit 218 may calculate an iris matching score by comparing the extracted feature quantities with the feature quantities included in the feature quantity data 221.

[0038] The integrated authentication unit 219 may calculate an integrated score based, for example, on the facial recognition score calculated by the facial recognition unit 217 and the iris recognition score calculated by the iris recognition unit 218. The integrated authentication unit 219 may determine that the subject (i.e., the person who is both the subject of facial recognition and the subject of iris recognition) is the registered person if the integrated score is above a threshold. The integrated authentication unit 219 may determine that the subject is not the registered person if the integrated score is below the threshold.

[0039] (Technical effects) In the information processing device 2, if the clothing determination unit 214 determines that the clothing of a person included in the visible light image is a specific type of clothing, the orientation control unit 215 changes the imaging range of the near-infrared camera 27 so that the clothing of the person included in the visible light image is not included in the imaging range of the near-infrared camera 27. Therefore, according to the information processing device 2, resistance to biometric authentication using near-infrared images captured by the near-infrared camera 27 and resistance to being photographed for biometric authentication can be reduced. As a result, biometric authentication can be introduced even in places where it is highly likely that the person to be authenticated is wearing swimwear, such as swimming pools and beaches. This makes it possible to introduce biometric payment in places such as swimming pools and beaches, or to implement entry and exit management to paid swimming areas using biometric authentication.

[0040] If the clothing determination unit 214 determines that the clothing of a person included in the visible light image is a specific type of clothing, the orientation control unit 215 may change the imaging range of the near-infrared camera 27 so that the clothing of the person included in the visible light image is not included in the imaging range of the near-infrared camera 27, but the person's eyes are included. Therefore, the information processing device 2 can capture a near-infrared image that can be used for iris authentication while avoiding including the person's clothing in the imaging range.

[0041] (First variation) If the person detection unit 213 detects multiple people from the visible light image, the near-infrared camera 27 does not need to take images. In this case, if no multiple people are detected in the visible light image taken by the visible light camera 26 after the person detection unit 213 has detected multiple people from the visible light image, the near-infrared camera 27 may resume taking images. In other words, if the visible light image contains people other than the person being authenticated, the near-infrared camera 27 may temporarily stop taking images.

[0042] If the person detection unit 213 detects multiple people from the visible light image (for example, if it detects multiple head regions), the orientation control unit 215 may change the imaging range of the near-infrared camera 27 so that the clothing of a person determined by the clothing determination unit 214 to be wearing a specific garment is not included in the imaging range of the near-infrared camera 27. Alternatively, if the person detection unit 213 detects multiple people from the visible light image (for example, if it detects multiple head regions), the orientation control unit 215 may change the imaging range of the near-infrared camera 27 so that the body parts (for example, the part below the neck or the torso) of all the multiple people included in the visible light image are not included in the imaging range of the near-infrared camera 27, based on the multiple head regions corresponding to each of the multiple people. In this case, if, as a result of the change in the imaging range of the near-infrared camera 27, the area of ​​the biometric authentication target within the imaging range of the near-infrared camera 27 becomes smaller than a predetermined amount, the orientation control unit 215 may control the output device 25 to issue a warning. The orientation control unit 215 may, for example, control the output device 25 to display a visible light image captured by the visible light camera 26, and issue a warning message indicating that only the person subject to biometric authentication should be visible.

[0043] Furthermore, even if multiple people are detected, those who are far outside the focal distance of the near-infrared camera 27 do not need to be considered as targets. To do this, it is necessary to know the distance from the camera to each person, but a rough distance can be estimated from the size of the detection result, so it is sufficient to decide whether to exclude them or not based on the estimated distance.

[0044] (Second variation) The information processing device 2 may acquire information about the environment surrounding the information processing device 2 (in other words, the environment surrounding the person subject to biometric authentication). The information about the environment may include at least one of the information about the location where the information processing device 2 is installed and information about the weather. If the information about the environment indicates that the environment is such that the person subject to biometric authentication may get wet (for example, if it indicates that the information processing device 2 is installed poolside or on a beach, or if it is raining), the orientation control unit 215 may change the imaging range of the near-infrared camera 27 so that the clothing of the person subject to biometric authentication is not included in the imaging range of the near-infrared camera 27. In this case, the clothing determination unit 214 does not need to perform a determination.

[0045] (Third variation) The clothing determination unit 214 does not need to determine whether the clothing of a person included in the visible light image is a specific type of clothing. In this case, the clothing determination unit 214 may determine the position of the clothing of a person included in the visible light image within the visible light image. In other words, the clothing determination unit 214 may determine the position of the clothing of the person within the imaging range of the visible light camera 26. Based on the position of the clothing determined by the clothing determination unit 214, the orientation control unit 215 may change the imaging range of the near-infrared camera 27 so that the clothing of a person included in the visible light image is not included in the imaging range of the near-infrared camera 27, regardless of the type of clothing the person is wearing.

[0046] <Third Embodiment> A third embodiment of the information processing device, information processing method, and recording medium will be described with reference to Figure 6. In the following description, the third embodiment of the information processing device, information processing method, and recording medium will be described using the information processing device 3. In the third embodiment, explanations that overlap with the second embodiment described above will be omitted as appropriate, and common parts in the drawings will be denoted by the same reference numerals.

[0047] In Figure 5, the arithmetic unit 21 of the information processing device 3 has a water droplet detection unit 311 and a guidance display unit 312, either as a logically implemented functional block or as a physically implemented processing circuit.

[0048] The water droplet detection unit 311 detects water droplets on the face of a person (for example, a person subject to biometric authentication) included in a visible light image captured by the visible light camera 26. The water droplet detection unit 311 may also detect water droplets on the face of a person included in a visible light image by using a computational model that, when a visible light image is input, outputs a result determining whether or not water droplets are attached to the person's face. An example of such a computational model is a computational model using a neural network (for example, a CNN).

[0049] When the water droplet detection unit 311 detects water droplets, the guidance display unit 312 controls the output device 25 so that information guiding the person's (for example, the person subject to biometric authentication) actions is displayed, such as "Please wipe the water droplets from your face."

[0050] (Technical effects) If water droplets are present on the face of the person being recognized, the accuracy of facial recognition may decrease. When the water droplet detection unit 311 detects water droplets on the face, the information processing device 3 displays information such as "Please wipe the water droplets off your face." Therefore, the information processing device 3 can prevent a decrease in facial recognition accuracy due to water droplets.

[0051] (modified version) The water droplet detection unit 311 may detect not only water droplets on the face but also clothing that covers a person's eyes, such as goggles. If the water droplet detection unit 311 detects clothing that covers a person's eyes, the guidance display unit 312 may control the output device 25 so that information that guides the person's (e.g., the person subject to biometric authentication) actions is displayed, such as "Please remove the clothing."

[0052] <Note> The following additional information is disclosed regarding the embodiments described above.

[0053] (Note 1) A visible light camera that images the target, A near-infrared camera for imaging the aforementioned object, A means for changing the imaging range of the near-infrared camera, A control means controls the changing means so that, based on the visible light image captured by the visible light camera, when predetermined conditions are met, the imaging range of the near-infrared camera is set to a higher position than when the predetermined conditions are not met. An information processing device equipped with the following features.

[0054] (Note 2) The system includes estimation means for estimating the situation based on the visible light image, The control means controls the modification means so that, when the situation satisfies the predetermined conditions, the imaging range of the near-infrared camera is set higher than when the situation does not satisfy the predetermined conditions. The information processing device described in Appendix 1.

[0055] (Note 3) The aforementioned situation includes information regarding the clothing of the subject, The control means controls the modification means so that the clothing of the target is not included in the imaging range of the near-infrared camera when the situation satisfies the predetermined conditions. The information processing device described in Appendix 2.

[0056] (Note 4) The aforementioned predetermined conditions include the fact that the clothing worn by the subject is a swimsuit. The control means controls the modification means so that the clothing of the target is not included in the imaging range of the near-infrared camera when the situation satisfies the predetermined condition that the target is wearing a swimsuit. The information processing device described in Appendix 3.

[0057] (Note 5) The aforementioned situation includes information about the surrounding environment of the subject, The aforementioned predetermined conditions include the environment in which the object may get wet, The control means controls the modification means so that no part of the object's body is included in the imaging range of the near-infrared camera if the situation satisfies the predetermined condition that the object may get wet. An information processing device as described in any one of the items 2 to 4 of the appendix.

[0058] (Note 6) If the visible light image includes other people present in the vicinity of the object in addition to the object, the system includes estimation means for estimating the head regions of the object and the other people. The control means controls the modification means so that the imaging range of the near-infrared camera does not include the target or any other person's body parts, based on the estimated head region. An information processing device as described in any one of the items 1 to 5 of the appendix.

[0059] (Note 7) The control means controls the modification means so that the target and other body parts of other people are not included in the imaging range of the near-infrared camera based on the estimated head region, and as a result, the target's area within the imaging range of the near-infrared camera becomes smaller than a predetermined amount, and a notification means is provided to issue a warning. The information processing device described in Appendix 6.

[0060] (Note 8) Based on the visible light image, if it is detected that water droplets are attached to the face of the subject, the notification means outputs information requesting the subject to remove the water droplets. An information processing device as described in any one of the items 1 to 7 of the appendix.

[0061] (Note 9) Based on the visible light image, if an eye covering is detected on the subject, the system includes a notification means that outputs information requesting the subject to remove the covering. An information processing device as described in any one of the items 1 to 8 of the appendix.

[0062] (Note 10) An information processing device comprising a visible light camera for imaging an object and a near-infrared camera for imaging the object, Based on the visible light image captured by the visible light camera, if predetermined conditions are met, the imaging range of the near-infrared camera is set to a higher position than when the predetermined conditions are not met. Information processing methods.

[0063] (Note 11) A computer comprising an information processing device that includes a visible light camera for imaging an object and a near-infrared camera for imaging the said object, Based on the visible light image captured by the visible light camera, if predetermined conditions are met, the imaging range of the near-infrared camera is set to a higher position than when the predetermined conditions are not met. A recording medium on which computer programs for executing information processing methods are stored.

[0064] This disclosure is not limited to the embodiments described above and may be modified as appropriate, without contradicting the gist or idea of ​​the invention as can be inferred from the claims and the specification as a whole. Information processing devices, information processing methods, and recording media with such modifications are also included in the technical scope of this disclosure. [Explanation of Symbols]

[0065] 1, 2, 3 Information Processing Devices 11.26 Visible light camera 12, 27 Near-infrared camera 21 Arithmetic unit 211 Image acquisition unit 212 Face detection unit 213 Person Detection Unit 214 Clothing detection unit 215 Directional control unit 216 Eye detection unit 217 Facial Recognition Section 218 Iris Recognition Department 219 Integrated Authentication Department 311 Water droplet detection unit 312 Guidance presentation section

Claims

1. A visible light camera that images the target, A near-infrared camera for imaging the aforementioned object, A means for changing the imaging range of the near-infrared camera, An estimation means for estimating the situation based on a visible light image captured by the visible light camera, A control means controls the changing means so that when the above situation satisfies predetermined conditions, the imaging range of the near-infrared camera is set higher than when the above situation does not satisfy predetermined conditions. Equipped with, The aforementioned situation includes information regarding the clothing of the subject. Information processing device.

2. The control means controls the modification means so that the clothing of the target is not included in the imaging range of the near-infrared camera when the situation satisfies the predetermined conditions. The information processing apparatus according to claim 1.

3. The aforementioned predetermined conditions include the fact that the clothing worn by the subject is a swimsuit. The control means controls the modification means so that the clothing of the target is not included in the imaging range of the near-infrared camera when the situation satisfies the predetermined condition that the target is wearing a swimsuit. The information processing apparatus according to claim 2.

4. The aforementioned situation includes information about the surrounding environment of the subject, The aforementioned predetermined conditions include the environment in which the object may get wet, The control means controls the modification means so that no part of the object's body is included in the imaging range of the near-infrared camera if the situation satisfies the predetermined condition that the object may get wet. The information processing apparatus according to claim 1.

5. If the visible light image includes other people present in the vicinity of the object in addition to the object, the system includes estimation means for estimating the head regions of the object and the other people. The control means controls the modification means so that the imaging range of the near-infrared camera does not include the target or any other person's body parts, based on the estimated head region. The information processing apparatus according to claim 1.

6. The control means controls the modification means so that the target and other body parts of other people are not included in the imaging range of the near-infrared camera based on the estimated head region, and as a result, the target's area within the imaging range of the near-infrared camera becomes smaller than a predetermined amount, and a notification means is provided to issue a warning. The information processing apparatus according to claim 5.

7. Based on the visible light image, if it is detected that water droplets are attached to the face of the subject, the notification means outputs information requesting the subject to remove the water droplets. The information processing apparatus according to claim 1.

8. Based on the visible light image, if an eye covering is detected on the subject, the system includes a notification means that outputs information requesting the subject to remove the covering. The information processing apparatus according to claim 1.

9. An information processing device comprising a visible light camera for imaging an object and a near-infrared camera for imaging the object, Based on the visible light image captured by the visible light camera, the situation is estimated. If the above situation satisfies the predetermined conditions, the imaging range of the near-infrared camera is set higher than when the above situation does not satisfy the predetermined conditions. The aforementioned situation includes information regarding the clothing of the subject. Information processing methods.

10. A computer comprising an information processing device that includes a visible light camera for imaging an object and a near-infrared camera for imaging the said object, Based on the visible light image captured by the visible light camera, the situation is estimated. If the above situation satisfies the predetermined conditions, the imaging range of the near-infrared camera is set higher than when the above situation does not satisfy the predetermined conditions. The aforementioned situation includes information regarding the clothing of the subject. A recording medium on which computer programs for executing information processing methods are stored.

Images