System, device, and method

Abstract

To provide a system, a device, and a method for acquiring an image of an object.SOLUTION: The system comprises: first polarization means which polarizes light emitted from an illumination light source, in a first direction; second polarization means which polarizes light traveling toward imaging means for imaging an object, in a second direction different from the first direction; and acquisition means which acquires an image including the object outputted from the imaging means.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] FIELD OF THE DISCLOSURE This disclosure relates to the technical field of systems, devices and methods for acquiring images of an object. [Background technology]

[0002] As an example of this type of system, a system has been proposed in which a number of pixels associated with a plurality of polarizing elements having different principal axis directions are treated as one pixel unit, and an image sensor in which the pixel units are arranged two-dimensionally is used to generate a captured image including an image of a subject (see Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 6409088 Summary of the Invention [Problem to be solved by the invention]

[0004] An object of this disclosure is to provide an information processing device, an information processing method, and a recording medium that aim to improve the technology related to the prior art documents mentioned above. [Means for solving the problem]

[0005] One embodiment of the system comprises a first polarization means for polarizing light emitted from an illumination light source in a first direction, a second polarization means for polarizing light directed toward an imaging means for imaging the object in a second direction different from the first direction, and an acquisition means for acquiring an image including the object output from the imaging means.

[0006] One aspect of the device comprises a first polarization means for polarizing light emitted from an illumination light source in a first direction, a second polarization means for polarizing light directed toward an imaging means for imaging the object in a second direction different from the first direction, and an acquisition means for acquiring an image including the object output from the imaging means.

[0007] One aspect of the method involves polarizing light emitted from an illumination light source in a first direction, polarizing light directed toward an imaging means that images the object in a second direction different from the first direction, and obtaining an image including the object that is output from the imaging means. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating an example of a configuration of a system according to an embodiment. [Figure 2] FIG. 10 is a diagram illustrating an example of an operation of the system according to the embodiment. [Figure 3] FIG. 1 is a diagram for explaining a problem when capturing an image of a target. [Figure 4] FIG. 10 is a diagram illustrating another example of the configuration of the system according to the embodiment. [Figure 5] FIG. 1 is a block diagram illustrating an example of a configuration of a calculation device according to an embodiment. [Figure 6] FIG. 10 is a conceptual diagram showing an example of a configuration for switching states. [Figure 7] FIG. 10 is a block diagram showing another example of the configuration of the arithmetic device according to the embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing another example of the configuration for switching states. [Figure 9] FIG. 10 is a block diagram showing another example of the configuration of the arithmetic device according to the embodiment. [Figure 10] FIG. 10 is a diagram illustrating another example of the configuration of the system according to the embodiment. [Figure 11] FIG. 10 is a diagram illustrating another example of the configuration of the system according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0009] First Embodiment A first embodiment of a system, an apparatus, and a method will be described with reference to Figures 1 and 2. In the following, the first embodiment of a system, an apparatus, and a method will be described using a system 1.

[0010] In FIG. 1, the system 1 includes polarization means POL1, polarization means POL2, and an image capture device 11. The polarization means POL1 and POL2 may be, for example, at least one of a polarizing plate and a polarizing film. The polarization means POL1 polarizes light emitted from an illumination light source LS in a first direction. Of the light emitted from the illumination light source LS and incident on the polarization means POL1, polarized light oscillating in the first direction is transmitted through the polarization means POL1, while polarized light oscillating in a direction different from the first direction is blocked by the polarization means POL1. The phrase "polarizing the light emitted from the illumination light source LS in the first direction" may mean creating polarized light oscillating in the first direction from unpolarized light emitted from the illumination light source LS. Alternatively, the phrase "polarizing the light emitted from the illumination light source LS in the first direction" may mean transmitting polarized light oscillating in the first direction from the light emitted from the illumination light source LS. Alternatively, "polarizing the light emitted from the illumination light source LS in a first direction" may mean extracting polarized light oscillating in the first direction from unpolarized light emitted from the illumination light source LS. Note that the "first direction" refers to the direction in which the transmission axis of the polarization means POL1 extends. Due to the polarization means POL1, the polarized light oscillating in the first direction (see "first polarization" in FIG. 1) from the light emitted from the illumination light source LS is used to illuminate the target TP.

[0011] The polarization means POL2 polarizes light traveling toward the imaging device CAM, which captures the object TP, in a second direction different from the first direction. "Light traveling toward the imaging device CAM" may include, for example, light reflected by the object TP. Of the light traveling toward the imaging device CAM and incident on the polarization means POL2, polarized light oscillating in the second direction is transmitted through the polarization means POL2, while polarized light oscillating in a direction different from the second direction is blocked by the polarization means POL2. The phrase "polarizing light traveling toward the imaging device CAM in the second direction" may mean creating polarized light oscillating in the second direction from unpolarized light traveling toward the imaging device CAM. Alternatively, the phrase "polarizing light traveling toward the imaging device CAM in the second direction" may mean transmitting polarized light oscillating in the second direction from light traveling toward the imaging device CAM. Alternatively, the phrase "polarizing light traveling toward the imaging device CAM in the second direction" may mean extracting polarized light oscillating in the second direction from unpolarized light traveling toward the imaging device CAM. The second direction refers to the direction in which the transmission axis of the polarization means POL2 extends. The second direction may be orthogonal to the first direction. Due to the polarization means POL2, polarized light oscillating in the second direction (see "second polarized light" in Figure 1) among the light traveling toward the image capture device CAM is incident on the image capture device CAM.

[0012] The image acquisition device 11 acquires an image including a target output from the imaging device CAM. The image acquisition device 11 may be connected to the imaging device CAM by wire or wirelessly. Alternatively, the imaging device CAM may constitute a part of the image acquisition device 11. That is, the image acquisition device 11 may include the imaging device CAM. Alternatively, the image acquisition device 11 may constitute a part of the imaging device CAM. An image including a target may include at least a part of the target, and may not include the entire target. The image including a target may be, for example, at least one of a face image including the target's face and an eye image including the target's eyes.

[0013] The illumination light source LS and the imaging device CAM may or may not constitute part of the system 1. The illumination light source LS may be a light source that emits visible light, or may be a light source that emits near-infrared light. The imaging device CAM may be, for example, a visible light camera that is sensitive to light in the visible wavelength range, or a near-infrared camera that is sensitive to light in the near-infrared wavelength range. If the illumination light source LS is a light source that emits near-infrared light, the imaging device CAM may be a near-infrared camera.

[0014] The operation of the system 1 will be further described with reference to the flowchart of FIG. 2. In FIG. 2, the polarization means POL1 polarizes the light emitted from the illumination light source LS in a first direction (step S101). The polarization means POL2 polarizes the light directed toward the imaging device CAM in a second direction (step S102). The image acquisition device 11 acquires an image including the object from the imaging device CAM (step S103). In this way, the system 1 may perform a method of polarizing the light emitted from the illumination light source LS in a first direction, polarizing the light directed toward the imaging device CAM that images the object TP in a second direction different from the first direction, and acquiring an image including the object output from the imaging device CAM.

[0015] The system 1 may be realized by a single device. In this case, the polarization means POL1, the polarization means POL2, and the image capture device 11 may be housed in a single housing. The housing may also house the illumination source LS and the image capture device CAM in addition to the polarization means POL1, the polarization means POL2, and the image capture device 11. In this case, it can be said that the single device includes the polarization means POL1 that polarizes light emitted from the illumination source LS in a first direction, the polarization means POL2 that polarizes light directed toward the image capture device CAM that captures an image of the object TP in a second direction different from the first direction, and the image capture device 11 that captures an image including the object TP output from the image capture device CAM.

[0016] (Technical Effects) To obtain an image including the target TP using the imaging device CAM, light from the target TP (i.e., the subject) must be focused as an image on the imaging sensor of the imaging device CAM. For example, light from an illumination light source LS is reflected by the target TP, and the light reflected from the target TP is incident on the imaging device CAM, thereby obtaining an image including the target TP. Here, when light incident on the target TP from the illumination light source LS is reflected by the surface of the target TP at an angle of reflection equal to the angle of incidence of the light incident on the target TP from the illumination light source LS, the light reflected at the angle of reflection is referred to as a "direct reflection component." Here, an explanation will be provided with reference to FIG. 3. In FIG. 3, the symbols "RL1" and "RL2" indicate direct reflection components. As shown in FIG. 3(a), when the direct reflection component RL1 is incident on the imaging device CAM, a high-brightness area, which is an area with a relatively high brightness value, may be included in the image due to the direct reflection component RL1. This is because the intensity (i.e., light intensity) of the direct reflection component RL1 is relatively high. For example, biometric authentication of the target TP may be performed using an image including the target TP. In this case, if a high-brightness area due to the direct reflection component RL1 is included in the image, biometric authentication of the subject TP may not be performed properly. Therefore, as shown in Figure 3(b), a method is often adopted in which the distance between the illumination light source LS and the image capture device CAM is made relatively long so that the direct reflection component RL2 does not enter the image capture device CAM. However, this method poses a technical problem in that it becomes difficult to miniaturize the image capture system including the illumination light source LS and the image capture device CAM. Note that the "direct reflection component" may also be referred to as, for example, a "specular reflection component" or a "mirror reflection component."

[0017] As shown in FIG. 1, the system 1 according to the first embodiment includes a polarization unit POL1 that polarizes light emitted from an illumination light source LS in a first direction and a polarization unit POL2 that polarizes light directed toward an imaging device CAM that captures an object TP in a second direction. Therefore, the light emitted from the illumination light source LS and incident on the object TP is polarized light oscillating in the first direction. Here, the polarization of the incident light is maintained for the directly reflected component. Therefore, when polarized light oscillating in the first direction is incident on the object TP, the directly reflected component is polarized light oscillating in the first direction. As described above, polarized light oscillating in a direction different from the second direction is blocked by the polarization unit POL2. In other words, polarized light oscillating in the first direction is blocked by the polarization unit POL2, thereby preventing polarized light oscillating in the first direction from entering the imaging device CAM. Therefore, the system 1 according to the first embodiment can prevent the directly reflected component of light emitted from the illumination light source LS and incident on the object TP from entering the imaging device CAM. As a result, the illumination light source LS and the imaging device CAM can be positioned while reducing the constraints on the directly reflected component. That is, according to the system 1 of the first embodiment, it is possible to miniaturize the imaging system including the illumination light source LS and the imaging device CAM. When polarized light oscillating in a first direction is diffusely reflected by the object TP, the diffusely reflected light becomes unpolarized. Of the unpolarized diffusely reflected light, polarized light oscillating in a second direction passes through the polarization means POL2 and enters the imaging device CAM, thereby obtaining an image including the object TP.

[0018] Second Embodiment A second embodiment of the system, apparatus, and method will be described with reference to Figures 4 and 5. Below, the second embodiment of the system, apparatus, and method will be described using System 2. Note that, for the second embodiment, descriptions that overlap with the description of the first embodiment will be omitted as appropriate.

[0019] 4, the system 2 includes an information processing device 100 and polarization means POL1a, POL1b, and POL2. The polarization means POL1a, POL1b, and POL2 may be, for example, at least one of a polarizing plate and a polarizing film.

[0020] The polarization means POL1a polarizes light emitted from the illumination light source LS1 in a first direction. The polarization means POL1b polarizes light emitted from the illumination light source LS2 in the first direction. The first direction refers to the direction in which the transmission axes of the polarization means POL1a and POL1b extend. The polarization means POL2 polarizes light directed toward the imaging device CAM, which images the object TP (not shown), in a second direction different from the first direction. The second direction refers to the direction in which the transmission axis of the polarization means POL2 extends. The illumination light sources LS1 and LS2 and the imaging device CAM may constitute part of the system 2. In other words, the system 2 may include the illumination light sources LS1 and LS2 and the imaging device CAM.

[0021] The information processing device 100 includes a calculation device 110, a storage device 120, a communication device 130, an input device 140, and an output device 150. The calculation device 110, the storage device 120, the communication device 130, the input device 140, and the output device 150 may be connected via a data bus 160. Note that the information processing device 100 does not necessarily have to include at least one of the input device 140 and the output device 150.

[0022] The arithmetic device 110 may include a processor 1101. The arithmetic device 110 may include other processors in addition to the processor 1101. That is, the arithmetic device 110 may include one or more processors. The processor 1101 may be a multi-core processor. When the arithmetic device 110 includes a single processor 1101 that is a multi-core processor, it can be said that the arithmetic device 110 logically includes multiple processors.

[0023] The processor 1101 may be, for example, at least one of a central processing unit (CPU), a graphics processing unit (GPU), a field programmable gate array (FPGA), a tensor processing unit (TPU), and a quantum processor.

[0024] The storage device 120 may include a memory 1201. The storage device 120 may include other memories in addition to the memory 1201. That is, the storage device 120 may include one or more memories. The memory 1201 may be, for example, at least one of a random access memory (RAM), a read-only memory (ROM), a hard disk drive, a magneto-optical disk drive, a solid-state drive (SSD), and an optical disk array. Therefore, the storage device 120 may include the memory 1201 as a non-transitory recording medium. The storage device 120 is capable of storing desired data. The memory 1201 of the storage device 120 may store a computer program 1201a executed by the calculation device 110. The storage device 120 may temporarily store data that the calculation device 110 temporarily uses when the calculation device 110 is executing the computer program 1201a.

[0025] The computer program 1201a may be recorded on a computer-readable, non-transitory recording medium. In this case, the computer program 1201a may be stored in the memory 1201 by reading the recording medium using a recording medium reading device (not shown) included in the information processing device 100. The recording medium may be at least one of an optical disk, a magnetic medium, a magneto-optical disk, a semiconductor memory, and any other medium capable of storing a program. The computer program 1201a may be acquired (in other words, downloaded) from a device (not shown) external to the information processing device 100 via the communication device 130. The acquired computer program 1201a may be stored in the memory 1201.

[0026] The communication device 130 may be capable of communicating with devices external to the information processing device 100. The communication device 130 may perform wired communication or wireless communication.

[0027] The input device 140 is a device capable of accepting information input to the information processing device 100 from outside. The input device 140 may include an operation device (e.g., a keyboard, a mouse, a touch panel, etc.) that can be operated by a user of the information processing device 100. The input device 140 may include a recording medium reading device that can read information recorded on a recording medium that is detachable from the information processing device 100, such as a USB (Universal Serial Bus) memory. Note that when information is input to the information processing device 100 via the communication device 130 (in other words, when the information processing device 100 acquires information via the communication device 130), the communication device 130 may function as an input device.

[0028] The output device 150 is a device capable of outputting information to the outside of the information processing device 100. The output device 150 may output, as the information, visual information such as characters or images, auditory information such as sound, or tactile information such as vibration. The output device 150 may include, for example, at least one of a display, a speaker, a printer, and a vibration motor. The output device 150 may be capable of outputting information to a recording medium detachable from the information processing device 100, such as a USB memory. Note that when the information processing device 100 outputs information via the communication device 130, the communication device 130 may function as the output device.

[0029] The processor 1101 of the arithmetic device 110, together with the memory 1201 of the storage device 120 in which a computer program 1201a is stored (in other words, together with the memory 1201 and the computer program 1201a stored in the memory 1201), may execute the processing to be performed by the information processing device 100. For example, the processor 1101 may execute the computer program 1201a, thereby realizing logical functional blocks in the arithmetic device 110 (for example, in the processor 1101) for executing the processing to be performed by the information processing device 100.

[0030] As shown in FIG. 5, the arithmetic device 110 may have an image acquisition unit 111 as a logically realized functional block or as a physically realized processing circuit. The image acquisition unit 111 may be realized in a form in which a logical functional block and a physical processing circuit (i.e., hardware) are mixed. The image acquisition unit 111 acquires an image including an object output from the imaging device CAM. The "image acquisition unit 111" is a component corresponding to the "image acquisition device 11" in the first embodiment.

[0031] The information processing device 100 may be, for example, at least one of a personal computer, a tablet terminal, and a smartphone. In this case, the information processing device 100 may include polarization means POL1a, POL1b, and POL2, illumination light sources LS1 and LS2, and an image capture device CAM. The polarization means POL1a, POL1b, and POL2, illumination light sources LS1 and LS2, and image capture device CAM may be housed in a single housing. In this case, the size of the housing may be, for example, a size that can be fixed to the information processing device 100 with a clip (for example, a side length of several centimeters to several tens of centimeters).

[0032] (Technical Effects) In the system 2, the light emitted from the illumination light source LS1 and incident on the object TP is polarized light vibrating in a first direction. Similarly, the light emitted from the illumination light source LS2 and incident on the object TP is also polarized light vibrating in the first direction. The polarization means POL2 blocks polarized light vibrating in a direction different from the second direction. Therefore, the system 2 according to the second embodiment can prevent directly reflected components of the light emitted from the illumination light sources LS1 and LS2 and incident on the object TP from being incident on the imaging device CAM. Therefore, the system 2 according to the second embodiment can achieve a compact imaging system including the illumination light sources LS1 and LS2 and the imaging device CAM. As a result, the distance D1 (see FIG. 4) between the illumination light source LS1 and the imaging device CAM can be set to, for example, 4 centimeters. Furthermore, the distance D2 (see FIG. 4) between the illumination light source LS2 and the imaging device CAM can be set to, for example, 4 centimeters.

[0033] <Third embodiment> A third embodiment of the system, apparatus, and method will be described with reference to Figures 6 and 7. Below, the third embodiment of the system, apparatus, and method will be described using System 2. Note that, for the third embodiment, descriptions that overlap with the descriptions for the first and second embodiments will be omitted as appropriate.

[0034] In the third embodiment, the positions of the polarization means POL1a, POL1b, and POL2 may be changed. For example, as shown in FIG. 6( a), a member 210 having three openings H11, H12, and H13 may be disposed near the illumination light sources LS1 and LS2 and the image capture device CAM. Light emitted from the illumination light source LS1 may pass through the opening H11 of the member 210. Light emitted from the illumination light source LS2 may pass through the opening H13 of the member 210. Light heading toward the image capture device CAM may pass through the opening H12 of the member 210 and enter the image capture device CAM.

[0035] A member 220 may be disposed between the member 210 and the illumination light sources LS1 and LS2 and the imaging device CAM. The member 220 may include polarization means POL1a, POL1b, and POL2. The member 220 may also include openings H21, H22, and H23. The member 220 is configured to be rotatable around an axis AX. In the state shown in FIG. 6( a), the opening H11 of the member 210 and the opening H21 of the member 220 overlap, the opening H12 of the member 210 and the opening H22 of the member 220 overlap, and the opening H13 of the member 210 and the opening H23 of the member 220 overlap. In the state shown in FIG. 6(b), the opening H11 of the member 210 and the polarization means POL1a overlap, the opening H12 of the member 210 and the polarization means POL2 overlap, and the opening H13 of the member 210 and the polarization means POL1b overlap.

[0036] 6(a), light emitted from illumination light source LS1 (i.e., unpolarized light) may be incident on object TP (not shown). Similarly, light emitted from illumination light source LS2 (i.e., unpolarized light) may be incident on object TP. Furthermore, light that has passed through openings H12 and H22 (i.e., unpolarized light) may be incident on image capture device CAM. In this case, the directly reflected components of the light emitted from illumination light sources LS1 and LS2 and incident on object TP may also be incident on image capture device CAM.

[0037] In the state shown in FIG. 6(b), polarized light emitted from illumination light source LS1 and vibrating in a first direction may be incident on object TP. Similarly, polarized light emitted from illumination light source LS2 and vibrating in the first direction may be incident on object TP. The polarization means POL2 blocks polarized light vibrating in a direction different from the second direction. Therefore, in the state shown in FIG. 6(b), polarized light vibrating in the second direction is incident on image capture device CAM. Therefore, in the state shown in FIG. 6(b), directly reflected components of light emitted from illumination light sources LS1 and LS2 and incident on object TP are prevented from being incident on image capture device CAM.

[0038] The information processing device 100 according to the third embodiment may include a calculation device 110a instead of the calculation device 110. The calculation device 110a may have one or more processors, similar to the calculation device 110. As shown in Fig. 7, the calculation device 110a may have an image acquisition unit 111, a determination unit 112, and a control unit 113 as logically realized functional blocks or as physically realized processing circuits. Note that at least one of the image acquisition unit 111, the determination unit 112, and the control unit 113 may be realized in a form in which a logical functional block and a physical processing circuit (i.e., hardware) are mixed.

[0039] Note that when the image acquisition unit 111, the determination unit 112, and the control unit 113 are realized as functional blocks, the image acquisition unit 111, the determination unit 112, and the control unit 113 may be realized by a single processor (for example, the processor 1101). Alternatively, the image acquisition unit 111, the determination unit 112, and the control unit 113 may be realized by different processors. Alternatively, parts of the image acquisition unit 111, the determination unit 112, and the control unit 113 may be realized by one processor, and the remaining parts of the image acquisition unit 111, the determination unit 112, and the control unit 113 may be realized by one or more other processors different from the one processor.

[0040] The determination unit 112 may determine whether to switch from the first state shown in Fig. 6(a) to the second state shown in Fig. 6(b). The control unit 113 can switch between the first state and the second state by rotating the member 220 around the axis AX. For this reason, the control unit 113 may be referred to as a switching means.

[0041] An example of the operation of the system 2 according to the third embodiment will be described. Here, the first state is assumed to be an initial state. In the first state, the image acquisition unit 111 of the information processing device 100 may acquire a first image, which is an image including the target TP, from the imaging device CAM.

[0042] The determination unit 112 of the information processing device 100 may determine whether to switch from the first state to the second state based on the first image. In other words, the determination unit 112 may determine whether to use the polarization means POL1a, POL1b, and POL2 based on the first image. For example, the determination unit 112 may determine to switch from the first state to the second state when the first image includes a high-brightness area, which is an area where the brightness value is higher than a predetermined value. The high-brightness area may be an area caused by excessively strong light (e.g., a direct reflection component) entering the imaging device CAM. An example of a high-brightness area is a so-called blown-out highlight area. For example, when the brightness is 256 levels, the high-brightness area may be an area consisting of pixels with a brightness value of 255. In this case, the predetermined value may be 254. The determination unit 112 may determine to switch from the first state to the second state when the first image includes a high-brightness area and the high-brightness area overlaps a part of the target TP. The part of the target TP may be, for example, at least one of the eyes of the target TP and the eyeglasses worn by the target TP. For example, the determination unit 112 may determine to switch from the first state to the second state if the target TP included in the first image is wearing eyeglasses. For example, the determination unit 112 may determine to switch from the first state to the second state if biometric authentication of the target TP using the first image fails. Note that "if biometric authentication of the target TP using the first image fails" may mean that the authentication score based on the first image is smaller than a predetermined threshold. The authentication score may mean a value indicating the degree of match or similarity between feature amounts extracted from the first image and pre-registered registration information (e.g., feature amounts). Note that the biometric authentication may be at least one of face authentication and iris authentication. Alternatively, the biometric authentication may be multimodal biometric authentication including at least one of face authentication and iris authentication.

[0043] If the determination unit 112 determines to switch from the first state to the second state, the control unit 113 may rotate the member 220 to switch from the first state to the second state. The image acquisition unit 111 may acquire a second image, which is an image including the object TP, from the imaging device CAM in the second state. Note that if the determination unit 112 determines not to switch from the first state to the second state, the control unit 113 does not need to rotate the member 220.

[0044] (Technical Effects) When the surface of an object is flat, the reflected light of light incident on the object will have a relatively large direct reflection component. In this case, for example, the direct reflection component may be greater than the diffusely reflected light. On the other hand, when the surface of an object is not flat (for example, the surface is rough), the reflected light of light incident on the object will have a relatively small direct reflection component. In this case, for example, the direct reflection component may be less than the diffusely reflected light. For example, when the target TP wears glasses, the proportion of the flat portion of the target TP's face will be greater than when the target TP does not wear glasses. Therefore, when the target TP wears glasses, an image including the target TP is more likely to be affected by the direct reflection component than when the target TP does not wear glasses. In other words, there are limited cases where an image including the target TP is affected by the direct reflection component.

[0045] Incidentally, as described in the second embodiment, by using the polarization means POL1a, POL1b, and POL2, it is possible to prevent the direct reflection component of the light emitted from the illumination light sources LS1 and LS2 and incident on the target TP from being incident on the imaging device CAM. On the other hand, the polarization means POL1a, POL1b, and POL2 reduce the amount of light incident on the imaging device CAM. As described above, there are limited cases where an image including the target TP is affected by the direct reflection component. Therefore, in the third embodiment, the target TP is imaged without using the polarization means POL1a, POL1b, and POL2 (for example, in the first state shown in FIG. 6(a)), and a first image including the target TP is acquired by the image acquisition unit 111 of the information processing device 100. If the first image is affected by the direct reflection component (e.g., if the determination unit 112 of the information processing device 100 determines to switch from the first state to the second state), the target TP is captured using the polarization units POL1a, POL1b, and POL2 (e.g., in the second state shown in FIG. 6(b)), and a second image including the target TP is acquired by the image acquisition unit 111. The first image may be affected by the direct reflection component in at least one of the following cases: the first image includes a high-luminance area where the luminance value is higher than a predetermined value; the target TP included in the first image is wearing eyeglasses; and biometric authentication of the target TP using the first image fails. Therefore, according to the system 2 of the third embodiment, it is possible to prevent the direct reflection component of light emitted from the illumination light sources LS1 and LS2 and incident on the target TP from entering the imaging device CAM while reducing the chance of a decrease in the amount of light incident on the imaging device CAM.

[0046] (First Modification) As described above, the polarization units POL1a, POL1b, and POL2 reduce the amount of light incident on the image capture device CAM. Therefore, in the first modified example, when the determination unit 112 determines to switch from the first state to the second state, the control unit 113 may perform at least one of increasing the intensity of light emitted from the illumination light sources LS1 and LS2, increasing the exposure of the image capture device CAM, and increasing the gain of the image capture device CAM. This configuration can prevent a reduction in the amount of light incident on the image capture device CAM when the polarization units POL1a, POL1b, and POL2 are used, and / or increase the brightness value (e.g., average brightness value) of the entire image. Furthermore, the control unit 113 may lower the intensity of light emitted from the illumination light sources LS1 and LS2 in the first state compared to the second state. The control unit 113 may increase the intensity of light emitted from the illumination light sources LS1 and LS2 in the second state compared to the first state. This configuration can reduce the power consumption of the illumination light sources LS1 and LS2.

[0047] (Second Modification) For example, the determination unit 112 may estimate at least one of the prescription of the eyeglasses worn by the target TP and the facial orientation of the target TP based on the first image. The prescription of the eyeglasses may be estimated based on the facial contour of the portion where the eyeglasses are superimposed and the facial contour of the portion where the eyeglasses are not superimposed. The determination unit 112 may determine whether to switch from the first state to the second state based on at least one of the prescription of the eyeglasses and the facial orientation. For example, the determination unit 112 may determine whether to switch from the first state to the second state based on the distance between the target TP and the imaging device CAM. The distance between the target TP and the imaging device CAM may be estimated based on, for example, the size of the target TP included in the first image, the zoom magnification of the imaging device CAM, etc. For example, the biometric authentication of the target TP may be iris authentication. For example, the determination unit 112 may determine to switch from the first state to the second state when iris authentication of one of the left eye and right eye of the target TP is successful and iris authentication of the other of the left eye and right eye of the target TP is unsuccessful. For example, the target TP may be imaged multiple times in the first state. Biometric authentication of the target TP may be performed multiple times using multiple images imaged in the first state. For example, the determination unit 112 may determine to switch from the first state to the second state when biometric authentication of the target TP is not successful within a predetermined time after biometric authentication of the target TP is started.

[0048] (Third Modification) In the third modified example, the arithmetic device 110a may not include the determination unit 112. In this case, the control unit 113 may rotate the member 220 so as to periodically switch between the first state and the second state. In this case, the image acquisition unit 111 may acquire multiple images including the target TP from the imaging device CAM. The multiple images may be used for biometric authentication of the target TP. The multiple images may also be used for training an engine related to biometric authentication. Note that the engine may refer to hardware and a core program for controlling components (e.g., hardware parts and program parts) related to biometric authentication. According to the third modified example, for example, image samples for training and evaluation of the engine related to biometric authentication that are robust to direct reflection components from glasses can be efficiently acquired.

[0049] (Fourth Modification) A member 210a shown in FIG. 8 may be used instead of the members 210 and 220 shown in FIG. 6. In FIG. 8, polarization means POL1a, POL1b, and POL3 may be arranged in the member 210a. Polarized light emitted from the illumination light source LS1 and oscillating in a first direction may pass through the polarization means POL1a and be incident on the target TP. Polarized light emitted from the illumination light source LS2 and oscillating in the first direction may pass through the polarization means POL1b and be incident on the target TP. The polarization means POL3 rotates in accordance with the rotation of the member 230. The direction in which the transmission axis of the polarization means POL3 extends may be changed by rotating the member 230.

[0050] For example, as shown in FIG. 8(a), when the direction in which the transmission axis of the polarization means POL3 extends is a first direction, polarized light oscillating in the first direction (e.g., a direct reflection component of polarized light oscillating in the first direction, which is emitted from the illumination light sources LS1 and LS2 and incident on the object TP) may be incident on the imaging device CAM. Therefore, the third state shown in FIG. 8(a) can be said to be equivalent to the first state shown in FIG. 6(a). For example, as shown in FIG. 8(b), when the direction in which the transmission axis of the polarization means POL3 extends is different from the first direction, polarized light oscillating in the first direction is blocked by the polarization means POL3. Therefore, the fourth state shown in FIG. 8(b) can be said to be equivalent to the second state shown in FIG. 6(b).

[0051] An example of the operation of the system 2 according to the fourth modified example will be described. Here, it is assumed that the third state is the initial state. The image acquisition unit 111 of the information processing device 100 may acquire a third image, which is an image including the target TP, from the imaging device CAM in the third state. The determination unit 112 of the information processing device 100 may determine whether to switch from the third state to a fourth state based on the third image. If the determination unit 112 determines to switch from the third state to the fourth state, the control unit 113 may rotate the member 230 so as to change from the third state to the fourth state. The image acquisition unit 111 may acquire a second image, which is an image including the target TP, from the imaging device CAM in the fourth state. Note that if the determination unit 112 determines not to switch from the third state to the fourth state, the control unit 113 does not need to rotate the member 230.

[0052] The arithmetic device 110a may not include the determination unit 112. In this case, the control unit 113 may continuously rotate the member 230. Alternatively, the control unit 113 may rotate the member 230 by a predetermined angle at predetermined intervals. In this case, the image acquisition unit 111 may acquire multiple images including the target TP from the imaging device CAM. The multiple images may be used for biometric authentication of the target TP. Furthermore, the multiple images may be used for learning an engine related to biometric authentication.

[0053] <Fourth embodiment> A fourth embodiment of the system, apparatus, and method will be described with reference to Fig. 9. Hereinafter, the fourth embodiment of the system, apparatus, and method will be described using system 2. Note that, for the fourth embodiment, descriptions that overlap with the descriptions for the first to third embodiments will be omitted as appropriate.

[0054] The information processing device 100 according to the fourth embodiment may include a calculation device 110b instead of the calculation device 110. The arithmetic device 110b may have one or more processors, similar to the arithmetic device 110. As shown in Fig. 9, the arithmetic device 110b may have an image acquisition unit 111, a determination unit 112, a control unit 113, and an authentication unit 114, which may be logically realized functional blocks or physically realized processing circuits. Note that at least one of the image acquisition unit 111, the determination unit 112, the control unit 113, and the authentication unit 114 may be realized in a form in which a logical functional block and a physical processing circuit (i.e., hardware) are mixed.

[0055] Note that when the image acquisition unit 111, the determination unit 112, the control unit 113, and the authentication unit 114 are realized as functional blocks, the image acquisition unit 111, the determination unit 112, the control unit 113, and the authentication unit 114 may be realized by a single processor (for example, the processor 1101). Alternatively, the image acquisition unit 111, the determination unit 112, the control unit 113, and the authentication unit 114 may each be realized by a different processor. Alternatively, some of the image acquisition unit 111, the determination unit 112, the control unit 113, and the authentication unit 114 may be realized by a single processor, and the remaining parts of the image acquisition unit 111, the determination unit 112, the control unit 113, and the authentication unit 114 may be realized by one or more other processors different from the single processor.

[0056] The authentication unit 114 may perform biometric authentication of the target TP using an image including the target TP acquired by the image acquisition unit 111. The biometric authentication may be at least one of facial authentication and iris authentication. Alternatively, the biometric authentication may be multimodal biometric authentication including at least one of facial authentication and iris authentication. For example, the authentication unit 114 may extract features from an image including the target TP. The authentication unit 114 may calculate an authentication score by comparing the extracted features with pre-registered registration information (e.g., features). The authentication unit 114 may determine whether the authentication score is equal to or greater than a predetermined threshold. If the authentication score is equal to or greater than the predetermined threshold, the authentication unit 114 may determine that the target TP is a registered person. On the other hand, if the authentication score is less than the predetermined threshold, the authentication unit 114 may determine that the target TP is not a registered person. If the target TP is determined to be a registered person (in other words, if the authentication score is equal to or greater than a predetermined threshold), this may be referred to as successful authentication. If the target TP is determined not to be a registered user (in other words, if the authentication score is smaller than a predetermined threshold), this may be referred to as an authentication failure. Note that the registration information may be stored in the storage device 120, for example.

[0057] (Technical Effects) According to the fourth embodiment, the information processing device 100 can perform biometric authentication of the target TP.

[0058] Fifth Embodiment A fifth embodiment of the system, apparatus, and method will be described with reference to FIG. 10. Hereinafter, the fifth embodiment of the system, apparatus, and method will be described using system 3. Note that, for the fifth embodiment, descriptions that overlap with the descriptions for the first to fourth embodiments will be omitted as appropriate. Furthermore, in the drawings, parts that are common to the first to fourth embodiments are denoted by the same reference numerals.

[0059] 10, a system 3 includes an information processing device 100, an authentication device 300, and polarization means POL1a, POL1b, and POL2. The information processing device 100 and the authentication device 300 may be connected via a network NW. The network NW may be a wide area network such as the Internet, or a narrow area network such as a LAN (Local Area Network).

[0060] The information processing device 100 may transmit an image including the target TP acquired from the imaging device CAM to the authentication device 300 via the communication device 130. The authentication device 300 may perform biometric authentication of the target TP using the image including the target TP. For example, the authentication device 300 may extract features from the image including the target TP. The authentication device 300 may calculate an authentication score by comparing the extracted features with pre-registered registration information (e.g., features). The authentication device 300 may determine whether the authentication score is equal to or greater than a predetermined threshold. If the authentication score is equal to or greater than the predetermined threshold, the authentication device 300 may determine that the target TP is a registered person. On the other hand, if the authentication score is less than the predetermined threshold, the authentication device 300 may determine that the target TP is not a registered person. The authentication device 300 may transmit the result of biometric authentication of the target TP to the information processing device 100.

[0061] (Technical Effects) According to the system 3 of the fifth embodiment, it is possible to reduce the load on the information processing device 100 compared to when the information processing device 100 performs biometric authentication of the target TP. Furthermore, in the system 3, since the information processing device 100 does not need to perform biometric authentication of the target TP, it is possible to suppress the hardware performance required for the information processing device 100.

[0062] Sixth Embodiment A sixth embodiment of the system, apparatus, and method will be described with reference to FIG. 11. Hereinafter, the sixth embodiment of the system, apparatus, and method will be described using system 4. Note that, for the sixth embodiment, descriptions that overlap with the descriptions for the first to fifth embodiments will be omitted as appropriate. Furthermore, in the drawings, parts that are common to the first to fifth embodiments are denoted by the same reference numerals.

[0063] 11, the system 4 includes an information processing device 100 and polarization means POL1 and POL2. The polarization means POL1 polarizes light emitted from an illumination light source LS1 in a first direction. The first direction refers to the direction in which the transmission axis of the polarization means POL1 extends. The polarization means POL2 polarizes light directed toward an imaging device CAM that captures an image of a target TP (not shown) in a second direction different from the first direction. The illumination light sources LS1 and LS2 and the imaging device CAM may constitute part of the system 4. That is, the system 4 may include the illumination light sources LS1 and LS2 and the imaging device CAM.

[0064] The information processing apparatus 100 according to the sixth embodiment may include a calculation device 110a shown in FIG. 6 instead of the calculation device 110. In the sixth embodiment, the determination unit 112 may determine whether to switch from a fifth state in which the illumination light source LS2 is on and the illumination light source LS1 is off to a sixth state in which the illumination light source LS1 is on and the illumination light source LS2 is off. In the sixth embodiment, the control unit 113 can switch between the fifth state and the sixth state by controlling the on / off states of the illumination light sources LS1 and LS2. For this reason, the control unit 113 may be referred to as a switching unit.

[0065] An example of the operation of the system 4 according to the sixth embodiment will be described. Here, the fifth state is assumed to be the initial state. In the fifth state, the image acquisition unit 111 of the information processing device 100 may acquire a first image, which is an image including the target TP, from the imaging device CAM.

[0066] The determination unit 112 of the information processing device 100 may determine whether to switch from the fifth state to the sixth state based on the first image. In other words, the determination unit 112 may determine whether to use the illumination light source LS1 and the polarization unit POL1 instead of the illumination light source LS2 based on the first image. For example, the determination unit 112 may determine to switch from the fifth state to the sixth state when the first image includes a high-luminance area, which is an area with a luminance value higher than a predetermined value. Note that the determination unit 112 may determine to switch from the fifth state to the sixth state when the first image includes a high-luminance area and the high-luminance area overlaps a part of the target TP. For example, the determination unit 112 may determine to switch from the fifth state to the sixth state when the target TP included in the first image is wearing eyeglasses. For example, the determination unit 112 may determine to switch from the fifth state to the sixth state when biometric authentication of the target TP using the first image fails.

[0067] If the determination unit 112 determines to switch from the fifth state to the sixth state, the control unit 113 may turn on the illumination light source LS1 and turn off the illumination light source LS2 to change from the fifth state to the sixth state. The image acquisition unit 111 may acquire a second image, which is an image including the object TP, from the imaging device CAM in the sixth state. Note that if the determination unit 112 determines not to switch from the fifth state to the sixth state, the control unit 113 may keep the illumination light source LS1 turned on and the illumination light source LS2 turned off.

[0068] (Technical Effects) According to the system 4 of the sixth embodiment, similarly to the system 2 of the third embodiment, it is possible to reduce the chance of a decrease in the amount of light incident on the imaging device CAM, while suppressing the direct reflection component of light incident on the object TP from being incident on the imaging device CAM.

[0069] (First Modification) In the sixth state (i.e., a state in which the illumination light source LS1 is on and the illumination light source LS2 is off), the polarization units POL1 and POL2 reduce the amount of light incident on the image capture device CAM. Therefore, in the first modified example, when the determination unit 112 determines to switch from the fifth state to the sixth state, the control unit 113 may increase the intensity of light emitted from the illumination light source LS1, increase the exposure of the image capture device CAM, or increase the gain of the image capture device CAM. This configuration can prevent a reduction in the amount of light incident on the image capture device CAM when the illumination light source LS1 and the polarization unit LS1 are used, and / or increase the brightness value (e.g., average brightness value) of the entire image. Furthermore, the control unit 113 may reduce the intensity of light emitted from the illumination light source LS2 in the fifth state compared to the intensity of light emitted from the illumination light source LS1 in the sixth state. The control unit 113 may increase the intensity of light emitted from the illumination light source LS1 in the sixth state compared to the intensity of light emitted from the illumination light source LS2 in the second state. With this configuration, the power consumption of the illumination light sources LS1 and LS2 can be reduced.

[0070] (Second Modification) For example, the determination unit 112 may estimate at least one of the prescription of the eyeglasses worn by the target TP and the facial orientation of the target TP based on the first image. The determination unit 112 may determine whether to switch from the fifth state to the sixth state based on at least one of the prescription of the eyeglasses and the facial orientation. For example, the determination unit 112 may determine whether to switch from the fifth state to the sixth state based on the distance between the target TP and the imaging device CAM. For example, the biometric authentication of the target TP may be iris authentication. For example, the determination unit 112 may determine to switch from the fifth state to the sixth state when iris authentication of one of the left eye and the right eye of the target TP is successful and iris authentication of the other of the left eye and the right eye of the target TP is unsuccessful. For example, the target TP may be imaged multiple times in the fifth state. Biometric authentication of the target TP may be performed multiple times using multiple images imaged in the fifth state. For example, the determining unit 112 may determine to switch from the fifth state to the sixth state when biometric authentication of the target TP is not successful for a predetermined time after the start of biometric authentication of the target TP.

[0071] (Third Modification) In the third modified example, the arithmetic device 110a may not include the determination unit 112. In this case, the control unit 113 may control the lighting state of each of the illumination light sources LS1 and LS2 so that the fifth state and the sixth state are periodically switched. In this case, the image acquisition unit 111 may acquire multiple images including the target TP from the imaging device CAM. The multiple images may be used for biometric authentication of the target TP. The multiple images may also be used for training an engine related to biometric authentication. According to the third modified example, for example, image samples for training and evaluation of an engine related to biometric authentication that is robust to direct reflection components from glasses can be efficiently acquired.

[0072] <Additional Notes> Some or all of the above embodiments can be described as, but are not limited to, the following supplementary notes.

[0073] (Appendix 1) a first polarizing means for polarizing light emitted from an illumination light source in a first direction; a second polarizing means for polarizing light directed toward an imaging means for imaging the object in a second direction different from the first direction; an acquisition means for acquiring an image including the object output from the imaging means; A system comprising:

[0074] (Appendix 2) a switching means for switching between a first state in which the first polarization means polarizes the light emitted from the illumination light source in the first direction and the second polarization means polarizes the light directed toward the image capture means in the second direction, and a second state in which the first polarization means does not polarize the light emitted from the illumination light source in the first direction and / or the second polarization means does not polarize the light directed toward the image capture means in the second direction; 10. The system of claim 1.

[0075] (Appendix 3) a determination means for determining whether to switch from the second state to the first state based on a first image including the object output from the imaging means in the second state; 1. The system described in Appendix 2.

[0076] (Appendix 4) the first polarization means polarizes light emitted from a first illumination light source serving as the illumination light source in the first direction; and a determining means for determining whether to switch from the third state to a fourth state in which the first illumination light source is turned on and the second illumination light source is turned off, based on a second image including the object output from the imaging means in a third state in which the first illumination light source is turned off and a second illumination light source different from the first illumination light source is turned on. 10. The system of claim 1.

[0077] (Appendix 5) a control unit that, when it is determined that the state is to be switched from the second state to the first state, performs at least one of increasing the intensity of light emitted from the illumination light source, increasing the exposure of the image capturing unit, and increasing the gain of the image capturing unit. 10. The system described in Appendix 3.

[0078] (Appendix 6) and a control unit that, when it is determined that the state is to be switched from the third state to the fourth state, performs at least one of increasing the intensity of the light emitted from the illumination light source, increasing the exposure of the image capturing unit, and increasing the gain of the image capturing unit. 10. The system described in Appendix 4.

[0079] (Appendix 7) The determination means determines to switch from the second state to the first state in at least one of the following cases: when the first image includes a high-luminance area whose luminance value is higher than a predetermined value; when biometric authentication of the subject performed based on the first image fails; and when the subject included in the first image is wearing eyeglasses. 10. The system described in Appendix 3.

[0080] (Appendix 8) When the first image includes the high-luminance region and the high-luminance region overlaps with a region estimated to be at least one of the subject's eyes and eyeglasses worn by the subject, the determining means determines to switch from the second state to the first state. 7. The system of claim 7.

[0081] (Appendix 9) The determining means determines to switch from the third state to the fourth state in at least one of the following cases: when the second image includes a high-luminance area whose luminance value is higher than a predetermined value; when biometric authentication of the subject performed based on the second image fails; and when the subject included in the second image is wearing eyeglasses. 10. The system described in Appendix 4.

[0082] (Appendix 10) When the high-luminance region is included in the second image and overlaps with a region estimated to be at least one of the subject's eyes and eyeglasses worn by the subject, the determining means determines to switch from the third state to the fourth state. 10. The system of claim 9.

[0083] (Appendix 11) a first polarizing means for polarizing light emitted from an illumination light source in a first direction; a second polarizing means for polarizing light directed toward an imaging means for imaging the object in a second direction different from the first direction; an acquisition means for acquiring an image including the object output from the imaging means; An apparatus comprising:

[0084] (Appendix 12) polarizing light emitted from an illumination source in a first direction; polarizing light directed toward an imaging means for imaging the object in a second direction different from the first direction; Acquire an image including the object output from the imaging means method.

[0085] (Appendix 13) A recording medium having a computer program recorded thereon to cause a computer included in a system comprising a first polarization means for polarizing light emitted from an illumination light source in a first direction and a second polarization means for polarizing light directed toward an imaging means for imaging the object in a second direction different from the first direction to execute a method for acquiring an image including the object output from the imaging means.

[0086] Furthermore, some or all of the configurations described in Supplementary Notes 2 to 10, which are dependent on Supplementary Note 1, may also be dependent on Supplementary Notes 11 and 12 in the same dependent relationship as Supplementary Notes 2 to 10. Furthermore, not limited to Supplementary Notes 1, 11, and 12, some or all of the configurations described as Supplements may be made dependent on various hardware, software, various recording means for recording software, or systems, within the scope of each of the above-mentioned embodiments.

[0087] This disclosure may be modified as appropriate within the scope of the claims and the entire specification without departing from the spirit or concept of the invention, and systems, devices, and methods incorporating such modifications are also included in the technical concept of this disclosure. [Explanation of symbols]

[0088] 1, 2, 3, 4...system, 11...image acquisition device, 100...information processing device, 111...image acquisition section, 112...determination section, 113...control section, 114...authentication section, CAM...imaging device, LS, LS1, LS2...illumination light source, POL1, POL1a, POL1b, POL2, POL3...polarization means

Claims

1. a first polarizing means for polarizing light emitted from the illumination light source in a first direction; a second polarizing means for polarizing light directed toward an imaging means for imaging the object in a second direction different from the first direction; an acquisition means for acquiring an image including the object output from the imaging means; A system comprising:

2. a switching means for switching between a first state in which the first polarization means polarizes the light emitted from the illumination light source in the first direction and the second polarization means polarizes the light directed toward the image capture means in the second direction, and a second state in which the first polarization means does not polarize the light emitted from the illumination light source in the first direction and / or the second polarization means does not polarize the light directed toward the image capture means in the second direction; The system of claim 1 .

3. a determination means for determining whether to switch from the second state to the first state based on a first image including the object output from the imaging means in the second state; The system of claim 2 .

4. the first polarization means polarizes light emitted from a first illumination light source serving as the illumination light source in the first direction; and a determining means for determining whether to switch from the third state to a fourth state in which the first illumination light source is turned on and the second illumination light source is turned off, based on a second image including the object output from the imaging means in a third state in which the first illumination light source is turned off and a second illumination light source different from the first illumination light source is turned on. The system of claim 1 .

5. a control unit that increases at least one of the intensity of light emitted from the illumination light source, the exposure of the image capturing unit, and the gain of the image capturing unit when it is determined that the state should be switched from the second state to the first state; The system of claim 3.

6. and a control unit that, when it is determined that the state is to be switched from the third state to the fourth state, performs at least one of increasing the intensity of the light emitted from the illumination light source, increasing the exposure of the image capturing unit, and increasing the gain of the image capturing unit. The system of claim 4.

7. The determination means determines to switch from the second state to the first state in at least one of the following cases: when the first image includes a high-luminance area having a luminance value higher than a predetermined value; when biometric authentication of the subject performed based on the first image has failed; and when the subject included in the first image is wearing eyeglasses. The system of claim 3.

8. The determination means determines to switch from the third state to the fourth state in at least one of the following cases: when the second image includes a high-luminance area having a luminance value higher than a predetermined value; when biometric authentication of the subject performed based on the second image fails; and when the subject included in the second image is wearing eyeglasses. The system of claim 4.

9. a first polarizing means for polarizing light emitted from the illumination light source in a first direction; a second polarizing means for polarizing light directed toward an imaging means for imaging the object in a second direction different from the first direction; an acquisition means for acquiring an image including the object output from the imaging means; An apparatus comprising:

10. polarizing light emitted from an illumination source in a first direction; polarizing light directed toward an imaging means for imaging the object in a second direction different from the first direction; Acquire an image including the object output from the imaging means method.

Images