Wearable device, information processing method, and recording medium

Abstract

This wearable device comprises: an imaging means for imaging an iris of a subject wearing the wearable device and generating an iris image including the iris; a person authentication means for determining, by using the iris image, whether the subject is the person to be authenticated; a detection means for detecting whether the subject is wearing the wearable device; and a control means for performing control on the basis of the detection results so that the person authentication means does not operate until the authenticated subject removes the wearable device.

Description

Wearable device, information processing method, and recording medium

[0001] The present disclosure relates to the technical fields of wearable devices, information processing methods, and recording media.

[0002] In this type of device, as described in Patent Document 1, for example, a head-mounted image display device that projects an image directly onto the retina and makes it perceived as a virtual image may be equipped with a function to capture an image of the iris or retina of the eye and perform personal authentication, thereby providing security by presenting video information only to pre-registered individuals.

[0003] JP 2008-241822 A

[0004] An object of this disclosure is to provide a wearable device, an information processing method, and a recording medium that aim to improve upon the techniques related to the prior art documents mentioned above.

[0005] One aspect of the wearable device comprises an imaging means for capturing an image of the iris of a subject wearing the wearable device and generating an iris image including the iris, an identity determination means for determining whether the subject is the subject using the iris image, a detection means for detecting whether the subject is wearing the wearable device, and a control means for controlling the identity determination means not to operate until the subject determined to be the subject removes the wearable device based on the detection result.

[0006] One aspect of the information processing method is an information processing method executed by a wearable device, which captures an image of the iris of a subject wearing the wearable device, generates an iris image including the iris, uses the iris image to perform a determination operation to determine whether the subject is the person in question, detects whether the subject is wearing the wearable device, and, based on the detection result, controls the device so that the determination operation is not performed until the subject determined to be the person in question removes the wearable device.

[0007] One aspect of the recording medium has a computer program recorded on it to cause a computer to execute an information processing method that captures an image of the iris of a subject wearing a wearable device, generates an iris image including the iris, uses the iris image to determine whether the subject is the person in question, detects whether the subject is wearing the wearable device, and, based on the detection results, controls the computer so that the determination operation is not performed until the subject determined to be the person in question removes the wearable device.

[0008] 1 is a block diagram showing the configuration of a wearable device according to the present disclosure. FIG. 2 is a flowchart showing the flow of information processing operations in a wearable device according to the present disclosure. FIG. 3 is a block diagram showing the configuration of a wearable device according to the present disclosure. FIG. 4 is a schematic diagram showing an overview of a wearable device according to the present disclosure. FIG. 5 is a block diagram showing the configuration of a wearable device according to the present disclosure. FIG. 6 is a flowchart showing the flow of information processing operations in a wearable device according to the present disclosure. FIG. 7 is a block diagram showing the configuration of a wearable device according to the present disclosure. FIG. 8 is a block diagram showing the configuration of a wearable device according to the present disclosure. FIG. 9 is a schematic diagram showing an overview of a wearable device according to the present disclosure.

[0009] Hereinafter, embodiments of a wearable device, an information processing method, and a recording medium will be described with reference to the drawings. [1: First Embodiment]

[0010] A first embodiment of a wearable device, an information processing method, and a recording medium will be described with reference to Figures 1 and 2. Hereinafter, the first embodiment of a wearable device, an information processing method, and a recording medium will be described using a wearable device 1. [1-1: Configuration of Wearable Device 1]

[0011] The configuration of a wearable device 1 according to this disclosure will be described with reference to FIG. 1. FIG. 1 is a block diagram showing the configuration of a wearable device 1 according to this disclosure. As shown in FIG. 1, the wearable device 1 includes an imaging device 11, an identity determination unit 12, a detection unit 13, and a control unit 14. The wearable device 1 is a device that can be worn by a target user. The user may wear the wearable device 1 on their head. [1-2: Information processing method executed by the wearable device 1]

[0012] An information processing method executed by the wearable device 1 will be described with reference to Fig. 2. Fig. 2 is a flowchart showing an example of the flow of the information processing method executed by the wearable device 1. The wearable device 1 may be realized by a computer executing a computer program for executing the information processing method.

[0013] As shown in FIG. 2 , the imaging device 11 captures an image of the iris of a user wearing the wearable device 1 and generates an iris image including the user's iris (step S11). The identity determination unit 12 determines whether the user is the user using the generated iris image (step S12). The identity determination unit 12 may determine whether the user is the user based on a comparison result between the generated iris image and a registered iris image. The operation of determining whether the user is the user using the generated iris image will be described in detail in another embodiment. The detection unit 13 detects whether the user is wearing the wearable device 1 (step S13). The detection unit 13 may detect whether the user is wearing the wearable device 1 via a function of the wearable device 1. The operation of detecting whether the user is wearing the wearable device 1 will be described in detail in another embodiment. The control unit 14 controls the operation of the identity determination unit 12 based on the detection result by the detection unit 13 (step S14). The control unit 14 controls the detection unit 13 not to operate until the user who has been determined to be the person in question removes the imaging device 11 .

[0014] In this way, wearable device 1 executes an information processing method that captures an image of the iris of the subject wearing wearable device 1, generates an iris image including the iris, uses the iris image to determine whether the subject is the person in question, detects whether the subject is wearing wearable device 1, and, based on the detection results, controls so that the determination operation is not performed until the subject determined to be the person in question removes wearable device 1.

[0015] The above-described wearable device 1 may be realized by a computer reading a computer program recorded on a recording medium. In this case, the computer program may cause the computer to execute an information processing method that captures an image of the iris of a subject wearing the wearable device 1, generates an iris image including the iris, determines whether the subject is the person in question using the iris image, detects whether the subject is wearing the wearable device 1, and, based on the detection result, prevents the determination operation from being performed until the subject determined to be the person in question removes the wearable device 1. [1-3: Technical Effects]

[0016] The wearable device 1 according to the present disclosure limits identity verification until the user removes the device, thereby reducing unnecessary identity verification and the processing load of the device.

[0017] A second embodiment of a wearable device, an information processing method, and a recording medium will be described with reference to Figures 3 to 7. Below, the second embodiment of a wearable device, an information processing method, and a recording medium will be described using a wearable device 2. Note that, for the second embodiment, descriptions that overlap with the first embodiment will be omitted as appropriate.

[0018] In this embodiment, the user wears the wearable device 2 on his / her head. The wearable device 2 worn on the head may be an immersive head-mounted display (so-called immersive VR (Virtual Reality) goggles). The wearable device 2 may also be a video see-through head-mounted display or an optical see-through head-mounted display (so-called AR (Augmented Reality) glasses). [2-1: Configuration of the Wearable Device 2]

[0019] The configuration of the wearable device 2 in this embodiment will be described with reference to Figures 3 to 5. Figures 3 and 5 are block diagrams showing the configuration of the wearable device 2 in this embodiment. Figure 4 is a schematic diagram showing the configuration of the wearable device 2 in this embodiment.

[0020] 3 , the wearable device 2 includes a computing unit 21, a storage device 22, a communication device 23, an input device 24, an output device 25, a camera 27, and a light source 28. The computing unit 21, the storage device 22, the communication device 23, the input device 24, the output device 25, the camera 27, and the light source 28 may be connected via a data bus 26.

[0021] The arithmetic device 21 may include a processor 21a. The arithmetic device 21 may include other processors in addition to the processor 21a. That is, the arithmetic device 21 may include one or more processors. The processor 21a may be a multi-core processor. When the arithmetic device 21 includes a single processor 21a that is a multi-core processor, it can be said that the arithmetic device 21 logically includes multiple processors.

[0022] The processor 21a may be, for example, at least one of a central processing unit (CPU), a graphics processing unit (GPU), a field programmable gate array (FPGA), a tensor processing unit (TPU), and a quantum processor.

[0023] The storage device 22 may include a memory 22a. The storage device 22 may include other memories in addition to the memory 22a. That is, the storage device 22 may include one or more memories. The memory 22a may be, for example, at least one of a RAM (Random Access Memory), a ROM (Read Only Memory), a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and an optical disk array. Therefore, the storage device 22 may include the memory 22a as a non-transitory recording medium.

[0024] The storage device 22 can store desired data. A computer program 221 to be executed by the arithmetic device 21 may be stored in the memory 22a of the storage device 22. The storage device 22 may temporarily store data that is temporarily used by the arithmetic device 21 when the arithmetic device 21 is executing the computer program 221.

[0025] The computer program 221 may be recorded on a computer-readable, non-transitory recording medium. In this case, the computer program 221 may be stored in the memory 22a by reading the recording medium using a recording medium reading device (not shown) included in the wearable device 2. The recording medium may be at least one of an optical disk, a magnetic medium, a magneto-optical disk, a semiconductor memory, and any other medium capable of storing a program. The computer program 221 may be acquired (in other words, downloaded) from a device (not shown) external to the wearable device 2 via the communication device 23. The acquired computer program 221 may be stored in the memory 22a.

[0026] The communication device 23 may be capable of communicating with devices external to the wearable device 2. The communication device 23 may perform wired communication or wireless communication.

[0027] The input device 24 is a device capable of receiving information input to the wearable device 2 from an external device. The input device 24 may include a recording medium reading device capable of reading information recorded on a recording medium detachable from the wearable device 2, such as a USB (Universal Serial Bus) memory. When information is input to the wearable device 2 via the communication device 23 (in other words, when the wearable device 2 acquires information via the communication device 23), the communication device 23 may function as an input device. When information is input to the wearable device 2 via the cameras 27L and 27R (in other words, when the wearable device 2 acquires information via the cameras 27L and 27R), the cameras 27L and 27R may function as input devices. In this case, the wearable device 2 may acquire information indicating the user's eye movement based on images captured by the cameras 27L and 27R. The user's eye movement may be, for example, at least one of the user's gaze movement and the user's wink. The input device 24 may also include an operating device (e.g., a remote control, a controller, a keyboard, a mouse, a touch panel, etc.) that can be operated by the user of the wearable device 2.

[0028] The output device 25 is a device capable of outputting information to the outside of the wearable device 2. The output device 25 may output visual information such as text or images, auditory information such as sound, or tactile information such as vibration. The output device 25 may include, for example, at least one of a display, a speaker, a printer, and a vibration motor. The display may be, for example, at least one of a liquid crystal display and an organic electroluminescence (EL) display. The printer may be, for example, at least one of an inkjet printer and a laser printer. The output device 25 may be capable of outputting information to a recording medium detachable from the wearable device 2, such as a USB memory. Note that when the wearable device 2 outputs information via the communication device 23, the communication device 23 may function as the output device.

[0029] In this embodiment, an immersive head-mounted display is used as an example of the wearable device 2. As shown in FIG. 4 , the wearable device 2 may include a display 251 as an output device 25, a camera 27L, a camera 27R, a plurality of light sources 28#1, 28#2, 28#3, and 28#4, a lens 29L for the left eye, and a lens 29R for the right eye. The light sources 28#1 and 28#2 may be arranged around the lens 29L. The light sources 28#3 and 28#4 may be arranged around the lens 29R. When the cameras 27L and 27R are not distinguished from each other, they are referred to as "cameras 27." When the plurality of light sources 28#1, 28#2, 28#3, and 28#4 are not distinguished from each other, they are referred to as "light sources 28." The lenses 29L and 29R may be referred to as VR lenses.

[0030] The display 251 displays information visible to the user wearing the wearable device 2. The wearable device 2 may have a display for the left eye and a display for the right eye instead of the display 251. The light source 28 irradiates light to the user. The light source 28 irradiates light at least to the iris of the user. The light source 28 may emit near-infrared light. The light source 28 may also emit visible light. The number of light sources 28 is not limited to four, and may be five or more, or three or less.

[0031] Camera 27L may be arranged in wearable device 2 so as to be able to capture an image of the user's left eye. Camera 27R may be arranged in wearable device 2 so as to be able to capture an image of the user's right eye. Camera 27 may be a camera capable of capturing near-infrared light. In other words, camera 27 may be a camera equipped with an imaging element sensitive to the near-infrared wavelength range. Camera 27 may also be a camera capable of capturing visible light. Camera 27 captures an eye image including the user's eye illuminated with light by light source 28. When the iris is imaged, light source 28 may emit light that is different from when the iris is not imaged.

[0032] The processor 21a of the arithmetic device 21, together with the memory 22a of the storage device 22 in which the computer program 221 is stored (in other words, together with the memory 22a and the computer program 221 stored in the memory 22a), may execute the processing to be performed by the wearable device 2. For example, the processor 21a may execute the computer program 221 to realize, within the arithmetic device 21 (for example, within the processor 21a), a logical functional block for executing the processing to be performed by the wearable device 2.

[0033] 5, the arithmetic device 21 may have, as logically realized functional blocks or as physically realized processing circuits, an image acquisition unit 211, an identity determination unit 212, a detection unit 213, and a control unit 214. The identity determination unit 212, the detection unit 213, and the control unit 214 are components corresponding to the identity determination unit 12, the detection unit 13, and the control unit 14 in the first embodiment, respectively. The identity determination unit 212 may have a matching unit 2121.

[0034] The detection unit 213 detects whether the user is wearing the wearable device 2. In other words, the detection unit 213 detects whether the wearable device 2 is being worn by the user. The wearable device 2 may include a contact sensor that outputs information indicating the contact state between the wearable device 2 and the user's head. In this case, the detection unit 213 may detect whether the user is wearing the wearable device 2 based on the output of the contact sensor. The wearable device 2 may also include a motion sensor that outputs information indicating the movement of the head of the user wearing the wearable device 2. The movement of the user's head may include the direction of the head, the tilt of the head, etc. Examples of the motion sensor include a gyro sensor and an acceleration sensor. In this case, the detection unit 213 may detect whether the user is wearing the wearable device 2 based on the output of the motion sensor.

[0035] The control unit 214 controls the identity determination operation. That is, the control unit 214 controls the operation of the identity determination unit 212. The control unit 214 may include an operation necessity determination unit 2141. The operation necessity determination unit 2141 determines whether or not the identity determination operation is necessary based on the detection result of the detection unit 213.

[0036] At least one of the image acquisition unit 211, the identity determination unit 212, the detection unit 213, and the control unit 214 may be realized in a format in which a logical function block and a physical processing circuit (i.e., hardware) are mixed. The processing performed by each of the image acquisition unit 211, the identity determination unit 212, the detection unit 213, and the control unit 214 will be described with reference to FIG. 6.

[0037] Note that when the image acquisition unit 211, the identity determination unit 212, the detection unit 213, and the control unit 214 are realized as functional blocks, the image acquisition unit 211, the identity determination unit 212, the detection unit 213, and the control unit 214 may be realized by a single processor (e.g., processor 21a). Alternatively, the image acquisition unit 211, the identity determination unit 212, the detection unit 213, and the control unit 214 may be realized by different processors. Alternatively, some of the image acquisition unit 211, the identity determination unit 212, the detection unit 213, and the control unit 214 may be realized by a single processor, and the remaining parts of the image acquisition unit 211, the identity determination unit 212, the detection unit 213, and the control unit 214 may be realized by one or more processors different from the single processor.

[0038] The wearable device 2 may be a standalone head-mounted display. Alternatively, the wearable device 2 may be a PC-connected head-mounted display connected to a personal computer. In this case, the arithmetic unit 21, the storage unit 22, the communication unit 23, the input unit 24, the output unit 25, the camera 27, and the light source 28 may be provided in the personal computer to which the head-mounted display is connected. The wearable device 2 may be a hybrid head-mounted display (i.e., a head-mounted display that can operate as both a standalone type and a PC-connected type). [2-2: Information Processing Method Executed by the Wearable Device 2]

[0039] An information processing method executed by the wearable device 2 will be described with reference to Fig. 6. Fig. 6 is a flowchart showing an example of the flow of the information processing method executed by the wearable device 2.

[0040] 6(a), the operation necessity determination unit 2141 determines whether the user has worn the wearable device 2 based on the detection result of the detection unit 213 (step S21). If it does not detect that the user has worn the wearable device 2 (step S21: No), the operation of step S21 is repeated. If it detects that the user has worn the wearable device 2 (step S21: Yes), the process proceeds to step S22.

[0041] The identity determination unit 212 determines whether the user is the identity of the user using the iris image (step S22). As shown in FIG. 6B, the image acquisition unit 211 acquires an eye image including the user's eyes (step S221). The user's eye image may be generated by, for example, capturing an image of the user's eyes with at least one of the cameras 27L and 27R. The image acquisition unit 211 may acquire the eye image from at least one of the cameras 27L and 27R.

[0042] The matching unit 2121 matches the iris image with the registered image (step S222). Specifically, the matching unit 2121 may generate an iris image including an iris region corresponding to the user's iris from the eye image. The matching unit 2121 may calculate a matching score by matching the generated iris image with a pre-registered iris image. Here, the matching score may refer to a score indicating the degree of match between the iris image and the pre-registered iris image. Note that the higher the degree of match between the iris image and the pre-registered iris image, the higher the matching score may be.

[0043] Alternatively, the matching unit 2121 may extract features related to the generated iris image. The matching unit 2121 may calculate a matching score by matching the extracted features with pre-registered features. Here, the matching score may refer to a score indicating the degree of match between the features extracted from the iris image and the pre-registered features. Note that the higher the degree of match between the features extracted from the iris image and the pre-registered features, the higher the matching score may be.

[0044] The matching unit 2121 may calculate a matching score for the user's left eye and a matching score for the user's right eye. However, the matching unit 2121 may calculate only one of the matching score for the left eye and the matching score for the right eye. In other words, the matching unit 2121 may calculate at least one of the matching score for the left eye and the matching score for the right eye.

[0045] Furthermore, the matching unit 2121 may calculate the matching score based on at least one of the degree of match between the iris image of the user's left eye and one pre-registered iris image and the degree of match between the iris image of the user's right eye and another pre-registered iris image. Alternatively, the matching unit 2121 may calculate the matching score based on at least one of the degree of match between a feature extracted from the iris image of the user's left eye and one pre-registered feature and the degree of match between a feature extracted from the iris image of the user's right eye and another pre-registered feature.

[0046] The identity determination unit 212 may determine whether the user is the person in question based on the matching result of the matching unit 2121. The identity determination unit 212 may compare the matching score with a predetermined threshold. If the matching score is equal to or greater than the predetermined threshold, the identity determination unit 212 may determine that the user is a person associated with a pre-registered iris image or feature amount. In this case, it can be said that a person (e.g., identification information) corresponding to the user has been identified by iris authentication. If the matching score is less than the predetermined threshold, the identity determination unit 212 may determine that the user is not a person associated with a pre-registered iris image or feature amount. In this case, it can be said that a person corresponding to the user has not been identified by iris authentication.

[0047] 6(a), the operation necessity determination unit 2141 determines whether the user has removed the wearable device 2 based on the detection result of the detection unit 213 (step S23). If it is not detected that the user has removed the wearable device 2 (step S23: No), the operation of step S23 is repeated. The operation necessity determination unit 2141 determines that operation of the identity determination unit 212 is unnecessary until the user determined to be the identity removes the wearable device 2. The control unit 214 controls the identity determination unit 212 not to operate until the user determined to be the identity removes the wearable device 2.

[0048] If it is detected that the user has removed the wearable device 2 (step S23: Yes), the process may proceed to step S21. That is, the operation necessity determination unit 2141 may determine whether the user has worn the wearable device 2 based on the detection result of the detection unit 213. If it is detected that the user has worn the wearable device 2 again (step S21: Yes), the process may proceed to step S22 again. That is, the control unit 214 may control the identity determination unit 212 to operate based on the detection result by the detection unit 213. In this way, the control unit 214 controls the operation of the identity determination unit 212 based on the detection result by the detection unit 213. [2-3: Modification]

[0049] The identity determination unit 212 may not have the matching unit 2121. In this case, the identity determination unit 212 may be configured to be able to communicate with a device that performs identity determination other than the wearable device 2 via the communication device 23. In other words, the identity determination of the user may be performed by a device other than the wearable device 2.

[0050] In this case, as shown in Fig. 7, the identity determination unit 212', which is a modified example of the identity determination unit 212, may have a matching result acquisition unit 2122 instead of the matching unit 2121. The matching result acquisition unit 2122 acquires the result of matching between an iris image and a registered image performed by a device different from the wearable device 2. The matching result acquired by the matching result acquisition unit 2122 may be equivalent to the result of matching achieved by the matching unit 2121. The identity determination unit 212' may determine whether the user is the identity of the user based on the result of matching between an iris image and a registered image performed by a device different from the wearable device 2. [2-4: Technical Effects]

[0051] The wearable device 2 according to the present disclosure limits identity determination until the device is removed from the user, thereby reducing unnecessary determinations and reducing the processing load. By limiting identity determination, it is possible to reduce the amount of light used to capture eye images for identity determination, thereby reducing the burden on the device and the user. [3: Third Embodiment]

[0052] A third embodiment relating to a wearable device, an information processing method, and a recording medium will be described with reference to FIG. 8 . Hereinafter, the third embodiment relating to a wearable device, an information processing method, and a recording medium will be described using a wearable device 3. Note that, for the third embodiment, descriptions that overlap with the descriptions of the first and second embodiments will be omitted as appropriate. Note that, in the drawings, parts common to the first and second embodiments are designated by the same reference numerals.

[0053] 8 , the arithmetic unit 21 included in the wearable device 3 may include, as logically realized functional blocks or as physically realized processing circuits, an image acquisition unit 211, an identity determination unit 212, a detection unit 213, and a control unit 314, as well as a light source control unit 315. The light source control unit 315 controls the light emitted by the light source 28. The light source control unit 315 may include a first control unit 3151. The first control unit 3151 may control the light source 28 so that light appropriate for capturing an iris image is emitted.

[0054] When it is detected that the user is wearing the wearable device 3, the action necessity determination unit 3141 determines that action by the identity determination unit 212 is required. The action necessity determination unit 3141 may determine that action by the first control unit 3151 is required, along with action by the identity determination unit 212. The control unit 314 may control the action of the first control unit 3151, along with action by the identity determination unit 212. The first control unit 3151 may control the light emitted by the light source 28 in response to the need for action by the identity determination unit 212.

[0055] The first control unit 3151 controls the light emitted by the light source 28 in accordance with light reaching the user's eyes from sources other than the light source 28. The light reaching the user's eyes from sources other than the light source 28 may include at least one of light emitted by the display 251 and light entering the housing of the wearable device 3 from outside the housing of the wearable device 3. The first control unit 3151 may control the light emitted by the light source 28 in accordance with at least one of the brightness of light reaching the user's eyes from sources other than the light source 28 and the color of light reaching the user's eyes from sources other than the light source 28. In other words, the first control unit 3151 may control the light emitted by the light source 28 in accordance with at least one of the brightness and color of light emitted by the display 251 and at least one of the brightness and color of light entering the housing of the wearable device 3 from outside the housing of the wearable device 3.

[0056] For example, the first control unit 3151 may control the amount of light irradiated by the light source 28 to be reduced as the brightness of light reaching the user's eyes from sources other than the light source 28 increases. Furthermore, for example, when the light source 28 irradiates near-infrared light, the first control unit 3151 may control the amount of light irradiated by the light source 28 to be reduced as the amount of near-infrared light contained in light reaching the user's eyes from sources other than the light source 28 increases. Furthermore, the first control unit 3151 may control the amount of light irradiated by the light source 28 to be reduced as the amount of red light in light reaching the user's eyes from sources other than the light source 28 increases. When the light source 28 irradiates near-infrared light, the first control unit 3151 may control the light irradiated by the light source 28 depending on the brightness of light reaching the user's eyes from sources other than the light source 28 and the color of light reaching the user's eyes from sources other than the light source 28. Alternatively, for example, when the light source 28 irradiates visible light, the first control unit 3151 may control the light irradiated by the light source 28 depending on the brightness of light reaching the user's eyes from sources other than the light source 28.

[0057] When the wearable device 3 includes a plurality of light sources 28, the control by the first control unit 3151 in response to light reaching the user's eyes from sources other than the light sources 28 may be control to increase or decrease the number of light sources 28 that are turned on. Furthermore, the control by the first control unit 3151 in response to light reaching the user's eyes from sources other than the light sources 28 may be control to control the intensity of the light of each light source 28. [Light Emitted by the Display 251]

[0058] The light emitted by the display 251 may be represented by information indicating the brightness and color of an image displayed by the display 251. The light emitted by the display 251 may be represented by image data for displaying an image on the display 251. The first control unit 3151 may control the light emitted by the light source 28 according to at least one of the brightness and color of the image displayed by the display 251.

[0059] For example, the first control unit 3151 may control the light emitted by the light source 28 in accordance with at least one of a representative value of values ​​indicating brightness and a representative value of values ​​indicating a specific color for the entire screen displayed by the display 251. The specific color may be red. For example, the first control unit 3151 may control the light emitted by the light source 28 in accordance with at least one of an average value of values ​​indicating brightness and an average value of values ​​indicating a specific color for the entire screen displayed by the display 251. Furthermore, the first control unit 3151 may control the light emitted by the light source 28 in accordance with at least one of a median value of values ​​indicating brightness and a median value of values ​​indicating a specific color for the entire screen displayed by the display 251. Furthermore, the first control unit 3151 may control the light emitted by the light source 28 in accordance with at least one of a maximum value of values ​​indicating brightness and a maximum value of values ​​indicating a specific color for the entire screen displayed by the display 251. In addition, the first control unit 3151 may control the light emitted by the light source 28 according to at least one of the minimum value indicating the brightness and the minimum value indicating the specific color on the entire screen displayed by the display 251.

[0060] Furthermore, the first control unit 3151 may control the light emitted by the light source 28 in accordance with at least one of a representative value of values ​​indicating brightness and a representative value of values ​​indicating a specific color in a predetermined region on the screen displayed by the display 251. The predetermined region may be a region corresponding to the position of the user's eyes. For example, the first control unit 3151 may control the light emitted by the light source 28 in accordance with at least one of an average value of values ​​indicating brightness and an average value of values ​​indicating a specific color in a predetermined region on the screen displayed by the display 251. Furthermore, the first control unit 3151 may control the light emitted by the light source 28 in accordance with at least one of a median value of values ​​indicating brightness and a median value of values ​​indicating a specific color in a predetermined region on the screen displayed by the display 251. Furthermore, the first control unit 3151 may control the light emitted by the light source 28 in accordance with at least one of a maximum value of values ​​indicating brightness and a maximum value of values ​​indicating a specific color in a predetermined region on the screen displayed by the display 251. Furthermore, the first control unit 3151 may control the light emitted by the light source 28 in accordance with at least one of the minimum value indicating the brightness and the minimum value indicating the specific color in a predetermined area on the screen displayed by the display 251. [Light entering the housing of the wearable device 3 from outside the housing]

[0061] The first control unit 3151 may acquire information indicating light entering the housing of the wearable device 3 from outside the housing of the wearable device 3 from the camera 27. In this case, the light entering the housing of the wearable device 3 from outside the housing of the wearable device 3 may be represented by image data indicating an image generated by the camera 27. The image data may include at least one of information indicating the brightness of an area including the user's eyes and information indicating the color of light irradiating the area including the user's eyes.

[0062] For example, the first control unit 3151 may control the light emitted by the light source 28 in accordance with at least one of a representative value of the brightness values ​​and a representative value of the specific color values ​​for the entire image generated by the camera 27. The specific color may be red. For example, the first control unit 3151 may control the light emitted by the light source 28 in accordance with at least one of an average value of the brightness values ​​and an average value of the specific color values ​​for the entire image generated by the camera 27. Furthermore, the first control unit 3151 may control the light emitted by the light source 28 in accordance with at least one of a median value of the brightness values ​​and a median value of the specific color values ​​for the entire image generated by the camera 27. Furthermore, the first control unit 3151 may control the light emitted by the light source 28 in accordance with at least one of a maximum value of the brightness values ​​and a maximum value of the specific color values ​​for the entire image generated by the camera 27. In addition, the first control unit 3151 may control the light emitted by the light source 28 according to at least one of the minimum value indicating the brightness and the minimum value indicating the specific color in the entire image generated by the camera 27.

[0063] Furthermore, the first control unit 3151 may control the light emitted by the light source 28 in accordance with at least one of a representative value of values ​​indicating brightness and a representative value of values ​​indicating a specific color in a predetermined region of the image generated by the camera 27. The predetermined region may be a region corresponding to the position of the user's eyes. For example, the first control unit 3151 may control the light emitted by the light source 28 in accordance with at least one of an average value of values ​​indicating brightness and an average value of values ​​indicating a specific color in a predetermined region of the image generated by the camera 27. Furthermore, the first control unit 3151 may control the light emitted by the light source 28 in accordance with at least one of a median value of values ​​indicating brightness and a median value of values ​​indicating a specific color in a predetermined region of the image generated by the camera 27. Furthermore, the first control unit 3151 may control the light emitted by the light source 28 in accordance with at least one of a maximum value of values ​​indicating brightness and a maximum value of values ​​indicating a specific color in a predetermined region of the image generated by the camera 27. In addition, the first control unit 3151 may control the light emitted by the light source 28 according to at least one of the minimum value indicating the brightness and the minimum value indicating the specific color in a specified area in the image generated by the camera 27.

[0064] That is, the first control unit 3151 may control the light emitted by the light source 28 in accordance with at least one of the brightness and color of the screen displayed by the display 251 and the brightness and color of the image generated by the camera 27. [Control Based on the Type of Wearable Device 3]

[0065] The first control unit 3151 may operate differently depending on the degree of contact between the wearable device 3 and the head. For example, if the wearable device 3 is an immersive head-mounted display, the first control unit 3151 may control the light emitted by the light source 28 mainly in accordance with the light emitted by the display 251. In other words, in the case of a wearable device 3 that comes into close contact with the head when worn, the first control unit 3151 may control the light emitted by the light source 28 in accordance with the light emitted by the display 251 rather than the light that enters the housing of the wearable device 3 from outside the housing of the wearable device 3. In the case of a wearable device 3 that comes into close contact with the head when worn, the first control unit 3151 may control the weight assigned to the light emitted by the display 251 so that it is greater than the weight assigned to the light that enters the housing of the wearable device 3 from outside the housing of the wearable device 3.

[0066] Furthermore, when the wearable device 3 is a see-through head-mounted display, the first control unit 3151 may control the light emitted by the light source 28 mainly in response to light that enters the housing of the wearable device 3 from outside the housing of the wearable device 3. When the wearable device 3 is a see-through head-mounted display, the first control unit 3151 may, for example, change the light emitted by the light source 28 depending on whether the surroundings are bright or dark. That is, when the wearable device 3 is of a type that does not come into close contact with the head when worn, the first control unit 3151 may control the light emitted by the light source 28 in response to light that enters the housing of the wearable device 3 from outside the housing of the wearable device 3 rather than the light emitted by the display 251. When the wearable device 3 is of a type that does not come into close contact with the head when worn, the first control unit 3151 may control the weight assigned to light that enters the housing of the wearable device 3 from outside the housing of the wearable device 3 so that it is greater than the weight assigned to light emitted by the display 251. In other words, the first control unit 3151 may change the weight assigned to the light emitted by the display 251 and the weight assigned to the light entering the housing of the wearable device 3 from outside the housing of the wearable device 3, depending on the type of wearable device 3, and control the light emitted by the light source 28.

[0067] Alternatively, the first control unit 3151 may vary its operation depending on the difference between the brightness of the screen displayed by the display 251 and the brightness of the image generated by the camera 27. The first control unit 3151 may also vary its operation depending on the difference between the color of the screen displayed by the display 251 and the color of the image generated by the camera 27. For example, when at least one of the difference in brightness and the difference in color is small, the first control unit 3151 may control the light emitted by the light source 28 mainly in accordance with the light emitted by the display 251. When at least one of the difference in brightness and the difference in color is large, the first control unit 3151 may control the light emitted by the light source 28 mainly in accordance with the light entering the housing of the wearable device 3 from outside the housing of the wearable device 3. [Technical Effects]

[0068] The wearable device 3 according to this disclosure controls the light emitted by the light source in accordance with light reaching the user's iris from sources other than the light source, and captures an image of the iris, thereby enabling the acquisition of an iris image suitable for identity verification. This improves the accuracy of identity verification. Light reaching the user's iris from sources other than the light source includes light emitted by the display and light entering the housing of the wearable device from outside the housing. The wearable device 3 controls the light emitted by the light source by changing the weight assigned to the light emitted by the display and the weight assigned to the light entering the housing of the wearable device from outside the housing, depending on the type of wearable device, thereby enabling control according to the type of wearable device. [4: Fourth Embodiment]

[0069] A fourth embodiment relating to a wearable device, an information processing method, and a recording medium will be described with reference to Fig. 9. Hereinafter, the fourth embodiment relating to a wearable device, an information processing method, and a recording medium will be described using a wearable device 4. Note that, for the fourth embodiment, descriptions that overlap with the descriptions of the first to third embodiments will be omitted as appropriate. Note that, in the drawings, parts common to the first to third embodiments are designated by the same reference numerals.

[0070] 9 , the arithmetic unit 21 included in the wearable device 4 may include, as logically realized functional blocks or as physically realized processing circuits, an image acquisition unit 211, an identity determination unit 212, a detection unit 213, a control unit 314, and a light source control unit 415, as well as an eye tracking unit 416. The light source control unit 415 may include, in addition to a first control unit 3151, a second control unit 4152.

[0071] The gaze tracking unit 416 performs gaze tracking, tracking the user's gaze toward the display 251, using an eye image including the user's eyes. Alternatively, the gaze tracking unit 416 may measure the user's eye movement. The following method is an example of a gaze tracking method. It is assumed that the user's eyes are illuminated by a point light source emitting near-infrared light. The gaze tracking unit 416 may estimate and track the gaze based on the relative positional relationship between the position of near-infrared light reflected by the cornea (i.e., Purkinje image) included in the eye image and the position of the pupil included in the eye image. Alternatively, the gaze tracking unit 416 may estimate and track the gaze based on the relative positional relationship between the position of the inner corner or outer corner of the eye included in the eye image and the position of the pupil or iris included in the eye image. Alternatively, the gaze tracking unit 416 may estimate and track the gaze using a machine learning model that outputs the gaze direction when an eye image is input. The gaze tracking method is not limited to the above-described method, and various other methods may be applied.

[0072] The eye image used by the gaze tracking unit 416 may be an eye image including the user's eye that is irradiated with light by the light source 28 and captured by the camera 27. The second control unit 4152 may control the light source 28 so that light appropriate for capturing the eye image used by the gaze tracking unit 416 is irradiated.

[0073] The first control unit 3151 may control the light emitted by the light source 28 when it is detected that the user has put on the wearable device 3, while the second control unit 4152 may control the light emitted by the light source 28 until it is detected that the user has removed the wearable device 3. In other words, the first control unit 3151 and the second control unit 4152 may have different operation timings. The first control unit 3151 and the second control unit 4152 may perform similar operations except for the operation timings. Alternatively, the first control unit 3151 and the second control unit 4152 may perform different operations except for the operation timings. For example, the light emitted under the control of the second control unit 4152 may have fewer near-infrared components than the light emitted under the control of the first control unit 3151.

[0074] Similar to the first control unit 3151, the second control unit 4152 may control the light emitted by the light source 28 in accordance with at least one of the brightness of light reaching the user's eyes from sources other than the light source 28 and the color of light reaching the user's eyes from sources other than the light source 28. In other words, the second control unit 4152 may control the light emitted by the light source 28 in accordance with at least one of the brightness and color of light emitted by the display 251 and the brightness and color of light entering the housing of the wearable device 3 from outside the housing of the wearable device 3.

[0075] The detection unit 413 may detect whether the user is wearing the wearable device 3 based on the results of eye gaze tracking by the eye gaze tracking unit 416, in addition to or instead of the state of contact between the wearable device 3 and the user and the movement of the user's head. If the user removes the wearable device 3, the eye gaze tracking unit 416 will no longer be able to track the user's eye gaze. Therefore, the detection unit 413 may detect that the user has removed the wearable device 3 in response to the eye gaze tracking unit 416 being unable to track the user's eye gaze. [Technical Effect]

[0076] When the user removes the wearable device 3, the gaze tracking unit 416 is no longer able to track the user's gaze. The wearable device 4 according to this disclosure can detect that the user has removed the wearable device 3 in response to the gaze tracking unit 416 being no longer able to track the user's gaze. Furthermore, the wearable device 4 captures an image of the eyes by controlling the light emitted by the light source in response to light reaching the user's iris from sources other than the light source, thereby obtaining an eye image suitable for gaze tracking. This improves the accuracy of gaze tracking. [5: Fifth Embodiment]

[0077] A fifth embodiment relating to a wearable device, an information processing method, and a recording medium will be described with reference to Figures 10 and 11. Below, the fifth embodiment relating to a wearable device, an information processing method, and a recording medium will be described using a wearable device 5. Note that, for the fifth embodiment, descriptions that overlap with the descriptions of the first to fourth embodiments will be omitted as appropriate. Note that, in the drawings, parts common to the first to fourth embodiments are indicated by the same reference numerals.

[0078] 10 , the wearable device 5 may include a rear camera 50 and a rear light source 51 instead of the camera 27 and the light source 28. As shown in Fig. 10 , the computing device 21 included in the wearable device 5 may include, as logically realized functional blocks or as physically realized processing circuits, an image acquisition unit 511, an identity determination unit 212, a detection unit 213, a control unit 314, a light source control unit 515, and an eye tracking unit 416.

[0079] As shown in FIG. 11 , the rear camera 50 and the rear light source 51 are provided on the side of the display 251 opposite the side facing the user. That is, the rear camera 50 and the rear light source 51 are provided facing the user. The rear camera 50 may include a rear camera 50L arranged facing the user's left eye to capture the user's left eye, and a rear camera 50R arranged facing the user's right eye to capture the user's right eye. By providing the rear camera 50 facing the user's eyes, it is possible to prevent an angle from occurring between the optical axis of the rear camera 50 and the user's line of sight. That is, the rear camera 50 can capture the user's eyes from the front. Furthermore, by providing the rear camera 50 facing the user's eyes, it is possible to prevent, for example, eyelashes from appearing in the eye image. This improves the accuracy of identity determination using iris images and gaze tracking using eye images.

[0080] The backlight source 51 irradiates light at least onto the iris of the user. The backlight source 51 may emit near-infrared light. Alternatively, the backlight source 51 may emit visible light. The backlight source 51 may include backlight source 51#1 and backlight source 51#2 arranged around the rear camera 50L to illuminate the left eye of the user, and backlight source 51#3 and backlight source 51#4 arranged around the rear camera 50R to illuminate the right eye of the user. The number of backlight sources 51 is not limited to four, and may be five or more, or three or less.

[0081] The rear camera 50 may be a camera capable of capturing near-infrared light. In other words, the rear camera 50 may be a camera equipped with an image sensor sensitive to the near-infrared wavelength range. The rear camera 50 may also be a camera capable of capturing visible light. The rear camera 50 captures an eye image including the user's eye illuminated by light from the rear light source 51.

[0082] The image acquisition unit 511 may acquire an eye image from the rear camera 50. The light source control unit 515 may control the light emitted by the rear light source 51. [Modification]

[0083] 12, the wearable device 5′ may include a rear camera 50 and a rear light source 51 in addition to the camera 27 and the light source 28. In this case, for example, the camera 27 and the light source 28 may be used for eye tracking. Also, the rear camera 50 and the rear light source 51 may be used for iris authentication.

[0084] The image acquisition unit 511 may acquire an eye image from at least one of the camera 27 and the rear camera 50. The light source control unit 515 may control light emitted by at least one of the light source 28 and the rear light source 51.

[0085] In addition, when the wearable device 5 is an immersive head-mounted display and is connected to a device such as a smartphone, the connected device such as a smartphone may be provided with a light source and a camera on the side opposite to the side of the display facing the user. [Technical effect]

[0086] In the wearable device 5 according to this disclosure, the camera that captures the user's eyes is positioned facing the user's eyes, so that no angle occurs between the camera's optical axis and the user's line of sight. In other words, the wearable device 5 can acquire an eye image that captures the user's eyes from the front. Furthermore, by positioning the camera facing the user's eyes, it is possible to prevent, for example, eyelashes from appearing in the eye image. This allows the wearable device 5 to improve the accuracy of identity determination using iris images and gaze tracking using eye images. [6: Note]

[0087] The above-described embodiments can be further described as, but are not limited to, the following supplementary notes: [Supplementary Note 1] A wearable device comprising: imaging means for capturing an image of the iris of a subject wearing a wearable device and generating an iris image including the iris; identity determination means for determining whether the subject is the principal using the iris image; detection means for detecting whether the subject is wearing the wearable device; and control means for controlling the identity determination means not to operate until the subject determined to be the principal removes the wearable device based on the detection result. [Supplementary Note 2] The wearable device according to Supplementary Note 1, wherein the control means controls the operation of the identity determination means, and has operation necessity determination means for determining whether operation of the identity determination means is necessary based on the detection result, and the operation necessity determination means determines that operation of the identity determination means is unnecessary until the subject determined to be the principal removes the wearable device. [Supplementary Note 3] The wearable device according to Supplementary Note 2, wherein the action necessity determination means determines that action by the identity determination means is necessary when it is detected that the subject is wearing the wearable device. [Supplementary Note 4] The wearable device according to Supplementary Note 1, wherein the identity determination means determines whether a matching score obtained by matching the iris image with a registered iris image exceeds a threshold. [Supplementary Note 5] The wearable device according to Supplementary Note 1, comprising: display means for displaying information visible to the subject wearing the wearable device; a light source for irradiating light onto at least the iris of the subject; and light source control means for controlling the light irradiated by the light source in accordance with light reaching the iris of the subject from sources other than the light source, wherein the imaging means images the eye of the subject illuminated with light by the light source.[Supplementary Note 6] The wearable device according to Supplementary Note 5, wherein light reaching the iris of the subject from sources other than the light source includes at least one of light emitted by the display means and light entering the housing of the wearable device from outside the housing, and the light source control means controls the light emitted by the light source by changing a weight assigned to the light emitted by the display means and a weight assigned to the light entering the housing from outside the housing of the wearable device according to the type of the wearable device. [Supplementary Note 7] The wearable device according to Supplementary Note 5, further comprising: gaze tracking means for tracking the gaze of the subject relative to the display means using an eye image including the eye generated by capturing an image of the subject's eye, and the detection means for detecting whether the subject is wearing the wearable device based on at least one of a state of contact between the wearable device and the subject, movement of the subject's head, and a tracking result of the subject's gaze. [Supplementary Note 8] The wearable device according to Supplementary Note 5, wherein the imaging means is provided on the side of the display means opposite to the side facing the subject. [Supplementary Note 9] An information processing method executed by a wearable device, comprising: capturing an image of the iris of a subject wearing the wearable device, generating an iris image including the iris, using the iris image to determine whether the subject is the person in question, detecting whether the subject is wearing the wearable device, and controlling not to perform the determination operation until the subject determined to be the person in question removes the wearable device based on the detection result. [Supplementary Note 10] A recording medium having recorded thereon a computer program for causing a computer to execute an information processing method: capturing an image of the iris of a subject wearing a wearable device, generating an iris image including the iris, using the iris image to determine whether the subject is the person in question, detecting whether the subject is wearing the wearable device, and controlling not to perform the determination operation until the subject determined to be the person in question removes the wearable device based on the detection result. [Supplementary Note 11] The wearable device according to Supplementary Note 5, wherein the illumination means is provided on the side of the display means opposite to the side facing the subject.

[0088] Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above-described embodiments. Various modifications that would be understood by a person skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. Furthermore, each embodiment can be combined with other embodiments as appropriate. Furthermore, to the extent permitted by law, the disclosures of all documents (e.g., published patent applications) cited in the above disclosure are incorporated by reference as part of the description of this disclosure.

[0089] To the extent permitted by law, this application claims priority to Japanese Patent Application No. 2024-066706, filed April 17, 2024, the disclosure of which is incorporated herein in its entirety by reference.

[0090] 1, 2, 3, 4, 5 Wearable device 11 Imaging device 12, 212 Person determination unit 13, 213, 413 Detection unit 14, 214, 314 Control unit 211, 511 Image acquisition unit 2121 Matching unit 2122 Matching result acquisition unit 2141, 3141 Action necessity determination unit 251 Display 27 Camera 28 Light source 315, 415, 515 Light source control unit 3151 First control unit 4152 Second control unit 416 Gaze tracking unit 50 Rear camera 51 Rear light source

Claims

1. A wearable device comprising: an imaging means for capturing an image of the iris of a subject wearing a wearable device and generating an iris image including said iris; an identity determination means for determining whether said subject is the subject using said iris image; a detection means for detecting whether said subject is wearing said wearable device; and a control means for controlling said identity determination means not to operate until said subject, who has been determined to be the subject based on the detection result, removes said wearable device.

2. The wearable device of claim 1, wherein the control means controls the operation of the identity determination means and has an operation necessity determination means that determines whether or not the identity determination means needs to operate based on the detection result, and the operation necessity determination means determines that operation of the identity determination means is unnecessary until the subject determined to be the identity removes the wearable device.

3. The wearable device according to claim 2, wherein the action necessity determination means determines that action by the identity determination means is necessary when it is detected that the subject is wearing the wearable device.

4. The wearable device according to claim 1, wherein the identity determination means determines whether a matching score obtained by matching the iris image with a registered iris image exceeds a threshold value.

5. A wearable device as described in claim 1, comprising: a display means for displaying information visible to the subject wearing the wearable device; a light source for irradiating light onto at least the iris of the subject; and a light source control means for controlling the light irradiated by the light source in accordance with light reaching the iris of the subject from sources other than the light source, wherein the imaging means images the subject's eyes illuminated by light from the light source.

6. The wearable device of claim 5, wherein the light reaching the iris of the subject from sources other than the light source includes at least one of light emitted by the display means and light entering the housing of the wearable device from outside the housing, and the light source control means controls the light emitted by the light source by changing the weight assigned to the light emitted by the display means and the weight assigned to the light entering the housing of the wearable device from outside the housing, depending on the type of the wearable device.

7. A wearable device as described in claim 5, further comprising: an eye tracking means for tracking the subject's gaze relative to the display means using an eye image including the eye generated by imaging the subject's eye; and the detection means for detecting whether the subject is wearing the wearable device based on at least one of the state of contact between the wearable device and the subject, the movement of the subject's head, and the tracking results of the subject's gaze.

8. The wearable device according to claim 5, wherein the imaging means is provided on the side of the display means opposite to the side facing the target.

9. An information processing method executed by a wearable device, comprising: capturing an image of the iris of a subject wearing the wearable device; generating an iris image including the iris; using the iris image to determine whether the subject is the person in question; detecting whether the subject is wearing the wearable device; and controlling the device so that the determination operation is not performed until the subject determined to be the person in question removes the wearable device based on the detection result.

10. A recording medium having recorded thereon a computer program for causing a computer to execute an information processing method, which comprises capturing an image of the iris of a subject wearing a wearable device, generating an iris image including said iris, using said iris image to determine whether said subject is the person in question, detecting whether said subject is wearing said wearable device, and controlling said determination operation not to be performed until said subject, who has been determined to be the person in question based on said detection result, removes said wearable device.

Images