Information processing device, spectacle type device, program, and information processing method

Abstract

To provide an information processing device, a spectacle type device, a program, and an information processing method.SOLUTION: In a system including a spectacle type device and an information processing device, an information processing device 200 comprises: a storage unit which stores biometric information for each of user's left and right palms; an authentication request acquisition unit which acquires an authentication request including captured data taken by a camera of the eyeglass-type device, which captured the user's left and right palms; an authentication-related information acquisition unit which, using the captured data included in the authentication request, acquires authentication-related information including biometric information for each of the left and right palms and positional relationship information indicating the positional relationship between the left and right palms; and an authentication unit which determines that authentication is successful when the biometric information for each of the left and right palms included in the authentication-related information matches the respective biometric information stored in the storage unit, and when the positional relationship information between the left and right palms indicated by the positional relationship information included in the authentication-related information satisfies the positional relationship when the camera captures the captured data in a state in which the user is wearing the spectacle type device.SELECTED DRAWING: Figure 10

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, a glasses-type device, a program, and an information processing method.

Background Art

[0002] Patent Document 1 describes a personal information leakage prevention system that prevents leakage of personal information of others. [Prior Art Document] [Patent Document] [Patent Document 1] Japanese Patent Application Laid-Open No. 2015-045960

Summary of the Invention

Means for Solving the Problems

[0003] According to an embodiment of the present invention, an information processing apparatus is provided. The information processing apparatus may include a storage unit that stores biometric information of each of the user's right palm and left palm. The information processing apparatus may include an authentication request acquisition unit that acquires an authentication request including imaging data obtained by imaging the right palm and the left palm by a camera mounted on the glasses-type device. The information processing apparatus may include an authentication-related information acquisition unit that acquires authentication-related information including biometric information of each of the right palm and the left palm and position relationship information indicating the position relationship between the right palm and the left palm, using the imaging data included in the authentication request. The information processing apparatus may include an authentication unit that determines authentication as successful when the biometric information of each of the right palm and the left palm included in the authentication-related information matches the biometric information of each of the right palm and the left palm of the user stored in the storage unit, and the position relationship between the right palm and the left palm indicated by the position relationship information included in the authentication-related information satisfies the position relationship when the camera captures the imaging data while the user wears the glasses-type device.

[0004] In the information processing apparatus, the authentication request acquisition unit may acquire the authentication request including the imaging data obtained by further imaging the right wrist and the left wrist. The authentication-related information acquisition unit may acquire the authentication-related information including the positional relationship information further indicating the positional relationship between the right wrist and the left wrist by using the imaging data included in the authentication request. When the biometric information of each of the right palm and the left palm included in the authentication-related information matches the biometric information of each of the right palm and the left palm of the user stored in the storage unit, and the positional relationship between the right palm and the left palm indicated by the positional relationship information included in the authentication-related information satisfies the positional relationship when the camera captured the imaging data with the user wearing the glasses-type device, and the positional relationship between the right wrist and the left wrist indicated by the positional relationship information included in the authentication-related information satisfies the positional relationship when the camera captured the imaging data with the user wearing the glasses-type device, the authentication may be determined to be successful.

[0005] Any of the information processing apparatuses may further include an instruction unit that instructs an operation of randomly specifying the shapes of the right hand and the left hand to specified shapes. After the instruction unit instructs the operation, the authentication-related information acquisition unit may further acquire imaging data captured by the camera mounted on the glasses-type device. Based on the imaging data acquired by the authentication-related information acquisition unit, the authentication unit determines whether the operation has been executed within a predetermined period from the timing instructed by the instruction unit. When it is determined that the operation has been executed within the predetermined period from the timing, authentication using the biometric information and the positional relationship information included in the authentication-related information may be started.

[0006] Any of the information processing apparatuses may further include an instruction unit that instructs an operation of drawing a randomly specified figure. The authentication-related information acquisition unit may further acquire imaging data captured by the camera mounted on the glasses-type device after the instruction unit instructs the operation. The authentication unit determines whether the imaging data acquired by the authentication-related information acquisition unit is imaging data of the back of the hand or imaging data of the palm. When it is determined that the imaging data acquired by the authentication-related information acquisition unit is imaging data of the back of the hand, it is further determined whether the operation has been executed within a predetermined period from the timing instructed by the instruction unit based on the imaging data acquired by the authentication-related information acquisition unit. When it is determined that the operation has been executed within the predetermined period from the timing, authentication using the biometric information and the positional relationship information included in the authentication-related information may be started.

[0007] In any of the information processing apparatuses, the storage unit may further store biometric information of the user's glabella. The authentication request acquisition unit may acquire the authentication request further including the biometric information of the glabella acquired by the biometric information acquisition unit mounted on the glasses-type device. The authentication-related information acquisition unit may acquire the authentication-related information further including the biometric information of the glabella included in the authentication request. The authentication unit determines that the authentication is successful when the biometric information of each of the right palm and the left palm included in the authentication-related information matches the biometric information of each of the right palm and the left palm of the user stored in the storage unit, the biometric information of the glabella included in the authentication-related information matches the biometric information of the glabella of the user stored in the storage unit, and the positional relationship of the right palm and the left palm indicated by the positional relationship information included in the authentication-related information satisfies the positional relationship when the camera captures the imaging data in a state where the user wears the glasses-type device.

[0008] Any of the above information processing apparatuses may further include an instruction unit that instructs an operation of inputting a password. The storage unit may further store the password of the user. The authentication-related information acquisition unit may further acquire the password received by the input reception function provided in the glasses-type device. The authentication unit determines that authentication is successful when the biometric information of each of the right palm and the left palm included in the authentication-related information matches the biometric information of each of the right palm and the left palm of the user stored in the storage unit, the password acquired by the authentication-related information acquisition unit matches the password of the user stored in the storage unit, and the positional relationship of the right palm and the left palm indicated by the positional relationship information included in the authentication-related information satisfies the positional relationship when the camera captures the imaging data while the user is wearing the glasses-type device.

[0009] In any of the above information processing apparatuses, the authentication unit determines whether the authentication-related information acquisition unit has acquired the password within a predetermined period from the timing instructed by the instruction unit. When it is determined that the authentication-related information acquisition unit has acquired the password within the predetermined period from the timing, authentication using the biometric information and the positional relationship information included in the authentication-related information and the password may be started.

[0010] In any of the above information processing apparatuses, the storage unit may further store biometric information of at least one of the back of the user's right hand and the back of the left hand. After the instruction unit instructs the operation, the authentication-related information acquisition unit may further acquire imaging data obtained by the camera mounted on the glasses-type device imaging at least one of the back of the right hand and the back of the left hand, and use the imaging data obtained by imaging at least one of the back of the right hand and the back of the left hand to further acquire biometric information of at least one of the back of the right hand and the back of the left hand. The authentication unit determines that authentication is successful when the biometric information of each of the palm of the right hand and the palm of the left hand included in the authentication-related information matches the biometric information of each of the palm of the right hand and the palm of the left hand of the user stored in the storage unit, the password acquired by the authentication-related information acquisition unit matches the password of the user stored in the storage unit, the biometric information of at least one of the back of the right hand and the back of the left hand acquired by the authentication-related information acquisition unit matches the biometric information of at least one of the back of the right hand and the back of the left hand of the user stored in the storage unit, and the positional relationship between the palm of the right hand and the palm of the left hand indicated by the positional relationship information included in the authentication-related information satisfies the positional relationship when the camera captures the imaging data in a state where the user wears the glasses-type device.

[0011] Any of the above information processing apparatuses may further include a control unit that controls the glasses-type device to notify that authentication is in progress when the authentication request acquisition unit acquires the authentication request.

[0012] According to an embodiment of the present invention, there is provided a glasses-type device equipped with any of the above information processing apparatuses.

[0013] According to an embodiment of the present invention, there is provided a program that causes a computer to function as any of the above information processing apparatuses when executed by the computer.

[0014] According to an embodiment of the present invention, an information processing method executed by a computer is provided. The information processing method may include an authentication request acquisition step of acquiring an authentication request including imaging data obtained by a camera mounted on a glasses-type device and imaging the right palm and the left palm. The information processing method may include an authentication-related information acquisition step of using the imaging data included in the authentication request to acquire authentication-related information including biometric information of each of the right palm and the left palm and position relationship information indicating the position relationship between the right palm and the left palm. The information processing method may include an authentication step of determining that authentication is successful when the biometric information of each of the right palm and the left palm included in the authentication-related information matches the biometric information of each of the right palm and the left palm of the user stored in a storage unit provided in the computer, and the position relationship between the right palm and the left palm indicated by the position relationship information included in the authentication-related information satisfies the position relationship when the camera captures the imaging data in a state where the user wears the glasses-type device.

[0015] Note that the above summary of the invention does not list all the necessary features of the present invention. Also, sub-combinations of these feature groups can also be inventions.

Brief Description of the Drawings

[0016]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Embodiments for Carrying Out the Invention

[0017] With the widespread use of AR (Augmented Reality) glasses, the possibility of unauthorized acquisition of biometric information such as fingerprint information and vein information by a third party has increased. For example, the third party asks to see the palm without telling that security authentication is in progress, and images the palm with the camera mounted on the AR glasses to illegally acquire biometric information. The system according to the present embodiment adopts a mechanism that, for example, acquires biometric information of both palms and the positional relationship between both palms from imaging data obtained by simultaneously imaging both palms using a camera mounted on the AR glasses, and executes security authentication based on the biometric information of both palms and the positional relationship between both palms.

[0018] Hereinafter, the present invention will be described through embodiments of the invention. However, the following embodiments do not limit the invention according to the claims. Also, not all combinations of features described in the embodiments are essential for the solution means of the invention.

[0019] FIG. 1 schematically shows an example of the system 10. The system 10 may include a glasses-type device 100 and an information processing apparatus 200.

[0020] The glasses-type device 100 may be any device as long as it is a glasses-type device having a wireless communication function. For example, the glasses-type device 100 is smart glasses.

[0021] The glasses-type device 100 may further have a display function of displaying content on a display unit. For example, the glasses-type device 100 is AR glasses.

[0022] The content may be in any data format. For example, the content is text. For example, the content is an illustration. For example, the content is a still image. Also, for example, the content is a video. For example, the content is 3D CG (Computer Graphics) data. The content may comprehensively include these.

[0023] The glasses-type device 100 may be a device capable of giving a user 102 wearing the glasses-type device 100 a feeling that the content is arranged in the real space by displaying the content on a transparent or translucent glass. That is, the glasses-type device 100 may be a so-called transmissive (see-through type) device. Note that the glasses-type device 100 may be a video pass-through type device. In this case, the glasses-type device 100 may display a captured image of a range corresponding to the visual field of the user 102 on a non-transmissive display and superimpose the content.

[0024] The information processing device 200 executes various processes. For example, the information processing device 200 executes authentication processing. For example, the information processing device 200 receives an authentication request from the glasses-type device 100 via the network 20, and determines whether the received authentication request is successful or not. The authentication request includes, for example, imaging data captured by a camera mounted on the glasses-type device 100 of the right palm and the left palm. The authentication request includes, for example, imaging data captured by a camera mounted on the glasses-type device 100 of the right palm and the left palm, and the right wrist and the left wrist. The imaging data is, for example, still image data. The imaging data may be moving image data. A specific method for the information processing device 200 to determine whether the authentication is successful or not will be described later.

[0025] The network 20 may include a cloud. The network 20 may include a mobile communication network. The mobile communication network may conform to any of communication methods such as 3G (3rd Generation) communication method, LTE (Long Term Evolution) communication method, 5G (5th Generation) communication method, and 6G (6th Generation) communication method and later. The network 20 may conform to a short-range wireless communication method such as Wi-Fi (registered trademark) communication method, Bluetooth (registered trademark) communication method, Zigbee (registered trademark) communication method, etc. The network 20 may include a wired connection.

[0026] For example, the information processing device 200 executes control processing for controlling various functions of the glasses-type device 100. For example, the information processing device 200 generates control information for controlling various functions of the glasses-type device 100, and controls various functions of the glasses-type device 100 by transmitting the generated control information to the glasses-type device 100 via the network 20.

[0027] For example, the information processing device 200 controls the output of the glasses-type device 100. For example, the information processing device 200 controls the audio output by a speaker mounted on the glasses-type device 100. For example, the information processing device 200 controls the display output to a display unit mounted on the glasses-type device 100.

[0028] Furthermore, various processes executed by the information processing device 200 may be executed by the glasses-type device 100. The glasses-type device 100 may be equipped with the information processing device 200, and the glasses-type device 100 and the information processing device 200 may be integrated.

[0029] FIG. 2 schematically shows an example of the configuration of the glasses-type device 100. The glasses-type device 100 may include a frame 110 having a rim 112, a bridge 114, and temples 118.

[0030] The glasses-type device 100 includes, for example, a camera 160. FIG. 2 illustrates an example in the case where the glasses-type device 100 includes one camera 160. The glasses-type device 100 may include a plurality of cameras 160.

[0031] The camera 160 is, for example, a visible light camera. The camera 160 may be an infrared camera.

[0032] The imaging range of the camera 160 is, for example, a range corresponding to the field of view of the user 102 wearing the glasses-type device 100. The imaging range of the camera 160 may be a range wider than the field of view of the user 102, or may be substantially the same range as the field of view of the user 102.

[0033] The arrangement of the camera 160 in FIG. 2 is an example. The camera 160 may be arranged at other positions of the frame 110. For example, the camera 160 may be arranged at an arbitrary position inside the frame 110. The camera 160 may be arranged at an arbitrary position outside the frame 110.

[0034] The glasses-type device 100 includes, for example, a sensor 180. FIG. 2 illustrates an example in the case where the glasses-type device 100 includes one sensor 180. The glasses-type device 100 may include a plurality of sensors 180.

[0035] Sensor 180 acquires biological information. Sensor 180 acquires, for example, biological information between the eyebrows. The biological information between the eyebrows includes, for example, vein information between the eyebrows. Sensor 180 may be an example of a biological information acquisition unit mounted on the glasses-type device 100. Biological information of the eyes may also be acquired. The biological information of the eyes includes, for example, iris information of the eyes.

[0036] The authentication request may include biological information between the eyebrows. The authentication request may include biological information of the eyes.

[0037] The arrangement of Sensor 180 in FIG. 2 is an example. Sensor 180 may be arranged at other positions of the frame 110. For example, Sensor 180 is arranged at an arbitrary position inside the frame 110. Sensor 180 may be arranged at an arbitrary position outside the frame 110.

[0038] The glasses-type device 100 includes, for example, a control device 150. The control device 150 controls various functions of the glasses-type device 100.

[0039] The control device 150 controls, for example, the input reception function of the glasses-type device 100. The glasses-type device 100 may receive various inputs according to the control by the control device 150.

[0040] The glasses-type device 100 receives various inputs through an operation unit arranged at an arbitrary position of the glasses-type device 100. The glasses-type device 100 receives various inputs through an input unit such as a button arranged at an arbitrary position of the frame 110. The glasses-type device 100 may receive various inputs by receiving input information from a communication terminal such as a smartphone, a tablet terminal, or a PC via the network 20.

[0041] The control device 150 controls, for example, the communication function of the glasses-type device 100. The glasses-type device 100 may communicate according to the control by the control device 150.

[0042] The glasses-type device 100 communicates with, for example, the information processing device 200. The glasses-type device 100 may communicate with any other communication terminal.

[0043] The control device 150 controls, for example, the display function to the lens 116. The lens 116 may be an example of a display unit of the glasses-type device 100.

[0044] The lens 116 may be a transparent or translucent display. In this case, the glasses-type device 100 may be a transparent or translucent display-type device. Further, the control device 150 may control the projection function of the glasses-type device 100 that projects a display onto the lens 116. In this case, the glasses-type device 100 may be a projection-type device. The projection function of the glasses-type device 100 may be an example of the display function of the glasses-type device 100.

[0045] The control device 150 may include a battery (not shown). The control device 150 and the battery may be separately arranged at another position of the frame 110.

[0046] The arrangement of the control device 150 in FIG. 2 is an example. The control device 150 may be arranged at other positions of the frame 110. The control device 150 is arranged, for example, at an arbitrary position inside the frame 110. For example, the control device 150 is arranged in the temple 118. As a specific example, the control device 150 may be arranged at the tip of the temple 118, that is, modernly. The control device 150 may be arranged at an arbitrary position outside the frame 110.

[0047] FIG. 3 is an explanatory diagram for explaining an example in which the information processing device 200 executes an authentication process. Here, it is assumed that the information processing device 200 stores biometric information of each of the palm 122 of the right hand and the palm 124 of the left hand of the user 102.

[0048] The biometric information of the palm includes, for example, the fingerprint information of the palm. The fingerprint information of the palm includes the fingerprint information of at least one finger among the thumb, index finger, middle finger, ring finger, and little finger. The biometric information of the palm includes, for example, the vein information of the palm. The biometric information of the palm may include both the fingerprint information of the palm and the vein information of the palm.

[0049] As shown in the upper part of FIG. 3, the user 102 wearing the glasses-type device 100 uses the camera 160 mounted on the glasses-type device 100 to capture the imaging data 165 shown in the lower part of FIG. 3, and causes the glasses-type device 100 to transmit an authentication request including the imaging data 165. Note that the xy coordinate system shown in the lower part of FIG. 3 is the coordinate system of the imaging data 165. The origin of the xy coordinate system may be the center of the imaging data 165.

[0050] The information processing apparatus 200 acquires, for example, authentication-related information related to the authentication process for the authentication request by using the imaging data 165 included in the authentication process received from the glasses-type device 100. The authentication-related information includes, for example, the biometric information of each of the right palm and the left palm. The authentication-related information includes, for example, position relationship information indicating the position relationship between the right palm and the left palm. The position relationship information may further indicate the position relationship between the right wrist and the left wrist. Here, the information processing apparatus 200 acquires the biometric information of each of the right palm 122 and the left palm 124, and the position relationship between the right palm and the left palm indicates a position relationship in which the value of the x coordinate of the right palm is larger than the value of the x coordinate of the left palm, and the position relationship between the right wrist and the left wrist indicates a position relationship in which the value of the y coordinate of the right wrist and the value of the y coordinate of the left wrist are each larger than the value of the y coordinate of the right palm and the value of the y coordinate of the left palm, respectively. The description will continue based on this assumption.

[0051] The xy coordinates of the palm may be the coordinates corresponding to the center of the palm. The xy coordinates of the wrist may be the coordinates corresponding to the center of the wrist.

[0052] The information processing device 200 executes authentication processing for an authentication request based on, for example, the acquired authentication-related information. The information processing device 200 determines that authentication is successful when, for example, the biometric information of each of the right palm and the left palm included in the authentication-related information matches the biometric information of each of the right palm 122 and the left palm 124 of the user 102 it stores, and the positional relationship between the right palm and the left palm indicated by the positional relationship information satisfies the positional relationship when the camera 160 captures imaging data while the user 102 is wearing the glasses-type device 100. The positional relationship between the right palm 122 and the left palm 124 when the camera 160 captures imaging data while the user 102 is wearing the glasses-type device 100 is, for example, a positional relationship in which the value of the x coordinate of the right palm 122 is greater than the value of the x coordinate of the left palm 124.

[0053] The information processing device 200 determines that authentication is successful when, for example, the biometric information of each of the right palm and the left palm included in the authentication-related information matches the biometric information of each of the right palm 122 and the left palm 124 of the user 102 it stores, the positional relationship between the right palm and the left palm indicated by the positional relationship information satisfies the positional relationship when the camera 160 captures imaging data while the user 102 is wearing the glasses-type device 100, and the positional relationship between the right wrist and the left wrist indicated by the positional relationship information satisfies the positional relationship when the camera 160 captures imaging data while the user 102 is wearing the glasses-type device 100. The positional relationship between the right wrist 132 and the left wrist 134 when the camera 160 captures imaging data while the user 102 is wearing the glasses-type device 100 is, for example, a positional relationship in which the value of the y coordinate of the right wrist 132 and the value of the y coordinate of the left wrist 134 are each greater than the value of the y coordinate of the right palm 122 and the value of the y coordinate of the left palm 124. The positional relationship between the right wrist 132 and the left wrist 134 when the camera 160 captures imaging data while the user 102 is wearing the glasses-type device 100 is, for example, a positional relationship in which the value of the y coordinate of the right wrist 132 and the value of the y coordinate of the left wrist 134 are positive.

[0054] In an example illustrated in FIG. 3, each biometric information of the right palm and the left palm included in the authentication-related information matches the biometric information of the right palm 122 and the left palm 124 of the user 102 stored in the information processing apparatus 200. And since the positional relationship between the right palm and the left palm indicated by the positional relationship information is a positional relationship where the value of the x coordinate of the right palm is greater than the value of the x coordinate of the left palm, the positional relationship between the right palm and the left palm indicated by the positional relationship information satisfies the positional relationship when the camera 160 captures imaging data while the user 102 wears the glasses-type device 100. Further, since the positional relationship between the right wrist and the left wrist indicated by the positional relationship information is a positional relationship where the value of the y coordinate of the right wrist and the value of the y coordinate of the left wrist are each greater than the value of the y coordinate of the right palm and the value of the y coordinate of the left palm, the positional relationship between the right wrist and the left wrist indicated by the positional relationship information satisfies the positional relationship when the camera 160 captures imaging data while the user 102 wears the glasses-type device 100. From the above, the information processing apparatus 200 determines that the authentication is successful.

[0055] FIG. 4 is an explanatory diagram for explaining another example in which the information processing apparatus 200 executes an authentication process. Here, mainly, differences from the example in which the information processing apparatus 200 executes an authentication process illustrated in FIG. 3 will be described.

[0056] As illustrated in the upper part of FIG. 4, a villain 302 wearing a glasses-type device 300 having the same functions as the glasses-type device 100 shows the right palm 122 and the left palm 124 to the user 102, captures imaging data 365 illustrated in the lower part of FIG. 4 using the camera mounted on the glasses-type device 300, and causes the glasses-type device 300 to transmit an authentication request including the imaging data 365. Note that the xy coordinate system illustrated in the lower part of FIG. 4 is the coordinate system of the imaging data 365. The origin of the xy coordinate system may be the center of the imaging data 365.

[0057] The information processing device 200 acquires authentication-related information related to the authentication process for an authentication request, for example, using the imaging data 365 included in the authentication process received from the glasses-type device 300. Here, the information processing device 200 acquires the biometric information of each of the palm 122 of the right hand and the palm 124 of the left hand, and the positional relationship between the palm of the right hand and the palm of the left hand indicates a positional relationship where the value of the x coordinate of the palm of the right hand is smaller than the value of the x coordinate of the palm of the left hand, and the positional relationship between the right wrist and the left wrist indicates a positional relationship where the value of the y coordinate of the right wrist and the value of the y coordinate of the left wrist are each larger than the value of the y coordinate of the palm of the right hand and the value of the y coordinate of the palm of the left hand. The following description will continue on this basis.

[0058] The information processing device 200 executes an authentication process for an authentication request, for example, based on the acquired authentication-related information. In an example illustrated in FIG. 4, the biometric information of each of the palm of the right hand and the palm of the left hand included in the authentication-related information matches the biometric information of each of the palm 122 of the right hand and the palm 124 of the left hand of the user 102 stored in the information processing device 200. However, since the positional relationship between the palm of the right hand and the palm of the left hand indicated by the positional relationship information is a positional relationship where the value of the x coordinate of the palm of the right hand is smaller than the value of the x coordinate of the palm of the left hand, the positional relationship between the palm of the right hand and the palm of the left hand indicated by the positional relationship information does not satisfy the positional relationship when the camera 160 captures imaging data while the user 102 is wearing the glasses-type device 100. From the above, the information processing device 200 determines that the authentication has failed.

[0059] With the widespread use of glasses-type devices such as AR glasses, there is a concern about the unauthorized acquisition of biometric information by misusing the camera mounted on the glasses-type device. Authentication processing based only on biometric information cannot prevent unauthorized access using the illegally acquired biometric information. Therefore, it is desirable to improve the confidentiality of information by preventing unauthorized access using illegally acquired biometric information.

[0060] In contrast, according to the system 10 according to the present embodiment, the information processing apparatus 200 determines whether authentication is successful or not based on the positional relationship between both hands in addition to the biometric information of the palms of both hands. Therefore, even if the biometric information of the user 102 is illegally acquired, the information processing apparatus 200 can determine that authentication has failed when the positional relationship between both hands does not satisfy the positional relationship when the camera 160 captured imaging data while the user 102 was wearing the glasses-type device 100. Thereby, the information processing apparatus 200 can prevent unauthorized access using illegally acquired biometric information and improve the confidentiality of information.

[0061] FIG. 5 is an explanatory diagram for explaining another example in which the information processing apparatus 200 executes authentication processing. Here, mainly, points different from the example in which the information processing apparatus 200 executes authentication processing illustrated in FIGS. 3 and 4 will be described.

[0062] As illustrated in the upper part of FIG. 5, the villain 302 wearing the glasses-type device 300 shows the palm 122 of the right hand and the palm 124 of the left hand to the user 102, and uses the camera mounted on the glasses-type device 300 to capture the imaging data 365 illustrated in the lower part of FIG. 5, and causes the glasses-type device 300 to transmit an authentication request including the imaging data 365. The information processing apparatus 200 acquires authentication-related information related to the authentication processing for the authentication request, for example, using the imaging data 365 included in the authentication processing received from the glasses-type device 300. Here, the description will continue on the assumption that the information processing apparatus 200 has acquired the biometric information of each of the palm 122 of the right hand and the palm 124 of the left hand, and the positional relationship between the palm of the right hand and the palm of the left hand indicates a positional relationship in which the value of the x coordinate of the palm of the right hand is smaller than the value of the x coordinate of the palm of the left hand, and the positional relationship between the right wrist and the left wrist indicates a positional relationship in which the value of the y coordinate of the right wrist and the value of the y coordinate of the left wrist are each smaller than the value of the y coordinate of the palm of the right hand and the value of the y coordinate of the palm of the left hand, respectively.

[0063] The information processing device 200 executes authentication processing for an authentication request based on, for example, the acquired authentication-related information. In an example illustrated in FIG. 5, the biometric information of each of the right palm and the left palm included in the authentication-related information matches the biometric information of each of the right palm 122 and the left palm 124 of the user 102 stored in the information processing device 200. However, since the positional relationship between the right palm and the left palm indicated by the positional relationship information is such that the value of the x coordinate of the right palm is smaller than the value of the x coordinate of the left palm, the positional relationship between the right palm and the left palm indicated by the positional relationship information does not satisfy the positional relationship when the camera 160 captures imaging data while the user 102 is wearing the glasses-type device 100. In addition, since the positional relationship between the right wrist and the left wrist indicated by the positional relationship information is such that the value of the y coordinate of the right wrist and the value of the y coordinate of the left wrist are each smaller than the value of the y coordinate of the right palm and the value of the y coordinate of the left palm, the positional relationship between the right wrist and the left wrist indicated by the positional relationship information does not satisfy the positional relationship when the camera 160 captures imaging data while the user 102 is wearing the glasses-type device 100. From the above, the information processing device 200 determines that the authentication has failed.

[0064] FIG. 6 is an explanatory diagram for explaining another example in which the information processing device 200 executes authentication processing. Here, the points different from the example in which the information processing device 200 executes authentication processing, each illustrated in FIGS. 3 to 5, will be mainly described. It should be noted that the villain 302 and the villain 402 are assumed to be in a cooperative relationship.

[0065] As illustrated in the upper part of FIG. 6, the villain 402 has the user 102 show the right palm 122 and the left palm 124. While the user 102 is showing the right palm 122 and the left palm 124 to the villain 402, the villain 302 wearing the glasses-type device 300 peeks from behind the user 102 and uses the camera mounted on the glasses-type device 300 to capture the imaging data 365 illustrated in the lower part of FIG. 6, and causes the glasses-type device 300 to transmit an authentication request including the imaging data 365.

[0066] The information processing device 200 acquires authentication-related information related to the authentication process for an authentication request, for example, using the imaging data 365 included in the authentication process received from the glasses-type device 300. Here, the description will continue on the assumption that the information processing device 200 acquires the biometric information of each of the right palm 122 and the left palm 124, and the positional relationship between the right palm and the left palm indicates a positional relationship where both the value of the x coordinate of the right palm and the value of the x coordinate of the left palm are negative, and the positional relationship between the right wrist and the left wrist indicates a positional relationship where both the value of the x coordinate of the right wrist and the value of the x coordinate of the left wrist are negative, and the information processing device 200 has acquired positional relationship information indicating such a positional relationship.

[0067] The information processing device 200 executes, for example, an authentication process for an authentication request based on the acquired authentication-related information. When the camera 160 captures imaging data with the user 102 wearing the glasses-type device 100, the positional relationship between the right palm 122 and the left palm 124 is, for example, a positional relationship where the value of the x coordinate of the right palm 122 is positive and the value of the x coordinate of the left palm 124 is negative. When the camera 160 captures imaging data with the user 102 wearing the glasses-type device 100, the positional relationship between the right wrist 132 and the left wrist 134 is, for example, a positional relationship where the value of the x coordinate of the right wrist 132 is positive and the value of the x coordinate of the left wrist 134 is negative.

[0068] In an example illustrated in FIG. 6, the biometric information of each of the right palm and the left palm included in the authentication-related information matches the biometric information of each of the right palm 122 and the left palm 124 of the user 102 stored in the information processing device 200. However, since the positional relationship between the right palm and the left palm indicated by the positional relationship information is a positional relationship in which both the value of the x-coordinate of the right palm and the value of the x-coordinate of the left palm are negative, the positional relationship between the right palm and the left palm indicated by the positional relationship information does not satisfy the positional relationship when the camera 160 captures imaging data while the user 102 is wearing the glasses-type device 100. In addition, since the positional relationship between the right wrist and the left wrist indicated by the positional relationship information is a positional relationship in which both the value of the x-coordinate of the right wrist and the value of the x-coordinate of the left wrist are negative, the positional relationship between the right wrist and the left wrist indicated by the positional relationship information does not satisfy the positional relationship when the camera 160 captures imaging data while the user 102 is wearing the glasses-type device 100. From the above, the information processing device 200 determines that the authentication has failed.

[0069] FIG. 7 is an explanatory diagram for explaining another example in which the information processing device 200 executes an authentication process. Here, the points different from the example in which the information processing device 200 executes the authentication process, which are illustrated in FIGS. 3 to 6 respectively, will be mainly explained.

[0070] User 102 wearing the glasses-type device 100 sends an authentication request to the information processing device 200 using the glasses-type device 100. In response to receiving the authentication request from the glasses-type device 100, for example, the information processing device 200 causes the speaker mounted on the glasses-type device 100 to output a voice saying "Please make your right hand into a palm and your left hand into a scissors" as shown in the upper part of FIG. 7, thereby instructing User 102 to make the shapes of the right hand and the left hand into randomly specified shapes. In the case where the glasses-type device 100 is AR glasses, the information processing device 200 may also instruct User 102 to make the shapes of the right hand and the left hand into randomly specified shapes by causing the display unit mounted on the glasses-type device 100 to display and output content. User 102 makes the right hand into a palm and the left hand into a scissors in response to the instruction, and then uses the camera 160 mounted on the glasses-type device 100 to capture the imaging data 165 shown in the lower part of FIG. 7, and causes the imaging data 165 to be transmitted to the glasses-type device 100.

[0071] The information processing device 200 determines, for example, based on the imaging data 165 received from the glasses-type device 100 whether the operation was executed within a predetermined period from the timing when the operation was instructed. For example, when the information processing device 200 determines that the operation was executed within the period from the timing when the operation was instructed, it starts authentication using biometric information and positional relationship information. In this case, the information processing device 200 may acquire biometric information and positional relationship information using the imaging data included in the authentication request, or may acquire biometric information and positional relationship information using the imaging data 165 captured while the operation is being executed. On the other hand, when the information processing device 200 determines that the operation was not executed within the period from the timing when the operation was instructed, it determines that authentication has failed.

[0072] In one example illustrated in FIG. 7, in response to acquiring an authentication request, the information processing apparatus 200 instructs an operation of changing the shapes of the right hand and the left hand to randomly specified shapes, and when it is determined that the operation has been executed within a predetermined period from the timing of instructing the operation, authentication using biometric information and positional relationship information is started. When a third party abuses a camera mounted on the glasses-type device to illegally acquire biometric information, the third party can illegally acquire biometric information by requesting the execution of a predetermined operation such as showing the palms of the right hand and the left hand. Therefore, when the execution of a complex operation for illegally acquiring biometric information is requested by the third party, or when, in addition to the execution of an operation for illegally acquiring biometric information, the execution of another operation is requested by the third party, the person requested to execute the operation is suspicious of the execution of the operation, and as a result, tends to take time to execute the operation. Therefore, the information processing apparatus 200 starts authentication using biometric information and positional relationship information only when it is determined that the operation has been executed within a predetermined period from the timing of instructing the operation of changing the shapes of the right hand and the left hand to randomly specified shapes, so that illegal access using illegally acquired biometric information can be further prevented and the confidentiality of information can be further improved.

[0073] FIG. 8 is an explanatory diagram for explaining another example in which the information processing apparatus 200 executes an authentication process. Here, mainly, differences from an example in which the information processing apparatus 200 executes an authentication process, each illustrated in FIGS. 3 to 7, will be described. It is assumed that the information processing apparatus 200 stores biometric information of the back 142 of the right hand of the user 102.

[0074] The biometric information of the back of the hand includes, for example, shape information indicating the shape of the back of the hand. The shape information indicating the shape of the back of the hand includes, for example, shape information indicating the shape of at least one finger among the thumb, index finger, middle finger, ring finger, and little finger. The biometric information of the back of the hand includes, for example, shape information indicating the shape of the nail. The shape information indicating the shape of the nail includes, for example, shape information indicating the shape of the nail of at least one finger among the thumb, index finger, middle finger, ring finger, and little finger. The biometric information of the back of the hand includes, for example, vein information of the back of the hand. The biometric information of the back of the hand may include a plurality of shape information indicating the shape of the back of the hand, shape information indicating the shape of the nail, and vein information of the back of the hand.

[0075] The user 102 wearing the glasses-type device 100 transmits an authentication request to the information processing device 200 using the glasses-type device 100. In response to receiving the authentication request from the glasses-type device 100, for example, the information processing device 200 causes the speaker mounted on the glasses-type device 100 to output an audio "Please draw a square with your right hand" as shown in the upper part of FIG. 8, thereby instructing the user 102 to perform an operation of drawing a randomly specified figure. In response to the instruction, the user 102 starts an operation of drawing a square with the right hand, and when drawing a square with the right hand, uses the camera 160 mounted on the glasses-type device 100 to capture the imaging data 165 shown in the lower part of FIG. 8, and causes the imaging data 165 to be transmitted to the glasses-type device 100.

[0076] The information processing device 200 determines, based on the imaging data 165 received from the glasses-type device 100 for example, whether or not the operation has been executed within a predetermined period from the timing when the operation was instructed. For example, when the information processing device 200 determines that the operation has been executed within the period from the timing when the operation was instructed, the information processing device 200 starts authentication using biometric information and positional relationship information. When the information processing device 200 executes authentication using biometric information and positional relationship information, the information processing device 200 may acquire biometric information of the back of the right hand using the imaging data 165 and execute authentication using biometric information and positional relationship information based on the biometric information of the back of the right hand. On the other hand, when the information processing device 200 determines that the operation has not been executed within the period from the timing when the operation was instructed, the information processing device 200 determines that authentication has failed.

[0077] The information processing device 200 may determine whether the imaging data 165 is imaging data of the back of the hand or imaging data of the palm of the hand. For example, when the information processing device 200 determines that the imaging data 165 is imaging data of the back of the hand, the information processing device 200 determines whether or not the operation has been executed within the period from the timing when the operation was instructed. On the other hand, when the information processing device 200 determines that the imaging data 165 is imaging data of the palm of the hand, the information processing device 200 determines that authentication has failed.

[0078] FIG. 9 is an explanatory diagram for explaining another example in which the information processing device 200 executes authentication processing. Here, the points different from the example in which the information processing device 200 executes authentication processing, each illustrated in FIGS. 3 to 8, will be mainly described. It is assumed that the information processing device 200 stores the password of the user 102 and the biometric information of each of the back of the right hand 142 and the back of the left hand 144 of the user 102.

[0079] User 102 wearing the glasses-type device 100 transmits an authentication request to the information processing device 200 using the glasses-type device 100. In response to receiving the authentication request from the glasses-type device 100, for example, as shown in the upper part of FIG. 9, the information processing device 200 causes the speaker mounted on the glasses-type device 100 to output an audio message "Please enter your password", thereby instructing User 102 to perform an operation of entering a password. Then, the glasses-type device 100 accepts the input of the password by User 102 via the virtual keyboard 190. The virtual keyboard 190 may be an example of the input reception function of the glasses-type device 100.

[0080] In response to the instruction, User 102 enters the password into the virtual keyboard 190 and causes the entered password to be transmitted to the glasses-type device 100. When entering the password, User 102 may use the camera 160 mounted on the glasses-type device 100 to capture the imaging data 165 shown in the lower part of FIG. 9 and cause the imaging data 165 to be transmitted to the glasses-type device 100.

[0081] Based on the password received from the glasses-type device 100, the information processing device 200 executes an authentication process for the authentication request. For example, when the biometric information of each of the right palm and the left palm included in the authentication-related information matches the biometric information of the right palm 122 and the left palm 124 of User 102 stored therein, the password received from the glasses-type device 100 matches the password of User 102 stored therein, and the positional relationship between the right palm and the left palm indicated by the positional relationship information satisfies the positional relationship when the camera 160 captures imaging data in the state where User 102 wears the glasses-type device 100, the information processing device 200 determines that the authentication is successful.

[0082] The information processing apparatus 200 determines, for example, whether a password has been received within a predetermined period from the timing when the operation was instructed. For example, when the information processing apparatus 200 determines that a password has been received within the period from the timing when the operation was instructed, it starts authentication using the biometric information and the positional relationship information and the password. When the information processing apparatus 200 executes authentication using the biometric information and the positional relationship information and the password, it may acquire the biometric information of each of the back of the right hand and the back of the left hand using the imaging data 165, and further execute authentication using the biometric information and the positional relationship information and the password based on the biometric information of each of the back of the right hand and the back of the left hand. On the other hand, when the information processing apparatus 200 determines that a password has not been received within the period from the timing when the operation was instructed, it determines that the authentication has failed.

[0083] FIG. 10 schematically shows an example of the functional configuration of the information processing apparatus 200. The information processing apparatus 200 includes a storage unit 202, a registration unit 204, an authentication request acquisition unit 206, an authentication-related information acquisition unit 208, an authentication unit 220, a control unit 222, and an instruction unit 224. Note that it is not always essential for the information processing apparatus 200 to include all of these configurations.

[0084] The storage unit 202 stores various types of information. The storage unit 202 stores, for example, the biometric information of the user 102 of the glasses-type device 100. The storage unit 202 stores, for example, the biometric information of each of the palm 122 of the right hand and the palm 124 of the left hand of the user 102. The storage unit 202 stores, for example, the biometric information of at least one of the back of the right hand 142 and the back of the left hand 144 of the user 102. The storage unit 202 stores, for example, the biometric information between the eyebrows of the user 102. The storage unit 202 includes, for example, the biometric information of at least one of the right eye and the left eye of the user 102. The storage unit 202 may store the password of the user 102.

[0085] The registration unit 204 registers various types of information in the storage unit 202. For example, the registration unit 204 receives various types of information via the network 20 and registers the received various types of information in the storage unit 202, thereby registering various types of information in the storage unit 202. The registration unit 204 may also register various types of information in the storage unit 202 by receiving an input from the user of the information processing apparatus 200 via the input unit included in the information processing apparatus 200. Note that the user of the information processing apparatus 200 may be an administrator who manages the personal information of the user 102.

[0086] The registration unit 204, for example, registers the biometric information of the glasses-type device 100 in the storage unit 202. The registration unit 204 may also register the password of the user 102 in the storage unit 202.

[0087] The authentication request acquisition unit 206 acquires an authentication request. For example, the authentication request acquisition unit 206 acquires the authentication request by receiving the authentication request via the network 20.

[0088] The authentication request acquisition unit 206, for example, receives the authentication request from the glasses-type device 100. The authentication request acquisition unit 206 may also receive the authentication request from any other communication terminal.

[0089] The authentication-related information acquisition unit 208 acquires authentication-related information. For example, the authentication-related information acquisition unit 208 acquires the authentication-related information using the imaging data included in the authentication request acquired by the authentication request acquisition unit 206.

[0090] The authentication-related information acquisition unit 208, for example, acquires authentication-related information including the biometric information between the eyebrows. The authentication-related information acquisition unit 208 may also acquire authentication-related information including the biometric information of the eyes.

[0091] The authentication unit 220 executes an authentication process for the authentication request acquired by the authentication request acquisition unit 206. For example, the authentication unit 220 executes the authentication process based on the authentication-related information acquired by the authentication-related information acquisition unit 208.

[0092] When the biometric information of each of the right palm and the left palm included in the authentication-related information matches the biometric information of the right palm 122 and the left palm 124 of the user 102 stored in the storage unit 202, and the positional relationship between the right palm and the left palm indicated by the positional relationship information included in the authentication-related information satisfies the positional relationship when the camera 160 captures imaging data while the user 102 is wearing the glasses-type device 100, the authentication unit 220 determines that the authentication is successful. In this case, when the biometric information of each of the right palm and the left palm included in the authentication-related information does not match the biometric information of the right palm 122 and the left palm 124 of the user 102 stored in the storage unit 202, the authentication unit 220 determines that the authentication has failed. Further, when the positional relationship between the right palm and the left palm indicated by the positional relationship information included in the authentication-related information does not satisfy the positional relationship when the camera 160 captures imaging data while the user 102 is wearing the glasses-type device 100, the authentication unit 220 determines that the authentication has failed.

[0093] The authentication unit 220 determines that authentication is successful when, for example, the biometric information of each of the right palm and the left palm included in the authentication-related information matches the biometric information of each of the right palm 122 and the left palm 124 of the user 102 stored in the storage unit 202, the positional relationship between the right palm and the left palm indicated by the positional relationship information included in the authentication-related information satisfies the positional relationship when the camera 160 captures imaging data while the user 102 is wearing the glasses-type device 100, and the positional relationship between the right wrist and the left wrist indicated by the positional relationship information included in the authentication-related information satisfies the positional relationship when the camera 160 captures imaging data while the user 102 is wearing the glasses-type device 100. In this case, the authentication unit 220 determines that authentication has failed when the biometric information of each of the right palm and the left palm included in the authentication-related information does not match the biometric information of each of the right palm 122 and the left palm 124 of the user 102 stored in the storage unit 202. Further, the authentication unit 220 determines that authentication has failed when the positional relationship between the right palm and the left palm indicated by the positional relationship information included in the authentication-related information does not satisfy the positional relationship when the camera 160 captures imaging data while the user 102 is wearing the glasses-type device 100. Further, the authentication unit 220 determines that authentication has failed when the positional relationship between the right wrist and the left wrist indicated by the positional relationship information included in the authentication-related information does not satisfy the positional relationship when the camera 160 captures imaging data while the user 102 is wearing the glasses-type device 100.

[0094] The authentication unit 220 determines that authentication is successful when, for example, the biometric information of each of the right palm and the left palm included in the authentication-related information matches the biometric information of each of the right palm 122 and the left palm 124 of the user 102 stored in the storage unit 202, the biometric information of the glabella included in the authentication-related information matches the biometric information of the glabella of the user 102 stored in the storage unit 202, and the positional relationship between the right palm and the left palm indicated by the positional relationship information included in the authentication-related information satisfies the positional relationship when the camera 160 captures imaging data while the user 102 is wearing the glasses-type device 100. In this case, when the biometric information of each of the right palm and the left palm included in the authentication-related information does not match the biometric information of each of the right palm 122 and the left palm 124 of the user 102 stored in the storage unit 202, the authentication unit 220 determines that authentication has failed. Also, when the biometric information of the glabella included in the authentication-related information does not match the biometric information of the glabella of the user 102 stored in the storage unit 202, the authentication unit 220 determines that authentication has failed. Further, when the positional relationship between the right palm and the left palm indicated by the positional relationship information included in the authentication-related information does not satisfy the positional relationship when the camera 160 captures imaging data while the user 102 is wearing the glasses-type device 100, the authentication unit 220 determines that authentication has failed. The authentication unit 220 may execute the authentication process for the authentication request based on the biometric information of the eyes in the same manner as when executing the authentication process for the authentication request based on the biometric information of the glabella.

[0095] The control unit 222 controls the glasses-type device 100. The control unit 222 controls various functions of the glasses-type device 100, for example. The control unit 222 controls various functions of the glasses-type device 100 by, for example, generating control information and transmitting the generated control information to the glasses-type device 100 via the network 20.

[0096] The control unit 222 controls, for example, the output functions of the glasses-type device 100. The control unit 222 controls, for example, the voice output function of the glasses-type device 100. The control unit 222 controls the voice output function of the glasses-type device 100 by controlling the voice output by a speaker mounted on the glasses-type device 100. The control unit 222 controls, for example, the display output function of the glasses-type device 100. The control unit 222 controls the display output function of the glasses-type device 100 by controlling the display output to a display unit mounted on the glasses-type device 100.

[0097] The control information includes, for example, output control information for controlling the output functions of the glasses-type device 100. The output control information includes, for example, voice output control information for controlling the voice output function of the glasses-type device 100. The output control information includes, for example, display output control information for controlling the display output function of the glasses-type device 100.

[0098] The control unit 222 controls the glasses-type device 100 to notify that authentication is in progress, for example, when the authentication request acquisition unit 206 acquires an authentication request. The control unit 222 controls the glasses-type device 100 to notify that authentication is in progress by controlling the voice output function of the glasses-type device 100. The control unit 222 controls the glasses-type device 100 to notify that authentication is in progress by controlling the display output function of the glasses-type device 100.

[0099] The instruction unit 224 instructs various operations. The instruction unit 224 instructs various operations by controlling the glasses-type device 100 using the control unit 222, for example.

[0100] The instruction unit 224 instructs various operations by causing voice data to be voice output to a speaker mounted on the glasses-type device 100, for example. The instruction unit 224 instructs various operations by causing content to be displayed and output to a display unit mounted on the glasses-type device 100, for example.

[0101] The instruction unit 224 instructs various operations, for example, to execute each of the various operations of the target once. The instruction unit 224 instructs various operations, for example, to execute each of the various operations of the target a plurality of times.

[0102] The instruction unit 224 instructs an operation to make the shapes of the right hand and the left hand into randomly specified shapes, for example. The instruction unit 224 instructs an operation to draw a randomly specified figure, for example. In this case, the instruction unit 224 may specify the hand that draws the randomly specified figure.

[0103] The authentication-related information acquisition unit 208 acquires imaging data captured by the camera 160 mounted on the glasses-type device 100, for example, after the instruction unit 224 instructs an operation. For example, based on the imaging data acquired by the authentication-related information acquisition unit 208, the authentication unit 220 determines whether an operation has been executed within a predetermined period from the timing instructed by the instruction unit 224. When it is determined that the operation has been executed within the period from the timing, the authentication unit 220 starts authentication using the biometric information and the positional relationship information included in the authentication-related information. In this case, when it is determined that the operation has not been executed within the period from the timing, the authentication unit 220 determines that authentication has failed.

[0104] The authentication unit 220 determines, for example, whether the imaging data acquired by the authentication-related information acquisition unit 208 is imaging data of the back of the hand or imaging data of the palm of the hand. When it is determined that the imaging data acquired by the authentication-related information acquisition unit 208 is imaging data of the back of the hand, the authentication unit 220 further determines whether an operation has been executed within a predetermined period from the timing instructed by the instruction unit 224 based on the imaging data acquired by the authentication-related information acquisition unit 208. When it is determined that the operation has been executed within the period from the timing, the authentication unit 220 starts authentication using the biometric information and the positional relationship information included in the authentication-related information. In this case, when it is determined that the imaging data acquired by the authentication-related information acquisition unit 208 is imaging data of the palm of the hand, the authentication unit 220 determines that authentication has failed. Also, when it is determined that the operation has not been executed within the period from the timing, the authentication unit 220 determines that authentication has failed.

[0105] The instruction unit 224 may instruct an operation of inputting a password. The authentication-related information acquisition unit 208 acquires, for example, the password received by the input reception function provided in the glasses-type device 100.

[0106] The authentication unit 220 determines that authentication is successful, for example, when the biometric information of each of the right palm and the left palm included in the authentication-related information matches the biometric information of each of the right palm 122 and the left palm 124 of the user 102 stored in the storage unit 202, the password acquired by the authentication-related information acquisition unit 208 matches the password of the user 102 stored in the storage unit 202, and the positional relationship between the right palm and the left palm indicated by the positional relationship information included in the authentication-related information satisfies the positional relationship when the camera 160 captures imaging data while the user 102 is wearing the glasses-type device 100. In this case, when the biometric information of each of the right palm and the left palm included in the authentication-related information does not match the biometric information of each of the right palm 122 and the left palm 124 of the user 102 stored in the storage unit 202, the authentication unit 220 determines that authentication has failed. Also, when the password acquired by the authentication-related information acquisition unit 208 does not match the password of the user 102 stored in the storage unit 202, it is determined that authentication has failed. Further, when the positional relationship between the right palm and the left palm indicated by the positional relationship information included in the authentication-related information does not satisfy the positional relationship when the camera 160 captures imaging data while the user 102 is wearing the glasses-type device 100, the authentication unit 220 determines that authentication has failed.

[0107] The authentication unit 220 determines, for example, whether the authentication-related information acquisition unit 208 has acquired a password within a predetermined period from the timing indicated by the instruction unit 224. When it is determined that the authentication-related information acquisition unit 208 has acquired a password within the period from the timing, the authentication unit 220 starts authentication using the biometric information and the positional relationship information included in the authentication-related information and the password. In this case, when the authentication unit 220 determines that the authentication-related information acquisition unit 208 has not acquired a password within the period from the timing, the authentication unit 220 determines that authentication has failed.

[0108] The authentication-related information acquisition unit 208 acquires, for example, imaging data obtained by imaging at least one of the back of the right hand and the back of the left hand by the camera 160 mounted on the glasses-type device 100 after the instruction unit 224 instructs an operation. The authentication-related information acquisition unit 208 acquires biometric information of at least one of the back of the right hand and the back of the left hand, for example, using the acquired imaging data obtained by imaging at least one of the back of the right hand and the back of the left hand.

[0109] The authentication unit 220 determines that the authentication is successful when, for example, the biometric information of each of the right palm and the left palm included in the authentication-related information matches the biometric information of each of the right palm 122 and the left palm 124 of the user 102 stored in the storage unit 202, the password acquired by the authentication-related information acquisition unit 208 matches the password of the user 102 stored in the storage unit 202, at least one of the biometric information of the back of the right hand and the back of the left hand acquired by the authentication-related information acquisition unit 208 matches at least one of the biometric information of the back of the right hand 142 and the back of the left hand 144 of the user stored in the storage unit 202, and the positional relationship between the right palm and the left palm indicated by the positional relationship information included in the authentication-related information satisfies the positional relationship when the camera 160 captures imaging data while the user 102 is wearing the glasses-type device 100. In this case, when the biometric information of each of the right palm and the left palm included in the authentication-related information does not match the biometric information of each of the right palm 122 and the left palm 124 of the user 102 stored in the storage unit 202, the authentication unit 220 determines that the authentication has failed. Also, when the password acquired by the authentication-related information acquisition unit 208 does not match the password of the user 102 stored in the storage unit 202, the authentication unit 220 determines that the authentication has failed. Further, when at least one of the biometric information of the back of the right hand and the back of the left hand acquired by the authentication-related information acquisition unit 208 does not match at least one of the biometric information of the back of the right hand 142 and the back of the left hand 144 of the user stored in the storage unit 202, the authentication unit 220 determines that the authentication has failed. Additionally, when the positional relationship between the right palm and the left palm indicated by the positional relationship information included in the authentication-related information does not satisfy the positional relationship when the camera 160 captures imaging data while the user 102 is wearing the glasses-type device 100, the authentication unit 220 determines that the authentication has failed.

[0110] FIG. 11 schematically shows an example of the functional configuration of the control device 150. The control device 150 includes a storage unit 152, a registration unit 154, an authentication request acquisition unit 156, an authentication-related information acquisition unit 158, an authentication unit 170, a control unit 172, and an instruction unit 174. Note that it is not always essential for the control device 150 to include all of these configurations.

[0111] The storage unit 152 stores various types of information. The storage unit 152 may store the same types of information as those stored in the storage unit 202. The storage unit 152 may have the same functions as the storage unit 202.

[0112] The registration unit 154 registers various types of information in the storage unit 152. For example, the registration unit 154 registers various types of information in the storage unit 152 by receiving an input from the user 102 via the input reception function provided in the glasses-type device 100. The registration unit 154 may also register various types of information in the storage unit 152 by receiving various types of information via the network 20 and registering the received various types of information in the storage unit 152.

[0113] The registration unit 154, for example, registers the biometric information of the glasses-type device 100 in the storage unit 152. The registration unit 154 may also register the password of the user 102 in the storage unit 152.

[0114] The authentication request acquisition unit 156 acquires an authentication request. For example, the authentication request acquisition unit 156 acquires an authentication request by receiving an input from the user 102 via the input reception function provided in the glasses-type device 100.

[0115] The authentication-related information acquisition unit 158 acquires authentication-related information. For example, the authentication-related information acquisition unit 158 acquires authentication-related information using the imaging data included in the authentication request acquired by the authentication request acquisition unit 156.

[0116] The authentication-related information acquisition unit 158 may acquire authentication-related information in the same manner as the authentication-related information acquisition unit 208. The authentication-related information acquisition unit 158 may have the same functions as the authentication-related information acquisition unit 208.

[0117] The authentication unit 170 executes an authentication process for the authentication request acquired by the authentication request acquisition unit 156. For example, the authentication unit 170 executes an authentication process based on the authentication-related information acquired by the authentication-related information acquisition unit 158.

[0118] Similar to the authentication unit 220, the authentication unit 170 may execute authentication processing. The authentication unit 170 may have the same functions as the authentication unit 220.

[0119] The control unit 172 controls the glasses-type device 100. For example, the control unit 172 controls various functions of the glasses-type device 100. For example, the control unit 172 generates control information and controls various functions of the glasses-type device 100 based on the generated control information. The control unit 172 may receive control information from the information processing device 200 via the network 20 and control various functions of the glasses-type device 100 based on the received control information.

[0120] Similar to the control unit 222, the control unit 172 may control the glasses-type device 100. The control unit 172 may have the same functions as the control unit 222.

[0121] The instruction unit 174 instructs various operations. For example, the instruction unit 174 instructs various operations by controlling the glasses-type device 100 using the control unit 172.

[0122] Similar to the instruction unit 224, the instruction unit 174 may instruct various operations. The instruction unit 174 may have the same functions as the instruction unit 224.

[0123] FIG. 12 is an explanatory diagram for explaining an example of the processing flow of the information processing device 200. Here, the start state is a state in which the information processing device 200 has not acquired an authentication request.

[0124] In step (steps may be described with S omitted), in step 102, the authentication request acquisition unit 206 acquires an authentication request from the glasses-type device 100. In S104, the authentication-related information acquisition unit 208 acquires authentication-related information using the imaging data included in the authentication request acquired by the authentication request acquisition unit 206 in S102.

[0125] In S106, the authentication unit 220 determines whether the biometric information of each of the right palm and the left palm included in the authentication-related information acquired by the authentication-related information acquisition unit 208 in S104 matches the biometric information of each of the right palm 122 and the left palm 124 of the user 102 of the glasses-type device 100 stored in the storage unit 202. If the authentication unit 220 determines that the biometric information of each of the right palm and the left palm included in the authentication-related information matches the biometric information of each of the right palm 122 and the left palm 124 of the user 102, the process proceeds to S108. If the authentication unit 220 determines that the biometric information of each of the right palm and the left palm included in the authentication-related information does not match the biometric information of each of the right palm 122 and the left palm 124 of the user 102, the process proceeds to S112.

[0126] In S108, the authentication unit 220 determines whether the positional relationship between the right palm and the left palm indicated by the positional relationship information included in the authentication-related information acquired by the authentication-related information acquisition unit 208 in S104 satisfies the positional relationship when the camera 160 captures imaging data while the user 102 is wearing the glasses-type device 100. If the information processing device 200 determines that the positional relationship between the right palm and the left palm indicated by the positional relationship information satisfies the positional relationship when the camera 160 captures imaging data while the user 102 is wearing the glasses-type device 100, the process proceeds to S110. If the information processing device 200 determines that the positional relationship between the right palm and the left palm indicated by the positional relationship information does not satisfy the positional relationship when the camera 160 captures imaging data while the user 102 is wearing the glasses-type device 100, the process proceeds to S112.

[0127] In S110, the authentication unit 220 determines that the authentication is successful. Thereafter, the authentication process for the authentication request ends.

[0128] In S112, the authentication unit 220 determines that the authentication has failed. Thereafter, the authentication process for the authentication request ends.

[0129] When the authentication-related information acquisition unit 208 acquires authentication-related information, the authentication unit 220 determines whether the positional relationship between the right palm and the left palm indicated by the positional relationship information satisfies the positional relationship when the camera 160 captures imaging data with the user 102 wearing the glasses-type device 100. Then, the authentication unit 220 may determine whether the biometric information of each of the right palm and the left palm included in the authentication-related information matches the biometric information of each of the right palm 122 and the left palm 124 of the user 102 of the glasses-type device 100 stored in the storage unit 202. That is, in an example of the processing flow of the information processing apparatus 200 described above, the order of S106 and S108 may be switched.

[0130] FIG. 13 schematically shows an example of the hardware configuration of a computer 1200 that functions as the control device 150 or the information processing device 200. The program installed in the computer 1200 causes the computer 1200 to function as one or more "units" of the device according to the above embodiment, or causes the computer 1200 to execute an operation associated with the device according to the above embodiment or the one or more "units", and / or causes the computer 1200 to execute the process according to the above embodiment or a stage of the process. Such a program may be executed by the CPU 1212 to cause the computer 1200 to execute specific operations associated with some or all of the blocks in the flowcharts and block diagrams described herein.

[0131] The computer 1200 according to this embodiment includes a CPU 1212, a RAM 1214, and a graphic controller 1216, which are interconnected by a host controller 1210. The computer 1200 also includes input / output units such as a communication interface 1222, a storage device 1224, a DVD drive 1226, and an IC card drive, which are connected to the host controller 1210 via an input / output controller 1220. The DVD drive 1226 may be a DVD-ROM drive, a DVD-RAM drive, or the like. The storage device 1224 may be a hard disk drive, a solid state drive, or the like. The computer 1200 also includes legacy input / output units such as a ROM 1230 and a keyboard 1242, which are connected to the input / output controller 1220 via an input / output chip 1240.

[0132] The CPU 1212 operates according to programs stored in the ROM 1230 and the RAM 1214, thereby controlling each unit. The graphic controller 1216 acquires image data generated by the CPU 1212 in a frame buffer or the like provided in the RAM 1214 or within itself, and causes the image data to be displayed on the display device 1218.

[0133] The communication interface 1222 communicates with other electronic devices via a network. The storage device 1224 stores programs and data used by the CPU 1212 within the computer 1200. The DVD drive 1226 reads a program or data from a DVD-ROM 1227 or the like and provides it to the storage device 1224. The IC card drive reads programs and data from an IC card and / or writes programs and data to an IC card.

[0134] ROM 1230 stores therein a boot program or the like executed by computer 1200 at activation, and / or a program dependent on the hardware of computer 1200. Input / output chip 1240 may also be connected to input / output controller 1220 via various input / output units through a USB port, a parallel port, a serial port, a keyboard port, a mouse port, etc.

[0135] The program is provided by a computer-readable storage medium such as a DVD-ROM 1227 or an IC card. The program is read from the computer-readable storage medium, installed in a storage device 1224, which is also an example of a computer-readable storage medium, RAM 1214, or ROM 1230, and executed by CPU 1212. The information processing described in these programs is read by computer 1200, resulting in the cooperation between the programs and the various types of hardware resources described above. The device or method may be configured by realizing the operation or processing of information according to the use of computer 1200.

[0136] For example, when communication is executed between computer 1200 and an external device, CPU 1212 may execute a communication program loaded in RAM 1214 and instruct communication interface 1222 to perform communication processing based on the processing described in the communication program. Communication interface 1222 reads the transmission data stored in a transmission buffer area provided in a recording medium such as RAM 1214, storage device 1224, DVD-ROM 1227, or an IC card under the control of CPU 1212, transmits the read transmission data to the network, or writes the received data received from the network to a reception buffer area or the like provided on the recording medium.

[0137] Further, the CPU 1212 may cause all or necessary parts of files or databases stored in an external recording medium such as the storage device 1224, the DVD drive 1226 (DVD-ROM 1227), an IC card, etc. to be read into the RAM 1214, and may execute various types of processing on the data on the RAM 1214. Next, the CPU 1212 may write back the processed data to the external recording medium.

[0138] Various types of information such as various types of programs, data, tables, and databases may be stored in a recording medium and may undergo information processing. The CPU 1212 may perform various types of processing on the data read from the RAM 1214, including various types of operations, information processing, conditional judgment, conditional branching, unconditional branching, information search / replacement, etc. described throughout this disclosure and specified by the instruction sequence of the program, and write back the result to the RAM 1214. Also, the CPU 1212 may search for information in files, databases, etc. within the recording medium. For example, when a plurality of entries each having an attribute value of a first attribute associated with an attribute value of a second attribute are stored in the recording medium, the CPU 1212 searches for an entry that matches the condition where the attribute value of the first attribute is specified among the plurality of entries, reads the attribute value of the second attribute stored in the entry, and thereby may obtain the attribute value of the second attribute associated with the first attribute that satisfies a predetermined condition.

[0139] The programs or software modules described above may be stored in a computer-readable storage medium on or near the computer 1200. Also, a recording medium such as a hard disk or RAM provided in a server system connected to a dedicated communication network or the Internet can be used as a computer-readable storage medium, thereby providing the program to the computer 1200 via the network.

[0140] In the flowcharts and block diagrams in this embodiment, the blocks may represent stages of a process in which operations are performed or "parts" of a device that has a role in performing the operations. Specific stages and "parts" may be implemented by a dedicated circuit, a programmable circuit supplied with computer-readable instructions stored on a computer-readable storage medium, and / or a processor supplied with computer-readable instructions stored on a computer-readable storage medium. The dedicated circuit may include digital and / or analog hardware circuits, and may include integrated circuits (ICs) and / or discrete circuits. The programmable circuit may include, for example, a reconfigurable hardware circuit including logical products, logical sums, exclusive logical sums, negative logical products, negative logical sums, and other logical operations, flip-flops, registers, and memory elements, such as a field programmable gate array (FPGA) and a programmable logic array (PLA).

[0141] The computer-readable storage medium may include any tangible device capable of storing instructions executable by an appropriate device, and as a result, a computer-readable storage medium having instructions stored therein will comprise a product including instructions that can be executed to create means for performing the operations specified in the flowchart or block diagram. Examples of computer-readable storage media may include electronic storage media, magnetic storage media, optical storage media, electromagnetic storage media, semiconductor storage media, and the like. More specific examples of computer-readable storage media may include floppy (registered trademark) disks, diskettes, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), electrically erasable programmable read-only memory (EEPROM), static random access memory (SRAM), compact disc read-only memory (CD-ROM), digital versatile disc (DVD), Blu-ray (registered trademark) disc, memory stick, integrated circuit card, and the like.

[0142] Computer-readable instructions may include any combination of one or more programming languages, including assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or object-oriented programming languages such as Smalltalk®, JAVA®, C++, and conventional procedural programming languages such as the "C" programming language or similar programming languages, in either source code or object code.

[0143] Computer-readable instructions may be provided to a processor of a general purpose computer, a special purpose computer, or other programmable data processing apparatus, or to a programmable circuit, locally or via a wide area network (WAN) such as a local area network (LAN), the Internet, etc., to cause the processor or programmable circuit to execute the operations specified in a flowchart or block diagram by generating means for performing the operations. Examples of processors include computer processors, processing units, microprocessors, digital signal processors, controllers, microcontrollers, etc.

[0144] As described above, the present invention has been described using embodiments, but the technical scope of the present invention is not limited to the scope described in the above embodiments. It is obvious to those skilled in the art that various changes or improvements can be made to the above embodiments. It is clear from the description of the claims that forms with such changes or improvements can also be included in the technical scope of the present invention.

[0145] In the claims, the specification, and the drawings, the execution order of each process such as the operations, procedures, steps, and stages in the apparatus, system, program, and method shown is not explicitly indicated as "earlier" or "preceding" etc. in particular, and it should be noted that it can be realized in any order unless the output of the previous process is used in the subsequent process. Regarding the operation flow in the claims, the specification, and the drawings, even if it is described using "first," "next," etc. for convenience, it does not mean that it is essential to be implemented in this order.

Explanation of Signs

[0146] 10 System, 20 Network, 100 Glasses-type Device, 102 User, 110 Frame, 112 Rim, 114 Bridge, 116 Lens, 118 Temple, 122 Right Palm, 124 Left Palm, 132 Right Wrist, 134 Left Wrist, 142 Right Shoulder Blade, 144 Left Shoulder Blade, 150 Control Device, 152 Storage Unit, 154 Registration Unit, 156 Authentication Request Acquisition Unit, 158 Authentication-related Information Acquisition Unit, 160 Camera, 165 Imaging Data, 170 Authentication Unit, 172 Control Unit, 174 Instruction Unit, 180 Sensor, 190 Virtual Keyboard, 200 Information Processing Device, 202 Storage Unit, 204 Registration Unit, 206 Authentication Request Acquisition Unit, 208 Authentication-related Information Acquisition Unit, 220 Authentication Unit, 222 Control Unit, 224 Instruction Unit, 300 Glasses-type Device, 302 Villain, 365 Imaging Data, 402 Villain, 1200 Computer, 1210 Host Controller, 1212 CPU, 1214 RAM, 1216 Graphics Controller, 1218 Display Device, 1220 Input / Output Controller, 1222 Communication Interface, 1224 Storage Device, 1230 ROM, 1240 Input / Output Chip

Claims

1. A storage unit that stores biometric information of each of the user's right palm and left palm; An authentication request acquisition unit that acquires an authentication request including imaging data obtained by a camera mounted on the glasses-type device imaging the right palm and the left palm; An authentication-related information acquisition unit that uses the imaging data included in the authentication request to acquire authentication-related information including biometric information of each of the right palm and the left palm and position relationship information indicating the position relationship between the right palm and the left palm; An authentication unit that determines authentication is successful when the biometric information of each of the right palm and the left palm included in the authentication-related information matches the biometric information of each of the right palm and the left palm of the user stored in the storage unit, and the position relationship between the right palm and the left palm indicated by the position relationship information included in the authentication-related information satisfies the position relationship when the camera captured the imaging data with the user wearing the glasses-type device. An information processing apparatus comprising the above.

2. The authentication request acquisition unit acquires the authentication request including the imaging data obtained by further imaging the right wrist and the left wrist; The authentication-related information acquisition unit uses the imaging data included in the authentication request to acquire the authentication-related information including the position relationship information further indicating the position relationship between the right wrist and the left wrist; The authentication unit determines authentication is successful when the biometric information of each of the right palm and the left palm included in the authentication-related information matches the biometric information of each of the right palm and the left palm of the user stored in the storage unit, the position relationship between the right palm and the left palm indicated by the position relationship information included in the authentication-related information satisfies the position relationship when the camera captured the imaging data with the user wearing the glasses-type device, and the position relationship between the right wrist and the left wrist indicated by the position relationship information included in the authentication-related information satisfies the position relationship when the camera captured the imaging data with the user wearing the glasses-type device. The information processing apparatus according to Claim 1.

3. An instruction unit that instructs an operation of randomly specifying the shapes of the right hand and the left hand to specified shapes is further provided. After the instruction unit instructs the operation, the authentication-related information acquisition unit further acquires imaging data captured by the camera mounted on the glasses-type device. Based on the imaging data acquired by the authentication-related information acquisition unit, the authentication unit determines whether the operation was executed within a predetermined period from the timing instructed by the instruction unit. When it is determined that the operation was executed within the predetermined period from the timing, the authentication unit starts authentication using the biometric information and the positional relationship information included in the authentication-related information. The information processing apparatus according to claim 1 or 2.

4. An instruction unit that instructs an operation of drawing a randomly specified figure further comprising After the instruction unit instructs the operation, the authentication-related information acquisition unit further acquires imaging data captured by the camera mounted on the glasses-type device. The authentication unit determines whether the imaging data acquired by the authentication-related information acquisition unit is imaging data of the back of the hand or imaging data of the palm. When it is determined that the imaging data acquired by the authentication-related information acquisition unit is imaging data of the back of the hand, based on the imaging data acquired by the authentication-related information acquisition unit, the authentication unit further determines whether the operation was executed within a predetermined period from the timing instructed by the instruction unit. When it is determined that the operation was executed within the predetermined period from the timing, the authentication unit starts authentication using the biometric information and the positional relationship information included in the authentication-related information. The information processing apparatus according to claim 1 or 2.

5. The storage unit further stores biometric information between the eyebrows of the user. The authentication request acquisition unit acquires the authentication request further including biometric information between the eyebrows acquired by the biometric information acquisition unit mounted on the glasses-type device. The authentication-related information acquisition unit acquires the authentication-related information further including the biometric information between the eyebrows included in the authentication request. When the biometric information of each of the palm of the right hand and the palm of the left hand included in the authentication-related information matches the biometric information of each of the palm of the right hand and the palm of the left hand of the user stored in the storage unit, the biometric information of the glabella included in the authentication-related information matches the biometric information of the glabella of the user stored in the storage unit, and the positional relationship between the palm of the right hand and the palm of the left hand indicated by the positional relationship information included in the authentication-related information satisfies the positional relationship when the camera captures the imaging data with the user wearing the glasses-type device, it determines that the authentication is successful. The information processing apparatus according to claim 1 or 2.

6. An instruction unit that instructs an operation of inputting a password further comprises The storage unit further stores the password of the user. The authentication-related information acquisition unit further acquires the password received by the input reception function provided in the glasses-type device. When the biometric information of each of the palm of the right hand and the palm of the left hand included in the authentication-related information matches the biometric information of each of the palm of the right hand and the palm of the left hand of the user stored in the storage unit, the password acquired by the authentication-related information acquisition unit matches the password of the user stored in the storage unit, and the positional relationship between the palm of the right hand and the palm of the left hand indicated by the positional relationship information included in the authentication-related information satisfies the positional relationship when the camera captures the imaging data with the user wearing the glasses-type device, it determines that the authentication is successful. The information processing apparatus according to claim 1 or 2.

7. The authentication unit determines whether the authentication-related information acquisition unit has acquired the password within a predetermined period from the timing indicated by the instruction unit. When it is determined that the authentication-related information acquisition unit has acquired the password within the predetermined period from the timing, it starts authentication using the biometric information and the positional relationship information included in the authentication-related information and the password. The information processing apparatus according to claim 6.

8. The storage unit further stores the biometric information of at least one of the back of the right hand and the back of the left hand of the user. After the instruction unit instructs the operation, the authentication-related information acquisition unit further acquires imaging data captured by the camera mounted on the glasses-type device, which captures at least one of the back of the right hand and the back of the left hand, and uses the imaging data captured by at least one of the back of the right hand and the back of the left hand to further acquire biometric information of at least one of the back of the right hand and the back of the left hand. The authentication unit determines that authentication is successful when the biometric information of each of the palm of the right hand and the palm of the left hand included in the authentication-related information matches the biometric information of each of the palm of the right hand and the palm of the left hand of the user stored in the storage unit, the password acquired by the authentication-related information acquisition unit matches the password of the user stored in the storage unit, the biometric information of at least one of the back of the right hand and the back of the left hand acquired by the authentication-related information acquisition unit matches the biometric information of at least one of the back of the right hand and the back of the left hand of the user stored in the storage unit, and the positional relationship between the palm of the right hand and the palm of the left hand indicated by the positional relationship information included in the authentication-related information satisfies the positional relationship when the camera captures the imaging data in a state where the user wears the glasses-type device. The information processing apparatus according to claim 6.

9. The information processing apparatus according to claim 1 or 2, further comprising a control unit that controls the glasses-type device to notify that authentication is in progress when the authentication request acquisition unit acquires the authentication request.

10. A glasses-type device equipped with the information processing apparatus according to claim 1 or 2.

11. A program that causes a computer to function as the information processing apparatus according to claim 1 or 2 when executed by the computer.

12. An information processing method executed by a computer, an authentication request acquisition step of acquiring an authentication request including imaging data captured by a camera mounted on a glasses-type device, the imaging data capturing the palm of the right hand and the palm of the left hand; an authentication-related information acquisition step of acquiring authentication-related information including biometric information of each of the palm of the right hand and the palm of the left hand and positional relationship information indicating the positional relationship between the palm of the right hand and the palm of the left hand, using the imaging data included in the authentication request. When the biometric information of each of the right palm and the left palm included in the authentication-related information matches the biometric information of each of the right palm and the left palm of the user stored in the storage unit provided in the computer, and the positional relationship of the right palm and the left palm indicated by the positional relationship information included in the authentication-related information satisfies the positional relationship when the camera captures the imaging data in a state where the user wears the glasses-type device, it is determined that the authentication is successful, and an authentication step An information processing method comprising the above.

Images