Multi-factor authentication for virtual reality

Abstract

Authenticating a virtual reality (VR) system using multiple authentication factors includes: for a first factor of the multiple authentication factors, collecting a password entered into a virtual keyboard, wherein the password is entered by a user selecting a series of data including numbers, letters, or images on a virtual keyboard displayed on a display of the VR system; and for a second factor of the multiple authentication factors, collecting a biometric fingerprint from movement of the VR system.

Description

Technical Field

[0001] The present disclosure relates to virtual reality (VR) systems, and more particularly, to multi-factor authentication for VR systems. Background Art

[0002] As virtual reality (VR) is gaining popularity, some VR applications may access sensitive or confidential information in the future. Therefore, more robust authentication may be required in the future.

[0003] Currently, most VR systems use a virtual keyboard displayed in a head-mounted display (HMD) to input digital information. In these systems, the user activates the keyboard using hand gesture recognition through a data glove or a recognition pen (wand) pointing to the displayed keys. However, these types of user interfaces are complex and cumbersome. Summary of the invention

[0004] The present disclosure provides multi-factor authentication applicable to VR systems using a head mounted display (HMD).

[0005] In one embodiment, a method for authenticating a VR system using multiple authentication factors is disclosed. The method includes: for a first factor of the multiple authentication factors, collecting a password entered into a virtual keyboard, wherein the password is entered by a user selecting a series of data including numbers, letters, or images on a virtual keyboard displayed on a display of the VR system; and for a second factor of the multiple authentication factors, collecting a biometric fingerprint from movement of the VR system.

[0006] In one embodiment, the VR system is a head mounted display (HMD). In one embodiment, the method further comprises displaying a virtual keyboard on the hemisphere in a fixed position within the hemisphere. In one embodiment, the virtual keyboard is arranged to randomly display at least ten keys on the hemisphere. In one embodiment, the password is entered by looking at the direction of the button on the virtual keyboard to select the button. In one embodiment, the selected button is verified by making a predefined confirmation head gesture. In one embodiment, the selection of the selected button is removed by making a predefined deselection head gesture. In one embodiment, a biometric fingerprint as reflected in a predefined confirmation head gesture and a predefined deselection head gesture is collected from the movement of the VR system. In one embodiment, collecting the biometric fingerprint comprises: measuring the acceleration of the predefined confirmation head gesture and the predefined deselection head gesture; and normalizing the acceleration. In one embodiment, the method further comprises comparing the collected biometric fingerprint with a fingerprint in a fingerprint database; and identifying the user when a fingerprint match is made. In one embodiment, a fingerprint match refers to a similarity between the collected biometric fingerprint and a reference fingerprint for fingerprint matching within a defined range.

[0007] In another embodiment, a system for authenticating a VR system using multiple authentication factors is disclosed. The system includes: a first factor of authentication collector configured to collect a password entered into a virtual keyboard, wherein the password is entered by a user selecting a series of data including numbers or images on a virtual keyboard displayed on a display of the VR system; and a second factor of authentication collector configured to collect biometric fingerprints from the movement of the VR system.

[0008] In one embodiment, the VR system is a head mounted display (HMD). In one embodiment, the system further comprises a projector configured to display a virtual keyboard on the hemisphere in a fixed position within the hemisphere. In one embodiment, the virtual keyboard is arranged to randomly display at least ten keys on the hemisphere. In one embodiment, the second factor authentication collector is configured to collect biometric fingerprints as reflected in a predefined head posture from the movement of the VR system. In one embodiment, the second factor authentication collector collects biometric fingerprints by measuring the acceleration of the predefined head posture. In one embodiment, the system further comprises: a comparator configured to compare the collected biometric fingerprints with fingerprints in a fingerprint database; and an identifier configured to identify the user when a fingerprint match is made.

[0009] In yet another embodiment, a device for authenticating a VR system using multiple authentication factors is disclosed. The device includes: a first component for collecting a password entered into a virtual keyboard for a first factor of the multiple authentication factors, wherein the password is entered by a user selecting a series of data including numbers or images on a virtual keyboard displayed on a display of the VR system; and a second component for collecting a biometric fingerprint from movement of the VR system for a second factor of the multiple authentication factors.

[0010] In one embodiment, the second component for collecting collects biometric fingerprints from the movement of the VR system as reflected in a predefined head pose. In one embodiment, the second component for collecting collects biometric fingerprints by measuring acceleration of the predefined head pose.

[0011] This description describes various aspects of the disclosure by way of example, and other features and advantages should be apparent from this description. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] Details regarding both the structure and operation of the present disclosure may be obtained, in part, by studying the accompanying drawings, in which like reference numerals refer to like parts, and in which:

[0013] Figure 1 is a layout of virtual keys (keypad) displayed on a sphere according to one embodiment of the present disclosure;

[0014] Figure 2 is a layout of virtual keys displayed on a sphere but projected in polar coordinates according to one embodiment of the present disclosure;

[0015] Figure 3 is a flow chart illustrating a process for a detection phase according to one embodiment of the present disclosure;

[0016] Figure 4 is a flowchart illustrating a process for detecting and confirming a head gesture according to one embodiment of the present disclosure;

[0017] Figure 5 is a flow chart illustrating a process for authenticating a VR system using multiple authentication factors according to one embodiment of the present disclosure; and

[0018] Figure 6 is a block diagram illustrating a system for authenticating a VR system using multiple authentication factors according to one embodiment of the present disclosure. DETAILED DESCRIPTION

[0019] As mentioned above, current virtual reality (VR) systems may use complex and cumbersome user interfaces.

[0020] Some embodiments of the present disclosure provide multi-factor authentication suitable for VR systems using head-mounted displays (HMDs). For example, multi-factor authentication uses at least two of the following: (1) some factor that the user knows, such as a password; (2) some factor that the user has, such as a mobile phone or a physical token; and (3) some factor that the user has, such as the user's fingerprint, voice, or characteristic movement. In one embodiment, the fingerprint may include a biometric signature. After reading these descriptions, it will be clear how to implement the present disclosure in various embodiments and applications. Although various embodiments of the present disclosure will be described herein, it is understood that these embodiments are presented by way of example only and not limitation. Thus, this detailed description of the various embodiments should not be construed as limiting the scope or breadth of the present disclosure.

[0021] In one embodiment, multi-factor authentication includes entering a password and collecting a biometric fingerprint while wearing the HMD. For example, the user enters a password by viewing a series of keys on a virtual keyboard displayed in the HMD to select a series of data such as numbers, letters, symbols, and / or images. The biometric fingerprint can be collected by monitoring the movement of the system (such as HMD movement (which represents the movement of the user's head)) or the movement of the user (such as hand or body movement) (e.g., captured by a camera).

[0022] In a specific implementation of the first factor authentication (i.e., entering a password), the following steps may be taken after the user puts on the HMD. Initially, the application of the VR system displays a virtual keyboard in the HMD. For example, a numeric keypad for entering a personal identification number (PIN) may be displayed in the HMD.

[0023] Figure 1 1 is a layout 100 of a virtual keyboard or keys displayed on a sphere according to one embodiment of the present disclosure. In this embodiment, the virtual keys (which may be configured as an ordered keyboard or a random display of numbers) are in fixed positions within the sphere where the HMD displays and the user views the keys. In one embodiment, a six-digit PIN may be used as a password. Thus, the application displays a keypad of ten buttons in a hemisphere in front of the user. The order of the ten buttons is random.

[0024] In one embodiment, in order to select a key for entering a password on the keypad, the user moves the head in the direction of the button (or key or other displayed virtual item). The button the user is looking at is then highlighted as the selected button. The user verifies the selected button by making a predefined confirmation head gesture (such as a vertical head swing). The highlighting of the selected button can be removed by a predefined deselection head gesture (such as a horizontal head swing). Thus, the user enters the password by continuously looking at the key to be selected and confirming / deselecting with a head gesture.

[0025] In one embodiment, for security reasons, the layout of the virtual keys is at least randomized for each new password entry. Thus, the randomization of the layout prevents disclosure of the password (by observing the movement of the head) to unauthorized persons. In some embodiments, the layout can even be randomized after each key selection to prevent leakage of information (i.e., the password). In another embodiment, the password is a sequence of pictograms to be found in a landscape, rather than alphanumeric characters.

[0026] In a specific implementation of second factor authentication (i.e., biometrics), the application of the VR system measures the biometrics to generate a biometric fingerprint. For gait or manuscript signing, the movement of the user's head for a known gesture is unique to the user. For example, confirming head gestures and deselecting head gestures can be used for this purpose. In one implementation, the biometric is measured as acceleration projected on two axes of the head for both confirming and deselecting gestures. After being standardized, the parameters of the gesture (e.g., acceleration) form a unique biometric fingerprint.

[0027] In a biometric system, the initial enrollment phase records several instances of gestures or movements. For the initial enrollment phase, the user repeatedly performs confirming head gestures and deselecting head gestures. Thus, the enrollment phase normalizes the inputs and averages them to generate a reference fingerprint. During the selection of keys, the application records the continuously captured biometric fingerprints.

[0028] In one embodiment, the application of the VR system can access a fingerprint database. For each registered user, the fingerprint database maintains a record including a user ID (which unambiguously identifies the user) and a reference fingerprint of the user. In one embodiment, the reference fingerprint is a series of data AR j ={δx j ,δy j}, where δx represents the azimuth acceleration and δy represents the elevation acceleration. This series is defined after a typical biometric enrollment phase, where the user performs several confirmation head gestures and the enrollment performs normalization and statistical calculations to extract the user's "average" fingerprint.

[0029] To authenticate the user, the application can verify two conditions: (1) the password entered via the virtual key matches the user's password; and (2) at least one measured biometric fingerprint matches the user's reference fingerprint (i.e., the user is authenticated). In one embodiment, fingerprint matching means that the similarity between the measured biometric fingerprint and the reference fingerprint is within a defined range.

[0030] Figure 2 200 is a layout of virtual keys displayed on a sphere but projected in polar coordinates according to one embodiment of the present disclosure. The horizontal axis (i.e., x-axis) represents the azimuth angle, while the vertical axis (i.e., y-axis) represents the elevation angle. The origin is the orientation of the HMD when the authentication process is started.

[0031] In one embodiment, each displayed button or key (ie, K i ) consists of a triple (K i ={x i ,y i ,V i}) means, where: x i represents the azimuth of the center of the displayed key in degrees, and x i ∈]-90,90[;y i represents the elevation angle of the center of the displayed key in degrees, and y i ∈]-90,90[; and V i represents the value of the key, and V i ∈{0..9}. Therefore, in Figure 2 In the illustrated embodiment, K1 = {0, 30, 0} and K4 = {-60, 0, 6}.

[0032] In one embodiment, the HMD is in polar coordinates {x user ,y user} to the application periodically reporting the direction of the user's head (i.e., gaze) to the application. Therefore, initially, if both conditions in equation [1] are true, the application determines that the user is looking at K i .

[0033]

[0034] Wherein R represents a fixed value. In one embodiment, the value R is the radius of a circle surrounding the key.

[0035] In one embodiment, the selection key is processed as follows.

[0036] First, when the application determines that the user is looking at or gazing at a key (i.e., equation [1] is satisfied for a value of i), the application graphically highlights the focused key. When the user's gaze moves away from the key (i.e., equation [1] is no longer satisfied for the corresponding value of i), the application removes the highlighting.

[0037] Second, if the key is highlighted within a given period of time (e.g., 100 milliseconds), the application enters a head gesture detection mode with three sub-modes. In the first sub-mode, if a confirmation head gesture is detected, the application detects the key by using a value V i Record key selections. Visible information and audible signals may inform the user of key selections. The application also records measured biometric fingerprints. In a second sub-mode, if a deselect head gesture is detected, the application removes the highlight of the selected key. In a third sub-mode, if no known gesture is detected, the application removes the current highlight.

[0038] In one embodiment, the password acquisition process waits for the user to select a predetermined number of keys (e.g., after selecting six keys). Once the predetermined number of keys are selected, the application enters the authentication verification phase.

[0039] In another embodiment, the HMD is configured with an eye gaze or eye movement tracking system that registers the direction of eye gaze or eye movement in the visor instead of the position of the HMD. user ,y user} is a combination of the position of the HMD and the direction of eye gaze. Thus, this embodiment allows keys to be selected with less head movement. This is particularly useful for relatively large keyboards (e.g., larger than a ten-key numeric keypad). In this embodiment, only the acceleration of the HMD is used to derive the measured biometric fingerprint (i.e., eye tracking information is not used to derive the measured biometric fingerprint).

[0040] In one embodiment, when detecting a head gesture, a vertical shake of the user's head is considered to confirm the head gesture, while a horizontal shake of the head is considered to deselect the head gesture.

[0041] In one embodiment, to detect the head posture, the application records the acceleration of the head in polar coordinates every n milliseconds during a predetermined number of seconds. Thus, the application has a series of samples A j ={δx j ,δy j}, where δx j represents the azimuthal acceleration during interval j, and δyj represents the elevation acceleration during the same interval j.

[0042] In one embodiment, the process of detecting and confirming head gestures and canceling head gestures can be divided into four stages. For example, stage 1 represents a pause, in which the HMD is "stationary" (which means that the user has no perceptible movement). Stage 2 represents movement in a first direction (e.g., up or down for confirming head gestures, and right or left for canceling head gestures). Stage 3 represents movement in a second direction opposite to the first direction (i.e., if the first direction is up, then the second direction is down, if the first direction is right, then the second direction is left, and vice versa). Stage 4 represents a pause, in which the HMD is "stationary".

[0043] In one embodiment, a set of parameters (listed below) characterize the above-mentioned stages.

[0044] ε stil = acceleration threshold for pause.

[0045] ε move = acceleration threshold of the head swing.

[0046] Δ still = Minimum duration of a pause (ie, phases 1 and 4).

[0047] The parameter (Δ still ) is measured in cycles. Therefore, the actual minimum duration of the pause is Δ still ×n milliseconds.

[0048] Δ mov1 = shortest duration of the first move (ie, phase 2).

[0049] Δ mov2 = minimum duration of the second move (ie, phase 3).

[0050] Δ max = maximum duration of each phase (i.e., if the phase is within Δ max ×If it is not completed within n milliseconds, the stage fails).

[0051] Sample A j Belongs to one of the following categories; stationary, up, down, right, left, or bad. The following set of equations defines the categories:

[0052]

[0053] After the parameters have been defined as described above, the following process defines the success or failure of the phase completion.

[0054] Figure 3 3 is a flow chart illustrating a process 300 for the detection phase according to one embodiment of the present disclosure. In one embodiment, at block 302, the process 300 verifies whether there is a Δ mov Continuous samples. For phases 1 and 4, the class is stationary, and Δ mov =Δ still For stage 2, the categories are down for confirming head pose and right for deselecting head pose, and Δ mov =Δ mov1 For stage 3, the categories are Up for confirming the head pose and Left for deselecting the head pose, and Δ mov =Δ mov2 If there are not enough consecutive samples, then at block 316 the detection fails.

[0055] If there are enough samples, then the process waits at block 324 until a sample has an unexpected class, or the total number of samples analyzed reaches a threshold value Δ at block 330. max In the first case (i.e., there is an unexpected category where the user initiates another "move", e.g., from top to bottom), the detection is successful at block 326. In the second case (i.e., the user stays in the same category for a long time, e.g., a long pause), the detection is successful but too long at block 332.

[0056] In a particular embodiment, initially, at block 310, both Counter 1 and Counter 2 are set to zero. At block 312, a sample is acquired, and at block 314, a determination is made whether the sample is of the appropriate class. If the sample is not of the appropriate class, then at block 316, detection fails. Otherwise, if the sample is of the appropriate class, then at block 318, both counters, Counter 1 and Counter 2, are incremented. At block 320, a determination is made whether Counter 1 is less than Δ mov If counter 1 is less than Δ mov , then more samples are acquired at block 312. Otherwise, samples are acquired at block 322 to determine at block 324 whether the acquired samples are of an unexpected class, or whether the total number of samples analyzed has reached a threshold value Δ max If it is determined at block 324 that the acquired sample is of an unexpected class, then at block 326 the detection is declared successful. Otherwise, if it is determined at block 324 that the acquired sample is of the appropriate class, then at block 328 counter 2 is incremented. Then, at block 330, it is determined whether the total number of samples analyzed has reached a threshold (i.e., counter 2 < Δ max). If the total number of samples has reached the threshold, then at block 332, the test is declared successful but took too long. Otherwise, another sample is obtained at block 322.

[0057] Figure 4 4 is a flow chart illustrating a process 400 for detecting and confirming a head gesture according to one embodiment of the present disclosure. The process 400 describes a series of stage detection steps.

[0058] exist Figure 4 In the illustrated embodiment of FIG. 4 , the process 400 performs the following steps by determining the duration (Δ mov ) should be equal to or greater than the minimum duration of the pause (Δ still ) to attempt to detect stage 1, where the expected category is "stationary" (stage 1). Then, stage 1 detection is performed at box 412. If the stage detection fails at box 420, then the stage detection failure is declared at box 422, meaning that the user's head has moved. If it is determined at box 424 that the stage detection is successful, but the duration of the pause is too long, then detection continues at box 412 until the appropriate stage 1 is determined at box 424.

[0059] exist Figure 4 In the illustrated embodiment, once stage 1 has been detected, process 400 proceeds by determining the duration of the movement (Δ mov ) should be equal to or greater than the minimum duration of the first move (Δ mov1 ) to attempt to detect phase 2 (i.e., the user's head moves downward), where the expected category is "down" (phase 2). Then, at block 432, a phase 2 detection is performed. If the phase detection fails at block 434, then at block 436, the overall detection is declared to have failed and the key is deselected. If it is determined at block 438 that the phase detection succeeded but the duration of the first movement (Δ mov1 ) is too long, then the overall detection is declared to have failed at box 456 and the key is deselected.

[0060] exist Figure 4 In the illustrated embodiment, once stage 2 has been detected, process 400 proceeds by determining the duration of the movement (Δ mov ) should be equal to or greater than the minimum duration of the second move (Δ mov2 ) to attempt to detect phase 3 (i.e., the user's head moves upward), where the expected category is "up" (phase 3). Then, at block 442, a phase 3 detection is performed. If the phase detection fails at block 444, then at block 446, the overall detection is declared to have failed and the key is deselected. If it is determined at block 448 that the phase detection succeeded but the duration of the second movement (Δmov2 ) is too long, then the overall detection is declared to have failed at box 456 and the key is deselected.

[0061] exist Figure 4 In the illustrated embodiment, once stage 3 has been detected, process 400 proceeds by determining the duration of the movement (Δ mov ) should be equal to or greater than the minimum duration of the pause (Δ still ) to attempt to detect stage 4 (i.e., the user remains stationary), where the expected category is "stationary" (stage 4). Then, at block 452, a stage 4 test is performed. If the stage test fails at block 454, then at block 456, the overall test is declared to have failed and the key is deselected. If it is determined at block 454 that the stage test is successful regardless of how long it is, then at block 458, the overall test is declared to have succeeded.

[0062] Figure 4 The illustrated embodiment of can be extended to a second process for detecting and deselecting a head gesture. Therefore, in the second process, for process 400, stages 2 and 3 will use parameters for horizontal head swings instead of parameters for vertical head swings.

[0063] exist Figure 4 In an alternative embodiment of the illustrated embodiment, the direction of the vertical swing head is selected to be upward for stage 2 and to be reversed (ie, downward) for stage 3.

[0064] Figure 5 is a flow chart illustrating a process 500 for authenticating a VR system using multiple authentication factors according to one embodiment of the present disclosure. In one embodiment, the process 500 collects a password entered into a virtual keyboard for a first factor of the multiple authentication factors at block 510, wherein the password is entered by a user selecting a series of data including numbers and / or images on a virtual keyboard displayed on a display of the VR system. Then, at block 520, a biometric fingerprint is collected from the movement of the VR system for a second factor of the multiple authentication factors.

[0065] Figure 6is a block diagram illustrating a system 600 for authenticating a VR system using multiple authentication factors according to one embodiment of the present disclosure. In one embodiment, the system 600 includes a first factor authentication collector 610 and a second factor authentication collector 620. In one embodiment, the first factor authentication collector 610 is configured to collect a password entered into a virtual keyboard, wherein the password is entered by a user selecting a series of data including numbers and / or images on a virtual keyboard displayed on a display of the VR system. In one embodiment, the second factor authentication collector 620 is configured to collect biometric fingerprints from the movement of the VR system.

[0066] The description of the embodiments disclosed herein is provided to enable any person skilled in the art to make or use the present disclosure. Many modifications to these embodiments will be readily apparent to those skilled in the art, and the principles defined herein may be applied to other embodiments without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure is not intended to be limited to the embodiments shown herein, but should be given the widest scope consistent with the principles and novel features disclosed herein.

[0067] Various embodiments of the present disclosure are implemented with electronic hardware, computer software, or a combination of these technologies. Some embodiments include one or more computer programs executed by one or more computing devices. In general, a computing device includes one or more processors, one or more data storage components (e.g., volatile or non-volatile memory modules and persistent optical and magnetic storage devices, such as hard disks and floppy disk drives, CD-ROM drives, and tape drives), one or more input devices (e.g., game controllers, mice, and keyboards), and one or more output devices (e.g., display devices).

[0068] A computer program includes executable code that is typically stored in a persistent storage medium and then copied to memory at run time. At least one processor executes the code by retrieving the program instructions from memory in a prescribed order. When executing the program code, the computer receives data from input and / or storage devices, performs operations on the data, and then delivers the resulting data to output and / or storage devices.

[0069] It will be appreciated by those skilled in the art that the various illustrative modules and method steps described herein can be implemented as electronic hardware, software, firmware or aforesaid combination. In order to clearly illustrate this interchangeability of hardware and software, various illustrative modules and method steps are generally described herein according to their functions. Whether this functionality is implemented as hardware or software depends on specific application and the design constraints imposed on the whole system. The technician can implement the described functions in various ways for each specific application, but this implementation method decision should not be interpreted as causing departure from the scope of the present disclosure. In addition, the functional grouping in the module or step is for ease of description. A specific function can be moved from one module or step to another module or step without departing from the present disclosure.

[0070] In the specific implementation of the present disclosure, not all features of each of the above examples are required. In addition, it is to be understood that the description and drawings presented herein represent the subject matter widely contemplated by the present disclosure. It is further understood that the scope of the present disclosure fully encompasses other embodiments that will become clear to those skilled in the art, and the scope of the present disclosure is therefore limited only by the appended claims.

Claims

1. A method for authenticating a virtual reality (VR) system using multiple authentication factors, the method comprising: For a first factor of the plurality of authentication factors, collecting a password input into a virtual keyboard, wherein the password is input by a user selecting a series of data including numbers, letters, or images on the virtual keyboard displayed on a display of the VR system; and For a second factor of the plurality of authentication factors, collecting a biometric fingerprint from movement of the VR system, The direction of the user's eye gaze or eye movement is registered, and the combination of the direction of the eye gaze or eye movement and the position of the display is detected as a polar coordinate value {x user ,y user }, x user represents the horizontal azimuth, and y user represents the vertical elevation angle, wherein collecting the biometric fingerprint comprises measuring acceleration in the form of polar coordinates {δx, δy} of a predefined confirmation head pose and a predefined deselection head pose, the acceleration being only the acceleration of the display without including eye tracking information, δx representing azimuth acceleration, and δy representing elevation acceleration, and The predefined confirmation head gesture and the predefined deselection head gesture are detected using a combination of the following multiple stages: a first pause when the VR system is still, the VR system moves in a first direction, the VR system moves in a second direction opposite to the first direction, and a second pause when the VR system is still, wherein for each stage, the minimum duration and maximum duration corresponding to the stage are used to determine the success, failure or too long success time of the stage detection.

2. The method of claim 1, wherein the VR system is a head mounted display (HMD).

3. The method of claim 1, further comprising The virtual keyboard on the hemisphere is displayed in a fixed position within the hemisphere. The method of claim 3 , wherein the virtual keyboard is arranged to display at least ten keys randomly on the hemisphere.

5. The method of claim 1, wherein the password is input by gazing in the direction of a button on the virtual keyboard to select the button. The method of claim 5 , wherein the selected button is verified by making a predefined confirmation head gesture. The method of claim 6 , wherein the selected button is deselected by making a predefined deselection head gesture.

8. The method of claim 7, wherein the biometric fingerprint as reflected in a predefined confirmation head gesture and a predefined deselection head gesture is collected from movement of the VR system.

9. The method according to claim 7, in, The acceleration is normalized.

10. The method of claim 1, further comprising: comparing the collected biometric fingerprints with fingerprints in a fingerprint database; as well as The user is identified when a fingerprint match is made.

11. The method of claim 10, wherein the fingerprint matching means that the similarity between the collected biometric fingerprint and the reference fingerprint for the fingerprint matching is within a defined range.

12. A system for authenticating a virtual reality (VR) system using multiple authentication factors, the system comprising: A first factor authentication collector configured to collect a password input into a virtual keyboard, wherein the password is input by a user selecting a series of data including numbers or images on the virtual keyboard displayed on a display of the VR system; and A second factor authentication collector configured to collect biometric fingerprints from the movement of the VR system, The direction of the user's eye gaze or eye movement is registered, and the combination of the direction of the eye gaze or eye movement and the position of the display is detected as a polar coordinate value {x user ,y user }, x user represents the horizontal azimuth, and y user represents the vertical elevation angle, wherein collecting the biometric fingerprint comprises measuring acceleration in the form of polar coordinates {δx, δy} of a predefined confirmation head pose and a predefined deselection head pose, the acceleration being only the acceleration of the display without including eye tracking information, δx representing azimuth acceleration, and δy representing elevation acceleration, and The predefined confirmation head gesture and the predefined deselection head gesture are detected using a combination of the following multiple stages: a first pause when the VR system is still, the VR system moves in a first direction, the VR system moves in a second direction opposite to the first direction, and a second pause when the VR system is still, wherein for each stage, the minimum duration and maximum duration corresponding to the stage are used to determine the success, failure or too long success time of the stage detection.

13. The system of claim 12, wherein the VR system is a head mounted display (HMD).

14. The system of claim 12, further comprising A projector is configured to display the virtual keyboard on the hemisphere in a fixed position within the hemisphere.

15. The system of claim 14, wherein the virtual keyboard is arranged to display at least ten keys randomly on the hemisphere.

16. The system of claim 12, wherein the second factor authentication collector is configured to collect the biometric fingerprint from movement of the VR system as reflected in a predefined head pose.

17. The system of claim 16, wherein the second factor authentication collector collects the biometric fingerprint by measuring acceleration of a predefined head gesture.

18. The system of claim 12, further comprising: a comparator configured to compare the collected biometric fingerprint with fingerprints in a fingerprint database; as well as An identifier is configured to identify the user when a fingerprint match is made.

19. A device for authenticating a virtual reality (VR) system using multiple authentication factors, the device comprising: a first component for collecting a password input into a virtual keyboard for a first factor among the plurality of authentication factors, wherein the password is input by a user selecting a series of data including numbers or images on the virtual keyboard displayed on a display of the VR system; as well as a second component for collecting a biometric fingerprint from movement of the VR system for a second factor of the plurality of authentication factors, The direction of the user's eye gaze or eye movement is registered, and the combination of the direction of the eye gaze or eye movement and the position of the display is detected as a polar coordinate value {x user ,y user }, x user represents the horizontal azimuth, and y user represents the vertical elevation angle, wherein collecting the biometric fingerprint comprises measuring acceleration in the form of polar coordinates {δx, δy} of a predefined confirmation head pose and a predefined deselection head pose, the acceleration being only the acceleration of the display without including eye tracking information, δx representing azimuth acceleration, and δy representing elevation acceleration, and The predefined confirmation head gesture and the predefined deselection head gesture are detected using a combination of the following multiple stages: a first pause when the VR system is still, the VR system moves in a first direction, the VR system moves in a second direction opposite to the first direction, and a second pause when the VR system is still, wherein for each stage, the minimum duration and maximum duration corresponding to the stage are used to determine the success, failure or too long success time of the stage detection.

20. The apparatus of claim 19, wherein the second means for collecting collects the biometric fingerprint from movement of the VR system as reflected in a predefined head pose.

21. The apparatus of claim 20, wherein the second means for collecting collects the biometric fingerprint by measuring acceleration of a predefined head posture.

Images