How to unlock electronic devices

Abstract

A method for unlocking software includes providing an electronic device having a processing unit and a gesture input device connected thereto. Detecting an input gesture operable to initiate password input, wherein the electronic device is in a software locked state, and randomly assigning a predefined set of input gestures to a predefined set of password symbols. The method for unlocking software additionally includes detecting one of the assigned input gestures via the gesture input device, and comparing an input password symbol corresponding to the detected input gesture with a stored unlock password via the processing unit. Furthermore, in the event that the input password symbol matches the stored unlock password, the method enables operation of the electronic device in the software unlocked state.

Description

Technical Field

[0001] The present disclosure relates generally to unlocking a software locked electronic device, and more particularly to unlocking an electronic device operable to identify a gesture sequence on a touch sensitive device and / or camera. Background Art

[0002] With the rapid advancement of technology, manufacturers of mobile devices (e.g., head mounted displays, smartphones, etc.) are constantly challenged to achieve mobile convenience by adding greater functional capabilities in a smaller form factor by leveraging user interface features. For example, in addition to the already advanced data capabilities of mobile devices, mobile electronic devices need to include software lock and unlock functions to provide privacy and data protection.

[0003] Head mounted displays (HMDs) are being developed for a wide variety of uses, including military, commercial, industrial, firefighting, and entertainment applications. For many of these applications, there is particular value in providing security features, such as software lockout of the HMD. Because HMDs are becoming increasingly lightweight and are not fixed to any physical location, they can be easily taken away or used by unauthorized individuals.

[0004] The goal of greater functionality is sometimes inconsistent with unlocking an electronic device because the user may require additional actions such as entering a password. Speaking a password while within audible distance of another person or a recording device may not provide reliable security. For electronic devices that do not have a keyboard input device, typing a password is not an option. Similarly, the electronic device may not have other input devices (such as fingerprint or biometric scanners) available or cameras with facial recognition capabilities, etc. In such situations, a touchpad or touch screen may be the preferred electronic input device. Therefore, a convenient and secure method for unlocking a previously software-locked electronic device is needed. Summary of the invention

[0005] The present disclosure provides a software unlocking method for unlocking functions of an electronic device, and an electronic device manufactured using the software unlocking method.

[0006] In a first exemplary embodiment, a method of unlocking software includes providing an electronic device having a processing unit and a gesture input device connected thereto. The method further includes detecting an input gesture operable to initiate a password input, wherein the electronic device is in a software locked state, and randomly assigning a predefined set of input gestures to a predefined set of password symbols. The method of unlocking software additionally includes detecting one of the assigned input gestures via the gesture input device, and comparing an input password symbol corresponding to the detected input gesture with a stored unlock password via the processing unit. In addition, in the event that the input password symbol matches the stored unlock password, the method enables operation of the electronic device in the software unlocked state.

[0007] In a second exemplary embodiment, an electronic device includes a processing unit and a gesture input device connected to the processing unit. The electronic device further includes a projector operable to generate image-bearing light connected to the processing unit, and a planar waveguide assembly operable to couple into the image-bearing light, wherein the planar waveguide assembly is operable to generate a virtual image display. In addition, the gesture input device is operable to detect an input gesture to initiate a password input during a software locked state, and the processing unit is operable to randomly assign a predefined set of input gestures to a predefined set of password symbols. In addition, the virtual image display is operable to display an input password screen that shows a randomly assigned set of input gestures corresponding to the set of password symbols. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] The accompanying drawings are incorporated herein as part of the specification. The accompanying drawings described herein illustrate embodiments of the presently disclosed subject matter and illustrate selected principles and teachings of the present disclosure. However, the accompanying drawings do not illustrate all possible implementations of the presently disclosed subject matter and are not intended to limit the scope of the present disclosure in any way.

[0009] Figure 1A An electronic device according to an embodiment of the present disclosure is shown.

[0010] Figure 1B An electronic device according to an embodiment of the present disclosure is shown.

[0011] Figure 2 A portion of a software lock screen display is shown according to an embodiment of the present disclosure.

[0012] Figure 3 A portion of a password input screen according to an embodiment of the present disclosure is shown.

[0013] Figure 4 A portion of a password input screen according to an embodiment of the present disclosure is shown.

[0014] Figure 5is a flowchart of a software unlocking method according to an embodiment of the present disclosure.

[0015] Figure 6 is a flowchart of a software unlocking method according to an embodiment of the present disclosure.

[0016] Figure 7 is a flowchart of a software unlocking method according to an embodiment of the present disclosure.

[0017] Figure 8 is a flowchart of a software unlocking method according to an embodiment of the present disclosure.

[0018] Fig. 9 is a flowchart of a software unlocking method according to an embodiment of the present disclosure.

[0019] Fig.10 is a flowchart of a software unlocking method according to an embodiment of the present disclosure.

[0020] Fig.11 A portion of a password input screen according to an embodiment of the present disclosure is shown.

[0021] Fig.12 A multi-purpose mobile computing device according to an embodiment of the present disclosure is shown. DETAILED DESCRIPTION

[0022] It should be understood that the present invention may adopt various alternative orientations and step sequences, unless otherwise expressly specified. It should also be understood that the specific assemblies and systems illustrated in the drawings and described in the following specification are merely exemplary embodiments of the inventive concepts defined herein. Therefore, specific dimensions, directions, or other physical characteristics associated with the disclosed embodiments should not be considered restrictive unless otherwise expressly stated. In addition, within this section of the application, the same elements in the various embodiments described herein may generally be referred to by the same reference numerals, although they may not be used.

[0023] Unless otherwise specified, when the terms "first", "second", etc. are used herein, the terms do not necessarily indicate any sequential, continuous or priority relationship, but are merely used to more clearly distinguish one element or a group of elements from another element or a group of elements.

[0024] In the context of the present disclosure, the terms "viewer," "operator," "observer," and "user" are considered equivalent and refer to a person wearing an electronic device and / or using an electronic device to view an image.

[0025] As used herein, the term "set" refers to a non-empty set, since the concept of a collection of elements or members of a set is widely understood in elementary mathematics. Unless explicitly stated otherwise, the term "subset" is used herein to refer to a non-empty proper subset, i.e., a subset of a larger set having one or more members. For a set S, a subset may include the complete set S. However, a "proper subset" of a set S is strictly contained in the set S and excludes at least one member of the set S.

[0026] Head mounted displays (HMDs) are developed for a variety of uses, including military, commercial, industrial, firefighting, and entertainment applications. The HMD is operable to form a virtual color image that can be visually superimposed on a real world image located in the field of view of the HMD user. An optically transparent parallel plate waveguide (also known as a planar waveguide) transmits image-bearing light generated by a color projector system to the HMD user. The planar waveguide transmits the image-bearing light in a narrow space to guide the virtual image to the pupil of the HMD user and enables the virtual image to be superimposed on the real world image located in the field of view of the HMD user.

[0027] In such a conventional imaging light guide, a collimated, relatively angle-encoded light beam from a color image projector source is coupled into an optically transparent planar waveguide assembly through an input coupling optical device, such as an in-coupling diffractive optical device, which can be mounted or formed on the surface of a parallel-plate planar waveguide or disposed within the waveguide. Such a diffractive optical device can be formed as, but not limited to, a diffraction grating or a holographic optical element. For example, the diffraction grating can be formed as a surface relief grating. After propagating along the planar waveguide, the diffracted color image-bearing light can be directed back out of the planar waveguide through a similar output grating, which can be arranged to provide pupil expansion along one or more dimensions of the virtual image. In addition, one or more diffraction steering gratings can be optically positioned along the waveguide between the input and output gratings to provide pupil expansion in one or more dimensions of the virtual image. The image-bearing light output from the parallel-plate planar waveguide provides an extended eyebox for the viewer.

[0028] Optical systems such as HMDs can produce virtual image displays. In contrast to methods of forming real images, virtual images are not formed on a display surface. That is, if the display surface is positioned at the perceived location of the virtual image, no image will be formed on the surface. Virtual image displays have many inherent advantages for augmented reality presentations. For example, the apparent size of the virtual image is not limited by the size or location of the display surface. Additionally, the source object of the virtual image may be small; for example, a magnifying glass provides a virtual image of an object. By forming a virtual image that appears to be somewhat distant, a more realistic viewing experience can be provided compared to a system that projects a real image. Providing a virtual image also eliminates the need to compensate for screen artifacts, which may be necessary when projecting a real image.

[0029] HMDs typically do not have a keyboard device for input. However, an HMD may have a touch-sensitive pad or area on the device for gesture input. Alternatively, a camera may be used to capture input gestures, or a combination of camera and touchpad input may be used to capture input gestures. Providing software unlock functionality using gesture sensing and gesture recognition input devices of an HMD provides a secure method for unlocking software-locked electronic devices.

[0030] The method for unlocking a software-locked electronic device may enable a user to unlock the electronic device by identifying a gesture sequence including at least two consecutive gestures. In an embodiment, the method for unlocking a software-locked electronic device includes mapping distinguishable gestures to symbols (characters and / or numbers or other symbols) displayed to the user by a display device such as a virtual image display or a liquid crystal display (LCD), detecting a gesture sequence from an electronic touch-sensitive device and / or other gesture capture device, converting the sensed gesture input sequence into a symbol sequence, and comparing the symbol sequence with a previously defined password symbol sequence to determine whether to unlock the electronic device.

[0031] like Figure 1AAs illustrated in FIG. 1 , in an embodiment, the electronic device 10 includes an HMD in the form of glasses. The electronic device 10 may include at least a right temple arm 12 and a processing unit 14 having means for storing data, storing computer programs, and for executing computer programs. Additionally, the processing unit 14 is connected to a gesture input device 16. The gesture input device 16 is operable to transmit gestures to the processing unit 14. In an embodiment, the gesture input device 16 is a touchpad. The gesture input device 16 is operable to receive input from one or more fingers of a user 20 and / or input from a stylus. Those skilled in the relevant art will recognize that where an input gesture is described as being performed by a finger of the user 20, the input gesture may also be performed by a stylus. The gestures received by the gesture input device 16 may include, without limitation, a tap on the gesture input device 16, a swipe / drag on the gesture input device 16 in a front-to-backward direction, a swipe / drag on the gesture input device 16 in a rear-to-front direction, a swipe / drag on the gesture input device 16 in a top-to-bottom direction, a swipe / drag on the gesture input device 16 in a bottom-to-top direction, a swipe / drag on the gesture input device 16 in both the front-to-backward and rear-to-frontward directions (and vice versa), a swipe / drag on the gesture input device 16 in both the bottom-to-top and top-to-bottom directions (and vice versa), a swipe / drag on the gesture input device 16 in the front-to-backward-forward direction, a swipe / drag on the gesture input device 16 in the rear-to-frontward direction, and a swipe / drag on the gesture input device 16 in a bottom-to-top-to-bottom direction, and a swipe / drag on the gesture input device 16 in a top-to-bottom-to-top direction. The gesture input device 16 may further detect whether one finger, two fingers, or three fingers are used during a gesture. The processing unit 14 can convert the gesture sequence into a symbol sequence which is suitable for comparison with a stored symbol sequence serving as a stored unlocking code.

[0032] like Figure 1B , in an embodiment, the electronic device 10 may further include at least one camera 18 positioned to view gestures of the user 20. In an embodiment, the camera 18 is located adjacent to the periphery of the lens 22 of the glasses. The field of view of the camera 18 is generally located in front of the user 20. In another embodiment, the camera 18 is located in the left or right temple arm 12 of the glasses, and the field of view of the camera 18 is generally located to the side of the user 20.

[0033] The camera 18 is connected to the processing unit 14 and can be used to capture and recognize gestures of the user 20. The processor 14 is operable to convert the gestures captured by the camera 18 into a corresponding sequence of symbols for comparison with a stored unlock code.

[0034] The electronic device 10 includes a display, such as, but not limited to, a virtual image display or a physical display (eg, a screen and / or LCD). Figure 2 , the electronic device 10 displays a lock screen 30 (virtual or physical) to the user 20, indicating that the electronic device 10 is in a software locked state. In an embodiment, the displayed lock screen 30 includes at least a lock icon 32 indicating the software locked state of the electronic device 10. Other icons and / or text may be displayed to notify the user 20 that the electronic device 10 is in a software locked state. Other information such as, but not limited to, date 34A, time 34B, electronic charge state 34C, and battery charge level 34D may also be displayed on the lock screen 30.

[0035] The electronic device 10 may be in or may enter a sleep state, in which the display is turned off, thereby conserving the power level of the electronic device 10 during non-use periods. In an embodiment, any touch of the gesture input device 16 is a wake-up prompt for operating the electronic device 10 in the wake-up state. If the electronic device 10 is in the software lock state, the wake-up prompt causes the display to present the lock screen 30. Alternatively, a specific touch pattern on the gesture input device 16 may be used to wake up the electronic device 10. For example, the wake-up prompt may be a two-finger tap, a single finger held on the gesture input device 16 for a predefined period of time, or a single finger sliding gesture on the gesture input device 16. Other gestures may be defined to wake up the electronic device 10. The wake-up state is a state of the electronic device 10 that allows at least input from the gesture input device 16 and / or from the camera 18, and presents an image in the display of the electronic device 10. Input from other sensors (e.g., buttons, tilt / tip sensors, accelerometers, magnetometers, etc.) may be used to change the state of the electronic device 10 from the sleep state to the wake-up state, and if in the software lock state, will cause the lock screen 30 to be displayed.

[0036] In an embodiment, the touch-activated software unlocking method of the gesture input device 16 (see Figure 5-10 ).like Figure 3As shown in FIG. 1 , when the user 20 starts the software unlocking method, an input password screen 40 (virtual or physical) is displayed to the user 20. The input password screen 40 may include a password display area 42, in which an input password symbol 48 is displayed when the user 20 enters a gesture sequence. In an embodiment, the input password symbol 48 may be temporarily displayed in the password display area 42. After a predetermined period of time, the input password symbol 48 may be covered by a shielding symbol 46 or replaced by a shielding symbol 46 to hide the input password symbol 48. The shielding symbol 46 may be a circle, a square, etc. to indicate that the input password symbol 48 has been entered without displaying the input password symbol 48. In this way, the user 20 can track and know which password characters have been entered. The input password symbol 48 also informs the user 20 which gesture the electronic device 10 has recognized through the user's input gesture.

[0037] Continue to refer Figure 3 In an embodiment, the enter password screen 40 also includes a gesture mapping area 44, where a set of password symbols 50 are displayed together with corresponding gesture symbols 52. The gesture symbols 52 indicate input gestures that can be used with the gesture input device 16 and / or the camera 18 to enter a sequence of password symbols 50. Figure 3 As shown in FIG. 1 , in an embodiment, the complete set of password symbols 50 is the set The password symbol 50 may alternatively be a set of Other symbol sets, such as geometric shapes, may also be used as the password symbols 50 .

[0038] like Figure 3 As illustrated in , in an embodiment, a set of password symbols 56 are displayed below the password symbol 50. The password symbol 56 enables the password to be composed of a mixture of symbols from different symbol sets 50, 56. The corresponding gestures can be indicated by displaying the gesture symbol 52 next to the password symbol 50 and / or the password symbol 56. In an embodiment, the gesture symbols 52 and their corresponding input gestures relative to the gesture input device 16 and / or the camera 18 are as follows: “>” indicates a single finger forward swipe gesture, “<” indicates a single finger backward swipe gesture, “*” indicates a single finger tap gesture, “**” indicates a two finger tap gesture, “>>” indicates a two finger forward swipe gesture, “<<” indicates a two finger backward swipe gesture, “ "Indicates a single finger bottom-to-top swipe gesture," "Indicates a single finger top-to-bottom swipe gesture," ” indicates a two-finger bottom-to-top swipe gesture, and “ ” indicates a two-finger sliding gesture from top to bottom. A two-finger input gesture means that two fingers are used to touch the gesture input device 16 at the same time. Alternative gesture symbols 52 can be used to indicate password symbols 50 and password sub-symbols 56.

[0039] When an input gesture is performed, in addition to displaying the input password symbol 48 in the password display area 42, the gesture symbol 52 may be highlighted in the gesture mapping area 44. The highlighting may include any one or a combination of the following: changing the color of the gesture symbol 52, changing the font style of the gesture symbol 52 (e.g., italic and / or bold versus regular), underlining the gesture symbol 52, and / or displaying a box 54 or circle around the symbol. Figure 3 As illustrated in FIG. 1 , in an embodiment, the frame 54 that highlights the gesture symbol 52 when the corresponding input gesture is performed may include one or more broken / dashed lines around both the password symbol and the sub-symbols 50, 52 and the gesture symbol 52. Figure 4 As illustrated in FIG. 5 , in an embodiment, a frame 54 that highlights the gesture symbol 52 is located around the gesture symbol 52 when the corresponding input gesture is performed.

[0040] During the software unlocking method, other input gestures may be used for other functions. For example, a three-digit tap on the gesture input device 16 may be used to indicate that the input sequence for password entry will restart at the beginning, erasing any previously entered password symbols. Alternatively, holding a single finger on the gesture input device 16 for at least a predefined time interval (e.g., two seconds) may be used to indicate that the input sequence for password entry will restart, erasing any previously entered password symbols.

[0041] When the camera 18 is used as an input gesture capture device, a "swipe" may be a movement of one or more fingers in the field of view of the camera 18. For example, a forward swipe may be a movement of one or more fingers from left to right, a backward swipe may be a movement of one or more fingers from right to left, an upward swipe may be a vertical movement of one or more fingers from bottom to top, and a downward swipe may be a vertical movement of one or more fingers from top to bottom. A "tap" gesture may be a motion of flexing one or more fingers in the field of view of the camera 18.

[0042] like Figure 4 , the input password screen 70 includes randomly assigned gesture symbols 52. When the software unlocking method starts, the input gestures can be randomly assigned to the password symbols 50 and the password sub-symbols 56. In this way, a person who observes the user 20 and sees the input gesture sequence for unlocking the electronic device 10 will not be able to unlock the electronic device 10 by utilizing the same gesture sequence. Therefore, the input gesture sequence can be made public, or the input gesture sequence can be observed by the public without revealing the actual unlock password.

[0043] like Figure 5 , in an embodiment, the software unlocking method 90 begins when the electronic device 10 is in a software locked state 100. To start the software unlocking method 90, in step 102, the user 20 provides an input gesture to the gesture input device 16 and / or the camera 18. In an embodiment, the input gesture that starts the software unlocking method 90 is one or more taps. In an embodiment, the software unlocking method 90 is started by pressing the button 24 of the electronic device 10. Step 102 may include randomly assigning the input gesture 52 to the password symbols and sub-symbols 50, 56. The next step 104 of the software unlocking method 90 clears any previously entered input gestures and causes the display to present the input password screen 40. Step 106 captures the input gesture of the user 20. Step 108 converts the input gesture into an input password symbol 48 (also referred to as an input character). In step 110, the input password symbol 48 is compared with the stored unlock password. Step 110 can be initiated by the user 20 providing an input gesture indicating that the password input sequence is completed. For example, the "enter" password input gesture can be a simultaneous top-to-middle and bottom-to-middle finger slide, i.e., a pinch. Step 112 takes action based on a comparison of the input password symbol 48 with the stored unlock password. The comparison indicates whether the input password symbol 48 matches or does not match the stored unlock password. If the input password symbol 48 matches the stored unlock password, the software unlock method 90 proceeds to step 116. In step 116, the electronic device 10 is unlocked and the software is operable, as indicated in step 120. If the input password symbol 48 does not match the stored unlock password, the software unlock method 90 proceeds to step 114 and the input password symbol 48 is cleared. The software unlock method 90 then returns to step 104 so that another sequence of input gestures can be obtained. Step 114 can also include randomly assigning input gestures 52 to password symbols and sub-symbols 50, 56.

[0044] like Figure 6, in an embodiment, the software unlocking method 150 begins when the electronic device 10 is in the software locked state 152. Step 154 ​​starts the software unlocking method 152. In an embodiment, the input gesture that starts the software unlocking method 150 may be one or more taps. In an embodiment, the software unlocking method 90 is started by pressing the button 24 of the electronic device 10. Step 156 clears any previous input gestures and displays the input password screen 40. Step 156 may also include randomly assigning the input gesture 52 to the password symbol and the sub-symbol 50, 56. Step 158 captures a single input gesture. Step 160 compares the input gesture with a predefined cancel gesture. If the input gesture is a cancel gesture, the software unlocking method 150 returns to step 156. In an embodiment, the cancel gesture may be a timeout period in which no input gesture is recognized / captured. In another embodiment, the cancel gesture may be a single finger touch gesture input device 16 predefined time period, such as two seconds. In yet another embodiment, the cancel gesture may be a three-finger touch of the gesture input device 16.

[0045] If the input gesture is not a cancel gesture, the software unlock method 150 proceeds to step 166, where the input gesture is converted into an input password symbol 48. Step 168 appends the input password symbol 48 to the end of any sequence of input password symbols 48 accumulated so far. Step 174 compares the current sequence of input password symbols 48 with the stored unlock password. In step 176, if the accumulated input password symbols 48 match the stored unlock password, the software unlock method 150 proceeds to step 178. In step 178, the electronic device 10 is unlocked and the software is operable in the software unlock state 180. If the accumulated input password symbols 48 do not match the stored unlock password, the software unlock method 150 proceeds to step 182. In step 182, the number of accumulated input password symbols 48 is compared with the maximum allowed number of input gestures. If the accumulated number of input password symbols 48 is at the maximum allowed number of input gestures, the software unlock method 150 returns to step 156. If the accumulated number of input password symbols 48 is less than its maximum allowed number, the software unlocking method 150 returns to step 158 where another input gesture is captured.

[0046] like Figure 7As shown in FIG. 2 , in an embodiment, the software unlocking method 200 starts when the electronic device 10 is in a software lock state 202. In the software lock state 202, the electronic device 10 is also in a sleep state with the display turned off. Step 204 initiates the software unlocking method 200 via a wake-up prompt. In an embodiment, the wake-up prompt is pressing a button 24 of the electronic device 10. In an embodiment, the wake-up prompt is a touch of a gesture input device 16. In step 205, the wake-up prompt causes the display to present a lock screen 30. In step 206, the user 20 initiates password entry via an input gesture, such as, but not limited to, a touch of a gesture input device 16, a virtual touch of a camera 18, or pressing a button 24 of the electronic device 10. Step 206 may also include randomly assigning input gestures 52 to password symbols and sub-symbols 50, 56. In step 207, initiating password entry causes the display to present an input password screen 40.

[0047] In the next step 208, an input gesture is captured. In step 210, the captured input gesture is compared with a predefined cancel gesture for indicating a cancel password input sequence. In an embodiment, the cancel gesture is a timeout period during which no input gesture is recognized / captured. In another embodiment, the cancel gesture may be a single finger touch of the gesture input device 16 for a predefined time period, such as two seconds. In yet another embodiment, the cancel gesture may be a three-finger touch of the gesture input device 16. If the input gesture is a cancel gesture, the software unlocking method 200 clears any previously input password symbols 48 in step 212 and returns to step 207 to display the electronic device input password screen 40, 70. Step 212 may also include randomly assigning input gestures 52 to password symbols and sub-symbols 50, 56.

[0048] If the input gesture is not a cancel gesture, the software unlocking method 200 proceeds to step 216, in which the input gesture is converted into an input password symbol 48 or an input character. Step 218 appends the input password symbol 48 or character to the end of the input password symbol 48 or character sequence accumulated so far. In step 224, the input password symbol 48 or character is displayed in the password display area 42. The input password symbol 48 or character displays a predefined, usually short time interval. In step 226, the time interval at which the input password symbol 48 has been displayed is compared with a set / predefined time period. Step 226 may include comparing the time interval at which the input password symbol 48 has been displayed with a set time period a predefined number of times per second. For example, step 226 may compare the time interval with the set time period every tenth of a second. If the time interval at which the input password symbol 48 has been displayed does not match the set time period or exceeds the set time period, the software unlocking method 200 returns to step 224. If the time interval of the input password symbol 48 being displayed exceeds the set time period, the software unlocking method 200 executes step 230 and displays the shielding symbol 46 instead of the input password symbol 48 or the character corresponding to the input gesture input. In this way, the input password symbol 48 or the character of the input password is removed from the password display area 42.

[0049] Step 232 then compares the sequence of input password symbols 48 entered so far with the stored unlock password. In step 234, if the accumulated input password symbols 48 match the stored unlock password, the software unlock method 200 proceeds to step 236. In step 236, the electronic device 10 is unlocked and the software is operable in the software unlock state 238. In an embodiment, step 230 of displaying the shielding symbol 46 after a set period of time occurs simultaneously with step 232, in which the sequence of input password symbols 48 is compared with the stored unlock password. In other words, in an embodiment, the timer of step 230 operates independently of step 232.

[0050] If the sequence of input password symbols 48 does not match the stored unlock password, the software unlock method 200 proceeds to step 240. In step 240, the accumulated number of input password symbols 48 is compared with the maximum allowed number of input gestures and / or input password symbols 48. If the accumulated number of input password symbols 48 is at the maximum allowed number, the software unlock method 200 clears the input password symbols 48 in step 244 and returns to step 207. If the accumulated number of input password symbols 48 is less than its maximum allowed number, the software unlock method 200 returns to step 208, in which another input gesture is captured.

[0051] like Figure 8, in an embodiment, the software unlocking method 300 begins with the electronic device 10 being in a software locked state 302. In the software locked state 302, the electronic device 10 may be in a sleep state with the display turned off. Step 304 initiates the software unlocking method 300 via an input gesture such as one or more taps on the input gesture device 16 or via pressing the electronic device button 24. Step 304 may allocate computer memory or set an initial value for a computer variable, etc. Step 305 determines whether the electronic device 10 is in a sleep state. If the electronic device 10 is in a sleep state, in step 306, the display is caused to present a lock screen 30. In step 308, the user 20 initiates password input via an input gesture, such as, but not limited to, a touch of the gesture input device 16 or a virtual touch of the camera 18. In step 310, initiating password input causes the software unlocking method 300 to randomly assign input gestures and their corresponding gesture symbols 52 to password symbols 50, 56. If, in step 305 , the software unlocking method 300 determines that the electronic device 10 is not in the sleep state, the software unlocking method 300 proceeds to step 310 .

[0052] Step 310 also clears any previously entered password symbols 48 and / or input gestures from the attempt to previously enter the stored unlock password. Then, in step 312, the display presents the input password screen 40. In the next step 314, the input gesture is captured. In step 316, the captured input gesture is compared with a predefined cancel gesture for indicating the cancellation of the password input sequence. In an embodiment, the cancel gesture is a timeout period during which no input gesture is recognized / captured. In another embodiment, the cancel gesture can be a single finger touch gesture input device 16 predefined time period, such as two seconds. In yet another embodiment, the cancel gesture can be a three-finger touch of the gesture input device 16. If the input gesture is a cancel gesture, the software unlocking method 300 returns to step 310 to clear any previously entered password symbols 48, and the input gesture and its corresponding gesture symbol 52 are randomly assigned to the password symbols 50, 56.

[0053] If the input gesture is not a cancel gesture, the software unlock method 300 proceeds to step 318, where the input gesture is converted into an input password symbol 48. Step 320 appends the input password symbol 48 to the end of any previously entered sequence of input password symbols 48. Step 328 then compares the sequence of input password symbols 48 entered so far with the stored unlock password. In step 330, if the accumulated input password symbols 48 match the stored unlock password, the software unlock method 300 proceeds to step 332. In step 332, the electronic device 10 is unlocked and the software is operable in the software unlock state 334. If in step 330, the sequence of input password symbols 48 does not match the stored unlock password, the software unlock method 300 proceeds to step 336. In step 336, the number of accumulated input password symbols 48 is compared with the maximum allowed number of input password symbols 48. If the accumulated number of input password symbols 48 is at the maximum allowed number, the software unlock method 300 returns to step 310 and clears the input password symbols 48. If the accumulated number of input password symbols 48 is less than its maximum allowed number, the software unlocking method 300 returns to step 314 where another input gesture is captured.

[0054] like Fig. 9 , in an embodiment, the software unlocking method 350 begins with the electronic device 10 being in a software locked state 352. In the software locked state 352, the electronic device 10 may be in a sleep state with the display turned off. Step 354 initiates the software unlocking method 350 via an input gesture, such as but not limited to one or more taps on the input gesture device 16 or pressing the button 24 of the electronic device 10. Step 354 may allocate computer memory to, for example, save the captured input gesture or set an initial value for a computer variable. Step 355 determines whether the electronic device 10 is in a sleep state. If the electronic device 10 is in a sleep state, in step 356, the display is caused to present the lock screen 30. In step 358, the user 20 initiates password entry via an input gesture, such as but not limited to a touch of the gesture input device 16 or a virtual touch of the camera 18. In step 360, initiating password entry causes the software unlocking method 350 to randomly assign input gestures and their corresponding gesture symbols 52 to password symbols 50, 56. If, in step 355 , the software unlocking method 350 determines that the electronic device 10 is not in the sleep state, the software unlocking method 300 proceeds to step 360 .

[0055] Step 360 also clears any previously entered password symbols 48 and / or input gestures from the attempt to previously enter the stored unlock password. Then, in step 362, the display presents the input password screen 40. In the next step 364, the input gesture is captured. In step 366, the captured input gesture is compared with a predefined cancel gesture for indicating the cancellation of the password input sequence. In an embodiment, the cancel gesture is a timeout period during which no input gesture is recognized / captured. In another embodiment, the cancel gesture can be a single finger touch gesture input device 16 predefined time period, such as two seconds. In yet another embodiment, the cancel gesture can be a three-finger touch of the gesture input device 16. If the input gesture is a cancel gesture, the software unlock method 350 returns to step 360 to clear any previously entered password symbols 48 and randomly assign the input gesture and its corresponding gesture symbol 52 to the password symbols 50, 56.

[0056] If the input gesture is not a cancel gesture, the software unlock method 350 proceeds to step 368 where the input gesture is converted into an input password symbol 48. Step 370 appends the input password symbol 48 to the end of any previously entered sequence of input password symbols 48.

[0057] Then, step 372 compares the sequence of input password symbols 48 entered so far with the stored unlock password. In step 374, if the accumulated input password symbols 48 match the stored unlock password, the software unlock method 350 proceeds to step 376. In step 376, the electronic device 10 is unlocked and the software is operable in the software unlock state 378. If in step 374, the sequence of input password symbols 48 does not match the stored unlock password, the software unlock method 350 proceeds to step 380. In step 380, the number of accumulated input password symbols 48 is compared with the maximum allowed number of input password symbols 48. If the accumulated number of input password symbols 48 is at the maximum allowed number, the software unlock method 350 returns to step 360 and clears the input password symbols 48. If the accumulated number of input password symbols 48 is less than its maximum allowed number, the software unlock method 350 returns to step 364, in which another input gesture is captured.

[0058] like Fig.10, in an embodiment, the software unlocking method 400 begins with the electronic device 10 being in a software locked state 402. In the software locked state 402, the electronic device 10 may be in a sleep state with the display turned off. Step 404 initiates the software unlocking method 400 via an input gesture such as one or more taps on the input gesture device 16 or pressing a button 24 of the electronic device 10. Step 404 may allocate computer memory, or set an initial value for a computer variable, etc. Step 405 determines whether the electronic device 10 is in a sleep state. If the electronic device 10 is in a sleep state, then in step 406, the display is caused to present a lock screen 30. In step 408, the user 20 initiates password entry via an input gesture, such as, but not limited to, a touch of the gesture input device 16 or a virtual touch of the camera 18. In step 410, initiating password entry causes the software unlocking method 400 to randomly assign input gestures and their corresponding gesture symbols 52 to password symbols 50, 56. If, in step 405 , the software unlocking method 400 determines that the electronic device 10 is not in the sleep state, the software unlocking method 400 proceeds to step 410 .

[0059] Step 410 also clears any previously entered password symbols 48 and / or input gestures from the attempt to previously enter the stored unlock password. Then, in step 412, the display presents the input password screen 40. In the next step 414, the input gesture is captured. In step 416, the captured input gesture is compared with a predefined cancel gesture for indicating the cancellation of the password input sequence. In an embodiment, the cancel gesture is a timeout period during which no input gesture is recognized / captured. In another embodiment, the cancel gesture can be a single finger touch gesture input device 16 predefined time period, such as two seconds. In yet another embodiment, the cancel gesture can be a three-finger touch of the gesture input device 16. If the input gesture is a cancel gesture, the software unlocking method 400 returns to step 410 to clear any previously entered password symbols 48 and randomly assign the input gesture and its corresponding gesture symbol 52 to the password symbols 50, 56.

[0060] If the input gesture is not a cancel gesture, the software unlocking method 400 proceeds to step 418, where the input gesture is converted into an input password symbol 48. Step 420 appends the input password symbol 48 to the end of any previously input sequence of input password symbols 48. In step 422, the input password symbol 48 is displayed in the password display area 42 of the input password screen 40. The input password symbol 48 is displayed for a predetermined, usually short time interval. In step 424, the time interval during which the input password symbol 48 has been displayed is compared with a set / predefined time period. If the time interval during which the input password symbol 48 has been displayed does not match the set time period or exceeds the set time period, the software unlocking method 400 returns to step 422. If the time interval during which the input password symbol 48 has been displayed exceeds the set time period, the software unlocking method 400 executes step 426, and displays the shielding symbol 46 instead of the input password symbol 48. In an embodiment, the step 426 of displaying the shielding symbol 46 after the set time period occurs simultaneously with the step 428 described below. In other words, in an embodiment, the timer of step 426 operates independently of step 428 .

[0061] Step 428 then compares the sequence of input password symbols 48 entered so far with the stored unlock password. In step 430, if the accumulated input password symbols 48 match the stored unlock password, the software unlock method 400 proceeds to step 432. In step 432, the electronic device 10 is unlocked and the software is operable in the software unlock state 434. If in step 430, the sequence of input password symbols 48 does not match the stored unlock password, the software unlock method 400 proceeds to step 436. In step 436, the number of accumulated input password symbols 48 is compared with the maximum allowed number of input password symbols 48. If the accumulated number of input password symbols 48 is at the maximum allowed number, the software unlock method 400 returns to step 410 and clears the input password symbols 48. If the accumulated number of input password symbols 48 is less than its maximum allowed number, the software unlock method 400 returns to step 414, in which another input gesture is captured.

[0062] When an input gesture is recognized in various software unlocking methods, the corresponding input password symbol 48 displayed in the password display area 42 of the input password screen 40, 70 can be highlighted in the gesture mapping area 44 to indicate to the user which input password symbol 48 has been recognized by the electronic device 10 as a symbol or character associated with the input gesture. In an embodiment, the highlighting of the input password symbol 48 is to display a border 54 around the corresponding password symbol 50 and / or password sub-symbol 56 in the gesture mapping area 44. In another embodiment, the highlighting of the input password symbol 48 is a change in the color of the password symbol 50 and / or password sub-symbol 56 in the gesture mapping area 44. In yet another embodiment, the highlighting of the input password symbol 48 is to display the password symbol 50 and / or password sub-symbol 56 in the gesture mapping area 44 with a background color different from the background color of the rest of the gesture mapping area 44. In still another embodiment, the highlighting of the input password symbol 48 is a flashing display of the password symbol 50 and / or password sub-symbol 56 in the gesture mapping area 44 for a period of time. In another embodiment, the input password symbol 48 may be highlighted in the gesture mapping area 44 in any combination of the aforementioned manners.

[0063] like Fig.11 As illustrated in FIG. 1 , in an embodiment, the input password screen 500 includes a password display area 502 and a gesture mapping area 504. In the gesture mapping area 504, a set of password symbols 520 are displayed together with corresponding gesture symbols 530. The input gesture corresponding to the gesture symbol 530 can be used with the gesture input device 16 and / or the camera 18 to input a symbol sequence (e.g., a stored unlock password). The password display area 502 may include a first section 516A for displaying an input password symbol 514. The password display area 502 may also include a second section 516B, which is used to selectively display a symbol 512 for indicating that a cancel gesture has been input. When the input gesture is recognized and converted into the input password symbol 514, the input password symbol 514 may be displayed in the first section 516A of the password display area 502 for a predefined time period, such as ten seconds. After the input password symbol 514 has been displayed for a predefined time period, the input password symbol 514 is replaced by a shielding symbol 510 that is used to hide the input password symbol 514.

[0064] like Fig.11 As shown in , the complete set of cryptographic symbols 520 is the set The password symbol 520 may additionally or alternatively be a set of Other sets of symbols may be used. The corresponding input gesture may be indicated by displaying a gesture symbol 530 next to the password symbol 520. In an embodiment, the gesture symbol 530 and its corresponding input gesture relative to the gesture input device 16 and / or camera 18 are as follows: "Indicates a single finger swipe forward gesture," "Indicates a single finger swipe back gesture," "Indicates a single finger tap gesture," "Indicates a two-finger tap gesture," "Indicates a two-finger swipe forward gesture," "Indicates a two-finger swipe back gesture," "Indicates a single finger bottom-to-top swipe gesture," "Indicates a single finger top-to-bottom swipe gesture," "Indicates a two-finger bottom-to-top swipe gesture," "Indicates a two-finger top-to-bottom swipe gesture," "Indicates a single-finger swipe gesture, forward and backward," ” indicates a two-finger sliding gesture simultaneously forward-backward and backward-forward (i.e., horizontal pinch). When utilizing the gesture input device 16, the two-finger input gesture means that two fingers are used to touch the gesture input device 16 simultaneously. When utilizing the camera 18, the two-finger input gesture means that two fingers are used simultaneously to perform an input gesture. Alternative gesture symbols 530 may be used to correspond to the input gesture. As described above, other input gestures may be used for other functions during the software unlocking method and / or password entry.

[0065] In an embodiment, the background 540 of the password input screen 500 is transparent or partially transparent, and the displayed symbols 510, 514, 512, 520, 530 are opaque or partially opaque. In another embodiment, the background 540 of the password input screen 500 is opaque or partially opaque, and the displayed symbols 510, 514, 512, 520, 530 are transparent or partially transparent.

[0066] like Fig.12 As shown in FIG. 1 , in an embodiment, electronic device 10 may include a multi-purpose mobile computing device such as a smart phone. Multi-purpose mobile computing device 10 includes a gesture input device 16 including a touch screen. Multi-purpose mobile computing device 10 also includes a processing unit 14, a camera 18, and a button 24.

[0067] One or more features of the embodiments described herein may be combined to create additional embodiments that are not depicted. Although various embodiments have been described in detail above, it should be understood that they are presented as examples rather than limitations. It will be clear to those skilled in the relevant art that the disclosed subject matter may be embodied in other specific forms, variations and modifications without departing from the scope, spirit or essential characteristics of the disclosed subject matter. Therefore, the above-described embodiments are considered to be illustrative in all aspects, rather than restrictive. The scope of the present invention is indicated by the appended claims, and all changes within the meaning and scope of its equivalents are intended to be included therein.

Claims

1. A method for unlocking software functions, comprising: An electronic device is provided, the electronic device comprising: Processing unit, a gesture input device connected to the processing unit, and monitor, detecting, via the gesture input device, an input gesture operable to initiate password input, wherein the electronic device is in a software locked state; randomly and automatically assigning a predefined set of input gestures to a predefined set of password symbols upon initiating password input, and displaying the predefined set of input gestures adjacent to the predefined set of password symbols; detecting, via the gesture input device, one of the assigned input gestures; comparing, via the processing unit, the input password symbol corresponding to the detected input gesture with a stored unlock password; and The input password symbol matches the stored unlock password, enabling the electronic device to be operated in a software unlocked state.

2. The method for unlocking a software function according to claim 1, wherein the gesture input device is a touch pad.

3. The method for unlocking software functionality according to claim 1, wherein the gesture input device is a camera.

4. The method for unlocking software functions according to claim 1, wherein the gesture input device is a touch screen.

5. The method of unlocking a software function according to claim 1, wherein the predefined set of input gestures is selected from the group consisting of: Single finger swipe forward gesture, single finger swipe backward gesture, single finger tap gesture, two finger tap gesture, two finger swipe forward gesture, two finger swipe backward gesture, single finger swipe bottom to top gesture, single finger swipe top to bottom gesture, two finger swipe bottom to top gesture, and two finger swipe top to bottom gesture.

6. The method for unlocking software functions according to claim 1 further comprises determining whether the electronic device is in a sleep state, wherein if the electronic device is in the sleep state, a lock screen is displayed via the display when the input gesture operable to initiate password input is detected.

7. The method for unlocking software functions according to claim 6, wherein: If the electronic device is not in the sleep state, when the input gesture operable to start password input is detected, a password input screen is displayed, wherein the password input screen includes a password display area and a gesture mapping area, wherein the predefined set of input gestures is shown using a predefined set of password symbols in the gesture mapping area, wherein the input password symbol corresponding to the detected input gesture is at least temporarily displayed in the password display area, and the detected input gesture is highlighted in the gesture mapping area.

8. The method for unlocking software functions according to claim 1, further comprising: displaying an input password screen, wherein the predefined set of input gestures has been randomly assigned to the predefined set of password symbols; and comparing the input password symbol corresponding to the detected input gesture with the stored unlock password, wherein the input password symbol does not match the stored unlock password; and randomly reallocating the predefined set of input gestures to the predefined set of password symbols.

9. The method of unlocking a software function according to claim 1, wherein detecting at least two input gestures via the gesture input device further comprises: Converting the input gesture into the corresponding password symbol; and appending said input password symbol to any sequence of input password symbols.

10. The method for unlocking software functions according to claim 1, further comprising: providing a number indicating the number of password symbols entered; In case the input password symbols do not match the stored unlocking password, comparing the number of the input password symbols with a predefined maximum allowed number of the input password symbols; In case the number of the input password symbols matches the maximum allowed number of the input password symbols, clearing the input password symbols; and The predefined set of input gestures is randomly reassigned to the predefined set of password symbols.

11. The method of unlocking a software function according to claim 10, further comprising detecting an input gesture via the gesture input device operation when the number of the input password symbols does not match the maximum allowed number of the input password symbols.

12. The method of unlocking a software function according to claim 1, wherein detecting one of the assigned input gestures via the gesture input device further comprises: Comparing the detected input gesture with a predefined cancel gesture; wherein if the detected input gesture matches the cancel gesture, clearing any previously input password symbols; The predefined set of input gestures is randomly reassigned to the predefined set of password symbols.

13. The method of unlocking software functionality according to claim 1, wherein the display is a virtual image.

14. An electronic device comprising: Processing unit; a gesture input device connected to the processing unit; as well as monitor, wherein the gesture input device is operable to detect an input gesture to initiate password input during a software locked state, wherein the processing unit is operable to randomly and automatically assign a predefined set of input gestures to a predefined set of password symbols when password input is initiated, and The display is operable to show a password input screen showing a predefined set of input gestures corresponding to a predefined set of password symbols, wherein the display is operable to show a predefined set of input gestures adjacent to the predefined set of password symbols.

15. The electronic device according to claim 14, further comprising: a projector operable to generate image-bearing light, wherein the projector is connected to the processing unit; and a planar waveguide assembly operable to transmit said image-bearing light, Wherein the display comprises one or more virtual images transmitted via the planar waveguide assembly.

16. The electronic device of claim 14, wherein the display is a virtual image.

Images