Device unlocking method and system and non-transient computer readable storage medium

Abstract

The invention provides a device unlocking method and system. The device unlocking method is used for unlocking an electronic device which can be operated by a user. The device unlocking method comprises the following steps: judging whether a user makes a starting gesture or not; when the user makes the starting gesture, displaying an unlocking image containing an indicating object with a first appearance; obtaining a state change from the starting gesture to change the indicative object from the first appearance to a second appearance according to the state change; in response to the fact that the second appearance is substantially the same as the preset appearance, judging whether the user makes an end gesture; and unlocking the electronic device when the user makes the end gesture. The device unlocking system can ensure that a user does different actions or actions every time the electronic device is to be unlocked by providing an unlocking image containing an indicating object with a different first appearance. Therefore, a person who wants to unlock the electronic device without permission of a user is difficult to unlock the electronic device through memory or imitation.

Description

Technical Field

[0001] This disclosure relates to a method and system, and more particularly to a device unlocking method and system. Background Technology

[0002] In some related technologies disclosed herein, many people now use personal devices (e.g., mobile phones, tablets, laptops, wearable devices, etc.) daily for tasks such as communication, work, and gaming. Each personal device typically has a built-in locking function to protect personal information stored within it. In the example of a head-mounted display used to provide a virtual reality environment, if the head-mounted display is locked by its owner, the person wishing to operate it needs to enter the correct password or interact correctly with an accessory device to unlock it. These personal devices are rarely unlocked in a gesture-related manner. Therefore, new methods for unlocking personal devices in a gesture-related manner should be proposed. Summary of the Invention

[0003] One aspect of this disclosure is a device unlocking method. This device unlocking method is used to unlock an electronic device operable by a user. The device unlocking method includes: determining whether the user makes a start gesture; when the user makes the start gesture, displaying an unlocking image including an indicator object having a first appearance; acquiring a state change from the start gesture, and changing the indicator object from the first appearance to a second appearance based on the state change; in response to the second appearance being substantially the same as a preset appearance, determining whether the user makes a stop gesture; and when the user makes the stop gesture, unlocking the electronic device.

[0004] In some embodiments, the indicative object includes at least one of a visual pattern and a numerical display bar, and the device unlocking method further includes: determining whether the second appearance is substantially the same as the preset appearance, wherein the preset appearance includes at least one of the visual pattern having a preset state and the numerical display bar having a preset password.

[0005] In some embodiments, a first range limit and a second range limit are determined based on the state change, and the preset password is selected from a numerical range defined based on the first range limit and the second range limit.

[0006] In some embodiments, the device unlocking method further includes: calculating a current hand posture data of the user based on sensing data associated with at least one of the user's hands.

[0007] In some embodiments, the state change obtained from the initial gesture includes determining a rotation angle based on the current hand posture data and an initial hand posture data, wherein the initial hand posture data is calculated when the user makes the initial gesture.

[0008] In some embodiments, the state change obtained from the initial gesture includes determining a displacement based on the current hand posture data and an initial hand posture data, wherein the initial hand posture data is calculated when the user makes the initial gesture.

[0009] In some embodiments, the state change obtained from the initial gesture includes: determining a gesture change based on the current hand posture data and an initial hand posture data, wherein the initial hand posture data is calculated when the user makes the initial gesture.

[0010] In some embodiments, the device unlocking method further includes: generating an image of the user's at least one hand as the sensing data using a camera.

[0011] In some embodiments, the device unlocking method further includes: generating motion data of the user's at least one hand as the sensing data using a motion sensor.

[0012] In some embodiments, unlocking the electronic device includes stopping the display of the unlocking image.

[0013] Another embodiment of this disclosure is a device unlocking system. This device unlocking system is used to unlock an electronic device operable by a user and includes a display panel, a sensor, and a processor. The sensor generates sensing data related to a hand gesture of the user. The processor, coupled to the sensor and the display panel, is used to: determine, based on the sensing data, whether the user has made a starting gesture; when the user makes the starting gesture, control the display panel to display an unlocking image including an indicator object having a first appearance; based on the sensing data, obtain a state change from the starting gesture, and change the indicator object from the first appearance to a second appearance by controlling the display panel according to the state change; in response to the second appearance being substantially the same as a preset appearance, determine, based on the sensing data, whether the user has made a ending gesture; and when the user makes the ending gesture, unlock the electronic device.

[0014] Another embodiment of this disclosure is a non-transitory computer-readable storage medium having a computer program for executing a device unlocking method. The device unlocking method is used to unlock an electronic device operable by a user and includes: determining whether the user makes a start gesture; when the user makes the start gesture, displaying an unlocking image including an indicator object having a first appearance; acquiring a state change from the start gesture, and changing the indicator object from the first appearance to a second appearance based on the state change; in response to the second appearance being substantially the same as a preset appearance, determining whether the user makes a stop gesture; and when the user makes the stop gesture, unlocking the electronic device.

[0015] In summary, by providing unlocking images that include indicative objects with different initial appearances, the device unlocking system ensures that the user performs a different action or movement each time they want to unlock the electronic device. This makes it difficult for someone to unlock the electronic device without the user's permission by remembering or imitating it. Attached Figure Description

[0016] Figure 1 This is a block diagram illustrating a device unlocking system according to some embodiments of the present disclosure.

[0017] Figure 2 This is a schematic diagram illustrating a wearable device that can be operated by a user in a real environment, according to some embodiments of the present disclosure.

[0018] Figure 3 This is a flowchart illustrating a device unlocking method according to some embodiments of the present disclosure.

[0019] Figure 4A This is a schematic diagram illustrating a starting gesture according to some embodiments of the present disclosure.

[0020] Figure 4B This is a schematic diagram illustrating the state changes of a starting gesture according to some embodiments of the present disclosure.

[0021] Figure 4C This is a schematic diagram illustrating an ending gesture according to some embodiments of the present disclosure.

[0022] Figure 5A This is a schematic diagram illustrating an unlocking image according to some embodiments of the present disclosure.

[0023] Figure 5B This is a schematic diagram illustrating an unlocking image according to some embodiments of the present disclosure.

[0024] Figure 6AThis is a schematic diagram illustrating another starting gesture according to some embodiments of the present disclosure.

[0025] Figure 6B This is a schematic diagram illustrating another state change from a starting gesture, as shown in some embodiments of this disclosure.

[0026] Figure 6C This is a schematic diagram illustrating another ending gesture according to some embodiments of the present disclosure.

[0027] Figure 7A This is a schematic diagram illustrating another unlocking image according to some embodiments of the present disclosure.

[0028] Figure 7B This is a schematic diagram illustrating another unlocking image according to some embodiments of the present disclosure.

[0029] Symbol explanation: 11: Processor 13: Display panel 15: Sensors 100: Device unlocking system 151: Camera 200: Wearable devices 300: Device unlocking method A1: Rotation angle C1, C2: Width D1: Distance DI: Video Data DS: Sensing data FL,FL': Unlock video FN: Numerical display bar FP: Visual Pattern G1,G1': Starting gesture G2,G2': End gesture S301~S306: Operation U1: User Detailed Implementation

[0030] The following detailed description of embodiments, in conjunction with the accompanying drawings, is provided. However, the specific embodiments described are only for explaining this case and are not intended to limit this case. The description of the structural operations is not intended to limit the order of their execution. Any structure resulting from the recombination of elements and producing an apparatus with equivalent functionality is within the scope of this disclosure.

[0031] The terms "coupled" or "connected" as used in this article can refer to two or more components making direct physical or electrical contact with each other, or making indirect physical or electrical contact with each other, or to two or more components operating or moving together.

[0032] Please see Figure 1 , Figure 1 This is a block diagram illustrating a device unlocking system 100 according to some embodiments of the present disclosure. In some embodiments, the device unlocking system 100 can be used to unlock an electronic device. Figure 1 As shown, the device unlocking system 100 includes a processor 11, a display panel 13, and a sensor 15. Specifically, the processor 11 is electrically and / or communicatively coupled to the display panel 13 and the sensor 15.

[0033] In some embodiments, the electronic device can be operated by an operator (not shown) in a public place (e.g., a park, library, etc.). It should be understood that the electronic device can be automatically or manually locked to protect its internal information from access, which also restricts the operator's ability to operate the device. For example, the operator may only be able to contact official authorities (e.g., police officers) in an emergency. Sensor 15 is used to sense the operator's hand movements to generate sensing data DS. Processor 11 is used to receive and process the sensing data DS to identify at least one gesture made by the operator, and to control display panel 13 based on the identification result to provide visual feedback to the operator. Notably, through visual feedback, the operator can input an unlock code into the electronic device based on a change in at least one gesture, thereby unlocking the electronic device.

[0034] In some embodiments, the processor 11, display panel 13, and / or sensor 15 may be integrated into an electronic device or separated from each other, but are not limited thereto. For example, the processor 11 and sensor 15 may be integrated into an electronic device, which may be any personal device of the operator (e.g., wearable device, handheld device, access control device, etc.). The display panel 13 may be implemented via an external display (e.g., flat panel display, heads-up display, etc.), which is separate from the electronic device and is visible only to the operator. The processor 11, display panel 13, and sensor 15 will be used in some practical applications of the device unlocking system 100 below (e.g., Figure 2 (As shown) for further explanation.

[0035] Please see Figure 2 , Figure 2 This is a schematic diagram illustrating a wearable device 200 (i.e., an electronic device) that can be operated by a user U1 (i.e., an operator) in a real environment (i.e., a public place) according to some embodiments of the present disclosure. Specifically, the wearable device 200 is a head-mounted display that can be worn on the head of the user U1 to provide immersive content to the user U1. However, the present disclosure is not limited thereto.

[0036] In some embodiments, the immersive content may be a virtual reality (VR) environment, a mixed reality (MR) environment, or an augmented reality (AR) environment. A virtual reality environment may contain at least one virtual reality object that cannot be directly seen by the user U1 in the real environment. A mixed reality environment simulates a real environment and enables at least one virtual reality object to interact with the simulated real environment. An augmented reality environment enhances the real environment that the user U1 directly sees with at least one virtual reality object.

[0037] like Figure 2 As shown, the wearable device 200 includes a device unlocking system 100. That is, in some embodiments, the device unlocking system 100 is applied to or integrated into the wearable device 200. Accordingly, if the wearable device 200 is locked, the user U1 can unlock the wearable device 200 through the device unlocking system 100. Figure 2 In one embodiment, the sensor 15 of the device unlocking system 100 includes a camera 151. The processor 11 is electrically and / or communicatively coupled to the display panel 13 and the camera 151 within the wearable device 200. The operation of the processor 11, display panel 13, and sensor 15 will be described below. Figure 3 Detailed explanation of the device unlocking method 300.

[0038] Figure 3 This is a flowchart illustrating a device unlocking method 300 applicable to a device unlocking system 100 according to some embodiments of the present disclosure. In some embodiments, such as Figure 3 As shown, the device unlocking method 300 can be executed by the device unlocking system 100 and includes operations S301 to S306. However, this disclosure should not be limited thereto.

[0039] In operation S301, processor 11 determines whether user U1 has made a starting gesture G1. (See also...) Figure 4A , Figure 4A This is a schematic diagram illustrating the initial gesture G1 according to some embodiments of the present disclosure. Figure 4A In some embodiments, the starting gesture G1 is the "OK" gesture, and can be defined by some finger features, such as the tip of the thumb touching the tip of the index finger, the thumb and index finger forming a circle, and the other three fingers (i.e., the middle finger, ring finger, and little finger) being naturally extended. However, the starting gesture G1 of this disclosure is not limited to this.

[0040] In some embodiments, the processor 11 calculates current hand posture data of the user U1 based on the sensing data DS generated by the sensor 15, and identifies a current gesture made by the user U1 based on the current hand posture data using at least one known gesture recognition method. Then, the processor 11 determines whether the current gesture matches the finger characteristics of the starting gesture G1, in order to determine whether the user U1 has made the starting gesture G1.

[0041] In some further embodiments, such as Figure 2 As shown, the sensing data DS is an image data DI of at least one hand of the user U1. Specifically, the camera 151 can generate image data DI as sensing data DS by capturing multiple images of at least one hand of the user U1, and transmit the image data DI to the processor 11. Accordingly, the processor 11 can analyze the image data DI using at least one known computer vision-based image recognition technique. For example, the processor 11 can detect multiple key points in the image data DI corresponding to multiple landmarks (e.g., fingertips, joints, etc.) of at least one hand of the user U1, and estimate the coordinates of each key point in a predefined spatial system, wherein the origin of the predefined spatial system is associated with the position of the wearable device 200 in the real environment. The processor 11 can then infer the current hand posture data of the user U1 from the coordinates of each key point.

[0042] In some embodiments of operation S301, if the current gesture does not conform to the finger characteristics of the initial gesture G1, the processor 11 determines that the user U1 has not performed the initial gesture G1, causing operation S301 to be executed again. If the current gesture conforms to the finger characteristics of the initial gesture G1, the processor 11 determines that the user U1 has performed the initial gesture G1. In some further embodiments, the current hand posture data corresponding to the current gesture that conforms to the finger characteristics of the initial gesture G1 is stored by the processor 11 as initial hand posture data. Accordingly, operation S302 can be executed.

[0043] In operation S302, an unlocking image FL is displayed, which includes an indicative object having a first appearance. In some embodiments of operation S302, the processor 11, in response to determining that the user U1 has made a starting gesture G1, controls the display panel 13 to display the unlocking image FL. Please refer to [link to relevant documentation]. Figure 5A , Figure 5A This is a schematic diagram illustrating an unlocked image FL according to some embodiments of the present disclosure. Figure 5A In this embodiment, the indicative object is a numerical display bar FN, and the first appearance is a numerical value displayed by the numerical display bar FN (e.g.: Figure 5A(e.g., "-30" in the original text). Further, the first appearance is randomly generated by the processor 11 of the device unlocking system 100. That is, the value displayed in the numerical display bar FN can be any value within a range. However, this disclosure should not be limited thereto. For example, in some embodiments, the processor 11 can convert the current gesture conforming to the finger characteristics of the starting gesture G1 into an initial value using a hash table or other suitable algorithm, thereby using the initial value as the first appearance. Figure 5A The unlocking image FL also includes a padlock icon on the numerical display bar FN, which serves as a prompt for the user U1 to unlock the wearable device 200. From the perspective of the user U1 wearing the wearable device 200, when the user U1 makes the starting gesture G1, the unlocking image FL will suddenly appear in the user U1's field of vision.

[0044] In some embodiments, such as Figure 2 As shown, operation S303 can be executed after the unlock image FL is displayed. In operation S303, the processor 11 obtains a state change from the initial gesture G1 to change the indicator object from a first appearance to a second appearance, which will be combined with... Figure 4B and 5B Please provide an explanation. Figure 4B This is a schematic diagram illustrating the state changes of a self-starting gesture G1 according to some embodiments of the present disclosure. Figure 5B This is a schematic diagram of an unlocked image FL shown according to some embodiments of the present disclosure.

[0045] In some embodiments, please also refer to Figure 4A and 4B User U1 maintains the initial gesture G1 and rotates the hand holding the initial gesture G1. Simultaneously, while user U1 rotates the hand holding the initial gesture G1, processor 11 calculates another current hand posture data of user U1 based on sensing data DS. Accordingly, in some further embodiments of operation S303, processor 11 can determine a rotation angle A1 based on the other current hand posture data and the initial hand posture data. For example, processor 11 can find the rotation angle A1 from a change in hand posture data from the initial hand posture data to the other current hand posture data.

[0046] Following the above embodiments, when a state change is obtained from the initial gesture G1, the processor 11 controls the display panel 13 to change the indicative object (e.g., the numerical display bar FN) according to the state change from the initial gesture G1. Please also refer to... Figure 4A and 5AWhen processor 11 first detects user U1 making the initial gesture G1, the value displayed in the numerical display bar FN is "-30" (i.e., first appearance). Please also refer to Figure 4B and 5B When the processor 11 acquires the rotation angle A1 (i.e., the state change since the initial gesture G1), the value displayed in the numerical display bar FN changes to "+26" (i.e., the second appearance). In some practical applications, Figure 5B The "+26" displayed in the FN value bar means that the user U1 rotates the hand that is holding the starting gesture G1 clockwise by 56 degrees (i.e., rotation angle A1).

[0047] Please refer to it again. Figure 3 In some embodiments, operation S304 is executed after the processor 11 obtains the state change from the initial gesture G1. In operation S304, the processor 11 determines whether the second appearance is substantially the same as a preset appearance.

[0048] In an embodiment where the indicative object is a numerical display bar FN, the preset appearance can be a preset password. If the value displayed by the numerical display bar FN when the processor 11 obtains the state change from the initial gesture G1 is substantially the same as the preset password, then the processor 11 will determine in operation S304 that the second appearance is substantially the same as the preset appearance, causing operation S305 to be executed. If the value displayed by the numerical display bar FN when the processor 11 obtains the state change from the initial gesture G1 is not substantially the same as the preset password, then the processor 11 will determine in operation S304 that the second appearance is not substantially the same as the preset appearance, causing operations S303 and S304 to be executed sequentially again.

[0049] In the above embodiment, user U1 makes a state change from the initial gesture G1 to change the value displayed in the value display bar FN to a preset password. In other words, user U1 enters the preset password on the unlock image FL by making a state change. It should be noted that the preset password is selected from another value range, which may be larger than the value range used to generate the first appearance of the indicative object. The other value range is defined based on the state change from the initial gesture G1. In the example where the state change from the initial gesture G1 is a rotation angle A1, the other value range is associated with a rotation angle range. It should be understood that the maximum rotation angle is limited by individual physical ability. If a person (e.g., user U1) can rotate the hand holding the initial gesture G1 360 degrees clockwise or counterclockwise, then a first range limit and a second range limit of the rotation angle range can be defined as "0" and "+360", "-180" and "+180", or "-360" and "+360", respectively, and the value range can be further defined according to the actual usage scenario or user preference. Note that in these embodiments, "+" and "-" represent clockwise and counterclockwise directions, respectively. However, this disclosure should not be limited thereto. In other embodiments, clockwise and counterclockwise directions can be represented in completely opposite ways.

[0050] Based on the description of operations S302 to S304, in some embodiments, if the display panel 13 displays an unlock image FL containing a value display bar FN with the value "+30" (i.e., the first appearance) and the preset password is the value "-45" (i.e., the preset appearance) when the processor 11 determines that the user U1 has made a starting gesture G1, then the user U1 needs to rotate the hand that is maintaining the starting gesture G1 counterclockwise by 75 degrees, so that the value displayed in the value display bar FN becomes "-45" (i.e., the second appearance).

[0051] In operation S305, processor 11 determines whether user U1 has made an end gesture G2. (See also...) Figure 4C , Figure 4C This is a schematic diagram illustrating the end gesture G2 according to some embodiments of this disclosure. Figure 4C In this embodiment, the ending gesture G2 is an unnamed gesture derived from the "OK" gesture. For example, after making the "OK" gesture, user U1 can separate the thumb and index finger of the hand that made the "OK" gesture to form an unnamed gesture. Figure 4C The ending gesture G2 can be defined by some finger characteristics, such as the tip of the thumb not touching the tip of the index finger, the thumb and index finger not forming a circle, and the other three fingers (i.e., the middle finger, ring finger, and little finger) being naturally extended. It should be understood that the ending gesture G2 of this disclosure can be any gesture different from the starting gesture G1, and is not limited thereto.

[0052] It should be noted that the description of operation S305 is similar to that of operation S301, and therefore the description of operation S305 is simplified here. For example, the processor 11 can identify another current gesture made by the user U1 based on the sensing data DS, and determine whether the other current gesture matches the finger characteristics of the ending gesture G2, thereby determining whether the user U1 has made the ending gesture G2.

[0053] In some embodiments of operation S305, if another current gesture fails to meet the finger characteristics of the ending gesture G2, the processor 11 determines that the user U1 has not performed the ending gesture G2, causing operation S305 to be executed again. When another current gesture meets the finger characteristics of the ending gesture G2, the processor 11 determines that the user U1 has performed the ending gesture G2, causing operation S306 to be executed.

[0054] In operation S306, processor 11 unlocks electronic devices (e.g.: Figure 2 (Wearable device 200 in the context of the device). In some embodiments of operation S306, the processor 11 controls the display panel 13 to stop displaying the unlock image FL, allowing the user U1 to operate the electronic device without restriction. From the perspective of the user U1 wearing the wearable device 200, when the user U1 makes the ending gesture G2, the unlock image FL will suddenly disappear from the user U1's field of vision, and the user U1 can experience immersive content. In some embodiments of operation S306, before controlling the display panel 13 to stop displaying the unlock image FL, the processor 11 controls the display panel 13 to present a visual dynamic effect on the unlock image FL. Specifically, the visual dynamic effect can be used to indicate that the wearable device 200 has been unlocked. For example, from the perspective of the user U1 wearing the wearable device 200, a U-shaped hook of the padlock pattern above the numerical display bar FN will rise, and the unlock image FL will then disappear.

[0055] At Figure 3In some further embodiments, the processor 11 further determines whether the user U1 makes a state change that makes the second appearance substantially the same as the preset appearance within a preset time limit (e.g., 30 seconds), and only determines whether the user U1 makes the end gesture G2 if the user U1 makes a state change that makes the second appearance substantially the same as the preset appearance within the preset time limit. In some embodiments, when the processor 11 starts to determine whether the user U1 makes the end gesture G2, the processor 11 will not consider whether the user U1 makes a state change that makes the second appearance substantially the same as the preset appearance. Furthermore, in some embodiments, the processor 11 determines that the user U1 makes the end gesture G2 only if the user U1 maintains a state change that makes the second appearance substantially the same as the preset appearance for a preset time period (e.g., 1 second).

[0056] It should be understood that the state changes from the initial gesture G1 are not restricted to Figure 4B The rotation angle A1 is shown. For example, the change in state from the initial gesture G1 can be a displacement. In some embodiments, after making the initial gesture G1, the user U1 can move the hand holding the initial gesture G1 a linear distance. During the period when the user U1 moves the hand holding the initial gesture G1 a linear distance, the processor 11 can determine the displacement (corresponding to the linear distance) based on the change from the initial hand posture data to the current hand posture data, and change the appearance of the indicative object (e.g., the value displayed in the numerical display bar FN) from a first appearance to a second appearance based on the displacement (i.e., operation S303). Then, the processor 11 can determine whether the second appearance is substantially the same as the preset appearance (i.e., operation S304). Specifically, the preset appearance can be a preset password, wherein the preset password is predefined by the user U1 selecting from another numerical range associated with a displacement distance range. This displacement range can have a first range limit and a second range limit based on the maximum linear displacement distance of a person's (e.g., user U1) hand (e.g., "0" and "+150", "-75" and "+75", "-150" and "+150", "0%" and "+100%", etc.), where the first and second range limits can be used to define the numerical range. Note that in these embodiments, "+" and "-" represent the rightward and leftward directions, or the upward and downward directions, respectively, and vice versa.

[0057] In some embodiments, the state change from the initial gesture G1 can be a gesture change, which will be combined with Figures 6A-6C Please provide an explanation. Figure 6A This is a schematic diagram of another starting gesture G1' shown in some embodiments of this disclosure. Figure 6B This is a schematic diagram illustrating the state changes of a self-starting gesture G1' according to some embodiments of the present disclosure. Figure 6C This is a schematic diagram of another ending gesture G2' shown according to some embodiments of this disclosure. Furthermore, the indicative object is not limited to... Figures 5A-5B The numerical display bar FN in the middle, and in some embodiments, may be a visual pattern, which will be paired with Figures 7A-7B Please provide an explanation. Figures 7A-7B This is a schematic diagram of another unlocked image FL' shown according to some embodiments of the present disclosure.

[0058] At Figure 6A In some embodiments, the initial gesture G1' is a "fist" gesture. In some embodiments, after making the "fist" gesture, the user U1 gradually (incompletely) unfolds the five fingers of the hand making the "fist" gesture. The description of determining whether the user U1 has made the initial gesture G1' is similar to the description of operation S301, and is therefore omitted here. In some embodiments, after the processor 11 determines that the user U1 has made the initial gesture G1', Figure 7A The unlocked image FL' is displayed (i.e., operation S302). At Figure 7A In one embodiment, the unlocking image FL' includes a visual pattern FP. The visual pattern FP can be implemented using a dynamic door pattern that can switch between an open state and a closed state. In the open state, the dynamic door pattern is split to have an opening. In the closed state, the dynamic door pattern does not have an opening. Further explanation is given below. Figure 7A In the process, after the processor 11 determines that the user U1 makes a starting gesture G1', the opening of the dynamic door pattern will randomly have a width C1. It is worth noting that the width C1 can be regarded as the first appearance of the visual pattern FP (i.e., the indicative object).

[0059] As the five fingers of the hand making a "fist" gesture gradually unfold, the processor 11 can, based on the initial hand posture data (when the processor 11 detects that the user U1 has made a "fist" gesture), perform the following actions: Figure 6A The hand gesture change is determined by the change in hand posture data from the initial gesture G1' calculated in the previous step, and the visual pattern FP is changed from a first appearance to a second appearance based on the gesture change (i.e., operation S303). In some further embodiments, the gesture change may be based on a distance D1 between the fingertips of the thumb and index finger (e.g., ...). Figure 6B (As shown). Distance D1 can be detected based on changes in hand posture data from the initial hand posture data to the current hand posture data. It should be understood that distance D1 will gradually increase as the five fingers of the hand making the "fist" gesture gradually unfold. At the same time, the opening of the dynamic door pattern will also widen until distance D1 no longer increases. Therefore, in Figure 7B In the dynamic door pattern, the opening has a width C2 (i.e., the second appearance of the visual pattern FP).

[0060] After receiving the gesture change, the processor 11 determines whether the width C2 is substantially the same as a preset width (i.e., operation S304). In other words, the preset appearance is... Figures 7A-7B In this embodiment, a preset width is used. Specifically, the preset width is predefined by the user U1 selecting from another numerical range associated with the spread of a finger. This finger spread range may have a first range limit and a second range limit (e.g., "0" and "+20", "0%" and "+100%", etc.) based on the maximum spread distance of a person's (e.g., user U1's) hand, wherein the first range limit and the second range limit can be used to define the numerical range. It should be understood that the maximum spread distance may be an average maximum distance between the fingertips of the thumb and index finger. The processor 11 may compare the width C2 (which may be substantially the same as the sum of the distance D1 and the width C1) with the preset width to determine whether the second appearance is substantially the same as the preset appearance.

[0061] When the width C2 is substantially the same as the preset width, the processor 11 further determines whether the user U1 has made a stop gesture G2' (i.e., operation S305) to determine whether to unlock the electronic device. The explanation of determining whether the user U1 has made a stop gesture G2' is similar to the explanation of operation S305, and therefore is omitted here. Figure 6C In this context, the ending gesture G2' is a "five" gesture. Specifically, the "five" gesture can be formed by the user U1 fully extending the five fingers of the hand making the "fist" gesture. However, the ending gesture G2' is not limited to this. In some embodiments, the user U1 can maintain the distance D1 between the tip of the thumb and the tip of the index finger (e.g., Figure 6B (As shown), and make the ending gesture G2' by raising the little finger or bending the wrist.

[0062] As can be seen from the description of the above embodiments, the state change from the initial gesture G1 may include rotation angle A1, displacement, or gesture change. The indicative object may be a visual pattern FP or a numerical display bar FN. However, this disclosure is not limited thereto. For example, in some embodiments, the indicative object includes both a visual pattern FP and a numerical display bar FN. In this case, the state of the visual pattern FP (e.g., rotated 26 degrees clockwise, moved 74 cm to the left, etc.) and the value of the numerical display bar FN (e.g., "+26", "-74", etc.) may correspond to each other. Furthermore, the preset appearance may include at least one of a visual pattern with a preset state (i.e., a preset width) and a numerical display bar with a preset password. For example, please also refer to... Figure 5A and 5B The padlock icon above the FN value display bar can change synchronously with the appearance of the FN value display bar (i.e., the value itself). For example, the padlock icon can be displayed on [the screen]. Figure 5AThe value can be rotated 30 degrees counterclockwise, and can also be rotated clockwise based on the change from "-30" to "+26". Figure 5B The middle part is rotated 26 degrees clockwise.

[0063] In the above embodiments, the device unlocking system 100 allows the user U1 to set a start gesture G1, a state change detected by the device unlocking system 100, a preset appearance, and an end gesture G2. Furthermore, the device unlocking system 100 also allows the user U1 to set at least one of the following: the type of indicator object (corresponding to the state change), the numerical range used to set the preset appearance, the sampling rate of the sensor 15, the update rate of the indicator object (for example, the state of the visual pattern FP is updated each time a specific state change (e.g., 2, 5, or 10 degrees, 1 cm, etc.) is detected), and the numerical range used to generate the first appearance. In other words, the device unlocking system 100 can be customized by the user U1. This avoids erroneous detection by the device unlocking system 100, thereby providing the user U1 with a better user experience.

[0064] To further explain, Figure 3 and 4A In embodiments ~4C, a set of start gestures G1, preset appearances (i.e., preset passwords, preset widths, etc.) and end gestures G2 are presented for illustrative purposes. However, this disclosure is not limited to this. For example, in some further embodiments, the device unlocking system 100 may set multiple sets of start gestures G1, preset appearances, and end gestures G2 to unlock the electronic device. It is worth noting that each set can be configured with a unique start gesture, a unique preset appearance (i.e., a unique password), and a unique end gesture. This configuration ensures the complexity of the password.

[0065] It should be understood that the configuration of the device unlocking system 100 is not limited to... Figure 2 The configuration shown. For example, in some embodiments, Figure 2 The camera 151 of the sensor 15 can be located outside the wearable device 200. Furthermore, in some embodiments, the sensor 15 also includes a motion sensor (not shown). Specifically, the motion sensor can be mounted on at least one hand of the user U1 and communicatively coupled to the processor 11. Accordingly, the motion sensor can generate motion data (not shown) as sensing data DS by sensing the movement of at least one hand of the user U1, and can transmit the motion data to the processor 11. The processor 11 can then perform at least one mathematical operation (e.g., orthogonal decomposition, integration, etc.) on the motion data to calculate the current hand posture data. In these embodiments, the motion sensor can be implemented using an inertial measurement unit including an accelerometer, a gyroscope, and a magnetometer.

[0066] In the above embodiments, the processor 11 can be implemented as a central processing unit, a graphics processing unit, an application-specific integrated circuit, a microprocessor, a system-on-a-chip, or other suitable processing circuitry. The display panel 13 can be implemented as an active-matrix organic light-emitting diode display, an organic light-emitting diode display, or other suitable display.

[0067] As can be seen from the embodiments of this disclosure above, the device unlocking system 100 of this disclosure can detect that the user U1 intends to unlock the electronic device by detecting a starting gesture G1. Then, when the system detects that the user U1 sequentially performs a state change that gives the indicator object a preset appearance and a ending gesture G2, the device unlocking system 100 will unlock the electronic device for the user U1. In other words, the device unlocking system 100 allows the user U1 to unlock the electronic device with maximum efficiency. It is important to note that the preset appearance can only be accurately achieved by the user U1 who is provided with visual feedback (i.e., the unlocking image FL), which further ensures the confidentiality of the password.

[0068] To further explain, in related technologies for unlocking electronic devices, the electronic device can display a specific image and allow the operator to input a preset pattern or password on the specific image. It is important to note that the electronic device in these technologies does not generate an initial pattern or value on the specific image. Therefore, the operator will perform the same action or behavior each time they want to unlock the electronic device (i.e., draw a preset pattern, input a preset password, etc.), which is easily memorized or imitated by someone who wants to unlock the electronic device without the operator's permission. In this disclosure, the device unlocking system 100 ensures that the user U1 performs a different action or behavior each time they want to unlock the wearable device 200 (i.e., the electronic device) by providing an unlocking image FL containing an indicative object with a different first appearance. In this way, it will be difficult for someone who wants to unlock the electronic device without the user U1's permission to unlock the wearable device 200 by memorization or imitation.

[0069] The methods of this disclosure can exist in the form of program code. The program code can be contained in a physical medium, such as a floppy disk, optical disk, hard disk, or any other transient or non-transitory computer-readable storage medium, wherein when the program code is loaded and executed by a computer, the computer becomes an apparatus for implementing the methods. The program code can also be transmitted via some transmission medium, such as wires or cables, via optical fibers, or via any other transmission mode, wherein when the program code is received, loaded, and executed by a computer, the computer becomes an apparatus for implementing the methods. When implemented on a general-purpose processor, the program code, in conjunction with the processor, provides a unique apparatus that operates similarly to an application-specific integrated circuit (ASIC).

[0070] Although the present disclosure has been described above with reference to embodiments, it is not intended to limit the present disclosure. Those skilled in the art can make various modifications and refinements without departing from the spirit and scope of the present disclosure. Therefore, the scope of protection of the present disclosure shall be determined by the appended claims.

Claims

1. A method for unlocking a device, characterized in that, For unlocking an electronic device operable by a user, and includes: Determine whether the user has made a starting gesture; When the user makes the initiating gesture, an unlocking image is displayed, which includes an indicative object having a first appearance; Obtain a state change from the initial gesture, and change the indicative object from the first appearance to a second appearance based on the state change; In response to the fact that the second appearance is substantially the same as a preset appearance, it is determined whether the user has made a gesture to end the action. as well as The electronic device is unlocked when the user makes the end gesture.

2. The device unlocking method as described in claim 1, characterized in that, The indicator object includes at least one of a visual pattern and a numerical display bar, and the device unlocking method further includes: Determine whether the second appearance is substantially the same as the preset appearance, wherein the preset appearance includes at least one of the visual pattern having a preset state and the numerical display bar having a preset password.

3. The device unlocking method as described in claim 2, characterized in that, A first range limit and a second range limit are determined based on the state change, and the preset password is selected from a numerical range defined based on the first range limit and the second range limit.

4. The device unlocking method as described in claim 1, characterized in that, Also includes: Based on sensor data associated with at least one of the user's hands, calculate the user's current hand posture data.

5. The device unlocking method as described in claim 4, characterized in that, The state change obtained from the initial gesture includes: A rotation angle is determined based on the current hand posture data and an initial hand posture data, wherein the initial hand posture data is calculated when the user makes the initial gesture.

6. The device unlocking method as described in claim 4, characterized in that, The state change obtained from the initial gesture includes: A displacement is determined based on the current hand posture data and an initial hand posture data, wherein the initial hand posture data is calculated when the user makes the initial gesture.

7. The device unlocking method as described in claim 4, characterized in that, The state change obtained from the initial gesture includes: A gesture change is determined based on the current hand posture data and an initial hand posture data, wherein the initial hand posture data is calculated when the user makes the initial gesture.

8. The device unlocking method as described in claim 4, characterized in that, Also includes: An image of at least one of the user's hands is generated using a camera as the sensing data.

9. The device unlocking method as described in claim 4, characterized in that, Also includes: A motion sensor generates motion data of at least one of the user's hands as the sensing data.

10. The device unlocking method as described in claim 1, characterized in that, Unlocking the electronic device includes: Stop displaying the unlock image.

11. A device unlocking system, characterized in that, For unlocking an electronic device operable by a user, and includes: A display panel; A sensor for generating sensory data related to a hand movement of the user; and A processor, coupled to the sensor and the display panel, is used to: Based on the sensor data, it is determined whether the user has made a starting gesture; When the user makes the initiation gesture, the display panel is controlled to display an unlock image containing an indicative object with a first appearance; Based on the sensing data, a state change from the initial gesture is obtained, and the display panel is controlled to change the indicative object from the first appearance to a second appearance based on the state change. In response to the fact that the second appearance is substantially the same as a preset appearance, the system determines, based on the sensing data, whether the user has made a gesture to end the interaction; and The electronic device is unlocked when the user makes the end gesture.

12. A non-transitory computer-readable storage medium, characterized in that, A computer program is provided for executing a device unlocking method, wherein the device unlocking method is used to unlock an electronic device operable by a user, and includes: Determine whether the user has made a starting gesture; When the user makes the initiating gesture, an unlocking image is displayed, which includes an indicative object having a first appearance; Obtain a state change from the initial gesture, and change the indicative object from the first appearance to a second appearance based on the state change; In response to the fact that the second appearance is substantially the same as a preset appearance, it is determined whether the user has made a gesture to end the action. as well as The electronic device is unlocked when the user makes the end gesture.

Images