Unlocking method and electronic device

Abstract

Embodiments of the present invention disclose an unlocking method and an electronic device, relating to the field of communication technologies, which can solve the problem of poor security of the electronic device. The method includes: displaying N virtual objects, where N is an integer greater than or equal to 2; receiving a first input from a user for a target virtual object among the N virtual objects; and unlocking the electronic device in response to the first input when the target virtual object is a preset virtual object and the input feature of the first input matches the preset input feature. Embodiments of the present invention are applied to the process of unlocking an electronic device according to a user's input.

Description

Technical Field

[0001] Embodiments of the present invention relate to the field of communication technologies, and in particular, to an unlocking method and an electronic device. Background Art

[0002] Currently, during the use of an electronic device, a user can input on a physical button (such as a power button) of the electronic device to unlock the electronic device, so that the user can use the electronic device.

[0003] However, in the above method, since the electronic device is unlocked through the power button, other users can also input on the power button to unlock the electronic device. Therefore, it may lead to the leakage of user privacy, and thus the security of the electronic device is poor. Summary of the Invention

[0004] Embodiments of the present invention provide an unlocking method and an electronic device, which can solve the problem of poor security of the electronic device.

[0005] To solve the above technical problems, the embodiments of the present invention adopt the following technical solutions:

[0006] In a first aspect of the embodiments of the present invention, an unlocking method is provided, which is applied to an electronic device. The unlocking method includes: displaying N virtual objects, where N is an integer greater than or equal to 2; receiving a first input from a user to a target virtual object among the N virtual objects; and in response to the first input, unlocking the electronic device when the target virtual object is a preset virtual object and the input feature of the first input matches a preset input feature.

[0007] In a second aspect of the embodiments of the present invention, an electronic device is provided. The electronic device includes: a display module, a receiving module, and an unlocking module. The display module is configured to display N virtual objects, where N is an integer greater than or equal to 2. The receiving module is configured to receive a first input from a user to a target virtual object among the N virtual objects displayed by the display module. The unlocking module is configured to, in response to the first input received by the receiving module, unlock the electronic device when the target virtual object is a preset virtual object and the input feature of the first input matches a preset input feature.

[0008] In a third aspect of the embodiments of the present invention, an electronic device is provided. The electronic device includes a processor, a memory, and a computer program stored in the memory and executable on the processor. When the computer program is executed by the processor, the steps of the unlocking method described in the first aspect are implemented.

[0009] In a fourth aspect of the embodiments of the present invention, there is provided a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the unlocking method described in the first aspect are implemented.

[0010] In the embodiments of the present invention, an electronic device can display N virtual objects, and based on a first input by a user to a target virtual object among the N virtual objects, when the target virtual object is a preset virtual object and the input feature of the first input matches a preset input feature, the electronic device is unlocked. Since there are multiple virtual objects displayed on the electronic device, when the user triggers the unlocking of the electronic device, the user needs to select from the multiple virtual objects the virtual object that can trigger the unlocking of the electronic device, that is, when the virtual object selected by the user is a preset virtual object and the input feature of the first input matches the preset input feature, the electronic device is unlocked. That is, when the virtual object selected by the user is not a preset virtual object, and / or the input feature of the first input does not match the preset input feature, the electronic device is not unlocked. Therefore, it is possible to prevent other users from directly unlocking the electronic device through the power button of the electronic device, thereby avoiding the leakage of user privacy, and thus improving the security of the electronic device. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] Figure 1 It is a schematic diagram of the architecture of an Android operating system provided by an embodiment of the present invention;

[0012] Figure 2 It is one of the schematic diagrams of an unlocking method provided by an embodiment of the present invention;

[0013] Figure 3 It is one of the example schematic diagrams of the interface of an electronic device provided by an embodiment of the present invention;

[0014] Figure 4 It is another example schematic diagram of the interface of an electronic device provided by an embodiment of the present invention;

[0015] Figure 5 It is another schematic diagram of an unlocking method provided by an embodiment of the present invention;

[0016] Figure 6 It is another example schematic diagram of the interface of an electronic device provided by an embodiment of the present invention;

[0017] Figure 7A It is another example schematic diagram of the interface of an electronic device provided by an embodiment of the present invention;

[0018] Figure 7B It is another example schematic diagram of the interface of an electronic device provided by an embodiment of the present invention;

[0019] Figure 8The third schematic diagram of an unlocking method provided by an embodiment of the present invention;

[0020] Figure 9 The sixth schematic diagram of an example interface of an electronic device provided by an embodiment of the present invention;

[0021] Figure 10 The fourth schematic diagram of an unlocking method provided by an embodiment of the present invention;

[0022] Figure 11 The seventh schematic diagram of an example interface of an electronic device provided by an embodiment of the present invention;

[0023] Figure 12 The fifth schematic diagram of an unlocking method provided by an embodiment of the present invention;

[0024] Figure 13 The eighth schematic diagram of an example interface of an electronic device provided by an embodiment of the present invention;

[0025] Figure 14 The structural schematic diagram of an electronic device provided by an embodiment of the present invention;

[0026] Figure 15 The hardware schematic diagram of an electronic device provided by an embodiment of the present invention. Detailed implementation manners

[0027] Next, the technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, rather than all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without making creative efforts belong to the scope of protection of the present invention.

[0028] The terms "first" and "second" in the description and claims of the embodiments of the present invention are used to distinguish different objects, rather than to describe a specific order of the objects. For example, the first input and the second input are used to distinguish different inputs, rather than to describe a specific order of the inputs.

[0029] In the description of the embodiments of the present invention, unless otherwise specified, the meaning of "a plurality" refers to two or more. For example, a plurality of elements refers to two elements or more than two elements.

[0030] The term "and / or" in this article is a relational term describing associated objects, indicating that three relationships may exist. For example, the display panel and / or the backlight may indicate: the display panel exists alone, the display panel and the backlight exist simultaneously, and the backlight exists alone. The symbol " / " in this article indicates that the associated objects are in an "or" relationship. For example, input / output indicates input or output.

[0031] In the embodiments of the present invention, words such as "exemplary" or "for example" are used to indicate examples, illustrations or explanations. Any embodiment or design solution described as "exemplary" or "for example" in the embodiments of the present invention should not be construed as being more preferred or having more advantages than other embodiments or design solutions. Rather, the use of words such as "exemplary" or "for example" is intended to present relevant concepts in a specific manner.

[0032] The embodiments of the present invention provide an unlocking method and an electronic device. Since there are multiple virtual objects displayed on the electronic device, when the user triggers the unlocking of the electronic device, the user needs to select a virtual object from the multiple virtual objects that can trigger the unlocking of the electronic device, that is, the virtual object selected by the user is a preset virtual object, and when the input feature of the first input matches the preset input feature, the electronic device unlocks. That is, when the virtual object selected by the user is not a preset virtual object, and / or when the input feature of the first input does not match the preset input feature, the electronic device does not unlock. Therefore, it is possible to prevent other users from directly unlocking the electronic device through the power button of the electronic device, thereby avoiding the leakage of the user's privacy, and thus improving the security of the electronic device.

[0033] The unlocking method and the electronic device provided by the embodiments of the present invention can be applied to the process of unlocking the electronic device. Specifically, it can be applied to the process of the electronic device unlocking according to the user's input.

[0034] The electronic device in the embodiments of the present invention can be an electronic device with an operating system. The operating system can be the Android operating system, can be the iOS operating system, or can be other possible operating systems, which are not specifically limited in the embodiments of the present invention.

[0035] Next, taking the Android operating system as an example, the software environment to which the unlocking method provided by the embodiments of the present invention is applied will be introduced.

[0036] As Figure 1 shown, it is a schematic diagram of the architecture of a possible Android operating system provided by the embodiments of the present invention. In Figure 1 , the architecture of the Android operating system includes 4 layers, namely: the application layer, the application framework layer, the system runtime layer, and the kernel layer (specifically, it can be the Linux kernel layer).

[0037] Among them, the application layer includes various applications in the Android operating system (including system applications and third-party applications).

[0038] The application framework layer is the framework of the application. Developers can develop some applications based on the application framework layer while complying with the development principles of the application framework.

[0039] The system runtime library layer includes libraries (also known as system libraries) and the Android operating system runtime environment. The libraries mainly provide various resources required by the Android operating system. The Android operating system runtime environment is used to provide a software environment for the Android operating system.

[0040] The kernel layer is the operating system layer of the Android operating system and belongs to the bottom layer of the software hierarchy of the Android operating system. The kernel layer provides core system services and hardware-related drivers for the Android operating system based on the Linux kernel.

[0041] Taking the Android operating system as an example, in the embodiments of the present invention, developers can develop a software program for implementing the unlocking method provided in the embodiments of the present invention based on the system architecture of the Android operating system as shown in Figure 1 shown above, so that the unlocking method can run based on the Android operating system as shown in Figure 1 shown above. That is, the processor or the electronic device can implement the unlocking method provided in the embodiments of the present invention by running the software program in the Android operating system.

[0042] The electronic device in the embodiments of the present invention can be a mobile electronic device or a non-mobile electronic device. Exemplarily, the mobile electronic device can be a mobile phone, a tablet computer, a laptop computer, a handheld computer, an in-vehicle electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (PDA), etc., and the non-mobile electronic device can be a personal computer (PC), a television (TV), a teller machine, or a self-service machine, etc. The embodiments of the present invention do not make specific limitations.

[0043] Next, with reference to the accompanying drawings, a detailed description will be given of an unlocking method and an electronic device provided in the embodiments of the present invention through specific embodiments and their application scenarios.

[0044] In an embodiment of the present invention, when a user needs to unlock an AR electronic device (hereinafter simply referred to as an AR device), the user can first input to the AR device to make the display screen of the AR device turn on and in an unlocked state, and display a plurality of virtual objects on the display screen. Thus, the user can input to a virtual object (such as a target virtual object) among the plurality of virtual objects (such as a first input), so that the AR device can determine whether the virtual object selected by the user is a preset virtual object according to the first input of the user, and whether the input feature of the first input matches the preset input feature. And when the virtual object selected by the user is a preset virtual object and the input feature of the first input matches the preset input feature, the AR device is unlocked. Therefore, it is possible to prevent other users from directly unlocking the AR device through the power button of the AR device, thereby avoiding the leakage of user privacy, and thus improving the security of the AR device.

[0045] An unlocking method provided by an embodiment of the present invention Figure 2 shows a flowchart of an unlocking method provided by an embodiment of the present invention. This method can be applied to an electronic device with an Android operating system as shown in Figure 1 shown. As shown in Figure 2 shown, the unlocking method provided by an embodiment of the present invention may include the following steps 201 to 203.

[0046] Step 201: The electronic device displays N virtual objects.

[0047] In an embodiment of the present invention, N is an integer greater than or equal to 2.

[0048] Optionally, in an embodiment of the present invention, when detecting a preset operation of the user, the electronic device displays N virtual objects.

[0049] In an embodiment of the present invention, when the user uses the electronic device, the user can light up the display screen of the electronic device (that is, trigger the electronic device to be in a turned-on and unlocked state), so that the electronic device can detect whether the operation of the user is a preset operation.

[0050] Optionally, in an embodiment of the present invention, the electronic device may be an electronic device with a virtual imaging function, such as a virtual reality (VR) electronic device or an augmented reality (AR) electronic device.

[0051] Optionally, in an embodiment of the present invention, the above N virtual objects may include at least one of the following: virtual images, virtual patterns, virtual characters, virtual pictures, etc.

[0052] Optionally, in an embodiment of the present invention, each of the above N virtual objects may be an AR object.

[0053] It should be noted that the above "AR object" can be understood as follows: The AR device analyzes a real object to obtain the characteristic information of the real object (such as the type information of the real object, the appearance information of the real object (such as structure, color, shape, etc.), and the position information of the real object in space, etc.), and constructs an AR model in the AR device according to the characteristic information.

[0054] Optionally, in the embodiments of the present invention, the electronic device can obtain the operation of the user through the camera of the electronic device to determine whether the user performs a preset operation.

[0055] Optionally, in the embodiments of the present invention, the above preset operation can be any one of the following: the operation of the user on the target physical object, the operation of the user on the first virtual object, and the operation of the user on the electronic device.

[0056] Optionally, in the embodiments of the present invention, the above first virtual object can be a virtual object among N virtual objects.

[0057] Optionally, in the embodiments of the present invention, the above preset operation can specifically be the movement input of the user on the target physical object, or can be the rotation input of the user on the target physical object, or can be the shaking input of the user on the target physical object.

[0058] It should be noted that the above target physical object is a real object.

[0059] Optionally, in the embodiments of the present invention, the electronic device can display N virtual objects on the display screen of the electronic device.

[0060] Optionally, in the embodiments of the present invention, the electronic device can display N virtual objects in an area on the display screen (such as the display area of the virtual object corresponding to the target physical object); or, the electronic device can display N virtual objects in another area on the display screen (such as the surrounding area corresponding to the display area of the virtual object corresponding to the target physical object).

[0061] Optionally, in the embodiments of the present invention, the electronic device can adopt a preset display method to display N virtual objects, and the preset display method can be any one of the following: an animation display method, a color display method, and a flashing display method.

[0062] Exemplarily, when the electronic device detects that the operation of the user on the target physical object (such as a cup) is a preset operation, the electronic device can control N virtual objects to "fly" out of the cup to display the N virtual objects in an area on the display screen (that is, the surrounding area corresponding to the display area of the virtual object corresponding to the cup).

[0063] For example, taking the AR glasses as an example of the electronic device for illustration. As Figure 3As shown, the user can perform a preset operation on the AR glasses (for example, the user's rotational input on a target physical object (such as cup 10)), so that the AR glasses can, according to the user's preset operation, display N virtual objects (such as "butterfly" virtual image 11, "cloud" virtual image 12, "moon" virtual image 13, "star" virtual image 14, and "a" virtual character 15) in the surrounding area of the virtual object corresponding to cup 10).

[0064] Optionally, in the embodiments of the present invention, the electronic device can obtain the trajectory information of the user's operation on the target physical object through the camera of the electronic device, and compare the trajectory information with the preset trajectory information in the electronic device to determine whether the user's operation on the target physical object is a preset operation.

[0065] Optionally, in the embodiments of the present invention, the above preset operation can specifically be the user's gesture input on the first virtual object.

[0066] It should be noted that the above gesture input can be understood as: the user simulates a movement input, a shaking input, a rotational input, etc. on the first virtual object through gestures, so that the first virtual object moves, shakes, or rotates.

[0067] Optionally, in the embodiments of the present invention, the above gesture input can include any one of the following: a gesture input of stretching and clenching fingers, a gesture input of rotating the palm, a gesture input of translating the palm, etc.

[0068] Optionally, in the embodiments of the present invention, when detecting the user's operation on the first virtual object, the electronic device can display N virtual objects in the virtual area corresponding to the environment area where the electronic device is located (such as the ground plane displayed by the electronic device or a physical object in the environment).

[0069] Exemplarily, as Figure 4 shown, the user can perform a preset operation on the AR glasses (for example, the user's gesture input on the first virtual object (such as "key" virtual object 16) (for example, the input of the user grasping the "key" virtual object 16)), so that the AR glasses can, according to the user's preset operation, display N virtual objects (such as "cloud" virtual image 17, "star" virtual image 18, "a" virtual character 19, and "cup" virtual image 20) in the virtual area corresponding to the environment area where the AR glasses are located).

[0070] Optionally, in an embodiment of the present invention, the electronic device may obtain trajectory information of a user's operation on a first virtual object through a camera of the electronic device, compare the trajectory information with preset trajectory information in the electronic device, and the electronic device may obtain position information of the user's operation on the first virtual object and position information of the first virtual object through the camera of the electronic device, and compare the position information of the user's operation on the first virtual object and the position information of the first virtual object to determine whether the user's operation on the target physical object is a preset operation.

[0071] Optionally, in an embodiment of the present invention, the above preset operation may specifically be a pressing input of a physical button of the electronic device to trigger the electronic device to be in a screen-on and unlocked state.

[0072] Optionally, in an embodiment of the present invention, when detecting an operation of a user on a physical button of the electronic device, the electronic device may project and display N virtual objects in an area in the environment where the electronic device is located (such as a ground plane or a physical object in the environment).

[0073] Optionally, in an embodiment of the present invention, in a motion scenario, the user may perform a long press input on a physical button of the electronic device so that the electronic device can project and display N virtual objects.

[0074] Optionally, in an embodiment of the present invention, when the user uses the electronic device, the user may perform an input on a target physical object through the electronic device (such as a gaze input) so that the electronic device enables a display function of virtual objects. In combination Figure 2 , as Figure 5 shown, before the above step 201, the unlocking method provided by the embodiment of the present invention may further include the following step 301, and the above step 201 may specifically be implemented through the following step 201a.

[0075] Step 301: The electronic device obtains a gaze area and a gaze duration of the user's line of sight.

[0076] Optionally, in an embodiment of the present invention, the electronic device may obtain a gaze area and a gaze duration of the user's line of sight through a camera.

[0077] Optionally, in an embodiment of the present invention, the electronic device may obtain gaze point information of the user through a camera (such as information on the position of the gaze point, and / or, information on the direction of the gaze point) to determine a gaze area and a gaze duration of the user's line of sight based on the gaze point information.

[0078] Optionally, in the embodiments of the present invention, if there is one physical object in the gaze area of the user's line of sight, the electronic device may determine the one physical object as the target physical object; if there are at least two physical objects in the gaze area of the user's line of sight, the electronic device may randomly select one physical object from the at least two physical objects to determine the one physical object as the target physical object.

[0079] Step 201a: When the gaze area includes the target physical object and the gaze duration is greater than or equal to the first preset threshold, the electronic device displays N virtual objects.

[0080] Optionally, in the embodiments of the present invention, if the gaze area includes the target physical object and the gaze duration is greater than or equal to the first preset threshold, the electronic device may mark the virtual object corresponding to the target physical object on the display screen of the electronic device by using a preset marking method, and the preset marking method may be any one of the following: a dotted box marking method, a highlighting marking method, a color marking method, a grayscale marking method, a marking method with a preset transparency, and a flashing marking method, etc.

[0081] Optionally, in the embodiments of the present invention, when the gaze duration is greater than or equal to the first preset threshold, if the electronic device detects an operation of the user on the target physical object, the electronic device displays N virtual objects.

[0082] Optionally, in the embodiments of the present invention, when the gaze duration is greater than or equal to the first preset threshold, the electronic device may display the first virtual object; if the electronic device detects an operation of the user on the first virtual object, the electronic device displays other virtual objects (i.e., the virtual objects other than the first virtual object among the N virtual objects).

[0083] Optionally, in the embodiments of the present invention, when the above preset operation is an operation of the user on the first virtual object, the first virtual object is the virtual object displayed when the gaze duration is greater than or equal to the first preset threshold.

[0084] In the embodiments of the present invention, when the gaze area includes the target physical object and the user's gaze duration on the target physical object is greater than or equal to the first preset threshold, the electronic device displays N virtual objects. Therefore, the electronic device can determine whether to display N virtual objects through multiple detections, so as to improve the security of the electronic device.

[0085] Optionally, in the embodiments of the present invention, the above step 201a may be specifically implemented through the following steps 201a1 to 201a3.

[0086] Step 201a1: When the gaze area includes the target physical object and the gaze duration is greater than or equal to the first preset threshold, and when the target physical object is at the first display angle, the electronic device displays the i-th virtual object in the first area of the target physical object.

[0087] In an embodiment of the present invention, the above-mentioned first region is a visible region on the target object at a first display angle.

[0088] In an embodiment of the present invention, i is a positive integer, and i ≤ N.

[0089] It should be noted that the above-mentioned "display angle" can be understood as: the angle value by which the side of the target object located within the user's gaze area rotates relative to the preset reference plane of the target object; the above-mentioned "visible region on the target object" can be understood as: the part of the target object that can be viewed when the user gazes at the target object.

[0090] In an embodiment of the present invention, the above-mentioned ith virtual object is a virtual object among the N virtual objects.

[0091] It can be understood that the electronic device can project and display N virtual objects in different regions of the target object in sequence.

[0092] Optionally, in an embodiment of the present invention, the electronic device can project and display the ith virtual object in the first region of the target object.

[0093] Step 201a2: The electronic device receives a second input from the user.

[0094] In an embodiment of the present invention, the above-mentioned second input is an input for the user to rotate the target object to a second display angle, and this second input is used to trigger the rotation of the target object relative to the electronic device.

[0095] Optionally, in an embodiment of the present invention, the difference between the above-mentioned second display angle and the first display angle is greater than or equal to a preset angle value.

[0096] Optionally, in an embodiment of the present invention, the above-mentioned second input can specifically be an input for the user to rotate the electronic device so that the target object rotates relative to the electronic device; or, the above-mentioned second input can specifically be an input for the user to rotate the target object so that the target object rotates relative to the electronic device.

[0097] Step 201a3: In response to the second input, the electronic device displays the (i + 1)th virtual object in the second region of the target object.

[0098] In an embodiment of the present invention, the above-mentioned second region is a visible region on the target object at a second display angle.

[0099] It can be understood that the above-mentioned second region and the first region are different regions on the target object.

[0100] Optionally, in the embodiments of the present invention, the electronic device may first project and display a virtual object (e.g., the i-th virtual object) on an area (e.g., the first area) of the target physical object, and then, when the rotation angle value of the target physical object by the user is greater than or equal to a preset angle value (e.g., rotating the target physical object to the second display angle), project and display the next virtual object (e.g., the i + 1-th virtual object) on another area (e.g., the second area) of the target physical object, and so on, until the last virtual object is projected and displayed, thereby projecting and displaying N virtual objects.

[0101] Exemplarily, as Figure 6 shown in (A) of FIG., when the target physical object (e.g., the cup 21) is at the first display angle, the AR glasses may project and display the i-th virtual object (e.g., the virtual character "b") on the first area (e.g., area 22) of the cup 21, and then, when the user rotates the cup 21 to the second display angle, as Figure 6 shown in (B) of FIG., the AR glasses may project and display the i + 1-th virtual object (e.g., the virtual character "cd") on the second area (e.g., 23) of the cup 21.

[0102] It can be understood that N virtual objects can be projected and displayed on the target physical object at different angles by the rotation of the target physical object by the user (or by the rotation of the electronic device worn by the user around the target physical object), so that the user can input to the N virtual objects to complete the unlocking operation. The embodiments of the present invention are not limited to a fixed space or path, and can provide multiple unlocking methods for the user.

[0103] In the embodiments of the present invention, when the target physical object is at the first display angle, the electronic device projects and displays a virtual object on an area of the target physical object, and when the rotation angle value of the target physical object by the user is greater than or equal to a preset angle value (e.g., rotating the target physical object to the second display angle), the electronic device will display the next virtual object on another area of the target physical object to display N virtual objects, that is, the N virtual objects are conditional. The user needs to rotate the target physical object multiple times to trigger the electronic device to sequentially display the N virtual objects, rather than the electronic device directly displaying the N virtual objects. Therefore, other users except those who know the unlocking password cannot trigger the electronic device to display the N virtual objects, increasing the unlocking difficulty for strange users, thereby improving the security of the electronic device.

[0104] Optionally, in the embodiments of the present invention, in a motion scenario, the user may input through a physical button of the electronic device to enable the electronic device to turn on the display function of the virtual object. Before the above step 201, the unlocking method provided by the embodiments of the present invention may further include the following step 401, and the above step 201 may specifically be implemented through the following steps 201b to 201d.

[0105] Step 401: The electronic device receives a third input from the user to the electronic device.

[0106] In the embodiments of the present invention, the above-mentioned third input is used to trigger the electronic device to display a virtual object.

[0107] Optionally, in the embodiments of the present invention, the above-mentioned third input may specifically be a long-press input by the user on a physical button (such as a touch sensor) of the electronic device.

[0108] Step 201b: In response to the third input, when the input duration of the third input is greater than or equal to a second preset threshold, the electronic device displays the j-th virtual object at a first position of the first physical object.

[0109] Optionally, in the embodiments of the present invention, when detecting an operation by the user on a physical button of the electronic device, the electronic device may obtain the current system time to determine the input duration of the third input based on the current system time and the end time of the third input.

[0110] Optionally, in the embodiments of the present invention, the above-mentioned first physical object may be a physical object in the environment where the electronic device is located, such as: a ground plane (such as the ground of a playground), the surface of a building, the surface of a plant, etc.

[0111] Optionally, in the embodiments of the present invention, the above-mentioned first position may be any position within the visible area of the first physical object.

[0112] In the embodiments of the present invention, the above-mentioned j-th virtual object is any one of the N virtual objects.

[0113] It can be understood that the electronic device may sequentially project and display N virtual objects at different positions on the first physical object.

[0114] Optionally, in the embodiments of the present invention, the electronic device may project and display the j-th virtual object at the first position of the first physical object.

[0115] Step 201c: When the electronic device is updated from a first geographical location to a second geographical location, the electronic device obtains the motion parameters of the electronic device.

[0116] In the embodiments of the present invention, the above-mentioned first position is the position corresponding to the first geographical location.

[0117] It should be noted that the above "the first position is the position corresponding to the first geographical location" can be understood as: the first position is the position within the visible area on the first physical object when the electronic device is at the first geographical location.

[0118] Optionally, in the embodiments of the present invention, the above first geographical location may be the location where the electronic device is located when the electronic device receives a third input from the user.

[0119] Optionally, in the embodiments of the present invention, when the electronic device receives a third input from the user, the electronic device may obtain the geographical location of the electronic device (i.e., the first geographical location) through the global positioning system (GPS), or may obtain the first geographical location of the electronic device according to the cell information of the network registered by the electronic device. It can be specifically determined according to actual usage requirements, and the embodiments of the present invention do not make limitations.

[0120] Optionally, in the embodiments of the present invention, the difference between the above second geographical location and the first geographical location is greater than or equal to a preset distance threshold.

[0121] Optionally, in the embodiments of the present invention, the electronic device may obtain the geographical location of the electronic device in real time to determine whether the electronic device is updated from the first geographical location to the second geographical location.

[0122] In the embodiments of the present invention, the above motion parameters include at least one of the following: the distance that the electronic device moves, the motion time of the electronic device, and the number of motion steps of the user holding the electronic device while moving; j is a positive integer, and j ≤ N.

[0123] Optionally, in the embodiments of the present invention, the electronic device may detect the motion state of the electronic device through the motion sensor of the electronic device to obtain the starting motion information of the electronic device, so that the electronic device may determine the motion parameters of the electronic device according to the starting motion information.

[0124] Optionally, in the embodiments of the present invention, the above motion sensor may include at least one of the following: a gyroscope, a gravity sensor, an acceleration sensor, etc.

[0125] Optionally, in the embodiments of the present invention, the above starting motion information includes at least one of the following: the starting motion position and the starting motion time.

[0126] Optionally, in the embodiments of the present invention, the electronic device may determine the distance that the electronic device moves according to the starting motion position and the second geographical location.

[0127] Optionally, in the case where the electronic device is updated from the first geographical location to the second geographical location, the electronic device may obtain the current system time to determine the motion time of the electronic device according to the current system time and the starting motion time.

[0128] Optionally, in the embodiments of the present invention, the electronic device may obtain the number of motion steps of the user holding the electronic device while moving through the gravity sensor of the electronic device.

[0129] Step 201d: When the motion parameters match the preset parameters, the electronic device displays the (j + 1)-th virtual object at the second position of the first physical object.

[0130] In the embodiment of the present invention, the above-mentioned second position is the position corresponding to the second geographical location.

[0131] It should be noted that the above-mentioned "the second position is the position corresponding to the second geographical location" can be understood as: the second position is the position within the visible area on the first physical object when the electronic device is at the second geographical location.

[0132] It can be understood that the above-mentioned second position and the first position are different positions on the first physical object.

[0133] Optionally, in the embodiment of the present invention, when the difference between the motion parameters and the preset parameters is less than or equal to the preset parameter value, the electronic device projects and displays the (j + 1)-th virtual object at the second position of the first physical object.

[0134] Optionally, in the embodiment of the present invention, the electronic device can first project and display a virtual object (such as the j-th virtual object) at a position (such as the first position) on the first physical object, and then when the geographical location of the electronic device changes by greater than or equal to the preset distance threshold (such as being updated from the first geographical location to the second geographical location) and the motion parameters match the preset parameters, project and display the next virtual object (such as the (j + 1)-th virtual object) at another position (such as the second position) on the first physical object, and so on, until the last virtual object is projected and displayed, thereby projecting and displaying N virtual objects.

[0135] Exemplarily, as Figure 7A shown, when the input duration of the third input is greater than or equal to the second preset threshold, the AR glasses can project and display the j-th virtual object (such as the "butterfly" virtual image) at the first position (such as position 25) of the first physical object (such as the ground plane 24), and then when the AR glasses are updated from the first geographical location to the second geographical location and the motion parameters of the AR glasses match the preset parameters, as Figure 7B shown, the AR glasses can project and display the (j + 1)-th virtual object (such as the "doll" virtual image) at the second position (such as position 26) of the ground plane 24.

[0136] It can be understood that the user can wear the electronic device to move, project and display N virtual objects at different positions on the first physical object, so that the user can input to the N virtual objects to complete the unlocking operation.

[0137] In an embodiment of the present invention, when the input duration of the third input of the user to the electronic device is greater than or equal to a second preset threshold, the electronic device projects and displays a virtual object at a position of the first physical object, and when the electronic device is updated from a first geographical location to a second geographical location (i.e., the geographical location change of the electronic device is greater than or equal to a preset distance threshold) and the motion parameters match the preset parameters, the electronic device then displays the next virtual object at another position of the first physical object to display N virtual objects. That is, the user needs to wear the electronic device and move to multiple different positions to trigger the electronic device to sequentially display the N virtual objects, rather than the electronic device directly displaying the N virtual objects. Therefore, the situation where other users can also trigger the electronic device to display the N virtual objects can be avoided, thereby improving the security of the electronic device.

[0138] Step 202: The electronic device receives a first input from the user for a target virtual object among the N virtual objects.

[0139] In an embodiment of the present invention, the above first input is used to trigger the electronic device to select a target virtual object from the N virtual objects.

[0140] Optionally, in an embodiment of the present invention, the above first input may be a gesture input of the user to the target virtual object (such as a gesture input of stretching - clenching fingers, including but not limited to a gesture input of rotating the palm, a gesture input of translating the palm, etc.) to select the target virtual object.

[0141] Optionally, in an embodiment of the present invention, the above target virtual object may be one virtual object or multiple virtual objects among the N virtual objects.

[0142] Optionally, in an embodiment of the present invention, when the target virtual object is one virtual object and the preset operation is an operation of the user on the target physical object, the above first input may specifically be a gesture input of the user to the one virtual object.

[0143] Optionally, in an embodiment of the present invention, when the target virtual object is multiple virtual objects and the preset operation is an operation of the user on the electronic device, the above first input may include multiple sub - inputs, and one sub - input is an input (such as a gesture input) of the user to one virtual object among the multiple virtual objects.

[0144] Optionally, in an embodiment of the present invention, when the target virtual object is one virtual object and the preset operation is an operation of the user on the first virtual object, the above first input may specifically be an input of the user to move the first virtual object to the target virtual object.

[0145] It should be noted that the above "moving the first virtual object to the target virtual object" can be understood as: after the first virtual object moves, at least part of the display area of the first virtual object coincides with the display area of the target virtual object.

[0146] Optionally, in the embodiments of the present invention, when the target virtual object is multiple virtual objects and the preset operation is the operation of the user on the first virtual object, the above first input may include multiple sub-inputs, and one sub-input is the input for the user to move the first virtual object to one of the multiple virtual objects.

[0147] Step 203: The electronic device responds to the first input and unlocks the electronic device when the target virtual object is a preset virtual object and the input feature of the first input matches the preset input feature.

[0148] Optionally, in the embodiments of the present invention, the electronic device may obtain the first information corresponding to the target virtual object to determine that the target virtual object is a preset virtual object when the first information matches the preset information in the electronic device.

[0149] It should be noted that the above "the first information matches the preset information in the electronic device" can be understood as: the first information corresponding to the target virtual object is the same as the preset information in the electronic device, or the difference between the first information corresponding to the target virtual object and the preset information in the electronic device is less than or equal to a preset threshold.

[0150] Optionally, in the embodiments of the present invention, the above first information includes the feature information of the target virtual object.

[0151] Optionally, in the embodiments of the present invention, the above feature information of the target virtual object may include at least one of the following: the grayscale value of the target virtual object, the detailed features of the target virtual object, the pixel value of the target virtual object, and the type information of the target virtual object.

[0152] Optionally, in the embodiments of the present invention, the above input feature may include at least one of the following: the input end position, the input action, and the input order.

[0153] Optionally, in the embodiments of the present invention, when the first input is the input for the user to move the first virtual object to the target virtual object, the electronic device may determine whether the input feature of the first input matches the preset input feature according to whether the input end position of the first input (i.e., the position of the first virtual object after moving) matches the position of the target virtual object.

[0154] Optionally, in an embodiment of the present invention, when the first input is a user's gesture input to the target virtual object, the electronic device can determine whether the input feature of the first input matches the preset input feature based on whether the input action of the first input matches the preset action.

[0155] Optionally, in an embodiment of the present invention, the first input includes multiple sub-inputs, and one sub-input is the user's input of one virtual object among the multiple virtual objects. The electronic device can determine whether the input feature of the first input matches the preset input feature based on whether the input order of the multiple sub-inputs matches the preset order.

[0156] It can be understood that the embodiments of the present invention provide richer unlocking forms, namely rich unlocking content and rich unlocking methods (unlocking methods that combine user gestures with physical objects), which can increase the fun of unlocking electronic devices, and through the combination of user gestures and physical objects, the security of electronic devices can be improved.

[0157] An unlocking method provided by an embodiment of the present invention is a method in which an electronic device can display N virtual objects and, based on a user's first input to a target virtual object among the N virtual objects, unlock the electronic device when the target virtual object is a preset virtual object and the input characteristics of the first input match the preset input characteristics. Since multiple virtual objects are displayed on the electronic device, when the user triggers the unlocking of the electronic device, the user needs to select a virtual object that can trigger the unlocking of the electronic device from the multiple virtual objects. That is, the electronic device is unlocked only when the virtual object selected by the user is a preset virtual object and the input characteristics of the first input match the preset input characteristics. That is, when the virtual object selected by the user is not a preset virtual object and / or the input characteristics of the first input do not match the preset input characteristics, the electronic device is not unlocked. Therefore, other users can be prevented from directly unlocking the electronic device through the power button of the electronic device, thereby preventing the user's privacy from being leaked, thereby improving the security of the electronic device.

[0158] It is understandable that with the development of AR electronic devices, users' private and personalized content will increase. Encrypting AR electronic devices can improve the security of user assets. The embodiments of the present invention provide a highly convenient unlocking method. When applied to AR electronic devices, it can promote the development of AR electronic devices while ensuring the security of user information.

[0159] Optionally, in a possible implementation of the embodiment of the present invention, the N virtual objects include a first virtual object, and the first input is an input by the user to move the first virtual object to the target virtual object. Figure 2 ,like Figure 8 As shown, the above step 203 can be specifically implemented through the following step 203a.

[0160] Step 203a: When the target virtual object is a preset virtual object and at least a part of the first virtual object overlaps with the target virtual object, the electronic device unlocks the electronic device.

[0161] Optionally, in an embodiment of the present invention, the above first input is specifically a gesture input by the user to move the first virtual object to the target virtual object (for example, a gesture input of stretching - clenching fingers, including but not limited to a gesture input of rotating the palm, a gesture input of translating the palm, etc.).

[0162] Optionally, in an embodiment of the present invention, the electronic device can obtain the position information of the moved first virtual object and the position information of the target virtual object to determine whether at least a part of the first virtual object overlaps with the target virtual object.

[0163] It should be noted that the above "at least a part of the first virtual object overlaps with the target virtual object" can be understood as: the first virtual object completely coincides with or partially coincides with the target virtual object.

[0164] Exemplarily, in combination with Figure 4 , as Figure 9 shown, the user can perform a first input on the "key" virtual object 16 (for example, an input on the "key" virtual object 16 and the "cup" virtual image 20), so that the AR glasses can, according to the user's first input, unlock the AR glasses when the first information corresponding to the "cup" virtual image 20 (for example, the feature information of the "cup" virtual image 20) is the same as the preset information in the AR glasses (for example, the "cup" feature information) and at least a part of the "key" virtual object 16 overlaps with the "cup" virtual image 20.

[0165] In an embodiment of the present invention, the electronic device unlocks the electronic device only when it detects that the target virtual object is a preset virtual object and at least a part of the first virtual object overlaps with the target virtual object; since the electronic device needs to perform multiple detections to determine whether to unlock the electronic device, the security of the electronic device can be improved.

[0166] Optionally, in another possible implementation manner of an embodiment of the present invention, in combination with Figure 2 , as Figure 10 shown, the above step 203 can be specifically implemented by the following step 203b.

[0167] Step 203b: When the target virtual object is a preset virtual object and the input action of the first input is a preset input action, the electronic device unlocks the electronic device.

[0168] Optionally, in the embodiments of the present invention, the above first input is specifically a gesture input of a user to a target virtual object.

[0169] Optionally, in the embodiments of the present invention, the electronic device can obtain the trajectory information of the input action of the user to the target virtual object through a camera, and compare the trajectory information of the input action with the trajectory information of the preset input action in the electronic device to determine whether the input action of the first input is a preset input action.

[0170] Exemplarily, in combination with Figure 3 , such as Figure 11 shown, the user can perform a first input (such as a gesture input of stretching - clenching fingers) on the target virtual object (such as the "butterfly" virtual image 11), so that the AR glasses can, according to the first input of the user, unlock the AR glasses when the first information corresponding to the "butterfly" virtual image 11 (such as the feature information of the "butterfly" virtual image 11) is the same as the preset information in the AR glasses (such as the "butterfly" feature information), and the input action of the first input (i.e., stretching - clenching fingers) is a preset action.

[0171] In the embodiments of the present invention, the electronic device unlocks the electronic device only when it detects that the target virtual object is a preset virtual object and the input action of the first input is a preset input action; since the electronic device needs to perform multiple detections to determine whether to unlock the electronic device, the security of the electronic device can be improved.

[0172] Optionally, in another possible implementation manner of the embodiments of the present invention, the above target virtual object includes M target virtual sub - objects, and the above preset virtual object includes M preset virtual sub - objects; the above first input includes M sub - inputs, and one sub - input is an input of the user to one target virtual sub - object; M is an integer greater than 1. In combination with Figure 2 , such as Figure 12 shown, the above step 203 can be specifically implemented by the following step 203c.

[0173] Step 203c: The electronic device unlocks the electronic device when the M target virtual sub - objects are the same as the M preset virtual sub - objects and the first input order of the M sub - inputs is the same as the preset second input order of the M preset virtual sub - objects.

[0174] Optionally, in the embodiments of the present invention, when detecting an operation of the physical button of the electronic device by the user, the electronic device can project and display N virtual objects on the ground plane.

[0175] Optionally, in the embodiments of the present invention, the electronic device may determine whether the M target virtual sub-objects are the same as the M preset virtual sub-objects by respectively matching the feature information of each target virtual sub-object with the feature information of a preset virtual sub-object one by one.

[0176] Optionally, in the embodiments of the present invention, after determining that the feature information of each target virtual sub-object respectively matches the feature information of a preset virtual sub-object, the electronic device may determine whether the first input order is the same as the preset second input order; or, after determining that the feature information of a target virtual sub-object corresponding to the first sub-input matches the feature information of a preset virtual sub-object, the electronic device may determine whether the target virtual sub-object corresponding to the first sub-input is the first preset virtual sub-object in the preset second input order, and after determining that the feature information of a target virtual sub-object corresponding to the second sub-input matches a piece of feature information, determine whether the target virtual sub-object corresponding to the second sub-input is the second preset virtual sub-object in the preset second input order, and so on, until it is determined whether the target virtual sub-object corresponding to the last sub-input is the last preset virtual sub-object in the preset second input order, so as to determine whether the first input order of the M sub-inputs is the same as the preset second input order of the M preset virtual sub-objects.

[0177] Exemplarily, as Figure 13 shown, the user may perform a first input (such as three sub-inputs) on the M target sub-virtual objects (such as the "butterfly" virtual images 27, 28, and 29) respectively, so that the AR glasses can, according to the user's first input, unlock the AR glasses when the feature information of the "butterfly" virtual image 27 is the same as the feature information of a preset virtual sub-object in the AR glasses (such as "butterfly" feature information), the feature information of the "butterfly" virtual image 28 is the same as the feature information of a preset virtual sub-object in the AR glasses (such as "butterfly" feature information), the feature information of the "butterfly" virtual image 29 is the same as the feature information of a preset virtual sub-object in the AR glasses (such as "butterfly" feature information), and the first input order of the three sub-inputs is the same as the preset second input order of the M target sub-virtual objects (i.e., the "butterfly" virtual images 27, 28, and 29).

[0178] In an embodiment of the present invention, the electronic device can sequentially project and display N virtual objects according to the user's operation on the electronic device. Thus, the user needs to sequentially select multiple virtual sub-objects from the N virtual objects that can trigger the unlocking of the electronic device. That is, when all the multiple virtual sub-objects selected by the user are preset virtual sub-objects and the input order of the multiple virtual sub-objects is the same as the preset order of the preset virtual sub-objects, the electronic device is unlocked. That is, when the multiple virtual sub-objects selected by the user are not preset virtual sub-objects, and / or the input order of the multiple virtual sub-objects is not the same as the preset order of the preset virtual sub-objects, the electronic device is not unlocked. Therefore, it is possible to avoid the situation where the electronic device is unlocked when the virtual objects selected by other users are preset virtual objects, thereby avoiding the leakage of the user's privacy and improving the security of the electronic device in this way.

[0179] It can be understood that the electronic device can sequentially project and display N virtual objects according to the user's operation on the electronic device when the electronic device is updated from the first geographical location to the second geographical location and the motion parameters match the preset parameters. Therefore, the embodiments of the present invention can be applied to mobile scenarios (such as sports scenarios, movie-watching scenarios, exhibition-viewing scenarios, etc.); the electronic device can complete the unlocking operation while moving.

[0180] Figure 14 Fig. shows a possible structural schematic diagram of the electronic device involved in the embodiment of the present invention. As Figure 14 shown, the electronic device 90 may include: a display module 91, a receiving module 92, and an unlocking module 93.

[0181] Among them, the display module 91 is used to display N virtual objects, where N is an integer greater than or equal to 2. The receiving module 92 is used to receive a first input from the user on a target virtual object among the N virtual objects displayed by the display module 91. The unlocking module 93 is used to unlock the electronic device in response to the first input received by the receiving module 92 when the target virtual object is a preset virtual object and the input feature of the first input matches the preset input feature.

[0182] [[ID=......]] ​

[0183] In a possible implementation, the electronic device 90 provided by the embodiments of the present invention may further include: an acquisition module. The acquisition module is configured to acquire the fixation area and fixation duration of the user's line of sight before the display module 91 displays N virtual objects. The display module 91 is specifically configured to display N virtual objects when the fixation area acquired by the acquisition module includes a target physical object and the fixation duration is greater than or equal to a first preset threshold.

[0184] In the embodiments of the present invention, the electronic device displays N virtual objects only when the fixation area includes a target physical object and the user's fixation duration on the target physical object is greater than or equal to a first preset threshold. Therefore, the electronic device can perform multiple detections to determine whether to display N virtual objects, thereby improving the security of the electronic device.

[0185] In a possible implementation, the display module 91 is specifically configured to, when the target physical object is at a first display angle, display the i-th virtual object in a first area of the target physical object, where the first area is a visible area on the target physical object at the first display angle; and receive a second input from the user, where the second input is an input for the user to rotate the target physical object to a second display angle; and in response to the second input, display the (i + 1)-th virtual object in a second area of the target physical object, where the second area is a visible area on the target physical object at the second display angle. Here, i is a positive integer and i ≤ N.

[0186] In the embodiments of the present invention, when the target physical object is at a first display angle, the electronic device projects and displays a virtual object in one area of the target physical object, and only when the angle value of the user rotating the target physical object is greater than or equal to a preset angle value (for example, rotating the target physical object to a second display angle), the electronic device displays the next virtual object in another area of the target physical object to display N virtual objects. Therefore, the electronic device can perform multiple detections to determine whether to display N virtual objects, thereby improving the security of the electronic device.

[0187] In a possible implementation, the N virtual objects include a first virtual object, and the first input is an input for the user to move the first virtual object to a target virtual object. The unlocking module 93 is specifically configured to unlock the electronic device when the target virtual object is a preset virtual object and at least a part of the first virtual object overlaps with the target virtual object.

[0188] In the embodiments of the present invention, the electronic device unlocks the electronic device only when it detects that the target virtual object is a preset virtual object and at least a part of the first virtual object overlaps with the target virtual object; since the electronic device needs to perform multiple detections to determine whether to unlock the electronic device, the security of the electronic device can be improved.

[0189] In a possible implementation, the above-mentioned unlocking module 93 is specifically configured to unlock the electronic device when the target virtual object is a preset virtual object and the input action of the first input is a preset input action.

[0190] In the embodiment of the present invention, the electronic device unlocks the electronic device only when it detects that the target virtual object is a preset virtual object and the input action of the first input is a preset input action; since the electronic device needs to perform multiple detections to determine whether to unlock the electronic device, the security of the electronic device can be improved.

[0191] In a possible implementation, the above-mentioned receiving module 92 is further configured to receive a third input from the user to the electronic device before the display module 91 displays N virtual objects. The display module 91 is specifically configured to, in response to the third input received by the receiving module 92, display the j-th virtual object at the first position of the first physical object when the input duration of the third input is greater than or equal to a second preset threshold; and when the electronic device is updated from the first geographical location to the second geographical location, obtain the motion parameters of the electronic device, where the first position corresponds to the first geographical location; and, when the motion parameters match the preset parameters, display the (j + 1)-th virtual object at the second position of the first physical object, where the second position corresponds to the second geographical location. The motion parameters include at least one of the following: the distance the electronic device moves, the movement time of the electronic device, and the number of movement steps of the user holding the electronic device while moving; j is a positive integer and j ≤ N.

[0192] In the embodiment of the present invention, when the input duration of the third input from the user to the electronic device is greater than or equal to the second preset threshold, the electronic device projects and displays a virtual object at a position of the first physical object, and when the electronic device is updated from the first geographical location to the second geographical location (i.e., the geographical location change of the electronic device is greater than or equal to the preset distance threshold) and the motion parameters match the preset parameters, the electronic device then displays the next virtual object at another position of the first physical object to display N virtual objects. Therefore, the electronic device can perform multiple detections to determine whether to display N virtual objects, thereby improving the security of the electronic device.

[0193] In a possible implementation, the above-mentioned target virtual object includes M target virtual sub-objects, and the above-mentioned preset virtual object includes M preset virtual sub-objects; the above-mentioned first input includes M sub-inputs, and one sub-input is the input of the user to one target virtual sub-object; M is an integer greater than 1. The unlocking module 93 is specifically configured to unlock the electronic device when the M target virtual sub-objects are the same as the M preset virtual sub-objects and the first input order of the M sub-inputs is the same as the preset second input order of the M preset virtual sub-objects.

[0194] In an embodiment of the present invention, the electronic device can determine whether to unlock the electronic device by respectively comparing the feature information of each target virtual sub-object with the feature information of a preset virtual sub-object, and comparing the first input order of M sub-inputs with the preset second input order of M preset virtual sub-objects, thereby improving the security of the electronic device.

[0195] The electronic device provided by the embodiment of the present invention can implement each process implemented by the electronic device in the above method embodiment. To avoid repetition, the detailed description will not be elaborated here.

[0196] Figure 15 A hardware schematic diagram of an electronic device for implementing various embodiments of the present invention. As Figure 15 shown, the electronic device 100 includes but is not limited to: a radio frequency unit 101, a network module 102, an audio output unit 103, an input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, a processor 110, and a power supply 111, etc.

[0197] It should be noted that those skilled in the art can understand that Figure 15 the structure of the electronic device shown in Figure 15 does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than

[0198] shown, or combine some components, or have different component arrangements. In an embodiment of the present invention, the electronic device includes but is not limited to mobile phones, tablet computers, laptop computers, handheld computers, vehicle-mounted terminals, wearable devices, and pedometers, etc.

[0199] Among them, the display unit 106 displays N virtual objects, where N is an integer greater than or equal to 2.

[0200] The user input unit 107 is configured to receive a first input from the user to a target virtual object among the N virtual objects.

[0201] An embodiment of the present invention provides an electronic device. Since there are multiple virtual objects displayed on the electronic device, when the user triggers the unlocking of the electronic device, the user needs to select a virtual object from the multiple virtual objects that can trigger the unlocking of the electronic device, that is, the virtual object selected by the user is a preset virtual object, and when the input feature of the first input matches the preset input feature, the electronic device unlocks. That is, when the virtual object selected by the user is not a preset virtual object, and / or when the input feature of the first input does not match the preset input feature, the electronic device does not unlock. Therefore, it is possible to prevent other users from directly unlocking the electronic device through the power button of the electronic device, thereby avoiding the leakage of user privacy, and thus improving the security of the electronic device.

[0202] It should be understood that in the embodiment of the present invention, the radio frequency unit 101 can be used for receiving and sending signals during information reception or call processes. Specifically, after receiving the downlink data from the base station, it is given to the processor 110 for processing; in addition, the uplink data is sent to the base station. Usually, the radio frequency unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low-noise amplifier, a duplexer, etc. In addition, the radio frequency unit 101 can also communicate with the network and other devices through a wireless communication system.

[0203] The network module 102 of the electronic device provides the user with wireless broadband Internet access, such as helping the user to send and receive emails, browse web pages, and access streaming media, etc.

[0204] The audio output unit 103 can convert the audio data received by the radio frequency unit 101 or the network module 102 or stored in the memory 109 into an audio signal and output it as sound. Moreover, the audio output unit 103 can also provide an audio output related to a specific function executed by the electronic device 100 (for example, a call signal reception sound, a message reception sound, etc.). The audio output unit 103 includes a speaker, a buzzer, and a receiver, etc.

[0205] The input unit 104 is used to receive audio or video signals. The input unit 104 may include a graphics processing unit (GPU) 1041 and a microphone 1042. The graphics processing unit 1041 processes the image data of static pictures or videos obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The processed image frames can be displayed on the display unit 106. The image frames processed by the graphics processing unit 1041 can be stored in the memory 109 (or other storage media) or transmitted via the radio frequency unit 101 or the network module 102. The microphone 1042 can receive sounds and process such sounds into audio data. The processed audio data can be output in a format that can be transmitted to a mobile communication base station via the radio frequency unit 101 in the case of a phone call mode.

[0206] The electronic device 100 further includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor and a proximity sensor. Among them, the ambient light sensor can adjust the brightness of the display panel 1061 according to the brightness of the ambient light, and the proximity sensor can turn off the display panel 1061 and / or the backlight when the electronic device 100 is moved to the ear. As a kind of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally three axes), and can detect the magnitude and direction of gravity when stationary, and can be used to identify the posture of the electronic device (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc.; the sensor 105 can also include a fingerprint sensor, a pressure sensor, an iris sensor, a molecular sensor, a gyroscope, a barometer, a hygrometer, a thermometer, an infrared sensor, etc., which will not be elaborated here.

[0207] The display unit 106 is used to display information input by the user or information provided to the user. The display unit 106 may include a display panel 1061, and the display panel 1061 can be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), etc.

[0208] The user input unit 107 can be used to receive input numerical or character information, and generate key signal inputs related to the user settings and function control of the electronic device. Specifically, the user input unit 107 includes a touch panel 1071 and other input devices 1072. The touch panel 1071, also known as a touch screen, can collect touch operations of the user thereon or nearby (such as operations of the user using a finger, a stylus, or any suitable object or accessory on or near the touch panel 1071). The touch panel 1071 can include two parts: a touch detection device and a touch controller. Among them, the touch detection device detects the touch orientation of the user, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and then sends it to the processor 110, and receives and executes the commands sent by the processor 110. In addition, various types such as resistive, capacitive, infrared, and surface acoustic wave can be used to implement the touch panel 1071. In addition to the touch panel 1071, the user input unit 107 can also include other input devices 1072. Specifically, the other input devices 1072 can include but are not limited to a physical keyboard, function keys (such as volume control keys, power on / off keys, etc.), a trackball, a mouse, a joystick, which will not be elaborated here.

[0209] Further, the touch panel 1071 can cover the display panel 1061. After the touch panel 1071 detects a touch operation thereon or nearby, it transmits the operation to the processor 110 to determine the type of touch event. Subsequently, the processor 110 provides a corresponding visual output on the display panel 1061 according to the type of touch event. Although in Figure 15 the touch panel 1071 and the display panel 1061 are implemented as two independent components to realize the input and output functions of the electronic device, in some embodiments, the touch panel 1071 and the display panel 1061 can be integrated to realize the input and output functions of the electronic device, and the specific implementation here is not limited.

[0210] The interface unit 108 is an interface for connecting an external device to the electronic device 100. For example, the external device can include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, an audio input / output (I / O) port, a video I / O port, a headset port, and so on. The interface unit 108 can be used to receive inputs from an external device (such as data information, power, etc.) and transmit the received inputs to one or more components within the electronic device 100 or can be used to transmit data between the electronic device 100 and the external device.

[0211] The memory 109 can be used to store software programs and various data. The memory 109 mainly includes a program storage area and a data storage area. Among them, the program storage area can store an operating system, application programs required for at least one function (such as a sound playback function, an image playback function, etc.); the data storage area can store data created according to the use of the mobile phone (such as audio data, phone book, etc.). In addition, the memory 109 can include high-speed random access memory and can also include non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other volatile solid-state storage devices.

[0212] The processor 110 is the control center of the electronic device, connecting various parts of the entire electronic device through various interfaces and circuits. By running or executing software programs and / or modules stored in the memory 109, and calling the data stored in the memory 109, it executes various functions of the electronic device and processes data, thereby monitoring the electronic device as a whole. The processor 110 can include one or more processing units; optionally, the processor 110 can integrate an application processor and a modem processor. Among them, the application processor mainly processes the operating system, user interface, application programs, etc., and the modem processor mainly processes wireless communication. It can be understood that the above-mentioned modem processor may not be integrated into the processor 110.

[0213] The electronic device 100 can also include a power supply 111 (such as a battery) for supplying power to each component. Optionally, the power supply 111 can be logically connected to the processor 110 through a power management system, so as to realize functions such as management of charging, discharging, and power consumption management through the power management system.

[0214] In addition, the electronic device 100 includes some functional modules not shown here and will not be elaborated further.

[0215] Optionally, an embodiment of the present invention also provides an electronic device, including the Figure 15 shown processor 110, memory 109, a computer program stored on the memory 109 and executable on the processor 110. When the computer program is executed by the processor 110, it realizes each process of the above method embodiment and can achieve the same technical effect. To avoid repetition, it will not be elaborated here.

[0216] Optionally, an embodiment of the present invention also provides an AR device, including a processor, a memory, a computer program stored on the memory and executable on the processor. When the computer program is executed by the processor, it realizes each process of the above method embodiment and can achieve the same technical effect. To avoid repetition, it will not be elaborated here.

[0217] Optionally, in the embodiments of the present invention, the electronic device in the above embodiments may be an AR device. Specifically, when the electronic device in the above embodiments (such as the electronic device shown in Figure 15 ) is an AR device, the AR device may include all or part of the functional modules in the above electronic device. Of course, the AR device may also include functional modules not included in the above electronic device.

[0218] It can be understood that in the embodiments of the present invention, when the electronic device in the above embodiments is an AR device, the electronic device may be an electronic device integrated with AR technology. Among them, AR technology is a technology that realizes the combination of the real scene and the virtual scene. By using AR technology, the visual function of humans can be restored, so that humans can experience the feeling of the combination of the real scene and the virtual scene through AR technology, and further enable humans to better experience the immersive feeling.

[0219] Taking the AR device as an AR glasses as an example, when the user wears the AR glasses, the scene seen by the user is generated by AR technology processing, that is, the virtual scene can be superimposed and displayed on the real scene through AR technology. When the user operates on the content displayed by the AR glasses, the user can see the AR glasses "peel off" the real scene, so as to show a more real side to the user. For example, when the user observes a cardboard box with the naked eye, only the outer shell of the cardboard box can be observed, but when the user wears the AR glasses, the user can directly observe the internal structure of the cardboard box through the AR glasses.

[0220] The above AR device may include a camera, so that the AR device can display and interact in combination with a virtual screen based on the picture captured by the camera. For example, in the embodiments of the present invention, when the user uses the AR device, the AR device may project and display a plurality of virtual objects on the virtual screen of the AR device, so that the user can input to the virtual objects among the plurality of virtual objects, so that the AR device can determine whether the virtual object selected by the user is a preset virtual object according to the user's input, and whether the input feature of the user's input matches the preset input feature, so as to determine whether to unlock the AR device.

[0221] In the embodiments of the present invention, the above virtual screen may be any carrier that can be used to display the content projected by the projection device when displaying content by using AR technology. Among them, the projection device may be a projection device using AR technology, such as the electronic device or AR device in the embodiments of the present invention.

[0222] In an embodiment of the present invention, when using AR technology to display content on a virtual screen, a projection device can project a virtual scene obtained (or internally integrated) by the projection device, or a virtual scene and a real scene, onto the virtual screen, so that the virtual screen can display this content, thereby showing the user the effect of superimposing the real scene and the virtual scene.

[0223] Optionally, in an embodiment of the present invention, in combination with different scenarios of AR technology applications, the virtual screen can generally be any possible carrier such as the display screen of an electronic device (such as a mobile phone), the lens of AR glasses, the windshield of a car, the wall of a room, etc.

[0224] Taking the virtual screen as the display screen of an electronic device, the lens of AR glasses, and the windshield of a car as examples respectively, the process of using AR technology to display content on the virtual screen will be described exemplarily below.

[0225] In one example, when the virtual screen is the display screen of an electronic device, the projection device can be the electronic device. The electronic device can collect the real scene in the area where the electronic device is located through its camera and display the real scene on the display screen of the electronic device. Then, the electronic device can project the virtual scene obtained (or internally integrated) by it onto the display screen of the electronic device, so that the virtual scene can be superimposed and displayed in the real scene, and further enable the user to see the effect after superimposing the real scene and the virtual scene through the display screen of the electronic device.

[0226] In another example, when the virtual screen is the lens of AR glasses, the projection device can be the AR glasses. When the user wears the glasses, the user can see the real scene in the area where the user is located through the lens of the AR glasses, and the AR glasses can project the virtual scene obtained (or internally integrated) by it onto the lens of the AR glasses, so that the user can see the display effect after superimposing the real scene and the virtual scene through the lens of the AR glasses.

[0227] In yet another example, when the virtual screen is the windshield of a car, the projection device can be any electronic device. When the user is inside the car, the user can see the real scene in the area where the user is located through the windshield of the car, and the projection device can project the virtual scene obtained (or internally integrated) by it onto the windshield of the car, so that the user can see the display effect after superimposing the real scene and the virtual scene through the windshield of the car.

[0228] Of course, in the embodiments of the present invention, the specific form of the virtual screen may not be limited. For example, it may be a non-carrier real space. In this case, when the user is located in the real space, the user can directly see the real scene in the real space, and the projection device can project the virtual scene obtained (or internally integrated) by it into the real space, so that the user can see the display effect after the real scene and the virtual scene are superimposed in the real space.

[0229] Optionally, the embodiments of the present invention further provide a computer-readable storage medium. A computer program is stored on the computer-readable storage medium. When the computer program is executed by a processor, it implements each process of the above method embodiments and can achieve the same technical effects. To avoid repetition, it will not be elaborated here. Among them, the computer-readable storage medium is, for example, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disc, etc.

[0230] It should be noted that in this article, the terms "include", "comprise" or any other variant thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements not only includes those elements, but also includes other elements not expressly listed, or further includes elements inherent to such process, method, article or device. Without more limitations, an element defined by the statement "including a..." does not exclude the existence of additional identical elements in the process, method, article or device including that element.

[0231] Through the description of the above embodiments, those skilled in the art can clearly understand that the above embodiment methods can be implemented by means of software plus a necessary general hardware platform. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. The computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disc), and includes several instructions for causing an electronic device (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods described in the various embodiments of the present invention.

[0232] The embodiments of the present invention have been described above in conjunction with the accompanying drawings. However, the present invention is not limited to the above specific embodiments. The above specific embodiments are merely illustrative and not restrictive. Under the inspiration of the present invention, those of ordinary skill in the art can also make many forms without departing from the purpose of the present invention and the scope protected by the claims, and all of them belong to the protection scope of the present invention.

Claims

1. An unlocking method, applied to an electronic device, characterized in that, The method includes: Receiving a third input from a user to an electronic device; In response to the third input, displaying N virtual objects, where N is an integer greater than or equal to 2; Receiving a first input from the user to a target virtual object among the N virtual objects; In response to the first input, unlocking the electronic device when the target virtual object is a preset virtual object and the input feature of the first input matches a preset input feature; The displaying of the N virtual objects includes: When the input duration of the third input is greater than or equal to a second preset threshold, displaying the jth virtual object at a first position of a first physical object; When the electronic device is updated from a first geographical location to a second geographical location, obtaining the motion parameters of the electronic device, where the first position corresponds to the first geographical location; When the motion parameters match preset parameters, displaying the (j + 1)th virtual object at a second position of the first physical object, where the second position corresponds to the second geographical location; Wherein, the motion parameters include at least one of the following: the distance the electronic device moves, the motion time of the electronic device, and the number of motion steps of the user holding the electronic device while moving; j is a positive integer and j ≤ N.

2. The method according to claim 1, characterized in that, Before displaying the N virtual objects, the method further includes: Obtaining the fixation area and fixation duration of the user's line of sight; The displaying of the N virtual objects includes: Displaying the N virtual objects when the fixation area includes a target physical object and the fixation duration is greater than or equal to a first preset threshold.

3. The method according to claim 1 or 2, characterized in that, The N virtual objects include a first virtual object, and the first input is an input by the user to move the first virtual object to the target virtual object; The unlocking of the electronic device when the target virtual object is a preset virtual object and the input feature of the first input matches a preset input feature includes: Unlocking the electronic device when the target virtual object is the preset virtual object and at least a partial area of the first virtual object overlaps with the target virtual object.

4. The method according to claim 1 or 2, characterized in that, The unlocking of the electronic device when the target virtual object is a preset virtual object and the input feature of the first input matches a preset input feature includes: Unlocking the electronic device when the target virtual object is the preset virtual object and the input action of the first input is a preset input action.

5. The method according to claim 1, characterized in that, The target virtual object includes M target virtual sub - objects, and the preset virtual object includes M preset virtual sub - objects; the first input includes M sub - inputs, and one sub - input is an input by the user to one target virtual sub - object; M is an integer greater than 1; The unlocking of the electronic device when the target virtual object is a preset virtual object and the input feature of the first input matches a preset input feature includes: When the M target virtual sub-objects are the same as the M preset virtual sub-objects, and the first input order of the M sub-inputs is the same as the preset second input order of the M preset virtual sub-objects, the electronic device is unlocked.

6. An electronic device, characterized in that, The electronic device includes: a display module, a receiving module, and an unlocking module; The receiving module is configured to receive a third input from a user to the electronic device; The display module is configured to display N virtual objects in response to the third input received by the receiving module, where N is an integer greater than or equal to 2; The receiving module is further configured to receive a first input from the user to a target virtual object among the N virtual objects displayed by the display module; The unlocking module is configured to unlock the electronic device in response to the first input received by the receiving module when the target virtual object is a preset virtual object and the input feature of the first input matches a preset input feature; The display module is specifically configured to display the j-th virtual object at a first position of a first physical object when the input duration of the third input is greater than or equal to a second preset threshold; The electronic device further includes: an acquisition module; The acquisition module is configured to acquire a motion parameter of the electronic device when the electronic device is updated from a first geographical location to a second geographical location, where the first position corresponds to the first geographical location; The display module is further configured to display the (j + 1)-th virtual object at a second position of the first physical object when the motion parameter acquired by the acquisition module matches a preset parameter, where the second position corresponds to the second geographical location; Wherein, the motion parameter includes at least one of the following: the distance that the electronic device moves, the motion time of the electronic device, and the number of motion steps of the user holding the electronic device while moving; j is a positive integer, and j ≤ N.

7. The electronic device according to claim 6, wherein The electronic device further includes: an acquisition module; The acquisition module is configured to acquire a fixation area and a fixation duration of the user's line of sight before the display module displays the N virtual objects; The display module is specifically configured to display the N virtual objects when the fixation area acquired by the acquisition module includes a target physical object and the fixation duration is greater than or equal to a first preset threshold.

8. The electronic device according to claim 6 or 7, characterized in that, The N virtual objects include a first virtual object, and the first input is an input in which the user moves the first virtual object to the target virtual object; The unlocking module is specifically configured to unlock the electronic device when the target virtual object is the preset virtual object and at least a partial area of the first virtual object overlaps with the target virtual object.

9. The electronic device according to claim 6 or 7, characterized in that, The unlocking module is specifically configured to unlock the electronic device when the target virtual object is the preset virtual object and the input action of the first input is a preset input action.

10. The electronic device according to claim 6, characterized in that, The target virtual object includes M target virtual sub-objects, and the preset virtual object includes M preset virtual sub-objects; the first input includes M sub-inputs, and one sub-input is the input of a user to a target virtual sub-object; M is an integer greater than 1; The unlocking module is specifically configured to unlock the electronic device when the M target virtual sub-objects are the same as the M preset virtual sub-objects, and the first input order of the M sub-inputs is the same as the preset second input order of the M preset virtual sub-objects.

11. An electronic device, characterized in that, It includes a processor, a memory, and a computer program stored on the memory and executable on the processor. When the computer program is executed by the processor, it implements the steps of the unlocking method according to any one of claims 1 to 5.

12. A computer-readable storage medium, characterized in that, A computer program is stored on the computer-readable storage medium. When the computer program is executed by the processor, it implements the steps of the unlocking method according to any one of claims 1 to 5.

Images