Unlocking method and electronic equipment

Abstract

The embodiment of the invention discloses an unlocking method and electronic equipment, relates to the technical field of communication, and can solve the problem of poor safety of the electronic equipment. The method comprises the following steps: displaying N virtual objects, wherein N is an integer greater than or equal to 2; receiving a first input of a user to a target virtual object in the N virtual objects; and in response to the first input, unlocking the electronic equipment under the condition that the target virtual object is the preset virtual object and the input feature of the first input is matched with the preset input feature. The embodiment of the invention is applied to the process that the electronic equipment is unlocked according to the input of the user.

Description

Technical Field

[0001] The embodiments of the present invention relate to the field of communication technology, and in particular to an unlocking method and an electronic device. Background Art

[0002] Currently, when using an electronic device, a user may input a physical button (such as a power button) of the electronic device to unlock the electronic device, thereby allowing the user to use the electronic device.

[0003] However, in the above method, since the electronic device is unlocked by the power button, other users can also input the power button to unlock the electronic device, which may lead to the leakage of user privacy, and the security of the electronic device is poor. Summary of the Invention

[0004] The embodiments of the present invention provide an unlocking method and an electronic device, which can solve the problem of poor security of electronic devices.

[0005] In order to solve the above technical problems, the embodiments of the present invention adopt the following technical solutions:

[0006] According to a first aspect of an embodiment of the present invention, an unlocking method is provided, which is applied to an electronic device. The unlocking method includes: displaying N virtual objects, where N is an integer greater than or equal to 2; receiving a first input from a user for a target virtual object among the N virtual objects; and unlocking the electronic device in response to the first input, if the target virtual object is a preset virtual object and the input feature of the first input matches the preset input feature.

[0007] According to a second aspect of an embodiment of the present invention, an electronic device is provided, comprising: a display module, a receiving module, and an unlocking module. The display module is configured to display N virtual objects, where N is an integer greater than or equal to 2. The receiving module is configured to receive a first input from a user for a target virtual object among the N virtual objects displayed by the display module. The unlocking module is configured to unlock the electronic device in response to the first input received by the receiving module, if the target virtual object is a preset virtual object and the input characteristics of the first input match the preset input characteristics.

[0008] According to a third aspect of an embodiment of the present invention, an electronic device is provided, which includes a processor, a memory, and a computer program stored in the memory and executable on the processor, wherein the computer program, when executed by the processor, implements the steps of the unlocking method described in the first aspect.

[0009] According to a fourth aspect of an embodiment of the present invention, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps of the unlocking method described in the first aspect are implemented.

[0010] In an embodiment of the present invention, an electronic device can display N virtual objects and, based on a user's first input to a target virtual object among the N virtual objects, unlock the electronic device when the target virtual object is a preset virtual object and the input feature of the first input matches the preset input feature. Since multiple virtual objects are displayed on the electronic device, when the user triggers the unlocking of the electronic device, the user needs to select a virtual object that can trigger the unlocking of the electronic device from the multiple virtual objects, that is, the electronic device is unlocked only when the virtual object selected by the user is a preset virtual object and the input feature of the first input matches the preset input feature. That is, when the virtual object selected by the user is not a preset virtual object and / or the input feature of the first input does not match the preset input feature, the electronic device is not unlocked. Therefore, other users can be prevented from directly unlocking the electronic device through the power button of the electronic device, thereby preventing the user's privacy from being leaked, thereby improving the security of the electronic device. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] Figure 1 A schematic diagram of the architecture of an Android operating system provided by an embodiment of the present invention;

[0012] Figure 2 One of the schematic diagrams of an unlocking method provided by an embodiment of the present invention;

[0013] Figure 3 This is one of the example schematic diagrams of an interface of an electronic device provided by an embodiment of the present invention;

[0014] Figure 4 A second example schematic diagram of an interface of an electronic device provided by an embodiment of the present invention;

[0015] Figure 5 A second schematic diagram of an unlocking method provided by an embodiment of the present invention;

[0016] Figure 6 This is a third example schematic diagram of an interface of an electronic device provided by an embodiment of the present invention;

[0017] Figure 7A A fourth example schematic diagram of an interface of an electronic device provided by an embodiment of the present invention;

[0018] Figure 7B A fifth example schematic diagram of an interface of an electronic device provided by an embodiment of the present invention;

[0019] Figure 8A third schematic diagram of an unlocking method provided by an embodiment of the present invention;

[0020] Figure 9 A sixth example schematic diagram of an interface of an electronic device provided by an embodiment of the present invention;

[0021] Figure 10 A fourth schematic diagram of an unlocking method provided by an embodiment of the present invention;

[0022] Figure 11 This is a seventh example schematic diagram of an interface of an electronic device provided by an embodiment of the present invention;

[0023] Figure 12 A fifth schematic diagram of an unlocking method provided by an embodiment of the present invention;

[0024] Figure 13 An eighth example schematic diagram of an interface of an electronic device provided by an embodiment of the present invention;

[0025] Figure 14 A schematic structural diagram of an electronic device provided by an embodiment of the present invention;

[0026] Figure 15 A hardware schematic diagram of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0027] The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of them. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present invention without making any creative efforts shall fall within the scope of protection of the present invention.

[0028] In the description and claims of the embodiments of the present invention, the terms "first" and "second" are used to distinguish different objects rather than to describe a specific order of objects. For example, "first input" and "second input" are used to distinguish different inputs rather than to describe a specific order of inputs.

[0029] In the description of the embodiments of the present invention, unless otherwise specified, "a plurality of" means two or more than two. For example, a plurality of elements means two elements or more than two elements.

[0030] The term "and / or" as used herein describes an association relationship between associated objects, indicating that three possible relationships exist. For example, "display panel and / or backlight" can represent three possible situations: the display panel alone, the display panel and backlight together, and the backlight alone. The symbol " / " as used herein indicates an "or" relationship between the associated objects. For example, input / output indicates either input or output.

[0031] In the embodiments of the present invention, words such as "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present invention should not be construed as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner.

[0032] An embodiment of the present invention provides an unlocking method and an electronic device. Since multiple virtual objects are displayed in the electronic device, when a user triggers the unlocking of the electronic device, the user needs to select a virtual object that can trigger the unlocking of the electronic device from the multiple virtual objects. That is, the electronic device is unlocked only when the virtual object selected by the user is a preset virtual object and the input feature of the first input matches the preset input feature. That is, when the virtual object selected by the user is not the preset virtual object, and / or the input feature of the first input does not match the preset input feature, the electronic device is not unlocked. Therefore, other users can be prevented from directly unlocking the electronic device through the power button of the electronic device, thereby avoiding the leakage of user privacy, thereby improving the security of the electronic device.

[0033] The unlocking method and electronic device provided by the embodiments of the present invention can be applied to the process of unlocking an electronic device. Specifically, the unlocking method and electronic device can be applied to the process of unlocking the electronic device according to user input.

[0034] The electronic device in the embodiment of the present invention may be an electronic device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present invention.

[0035] The following takes the Android operating system as an example to introduce the software environment applied by the unlocking method provided in the embodiment of the present invention.

[0036] like Figure 1 As shown in FIG, a possible architecture diagram of an Android operating system provided by an embodiment of the present invention. Figure 1 The architecture of the Android operating system includes four layers: application layer, application framework layer, system runtime layer and kernel layer (specifically, the Linux kernel layer).

[0037] The application layer includes various applications in the Android operating system (including system applications and third-party applications).

[0038] The application framework layer is the framework of the application. Developers can develop some applications based on the application framework layer while complying with the development principles of the application framework.

[0039] The system runtime layer includes libraries (also called system libraries) and the Android operating system runtime environment. Libraries primarily provide the various resources required by the Android operating system. The Android operating system runtime environment provides the software environment for the Android operating system.

[0040] The kernel layer is the operating system layer of the Android operating system and is the lowest level of the Android operating system software hierarchy. Based on the Linux kernel, the kernel layer provides core system services and hardware-related drivers for the Android operating system.

[0041] Taking the Android operating system as an example, in the embodiment of the present invention, developers can Figure 1 The system architecture of the Android operating system shown in FIG. 1 is used to develop a software program for implementing the unlocking method provided by the embodiment of the present invention, so that the unlocking method can be based on the following example: Figure 1 The Android operating system shown is running. That is, the processor or electronic device can implement the unlocking method provided by the embodiment of the present invention by running the software program in the Android operating system.

[0042] The electronic devices in the embodiments of the present invention may be mobile electronic devices or non-mobile electronic devices. For example, the mobile electronic devices may be mobile phones, tablet computers, laptop computers, PDAs, in-vehicle electronic devices, wearable devices, ultra-mobile personal computers (UMPCs), netbooks, or personal digital assistants (PDAs), and the non-mobile electronic devices may be personal computers (PCs), televisions (TVs), ATMs, or self-service kiosks, etc., without specific limitations in the embodiments of the present invention.

[0043] In the following, in conjunction with the accompanying drawings, an unlocking method and an electronic device provided by an embodiment of the present invention are described in detail through specific embodiments and application scenarios.

[0044] In an embodiment of the present invention, when a user needs to unlock an AR electronic device (hereinafter referred to as an AR device), the user can first input into the AR device so that the display screen of the AR device is in a bright and unlocked state, and multiple virtual objects are displayed on the display screen, so that the user can input (for example, a first input) a virtual object (for example, a target virtual object) among the multiple virtual objects, so that the AR device can determine, based on the user's first input, whether the virtual object selected by the user is a preset virtual object, and whether the input feature of the first input matches the preset input feature. The AR device is unlocked only when the virtual object selected by the user is the preset virtual object and the input feature of the first input matches the preset input feature. Therefore, other users can be prevented from directly unlocking the AR device through the power button of the AR device, thereby preventing the user's privacy from being leaked, thereby improving the security of the AR device.

[0045] An unlocking method provided by an embodiment of the present invention, Figure 2 A flowchart of an unlocking method provided by an embodiment of the present invention is shown. The method can be applied to a device having the following characteristics: Figure 1 An electronic device with the Android operating system as shown. Figure 2 As shown, the unlocking method provided by the embodiment of the present invention may include the following steps 201 to 203.

[0046] Step 201: The electronic device displays N virtual objects.

[0047] In the embodiment of the present invention, N is an integer greater than or equal to 2.

[0048] Optionally, in an embodiment of the present invention, when a preset operation of the user is detected, the electronic device displays N virtual objects.

[0049] In an embodiment of the present invention, when using an electronic device, a user can light up the display screen of the electronic device (i.e., trigger the electronic device to be in a light-screen and unlocked state), so that the electronic device can detect whether the user's operation is a preset operation.

[0050] Optionally, in the embodiment of the present invention, the electronic device may be an electronic device with a virtual imaging function, such as a virtual reality (VR) electronic device or an augmented reality (AR) electronic device.

[0051] Optionally, in an embodiment of the present invention, the N virtual objects may include at least one of the following: a virtual image, a virtual pattern, a virtual character, a virtual picture, etc.

[0052] Optionally, in an embodiment of the present invention, each of the N virtual objects may be an AR object.

[0053] It should be noted that the above-mentioned "AR object" can be understood as: the AR device analyzes the real object to obtain the feature information of the real object (such as the type information of the real object, the appearance information of the real object (such as structure, color, shape, etc.) and the position information of the real object in space, etc.), and constructs an AR model in the AR device based on the feature information.

[0054] Optionally, in an embodiment of the present invention, the electronic device may obtain the user's operation through a camera of the electronic device to determine whether the user performs a preset operation.

[0055] Optionally, in an embodiment of the present invention, the preset operation may be any one of the following: an operation of a user on a target physical object, an operation of a user on a first virtual object, and an operation of a user on an electronic device.

[0056] Optionally, in an embodiment of the present invention, the first virtual object may be a virtual object among N virtual objects.

[0057] Optionally, in an embodiment of the present invention, the above-mentioned preset operation may specifically be a user's movement input on the target object, or a user's rotation input on the target object, or a user's shaking input on the target object.

[0058] It should be noted that the above-mentioned target objects are real objects.

[0059] Optionally, in an embodiment of the present invention, the electronic device may display N virtual objects on a display screen of the electronic device.

[0060] Optionally, in an embodiment of the present invention, the electronic device may display N virtual objects in an area on the display screen (for example, the display area of ​​the virtual object corresponding to the target physical object); or, the electronic device may display N virtual objects in another area on the display screen (for example, the surrounding area corresponding to the display area of ​​the virtual object corresponding to the target physical object).

[0061] Optionally, in an embodiment of the present invention, the electronic device may display N virtual objects in a preset display mode, where the preset display mode may be any one of the following: an animation display mode, a color display mode, and a flashing display mode.

[0062] For example, when the electronic device detects that the user's operation on the target physical object (such as a cup) is a preset operation, the electronic device can control N virtual objects to "fly" out of the cup to display the N virtual objects in an area on the display screen (i.e., the surrounding area corresponding to the display area of ​​the virtual object corresponding to the cup).

[0063] For example, the electronic device is AR glasses. Figure 3As shown, the user can perform preset operations on the AR glasses (for example, the user's rotation input on the target object (for example, the cup 10)), so that the AR glasses can display N virtual objects (for example, a "butterfly" virtual image 11, a "cloud" virtual image 12, a "moon" virtual image 13, a "star" virtual image 14 and an "a" virtual character 15) in the surrounding area of ​​the virtual object corresponding to the cup 10 according to the user's preset operation.

[0064] Optionally, in an embodiment of the present invention, the electronic device may obtain trajectory information of the user's operation on the target object through the camera of the electronic device, and compare the trajectory information with the preset trajectory information in the electronic device to determine whether the user's operation on the target object is a preset operation.

[0065] Optionally, in an embodiment of the present invention, the preset operation may specifically be a gesture input of the user to the first virtual object.

[0066] It should be noted that the above-mentioned gesture input can be understood as: the user performs a movement input, a shaking input, a rotation input, etc. on the first virtual object through gesture simulation, so that the first virtual object moves, shakes or rotates.

[0067] Optionally, in an embodiment of the present invention, the above-mentioned gesture input may include any one of the following: a gesture input of stretching and clenching fingers, a gesture input of rotating the palm, and a gesture input of translating the palm.

[0068] Optionally, in an embodiment of the present invention, when a user operation on a first virtual object is detected, the electronic device may display N virtual objects in a virtual area corresponding to the environment area where the electronic device is located (for example, the ground plane displayed by the electronic device or a physical object in the environment).

[0069] For example, Figure 4 As shown, the user can perform preset operations on the AR glasses (for example, the user's gesture input to the first virtual object (for example, the "key" virtual object 16) (for example, the user's input of grasping the "key" virtual object 16)), so that the AR glasses can display N virtual objects (for example, the "cloud" virtual image 17, the "star" virtual image 18, the "a" virtual character 19 and the "cup" virtual image 20) in the virtual area corresponding to the environment area where the AR glasses are located according to the user's preset operation.

[0070] Optionally, in an embodiment of the present invention, the electronic device may obtain trajectory information of the user's operation on the first virtual object through a camera of the electronic device, and compare the trajectory information with preset trajectory information in the electronic device. The electronic device may also obtain location information of the user's operation on the first virtual object and the location information of the first virtual object through a camera of the electronic device, and compare the location information of the user's operation on the first virtual object and the location information of the first virtual object to determine whether the user's operation on the target physical object is a preset operation.

[0071] Optionally, in an embodiment of the present invention, the above-mentioned preset operation may specifically be a user pressing a physical button of the electronic device to trigger the electronic device to be in a light-screen and unlocked state.

[0072] Optionally, in an embodiment of the present invention, when a user's operation on a physical button of an electronic device is detected, the electronic device may project and display N virtual objects in an area in the environment where the electronic device is located (eg, a ground plane or a physical object in the environment).

[0073] Optionally, in an embodiment of the present invention, the user may long-press a physical button of the electronic device in a sports scene, so that the electronic device may project and display N virtual objects.

[0074] Optionally, in an embodiment of the present invention, when a user uses an electronic device, he or she can input a target object (such as gaze input) through the electronic device to enable the electronic device to activate the display function of the virtual object. Figure 2 ,like Figure 5 As shown, before the above step 201, the unlocking method provided by the embodiment of the present invention may further include the following step 301, and the above step 201 may be specifically implemented by the following step 201a.

[0075] Step 301: The electronic device obtains the gaze area and gaze duration of the user.

[0076] Optionally, in an embodiment of the present invention, the electronic device may obtain the gaze area and gaze duration of the user through a camera.

[0077] Optionally, in an embodiment of the present invention, the electronic device can obtain the user's gaze point information (such as information on the gaze point position and / or information on the gaze point direction) through a camera to determine the user's gaze area and gaze duration based on the gaze point information.

[0078] Optionally, in an embodiment of the present invention, if the gaze area of ​​the user's line of sight includes a physical object, the electronic device may determine the physical object as the target physical object; if the gaze area of ​​the user's line of sight includes at least two physical objects, the electronic device may randomly select a physical object from the at least two physical objects to determine the physical object as the target physical object.

[0079] Step 201a: When the gaze area includes the target object and the gaze duration is greater than or equal to a first preset threshold, the electronic device displays N virtual objects.

[0080] Optionally, in an embodiment of the present invention, if the gaze area includes a target physical object and the gaze duration is greater than or equal to a first preset threshold, the electronic device can use a preset marking method to mark the virtual object corresponding to the target physical object on the display screen of the electronic device. The preset marking method can be any one of the following: a dotted box marking method, a highlight marking method, a color marking method, a grayscale marking method, a marking method with a preset transparency, and a flashing marking method, etc.

[0081] Optionally, in an embodiment of the present invention, when the gaze duration is greater than or equal to a first preset threshold, if the electronic device detects that the user operates on the target object, the electronic device displays N virtual objects.

[0082] Optionally, in an embodiment of the present invention, when the gaze duration is greater than or equal to a first preset threshold, the electronic device may display a first virtual object; if the electronic device detects a user operation on the first virtual object, the electronic device displays other virtual objects (i.e., virtual objects other than the first virtual object among the N virtual objects).

[0083] Optionally, in an embodiment of the present invention, when the above-mentioned preset operation is a user's operation on a first virtual object, the first virtual object is a virtual object displayed when the gaze duration is greater than or equal to a first preset threshold.

[0084] In an embodiment of the present invention, the electronic device displays N virtual objects only when the gaze area includes a target physical object and the user's gaze time on the target physical object is greater than or equal to a first preset threshold. Therefore, the electronic device can determine whether to display N virtual objects through multiple detections, thereby improving the security of the electronic device.

[0085] Optionally, in an embodiment of the present invention, the above step 201a can be specifically implemented through the following steps 201a1 to 201a3.

[0086] Step 201a1: When the gaze area includes the target object and the gaze duration is greater than or equal to a first preset threshold, and when the target object is at a first display angle, the electronic device displays the i-th virtual object in the first area of ​​the target object.

[0087] In the embodiment of the present invention, the first area is a visible area on the target object at a first display angle.

[0088] In the embodiment of the present invention, i is a positive integer, i≤N.

[0089] It should be noted that the above-mentioned "display angle" can be understood as: the angle value of a side of the target object located in the user's gaze area relative to the preset reference plane of the target object; the above-mentioned "visible area on the target object" can be understood as: the part of the target object that can be viewed when the user gazes at the target object.

[0090] In the embodiment of the present invention, the i-th virtual object is a virtual object among N virtual objects.

[0091] It can be understood that the electronic device can project and display N virtual objects in sequence in different areas of the target object.

[0092] Optionally, in an embodiment of the present invention, the electronic device may project and display the i-th virtual object in a first area of ​​the target physical object.

[0093] Step 201a2: The electronic device receives a second input from the user.

[0094] In an embodiment of the present invention, the second input is an input of the user rotating the target object to a second display angle, and the second input is used to trigger the target object to rotate relative to the electronic device.

[0095] Optionally, in an embodiment of the present invention, the difference between the second display angle and the first display angle is greater than or equal to a preset angle value.

[0096] Optionally, in an embodiment of the present invention, the second input may specifically be a rotation input of the electronic device by the user, so that the target object rotates relative to the electronic device; or, the second input may specifically be a rotation input of the target object by the user, so that the target object rotates relative to the electronic device.

[0097] Step 201a3: In response to the second input, the electronic device displays the (i+1)th virtual object in the second area of ​​the target object.

[0098] In the embodiment of the present invention, the second area is a visible area on the target object at the second display angle.

[0099] It can be understood that the second area and the first area are different areas on the target object.

[0100] Optionally, in an embodiment of the present invention, the electronic device may first project and display a virtual object (e.g., the i-th virtual object) on an area (e.g., the first area) on the target physical object, and then, when the user rotates the target physical object to an angle greater than or equal to a preset angle value (e.g., rotating the target physical object to a second display angle), project and display the next virtual object (e.g., the i+1-th virtual object) on another area (e.g., the second area) of the target physical object, and so on, until the last virtual object is projected and displayed, thereby projecting and displaying N virtual objects.

[0101] For example, Figure 6 As shown in (A) of FIG, when the target object (e.g., cup 21) is at a first display angle, the AR glasses can project and display the i-th virtual object (e.g., virtual character "b") on a first area (e.g., area 22) of the cup 21, and then when the user rotates the cup 21 to a second display angle, as shown in FIG. Figure 6 As shown in (B) in FIG, the AR glasses can project and display the i+1th virtual object (eg, the virtual character “cd”) on the second area (eg, 23 ) of the cup 21 .

[0102] It is understood that by rotating the target object (or rotating the user's electronic device around the target object), N virtual objects can be projected and displayed on the target object at different angles, so that the user can input these N virtual objects to complete the unlocking operation. The embodiments of the present invention are not limited to a fixed space or path and can provide users with multiple unlocking methods.

[0103] In an embodiment of the present invention, when the target physical object is at a first display angle, the electronic device projects and displays a virtual object on an area of ​​the target physical object, and only when the user rotates the target physical object to an angle value greater than or equal to a preset angle value (for example, rotating the target physical object to a second display angle) does the electronic device display the next virtual object in another area of ​​the target physical object, so as to display N virtual objects, that is, the N virtual objects are conditional, and the user needs to rotate the target physical object multiple times to trigger the electronic device to display the N virtual objects in sequence, rather than the electronic device directly displaying the N virtual objects. Therefore, other users except those who know the unlock password cannot trigger the electronic device to display the N virtual objects, which increases the difficulty of unlocking for strangers, thereby improving the security of the electronic device.

[0104] Optionally, in an embodiment of the present invention, a user can input physical buttons on an electronic device in a sports scenario to enable the electronic device to display virtual objects. Prior to step 201, the unlocking method provided in an embodiment of the present invention may further include step 401, and step 201 may be implemented through steps 201b to 201d.

[0105] Step 401: The electronic device receives a third input from a user.

[0106] In an embodiment of the present invention, the third input is used to trigger the electronic device to display a virtual object.

[0107] Optionally, in an embodiment of the present invention, the third input may specifically be a long press input of a physical button (such as a touch sensor) of the electronic device by the user.

[0108] Step 201b: The electronic device displays the jth virtual object at the first position of the first physical object in response to the third input, when the input duration of the third input is greater than or equal to the second preset threshold.

[0109] Optionally, in an embodiment of the present invention, when detecting a user operation on a physical button of the electronic device, the electronic device can obtain the current system time to determine the input duration of the third input based on the current system time and the end time of the third input.

[0110] Optionally, in an embodiment of the present invention, the first physical object may be a physical object in the environment where the electronic device is located, such as a ground plane (such as the ground of a playground), a surface of a building, a surface of a plant, etc.

[0111] Optionally, in an embodiment of the present invention, the first position may be any position in the visible area of ​​the first object.

[0112] In the embodiment of the present invention, the j-th virtual object is any one of the N virtual objects.

[0113] It can be understood that the electronic device can project and display N virtual objects in sequence at different positions on the first physical object.

[0114] Optionally, in an embodiment of the present invention, the electronic device may project and display the jth virtual object at the first position of the first physical object.

[0115] Step 201c: When the electronic device updates from the first geographical location to the second geographical location, the electronic device obtains the motion parameters of the electronic device.

[0116] In the embodiment of the present invention, the first position is a position corresponding to the first geographical location.

[0117] It should be noted that the above “the first position is a position corresponding to the first geographical location” can be understood as: the first position is a position within the visible area of ​​the first physical object when the electronic device is in the first geographical location.

[0118] Optionally, in the embodiment of the present invention, the first geographical location may be the location of the electronic device when the electronic device receives the third input from the user.

[0119] Optionally, in an embodiment of the present invention, when the electronic device receives the third input from the user, the electronic device may obtain the electronic device's geographic location (i.e., the first geographic location) through a global positioning system (GPS), or may obtain the electronic device's first geographic location based on cell information of a network where the electronic device is registered. The specific location may be determined based on actual usage requirements and is not limited in the embodiment of the present invention.

[0120] Optionally, in an embodiment of the present invention, the difference between the second geographical location and the first geographical location is greater than or equal to a preset distance threshold.

[0121] Optionally, in an embodiment of the present invention, the electronic device may obtain the geographical location of the electronic device in real time to determine whether the electronic device is updated from the first geographical location to the second geographical location.

[0122] In an embodiment of the present invention, the above-mentioned motion parameters include at least one of the following: the distance the electronic device moves, the movement time of the electronic device, and the number of steps the user takes while holding the electronic device; j is a positive integer, j≤N.

[0123] Optionally, in an embodiment of the present invention, the electronic device may detect the motion state of the electronic device through a motion sensor of the electronic device to obtain the starting motion information of the electronic device, so that the electronic device may determine the motion parameters of the electronic device based on the starting motion information.

[0124] Optionally, in an embodiment of the present invention, the motion sensor may include at least one of the following: a gyroscope, a gravity sensor, an acceleration sensor, and the like.

[0125] Optionally, in an embodiment of the present invention, the above-mentioned starting movement information includes at least one of the following: a starting movement position and a starting movement time.

[0126] Optionally, in an embodiment of the present invention, the electronic device may determine the distance the electronic device has moved based on the starting movement position and the second geographical location.

[0127] Optionally, in an embodiment of the present invention, when the electronic device updates from the first geographical location to the second geographical location, the electronic device may obtain the current system time to determine the movement time of the electronic device based on the current system time and the start movement time.

[0128] Optionally, in an embodiment of the present invention, the electronic device may obtain the number of steps taken by the user while holding the electronic device through a gravity sensor of the electronic device.

[0129] Step 201d: When the motion parameters match the preset parameters, the electronic device displays the j+1th virtual object at the second position of the first physical object.

[0130] In the embodiment of the present invention, the second position is a position corresponding to the second geographical location.

[0131] It should be noted that the above “the second position is a position corresponding to the second geographical location” can be understood as: the second position is a position within the visible area of ​​the first physical object when the electronic device is in the second geographical location.

[0132] It can be understood that the second position and the first position are different positions on the first physical object.

[0133] Optionally, in an embodiment of the present invention, when the difference between the motion parameter and the preset parameter is less than or equal to the preset parameter value, the electronic device projects and displays the j+1th virtual object at the second position of the first physical object.

[0134] Optionally, in an embodiment of the present invention, the electronic device may first project and display a virtual object (e.g., the jth virtual object) at a position (e.g., the first position) on the first physical object, and then, when the geographic location of the electronic device changes by more than or equal to a preset distance threshold (e.g., updated from the first geographic location to the second geographic location) and the motion parameters match the preset parameters, project and display the next virtual object (e.g., the j+1th virtual object) at another position (e.g., the second position) on the first physical object, and so on, until the last virtual object is projected and displayed, thereby projecting and displaying N virtual objects.

[0135] For example, Figure 7A As shown, when the input duration of the third input is greater than or equal to the second preset threshold, the AR glasses can project and display the jth virtual object (e.g., a "butterfly" virtual image) on a first position (e.g., position 25) of a first physical object (e.g., ground plane 24), and then when the AR glasses are updated from the first geographical location to the second geographical location, and the motion parameters of the AR glasses match the preset parameters, as shown in FIG. Figure 7B As shown, the AR glasses can project and display the j+1th virtual object (such as a “doll” virtual image) at a second position (such as position 26 ) on the ground plane 24 .

[0136] It is understandable that the user can wear the electronic device and move, and N virtual objects can be projected and displayed on different positions of the first physical object, so that the user can input the N virtual objects to complete the unlocking operation.

[0137] In an embodiment of the present invention, when the input duration of the user's third input to the electronic device is greater than or equal to the second preset threshold, the electronic device projects and displays a virtual object at a position of the first physical object, and when the electronic device is updated from the first geographic location to the second geographic location (that is, the geographic location change of the electronic device is greater than or equal to the preset distance threshold), and the motion parameters match the preset parameters, the electronic device displays the next virtual object at another position of the first physical object, so as to display N virtual objects. That is, the user needs to wear the electronic device and move to multiple different positions to trigger the electronic device to display the N virtual objects in sequence, rather than the electronic device directly displaying the N virtual objects. Therefore, it can avoid the situation where other users can also trigger the electronic device to display N virtual objects, thereby improving the security of the electronic device.

[0138] Step 202: The electronic device receives a first input from a user on a target virtual object among N virtual objects.

[0139] In an embodiment of the present invention, the first input is used to trigger the electronic device to select a target virtual object from N virtual objects.

[0140] Optionally, in an embodiment of the present invention, the first input may be a user's gesture input of the target virtual object (e.g., a gesture input of stretching and clenching fingers, including but not limited to a gesture input of rotating the palm, a gesture input of translating the palm, etc.) to select the target virtual object.

[0141] Optionally, in the embodiment of the present invention, the target virtual object may be one virtual object or multiple virtual objects among N virtual objects.

[0142] Optionally, in an embodiment of the present invention, when the target virtual object is a virtual object and the preset operation is an operation of the user on the target physical object, the first input may specifically be a gesture input of the user on the virtual object.

[0143] Optionally, in an embodiment of the present invention, when the target virtual object is multiple virtual objects and the preset operation is the user's operation on the electronic device, the above-mentioned first input may include multiple sub-inputs, and one sub-input is the user's input to one of the multiple virtual objects (for example, gesture input).

[0144] Optionally, in an embodiment of the present invention, when the target virtual object is a virtual object and the preset operation is a user operation on a first virtual object, the first input may specifically be an input of the user moving the first virtual object to the target virtual object.

[0145] It should be noted that the above “the first virtual object moves to the target virtual object” can be understood as: after the first virtual object moves, the display area of ​​the first virtual object and the display area of ​​the target virtual object at least partially overlap.

[0146] Optionally, in an embodiment of the present invention, when the target virtual object is multiple virtual objects and the preset operation is the user's operation on the first virtual object, the above-mentioned first input may include multiple sub-inputs, and one sub-input is the input of the user moving the first virtual object to one of the multiple virtual objects.

[0147] Step 203: The electronic device unlocks the electronic device in response to the first input, if the target virtual object is a preset virtual object and the input feature of the first input matches the preset input feature.

[0148] Optionally, in an embodiment of the present invention, the electronic device may obtain first information corresponding to the target virtual object, so as to determine that the target virtual object is a preset virtual object when the first information matches preset information in the electronic device.

[0149] It should be noted that the above-mentioned "the first information matches the preset information in the electronic device" can be understood as: the first information corresponding to the target virtual object is the same as the preset information in the electronic device, or the difference between the first information corresponding to the target virtual object and the preset information in the electronic device is less than or equal to the preset threshold.

[0150] Optionally, in an embodiment of the present invention, the first information includes feature information of the target virtual object.

[0151] Optionally, in an embodiment of the present invention, the feature information of the target virtual object may include at least one of the following: a grayscale value of the target virtual object, a detail feature of the target virtual object, a pixel value of the target virtual object, and type information of the target virtual object.

[0152] Optionally, in an embodiment of the present invention, the above-mentioned input feature may include at least one of the following: input end position, input action, and input order.

[0153] Optionally, in an embodiment of the present invention, when the first input is an input in which the user moves the first virtual object to the target virtual object, the electronic device can determine whether the input feature of the first input matches the preset input feature based on whether the input end position of the first input (i.e., the position of the first virtual object after movement) matches the position of the target virtual object.

[0154] Optionally, in an embodiment of the present invention, when the first input is a user's gesture input to the target virtual object, the electronic device can determine whether the input feature of the first input matches the preset input feature based on whether the input action of the first input matches the preset action.

[0155] Optionally, in an embodiment of the present invention, the first input includes multiple sub-inputs, and one sub-input is the user's input of one virtual object among the multiple virtual objects. The electronic device can determine whether the input feature of the first input matches the preset input feature based on whether the input order of the multiple sub-inputs matches the preset order.

[0156] It can be understood that the embodiments of the present invention provide richer unlocking forms, namely rich unlocking content and rich unlocking methods (unlocking methods that combine user gestures with physical objects), which can increase the fun of unlocking electronic devices, and through the combination of user gestures and physical objects, the security of electronic devices can be improved.

[0157] An unlocking method provided by an embodiment of the present invention is a method in which an electronic device can display N virtual objects and, based on a user's first input to a target virtual object among the N virtual objects, unlock the electronic device when the target virtual object is a preset virtual object and the input characteristics of the first input match the preset input characteristics. Since multiple virtual objects are displayed on the electronic device, when the user triggers the unlocking of the electronic device, the user needs to select a virtual object that can trigger the unlocking of the electronic device from the multiple virtual objects. That is, the electronic device is unlocked only when the virtual object selected by the user is a preset virtual object and the input characteristics of the first input match the preset input characteristics. That is, when the virtual object selected by the user is not a preset virtual object and / or the input characteristics of the first input do not match the preset input characteristics, the electronic device is not unlocked. Therefore, other users can be prevented from directly unlocking the electronic device through the power button of the electronic device, thereby preventing the user's privacy from being leaked, thereby improving the security of the electronic device.

[0158] It is understandable that with the development of AR electronic devices, users' private and personalized content will increase. Encrypting AR electronic devices can improve the security of user assets. The embodiments of the present invention provide a highly convenient unlocking method. When applied to AR electronic devices, it can promote the development of AR electronic devices while ensuring the security of user information.

[0159] Optionally, in a possible implementation of the embodiment of the present invention, the N virtual objects include a first virtual object, and the first input is an input by the user to move the first virtual object to the target virtual object. Figure 2 ,like Figure 8 As shown, the above step 203 can be specifically implemented through the following step 203a.

[0160] Step 203a: When the target virtual object is a preset virtual object and the first virtual object and the target virtual object overlap at least partially, the electronic device unlocks the electronic device.

[0161] Optionally, in an embodiment of the present invention, the above-mentioned first input is specifically a gesture input of the user moving the first virtual object to the target virtual object (for example, a gesture input of stretching and clenching fingers, including but not limited to a gesture input of rotating the palm, a gesture input of translating the palm, etc.).

[0162] Optionally, in the embodiment of the present invention, the electronic device may obtain the position information of the first virtual object and the position information of the target virtual object after the movement to determine whether the first virtual object and the target virtual object overlap at least partially.

[0163] It should be noted that the above “the first virtual object and the target virtual object overlap at least partially” can be understood as: the first virtual object and the target virtual object completely overlap or partially overlap.

[0164] For example, combined Figure 4 ,like Figure 9 As shown, the user can make a first input to the "key" virtual object 16 (for example, input to the "key" virtual object 16 and the "cup" virtual image 20), so that the AR glasses can unlock the AR glasses according to the user's first input, when the first information corresponding to the "cup" virtual image 20 (for example, the characteristic information of the "cup" virtual image 20) is the same as the preset information in the AR glasses (for example, the "cup" characteristic information), and the "key" virtual object 16 and the "cup" virtual image 20 overlap at least partially.

[0165] In an embodiment of the present invention, the electronic device unlocks the electronic device only when it detects that the target virtual object is a preset virtual object and the first virtual object overlaps with the target virtual object at least partially. Since the electronic device needs to pass multiple detections to determine whether to unlock the electronic device, the security of the electronic device can be improved.

[0166] Optionally, in another possible implementation of the embodiment of the present invention, combined with Figure 2 ,like Figure 10 As shown, the above step 203 can be specifically implemented through the following step 203b.

[0167] Step 203b: When the target virtual object is a preset virtual object and the input action of the first input is a preset input action, the electronic device unlocks the electronic device.

[0168] Optionally, in an embodiment of the present invention, the first input is specifically a gesture input of the user to the target virtual object.

[0169] Optionally, in an embodiment of the present invention, the electronic device can obtain trajectory information of the user's input action on the target virtual object through a camera, and compare the trajectory information of the input action with the trajectory information of a preset input action in the electronic device to determine whether the input action of the first input is a preset input action.

[0170] For example, combined Figure 3 ,like Figure 11 As shown, the user can make a first input (such as a gesture input of stretching and clenching fingers) to the target virtual object (such as the "butterfly" virtual image 11), so that the AR glasses can unlock the AR glasses according to the user's first input, when the first information corresponding to the "butterfly" virtual image 11 (such as the characteristic information of the "butterfly" virtual image 11) is the same as the preset information in the AR glasses (such as the "butterfly" characteristic information), and the input action of the first input (i.e., stretching and clenching fingers) is the preset action.

[0171] In an embodiment of the present invention, the electronic device unlocks the electronic device only when it detects that the target virtual object is a preset virtual object and the input action of the first input is a preset input action; since the electronic device needs to pass multiple detections to determine whether to unlock the electronic device, the security of the electronic device can be improved.

[0172] Optionally, in another possible implementation of the embodiment of the present invention, the target virtual object includes M target virtual sub-objects, the preset virtual object includes M preset virtual sub-objects; the first input includes M sub-inputs, and one sub-input is the user's input to one target virtual sub-object; and M is an integer greater than 1. Figure 2 ,like Figure 12 As shown, the above step 203 can be specifically implemented through the following step 203c.

[0173] Step 203c: When the M target virtual sub-objects are identical to the M preset virtual sub-objects, and the first input order of the M sub-inputs is identical to the preset second input order of the M preset virtual sub-objects, the electronic device unlocks the electronic device.

[0174] Optionally, in an embodiment of the present invention, when an operation of a physical button of the electronic device by a user is detected, the electronic device may project and display N virtual objects on a ground plane.

[0175] Optionally, in an embodiment of the present invention, the electronic device may determine whether the M target virtual sub-objects are identical to the M preset virtual sub-objects based on whether the feature information of each target virtual sub-object matches the feature information of each preset virtual sub-object.

[0176] Optionally, in an embodiment of the present invention, the electronic device may determine whether the first input order is the same as the preset second input order after determining that the feature information of each target virtual sub-object matches the feature information of a preset virtual sub-object respectively; or, the electronic device may determine whether the target virtual sub-object corresponding to the first sub-input is the first preset virtual sub-object in the preset second input order after determining that the feature information of a target virtual sub-object corresponding to the first sub-input matches the feature information of a preset virtual sub-object, and determine whether the target virtual sub-object corresponding to the second sub-input is the second preset virtual sub-object in the preset second input order after determining that the feature information of a target virtual sub-object corresponding to the second sub-input matches a feature information, and so on, until it is determined whether the target virtual sub-object corresponding to the last sub-input is the last preset virtual sub-object in the preset second input order, thereby determining whether the first input order of M sub-inputs is the same as the preset second input order of M preset virtual sub-objects.

[0177] For example, Figure 13 As shown, the user can make a first input (for example, three sub-inputs) on M target sub-virtual objects (for example, the "butterfly" virtual image 27, the "butterfly" virtual image 28, and the "butterfly" virtual image 29), so that the AR glasses can unlock the AR glasses according to the user's first input, when the feature information of the "butterfly" virtual image 27 is the same as the feature information of a preset virtual sub-object in the AR glasses (for example, the "butterfly" feature information), the feature information of the "butterfly" virtual image 28 is the same as the feature information of a preset virtual sub-object in the AR glasses (for example, the "butterfly" feature information), and the feature information of the "butterfly" virtual image 29 is the same as the feature information of a preset virtual sub-object in the AR glasses (for example, the "butterfly" feature information), and the first input order of the three sub-inputs is the same as the preset second input order of the M target sub-virtual objects (i.e., the "butterfly" virtual image 27, the "butterfly" virtual image 28, and the "butterfly" virtual image 29).

[0178] In an embodiment of the present invention, the electronic device can project and display N virtual objects in sequence according to the user's operation on the electronic device, so that the user needs to select multiple virtual sub-objects that can trigger the unlocking of the electronic device from the N virtual objects in sequence, that is, the electronic device is unlocked only when the multiple virtual sub-objects selected by the user are all preset virtual sub-objects, and the input order of the multiple virtual sub-objects is the same as the preset order of the preset virtual sub-objects. That is, when the multiple virtual sub-objects selected by the user are not preset virtual sub-objects, and / or the input order of the multiple virtual sub-objects is different from the preset order of the preset virtual sub-objects, the electronic device is not unlocked. Therefore, the situation where the electronic device is unlocked when the virtual object selected by other users is the preset virtual object can be avoided, thereby avoiding the user's privacy leakage, and thus improving the security of the electronic device.

[0179] It is understood that the electronic device can project and display N virtual objects in sequence based on the user's operation on the electronic device, when the electronic device updates from a first geographic location to a second geographic location and the motion parameters match the preset parameters. Therefore, the embodiment of the present invention is applicable to mobile scenarios (such as sports scenes, movie viewing scenes, exhibition scenes, etc.); the electronic device can complete the unlocking operation while moving.

[0180] Figure 14 FIG. 1 shows a possible structural diagram of an electronic device involved in an embodiment of the present invention. Figure 14 As shown, the electronic device 90 may include: a display module 91 , a receiving module 92 and an unlocking module 93 .

[0181] The display module 91 is configured to display N virtual objects, where N is an integer greater than or equal to 2. The receiving module 92 is configured to receive a first input from a user for a target virtual object among the N virtual objects displayed by the display module 91. The unlocking module 93 is configured to unlock the electronic device in response to the first input received by the receiving module 92, if the target virtual object is a preset virtual object and the input characteristics of the first input match the preset input characteristics.

[0182] An embodiment of the present invention provides an electronic device. Since multiple virtual objects are displayed in the electronic device, when a user triggers the unlocking of the electronic device, the user needs to select a virtual object that can trigger the unlocking of the electronic device from the multiple virtual objects. That is, the electronic device is unlocked only when the virtual object selected by the user is a preset virtual object and the input feature of the first input matches the preset input feature. That is, when the virtual object selected by the user is not the preset virtual object, and / or the input feature of the first input does not match the preset input feature, the electronic device is not unlocked. Therefore, other users can be prevented from directly unlocking the electronic device through the power button of the electronic device, thereby preventing the user's privacy from being leaked, thereby improving the security of the electronic device.

[0183] In one possible implementation, the electronic device 90 provided in an embodiment of the present invention may further include an acquisition module. The acquisition module is configured to acquire the user's gaze area and gaze duration before the display module 91 displays N virtual objects. The display module 91 is specifically configured to display the N virtual objects if the gaze area acquired by the acquisition module includes the target object and the gaze duration is greater than or equal to a first preset threshold.

[0184] In an embodiment of the present invention, the electronic device displays N virtual objects only when the gaze area includes a target physical object and the user's gaze time on the target physical object is greater than or equal to a first preset threshold. Therefore, the electronic device can determine whether to display N virtual objects through multiple detections, thereby improving the security of the electronic device.

[0185] In one possible implementation, the display module 91 is specifically configured to, when the target physical object is at a first display angle, display the i-th virtual object in a first area of ​​the target physical object, where the first area is the visible area of ​​the target physical object at the first display angle; receive a second input from the user, where the second input is an input in which the user rotates the target physical object to a second display angle; and, in response to the second input, display the i+1-th virtual object in a second area of ​​the target physical object, where the second area is the visible area of ​​the target physical object at the second display angle. Where i is a positive integer, i≤N.

[0186] In an embodiment of the present invention, when the target physical object is at a first display angle, the electronic device projects and displays a virtual object on an area of ​​the target physical object, and only when the user rotates the target physical object to an angle value greater than or equal to a preset angle value (for example, rotating the target physical object to a second display angle) does the electronic device display the next virtual object in another area of ​​the target physical object, so as to display N virtual objects. Therefore, the electronic device can determine whether to display N virtual objects through multiple detections, thereby improving the security of the electronic device.

[0187] In one possible implementation, the N virtual objects include a first virtual object, and the first input is an input by a user moving the first virtual object to a target virtual object. The unlocking module 93 is specifically configured to unlock the electronic device when the target virtual object is a preset virtual object and the first virtual object and the target virtual object at least partially overlap.

[0188] In an embodiment of the present invention, the electronic device unlocks the electronic device only when it detects that the target virtual object is a preset virtual object and the first virtual object overlaps with the target virtual object at least partially. Since the electronic device needs to pass multiple detections to determine whether to unlock the electronic device, the security of the electronic device can be improved.

[0189] In a possible implementation, the unlocking module 93 is specifically configured to unlock the electronic device when the target virtual object is a preset virtual object and the input action of the first input is a preset input action.

[0190] In an embodiment of the present invention, the electronic device unlocks the electronic device only when it detects that the target virtual object is a preset virtual object and the input action of the first input is a preset input action; since the electronic device needs to pass multiple detections to determine whether to unlock the electronic device, the security of the electronic device can be improved.

[0191] In one possible implementation, the receiving module 92 is further configured to receive a third input from the user to the electronic device before the display module 91 displays N virtual objects. The display module 91 is specifically configured to, in response to the third input received by the receiving module 92, display the jth virtual object at the first position of the first physical object when the input duration of the third input is greater than or equal to a second preset threshold; and obtain motion parameters of the electronic device when the electronic device is updated from the first geographic location to the second geographic location, the first position being the position corresponding to the first geographic location; and, when the motion parameters match the preset parameters, display the j+1th virtual object at the second position of the first physical object, the second position being the position corresponding to the second geographic location. The motion parameters include at least one of the following: the distance the electronic device moves, the movement time of the electronic device, and the number of steps the user takes while holding the electronic device; j is a positive integer, j≤N.

[0192] In an embodiment of the present invention, when the input duration of the user's third input to the electronic device is greater than or equal to a second preset threshold, the electronic device projects and displays a virtual object at a position of the first physical object, and only when the electronic device is updated from the first geographic location to the second geographic location (that is, the geographic location change of the electronic device is greater than or equal to the preset distance threshold) and the motion parameters match the preset parameters, the electronic device displays the next virtual object at another position of the first physical object to display N virtual objects. Therefore, the electronic device can determine whether to display N virtual objects through multiple detections, thereby improving the security of the electronic device.

[0193] In one possible implementation, the target virtual object includes M target virtual sub-objects, the preset virtual object includes M preset virtual sub-objects, the first input includes M sub-inputs, each sub-input being a user input to a target virtual sub-object, and M being an integer greater than 1. The unlocking module 93 is specifically configured to unlock the electronic device if the M target virtual sub-objects are the same as the M preset virtual sub-objects, and the first input order of the M sub-inputs is the same as the preset second input order of the M preset virtual sub-objects.

[0194] In an embodiment of the present invention, the electronic device can determine whether to unlock the electronic device by comparing the feature information of each target virtual sub-object with the feature information of a preset virtual sub-object, and comparing the first input order of M sub-inputs with the preset second input order of M preset virtual sub-objects, thereby improving the security of the electronic device.

[0195] The electronic device provided by the embodiment of the present invention can implement each process implemented by the electronic device in the above method embodiment. To avoid repetition, the detailed description is not repeated here.

[0196] Figure 15 Schematic diagram of hardware of an electronic device for implementing various embodiments of the present invention. Figure 15 As shown, the electronic device 100 includes but is not limited to: a radio frequency unit 101, a network module 102, an audio output unit 103, an input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, a processor 110, and a power supply 111 and other components.

[0197] It should be noted that those skilled in the art can understand that Figure 15 The electronic device structure shown in the figure does not limit the electronic device, and the electronic device may include Figure 15 More or fewer components, or combinations of certain components, or different component arrangements are shown. In the embodiments of the present invention, electronic devices include but are not limited to mobile phones, tablet computers, laptop computers, PDAs, vehicle-mounted terminals, wearable devices, and pedometers.

[0198] The display unit 106 displays N virtual objects, where N is an integer greater than or equal to 2.

[0199] The user input unit 107 is configured to receive a first input from a user on a target virtual object among the N virtual objects.

[0200] The processor 110 is configured to unlock the electronic device in response to a first input when the target virtual object is a preset virtual object and an input feature of the first input matches the preset input feature.

[0201] An embodiment of the present invention provides an electronic device. Since multiple virtual objects are displayed in the electronic device, when a user triggers the unlocking of the electronic device, the user needs to select a virtual object that can trigger the unlocking of the electronic device from the multiple virtual objects. That is, the electronic device is unlocked only when the virtual object selected by the user is a preset virtual object and the input feature of the first input matches the preset input feature. That is, when the virtual object selected by the user is not the preset virtual object, and / or the input feature of the first input does not match the preset input feature, the electronic device is not unlocked. Therefore, other users can be prevented from directly unlocking the electronic device through the power button of the electronic device, thereby preventing the user's privacy from being leaked, thereby improving the security of the electronic device.

[0202] It should be understood that in this embodiment of the present invention, the RF unit 101 can be used to receive and transmit signals during information transmission or calls. Specifically, it receives downlink data from the base station and transmits it to the processor 110 for processing; in addition, it transmits uplink data to the base station. Typically, the RF unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low-noise amplifier, a duplexer, and the like. Furthermore, the RF unit 101 can communicate with the network and other devices via a wireless communication system.

[0203] The electronic device provides users with wireless broadband Internet access through the network module 102, such as helping users to send and receive emails, browse web pages, and access streaming media.

[0204] The audio output unit 103 can convert audio data received by the RF unit 101 or the network module 102 or stored in the memory 109 into an audio signal and output the audio signal as sound. In addition, the audio output unit 103 can also provide audio output related to a specific function performed by the electronic device 100 (for example, a call signal reception sound, a message reception sound, etc.). The audio output unit 103 includes a speaker, a buzzer, a receiver, etc.

[0205] The input unit 104 is used to receive audio or video signals. The input unit 104 may include a graphics processing unit (GPU) 1041 and a microphone 1042. The GPU 1041 processes image data of still pictures or videos obtained by an image capture device (such as a camera) in video capture mode or image capture mode. The processed image frames can be displayed on the display unit 106. The image frames processed by the GPU 1041 can be stored in the memory 109 (or other storage medium) or transmitted via the RF unit 101 or the network module 102. The microphone 1042 can receive sound and process such sound into audio data. In the case of a telephone call mode, the processed audio data can be converted into a format that can be sent to a mobile communication base station via the RF unit 101 for output.

[0206] The electronic device 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor and a proximity sensor, wherein the ambient light sensor can adjust the brightness of the display panel 1061 according to the brightness of the ambient light, and the proximity sensor can turn off the display panel 1061 and / or the backlight when the electronic device 100 is moved to the ear. As a type of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in all directions (generally three axes), and can detect the magnitude and direction of gravity when stationary. It can be used to identify the posture of the electronic device (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc.; the sensor 105 can also include a fingerprint sensor, a pressure sensor, an iris sensor, a molecular sensor, a gyroscope, a barometer, a hygrometer, a thermometer, an infrared sensor, etc., which will not be repeated here.

[0207] The display unit 106 is used to display information input by the user or information provided to the user. The display unit 106 may include a display panel 1061, which may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), etc.

[0208] The user input unit 107 can be used to receive input digital or character information, and to generate key signal input related to the user settings and function control of the electronic device. Specifically, the user input unit 107 includes a touch panel 1071 and other input devices 1072. The touch panel 1071, also known as a touch screen, can collect user touch operations on or near it (such as operations performed by the user using any suitable object or accessory such as a finger, stylus, etc. on or near the touch panel 1071). The touch panel 1071 may include two parts: a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch direction and detects the signal caused by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device and converts it into touch point coordinates, which are then sent to the processor 110, which receives the command sent by the processor 110 and executes it. In addition, the touch panel 1071 can be implemented using various types such as resistive, capacitive, infrared and surface acoustic wave. In addition to the touch panel 1071, the user input unit 107 may also include other input devices 1072. Specifically, other input devices 1072 may include but are not limited to a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail here.

[0209] Furthermore, the touch panel 1071 may be overlaid on the display panel 1061. When the touch panel 1071 detects a touch operation on or near it, it transmits the information to the processor 110 to determine the type of touch event. Subsequently, the processor 110 provides corresponding visual output on the display panel 1061 according to the type of touch event. Figure 15 In the figure, the touch panel 1071 and the display panel 1061 are two independent components to realize the input and output functions of the electronic device. However, in some embodiments, the touch panel 1071 and the display panel 1061 can be integrated to realize the input and output functions of the electronic device, which is not limited here.

[0210] The interface unit 108 is an interface for connecting an external device to the electronic device 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, an audio input / output (I / O) port, a video I / O port, a headphone port, etc. The interface unit 108 may be used to receive input (e.g., data information, power, etc.) from the external device and transmit the received input to one or more elements within the electronic device 100, or may be used to transmit data between the electronic device 100 and the external device.

[0211] Memory 109 can be used to store software programs and various data. Memory 109 may primarily include a program storage area and a data storage area. The program storage area may store an operating system and at least one application required for a function (such as a sound playback function or an image playback function); the data storage area may store data generated based on the use of the mobile phone (such as audio data, a phone book, etc.). Furthermore, memory 109 may include high-speed random access memory and non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device.

[0212] The processor 110 is the control center of the electronic device. It connects all parts of the electronic device using various interfaces and circuits. By running or executing software programs and / or modules stored in the memory 109 and accessing data stored in the memory 109, it performs various functions of the electronic device and processes data, thereby providing overall monitoring of the electronic device. The processor 110 may include one or more processing units; optionally, the processor 110 may integrate an application processor and a modem processor. The application processor primarily handles the operating system, user interface, and application programs, while the modem processor primarily handles wireless communications. It is understood that the modem processor may not be integrated into the processor 110.

[0213] The electronic device 100 may also include a power supply 111 (such as a battery) to supply power to each component. Optionally, the power supply 111 may be logically connected to the processor 110 through a power management system, thereby managing functions such as charging, discharging, and power consumption through the power management system.

[0214] In addition, the electronic device 100 includes some functional modules not shown, which will not be described here.

[0215] Optionally, an embodiment of the present invention further provides an electronic device, including: Figure 15 The processor 110, memory 109, and a computer program stored in the memory 109 and executable on the processor 110 are shown. When the computer program is executed by the processor 110, the various processes of the above-mentioned method embodiment are implemented, and the same technical effects can be achieved. To avoid repetition, they will not be described here.

[0216] Optionally, an embodiment of the present invention further provides an AR device, including a processor, a memory, and a computer program stored in the memory and runnable on the processor. When the computer program is executed by the processor, the various processes of the above-mentioned method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0217] Optionally, in an embodiment of the present invention, the electronic device in the above embodiment may be an AR device. Figure 15 When the electronic device (as shown) is an AR device, the AR device may include all or part of the functional modules in the above electronic device. Of course, the AR device may also include functional modules not included in the above electronic device.

[0218] It is understood that in the embodiments of the present invention, when the electronic device in the above embodiments is an AR device, the electronic device may be an electronic device integrated with AR technology. AR technology refers to a technology that achieves the integration of real scenes and virtual scenes. AR technology can restore human visual functions, allowing humans to experience the combination of real scenes and virtual scenes through AR technology, thereby enabling humans to better experience the immersive feeling.

[0219] Taking AR glasses as an example, when a user puts on AR glasses, the scene they see is generated through AR technology. That is, AR technology allows the virtual scene to be superimposed on the real scene. As the user interacts with the content displayed by the AR glasses, they can see the AR glasses "peeling back" the real scene, presenting a more realistic view. For example, when a user observes a cardboard box with the naked eye, they can only see the outer shell. However, when wearing AR glasses, they can directly see the internal structure of the box.

[0220] The AR device may include a camera, so that the AR device can display and interact with virtual images based on the images captured by the camera. For example, in an embodiment of the present invention, when a user uses the AR device, the AR device can project and display multiple virtual objects on the virtual screen of the AR device, so that the user can input a virtual object among the multiple virtual objects, so that the AR device can determine whether the virtual object selected by the user is a preset virtual object based on the user's input, and whether the input characteristics of the user's input match the preset input characteristics, so as to determine whether to unlock the AR device.

[0221] In the embodiment of the present invention, the virtual screen can be any carrier that can be used to display content projected by a projection device when displaying content using AR technology. The projection device can be a projection device using AR technology, such as the electronic device or AR device in the embodiment of the present invention.

[0222] In an embodiment of the present invention, when AR technology is used to display content on a virtual screen, the projection device can project the virtual scene obtained (or internally integrated) by the projection device, or the virtual scene and the real scene onto the virtual screen, so that the virtual screen can display these contents, thereby showing the user the effect of superimposing the real scene and the virtual scene.

[0223] Optionally, in an embodiment of the present invention, in combination with different scenarios of AR technology application, the virtual screen can generally be any possible carrier such as the display screen of an electronic device (such as a mobile phone), the lens of AR glasses, the windshield of a car, the wall of a room, etc.

[0224] The following uses the virtual screen as the display screen of an electronic device, the lens of AR glasses, and the windshield of a car as examples to illustrate the process of displaying content on a virtual screen using AR technology.

[0225] In one example, when the virtual screen is a display screen of an electronic device, the projection device can be the electronic device. The electronic device can capture the real scene in the area where the electronic device is located through its camera and display the real scene on the display screen of the electronic device. The electronic device can then project the captured (or internally integrated) virtual scene onto the display screen of the electronic device, so that the virtual scene can be superimposed on the real scene, and the user can see the effect of the superposition of the real scene and the virtual scene through the display screen of the electronic device.

[0226] In another example, when the virtual screen is a pair of AR glasses, the projection device can be the AR glasses. When the user wears the glasses, the user can see the real scene in the area they are in through the AR glasses' lenses, and the AR glasses can project the virtual scene they have acquired (or integrated internally) onto the AR glasses' lenses, so that the user can see the display effect of the real scene and the virtual scene superimposed through the AR glasses' lenses.

[0227] In another example, when the virtual screen is a car windshield, the projection device can be any electronic device. When a user is inside the car, the user can see the real scene in the area through the car windshield, and the projection device can project the virtual scene it has acquired (or integrated internally) onto the car windshield, so that the user can see the display effect of the real scene and the virtual scene superimposed on the car windshield.

[0228] Of course, in the embodiments of the present invention, the specific form of the virtual screen is not limited. For example, it may be a non-carrier real space. In this case, when the user is in the real space, the user can directly see the real scene in the real space, and the projection device can project the virtual scene it obtains (or integrates internally) into the real space, so that the user can see the display effect of the real scene and the virtual scene superimposed in the real space.

[0229] Optionally, an embodiment of the present invention further provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the various processes of the above-described method embodiment are implemented and the same technical effects are achieved. To avoid repetition, the details are not described here. The computer-readable storage medium is, for example, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0230] It should be noted that, in this document, the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, article, or apparatus comprising a series of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or apparatus. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or apparatus comprising the element.

[0231] Through the description of the above embodiments, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus the necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better embodiment. Based on this understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), including a number of instructions for enabling an electronic device (which can be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods described in each embodiment of the present invention.

[0232] The embodiments of the present invention are described above in conjunction with the accompanying drawings, but the present invention is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present invention, ordinary technicians in this field can also make many forms without departing from the scope of protection of the present invention and the claims, all of which are protected by the present invention.

Claims

1. An unlocking method, applied to an electronic device, characterized in that: The method comprises: Obtain the user's gaze area and gaze duration; When the gaze area includes a target object and the gaze duration is greater than or equal to a first preset threshold, displaying N virtual objects, where N is an integer greater than or equal to 2; receiving a first input from a user on a target virtual object among the N virtual objects; In response to the first input, if the target virtual object is a preset virtual object and an input feature of the first input matches a preset input feature, unlocking the electronic device; The displaying of N virtual objects includes: When the target object is at a first display angle, displaying the i-th virtual object in a first area of ​​the target object, where the first area is a visible area on the target object at the first display angle; receiving a second input from the user, where the second input is an input from the user to rotate the target object to a second display angle; In response to the second input, displaying an (i+1)th virtual object in a second area of ​​the target object, where the second area is a visible area on the target object at the second display angle; Wherein, i is a positive integer, i≤N.

2. The method according to claim 1, characterized in that The N virtual objects include a first virtual object, and the first input is an input by a user to move the first virtual object to the target virtual object; The method of unlocking the electronic device when the target virtual object is a preset virtual object and the input feature of the first input matches the preset input feature includes: When the target virtual object is the preset virtual object and the first virtual object and the target virtual object overlap at least partially, the electronic device is unlocked.

3. The method according to claim 1, characterized in that The method of unlocking the electronic device when the target virtual object is a preset virtual object and the input feature of the first input matches the preset input feature includes: When the target virtual object is the preset virtual object and the input action of the first input is a preset input action, the electronic device is unlocked.

4. An electronic device, characterized in that: The electronic device comprises: an acquisition module, a display module, a receiving module and an unlocking module; The acquisition module is used to obtain the gaze area and gaze duration of the user; The display module is configured to display N virtual objects when the gaze area acquired by the acquisition module includes a target object and the gaze duration acquired by the acquisition module is greater than or equal to a first preset threshold, where N is an integer greater than or equal to 2; The receiving module is configured to receive a first input from a user on a target virtual object among the N virtual objects displayed by the display module; The unlocking module is configured to unlock the electronic device in response to the first input received by the receiving module, if the target virtual object is a preset virtual object and the input feature of the first input matches the preset input feature; The display module is specifically configured to display an i-th virtual object in a first area of ​​the target object when the target object is at a first display angle, where the first area is a visible area on the target object at the first display angle; The receiving module is further configured to receive a second input from the user, where the second input is an input from the user rotating the target object to a second display angle; The display module is further configured to display an (i+1)th virtual object in a second area of ​​the target object in response to the second input received by the receiving module, where the second area is a visible area on the target object at the second display angle; Wherein, i is a positive integer, i≤N.

5. The electronic device according to claim 4, characterized in that The N virtual objects include a first virtual object, and the first input is an input by a user to move the first virtual object to the target virtual object; The unlocking module is specifically configured to unlock the electronic device when the target virtual object is the preset virtual object and the first virtual object and the target virtual object overlap at least partially.

6. The electronic device according to claim 4, wherein: The unlocking module is specifically configured to unlock the electronic device when the target virtual object is the preset virtual object and the input action of the first input is a preset input action.

7. An electronic device, characterized in that: The invention comprises a processor, a memory, and a computer program stored in the memory and executable on the processor, wherein the computer program implements the steps of the unlocking method according to any one of claims 1 to 4 when executed by the processor.

8. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program, which, when executed by a processor, implements the steps of the unlocking method according to any one of claims 1 to 4.

Images