Application control method, device and electronic device
By configuring different working states in the image collector and using preview images for identity authentication, the problem of users forgetting the file safe password is solved and a safe and efficient identity authentication process is achieved.
Patent Information
- Application Number
- CN202011062160.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-09-30
- Publication Date
- 2025-01-21
- Estimated Expiration
- 2040-09-30
AI Technical Summary
In the prior art, when a user forgets the password password of the file safe, the reset process is cumbersome and may lead to loss of file information or illegal access.
By configuring the first working state and the second working state in the image collector, and using the preview image collected when the image collector is in the second working state for user identity authentication, identity verification without memorizing passwords is achieved.
It reduces the operating power consumption of the image collector, improves the security and convenience of user identity authentication, and avoids the inconvenience and security threats caused by users forgetting their passwords.
Smart Images

Figure CN112199655B_ABST
Abstract
Description
Technical Field
[0001] The present application mainly relates to the field of communication technology, and more specifically to an application control method, device and electronic device. Background Art
[0002] With the development of computer communication technology, electronic devices are becoming more and more intelligent, capable of realizing more and more functions, and becoming an indispensable auxiliary tool for people's daily office work.
[0003] In actual applications, in order to ensure the safety of electronic equipment, important files or disks are usually encrypted. For example, a file safe is set for electronic equipment, which is a file security storage software. This software can virtualize a disk or a folder that stores files in an encrypted manner. Before accessing the file safe, password verification is required. Only after the password verification is passed can the files in the file safe be read and written.
[0004] However, in the existing security processing method, once the user forgets the password of the file safe, the password must be reset, which is a cumbersome process, and the file information stored in the file safe before the reset may be destroyed, and the file information can no longer be viewed later, or the set password is cleared by resetting the file safe, resulting in illegal users being able to access the file information therein, and the storage security of the file information in the file safe cannot be guaranteed. Summary of the invention
[0005] In view of this, in order to solve the various inconveniences caused by users forgetting passwords in applications based on passwords for user identity authentication, this application provides the following technical solutions:
[0006] On the one hand, the present application proposes an application control method, the method comprising:
[0007] Obtaining a processing request initiated by a first user for a target application, and controlling the image collector to switch from a first working state to a second working state to perform image acquisition;
[0008] Performing identity authentication on the first user based on the first preview image acquired by the image acquirer in the second working state to obtain a first identity authentication result;
[0009] If the first identity authentication result is passed, respond to the processing request and control the image collector to resume operation in the first working state;
[0010] The first operating power consumption of the image collector in the first operating state is less than the second operating power consumption in the second operating state.
[0011] Optionally, obtaining the processing request initiated by the first application for the target application includes:
[0012] Performing a sight tracking detection on the second preview image acquired by the image acquisition device in the first working state to obtain a sight tracking detection result;
[0013] Based on the gaze tracking detection result, a processing request for a target application is generated.
[0014] Optionally, the method further includes:
[0015] Performing identity authentication on the first user based on the second preview image acquired by the image acquirer in the first working state to obtain a second identity authentication result;
[0016] Counting the consistency rate between the first identity authentication result and the second identity authentication result corresponding to the same processing request among multiple processing requests initiated for the target application;
[0017] If the consistency rate is less than a first threshold, increasing the performance parameters of the image collector in the first working state; wherein the performance parameters include resolution and frame rate, and the increased performance parameters of the image collector in the first working state are less than the corresponding performance parameters of the image collector in the second working state;
[0018] If the consistency rate is not less than the first threshold, the performance parameters of the image collector in the first working state are maintained unchanged; or, the performance parameters of the image collector in the first working state are adjusted to preset minimum performance parameters.
[0019] Optionally, the processing request includes an access request and a configuration request, wherein:
[0020] If the processing request is the access request, the responding to the processing request includes:
[0021] In response to the access request, output access content of the target application;
[0022] If the processing request is the configuration request, the responding to the processing request includes:
[0023] In response to the configuration request, configuration information for the target application is determined in the electronic device.
[0024] Optionally, performing identity authentication on the first user based on the first preview image acquired by the image acquirer in the second working state to obtain a first identity authentication result, and responding to the processing request if the first identity authentication result is passed, includes:
[0025] Calling a target user image for the target application;
[0026] Performing feature matching on the first preview image acquired by the image acquirer in the second working state and the target user image to obtain a first feature matching degree;
[0027] When detecting that the first feature matching degree reaches a first matching threshold but does not reach a second matching threshold, controlling the first process of the target application to run so as to pre-start the target application;
[0028] In the process of controlling the operation of the first process, it is determined that the first feature matching degree between the first preview image newly acquired by the image collector within a preset time period and the target user image reaches the second matching threshold, the second process of the target application is controlled to run, the target application is successfully started, and the processing request is responded to.
[0029] Optionally, performing identity authentication on the first user based on the first preview image acquired by the image acquirer in the second working state to obtain a first identity authentication result includes:
[0030] Detecting whether the first preview image acquired by the image collector in the second working state contains complete facial features;
[0031] If the complete facial features are not included, outputting adjustment prompt information according to the facial feature category included in the first preview image, wherein the adjustment prompt information is used to instruct the first user to adjust the relative position between the face and the image collector so that the collected first preview image can include the complete facial features;
[0032] If the complete facial features are included, the first user is authenticated based on the complete facial features included in the first preview image to obtain a first identity authentication result.
[0033] Optionally, the first identity authentication result is failure, including at least one of the following implementation methods:
[0034] The first preview image does not include a face image;
[0035] The clarity of the face image included in the first preview image is less than a first clarity threshold;
[0036] The feature matching degree between the first preview image and the target user for the target application does not reach a first matching threshold;
[0037] The position change amount of the first preview image within a first time period is greater than a first change threshold, and the first time period is determined based on the time period taken to acquire a frame of image;
[0038] The position change amount of the first preview image within the first time period is greater than the first change threshold, and the position change amount of the latest first preview image obtained after the second time period within the first time period is still greater than the first change threshold.
[0039] Optionally, after obtaining the processing request initiated by the first user for the target application, the method further includes:
[0040] According to the preset authentication priorities of different identity authentication methods, controlling the electronic device to execute a first identity authentication method, wherein the different identity authentication methods include an image authentication method, a fingerprint authentication method, and a password authentication method;
[0041] If the first identity authentication method is the image authentication method, executing the step of controlling the image collector to switch from the first working state to the second working state to perform image acquisition;
[0042] If the first identity authentication result is failure, output a first prompt message indicating that the identity authentication of the first user has failed; or, perform identity authentication on the first user according to the identity authentication method corresponding to the next identity authentication priority, to obtain a third identity authentication result;
[0043] If the third identity authentication result is passed, executing the step of responding to the processing request;
[0044] If the third identity authentication result is failed, outputting a second prompt message indicating that the identity authentication of the first user has failed; or
[0045] Continue to authenticate the first user according to the identity authentication method corresponding to the next identity authentication priority until the identity authentication of the first user is successful, and execute the step of responding to the processing request; or the identity authentication of the first user fails according to the different identity authentication methods, and output a third prompt information indicating that the identity authentication of the first user has failed.
[0046] On the other hand, the present application also proposes an application control device, the device comprising:
[0047] A processing request obtaining module, used to obtain a processing request initiated by a first user for a target application;
[0048] A first control module, used for controlling the image collector to switch from a first working state to a second working state to perform image acquisition;
[0049] A first identity authentication processing module, configured to perform identity authentication on the first user according to the first preview image acquired by the image acquirer in the second working state, and obtain a first identity authentication result;
[0050] A processing request response module, used for responding to the processing request when the first identity authentication result is passed;
[0051] A second control module, configured to control the image collector to resume operation in the first working state when the first identity authentication result is passed;
[0052] The first operating power consumption of the image collector in the first operating state is less than the second operating power consumption in the second operating state.
[0053] On the other hand, the present application also proposes an electronic device, the electronic device comprising:
[0054] monitor;
[0055] A memory, used to store a first program for implementing the above-mentioned application control method and a second program for supporting the operation of the target application;
[0056] The processor is used to load and execute the first program stored in the memory to implement the steps of the application control method as described above.
[0057] It can be seen that the present application provides an application control method, device and electronic device, which configure at least two working modes, such as a first working state and a second working state, for the image collector, and the first operating power consumption when the image collector is in the first working state is less than the second operating power consumption in the second working state. In this way, after the electronic device obtains a processing request initiated by the first user for the target application, it will control the image collector to switch from the first working state to the second working state for image acquisition. Compared with the image collector always operating in the working mode corresponding to the second working state, the operating power consumption of the image collector is greatly reduced.
[0058] Afterwards, the electronic device can use the first preview image collected by the image collector at this time to authenticate the first user, and will respond to the processing request only when the first authentication result is passed, so that the first user can operate the target application of the electronic device, ensuring the safety of the electronic device, and does not require the user to personally remember the password for operating the target application, avoiding various inconveniences caused by the user forgetting the password, and the threat of clearing the current configuration and recorded content of the target application. Moreover, when the first authentication result is passed, the electronic device can control the image collector to resume operation in the first working state with lower operating power consumption, so as to reduce unnecessary power consumption and reduce ineffective resource occupation. BRIEF DESCRIPTION OF THE DRAWINGS
[0059] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are merely embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without creative work.
[0060] Figure 1 A flowchart of an optional example of the application control method proposed in this application;
[0061] Figure 2 A flowchart diagram of another optional example of the application control method proposed in this application;
[0062] Figure 3 A flowchart diagram of another optional example of the application control method proposed in this application;
[0063] Figure 4 A flowchart diagram of another optional example of the application control method proposed in this application;
[0064] Figure 5 A flowchart diagram of another optional example of the application control method proposed in this application;
[0065] Figure 6 A schematic diagram of the structure of an optional example of the application control device proposed in this application;
[0066] Figure 7 A schematic structural diagram of another optional example of the application control device proposed in this application;
[0067] Figure 8 This is a hardware structure diagram of an electronic device embodiment proposed in the present application that is applicable to the application control method and device proposed in the present application. DETAILED DESCRIPTION
[0068] In view of the technology described in the background technology section, this application proposes to use other encryption methods that do not require users to remember encryption passwords to avoid a series of problems caused by forgetting encryption passwords. Specifically, in combination with the rapid development of artificial intelligence technology in recent years, such as intelligent office and entertainment, before users use intelligent electronic devices to operate, in order to ensure operational safety and avoid illegal operations on electronic devices, such as changing the configuration of installed applications on electronic devices, uninstalling certain applications, installing new applications, etc., which may cause security risks such as leakage or destruction of important information of electronic devices. It can be required that before executing these but not limited to these operations, the first user who currently requests to operate the electronic device must first undergo an identity authentication process. At this time, a more reliable, flexible, and practical identity authentication method that reduces the requirements on the user himself (such as memory) can be used compared to the traditional method of user identity authentication through passwords.
[0069] Exemplarily, the present application may choose to adopt an image-based user authentication method, which is a common authentication method implemented using artificial intelligence technology. It only requires a feature comparison between the currently captured user image and the pre-stored legitimate user image to determine whether the current user's identity is qualified. The user does not need to remember passwords, which is simple and convenient.
[0070] However, in order to obtain the image of the current user in a timely manner, the image collector is usually controlled to be in a working state at all times, such as controlling the camera to be in an on state all the time, which results in a large occupation of resources; and, in order to ensure the clarity of the collected user image so that the image features can be accurately and reliably extracted later, the turned-on image collector is required to work under a higher performance configuration, which not only increases the ineffective occupation of resources, but also makes the image collector's operating power consumption higher, resulting in unnecessary energy loss.
[0071] In order to improve the above problems, the present application further proposes to configure at least two working states for the image collector, one of which is the normal working mode of the image collector. In this working state, although a relatively high-quality image can be collected, its operating power consumption is relatively high; the other working state is different from the normal working mode of the image collector, and reduces the performance configuration standard of the image collector, such as reducing the resolution and frame rate of image acquisition, so as to achieve the purpose of reducing the operating power consumption of the image collector in this working state and appropriately reducing the ineffective occupation of resources. In this way, the present application can select the working state of the image collector according to the actual application requirements, rather than being in a working state with high operating power consumption all the time, which can reduce energy consumption while meeting the image acquisition requirements for identity authentication.
[0072] Of course, according to actual needs, this application can also set more working states based on the performance configuration parameters supported by the image collector to meet the image acquisition requirements in different scenarios. This application does not elaborate on the configuration process of multiple working states of the image collector.
[0073] In some embodiments proposed in this application, the above-mentioned user authentication method is not limited to the authentication method based on the user image given above, and can also be implemented based on other physiological parameters of the user, such as fingerprint authentication method, voiceprint authentication method, pupil authentication method, etc. According to the security requirements of the specific application scenario, this application can select one or more authentication methods to implement during the user authentication. Among them, in the case of multiple authentication methods, the priority of these multiple authentication methods can be pre-configured, so that in the actual authentication process, the corresponding authentication method called according to the priority can be used to implement the authentication of the first user. This application does not elaborate on the implementation process of the above authentication methods.
[0074] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.
[0075] It should be noted that, for the convenience of description, only the parts related to the relevant invention are shown in the drawings. In the absence of conflict, the embodiments and features in the embodiments of the present application can be combined with each other.
[0076] It should be understood that the "system", "device", "unit" and / or "module" used in this application is a method for distinguishing different components, elements, parts, portions or assemblies at different levels. However, if other words can achieve the same purpose, the word can be replaced by other expressions.
[0077] As shown in this application and claims, unless the context clearly indicates an exception, the words "a", "an", "a kind" and / or "the" do not refer to the singular, but also include the plural. Generally speaking, the terms "include" and "comprise" only indicate the inclusion of clearly identified steps and elements, and these steps and elements do not constitute an exclusive list. The method or device may also include other steps or elements. The elements defined by the sentence "includes a..." do not exclude the existence of other identical elements in the process, method, commodity or device that includes the elements.
[0078] Among them, in the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" refers to two or more than two. The following terms "first" and "second" are used for descriptive purposes only and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features.
[0079] In addition, flow charts are used in the present application to illustrate the operations performed by the system according to the embodiments of the present application. It should be understood that the preceding or following operations are not necessarily performed accurately in order. On the contrary, the various steps may be processed in reverse order or simultaneously. At the same time, other operations may also be added to these processes, or a certain step or several steps of operations may be removed from these processes.
[0080] Reference Figure 1 , is a flow chart of an optional example of the application control method proposed in this application, which can be applied to electronic devices, which may include but are not limited to: smart phones, tablet computers, wearable devices, ultra-mobile personal computers (ultra-mobile personal computers, UMPC), netbooks, personal digital assistants (personal digital assistants, PDA), e-book readers, smart speakers, vehicle-mounted equipment, robots, desktop computers, etc. This application does not limit the product form and structure of the electronic device. Figure 1 As shown, the application control method may include the following steps:
[0081] Step S11, obtaining a processing request initiated by a first user for a target application, and controlling the image collector to switch from a first working state to a second working state to perform image acquisition;
[0082] In the embodiments of the present application, the image collector can be an independent device, such as a video camera, a camera, etc., or it can be a camera integrated in the electronic devices listed above. The present application does not limit the configuration method and installation location of the image collector, which can be determined according to the circumstances.
[0083] In combination with the above description of the technical concept of the present application, the present application configures different working states for the image collector, and the first operating power consumption of the image collector in the first working state is less than the second operating power consumption in the second working state. Accordingly, the image quality (such as image clarity, etc.) of the preview image collected by the image collector in the first working state is lower than the image quality of the preview image collected in the second working state. The present application does not limit the performance configuration parameters of the image collector in different working states.
[0084] Based on this, when the first user (which can refer to any user) needs to operate the electronic device, such as accessing an application in the electronic device, using a function of the application or accessing a file stored in the application, installing a new application in the electronic device, uninstalling an application currently installed in the electronic device, etc., a processing request for the target application can be generated based on the user's operation. The target application here can be an application to be accessed, an application to be uninstalled, an application to be installed, etc. This application does not limit the application category of the target application. It should be understood that in different operation scenarios of the electronic device, the method of generating a processing request for the target application and the content contained in the processing request may be different, and this application will not be described in detail one by one.
[0085] Exemplarily, the target application may be a file safe installed in an electronic device, i.e., a file security storage software, which usually outputs a corresponding application icon on the operation interface of the electronic device. When the first user needs to perform a read / write operation on the file safe, he / she may click (or use other selection methods, not limited to the click selection method) the application icon of the file safe, hoping to open the file safe to complete subsequent file read / write operations. In this process, based on the first user's opening operation on the file safe, an access request (i.e., a processing request) for the file safe may be initiated.
[0086] If the target application is an application program that needs to be installed on the electronic device, the first user is usually required to download an installation package of the target application from an application store or a webpage, and click on the installation package in the hope of installing the target application into the electronic device system, so that the target application is executed by the electronic device. In this process, a corresponding processing request may also be generated when the installation package of the target application is clicked or the installation is confirmed; similarly, when deleting an existing target application, a corresponding processing request may be generated when the user chooses to confirm the deletion of the target application, etc.
[0087] In an embodiment of the present application, when the electronic device obtains a processing request for a target application initiated by a first user, in order to avoid illegal operation of the electronic device and reduce the security of the electronic device, it is necessary to authenticate the first user before responding to the processing request. As analyzed above, this embodiment will adopt an image-based identity authentication method, so it is necessary to obtain a relatively high-quality image of the first user. Combined with the above description of the first working state and the second working state of the image collector, the image collector will be controlled to switch from the first working state to the second working state at this time, so that the image collector can obtain a relatively high-quality user image.
[0088] It should be understood that before the electronic device obtains the above-mentioned processing request, the image collector has been running in the first working state, so that the image collector works in a relatively low power consumption state. Although the quality of the images collected during this period is low, it is still possible to determine whether there is a user, that is, to preliminarily judge whether there is a user operating the electronic device, etc. The specific implementation process will not be described in detail.
[0089] In some embodiments, for the switching control of different working states of the above-mentioned image collector, when the electronic device obtains the above-mentioned processing request, it can generate a working state switching instruction for the image collector and send it to the image collector. The image collector responds to the working state switching instruction to switch from the current first working state to the second working state. However, it is not limited to this software switching implementation method. According to needs, corresponding switching circuits can also be configured to implement the switching of the above-mentioned working states in hardware. The specific implementation process is not described in detail in this application.
[0090] In which, when the image collector has more working states, the working state switching instruction generated by the electronic device may include an identifier of the target working state to be switched to, so that when the image collector responds to the working state switching instruction, it directly switches to the working state corresponding to the identifier, etc. The specific implementation process is not limited in this application.
[0091] Step S12, performing identity authentication on the first user according to the first preview image acquired by the image collector in the second working state, and obtaining a first identity authentication result;
[0092] In an embodiment of the present application, for an image-based identity authentication method, a target user image of a target user who has operation authority over the electronic device, or even a target user who has operation authority over the above-mentioned target application, may be pre-stored. The target user image contains image features that can accurately indicate the identity of the target user, but is not limited to the specific image content contained in the target user image. It may be a facial image, a full-body image, an image of a specific organ, etc. of the target user, depending on the circumstances, and this embodiment will not describe them one by one.
[0093] Based on this, it is determined that there is currently a first user who wants to operate the target application of the electronic device and hopes to capture the user image of the first user to identify the identity of the first user. Therefore, during the period when the user operates the electronic device, he or she is usually in front of the electronic device and facing the display screen of the electronic device to facilitate viewing the information content displayed on the display screen. The image acquisition direction of the image acquirer in the embodiment of the present application can be consistent with the display direction of the display screen, so that it can capture the image of the first user operating the electronic device.
[0094] Afterwards, the first user can be authenticated based on the first preview image collected by the image collector to determine whether the first user has the operating authority for the target application of the electronic device. In the image authentication process, the image feature similarity between the first preview image and the pre-stored corresponding target user image can be analyzed, and it can be determined whether it reaches a preset similarity threshold to determine whether the first user contained in the first preview image is the target user corresponding to the target user image. This application does not limit the specific implementation method of the image authentication method, and is not limited to this image feature similarity judgment method, which can be determined according to the circumstances.
[0095] In some embodiments, in order to improve the efficiency of image recognition, the present application may also pre-utilize target user images and non-target user images, and after training an initial image authentication model (such as a machine learning network structure), obtain an image authentication model used to identify whether an image is a target user image. In this way, in actual applications, after obtaining the first preview image, it can be directly input into the image authentication model to output the corresponding first identity authentication result. The present application does not elaborate on the network structure of the image authentication model and its training method.
[0096] Step S13: If the first identity authentication result is passed, respond to the above processing request and control the image collector to resume operation in the first working state.
[0097] Continuing from the above description, after completing the identity authentication of the first user in the above manner and obtaining the corresponding first identity authentication result, if the first identity authentication result is passed, it means that the first user has the operating authority for the target application of the electronic device. The electronic device will respond to the above processing request and perform the corresponding operation actions on the target application, such as accessing the requested target file recorded in the target application, deleting the target application, installing the target application on the electronic device, etc. The specific operation can be determined based on the specific request content of the processing request, and this application will not describe them in detail here.
[0098] It can be seen that the above-mentioned processing request may include but is not limited to access request and configuration request. If the processing request is an access request, the above-mentioned response processing request may specifically include: responding to the access request and outputting the access content of the target application. Exemplarily, if the first user accesses a file in the file safe (a target application) of an electronic device, the file safe must be opened and the file must be decrypted to view the file content. In this scenario, the first user clicks on the file safe, which can initiate an access request for the file safe and output the corresponding identity authentication result. The first user is authenticated in the above manner. After the authentication is passed, the user enters the operation interface of the file safe and can access the files encrypted by the file safe. Of course, the present application can also authenticate the first user in the above manner when the first user clicks to access the file in the file safe to determine whether the first user is allowed to access the file.
[0099] If the above-mentioned processing request is a configuration request, the above-mentioned response processing request process may include: responding to the configuration request and determining the configuration information for the target application in the electronic device. Exemplarily, when the first user wishes to adjust the system configuration of the electronic device, optimize or uninstall existing applications, install new applications and other configuration requirements, combined with the description of the corresponding part of the above-mentioned embodiment, the corresponding operation interface can be entered to perform input operations, and the electronic device responds to the input operation and generates a corresponding configuration request. At this time, in order to realize the identity authentication of the first user, the identity authentication interface can be output to display the first preview image collected by the image collector. In this process, the first user can actively adjust the relative position with the electronic device based on the presented first preview image content, so that the first preview image includes sufficient image features to support the completion of the identity authentication of the first user. The specific implementation process is not described in detail in this embodiment.
[0100] It can be seen that in order to ensure the safe use of electronic devices, according to the security requirements of application scenarios, the first user can be authenticated in the above manner before performing various types of operations on the electronic device. The types of these operations include but are not limited to the target application access, system configuration adjustment, application configuration adjustment, installation / uninstallation of applications, etc. listed above. It should be understood that for different types of operations, the specific content and method of the processing request initiated may be different, and the implementation process of determining the response to the processing request will also be different. This application does not describe them in detail one by one.
[0101] Moreover, after completing the identity authentication of the first user in the above manner, during the operation of the target application, it is usually not necessary to collect the image of the first user for identity authentication. In this case, in order to reduce the operating power consumption of the image collector, the image collector can be restored to the first working state, that is, restored to a state with lower operating power consumption. Regarding the implementation method of switching from the second working state to the first working state, please refer to the description of the corresponding part of the above embodiment and will not be repeated here.
[0102] To sum up, in the embodiment of the present application, at least two working modes, namely the first working state and the second working state, are configured for the image collector, and the first operating power consumption when the image collector is in the first working state is less than the second operating power consumption when the image collector is in the second working state. In this way, after the electronic device obtains the processing request initiated by the first user for the target application, it will control the image collector to switch from the first working state to the second working state for image acquisition. Since it is in the first working state before, the image collector is always operating in the working mode corresponding to the second working state, which greatly reduces the operating power consumption of the image collector.
[0103] Afterwards, the electronic device can use the first preview image captured by the image collector at this time to authenticate the first user, and will respond to the processing request only when the first authentication result is passed, so that the first user can operate the target application of the electronic device, thereby ensuring the safety of the electronic device. There is no need for the user to personally memorize the password for operating the target application, avoiding various inconveniences caused by the user forgetting the password, and the threat of clearing the current configuration and recorded content of the target application.
[0104] Moreover, when the first identity authentication result is passed, the electronic device can control the image collector to resume operation in the first working state with lower power consumption, so as to reduce unnecessary power consumption and reduce ineffective occupation of resources.
[0105] Reference Figure 2 , which is a flowchart of another optional example of the application control method proposed in this application. This embodiment may be a detailed implementation of the application control method described in the above embodiment, but is not limited to the detailed implementation described in this embodiment. Figure 2 As shown, the method may specifically include but is not limited to the following steps:
[0106] Step S21, obtaining a second preview image acquired by the image collector in the first working state;
[0107] Step S22, performing a gaze tracking detection on the second preview image to obtain a gaze tracking detection result;
[0108] Step S23, generating a processing request for a target application based on the gaze tracking detection result;
[0109] In combination with the above description of the technical concept of the present application, in order to be able to timely capture the image of the user operating the electronic device, the image collector is always in the on state, but under normal circumstances, that is, when the user identity authentication is not required, the image collector is in a first working state with relatively low operating power consumption. Although the quality of the preview image captured during this period is relatively low, it can meet the monitoring requirements in the first working state.
[0110] It should be understood that when the image collector is turned on, preview images within the image acquisition range in front of the lens are usually continuously acquired. In this embodiment, the preview image acquired in the first working state can be recorded as the second preview image to distinguish it from the first preview image acquired in the second working state.
[0111] In the process of the image collector continuously collecting the second preview image, in order to determine which application the first user requests to process this time, the user's line of sight direction in the continuously collected second preview image can be analyzed to implement line of sight tracking detection of the first user, determine which application icon or other application logo presented by the electronic device the first user continuously looks at for a certain period of time, determine the application as the target application, and generate a processing request for the target application.
[0112] It can be seen that the present application can adopt an image analysis method to determine the target application that the first user wants to process by tracking the direction of the first user's line of sight, without the need for input devices (such as a mouse, keyboard, etc.), that is, by operating the input device to select the target application to be processed this time. In this way, when the user's hands are doing other things, the method of determining the target application described in this embodiment and generating a processing request for the target application can meet the user's needs for target application processing.
[0113] It should be noted that the specific implementation method for obtaining the processing request initiated by the first user for the target application in the present application is not limited to the image analysis implementation method described in the present embodiment, and can also generate a processing request for the target application in response to the first user's selection operation on the target application with the help of an input device; a voice recognition method can also be used, that is, by analyzing the audio output by the first user, determining the target application requested to be processed by the first user, and then generating a processing request for the target application, or directly initiating a processing request for the target application based on the audio analysis results, etc. The present application does not limit the specific implementation method of the audio analysis, which can be determined according to the needs of the application scenario, and can usually include but is not limited to: semantic recognition methods and audio content recognition methods based on artificial intelligence technologies such as deep learning / machine learning, etc., which are not described in detail one by one in the present application.
[0114] Step S24, controlling the image collector to switch from the first working state to the second working state to perform image acquisition;
[0115] In the actual application of this application, according to the application needs, some applications of the electronic device can be selected to configure corresponding operation permissions. For example, for applications involving important information of the electronic device, system security, important functions, etc., the specific application content is not limited in this application and can be flexibly configured or adjusted according to actual needs; for other applications, there is no need to set operation permissions, and this application does not describe the use process of these applications.
[0116] In this case, corresponding security authentication conditions can be constructed for the operating permissions configured for the electronic device. The security authentication conditions may include the contents of the configured operating permissions. In this way, after the user operates the electronic device and initiates a processing request for the target application, the electronic device can first detect whether the processing request meets the preset security authentication conditions, that is, verify whether the target application targeted by the processing request is configured with operating permissions. If so, it means that before the electronic device responds to the processing request, it needs to verify whether the first user who initiated the processing request has the operating permissions for the target application; conversely, if not, it means that the electronic device has not configured operating permissions for the target application, and the electronic device can directly respond to the processing request.
[0117] Among them, the content of the above-mentioned security authentication conditions can be determined based on the content of each operating permission actually configured in the electronic device. This application does not limit the content of the security authentication conditions and the method of generating them. According to the needs of the application scenario, after the operating permissions configured in the electronic device change, the content of the security authentication conditions can be adjusted accordingly to ensure the safety of the use of the electronic device.
[0118] It should be understood that if the application scenario has relatively high requirements for the safety of the use of electronic devices, corresponding operation permissions can be set for all operations on the electronic device. In this case, the target application can be any application installed on the electronic device (including system applications) and a new application that the user wants to install on the electronic device. This application does not limit the configuration method and requirements for the application processing operation permissions of the electronic device, which can be determined according to the circumstances.
[0119] After the above analysis, it is determined that the target application for which the processing request obtained by the electronic device is configured with operation permissions, and the first user needs to be authenticated before it can be determined whether to respond to the processing request. Therefore, combined with the above description of the first working state and the second working state of the image collector, this embodiment will control the image collector to switch from the first working state to the second working state for image acquisition, so that the image quality of the preview image acquired by the image collector is sufficient to meet the subsequent image-based identity authentication requirements. This application does not limit the specific performance parameter content of the image collector in the second working state.
[0120] Step S25, detecting whether the first preview image acquired by the image collector in the second working state contains complete facial features, if not, proceeding to step S26; if yes, executing step S27;
[0121] In order to improve the reliability and accuracy of user identification, the embodiment of the present application selects to adopt face recognition, that is, to authenticate the identity of the first user by the facial features. The working principle of the face recognition method is not described in detail in the present application. Based on this, the present embodiment requires that the first preview image can include the facial image of the first user.
[0122] However, when the user is operating the electronic device, the user may shake left and right, turn his head, etc. Since the image capture range corresponding to the image preview frame of the image collector is limited, if the user's head movement is too large, it is easy to cause the first preview image collected to not contain the complete facial features of the first user, and even the first user's facial image may not be collected, or the collected first user's facial image may be blurred (such as caused by the first user's rapid movement), etc. This will affect the subsequent identity authentication results, and may even make it impossible to perform identity authentication due to the inability to recognize facial features.
[0123] Based on the above considerations, before the first user is authenticated, the embodiment of the present application can first detect whether the first preview image collected by the image collector in the second working state contains complete facial features, and can extract and analyze the image features of the first preview image to determine whether it contains the facial features and the facial category to which it belongs, and then determine whether these facial features are complete based on the extracted facial features, such as whether they contain facial features corresponding to one or more parts of the face used for identity recognition; whether the facial features of one or more parts of the face used for identity recognition are clear and contain complete features of the parts, etc. The present application does not elaborate on the specific implementation method of step S25, which can be determined based on the requirements of the specific application scenario for identity authentication, and is not limited to the implementation method described above.
[0124] It should be understood that the above-mentioned first preview image can be collected when the image collector is in the second working state. For each frame of image presented in the image preview box, the present application can detect each frame of the collected first preview image according to the above-mentioned processing method, and determine whether the complete facial features of the first user are collected through the detection results of multiple consecutive frames of the first preview image; or whether multiple consecutive frames of the first preview image all collect the complete facial features of the first user, so as to reduce the interference of the situation where the user only passes by the image collector.
[0125] Step S26, outputting adjustment prompt information according to the facial feature category included in the first preview image;
[0126] Following the above analysis, since the detection result that the first preview image does not contain complete facial features is usually caused by an inappropriate relative position relationship between the user and the image collector, the electronic device can output adjustment prompt information after learning the detection result to instruct the first user to adjust the relative position between the face and the image collector so that the collected first preview image can contain complete facial features. Optionally, the adjustment prompt information may include but is not limited to position adjustment direction, distance, etc. This application does not limit the content of the adjustment prompt information and its output method, such as voice prompt method, pop-up text prompt, etc., which can be configured according to needs.
[0127] It should be understood that during the processing of this embodiment, the image collector is still continuously collecting the first preview image, and the electronic device detects the first preview image in the above manner. Therefore, after the first user adjusts the relative position between his face and the image collector according to the adjustment prompt information output by the electronic device, the image collector can promptly collect the new first preview image and continue to detect whether it contains complete facial features in the above manner. This cycle is repeated until one or more consecutive frames of the first preview image contain complete facial features, and subsequent steps are executed; or, if the first preview image containing complete facial features cannot be obtained after multiple adjustments, it can be considered that the first user does not have the operation authority of the target application and directly refuses to respond to the processing request. This application does not limit this.
[0128] Step S27, performing identity authentication on the first user based on the complete facial features included in the first preview image to obtain a first identity authentication result;
[0129] Step S28: If the first identity authentication result is passed, respond to the above processing request and control the image collector to resume operation in the first working state.
[0130] In the embodiment of the present application, the complete facial features contained in the first preview image can be compared with the facial features of the target user corresponding to the pre-stored target application, such as by calculating the similarity, and the first identity authentication result is obtained by judging whether the comparison result (such as the similarity) reaches the preset similarity threshold. It should be understood that if the first user is the target application, the complete facial features contained in the first preview image will often have a high similarity with the facial features of the target user, and can reach the preset similarity threshold; otherwise, the complete facial features contained in the first preview image will not have a similarity with the facial features of the target user, and the first identity authentication result obtained will be a failure.
[0131] It should be noted that this application uses face recognition to implement the specific implementation process of the identity authentication of the first user. The identity authentication model can also be pre-trained, and the collected first preview image is directly input into the identity authentication model to output the corresponding first identity authentication result, etc., but it is not limited to this model-based authentication method. Among them, the identity authentication model can be obtained by training the corresponding image samples based on machine learning / deep learning algorithms, and this application does not elaborate on the training method of the identity authentication model.
[0132] When the first identity authentication result is passed, the electronic device responds to the above processing request and controls the image collector to resume operation in the first working state. The implementation process can refer to the description of the corresponding part of the above embodiment and will not be repeated here.
[0133] In summary, the embodiment of the present application analyzes the collected first preview image and uses line of sight tracking to determine the target application for processing by the first application request, and initiates a processing request for the target application. The electronic device controls the image collector to switch from the first working state to the second working state for image collection, and detects whether the collected first preview image satisfies the complete facial features. If not, the corresponding adjustment prompt information can be output to instruct the first user to adjust the relative position between his face and the image collector to ensure that the collected first preview image contains the complete facial features, thereby achieving a more accurate identity authentication of the first user based on the complete facial features, and only when the first identity authentication result is passed, will the processing request be responded to, allowing the first user to operate the target application of the electronic device, thereby ensuring the safety of the use of the electronic device and avoiding various inconveniences caused by the user forgetting the password; at the same time, the electronic device can control the image collector to resume operation in the first working state with lower operating power consumption, so as to reduce unnecessary power consumption and reduce ineffective resource occupation.
[0134] Reference Figure 3 , which is a flowchart of another optional example of the application control method proposed in this application. This embodiment can be another detailed implementation of the application control method described in the above embodiment, which is different from the detailed implementation described in the above embodiment, such as Figure 3 As shown, the application control method proposed in this embodiment may include:
[0135] Step S31, obtaining a processing request initiated by a first user for a target application, and controlling the image collector to switch from a first working state to a second working state to perform image acquisition;
[0136] Regarding the specific implementation process of step S31, reference may be made to but not limited to the description of the corresponding part of the above embodiment, and this embodiment will not elaborate on it.
[0137] Step S32, calling a target user image for a target application;
[0138] Among them, the target user image can be image information of a target user who has the operating authority of the target application of the electronic device, and can be used to realize the identity authentication of the first user who requests to operate the electronic device. It should be noted that in the process of authenticating the first user, the content of the target user image will be different depending on the image feature content, which can be determined according to the identity authentication method implemented in this application.
[0139] For example, if the present application uses face recognition to authenticate the first user, then the target user image must at least include the target user's facial image; if the present application uses pupil authentication, the target user image may include the target user's eye image or pupil image, etc., which are not listed here. Since the specific method for authenticating the first user operating the electronic device is usually determined in advance, in the process of determining the specific authentication method, standard information for authentication, i.e., the target user image, is usually obtained and stored in association with the authentication method. The specific implementation process is not described in detail.
[0140] Step S33, performing feature matching on the first preview image acquired by the image collector in the second working state and the target user image to obtain a first feature matching degree;
[0141] In this embodiment, after the electronic device obtains the first preview image, it can extract features of the first preview image to obtain user identity features contained in the first preview image, such as facial features, body features, etc., and then the extracted user identity features can be matched with the user identity features of the pre-stored target user image to obtain a first feature matching degree. It should be noted that the user identity features of the target user image can be extracted and stored in advance, or can be directly extracted from the first preview image and the target user image when performing this identity authentication, depending on the situation.
[0142] Among them, the matching method of the above-mentioned user identity features may include but is not limited to: feature by feature comparison, counting the comparison results of each feature, and obtaining the corresponding feature matching degree; using a similarity calculation method to calculate the similarity between the user identity features respectively contained in the first preview image and the target user image, and the similarity is used to represent the feature matching degree. The greater the similarity, the higher the similarity between the two user identity features, and the more likely the first user is the target user.
[0143] In some other embodiments proposed in the present application, the above step S33 can also be implemented by a pre-trained feature matching model, that is, the first preview image and the target user image are input into the feature matching model, and the first feature matching degree of the user identity feature between the two images is output. The present application does not limit the specific training method of the feature matching model, and the first feature matching degree can be the probability of predicting that the first user included in the first preview image is the target user, or a corresponding matching score determined based on the above comparison result or similarity, etc. The present application does not limit the method for obtaining the above first feature matching degree and its representation method, which can be determined according to the actual situation.
[0144] In addition, the feature matching method of the above steps of the present application can also be implemented according to the facial feature matching method described in the above embodiment. On this basis, it can also be implemented in combination with the user's body features. It can be determined according to actual application needs, and this application will not describe them in detail here.
[0145] Step S34, detecting whether the first feature matching degree reaches the first matching threshold, if so, proceeding to step S35, if not, executing step S310;
[0146] Step S35, detecting whether the first feature matching degree reaches the second matching threshold, if not, proceeding to step S36; if yes, executing step S38;
[0147] Step S36, controlling the first process of the target application to run, so as to pre-start the target application,
[0148] In order to shorten the waiting time from successful identity authentication to successful startup of the target application, so as to improve the user experience, the embodiment of the present application proposes a function pre-start scheme for electronic equipment, which specifically divides the entire startup process of the target application into a basic process pre-start part and a core process startup. That is to say, the multiple processes called by the entire process of starting the target application are divided into two parts according to their importance. One or more processes that will not involve important functions or information access of the target application and are only used to implement the basic services of the target application are recorded as the first process, and other processes that involve important functions or information access of the target application are recorded as the second process. The present application does not limit the contents of the first process and the second process, which can be determined according to the type of the target application. The present application will not elaborate on this.
[0149] It can be seen that before the identity authentication is passed, even if the first process is started, it is only the pre-start of the target application. At this time, the first user cannot perform any input operations on the target application, and even the target application displayed on the electronic device will not change. It is only the pre-start of the background function, which will not threaten the safety of the electronic device. However, once the identity authentication is passed, since the pre-start of the target application is realized before this, there is no need to execute the pre-start process again, and the subsequent startup process can be directly executed to start the target application. Compared with the application control method in traditional applications, the pre-start implementation method proposed in this embodiment improves the startup speed of the target application.
[0150] Based on the above concept, the embodiment of the present application divides the entire identity authentication process into two stages, the pre-start stage and the full start stage, and for these two stages, corresponding identity authentication conditions can be configured, which are respectively recorded as the first identity authentication condition and the second identity authentication condition. After obtaining the first feature matching degree, it is determined whether to pre-start the target application by detecting whether it meets the first identity authentication condition. After determining that the target application can be pre-started, the second identity authentication condition will continue to be detected to further determine whether the target application can be fully started.
[0151] Therefore, this embodiment pre-configures a first matching threshold and a second matching threshold for the above-mentioned different identity authentication conditions, that is, the matching critical value at which the feature matching degree meets the corresponding identity feature conditions. This application does not limit the specific values of these two matching thresholds, but when the higher the feature matching degree, the greater the probability of passing the identity authentication of the first user, the first matching threshold is smaller than the second matching threshold.
[0152] According to the identity authentication concept described above, after obtaining the first feature matching degree, it can be detected whether it has reached the first matching threshold. If so, it can be preliminarily considered that the first user may belong to the target user (which may include one or more users with operating permissions of the electronic device), and the first user needs to be further authenticated, that is, to detect whether the first feature matching degree reaches the second matching threshold. Here, the second matching threshold can be the feature matching critical value for determining whether the identity authentication of the first user is passed. The content of the steps performed based on the detection result can refer to the description of the corresponding part below.
[0153] Since the present implementation allows the pre-start of the target application, and in the process of further identity authentication of the first user, various factors such as the movement of the first user may make it impossible to directly determine through one frame of preview image, and it may be necessary to analyze and authenticate multiple consecutive frames of first preview images. Therefore, determining at a certain moment that the first feature matching degree does not reach the second matching threshold does not directly determine that the identity authentication of the first user has failed. Under such detection results, the present embodiment can first control the running of the first process of the target application to pre-start the target application. The pre-start implementation process of different applications is not described in detail in this application.
[0154] If the above detection result is that the first feature matching degree does not reach the first matching threshold, it can be considered that the first user does not have the operation authority for the target application and does not belong to the target application. The first prompt message that the identity authentication of the first user failed and the target application is prohibited from starting (that is, the response processing request is prohibited) is output to inform the first user of the identity authentication result. This application does not limit the content of the first prompt message and its output method.
[0155] In some other embodiments proposed in the present application, when the detection result of step S34 is negative, the first feature matching degree may not reach the first matching threshold due to reasons such as the inappropriate current position of the first user. At this time, the adjustment prompt information as mentioned above can also be output to prompt the first user to adjust the relative position between the first user and the image collector so that the first feature matching degree of the newly obtained first preview image can reach the first matching threshold; if the first feature matching degree obtained within a specific time period still does not reach the first matching threshold, the first prompt information is output in the above manner, or the first user is determined to be an illegal user, and the user information of the first user is added to the blacklist. If needed, the alarm information of the target application of the first user attacking the electronic device can also be fed back to the preset terminal output, such as the electronic device of the target user or the administrator, etc., which will not be described in detail in the present application.
[0156] In some other embodiments proposed in the present application, the detection and judgment implementation process of the above-mentioned first feature matching degree, as described in the corresponding part of the above-mentioned embodiments, can also be completed by a pre-trained feature matching model. At this time, the model can output three detection results: the first feature matching degree of the input first preview image does not reach the first matching threshold, reaches the first matching threshold but does not reach the second matching threshold, and reaches the second matching threshold. Different monitoring results can trigger the execution of corresponding subsequent steps, and the training process of the model will not be described in detail.
[0157] Step S37, detect whether the duration of the identity authentication of the first user reaches the preset duration, if not, return to step S33 to continue the detection; if yes, end the currently running first process, and execute step S39,
[0158] Following the above description, after the first process of the target application is started, during this period, the image collector will continue to collect new first preview images, and compare the new first feature matching degree obtained with the first matching threshold and the second matching threshold in the above manner in turn to determine whether the identity authentication of the first user is passed. However, in this cyclic detection and judgment process, it will not be executed in an infinite loop. Usually, a certain time length is preset (recorded as the preset time length, the specific value is not limited, and can be determined according to actual needs), and multiple detection and judgment are allowed within the preset time length. Once the preset time length is exceeded, the first feature matching degree of the collected first preview image still reaches the first matching threshold, but does not reach the second matching threshold, and the detection and judgment will no longer continue. As analyzed below, it can be directly considered that the identity authentication of the first user has failed.
[0159] Based on this, after each detection and judgment is completed in the above manner, before executing the next detection and judgment, the embodiment of the present application can first detect whether the current identity authentication time for the first user has reached the preset time. If not, the detection and judgment can continue to be cyclically performed in the above manner; if the preset time is reached, it means that the identity authentication of the first user has failed, and the first user is not allowed to operate on the target user, so there is no need to start the target application. Therefore, in this case, the currently running first process can be directly ended.
[0160] Step S38, controlling the first process and the second process of the target application to move, and successfully starting the target application;
[0161] It should be understood that when the detection result of the above step S35 is no, after pre-starting the target application, if the electronic device determines within the preset time period that the first preview image newly acquired by the image acquirer within the preset time period has a first feature matching degree with the target user image that reaches the second matching threshold, then since the first process has been started at this time, the second process of the target application can be directly controlled to run, thereby successfully starting the target application.
[0162] Among them, in order to improve the reliability and stability of detection, the present application may also require that the detection result that the above-mentioned first feature matching degree reaches the second matching threshold can be maintained unchanged within the first time length, that is, the first feature matching degrees corresponding to the multiple first preview images collected within the first time length are all greater than the second matching threshold, in order to determine that the user identity authentication is passed, but this may query a certain waiting time and reduce customer experience. The present application can flexibly choose according to actual needs.
[0163] If the detection result of the above step S35 is yes, it can be directly determined that the identity authentication of the first user is passed, and the first process and the second process of the target application are directly controlled to run, and the target application is successfully started, that is, there is no need to pre-start the target application. Therefore, the specific implementation process of step S38 can be determined according to the situation.
[0164] Step S39, responding to the processing request and controlling the image collector to resume operation in the first working state;
[0165] After determining that the identity authentication of the first user is successful, the specific implementation process of executing step S39 can refer to the description of the corresponding part of the above embodiment, and this application will not elaborate on it here.
[0166] Step S310: outputting a first prompt message indicating that the identity authentication of the first user has failed and that starting of the target application is prohibited.
[0167] As analyzed above, no matter at which stage, after determining that the identity authentication of the first user fails, step S310 can be executed. The specific implementation process can refer to the description of the corresponding part of the above embodiment and will not be repeated here.
[0168] In summary, in the embodiments of the present application, in addition to being able to achieve the technical effects of the above embodiments, the present embodiment divides the startup process of the target application into a pre-startup phase and a core startup phase. In this way, during the identity authentication process, the first preview image collected and the first feature matching degree of the target user image are compared with the first matching threshold and the second matching threshold, respectively. When it is determined that the first feature matching degree reaches the first matching threshold but does not reach the second matching threshold, that is, the first identity authentication condition is met, the target application is pre-started, that is, the first process of the target application is controlled to run; after further detection and authentication, it is determined that the newly obtained first feature matching degree reaches the second matching threshold within the preset time length, and only the second process of the target application needs to be controlled to run, so that the target application can be successfully started and the response processing request can be responded. Compared with the traditional solution, the first process and the second process are controlled to run and the target application is started only after the identity authentication is determined to be passed. The target application pre-start method proposed in the present application shortens the waiting time for responding to the processing request after the user identity authentication is passed, and improves the user experience.
[0169] In combination with the application control method described in the above embodiment, in order to more clearly explain the implementation method of pre-starting the target application in the above description, the following will take the smart office scenario where the target application is a file safe and the first user needs to access the encrypted files in the file safe as an example to illustrate the execution process of the specific application scenario of the application control method, but it is not limited to the execution process described in this embodiment.
[0170] When the first user is located in front of the display screen of the electronic device and operates the file safe output by the electronic device and initiates an access request for the file safe, the image collector will send the collected first preview image to the processor of the electronic device, and the processor will obtain the first feature matching degree between the first preview image and the target user image. If only a part of the face or a part of the body of the first user is in the image preview frame at this time, the user identity feature extracted from the first preview image at this time is the facial feature or the body feature of this part, and it is often only possible to preliminarily predict whether the first user is the target user. If the first user is preliminarily predicted to be the target user, that is, the first feature matching degree meets the first identity authentication condition (reaches the first matching threshold but does not reach the second matching threshold), the first process of the file safe can be started, such as outputting the preset operation interface of the target application, specifically, the password authentication interface of the file safe can be output, or the operation interface of the file safe can be entered, and the first user can see the files contained in the file safe, etc. At this time, responding to the input operation for the preset operation interface will be prohibited, and further identity authentication is still required.
[0171] During the operation of the first process of the file safe, the user can continuously adjust the positional relationship between himself and the electronic device, such as sitting in front of the electronic device display screen in a marked posture and making the face completely present in the image preview frame, so that the first preview image collected by the image collector contains complete facial features. After that, feature matching detection can be continued in accordance with the face recognition method. When it is determined that the second identity authentication condition is met within a preset time (that is, the second matching threshold is reached), the first user is identified as the target user, and the second process of the file safe can be controlled to run, allowing the first user to access the file in the file safe, that is, to decrypt the file.
[0172] Among them, after the above authentication, the first feature matching degree detected within the preset time period has not always met the second identity authentication condition, and it is determined that the first user is not the target user, and the first process of the previously pre-started file safe will be completely exited, such as exiting the file safe operation interface.
[0173] It can be seen that compared with traditional face recognition applications, the user's entire face or most of the face must be located in the image preview frame and maintained for a period of time before reliable identity authentication can be obtained. For this user, even if the identity authentication is passed, it will feel that it takes a long time to start the target application, which is a poor experience. The application control method proposed in the embodiment of the present application uses a pre-start control method on the basis of ensuring the safe use of the file safe, which makes the target user feel that the file safe startup speed is accelerated.
[0174] In the application control method described in the above embodiments, the performance parameters of the image collector in each working state can be adjusted to make the image collector better meet the identity authentication requirements of the current application scenario. Figure 4 The flowchart of another optional example of the application control method proposed in the present application is shown. Regarding the implementation process of using the first preview image acquired by the image collector to authenticate the first user, control whether to start the target application, and respond to the processing request, you can refer to the description of the corresponding part of the above embodiment. This embodiment mainly describes the adjustment process of the performance parameters of the image collector under various working states. Figure 4 As shown, the method may include:
[0175] Step S41, performing identity authentication on the first user according to the second preview image acquired by the image collector in the first working state, and obtaining a second identity authentication result;
[0176] Combined with the above description of the two working states of the image collector, it can be seen that the image quality of the second preview image collected by the image collector in the first working state is relatively low, such as the clarity angle, and the frequency of collecting the second preview image may also be lower than the collection frequency in the first working state. Therefore, the reliability of the second identity authentication result obtained by authenticating the first user based on the second preview image may not be high, and it is usually not used as a criterion for whether to respond to the processing request.
[0177] The implementation process of how to authenticate the first user based on the second preview image and obtain the second authentication result is similar to the implementation process of how to authenticate the first user based on the first preview image and obtain the first authentication result. Please refer to the description of the corresponding part of the above embodiment, and this embodiment will not repeat it again.
[0178] Step S42, counting the consistency rate between the first identity authentication result and the second identity authentication result corresponding to the same processing request among multiple processing requests initiated for the target application;
[0179] Among them, the process of obtaining the first identity authentication result can be described according to the corresponding part of the above embodiment, and this embodiment will not elaborate on it.
[0180] The embodiment of the present application can determine whether the performance parameters corresponding to the two working states of the current image acquisition device are suitable for the current application scenario through two identity authentication results. Therefore, after obtaining the first identity authentication result and the second identity authentication result of each round of identity authentication (i.e., each processing request initiated) in the above manner, the first identity authentication result obtained in each round of identity authentication can be compared with the second identity authentication result to determine whether the first identity authentication result obtained this time is consistent with the second identity authentication result.
[0181] By performing statistics cyclically in the above manner, after a specific number of processing requests, the first identity authentication result is compared with the second identity authentication result, and the number of times the comparison results of the first identity authentication result and the second identity authentication result corresponding to each processing request are consistent, that is, the number of consistent times, can be obtained. The ratio between the number of consistent times and the total number of statistics is determined as the consistency rate of the first identity authentication result and the second identity authentication result corresponding to the same processing request, but it is not limited to this consistency rate calculation method.
[0182] Step S43, detecting whether the consistency rate is less than a first threshold, if yes, proceeding to step S44; if no, executing step S45;
[0183] Step S44, increasing the performance parameter of the image collector in the first working state;
[0184] The first threshold may be a critical value for determining whether to adjust a performance parameter of the image collector in the first working state, such as 60%. The present application does not limit the specific value of the first threshold, which may be determined according to actual application requirements.
[0185] In the embodiment of the present application, the performance parameters used to distinguish the working state of the image collector may include resolution and frame rate. After the above detection and judgment, if the above statistical consistency rate is less than the first threshold, it can be considered that the accuracy of the second identity authentication result obtained based on the second preview image is low, and there may be no basis for judging whether to respond to the processing request. Therefore, in this case, the present application can appropriately improve the performance parameters of the image collector in the first working state to improve the reliability and accuracy of the corresponding second identity authentication result. Specifically, the performance parameters can be adjusted according to the preset adjustment rules. The specific implementation process of step S44 is not described in detail in this application.
[0186] It should be noted that the increased performance parameters of the image acquirer in the first working state are still smaller than the corresponding performance parameters of the image acquirer in the second working state. In this way, the first operating power consumption of the image acquirer in the first working state is always smaller than the second operating power consumption in the second working state, thereby ensuring that the application control method described in the above embodiment still has the above technical effect.
[0187] Exemplarily, in the first performance parameter of the image collector in the first working state, the resolution can be 60x80 or other lower resolutions, and the frame rate can be 1fps or other lower frame rates, so that the second preview image contains less information; and in the second performance parameter of the image collector in the second working state, the resolution can be 640x480, 320x 240, etc., and the frame rate can be 30fps, etc., so that the first preview image can contain more accurate information to reliably realize the identity authentication of the first user. This application does not limit the specific content of the above-mentioned first performance parameter and second performance parameter, which can be determined according to the circumstances.
[0188] Step S45, maintaining the performance parameters of the image collector in the first working state unchanged.
[0189] After the above detection and judgment, if the above statistical consistency rate is not less than the first threshold, it can be considered that the accuracy of the second identity authentication result obtained based on the second preview image is sufficient to meet the requirements, and there is no need to adjust the performance parameters of the image collector in the first working state. Optionally, as needed, the performance parameters of the image collector in the first working state can also be adjusted to preset minimum performance parameters, but it is still required to meet the above consistency rate in the application. The condition is not less than the first threshold, so as to minimize the operating power consumption of the image collector in the first working state when the user identity authentication is not performed.
[0190] In summary, this embodiment authenticates the first user by comparing the corresponding preview images collected when the image acquirer is in different working states, and obtains the corresponding authentication results. When the consistency rate of the two authentication results for the same processing request is less than the first threshold, the performance parameters of the image acquirer in the first working state can be appropriately increased to ensure that the image quality of the second preview image collected in the first working state can meet the requirements, such as being able to reliably implement line of sight tracking detection, ensuring that the image acquirer runs at a lower operating power consumption most of the time, and ensuring the reliable execution of the above-mentioned application control method.
[0191] In the application of each application control method described in the above embodiments, during the identity authentication process of the first user, the first user's face may not be detected due to the inappropriate position of the first user and the image collector, the first user's large movement range, or the inability to detect the complete face of the first user, or the collected preview image is blurred, etc., which may cause the above-mentioned identity authentication of the first user based on the first preview image, and the first identity authentication result obtained is not passed. Therefore, in the above embodiments, the first identity authentication result being not passed may include but is not limited to the following methods:
[0192] The first preview image does not include a face image; the clarity of the face image included in the first preview image is less than a first clarity threshold (the value of which can be determined according to actual needs); the feature matching degree between the first preview image and the target user for the target application does not reach the first matching threshold (the subsequent processing steps in this case can refer to but are not limited to the description of the corresponding part above); the position change of the first preview image within the first time length is greater than the first change threshold (that is, the first user's movement amplitude is too large), the first time length can be determined based on the time length spent to obtain a frame of image, and the specific value is not limited; the position change of the first preview image within the first time length is greater than the first change threshold, and the position change of the latest first preview image obtained after the second time length within the first time length is still greater than the first change threshold, that is, the first user's movement amplitude is too large, and after a period of adjustment, the movement amplitude is still too large. For example, within 1 / 30 second, the face image exceeds the image preview frame by 1 cm, and after 1 second, the movement amplitude is still not less than 1 cm, etc., and the present application does not limit the specific values of the above-mentioned first change threshold, first time length, second time length and other parameters.
[0193] It should be noted that during the execution of the application control method, one or more combinations can be selected from the multiple implementation methods listed above in which the first identity authentication results are not passed to form a third identity authentication condition. In this way, when the first preview image is authenticated, the corresponding image features can be extracted to detect whether the third identity authentication condition is met to obtain the first identity authentication result. The above embodiment only describes the implementation method of whether the complete facial features are included, and does not describe the third identity authentication condition of other content. This application can determine the corresponding third identity authentication condition based on the needs of the application scenario, refer to the description of the corresponding part of the above embodiment, add it to the corresponding part, and complete the identity authentication of the first user. The specific implementation process is not described in detail in this application.
[0194] In some other embodiments proposed in the present application, based on the application control method described in combination with one or more of the above embodiments, the present application can also configure multiple identity authentication methods, which are not limited to the image authentication method described above, and can also include fingerprint authentication methods and password authentication methods, etc. At the same time, corresponding authentication priorities can be set for these multiple identity authentication methods. In this way, after the electronic device obtains the processing request, it can implement identity authentication of the first user according to the authentication priority.
[0195] Specifically, refer to Figure 5 A flowchart of another optional example of the application control method proposed in the present application is shown, and the method may include:
[0196] Step S51, obtaining a processing request initiated by a first user for a target application;
[0197] Step S52, controlling the electronic device to execute the first identity authentication method according to the preset authentication priorities of different identity authentication methods;
[0198] In this embodiment, different identity authentication methods include image authentication method, fingerprint authentication method and password authentication method. This application does not limit the authentication priority determination method and content of these multiple authentication methods. This embodiment takes the order of image authentication method, fingerprint authentication method and password authentication method as an example to determine the authentication priority from high to low. At this time, the first identity authentication method with the highest authentication priority can be the image authentication method. The implementation process of other methods is similar and will not be described in detail in this embodiment.
[0199] Step S53, if the first identity authentication method is an image authentication method, controlling the image collector to switch from the first working state to the second working state to perform image acquisition;
[0200] Step S54, performing identity authentication on the first user according to the first preview image acquired by the image collector in the second working state, and obtaining a first identity authentication result;
[0201] Step S55, if the first identity authentication result is failed, controlling the image collector to resume operation in the first working state;
[0202] Regarding the specific implementation process of steps S53 to S55, reference may be made to the description of the corresponding parts of the above embodiment, which will not be elaborated in this embodiment.
[0203] Step S56, performing identity authentication on the first user according to the identity authentication method corresponding to the next identity authentication priority, and obtaining a third identity authentication result;
[0204] In another optional example, when the first identity authentication result is failed, a first prompt message indicating that the identity authentication of the first user has failed may be directly output. The present application does not limit the output method and content of the first prompt message.
[0205] Following the example above, the identity authentication method corresponding to the next identity authentication priority can be a fingerprint authentication method. In this case, the electronic device can output a fingerprint authentication interface to remind the first user to place his finger on the display area corresponding to the fingerprint authentication interface to collect the fingerprint information to be authenticated by the first user. After that, the fingerprint information to be authenticated is compared with the fingerprint information of the target user to obtain a third identity authentication result. This application does not limit how to adopt the fingerprint authentication method or the method for implementing the identity authentication of the first user.
[0206] After the above fingerprint authentication, if the third identity authentication result is passed, the processing request can be responded to. The specific implementation process can refer to the description of the corresponding part of the above embodiment and will not be repeated.
[0207] Step S57, if the third identity authentication result is failed, continue to authenticate the first user in the identity authentication method corresponding to the next identity authentication priority until the identity authentication of the first user passes, and respond to the processing request.
[0208] In some embodiments, if the authentication still fails after fingerprint authentication, a second prompt message indicating that the identity authentication of the first user has failed may be output. The second prompt message is similar to the first prompt message and will not be described in detail in this embodiment.
[0209] Following the example above, the identity authentication method corresponding to the next identity authentication priority is the password authentication method. At this time, the password input result can be output for the first user to enter the password to be authenticated, so as to use the pre-stored target password to verify whether the password to be authenticated is correct. There is no limitation on the specific implementation process of how to authenticate the first user through the password authentication method.
[0210] After the above triple identity authentication, it is determined that the identity authentication of the first user is passed, and the processing request is responded to. The specific response process is not described in detail in this embodiment. After the above triple identity authentication, the identity authentication of the first user fails, that is, the identity authentication of the first user fails according to different identity authentication methods. A third prompt message indicating that the identity authentication of the first user fails can be output. This application does not limit the output method and content of the third prompt message. At the same time as the above prompt messages are output, for security reasons, the first user's request can also be sent to the preset terminal of the target user or the management user to make the target user or the management user aware of this situation. The specific implementation process is not described in detail in this embodiment.
[0211] In summary, this embodiment sets up multiple identity authentication methods to meet the needs of different application scenarios. When a specific identity authentication method is not suitable due to external factors, such as when the user's finger is injured and the correct fingerprint information of the user cannot be recognized, other identity authentication methods can be used to authenticate the first user to meet the first user's needs for using the electronic device. Compared with the traditional specific identity authentication method, the flexibility of user identity authentication is improved while ensuring the safety of the use of the electronic device.
[0212] In addition, it should be noted that in the application control method, it is not limited to the use of the triple authentication method as described above to achieve identity authentication of the first user. One or a combination of two of them can also be selected as needed. The specific implementation process will not be described in detail in this application.
[0213] Reference Figure 6 , is a schematic diagram of an optional example of the structure of the application control device proposed in this application, and the device may include:
[0214] A processing request obtaining module 61 is used to obtain a processing request initiated by a first user for a target application;
[0215] Optionally, the processing request obtaining module 61 may include:
[0216] A sight tracking detection unit, used for performing sight tracking detection on the second preview image acquired by the image acquisition device in the first working state, to obtain a sight tracking detection result;
[0217] A processing request generating unit is used to generate a processing request for a target application based on the gaze tracking detection result.
[0218] A first control module 62, used to control the image collector to switch from a first working state to a second working state to perform image acquisition;
[0219] A first identity authentication processing module 63, configured to perform identity authentication on the first user according to the first preview image acquired by the image collector in the second working state, and obtain a first identity authentication result;
[0220] Optionally, the first identity authentication processing module 63 may include:
[0221] A target user image calling unit, used to call a target user image for the target application;
[0222] a feature matching unit, configured to perform feature matching between the first preview image acquired by the image collector in the second working state and the target user image to obtain a first feature matching degree;
[0223] a pre-start unit, configured to control the first process of the target application to run so as to pre-start the target application when detecting that the first feature matching degree reaches a first matching threshold but does not reach a second matching threshold;
[0224] The target application startup unit is used to determine, during the process of controlling the operation of the first process, whether the first feature matching degree between the first preview image newly acquired by the image collector within a preset time period and the target user image reaches the second matching threshold, control the operation of the second process of the target application, and successfully start the target application.
[0225] In some other embodiments proposed in the present application, the first identity authentication processing module 63 may also include:
[0226] A complete facial feature detection unit, used to detect whether the first preview image acquired by the image collector in the second working state contains complete facial features;
[0227] an adjustment prompt information output unit, configured to output adjustment prompt information according to the facial feature category included in the first preview image when the detection result of the complete facial feature detection unit is that the complete facial feature is not included;
[0228] The adjustment prompt information is used to instruct the first user to adjust the relative position between the face and the image collector so that the collected first preview image can include complete facial features;
[0229] The first identity authentication unit is used to perform identity authentication on the first user according to the complete facial features included in the first preview image when the detection result of the complete facial feature detection unit is that the complete facial features are included, so as to obtain a first identity authentication result.
[0230] A processing request response module 64, configured to respond to the processing request if the first identity authentication result is passed;
[0231] Optionally, the processing request includes an access request and a configuration request, so the processing request response module 64 may include:
[0232] A first response unit, configured to respond to the access request and output access content of the target application;
[0233] The second response unit is used to respond to the configuration request and determine the configuration information for the target application in the electronic device.
[0234] A second control module 65, configured to control the image collector to resume operation in the first working state when the first identity authentication result is passed;
[0235] The first operating power consumption of the image collector in the first operating state is less than the second operating power consumption in the second operating state.
[0236] In some other embodiments proposed in the present application, the first determining means for determining that the first identity authentication result is failed may include at least one of the following determining units:
[0237] A first determining unit, used to determine that the first preview image does not contain a face image;
[0238] A second determining unit, configured to determine whether the clarity of the face image included in the first preview image is less than a first clarity threshold;
[0239] A third determining unit is used to determine that the feature matching degree between the first preview image and the target user for the target application does not reach a first matching threshold;
[0240] a fourth determining unit, configured to determine whether a position change of the first preview image within a first time period is greater than a first change threshold, wherein the first time period is determined based on a time period taken to acquire a frame of image;
[0241] The fifth determining unit is used to determine whether the position change of the first preview image within the first time period is greater than the first change threshold, and whether the latest first preview image obtained after the second time period is within the first time period.
[0242] In some other embodiments proposed in the present application, based on the application control device described in the above embodiments, such as Figure 7 As shown, the device may also include:
[0243] A second identity authentication processing module 66, configured to perform identity authentication on the first user according to the second preview image acquired by the image collector in the first working state, and obtain a second identity authentication result;
[0244] A statistics module 67, configured to count the consistency rate between the first identity authentication result and the second identity authentication result corresponding to the same processing request in multiple processing requests initiated for the target application;
[0245] A consistency rate detection module 68 is used to detect whether the consistency rate is less than a first threshold value. If the consistency rate is not less than the first threshold value, the performance parameters of the image collector in the first working state are maintained unchanged; or the performance parameters of the image collector in the first working state are adjusted to preset minimum performance parameters;
[0246] The performance parameter adjustment module 69 is used to increase the performance parameter of the image collector in the first working state when the detection result of the consistency rate detection module 68 is that the consistency rate is less than the first threshold.
[0247] The performance parameters include resolution and frame rate, and the increased performance parameters of the image collector in the first working state are smaller than the corresponding performance parameters of the image collector in the second working state.
[0248] In some other embodiments proposed in this application, the above device may further include:
[0249] A first identity authentication method determination module, configured to control the electronic device to execute a first identity authentication method according to the preset authentication priorities of different identity authentication methods, and if the first identity authentication method is the image authentication method, trigger the first control module to control the image collector to switch from the first working state to the second working state for image acquisition;
[0250] Among them, different identity authentication methods include image authentication method, fingerprint authentication method and password authentication method.
[0251] A first information output module, configured to output first prompt information indicating that the identity authentication of the first user has failed when the first identity authentication result is a failure;
[0252] A third identity authentication processing module is used to, if the first identity authentication result is a failure, perform identity authentication on the first user according to the identity authentication method corresponding to the next identity authentication priority to obtain a third identity authentication result, and if the third identity authentication result is a pass, trigger the processing request response module to respond to the processing request;
[0253] A second information output module is used to output second prompt information of identity authentication failure for the first user when the third identity authentication result is failure;
[0254] a fourth identity authentication processing module, configured to, if the third identity authentication result is a failure, continue to authenticate the first user in accordance with the identity authentication method corresponding to the next identity authentication priority until the identity authentication of the first user passes, thereby triggering the processing request response module to respond to the processing request;
[0255] A third information output module is configured to output third prompt information indicating that the identity authentication of the first user fails when the identity authentication of the first user fails in the different identity authentication methods.
[0256] It should be noted that the various modules, units, etc. in the above-mentioned device embodiments can be stored in the memory as program modules, and the processor executes the above-mentioned program modules stored in the memory to implement the corresponding functions. For the functions implemented by each program module and its combination, as well as the technical effects achieved, please refer to the description of the corresponding parts of the above-mentioned method embodiments, which will not be repeated in this embodiment.
[0257] The present application also provides a storage medium on which a computer program can be stored. The computer program can be called and loaded by a processor to implement the various steps of the application control method described in the above embodiment.
[0258] Reference Figure 8 , is a hardware structure diagram of an electronic device embodiment applicable to the application control method and device proposed in this application. This application does not limit the product form of the electronic device, which can be determined according to the needs of the application scenario, such as Figure 8 As shown, the electronic device may include: a display 81, at least one memory 82 and at least one processor 83, wherein:
[0259] The display 81, the memory 82, and the processor 83 may be connected to each other via a communication bus. The present application does not limit the specific connection method of these parts, and the data communication implementation process between them.
[0260] The memory 82 is used to store the first program for implementing the above-mentioned application control method and the second program for supporting the operation of the target application; the processor 83 can load and execute the first program stored in the memory 82 to implement the various steps of the application control method proposed in any optional embodiment of the present application, and execute the second program to implement the operation of the target application. The specific implementation process can refer to the description of the corresponding part of the corresponding embodiment below.
[0261] In the embodiment of the present application, the memory 82 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device or other volatile solid-state storage device. The processor 83 may be a central processing unit (CPU), an application-specific integrated circuit (ASIC), a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices.
[0262] In one possible implementation, the memory 82 may include a program storage area and a data storage area. The program storage area may store an operating system, an application program required for at least one function (such as an information display function), a program for implementing the application control method proposed in the present application, etc.; the data storage area may store data generated during the use of the electronic device.
[0263] It should be understood that Figure 8 The structure of the electronic device shown does not constitute a limitation on the electronic device in the embodiment of the present application. In practical applications, the electronic device may include Figure 8 More or fewer components as shown, or a combination of certain components, such as a touch sensing unit for sensing touch events on a touch display panel, at least one input device such as a keyboard, a mouse, a camera, a microphone, etc.; at least one output device such as a display, a speaker, a vibration mechanism, a lamp, and various communication interfaces, power management models, antennas, etc., are not listed one by one in this application.
[0264] Finally, it should be noted that the various embodiments in this specification are described in a progressive or parallel manner, and each embodiment focuses on the differences from other embodiments, and the same or similar parts between the various embodiments can be referred to each other. For the devices and electronic devices disclosed in the embodiments, since they correspond to the methods disclosed in the embodiments, the description is relatively simple, and the relevant parts can be referred to the method part description.
[0265] The above description of the disclosed embodiments enables those skilled in the art to implement or use the present application. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application will not be limited to the embodiments shown herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.
Claims
1. An application control method, the method comprising: Obtaining a processing request initiated by a first user for a target application, and controlling the image collector to switch from a first working state to a second working state to perform image acquisition; Performing identity authentication on the first user based on the first preview image acquired by the image acquirer in the second working state to obtain a first identity authentication result; If the first identity authentication result is passed, respond to the processing request and control the image collector to resume operation in the first working state; Wherein, the first operating power consumption of the image collector in the first working state is less than the second operating power consumption in the second working state; The step of performing identity authentication on the first user based on the first preview image acquired by the image acquirer in the second working state to obtain a first identity authentication result, and responding to the processing request if the first identity authentication result is passed, includes: Calling a target user image for the target application; Performing feature matching on the first preview image acquired by the image acquirer in the second working state and the target user image to obtain a first feature matching degree; When detecting that the first feature matching degree satisfies a first identity authentication condition, determining to pre-start the target application; After determining to pre-start the target application, detecting a second identity authentication condition based on the first feature matching degree, and fully starting the target application if it is determined that the first feature matching degree satisfies the second identity authentication condition; The first identity authentication condition and the second identity authentication condition each correspond to a feature matching degree of a different magnitude.
2. According to the method of claim 1, obtaining the processing request initiated by the first user for the target application comprises: Performing a sight tracking detection on the second preview image acquired by the image acquisition device in the first working state to obtain a sight tracking detection result; Based on the gaze tracking detection result, a processing request for a target application is generated.
3. The method according to claim 2, further comprising: Performing identity authentication on the first user based on the second preview image acquired by the image acquirer in the first working state to obtain a second identity authentication result; Counting the consistency rate between the first identity authentication result and the second identity authentication result corresponding to the same processing request among multiple processing requests initiated for the target application; If the consistency rate is less than a first threshold, increasing the performance parameters of the image collector in the first working state; wherein the performance parameters include resolution and frame rate, and the increased performance parameters of the image collector in the first working state are less than the corresponding performance parameters of the image collector in the second working state; If the consistency rate is not less than the first threshold, the performance parameters of the image collector in the first working state are maintained unchanged; or, the performance parameters of the image collector in the first working state are adjusted to preset minimum performance parameters.
4. The method according to any one of claims 1 to 3, wherein the processing request comprises an access request and a configuration request, wherein: If the processing request is the access request, the responding to the processing request includes: In response to the access request, output access content of the target application; If the processing request is the configuration request, the responding to the processing request includes: In response to the configuration request, configuration information for the target application is determined in the electronic device.
5. According to the method according to any one of claims 1 to 3, when the detection of the first feature matching degree meets the first identity authentication condition, determining to pre-start the target application; After determining to pre-start the target application, detecting a second identity authentication condition based on the first feature matching degree, and fully starting the target application when determining that the first feature matching degree satisfies the second identity authentication condition, includes: When detecting that the first feature matching degree reaches a first matching threshold but does not reach a second matching threshold, controlling the first process of the target application to run so as to pre-start the target application; In the process of controlling the operation of the first process, it is determined that the first feature matching degree between the first preview image newly acquired by the image collector within a preset time period and the target user image reaches the second matching threshold, the second process of the target application is controlled to run, the target application is successfully started, and the processing request is responded to.
6. The method according to any one of claims 1 to 3, wherein the step of performing identity authentication on the first user based on the first preview image acquired by the image collector in the second working state to obtain a first identity authentication result comprises: Detecting whether the first preview image acquired by the image collector in the second working state contains complete facial features; If the complete facial features are not included, outputting adjustment prompt information according to the facial feature category included in the first preview image, wherein the adjustment prompt information is used to instruct the first user to adjust the relative position between the face and the image collector so that the collected first preview image can include the complete facial features; If the complete facial features are included, the first user is authenticated based on the complete facial features included in the first preview image to obtain a first identity authentication result.
7. The method according to any one of claims 1 to 3, wherein the first identity authentication result is failure, including at least one of the following implementation methods: The first preview image does not include a face image; The clarity of the face image included in the first preview image is less than a first clarity threshold; The feature matching degree between the first preview image and the target user for the target application does not reach a first matching threshold; The position change amount of the first preview image within a first time period is greater than a first change threshold, and the first time period is determined based on the time period taken to acquire a frame of image; The position change amount of the first preview image within the first time period is greater than the first change threshold, and the position change amount of the latest first preview image obtained after the second time period within the first time period is still greater than the first change threshold.
8. The method according to any one of claims 1 to 3, after obtaining the processing request initiated by the first user for the target application, the method further comprises: According to the preset authentication priorities of different identity authentication methods, controlling the electronic device to execute a first identity authentication method, wherein the different identity authentication methods include an image authentication method, a fingerprint authentication method, and a password authentication method; If the first identity authentication method is the image authentication method, executing the step of controlling the image collector to switch from the first working state to the second working state to perform image acquisition; If the first identity authentication result is failed, outputting first prompt information about the identity authentication failure of the first user; Alternatively, the first user is authenticated according to the authentication method corresponding to the next authentication priority to obtain a third authentication result; If the third identity authentication result is passed, executing the step of responding to the processing request; If the third identity authentication result is failed, outputting a second prompt message indicating that the identity authentication of the first user has failed; or Continue to authenticate the first user according to the identity authentication method corresponding to the next identity authentication priority until the identity authentication of the first user is successful, and execute the step of responding to the processing request; or the identity authentication of the first user fails according to the different identity authentication methods, and output a third prompt information indicating that the identity authentication of the first user has failed.
9. An application control device, comprising: A processing request obtaining module, used to obtain a processing request initiated by a first user for a target application; A first control module, used for controlling the image collector to switch from a first working state to a second working state to perform image acquisition; A first identity authentication processing module, configured to perform identity authentication on the first user based on the first preview image acquired by the image acquirer in the second working state, and obtain a first identity authentication result; A processing request response module, used for responding to the processing request when the first identity authentication result is passed; A second control module, configured to control the image collector to resume operation in the first working state when the first identity authentication result is passed; Wherein, the first operating power consumption of the image collector in the first working state is less than the second operating power consumption in the second working state; The first identity authentication processing module includes: A target user image calling unit, used to call a target user image for the target application; a feature matching unit, configured to perform feature matching between the first preview image acquired by the image collector in the second working state and the target user image to obtain a first feature matching degree; A pre-start unit, configured to determine to pre-start the target application when detecting that the first feature matching degree satisfies a first identity authentication condition; A target application startup unit is used to detect a second identity authentication condition based on the first feature matching degree after determining to pre-start the target application, and fully start the target application when it is determined that the first feature matching degree meets the second identity authentication condition; the first identity authentication condition and the second identity authentication condition each correspond to a feature matching degree of different sizes.
10. An electronic device, comprising: monitor; A memory, used to store a first program for implementing the application control method according to any one of claims 1 to 8, and a second program for supporting the operation of a target application; A processor is used to load and execute the first program stored in the memory to implement each step of the application control method according to any one of claims 1 to 8.
Citation Information
Patent Citations
Image sensing system and method as well as eyeball tracking system and method
CN104580943A
Automatic retries for facial recognition
CN110555359A
System for gaze interaction
WO2018156912A1