Login Verification Method, Device, Electronic Device and Storage Medium for Application

Abstract

The present application provides a login verification method, device, electronic device and storage medium for an application program; the method includes: performing a collection operation on a first type of biometric feature to obtain a first collection result; in response to the first collection result including a first biometric feature and the first biometric feature having a binding relationship with a first account, displaying an application interface in a logged-in state, where the logged-in state is a state of logging in to the application program based on the first account; performing a collection operation on a second type of biometric feature to obtain a second collection result, where the second type is different from the first type; and controlling the logged-in state of the application interface based on the second collection result. Through the present application, it is possible to ensure the use security in an application program with a logged-in state.

Description

Technical Field

[0001] This application relates to the field of information security technology, and in particular, to a login verification method, device, electronic device, and storage medium for an application program. Background Art

[0002] Applying biometrics to the electronic payment scenario in an application program can improve the convenience of payment, but at the same time, it faces security risks.

[0003] Taking palm brushing payment as an example, in a scenario with a login state, for example, after a user brushes their palm to log in, the login state-related information will be temporarily cached in the palm brushing payment terminal. Assuming the user does not log out normally, or leaves briefly without being in front of the screen, it is easy for the device with the user's login state to be maliciously used by others, resulting in security-related problems. Summary of the Invention

[0004] Embodiments of this application provide a login verification method, device, electronic device, computer-readable storage medium, and computer program product for an application program, which can ensure the security of use in an application program with a login state.

[0005] The technical solution of the embodiments of this application is implemented as follows:

[0006] Embodiments of this application provide a login verification method for an application program, including:

[0007] Performing a collection operation on a first type of biometric to obtain a first collection result;

[0008] In response to the first collection result including a first biometric, and the first biometric having a binding relationship with a first account, displaying an application interface in a logged-in state, where the logged-in state is a state of logging in to the application program based on the first account;

[0009] Performing a collection operation on a second type of biometric to obtain a second collection result, where the second type is different from the first type;

[0010] Based on the second collection result, controlling the logged-in state of the application interface.

[0011] In the above solution, the application interface is an interface in the application program that involves private information.

[0012] Embodiments of this application provide a login verification device for an application program, including:

[0013] A collection module, configured to perform a collection operation on a first type of biometric to obtain a first collection result;

[0014] A display module, configured to display an application interface in a logged-in state in response to the first acquisition result including a first biometric feature and the first biometric feature being bound to a first account, where the logged-in state is a state of logging in to an application program based on the first account;

[0015] The acquisition module is further configured to perform an acquisition operation of a second type of biometric feature to obtain a second acquisition result, where the second type is different from the first type;

[0016] A control module, configured to control the logged-in state of the application interface based on the second acquisition result.

[0017] In the above solution, the control module is further configured to control the application interface to maintain the logged-in state in response to the second acquisition result including a second biometric feature and the second biometric feature being bound to the first account.

[0018] In the above solution, the control module is further configured to switch the application interface from the logged-in state to a non-logged-in state in response to the second acquisition result including a second biometric feature and the second biometric feature not being bound to the first account, where the non-logged-in state is a state of not logging in to the application program based on the first account.

[0019] In the above solution, the display module is further configured to display a prompt message in response to the second acquisition result including a second biometric feature and the second biometric feature not being bound to the first account, where the prompt message is used to prompt that verification based on the first type of biometric feature is required; the acquisition module is further configured to perform the acquisition operation of the first type of biometric feature again to obtain a third acquisition result; the control module is further configured to determine that the verification fails and switch the application interface from the logged-in state to the non-logged-in state in response to the third acquisition result not including the first biometric feature.

[0020] In the above solution, the control module is further configured to determine that the verification passes and control the application interface to maintain the logged-in state in response to the third acquisition result including the first biometric feature.

[0021] In the above solution, the display module is further configured to display a graphic code; the login verification device of the application program further includes an adjustment module, configured to receive configuration information sent by a second electronic device after scanning the graphic code; and perform one of the following processes based on the configuration information: adjust the frequency of performing the acquisition operation of the second type of biometric feature; display the time interval from the current moment to the next execution of the acquisition operation of the second type of biometric feature; restore the frequency of performing the acquisition operation of the second type of biometric feature to the default frequency.

[0022] In the above solution, the control module is further configured to abort the business process in the application interface in response to the graphic code being scanned; and to resume the business process in the application interface in response to receiving the configuration information sent by the second electronic device.

[0023] In the above solution, the graphic code includes the identifier of the first electronic device, and is used for the second electronic device to perform the following processing: based on the identifier, display a setting interface corresponding to the first electronic device, where the setting interface includes a sensitivity setting control; in response to a trigger operation on the sensitivity setting control, display a sensitivity setting interface, where the sensitivity setting interface includes at least one of the following controls: an interval time control for adjusting the frequency of the first electronic device to perform the acquisition operation of the second type of biometric feature; a visualization control for displaying, in the first electronic device, the time interval from the current moment to the next execution of the acquisition operation of the second type of biometric feature; and a restore default configuration control for restoring the frequency of the first electronic device to perform the acquisition operation of the second type of biometric feature to the default frequency.

[0024] In the above solution, the login verification device of the application further includes an acquisition module, configured to acquire a first distance and a second distance before the control module controls the login state of the application interface based on the second acquisition result, where the first distance is the distance between the organism corresponding to the first biometric feature and the first electronic device, and the second distance is the distance between the organism corresponding to the second biometric feature and the first electronic device; the acquisition module is further configured to, in response to the difference between the second distance and the first distance being greater than a difference threshold, re-perform the acquisition operation of the second type of biometric feature.

[0025] In the above solution, the login verification device of the application further includes a determination module, configured to determine to perform the acquisition operation of the second type of biometric feature in response to the biometric protection function in the second electronic device being in an enabled state, where the biometric protection function is used to control the login state of the application interface based on the second type of biometric feature.

[0026] In the above solution, the control module is further configured to switch the application interface from the login state to the non-login state in response to the second acquisition result not including the second biometric feature, where the non-login state is the state of not logging in to the application based on the first account.

[0027] In the above solution, the determination module is further configured to determine the similarity between the first biometric feature and multiple authorized biometric features of the first type; in response to the maximum similarity being greater than the similarity threshold, query the account bound to the authorized biometric feature corresponding to the maximum similarity as the first account.

[0028] In the above solution, the acquisition module is further configured to perform one of the following processes: periodically perform the acquisition operation of the biometric feature of the second type; in response to the non-operation duration being greater than the duration threshold, perform the acquisition operation of the biometric feature of the second type; in response to a sensitive operation being performed in the application interface, perform the acquisition operation of the biometric feature of the second type.

[0029] In the above solution, the acquisition module is further configured to perform one of the following processes: in response to a trigger operation on the login entry in the first electronic device, perform the acquisition operation of the biometric feature of the first type; periodically perform the acquisition operation of the biometric feature of the first type; in response to the first electronic device entering the lit screen state from the screen-off state, perform the acquisition operation of the biometric feature of the first type; in response to detecting a living body and the distance between the living body and the first electronic device being less than the distance threshold, perform the acquisition operation of the biometric feature of the first type.

[0030] In the above solution, the control module is further configured to control the application interface to be in a silent mode, where the silent mode is used to block the output of prompts related to the acquisition operation of the biometric feature of the second type; the acquisition module is further configured to perform the acquisition operation of the biometric feature of the second type based on the silent mode.

[0031] In the above solution, the first account is the account associated with the first living body, and the acquisition module is further configured to pre-acquire the biometric feature of the first type and the biometric feature of the second type of the first living body; the login verification device of the application further includes a binding module for binding the biometric feature of the first type and the biometric feature of the second type of the first living body to the first account.

[0032] In the above solution, the first biometric feature is one of a palmprint feature and a face feature, and the second biometric feature is the other of a palmprint feature and a face feature.

[0033] In the above solution, the application interface is the interface in the application that involves privacy information.

[0034] An embodiment of the present application provides an electronic device, including:

[0035] A memory for storing computer-executable instructions or computer programs;

[0036] A processor, when executing computer-executable instructions or computer programs stored in the memory, implements the login verification method of the application program provided by the embodiments of the present application.

[0037] The embodiments of the present application provide a computer-readable storage medium storing computer-executable instructions or computer programs, which, when executed by a processor, implement the login verification method of the application program provided by the embodiments of the present application.

[0038] The embodiments of the present application provide a computer program product including a computer program or computer-executable instructions, which, when executed by a processor, implement the login verification method of the application program provided by the embodiments of the present application.

[0039] The embodiments of the present application have the following beneficial effects:

[0040] After logging in to the application program based on the first account bound to the first biometric feature, continue to perform the collection operation of the second type of biometric feature, and based on the second collection result, control the login state of the application interface. In this way, after logging in to the application program based on one type of biometric feature, another type of biometric feature is used for auxiliary verification, and the verification channels are more comprehensive, which can effectively prevent the user information from being maliciously used or leaked by others, thus ensuring the security of the information after the user logs in to the application program. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] Figure 1 is a schematic structural diagram of the login verification system 100 of the application program provided by the embodiments of the present application;

[0042] Figure 2 is a schematic structural diagram of the electronic device 500 provided by the embodiments of the present application;

[0043] Figure 3 is a schematic flowchart of the login verification method of the application program provided by the embodiments of the present application;

[0044] Figure 4 is a schematic flowchart of the login verification method of the application program provided by the embodiments of the present application;

[0045] Figure 5 is a schematic flowchart of the login verification method of the application program provided by the embodiments of the present application;

[0046] Figure 6 is a schematic diagram of the application scenario of the login verification method of the application program provided by the embodiments of the present application;

[0047] Figure 7 is a schematic diagram of the principle of the registration and use process provided by the embodiments of the present application;

[0048] Figure 8It is a schematic diagram of the overall architecture of the login verification method for the application provided by the embodiments of the present application;

[0049] Figure 9 It is a schematic flowchart of the login verification method for the application provided by the embodiments of the present application;

[0050] Figure 10 It is a schematic diagram of the application scenario of the login verification method for the application provided by the embodiments of the present application. Detailed implementation manners

[0051] In order to make the objectives, technical solutions and advantages of the present application clearer, the present application will be further described in detail below with reference to the accompanying drawings. The described embodiments should not be construed as limitations on the present application. All other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the scope of protection of the present application.

[0052] In the following description, reference is made to "some embodiments", which describe a subset of all possible embodiments. However, it can be understood that "some embodiments" can be the same subset or different subsets of all possible embodiments, and can be combined with each other without conflict.

[0053] It can be understood that in the embodiments of the present application, when it comes to relevant data such as user information (such as biometric data of the user's palmprint, face, etc.), when the embodiments of the present application are applied to specific products or technologies, user permission or consent needs to be obtained, and the collection, use and processing of relevant data need to comply with relevant laws, regulations and standards of relevant countries and regions.

[0054] In the following description, the terms "first\second\..." are only used to distinguish similar objects and do not represent a specific order for the objects. It can be understood that "first\second\..." can be interchanged with a specific order or sequence when permitted, so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein.

[0055] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by those of ordinary skill in the technical field to which this application belongs. The terms used herein are only for the purpose of describing the embodiments of the present application and are not intended to limit the present application.

[0056] Before further elaborating on the embodiments of the present application, the nouns and terms involved in the embodiments of the present application are described. The nouns and terms involved in the embodiments of the present application are subject to the following explanations.

[0057] 1) Responsive to: Used to represent the conditions or states upon which the executed operations depend. When the dependent conditions or states are met, one or more of the executed operations can be real-time or can have a set delay; without special instructions, there is no restriction on the execution order of multiple executed operations.

[0058] 2) Biometric: That is, the unique physiological characteristics or behavioral patterns of each organism that can be measured, or automatically identified and verified. Biometrics can be classified into physiological characteristics (such as fingerprints, faces, irises, palm prints, etc.) and behavioral characteristics (such as gait, voice, handwriting, etc.).

[0059] 3) Biometric identification: Refers to the technology of using the inherent physiological characteristics or behavioral characteristics of an organism by a computer for personal identity verification, including palm recognition, face recognition, fingerprint recognition, retina recognition, etc. Among them, palm recognition is a technology that exchanges identity information through palm multimedia information. For example, it can be recognized by measuring the physical characteristics of the palm and fingers of an organism; face recognition is a technology that exchanges identity information through face multimedia information, and face recognition includes facial recognition and facial authentication.

[0060] 4) Graphic code: A graphic carrying information, including barcodes and two-dimensional codes. Among them, a barcode is a graphic identifier that arranges multiple black bars and blanks of unequal widths according to a certain coding rule to express a set of information. A common barcode is a parallel line pattern composed of black bars (referred to as bars for short) and white bars (referred to as spaces for short) with a large difference in reflectivity. A two-dimensional code, also known as a QR code, is a black and white graphic that is distributed in a plane (i.e., in two dimensions) according to a certain rule using a specific geometric figure and records data symbol information; in code compilation, it cleverly uses the concept of the "0" and "1" bit streams of the internal logic basis of a computer, uses several geometric shapes corresponding to binary to represent alphanumeric information, and is automatically read by an image input device or an optoelectronic scanning device to achieve automatic information processing.

[0061] 5) Operating habit: Refers to the operating method that a user has developed over time during the process of using an application program, such as click habit, swipe habit, press habit, etc. Among them, the click habit can be the average number of clicks of a user within a set time period (such as 2 minutes); the swipe habit can be at least one of the average swipe distance and swipe speed when a user performs multiple swipe operations; the press habit can be the average touch pressure area when a user performs a press operation, that is, the average contact area between the finger and the screen when a user performs multiple press operations.

[0062] The embodiments of the present application provide a login verification method, device, electronic device, computer-readable storage medium, and computer program product for an application, which can ensure the usage security in an application with a login state. The electronic device provided by the embodiments of the present application will be described below. To distinguish it from the second electronic device used to scan the graphic code, the electronic device to which the login verification method of the application provided by the embodiments of the present application is applied is called the first electronic device. That is to say, the login verification method of the application provided by the embodiments of the present application is applied to the first electronic device. The first electronic device provided by the embodiments of the present application can be implemented as a terminal device, or can be jointly implemented by a server and a terminal device. The following takes the example of jointly implementing the login verification method of the application provided by the embodiments of the present application by a terminal device and a server for illustration.

[0063] Exemplarily, referring to Figure 1 , Figure 1 is a schematic diagram of the architecture of the login verification system 100 of the application provided by the embodiments of the present application. To support applications that ensure usage security in an application with a login state, such as Figure 1 As shown, the login verification system 100 of the application includes: a server 200, a network 300, and a terminal device 400. Among them, the network 300 can be a local area network or a wide area network, or a combination of the two. An application 410 is running on the terminal device 400. The application 410 can be various types of applications. For example, when the terminal device 400 is a payment terminal, the application 410 can be a payment application; when the terminal device 400 is a mobile phone or a tablet computer, the application 410 can be an email application or a shopping application, etc.

[0064] In some embodiments, taking the payment scenario as an example, the terminal device 400 (such as a payment terminal) can perform an operation of collecting the first type of biometric feature (such as a palmprint feature) to obtain a first collection result. Then, the terminal device 400 can send the first collection result to the server 200 through the network 300 for the server 200 to make a judgment. For example, when the server 200 determines that the first collection result includes the first biometric feature and the first biometric feature has a binding relationship with the first account, the server 200 can return the first account to the terminal device 400 so that the terminal device 400 can log in to the application 410 based on the first account. Subsequently, the terminal device 400 can also perform an operation of collecting the second type of biometric feature (such as a face feature) to obtain a second collection result, and control the login state of the application interface based on the second collection result. For example, when the second collection result does not include the second biometric feature, the terminal device 400 can control the application interface to switch from the login state to the non-login state; when the second collection result includes the second biometric feature and the second biometric feature has a binding relationship with the first account, the terminal device 400 can control the application interface to remain in the login state.

[0065] It should be noted that the above application program 410 may be a native program or software module in the operating system; it may be a local application (APP), that is, a program that needs to be installed in the operating system to run, such as a payment APP or an email APP, etc.; it may also be a mini-program, that is, a program that only needs to be downloaded to the browser environment to run. The embodiments of the present application do not make specific limitations on this.

[0066] In some other embodiments, the embodiments of the present application can also be implemented by means of cloud technology. Cloud technology refers to a hosting technology that unifies a series of resources such as hardware, software, and networks within a wide area network or a local area network to achieve data calculation, storage, processing, and sharing.

[0067] Cloud technology is a general term for network technology, information technology, integration technology, management platform technology, and application technology based on the cloud computing business model. It can form a resource pool, be used on demand, and is flexible and convenient. Cloud computing technology will become an important support. The background services of the technical network system require a large amount of computing and storage resources.

[0068] By way of example, Figure 1 the server 200 in can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers. It can also be a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery network (CDN), and big data and artificial intelligence platforms. The terminal device 400 can be a smart phone, a tablet computer, a laptop computer, a desktop computer, a smart speaker, a smart watch, a vehicle-mounted terminal, a payment terminal (such as including a palm-sweeping payment terminal, a face-sweeping payment terminal, etc.), etc., but is not limited thereto. The terminal device 400 and the server 200 can be directly or indirectly connected through wired or wireless communication methods, and the embodiments of the present application do not make restrictions on this.

[0069] Next, the structure of the first electronic device provided by the embodiments of the present application will be further described. Taking the first electronic device as the terminal device as an example, refer to Figure 2 , Figure 2 which is a schematic structural diagram of the first electronic device 500 provided by the embodiments of the present application, Figure 2The first electronic device 500 shown includes: at least one processor 510, a memory 550, at least one network interface 520 and a user interface 530. The various components in the first electronic device 500 are coupled together via a bus system 540. It is understood that the bus system 540 is used to achieve connection and communication between these components. In addition to the data bus, the bus system 540 also includes a power bus, a control bus and a status signal bus. However, for the sake of clarity, the bus system 540 is not described in detail. Figure 2 Various buses are labeled as bus system 540 .

[0070] The processor 510 can be an integrated circuit chip with signal processing capabilities, such as a general-purpose processor, a digital signal processor (DSP), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc., where the general-purpose processor can be a microprocessor or any conventional processor, etc.

[0071] The user interface 530 includes one or more output devices 531 that enable presentation of media content, including one or more speakers and / or one or more visual display screens. The user interface 530 also includes one or more input devices 532, including user interface components that facilitate user input, such as a keyboard, mouse, microphone, touch screen display, camera, other input buttons and controls.

[0072] The memory 550 may be removable, non-removable, or a combination thereof. Exemplary hardware devices include solid-state memory, hard disk drives, optical disk drives, etc. The memory 550 may optionally include one or more storage devices that are physically remote from the processor 510.

[0073] The memory 550 includes a volatile memory or a non-volatile memory, and may also include both volatile and non-volatile memories. The non-volatile memory may be a read-only memory (ROM), and the volatile memory may be a random access memory (RAM). The memory 550 described in the embodiments of the present application is intended to include any suitable type of memory.

[0074] In some embodiments, the memory 550 can store data to support various operations, examples of which include programs, modules, and data structures, or a subset or superset thereof, as exemplarily described below.

[0075] Operating system 551, including system programs for processing various basic system services and performing hardware-related tasks, such as framework layer, core library layer, driver layer, etc., for implementing various basic services and processing hardware-based tasks;

[0076] A network communication module 552 for reaching other computing devices via one or more (wired or wireless) network interfaces 520. Exemplary network interfaces 520 include: Bluetooth, Wireless Fidelity (WiFi), and Universal Serial Bus (USB), etc.;

[0077] A presentation module 553 for enabling the presentation of information (e.g., a user interface for operating peripheral devices and displaying content and information) via one or more output devices 531 associated with the user interface 530 (such as a display screen, a speaker, etc.);

[0078] An input processing module 554 for detecting and translating one or more user inputs or interactions from one of one or more input devices 532.

[0079] In some embodiments, the device provided by the embodiments of the present application can be implemented in software. Figure 2 Shows a login verification device 555 of an application program stored in the memory 550, which can be software in the form of a program and a plug-in, etc., including the following software modules: a collection module 5551, a display module 5552, a control module 5553, an adjustment module 5554, an acquisition module 5555, a determination module 5556, and a binding module 5557. These modules are logical, so they can be combined arbitrarily or further split according to the functions implemented. It should be noted that, Figure 2 For the convenience of expression, all the above modules are shown at once, but it should not be considered that the login verification device 555 of the application program excludes the implementation that may only include the collection module 5551, the display module 5552, and the control module 5553. The functions of each module will be described below.

[0080] Next, the login verification method of the application program provided by the embodiments of the present application will be specifically described in combination with the exemplary applications and implementations of the first electronic device provided by the embodiments of the present application.

[0081] See Figure 3 , Figure 3 is a flowchart of the login verification method of the application program provided by the embodiments of the present application, which will be described in combination with the steps shown in Figure 3 .

[0082] In step 101, a collection operation of the first type of biometric feature is performed to obtain a first collection result.

[0083] In some embodiments, a login entry may be displayed in the human-computer interaction interface of the first electronic device. Then, step 101 may be implemented in the following manner: in response to a trigger operation on the login entry, perform a collection operation of the first type of biometric feature to obtain a first collection result.

[0084] Exemplarily, taking the first electronic device as a payment terminal and the first type of biometric feature as a palmprint feature as an example, a login entry may be displayed on the screen (i.e., the human-computer interaction interface) of the payment terminal. When receiving a click operation from the user on the login entry, the payment terminal may call the built-in (or external) camera to perform a collection operation of the palmprint feature to obtain a first collection result. For example, when receiving a click operation from the user on the login entry, the payment terminal may control the camera in the palmprint recognition area to change from the off state to the on state to perform a collection operation of the palmprint feature. For example, the camera in the palmprint recognition area will collect the environment above the palmprint recognition area to obtain a first collection result.

[0085] In some other embodiments, the first electronic device may also periodically perform a collection operation of the first type of biometric feature. For example, taking the first electronic device as a mobile phone and the first type of biometric feature as a palmprint feature as an example, before the user logs in to the application by swiping the palm, the mobile phone may periodically perform a collection operation of the palmprint feature, such as performing a collection operation of the palmprint feature every 10 seconds.

[0086] In some embodiments, the first electronic device may also implement the above step 101 in the following manner: in response to the first electronic device changing from the screen-off state to the screen-on state, perform a collection operation of the first type of biometric feature to obtain a first collection result.

[0087] Exemplarily, taking the first electronic device as a payment terminal and the first type of biometric feature as a palmprint feature as an example, when the user clicks on the screen of the payment terminal in the screen-off state, the payment terminal will change from the screen-off state to the screen-on state and control the camera in the palmprint recognition area to change from the off state to the on state to perform a collection operation of the palmprint feature. In this way, the collection operation of the palmprint feature is only performed when the payment terminal is in the screen-on state, which can effectively reduce the resource consumption of the payment terminal.

[0088] In some other embodiments, the first electronic device may also implement the above step 101 in the following manner: in response to detecting a living body (such as a human body) and the distance between the living body and the first electronic device being less than a distance threshold, perform a collection operation of the first type of biometric feature to obtain a first collection result.

[0089] Exemplarily, taking the first electronic device as a laptop and the first biometric feature as a facial feature as an example, before the user logs in to the application by face swiping, the laptop can call the built-in (or external) sensor (such as a distance sensor) to detect whether there is an organism in the environment where the distance from the laptop is less than a distance threshold (such as 1 meter). If there is an organism, the facial feature collection operation is performed. For example, the laptop can control the built-in (or external) camera to enter the working state to perform the facial feature collection operation. In this way, it can be avoided that when there is no one nearby, the laptop still performs the facial feature collection operation, thus wasting the resources of the laptop in vain.

[0090] In step 102, in response to the first collection result including the first biometric feature and the first biometric feature being bound to the first account, an application interface in the logged-in state is displayed.

[0091] Here, the first account can be a social network account (such as a personal instant messaging account or an enterprise instant messaging account), the logged-in state is the state of logging in to the application based on the first account, and the application interface is the interface in the application that involves privacy information (such as balance, purchase records, identity information, etc.).

[0092] In some embodiments, taking the first electronic device as a payment terminal and the first biometric feature as a palmprint feature as an example, the payment terminal can call the camera in the palmprint recognition area to collect images of the environment, obtaining multiple images (i.e., the first collection result). Then, palm detection processing is performed on the multiple collected images (i.e., determining whether there is a palm in the multiple collected images). When a palm is detected from the multiple images (assuming including images 1 to 10) (for example, assuming the user places the palm above the palmprint recognition area), for example, assuming the user's palm is detected in images 3 to 7, the optimal palm image (assuming it is image 4) can be comprehensively selected through coefficient indicators such as palm size, angle, image contrast, image brightness, and clarity. Subsequently, image 4 can be sent to the server so that the server can extract the corresponding palmprint feature from image 4 and determine the similarity between the extracted palmprint feature and multiple authorized palmprint features. When the maximum similarity is greater than or equal to the similarity threshold (for example, 95%), the server can further query the account (assuming it is account 1 associated with user A) bound to the authorized palmprint feature corresponding to the maximum similarity as the first account (i.e., the currently collected palmprint feature is the palmprint feature of user A). Subsequently, the server can perform encryption processing using the Data Encryption Standard (DES) based on a random number, account 1, and the current timestamp to obtain a token and return the token to the payment terminal so that the payment terminal can log in to the application running on the payment terminal (such as the palm payment APP) based on the account 1 carried in the token.

[0093] It should be noted that each time the payment terminal sends a request to the server subsequently, it needs to carry the token to prove the identity of user A. In addition, the token can have a certain validity period, that is, a temporary token. After the validity period expires, the server will generate a new token and send the new token to the payment terminal. Additionally, when the server determines that the maximum similarity is less than the similarity threshold, it indicates that the currently collected palmprint feature does not belong to any authorized user, and a corresponding notification message can be sent to the payment terminal to display a prompt message on the screen of the payment terminal to prompt the user to re-collect the palmprint feature.

[0094] Furthermore, it should be noted that in addition to the network verification method, a local verification method can also be adopted. For example, when the first electronic device locally stores multiple authorized biometric features of the first type, the first biometric feature can be matched with the multiple authorized biometric features stored locally. The embodiments of the present application do not make specific limitations on this.

[0095] In some other embodiments, when the first acquisition result does not include the first biometric feature, a prompt message may be displayed on the human-computer interaction interface of the first electronic device to prompt that the acquisition operation of the first type of biometric feature needs to be re-executed. For example, taking the first type of biometric feature as the palmprint feature, the following prompt message may be displayed on the human-computer interaction interface of the first electronic device: Please place your palm above the palmprint recognition area again.

[0096] In some embodiments, taking the first account as the account associated with the first organism as an example, refer to Figure 4 , Figure 4 which is a schematic flowchart of the login verification method of the application provided by the embodiments of the present application. As Figure 4 shown, before performing Figure 3 the step 101 shown, the steps 105 and 106 shown may also be performed, and will be described in conjunction with Figure 4 the steps shown. Figure 4

[0097] In step 105, the first type of biometric feature and the second type of biometric feature of the first organism are pre-acquired.

[0098] In some embodiments, taking the first type of biometric feature as the palmprint feature, the second type of biometric feature as the facial feature, the first electronic device as the payment terminal, and the first organism as user A as an example, before using the palm-swipe login function, the user first registers, that is, the payment terminal needs to pre-acquire the palmprint feature and facial feature of user A as the authorized biometric features.

[0099] In step 106, the first type of biometric feature and the second type of biometric feature of the first organism are bound to the first account.

[0100] In some embodiments, continuing with the above example, after the payment terminal acquires the palmprint feature and facial feature of user A, it can bind the acquired palmprint feature and facial feature to the account associated with user A (i.e., the first account, such as the social network account registered by user A).

[0101] It should be noted that the above application can be other types of applications in addition to the palm-swipe payment APP, such as an email APP, a shopping APP, etc. The embodiments of the present application do not make specific limitations in this regard.

[0102]

[0103] In step 103, the acquisition operation of the second type of biometric feature is performed to obtain a second acquisition result.​Here, the biometric feature of the second type is different from that of the first type. For example, if the biometric feature of the first type can be one of palmprint feature and face feature, then the biometric feature of the second type is the other one of palmprint feature and face feature. For example, assuming that the biometric feature of the first type is palmprint feature, then the biometric feature of the second type is face feature.

[0104] It should be noted that the biometric feature of the first type (or the biometric feature of the second type) can be other biometric features in addition to palmprint feature and face feature, such as voiceprint feature, iris feature, etc. For example, the biometric feature of the first type can be voiceprint feature, and the biometric feature of the second type can be iris feature. The embodiments of the present application do not make specific limitations thereto.

[0105] In some embodiments, the first electronic device can periodically perform the acquisition operation of the biometric feature of the second type. For example, the first electronic device can perform the acquisition operation of the biometric feature of the second type once every 1 minute. Of course, the first electronic device can also perform the acquisition operation of the biometric feature of the second type when it detects that the duration of the user's inactivity is greater than a duration threshold (such as 2 minutes). For example, assuming that the first electronic device has not received any operation triggered by the user within 2 minutes after displaying the application interface in the logged-in state, it can perform the acquisition operation of the biometric feature of the second type, so as to avoid the device with the logged-in state of the user being maliciously used when the user briefly leaves the screen.

[0106] In some other embodiments, the first electronic device can also perform the acquisition operation of the biometric feature of the second type when it detects that the user has performed a sensitive operation in the application interface (such as balance query operation, transfer operation, etc.). For example, taking the first electronic device as a payment terminal and the biometric feature of the second type as face feature as an example, when the payment terminal detects that the user has performed a transfer operation in the application interface, it can call the built-in (or external) camera to collect the face image of the user in front of the screen to determine whether it is the same user.

[0107] In some embodiments, it is also possible to determine whether it is the same person according to the user's operation habits. When it is determined that it is not the same person, the collection operation of the second type of biometric feature is performed. Then, the first electronic device can also perform the above step 103 in the following manner: Obtain the operation data of the current time period (for example, assume it is from the 3rd minute to the 4th minute after logging in to the application), and the operation data of the previous time period (for example, assume it is within 1 minute after logging in to the application); respectively perform feature extraction processing on the operation data of the current time period and the operation data of the previous time period, and correspondingly obtain the features of the operation data of the current time period and the features of the operation data of the previous time period; subsequently, based on the features of the operation data of the current time period and the features of the operation data of the previous time period, call a machine learning model to perform prediction processing to determine whether it is the same organism. For example, the machine learning model can calculate the similarity between the features of the operation data of the current time period and the features of the operation data of the previous time period (for example, calculate the Euclidean distance between two feature vectors). When the similarity is less than the similarity threshold, an output of a judgment result that it is not the same organism is generated. At this time, the first electronic device performs the collection operation of the second type of biometric feature.

[0108] It should be noted that the above operation data may include at least one of the following: the number of clicks of the user, at least one of the sliding distance and sliding speed when the user performs a sliding operation, and the touch area when the user performs a pressing operation.

[0109] For example, taking the first electronic device as a payment terminal, the first type of biometric feature as a palmprint feature, and the second type of biometric feature as a face feature as an example, assume that the user (for example, user A) logs in to the application (such as the palm payment APP) running on the payment terminal by swiping the palm at 10:00. At the same time, assume that the current time is 10:03. Then the payment terminal can further obtain the operation data of the user (which may be user A or other users) on the payment terminal in the current time period (for example, from 10:03 to 10:04) and the operation data of the user (that is, user A) on the payment terminal in the previous time period (for example, from 10:00 to 10:01), and respectively perform feature extraction processing on the operation data of these two time periods to correspondingly obtain the features of the operation data of the current time period and the features of the operation data of the previous time period. Subsequently, based on the features of the operation data of the current time period and the features of the operation data of the previous time period, a machine learning model can be called to perform prediction processing so that the machine learning model outputs a judgment result of whether it is the same user. When the judgment result output by the machine learning model is that it is not the same user, that is, the user operating on the payment terminal in the current time period is not the same user as the user operating on the payment terminal in the previous time period, the payment terminal can perform the collection operation of the face feature for further verification.

[0110] It should be noted that the above machine learning model can be trained based on the operation data of sample users at different time periods. In addition, an exemplary structure of the machine learning model may include: an input layer (i.e., an embedding layer), an encoding layer (which can be composed of multiple cascaded convolutional layers, for example), a fully connected layer, and an output layer (including an activation function, such as the Softmax function). For example, the operation data of the current time period and the operation data of the previous time period can be input into the input layer for embedding processing, and then the encoding layer encodes the embedded feature vector output by the input layer to obtain a hidden layer feature vector. Subsequently, the fully connected layer performs a fully connected process on the hidden layer feature vector, and finally, the fully connected result output by the fully connected layer is input into the output layer to perform an activation process through the output layer to obtain a judgment result on whether it is the same user.

[0111] It should be noted that the above machine learning model can be a neural network model (such as a convolutional neural network, a deep convolutional neural network, or a fully connected neural network, etc.), a decision tree model, a gradient boosting tree, a multi-layer perceptron, and a support vector machine, etc. The embodiments of the present application do not make specific limitations on the type of the machine learning model.

[0112] In some other embodiments, it is also possible to determine whether it is the same user based on rules. For example, after obtaining the operation data of the current time period, the operation data of the current time period can be compared with the operation data of the previous time period. When the difference between the two is greater than the difference threshold, for example, assuming that the sliding distance of the sliding operation included in the operation data of the current time period (assumed to be 3 cm) is significantly greater than the sliding distance of the sliding operation included in the operation data of the previous time period (assumed to be only 1 cm), or assuming that the touch pressure area included in the operation data of the current time period (assumed to be 0.5 square cm) is significantly smaller than the touch pressure area included in the operation data of the previous time period (assumed to be 1.5 square cm), it indicates that the two time periods are not the same user. Then, the payment terminal can perform a face feature collection operation for further verification. The embodiments of the present application do not make specific limitations on this.

[0113] In some embodiments, referring to Figure 5 , Figure 5 is a schematic flowchart of the login verification method of the application provided by the embodiments of the present application. As shown in Figure 5 , Figure 3 shown, step 103 shown in Figure 5 can be implemented by steps 1031 to 1032 shown in Figure 5 . It will be described in combination with the steps shown in

[0114] In step 1031, the application interface is controlled to be in the silent mode.

[0115] Here, the silent mode is used to block prompts (such as vibrations, sounds, images, etc.) related to the acquisition operation of the second type of biometric feature.

[0116] In step 1032, based on the silent mode, perform the acquisition operation of the second type of biometric feature to obtain a second acquisition result.

[0117] In some embodiments, taking the first electronic device as a payment terminal and the second type of biometric feature as a facial feature as an example, the payment terminal can perform the acquisition operation of the facial feature based on the silent mode to obtain a second acquisition result. For example, when the payment terminal performs the acquisition operation of the facial feature, it will not display the currently acquired face image on the screen in real time. That is to say, the payment terminal can silently perform the acquisition operation of the facial feature in the background, so as not to interfere with the process of the user performing related operations in the application interface, thus improving the user experience.

[0118] In step 104, based on the second acquisition result, control the login state of the application interface.

[0119] In some embodiments, step 104 can be implemented in the following manner: in response to the second acquisition result including a second biometric feature and the second biometric feature having a binding relationship with the first account, control the application interface to maintain the login state.

[0120] Exemplarily, taking the second type of biometric feature as a facial feature as an example, the first electronic device can call the built-in (or external) camera to collect images of the environment in front of the first electronic device to obtain multiple images (i.e., the second acquisition result). Then, face detection processing can be performed on the multiple images (including images 1 to 10) (i.e., detect whether there is a face in the multiple collected images). Suppose a face is detected from the multiple images. For example, suppose faces are detected in images 2 to 9. Then, the optimal face image (suppose it is image 5) can be comprehensively selected according to coefficient indicators such as face size, angle, image contrast, image brightness, and clarity. Subsequently, the first electronic device can send image 5 to the server so that the server can extract the corresponding facial feature from image 5 and match the extracted facial feature with multiple pre-stored authorized facial features in the server. When the maximum similarity is greater than the similarity threshold, query the account bound to the authorized facial feature corresponding to the maximum similarity. If the queried account is the first account, it is determined to be the same person. The server can send a notification message to maintain the login state to the first electronic device so that the first electronic device controls the application interface to maintain the login state.

[0121] In some other embodiments, the above step 104 can also be implemented in the following manner: in response to the second acquisition result including a second biometric feature and the second biometric feature not being bound to the first account, switch the application interface from the logged-in state to the non-logged-in state, where the non-logged-in state is the state where the application is not logged in based on the first account.

[0122] Exemplarily, taking the second biometric feature as a facial feature as an example, when the second acquisition result includes a facial feature, but the facial feature is not bound to the first account. For example, assuming that the currently acquired facial feature is bound to the second account, indicating that it is not the same user, the first electronic device can directly switch the application interface from the logged-in state to the non-logged-in state, thereby preventing the user's information from being leaked or misused maliciously by others.

[0123] In some embodiments, when it is determined that it is not the same person, further verification can be performed. When the verification fails, the logged-in state is exited. Then, the above operation of switching the application interface from the logged-in state to the non-logged-in state in response to the second acquisition result including a second biometric feature and the second biometric feature not being bound to the first account can be implemented in the following manner: in response to the second acquisition result including a second biometric feature and the second biometric feature not being bound to the first account, display a prompt message, where the prompt message is used to prompt that verification based on the first type of biometric feature is required; perform the acquisition operation of the first type of biometric feature again to obtain a third acquisition result; in response to the third acquisition result not including the first biometric feature, determine that the verification fails, and switch the application interface from the logged-in state to the non-logged-in state.

[0124] Exemplarily, taking the first type of biometric feature as a palmprint feature, the second type of biometric feature as a facial feature, and the first electronic device as a payment terminal as an example, when the server determines that the currently acquired facial feature is not bound to the first account, that is, it is determined that it is not the same person (for example, the palmprint feature is the palmprint feature of user A, while the facial feature is the facial feature of user B), the server can send a corresponding notification message to the payment terminal so that the payment terminal displays a prompt message for requiring palmprint verification again in the human-computer interaction interface, such as "Palmprint verification is required again". Subsequently, the payment terminal can perform the acquisition operation of the palmprint feature again to obtain a third acquisition result. When the third acquisition result does not include the palmprint feature (or there is a palmprint feature, but the palmprint feature is not the palmprint feature of user A), it is determined that the verification fails, and the payment terminal can switch the application interface from the logged-in state to the non-logged-in state.

[0125] In some other embodiments, continuing with the above example, when the third acquisition result includes the first biometric feature (such as the palmprint feature of user A), indicating that user A is still in front of the screen of the payment terminal, it is determined that the verification is passed, and the payment terminal can control the application interface to remain in the logged-in state. Thus, when it is determined that it is not the same person based on the facial feature, further verification is performed based on the palmprint feature, avoiding the incorrect assumption that it is not the same person due to factors such as the photographing angle, and then logging out of the logged-in state, which affects the normal operations of the user.

[0126] In some embodiments, when it is determined that it is not the same person, that is, when the second biometric feature has no binding relationship with the first account, the first electronic device can also perform the following processing: display a graphic code (such as a QR code); receive the configuration information sent by the second electronic device (such as a mobile phone, a tablet computer, etc.) after scanning the graphic code; based on the configuration information, perform one of the following processing: adjust the frequency of performing the acquisition operation of the second type of biometric feature; display the time interval from the current moment to the next execution of the acquisition operation of the second type of biometric feature; restore the frequency of performing the acquisition operation of the second type of biometric feature to the default frequency.

[0127] In some other embodiments, continuing with the above example, the first electronic device can also perform the following processing: in response to the graphic code being scanned, abort the service process in the application interface; in response to receiving the configuration information sent by the second electronic device, resume the service process in the application interface.

[0128] For example, taking the first electronic device as the payment terminal and the second electronic device as the mobile phone as an example, when it is determined that it is not the same person (that is, the second biometric feature has no binding relationship with the first account), a QR code can be displayed in the human-computer interaction interface of the payment terminal for the user to scan. When the payment terminal detects that the QR code is scanned, a waiting interface can be displayed to abort the service process in the application interface. Subsequently, when the payment terminal receives the configuration information sent by the user's mobile phone, the display of the waiting interface can be cancelled to resume the service process in the application interface.

[0129] In some embodiments, the above-mentioned graphic code may include an identifier of the first electronic device, such as a string serial number (SN), for the second electronic device to perform the following processing: Based on the identifier, display a setting interface corresponding to the first electronic device, where the setting interface includes a sensitivity setting control; in response to a triggering operation on the sensitivity setting control, display a sensitivity setting interface, where the sensitivity setting interface includes at least one of the following controls: an interval time control for adjusting the frequency of the first electronic device to perform the acquisition operation of the second type of biometric feature; a visualization control for displaying, in the first electronic device, the time interval from the current moment to the next execution of the acquisition operation of the second type of biometric feature; a restore default configuration control for restoring the frequency of the first electronic device to perform the acquisition operation of the second type of biometric feature to the default frequency.

[0130] Exemplarily, taking the first electronic device as a payment terminal and the second electronic device as a mobile phone as an example, the two-dimensional code displayed on the screen of the payment terminal may carry the identifier of the payment terminal. When the user scans the two-dimensional code displayed on the payment terminal with the mobile phone, a setting interface corresponding to the current payment terminal, that is, a setting interface for setting the current payment terminal, may be displayed on the mobile phone based on the identifier carried in the two-dimensional code. A sensitivity setting control may be displayed in the setting interface. When receiving a click operation of the user on the sensitivity setting control, it may jump from the setting interface to the sensitivity setting interface, and an interval time control, a visualization control, and a restore default configuration control may be displayed in the sensitivity setting interface.

[0131] For example, when the user's mobile phone receives a click operation of the user on the interval time control, a pop-up window may be displayed, and multiple candidate frequencies, such as frequencies 1 to 5, may be displayed in the pop-up window. When the user selects frequency 2 in the pop-up window, the user's mobile phone may send corresponding configuration information (for example, the configuration information may carry the selected frequency 2 by the user) to the payment terminal through the server, so that the payment terminal adjusts the frequency of performing the acquisition operation of the second type of biometric feature (such as a face feature) to frequency 2.

[0132] For example, when the user's mobile phone receives a click operation of the user on the visualization control, the user's mobile phone may send corresponding configuration information (for example, the configuration information may carry a notification message for displaying the time interval) to the payment terminal through the server, so that the payment terminal displays a floating window on the screen and displays the time interval from the current moment to the next execution of the acquisition operation of the second type of biometric feature in the floating window, such as "There are still 10 seconds left until the next execution of the acquisition operation of the face feature", to facilitate the user to prepare in advance for the acquisition of the face feature.

[0133] For example, when the user's mobile phone receives a click operation on the restore default configuration control, the user's mobile phone can send corresponding configuration information to the payment terminal through the server (for example, the configuration information can carry a notification message to restore to the default frequency), so that the payment terminal restores the frequency of performing the acquisition operation of the second type of biometric feature to the default frequency.

[0134] In some embodiments, following the above example, before the first electronic device performs the acquisition operation of the second type of biometric feature, the following processing can also be performed: in response to the biometric protection function in the second electronic device being in an enabled state, it is determined that the acquisition operation of the second type of biometric feature will be performed, where the biometric protection function is used to control the login state of the application interface based on the second type of biometric feature.

[0135] For example, taking the second type of biometric feature as the face feature, the first electronic device as the payment terminal, and the second electronic device as the mobile phone as an example, there can be a control entry on the mobile phone, and the user can turn on or off the face security protection function. When the user turns on the face security protection function on the mobile phone, the payment terminal will perform the acquisition operation of the face feature; when the user turns off the face security protection function on the mobile phone, the payment terminal will not perform the acquisition operation of the face feature. In this way, the user can very conveniently determine whether to turn on the face security protection function.

[0136] In some other embodiments, after obtaining the second acquisition result, the first electronic device can also use the depth information of the image to detect the distance between the user in the second acquisition result and the first electronic device. If the distance is greater than the distance threshold, it means that the person behind is being collected, and re-acquisition is required. That is, the first electronic device can also perform the following processing: obtain a first distance and a second distance, where the first distance is the distance between the organism corresponding to the first biometric feature and the first electronic device, and the second distance is the distance between the organism corresponding to the second biometric feature and the first electronic device; in response to the difference between the second distance and the first distance being greater than the difference threshold (for example, 0.2 meters), re-perform the acquisition operation of the second type of biometric feature.

[0137] Exemplarily, taking the first biometric feature as the palmprint feature, the second biometric feature as the facial feature, and the first electronic device as the payment terminal as an example, when the payment terminal performs the acquisition operation of the palmprint feature, it can also call a depth sensor (such as an infrared ranging sensor) to detect the distance between the user and the payment terminal (i.e., the first distance). Similarly, when the payment terminal performs the acquisition operation of the facial feature, it can also call the infrared ranging sensor to detect the distance between the user and the payment terminal (i.e., the second distance). When the difference between the two is greater than the difference threshold, it indicates that the facial feature of the person behind is being collected, and a corresponding prompt message can be displayed on the payment terminal to prompt the user to re-collect the facial feature. In this way, unnecessary subsequent verification processes can be directly omitted, thus effectively saving the resource consumption of the payment terminal.

[0138] In some other embodiments, the above step 104 can also be implemented in the following manner: in response to the second acquisition result not including the second biometric feature, switch the application interface from the logged-in state to the non-logged-in state.

[0139] Exemplarily, taking the second biometric feature as the facial feature as an example, when the second acquisition result does not include the facial feature, for example, no face is detected in multiple images captured by the built-in camera of the first electronic device, it indicates that the user has left in front of the screen of the first electronic device. To prevent the user information from being maliciously used by others, the first electronic device can switch the application interface from the logged-in state to the non-logged-in state to ensure the security of the user information.

[0140] The login verification method of the application program provided by the embodiments of the present application, after logging in to the application program based on the first account bound to the first biometric feature, continues to perform the acquisition operation of the second type of biometric feature, and controls the logged-in state of the application interface based on the second acquisition result. In this way, after logging in to the application program based on the first biometric feature, continuous verification is performed through the second type of biometric feature, which can effectively prevent the user information from being maliciously used or leaked by others, thus ensuring the security of the user information.

[0141] Next, taking the payment scenario as an example, the exemplary application of the embodiments of the present application in an actual application scenario is described.

[0142] After a user logs in to a mini-program by swiping their palm on an offline public palm-face payment terminal, to avoid account security issues caused by the remaining logged-in state due to the user leaving, it is necessary to continuously perform identity verification after logging in. However, continuously raising the palm is not good for the user experience.

[0143] In view of this, the embodiments of the present application provide a login verification method for an application. When a user registers for a palm-sweeping application (such as a mini-program), it is recommended that the user bind the face-related information at the same time. In this way, based on the binding relationship between the user's palm (corresponding to the first type of biometric feature mentioned above) and the face (corresponding to the second type of biometric feature mentioned above), when logging in to the relevant application by sweeping the palm offline later, the fact that the face will be relatively fixed in front of the device for a long time can be utilized, so that it can be used for silent recognition and identification to confirm whether it is the same person to ensure the user's information security.

[0144] The following specifically describes the login verification method for the application provided by the embodiments of the present application.

[0145] In some embodiments, refer to Figure 6 , Figure 6 which is a schematic diagram of the application scenario of the login verification method for the application provided by the embodiments of the present application. As Figure 6 shown, the login verification method for the application provided by the embodiments of the present application can be applied to the palm-sweeping payment scenario. The user can log in to the mini-program by sweeping the palm. For example, the user can place the palm 602 above the palmprint recognition area 601 so that the palm-sweeping payment terminal collects the user's palm 602 to obtain the user's palm image. Then, the corresponding palmprint features can be extracted from the palm image. Subsequently, the extracted palmprint features can be matched with multiple authorized palmprint features, and then the user's identity information (such as the instant messaging account associated with the user) can be obtained. Finally, the mini-program can be logged in based on the obtained instant messaging account.

[0146] In other embodiments, refer to Figure 7 , Figure 7 which is a schematic diagram of the principle of the registration and use process provided by the embodiments of the present application. As Figure 7 shown, the login verification method for the application provided by the embodiments of the present application includes two stages: registration and use. Among them, for the registration stage, when the user binds a social network account (such as an instant messaging account) to the registered palm in the early stage, it is recommended to bind the user's face information at the same time. This face information will only be bound to the palm-related application. For the use stage, when the user uses the palm-sweeping offline, after logging in by sweeping the palm, the face information bound to the palm will be detected in real time for real-time silent recognition, and the process can continue only if it is the same person. At the same time, there can also be a control entry on the mobile phone (corresponding to the second electronic device mentioned above), and the user can turn on or off the face security protection function first. That is to say, only when the user turns on the face security protection function on the mobile phone, after logging in by sweeping the palm, will the face information bound to the palm be detected in real time for real-time silent recognition.

[0147] In some embodiments, refer to Figure 8 , Figure 8This is a schematic diagram of the overall architecture of the login verification method for an application provided by an embodiment of the present application. As Figure 8 shown, the overall architecture of the login verification method for the application provided by the embodiment of the present application includes: a palm-sweeping payment terminal (corresponding to the above-mentioned first electronic device) and a palm-sweeping backend service. First, the palm-sweeping payment terminal will be described below.

[0148] Exemplarily, the palm-sweeping payment terminal is mainly used to carry palm-sweeping payment and login-related services. It has two core cameras, including a 3D palm-sweeping camera and a 3D face-sweeping camera. Among them, the 3D palm-sweeping camera is used to support palm-sweeping-related services, and the 3D face-sweeping camera is only used for auxiliary identification to confirm the user's identity. In addition, a palm-sweeping payment APP runs on the palm-sweeping payment terminal. Among them, the palm-sweeping payment APP includes a palm-sweeping registration module, a palm-sweeping login module, a face-sweeping silent recognition module, a process control module, and a payment result page module.

[0149] Exemplarily, taking palm collection and recognition as an example, the palm-sweeping payment APP can call the 3D palm-sweeping camera to collect the current palm streaming media data of the user. After obtaining the streaming media data, the palm-sweeping payment terminal can optimize the streaming media data. For example, it can comprehensively select the optimal palm image through coefficient indicators such as palm size, angle, image contrast, image brightness, and clarity. Subsequently, the palm-sweeping payment terminal can send the selected optimal palm image to the palm-sweeping backend service for palm recognition, and further obtain the user identity information (such as an instant messaging account) corresponding to the palm or relevant information such as a payment code.

[0150] It should be noted that the process of face collection and recognition is similar to the process of palm collection and recognition, and the embodiments of the present application will not elaborate on this here.

[0151] Next, the palm-sweeping registration module in the palm-sweeping payment APP will be described.

[0152] In some embodiments, before using the palm-sweeping related application, the user needs to bind the palm to the instant messaging account in advance. The specific process is as follows: The user first sweeps the palm. Since the user is not registered, it will be prompted that the user is a new user and needs to scan the code for registration and activation. Subsequently, the palm-sweeping payment terminal will display the palm-sweeping mini-program code, which is associated with the palm image pre-recognized and uploaded by the current user. After the user scans the code with the mobile phone, it will enter the mini-program on the mobile phone side. The mobile phone mini-program will obtain the current user's identity (such as the instant messaging account) and ask the user whether to bind the palm to the current instant messaging account. After the user confirms, the palm will be bound to the instant messaging account. After the binding is completed, the user will be further asked to confirm whether to allow the face information to be bound to the palm for subsequent more secure identification and verification. The face does not need to be registered. When using the instant messaging client, the user needs to be verified by real name, and the face image of the current user will be stored for subsequent silent identification and comparison.

[0153] Next, the palm-sweeping login module in the palm-sweeping payment APP will be further described.

[0154] In some embodiments, the palm-sweeping payment terminal will run the mini-program framework, and the user will log in by means of palm-sweeping recognition. After the user logs in, the merchant mini-program will have the identity information of the current user, and the user can perform related operations such as shopping and payment. However, due to the login scenario, it is easy to cause the insecurity of user information. For example, if the user forgets to log out, etc., it is easy to cause the information to be maliciously used.

[0155] Next, the face silent recognition module in the palm-sweeping payment APP will be further described.

[0156] In some embodiments, assuming that the user keeps the hand fixed in front of the 3D palm-sweeping camera for a long time, silent recognition and identity confirmation can be achieved, but it has a greater impact on the user experience, and the user needs to keep the palm suspended for a long time. To solve the above problems, the technical solution provided in the embodiments of the present application additionally installs a 3D face-sweeping camera for face recognition on the palm-sweeping payment terminal. After the user logs in successfully, the face image information (i.e., the authorized face image) bound to the instant messaging account will be further obtained. Subsequently, the 3D face-sweeping camera can be called to perform silent face collection to avoid interrupting the user's operation. Subsequently, the collected face streaming media data can be transmitted to the palm-sweeping backend service for recognition.

[0157] Exemplarily, refer to Figure 9 , Figure 9 is the flow schematic diagram of the login verification method of the application program provided in the embodiments of the present application, and will be described in combination with Figure 9 the steps shown.

[0158] In step 201, silent recognition.

[0159] In step 202, it is determined whether it is the same person. If so, step 201 is executed; if not, steps 203 to 205 or steps 206 to 208 are executed.

[0160] In step 203, palm brushing verification is performed.

[0161] In step 204, it is determined whether the verification passes. If the verification fails, step 205 is executed; if the verification passes, step 201 is executed.

[0162] In step 205, the service is aborted.

[0163] In some embodiments, during the silent face recognition process, it is continuously determined whether it is the same person. If it is the same person, continuous silent recognition is performed. When it is not the same person, a prompt interface for palm brushing verification will pop up on the palm brushing payment terminal, and the interface may also include the QR code information of the palm brushing service mini-program. After the user performs palm brushing verification, if it passes, the silent recognition process is carried out; if it does not pass, the service is directly aborted, and in this case, it can be determined that it is not the user himself.

[0164] In step 206, the QR code is displayed.

[0165] In step 207, a waiting interface is displayed.

[0166] In step 208, status synchronization is performed, and then step 201 is executed.

[0167] In some embodiments, in some scenarios, such as in the supermarket queuing scenario, when the user has multiple items, the user may often face the items, resulting in failure to recognize or misrecognize the person behind. In this case, the user can choose to appropriately reduce the frequency of silent recognition or master the timing of recognition by himself. For example, the user can previously configure on the mobile phone or enter the mini-program by scanning the QR code on the interface prompt when face recognition fails. After the user scans the QR code, the service on the palm brushing payment terminal will enter the aborted state, waiting for the user to operate on the mobile phone, pull the relevant new configuration information of face silent recognition, and then start the service process.

[0168] Exemplarily, refer to Figure 10 , Figure 10 is a schematic diagram of the application scenario of the login verification method of the application program provided by the embodiment of the present application, as Figure 10As shown, after the user scans the QR code displayed on the palm-sweeping payment terminal with the mobile phone, the user can enter the palm-sweeping service mini-program, and the corresponding mini-program interface 1001 will be displayed on the mobile phone. A "Facial Assistant Verification Sensitivity Setting" button 1002 is displayed in the mini-program interface 1001. After entering the palm-sweeping service mini-program, the user can set it by clicking the Facial Assistant Verification Sensitivity Setting button. For example, when receiving the click operation of the user on the "Facial Assistant Verification Sensitivity Setting" button 1002, the sensitivity setting interface 1003 can be entered. An "Interval Time" button 1004, a "Visualization" button 1005, and a "Restore Default Configuration" button 1006 are displayed in the sensitivity setting interface 1003. The user can set the interval time for the palm-sweeping payment terminal to perform face recognition through the "Interval Time" button 1004, that is, the interval time is the recognition interval set by the user. After the user sets this interval time, the palm-sweeping payment terminal will take the interval time currently set by the user as the standard and regularly start silent face recognition. The "Visualization" button 1005 is used to provide a floating window interface on the palm-sweeping payment terminal to display the time interval from the current moment to the next face recognition, so as to facilitate the user to prepare for silent recognition verification in advance. The "Restore Default Configuration" button 1006 is used to quickly restore to the default silent recognition state when the user experiences problems.

[0169] Next, the process control module in the palm-sweeping payment APP will be further described.

[0170] In some embodiments, when the results of silent face recognition are consistent, there is no reaction. When the face changes, or the face status changes, such as the face disappears, the ability to log out of the palm-sweeping will be called to eliminate the login state and ensure the security of user information.

[0171] Next, the payment result page module in the palm-sweeping payment APP will be further described.

[0172] In some embodiments, the payment result page module is used to display relevant payment results. For example, when the user exits the operation in the mini-program, the relevant payment results will be displayed through the payment result page module, such as payment success or payment failure, etc.

[0173] Next, continue with Figure 8 the palm-sweeping backend service shown in

[0174] In some embodiments, the back-end services of palm brushing mainly include face recognition service, palm recognition service, mini-program service, and payment service. Among them, the face / palm recognition service is mainly used to receive the face / palm images uploaded from the palm-brushing payment terminal, extract features from the current images, and compare the extracted face / palm features with the authorized face / palm features in the database to find the authorized face / palm feature with the highest score, so as to obtain the user's identity information. If the comparison is successful, that is, after successfully matching the user's identity, information for payment can be returned to the palm-brushing payment terminal, such as a payment code; the mini-program service is mainly used for the user to obtain the specific mini-program login status of the user through palm brushing recognition, and then can log in to the mini-program running on the palm-brushing payment terminal; the payment service is used for the merchant to initiate a back-end payment service to the payment back-end after obtaining the payment code.

[0175] The login verification method of the application program provided by the embodiments of the present application, by combining the user's face-related information when registering the palm-brushing application, when performing related applications based on palm brushing offline in the future, the face can be borrowed to be relatively fixed in front of the device for a long time, so that it can be used for silent recognition and identification to confirm whether it is the same person to ensure the user's information security.

[0176] Next, continue to describe the exemplary structure of the software module implementation of the login verification device 555 of the application program provided by the embodiments of the present application. In some embodiments, as Figure 2 shown, the software module in the login verification device 555 of the application program stored in the memory 550 may include: a collection module 5551, a display module 5552, and a control module 5553.

[0177] The collection module 5551 is used to perform the collection operation of the first type of biometric feature to obtain the first collection result; the display module 5552 is used to display the application interface in the logged-in state in response to the first collection result including the first biometric feature and the first biometric feature being bound to the first account, where the logged-in state is the state of logging in to the application program based on the first account; the collection module 5551 is further used to perform the collection operation of the second type of biometric feature to obtain the second collection result, where the second type is different from the first type; the control module 5553 is used to control the logged-in state of the application interface based on the second collection result.

[0178] In some embodiments, the control module 5553 is further used to control the application interface to maintain the logged-in state in response to the second collection result including the second biometric feature and the second biometric feature being bound to the first account.

[0179] In some embodiments, the control module 5553 is further configured to, in response to the second acquisition result including a second biometric feature and the second biometric feature not being bound to the first account, switch the application interface from the logged-in state to the non-logged-in state, where the non-logged-in state is a state in which the application is not logged in based on the first account.

[0180] In some embodiments, the display module 5552 is further configured to, in response to the second acquisition result including a second biometric feature and the second biometric feature not being bound to the first account, display a prompt message, where the prompt message is used to prompt that verification based on the first type of biometric feature is required; the acquisition module 5551 is further configured to perform the acquisition operation of the first type of biometric feature again to obtain a third acquisition result; the control module 5553 is further configured to, in response to the third acquisition result not including the first biometric feature, determine that the verification fails and switch the application interface from the logged-in state to the non-logged-in state.

[0181] In some embodiments, the control module 5553 is further configured to, in response to the third acquisition result including the first biometric feature, determine that the verification passes and control the application interface to remain in the logged-in state.

[0182] In some embodiments, the display module 5552 is further configured to display a graphical code; the login verification device 555 of the application further includes an adjustment module 5554, configured to receive configuration information sent by the second electronic device after scanning the graphical code; based on the configuration information, perform one of the following processes: adjust the frequency of performing the acquisition operation of the second type of biometric feature; display the time interval from the current moment to the next execution of the acquisition operation of the second type of biometric feature; restore the frequency of performing the acquisition operation of the second type of biometric feature to the default frequency.

[0183] In some embodiments, the control module 5553 is further configured to, in response to the graphical code being scanned, abort the service process in the application interface; and in response to receiving the configuration information sent by the second electronic device, resume the service process in the application interface.

[0184] In some embodiments, the graphical code includes an identifier of the first electronic device, and is used for the second electronic device to perform the following processes: based on the identifier, display a setting interface corresponding to the first electronic device, where the setting interface includes a sensitivity setting control; in response to a trigger operation on the sensitivity setting control, display a sensitivity setting interface, where the sensitivity setting interface includes at least one of the following controls: an interval time control for adjusting the frequency of performing the acquisition operation of the second type of biometric feature by the first electronic device; a visualization control for displaying the time interval from the current moment to the next execution of the acquisition operation of the second type of biometric feature in the first electronic device; a restore default configuration control for restoring the frequency of performing the acquisition operation of the second type of biometric feature by the first electronic device to the default frequency.

[0185] In some embodiments, the login verification device 555 of the application further includes an acquisition module 5555, configured to acquire a first distance and a second distance before the control module 5553 controls the login state of the application interface based on the second acquisition result, where the first distance is the distance between the organism corresponding to the first biometric feature and the first electronic device, and the second distance is the distance between the organism corresponding to the second biometric feature and the first electronic device; the acquisition module 5551 is further configured to, in response to the difference between the second distance and the first distance being greater than the difference threshold, re - execute the acquisition operation of the second type of biometric feature.

[0186] In some embodiments, the login verification device 555 of the application further includes a determination module 5556, configured to, before the acquisition module 5551 executes the acquisition operation of the second type of biometric feature, in response to the biometric protection function in the second electronic device being in an enabled state, determine to execute the acquisition operation of the second type of biometric feature, where the biometric protection function is used to control the login state of the application interface based on the second type of biometric feature.

[0187] In some embodiments, the control module 5553 is further configured to, in response to the second acquisition result not including the second biometric feature, switch the application interface from the logged - in state to the non - logged - in state, where the non - logged - in state is the state of not logging in to the application based on the first account.

[0188] In some embodiments, the determination module 5556 is further configured to determine the similarity between the first biometric feature and multiple authorized biometric features of the first type; and to query the account bound to the authorized biometric feature corresponding to the maximum similarity as the first account in response to the maximum similarity being greater than the similarity threshold.

[0189] In some embodiments, the acquisition module 5551 is further configured to perform one of the following processes: periodically perform the acquisition operation of the second type of biometric feature; perform the acquisition operation of the second type of biometric feature in response to the non - operation duration being greater than the duration threshold; perform the acquisition operation of the second type of biometric feature in response to a sensitive operation being performed in the application interface.

[0190] In some embodiments, the acquisition module 5551 is further configured to perform one of the following processes: perform the acquisition operation of the first type of biometric feature in response to a trigger operation on the login entry in the first electronic device; periodically perform the acquisition operation of the first type of biometric feature; perform the acquisition operation of the first type of biometric feature in response to the first electronic device entering the lit - screen state from the screen - off state; perform the acquisition operation of the first type of biometric feature in response to detecting an organism and the distance between the organism and the first electronic device being less than the distance threshold.

[0191] In some embodiments, the control module 5553 is further configured to control the application interface to be in a silent mode, where the silent mode is used to block the output of prompts related to the acquisition operation of the second type of biometric feature; the acquisition module 5551 is further configured to perform the acquisition operation of the second type of biometric feature based on the silent mode.

[0192] In some embodiments, the first account is an account associated with the first biological entity; the acquisition module 5551 is further configured to pre-acquire the first type of biometric feature and the second type of biometric feature of the first biological entity; the login verification device 555 of the application further includes a binding module 5557, configured to bind the first type of biometric feature and the second type of biometric feature of the first biological entity to the first account.

[0193] In some embodiments, the first biometric feature is one of a palmprint feature and a face feature, and the second biometric feature is the other of the palmprint feature and the face feature.

[0194] In some embodiments, the application interface is an interface in the application program that involves privacy information.

[0195] It should be noted that the description of the device in the embodiments of the present application is similar to the description of the above method embodiments, and has beneficial effects similar to those of the method embodiments, so details will not be repeated. For the technical details not described in the login verification device of the application program provided in the embodiments of the present application, they can be understood according to Figure 3 、 Figure 4 、or Figure 5 the description of any one of the drawings.

[0196] The embodiments of the present application provide a computer program product, which includes a computer program or computer-executable instructions, and the computer program or computer-executable instructions are stored in a computer-readable storage medium. The processor of the computer device reads the computer-executable instructions from the computer-readable storage medium, and the processor executes the computer-executable instructions, so that the computer device executes the login verification method of the application program in the above embodiments of the present application.

[0197] The embodiments of the present application provide a computer-readable storage medium storing computer-executable instructions, where the computer-executable instructions are stored, and when the computer-executable instructions are executed by a processor, the processor will be caused to execute the login verification method of the application program provided in the embodiments of the present application, for example, as Figure 3 、 Figure 4 、or Figure 5 shown in the login verification method of the application program.

[0198] In some embodiments, the computer-readable storage medium may be a memory such as FRAM, ROM, PROM, EPROM, EEPROM, flash memory, magnetic surface memory, optical disc, or CD-ROM; or it may be various devices including one or any combination of the above memories.

[0199] In some embodiments, the executable instructions may be in the form of a program, software, software module, script, or code, and may be written in any form of programming language (including compiled or interpreted languages, or declarative or procedural languages), and may be deployed in any form, including being deployed as an independent program or being deployed as a module, component, subroutine, or other unit suitable for use in a computing environment.

[0200] As an example, the executable instructions may be deployed to execute on one electronic device, or on multiple electronic devices located at one location, or alternatively, on multiple electronic devices distributed at multiple locations and interconnected through a communication network.

[0201] As described above, the above are only embodiments of the present application and are not intended to limit the protection scope of the present application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and scope of the present application are included in the protection scope of the present application.

Claims

1. A login verification method for an application, characterized in that, Applied to a first electronic device, the method includes: Performing a collection operation of a first type of biometric feature to obtain a first collection result; In response to the first collection result including a first biometric feature and the first biometric feature having a binding relationship with a first account, displaying an application interface in a logged-in state, where the logged-in state is a state of logging in to the application program based on the first account; Performing a collection operation of a second type of biometric feature to obtain a second collection result, where the second type is different from the first type; Based on the second collection result, controlling the logged-in state of the application interface; Displaying a graphic code; Receiving configuration information sent by a second electronic device after scanning the graphic code; Based on the configuration information, performing one of the following processes: Adjusting the frequency of performing the collection operation of the second type of biometric feature; Displaying the time interval from the current moment to the next execution of the collection operation of the second type of biometric feature; Restoring the frequency of performing the collection operation of the second type of biometric feature to the default frequency.

2. The method according to claim 1, wherein The controlling the logged-in state of the application interface based on the second collection result includes: In response to the second collection result including a second biometric feature and the second biometric feature having a binding relationship with the first account, controlling the application interface to maintain the logged-in state.

3. The method according to claim 1 or 2, characterized in that, The controlling the logged-in state of the application interface based on the second collection result includes: In response to the second collection result including a second biometric feature and the second biometric feature not having a binding relationship with the first account, switching the application interface from the logged-in state to a non-logged-in state, where the non-logged-in state is a state of not logging in to the application program based on the first account.

4. The method according to claim 3, characterized in that, The switching the application interface from the logged-in state to the non-logged-in state in response to the second collection result including a second biometric feature and the second biometric feature not having a binding relationship with the first account includes: In response to the second collection result including a second biometric feature and the second biometric feature not having a binding relationship with the first account, displaying a prompt message, where the prompt message is used to prompt that verification based on the first type of biometric feature is required; Performing the collection operation of the first type of biometric feature again to obtain a third collection result; In response to the third collection result not including the first biometric feature, determining that the verification fails and switching the application interface from the logged-in state to the non-logged-in state.

5. The method according to claim 4, wherein The method further includes: In response to the third collection result including the first biometric feature, determining that the verification passes and controlling the application interface to maintain the logged-in state.

6. The method according to claim 1, wherein The method further includes: In response to the graphic code being scanned, aborting the business process in the application interface; In response to receiving the configuration information sent by the second electronic device, resuming the business process in the application interface.

7. The method according to claim 1, wherein The graphic code includes an identifier of the first electronic device and is used for the second electronic device to perform the following processing: Based on the identifier, display a settings interface corresponding to the first electronic device, where the settings interface includes a sensitivity setting control; In response to a trigger operation on the sensitivity setting control, display a sensitivity setting interface, where the sensitivity setting interface includes at least one of the following controls: An interval time control for adjusting the frequency of the first electronic device to perform the acquisition operation of the second type of biometric feature; A visualization control for displaying, in the first electronic device, the time interval from the current moment to the next execution of the acquisition operation of the second type of biometric feature; A restore default configuration control for restoring the frequency of the first electronic device to perform the acquisition operation of the second type of biometric feature to the default frequency.

8. The method according to claim 2, wherein Before controlling the login state of the application interface based on the second acquisition result, the method further includes: Obtain a first distance and a second distance, where the first distance is the distance between the organism corresponding to the first biometric feature and the first electronic device, and the second distance is the distance between the organism corresponding to the second biometric feature and the first electronic device; In response to the difference between the second distance and the first distance being greater than a difference threshold, re-perform the acquisition operation of the second type of biometric feature.

9. The method according to claim 1, wherein Before performing the acquisition operation of the second type of biometric feature, the method further includes: In response to the biometric protection function in the second electronic device being in an enabled state, determine that the acquisition operation of the second type of biometric feature will be performed, where the biometric protection function is used to control the login state of the application interface based on the second type of biometric feature.

10. The method according to claim 1, characterized in that The controlling the login state of the application interface based on the second acquisition result includes: In response to the second acquisition result not including the second biometric feature, switch the application interface from the login state to the non-login state, where the non-login state is the state of not logging in to the application program based on the first account.

11. The method according to claim 1, wherein The method further includes: Determine the similarity between the first biometric feature and multiple authorized biometric features of the first type; In response to the maximum similarity being greater than a similarity threshold, query the account bound to the authorized biometric feature corresponding to the maximum similarity as the first account.

12. The method according to claim 1, characterized in that, The performing the acquisition operation of the second type of biometric feature includes: Perform one of the following processes: Periodically perform the acquisition operation of the second type of biometric feature; In response to the non-operation duration being greater than a duration threshold, perform the acquisition operation of the second type of biometric feature; In response to a sensitive operation being performed in the application interface, perform the acquisition operation of the second type of biometric feature.

13. According to the method of claim 1, wherein The login verification method of the application program is applied to a first electronic device; The performing the acquisition operation of the first type of biometric feature includes: Perform one of the following processes: In response to a trigger operation on the login entry in the first electronic device, perform the acquisition operation of the first type of biometric feature; Periodically perform the acquisition operation of the first type of biometric feature; In response to the first electronic device entering the screen-on state from the screen-off state, perform a collection operation of the first type of biometric feature; In response to detecting a living body and the distance between the living body and the first electronic device being less than a distance threshold, perform a collection operation of the first type of biometric feature; The performing a collection operation of the second type of biometric feature includes: Controlling the application interface to be in a silent mode, where the silent mode is used to block the output of prompts related to the collection operation of the second type of biometric feature; Performing the collection operation of the second type of biometric feature based on the silent mode.

14. The method according to claim 1, wherein The first account is an account associated with the first living body; The method further includes: Pre-collecting the first type of biometric feature and the second type of biometric feature of the first living body; Binding the first type of biometric feature and the second type of biometric feature of the first living body to the first account.

15. The method according to claim 2, wherein The first biometric feature is one of a palmprint feature and a face feature, and the second biometric feature is the other of a palmprint feature and a face feature.

16. A login verification device for an application, characterized in that, Applied to a first electronic device, the apparatus includes: A collection module, configured to perform a collection operation of the first type of biometric feature to obtain a first collection result; A display module, configured to display an application interface in a logged-in state in response to the first collection result including a first biometric feature and the first biometric feature having a binding relationship with a first account, where the logged-in state is a state of logging in to an application program based on the first account; The collection module is further configured to perform a collection operation of the second type of biometric feature to obtain a second collection result, where the second type is different from the first type; A control module, configured to control the logged-in state of the application interface based on the second collection result; display a graphic code; receive configuration information sent by a second electronic device after scanning the graphic code; and based on the configuration information, perform one of the following processes: adjust the frequency of performing the collection operation of the second type of biometric feature; display the time interval from the current moment to the next execution of the collection operation of the second type of biometric feature; restore the frequency of performing the collection operation of the second type of biometric feature to the default frequency.

17. An electronic device, characterized in that, Includes: A memory, configured to store computer-executable instructions or a computer program; A processor, configured to implement the login verification method of the application program according to any one of claims 1 to 15 when executing the computer-executable instructions or the computer program stored in the memory.

18. A computer-readable storage medium storing computer-executable instructions or a computer program, characterized in that, When the computer-executable instructions or the computer program are executed by the processor, the login verification method of the application program according to any one of claims 1 to 15 is implemented.

19. A computer program product, comprising a computer program or computer-executable instructions, characterized in that, When the computer program or the computer-executable instructions are executed by the processor, the login verification method of the application program according to any one of claims 1 to 15 is implemented.

Images