Data Clearing Method, Device, Equipment and Storage Medium
By automatically clearing user account data when the signal connection strength between the terminal and the face recognition device is worse than the connection conditions, the problem of user account information leakage in self-service settlement equipment is solved, and the security protection of user information is achieved.
Patent Information
- Application Number
- CN202110096156.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-01-25
- Publication Date
- 2025-06-24
- Estimated Expiration
- 2041-01-25
AI Technical Summary
Self-service settlement equipment may lead to the leakage of user account information when shared by multiple users, especially when the signal connection strength changes, the account data cannot be cleared in time.
When the signal connection strength between the terminal and the face recognition device is less than the connection conditions, the account data corresponding to the user account is automatically cleared to ensure information security.
It effectively avoids the leakage of user information, especially when shared by multiple users in public devices, ensuring the security of user privacy.
Smart Images

Figure CN114792012B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of information security, and particularly to a data clearing method, apparatus, device, and storage medium. Background Art
[0002] Self-checkout equipment refers to a cashier device that can settle bills without manual operation.
[0003] Generally, self-checkout equipment is located in public places such as shopping malls and supermarkets and belongs to public equipment. When there are many settlement users, the self-checkout equipment will cache a large amount of user data. After the first user settles the first bill, the self-checkout equipment retains the account information of the first user. If the first user is a merchant member, the account information is member information. After the first user settles the bill, the second user also uses the same self-checkout equipment to settle the second bill.
[0004] In the above technical solution, the account information of the first user may be left in the self-checkout equipment, so that the second user may use the member information of the first user when settling the bill, resulting in the leakage of the account information of the first user. Summary of the Invention
[0005] Embodiments of this application provide a data clearing method, apparatus, device, and storage medium. When the signal connection strength between the terminal and the face recognition device is worse than the connection condition, the account data corresponding to the user account is automatically cleared to avoid the leakage of user information. The technical solution includes the following solutions:
[0006] According to one aspect of this application, a data clearing method is provided. The method includes:
[0007] Obtain the first user account logged in the face recognition device, where the first user account is logged in under the condition of matching with the second user account, and the second user account is the user account logged in the first terminal;
[0008] Obtain the signal connection strength between the face recognition device and the first terminal;
[0009] In response to the signal connection strength being worse than the connection condition, clear the account data corresponding to the first user account in the face recognition device.
[0010] According to another aspect of this application, a data clearing apparatus is provided. The apparatus includes:
[0011] An obtaining module, configured to obtain the first user account logged in the face recognition device, where the first user account is logged in under the condition of matching with the second user account, and the second user account is the user account logged in the first terminal;
[0012] The obtaining module is configured to obtain the signal connection strength between the face recognition device and the first terminal;
[0013] The data clearing module is configured to, in response to the signal connection strength being worse than the connection condition, clear the account data corresponding to the first user account in the face recognition device.
[0014] In an optional embodiment, the obtaining module is configured to, in response to the signal connection strength being worse than the connection condition, obtain an association relationship, where the association relationship is used to characterize the relationship between the user account and the storage address of the account data; obtain the storage address of the account data according to the association relationship and the first user account; the data clearing module is configured to clear the account data from the storage address.
[0015] In an optional embodiment, the face recognition device includes a cash register device, and the cash register device is configured to generate payment information after the purchase order is settled;
[0016] The obtaining module is configured to obtain the account type of the first user account;
[0017] The data clearing module is configured to, in response to the account type belonging to the member type, clear the member preferential information and the first payment information corresponding to the first user account from the storage address; in response to the account type belonging to the non-member type, clear the second payment information corresponding to the first user account from the storage address.
[0018] In an optional embodiment, the device includes a processing module;
[0019] The processing module is configured to, in response to the signal connection strength being reduced to within the first signal range, determine that the signal connection strength is worse than the connection condition; or, in response to the signal connection strength being lower than the signal strength threshold, determine that the signal connection strength is worse than the connection condition.
[0020] In an optional embodiment, the device includes a receiving module;
[0021] The receiving module is configured to receive the first user account sent by the server, where the first user account is obtained by the server according to the first face image collected by the face recognition device; in response to the face recognition device establishing a connection with the first terminal, receive the second user account sent by the first terminal; the processing module is configured to, in response to the first user account and the second user account matching, control the first user account to log in on the face recognition device.
[0022] In an optional embodiment, the processing module is configured to disconnect the connection between the face recognition device and the first terminal in response to a mismatch between the first user account and the second user account;
[0023] The obtaining module is configured to obtain a list of candidate signal strengths, where the list of candidate signal strengths includes signal connection strengths corresponding to at least two terminals;
[0024] The receiving module is configured to sequentially connect to the terminals corresponding to the signal connection strengths in the list of candidate signal strengths and receive a third user account sent by the second terminal that has been connected;
[0025] The processing module is configured to control the first user account to log in to the face recognition device in response to a match between the third user account and the first user account.
[0026] In an optional embodiment, the obtaining module is configured to obtain a list of candidate signal strengths in response to the end of the payment process corresponding to the first user account and the disconnection from the first terminal, where the list of candidate signal strengths includes signal connection strengths corresponding to at least two terminals;
[0027] The receiving module is configured to, in response to receiving a fourth user account sent by the server, sequentially connect to the terminals corresponding to the signal connection strengths in the list of candidate signal strengths and receive a fifth user account sent by the third terminal that has been connected, where the fourth user account is recognized by the server based on a second face image collected by the face recognition device;
[0028] The processing module is configured to control the fourth user account to log in to the face recognition device in response to a match between the fifth user account and the fourth user account.
[0029] In an optional embodiment, the device includes a display module;
[0030] The display module is configured to display a purchase order corresponding to the first user account;
[0031] The receiving module is configured to receive a payment operation for the purchase order;
[0032] The data clearing module is configured to clear the account data corresponding to the first user account in response to receiving a payment success message sent by the server and the signal connection strength between the face recognition device and the first terminal being worse than the connection condition, where the payment success message is generated by the server after the payment for the purchase order corresponding to the first user account is successful.
[0033] In an optional embodiment, the obtaining module is configured to obtain the face image collected by the face recognition device and the first user account in response to the type of the first user account belonging to a non-member type and receiving a membership registration operation.
[0034] The processing module is configured to generate a membership account according to the face image and the first user account.
[0035] According to another aspect of the present application, there is provided a computer device, which includes a processor and a memory. At least one instruction, at least one program, a code set or an instruction set is stored in the memory, and the at least one instruction, the at least one program, the code set or the instruction set is loaded and executed by the processor to implement the data clearing method described in the above aspect.
[0036] According to another aspect of the present application, there is provided a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the data clearing method described in the above aspect is implemented.
[0037] According to another aspect of the present application, there is provided a computer program product or a computer program, which includes computer instructions stored in a computer-readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the data clearing method described in the above aspect.
[0038] The beneficial effects brought by the technical solutions provided in the embodiments of the present application at least include the following effects:
[0039] By controlling the face recognition device to clear the account data of the first user account due to the signal connection strength between the face recognition device and the first terminal being worse than the connection condition, when the terminal used by the user is far from the connection range of the face recognition device, the face recognition device performs a fallback cleaning operation on the account data of the first user account, avoiding the leakage of user personal information caused by multiple users using the face recognition device simultaneously when the face recognition device is a public device. BRIEF DESCRIPTION OF THE DRAWINGS
[0040] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings required for the description of the embodiments. Obviously, the following drawings are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.
[0041] Figure 1It is a block diagram of a computer system provided by an exemplary embodiment of the present application;
[0042] Figure 2 It is a flowchart of a data clearing method provided by an exemplary embodiment of the present application;
[0043] Figure 3 It is a flowchart of a data clearing method provided by another exemplary embodiment of the present application;
[0044] Figure 4 It is a flowchart of a data clearing method provided by another exemplary embodiment of the present application;
[0045] Figure 5 It is a flowchart of a data clearing method provided by another exemplary embodiment of the present application;
[0046] Figure 6 It is a flowchart of a data clearing method provided by another exemplary embodiment of the present application;
[0047] Figure 7 It is a system framework diagram among a face recognition device, a terminal, and a server provided by an exemplary embodiment of the present application;
[0048] Figure 8 It is a flowchart of a data clearing method provided by another exemplary embodiment of the present application;
[0049] Figure 9 It is a schematic diagram of a device connection page provided by an exemplary embodiment of the present application;
[0050] Figure 10 It is a block diagram of a data clearing device provided by another exemplary embodiment of the present application;
[0051] Figure 11 It is a block diagram of a server provided by an exemplary embodiment of the present application;
[0052] Figure 12 It is a block diagram of a computer device provided by an exemplary embodiment of the present application. Detailed implementation manners
[0053] To make the objectives, technical solutions, and advantages of the present application clearer, the following will further describe the embodiments of the present application in detail with reference to the accompanying drawings.
[0054] First, introduce the nouns involved in the embodiments of the present application:
[0055] 3D Camera (3-Dimension Camera): It refers to a camera that can detect the distance information of the shooting space. Usually, a live face detection is achieved by adding a live detection program. It has functions such as face recognition, gesture recognition, human skeleton recognition, 3D measurement, environment perception, 3D map reconstruction, etc. It can be widely applied in the fields of smart terminals, intelligent robots, drones, driverless, autonomous driving, virtual reality technology (VR), augmented reality technology (AR), smart home, smart healthcare, intelligent customer service, etc.
[0056] SQLite Database: It refers to a lightweight database, a relational database management system that complies with ACID. ACID is the abbreviation of the four basic elements for the correct execution of database transactions, including atomicity, consistency, isolation, and durability. In the embodiments of the present application, the terminal stores face features and user accounts through the SQLite database.
[0057] Computer Vision Technology (CV) is a science that studies how to enable machines to "see". Further, it refers to using cameras and computers to replace human eyes for machine vision such as target recognition, tracking, and measurement, and further performing graphic processing to make the computer-processed images more suitable for human eye observation or transmission to instrument detection. As a scientific discipline, computer vision studies related theories and technologies and attempts to establish an artificial intelligence system that can obtain information from images or multi-dimensional data. Computer vision technology usually includes image processing, image recognition, image semantic understanding, image retrieval, optical character recognition (OCR), video processing, video semantic understanding, video content / behavior recognition, 3D object reconstruction, 3D technology, virtual reality, augmented reality, simultaneous localization and mapping, etc. The method provided in the embodiments of the present application performs identity recognition on face features through computer vision technology.
[0058] The data clearing method provided in the embodiments of the present application can be applied to the following scenarios:
[0059] I. Face payment scenario.
[0060] In this application scenario, the data clearing method provided by the embodiments of the present application can be applied to a cash register device with a camera. For example, when a user uses the cash register device, a payment application for settlement is logged in on the user's smart phone. During the payment process of the user, the smart phone is connected to the cash register device, and the smart phone sends the payment account to the cash register device. The cash register device receives the user account recognized according to the face image. When the payment account is compared with the received user account and they are consistent, the payment process is entered; after the payment is completed, the user leaves the cash register device, and the used smart phone also leaves the cash register device. When the signal connection strength between the smart phone and the cash register device is worse than the connection condition, the cash register device clears the account data corresponding to the payment account, protecting the user's personal privacy and avoiding the leakage of account information.
[0061] II. Ticket checking and boarding scenario.
[0062] In this application scenario, the data clearing method provided by the embodiments of the present application can be applied to a ticket checking device with a camera. For example, a train ticket purchase account for purchasing train tickets is logged in on the user's smart phone. There is a ticket checking device with a camera set up at the railway station. During the ticket checking process, the smart phone is connected to the ticket checking device, and the smart phone sends the purchase account to the ticket checking device. The ticket checking device receives the user account recognized by the server according to the face image. When the purchase account is compared with the received user account and they are consistent, the verification process of the ticket information is entered; after the ticket checking device verifies the ticket information purchased by the user, the user leaves the ticket checking device, and the used smart phone also leaves the ticket checking device. When the signal connection strength between the smart phone and the ticket checking device is worse than the connection condition, the ticket checking device clears the account data corresponding to the purchase account, avoiding the leakage of the user's travel information.
[0063] The above only takes two application scenarios as examples for illustration. The data clearing method provided by the embodiments of the present application can also be applied to other scenarios (for example, the scenario where many users use the same medical device for physical examination). The embodiments of the present application do not limit the specific application scenarios.
[0064] The data clearing method provided by the embodiments of the present application can be applied to a computer device with strong data processing capabilities. In a possible implementation manner, the data clearing method provided by the embodiments of the present application can be applied to a personal computer, a workstation or a server, that is, the clearing of the face recognition device can be realized through a personal computer, a workstation or a server.
[0065] Figure 1The figure shows a schematic diagram of a computer system provided by an exemplary embodiment of the present application. The computer system 100 includes a face recognition device 111, a terminal 112, and a server 120. Among them, data communication is carried out between the face recognition device 111 and the server 120 through a communication network. Optionally, the communication network can be a wired network or a wireless network, and the communication network can be at least one of a local area network, a metropolitan area network, and a wide area network. The terminal 112 and the face recognition device carry out data communication through wireless communication technology. Optionally, the wireless communication technology includes at least one of Bluetooth technology, AirDrop, ZigBee technology, and Near Field Communication (NFC).
[0066] Schematically, an application program that supports face recognition is installed and run in the face recognition device 111. The application program can be at least one of a camera application program, a shopping application program, a payment application program, and a ticket purchase application program. When the application program is started, the camera of the face recognition device 111 is called to collect a face image, and the collected face image is sent to the server 120.
[0067] Optionally, the face recognition device 111 can be a mobile terminal such as a camera (such as an AI camera or a 3D camera), a self-checkout device, a ticket inspection device, a medical device, a smart phone, a tablet computer, a laptop computer, a smart robot, etc., or can also be a terminal such as a desktop computer or a projection computer. The type of the face recognition device in the embodiment of the present application is not limited.
[0068] The server 120 can be an independent physical server, or a server cluster or a distributed system composed of multiple physical servers, or can also be a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, Content Delivery Network (CDN), and big data and artificial intelligence platforms. In a possible implementation manner, the server 120 is the background server of the application program in the face recognition device 111.
[0069] Schematically, an application program is installed and running in the terminal 112. Schematically, the application program is the same as the application program installed and running in the face recognition device 111. When the terminal 112 is connected to the face recognition device 111, a prompt message is displayed on the terminal 112: The face recognition device is connected. The terminal 112 can send the user account logged in to the application program to the face recognition device 111. The face recognition device 111 matches the user account sent by the terminal 112 with the user account sent by the server 120. When the two are consistent, the user account is logged in on the face recognition device. Schematically, the user account can also be a membership account of a merchant.
[0070] Optionally, the terminal 112 can be a mobile terminal such as a smart phone, a tablet computer, a laptop computer, a smart robot, etc., or a terminal such as a desktop computer, a projection computer, etc. The embodiments of the present application do not limit the type of the terminal.
[0071] As Figure 1 shown, in this embodiment, a face recognition application program is installed in the face recognition device 111. When the face recognition application program is started, the camera component of the face recognition device 111 can be called for image acquisition. The face recognition device 111 collects a face image and sends the collected face image to the server 120. The server 120 is used to perform the following steps: Step 11, obtain a face image; Step 12, extract face features; Step 13, match a user account (the first user account) according to the face features; Step 14, send the user account to the face recognition device.
[0072] At the same time, when the terminal 112 is within the connection range of the face recognition device 111, the terminal 112 is connected to the face recognition device 111, and the terminal 112 sends the first user account to the face recognition device 111. The face recognition device 111 matches the first user account with the second user account. If the two match, the second user account (or the first user account) can be logged in on the face recognition device 111.
[0073] When the user is away from the face recognition device 111, the signal connection strength between the terminal 112 and the face recognition device 111 gradually weakens. When the signal connection strength is worse than the connection condition, the face recognition device 111 will delete the account data corresponding to the first user account. To avoid the leakage of user privacy caused by the residual account data corresponding to the first user account remaining in the face recognition device 111.
[0074] It can be understood that the above embodiments only take the case where a face recognition supported application program is installed in the terminal as an example. In actual use, the above data clearing method can also be applied to mini programs (programs that rely on the host program to run) or web pages. A so-called mini program is an application program that can be used without being downloaded and installed. In order to provide users with more diverse business services, developers can develop corresponding mini programs for the applications on the terminal (such as instant messaging applications, shopping applications, email applications, etc.). The mini program can be embedded into the application on the terminal as a sub-application. The application program on the terminal is the host program of the mini program. By running the sub-application (i.e., the corresponding mini program) in the application, corresponding business services can be provided for users. The embodiments of the present application do not limit this.
[0075] Figure 2 FIG. shows a flowchart of a data clearing method provided by an exemplary embodiment of the present application. In this embodiment, the method is described by taking it as an example that it is applied to a face recognition device 111 in a computer system 100 as shown in Figure 1 The method includes the following steps:
[0076] Step 201, obtain a first user account logged in to the face recognition device. The first user account is logged in when it matches a second user account, and the second user account is a user account logged in to the first terminal.
[0077] A face recognition application program is installed and running in the face recognition device. The face recognition application program is used to call a payment application program according to the first user account, and complete the payment process by logging in the first user account in the face recognition application program.
[0078] The first terminal is a terminal used by the first user. The first user is the user who is using the face recognition device. An application program corresponding to the face recognition application program is installed and running in the first terminal. The application program is the same application program as the face recognition application program or different application programs of the same type. The first terminal can be a smart phone, a tablet computer and other terminals. The following embodiments take the first terminal as a smart phone as an example for description.
[0079] In one example, the face recognition device is the cashier device of supermarket A. An application program 1 related to supermarket A is installed in the face recognition device, and the first user account is logged in to the application program 1; an application program 2 related to supermarket A is installed in the first terminal used by the first user, and the second user account is logged in to the application program 2. The second user account matches the first user account, that is, the two user accounts are user accounts of the same user.
[0080] In another example, the face recognition device is the cashier device of shopping mall B. A face recognition application 1 that matches the device is installed in the face recognition device, and a first user account is logged in to the face recognition application 1. A face recognition application 2 is installed in the first terminal used by the first user. The face recognition application 2 corresponds to the cashier device of type K, and the cashier device of shopping mall B belongs to type K. A second user account is logged in to the face recognition application 2, and the second user account is matched with the first user account, that is, the two user accounts are the user accounts of the same user.
[0081] Schematically, when the user account received by the face recognition device and the user account sent by the terminal used by the user indicate that they are the user accounts of the same user, the first user account is logged in to the face recognition device.
[0082] Step 202: Obtain the signal connection strength between the face recognition device and the first terminal.
[0083] The face recognition device and the first terminal can perform data communication through wireless communication technologies. The wireless communication technologies include at least one of Bluetooth technology, AirDrop, ZigBee technology, and NFC. In this embodiment, the signal connection strength is represented by the Bluetooth signal strength. The Bluetooth signal strength refers to the strength of the Bluetooth signal received by the face recognition device from the terminal, and is represented by RSSI (Received Signal Strength Indication). Calculate RSSI according to the following calculation formula:
[0084]
[0085] Among them, the logarithmic function lg(x) is a logarithmic function with base 10. P is the ratio of the received signal power to the transmitted signal power, and the unit of RSSI is usually expressed in decibel milliwatt (dBm). In an ideal state, the receiving party receives all the signals transmitted by the signal transmitting party. If the transmitting power is 1 milliwatt (mW), the maximum value of this RSSI is 0. Usually, the value of RSSI is negative. Therefore, the closer the value of RSSI is to 0, the closer the signal reception is to the ideal state, and the smaller the absolute value of the RSSI value, the greater the signal strength. For example, the signal strength of -50dBm is better than the signal strength of -70dBm.
[0086] Schematically, after the first terminal is connected to the face recognition device, the face recognition device receives the RSSI value sent by the first terminal at regular intervals, and determines the signal connection strength between the face recognition device and the first terminal according to the RSSI value.
[0087] Schematically, the face recognition device is a cashier device. After the cashier device is connected to the first terminal, it receives the RSSI value according to the payment situation of the order. For example, before the user completes the payment, the face recognition device receives the RSSI value sent by the first terminal every T1 time period. After the user completes the payment, the face recognition device receives the RSSI value sent by the first terminal every T2 time period, where T2 < T1, and both T1 and T2 are positive numbers.
[0088] Step 203, in response to the signal connection strength being worse than the connection condition, clear the account data corresponding to the first user account in the face recognition device.
[0089] The connection condition refers to the intensity value satisfied by the signal connection strength between the face recognition device and the terminal when the face recognition device reaches the degree of clearing the account data.
[0090] Determine that the signal connection strength is worse than the connection condition through the following two methods:
[0091] 1. In response to the signal connection strength decreasing to within the first signal range, determine that the signal connection strength is worse than the connection condition.
[0092] 2. In response to the signal connection strength being lower than the signal strength threshold, determine that the signal connection strength is worse than the connection condition.
[0093] In one example, the first signal range is [-100dBm, -50dBm]. The face recognition device receives the RSSI value of -70dBm sent by the first terminal. Since this RSSI value is within the first signal range, the face recognition device determines that the first terminal will leave the connection range of the face recognition device, that is, the user is about to stop using the face recognition device (or the user is about to leave the face recognition device), and the face recognition device clears the account data corresponding to the first user account.
[0094] In another example, the signal strength threshold is -70dBm. The face recognition device receives the RSSI value of -100dBm sent by the first terminal. Since this RSSI value is less than the signal strength threshold, the face recognition device determines that the first terminal will leave the connection range of the face recognition device, that is, the user is about to stop using the face recognition device (or the user is about to leave the face recognition device), and the face recognition device clears the account data corresponding to the first user account.
[0095] The account data refers to the data associated with the user account, and the account data includes at least one of the login time of the account, the logout time of the account, the events executed during the login period (such as payment events), the account password, the order information corresponding to the account, and the face features associated with the account.
[0096] In summary, for the method provided in this embodiment, when the signal connection strength between the face recognition device and the first terminal is worse than the connection condition, the face recognition device is controlled to clear the account data of the first user account. When the terminal used by the user is far from the connection range of the face recognition device, the face recognition device performs a fallback cleaning operation on the account data of the first user account, avoiding the leakage of user personal information caused by multiple users using the face recognition device simultaneously when the face recognition device is a public device.
[0097] Figure 3 FIG. shows a flowchart of a data clearing method provided by another exemplary embodiment of the present application. In this embodiment, the method is applied to the face recognition device 111 in the computer system 100 as shown in Figure 1 and is described by taking the face recognition device 111 in the computer system 100 as an example. The method includes the following steps:
[0098] Step 301, receive the first user account sent by the server, where the first user account is obtained by the server according to the first face image collected by the face recognition device.
[0099] When a user uses the face recognition device, the user stands in front of the face recognition device. The face recognition device has a 3D camera and collects a face image of the user's face. The face recognition device uploads the collected face image to the server. The server is the background server of the face recognition application installed in the face recognition device, such as Figure 1 the server 120 shown.
[0100] Schematically, the server includes a machine learning model with face recognition capabilities. The machine learning model performs identity recognition on the face image. First, face features are extracted from the face image, and then the face features are input into the machine learning model to output identity information. For example, the face in face image 1 represents user 1, and the user account owned by user 1 is user account 1.
[0101] Schematically, the server includes a face feature - account database. In this database, the face uses the face feature as the key (Key) and the user account as the value (Value), and the face feature and the user account are stored in the form of key - value pairs. The server includes a machine learning model with face feature extraction capabilities. The machine learning model extracts face features from the face image, and determines the user account from the face feature - account database according to the face features. The face feature - account database can be an SQLite database. The SQLite database is a lightweight database and a relational data management system that complies with ACID.
[0102] Step 302, in response to the face recognition device establishing a connection with the first terminal, receive the second user account sent by the first terminal.
[0103] The first user approaches the face recognition device, for example, stands in front of the face recognition device. The first terminal used by the first user also approaches the face recognition device. An application program corresponding to the face recognition device is installed and running on the first terminal. Schematically, the face recognition device includes a Bluetooth unit, and the first terminal also includes a Bluetooth unit. The face recognition device and the first terminal can be connected through the Bluetooth unit and conduct data communication. After the first terminal and the face recognition device are connected, the first terminal sends the second user account logged in the above application program to the face recognition device through the Bluetooth unit.
[0104] In some embodiments, the first terminal and the face recognition device are under the same wireless network, such as a Wireless-Fidelity (Wi-Fi) network. The first terminal sends the second user account logged in the above application program to the face recognition device.
[0105] Step 303, in response to the matching of the first user account and the second user account, control the first user account to log in on the face recognition device.
[0106] The face recognition device matches the first user account sent by the server with the second user account sent by the first. If the two user accounts are the same, the first user account is automatically logged in on the face recognition device.
[0107] When the first user account and the second user account do not match, perform the following steps S1 to S4:
[0108] S1, in response to the non-matching of the first user account and the second user account, disconnect the connection between the face recognition device and the first terminal.
[0109] If the first user account and the second user account are inconsistent, disconnect the face recognition device from the first terminal.
[0110] S2, obtain a candidate signal strength list, which includes the signal connection strengths corresponding to at least two terminals.
[0111] Schematically, there are multiple users using the same face recognition device. Taking the Bluetooth connection method as an example, the face recognition device can detect the signal connection strengths corresponding to multiple terminals used by multiple users and form a candidate signal strength list. Schematically, the signal connection strengths in the candidate signal strength list are sorted in the order of weaker signal strength, or in the order of the time when the signal strength is detected, or in the order of the terminal identifier.
[0112] S3, connect to the terminals corresponding to the signal connection strengths in the candidate signal strength list in sequence and receive the third user account sent by the second terminal that has been connected.
[0113] In one example, the candidate signal strength list includes Terminal 1, Terminal 2, and Terminal 3, with signal connection strengths of Strength 1, Strength 2, and Strength 3 respectively (Strength 1 > Strength 2 > Strength 3). The face recognition device sequentially selects Terminal 1, Terminal 2, and Terminal 3 from the candidate signal strength list for connection. When Terminal 1 is connected to the face recognition device, Terminal 1 sends the logged-in user account 1 to the face recognition device, and this user account 1 is inconsistent with the first user account; the face recognition device is connected to Terminal 2, and Terminal 2 sends the logged-in user account 2 to the face recognition device, and this user account 2 is consistent with the first user account, and this user account 2 is the third user account.
[0114] S4. In response to the match between the third user account and the first user account, control the first user account to log in to the face recognition device.
[0115] When the face recognition device re-determines the matching user account, control the first user account to log in.
[0116] Step 304: Obtain the first user account logged in to the face recognition device. The first user account is logged in under the condition of matching with the second user account, and the second user account is the user account logged in to the first terminal.
[0117] After the face recognition device logs in the first user account, the user can perform business events through the face recognition device. For example, if the face recognition device is a cashier device, the cashier device displays the purchase orders of the first user account, and the user can make payments for the purchase orders on this cashier device. Payment application programs are installed on both the face recognition device and the first terminal; or, if the face recognition device is a ticket verification device, the ticket verification device verifies whether the ticket purchase information corresponding to the first user account matches the user's identity. After the ticket verification is passed, the turnstile opens. Ticket application programs are installed on both the face recognition device and the first terminal; or, if the face recognition device is a medical device, the medical device can display the registration information, medical records, physical examination reports, etc. corresponding to the first user account, and the user can choose to print the registration form, print the medical records, print the physical examination report, etc.
[0118] When the face recognition device is applied in different fields, corresponding application programs are installed in the face recognition device.
[0119] Step 305: Obtain the signal connection strength between the face recognition device and the first terminal.
[0120] Schematically, the signal connection strength between the first terminal and the face recognition device is represented by the RSSI value. After the first terminal is connected to the face recognition device, the face recognition device receives the RSSI value sent by the first terminal at regular intervals, and determines the signal connection strength between the face recognition device and the first terminal according to the RSSI value.
[0121] Step 306a, in response to the signal connection strength being lower than the signal strength threshold, obtain an association relationship, where the association relationship is used to characterize the relationship between the user account and the storage address of the account data.
[0122] Step 306b, in response to the signal connection strength being within the first signal range, obtain an association relationship, where the association relationship is used to characterize the relationship between the user account and the storage address of the account data.
[0123] Schematically, the signal strength threshold is -70 dBm, the signal connection strength is -100 dBm, and the face recognition device obtains the relationship used to characterize the relationship between the user account and the storage address of the account data.
[0124] Schematically, the first signal range is [-100 dBm, -50 dBm], the signal connection strength is -70 dBm, and the face recognition device obtains the relationship used to characterize the relationship between the user account and the storage address of the account data.
[0125] Use Table 1 to represent the association relationship between the user account and the storage address of the account data.
[0126] Table 1
[0127]
[0128] In some embodiments, when the signal connection strength between the terminal and the face recognition device is lower than the strength threshold, the terminal sends the second user account to the face recognition device again, so that the face recognition device confirms to delete the corresponding account data to avoid misdeletion operations.
[0129] Step 307, obtain the storage address of the account data according to the association relationship and the first user account.
[0130] Schematically, the first user account is Account 1, and the storage address corresponding to this user account is Storage Address 1.
[0131] Step 308, clear the account data from the storage address.
[0132] The face recognition device clears the account data corresponding to Account 1 from Storage Address 1. The account data includes at least one of the account's login time, the account's logout time, the events executed during the login time (such as payment events, identity verification events, etc.), the account password, the order information corresponding to the account (including but not limited to ticket purchase information), and the face features associated with the account.
[0133] Schematically, the face recognition device includes a cashier device, and this cashier device is used to generate payment information after the purchase order settlement. Payment information refers to information related to the payment process, such as payment method, payment amount, payment completion time, payment account, whether to participate in the discount, discount type, etc.
[0134] When the face recognition device is a cash register device, the steps for the cash register device to clear the account information include the following steps a to c:
[0135] Step a, obtain the account type of the first user account.
[0136] The cash register device determines the account type of the first user account, and the account type includes a membership type and a non - membership type.
[0137] Step b, in response to the account type belonging to the membership type, clear the membership preferential information and the first payment information corresponding to the first user account from the storage address.
[0138] The membership preferential information refers to the preferential information corresponding to the membership account, such as coupon, discount card, points redemption and other information. The first payment information includes the payment method, the payment amount (including the payment amount after actually enjoying the membership preferential information and the payment amount before not enjoying the membership preferential information), and the payment account.
[0139] Illustratively, the cash register device is the cash register device of supermarket A, and the first user account is the membership account of supermarket A. When settling the purchase order corresponding to the first user account, the cash register device determines that coupon 1 is used for this purchase order, the actual payment amount is 100 yuan, the amount to be paid before not using coupon 1 is 120 yuan, the payment method is face recognition payment method, the payment time is 1:00 p.m., and the payment account is payment account 1. When the cash register device clears the account data, it will clear the relevant data of the coupon information, payment amount, payment time and payment account corresponding to the first user account.
[0140] In some embodiments, the first user account and the payment account used by the user are the same account. For example, the membership card of supermarket A is a recharge card, and the user consumes by recharging the recharge card. The membership account corresponding to this membership card is the payment account for payment.
[0141] Step c, in response to the account type belonging to the non - membership type, clear the second payment information corresponding to the first user account from the storage address.
[0142] The second payment information includes the payment method, the payment amount, and the payment account.
[0143] Illustratively, the first user account is a non - membership account of supermarket A. When settling the purchase order corresponding to the first user account, the cash register device determines that the actual payment amount for this purchase order is 100 yuan, without enjoying any preferential information, the payment method is face recognition payment method, the payment time is 2:00 p.m., and the payment account is payment account 1. The cash register device clears the relevant data of the payment amount, payment time and payment account corresponding to the first user account from the storage address.
[0144] In summary, for the method of this embodiment, when the signal connection strength between the face recognition device and the first terminal is worse than the connection condition, the face recognition device is controlled to clear the account data of the first user account. When the terminal used by the user is far from the connection range of the face recognition device, the face recognition device performs a fallback cleaning operation on the account data of the first user account, avoiding the leakage of user personal information caused by multiple users using the face recognition device simultaneously when it is a public device.
[0145] For the method of this embodiment, the association relationship is also obtained in two ways: when the signal connection strength is lower than the strength threshold or the signal connection strength is within the first signal interval, making the way for the face recognition device to judge the signal connection strength more flexible. In addition, by associating the storage address of the first user account and the account data, the face recognition device can accurately delete the account data associated with the first user account according to the storage address, avoiding the retention of account data in the face recognition device and causing user privacy leakage.
[0146] For the method of this embodiment, after the face recognition device establishes a connection with the terminal, the first user account sent by the terminal is also matched with the second user account obtained by the face recognition device according to the face image. When the two match, the first user account is controlled to log in on the face recognition device, enabling the user account to quickly log in on the face recognition device and facilitating the face recognition device to provide subsequent services for the user.
[0147] For the method of this embodiment, when the first user account does not match the second user account, the connection between the face recognition device and the terminal is disconnected, and the terminal corresponding to the signal connection strength in the candidate signal strength list is connected in sequence, and the third user account sent by the connected terminal is received and matched with the first user account. When the match is successful, the first user account can also log in. Without manual operation by the user, the face recognition device can automatically log in to the user account that matches the user, facilitating user use.
[0148] For the method of this embodiment, the user accounts are also distinguished into members and non - members, and the corresponding account data is cleared for different types of user accounts, enabling the account data to be accurately cleared, avoiding the retention of account data in the face recognition device and causing user privacy leakage.
[0149] Based on Figure 3 In an optional embodiment, the face recognition device includes a cashier device. When the first user finishes the payment process and leaves the cashier device, the cashier device disconnects the connection with the first terminal corresponding to the first user account and performs the following steps 311 to 313, as Figure 4 shown:
[0150] Step 311, in response to the end of the payment process corresponding to the first user account and the disconnection from the first terminal, obtain a list of candidate signal strengths, where the list of candidate signal strengths includes the signal connection strengths corresponding to at least two terminals.
[0151] After the first user, there are multiple users queuing up to use the cash register device. The multiple smartphones used by these multiple users correspond to their respective signal connection strengths, and the cash register device detects these signal connection strengths to form a list of candidate signal strengths. In one example, the signal connection strengths include terminal a and terminal b, and the signal connection strengths are strength 1 and strength 2 respectively (strength 1 > strength 2).
[0152] Step 312, in response to receiving the fourth user account sent by the server, sequentially connect to the terminals corresponding to the signal connection strengths in the list of candidate signal strengths, and receive the fifth user account sent by the connected third terminal. The fourth user account is recognized by the server based on the second face image collected by the face recognition device.
[0153] Illustratively, after the first user, the second user uses the cash register device. The second user stands in front of the cash register device, and the camera of the cash register device captures the face image of the second user and sends the face image of the second user to the server. The server performs identity recognition based on the face image of the second user to obtain the fourth user account, and the server sends the fourth user account to the cash register device.
[0154] The cash register device sequentially connects to terminal 1 and terminal 2 from the list of candidate signal strengths. When the cash register device connects to terminal 1, terminal 1 sends account a (the fifth user account) to the cash register device; when the cash register device connects to terminal 2, terminal 2 sends account b (the fifth user account) to the cash register device.
[0155] Step 313, in response to the matching of the fifth user account and the fourth user account, control the fourth user account to log in to the face recognition device.
[0156] Similarly, when the user account sent by the server matches the user account sent by the terminal, the fourth user account logs in to the face recognition device. That is, the user account corresponding to the second user logs in to the cash register device.
[0157] In summary, the method of this embodiment also, after the previous user finishes using the face recognition device, the face recognition device automatically connects to the terminals corresponding to the signal connection strengths in the candidate strength list in sequence, without the user having to manually select the terminal used by himself to connect to the face recognition device, improving the connection efficiency of the device.
[0158] Based on Figure 3In an alternative embodiment, the face recognition device includes a cash register device. When the first user makes a payment for a purchase order, the face recognition device performs the following steps 321 to 323, as Figure 5 shown:
[0159] Step 321, display the purchase order corresponding to the first user account.
[0160] Illustratively, the cash register device has a display screen, and the purchase order corresponding to the first user account is displayed on the display screen. In one example, the purchase order is generated by scanning the barcodes of the goods; in another example, the purchase order is a purchase order generated by the user selecting goods online through a terminal and sent to the cash register device through the terminal.
[0161] Step 322, receive the payment operation for the purchase order.
[0162] Illustratively, payment controls are displayed on the display screen of the cash register device, and the user clicks on the payment control to make a payment. The payment operation includes at least one of the following operations: click operation, double-click operation, long-press operation, drag operation, slide operation, drag operation, and their combined operations. The payment methods include scanning the collection code payment method, presenting the payment code payment method, face payment method, and inputting the password payment method.
[0163] Step 323, in response to receiving the payment success information sent by the server and the signal connection strength between the face recognition device and the first terminal being worse than the connection condition, clear the account data corresponding to the first user account. The payment success information is generated by the server after the payment for the purchase order corresponding to the first user account is successful.
[0164] After the user makes a payment for the purchase order, the cash register device sends the payment result to the server. The server generates the payment success information based on the payment result and sends the payment success information to the cash register device. When the cash register device receives the payment success information, it detects that the signal connection strength between the first terminal and the cash register device is worse than the connection condition and clears the account data corresponding to the first user account.
[0165] In summary, the method of this embodiment avoids the problem of payment information leakage after the user makes a payment by clearing the account data corresponding to the first user account when the signal connection strength is worse than the connection condition after the user's payment is completed.
[0166] Based on Figure 3 In an alternative embodiment, when the account type of the first user account is not a membership type, the user can be guided to register for membership. The face recognition device performs the following steps 331 and 332, as Figure 6 shown:
[0167] Step 331: In response to the type of the first user account belonging to the non - member type and receiving a membership registration operation, obtain the face image collected by the face recognition device and the first user account.
[0168] Illustratively, the face recognition device includes a cash register device. The cash register device has a display screen. When the cash register device detects that the first user account is a non - member account, the display screen shows a membership registration guidance page, which is used to help users register for a membership account. Illustratively, users complete the registration of the membership account by filling in information such as mobile phone number, birthday, name, and gender. The cash register device also has a camera, and the face image of the user is collected through the camera to obtain the first user account sent by the server.
[0169] Step 332: Generate a membership account according to the face image and the first user account.
[0170] Illustratively, the collected face image is used as the account avatar corresponding to the membership account. Next time, the user can use the "face - swiping" method to enable the cash register device to obtain the membership account. Illustratively, a membership flag is added to the first user account to generate a membership account, that is, without changing the first user account currently used by the user, the first user account is distinguished from the non - member account through the membership flag.
[0171] In summary, the method provided in this embodiment guides users to register membership information through a face recognition device, thereby facilitating users to verify their membership identities in a "face - swiping" manner and improving the subsequent service efficiency.
[0172] It can be understood that the above Figure 4 、 Figure 5 、 Figure 6 Corresponding method embodiments can be implemented separately or in combination, and the embodiments of the present application do not limit this.
[0173] In one example, the face recognition device is a self - checkout device or a cash register device in an unmanned supermarket.
[0174] Figure 7 Fig. shows the system framework diagram for clearing account data provided by an exemplary embodiment of the present application. The system includes a server 120, a face recognition device 111, and a terminal 112.
[0175] The face recognition device 111 is a self-checkout device equipped with a 3D camera 21, which is used to collect face images. The 3D camera 21 also includes a cache module, which is used to cache the data stream collected by the sensor of the 3D camera. For example, RGB image data stream (R represents red, G represents green, B represents blue), depth image stream, etc. It will also cache the face features corresponding to the user accounts that have logged in to the face recognition device 111. The data format can be stored in the following format: {userid:XXXX, data: data stream storage address}.
[0176] A face recognition application program is also installed in the face recognition device 111. The face recognition application program includes a face collection module 22 and a face optimization module 23. The face collection module 22 is used to call the 3D camera to collect face images; the face optimization module 23 is used to comprehensively evaluate and select the optimal face image through coefficient indicators such as face size, face angle, image contrast, image brightness, and image clarity. Schematically, after the face optimization module 23 optimizes the face image, it sends the face image to the server 120, and a waiting page or a loading page is displayed on the user interface of the face recognition device 111. When the face recognition device 111 receives the identity information corresponding to the face image sent by the server 120, the content corresponding to the identity information, such as membership account, payment information, etc., is displayed on the user interface.
[0177] The face recognition application program also includes a membership module 24, which is used to manage the membership system of the merchant. Therefore, during the process of users using membership-related services, the face recognition device 111 caches membership identity information, membership preferential information, and payment information. The data format can be stored in the following format: {userid:XXXX}.
[0178] The image data stream collected by the face collection module 22 included in the face recognition application program is sent to the face optimization module 23, and the face image optimized by the face optimization module 23 is sent to the server 120 through the network module 25.
[0179] Server 120 includes a face recognition service 26 and a face feature - account database 27. Server 120 extracts face features from the received face images, matches the face features with the face feature - account database 27. If the match is successful, it determines the user account (the first user account) corresponding to the face features. Server 120 sends the second user account to the face recognition device 111 through the network module 25. Server 120 also includes a basic account service, which is used to pull relevant basic information, such as the user's gender, age, birthday, hobbies and other information, through the user account. Server 120 also includes a payment service, which is used to call the payment system to make a payment after obtaining the user identity through face recognition or password input.
[0180] Meanwhile, when the terminal 112 is close to the face recognition device 111, the terminal 112 includes a Bluetooth module 28. The terminal 112 and the face recognition device 111 are connected through the Bluetooth module 28. The terminal sends the second user account logged in the face recognition application to the face recognition device 111.
[0181] The face recognition device 111 matches the first user account with the second user account. When the two are the same, it controls the first user account to log in to the face recognition device; when the two are different, it controls the face recognition device to disconnect from the terminal.
[0182] After the face recognition device 111 has established a connection with the terminal 112, when the user leaves the face recognition device, the signal connection strength between the face recognition device and the terminal will gradually weaken. The face recognition device deletes the account data corresponding to the second user account according to the signal connection strength, avoiding the leakage of the user's privacy information caused by the second user account remaining in the face recognition device.
[0183] The face recognition device 111 also includes a startup module 29, which is used to start the payment process in the way of face - brushing payment when the face recognition device is in an idle state. There is a button displayed on the display screen of the face recognition device 111. When the user clicks the button, it is used as the starting point of the user's current session to start the face recognition module and start a new round of face recognition process.
[0184] The data clearing method provided by the embodiments of the present application is described in combination with the terminal used by the user. Figure 8 The flowchart of the data clearing method provided by another exemplary embodiment of the present application is shown. In this embodiment, it is described by taking the method applied to the computer system 100 as shown in Figure 1 as an example. The method includes the following steps:
[0185] Step 801, the terminal displays a device connection page, and the device connection page includes a device identification switch.
[0186] Schematically, taking the terminal as a smart phone as an example. An application program corresponding to the face recognition device is installed in the smart phone. The user clicks on the application program to enter the device connection page 40. As Figure 9 shown, a device recognition switch 41 is displayed on the device connection page 40.
[0187] Step 802, in response to receiving a trigger operation on the device recognition switch, the terminal controls the connection unit to be in a connectable state.
[0188] After the user triggers the device recognition switch 41, the application program calls the connection unit of the terminal, so that the connection unit is in a connectable state. Schematically, the connection unit is a Bluetooth unit. After the user triggers the device recognition switch 41, the application program turns on the Bluetooth switch of the terminal, and at the same time, a prompt message 42 is displayed on the device connection page 40. The content of the prompt message 42 is: Your Bluetooth function has been turned on.
[0189] Step 803, in response to the face recognition device being within the connection range, the terminal connects to the face recognition device through the connection unit.
[0190] When the smart phone is within the connection range of the face recognition device, since the Bluetooth switch of the smart phone is in the on state, nearby face recognition devices can be searched for, or the smart phone can be searched for by nearby face recognition devices. In some embodiments, the face recognition device connects to the terminal corresponding to the signal strength in sequence according to the signal connection strength in the candidate signal strength list; in other embodiments, the user can connect to the face recognition device by manual selection.
[0191] Step 804, the terminal sends the second user account to the face recognition device.
[0192] After the terminal is connected to the face recognition device, the terminal sends the second user account to the face recognition device. The second user account is logged in to the application program corresponding to the face recognition device, that is, the application program used to turn on the device recognition switch.
[0193] Step 805, the face recognition device collects a face image and sends the face image to the server.
[0194] The face recognition device has a 3D camera for collecting the facial image of the user to form a face image.
[0195] Step 806, the face recognition device receives the first user account sent by the server.
[0196] Step 807, the face recognition device compares the first user account with the second user account.
[0197] Step 808, in response to the first user account being the same as the second user account, the face recognition device controls the first user account to log in.
[0198] Step 809, obtain the signal connection strength between the face recognition device and the terminal.
[0199] Step 810, in response to the signal connection strength between the terminal and the face recognition device being worse than the connection condition, clear the account data corresponding to the first user account.
[0200] For steps 806 to 808, refer to the implementation manner of step 303 in the above Figure 3 embodiment; for the implementation manner of steps 809 to 810, refer to steps 305 to 308 in the above Figure 3 embodiment, which will not be elaborated here.
[0201] In summary, the method of this embodiment enables the user to flexibly control the connection between the terminal and the face recognition device by setting a device recognition switch on the device connection page, thereby making it more convenient and fast for the subsequent user to use the face recognition device and for the face recognition device to clear the account data.
[0202] The following is an apparatus embodiment of the present application, which can be used to execute the method embodiment of the present application. For details not disclosed in the apparatus embodiment of the present application, please refer to the method embodiment of the present application.
[0203] Figure 10 The block diagram of a data clearing device provided by an exemplary embodiment of the present application is shown. The device includes the following parts:
[0204] An obtaining module 1010, configured to obtain a first user account logged in the face recognition device, where the first user account is logged in the case of matching with a second user account, and the second user account is a user account logged in the first terminal;
[0205] The obtaining module 1010 is configured to obtain the signal connection strength between the face recognition device and the first terminal;
[0206] A data clearing module 1020, configured to clear the account data corresponding to the first user account in the face recognition device in response to the signal connection strength being worse than the connection condition.
[0207] In an optional embodiment, the obtaining module 1010 is configured to obtain an association relationship in response to the signal connection strength being worse than the connection condition, where the association relationship is used to represent the relationship between the user account and the storage address of the account data; obtain the storage address of the account data according to the association relationship and the first user account; the data clearing module 1020 is configured to clear the account data from the storage address.
[0208] In an optional embodiment, the face recognition device includes a cash register device, which is used to generate payment information after the settlement of a purchase order;
[0209] The obtaining module 1010 is configured to obtain the account type of the first user account;
[0210] The data clearing module 1020 is configured to, in response to the account type belonging to the member type, clear the member preferential information and the first payment information corresponding to the first user account from the storage address; in response to the account type belonging to the non-member type, clear the second payment information corresponding to the first user account from the storage address.
[0211] In an optional embodiment, the device includes a processing module 1030;
[0212] The processing module 1030 is configured to, in response to the signal connection strength decreasing to within the first signal range, determine that the signal connection strength is worse than the connection condition; or, in response to the signal connection strength being lower than the signal strength threshold, determine that the signal connection strength is worse than the connection condition.
[0213] In an optional embodiment, the device includes a receiving module 1040;
[0214] The receiving module 1040 is configured to receive the first user account sent by the server, where the first user account is obtained by the server based on the first face image collected by the face recognition device; in response to the face recognition device establishing a connection with the first terminal, receive the second user account sent by the first terminal; the processing module is configured to, in response to the first user account and the second user account matching, control the first user account to log in on the face recognition device.
[0215] In an optional embodiment, the processing module 1030 is configured to, in response to the first user account not matching the second user account, disconnect the connection between the face recognition device and the first terminal;
[0216] The obtaining module 1010 is configured to obtain a candidate signal strength list, where the candidate signal strength list includes the signal connection strengths corresponding to at least two terminals;
[0217] The receiving module 1040 is configured to sequentially connect to the terminals corresponding to the signal connection strengths in the candidate signal strength list, and receive the third user account sent by the connected second terminal;
[0218] The processing module 1030 is configured to, in response to the third user account matching the first user account, control the first user account to log in on the face recognition device.
[0219] In an optional embodiment, the obtaining module 1010 is configured to obtain a list of candidate signal strengths in response to the end of the payment process corresponding to the first user account and the disconnection from the first terminal. The list of candidate signal strengths includes the signal connection strengths corresponding to at least two terminals.
[0220] The receiving module 1040 is configured to, in response to receiving the fourth user account sent by the server, sequentially connect to the terminals corresponding to the signal connection strengths in the list of candidate signal strengths, and receive the fifth user account sent by the connected third terminal. The fourth user account is recognized by the server based on the second face image collected by the face recognition device.
[0221] The processing module 1030 is configured to control the fourth user account to log in to the face recognition device in response to the matching of the fifth user account and the fourth user account.
[0222] In an optional embodiment, the device includes a display module 1050.
[0223] The display module 1050 is configured to display the purchase order corresponding to the first user account.
[0224] The receiving module 1040 is configured to receive a payment operation for the purchase order.
[0225] The data clearing module 1020 is configured to clear the account data corresponding to the first user account in response to receiving the payment success information sent by the server and the signal connection strength between the face recognition device and the first terminal being worse than the connection condition. The payment success information is generated by the server after the payment for the purchase order corresponding to the first user account is successful.
[0226] In an optional embodiment, the obtaining module 1010 is configured to obtain the face image collected by the face recognition device and the first user account in response to the type of the first user account belonging to the non - member type and receiving a membership registration operation.
[0227] The processing module 1030 is configured to generate a membership account based on the face image and the first user account.
[0228] In summary, the device of this embodiment controls the face recognition device to clear the account data of the first user account by the signal connection strength between the face recognition device and the first terminal being worse than the connection condition. When the terminal used by the user is far from the connection range of the face recognition device, the face recognition device performs a fallback cleaning operation on the account data of the first user account, avoiding the leakage of user personal information caused by multiple users using it simultaneously when the face recognition device is a public device.
[0229] The device of this embodiment also obtains the association relationship in two ways: when the signal connection strength is lower than the strength threshold or the signal connection strength is within the first signal interval, making the way for the face recognition device to judge the signal connection strength more flexible. In addition, by associating the first user account with the storage address of the account data, the face recognition device can accurately delete the account data associated with the first user account according to the storage address, avoiding the retention of account data in the face recognition device and causing the leakage of user privacy.
[0230] When the face recognition device is connected to the terminal, the device of this embodiment also matches the first user account sent by the terminal with the second user account obtained by the face recognition device according to the face image. When the two match, it controls the first user account to log in on the face recognition device, so that the user account can be quickly logged in on the face recognition device, facilitating the face recognition device to provide subsequent services for the user.
[0231] When the first user account does not match the second user account, the device of this embodiment disconnects the connection between the face recognition device and the terminal, sequentially connects to the terminals corresponding to the signal connection strengths in the candidate signal strength list, and receives the third user account sent by the connected terminal to match with the first user account. When the match is successful, the first user account can also log in. Without manual operation by the user, the face recognition device can automatically log in to the user account that matches the user, facilitating the user to use.
[0232] The device of this embodiment also differentiates user accounts into members and non - members, thereby clearing the corresponding account data for different types of user accounts, enabling the account data to be accurately cleared, avoiding the retention of account data in the face recognition device and causing the leakage of user privacy.
[0233] After the previous user finishes using the face recognition device, the device of this embodiment also automatically connects the face recognition device to the terminals corresponding to the signal connection strengths in the candidate strength list in sequence, without the user having to manually select the terminal used by himself to connect to the face recognition device, improving the connection efficiency of the device.
[0234] The device of this embodiment also clears the account data corresponding to the first user account after the user's payment is completed and when the signal connection strength is worse than the connection condition, avoiding the problem of payment information leakage after the user's payment.
[0235] The device of this embodiment also guides the user to register member information through the face recognition device, thereby facilitating the user to verify the member identity in the way of "face - swiping" and improving the subsequent service efficiency.
[0236] Figure 11The structure diagram of a server provided by an exemplary embodiment of the present application is shown. The server may be the server 120 in the computer system 100 as shown in Figure 1 Figure 1. Specifically, it includes the following parts.
[0237] The server 1100 includes a Central Processing Unit (CPU) 1101, a system memory 1104 including a Random Access Memory (RAM) 1102 and a Read Only Memory (ROM) 1103, and a system bus 1105 connecting the system memory 1104 and the central processing unit 1101. The server 1100 also includes a Basic Input / Output System (I / O system) 1106 for transferring information between various devices within the computer, and a mass storage device 1107 for storing an operating system 1113, application programs 1114, and other program modules 1115.
[0238] The Basic Input / Output System 1106 includes a display 1108 for displaying information and input devices 1109 such as a mouse and a keyboard for user input. Among them, both the display 1108 and the input devices 1109 are connected to the central processing unit 1101 through an input / output controller 1110 connected to the system bus 1105. The Basic Input / Output System 1106 may also include an input / output controller 1110 for receiving and processing inputs from multiple other devices such as a keyboard, a mouse, or an electronic stylus. Similarly, the input / output controller 1110 also provides outputs to a display screen, a printer, or other types of output devices.
[0239] The mass storage device 1107 is connected to the central processing unit 1101 through a mass storage controller (not shown) connected to the system bus 1105. The mass storage device 1107 and its associated computer-readable medium provide non-volatile storage for the server 1100. That is to say, the mass storage device 1107 may include a computer-readable medium (not shown) such as a hard disk or a Compact Disc Read Only Memory (CD-ROM) drive.
[0240] A computer-readable medium may include a computer storage medium and a communication medium. The computer storage medium includes volatile and non-volatile, removable and non-removable media implemented by any method or technology for storing information such as computer-readable instructions, data structures, program modules, or other data. The computer storage medium includes RAM, ROM, erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other solid-state storage technologies, CD-ROM, digital versatile disc (DVD), or solid-state drive (SSD), other optical storage, magnetic tape cartridges, tapes, magnetic disk storage, or other magnetic storage devices. Among them, random access memory may include resistive random access memory (ReRAM) and dynamic random access memory (DRAM). Of course, those skilled in the art know that the computer storage medium is not limited to the above several types. The above-mentioned system memory 1104 and mass storage device 1107 may be collectively referred to as memory.
[0241] According to various embodiments of the present application, the server 1100 may also run by connecting to a remote computer on the network through a network such as the Internet. That is, the server 1100 may be connected to the network 1112 through the network interface unit 1111 connected to the system bus 1105, or in other words, the network interface unit 1111 may also be used to connect to other types of networks or remote computer systems (not shown).
[0242] The above-mentioned memory further includes one or more programs, and one or more programs are stored in the memory and configured to be executed by the CPU.
[0243] Figure 12The structural block diagram of a computer device 1200 provided by an exemplary embodiment of the present application is shown. The device type of the computer device 1200 may be a portable mobile terminal, such as: a smart phone, a tablet computer, an MP3 player (Moving Picture Experts Group Audio Layer III), an MP4 (Moving Picture Experts Group Audio Layer IV) player. The computer device 1200 may also be referred to by other names such as a user device, a portable terminal, etc. The computer device 1200 may be, for example, Figure 1 the face recognition device 111 as shown, or may also be the terminal 112 used by the user.
[0244] Generally, the computer device 1200 includes: a processor 1201 and a memory 1202.
[0245] The processor 1201 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 1201 may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), PLA (Programmable Logic Array). The processor 1201 may also include a main processor and a co-processor. The main processor is a processor for processing data in the wake state, also known as the CPU (Central Processing Unit); the co-processor is a low-power processor for processing data in the standby state. In some embodiments, the processor 1201 may be integrated with a GPU (Graphics Processing Unit), and the GPU is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 1201 may also include an AI (Artificial Intelligence) processor, and the AI processor is used to process computational operations related to machine learning.
[0246] The memory 1202 may include one or more computer-readable storage media, which may be tangible and non-transitory. The memory 1202 may also include high-speed random access memory and non-volatile memory, such as one or more disk storage devices and flash storage devices. In some embodiments, the non-transitory computer-readable storage media in the memory 1202 is used to store at least one instruction for being executed by the processor 1201 to implement the data clearing method provided in the embodiments of the present application.
[0247] In some embodiments, the computer device 1200 may further optionally include: a peripheral device interface 1203 and at least one peripheral device. Specifically, the peripheral device includes at least one of a radio frequency circuit 1204, a touch display screen 1205, a camera assembly 1206, an audio circuit 1207, and a power supply 1208.
[0248] The peripheral device interface 1203 can be used to connect at least one peripheral device related to I / O (Input / Output) to the processor 1201 and the memory 1202. In some embodiments, the processor 1201, the memory 1202, and the peripheral device interface 1203 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 1201, the memory 1202, and the peripheral device interface 1203 can be implemented on a separate chip or circuit board, and the present embodiment does not limit this.
[0249] The radio frequency circuit 1204 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The radio frequency circuit 1204 communicates with a communication network and other communication devices through electromagnetic signals. The radio frequency circuit 1204 converts an electrical signal into an electromagnetic signal for transmission, or converts the received electromagnetic signal into an electrical signal. Optionally, the radio frequency circuit 1204 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a subscriber identity module card, etc. The radio frequency circuit 1204 can communicate with other terminals through at least one wireless communication protocol. The wireless communication protocol includes but is not limited to: the World Wide Web, a metropolitan area network, an intranet, generations of mobile communication networks (2G, 3G, 4G, 5G, and their combinations), a wireless local area network, and a Wireless Fidelity (WiFi) network. In some embodiments, the radio frequency circuit 1204 may further include a circuit related to NFC (Near Field Communication), and the present application does not limit this.
[0250] The touch display screen 1205 is used to display a UI (User Interface). The UI may include graphics, text, icons, videos, and any combination thereof. The touch display screen 1205 also has the ability to collect touch signals on or above the surface of the touch display screen 1205. The touch signal can be input as a control signal to the processor 1201 for processing. The touch display screen 1205 is used to provide virtual buttons and / or a virtual keyboard, also known as soft buttons and / or a soft keyboard. In some embodiments, there may be one touch display screen 1205, which is provided on the front panel of the computer device 1200; in other embodiments, there may be at least two touch display screens 1205, which are respectively provided on different surfaces of the computer device 1200 or are in a folded design; in other embodiments, the touch display screen 1205 may be a flexible display screen, which is provided on a curved surface or a folding surface of the computer device 1200. Even further, the touch display screen 1205 can also be set to an irregular non-rectangular shape, that is, an irregular-shaped screen. The touch display screen 1205 can be prepared using materials such as LCD (Liquid Crystal Display) and OLED (Organic Light-Emitting Diode).
[0251] The camera module 1206 is used to collect images or videos. Optionally, the camera module 1206 includes a front camera and a rear camera. Generally, the front camera is used to implement video calls or selfies, and the rear camera is used to take photos or videos. In some embodiments, there are at least two rear cameras, which are any one of a main camera, a depth-of-field camera, and a wide-angle camera respectively, to implement the function of background blurring by fusing the main camera and the depth-of-field camera, and to implement panoramic shooting and VR (Virtual Reality) shooting functions by fusing the main camera and the wide-angle camera. In some embodiments, the camera module 1206 may further include a flash. The flash can be a single-color-temperature flash or a two-color-temperature flash. A two-color-temperature flash refers to a combination of a warm-light flash and a cold-light flash, which can be used for light compensation under different color temperatures.
[0252] The audio circuit 1207 is used to provide an audio interface between the user and the computer device 1200. The audio circuit 1207 may include a microphone and a speaker. The microphone is used to collect sound waves of the user and the environment, and convert the sound waves into electrical signals for input to the processor 1201 for processing, or input to the radio frequency circuit 1204 to achieve voice communication. For the purpose of stereo collection or noise reduction, there may be multiple microphones, which are respectively arranged at different parts of the computer device 1200. The microphone may also be an array microphone or an omnidirectional collection microphone. The speaker is used to convert the electrical signals from the processor 1201 or the radio frequency circuit 1204 into sound waves. The speaker may be a traditional thin film speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can not only convert electrical signals into sound waves audible to humans, but also convert electrical signals into sound waves inaudible to humans for uses such as ranging. In some embodiments, the audio circuit 1207 may further include a headphone jack.
[0253] The power supply 1208 is used to supply power to each component in the computer device 1200. The power supply 1208 may be alternating current, direct current, a disposable battery or a rechargeable battery. When the power supply 1208 includes a rechargeable battery, the rechargeable battery may be a wired rechargeable battery or a wireless rechargeable battery. A wired rechargeable battery is a battery charged through a wired line, and a wireless rechargeable battery is a battery charged through a wireless coil. The rechargeable battery can also be used to support fast charging technology.
[0254] In some embodiments, the computer device 1200 further includes one or more sensors 1210. The one or more sensors 1210 include but are not limited to: an acceleration sensor 1211, a gyroscope sensor 1212, a pressure sensor 1213, an optical sensor 1214, and a proximity sensor 1215.
[0255] The acceleration sensor 1211 can detect the magnitudes of accelerations on the three coordinate axes of the coordinate system established with the computer device 1200. For example, the acceleration sensor 1211 can be used to detect the components of the gravitational acceleration on the three coordinate axes. The processor 1201 can control the touch display screen 1205 to display the user interface in a landscape view or a portrait view according to the gravitational acceleration signals collected by the acceleration sensor 1211. The acceleration sensor 1211 can also be used for collecting game or user movement data.
[0256] The gyroscope sensor 1212 can detect the body orientation and rotation angle of the computer device 1200. The gyroscope sensor 1212 can cooperate with the acceleration sensor 1211 to collect the 3D actions of the user on the computer device 1200. Based on the data collected by the gyroscope sensor 1212, the processor 1201 can implement the following functions: motion sensing (such as changing the UI according to the user's tilting operation), image stabilization during shooting, game control, and inertial navigation.
[0257] The pressure sensor 1213 can be disposed on the side frame of the computer device 1200 and / or the lower layer of the touch display screen 1205. When the pressure sensor 1213 is disposed on the side frame of the computer device 1200, it can detect the holding signal of the user on the computer device 1200, and perform left / right hand recognition or shortcut operations according to the holding signal. When the pressure sensor 1213 is disposed on the lower layer of the touch display screen 1205, it can control the operable controls on the UI interface according to the pressure operation of the user on the touch display screen 1205. The operable controls include at least one of button controls, scroll bar controls, icon controls, and menu controls.
[0258] The optical sensor 1214 is used to collect the ambient light intensity. In one embodiment, the processor 1201 can control the display brightness of the touch display screen 1205 according to the ambient light intensity collected by the optical sensor 1214. Specifically, when the ambient light intensity is high, the display brightness of the touch display screen 1205 is increased; when the ambient light intensity is low, the display brightness of the touch display screen 1205 is decreased. In another embodiment, the processor 1201 can also dynamically adjust the shooting parameters of the camera module 1206 according to the ambient light intensity collected by the optical sensor 1214.
[0259] The proximity sensor 1215, also known as the distance sensor, is usually disposed on the front of the computer device 1200. The proximity sensor 1215 is used to collect the distance between the user and the front of the computer device 1200. In one embodiment, when the proximity sensor 1215 detects that the distance between the user and the front of the computer device 1200 is gradually decreasing, the processor 1201 controls the touch display screen 1205 to switch from the lit screen state to the off screen state; when the proximity sensor 1215 detects that the distance between the user and the front of the computer device 1200 is gradually increasing, the processor 1201 controls the touch display screen 1205 to switch from the off screen state to the lit screen state.
[0260] Those skilled in the art can understand that Figure 12 the structure shown in
[0261] An embodiment of the present application further provides a computer device, which includes a processor and a memory. At least one instruction, at least one program, a code set, or an instruction set is stored in the memory of the computer device. The at least one instruction, at least one program, the code set, or the instruction set is loaded and executed by the processor to implement the data clearing method in the above embodiment.
[0262] An embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the data clearing method in the above embodiment is implemented.
[0263] An embodiment of the present application further provides a computer program product or a computer program. The computer program product or the computer program includes computer instructions, and the computer instructions are stored in a computer-readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the data clearing method as in the above embodiment.
[0264] It should be understood that "a plurality of" mentioned herein refers to two or more. "And / or" describes the association relationship of associated objects and indicates that three relationships may exist. For example, A and / or B may represent: A exists alone, A and B exist simultaneously, and B exists alone. The character " / " generally represents an "or" relationship between the associated objects before and after.
[0265] Those of ordinary skill in the art can understand that all or part of the steps of implementing the above embodiment can be completed by hardware, or can be completed by a program instructing relevant hardware. The program can be stored in a computer-readable storage medium. The storage medium mentioned above can be a read-only memory, a magnetic disk, an optical disc, or the like.
[0266] The above are only optional embodiments of the present application and are not intended to limit the present application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims
1. A data clearing method, characterized in that, The method includes: Obtain a first user account logged in to the face recognition device, where the first user account is logged in under the condition of being matched with a second user account, and the second user account is a user account logged in to a first terminal; Obtain the signal connection strength between the face recognition device and the first terminal; Display the purchase order corresponding to the first user account; Receive a payment operation for the purchase order; In response to receiving the payment success information sent by the server and the signal connection strength between the face recognition device and the first terminal being worse than the connection condition, clear the account data corresponding to the first user account in the face recognition device. The payment success information is generated by the server after the payment for the purchase order corresponding to the first user account is successful.
2. The method according to claim 1, characterized in that The clearing of the account data corresponding to the first user account in the face recognition device in response to the signal connection strength being worse than the connection condition includes: In response to the signal connection strength being worse than the connection condition, obtain an association relationship, where the association relationship is used to represent the relationship between the user account and the storage address of the account data; Obtain the storage address of the account data according to the association relationship and the first user account; Clear the account data from the storage address.
3. The method according to claim 2, characterized in that, The face recognition device includes a cash register device, and the cash register device is used to generate payment information after the settlement of the purchase order; The clearing of the account data from the storage address includes: Obtain the account type of the first user account; In response to the account type belonging to the member type, clear the member preferential information and the first payment information corresponding to the first user account from the storage address; In response to the account type belonging to the non-member type, clear the second payment information corresponding to the first user account from the storage address.
4. The method according to any one of claims 1 to 3, characterized in that, The method further includes: In response to the signal connection strength decreasing to within a first signal range, determine that the signal connection strength is worse than the connection condition; Or, In response to the signal connection strength being lower than the signal strength threshold, determine that the signal connection strength is worse than the connection condition.
5. The method according to any one of claims 1 to 3, characterized in that Before obtaining the first user account logged in to the face recognition device, it includes: Receive the first user account sent by the server, where the first user account is obtained by the server according to the first face image collected by the face recognition device; In response to the face recognition device establishing a connection with the first terminal, receive the second user account sent by the first terminal; In response to the first user account and the second user account being matched, control the first user account to log in to the face recognition device.
6. The method according to claim 5, wherein The method further includes: In response to the first user account not being matched with the second user account, disconnect the connection between the face recognition device and the first terminal; Obtain a candidate signal strength list, where the candidate signal strength list includes the signal connection strengths corresponding to at least two terminals; Connect to the terminals corresponding to the signal connection strengths in the candidate signal strength list in sequence, and receive the third user account sent by the connected second terminal; In response to the third user account matching the first user account, control the first user account to log in to the face recognition device.
7. The method according to any one of claims 1 to 3, characterized in that The method further includes: In response to the payment process corresponding to the first user account ending and disconnecting from the first terminal, obtain a list of candidate signal strengths, where the list of candidate signal strengths includes signal connection strengths corresponding to at least two terminals; In response to receiving a fourth user account sent by the server, sequentially connect to the terminals corresponding to the signal connection strengths in the list of candidate signal strengths, and receive a fifth user account sent by the connected third terminal, where the fourth user account is recognized by the server based on the second face image collected by the face recognition device; In response to the fifth user account matching the fourth user account, control the fourth user account to log in to the face recognition device.
8. The method according to any one of claims 1 to 3, characterized in that The method further includes: In response to the type of the first user account belonging to a non - member type and receiving a membership registration operation, obtain the face image collected by the face recognition device and the first user account; Generate a membership account based on the face image and the first user account.
9. A data clearing device, characterized in that, The device includes: An obtaining module, configured to obtain a first user account logged in to a face recognition device, where the first user account is logged in when matching a second user account, and the second user account is a user account logged in to a first terminal; The obtaining module is configured to obtain the signal connection strength between the face recognition device and the first terminal; A display module, configured to display a purchase order corresponding to the first user account; A receiving module, configured to receive a payment operation for the purchase order; A data clearing module, configured to, in response to receiving payment success information sent by the server and the signal connection strength between the face recognition device and the first terminal being worse than the connection condition, clear the account data corresponding to the first user account in the face recognition device, where the payment success information is generated by the server after the payment for the purchase order corresponding to the first user account is successful.
10. A computer device, characterized in that, The computer device includes: a processor and a memory, where at least one instruction, at least one program, a code set, or an instruction set is stored in the memory, and the at least one instruction, the at least one program, the code set, or the instruction set is loaded and executed by the processor to implement the data clearing method according to any one of claims 1 to 8.
11. A computer-readable storage medium, characterized in that, A computer program is stored on the computer - readable storage medium, and when the computer program is executed by a processor, it implements the data clearing method according to any one of claims 1 to 8.
12. A computer program product, characterized in that, The computer program product includes computer instructions, the computer instructions are stored in a computer - readable storage medium, and the processor reads and executes the computer instructions from the computer - readable storage medium to implement the data clearing method according to any one of claims 1 to 8.
Citation Information
Patent Citations
Face-scanning payment method and device, readable storage medium and terminal equipment
CN110378696A