Method, computer program product and electronic device for secure display of electronic voucher graphic code by a smart wearable device

Abstract

The application discloses a method, a computer program product and an electronic device for safe display of an electronic certificate graphic code by an intelligent wearable device. The method comprises the following steps: S1, obtaining a voice instruction input by a user; S2, if it is identified that the voice instruction is an electronic certificate graphic code display instruction, performing voiceprint recognition on the voice instruction according to a pre-stored voiceprint of a legal user; and S3, if the voiceprint recognition is passed, displaying the electronic certificate graphic code on the intelligent wearable device. The application can effectively prevent the electronic certificate graphic code from being stolen. In addition, the application uses the same voice data input by the user to perform business instruction recognition and voiceprint recognition, which is two-in-one, reduces user operation and is convenient and fast.

Description

Technical Field

[0001] This invention relates to the field of smart wearable device technology, and in particular to a method, computer program product, and electronic device for securely displaying electronic credential graphic codes on a smart wearable device. Background Technology

[0002] Many smartwatches feature Alipay / WeChat payment code display. Users simply scan the activation QR code on the smartwatch with Alipay / WeChat, then bind their Alipay / WeChat account to the smartwatch. The smartwatch can then directly display the Alipay / WeChat payment code. When needed, users simply open the Alipay / WeChat payment code on the smartwatch via the Alipay / WeChat app or a quick touchscreen entry. The payment terminal (cash register) scans the Alipay / WeChat payment code to complete the transaction.

[0003] Electronic social security card QR codes (hereinafter referred to as social security codes) and medical insurance codes are widely used in scenarios such as hospital registration, medical treatment settlement, pharmacy purchases, medical insurance payments, and identity verification. Users typically display their social security codes or medical insurance codes through mobile applications or mini-programs, which are then scanned by business terminals to complete identity verification, medical insurance settlement, or business processing. Smartwatches, being wearable and visible with a simple wrist raise, could be integrated with their payment code display function. This would allow users to quickly present their social security codes or medical insurance codes without taking out their phones during medical treatment, medication purchases, and settlements. However, the existing payment code display function on smartwatches is not secure enough. Directly referencing the existing payment code display function for social security codes or medical insurance codes could easily lead to their being stolen and misused. Summary of the Invention

[0004] The purpose of this invention is to provide a method for securely displaying electronic voucher graphic codes using a smart wearable device, as well as a computer program product and electronic device capable of implementing the method, which can prevent the electronic voucher graphic codes from being fraudulently used.

[0005] To achieve the above objectives, the present invention provides a method for securely displaying electronic voucher graphic codes using a smart wearable device, comprising the following steps: S1. Obtain the user's voice input; S2. If the voice command is identified as an electronic voucher graphic code display command, then the voice command is identified based on the pre-stored legitimate user voiceprint. S3. If the voiceprint recognition is successful, the electronic voucher graphic code will be displayed on the smart wearable device.

[0006] Further, after step S3, the following steps are performed: S4. If the voiceprint recognition fails, the user's face image is captured and face recognition is performed on the captured user's face image based on the pre-stored valid user face images; S5. If facial recognition is successful, the electronic voucher graphic code will be displayed on the smart wearable device.

[0007] Further, after step S5, the following steps are performed: S6. If facial recognition fails, a password verification interface will be displayed on the smart wearable device for the user to enter a password, and the password entered by the user will be verified based on the pre-stored valid passwords. S7. If the password verification is successful, the electronic voucher graphic code will be displayed on the smart wearable device.

[0008] Furthermore, in step S8, which is executed after step S6, if the password verification fails, the electronic credential graphic code will not be displayed.

[0009] Furthermore, in step S2, after recognizing that the above voice command is an electronic voucher graphic code display command, if the current time is within the authentication-free validity period and the device status meets the preset security conditions, then voiceprint recognition is not performed, but the electronic voucher graphic code is directly displayed on the smart wearable device.

[0010] Furthermore, in step S2, the aforementioned preset security conditions are: after the last successful authentication, the smart wearable device has never been removed from the wrist, never been restarted, and never switched the account bound to the electronic credential graphic code.

[0011] Furthermore: During the display of the electronic voucher graphic code, if the business terminal detects that it has completed scanning the electronic voucher graphic code or receives a user-inputted closing instruction, the electronic voucher graphic code will be closed. and / or If the display period expires or the smart wearable device is detected to be removed from the wrist during the display of the electronic voucher graphic code, the electronic voucher graphic code will be turned off.

[0012] Furthermore, the electronic certificate graphic code is an electronic social security card QR code or a medical insurance code.

[0013] The present invention also provides a computer program product, including a computer program that, when executed by a processor of a smart wearable device, implements the method described above for securely displaying electronic credential graphic codes on a smart wearable device.

[0014] The present invention also provides an electronic device, including a processor and a memory electrically connected to the processor, the memory storing a computer program product as described above, the processor executing the computer program product to realize the method for securely displaying electronic credential graphic codes in a smart wearable device as described above.

[0015] The present invention provides a method for securely displaying electronic voucher graphic codes using a smart wearable device. In step S2, if the user-inputted voice command is identified as an electronic voucher graphic code display command, voiceprint recognition is performed on the voice command. In step S3, the electronic voucher graphic code is displayed only after successful voiceprint recognition, effectively preventing the electronic voucher graphic code from being fraudulently used. Furthermore, the present invention utilizes the same voice data input by the user for both business command recognition and voiceprint recognition, achieving two goals at once, reducing user operations, and providing convenience and speed. Attached Figure Description

[0016] Figure 1 This is a circuit structure block diagram of the smart wearable device provided by the present invention.

[0017] Figure 2 This is a flowchart illustrating the method for securely displaying electronic credential graphic codes using a smart wearable device, as provided by the present invention. Detailed Implementation

[0018] The present invention will be further described in detail below with reference to specific embodiments.

[0019] The system for securely displaying electronic credential graphic codes using smart wearable devices includes the smart wearable device and a server. The smart wearable device is a smartwatch, such as... Figure 1 As shown, the smartwatch includes a processor and a microphone, camera, display, wrist-off detection module, security chip, communication module, and memory electrically connected to the processor. The wrist-off detection module uses existing technology, such as an infrared LED sensor. The smartwatch also includes function keys for triggering functions such as application list display, electronic voucher graphic code display, and graphic code switching; an AI voice key for triggering voice acquisition; and an SOS key for triggering an emergency signal. The server includes a processor and memory electrically connected to the processor. The smartwatch communicates remotely with the server via the communication module.

[0020] First Embodiment The server's memory stores a computer program product, which includes a computer program. The server processor executes this computer program to implement, for example... Figure 2 The method for securely displaying electronic credential graphic codes using a smart wearable device is described below. The steps of this method are detailed below.

[0021] S1. Obtain the user's voice input.

[0022] After wearing the smartwatch, if a user wants to display their social security code, they can activate the voice assistant by long-pressing the AI ​​voice button or by activating it via the touchscreen. The smartwatch collects the user's voice through its microphone and displays a message indicating that the voice assistant is listening. The user can then say, "Open social security code." The smartwatch displays a "thinking" status and sends the collected voice data and authentication information generated by the security chip to the server. This allows the server to obtain the user's voice command. The authentication information includes a request signature generated based on the device identifier, user account identifier, timestamp, random number, and wearing status.

[0023] S2. If the voice command is identified as an electronic voucher graphic code display command, then the voice command is identified based on the pre-stored legitimate user voiceprint.

[0024] After receiving the voice data and authentication information, the server performs voice recognition and intent parsing on the voice data. If the voice data is identified as a command to display the social security code (i.e., the electronic certificate graphic code is the social security code), it determines whether the user has activated and bound the social security code service. If the user has not bound and activated the social security code, the server displays the social security code activation QR code on the smartwatch and prompts the user to use a mobile terminal, such as a mobile phone, to scan the code to bind and activate the social security code. If the user has already bound and activated the social security code, the server performs voiceprint recognition on the voice command based on pre-stored legitimate user voiceprints.

[0025] Preferably, other embodiments can be modified to first determine whether the current account needs authentication instead of performing voiceprint recognition. If the user is within the authentication-free validity period, the device status is determined to meet the preset security conditions based on the above authentication information. The authentication-free validity period can be set to be valid for a preset time period after the last successful authentication, such as valid for the current day or within 3 hours, or it can be changed to be valid for a preset number of business requests after the last successful authentication, such as valid for 5 code display requests. The above preset security conditions are: after the last successful authentication, the smartwatch has never been removed from the wrist, never restarted, and never changed the account bound to the electronic certificate graphic code. Based on the above authentication information, the server determines that after the last successful authentication, the smartwatch has been worn continuously, has not been restarted, and has not changed the account bound to the social security code, that is, the user is within the authentication-free validity period and the device status meets the preset security conditions, so voiceprint recognition is not performed, and code data is directly sent to the smartwatch. The code data includes code content, display validity period parameters, random number, and server signature. After receiving the social security code, the smartwatch verifies the code data using its security chip, then announces via voice that it is opening the social security code and displays the code on the screen. While displaying the social security code, the smartwatch interface shows the social security code, user-anonymized information, region information, and an automatic refresh countdown. When the countdown expires, the smartwatch requests the server to resend the refreshed code data. Upon receiving the new code data, the smartwatch refreshes the displayed social security code. If the user is not within the authentication-free period or the device does not meet preset security conditions, the server performs voiceprint recognition on the aforementioned voice data.

[0026] S3. If the voiceprint recognition is successful, the electronic voucher graphic code will be displayed on the smart wearable device.

[0027] If voiceprint recognition passes, the server sends the code data to the smartwatch. Upon receiving it, the smartwatch verifies the code data using its security chip, then announces "Opening Social Security Code" and displays the code on its screen. While displaying the Social Security Code, the smartwatch interface shows the Social Security Code, user-anonymized information, region information, and an automatic refresh countdown. When the countdown expires, the smartwatch requests the server to resend the updated code data. Upon receiving the new code data, the smartwatch refreshes the displayed Social Security Code.

[0028] S4. If voiceprint recognition fails, then capture the user's face image and perform face recognition on the captured user's face image based on the pre-stored valid user face images.

[0029] If voiceprint recognition fails, the server prompts the smartwatch to display a verification failure message and redirects to the facial recognition authentication page, instructing the user to face the screen. The smartwatch captures facial image and video frames using its camera and uploads them to the server. The server then performs facial recognition and liveness detection on the captured facial image and video frames.

[0030] S5. If facial recognition is successful, the electronic voucher graphic code will be displayed on the smart wearable device.

[0031] If facial recognition passes, the server sends the social security code data to the smartwatch. The smartwatch then announces via voice that it is opening the social security code and displays the code on its screen. While displaying the social security code, the smartwatch interface shows the social security code, user-anonymized information, region information, and an automatic refresh countdown. When the countdown expires, the smartwatch requests the server to resend the updated code data. Upon receiving the new code data, the smartwatch refreshes the displayed social security code.

[0032] S6. If facial recognition fails, a password verification interface will be displayed on the smart wearable device for the user to enter a password. The password entered by the user will be verified based on the pre-stored valid passwords.

[0033] If facial recognition fails or no face is detected within a preset time, the smartwatch will display a message indicating facial recognition failure and proceed to the password verification process. The password verification interface will be displayed on the smartwatch screen for the user to enter the password. If the user's password is received, it will be uploaded to the server, which will then verify the user's password against a pre-stored list of valid passwords.

[0034] S7. If the password verification is successful, the electronic voucher graphic code will be displayed on the smart wearable device.

[0035] If the password verification is successful, the server sends the social security code data to the smartwatch. The smartwatch then announces via voice that it is opening the social security code and displays the code on its screen. When displaying the social security code, the smartwatch interface shows the social security code, user-anonymized information, region information, and an automatic refresh countdown. When the countdown expires, the smartwatch requests the server to resend the updated code data. Upon receiving the new code data, the smartwatch refreshes the displayed social security code.

[0036] During the display of the social security code, if the server detects that the business terminal has completed scanning the social security code, it will instruct the smartwatch to close the social security code. If the user clicks to close the display page on the smartwatch (i.e., enters a close command), the smartwatch will close the social security code. Preferably, since the code data includes a display validity period parameter, if the display validity period expires or the smartwatch is detected to be removed from the wrist, the smartwatch will close the social security code.

[0037] S8. If the password verification fails, the electronic voucher graphic code will not be displayed.

[0038] If the password verification fails, the server will not send the code data, and the smartwatch will not display the social security code.

[0039] To access the medical insurance code, users simply need to change "Open Social Security Code" to "Open Medical Insurance Code." The subsequent display process for the medical insurance code is the same as that for the social security code, and will not be repeated here. In addition to the social security code and medical insurance code, the electronic voucher graphic code can also be changed to an electronic health card code, medical treatment code, prescription code, payment code, access control code, identity code, etc.

[0040] Second Embodiment In the first embodiment, voice command recognition, voiceprint recognition, face recognition, and password recognition were all performed by the server. In this embodiment, the smartwatch itself performs voice command recognition, voiceprint recognition, face recognition, and password recognition, and retrieves code data from the server after successful recognition. In this embodiment, the smartwatch's memory stores a computer program product, which includes a computer program. The smartwatch processor executes this computer program to implement the following... Figure 2 The method for securely displaying electronic credential graphic codes using a smart wearable device is described below. The steps of this method are detailed below.

[0041] S1. Obtain the user's voice input.

[0042] After wearing the smartwatch, if a user wants to display their medical insurance code, they can activate the voice assistant by long-pressing the AI ​​voice button or by activating it via the touchscreen. The smartwatch will then collect the user's voice through its microphone and display a message indicating that the voice assistant is listening. The user can then say, "Open medical insurance code." After collecting the voice data, the smartwatch will display a "thinking" status.

[0043] S2. If the voice command is identified as an electronic voucher graphic code display command, then the voice command is identified based on the pre-stored legitimate user voiceprint.

[0044] The smartwatch performs voice recognition and intent analysis on the collected voice data. If the voice data is recognized as a command to open the medical insurance code, it determines whether the user has activated and bound the medical insurance code service. If the user has not bound and activated the medical insurance code, the smartwatch displays the medical insurance code activation QR code and prompts the user to scan the code using a mobile terminal, such as a mobile phone, to bind and activate the medical insurance code. If the user has already bound and activated the medical insurance code, the smartwatch performs voiceprint recognition on the voice command based on pre-stored legitimate user voiceprints.

[0045] Preferably, other embodiments can be modified to first determine whether the current account requires authentication instead of voiceprint recognition. If the user is within the authentication-free validity period, the device status is determined to meet preset security conditions. The authentication-free validity period is, for example, valid for the day following the last successful authentication or valid for 3 hours. The aforementioned preset security conditions are: since the last successful authentication, the smartwatch has not been removed from the wrist, has not been restarted, and has not switched the account bound to the electronic voucher graphic code. The smartwatch determines that since the last successful authentication, the smartwatch has been worn continuously, has not been restarted, and has not switched the account bound to the medical insurance code, i.e., the user is within the authentication-free validity period and the device status meets the preset security conditions, so it does not perform voiceprint recognition and directly obtains the code data from the server. The server sends the code data to the smartwatch. The code data includes code content, display validity period parameters, random number, and server signature. After receiving the code data, the smartwatch performs signature verification on the code data through the security chip. After successful verification, it announces that the medical insurance code is being opened and displays the medical insurance code on the screen. When displaying the medical insurance code, the smartwatch interface shows the medical insurance code, user-anonymized information, region information, and an automatic refresh countdown. When the countdown expires, the smartwatch requests the server to resend the refreshed code data. Upon receiving the new code data, the smartwatch refreshes the displayed medical insurance code. If the user is not within the authentication-free period or the device does not meet preset security conditions, the smartwatch will perform voiceprint recognition on the aforementioned voice data.

[0046] S3. If the voiceprint recognition is successful, the electronic voucher graphic code will be displayed on the smart wearable device.

[0047] If voiceprint recognition passes, the smartwatch generates authentication information via its security chip and sends this information to the server to request the issuance of code data. The authentication information includes a request signature generated based on device identifier, user account identifier, service type, timestamp, random number, and wearing status. The server issues the code data to the smartwatch based on the authentication information. After receiving the code data, the smartwatch verifies the signature using its security chip. Upon successful verification, it announces that it is opening the medical insurance code and displays the code on the screen. When displaying the medical insurance code, the smartwatch interface shows the medical insurance code, user anonymized information, region information, and an automatic refresh countdown. When the countdown expires, the smartwatch requests the server to reissue the refreshed code data. Upon receiving the new code data, the smartwatch refreshes the displayed medical insurance code.

[0048] S4. If voiceprint recognition fails, then capture the user's face image and perform face recognition on the captured user's face image based on the pre-stored valid user face images.

[0049] If voiceprint recognition fails, the smartwatch will display a verification failure message and redirect to the facial recognition authentication page, prompting the user to face the screen. The smartwatch uses its camera to capture facial image video frames and performs facial recognition and liveness detection on these frames.

[0050] S5. If facial recognition is successful, the electronic voucher graphic code will be displayed on the smart wearable device.

[0051] If facial recognition passes, the smartwatch generates authentication information via its security chip and sends it to the server to request the issuance of health insurance code data. The authentication information includes a request signature generated based on device identifier, user account identifier, service type, timestamp, random number, and wearing status. The server issues the code data to the smartwatch based on the authentication information. Upon receiving the code data, the smartwatch verifies the signature using its security chip. If verification is successful, it announces that it is opening the health insurance code and displays the code on the screen. When displaying the health insurance code, the smartwatch's interface shows the health insurance code, user-anonymized information, region information, and an automatic refresh countdown. When the countdown expires, the smartwatch requests the server to reissue the refreshed code data. Upon receiving the new code data, the smartwatch refreshes the displayed health insurance code.

[0052] S6. If facial recognition fails, a password verification interface will be displayed on the smart wearable device for the user to enter a password. The password entered by the user will be verified based on the pre-stored valid passwords.

[0053] If facial recognition fails or no face is detected within a preset time, the smartwatch will display a message indicating facial recognition failure and proceed to the password verification process. The password verification interface will be displayed on the smartwatch screen for the user to enter a password. If the user's password is received, the smartwatch will verify the password against a pre-stored set of valid passwords.

[0054] S7. If the password verification is successful, the electronic voucher graphic code will be displayed on the smart wearable device.

[0055] If the password verification is successful, the smartwatch generates authentication information via its security chip and sends this information to the server to request the issuance of code data. The authentication information includes a request signature generated based on the device identifier, user account identifier, service type, timestamp, random number, and wearing status. The server issues the code data to the smartwatch based on the authentication information. After receiving the code data, the smartwatch verifies the signature of the code data via its security chip. Upon successful verification, it announces that it is opening the medical insurance code and displays the medical insurance code on the screen. When displaying the medical insurance code, the smartwatch's interface includes the medical insurance code, user anonymized information, region information, and an automatic refresh countdown. When the countdown expires, the smartwatch re-requests the server to issue the refreshed code data. Upon receiving the new code data, the smartwatch refreshes the displayed medical insurance code.

[0056] During the display of the medical insurance code, if the smartwatch receives a message from the server indicating that the medical insurance code has been scanned, meaning it has detected that the business terminal has completed the scanning, it will close the medical insurance code. If the user clicks to close the display page on the smartwatch (i.e., enters a close command), the smartwatch will close the medical insurance code. Preferably, since the code data includes a display validity period parameter, if the display validity period expires or the smartwatch is detected to be removed from the wrist, the smartwatch will close the medical insurance code.

[0057] S8. If the password verification fails, the electronic voucher graphic code will not be displayed.

[0058] If the password verification fails, the smartwatch will not display the medical insurance code.

[0059] Third Embodiment This embodiment is largely the same as the first embodiment, except that the smartwatch performs voice recognition and intent parsing on the collected voice data. After recognizing the voice data as a social security code display command, the smartwatch determines the service type as social security code display based on the command. Then, the security chip generates a request signature based on the device identifier, user account identifier, service type, timestamp, random number, and wearing status, using this signature as authentication information. The smartwatch sends the collected voice data and the authentication information generated by the security chip to the server. Upon receiving the voice data and authentication information, the server determines that the voice command is a social security code display command (i.e., an electronic certificate graphic code display command) based on the authentication information and performs voiceprint recognition on the command based on pre-stored legitimate user voiceprints. Subsequent processes are the same as in the first embodiment and will not be repeated here; please refer to the first embodiment above.

[0060] The above description is merely an embodiment of the present invention and does not limit the scope of patent protection. Any non-substantial changes or substitutions made by those skilled in the art based on the present invention will still fall within the scope of patent protection.

Claims

1. A method for securely displaying electronic voucher graphic codes using a smart wearable device, characterized in that, Includes the following steps: S1. Obtain the user's voice input; S2. If the voice command is identified as an electronic voucher graphic code display command, then the voice command is identified based on the pre-stored legitimate user voiceprint. S3. If the voiceprint recognition is successful, the electronic voucher graphic code will be displayed on the smart wearable device.

2. The method for securely displaying electronic voucher graphic codes using a smart wearable device as described in claim 1, characterized in that, After step S3, perform the following steps: S4. If the voiceprint recognition fails, the user's face image is captured and face recognition is performed on the captured user's face image based on the pre-stored valid user face images; S5. If facial recognition is successful, the electronic voucher graphic code will be displayed on the smart wearable device.

3. The method for securely displaying electronic voucher graphic codes using a smart wearable device as described in claim 2, characterized in that, After step S5, perform the following steps: S6. If facial recognition fails, a password verification interface will be displayed on the smart wearable device for the user to enter a password, and the password entered by the user will be verified based on the pre-stored valid passwords. S7. If the password verification is successful, the electronic voucher graphic code will be displayed on the smart wearable device.

4. The method for securely displaying electronic voucher graphic codes using a smart wearable device as described in claim 3, characterized in that, If the password verification fails in step S8, which is executed after step S6, the electronic certificate graphic code will not be displayed.

5. The method for securely displaying electronic voucher graphic codes using a smart wearable device as described in claim 1, characterized in that, In step S2, after recognizing that the above voice command is an electronic voucher graphic code display command, if the current time is within the authentication-free validity period and the device status meets the preset security conditions, then voiceprint recognition is not performed and the electronic voucher graphic code is directly displayed on the smart wearable device.

6. The method for securely displaying electronic voucher graphic codes using a smart wearable device as described in claim 5, characterized in that, In step S2, the aforementioned preset security conditions are: after the last successful authentication, the smart wearable device has never been removed from the wrist, never been restarted, and never changed the account bound to the electronic credential graphic code.

7. The method for securely displaying electronic voucher graphic codes using a smart wearable device as described in claim 1, characterized in that: During the display of the electronic voucher graphic code, if the business terminal detects that it has completed scanning the electronic voucher graphic code or receives a user-inputted closing instruction, the electronic voucher graphic code will be closed. and / or If the display period expires or the smart wearable device is detected to be removed from the wrist during the display of the electronic voucher graphic code, the electronic voucher graphic code will be turned off.

8. The method for securely displaying electronic voucher graphic codes using a smart wearable device as described in any one of claims 1 to 7, characterized in that, The electronic certificate graphic code is either an electronic social security card QR code or a medical insurance code.

9. A computer program product comprising a computer program, characterized in that, When executed by the processor of a smart wearable device, the computer program implements the method for securely displaying electronic credential graphic codes by a smart wearable device as described in any one of claims 1 to 8.

10. An electronic device, characterized in that, The device includes a processor and a memory electrically connected to the processor, the memory storing a computer program product as described in claim 9, wherein the processor executes the computer program product to implement the method for securely displaying electronic credential graphic codes by a smart wearable device as described in any one of claims 1 to 8.

Images