Authentication methods, devices, systems, smart glasses, and media based on smart glasses

By displaying transaction verification credentials through smart glasses and acquiring various biometric information within the voice authorization time window, the problem of the disconnect between identity authentication and payment authorization in existing payment solutions is solved, improving payment security and convenience, and making it suitable for high-security payment scenarios.

CN123118090APending Publication Date: 2026-11-17CHINA MOBILE FINANCIAL TECHNOLOGY CO LTD +1
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202611457385.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2026-09-18
Publication Date
2026-11-17

AI Technical Summary

Technical Problem

Existing payment solutions cannot dynamically adjust security levels based on transaction amounts and application scenarios. Identity authentication and payment authorization are disconnected, making it difficult to resist coerced payments and AI-generated attacks. Furthermore, single-biometric payment methods are susceptible to environmental interference, leading to recognition failures.

Method used

The identity verification method based on smart glasses obtains multiple biometric information by displaying transaction verification credentials and cross-verifying them within the voice authorization time window. It then executes the transaction operation in conjunction with the voice authorization command. By adopting a multimodal physiological coupling and a dense endogenous security mechanism, it achieves two-factor payment verification with cross-modal physiological coupling, dense endogenous security, and scenario adaptive closed loop.

Benefits of technology

It improves the accuracy of identity verification and the ability to resist spoofing attacks, reduces the probability of recognition failure caused by environmental interference of a single biometric feature, realizes a hierarchical risk control strategy, and is easy to apply to high-security payment scenarios.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN123118090A_ABST
    Figure CN123118090A_ABST
Patent Text Reader

Abstract

This invention discloses an identity verification method, device, system, smart glasses, and medium based on smart glasses. The method includes: displaying a transaction verification certificate in response to the smart glasses recognizing a transaction object; acquiring biometric information of a target user associated with the smart glasses within a voice authorization time window associated with the transaction verification certificate; and executing a transaction operation on the transaction object in response to receiving a voice authorization command and the identity verification result obtained based on the biometric information being successful. This invention solves the technical problems in existing technologies where identity authentication and payment authorization are disconnected, making it difficult to resist security threats such as coercive payments and AI-generated attacks, resulting in low payment security strength. It also addresses the high probability of recognition failure due to interference from the payment environment when using a single biometric feature for payment. The method effectively improves the accuracy of identity verification and its resistance to impersonation attacks, and reduces the probability of recognition failure due to environmental interference with a single biometric feature.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to the field of identity recognition technology, and in particular to an identity verification method, device, system, smart glasses, and medium based on smart glasses. Background Technology

[0002] In existing payment systems, payment solutions such as password payment, fingerprint payment, facial recognition payment, password-free payment, and iris recognition payment can be adopted. However, existing payment solutions all use fixed authentication processes and judgment thresholds, which cannot dynamically adjust the security level according to the transaction amount and application scenario. Identity authentication and payment authorization are disconnected from each other, making it difficult to resist new security threats such as coerced payments and AI synthetic attacks. They also cannot meet the comprehensive requirements of wearable devices such as smart glasses for high security, strong privacy protection, and natural interaction in financial-grade payment scenarios. Summary of the Invention

[0003] This invention provides an identity verification method, device, system, smart glasses, and medium based on smart glasses, to solve the technical problems in the prior art where identity authentication and payment authorization are disconnected, making it difficult to resist security threats such as coerced payments and AI synthetic attacks, resulting in low payment security strength, and the use of single biometric payment is susceptible to interference from the payment environment, leading to a high probability of recognition failure.

[0004] According to one aspect of the present invention, an authentication method based on smart glasses is provided, comprising: In response to the smart glasses recognizing the transaction object, a transaction verification certificate is displayed; Within the voice authorization time window associated with the transaction verification certificate, the biometric information of the target user associated with the smart glasses is obtained; wherein, the voice authorization time window is generated based on the voice authorization trigger time; Upon receiving a voice authorization command and confirming that the identity verification result based on the biometric information is successful, a transaction operation on the transaction target is executed.

[0005] According to another aspect of the present invention, an authentication device based on smart glasses is provided, comprising: The display module is used to display transaction verification credentials in response to the smart glasses recognizing the transaction target; The acquisition module is used to acquire biometric information of a target user associated with the smart glasses within a voice authorization time window associated with the transaction verification certificate; wherein the voice authorization time window is generated based on the voice authorization trigger time. The execution module is used to execute a transaction operation on the transaction target in response to receiving a voice authorization command and the identity verification result obtained based on the biometric information being successful.

[0006] According to another aspect of the present invention, a smart glasses is provided, the smart glasses comprising: a communication module, at least one processor; and A memory communicatively connected to the at least one processor; wherein, The communication module is used for data transmission with the cloud server; The memory stores a computer program that can be executed by the at least one processor, which enables the at least one processor to perform the smart glasses-based authentication method according to any embodiment of the present invention.

[0007] According to another aspect of the present invention, an authentication system based on smart glasses is provided, comprising: smart glasses and a cloud server; wherein the smart glasses are communicatively connected to the cloud server; In response to the smart glasses recognizing the subject matter of the transaction, the smart glasses display a transaction verification certificate; Within the voice authorization time window associated with the transaction verification certificate, the smart glasses acquire the biometric information of the target user associated with the smart glasses; wherein, the voice authorization time window is generated based on the voice authorization trigger time; Upon receiving a voice authorization command, and with the cloud server confirming successful identity verification based on the biometric information, the smart glasses execute a transaction operation on the transaction target.

[0008] According to another aspect of the present invention, a computer-readable storage medium is provided, the computer-readable storage medium storing computer instructions for causing a processor to execute and implement the smart glasses-based authentication method according to any embodiment of the present invention.

[0009] According to another aspect of the present invention, a computer program product is provided, the computer program product comprising a computer program that, when executed by a processor, implements the smart glasses-based authentication method according to any embodiment of the present invention.

[0010] The technical solution of this invention, in response to the smart glasses recognizing the transaction target, displays a transaction verification certificate; within the voice authorization time window associated with the transaction verification certificate, it acquires the biometric information of the target user associated with the smart glasses; wherein the voice authorization time window is generated based on the voice authorization trigger time; in response to receiving the voice authorization command, and the identity verification result obtained based on the biometric information is successful, it executes the transaction operation on the transaction target. This solves the technical problems in the prior art where identity authentication and payment authorization are disconnected, making it difficult to resist security threats such as coerced payment and AI synthetic attacks, resulting in low payment security strength, and the high probability of recognition failure due to interference from the payment environment when using a single biometric payment method. It can effectively improve the accuracy of identity verification and the ability to resist impersonation attacks, and reduce the probability of recognition failure due to environmental interference of a single biometric feature; furthermore, the use of multiple biometric cross-verification improves the confidence of identity determination, facilitates the implementation of hierarchical risk control strategies, and ensures payment security while taking into account the convenience of payment operation, thus expanding the applicable scope of high-security payment scenarios.

[0011] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of the present invention, nor is it intended to limit the scope of the invention. Other features of the invention will become readily apparent from the following description. Attached Figure Description

[0012] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0013] Figure 1 This is a schematic diagram of a trusted architecture for an identity verification system based on smart glasses, provided in an embodiment of the present invention.

[0014] Figure 2 This is a flowchart of an identity verification method based on smart glasses provided in an embodiment of the present invention.

[0015] Figure 3 This is a schematic diagram illustrating the configuration of a transaction verification certificate provided in an embodiment of the present invention.

[0016] Figure 4 This is a schematic diagram illustrating the configuration of a voice authorization time window provided in an embodiment of the present invention.

[0017] Figure 5 This is a flowchart of another authentication method based on smart glasses provided in an embodiment of the present invention.

[0018] Figure 6 This is a schematic diagram of the configuration of a payment intent encoding structure provided in an embodiment of the present invention.

[0019] Figure 7 This is a schematic diagram of the configuration of a timing double-lock window provided in an embodiment of the present invention.

[0020] Figure 8 This is a schematic diagram illustrating the implementation of physiological coupling live detection provided in an embodiment of the present invention.

[0021] Figure 9 This is a schematic diagram illustrating an implementation of determining a target verification threshold provided by an embodiment of the present invention.

[0022] Figure 10 This is a flowchart illustrating the implementation of dense-state cross-attention fusion according to an embodiment of the present invention.

[0023] Figure 11 This is a schematic diagram illustrating an authentication implementation provided by an embodiment of the present invention.

[0024] Figure 12 This is a schematic diagram illustrating the implementation of continuous and reliable monitoring after payment, provided by an embodiment of the present invention.

[0025] Figure 13 This is a schematic diagram illustrating the implementation of a model lightweighting and federated learning architecture provided in an embodiment of the present invention.

[0026] Figure 14 This is a schematic diagram of the structure of an identity verification device based on smart glasses provided in an embodiment of the present invention.

[0027] Figure 15 This is a schematic diagram of the structure of an identity verification system based on smart glasses provided in an embodiment of the present invention.

[0028] Figure 16 This is a structural block diagram of a smart glasses provided in an embodiment of the present invention. Detailed Implementation

[0029] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of the present invention.

[0030] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that embodiments of the invention described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0031] Existing payment technologies can be categorized into five types: password payment, fingerprint payment, facial recognition payment, password-free payment, and iris recognition payment. Password payment verifies identity by having the user input characters, which are then hashed and encrypted before being compared with information stored in the cloud. Fingerprint payment relies on the extraction and matching of fingerprint ridge features to verify identity. Facial recognition payment uses deep learning to extract facial features and supplements them with basic liveness detection to complete contactless authentication. Password-free payment achieves seamless payment based on the device's trustworthiness, transaction amount, and behavioral risk control rules. Existing iris recognition payment uses near-infrared iris texture features, extracts single-modal features, and compares them with templates to complete identity verification. Each of these solutions builds an independent payment authentication process around identity consistency verification.

[0032] Existing payment technologies generally have significant limitations: passwords are easily forgotten, leaked, and spied on; fingerprints are easily forged and greatly affected by environmental interference; facial recognition is susceptible to lighting, occlusion, and spoofing attacks, posing significant privacy and security risks. Password-free payments lack strong identity and liveness verification, resulting in a high risk of fraudulent transactions. Current iris payments mostly use single-modal independent authentication with simple liveness detection mechanisms that are not strongly time-bound to payment intent and authorization actions. Furthermore, biometric features need to be uploaded to the cloud for decryption and comparison, posing a data leakage risk. At the same time, all solutions employ fixed authentication processes and decision thresholds, failing to dynamically adjust security levels based on transaction amounts and application scenarios. Identity authentication and payment authorization are disconnected, making it difficult to defend against new security threats such as coerced payments and AI-generated attacks. They also cannot meet the comprehensive requirements of wearable devices like smart glasses in financial-grade payment scenarios, which demand high security, strong privacy protection, and natural interaction.

[0033] Therefore, this solution needs to address the following technical issues: existing payment methods mostly use single-modal authentication, which lacks sufficient security and is easily forged; identity authentication and payment authorization are disconnected, making it impossible to prevent coerced payments and malicious hijacking; single-modal liveness detection capabilities are weak, making it difficult to resist combined attacks such as AI-synthesized speech and iris video; biometric features need to be uploaded to the cloud for comparison, posing privacy and compliance risks; the authentication process and thresholds are fixed, making it impossible to dynamically adjust the security level according to the payment scenario and amount; the interaction on wearable devices such as smart glasses is awkward, the data collection experience is poor, and there is a lack of integrated adaptation solutions; verification is only performed when payment is initiated, lacking continuous protection mechanisms during and after payment; the recognition model struggles to balance lightweight design, low power consumption, and high accuracy, and cannot evolve in a privacy-friendly manner.

[0034] Addressing the common shortcomings of existing payment authentication technologies, such as single-modal fragility, independent liveness detection, disconnect between identity and authorization, cloud-based biometrics, unschedulable fixed thresholds, and mismatch with wearable interactions, this invention does not simply perform feature splicing or parallel verification of voiceprints and irises. Instead, it proposes an identity verification method and system based on smart glasses. This identity verification system is a two-factor payment verification system for smart glasses that features strong binding of payment intent, cross-modal physiological coupling, intrinsic security in a closed state, and scene-adaptive closed loop.

[0035] The authentication system based on smart glasses proposed in this invention can include a three-level trusted architecture. Figure 1 This is a schematic diagram of a trusted architecture for an identity verification system based on smart glasses, provided in an embodiment of the present invention. Figure 1 As shown, the trusted perception domain corresponding to the smart glasses in the smart glasses-based identity verification system may include: a near-infrared iris acquisition module, a microphone array and a bone conduction dual-path voiceprint module, an NPU inference unit (neural network processor), a trusted execution environment (TEE), a differential privacy desensitization module, a homomorphic encryption engine, a dense-state fusion accelerator, and a ZKP proof generator. All original biometric data does not leave the TEE, and the biometrics are kept in a dense state throughout the process.

[0036] The payment service federated scheduling domain corresponding to the smart glasses-based identity verification system includes a dynamic password generation service, a scenario risk engine, federated learning aggregation nodes, and an encrypted template index service. It does not store any reversible biometric information.

[0037] The zero-knowledge verification and on-chain evidence storage domain corresponding to the cloud server in the smart glasses-based identity verification system includes the ZKP verification engine, the ciphertext similarity verification module, and the consortium blockchain evidence storage nodes. The verification process does not access any user feature data, achieving "verifiable but invisible".

[0038] In one embodiment, Figure 2This is a flowchart of an authentication method based on smart glasses provided in an embodiment of the present invention. This embodiment is applicable to mobile payment. The method can be executed by an authentication device based on smart glasses, which can be implemented in hardware and / or software and can be configured in smart glasses. Figure 2 As shown, the method includes: S110: In response to the smart glasses recognizing the subject matter of the transaction, display the transaction verification certificate.

[0039] In one example, the subject of the transaction refers to the object of the transaction corresponding to this payment transaction. For example, the subject of the transaction can be a physical product; the subject of the transaction can also refer to a graphic carrier that carries the local payment transaction. For example, the subject of the transaction can be a transaction QR code corresponding to a physical product.

[0040] In one example, a transaction verification credential refers to an interface that requires the user to verify and confirm the transaction amount for the current payment transaction. It can be a dynamic payment password with semantic validation, serving as a unique structured instruction representing the transaction. The transaction verification credential is one-time use, tamper-proof, and prevents the recording and reuse of fixed verification credentials. In practice, the transaction verification credential can be presented to the user through the optical display unit in smart glasses. For example, Figure 3 This is a schematic diagram illustrating the configuration of a transaction verification certificate provided in an embodiment of the present invention. Figure 3 As shown, the transaction verification voucher displays "Confirm payment of ¥12.50?" to allow users to check and confirm the transaction amount.

[0041] In this embodiment, when the smart glasses receive a mobile payment trigger operation, the mobile payment authentication function can be enabled, and the camera configured in the smart glasses can be used to identify the transaction object and the transaction amount corresponding to the transaction object. Based on the payment amount, a corresponding transaction verification certificate can be generated and displayed so that the user can confirm the payment amount of the transaction object.

[0042] In one embodiment, the transaction verification certificate is generated based on the transaction amount, merchant type, and risk level; The transaction verification certificate includes the transaction amount, random verification code, authorization password, and certificate generation timestamp.

[0043] In one example, the transaction amount refers to the specific monetary value of this transaction, which can be an integer or a decimal, such as 12.5 yuan or 199 yuan; the random verification code refers to a verification character that is randomly generated once and used to prevent the transaction verification voucher from being replayed or tampered with; the authorization password is the key verb used to trigger valid iris scanning, such as words like "authorize" or "confirm"; the voucher generation timestamp refers to the precise time when the transaction verification voucher was generated, used to limit the validity period of the transaction verification voucher and prevent it from being reused after expiration.

[0044] In one example, merchant type refers to the type categorized according to the organizational form of the business entity, which may include operator merchants, individual merchants, and collective merchants, etc. In another example, risk level is used to characterize the risk level of the transaction scenario corresponding to this transaction; the risk level can be determined based on one or more of the following: merchant type, transaction location, transaction time, transaction channel, type of transaction object, and equipment environment.

[0045] In one example, the cloud server can generate a transaction verification credential with semantic verification based on the transaction amount, merchant type, and risk level. This credential, which includes the transaction amount, random verification code, authorization password, and credential generation timestamp, is then sent to the smart glasses. The credential is projected into the user's field of vision through the optical display unit in the smart glasses, allowing the user to directly view the displayed content and complete the transaction amount verification and transaction information confirmation.

[0046] In this embodiment, the transaction verification certificate is presented directly to the user through smart glasses, eliminating the need for the user to look down at their phone screen. This allows the user to quickly and easily verify the transaction amount and merchant information in real time, simplifying the transaction confirmation process. Simultaneously, the transaction verification certificate is displayed independently through the smart glasses and interacts with the scanning terminal, preventing issues such as merchants tampering with the displayed amount or screen obstruction, thus improving the authenticity of transaction confirmation and reducing the risk of erroneous payments. Furthermore, the transaction verification certificate is only projected onto the near-eye display interface of the smart glasses, making it difficult for others to see the displayed content, enhancing the privacy of the transaction verification certificate. Moreover, the complete transaction verification certificate can be verified before the user's biometric authorization. If any anomalies are found in the transaction amount or the transaction object, the transaction can be terminated in advance, improving the ability to identify abnormal transactions and further enhancing transaction risk management capabilities.

[0047] S120. Within the voice authorization time window associated with the transaction verification certificate, obtain the biometric information of the target user associated with the smart glasses; wherein, the voice authorization time window is generated based on the voice authorization trigger time.

[0048] In one embodiment, the voice authorization time window is generated based on the voice authorization trigger time and includes: The window start time is determined based on the voice authorization trigger time and the effective window advance. The window cutoff time is determined based on the voice authorization trigger time and the effective window delay. The voice authorization time window is generated based on the window start time and window end time.

[0049] In one example, the voice authorization time window is a pre-configured continuous time interval, which is the valid period during which a user is allowed to perform iris capture operations; only iris features captured within this voice authorization time window can be considered valid iris features, and commands that capture iris features outside this voice authorization time window are determined to be invalid authorizations.

[0050] In one example, the voice authorization trigger moment refers to the moment when the voice recognition module in the smart glasses detects the pronunciation of the authorization command word. It can be understood as the precise time point when the user reads the authorization command word. The voice authorization trigger moment is the time point when the voice authorization time window is opened to start listening to and collecting the user's iris features. When the voice authorization trigger moment is reached, the system automatically enters the iris feature collection state.

[0051] In one example, the effective window advance refers to the time offset of pre-collecting iris features relative to the voice authorization trigger moment. This can be understood as starting to capture the user's iris features a certain amount of time before the voice authorization trigger moment, compensating for the response delay in iris feature acquisition and signal wake-up. For example, the effective window advance can be 0.3 seconds. Starting 0.3 seconds before the voice recognition module in the smart glasses begins collecting the voice authorization command, the iris acquisition module enters a ready-to-activate state.

[0052] In one example, the effective window delay is the time offset between the end of the voice authorization time window and the completion of the authorized voice recognition; or, to put it another way: after recognizing the user's voice authorization command, the window remains open for an additional period of time, which is the window delay, used to complete iris feature extraction and comparison verification. For example, the effective window delay can be 0.5 seconds. Within 0.5 seconds after the voice recognition module in the smart glasses completes the acquisition of the voice authorization command, the iris acquisition module remains active.

[0053] After the smart glasses determine the voice authorization trigger time, the window start time is obtained by subtracting the effective window advance from the voice authorization trigger time; the window end time is obtained by adding the effective window delay to the voice authorization trigger time; and the window start time and window end time are combined to form the voice authorization time window.

[0054] Figure 4 This is a schematic diagram illustrating the configuration of a voice authorization time window according to an embodiment of the present invention. Figure 4 As shown, the start time of the voice authorization time window is formed by subtracting the effective window advance from the voice authorization trigger time, and the end time of the voice authorization time window is formed by adding the effective window delay to the voice authorization trigger time. The corresponding voice authorization time window is formed by the start time and the end time of the window.

[0055] In one embodiment, acquiring biometric information of a target user associated with smart glasses includes: acquiring initial voiceprint features and initial iris features of the target user associated with smart glasses; wherein the difference between the effective acquisition time of the initial iris features and the voice authorization trigger time is less than the maximum allowable timing deviation value.

[0056] In one example, the maximum permissible timing deviation value is used to characterize the effective deviation value of the initial iris features acquired. For example, the maximum permissible timing deviation value can be 100 milliseconds. The effective acquisition time point refers to the time point at which a valid iris image is actually acquired. In actual operation, the absolute value of the difference between the effective acquisition time point of the initial iris features and the voice authorization trigger time is less than the maximum permissible timing deviation value. By actively limiting the iris acquisition window, a strong binding effect on transaction intent can be achieved.

[0057] In this embodiment, the iris acquisition module in the smart glasses can collect the iris features of the target user associated with the smart glasses within the voice authorization time window to obtain initial iris features; at the same time, when a voice authorization command is detected, the voice acquisition module in the smart glasses can collect the voiceprint of the target user associated with the smart glasses in real time to obtain initial voiceprint features.

[0058] S130. In response to receiving a voice authorization command and the identity verification result obtained based on biometric information being successful, execute the transaction operation on the subject matter of the transaction.

[0059] In one example, a voice authorization command refers to the voice content output by the user to authorize and confirm the transaction. The system configured in the smart glasses can extract keywords from the collected voice signal, simultaneously extract the corresponding voiceprint features, and complete the transaction authorization verification under a time-series window constraint. For example, the voice authorization command could be "Confirm payment of 12.5 yuan," where "confirm" is the authorization password.

[0060] In this embodiment, the cloud server can determine the identity verification result of the target user as successful based on biometric information, and the smart glasses can continue the transaction operation on the target item after receiving the voice authorization command from the target user.

[0061] The technical solution of this embodiment displays a transaction verification certificate in response to the smart glasses recognizing the transaction target; within the voice authorization time window associated with the transaction verification certificate, it acquires the biometric information of the target user associated with the smart glasses; wherein the voice authorization time window is generated based on the voice authorization trigger time; in response to receiving the voice authorization command and the identity verification result obtained based on the biometric information being successful, it executes the transaction operation on the transaction target. This solves the technical problems in the prior art where identity authentication and payment authorization are disconnected, making it difficult to resist security threats such as coerced payment and AI synthetic attacks, resulting in low payment security strength, and the high probability of recognition failure due to interference from the payment environment when using a single biometric payment method. It can effectively improve the accuracy of identity verification and the ability to resist impersonation attacks, and reduce the probability of recognition failure due to environmental interference of a single biometric feature; furthermore, the use of multiple biometric cross-verification improves the confidence of identity determination, facilitates the implementation of hierarchical risk control strategies, and ensures payment security while taking into account the convenience of payment operation, thus expanding the applicable scope of high-security payment scenarios.

[0062] In one embodiment, Figure 5 This is a flowchart of another identity verification method based on smart glasses provided by an embodiment of the present invention. This embodiment further refines the process of determining the identity verification result based on biometric information, based on the above embodiments. Figure 5 As shown, the method includes: S210, In response to the smart glasses recognizing the subject matter of the transaction, display the transaction verification certificate.

[0063] S220. Within the voice authorization time window associated with the transaction verification certificate, obtain the biometric information of the target user associated with the smart glasses; wherein, the voice authorization time window is generated based on the voice authorization trigger time.

[0064] In this embodiment, the biometric information includes: voiceprint signal, iris micro-tremor signal, pupil diameter fluctuation signal, and respiratory fundamental frequency signal.

[0065] In one example, the voiceprint signal refers to the audio signal of the target user that is collected. This signal carries the voiceprint biometrics determined by the human vocal tract and oral cavity physiological structure. It can be obtained through the microphone array and bone conduction dual-channel voiceprint module in smart glasses. The user extracts the voiceprint features to complete the identity verification.

[0066] In one example, the iris micro-tremor signal refers to the minute periodic shaking signal of the iris extracted through image processing after continuously acquiring images of the iris region of the target user. The iris exhibits subtle physiological tremors controlled by the human autonomic nervous system, which are inherent dynamic characteristics of a living organism. This can be used to determine whether the iris image acquisition object is a real living person and to defend against spoofing attacks such as static iris photographs and printed images.

[0067] In one example, the pupil diameter fluctuation signal refers to the time-series signal formed by continuously acquiring images of the target user's eyes and detecting the dynamic changes in pupil diameter caused by illumination and neural reflexes in real time. Pupil size is autonomously regulated by the human eye and possesses the characteristic of dynamic changes in living individuals. This can be combined with iris features to assist in liveness detection and improve the iris recognition's resistance to spoofing attacks.

[0068] In one example, the fundamental frequency signal refers to the periodic physiological signal obtained by collecting the respiratory activity of the target user, representing the basic frequency of breathing. Breathing is a continuous autonomous physiological activity of the human body and can serve as an auxiliary biosignal for determining liveness; it can be fused with voiceprint and iris dynamic signals to verify the target as a living person from multiple dimensions, thereby improving the overall payment risk control strength.

[0069] S230. Determine the cross-correlation coefficient between the naturalness score of the voiceprint signal and the naturalness score of the iris microtremor signal, and use it as the first cross-correlation coefficient.

[0070] In one example, the naturalness score of a voiceprint signal refers to an evaluation value obtained by quantifying and scoring the collected speech audio signal, used to characterize the degree to which the speech signal belongs to the natural voice produced by a human in a real-life situation. The processor in the smart glasses can comprehensively calculate the naturalness score of the voiceprint signal based on dimensions such as audio waveform, spectral characteristics, vocal tract dynamic changes, and breathing coupling characteristics. In actual operation, forged audio such as recorded playback, AI synthesized speech, and spliced ​​speech will have a naturalness score lower than a preset threshold, thereby identifying unnatural forged speech and helping to prevent voice fraud attacks.

[0071] In one example, the naturalness score of the iris microtremor signal refers to the score obtained by quantitatively evaluating the temporal signal of iris microtremor extracted from continuous eye images. It is used to characterize the confidence level of whether the iris microtremor signal conforms to the autonomous physiological tremor pattern of a real human eye. The system comprehensively calculates this score based on dimensions such as tremor amplitude, tremor dominant frequency, phase continuity, and noise distribution. Iris images generated by prostheses such as photographs, printouts, screen playback videos, and artificially made simulated eyes cannot reproduce the original iris microtremor characteristics of the human eye, and their corresponding naturalness scores are lower than a preset threshold. This is used to identify prosthetic attacks and serves as a liveness detection indicator.

[0072] In one example, the first cross-correlation coefficient is used to characterize the degree of linear correlation between the voiceprint signal and the iris micro-tremor signal. Its value ranges between -1 and 1. The closer the first cross-correlation coefficient is to 1, the stronger the correlation between the voiceprint signal and the iris micro-tremor signal.

[0073] S240. Determine the cross-correlation coefficient between the naturalness score of the voiceprint signal and the naturalness score of the pupil diameter fluctuation signal, as the second cross-correlation coefficient.

[0074] In one example, the naturalness score of the pupil diameter fluctuation signal refers to the score obtained by quantitatively evaluating the continuously acquired pupil diameter change signal over time. This score characterizes the confidence level of whether the pupil diameter fluctuation signal conforms to the autonomous physiological regulation of the human eye. The processor in the smart glasses can comprehensively calculate this score based on dimensions such as the fluctuation amplitude and frequency of the pupil diameter, the synchronicity of the left and right eyes, and the response rate and response curve with changes in light intensity. Forged irises from sources such as still photos, printed images, screen video playback, and simulated artificial eyes do not conform to the physiological laws of the real human eye, and their naturalness scores are below a preset threshold. This helps identify forged liveness signals and assists in preventing spoofing attacks.

[0075] In one example, the second cross-correlation coefficient is used to characterize the degree of linear correlation between the voiceprint signal and the pupil diameter fluctuation signal. Its value ranges between -1 and 1. The closer the second cross-correlation coefficient is to 1, the stronger the correlation between the voiceprint signal and the pupil diameter fluctuation signal.

[0076] S250. Determine the cross-correlation coefficient between the naturalness score of the voiceprint signal and the naturalness score of the respiratory fundamental frequency signal, as the third cross-correlation coefficient.

[0077] In one example, the naturalness score of the respiratory fundamental frequency signal refers to the score obtained by quantitatively evaluating the acquired respiratory fundamental frequency time-series signal, which is used to characterize the confidence level of whether the respiratory cycle signal conforms to the real physiological laws of human spontaneous breathing. The processor in the smart glasses can comprehensively calculate this score based on dimensions such as the stability of the respiratory fundamental frequency, the range of periodic fluctuations, waveform continuity, and the coupling relationship between respiratory rhythm and speech production. Pre-recorded or artificially simulated fake respiratory signals are difficult to replicate the natural rhythm characteristics of real human breathing, and their naturalness score is lower than a preset threshold. This is used to identify fake samples and serve as an auxiliary indicator for liveness verification.

[0078] In one example, the third cross-correlation coefficient is used to characterize the degree of linear correlation between the voiceprint signal and the respiratory fundamental frequency signal. Its value ranges between -1 and 1. The closer the third cross-correlation coefficient is to 1, the stronger the correlation between the voiceprint signal and the respiratory fundamental frequency signal.

[0079] S260. Determine the cross-correlation coefficient between the naturalness score of the iris microtremor signal and the naturalness score of the pupil diameter fluctuation signal, as the fourth cross-correlation coefficient.

[0080] In one example, the fourth cross-correlation coefficient is used to characterize the degree of linear correlation between the iris micro-tremor signal and the pupil diameter fluctuation signal. Its value ranges between -1 and 1. The closer the fourth cross-correlation coefficient is to 1, the stronger the correlation between the iris micro-tremor signal and the pupil diameter fluctuation signal.

[0081] S270. Determine the physiological signal coupling degree based on the ratio between the sum of cross-correlation coefficients and the pre-configured average coefficients; wherein the sum of cross-correlation coefficients is the sum of the first cross-correlation coefficient, the second cross-correlation coefficient, the third cross-correlation coefficient, and the fourth cross-correlation coefficient.

[0082] In one example, the physiological signal coupling degree is used to reflect the synchronicity of four types of physiological signals: voiceprint signal, iris micro-tremor signal, pupil diameter fluctuation signal, and respiratory fundamental frequency signal; the larger the value of the physiological signal coupling degree, the closer it is to the natural physiological state of a real person.

[0083] In one example, the first cross-correlation coefficient, the second cross-correlation coefficient, the third cross-correlation coefficient, and the fourth cross-correlation coefficient are added together to obtain the total cross-correlation coefficient; then the ratio between the total cross-correlation coefficient and the pre-configured average coefficient is used as the physiological signal coupling degree.

[0084] In one example, the average coefficient is related to the number of types of physiological signals. In this embodiment, the physiological signals include voiceprint signals, iris micro-tremor signals, pupil diameter fluctuation signals, and respiratory fundamental frequency signals, with the corresponding average coefficient being 4. Accordingly, the ratio between the sum of the cross-correlation coefficients and 4 can be used as the physiological signal coupling degree.

[0085] S280. Determine the liveness verification result of the target user based on the comparison results between the physiological signal coupling degree and the pre-configured coupling degree threshold, and the comparison results between the naturalness score of each signal and the score threshold.

[0086] In one example, the coupling threshold refers to a pre-configured critical value used to determine the synchronicity between the four types of physiological signals; for example, the coupling threshold could be 0.85. In another example, the scoring threshold refers to a pre-configured critical value used to assess whether each type of physiological signal closely approximates the physiological patterns of a real person; for example, the scoring threshold could be 0.7.

[0087] In one example, if the physiological signal coupling degree is greater than or equal to a pre-configured coupling degree threshold, and the naturalness score of each type of physiological signal is greater than the score threshold, the liveness verification result of the target user can be determined as successful; if the physiological signal coupling degree is less than the pre-configured coupling degree threshold, and / or the naturalness score of each type of physiological signal is less than or equal to the score threshold, the liveness verification result of the target user can be determined as unsuccessful.

[0088] In this embodiment, a new liveness detection criterion is constructed by utilizing the natural synchronicity of human physiological signals. First, the naturalness of each type of physiological signal is evaluated individually, then the coupling and synergistic relationship of multiple physiological signals is verified. This multi-layered verification reduces the probability of false positives and false negatives in liveness detection. Furthermore, the verification threshold can be dynamically adjusted according to the risk level of the transaction scenario, adaptively changing the risk control intensity. Liveness verification, in conjunction with iris and voiceprint recognition, addresses the deficiency of simple biometric comparison in distinguishing between live and spoofed individuals. Simultaneously, relying on smart glasses to synchronously collect multiple physiological signals enhances the security level of the voice payment authorization process without increasing the user's operational burden.

[0089] S290. The initial iris features and initial voiceprint features of the target user are perturbed to obtain perturbed iris features and perturbed voiceprint features.

[0090] In one example, the initial iris feature refers to the original extracted iris feature vector that has not been desensitized; the initial voiceprint feature refers to the original extracted voiceprint feature vector that has not been desensitized; the perturbed iris feature refers to the iris feature vector after differential privacy desensitization; and the perturbed voiceprint feature refers to the voiceprint feature vector after differential privacy desensitization.

[0091] In one example, to prevent features from being reverse-engineered, smart glasses can add Laplace noise to the target user's initial iris features and initial voiceprint features to obtain perturbed iris features and perturbed voiceprint features.

[0092] Specifically, the ratio between feature sensitivity and privacy budget can be determined. Then, a Laplace noise function is used to calculate this ratio, generating noise conforming to a Laplace distribution to perturb the initial iris and voiceprint features, thus achieving privacy protection. The Laplace noise and the initial iris features are then added together to obtain the perturbed iris features, and the same applies to the initial voiceprint features. Feature sensitivity refers to the maximum variation range of the initial iris and voiceprint features. For example, the feature sensitivity value can be 1 to ensure a reasonable noise perturbation amplitude that does not affect feature comparison accuracy. Privacy budget refers to the calculation parameter for differential privacy. The smaller the privacy budget value, the stronger the privacy protection. For example, the privacy budget value can be 0.1 to achieve a balance between privacy protection and comparison accuracy. Irreversible feature desensitization is achieved without affecting comparison accuracy.

[0093] S2100. Homomorphic encryption is performed on the perturbed iris features and perturbed voiceprint features to obtain encrypted iris features and encrypted voiceprint features.

[0094] In one example, encrypted iris features refer to iris features that have undergone homomorphic encryption. These encrypted iris features cannot be read directly and can only be processed in the ciphertext domain. Encrypted voiceprint features refer to voiceprint features that have undergone homomorphic encryption. These encrypted voiceprint features cannot be read directly and can only be processed in the ciphertext domain.

[0095] In one example, a homomorphic encryption function can be used to homomorphically encrypt the perturbed iris features to obtain encrypted iris features. Similarly, in another example, a homomorphic encryption function can be used to homomorphically encrypt the perturbed voiceprint features to obtain encrypted voiceprint features. In yet another example, the smart glasses can perform homomorphic encryption on both the perturbed iris features and the perturbed voiceprint features within a Trusted Execution Environment (TEE) to obtain the corresponding encrypted iris features and encrypted voiceprint features.

[0096] S2110. Perform cross-attention fusion on encrypted iris features and encrypted voiceprint features to obtain fused ciphertext features.

[0097] In one example, encrypted iris features can be used as the query vector, and encrypted voiceprint features as the key vector and value vector, respectively. These are then substituted into a cross-attention function to obtain the fused ciphertext features. The key vector is used for matching calculations with the query vector, and the value vector is used to output the fused features based on the matching results. First, the transpose product of the query vector and the key vector is determined to calculate the similarity between them, resulting in the attention weight matrix. Then, the dimension of the key vector (i.e., the dimension of the encrypted voiceprint features) is determined. Finally, the Softmax activation function is used to calculate the ratio between the transpose product and the dimension of the key vector, and the product of the calculated result and the value vector yields the fused ciphertext features.

[0098] S2120. In response to receiving a voice authorization command, and if the similarity between the fused encrypted features obtained based on biometric information and the registered feature template is greater than or equal to the target verification threshold, the liveness verification result obtained based on biometric information is verified as passed, the temporal double-lock verification based on voiceprint features and iris features in biometric information is passed, and the voice authorization command contains an authorization password, a zero-knowledge proof is generated.

[0099] In one embodiment, the process of determining the target verification threshold includes: The cloud server dynamically adjusts the weights of transaction amount, scenario, environment, and device security based on transaction amount, transaction scenario, data collection environment, user habits, and device security status. The target verification threshold is determined by the product of the preset basic verification threshold, transaction amount weight, scenario weight, environment weight, and device security weight.

[0100] In one example, the target verification threshold can be dynamically adjusted based on factors in three dimensions: transaction amount, transaction scenario, data collection environment, user habits, and device security, in order to achieve a closed-loop scheduling of lenient thresholds for small amounts, strict thresholds for large amounts, and escalation of risks.

[0101] In one example, the preset basic verification threshold refers to a pre-configured baseline threshold for transactions to ensure basic security. To ensure basic transaction security, the similarity between the fused features and the registration template can be above 99.99%. For example, the preset basic verification threshold can be 0.9999.

[0102] In one example, the transaction amount weight refers to a weight that is dynamically adjusted based on the transaction amount. The larger the transaction amount, the greater the corresponding transaction amount weight and the higher the target verification threshold. If the transaction amount exceeds the preset threshold, the transaction amount weight can be configured to a value greater than or equal to 1.1 to increase the final target verification threshold by more than 10%, thereby improving the security of large transactions.

[0103] In one example, scenario weight refers to a weight that is dynamically adjusted based on the risk level of the transaction scenario. The higher the risk level of the scenario, the greater the corresponding scenario weight. When the transaction scenario is public Wi-Fi, the scenario weight can be configured to a value greater than or equal to 1.2, so as to increase the final target verification threshold by more than 20%, thereby improving the verification strictness of risky scenarios.

[0104] In one example, the environmental weight refers to a weight that is dynamically adjusted based on the quality of the physiological signal acquisition environment. The noisier or more abnormal the environment, the greater the corresponding environmental weight. In noisy or dimly lit environments, the environmental weight can be configured to a value greater than or equal to 1.2 to increase the final target verification threshold by more than 20%, thereby improving the verification rigor of risky scenarios.

[0105] In one example, the device security weight refers to a weight that is dynamically adjusted based on the security status of the smart glasses and the collaborating devices. A higher device security weight is assigned to devices that are malfunctioning or untrusted. When the collaborating device is an unfamiliar device, the device security weight can be configured to a value greater than or equal to 1.2 to increase the verification rigor in risky scenarios.

[0106] In this embodiment, a preset basic verification threshold, transaction amount weight, scenario weight, environment weight, and device security weight can be multiplied together, and the product value can be used as the final target verification threshold. This allows for the assessment of transaction risks from multiple dimensions, achieving refined risk identification. By cross-judging multiple indicators, missed detections and false interceptions due to single-dimensional risk control are avoided. Furthermore, the verification intensity of subsequent biometric liveness checks can be adaptively adjusted based on the results of each dimension's threshold assessment. This ensures payment convenience in low-risk scenarios and tightens biometric verification rules in high-risk scenarios, balancing security and user experience. Simultaneously, the multi-dimensional thresholds support independent configuration and iteration, adapting to different types of merchants. They also enable initial risk screening at the pre-biometric stage, allowing for early termination of the verification process for high-risk transactions, reducing computational overhead and accelerating transaction processing.

[0107] In one example, the smart glasses can generate a zero-knowledge proof π if all the following propositions are true: the similarity between the fused encrypted features obtained from biometric information and the registration feature template is greater than or equal to the target verification threshold; the liveness verification result obtained from biometric information is passed; the temporal double-lock verification based on voiceprint and iris features from biometric information is passed; and the voice authorization command contains the authorization password. It should be noted that the zero-knowledge proof π only contains proof information showing that all verifications have passed; it does not contain any biometric features or transaction details.

[0108] S2130: Receive the authentication result generated by the cloud server based on zero-knowledge proof and pre-stored verification key.

[0109] In one example, the verification key is a public verification key pre-stored on a cloud server, used to decrypt and verify the legitimacy of zero-knowledge proofs, and exists in pairs with the proof key of the smart glasses.

[0110] In one example, the smart glasses send the generated zero-knowledge proof to the cloud server. The cloud server uses a zero-knowledge proof verification function and a verification key to verify whether the zero-knowledge proof generated by the smart glasses is legal and valid. If the zero-knowledge proof is valid and legal, the authentication result is verification passed; otherwise, the authentication result is proof invalid and verification failed.

[0111] S2140. If the identity verification result is successful, execute the transaction operation on the subject matter of the transaction.

[0112] In one example, once the smart glasses receive a verified authentication result from the cloud server, the smart glasses can perform a transaction on the subject matter of the transaction.

[0113] In one embodiment, the authentication method based on smart glasses further includes: Within the preset timeframe after the transaction ends, the target user's biometric information and the actual device posture of the smart glasses are acquired in real time. If no iris features are detected, and the naturalness scores of the voiceprint signal, iris micro-tremor signal, pupil diameter fluctuation signal, and respiratory fundamental frequency signal are less than the scoring threshold, and the actual degree of change in the device posture reaches the change threshold, a risk handling operation will be performed.

[0114] In one example, the preset transaction end duration refers to a pre-configured threshold for the duration after a transaction ends, during which physiological signals need to be monitored. For example, the preset transaction end duration is 30 seconds.

[0115] In one example, the actual device posture refers to the tilt state of the smart glasses relative to the target user. In actual operation, pitch angle, yaw angle, and roll angle can be used to characterize the orientation and tilt state of the smart glasses in three-dimensional space relative to the frame. For example, the actual device posture can include one of the following: normal wearing posture, forehead-raised posture, tilted wearing posture, and removed / unworn posture.

[0116] In one example, after a transaction ends, the smart glasses continue to monitor the target user's biometric information and the actual device posture of the smart glasses for a preset period after the transaction ends. If rapid iris detachment is detected, and the naturalness scores of the voiceprint signal, iris micro-vibration signal, pupil diameter fluctuation signal, and respiratory fundamental frequency signal are less than a scoring threshold, and the degree of change in the actual device posture of the smart glasses reaches a change threshold, the smart glasses perform risk handling operations. Alternatively, if rapid iris detachment is detected, and the physiological signal coupling degree is less than or equal to a coupling degree threshold, and the degree of change in the actual device posture of the smart glasses reaches a change threshold, the smart glasses perform risk handling operations. Exemplarily, the risk handling operations may include: sending a risk control alert to the user or the trading platform to remind the user to pay attention to account anomalies; immediately freezing the user's trading account to prevent subsequent theft and tampering.

[0117] The technical solution of this embodiment, through continuous and reliable monitoring after the transaction is completed, can form a reliable closed loop of the entire chain of verification, payment and post-monitoring, avoiding the security blind spot of verification ending in the prior art, and further improving transaction security.

[0118] In one embodiment, which is a preferred embodiment, the authentication process of payment transactions based on the smart glasses authentication method is described in detail. The smart glasses authentication method in this embodiment includes the following steps: Step 1: Structured encoding of payment intent.

[0119] Figure 6 This is a configuration diagram of a payment intent encoding structure provided in an embodiment of the present invention. The cloud server generates a dynamic payment password with semantic verification based on the transaction amount, merchant type, and risk level, which serves as a transaction verification credential. The payment intent encoding structure is as follows: Figure 6 As shown: ; in, : This refers to the transaction verification certificate, which can also be understood as the payment dynamic password (an overall identifier that represents a unique structured instruction for this transaction). Transaction amount, i.e., the specific amount of this transaction, such as 199 yuan or 8800 yuan; Random verification code refers to a verification character that is randomly generated once and used to prevent password replay or tampering. Authorization password: A key verb used to trigger effective iris scanning, such as "authorize"; The voucher generation timestamp refers to the precise time when the transaction verification voucher was generated. It is used to limit the validity period of the transaction verification voucher and prevent it from being reused after it expires.

[0120] It should be noted that the transaction verification certificate has the characteristics of being one-time use, preventing replay, and preventing tampering, thus avoiding the recording and reuse of fixed passwords.

[0121] Step 2: Use a time-series dual-lock authorization mechanism to verify the user's iris and voiceprint features.

[0122] This invention abandons the traditional multimodal mode of "simultaneous acquisition and comparison" and proposes an asymmetric temporal binding mechanism of voiceprint command lock and iris permission lock: (1) Voiceprint features are responsible for the integrity of the command: the entire command must be read aloud completely, continuously, and without tampering; (2) Iris features are responsible for authorization validity: data is collected only within a very narrow time window when the user reads the authorized verb.

[0123] The effective acquisition window (i.e., the voice authorization time window) satisfies: ; Formula character Chinese explanation: : The effective acquisition time of iris features (i.e., the time point when the iris acquisition module can acquire features normally and participate in subsequent verification); The voice authorization trigger time is the precise time when the user reads the authorization verb (Verb_{auth}) (based on the moment when the on-device speech recognition module detects the pronunciation of "authorization"). 0.3s: Effective window advance before the pronunciation of the authorizing verb (i.e., the iris acquisition module enters the waiting state 0.3 seconds before the pronunciation of "authorizing"). 0.5s: The effective window delay after the pronunciation of the authorized verb (i.e., the iris acquisition module remains active for 0.5 seconds after the pronunciation of "authorize"; otherwise, the acquisition is invalid). ∈: belongs to the symbol, indicating The range of values ​​is within between.

[0124] Timing deviation constraints: Formula character Chinese explanation: ΔT: Timing deviation (the difference between the actual iris scan time and the "authorization" pronunciation time); The effective acquisition time of the initial iris features is the actual acquisition time of the valid image. Voice authorization trigger moment, that is, the precise point in time when the user reads the authorization verb aloud; 100ms: Maximum allowable timing deviation (if this deviation is exceeded, the iris acquisition data is considered invalid and the double-lock verification fails). This invention overcomes technological bias by actively restricting the iris feature acquisition window and sacrificing ease of acquisition for strong binding of payment intent. The technical solution in this embodiment significantly improves security by truly and strongly binding identity authentication with payment intent. Existing password, fingerprint, facial, and iris payment methods only complete "identity verification" and cannot confirm whether the user has actively authorized the transaction, making them vulnerable to coercion, hijacking, or accidental payment. This application, through a time-sequential dual-locking mechanism of voiceprint commands and the iris acquisition window, deeply binds identity authentication with real-time payment actions, fundamentally preventing unauthorized payment behavior, and achieving a security level far exceeding traditional single-factor authentication.

[0125] Figure 7 This is a schematic diagram of a timing-based double-lock window configuration provided in an embodiment of the present invention, as shown below. Figure 7 As shown, the target user's iris features are collected starting with the effective window advance amount before the voice authorization trigger moment, and are used as valid iris features. The target user's iris features are also collected with the effective window delay amount after the voice authorization trigger moment, and are used as valid iris features. At the same time, the target user's voiceprint features are continuously collected throughout the process.

[0126] Step 3: The smart glasses perform cross-modal physiological coupling liveness detection.

[0127] This invention does not use independent liveness detection, but instead constructs a four-dimensional physiological coupling model of voiceprint, iris, pupil and respiration. It uses time-frequency correlation to determine whether they are natural synchronization signals of the same living organism, thereby resisting combined attacks such as AI synthesis, video re-enactment, and prosthetic splicing.

[0128] Figure 8 This is a schematic diagram illustrating the implementation of physiological coupling in vivo detection according to an embodiment of the present invention. Figure 8 As shown, the physiological coupling in vivo detection process includes the following steps: First, various physiological signals are extracted simultaneously: voiceprint resonance envelope fV(t); iris microtremor frequency fI(t); pupil diameter fluctuation fP(t); and respiratory fundamental frequency fB(t).

[0129] Where fV(t): a function of the envelope of the voiceprint formant as a function of time (f represents a function, V represents voiceprint, and t represents time, reflecting the energy change law of the voiceprint signal over time). fI(t): A function of the frequency of iris microtremors over time (I represents Iris, which reflects the frequency of the iris's subtle tremors over time and is an important characteristic of the living iris). fP(t): A function of the pupil diameter fluctuation over time (P represents the pupil, reflecting the diameter fluctuation pattern of the pupil with changes in light and physiological state). fB(t): A function of the fundamental frequency of respiration over time (B represents respiration, reflecting the change of the fundamental frequency of the respiratory rhythm over time).

[0130] Then, the physiological signal coupling degree is determined, and the formula for calculating the physiological signal coupling degree can be: ; Among them, C: four-dimensional physiological signal coupling degree, which is used as the core judgment indicator to reflect the synchronicity of the four types of physiological signals. The larger the value, the closer it is to the natural physiological state of a real person. 4: Average coefficient, used to sum the cross-correlation coefficients of the four types of signals and take the average value to ensure that the coupling degree is within a reasonable range; Corr(⋅): Cross-correlation coefficient function, used to calculate the degree of linear correlation between two signals. The value ranges from [-1, 1]. The closer the value is to 1, the stronger the correlation. Corr(V,I): refers to the first cross-correlation coefficient, that is, the cross-correlation coefficient between the voiceprint signal (V) and the iris micro-tremor signal (I); Corr(V,P): refers to the second cross-correlation coefficient, which is the cross-correlation coefficient between the voiceprint signal (V) and the pupil diameter fluctuation signal (P); Corr(V,B): refers to the third cross-correlation coefficient, which is the cross-correlation coefficient between the voiceprint signal (V) and the respiratory fundamental frequency signal (B); Corr(I,P): refers to the fourth cross-correlation coefficient, which is the cross-correlation coefficient between the iris micro-tremor signal (I) and the pupil diameter fluctuation signal (P).

[0131] Then, the liveness determination rule is used for judgment: C≥0.85 and the naturalness score of the physiological signal of each monomodal >0.7.

[0132] Finally, if C ≥ 0.85 and the naturalness score of the physiological signal of each monomodal is > 0.7, the liveness verification passes; if C ≥ 0.85, and / or the naturalness score of the physiological signal of each monomodal is > 0.7, it is determined to be forgery and payment is refused.

[0133] This method is not a simple superposition of conventional liveness detection, but rather utilizes the natural synchronicity of human physiological signals to construct a new liveness determination criterion, exhibiting outstanding non-obviousness. The liveness detection capability in this embodiment is stronger and can resist AI synthesis and composite forgery attacks. Existing face and iris payment systems mostly use single-modal independent liveness detection, which is easily compromised by photos, videos, 3D masks, and AI-synthesized speech. This application determines liveness by the coupling degree of four types of physiological signals: voiceprint, iris, pupil, and respiration. It utilizes the natural synchronicity of human physiological signals to achieve highly robust anti-spoofing capabilities, effectively defending against current mainstream composite attacks such as AI speech synthesis and iris video re-enhancing.

[0134] Step 4: The cloud server dynamically adjusts the verification threshold based on the scenario.

[0135] Figure 9 This is a schematic diagram illustrating an implementation of determining a target verification threshold provided by an embodiment of the present invention, as shown below. Figure 9 As shown, the process of determining the target verification threshold includes the following steps: First, obtain the preset basic verification threshold, transaction amount weight, scenario weight, environment weight, and device security weight.

[0136] Then, determine the target validation threshold.

[0137] Finally, the target verification threshold is used as the threshold for judging the similarity between the fused ciphertext features and the registered feature template.

[0138] This invention dynamically adjusts the verification threshold based on five dimensions: payment amount, scenario, environment, user habits, and device security, achieving a closed-loop scheduling of "lenient for small amounts, strict for large amounts, and escalated risk." ; in, This refers to the final target verification threshold, which is the core judgment criterion for this transaction. The similarity between the fused features and the registration template must reach this threshold to pass verification. This refers to the preset basic verification threshold, which serves as the benchmark threshold for financial-grade payments to ensure basic security. This refers to the weight of the transaction amount, which is used to dynamically adjust the weight based on the transaction amount. The larger the amount, the greater the weight, and the higher the final threshold. This refers to the scenario weight, which is used to adjust the risk level of the transaction scenario. The higher the risk of the scenario, the greater the weight. This refers to the environmental weight, which is used to adjust based on the quality of the data collection environment. The weight is greater when the environment is noisy or the lighting is abnormal. This refers to the device security weight, which is adjusted based on the security status of smart glasses and collaborative devices. The weight is higher when the device is abnormal or untrusted. Among them: preset basic verification threshold =0.9999, the benchmark similarity threshold for financial-grade payments, meaning that the similarity between the fused features and the registration template must reach 99.99% or higher to ensure basic security; Transaction amount weight ≥1.1: When the transaction amount exceeds the preset large transaction threshold, the weight is not less than 1.1, and the final threshold is increased by more than 10%, thereby improving the security of large transactions. Public network / unknown device weight ≥1.2, when the transaction environment is public WiFi and the device is an unfamiliar device, the weight is no less than 1.2, further improving the verification rigor of risk scenarios.

[0139] The security strategy in this embodiment is dynamically adaptive, balancing security and user experience. Existing payment solutions all use fixed authentication processes and fixed thresholds, which are inconvenient for small transactions and insecure for large transactions. This application dynamically adjusts the verification strength based on transaction amount, scenario risk, environmental quality, device status, and user behavior, achieving quick verification for small transactions, strict verification for large transactions, and upgraded protection for high-risk scenarios, solving the pain point of the "one-size-fits-all" approach of traditional solutions. This mechanism breaks the industry convention of fixed thresholds, achieving refined control of payment security and representing a significant technological advancement.

[0140] Step 5: Perform differential privacy perturbation and feature desensitization on the initial iris features and initial voiceprint features to obtain perturbed iris features and perturbed voiceprint features.

[0141] To prevent features from being reverse-engineered, the smart glasses add Laplacian noise to the initial iris and voiceprint features: ; in, The final feature vector after differential privacy desensitization is used for subsequent encryption and fusion, and the original features cannot be reversed to restore them. The original extracted biometric vectors, i.e., the original feature data of the iris or voiceprint, have not been desensitized. : Laplace noise function, used to generate noise that conforms to the Laplace distribution, used to perturb the original features and achieve privacy protection; Feature sensitivity refers to the maximum variation of the original features. In this invention, the value is set to 1 to ensure that the noise disturbance amplitude is reasonable and does not affect the feature comparison accuracy. ε: Privacy budget, which is the core parameter of differential privacy. The smaller the value, the stronger the privacy protection. In this invention, the value is 0.1 to achieve a balance between privacy protection and comparison accuracy. Irreversible desensitization of features is achieved without affecting the accuracy of the comparison.

[0142] Step 6: Perform homomorphic encryption and cross-attention fusion on the perturbed iris features and perturbed voiceprint features to obtain fused ciphertext features.

[0143] Figure 10 This is a flowchart illustrating the implementation of dense-state cross-attention fusion according to an embodiment of the present invention. Figure 10 As shown, the dense-state cross-attention fusion process provided in this embodiment includes the following steps: First, homomorphic encryption is performed on the perturbed iris features and perturbed voiceprint features respectively to obtain encrypted iris features and encrypted voiceprint features; Then, cross-attention fusion is performed on the encrypted iris features and encrypted voiceprint features to obtain fused ciphertext features.

[0144] This invention does not compare the original features in the cloud, but instead performs homomorphic encryption on the features within the TEE of the smart glasses and directly completes cross-attention fusion in the ciphertext domain: ; in, Encrypted iris features, i.e., iris feature ciphertext after homomorphic encryption (encrypted iris features cannot be read directly, but can only be processed in the ciphertext field). Homomorphic encryption functions (HE stands for Homomorphic Encryption, which can achieve "ciphertext operation, plaintext result", and complete feature fusion without decryption). Disturbed iris features That is, the iris feature vector after differential privacy desensitization; Encrypted voiceprint features, i.e., voiceprint feature ciphertext after homomorphic encryption (and... Similarly, encrypted voiceprint features). Disturbance voiceprint characteristics That is, the voiceprint feature vector after differential privacy desensitization; The process of ciphertext cross-attention fusion: ; in, Cross-attention computation function (used to achieve deep fusion of iris and voiceprint ciphertext features and extract the associated features between the two). Q: Query vector (in this invention, the encrypted iris feature) (used to query the association between voiceprint features). K: Key vector (in this invention, it is the encrypted voiceprint feature) (used for matching calculations with the query vector). V: Value vector (in this invention, it is the encrypted voiceprint feature) (used to output fused features based on the matching results). Softmax(⋅): Softmax activation function (used to normalize attention weights, ensuring the sum of the weights is 1, highlighting key related features); : The product of the query vector and the transpose of the key vector (used to calculate the similarity between Q and K, and obtain the attention weight matrix); The dimension of the key vector (K) (i.e., the encrypted voiceprint feature) (dimensions).

[0145] ; Formula character Chinese explanation: The final feature ciphertext after cross-attention fusion in the ciphertext domain (which integrates the core association features of the iris and voiceprint, and is used for subsequent similarity comparison). : Encrypted iris features As Q, the encrypted voiceprint feature Substituting K and V into the cross-attention function yields the fused feature ciphertext.

[0146] Step 7: Verify payment based on zero-knowledge proof.

[0147] Figure 11 This is a schematic diagram illustrating an authentication implementation provided by an embodiment of the present invention, such as... Figure 11 As shown, the authentication process in this embodiment includes the following steps: First, the smart glasses generate ZKP proofs.

[0148] The smart glasses generate a ZKP proof of π, proving all of the following propositions to be true: Similarity between fused ciphertext features and registration template ≥ ; The liveness verification result obtained based on biometric information is that the verification passed. The temporal double-lock verification based on the voiceprint and iris features in the biometric information passed; Complete password match, meaning the voice authorization command contains the authorization password.

[0149] Then, the ZKP proof is uploaded to the cloud server.

[0150] Then, the cloud server performs the authentication operation.

[0151] Finally, if the verification is successful, the payment is executed; if the verification fails, the transaction is rejected and a risk control report is submitted.

[0152] The cloud server only executes: Verify(π,VK)→{Accept,Reject}; Formula character Chinese explanation: Verify(⋅): Zero-knowledge proof verification function (used to verify whether the ZKP proof generated by the terminal is legal and valid); π: Terminal-generated zero-knowledge proof (containing proof information that "all verifications have passed", but not containing any biometrics or transaction details); VK: Verification Key (a publicly available verification key stored in the cloud, used to decrypt and verify the legitimacy of ZKP proofs, and exists in pairs with the proof key on the terminal). {Accept,Reject}: The set of verification results (Accept means the proof is valid and all verifications pass; Reject means the proof is invalid and verification fails).

[0153] Throughout the entire process, the cloud cannot access any biometric information, achieving "verifiable but invisible" secure payment. Biometric privacy protection reaches financial-grade secure levels, completely solving the problem that existing biometric payment methods generally require uploading encrypted features to a cloud server for decryption and comparison, which allows the cloud server to access the user's core biometric information, posing risks of permanent leakage, misuse, and backtracking. This application employs edge-side differential privacy desensitization, homomorphic encryption ciphertext fusion, and zero-knowledge proof verification. The cloud server only performs legitimacy verification, never touching, storing, or decrypting any original biometric features, achieving "verifiable but invisible" and fully meeting privacy compliance requirements.

[0154] The technical solution of this invention is more compatible with wearable devices such as smart glasses, resulting in a more natural and seamless interaction. Passwords and fingerprints are difficult to input or collect on glasses, and facial recognition is easily affected by angles and obstructions, while existing iris payment interactions are clunky. This solution is based on an integrated process of near-eye display, voice commands, and visual acquisition, making the interaction more in line with the usage habits of wearable devices, with more user-friendly data collection, faster response, and a better wearing experience.

[0155] Furthermore, the technical solution of this invention possesses transaction trustworthiness capabilities that prevent replay, tampering, and are traceable. Existing payment systems largely rely on traditional encryption and risk control, lacking inherent security at the transaction level. This invention employs mechanisms such as one-time dynamic passwords, encrypted verification, and on-chain evidence storage, enabling transactions to possess capabilities that prevent replay, tampering, auditability, and evidentiary value. Overall security and reliability are significantly superior to existing technologies.

[0156] Step 8: Conduct continuous and reliable monitoring after payment.

[0157] Figure 12 This is a schematic diagram illustrating the implementation of continuous and reliable monitoring after payment, as provided in an embodiment of the present invention. Figure 12 As shown, the post-payment continuous reliable monitoring process includes the following steps: First, after payment is completed, the stability of physiological signals is monitored for 30 seconds via smart glasses.

[0158] Then, determine if there is an anomaly. If so: The iris detaches rapidly; Physiological coupling degree drops sharply; Sudden change in equipment attitude; Then immediately execute: Abnormal → Freeze and / or Alert Wherein, Abnormal: an abnormal state identifier (this identifier is triggered when any of the above abnormal situations are detected); →: a mapping symbol, indicating the subsequent operation triggered by the abnormal state; Risk management procedures include the following: Freeze: Account freezing operation (immediately freezes the user's payment account to prevent subsequent theft or tampering); Alert: Risk control alarm operation (sends risk control alarms to users and payment platforms to remind users to pay attention to account abnormalities).

[0159] This forms a trusted closed loop across the entire process of verification, payment, and post-monitoring, filling the security blind spot of existing technologies where "verification is the end".

[0160] This embodiment addresses the security blind spot after payment by performing continuous and reliable monitoring throughout the entire process for a period of time after the transaction is completed. Traditional payment only performs verification once at the time of initiation, lacking protection during and after the payment process, making it vulnerable to tampering, hijacking, or unauthorized use. This application achieves continuous physiological and device status monitoring from authentication initiation and transaction execution to a period of time after payment. In case of anomalies, the account is immediately frozen and an alarm is triggered, forming a reliable closed loop across the entire chain.

[0161] Figure 13 This is a schematic diagram illustrating the implementation of a lightweight model and federated learning architecture provided in an embodiment of the present invention, as shown below. Figure 13As shown, a new global model can be obtained by training locally on smart glasses and then federated averaging on a cloud server, and the new global model can be distributed to all smart glasses for updates.

[0162] To adapt to smart glasses, this invention adopts: Knowledge distillation: ; in, Knowledge distillation total loss function (used to train a lightweight model, enabling the lightweight model (student model) to learn the knowledge of the high-precision model (teacher model)). Hard loss weighting coefficient (used to balance the proportion of hard loss and soft loss; the value in this invention is 0.3). Hard loss (the loss between the prediction result of the lightweight model and the true label, reflecting the classification accuracy of the model); : Soft loss weight coefficient (complementary to hard loss weight coefficient, ensuring that the sum of the total weights is 1). KL divergence (relative entropy, used to measure the difference between the prediction distributions of the teacher model and the student model, where pt is the prediction probability distribution of the teacher model and ps is the prediction probability distribution of the student model). 0.3: The specific value of the hard loss weight coefficient (after experimental verification, this value can achieve a balance between lightweight and high precision).

[0163] 8-bit quantization (Chinese description: compressing model parameters from 32 bits to 8 bits, significantly reducing model size and edge inference power consumption without significantly reducing model accuracy, adapting to the low power consumption requirements of smart glasses). Federal Average Training ; in, The global model parameters after the t-th training round are the unified model parameters obtained after collaborative training of all terminals and are distributed to each terminal for updates. : The summation symbol indicates a weighted summation of the local model parameters of K terminals; k: Terminal number, from 1 to K, where K is the total number of terminals participating in federated learning; K: The total number of terminals participating in federated learning, for example, multiple smart glasses terminals collaboratively participating in model training; : The number of local training samples of the k-th terminal, the amount of training data stored locally on the terminal after de-identification; N: The total number of samples from all terminals participating in federated learning; : Local model parameters of the kth terminal (model parameters obtained after the terminal is trained based on local samples).

[0164] Achieve model size ≤2MB, inference time <100ms, multi-terminal collaborative evolution, and data not leaving the local machine.

[0165] This embodiment achieves lightweight deployment through model distillation and quantization, and uses federated learning to continuously optimize the model without leaving the local data, thus balancing low power consumption, small size and high recognition accuracy.

[0166] In one embodiment, Figure 14 This is a schematic diagram of the structure of an identity verification device based on smart glasses provided in an embodiment of the present invention. Figure 14 As shown, the device includes: Display module 310 is used to display transaction verification certificate in response to the smart glasses recognizing the transaction target; The acquisition module 320 is used to acquire the biometric information of the target user associated with the smart glasses within the voice authorization time window associated with the transaction verification certificate; wherein, the voice authorization time window is generated based on the voice authorization trigger time; The execution module 330 is used to execute a transaction operation on the subject matter of the transaction in response to receiving a voice authorization command and the identity verification result obtained based on biometric information being successful.

[0167] In one embodiment, the transaction verification certificate is generated based on the transaction amount, merchant type, and risk level; The transaction verification certificate includes the transaction amount, random verification code, authorization password, and certificate generation timestamp.

[0168] In one embodiment, the voice authorization time window is generated based on the voice authorization trigger time and includes: The window start time is determined based on the voice authorization trigger time and the effective window advance. The window cutoff time is determined based on the voice authorization trigger time and the effective window delay. The voice authorization time window is generated based on the window start time and window end time.

[0169] In one embodiment, obtaining biometric information of a target user associated with smart glasses includes: Acquire the initial voiceprint and initial iris features of the target user associated with the smart glasses; wherein the difference between the effective acquisition time of the initial iris features and the voice authorization trigger time is less than the maximum allowable timing deviation value.

[0170] In one embodiment, the biometric information includes: voiceprint signal, iris micro-tremor signal, pupil diameter fluctuation signal, and respiratory fundamental frequency signal; the smart glasses-based authentication device further includes: The first determining module is used to determine the cross-correlation coefficient between the naturalness score of the voiceprint signal and the naturalness score of the iris microtremor signal, as the first cross-correlation coefficient. The second determining module is used to determine the cross-correlation coefficient between the naturalness score of the voiceprint signal and the naturalness score of the pupil diameter fluctuation signal, as the second cross-correlation coefficient; The third determination module is used to determine the cross-correlation coefficient between the naturalness score of the voiceprint signal and the naturalness score of the respiratory fundamental frequency signal, as the third cross-correlation coefficient. The fourth determination module is used to determine the cross-correlation coefficient between the naturalness score of the iris microtremor signal and the naturalness score of the pupil diameter fluctuation signal, as the fourth cross-correlation coefficient. The fifth determining module is used to determine the coupling degree of physiological signals based on the ratio between the sum of cross-correlation coefficients and the pre-configured average coefficients; wherein the sum of cross-correlation coefficients is the sum of the first cross-correlation coefficient, the second cross-correlation coefficient, the third cross-correlation coefficient, and the fourth cross-correlation coefficient; The sixth determination module is used to determine the liveness verification result of the target user based on the comparison result between the coupling degree of physiological signals and the pre-configured coupling degree threshold, as well as the comparison result between the naturalness score of each signal and the score threshold.

[0171] In one embodiment, the smart glasses-based authentication device further includes: The perturbation processing module is used to perturb the initial iris features and initial voiceprint features of the target user to obtain perturbed iris features and perturbed voiceprint features. The encryption module is used to perform homomorphic encryption on the perturbed iris features and perturbed voiceprint features to obtain encrypted iris features and encrypted voiceprint features; The fusion module is used to perform cross-attention fusion of encrypted iris features and encrypted voiceprint features to obtain fused ciphertext features.

[0172] In one embodiment, the authentication result is obtained based on biometric information, specifically for: If the similarity between the fused encrypted features obtained based on biometric information and the registration feature template is greater than or equal to the target verification threshold, the liveness verification result obtained based on biometric information is verified as passed, the temporal double-lock verification based on voiceprint features and iris features in biometric information is passed, and the voice authorization command contains the authorization password, a zero-knowledge proof is generated. Receive authentication results generated by the cloud server based on zero-knowledge proofs and pre-stored verification keys.

[0173] In one embodiment, the process of determining the target verification threshold includes: The cloud server dynamically adjusts the weights of transaction amount, scenario, environment, and device security based on transaction amount, transaction scenario, data collection environment, user habits, and device security status. The target verification threshold is determined by the product of the preset basic verification threshold, transaction amount weight, scenario weight, environment weight, and device security weight.

[0174] In one embodiment, the smart glasses-based authentication device further includes: The acquisition module is also used to acquire the target user's biometric information and the actual device posture of the smart glasses in real time within a preset time after the transaction ends. The processor is used to perform risk management operations if no iris features are detected, and the naturalness scores of the voiceprint signal, iris micro-tremor signal, pupil diameter fluctuation signal, and respiratory fundamental frequency signal are less than the scoring threshold, and the degree of change in the actual device posture reaches the change threshold.

[0175] The smart glasses-based authentication device provided in this embodiment of the invention can execute the smart glasses-based authentication method provided in any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the method execution.

[0176] In one embodiment, Figure 15 This is a schematic diagram of the structure of an identity verification system based on smart glasses provided in an embodiment of the present invention. Figure 15 As shown, the system includes: smart glasses 410 and cloud server 420; wherein, smart glasses 410 and cloud server 420 are connected for communication. In response to the smart glasses 410 recognizing the subject of the transaction, the smart glasses 410 displays the transaction verification certificate; Within the voice authorization time window associated with the transaction verification certificate, the smart glasses 410 acquires the biometric information of the target user associated with the smart glasses 410; wherein, the voice authorization time window is generated based on the voice authorization trigger time; Upon receiving a voice authorization command and with the cloud server 420 confirming successful identity verification based on biometric information, the smart glasses 410 executes a transaction operation on the target item.

[0177] In one embodiment, Figure 16 This is a structural block diagram of a smart glasses provided in an embodiment of the present invention, such as... Figure 16The diagram illustrates a schematic of a smart glasses 10 that can be used to implement embodiments of the present invention. The smart glasses are intended to represent various forms of digital computers, such as laptops, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframes, and other suitable computers. Electronic devices can also represent various forms of mobile devices, such as personal digital processors, cellular phones, smartphones, wearable devices (e.g., helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the invention described and / or claimed herein.

[0178] like Figure 16 As shown, the electronic device 10 includes at least one processor 11 and a memory, such as a read-only memory (ROM) 12 or a random access memory (RAM) 13, communicatively connected to the at least one processor 11. The memory stores computer programs executable by the at least one processor. The processor 11 can perform various appropriate actions and processes based on the computer program stored in the ROM 12 or loaded from storage unit 18 into the RAM 13. The RAM 13 can also store various programs and data required for the operation of the smart glasses 10. The processor 11, ROM 12, and RAM 13 are interconnected via a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0179] Multiple components in the smart glasses 10 are connected to the I / O interface 15, including: an input unit 16, such as a keyboard, mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a disk, optical disk, etc.; and a communication module 19, such as a network card, modem, wireless transceiver, etc. The communication unit module allows the electronic device 10 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.

[0180] Processor 11 can be a variety of general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. Processor 11 performs the various methods and processes described above, such as authentication methods based on smart glasses.

[0181] In some embodiments, the smart glasses-based authentication method may be implemented as a computer program tangibly contained in a computer-readable storage medium, such as storage unit 18. In some embodiments, part or all of the computer program may be loaded and / or installed on electronic device 10 via ROM 12 and / or communication module 19. When the computer program is loaded into RAM 13 and executed by processor 11, one or more steps of the smart glasses-based authentication method described above may be performed. Alternatively, in other embodiments, processor 11 may be configured to perform the smart glasses-based authentication method by any other suitable means (e.g., by means of firmware).

[0182] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SoCs), payload-programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.

[0183] Computer programs used to implement the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that when executed by the processor, the computer programs cause the functions / operations specified in the flowcharts and / or block diagrams to be performed. The computer programs may be executed entirely on a machine, partially on a machine, or as a standalone software package, partially on a machine and partially on a remote machine, or entirely on a remote machine or server.

[0184] In the context of this invention, a computer-readable storage medium can be a tangible medium that may contain or store a computer program for use by or in conjunction with an instruction execution system, apparatus, or device. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination thereof. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.

[0185] To provide interaction with a user, the systems and techniques described herein can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the electronic device. Other types of devices can also be used to provide interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including sound input, voice input, or tactile input).

[0186] The systems and technologies described herein can be implemented in computing systems that include backend components (e.g., as data servers), or middleware components (e.g., application servers), or frontend components (e.g., user computers with graphical user interfaces or web browsers through which users can interact with implementations of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., communication networks). Examples of communication networks include local area networks (LANs), wide area networks (WANs), blockchain networks, and the Internet.

[0187] A computing system can include clients and servers. Clients and servers are generally located far apart and typically interact through communication networks. The client-server relationship is created by computer programs running on the respective computers and having a client-server relationship with each other. The server can be a cloud server, also known as a cloud computing server or cloud host, which is a hosting product within the cloud computing service system to address the shortcomings of traditional physical hosts and VPS services, such as high management difficulty and weak business scalability.

[0188] This invention also provides a computer program product, including a computer program that, when executed by a processor, can implement the smart glasses-based authentication method as provided in any embodiment of this application.

[0189] In the implementation of the computer program product, computer program code for performing the operations of this application can be written in one or more programming languages ​​or a combination thereof. Programming languages ​​include object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as conventional procedural programming languages ​​such as C or similar languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0190] It should be understood that the various forms of processes shown above can be used, with steps reordered, added, or deleted. For example, the steps described in this invention can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution of this invention can be achieved, and this is not limited herein.

[0191] The specific embodiments described above do not constitute a limitation on the scope of protection of this invention. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this invention should be included within the scope of protection of this invention.

Claims

1. A smart glasses-based identity verification method, characterized by, include: In response to the smart glasses recognizing the transaction object, a transaction verification certificate is displayed; Within the voice authorization time window associated with the transaction verification certificate, the biometric information of the target user associated with the smart glasses is obtained; wherein, the voice authorization time window is generated based on the voice authorization trigger time; Upon receiving a voice authorization command and confirming that the identity verification result based on the biometric information is successful, a transaction operation on the transaction target is executed.

2. The method of claim 1, wherein, The transaction verification certificate is generated based on the transaction amount, merchant type, and risk level. The transaction verification certificate includes the transaction amount, random verification code, authorization password, and certificate generation timestamp.

3. The method of claim 1, wherein, The voice authorization time window is generated based on the voice authorization trigger time and includes: The window start time is determined based on the voice authorization trigger time and the effective window advance. The window cutoff time is determined based on the voice authorization trigger time and the effective window delay. A voice authorization time window is generated based on the window start time and the window end time.

4. The method of claim 1, wherein, The acquisition of biometric information of the target user associated with the smart glasses includes: Acquire the initial voiceprint and initial iris features of the target user associated with the smart glasses; wherein the difference between the effective acquisition time of the initial iris features and the voice authorization trigger time is less than the maximum allowable timing deviation value.

5. The method of claim 1, wherein, The biometric information includes: voiceprint signal, iris microtremor signal, pupil diameter fluctuation signal, and respiratory fundamental frequency signal; the method further includes: The cross-correlation coefficient between the naturalness score of the voiceprint signal and the naturalness score of the iris microtremor signal is determined as the first cross-correlation coefficient; The cross-correlation coefficient between the naturalness score of the voiceprint signal and the naturalness score of the pupil diameter fluctuation signal is determined as the second cross-correlation coefficient; The cross-correlation coefficient between the naturalness score of the voiceprint signal and the naturalness score of the respiratory fundamental frequency signal is determined as the third cross-correlation coefficient; The cross-correlation coefficient between the naturalness score of the iris microtremor signal and the naturalness score of the pupil diameter fluctuation signal is determined as the fourth cross-correlation coefficient; The physiological signal coupling degree is determined based on the ratio between the sum of cross-correlation coefficients and the pre-configured average coefficient; wherein the sum of cross-correlation coefficients is the sum of the first cross-correlation coefficient, the second cross-correlation coefficient, the third cross-correlation coefficient, and the fourth cross-correlation coefficient; The liveness verification result of the target user is determined based on the comparison between the coupling degree of the physiological signal and the pre-configured coupling degree threshold, and the comparison between the naturalness score of each signal and the score threshold.

6. The method of claim 1, wherein, The method further includes: The initial iris features and initial voiceprint features of the target user are perturbed to obtain perturbed iris features and perturbed voiceprint features; The disturbed iris features and the disturbed voiceprint features are homomorphically encrypted to obtain encrypted iris features and encrypted voiceprint features; Cross-attention fusion is performed on the encrypted iris features and the encrypted voiceprint features to obtain fused ciphertext features.

7. The method of claim 1, wherein, The authentication result is obtained based on the biometric information, including: If the similarity between the fused encrypted features obtained based on the biometric information and the registration feature template is greater than or equal to the target verification threshold, the liveness verification result obtained based on the biometric information is verified as passed, the temporal double-lock verification based on the voiceprint features and iris features in the biometric information is passed, and the voice authorization command contains the authorization password, a zero-knowledge proof is generated. Receive the authentication result generated by the cloud server based on the zero-knowledge proof and the pre-stored verification key.

8. The method of claim 7, wherein, The process of determining the target verification threshold includes: The cloud server dynamically adjusts the weights of transaction amount, scenario, environment, and device security based on transaction amount, transaction scenario, data collection environment, user habits, and device security status. The target verification threshold is determined based on the product of the preset basic verification threshold, the transaction amount weight, the scenario weight, the environment weight, and the device security weight.

9. The method according to any one of claims 1-8, characterized in that, The method further includes: Within the preset timeframe after the transaction ends, the biometric information of the target user and the actual device posture of the smart glasses are acquired in real time. If no iris features are detected, and the naturalness scores of the voiceprint signal, iris micro-tremor signal, pupil diameter fluctuation signal, and respiratory fundamental frequency signal are less than the scoring threshold, and the degree of change in the actual device posture reaches the change threshold, a risk handling operation will be performed.

10. An identity verification device based on smart glasses, characterized in that, include: The display module is used to display transaction verification credentials in response to the smart glasses recognizing the transaction target; The acquisition module is used to acquire biometric information of a target user associated with the smart glasses within a voice authorization time window associated with the transaction verification certificate; wherein the voice authorization time window is generated based on the voice authorization trigger time. The execution module is used to execute a transaction operation on the transaction target in response to receiving a voice authorization command and the identity verification result obtained based on the biometric information being successful.

11. A type of smart glasses, characterized in that, The smart glasses include: a communication module, at least one processor; and A memory communicatively connected to the at least one processor; wherein, The communication module is used for data transmission with the cloud server; The memory stores a computer program that can be executed by the at least one processor, the computer program being executed by the at least one processor to enable the at least one processor to perform the smart glasses-based authentication method according to any one of claims 1-9.

12. An identity verification system based on smart glasses, characterized in that, include: Smart glasses and a cloud server; wherein the smart glasses are communicatively connected to the cloud server; In response to the smart glasses recognizing the subject matter of the transaction, the smart glasses display a transaction verification certificate; Within the voice authorization time window associated with the transaction verification certificate, the smart glasses acquire the biometric information of the target user associated with the smart glasses; wherein, the voice authorization time window is generated based on the voice authorization trigger time; Upon receiving a voice authorization command, and with the cloud server confirming successful identity verification based on the biometric information, the smart glasses execute a transaction operation on the transaction target.

13. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer instructions that, when executed by a processor, implement the authentication method based on smart glasses as described in any one of claims 1-9.

14. A computer program product, characterized in that, The computer program product includes a computer program that, when executed by a processor, implements the authentication method based on smart glasses according to any one of claims 1-9.