Security verification method and device based on augmented reality technology, and storage medium

Abstract

The invention discloses a security verification method and device based on an augmented reality technology, and a storage medium. Relates to the field of financial science and technology, and the method comprises the steps: obtaining the environment information of a physical environment where a target customer is located through an augmented reality sensor in a target transaction process of the target customer under the condition of obtaining the authorization of the target customer; generating an environment key based on the environment information; matching the environment key with a pre-stored key in a preset database, and collecting a first mandible vibration spectrum and an iris feature when the target client reads the digital code under the condition of successful matching; fusing the first mandible vibration spectrum, the iris feature and a pre-stored voiceprint to generate an authentication factor; and verifying the authentication factor through the system back end, and executing the target transaction under the condition that the verification of the authentication factor is passed. Through the method and the device, the problem of poor verification accuracy caused by high in-vivo detection misjudgment rate of security verification based on an augmented reality technology in related technologies is solved.

Description

Technical Field

[0001] This application relates to the field of financial technology, and more specifically, to a secure verification method, apparatus, and storage medium based on augmented reality technology. Background Technology

[0002] As Augmented Reality (AR) technology matures, it can be applied to customer authentication, virtual transaction environment construction, and personalized service delivery. However, while current AR security service systems can provide intuitive virtual interface overlays to guide customers through complex operations, their technical implementation has some fundamental limitations. On the one hand, the system's high dependence on preset marker points greatly limits the application scenarios and user experience flexibility of AR services. On the other hand, authentication methods based on single biometric features (e.g., face or iris recognition) have limited accuracy in liveness detection and face potential security risks from attacks that mimic highly realistic biometric features, hindering the widespread application of AR in security verification.

[0003] In biometric identification, most existing technologies rely on a single biometric feature, such as iris or facial recognition, for customer authentication. In practice, single features are easily affected by environmental factors, such as lighting conditions, and the user wearing glasses or masks, which can reduce recognition accuracy. More seriously, single biometric features are easily replicated; for example, 3D masks can mimic facial features, and high-precision iris images can be used to deceive the system, leading to a high false positive rate in liveness detection mechanisms and posing certain security risks.

[0004] There is currently no effective solution to the problem of high false positive rate in liveness detection for security verification based on augmented reality technology, which leads to poor verification accuracy. Summary of the Invention

[0005] The main objective of this application is to provide a security verification method, device, and storage medium based on augmented reality technology, in order to solve the problem of high false positive rate in liveness detection and poor verification accuracy in related technologies based on augmented reality technology.

[0006] To achieve the above objectives, according to one aspect of this application, a security verification method based on augmented reality technology is provided. The method includes: during a target customer's transaction, with the target customer's authorization, acquiring environmental information of the target customer's physical environment using augmented reality sensors; generating an environmental key based on the environmental information; matching the environmental key with a pre-stored key in a preset database; if the match is successful, collecting the first mandibular vibration spectrum and iris features of the target customer when reading a digital code; fusing the first mandibular vibration spectrum, iris features, and pre-stored voiceprint to generate an authentication factor; verifying the authentication factor through a system backend; and executing the target transaction if the authentication factor verification is successful.

[0007] Optionally, fusing the first mandibular vibration spectrum, iris features, and pre-stored voiceprints to generate an authentication factor includes: fusing the first mandibular vibration spectrum, iris features, and pre-stored voiceprints according to preset weights corresponding to the first mandibular vibration spectrum, preset weights corresponding to the iris features, and preset weights corresponding to the pre-stored voiceprints to obtain fused feature data; and encrypting the fused feature data using a hash function to generate the authentication factor.

[0008] Optionally, the authentication factor is verified through the system backend. If the authentication factor verification is successful, the target transaction is executed, including: decrypting the authentication factor using a key through the system backend to obtain the decrypted first mandibular vibration spectrum, the decrypted iris feature, and the decrypted pre-stored voiceprint; matching the decrypted first mandibular vibration spectrum with the pre-stored mandibular vibration spectrum template to determine the first degree of matching; comparing the decrypted iris feature with the pre-stored iris template to determine the second degree of matching; matching the decrypted pre-stored voiceprint with the real-time voiceprint of the target customer during the target transaction to determine the third degree of matching; verifying the authentication factor based on the first, second, and third degree of matching, and executing the target transaction if the authentication factor verification is successful through the system backend.

[0009] Optionally, generating an environmental key based on environmental information includes: identifying a target region in the physical environment based on the environmental information, wherein the target region is a region in the physical environment where the gradient change is greater than a preset threshold; and generating an environmental key based on the target region and quantum dot-nanocrystal hybrid thin film technology.

[0010] Optionally, if the authentication factor is verified, executing the target transaction includes: collecting the business interface during the execution of the target transaction, wherein the business interface includes a human image of the target customer; if the occlusion area of ​​the human image is greater than a preset percentage, splitting the business interface into multiple visually continuous sub-interface fragments; and, based on the target customer's field of vision direction and dynamic position information, using non-Euclidean space mapping technology, redistributing the multiple visually continuous sub-interface fragments to the arc-shaped area of ​​the target customer's field of vision within a preset angle range.

[0011] Optionally, if the authentication factor is verified, executing the target transaction includes: recognizing the target customer's signature gesture; collecting the second mandibular vibration spectrum when the target customer executes the target transaction; if the first mandibular vibration spectrum and the second mandibular vibration spectrum are successfully matched, matching a preset instruction according to the second mandibular vibration spectrum; and executing the target transaction according to the preset instruction if the signature gesture is verified.

[0012] Optionally, if the signature gesture verification is successful, executing the target transaction according to the preset instructions includes: analyzing the computing power requirement corresponding to the preset instructions; selecting computing power resources according to the computing power requirement; and executing the target transaction according to the computing power resources and the preset instructions.

[0013] To achieve the above objectives, according to another aspect of this application, a security verification device based on augmented reality technology is provided. The device includes: an acquisition unit, configured to acquire environmental information of the physical environment of the target customer during a target transaction, provided the target customer has authorized the transaction; a generation unit, configured to generate an environmental key based on the environmental information; a matching unit, configured to match the environmental key with a pre-stored key in a preset database, and, if the match is successful, to collect the first mandibular vibration spectrum and iris features of the target customer when reading a digital code; a fusion unit, configured to fuse the first mandibular vibration spectrum, iris features, and pre-stored voiceprint to generate an authentication factor; and an execution unit, configured to verify the authentication factor through a system backend, and, if the authentication factor verification is successful, to execute the target transaction.

[0014] Optionally, the fusion unit includes: a fusion module, used to fuse the first mandibular vibration spectrum, iris features and pre-stored voiceprints according to the preset weights corresponding to the first mandibular vibration spectrum, the preset weights corresponding to the iris features and the preset weights corresponding to the pre-stored voiceprints, to obtain fused feature data; and a first generation module, used to encrypt the fused feature data through a hash function to generate an authentication factor.

[0015] Optionally, the execution unit includes: a decryption module, used to decrypt the authentication factor using a key through the system backend to obtain the decrypted first mandibular vibration spectrum, the decrypted iris feature, and the decrypted pre-stored voiceprint; a first matching module, used to match the decrypted first mandibular vibration spectrum with the pre-stored mandibular vibration spectrum template to determine the first matching degree between the decrypted first mandibular vibration spectrum and the pre-stored mandibular vibration spectrum template; a second matching module, used to compare the decrypted iris feature with the pre-stored iris template to determine the second matching degree between the decrypted iris feature and the pre-stored iris template; a third matching module, used to match the decrypted pre-stored voiceprint with the real-time voiceprint of the target customer during the target transaction process to determine the third matching degree between the decrypted pre-stored voiceprint and the real-time voiceprint; and a first execution module, used to verify the authentication factor based on the first matching degree, the second matching degree, and the third matching degree, and execute the target transaction if the authentication factor verification is successful in the system backend.

[0016] Optionally, the generation unit includes: a first identification module for identifying a target region in the physical environment based on environmental information, wherein the target region is a region in the physical environment where the gradient change is greater than a preset threshold; and a second generation module for generating an environmental key based on the target region and quantum dot-nanocrystal hybrid thin film technology.

[0017] Optionally, the execution unit includes: a first acquisition module for acquiring the business interface during the execution of the target transaction, wherein the business interface includes a human body image of the target customer; a splitting module for splitting the business interface into multiple visually continuous sub-interface fragments when the occlusion area of ​​the human body image is greater than a preset percentage; and a distribution module for redistributing the multiple visually continuous sub-interface fragments to the visual arc area within a preset angle range of the target customer, based on the target customer's field of vision direction and dynamic position information, using non-Euclidean space mapping technology.

[0018] Optionally, the execution unit includes: a second identification module for identifying the signature gesture of the target customer; a second acquisition module for acquiring the second mandibular vibration spectrum when the target customer executes the target transaction; a fourth matching module for matching a preset instruction according to the second mandibular vibration spectrum if the first mandibular vibration spectrum and the second mandibular vibration spectrum are successfully matched; and a second execution module for executing the target transaction according to the preset instruction if the signature gesture verification is successful.

[0019] Optionally, the second execution module includes: an analysis submodule for analyzing the computing power requirements corresponding to the preset instructions; a selection submodule for selecting computing power resources according to the computing power requirements; and an execution submodule for executing the target transaction according to the computing power resources and the preset instructions.

[0020] According to another aspect of this application, a computer-readable storage medium is provided, the computer-readable storage medium including a stored program, wherein, when the program is running, it controls the device where the computer-readable storage medium is located to execute any kind of security verification method based on augmented reality technology.

[0021] According to another aspect of this application, an electronic device is provided, comprising: one or more processors, a memory, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs include a security verification method for performing any augmented reality-based technology.

[0022] According to another aspect of this application, a computer program product is provided, including computer instructions that, when executed by a processor, implement the steps of the augmented reality-based security verification method described above.

[0023] In this embodiment, during a target transaction, with the target customer's authorization, environmental information about the target customer's physical environment is acquired using augmented reality sensors. Based on this environmental information, an environmental key is generated. The environmental key is matched with a pre-stored key in a preset database. If the match is successful, the vibration spectrum of the first mandible and iris features of the target customer when reading a digital code are collected. The vibration spectrum of the first mandible, iris features, and pre-stored voiceprints are fused to generate an authentication factor. The authentication factor is verified by the system backend. If the authentication factor is verified, the target transaction is executed. This solves the technical problem of high false positive rate in liveness detection for security verification based on augmented reality technology, which leads to poor verification accuracy. In this application, environmental information of the physical environment in which the target customer is located during the target transaction is obtained through augmented reality sensors. An environmental key is generated based on the environmental information and matched with a pre-stored key. If the match is successful, the vibration spectrum of the first mandible and iris features of the target customer are collected and fused with the pre-stored voiceprint to obtain an authentication factor. After the verification factor formed by the fusion of the vibration spectrum of the first mandible, iris features and the pre-stored voiceprint passes the verification, the target transaction is executed, thereby achieving the technical effect of improving the accuracy of verification. Attached Figure Description

[0024] The accompanying drawings, which form part of this application, are used to provide a further understanding of this application. The illustrative embodiments and descriptions of this application are used to explain this application and do not constitute an undue limitation of this application. In the drawings:

[0025] Figure 1 A hardware structure block diagram of a computer terminal for implementing a security verification method based on augmented reality technology is shown.

[0026] Figure 2 This is a flowchart of a security verification method based on augmented reality technology provided in the embodiments of this application;

[0027] Figure 3 This is a schematic diagram of a security verification device based on augmented reality technology provided in the embodiments of this application;

[0028] Figure 4 This is a structural block diagram of an electronic device according to an embodiment of this application. Detailed Implementation

[0029] To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present application, and not all embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative effort should fall within the scope of protection of the present application.

[0030] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0031] It should be noted that all relevant information (including but not limited to user environment information, user personal information, etc.) and data (including but not limited to data used for verification, data used for analysis, etc.) involved in this application are information and data authorized by the user or fully authorized by all parties. For example, if there is an interface between this system and the relevant user or organization, before obtaining the relevant information, it is necessary to send an acquisition request to the aforementioned user or organization through the interface, and obtain the relevant information after receiving the consent information from the aforementioned user or organization.

[0032] Example 1

[0033] According to an embodiment of this application, a method embodiment for security verification based on augmented reality technology is also provided. It should be noted that the steps shown in the flowchart in the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions. Although a logical order is shown in the flowchart, in some cases, the steps shown or described may be executed in a different order than that shown here.

[0034] The method embodiment provided in Embodiment 1 of this application can be executed on a mobile terminal, computer terminal, or similar computing device. Figure 1 A hardware structure block diagram of a computer terminal (or mobile device) for implementing a security verification method based on augmented reality technology is shown. Figure 1 As shown, the computer terminal 10 (or mobile device) may include one or more processors 102 (shown as 102a, 102b, ..., 102n in the figure) 102 (processor 102 may include, but is not limited to, a microprocessor MCU or a programmable logic device FPGA, etc.), a memory 104 for storing data, and a transmission device 106 for communication functions. In addition, it may also include: a display, an input / output interface (I / O interface), a Universal Serial Bus (USB) port (which may be included as one of the ports of a BUS bus), a network interface, a power supply, and / or a camera. Those skilled in the art will understand that... Figure 1 The structure shown is for illustrative purposes only and does not limit the structure of the aforementioned electronic device. For example, computer terminal 10 may also include... Figure 1 The more or fewer components shown, or having the same Figure 1 The different configurations shown.

[0035] It should be noted that the aforementioned one or more processors 102 and / or other data processing circuits are generally referred to herein as "data processing circuits". These data processing circuits may be embodied, in whole or in part, in software, hardware, firmware, or any other combination thereof. Furthermore, the data processing circuits may be a single, independent processing module, or may be integrated, in whole or in part, into any other element within the computer terminal 10 (or mobile device). As involved in the embodiments of this application, the data processing circuits serve as a processor control mechanism (e.g., selection of a variable resistor termination path connected to an interface).

[0036] The memory 104 can be used to store software programs and modules of application software, such as the program instructions / data storage device corresponding to the security verification method based on augmented reality technology in the embodiments of this application. The processor 102 executes various functional applications and data processing by running the software programs and modules stored in the memory 104, thereby realizing the aforementioned security verification method based on augmented reality technology. The memory 104 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory 104 may further include memory remotely located relative to the processor 102, and these remote memories can be connected to the computer terminal 10 via a network. Examples of such networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.

[0037] The transmission device 106 is used to receive or send data via a network. Specific examples of the network described above may include a wireless network provided by the communication provider of the computer terminal 10. In one example, the transmission device 106 includes a Network Interface Controller (NIC), which can connect to other network devices via a base station to communicate with the Internet. In another example, the transmission device 106 may be a Radio Frequency (RF) module, used for wireless communication with the Internet.

[0038] The display can be, for example, a touchscreen liquid crystal display (LCD), which allows the user to interact with the user interface of the computer terminal 10 (or mobile device).

[0039] Under the aforementioned operating environment, this application provides the following: Figure 2 The security verification method based on augmented reality technology is shown. Figure 2 This is a flowchart of a security verification method based on augmented reality technology according to Embodiment 1 of this application.

[0040] Step S201: During the target transaction process, with the authorization of the target customer, the environmental information of the physical environment in which the target customer is located is obtained through augmented reality sensors.

[0041] Optionally, during the process of a target customer conducting a target transaction (such as a large transfer or account inquiry), authorization from the target customer must be obtained first to protect customer privacy and data security. Augmented reality (AR) sensors can be integrated into AR glasses or devices. These sensors can capture and analyze environmental information about the target customer's surroundings. This environmental information includes geometric information about the target customer's environment, such as the texture of marble, the veins of green plants, and the shape and location of furniture.

[0042] Step S202: Generate an environment key based on the environment information.

[0043] Optionally, based on environmental information, an environmental key can be generated using quantum dot-nanocrystalline hybrid thin film technology. By analyzing high-entropy regions in the environmental point cloud data—regions with high information density and difficult-to-predict characteristics—and utilizing the properties of these regions combined with the random distribution of the quantum dot-nanocrystalline hybrid thin film, a chaotic mapping seed is generated. Subsequently, the chaotic mapping seed undergoes further encryption processing and, combined with a pre-stored private key, generates the environmental key. The generated environmental key possesses high randomness and uniqueness, significantly increasing the difficulty and security of environmental authentication.

[0044] Step S203: Match the environment key with the pre-stored key in the preset database. If the match is successful, collect the first mandibular vibration spectrum and iris features of the target customer when reading the digital code.

[0045] Optionally, after the environment key successfully matches the pre-stored key, indicating that the user is in a secure environment, the system then collects the first mandibular vibration spectrum and iris features of the target customer while they read the numeric code. The mandibular vibration spectrum, captured by a bone conduction microphone, reflects the vibration pattern of the mandible when the target customer reads the code and serves as a biometric for liveness detection and authentication. The iris features are obtained through iris recognition technology. The iris contains complex textures, and each person's iris pattern is unique. When the target customer reads the numeric code, the bone conduction microphone captures the minute vibrations of the mandible and records them as the first mandibular vibration spectrum, while the iris camera acquires an iris image for iris feature extraction.

[0046] Step S204: The vibration spectrum of the first mandible, iris features, and pre-stored voiceprints are fused to generate an authentication factor.

[0047] Optionally, the collected first mandibular vibration spectrum, iris features, and pre-stored voiceprint information can be fused to generate an authentication factor. Voiceprint refers to the personal voice characteristics obtained by analyzing speech signals, and pre-stored voiceprints are voice templates stored by target customers when registering or setting security parameters.

[0048] Step S205: Verify the authentication factor through the system backend. If the authentication factor is verified, execute the target transaction.

[0049] Optionally, the system backend verifies the generated authentication factor. If the verification passes, it is considered that the target customer has provided legitimate identity verification and liveness detection. At this time, the system allows the execution of the target transaction, ensuring that the target transaction has undergone strict identity verification and liveness detection, effectively preventing unauthorized access and fraudulent behavior, and improving the security and reliability of the transaction.

[0050] The security verification method based on augmented reality technology provided in this application, during the target customer's transaction process, acquires environmental information of the target customer's physical environment through augmented reality sensors with the target customer's authorization; generates an environmental key based on the environmental information; matches the environmental key with a pre-stored key in a preset database; if the match is successful, collects the first mandibular vibration spectrum and iris features when the target customer reads a digital code; fuses the first mandibular vibration spectrum, iris features, and pre-stored voiceprint to generate an authentication factor; verifies the authentication factor through the system backend; and executes the target transaction if the authentication factor verification is successful. This method solves the technical problem of high false positive rate in liveness detection and poor verification accuracy in security verification based on augmented reality technology. In this application, environmental information of the physical environment in which the target customer is located during the target transaction is obtained through augmented reality sensors. An environmental key is generated based on the environmental information and matched with a pre-stored key. If the match is successful, the vibration spectrum of the first mandible and iris features of the target customer are collected and fused with the pre-stored voiceprint to obtain an authentication factor. After the verification factor formed by the fusion of the vibration spectrum of the first mandible, iris features and the pre-stored voiceprint passes the verification, the target transaction is executed, thereby achieving the technical effect of improving the accuracy of verification.

[0051] To defend against replication attacks based on a single biometric feature, optionally, in the augmented reality-based security verification method provided in this application embodiment, the vibration spectrum of the first mandible, iris features, and pre-stored voiceprints are fused to generate authentication factors including:

[0052] The first step is to fuse the first mandibular vibration spectrum, iris features, and pre-stored voiceprints according to the preset weights corresponding to the first mandibular vibration spectrum, the preset weights corresponding to the iris features, and the preset weights corresponding to the pre-stored voiceprints to obtain the fused feature data.

[0053] Optionally, the system first performs linear weighting of the first mandibular vibration spectrum, iris features, and pre-stored voiceprints according to a preset weight allocation, or integrates them using a more complex fusion algorithm (such as a multimodal fusion algorithm, deep learning model, etc.) to generate fused feature data. The weight allocation considers the robustness, reproducibility, and stability of different biometric features, and is dynamically adjusted to balance security and user experience.

[0054] The second step is to encrypt the merged feature data using a hash function to generate an authentication factor.

[0055] Optionally, the fused feature data is treated as input, and the system uses a hash function (such as SHA-256, SHA-3, etc.) to convert it into a fixed-length hash value. The generated authentication factor, by combining comprehensive information from the environmental key, the first mandibular vibration spectrum, iris features, and pre-stored voiceprints, and encrypted using a hash function, achieves significantly enhanced security.

[0056] In summary, the above steps generate highly secure authentication factors, which can be used to verify the identity of target customers and perform liveness detection, ensuring the security and reliability of transactions.

[0057] To improve the accuracy of security verification, optionally, in the security verification method based on augmented reality technology provided in this application embodiment, the authentication factor is verified by the system backend, and the target transaction is executed when the authentication factor verification is successful, including:

[0058] The first step is to use the key to decrypt the authentication factor through the system backend, and obtain the decrypted first mandibular vibration spectrum, the decrypted iris features, and the decrypted pre-stored voiceprint.

[0059] Optionally, upon receiving the generated authentication factor, the system backend decrypts the authentication factor using a previously saved security key. The decryption process is the reverse of encryption, aiming to restore the first mandibular vibration spectrum, iris features, and voiceprint information contained in the authentication factor to their original state for subsequent matching and verification. This ensures the secure transmission and storage of biometric data; even if the authentication factor is intercepted during transmission, its content is difficult to decrypt without the correct key, thus protecting the security of customer information and preventing unauthorized access and use of data.

[0060] The second step is to match the decrypted first mandibular vibration spectrum with the pre-stored mandibular vibration spectrum template to determine the first degree of matching between the decrypted first mandibular vibration spectrum and the pre-stored mandibular vibration spectrum template.

[0061] Optionally, the system backend compares the decrypted first mandibular vibration spectrum with a pre-stored mandibular vibration spectrum template, and determines the first matching degree by calculating the similarity between the two. The matching degree between the first mandibular vibration spectrum and the pre-stored template can be evaluated based on methods such as spectral analysis or pattern matching techniques. As part of the authentication factor, the mandibular vibration spectrum increases the complexity and security of identity verification, effectively resisting replication attacks based on static biometrics.

[0062] The third step is to compare the decrypted iris features with the pre-stored iris template to determine the second matching degree between the decrypted iris features and the pre-stored iris template.

[0063] Optionally, iris features are highly unique and stable, making them a very secure factor in biometrics. By comparing the decrypted iris features with a pre-stored template, the identity of the target customer can be further confirmed, maintaining high-precision authentication even in complex environments, thus enhancing the reliability and security of the overall authentication system.

[0064] The fourth step is to match the decrypted pre-stored voiceprint with the real-time voiceprint of the target customer during the target transaction process to determine the third degree of matching between the decrypted pre-stored voiceprint and the real-time voiceprint.

[0065] Optionally, during the target transaction process, the system will collect the target customer's real-time voiceprint and match it with the decrypted pre-stored voiceprint to determine the third degree of matching. Voiceprint matching uses acoustic feature extraction and comparison technology. The matching verification between real-time voiceprint and pre-stored voiceprint adds a dimension to multi-factor authentication. Combined with the verification of other biometric features, it can ensure that the customer's identity can still be accurately identified in most cases, prevent voice imitation and playback attacks, and improve the robustness of the authentication process.

[0066] The fifth step is to verify the authentication factor based on the first, second, and third matching degrees. If the authentication factor verification is successful in the system backend, the target transaction is executed.

[0067] Optionally, considering the first, second, and third matching degrees, a threshold can be set. Only when all matching degrees exceed this threshold is the entire authentication factor considered verified. Alternatively, weighted averaging, logical AND operations, or other methods can be used to combine all matching degrees to form a holistic verification decision.

[0068] In summary, by verifying the authentication factors through the first, second, and third matching degrees mentioned above, the comprehensiveness and security of multi-factor authentication are ensured, the risk of single point of failure is reduced, and the target transaction will only be executed if the verification is passed, effectively guaranteeing the security and legality of the transaction.

[0069] To enhance the randomness of the environment key, optionally, in the security verification method based on augmented reality technology provided in this application embodiment, generating the environment key based on environmental information includes:

[0070] The first step is to identify the target region in the physical environment based on environmental information. The target region is the region in the physical environment where the gradient change is greater than a preset threshold.

[0071] Optionally, regions in the physical environment whose gradient changes are greater than a preset threshold can be identified. Gradient change refers to the rate of change of environmental features in space. The preset threshold is a set numerical standard used to define which regions contain sufficient information and complexity to be selected as target regions.

[0072] The second step involves generating an environmental key based on the target region and quantum dot-nanocrystalline hybrid thin film technology.

[0073] Optionally, after determining the target region, quantum dot-nanocrystal hybrid thin film technology is used to combine the characteristics of the target region with the quantum effects of the thin film to generate an environmental key. The system maps the characteristic information of the target region onto the thin film, and by exciting the quantum effects of the thin film, obtains a set of randomly distributed optical or electrical modes. These modes serve as seeds for chaotic mapping and are further transformed into environmental keys.

[0074] In summary, the generation of environmental keys using the quantum dot-nanocrystalline hybrid thin film technology combines the complexity of the physical environment with the randomness of quantum materials, resulting in environmental keys that are highly random and unpredictable.

[0075] To ensure smooth user interaction during the execution of the target transaction, optionally, in the security verification method based on augmented reality technology provided in this application embodiment, executing the target transaction after the authentication factor is verified includes:

[0076] The first step is to collect the business interface during the execution of the target transaction, which includes the human body image of the target customer.

[0077] Optionally, the business interface during the execution of the target transaction can be collected. The business interface is an interactive interface provided to the target customer in the AR environment, which can combine virtual information with real-world scenarios.

[0078] The second step is to split the business interface into multiple visually continuous sub-interface fragments when the area occluded by the human image is greater than the preset percentage.

[0079] Optionally, when the system detects that the area of ​​a human image occluding the business interface exceeds a preset percentage (i.e., exceeds a certain threshold, such as 15%), in order to ensure the continuity of the transaction process, the system will automatically split the business interface into multiple sub-interface fragments. Each sub-interface fragment contains a portion of the business interface content. In this way, even if one fragment is occluded, the other fragments can still maintain the user's visibility of the transaction information, ensuring the continuity of the transaction operation and the user experience.

[0080] The third step involves using non-Euclidean spatial mapping technology, based on the target customer's visual direction and dynamic location information, to redistribute multiple visually continuous sub-interface fragments to the visual arc area within the target customer's preset angle range.

[0081] Optionally, after the business interface is split, the system will use non-Euclidean spatial mapping technology to redistribute multiple sub-interface fragments to the target customer's pre-defined angular arc-shaped field of view, based on the target customer's viewing direction and dynamic location information. This distribution method takes into account the target customer's positional changes in space and the viewing characteristics of augmented reality sensors (e.g., AR glasses), ensuring that each sub-interface fragment is presented at the most suitable angle and position in the target customer's field of view, so that the target customer can continue to effectively view transaction information even if the target customer moves or changes posture.

[0082] In summary, the above steps can solve the problem of human image occlusion during the transaction process, thereby achieving continuous visualization and efficient interaction of transaction information.

[0083] To enhance the security of the target transaction process, optionally, in the augmented reality-based security verification method provided in this application embodiment, executing the target transaction after verifying the authentication factor passes includes:

[0084] The first step is to identify the signature gesture of the target customer.

[0085] Optionally, a signature gesture refers to a series of specific gestures performed by a user to confirm a transaction or other important operation, expressed through the form of air gestures. By recognizing signature gestures, the system can ensure that users actively participate in the transaction confirmation process, rather than passively or under duress, thus increasing the initiative and security of the transaction.

[0086] The second step is to collect the vibration spectrum of the second mandible when the target customer executes the target transaction.

[0087] Optionally, when a target customer's signature gesture is detected, the vibration spectrum of the second mandible is collected in real time during the execution of the target transaction.

[0088] The third step is to match the vibration spectrum of the first mandible with the vibration spectrum of the second mandible, and then match the preset command according to the vibration spectrum of the second mandible.

[0089] Optionally, the vibration spectrum of the second mandible can be matched with that of the first mandible. If the two match successfully, it indicates that the target customer's state at the time of signing and confirming the transaction is consistent with that at the time of generating the authentication factor, and that they have not been subjected to a liveness attack. By analyzing the acoustic features in the vibration spectrum of the second mandible, it is possible to identify whether the target customer has issued a preset instruction (such as "confirm transfer" or "agree to purchase") through a bone conduction microphone.

[0090] The fourth step is to execute the target transaction according to the preset instructions once the signature gesture verification is successful.

[0091] Optionally, upon receiving a preset instruction and confirming it via a signature gesture, the corresponding target transaction, such as fund transfer, goods purchase, or service order, will be executed automatically.

[0092] In summary, by combining the above steps with dual confirmation through signature gestures and preset instructions, the execution of the target transaction is ensured to be based on the clear intention of the target customer, providing a safe and intuitive transaction confirmation experience.

[0093] To optimize the use of computing resources, optionally, in the security verification method based on augmented reality technology provided in this application embodiment, executing the target transaction according to a preset instruction after the signature gesture verification is passed includes:

[0094] The first step is to analyze the computing power requirements corresponding to the preset instructions.

[0095] Optionally, the required computing power can be analyzed based on the specific content of the preset instructions, including estimates of the transaction type, the amount of data processing required, and the complexity of the interactive interface.

[0096] The second step is to select computing resources based on computing power requirements.

[0097] For example, simple transaction queries require only low computing power to handle text display and basic user interaction; while high-precision 3D model displays and complex financial operations require higher computing power to support real-time rendering and data analysis.

[0098] The third step is to execute the target transaction based on computing resources and preset instructions.

[0099] Optionally, after the computing resources are selected, the target transaction related to the preset instructions is executed according to the specific configuration of the selected resources. This includes a series of operations such as data processing, graphics rendering, and security verification to ensure the correctness of the transaction information, the integrity of privacy protection, and the smoothness of the interaction.

[0100] In summary, by following the steps above and accurately matching computing resources with preset instructions, target transactions can be executed efficiently and securely. Whether it is a simple query or a complex high-precision model display, timely response and high-quality service can be obtained.

[0101] It should be noted that the steps shown in the flowchart in the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions, and although a logical order is shown in the flowchart, in some cases the steps shown or described may be executed in a different order than that shown here.

[0102] Example 2

[0103] This application also provides a security verification device based on augmented reality technology. It should be noted that this security verification device can be used to execute the security verification method based on augmented reality technology provided in this application. The following describes the security verification device based on augmented reality technology provided in this application.

[0104] According to embodiments of this application, an apparatus for implementing the above-described security verification method based on augmented reality technology is also provided, such as... Figure 3 As shown, the device includes: an acquisition unit 301, a generation unit 302, a matching unit 303, a fusion unit 304, and an execution unit 305.

[0105] Specifically, the acquisition unit 301 is used to acquire environmental information of the physical environment in which the target customer is located through an augmented reality sensor, with the authorization of the target customer, during the target customer's target transaction process.

[0106] The generation unit 302 is used to generate an environment key based on environment information;

[0107] The matching unit 303 is used to match the environmental key with the pre-stored key in the preset database. If the match is successful, it collects the first mandibular vibration spectrum and iris features of the target customer when reading the digital code.

[0108] The fusion unit 304 is used to fuse the vibration spectrum of the first mandible, iris features and pre-stored voiceprints to generate an authentication factor;

[0109] Execution unit 305 is used to verify the authentication factor through the system backend, and execute the target transaction if the authentication factor is verified.

[0110] The security verification device based on augmented reality technology provided in this application embodiment, through the acquisition unit 301, acquires environmental information of the physical environment of the target customer during the target customer's target transaction process, with the authorization of the target customer, through augmented reality sensors; the generation unit 302 generates an environmental key based on the environmental information; the matching unit 303 matches the environmental key with a pre-stored key in a preset database, and if the match is successful, collects the first mandibular vibration spectrum and iris features when the target customer reads the digital code; the fusion unit 304 fuses the first mandibular vibration spectrum, iris features, and pre-stored voiceprint to generate an authentication factor; the execution unit 305 verifies the authentication factor through the system backend, and executes the target transaction if the authentication factor verification is successful. This solves the problem of high false positive rate of liveness detection in related technologies based on augmented reality technology, resulting in poor verification accuracy, and achieves the effect of improving the accuracy of verification.

[0111] Optionally, in the security verification device based on augmented reality technology provided in this application embodiment, the fusion unit 304 includes: a fusion module, used to fuse the first mandibular vibration spectrum, iris features and pre-stored voiceprint according to the preset weights corresponding to the first mandibular vibration spectrum, the preset weights corresponding to the iris features and the preset weights corresponding to the pre-stored voiceprint, to obtain fused feature data; and a first generation module, used to encrypt the fused feature data through a hash function to generate an authentication factor.

[0112] Optionally, in the security verification device based on augmented reality technology provided in this application embodiment, the execution unit 305 includes: a decryption module, used to decrypt the authentication factor using a key through the system backend to obtain the decrypted first mandibular vibration spectrum, the decrypted iris feature, and the decrypted pre-stored voiceprint; a first matching module, used to match the decrypted first mandibular vibration spectrum with the pre-stored mandibular vibration spectrum template to determine the first matching degree between the decrypted first mandibular vibration spectrum and the pre-stored mandibular vibration spectrum template; a second matching module, used to compare the decrypted iris feature with the pre-stored iris template to determine the second matching degree between the decrypted iris feature and the pre-stored iris template; a third matching module, used to match the decrypted pre-stored voiceprint with the real-time voiceprint of the target customer during the target transaction process to determine the third matching degree between the decrypted pre-stored voiceprint and the real-time voiceprint; and a first execution module, used to verify the authentication factor according to the first matching degree, the second matching degree, and the third matching degree, and execute the target transaction if the authentication factor verification is passed by the system backend.

[0113] Optionally, in the security verification device based on augmented reality technology provided in the embodiments of this application, the generation unit 302 includes: a first identification module, used to identify a target area in the physical environment based on environmental information, wherein the target area is a region in the physical environment where the gradient change is greater than a preset threshold; and a second generation module, used to generate an environmental key based on the target area and quantum dot-nanocrystal hybrid thin film technology.

[0114] Optionally, in the security verification device based on augmented reality technology provided in this application embodiment, the execution unit 305 includes: a first acquisition module, used to acquire the business interface during the execution of the target transaction, wherein the business interface includes a human body image of the target customer; a splitting module, used to split the business interface into multiple visually continuous sub-interface fragments when the occlusion area of ​​the human body image is greater than a preset percentage; and a distribution module, used to redistribute the multiple visually continuous sub-interface fragments to the visual arc area within the preset angle range of the target customer's field of vision according to the target customer's field of vision direction and dynamic position information, using non-Euclidean space mapping technology.

[0115] Optionally, in the security verification device based on augmented reality technology provided in this application embodiment, the execution unit 305 includes: a second identification module for identifying the signature gesture of the target customer; a second acquisition module for acquiring the second mandibular vibration spectrum when the target customer executes the target transaction; a fourth matching module for matching a preset instruction according to the second mandibular vibration spectrum if the first mandibular vibration spectrum and the second mandibular vibration spectrum are successfully matched; and a second execution module for executing the target transaction according to the preset instruction if the signature gesture verification is passed.

[0116] Optionally, in the security verification device based on augmented reality technology provided in this application embodiment, the second execution module includes: an analysis submodule for analyzing the computing power requirements corresponding to the preset instructions; a selection submodule for selecting computing power resources according to the computing power requirements; and an execution submodule for executing the target transaction according to the computing power resources and the preset instructions.

[0117] It should be noted that the acquisition unit 301, generation unit 302, matching unit 303, fusion unit 304, and execution unit 305 mentioned above correspond to steps S201 to S205 in Embodiment 1. The three units and the corresponding steps implement the same instances and application scenarios, but are not limited to the content disclosed in Embodiment 1. It should be noted that the above modules or units can be hardware or software components stored in memory (e.g., memory 104) and processed by one or more processors (e.g., processors 102a, 102b, ..., 102n). The above modules can also be part of a device and run in the computer terminal 10 provided in Embodiment 1.

[0118] Example 3

[0119] Embodiments of this application may provide a computer terminal, which may be any computer terminal device in a group of computer terminals. Optionally, in this embodiment, the aforementioned computer terminal may also be replaced with a mobile terminal or an electronic device, etc.

[0120] Optionally, in this embodiment, the computer terminal may be located in at least one of a plurality of network devices in a computer network.

[0121] In this embodiment, the aforementioned computer terminal can execute program code for the following steps in the security verification method based on augmented reality technology: during the target customer's target transaction, with the target customer's authorization, environmental information of the target customer's physical environment is obtained through augmented reality sensors; an environmental key is generated based on the environmental information; the environmental key is matched with a pre-stored key in a preset database, and if the match is successful, the vibration spectrum of the first mandible and iris features of the target customer when reading the digital code are collected; the vibration spectrum of the first mandible, iris features, and pre-stored voiceprint are fused to generate an authentication factor; the authentication factor is verified through the system backend, and the target transaction is executed if the authentication factor is verified.

[0122] Optionally, the aforementioned computer terminal can execute program code for the following steps in the security verification method based on augmented reality technology: fusing the vibration spectrum of the first mandible, iris features, and pre-stored voiceprints to generate authentication factors, including: fusing the vibration spectrum of the first mandible, iris features, and pre-stored voiceprints according to the preset weights corresponding to the vibration spectrum of the first mandible, the preset weights corresponding to the iris features, and the preset weights corresponding to the pre-stored voiceprints to obtain fused feature data; encrypting the fused feature data using a hash function to generate authentication factors.

[0123] Optionally, the aforementioned computer terminal can execute program code for the following steps in the security verification method based on augmented reality technology: verifying the authentication factor through the system backend, and executing the target transaction if the authentication factor verification is successful, including: decrypting the authentication factor using a key through the system backend to obtain the decrypted first mandibular vibration spectrum, the decrypted iris feature, and the decrypted pre-stored voiceprint; matching the decrypted first mandibular vibration spectrum with the pre-stored mandibular vibration spectrum template to determine the first matching degree between the decrypted first mandibular vibration spectrum and the pre-stored mandibular vibration spectrum template; comparing the decrypted iris feature with the pre-stored iris template to determine the second matching degree between the decrypted iris feature and the pre-stored iris template; matching the decrypted pre-stored voiceprint with the real-time voiceprint of the target customer during the target transaction process to determine the third matching degree between the decrypted pre-stored voiceprint and the real-time voiceprint; verifying the authentication factor based on the first matching degree, the second matching degree, and the third matching degree, and executing the target transaction if the authentication factor verification is successful through the system backend.

[0124] Optionally, the aforementioned computer terminal may execute program code for the following steps in the security verification method based on augmented reality technology: generating an environmental key based on environmental information includes: identifying a target region in the physical environment based on environmental information, wherein the target region is a region in the physical environment where the gradient change is greater than a preset threshold; and generating an environmental key based on the target region and quantum dot-nanocrystal hybrid thin film technology.

[0125] Optionally, the aforementioned computer terminal can execute program code for the following steps in the security verification method based on augmented reality technology: If the authentication factor is verified, executing the target transaction includes: acquiring the business interface during the execution of the target transaction, wherein the business interface includes a human image of the target customer; if the occlusion area of ​​the human image is greater than a preset percentage, splitting the business interface into multiple visually continuous sub-interface fragments; and, based on the target customer's field of vision direction and dynamic position information, using non-Euclidean space mapping technology, redistributing the multiple visually continuous sub-interface fragments to the arc-shaped area of ​​the target customer's field of vision within a preset angle range.

[0126] Optionally, the aforementioned computer terminal can execute program code for the following steps in the security verification method based on augmented reality technology: if the authentication factor is verified, the target transaction is executed, including: recognizing the signature gesture of the target customer; collecting the second mandibular vibration spectrum when the target customer executes the target transaction; if the first mandibular vibration spectrum and the second mandibular vibration spectrum are successfully matched, matching a preset instruction according to the second mandibular vibration spectrum; and executing the target transaction according to the preset instruction if the signature gesture is verified.

[0127] Optionally, the aforementioned computer terminal may execute program code for the following steps in the security verification method based on augmented reality technology: if the signature gesture verification is successful, executing the target transaction according to the preset instruction includes: analyzing the computing power requirement corresponding to the preset instruction; selecting computing power resources according to the computing power requirement; and executing the target transaction according to the computing power resources and the preset instruction.

[0128] Optionally, Figure 4 This is a structural block diagram of an electronic device according to an embodiment of this application. Figure 4 As shown, the electronic device may include: one or more ( Figure 4 (Only one is shown) Processor 402, memory 404, memory controller, and peripheral interface, wherein the peripheral interface is connected to the radio frequency module, audio module and display.

[0129] The memory can be used to store software programs and modules, such as the program instructions / modules corresponding to the augmented reality-based security verification method and device in this application embodiment. The processor executes various functional applications and data processing by running the software programs and modules stored in the memory, thereby realizing the aforementioned augmented reality-based security verification method. The memory may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory may further include memory remotely located relative to the processor, and these remote memories can be connected to the terminal via a network. Examples of such networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.

[0130] The processor can access the information and application programs stored in the memory via the transmission device to execute the steps described above in the security verification method based on augmented reality technology.

[0131] This application provides a security verification scheme based on augmented reality technology. During a target transaction, with the target customer's authorization, augmented reality sensors acquire environmental information about the target customer's physical environment. Based on this information, an environmental key is generated. This environmental key is matched with a pre-stored key in a preset database. If the match is successful, the vibration spectrum of the first mandible and iris features of the target customer reading a digital code are collected. The vibration spectrum of the first mandible, iris features, and pre-stored voiceprint are fused to generate an authentication factor. The authentication factor is verified by the system backend. If the authentication factor verification is successful, the target transaction is executed. This solves the technical problem of high false positive rates in liveness detection during augmented reality-based security verification, leading to poor verification accuracy, thereby improving the accuracy of verification.

[0132] Those skilled in the art will understand that Figure 4 The structure shown is for illustrative purposes only. Electronic devices can also be smartphones, tablets, handheld computers, mobile internet devices (MIDs), PADs, and other terminal devices. Figure 4 This does not limit the structure of the aforementioned electronic device. For example, electronic devices may also include components that are more... Figure 4 The more or fewer components shown (such as network interfaces, display devices, etc.), or having the same Figure 4 The different configurations shown.

[0133] Those skilled in the art will understand that all or part of the steps in the various methods of the above embodiments can be implemented by a program instructing the hardware related to the terminal device. The program can be stored in a computer-readable storage medium, which may include: flash drive, read-only memory (ROM), random access memory (RAM), disk or optical disk, etc.

[0134] Example 4

[0135] Embodiments of this application also provide a storage medium. Optionally, in this embodiment, the storage medium can be used to store the program code executed by the security verification method based on augmented reality technology provided in Embodiment 1.

[0136] Optionally, in this embodiment, the storage medium may be located in any computer terminal in a group of computer terminals in a computer network, or in any mobile terminal in a group of mobile terminals.

[0137] Optionally, in this embodiment, the storage medium is configured to store program code for performing the following steps: during the target customer's target transaction, with the target customer's authorization, environmental information of the target customer's physical environment is obtained through augmented reality sensors; based on the environmental information, an environmental key is generated; the environmental key is matched with a pre-stored key in a preset database, and if the match is successful, the vibration spectrum of the first mandible and iris features of the target customer when reading the digital code are collected; the vibration spectrum of the first mandible, iris features, and pre-stored voiceprint are fused to generate an authentication factor; the authentication factor is verified through the system backend, and if the authentication factor is verified, the target transaction is executed.

[0138] Optionally, the storage medium is also configured to store program code for performing the following steps: fusing the first mandibular vibration spectrum, iris features, and pre-stored voiceprints to generate an authentication factor, including: fusing the first mandibular vibration spectrum, iris features, and pre-stored voiceprints according to preset weights corresponding to the first mandibular vibration spectrum, preset weights corresponding to the iris features, and preset weights corresponding to the pre-stored voiceprints to obtain fused feature data; and encrypting the fused feature data using a hash function to generate the authentication factor.

[0139] Optionally, the storage medium is also configured to store program code for performing the following steps: verifying the authentication factor through the system backend, and executing the target transaction if the authentication factor verification is successful, including: decrypting the authentication factor using a key through the system backend to obtain the decrypted first mandibular vibration spectrum, the decrypted iris feature, and the decrypted pre-stored voiceprint; matching the decrypted first mandibular vibration spectrum with the pre-stored mandibular vibration spectrum template to determine the first degree of matching between the decrypted first mandibular vibration spectrum and the pre-stored mandibular vibration spectrum template; comparing the decrypted iris feature with the pre-stored iris template to determine the second degree of matching between the decrypted iris feature and the pre-stored iris template; matching the decrypted pre-stored voiceprint with the real-time voiceprint of the target customer during the target transaction process to determine the third degree of matching between the decrypted pre-stored voiceprint and the real-time voiceprint; verifying the authentication factor based on the first degree of matching, the second degree of matching, and the third degree of matching, and executing the target transaction if the system backend authentication factor verification is successful.

[0140] Optionally, the storage medium is also configured to store program code for performing the following steps: generating an environmental key based on environmental information, including: identifying a target region in the physical environment based on the environmental information, wherein the target region is a region in the physical environment where the gradient change is greater than a preset threshold; and generating an environmental key based on the target region and quantum dot-nanocrystal hybrid thin film technology.

[0141] Optionally, the storage medium is also configured to store program code for performing the following steps: upon successful verification of the authentication factor, executing the target transaction includes: acquiring the business interface during the execution of the target transaction, wherein the business interface includes a human image of the target customer; if the occlusion area of ​​the human image is greater than a preset percentage, splitting the business interface into multiple visually continuous sub-interface fragments; and, based on the target customer's field of vision direction and dynamic position information, using non-Euclidean spatial mapping technology, redistributing the multiple visually continuous sub-interface fragments to the arc-shaped area of ​​the target customer's field of vision within a preset angle range.

[0142] Optionally, the storage medium is also configured to store program code for performing the following steps: if the authentication factor is verified, executing the target transaction includes: recognizing the signature gesture of the target customer; acquiring the second mandibular vibration spectrum when the target customer executes the target transaction; if the first mandibular vibration spectrum and the second mandibular vibration spectrum are successfully matched, matching a preset instruction according to the second mandibular vibration spectrum; and executing the target transaction according to the preset instruction if the signature gesture is verified.

[0143] Optionally, the storage medium is also configured to store program code for performing the following steps: upon successful signature gesture verification, executing the target transaction according to preset instructions, including: analyzing the computing power requirements corresponding to the preset instructions; selecting computing power resources according to the computing power requirements; and executing the target transaction according to the computing power resources and the preset instructions.

[0144] This application also provides a computer program product that, when executed on a data processing device, is suitable for performing security verification method steps based on augmented reality technology.

[0145] The sequence numbers of the embodiments in this application are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.

[0146] In the above embodiments of this application, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0147] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. The device embodiments described above are merely illustrative; for example, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection of units or modules may be electrical or other forms.

[0148] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment, depending on actual needs.

[0149] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0150] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as a USB flash drive, read-only memory (ROM), random access memory (RAM), portable hard drive, magnetic disk, or optical disk.

[0151] The above description is only a preferred embodiment of this application. It should be noted that for those skilled in the art, several improvements and modifications can be made without departing from the principle of this application, and these improvements and modifications should also be considered within the scope of protection of this application.

Claims

1. A security verification method based on augmented reality technology, characterized in that, The method comprises the following steps: During the target transaction process of the target customer, the environment information of the physical environment where the target customer is located is obtained through an augmented reality sensor under the authorization of the target customer; Based on the environment information, an environment key is generated; The environment key is matched with a pre-stored key in a preset database, and if the matching is successful, the first mandibular vibration frequency and iris features of the target customer when reading the digital code are collected; The first mandibular vibration frequency, the iris features and the pre-stored voiceprint are fused to generate an authentication factor; The authentication factor is verified through the system backend, and if the authentication factor is verified, the target transaction is executed.

2. The method of claim 1, wherein, Fusing the first mandibular vibration frequency, the iris features and the pre-stored voiceprint to generate an authentication factor comprises: According to the preset weight corresponding to the first mandibular vibration frequency, the preset weight corresponding to the iris features and the preset weight corresponding to the pre-stored voiceprint, the first mandibular vibration frequency, the iris features and the pre-stored voiceprint are fused to obtain the fused feature data; The fused feature data is encrypted through a hash function to generate the authentication factor.

3. The method of claim 2, wherein, Verifying the authentication factor through the system backend, and if the authentication factor is verified, executing the target transaction comprises: The authentication factor is decrypted by the system backend using a key to obtain the decrypted first mandibular vibration frequency, the decrypted iris features and the decrypted pre-stored voiceprint; The decrypted first mandibular vibration frequency is matched with a pre-stored mandibular vibration frequency template to determine the first matching degree of the decrypted first mandibular vibration frequency and the pre-stored mandibular vibration frequency template; The decrypted iris features are compared with a pre-stored iris template to determine the second matching degree of the decrypted iris features and the pre-stored iris template; The decrypted pre-stored voiceprint and the real-time voiceprint of the target customer during the target transaction process are matched to determine the third matching degree of the decrypted pre-stored voiceprint and the real-time voiceprint; According to the first matching degree, the second matching degree and the third matching degree, the authentication factor is verified, and if the authentication factor is verified through the system backend, the target transaction is executed.

4. The method of claim 1, wherein, Generating an environment key based on the environment information comprises: Based on the environment information, a target area in the physical environment is identified, wherein the target area is an area in the physical environment with a gradient change greater than a preset threshold; Based on the target area and quantum dot-nanocrystal hybrid film technology, the environment key is generated.

5. The method of claim 1, wherein, If the authentication factor is verified, the target transaction is executed, which comprises: Collecting a business interface during the execution of the target transaction, wherein the business interface includes a human body image of the target customer; If the occluded area of the human body image is greater than a preset proportion, the business interface is split into a plurality of visually continuous sub-interface fragments; According to the target customer's visual direction and dynamic position information, a non-Euclidean space mapping technique is used to redistribute the plurality of visually continuous sub-interface fragments to the visual arc-shaped area within the target customer's preset angle range.

6. The method of claim 1, wherein, In the case where the authentication factor is verified, the target transaction is executed, including: Identifying the signature gesture of the target customer; Collecting the second mandibular vibration spectrum of the target customer when performing the target transaction; In the case where the first mandibular vibration spectrum and the second mandibular vibration spectrum match successfully, the second mandibular vibration spectrum is matched according to the preset instruction; In the case where the signature gesture is verified, the target transaction is executed according to the preset instruction.

7. The method of claim 6, wherein, In the case where the signature gesture is verified, the target transaction is executed according to the preset instruction, including: Analyzing the computing power requirement corresponding to the preset instruction; Selecting computing power resources according to the computing power requirement; Executing the target transaction according to the computing power resources and the preset instruction.

8. A security verification device based on augmented reality technology, characterized by, Including: An acquisition unit is configured to acquire environmental information of a physical environment in which a target customer is located by using an augmented reality sensor when the target customer performs a target transaction, and to acquire the environmental information when the target customer authorizes; A generation unit is configured to generate an environmental key based on the environmental information; A matching unit is configured to match the environmental key with a pre-stored key in a preset database, and to acquire a first mandibular vibration spectrum and iris features of the target customer when reading a digital code in the case where the matching is successful; A fusion unit is configured to fuse the first mandibular vibration spectrum, the iris features, and a pre-stored voiceprint to generate an authentication factor; An execution unit is configured to verify the authentication factor by using a system backend, and to execute the target transaction in the case where the authentication factor is verified.

9. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes a stored executable program, wherein the computer-readable storage medium controls the device in which the computer-readable storage medium is located to execute the security verification method based on augmented reality technology according to any one of claims 1 to 7 when the executable program is running.

10. An electronic device, comprising: Including: A memory storing an executable program; A processor configured to run the program, wherein the program executes the security verification method based on augmented reality technology according to any one of claims 1 to 7 when the program is running.

11. A computer program product comprising computer instructions, characterized in that, The computer instructions are executed by the processor to implement the steps of the security verification method based on augmented reality technology according to any one of claims 1 to 7.

Images