A digital drive safety verification method, device, storage medium and electronic device

Abstract

The present specification discloses a digital drive security verification method, device, storage medium and electronic device, wherein the method comprises: obtaining target identity authentication information input by a physical object, constructing a virtual digital object for the physical object, obtaining target digital object image features from the virtual digital object, performing identity verification processing on the physical object based on the target identity authentication information and the target digital object image features, and obtaining a digital drive security verification result.

Description

Technical Field

[0001] The present specification relates to the field of electronic digital data processing technology, and in particular to a digital drive security verification method, device, storage medium and electronic device. Background Art

[0002] Virtual reality scenarios such as the metaverse and digital twins have developed rapidly in recent years. The most critical thing in virtual reality scenarios is to drive virtual objects, so that virtual objects can move and communicate as naturally in virtual scenarios such as the metaverse as physical objects in the real physical world. Summary of the invention

[0003] This specification provides a digital drive security verification method, device, storage medium and electronic device, and the technical solution is as follows:

[0004] In a first aspect, this specification provides a digital drive security verification method, the method comprising:

[0005] Get the target authentication information entered by the entity object;

[0006] Constructing a virtual digital object for the physical object, and acquiring a target digital object image feature from the virtual digital object;

[0007] Based on the target identity authentication information and the target digital object image features, identity verification processing is performed on the physical object to obtain a digital drive security verification result.

[0008] In a second aspect, this specification provides a digital drive safety verification device, the device comprising:

[0009] An information acquisition module is used to acquire target identity authentication information input by an entity object;

[0010] A feature extraction module, used to construct a virtual digital object for the physical object and obtain target digital object image features from the virtual digital object;

[0011] The security verification module is used to perform identity verification processing on the physical object based on the target identity verification information and the target digital object image features to obtain a digital drive security verification result.

[0012] In a third aspect, the present specification provides a computer storage medium, wherein the computer storage medium stores at least one instruction, wherein the instruction is suitable for being loaded by a processor and executing the method steps of one or more embodiments of the present specification.

[0013] In a fourth aspect, the present specification provides a computer program product, wherein the computer program product stores at least one instruction, wherein the instruction is suitable for being loaded by a processor and executing the method steps of one or more embodiments of the present specification.

[0014] In a fifth aspect, the present specification provides an electronic device, which may include: a processor and a memory; wherein the memory stores a computer program, and the computer program is suitable for being loaded by the processor and executing the method steps of one or more embodiments of the present specification.

[0015] The beneficial effects brought by the technical solutions provided by some embodiments of this specification include at least:

[0016] In one or more embodiments of the present specification, the electronic device obtains the target identity authentication information input by the physical object, constructs a virtual digital object for the physical object, obtains the target digital object image features from the virtual digital object, and performs identity verification processing on the physical object from the physical object identity verification dimension and the virtual digital object identity verification dimension based on the target identity authentication information and the target digital object image features, and uses highly detailed and personalized target digital object image features to greatly improve the accuracy and security of identity authentication. It can also reduce the hardware requirements for real-time biometrics, reduce the dependence on hardware, and can also use the quickly obtained target identity authentication information combined with the target digital object image features to perform fast and effective security checks while ensuring user privacy, effectively defending against complex presentation attacks and injection attack risks. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the technical solutions in this specification or the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this specification. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0018] Figure 1 This is a scenario diagram of a digital drive safety verification system provided in this manual;

[0019] Figure 2 It is a flowchart of a digital drive safety verification method provided in this manual;

[0020] Figure 3 It is a digitally driven scene diagram provided in this manual;

[0021] Figure 4 This is a flow chart of identity verification provided in this manual;

[0022] Figure 5 It is a flow chart of entity identity information verification provided in this manual;

[0023] Figure 6 This is a flowchart of a virtual digital identity image verification process provided in this manual;

[0024] Figure 7 This is a schematic diagram of a process for acquiring image features of a target digital object provided in this specification;

[0025] Figure 8 It is a structural schematic diagram of a digital drive safety verification device provided in this manual;

[0026] Fig. 9 It is a structural schematic diagram of an electronic device provided in this manual. DETAILED DESCRIPTION

[0027] The following will be combined with the drawings in this specification to clearly and completely describe the technical solutions in this specification. Obviously, the described embodiments are only part of the embodiments of this specification, not all of the embodiments. Based on the embodiments in this specification, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this specification.

[0028] In the description of this specification, it should be understood that the terms "first", "second", etc. are only used for descriptive purposes and cannot be understood as indicating or implying relative importance. In the description of this specification, it should be noted that, unless otherwise clearly specified and limited, "including" and "having" and any of their variations are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally also includes steps or units that are not listed, or optionally also includes other steps or units inherent to these processes, methods, products or devices. For those of ordinary skill in the art, the specific meanings of the above terms in this specification can be understood by specific circumstances. In addition, in the description of this specification, unless otherwise specified, "multiple" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships can exist, for example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the associated objects before and after are an "or" relationship.

[0029] In related technologies, virtual reality scenes rely on smart devices with virtual reality functions, such as smart watches, head-mounted VR devices, etc., and there will be applications with virtual reality functions on smart devices that users need and use. The virtual reality functions operated by users in the applications require biometric identity verification. Currently, smart devices with virtual reality functions are difficult to resist "presentation attacks and injection attacks", which leads to problems of insecure and inaccurate biometric authentication.

[0030] Among them, presentation attacks such as using fake biometrics;

[0031] Among them, injection attacks include injecting malicious data into data transmission;

[0032] The present specification is described in detail below with reference to specific embodiments.

[0033] See also Figure 1 , is a schematic diagram of a scenario of a digital drive safety verification system provided in this specification. Figure 1 As shown, the digital drive security verification system may include at least a client cluster and a service platform 100 .

[0034] The client cluster may include at least one client, such as Figure 1 As shown, it specifically includes client 1 corresponding to user 1, client 2 corresponding to user 2, ..., client n corresponding to user n, where n is an integer greater than 0.

[0035] Each client in the client cluster may be an electronic device with communication function, including but not limited to: wearable device, handheld device, personal computer, tablet computer, vehicle-mounted device, smart phone, computing device or other processing device connected to a wireless modem, etc. Electronic devices may be called different names in different networks, such as: user equipment, access terminal, user unit, user station, mobile station, mobile station, remote station, remote terminal, mobile device, user terminal, terminal, wireless communication device, user agent or user device, cellular phone, cordless phone, personal digital assistant (PDA), electronic devices in 5G network or future evolution network, etc.

[0036] The service platform 100 can be a separate server device, such as a rack-mounted, blade, tower, or cabinet-mounted server device, or a workstation, mainframe computer, or other hardware device with strong computing power; it can also be a server cluster composed of multiple servers, and the servers in the service cluster can be composed in a symmetrical manner, wherein each server has equivalent functions and status in the transaction link, and each server can provide services to the outside independently, and the independent service can be understood as not requiring the assistance of other servers.

[0037] In one or more embodiments of the present specification, the service platform 100 may establish a communication connection with at least one client in the client cluster, and complete data interaction during the digital drive security verification process based on the communication connection, such as online transaction data interaction. For example, the service platform 100 may recommend content to the client based on the target neural network model obtained based on the digital drive security verification method of the present specification; for example, the service platform 100 may obtain training data from the client, such as the first training data.

[0038] It should be noted that the service platform 100 and at least one client in the client cluster establish a communication connection through a network for interactive communication, wherein the network can be a wireless network or a wired network, the wireless network includes but is not limited to a cellular network, a wireless local area network, an infrared network or a Bluetooth network, and the wired network includes but is not limited to Ethernet, a universal serial bus (USB) or a controller local area network. In one or more embodiments of the specification, technologies and / or formats including Hyper Text Mark-up Language (HTML), Extensible Markup Language (XML), etc. are used to represent data (such as a target compressed package) exchanged through the network. In addition, conventional encryption technologies such as Secure Socket Layer (SSL), Transport Layer Security (TLS), Virtual Private Network (VPN), Internet Protocol Security (IPsec), etc. can also be used to encrypt all or some links. In other embodiments, customized and / or dedicated data communication technologies can also be used to replace or supplement the above data communication technologies.

[0039] The digital drive safety verification system embodiment provided in this specification and the digital drive safety verification method in one or more embodiments belong to the same concept. The execution subject corresponding to the digital drive safety verification method involved in one or more embodiments of the specification can be the above-mentioned service platform 100; the execution subject corresponding to the digital drive safety verification method involved in one or more embodiments of the specification can also be the electronic device corresponding to the client, which is determined based on the actual application environment. The implementation process of the digital drive safety verification system embodiment can be found in the following method embodiment, which will not be repeated here.

[0040] based on Figure 1 The scenario diagram is shown, and the digital drive security verification method provided by one or more embodiments of this specification is introduced in detail below.

[0041] See also Figure 2 , a flowchart of a digital drive safety verification method is provided for one or more embodiments of this specification, the method can be implemented by a computer program and can be run on a digital drive safety verification device based on the von Neumann system. The computer program can be integrated into an application or run as an independent tool application. The digital drive safety verification device can be an electronic device with virtual reality function.

[0042] Specifically, the digital drive safety verification method includes:

[0043] S102: Acquire target identity authentication information input by the entity object;

[0044] Optionally, in order to ensure the security of the digital drive, this specification relates to a digital drive security verification method, including entity identity information verification and digital identity information verification, and the security of the digital drive is enhanced by combining at least two methods;

[0045] Exemplarily, the electronic device collects target identity authentication information required for identity authentication of the physical object. The target identity authentication information includes one or more of fingerprint, facial recognition, voice recognition, biometric data, device password information, etc.

[0046] Optionally, the target identity authentication information can be selected from verification information that can only be obtained by low-dependence biometric information sensor devices, such as device password information, thereby reducing the hardware requirements for real-time biometric recognition and the dependence on hardware. It can also use the quickly acquired target identity authentication information combined with the target digital object image features to perform a fast and effective security check while ensuring user privacy;

[0047] Optionally, in order to ensure the accuracy and security of the target authentication information, a secure transmission protocol and encryption technology are used to protect the security of the target authentication information during transmission, and to ensure that the device has tamper-proof characteristics.

[0048] In a feasible implementation, when the physical object performs a device activation operation on an electronic device with a virtual reality function, the physical object is instructed to set device password information, and the device password information can be subsequently used for identity information consistency verification. During subsequent use, when the physical object needs to use the electronic device, the current device password information can be entered. The current device password information can then be used as the target identity authentication information entered by the physical object and obtained by the electronic device.

[0049] S104: constructing a virtual digital object for the physical object, and acquiring a target digital object image feature from the virtual digital object;

[0050] The following is a brief explanation of digital drive:

[0051] Entity objects can be understood as objects in the real physical world, such as users, animals, plants, etc.

[0052] It can be understood that digital driving is a virtual digital object driving based on a physical object, and is driven by collecting changes in the physical object. In this specification, the physical object image of the physical object in the real world space can be collected by the image acquisition part, which can be in the form of collecting physical object video, physical object picture, etc., and then the key point information (such as key point identification, key points) of several key points are identified through the physical object image. For example, in a facial driving scenario of a virtual object based on a physical object, 256 key points, 512 key points, etc. can be set. By determining these key points of the physical object, the driving processing of the virtual object can be performed according to the key points. For example, when determining n key points of the physical object at each sampling moment, a virtual digital object for the physical object can be constructed based on the key point information corresponding to these n key points, thereby realizing the driving of the virtual digital object.

[0053] In a feasible implementation, the electronic device may be configured with a digital drive module, which may be divided into a two-dimensional digital drive and a three-dimensional digital drive, such as Figure 3 As shown, Figure 3 It is a digitally driven scene diagram. The category of virtual digital objects generated also depends on whether the electronic device has a camera, an infrared camera, a binocular camera, a three-dimensional structured light camera, etc. The digital drive module may not be installed on the electronic device as an external device, but may be a mobile terminal or the front end of a cloud server. Figure 3As shown, in general, the safety level of generating two-dimensional digital humans is not as high as that of generating three-dimensional digital humans. For physical objects, for example, users only need to provide a personal photo, and through a series of super-resolution activation and AIGC generation technologies, the creation of a three-dimensional digital human of that identity can be completed; while three-dimensional digital objects require real-time scanning and recording of user facial information based on three-dimensional structured light image acquisition. At the same time, because three-dimensional information needs to be generated, users are also required to complete a series of live action verifications, including blinking, shaking their heads up and down, left and right, opening their mouths, etc., recording mainstream facial actions to complete the representation, and finally completing the creation of three-dimensional digital objects through expression migration technology.

[0054] Exemplarily, after the electronic device completes constructing the virtual digital object for the physical object, it can directly access the digital object model data for modeling the virtual digital object, extract a virtual digital object image of the virtual digital object simulating the physical object from the digital object model data, and extract target digital object image features from the virtual digital object image;

[0055] Schematically, usually the image quality indicators such as resolution and clarity of the modeled virtual digital object image are better than those of the direct physical object image;

[0056] Exemplarily, the constructing of a virtual digital object for the physical object and obtaining the target digital object image features from the virtual digital object may be performed in the following manner:

[0057] A2: Determine an identity verification request of the target application, and call a digital object verification calling interface in response to the identity verification request to start a digital object verification process;

[0058] The target application can be understood as the device application that currently initiates the identity verification request on the electronic device;

[0059] In order to avoid the application layer being unable to directly access the device hardware layer for identity verification, the electronic device sets a digital object verification calling interface. When the target application on the electronic device currently initiates an identity verification request, the target application can directly call the digital object verification calling interface to respond to the identity verification request and start the digital object verification process;

[0060] A4: outputting a physical action verification prompt to the physical object based on the digital object verification process;

[0061] The digital object verification process is mainly used to verify the biometric identity of the physical object from the digital object verification dimension. The upper-layer application can start the digital object verification process by calling the digital object verification call interface. Based on the digital object verification process, the electronic device can output a physical action verification prompt to the physical object. The physical action verification prompt is used to instruct the physical object to complete the specified identity verification action; for example: blinking, shaking the head up and down, left and right, opening the mouth, etc.

[0062] A6: Collecting the physical action image of the physical object input based on the physical action verification prompt, constructing a virtual digital object for the physical object based on the physical action image, and controlling the target application to obtain target digital object image features from the virtual digital object.

[0063] Schematically, the electronic device collects an entity action image input by the entity object based on the entity action verification prompt, constructs a virtual digital object for the entity object based on the entity action image, and the target application of the electronic device can directly access the digital object model data of the modeled virtual digital object, extracts the virtual digital object image of the virtual digital object simulating the entity object from the digital object model data, and extracts the target digital object image feature from the virtual digital object image;

[0064] S106: Based on the target identity verification information and the target digital object image features, identity verification processing is performed on the physical object to obtain a digital drive security verification result.

[0065] Indicatively, based on the target identity authentication information, the entity object is verified from the entity identity information dimension to obtain the entity identity verification result; based on the target digital object image feature, the entity object is verified from the virtual digital object dimension to obtain the digital identity verification result, and then the entity identity verification result and the digital identity verification result are combined to obtain the final digital drive security verification result;

[0066] In one or more embodiments of the present specification, the electronic device obtains the target identity authentication information input by the physical object, constructs a virtual digital object for the physical object, obtains the target digital object image features from the virtual digital object, and performs identity verification processing on the physical object from the physical object identity verification dimension and the virtual digital object identity verification dimension based on the target identity authentication information and the target digital object image features, and uses highly detailed and personalized target digital object image features to greatly improve the accuracy and security of identity authentication. It can also reduce the hardware requirements for real-time biometrics, reduce the dependence on hardware, and can also use the quickly obtained target identity authentication information combined with the target digital object image features to perform fast and effective security checks while ensuring user privacy, effectively defending against complex presentation attacks and injection attack risks.

[0067] See also Figure 4 , Figure 4 This is a flow chart of an identity verification process proposed in one or more embodiments of this specification. Specifically:

[0068] S202: Obtaining trusted identity authentication information;

[0069] Trusted authentication information such as fingerprint, face, voice, iris, unlock password, etc. is used for identity authentication.

[0070] In a feasible implementation manner, the obtaining of the trusted identity authentication information may be performed in the following manner: using a trusted identity authentication component to access a device trusted execution environment, and obtaining the trusted identity authentication information for the entity object from the device trusted execution environment;

[0071] For example, an electronic device may be configured with a trusted execution environment (TEE), which is a secure computing environment that may be supported by a hardware security module (such as a TPM or SE) and is used to process and store sensitive data.

[0072] Exemplarily, a trusted authentication component (e.g., a biometric sensor or a security module) is initialized to ensure that the trusted authentication component is in a secure state and is ready for data collection and processing. A secure channel is established between the authentication component and a trusted execution environment of the device, and the authentication component obtains trusted authentication information for an entity object from the trusted execution environment, which can be performed in the trusted execution environment S204;

[0073] The above method provides a highly secure trusted execution environment TEE to process and verify identity information, greatly reducing the risk of data leakage or tampering. By isolating sensitive data processing at the hardware level, the overall security of the system is enhanced, while ensuring the reliability and integrity of the user authentication process. This is especially important for application scenarios that require high security (such as financial services, government services, etc.).

[0074] S204: Performing entity identity information verification processing on the entity object based on the trusted identity verification information and the target identity verification information to obtain a first identity verification result;

[0075] Specifically, comparing the trusted identity verification information with the target identity verification information to see if they match, thereby obtaining a first identity verification result;

[0076] Exemplarily, the target identity authentication information includes a target device unlocking password and target biometric identification information, and the trusted identity authentication information includes a trusted device unlocking password and trusted biometric identification information as an example for explanation, as follows:

[0077] See also Figure 5 , Figure 5 The present invention is a flow chart of entity identity information verification, wherein the entity identity information of the entity object is verified based on the trusted identity authentication information and the target identity authentication information to obtain a first identity verification result, and the following implementation methods may be referred to:

[0078] S3002: performing an unlock password verification process on the physical object based on the target device unlock password and the trusted device unlock password to obtain an unlock password verification result;

[0079] Exemplarily, the target device unlock password and the trusted device unlock password are compared to see if they are consistent. If they are consistent, an unlock password verification result of the unlock password verification pass type is generated. If they are inconsistent, an unlock password verification result of the unlock password verification fail type is generated to complete the unlock password verification process for the physical object, thereby obtaining the unlock password verification result;

[0080] S3004: Performing biometric information verification processing on the entity object based on the target biometric identification information and the trusted biometric identification information to obtain a biometric information verification result;

[0081] Use an information matching algorithm to compare the target biometric information and the trusted biometric information to obtain a biometric verification similarity. For example, the information matching algorithm may be a Hamming distance, a Euclidean distance, etc. A similarity threshold is set. If the biometric verification similarity is greater than the similarity threshold, a biometric verification result of a biometric verification pass type and / or a biometric verification similarity is generated. If the biometric verification similarity is less than or equal to the similarity threshold, a biometric verification result of a biometric verification failure type and / or a biometric verification similarity is generated.

[0082] S3006: Generate a first identity verification result based on the unlocking password verification result and the biometric information verification result.

[0083] Indicatively, the security and reliability of identity authentication is improved by combining the unlocking password verification result and the biometric information verification result;

[0084] According to the unlock password verification result and the biometric information verification result, the system generates a first identity verification result. If both independent verifications are successful or through a set logical combination, the result is a successful verification; if any one of the verifications fails, the result is a failed verification.

[0085] S206: Acquire a trusted digital object image feature for the physical object;

[0086] In a feasible implementation manner, the obtaining of the trusted digital object image features for the physical object includes: using a trusted identity authentication component to access a device trusted execution environment, and obtaining the trusted digital object image features for the physical object from the device trusted execution environment.

[0087] For example, an electronic device may be configured with a trusted execution environment (TEE), which is a secure computing environment that may be supported by a hardware security module (such as a TPM or SE) and is used to process and store sensitive data.

[0088] Exemplarily, a trusted authentication component (e.g., a biometric sensor or a security module) is initialized to ensure that the trusted authentication component is in a secure state and is ready for data collection and processing. A secure channel is established between the authentication component and a trusted execution environment of the device, and the authentication component obtains a trusted digital object image feature for a physical object from the trusted execution environment, which can be performed in the trusted execution environment S208;

[0089] The credible digital object image feature is a digital object image feature obtained from a credible virtual digital object after a credible virtual digital object is created for a physical object in a credible scenario.

[0090] S208: Performing virtual digital identity image verification processing on the physical object based on the trusted digital object image feature and the target digital object image feature to obtain a second identity verification result;

[0091] Specifically, comparing the trusted digital object image feature with the target digital object image feature to see if they match, thereby obtaining a second identity verification result;

[0092] In one or more embodiments of this specification, see Figure 6 , Figure 6 The present invention is a flowchart of a virtual digital identity image verification process, wherein the virtual digital identity image verification process is performed on the physical object based on the image features of the trusted digital object and the image features of the target digital object to obtain a second identity verification result, which can be referred to as follows:

[0093] S4002: performing image feature similarity comparison on the physical object based on the credible digital object image feature and the target digital object image feature to obtain image feature similarity parameters;

[0094] Schematically, a similarity algorithm is used to calculate the similarity between the authentic digital object image feature and the target digital object image feature, and the similarity is used as an image feature similarity parameter;

[0095] Optionally, the similarity algorithm may be a similarity algorithm such as Euclidean distance, Hamming distance, Mahalanobis distance, etc.;

[0096] S4004: Generate a second identity verification result based on the image feature similarity parameter and the similarity parameter threshold.

[0097] Exemplarily, a similarity parameter threshold is set based on experience or pre-test results. The similarity parameter threshold is a key parameter that determines whether identity authentication passes or fails.

[0098] If the image feature similarity parameter is greater than the similarity parameter threshold, a second identity verification result of the verification pass type is generated; if the image feature similarity parameter is less than or equal to the similarity parameter threshold, a second identity verification result of the verification fail type is generated;

[0099] S210: Obtain a digital drive security verification result based on the first identity verification result and the second identity verification result.

[0100] According to the first identity verification result and the second identity verification result, the system generates a digital drive security verification result. If both independent verifications are successfully verified or through a set logical combination, the result is a successful verification; if any one of the verifications fails, the result is a failed verification.

[0101] In one or more embodiments of the present specification, the identity verification of the physical object is processed from the physical object identity verification dimension and the virtual digital object identity verification dimension, and the highly detailed and personalized target digital object image features are used to greatly improve the accuracy and security of identity verification. It can also reduce the hardware requirements for real-time biometrics and reduce the dependence on hardware. It can also use the quickly acquired target identity verification information combined with the target digital object image features to perform fast and effective security checks while ensuring user privacy, effectively defending against complex presentation attacks and injection attack risks.

[0102] See also Figure 7 , Figure 7 The present invention is a schematic diagram of a process of acquiring a target digital object image feature, wherein the process of acquiring the target digital object image feature from the virtual digital object comprises:

[0103] S5002: Determine a key object comparison area for the virtual digital object;

[0104] Determine the key object comparison area in the virtual digital object, which contains important virtual digital object identification information. Key object comparison area includes but is not limited to:

[0105] Face area: Facial features are critical for digital object authentication, including eyes, nose, mouth, etc.

[0106] Iris area: The iris has a highly unique pattern and is suitable as a biometric feature for high-security digital objects.

[0107] Fingerprint area: The texture pattern of the finger is also a commonly used biometric feature of digital objects.

[0108] Palm print area: Some systems may use palm print as an auxiliary verification method.

[0109] In a feasible implementation, a key object comparison area may be preset, such as a face area as the key object comparison area, and the preset key object comparison area for the virtual digital object may be directly obtained in subsequent practical applications;

[0110] In a feasible implementation, the physical object is subjected to biometric information verification processing based on the target biometric information and the trusted biometric information to obtain a biometric information verification result, which may include a biometric information verification similarity. By obtaining a first identity verification result for the physical object, a key object comparison area for the virtual digital object is determined from multiple object comparison areas based on the first identity verification result (such as the biometric information verification similarity).

[0111] It can be understood that the obtained biometric information verification result, i.e., the first identity verification result, is used as a decision-making basis to optimize and refine the next verification strategy, so as to "determine the key object comparison area for the virtual digital object from multiple object comparison areas", thereby ensuring the efficiency and accuracy of identity verification, especially in the face of complex scenarios requiring multiple verification factors;

[0112] Exemplarily, analyzing the first identity verification result The first identity verification result may include multiple types of biometric information verification results, such as the biometric information verification similarity of facial recognition, fingerprint recognition, or iris recognition. First, the system needs to analyze the various types of biometric information verification similarities in the first identity verification result to determine which biometric identification methods show higher reliability and accuracy, and which may require further verification. Then, based on the results of the verification of various types of biometric information verification similarities, the system can identify specific biometric feature areas (such as a part of the face, the fingerprint of a specific finger, etc.) that show uncertainty or low similarity in the initial verification and require further enhanced verification, such as setting a verification similarity threshold. If the biometric information verification similarity of a certain biometric information type is less than the verification similarity threshold, the biometric information type is determined to be the biometric type to be verified, and the key object comparison area corresponding to the biometric type to be verified is determined;

[0113] Furthermore, priorities are set for multiple types of biometric information. Among the biometric features of multiple types of biometric information, the system will set priorities for different object comparison areas based on the verification performance of the first identity verification result. For example, if the result of facial recognition is not certain enough, but the fingerprint recognition result is more reliable, then in the next verification, the system can increase the focus on the facial area to improve the overall verification reliability. That is, setting the key object comparison area from the virtual digital object dimension

[0114] S5004: Acquire target digital object image features corresponding to the key object comparison area from the virtual digital object.

[0115] In one or more embodiments of the present specification, the above method is used to obtain the target digital object image features corresponding to the key object comparison area, which not only improves the accuracy of identity authentication, but also optimizes the processing flow and saves resources, which is particularly effective in processing large-scale or high-security environments. At the same time, it makes the identity authentication process more flexible and adaptable, and can respond quickly to different security requirements and specific situations.

[0116] The following will be combined Figure 8 , the digital drive safety verification device provided in this specification is introduced in detail. It should be noted that, Figure 8 The digital drive safety verification device shown is used to execute this instruction Figure 1 to Figure 7 For the convenience of explanation, only the parts related to this specification are shown. For specific technical details not disclosed, please refer to this specification. Figure 1 to Figure 7 The embodiment shown.

[0117] See also Figure 8 , which shows a schematic diagram of the structure of the digital drive safety verification device of the present specification. The digital drive safety verification device 1 can be implemented as all or part of the device through software, hardware or a combination of both. According to some embodiments, the digital drive safety verification device 1 includes an information acquisition module 11, a feature extraction module 12 and a safety verification module 13, which are specifically used to:

[0118] The information acquisition module 11 is used to acquire the target identity authentication information input by the entity object;

[0119] A feature extraction module 12, used to construct a virtual digital object for the physical object and obtain target digital object image features from the virtual digital object;

[0120] The security verification module 13 is used to perform identity verification processing on the physical object based on the target identity verification information and the target digital object image features to obtain a digital drive security verification result.

[0121] Optionally, the security verification module 13 is used to:

[0122] Acquire trusted identity authentication information, and perform entity identity information verification processing on the entity object based on the trusted identity authentication information and the target identity authentication information to obtain a first identity verification result;

[0123] Acquire a trusted digital object image feature for the physical object, and perform a virtual digital identity image verification process on the physical object based on the trusted digital object image feature and the target digital object image feature to obtain a second identity verification result;

[0124] Based on the first identity verification result and the second identity verification result, a digital drive security verification result is obtained.

[0125] Optionally, the target identity authentication information includes a target device unlocking password and target biometric identification information, and the trusted identity authentication information includes a trusted device unlocking password and trusted biometric identification information.

[0126] The security verification module 13 is used to:

[0127] Performing an unlock password verification process on the physical object based on the target device unlock password and the trusted device unlock password to obtain an unlock password verification result;

[0128] Performing biometric information verification processing on the entity object based on the target biometric identification information and the trusted biometric identification information to obtain a biometric information verification result;

[0129] A first identity verification result is generated based on the unlocking password verification result and the biometric information verification result.

[0130] Optionally, the device 1 is further used for: the obtaining of the trusted identity authentication information comprises: using a trusted identity authentication component to access a device trusted execution environment, and obtaining the trusted identity authentication information for the entity object from the device trusted execution environment; and / or,

[0131] Optionally, the apparatus 1 is further used to: use a trusted identity authentication component to access a device trusted execution environment, and obtain a trusted digital object image feature for the physical object from the device trusted execution environment.

[0132] Optionally, the security verification module 13 is used to:

[0133] Performing image feature similarity comparison on the physical object based on the credible digital object image feature and the target digital object image feature to obtain image feature similarity parameters;

[0134] Based on the image feature similarity parameter and the similarity parameter threshold, a second identity verification result is generated.

[0135] Optionally, the feature extraction module 12 is used to:

[0136] determining a key object comparison area for the virtual digital object;

[0137] The target digital object image features corresponding to the key object comparison area are obtained from the virtual digital object.

[0138] Optionally, the feature extraction module 12 is used to:

[0139] Acquire a preset key object comparison area for the virtual digital object; and / or,

[0140] A first identity verification result for the physical object is obtained, and a key object comparison area for the virtual digital object is determined from a plurality of object comparison areas based on the first identity verification result.

[0141] Optionally, the feature extraction module 12 is used to:

[0142] Determine an identity verification request of a target application, and initiate a digital object verification process by calling a digital object verification calling interface in response to the identity verification request;

[0143] Outputting a physical action verification prompt to the physical object based on the digital object verification process;

[0144] The physical object is captured based on a physical action image input by the physical action verification prompt, a virtual digital object for the physical object is constructed based on the physical action image, and the target application is controlled to obtain a target digital object image feature from the virtual digital object.

[0145] It should be noted that the digital drive safety verification device provided in the above embodiment only uses the division of the above functional modules as an example when executing the digital drive safety verification method. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the digital drive safety verification device provided in the above embodiment and the digital drive safety verification method embodiment belong to the same concept, and the implementation process thereof is detailed in the method embodiment, which will not be repeated here.

[0146] The above serial numbers in this specification are for description only and do not represent the advantages or disadvantages of the embodiments.

[0147] In one or more embodiments of the present specification, the electronic device obtains the target identity authentication information input by the physical object, constructs a virtual digital object for the physical object, obtains the target digital object image features from the virtual digital object, and performs identity verification processing on the physical object from the physical object identity verification dimension and the virtual digital object identity verification dimension based on the target identity authentication information and the target digital object image features, and uses highly detailed and personalized target digital object image features to greatly improve the accuracy and security of identity authentication. It can also reduce the hardware requirements for real-time biometrics, reduce the dependence on hardware, and can also use the quickly obtained target identity authentication information combined with the target digital object image features to perform fast and effective security checks while ensuring user privacy, effectively defending against complex presentation attacks and injection attack risks.

[0148] The present specification also provides a computer storage medium, which can store multiple instructions, which are suitable for being loaded and executed by a processor as described above. Figure 1 to Figure 7 The digital drive safety verification method of the embodiment shown in the figure can be specifically executed by referring to Figure 1 to Figure 7 The specific description of the illustrated embodiment will not be repeated here.

[0149] The present specification also provides a computer program product, which stores at least one instruction, and the at least one instruction is loaded and executed by the processor as described above. Figure 1 to Figure 7 The digital drive safety verification method of the embodiment shown in the figure can be specifically executed by referring to Figure 1 to Figure 7 The specific description of the illustrated embodiment will not be repeated here.

[0150] Please refer to Fig. 9 , is a block diagram of a structure of an electronic device provided in an embodiment of this specification. The electronic device in this specification may include one or more of the following components: a processor 1010, a memory 1020, an input device 1030, an output device 1040, and a bus 1050. The processor 1010, the memory 1020, the input device 1030, and the output device 1040 may be connected via a bus 1050.

[0151] The processor 1010 may include one or more processing cores. The processor 1010 uses various interfaces and lines to connect various parts in the entire terminal, and executes various functions and processes data of the terminal 100 by running or executing instructions, programs, code sets or instruction sets stored in the memory 1020, and calling data stored in the memory 1020. Optionally, the processor 1010 can be implemented in at least one hardware form of digital signal processing (DSP), field-programmable gate array (FPGA), and programmable logic array (PLA). The processor 1010 can integrate one or a combination of a central processing unit (CPU), a graphics processing unit (GPU), and a modem. Among them, the CPU mainly processes the operating system, user interface, and application programs; the GPU is responsible for rendering and drawing display content; and the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 1010, but may be implemented separately through a communication chip.

[0152] The memory 1020 may include a random access memory (RAM) or a read-only memory (ROM). Optionally, the memory 1020 includes a non-transitory computer-readable storage medium. The memory 1020 may be used to store instructions, programs, codes, code sets, or instruction sets.

[0153] The input device 1030 is used to receive input instructions or data, and the input device 1030 includes but is not limited to a keyboard, a mouse, a camera, a microphone, or a touch device. The output device 1040 is used to output instructions or data, and the output device 1040 includes but is not limited to a display device and a speaker. In the embodiment of this specification, the input device 1030 can be a temperature sensor for obtaining the operating temperature of the terminal. The output device 1040 can be a speaker for outputting audio signals.

[0154] In addition, those skilled in the art will understand that the structure of the terminal shown in the above drawings does not constitute a limitation on the terminal, and the terminal may include more or fewer components than shown, or combine certain components, or arrange the components differently. For example, the terminal also includes a radio frequency circuit, an input unit, a sensor, an audio circuit, a wireless fidelity (WIFI) module, a power supply, a Bluetooth module and other components, which will not be described in detail here.

[0155] In the embodiments of this specification, the execution subject of each step may be the terminal described above. Optionally, the execution subject of each step is the operating system of the terminal. The operating system may be an Android system, an IOS system, or other operating systems, which is not limited in the embodiments of this specification.

[0156] exist Fig. 9 In the electronic device, the processor 1010 can be used to call the program stored in the memory 1020 and execute it to implement the digital drive security verification method as described in the various method embodiments of this specification, specifically performing the following steps:

[0157] Get the target authentication information entered by the entity object;

[0158] Constructing a virtual digital object for the physical object, and acquiring a target digital object image feature from the virtual digital object;

[0159] Based on the target identity authentication information and the target digital object image features, identity verification processing is performed on the physical object to obtain a digital drive security verification result.

[0160] In a feasible implementation manner, the processor 1010 may perform the following steps after performing the identity verification process on the physical object based on the target identity verification information and the target digital object image feature to obtain a digital drive security verification result:

[0161] Acquire trusted identity authentication information, and perform entity identity information verification processing on the entity object based on the trusted identity authentication information and the target identity authentication information to obtain a first identity verification result;

[0162] Acquire a trusted digital object image feature for the physical object, and perform a virtual digital identity image verification process on the physical object based on the trusted digital object image feature and the target digital object image feature to obtain a second identity verification result;

[0163] Based on the first identity verification result and the second identity verification result, a digital drive security verification result is obtained.

[0164] In a feasible implementation manner, the processor 1010 may execute the target identity authentication information including the target device unlocking password and the target biometric identification information, the trusted identity authentication information including the trusted device unlocking password and the trusted biometric identification information,

[0165] The entity identity information of the entity object is verified based on the trusted identity verification information and the target identity verification information to obtain a first identity verification result, and the following steps are performed:

[0166] Performing an unlock password verification process on the physical object based on the target device unlock password and the trusted device unlock password to obtain an unlock password verification result;

[0167] Performing biometric information verification processing on the entity object based on the target biometric identification information and the trusted biometric identification information to obtain a biometric information verification result;

[0168] A first identity verification result is generated based on the unlocking password verification result and the biometric information verification result.

[0169] In a feasible implementation manner, the processor 1010 may perform the following steps when executing the acquisition of trusted identity authentication information: using a trusted identity authentication component to access a device trusted execution environment, and acquiring trusted identity authentication information for the entity object from the device trusted execution environment;

[0170] In a feasible implementation, the processor 1010 may perform the following steps when executing the acquisition of the trusted digital object image features for the physical object: using a trusted identity authentication component to access a device trusted execution environment, and acquiring the trusted digital object image features for the physical object from the device trusted execution environment.

[0171] In a feasible implementation manner, the processor 1010 may perform the following steps after performing the virtual digital identity image verification process on the physical object based on the credible digital object image feature and the target digital object image feature to obtain a second identity verification result:

[0172] Performing image feature similarity comparison on the physical object based on the credible digital object image feature and the target digital object image feature to obtain image feature similarity parameters;

[0173] Based on the image feature similarity parameter and the similarity parameter threshold, a second identity verification result is generated.

[0174] In a feasible implementation manner, the processor 1010 may perform the following steps while executing the step of acquiring the target digital object image feature from the virtual digital object:

[0175] determining a key object comparison area for the virtual digital object;

[0176] The target digital object image features corresponding to the key object comparison area are obtained from the virtual digital object.

[0177] In a feasible implementation manner, the processor 1010 may perform the following steps when determining the key object comparison area for the virtual digital object:

[0178] Acquire a preset key object comparison area for the virtual digital object; and / or,

[0179] A first identity verification result for the physical object is obtained, and a key object comparison area for the virtual digital object is determined from a plurality of object comparison areas based on the first identity verification result.

[0180] In a feasible implementation manner, the processor 1010 may perform the following steps while executing the step of constructing a virtual digital object for the physical object and obtaining a target digital object image feature from the virtual digital object:

[0181] Determine an identity verification request of a target application, and initiate a digital object verification process by calling a digital object verification calling interface in response to the identity verification request;

[0182] Outputting a physical action verification prompt to the physical object based on the digital object verification process;

[0183] The physical object is captured based on a physical action image input by the physical action verification prompt, a virtual digital object for the physical object is constructed based on the physical action image, and the target application is controlled to obtain a target digital object image feature from the virtual digital object.

[0184] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiments can be implemented by instructing related hardware through a computer program, and the program can be stored in a computer-readable storage medium, and when the program is executed, it can include the processes of the embodiments of the above-mentioned methods. The storage medium can be a disk, an optical disk, a read-only storage memory, or a random access memory, etc.

[0185] It should be noted that the information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, stored data, displayed data, etc.) and signals involved in the embodiments of this specification are all authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of relevant countries and regions. For example, the object characteristics, interactive behavior characteristics and user information involved in this specification are all obtained with full authorization.

[0186] The above disclosure is only the preferred embodiment of this specification, which certainly cannot be used to limit the scope of rights of this specification. Therefore, equivalent changes made according to the claims of this specification are still within the scope covered by this specification.

Claims

1. A digital drive security verification method, wherein the digital drive is to drive a virtual digital object corresponding to the physical object based on the change of the physical object, and the method comprises: Get the target authentication information entered by the entity object; Constructing a virtual digital object for the physical object, and obtaining a target digital object image feature from the virtual digital object, wherein obtaining the target digital object image feature from the virtual digital object comprises: accessing digital object model data for modeling the virtual digital object, and extracting the target digital object image feature corresponding to the virtual digital object simulating the physical object from the digital object model data; Based on the target identity verification information and the target digital object image features, the physical object is subjected to identity verification processing to obtain a digital drive security verification result; The performing identity verification processing on the physical object based on the target identity verification information and the target digital object image feature to obtain a digital drive security verification result includes: Acquire trusted identity authentication information, and perform entity identity information verification processing on the entity object based on the trusted identity authentication information and the target identity authentication information to obtain a first identity verification result; Acquire a trusted digital object image feature for the physical object, and perform virtual digital identity image verification processing on the physical object based on the trusted digital object image feature and the target digital object image feature to obtain a second identity verification result, wherein the trusted digital object image feature is a digital object image feature obtained from the trusted virtual digital object after creating a trusted virtual digital object for the physical object in a trusted scenario; Based on the first identity verification result and the second identity verification result, a digital drive security verification result is obtained.

2. The method according to claim 1, wherein the target identity authentication information includes a target device unlock password and target biometric identification information, and the trusted identity authentication information includes a trusted device unlock password and trusted biometric identification information, The performing entity identity information verification processing on the entity object based on the trusted identity verification information and the target identity verification information to obtain a first identity verification result includes: Performing an unlock password verification process on the physical object based on the target device unlock password and the trusted device unlock password to obtain an unlock password verification result; Performing biometric information verification processing on the entity object based on the target biometric identification information and the trusted biometric identification information to obtain a biometric information verification result; A first identity verification result is generated based on the unlocking password verification result and the biometric information verification result.

3. The method according to claim 1, The obtaining of trusted identity authentication information includes: Accessing a device trusted execution environment using a trusted identity authentication component, and obtaining trusted identity authentication information for the entity object from the device trusted execution environment; and / or, The obtaining of the trusted digital object image feature for the entity object comprises: using a trusted identity authentication component to access a device trusted execution environment, and obtaining the trusted digital object image feature for the entity object from the device trusted execution environment.

4. The method according to claim 1, wherein the step of performing virtual digital identity image verification processing on the physical object based on the credible digital object image feature and the target digital object image feature to obtain a second identity verification result comprises: Performing image feature similarity comparison on the physical object based on the credible digital object image feature and the target digital object image feature to obtain image feature similarity parameters; Based on the image feature similarity parameter and the similarity parameter threshold, a second identity verification result is generated.

5. The method according to claim 1, wherein obtaining the target digital object image features from the virtual digital object comprises: determining a key object comparison area for the virtual digital object; The target digital object image features corresponding to the key object comparison area are obtained from the virtual digital object.

6. The method according to claim 5, wherein determining a key object comparison area for the virtual digital object comprises: Acquire a preset key object comparison area for the virtual digital object; and / or, A first identity verification result for the physical object is obtained, and a key object comparison area for the virtual digital object is determined from a plurality of object comparison areas based on the first identity verification result.

7. The method according to any one of claims 1 to 6, wherein constructing a virtual digital object for the physical object and obtaining a target digital object image feature from the virtual digital object comprises: Determine an identity verification request of a target application, and initiate a digital object verification process by calling a digital object verification calling interface in response to the identity verification request; Outputting a physical action verification prompt to the physical object based on the digital object verification process; The physical object is captured based on a physical action image input by the physical action verification prompt, a virtual digital object for the physical object is constructed based on the physical action image, and the target application is controlled to obtain a target digital object image feature from the virtual digital object.

8. A digital drive security verification device, wherein the digital drive is to drive a virtual digital object corresponding to the physical object based on the change of the physical object, and the device comprises: An information acquisition module is used to acquire target identity authentication information input by an entity object; A feature extraction module is used to construct a virtual digital object for the physical object, and obtain a target digital object image feature from the virtual digital object, wherein the step of obtaining the target digital object image feature from the virtual digital object includes: accessing digital object model data for modeling the virtual digital object, and extracting the target digital object image feature corresponding to the virtual digital object simulating the physical object from the digital object model data; A security verification module, used to perform identity verification processing on the physical object based on the target identity verification information and the target digital object image features, and obtain a digital drive security verification result; The step of performing identity verification on the physical object based on the target identity verification information and the target digital object image features to obtain a digital drive security verification result includes: Acquire trusted identity authentication information, and perform entity identity information verification processing on the entity object based on the trusted identity authentication information and the target identity authentication information to obtain a first identity verification result; Acquire a trusted digital object image feature for the physical object, and perform virtual digital identity image verification processing on the physical object based on the trusted digital object image feature and the target digital object image feature to obtain a second identity verification result, wherein the trusted digital object image feature is a digital object image feature obtained from the trusted virtual digital object after creating a trusted virtual digital object for the physical object in a trusted scenario; Based on the first identity verification result and the second identity verification result, a digital drive security verification result is obtained.

9. A computer storage medium storing a plurality of instructions, wherein the instructions are suitable for being loaded by a processor and executing the method steps as claimed in any one of claims 1 to 7.

10. A computer program product, wherein the computer program product stores at least one instruction, wherein the at least one instruction is loaded by a processor and executes the method steps according to any one of claims 1 to 7.

11. An electronic device, comprising: A processor and a memory; wherein the memory stores a computer program, and the computer program is suitable for being loaded by the processor and executing the method steps as claimed in any one of claims 1 to 7.

Images