Multi-modal authentication method, device, system, equipment, storage medium and program product

Abstract

The invention provides a multi-mode authentication method, device and system, electronic equipment, a computer readable storage medium and a computer program product, and relates to the technical field of computers, in particular to the technical field of information authentication. The method comprises the following steps: in response to a received use request for target equipment, determining a candidate authentication mode associated with the target equipment; determining a target authentication mode from the candidate authentication modes, and receiving to-be-authenticated information corresponding to the target authentication mode; in response to matching of the to-be-authenticated information and pre-stored verification information of the target equipment, authentication passing indication information is generated; and sending the authentication passing indication information to the target equipment. According to the method, the universality and expandability of information authentication are improved, and the development and maintenance cost is reduced.

Description

Technical Field

[0001] The present disclosure relates to the field of computer technology, specifically to the field of information authentication technology, and in particular to a multimodal authentication method, device, system, electronic device, computer-readable storage medium, and computer program product. Background Art

[0002] With the rapid development of information technology, data exchange between various cloud services and IoT devices requires reliable authorization authentication to prevent malicious attacks and data leakage. Information authentication can help verify the permissions of senders and receivers, and has become an important means of protecting cloud platforms and smart devices. Summary of the invention

[0003] The embodiments of the present disclosure provide a multimodal authentication method, device, system, electronic device, computer-readable storage medium, and computer program product, which can improve the versatility and scalability of information authentication.

[0004] In a first aspect, an embodiment of the present disclosure proposes a multimodal authentication method, comprising: in response to receiving a use request for a target device, determining a candidate authentication method associated with the target device; determining a target authentication method from the candidate authentication methods, and receiving information to be authenticated corresponding to the target authentication method; in response to the information to be authenticated matching pre-stored verification information of the target device, generating authentication pass indication information; and sending the authentication pass indication information to the target device.

[0005] In the second aspect, an embodiment of the present disclosure proposes a multimodal authentication device, comprising: an authentication method determination module, configured to determine a candidate authentication method associated with a target device in response to receiving a use request for a target device; an information receiving module, configured to determine a target authentication method from the candidate authentication methods, and receive information to be authenticated corresponding to the target authentication method; an information generating module, configured to generate authentication pass indication information in response to a match between the information to be authenticated and pre-stored verification information of the target device; and an information sending module, configured to send the authentication pass indication information to the target device.

[0006] In the third aspect, an embodiment of the present disclosure proposes a multimodal authentication system, including: an authentication end, configured to determine a candidate authentication method associated with a target device in response to receiving a use request for a target device; determine a target authentication method from the candidate authentication methods, and receive information to be authenticated corresponding to the target authentication method; generate and send authentication pass indication information in response to the information to be authenticated matching pre-stored verification information of the target device; the target device, configured to enable device usage permission in response to receiving the authentication pass indication information.

[0007] In a fourth aspect, an embodiment of the present disclosure provides an electronic device, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor, when executing, can implement the multimodal authentication method described in any implementation method in the first aspect.

[0008] In a fifth aspect, an embodiment of the present disclosure provides a non-transitory computer-readable storage medium storing computer instructions, which are used to enable a computer to implement a multimodal authentication method as described in any implementation method in the first aspect when executed.

[0009] In a sixth aspect, an embodiment of the present disclosure provides a computer program product comprising a computer program, which, when executed by a processor, can implement the multimodal authentication method as described in any implementation manner in the first aspect.

[0010] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] Other features, objects and advantages of the present disclosure will become more apparent from the detailed description of non-limiting embodiments made with reference to the following drawings:

[0012] Figure 1 is an exemplary system architecture in which the present disclosure may be applied;

[0013] Figure 2 A flowchart of a multi-modal authentication method provided by an embodiment of the present disclosure;

[0014] Figure 3 A flowchart of another multi-modal authentication method provided by an embodiment of the present disclosure;

[0015] Figure 4 A structural block diagram of a multi-modal authentication device provided in an embodiment of the present disclosure;

[0016] Figure 5 A timing diagram of the interaction between various devices in a multimodal authentication system provided by an embodiment of the present disclosure;

[0017] Figure 6 A structural block diagram of a multimodal authentication system in an application scenario provided by an embodiment of the present disclosure;

[0018] Figure 7 A schematic diagram of the structure of an electronic device suitable for executing a multimodal authentication method provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0019] The following is a description of exemplary embodiments of the present disclosure in conjunction with the accompanying drawings, including various details of the embodiments of the present disclosure to facilitate understanding, which should be considered as merely exemplary. Therefore, it should be recognized by those of ordinary skill in the art that various changes and modifications may be made to the embodiments described herein without departing from the scope and spirit of the present disclosure. Similarly, for clarity and conciseness, descriptions of well-known functions and structures are omitted in the following description. It should be noted that the embodiments in the present disclosure and the features in the embodiments may be combined with each other without conflict.

[0020] In the technical solution of the present disclosure, the collection, storage, use, processing, transmission, provision and disclosure of user personal information involved are in compliance with the provisions of relevant laws and regulations and do not violate public order and good morals.

[0021] Figure 1 An exemplary system architecture 100 is shown to which embodiments of the multimodal authentication method, apparatus, system, electronic device, and computer-readable storage medium of the present disclosure can be applied.

[0022] like Figure 1 As shown, the system architecture 100 may include an authentication end 101, a terminal device 102, and a network 103. The network 103 is used to provide a medium for a communication link between the authentication end 101 and the terminal device 102. The network 103 may include various connection types, such as wired, wireless communication links, or optical fiber cables.

[0023] The user can use the authentication terminal 101 to interact with the terminal device 102 through the network 103 to receive or send messages, etc. The authentication terminal 101 and the terminal device 102 can be installed with various applications for realizing information communication between the two, such as interactive applications, web browser applications, instant messaging applications, etc.

[0024] The authentication end 101 and the terminal device 102 can be hardware or software. When the authentication end 101 is hardware, it can be various electronic devices with a display screen, including but not limited to smart phones, tablet computers, laptop computers, desktop computers, etc.; when the authentication end 101 is software, it can be installed in the electronic devices listed above, which can be implemented as multiple software or software modules, or as a single software or software module, and no specific limitation is made here. When the terminal device 102 is hardware, it can be an electronic device or a hardware device, including but not limited to a printer, a computer, an access control system, etc.; when the terminal device 102 is software, it can be implemented as multiple software or software modules, or as a single software or software module, and no specific limitation is made here.

[0025] The authentication terminal 101 can provide various services through various built-in applications. Taking an interactive application that can provide authentication based on the information to be authenticated as an example, the authentication terminal 101 can achieve the following effects when running the interactive application: first, in response to receiving a use request for a target device, determine the candidate authentication method associated with the target device; then determine the target authentication method from the candidate authentication methods, and receive the information to be authenticated corresponding to the target authentication method; then, in response to the information to be authenticated matching the pre-stored verification information of the target device, generate authentication pass indication information; finally, send the authentication pass indication information to the target device.

[0026] It should be noted that, in addition to being obtained from the authentication terminal 101 through the network 103, the information to be authenticated can also be pre-stored locally in the authentication terminal 101 in various ways. Therefore, when the authentication terminal 101 detects that the data has been stored locally (for example, when starting to process the authentication task of the previously stored information to be authenticated), it can choose to directly obtain the data locally. In this case, the exemplary system architecture 100 may also not include the authentication terminal 101 and the network 103.

[0027] Since authentication based on the information to be authenticated requires more computing resources and stronger computing power, the multimodal authentication method provided in the subsequent embodiments of the present disclosure is generally executed by the authentication terminal 101 with stronger computing power and more computing resources. Correspondingly, the multimodal authentication device is generally also set in the authentication terminal 101.

[0028] It should be understood that Figure 1 The number of terminal devices, networks and servers in the embodiment is only for illustration. Any number of terminal devices, networks and servers may be provided according to implementation requirements.

[0029] Please refer to Figure 2 , Figure 2 A flowchart of a multimodal authentication method provided by an embodiment of the present disclosure, wherein process 200 includes the following steps:

[0030] Step 201: In response to receiving a use request for a target device, determining a candidate authentication method associated with the target device.

[0031] This step is intended to be performed by the execution subject of the multimodal authentication method (e.g. Figure 1 The authentication end 101 shown receives a request for use of the target device and determines a candidate authentication method associated with the target device. Specifically, the execution body may be equipped with a sound collection device, such as a microphone array, for collecting the user's voice request for use of the target device. The execution body may also be equipped with a display, and the user may send a request for use of the target device by interacting with the display, wherein the display may be a liquid crystal touch screen.

[0032] In this embodiment, when the execution subject receives a request to use the target device, it determines the candidate authentication method associated with the target device. The target device is a device that needs to be authenticated before it can be used / enabled, such as a printer, system platform, access control, etc. The candidate authentication method refers to the means used for authentication, and the candidate authentication methods can be flexibly added or deleted according to different application scenarios and security requirements.

[0033] Step 202: Determine a target authentication method from candidate authentication methods, and receive information to be authenticated corresponding to the target authentication method.

[0034] In this embodiment, the execution subject prompts the user to select a candidate authentication method, and the user selects at least one candidate authentication method associated with the target device from the candidate authentication methods as the target authentication method through a sound collection device or a display, and collects the information to be authenticated through an information collection device corresponding to the candidate authentication method. Among them, the information collection device refers to a hardware device used to obtain, collect and process various types of data, such as a sensor, a scanner, a card reader, a camera, etc.

[0035] In this embodiment, the information to be authenticated may include facial images, fingerprint information, barcode information, QR code information, RFID (Radio Frequency Identification) tags, etc. collected by an information collection device.

[0036] Step 203: In response to the information to be authenticated matching the pre-stored verification information of the target device, authentication pass indication information is generated.

[0037] In this embodiment, when the execution subject receives the information to be authenticated, in response to the information to be authenticated matching the pre-stored verification information of the target device, an authentication pass indication message is generated. Specifically, the execution subject matches the information to be authenticated with the pre-stored verification information associated with the target device, and when there is pre-stored verification information matching the information to be authenticated, an authentication pass indication message is generated, and when there is no pre-stored verification information matching the information to be authenticated, a prompt message for changing the authentication method is generated. Among them, the pre-stored verification information refers to the authority authentication information associated with the target device and pre-saved in the database, and the authentication pass indication message refers to the instruction information that the information to be authenticated has passed the authority authentication and can control the use / opening of the device.

[0038] Step 204: Send authentication success indication information to the target device.

[0039] In this embodiment, the execution subject sends the authentication pass indication information to the target device. Specifically, when the execution subject generates the authentication pass indication information, the authentication pass indication information is sent to the target device to control the target device to start.

[0040] The multimodal authentication method provided by the disclosed embodiment, when receiving a use request for a target device, determines a candidate authentication method associated with the target device, then determines a target authentication method from the candidate authentication methods, and receives information to be authenticated corresponding to the target authentication method, then generates authentication pass indication information in response to matching the information to be authenticated with pre-stored verification information of the target device, and finally sends the authentication pass indication information to the target device. This embodiment improves the efficiency and accuracy of authority authentication by automatically matching the corresponding pre-stored verification information after obtaining the information to be authenticated.

[0041] Please refer to Figure 3 , Figure 3 A flowchart of another multimodal authentication method provided by an embodiment of the present disclosure, wherein process 300 includes the following steps:

[0042] Step 301: In response to receiving a use request for a target device, determining a candidate authentication method associated with the target device.

[0043] In this embodiment, the candidate authentication methods include at least one of an image authentication method, a password authentication method, a graphic code authentication method, and a radio frequency signal authentication method. Among them, the image authentication method refers to authentication by collecting the user's facial image through a camera, the password authentication method refers to authentication through a password preset by the user, the graphic code authentication method refers to authentication through a QR code, bar code, or other graphic code generated by the user's personal terminal and associated with the user's information, and the radio frequency information authentication method refers to authentication by the user through NFC (Near Field Communication), card swiping, and other methods. NFC is a short-range high-frequency wireless communication technology that allows electronic devices to exchange and communicate data within a very close distance (usually within 10 cm). NFC technology is based on radio frequency identification (RFID) technology and transmits data through an electromagnetic field. It has the characteristics of fast speed, low power consumption, and simple operation.

[0044] In this embodiment, different candidate authentication methods can collect user information through different authentication devices, and different authentication devices can be connected to the execution subject using a common interface, so that different candidate authentication methods are integrated into the same authentication channel. And the candidate authentication methods can be flexibly added or deleted according to different application scenarios and security requirements.

[0045] Step 302: Output the options corresponding to the candidate authentication methods one by one.

[0046] In this embodiment, the execution subject displays the optional items corresponding to the candidate authentication methods on a display screen or outputs them through a microphone, so that the user can select the candidate authentication method.

[0047] In some optional implementations of this embodiment, there may be only one candidate authentication method, and the user may select any candidate authentication method for authentication; there may also be multiple candidate authentication methods, and the user may choose to use a combination of multiple candidate authentication methods for authentication. In this case, authentication pass indication information may be generated only when all selected candidate authentication methods have passed authentication.

[0048] Step 303: Based on the selected option, determine a target authentication method from the candidate authentication methods, and receive the to-be-authenticated information corresponding to the target authentication method.

[0049] In this embodiment, the execution subject determines the candidate authentication method corresponding to the optional item as the target authentication method based on at least one selected optional item, and collects the information to be authenticated through the information collection device corresponding to the candidate authentication method.

[0050] Step 304: Obtain pre-stored verification information of the target device.

[0051] In this embodiment, the execution subject obtains the pre-stored verification information of the target device. Specifically, the database associated with the target device pre-stores verification information including authority authentication. After obtaining the information to be authenticated, the execution subject can obtain the pre-stored verification information of the target device from the database.

[0052] Step 305: Determine whether there is first verification information corresponding to the target authentication method in the pre-stored verification information.

[0053] In this embodiment, the execution subject determines whether there is first verification information corresponding to the target authentication method in the pre-stored verification information based on the acquired pre-stored verification information. The first verification information is different types of verification information in the pre-stored verification information, and the types of the first verification information include image authentication information, password authentication information, and permission authentication information.

[0054] In some optional methods of this embodiment, when the target authentication method is an image authentication method, the information to be authenticated received by the execution subject is a user's facial image, and the first verification information is all image authentication information pre-stored in the database.

[0055] In some optional methods of this embodiment, when the target authentication method is a password authentication method, the information to be authenticated received by the execution subject is a user name and password input by the user, and the first verification information is all password authentication information pre-stored in the database.

[0056] In some optional methods of this embodiment, when the target authentication method is a graphic code authentication method, the execution entity will generate a QR code. After the user scans the QR code, the execution entity decodes the authority authentication information stored in the QR code by reading the data in the QR code image. The first verification information is all authority authentication information pre-stored in the database.

[0057] In some optional methods of this embodiment, when the target authentication method is a radio frequency signal authentication method, the user swipes the card through a card swiping device, and the radio frequency signal received by the execution subject contains authority authentication information, and the first verification information is the authority authentication information pre-stored in the database.

[0058] Step 306: In response to the presence of first verification information corresponding to the target authentication method in the pre-stored verification information, and the presence of target verification information matching the information to be authenticated in the first verification information, it is determined that the information to be authenticated matches the pre-stored verification information of the target device, and authentication pass indication information is generated.

[0059] In this embodiment, when the execution subject obtains the first verification information corresponding to the target authentication method, and the first verification information contains target verification information that matches the information to be authenticated, it is determined that the information to be authenticated matches the pre-stored verification information of the target device, and authentication pass indication information is generated.

[0060] In some optional methods of this embodiment, when the target authentication method is an image authentication method, a specific implementation method for determining whether there is first verification information that matches the information to be authenticated may be: preprocessing the information to be authenticated (user facial image), wherein the preprocessing may include graying, normalizing, aligning, and denoising the user facial image; detecting the user's facial position and extracting a sub-image containing the user's face; performing feature extraction on the sub-image through a deep learning method; matching the extracted features with the features of the image authentication information in the first verification information in sequence; if the degree of match is higher than a predetermined threshold, determining that the information to be authenticated matches the image authentication information; if the degree of match is lower than a predetermined threshold, determining that the information to be authenticated does not match the image authentication information; after the information to be authenticated and all the image authentication information in the first verification information are matched, when there is image authentication information that matches the information to be authenticated, determining that there is target verification information that matches the information to be authenticated in the first verification information; and when there is no image authentication information that matches the information to be authenticated, determining that there is no target verification information that matches the information to be authenticated in the first verification information.

[0061] In some optional methods of the present embodiment, when the target authentication method is a password authentication method, a specific implementation method for determining whether there is first verification information that matches the information to be authenticated may be: performing character matching on the information to be authenticated (user name and password entered by the user) and the first verification information (password authentication information); when there is password authentication information that completely matches the information to be authenticated, determining that there is target verification information that matches the information to be authenticated in the first verification information; and when there is no password authentication information that completely matches the information to be authenticated, determining that there is no target verification information that matches the information to be authenticated in the first verification information. Among them, the character matching methods include brute force matching, KMP algorithm (Knuth-Morris-Pratt algorithm), Boyer-Moore algorithm, Rabin-Karp algorithm, etc. The brute force matching method is to compare the text and the pattern character by character to find the matching substring; the KMP algorithm specifically means that in the matching process, if a character is found to be unmatched, it is not necessary to start matching from the beginning, but to use the already matched information to skip some unnecessary comparisons, thereby reducing the waste of time; the Boyer-Moore algorithm specifically matches from right to left in the pattern string, and uses some heuristic rules to skip unnecessary character comparisons, thereby speeding up the matching process; the Rabin-Karp algorithm reduces the number of direct comparisons by mapping substrings to hash values. In this embodiment, the execution subject can select different character matching methods according to actual needs.

[0062] In some optional methods of this embodiment, when the target authentication method is a graphic code authentication method, the specific implementation method of determining whether there is first verification information that matches the information to be authenticated may be: matching the information to be authenticated (user name, authorization token or other verification information) obtained by the user scanning the QR code and performing subject decoding with the first verification information (authorization authentication information); when there is authority authentication information that matches the information to be authenticated, determining that there is target verification information that matches the information to be authenticated in the first verification information; and when there is no authority authentication information that completely matches the information to be authenticated, determining that there is no target verification information that matches the information to be authenticated in the first verification information.

[0063] In some optional methods of this embodiment, when the target authentication method is a radio frequency signal authentication method, a specific implementation method for determining whether there is first verification information that matches the information to be authenticated may be: matching the information to be authenticated (card number, user name, authorization token or other verification information) read by the execution subject after the user swipes the card with the first verification information (authority authentication information); when there is authority authentication information that matches the information to be authenticated, determining that there is first verification information that matches the information to be authenticated; and when there is no authority authentication information that completely matches the information to be authenticated, determining that there is no first verification information that matches the information to be authenticated.

[0064] In this embodiment, when the execution subject determines that the information to be authenticated matches the pre-stored verification information of the target device, it generates authentication pass indication information, wherein the authentication pass indication information means that the information to be authenticated has passed the authority authentication and can control the instruction information of the device use / activation.

[0065] Step 307: In response to the fact that the pre-stored verification information does not contain the first verification information corresponding to the target authentication method, a prompt message for changing the authentication method is generated.

[0066] In this embodiment, when the execution subject determines that the first verification information corresponding to the target authentication method does not exist in the pre-stored verification information, a prompt message for changing the authentication method is generated. The execution subject can display the prompt message for changing the authentication method on a display, or generate a voice prompt message for changing the authentication method and play it to the user through a microphone.

[0067] Step 308: Send the authentication pass indication information to the signal converter, so that the authentication pass indication information is processed by the signal converter into a radio frequency signal and forwarded to the target device.

[0068] In this embodiment, the execution subject sends the authentication pass indication information to the signal converter, so that the authentication pass indication information is processed by the signal converter into a radio frequency signal and forwarded to the target device. Specifically, the execution subject can send the authentication pass indication information to the signal converter, and the signal converter uses NFC (near field communication) to convert the authentication pass indication information into a radio frequency signal and send it to the signal receiver of the target device, so that information can be exchanged without contacting the target device, thereby improving the flexibility of information transmission.

[0069] The multimodal authentication method provided by the embodiment of the present disclosure discloses that when a use request for a target device is received, a candidate authentication method associated with the target device is determined, and an optional item corresponding to the candidate authentication method is output, and then based on the selected optional item, the target authentication method is determined from the candidate authentication methods, and the information to be authenticated corresponding to the target authentication method is received, and then the pre-stored verification information of the target device is obtained, and when it is determined that there is first verification information corresponding to the target authentication method in the pre-stored verification information, and there is target verification information matching the information to be authenticated in the first verification information, it is determined that the information to be authenticated matches the pre-stored verification information of the target device, and authentication pass indication information is generated, and finally the authentication pass indication information is sent to the signal converter. This embodiment combines multiple authentication methods by adopting a universal interface, thereby greatly improving the security, flexibility, versatility and scalability of the authentication system, shortening the development cycle, reducing the cost of development and maintenance, and improving the user experience.

[0070] Further references Figure 4As an implementation of the methods shown in the above figures, the present disclosure provides an embodiment of a multi-modal authentication device. Figure 2 Corresponding to the method embodiment shown, the device can be specifically applied to various electronic devices.

[0071] like Figure 4 As shown, the multimodal authentication device 400 of this embodiment may include: an authentication mode determination module 401 , an information receiving module 402 , an information generating module 403 , and an information sending module 404 .

[0072] The authentication mode determination module 401 is configured to determine a candidate authentication mode associated with the target device in response to receiving a use request for the target device.

[0073] The candidate authentication methods in the authentication method determination module 401 include at least one of an image authentication method, a password authentication method, a graphic code authentication method and a radio frequency signal authentication method.

[0074] The information receiving module 402 is configured to determine a target authentication method from candidate authentication methods and receive information to be authenticated corresponding to the target authentication method.

[0075] Among them, the determination of the target authentication method from the candidate authentication methods in the information receiving module 402 is further configured as: an output unit is configured to output options corresponding to the candidate authentication methods one by one; a determination unit is configured to determine the target authentication method from the candidate authentication methods based on the selected options.

[0076] The information generation module 403 is configured to generate authentication pass indication information in response to the information to be authenticated matching the pre-stored verification information of the target device.

[0077] The information sending module 404 is configured to send authentication success indication information to the target device.

[0078] The information sending module 404 is further configured as: a signal forwarding unit, configured to send the authentication pass indication information to the signal converter, so that the authentication pass indication information is processed by the signal converter into a radio frequency signal and forwarded to the target device.

[0079] In some optional implementations of the present embodiment, the multimodal authentication device 400 of the present embodiment may further include: an information acquisition module 405, configured to acquire pre-stored verification information of a target device; an information judgment module 406, configured to judge whether there is first verification information corresponding to a target authentication method in the pre-stored verification information; an information matching module 407, configured to determine that the information to be authenticated matches the pre-stored verification information of the target device in response to the presence of first verification information corresponding to the target authentication method in the pre-stored verification information and the presence of first verification information matching the information to be authenticated; an information generation module 408, configured to generate prompt information for changing the authentication method in response to the absence of first verification information corresponding to the target authentication method in the pre-stored verification information.

[0080] In this embodiment, in the multimodal authentication device 400, the specific processing of the authentication mode determination module 401, the information receiving module 402, the information generating module 403, and the information sending module 404 and the technical effects thereof can be referred to respectively. Figure 2 The relevant descriptions of steps 201 - 204 in the corresponding embodiment are not repeated here.

[0081] This embodiment exists as a device embodiment corresponding to the above-mentioned method embodiment. The multimodal authentication device provided by this embodiment combines multiple authentication methods by adopting a universal interface, thereby greatly improving the security, flexibility, versatility and scalability of the authentication system, shortening the development cycle, reducing development and maintenance costs, and improving user experience.

[0082] Continue to refer Figure 5 , Figure 5 A timing sequence 500 of interactions between various devices in an embodiment of a multimodal authentication system provided by the present disclosure.

[0083] A multimodal authentication system provided by an embodiment of the present disclosure may include an authentication end 501 , a signal converter 502 , and a target device 503 .

[0084] The authentication end 501 is configured to, in response to receiving a use request for a target device, determine a candidate authentication method associated with the target device; determine a target authentication method from the candidate authentication methods, and receive information to be authenticated corresponding to the target authentication method; in response to the information to be authenticated matching the pre-stored verification information of the target device, generate and send authentication pass indication information. The above process of generating and sending authentication pass indication information can be consistent with the corresponding description in the process 200 in the aforementioned embodiment, and will not be repeated here.

[0085] In this embodiment, the authentication terminal 501 includes at least one of an image acquisition component, a password receiving component, a graphic code scanning component, and a radio frequency signal receiving component. Among them, the image acquisition component may include a camera, a scanner, a visual sensor, etc., the password receiving component may be a physical keyboard, a virtual keyboard, a touch screen, etc., the graphic code scanning component may be a barcode scanning gun, a barcode scanner, a camera and a scanning application of a smart phone, etc., and the radio frequency signal receiving component includes components from multiple stages such as an antenna to a demodulator, an analog-to-digital converter, and a digital signal processing.

[0086] In an optional manner of this embodiment, the authentication end 501 is configured to, in response to the target authentication mode being an image authentication mode and the authentication end including an image acquisition component, acquire the image information to be authenticated through the image acquisition component.

[0087] In an optional manner of this embodiment, the authentication end 501 is configured to obtain the password information to be authenticated through the password receiving component in response to the target authentication mode being a password authentication mode and the authentication end including a password receiving component.

[0088] In an optional manner of this embodiment, the authentication end 501 is configured to, in response to the target authentication mode being a graphic code authentication mode and the authentication end including a graphic code scanning component, scan the graphic code to be authenticated by the graphic code scanning component.

[0089] In an optional manner of this embodiment, the authenticator 501 is configured to obtain the RF signal to be authenticated through the RF signal receiving component in response to the target authentication mode being a RF signal authentication and the authenticator including a RF signal receiving component.

[0090] In an optional manner of this embodiment, the authentication terminal 501 can use a universal hardware interface to integrate the image acquisition component, the password receiving component, the graphic code scanning component and the radio frequency signal receiving component into one authentication channel. The universal hardware interface can be a USB interface, which ensures that different components can use the same line for data transmission.

[0091] The signal converter 502 is configured to receive the authentication pass indication information from the authentication end and convert the authentication pass indication information into a target radio frequency signal. The signal converter 502 is an NFC (near field communication) module, which is configured to receive the authentication pass indication information from the authentication end and convert the authentication pass indication information from a digital signal into a target radio frequency signal.

[0092] The target device 503 is configured to enable device usage permission in response to receiving the authentication pass indication information.

[0093] In this embodiment, the target device 503 includes a signal receiver and a controller. The signal receiver is configured to receive the target radio frequency signal from the signal converter 502 and convert the authentication pass indication information into a device unlocking signal. The controller is configured to enable the device usage permission based on the device unlocking signal. Among them, the signal receiver refers to a device used to receive and process various forms of signals, and the controller refers to a device or circuit used to control and coordinate the work of various parts in the system to ensure that the system can operate in a predetermined manner.

[0094] The multimodal authentication system provided in this embodiment combines multiple authentication methods by adopting a universal interface, thereby greatly improving the security, flexibility, versatility and scalability of the authentication system, shortening the development cycle, reducing development and maintenance costs, and improving user experience.

[0095] To deepen understanding, the present disclosure also provides a specific implementation scheme 600 in combination with a specific application scenario, see Figure 6 In this implementation, the authentication end 610 of the multimodal authentication system can interact with the target device 630 through the signal converter 620 .

[0096] In this embodiment, the authentication end 610 is a tablet computer, and the tablet computer is connected to the authentication component using OTG (On-The-Go) technology. Among them, OTG technology can support direct connection and data transmission between devices using a universal interface 640 without relying on a computer as an intermediary. For example, in this embodiment, the tablet computer can be connected to the signal converter 620 and the radio frequency information component 650 using OTG technology.

[0097] In this embodiment, the signal converter 620 is an NFC module. After the authentication end 610 generates authentication pass indication information after authentication, the NFC module sends the received authentication pass indication information to the signal receiver 660 of the target device 630 through radio frequency technology.

[0098] In this embodiment, the target device 630 is a printer. When the receiver of the target device 630 receives the authentication pass indication information, the authentication pass indication information is converted into a device unlocking signal, and the use permission of the target device 630 is enabled based on the device unlocking signal.

[0099] The multimodal authentication system provided in this embodiment combines multiple authentication methods by adopting a universal interface, thereby greatly improving the security, flexibility, versatility and scalability of the authentication system, shortening the development cycle, reducing development and maintenance costs, and improving user experience.

[0100] According to an embodiment of the present disclosure, the present disclosure also provides an electronic device, which includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the multimodal authentication method described in any of the above embodiments can be implemented when the at least one processor executes.

[0101] According to an embodiment of the present disclosure, the present disclosure further provides a readable storage medium, which stores computer instructions, and the computer instructions are used to enable a computer to implement the multimodal authentication method described in any of the above embodiments when executed.

[0102] According to an embodiment of the present disclosure, the present disclosure further provides a computer program product, which, when executed by a processor, can implement the multimodal authentication method described in any of the above embodiments.

[0103] Figure 7 A schematic block diagram of an example electronic device 700 that can be used to implement an embodiment of the present disclosure is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and / or required herein.

[0104] like Figure 7 As shown, the device 700 includes a computing unit 701, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 702 or a computer program loaded from a storage unit 708 into a random access memory (RAM) 703. In the RAM 703, various programs and data required for the operation of the device 700 can also be stored. The computing unit 701, the ROM 702, and the RAM 703 are connected to each other via a bus 704. An input / output (I / O) interface 705 is also connected to the bus 704.

[0105] A number of components in the device 700 are connected to the I / O interface 705, including: an input unit 706, such as a keyboard, a mouse, etc.; an output unit 707, such as various types of displays, speakers, etc.; a storage unit 708, such as a disk, an optical disk, etc.; and a communication unit 709, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 709 allows the device 700 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0106] The computing unit 701 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the computing unit 701 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc. The computing unit 701 performs the various methods and processes described above, such as a multimodal authentication method. For example, in some embodiments, the multimodal authentication method may be implemented as a computer software program, which is tangibly contained in a machine-readable medium, such as a storage unit 708. In some embodiments, part or all of the computer program may be loaded and / or installed on the device 700 via the ROM 702 and / or the communication unit 709. When the computer program is loaded into the RAM 703 and executed by the computing unit 701, one or more steps of the multimodal authentication method described above may be performed. Alternatively, in other embodiments, the computing unit 701 may be configured to perform the multimodal authentication method in any other appropriate manner (e.g., by means of firmware).

[0107] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0108] The program code for implementing the method of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that the program code, when executed by the processor or controller, enables the functions / operations specified in the flow chart and / or block diagram to be implemented. The program code may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0109] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0110] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0111] The systems and techniques described herein may be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), and the Internet.

[0112] A computer system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The relationship between the client and the server is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and virtual private servers (VPS) services.

[0113] According to the technical solution of the embodiment of the present disclosure, a universal interface is adopted to combine multiple authentication methods, thereby greatly improving the security, flexibility, versatility and scalability of the authentication system, shortening the development cycle, reducing development and maintenance costs, and improving user experience.

[0114] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps recorded in this disclosure can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solutions disclosed in this disclosure can be achieved, and this document does not limit this.

[0115] The above specific implementations do not constitute a limitation on the protection scope of the present disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present disclosure shall be included in the protection scope of the present disclosure.

Claims

1. A multimodal authentication method, comprising: In response to receiving a use request for a target device, determining a candidate authentication mode associated with the target device; Determine a target authentication method from the candidate authentication methods, and receive information to be authenticated corresponding to the target authentication method; In response to the information to be authenticated matching the pre-stored verification information of the target device, generating authentication pass indication information; The authentication success indication information is sent to the target device.

2. The method according to claim 1, wherein: The candidate authentication methods include at least one of an image authentication method, a password authentication method, a graphic code authentication method, and a radio frequency signal authentication method.

3. The method according to claim 1, wherein: The step of determining a target authentication method from the candidate authentication methods includes: Outputting options corresponding to the candidate authentication methods one by one; Based on the selected option, a target authentication method is determined from the candidate authentication methods.

4. The method according to claim 1, further comprising: Obtaining pre-stored verification information of the target device; In response to determining that the pre-stored verification information contains first verification information corresponding to the target authentication mode, and the first verification information contains target verification information matching the information to be authenticated, it is determined that the information to be authenticated matches the pre-stored verification information of the target device.

5. The method according to claim 4, further comprising: In response to the absence of first verification information corresponding to the target authentication method in the pre-stored verification information, prompt information for changing the authentication method is generated.

6. The method according to claim 1, wherein: The step of sending the authentication success indication information to the target device includes: The authentication pass indication information is sent to a signal converter, so that the authentication pass indication information is processed by the signal converter into a radio frequency signal and forwarded to the target device.

7. A multimodal authentication device, comprising: an authentication mode determination module, configured to determine a candidate authentication mode associated with the target device in response to receiving a use request for the target device; An information receiving module is configured to determine a target authentication method from the candidate authentication methods and receive information to be authenticated corresponding to the target authentication method; an information generation module, configured to generate authentication pass indication information in response to the information to be authenticated matching the pre-stored verification information of the target device; The information sending module is configured to send the authentication success indication information to the target device.

8. The device according to claim 7, wherein: The candidate authentication methods in the authentication method determination module include at least one of an image authentication method, a password authentication method, a graphic code authentication method and a radio frequency signal authentication method.

9. The method according to claim 7, wherein: The determining of the target authentication method from the candidate authentication methods in the information receiving module is further configured as follows: An output unit, configured to output options corresponding one to one to the candidate authentication methods; The determination unit is configured to determine a target authentication method from the candidate authentication methods based on the selected optional item.

10. The method according to claim 7, further comprising: An information acquisition module, configured to acquire pre-stored verification information of the target device; The information matching module is configured to determine that the information to be authenticated matches the pre-stored verification information of the target device in response to determining that there is first verification information corresponding to the target authentication method in the pre-stored verification information, and there is target verification information matching the information to be authenticated in the first verification information.

11. The apparatus according to claim 10, further comprising: The replacement information generation module is configured to generate prompt information for changing the authentication method in response to the absence of first verification information corresponding to the target authentication method in the pre-stored verification information.

12. The device according to claim 7, wherein: The information sending module is further configured as follows: The signal forwarding unit is configured to send the authentication pass indication information to the signal converter, so that the authentication pass indication information is processed by the signal converter into a radio frequency signal and forwarded to the target device.

13. A multimodal authentication system, comprising: an authentication end, configured to, in response to receiving a use request for a target device, determine a candidate authentication mode associated with the target device; Determine a target authentication method from the candidate authentication methods, and receive information to be authenticated corresponding to the target authentication method; in response to the information to be authenticated matching pre-stored verification information of the target device, generate and send authentication pass indication information; The target device is configured to enable device usage permission in response to receiving the authentication pass indication information.

14. The system of claim 13, further comprising: A signal converter, configured to receive the authentication pass indication information from the authentication end, and convert the authentication pass indication information into a target radio frequency signal; The target device includes a signal receiver and a controller, The signal receiver is configured to receive the target radio frequency signal from the signal converter and convert the authentication pass indication information into a device unlocking signal; The controller is configured to enable device usage permission based on a device unlocking signal.

15. The system of claim 13, wherein: The signal converter is a near field communication module, configured to receive the authentication pass indication information from the authentication end, and convert the authentication pass indication information from a digital signal into a target radio frequency signal.

16. The system of claim 13, wherein: The authentication end includes: at least one of an image acquisition component, a password receiving component, a graphic code scanning component and a radio frequency signal receiving component; The authentication end is further configured as: In response to the target authentication mode being an image authentication mode and the authentication end including an image acquisition component, acquiring image information to be authenticated through the image acquisition component; In response to the target authentication mode being a password authentication mode and the authentication end including a password receiving component, obtaining password information to be authenticated through the password receiving component; In response to the target authentication mode being a graphic code authentication mode and the authentication terminal including a graphic code scanning component, scanning a graphic code to be authenticated by the graphic code scanning component; In response to the target authentication mode being a radio frequency signal authentication party and the authentication end including a radio frequency signal receiving component, the radio frequency signal to be authenticated is acquired through the radio frequency signal receiving component.

17. An electronic device comprising: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the multimodal authentication method according to any one of claims 1 to 6.

18. A non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to cause the computer to execute the multimodal authentication method according to any one of claims 1 to 6.

19. A computer program product, comprising a computer program, wherein when the computer program is executed by a processor, the steps of the multimodal authentication method according to any one of claims 1 to 6 are implemented.

Images