Method, System, Device, and Storage Medium for Filling in Identity Authentication Information

Through optical character recognition technology, the text information in the ID card image is automatically identified and filled in, which solves the problem of complex and inefficient identity authentication process in the prior art, and realizes efficient and accurate filling of identity authentication information.

CN114429634BActive Publication Date: 2025-06-20TENCENT TECHNOLOGY (SHENZHEN) CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202011104022.4
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-10-15
Publication Date
2025-06-20
Estimated Expiration
2040-10-15

AI Technical Summary

Technical Problem

In the prior art, the identity authentication process requires the user to manually upload the ID photo and fill in personal information, which is complicated, inefficient and easily lead to incorrect information filling.

Method used

Through optical character recognition technology, the server obtains the ID image and calls the optical character recognition interface for recognition, automatically extracts and checks text information, and finally sends the recognition result to the terminal, and the terminal automatically fills in to the target position.

Benefits of technology

It realizes efficient and accurate filling of identity authentication information, simplifies user operations, reduces the possibility of information filling incorrectly, and improves the efficiency and accuracy of identity authentication.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114429634B_ABST
    Figure CN114429634B_ABST
Patent Text Reader

Abstract

The present application discloses a method, system, device, and storage medium for filling in identity authentication information. The method includes: obtaining a document image; calling an optical character recognition interface through a document photo optical character recognition module to recognize the document image; checking, through the document photo optical character recognition module, the recognition result of whether the document image is a valid document photo and the text information of the document image; and sending, through the document photo optical character recognition module, the type of the document image and the text information that passes the check to a terminal, so that the terminal fills in the text information that passes the check at a target position, and the target position matches the type of the document image. After the server of the present application obtains the document image, the terminal can automatically fill in the personal information corresponding to the document at the target position, with more convenient operation and higher efficiency; the optical character recognition result is automatically checked by using the document photo optical character recognition module of the server, which is more accurate and can be widely applied to the field of computer technology.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of computer technology, and in particular, to a method, system, device, and storage medium for filling in identity authentication information. Background Art

[0002] Identity authentication (Customer Due Diligence, CDD), also known as "identity verification" or "identity discrimination", refers to the process of confirming the identity of an operator in a computer and computer network system. In recent years, with the rapid development of computer network technology, identity authentication has been more and more widely and deeply applied in fields such as financial transactions, community management, express logistics, etc., and the requirements for identity authentication technology have also become higher and higher.

[0003] Nowadays, in many life scenarios, such as industries like finance, telecommunications, security, education, medical care, and online shopping malls, real-name authentication is required. The identity authentication process of real-name authentication not only requires users to upload photos or scans of documents such as identity cards, driver's licenses, and residence permits, but also requires users to fill in personal information corresponding to the documents (such as name, date of birth, etc.). For this reason, the identity authentication process of related technologies generally requires users to manually fill in all personal information as identity authentication information after uploading a photo or scan of the document. This is complex for users to operate, requires a lot of identity authentication information to be input or filled in, has low efficiency, and is prone to information filling errors. Summary of the Invention

[0004] Embodiments of this application provide a method, system, device, and storage medium for filling in identity authentication information, which can realize the efficient and accurate filling of identity authentication information through the text information of optical character recognition.

[0005] According to one aspect of the embodiments of this application, a method for filling in identity authentication information, which is applied to a server, includes the following steps:

[0006] Obtain a document image;

[0007] Call an optical character recognition interface through a document photo optical character recognition module to recognize the document image. Among them, the document photo optical character recognition module is used to trigger an information call instruction, and the information call instruction includes an interface call instruction; the optical character recognition interface recognizes the document image according to the interface call instruction to obtain the recognition result of whether the document image is a valid document photo, the type of the document image, and the text information of the document image;

[0008] Check the recognition result and the text information through the document photo optical character recognition module;

[0009] The type and the text information that has passed the inspection are sent to the terminal through the ID photo optical character recognition module, so that the terminal fills the text information that has passed the inspection into a target position, and the target position matches the type.

[0010] According to one aspect of the embodiments of the present application, an identity authentication information filling method is applied to a terminal and includes the following steps:

[0011] Display a first user interface of the terminal, where the first user interface displays an image upload button for an ID photo.

[0012] In response to an identity authentication instruction, display a second user interface of the terminal. The second user interface displays an image display frame and a text information filling area. The uploaded ID photo is displayed in the image display frame, and the text information filled in the text information filling area is obtained by the method described above.

[0013] According to one aspect of the embodiments of the present application, an identity authentication information filling method is applied to a system composed of a terminal and a server and includes the following steps:

[0014] The terminal obtains an ID photo and uploads the ID photo to the server.

[0015] The ID photo optical character recognition module of the server calls the optical character recognition interface of the server to recognize the ID photo. Among them, the ID photo optical character recognition module is used to trigger an information call instruction, and the information call instruction includes an interface call instruction. The optical character recognition interface recognizes the ID photo according to the interface call instruction to obtain an identification result of whether the ID photo is a valid ID photo, the type of the ID photo, and the text information of the ID photo.

[0016] The ID photo optical character recognition module checks the recognition result and the text information.

[0017] The ID photo optical character recognition module sends the type and the text information that has passed the inspection to the terminal.

[0018] The terminal fills the text information that has passed the inspection into a target position, and the target position matches the type.

[0019] According to the fifth aspect of the embodiments of the present application, an identity authentication information filling device is applied to a terminal and includes:

[0020] A first user interface display module, configured to display a first user interface of the terminal, where the first user interface displays an image upload frame for an ID photo.

[0021] A second user interface display module, configured to display a second user interface of the terminal in response to an identity authentication instruction. The second user interface is provided with an image display frame and a text information filling area. The uploaded document image is displayed in the image display frame, and the text information of the document image filled in the text information filling area is obtained by the method described in the first aspect.

[0022] According to an aspect of an embodiment of the present application, an identity authentication information filling device is applied to a server and includes:

[0023] An image acquisition module, configured to acquire a document image;

[0024] An identification module, configured to call an optical character recognition interface through a document photo optical character recognition module to recognize the document image. The document photo optical character recognition module is used to trigger an information call instruction, and the information call instruction includes an interface call instruction. The optical character recognition interface recognizes the document image according to the interface call instruction to obtain an identification result of whether the document image is a valid document photo, a type of the document image, and text information of the document image;

[0025] An inspection module, configured to inspect the identification result and the text information through the document photo optical character recognition module;

[0026] An identification result sending module, configured to send the type and the text information that passes the inspection to the terminal through the document photo optical character recognition module, so that the terminal fills the text information that passes the inspection into a target position, and the target position matches the type.

[0027] According to an aspect of an embodiment of the present application, an identity authentication information filling system includes a terminal and a server.

[0028] The terminal is configured to acquire a document image and upload the document image to the server;

[0029] The server includes a document photo optical character recognition module and an optical character recognition interface.

[0030] The document photo optical character recognition module is configured to trigger an information call instruction and call the optical character recognition interface to recognize the document image. The information call instruction includes an interface call instruction.

[0031] The optical character recognition interface is configured to recognize the document image according to the interface call instruction to obtain an identification result of whether the document image is a valid document photo, a type of the document image, and text information of the document image.

[0032] The ID photo optical character recognition module is further configured to check the recognition result and the text information, and send the type and the text information that passes the check to the terminal;

[0033] The terminal is further configured to fill the text information that passes the check into a target position, and the target position matches the type.

[0034] According to an aspect of an embodiment of the present application, a computer device includes:

[0035] At least one processor;

[0036] At least one memory for storing at least one program;

[0037] When the at least one program is executed by the at least one processor, the at least one processor implements the method described above.

[0038] According to an aspect of an embodiment of the present application, a computer-readable storage medium stores a program executable by a processor, and the program executable by the processor is used to implement the method described in the first aspect or the second aspect when executed by the processor.

[0039] After the server obtains the ID photo image according to the technical solution of the embodiment of the present application, the ID photo optical character recognition module of the server calls the optical character recognition interface to recognize the ID photo image, obtains the text information of the ID photo image and returns the text information to the terminal, which is filled into the target position by the terminal. By using the ID photo optical character recognition module to call the optical character recognition interface with optical character recognition function, the text recognition of ID cards, driver's licenses and other ID photo images is realized, and the recognized text information is automatically filled into the target position of the terminal. In this way, after the user uploads the ID photo image through the terminal, the terminal can automatically fill in the personal information corresponding to the ID card at the target position. Compared with the related technology that requires the user to manually fill in the personal information, the operation is simpler and the efficiency is higher; the server triggers the information call instruction through the ID photo optical character recognition module to trigger the control instruction, and the ID photo image is recognized according to the interface call instruction through the optical character recognition interface to execute the control instruction, separating the trigger of the control instruction and the execution of the instruction in the text recognition function of the ID photo image, further improving the text recognition efficiency of the ID photo image; by using the ID photo optical character recognition module to check the recognition result and text information of the ID photo image, the server's ID photo optical character recognition module is used to automatically check the result of optical character recognition, reducing the occurrence of information filling errors and being more accurate; the server recognizes the type of the ID photo image and sends it to the terminal, so that the terminal can automatically match the corresponding target position according to the type, and can automatically adjust the format, style and other contents of the target position according to the types of different ID cards, facilitating user operation. Description of the Drawings

[0040] To more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings required for the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0041] Figure 1 A schematic diagram of an implementation environment for the identity authentication information filling method provided by the application embodiment;

[0042] Figure 2 Another schematic diagram of an implementation environment for the identity authentication information filling method provided by the application embodiment;

[0043] Figure 3 A schematic diagram of the software structure of the identity authentication information filling system in the embodiments of the present application;

[0044] Figure 4 A flowchart of the identity authentication information filling method in the embodiments of the present application when used in a server;

[0045] Figure 5 A flowchart of the identity authentication information filling method in the embodiments of the present application when used in a terminal;

[0046] Figure 6 A schematic diagram of the identity authentication interface in the embodiments of the present application;

[0047] Figure 7 A schematic diagram of the first user interface in the embodiments of the present application;

[0048] Figure 8 A schematic diagram of the second user interface in the embodiments of the present application;

[0049] Figure 9 A schematic diagram of the interface of the second user interface in the embodiments of the present application after filling in the text information using the OCR recognition result of the server;

[0050] Figure 10 A schematic diagram of the mobile phone number input and verification code sending interface of the third user interface in the embodiments of the present application;

[0051] Figure 11 A schematic diagram of the verification code filling interface of the third user interface in the embodiments of the present application;

[0052] Figure 12 A flowchart of the identity authentication information filling method in the embodiments of the present application when used in the identity authentication information filling system;

[0053] Figure 13The following is a specific implementation flowchart of the method for filling in identity authentication information in the embodiments of the present application when applied to payment identity authentication;

[0054] Figure 14 The following is a first structural schematic diagram of the device for filling in identity authentication information in the embodiments of the present application when used in a server;

[0055] Figure 15 The following is a second structural schematic diagram of the device for filling in identity authentication information in the embodiments of the present application when used in a terminal;

[0056] Figure 16 The following is a third structural schematic diagram of the device for filling in identity authentication information in the embodiments of the present application. Detailed implementation manners

[0057] In order to enable those skilled in the art to better understand the solution of the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without making creative efforts shall fall within the protection scope of the present application.

[0058] The terms "first", "second", "third", "fourth", etc. in the specification and claims of the present application and the accompanying drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or device that includes a series of steps or units is not limited to the listed steps or units, but optionally further includes steps or units not listed, or optionally further includes other steps or units inherent to these processes, methods, products, or devices.

[0059] Referring to "embodiments" herein means that the specific features, structures, or characteristics described in connection with the embodiments can be included in at least one embodiment of the present application. The phrase appears in various places in the specification and does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment mutually exclusive with other embodiments. Those skilled in the art will explicitly and implicitly understand that the embodiments described herein can be combined with other embodiments.

[0060] First, relevant noun terms involved in the embodiments of the present application are introduced and explained:

[0061] Optical Character Recognition (OCR): It refers to the process of analyzing and recognizing an image file of text materials to obtain text and layout information.

[0062] Internet Data Center (IDC): By means of Internet communication lines and bandwidth resources, a standardized professional-level computer room environment is established, which can provide services such as safe, reliable, fast, and comprehensive data storage, server hosting, leasing, and related value-added services for government agencies and enterprises and institutions.

[0063] Access_token: The globally unique interface call credential for a (WeChat) official account. The official account needs to use the Access_token when calling each interface, and developers need to save it properly. The storage of the Access_token should reserve at least 512 character spaces. The Access_token has a certain validity period (such as 2 hours) and needs to be refreshed regularly. Repeatedly obtaining it will cause the previously obtained Access_token to become invalid.

[0064] MediaID (Multimedia Identity Number): Used by a (WeChat) official account to identify successfully uploaded multimedia materials such as pictures, voices, and videos. The MediaID is obtained by uploading multimedia files through the material management interface. Through the material management interface provided by the WeChat official account platform, multimedia materials such as pictures, voices, and videos are uploaded to the WeChat server. After successful upload, the WeChat server will return a corresponding MediaID.

[0065] Application Programming Interface (API): Some predefined functions, aiming to provide the ability for application programs and developers to access a set of routines based on a certain software or hardware, without the need to access the source code or understand the details of the internal working mechanism.

[0066] In scenarios that require real-name authentication in finance, telecommunications, security, education, medical care, online shopping malls, etc., not only do users need to upload photos or scans of identity documents, driver's licenses, residence permits, etc., but also they need to fill in the personal information corresponding to the document (such as name, date of birth, etc.). In the identity authentication process of related technologies, generally, after the user uploads a photo or scan of the document, they need to manually fill in all personal information as identity authentication information. The operation is complex, there is a lot of identity authentication information to input or fill in, the efficiency is low, and it is easy to cause incorrect information filling.

[0067] To this end, the embodiments of the present application provide a method for filling in identity authentication information. This method uses OCR recognition technology to recognize the image of documents such as ID cards, driver's licenses, and residence permits uploaded by users, obtains the corresponding text information, and automatically fills the obtained text information into the target position to assist in filling in the information required for identity authentication such as personal information. The operation is more convenient and the efficiency is higher. Further, this method can also automatically check the results of OCR recognition, reducing the occurrence of information filling errors and being more accurate. In addition, this method can also identify the type of document image and automatically adjust the format, style, and other contents of the target position according to the types of different documents, which greatly facilitates users.

[0068] Figure 1 and Figure 2 are the implementation environments of a method for filling in identity authentication information provided by the embodiments of the present application. The devices included in the two implementation environments are different, and the functions of each device can also be different. Then, the steps executed by each device in this method for filling in identity authentication information can be different. The embodiments of the present application do not limit which specific implementation environment it is.

[0069] In a possible implementation manner, referring to Figure 1 , this implementation environment may include a computer device 101. The computer device 101 may have an image acquisition function and an image processing function. The computer device 101 can acquire the image of documents such as ID cards, driver's licenses, Hong Kong and Macau passports, home return permits, and residence permits, and perform text recognition on the document image and automatically fill in the recognized text information. Figure 1 In, the smart phone 1011, the tablet computer 1012, and the desktop computer 1013 are all exemplary embodiments of the terminal; and 1014 is the server.

[0070] In another possible implementation manner, referring to Figure 2 , this implementation environment may include a computer device 101 and an image acquisition device 102. The image acquisition device 102 may have an image acquisition function, and the computer device 101 may have an image processing function. The image acquisition device 102 can acquire the image of documents such as ID cards, driver's licenses, Hong Kong and Macau passports, home return permits, and residence permits, and send the acquired document image to the computer device 101. The computer device 101 performs text recognition on the document image and automatically fills in the recognized text information. Figure 2 In, the smart phone 1011, the tablet computer 1012, and the desktop computer 1013 are all exemplary embodiments of the terminal; and 1014 is the server.

[0071] The method for filling in identity authentication information can be applied to various scenarios. For example, the method for filling in identity authentication information can be applied to the financial payment scenario. The terminal of the computer device 101 can collect the document images of documents such as identity cards, driving licenses, Hong Kong and Macao passports, home return permits, and residence permits and upload them to the server. The server automatically performs OCR recognition on the user document images uploaded by the terminal to obtain the personal information of the documents, and sends the recognized personal information to the terminal, which automatically fills it in the corresponding position (i.e., the target position) in the filling area, so as to provide assistance for filling in identity information before payment for the user and improve the convenience of identity authentication. Of course, the method for filling in identity authentication information can also be applied to other scenarios that require real-name authentication, such as telecommunications, security, education, medical care, online shopping malls, etc., which will not be listed one by one here.

[0072] Those skilled in the art can understand that the computer device 101 can be a terminal, a server, or a system composed of a terminal and a server. The embodiments of the present application do not limit this. The terminal can be a smart phone, a tablet computer, a notebook computer, a desktop computer, a smart speaker, a smart watch, etc., but is not limited thereto. The server can be an independent physical server, a server cluster or a distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms.

[0073] Based on Figure 1 or Figure 2 the shown implementation environment, a software structure diagram of the identity authentication information filling system according to the embodiments of the present application is proposed. As Figure 2 shown, the system includes a front end 301 and a server unit 302. The terminal 301 communicates and exchanges data with the server unit 302 through a network. Specifically, the front end 301 is used to capture a document image and upload it to the server unit 302, and receive the text information (such as information containing name, date of birth, and SMS verification code, etc.) obtained by the server unit 302 after OCR recognition and inspection. The front end 301 can be software running on Figure 1 or Figure 2 the shown terminal, such as an application program (such as a WeChat mini program) with a function of taking and uploading documents.

[0074] The server unit 302 is used to receive the document image, call the optical character recognition interface integrated with the optical character recognition algorithm at the bottom layer to recognize the document image, obtain the recognition result of whether the document image is a valid document photo, the type of the document image, and the text information of the document image and perform inspection, and return the type of the document image and the text information of the document image that passes the inspection to the front end. The server unit 302 can be software running onFigure 1 or Figure 2 the software of the server shown, such as an application program with functions of storing certificate images, OCR recognition and checking, etc.

[0075] such as Figure 3 As shown, the server unit 302 can be further divided into a first service unit and a second service unit. Among them, the first service unit is used to receive and store the certificate images uploaded by the front end. The first service unit can be a WeChat server, a third-party application program or a web page (such as an H5 web page), etc.

[0076] The second service unit is the unit in the server unit 302 mainly responsible for OCR recognition and checking. Both the first service unit and the second service unit can be deployed in the computer room of the data center IDC, so as to communicate and interact with the front end 301 deployed on the terminal.

[0077] such as Figure 3 As shown, the second service unit can be further divided into a certificate photo optical character recognition module, a user information query module, an authentication information acquisition module and an optical character recognition interface. Optionally, the second service unit can use Node.js as the backend development platform to implement the certificate photo optical character recognition module, the user information query module, the authentication information acquisition module and the optical character recognition interface, and realize the call or access between the modules in the second service unit through the API interface.

[0078] The certificate photo optical character recognition module is used to provide integrated functions such as OCR recognition and checking. It realizes the OCR recognition of the certificate image by calling the underlying optical character recognition interface, and can also automatically check the results of the OCR recognition. It is the integrated (control) end of the OCR recognition function and the generation end of the call instruction. The certificate photo optical character recognition module can trigger an information call instruction to call the user information query module, the authentication information acquisition module and the optical character recognition interface to perform the OCR recognition of the certificate image. Corresponding to the user information query module, the authentication information acquisition module and the optical character recognition interface, the information call instruction includes a user information call instruction, an authentication information call instruction and an interface call instruction. It can be understood that the information call instruction can be either generated by the certificate photo optical character recognition module according to the request of the terminal or obtained by receiving the information call instruction from a remote server, a host computer, etc.

[0079] The user information query module is used to query the basic information of the user, including account information, status information (such as status information indicating whether it is in a normal state, etc.).

[0080] An authentication information acquisition module is used to acquire authentication information. Taking an application based on WeChat as an example, the authentication information can be an access token (Access_token). Since the Access_token has a validity period, the authentication information acquisition module needs to dynamically acquire and update the Access_token to obtain the corresponding permissions for operations such as uploading document images.

[0081] An optical character recognition interface, which is a functional interface encapsulating the OCR recognition algorithm at the bottom layer, is the execution end of the OCR recognition function, providing the ability to recognize document photos based on OCR recognition technology, and can recognize text information such as names and document numbers on the document image through the OCR recognition algorithm. Optionally, the optical character recognition interface can also identify whether the document image is a valid document photo, reducing the risk of identity authentication caused by invalid document photos such as non-document photos, fake photos, and unrecognizable pictures uploaded, and improving the security of identity authentication. Optionally, the optical character recognition interface can also identify the type of the document image to facilitate subsequent automatic adjustment of content such as the style and format of the target position. The identification of the type of the document image can be but is not limited to: 1) Obtained according to the text representing the type obtained by OCR recognition. For example, for an ID card, the type of the document image can be determined as an ID card according to the recognized words "Resident Identity Card"; for a driver's license, the type of the document image can be determined as a driver's license according to the recognized words "Motor Vehicle Driving License"; 2) Obtained by recognizing the document image through a pre-trained document image type recognition model. Among them, the pre-trained document image type recognition model can be pre-trained in advance using algorithms such as deep learning algorithms and support vector machines (Support Vector Machine, SVM) according to the given training samples and labels before recognition.

[0082] Figure 3The working process of the identity authentication information filling system is as follows: The front end 301 acquires the certificate image and uploads the certificate image to be stored in the first service unit of the server unit 302. The optical character recognition module of the certificate photo sends an OCR recognition instruction (i.e., an interface information call instruction) to the optical character recognition interface; after receiving the OCR recognition instruction, the optical character recognition interface acquires the certificate image from the first service unit, recognizes the certificate image using the encapsulated OCR recognition algorithm, obtains the recognition result of whether the certificate image is a valid certificate photo, the type of the certificate image, and the text information of the certificate image, and returns them to the optical character recognition module of the certificate photo; the optical character recognition module of the certificate photo checks the returned recognition result and text information, and after passing the detection (i.e., the certificate image is a valid certificate photo and the text information of the certificate image meets requirements such as correct content and correct format), returns the text information of the certificate image and the type of the certificate image to the front end 301; the front end 301 receives the text information of the certificate image and the type of the certificate image, adjusts the styles, formats, etc. of the target position according to the type of the certificate image, and automatically fills the text information of the certificate image into the adjusted target position.

[0083] Based on the above description of the implementation environment and the embodiments of the identity authentication information filling system, an embodiment of the present invention provides an identity authentication information filling method, which can be applied to Figures 1 - 3 the identity authentication information filling system shown in Figures 1 - 3 and can be specifically executed by the server shown in Figure 4 . Please refer to

[0084] S401. The optical character recognition interface of the server acquires the certificate image.

[0085] Specifically, the certificate can be an identity card, a driver's license, a residence permit, a Hong Kong and Macao permit, an officer's certificate, a home return permit, a social security card, a medical insurance card, etc., which can represent the user's identity. The certificate image can be the front image of the certificate, the back image of the certificate, or can also include both the front image and the back image of the certificate. This application does not make specific limitations on this.

[0086] As mentioned above, the first service unit can store the certificate image, so the optical character recognition interface of the server can read the stored certificate image from the first service unit. Of course, those skilled in the art can understand that the optical character recognition interface of the server can also receive the certificate image taken and uploaded by the terminal in real time.

[0087] In a possible implementation manner, step S401 can be further divided into the following steps S4011 - S4013:

[0088] S4011. The first service unit of the server receives and stores the ID image uploaded by the terminal, generates a unique identifier for the ID image, and returns it to the terminal.

[0089] In the embodiment of the present application, after the server receives the ID image uploaded by the front-end 301 running on the terminal, the ID image can be stored in the first service unit. The unique identifier of the ID image is used to uniquely (globally) identify the ID image, facilitating the subsequent optical character recognition interface to retrieve the corresponding ID image from the first service unit through this unique identifier. Optionally, the unique identifier of the ID image can be a combination of numbers, letters, symbols, etc. Exemplarily, if the first service unit is a WeChat server, the unique identifier of the ID image can be the media ID.

[0090] Taking the terminal as a mobile phone, the front-end 301 as the WeChat client deployed on the mobile phone, and the first service unit as the WeChat server as an example, the Access_token can be used to call the WeChat client to activate the camera of the user's mobile phone, capture the user's ID image and upload it to the WeChat server. After receiving the ID image, the WeChat server will return the corresponding media ID to the front-end 301.

[0091] S4012. The ID photo optical character recognition module of the server calls the authentication information acquisition module to obtain the authentication information according to the authentication information call instruction.

[0092] Specifically, the ID photo optical character recognition module needs to obtain the corresponding permissions before calling the optical character recognition interface. Therefore, the ID photo optical character recognition module will call the authentication information acquisition module to obtain the corresponding authentication information. Optionally, the authentication information can be access credential information that needs to be dynamically obtained and updated, such as the access token Access_token, etc.

[0093] S4013. The optical character recognition interface of the server obtains the ID image from the first service unit according to the unique identifier and the authentication information.

[0094] Specifically, when the ID photo optical character recognition module needs to call the optical character recognition interface for recognition, it will send the unique identifier of the ID image and the authentication information to the optical character recognition interface. After receiving the authentication information and obtaining the access permission for the ID image, the optical character recognition interface will find the corresponding ID image from the first service unit according to this unique identifier.

[0095] S402. The ID photo optical character recognition module of the server calls the optical character recognition interface to recognize the ID image.

[0096] In the embodiment of the present application, the OCR recognition function of certificates is implemented by two modules in the server, namely the certificate photo optical character recognition module and the optical character recognition interface. Among them, the certificate photo optical character recognition module is responsible for calling the information of the user information query module, the authentication information acquisition module, etc. and the optical character recognition interface to implement the OCR integrated recognition function of the user certificate. It is the integrated (control) end of the OCR recognition function and the generation end of the call instruction. The optical character recognition interface encapsulates the OCR recognition algorithm and is the execution end of the OCR recognition function. It can extract the corresponding text information from the certificate image through the OCR recognition technology according to the call instruction of the certificate photo optical character recognition module. Compared with the method of implementing all certificate OCR recognition functions through one module or interface, this method of separating the instruction call (or control) and instruction execution in the OCR recognition function can greatly improve the speed and efficiency of OCR recognition on the server. It can be understood that the optical character recognition interface can be implemented by using third-party OCR recognition interfaces with OCR recognition capabilities, such as Tencent's OCR recognition interface and Baidu AI interface.

[0097] Optionally, in order to improve the security of identity authentication, the optical character recognition interface can also identify whether the certificate image is a valid certificate photo. It can be understood that the recognition result of the certificate image not being a valid certificate photo (i.e., an invalid certificate photo) can be, but is not limited to: the uploaded certificate image is a non-certificate photo (such as a face image, an image of an item, etc.), or the uploaded certificate image is a fake certificate photo (such as a forged or counterfeited certificate photo), or the uploaded certificate image is an unrecognizable picture (such as the uploaded certificate image is blurred, or the format of the uploaded certificate image does not meet the recognition format requirements, etc.).

[0098] Optionally, if the certificate image is a second-generation ID card in China, the text information obtained by OCR recognition can be, but is not limited to, the user's name, gender, ethnicity, date of birth, address, citizen identity number, issuing authority, and expiration date; if the certificate image is a Hong Kong ID card, the text information obtained by OCR recognition can be, but is not limited to, the user's name, Chinese telegraph number of the name, date of birth, gender, issuing date, and ID card number; if the certificate image is a driver's license, the text information obtained by OCR recognition can be, but is not limited to, the user's name, gender, nationality, date of birth, address, citizen identity number, date of first obtaining the license, driving license type, effective start date, expiration date, file number, etc. It can be understood that if the certificate image is other certificate images (such as a residence permit image, a Hong Kong and Macao permit image, etc.), the text information obtained by OCR recognition can be adjusted accordingly according to the specific certificate type.

[0099] Step S402 can be further divided into the following steps S4021 - S4024:

[0100] S4021. The ID photo optical character recognition module of the server receives the unique identifier sent by the terminal.

[0101] In the embodiment of the present application, after the terminal uploads the ID photo image to the first service unit of the server for storage and obtains the unique identifier returned by the first service unit, it can send the unique identifier to the optical character recognition module of the server in the form of a request. After receiving the unique identifier, the optical character recognition module of the server will trigger an information invocation instruction to start the OCR recognition process. As mentioned above, the information invocation instruction includes a user information invocation instruction, an authentication information invocation instruction, and an interface invocation instruction.

[0102] S4022. The ID photo optical character recognition module of the server invokes the user information query module according to the authentication information invocation instruction to obtain user information and determine the user status.

[0103] Specifically, the ID photo optical character recognition module can query the basic information of the user, such as the user account information and status information (such as the status information of whether it is in a normal state), through the API interface to call the user information query module, so as to facilitate the ID photo optical character recognition module to obtain richer user information and timely detect abnormal states.

[0104] S4023. When the user status is in a normal state, the ID photo optical character recognition module of the server sends the unique identifier and the authentication information to the optical character recognition interface, so that the optical character recognition interface recognizes the ID photo image to obtain the recognition result of whether the ID photo image is a valid ID photo, the type of the ID photo image, and the text information of the ID photo image.

[0105] Specifically, the normal state means Figure 3 that the system is in a normal working state, that is, not in an abnormal state. It can be understood that the normal state can be but is not limited to: the state where the user's currently logged-in account and password are the same as those registered and belong to a legal login state, the state where the system is not under a security attack (such as a replay attack, etc.), the state where there is no packet loss in the information transmission and reception of each module in the system, the state where the authentication information is within the validity period, and so on.

[0106] S4024. The ID photo optical character recognition module of the server receives the recognition result, the type of the ID photo image, and the text information returned by the optical character recognition interface.

[0107] In the embodiment of the present application, after the user status is recognized as normal, as described above, the ID photo optical character recognition module can send the unique identifier and authentication information to the optical character recognition interface. When the authentication information is valid (i.e., having the permission to obtain the ID image), the optical character recognition interface obtains the ID image from the first service unit according to the unique identifier, and uses the OCR recognition algorithm to obtain the recognition result of whether the ID image is a valid ID photo, the type of the ID image, and the text information of the ID image, and returns them to the ID photo optical character recognition module.

[0108] S403. The ID photo optical character recognition module of the server checks the recognition result and the text information.

[0109] Different from the related art that does not review the filled text information or checks the filled text information through manual review, in the embodiment of the present application, the process of inspection and review is set in the ID photo optical character recognition module of the server, and the ID photo optical character recognition module automatically completes the inspection and review, improving the efficiency of inspection. At the same time, through the automatic inspection of the ID photo optical character recognition module, the occurrence of incorrect information filling is reduced, making it more accurate.

[0110] Optionally, step S403 can be checked according to the following three situations:

[0111] Situation 1: When it is determined according to the recognition result that the ID image is an invalid ID photo, the ID photo optical character recognition module of the server determines that the check fails and generates an error code to be returned to the terminal.

[0112] Specifically, the recognition result corresponding to the ID image being an invalid ID photo can be, but is not limited to: the uploaded ID image is not an ID photo (such as a face image, an image of an item, etc.), or the uploaded ID image is a fake ID photo (such as a forged or counterfeited ID photo), or the uploaded ID image is an unrecognizable picture (such as the uploaded ID image is blurred, the format of the uploaded ID image does not meet the recognition format requirements, etc.).

[0113] When the ID image is an invalid ID photo, the ID photo optical character recognition module directly determines that the check fails, and at this time, an error code (such as 00, etc.) will be returned to the terminal, prompting the terminal to re-upload the ID image.

[0114] Situation 2: When the ID image is a valid ID photo and the text information recognized by OCR does not meet the preset conditions, it is determined that the check fails, and a manual filling prompt message to be returned to the terminal is generated.

[0115] Specifically, the text information recognized by the OCR of the ID image not meeting the preset conditions includes, but is not limited to: the uploaded ID image is not a photo of an ID (such as a face image, an image of an item, etc.), or the uploaded ID image is a photo of a fake ID (such as a forged or counterfeited ID photo), or the uploaded ID image is an unrecognizable picture (such as the uploaded ID image is blurred, or the format of the uploaded ID image does not meet the recognition format requirements, etc.). The situation where the text information of the ID image does not meet the preset conditions is caused by the OCR being unable to recognize, the OCR recognition being incomplete, or the OCR recognition being inaccurate, etc. At this time, the ID photo optical character recognition module also determines that the check fails and returns a manual filling prompt message (such as a pop-up prompt message, a text prompt, etc.) to the terminal, prompting the user to manually fill in the corresponding personal user information.

[0116] Case 3: When the ID image is a valid ID photo and the text information recognized by the OCR meets the preset conditions, it is determined that the check passes, and step S404 is executed.

[0117] Specifically, the text information recognized by the OCR of the ID image meeting the preset conditions includes, but is not limited to: the text information is complete (such as the date of birth and month are complete), the content of the text information is correct (such as the date of birth is legal, for example, the year of birth is earlier than the current year), or the format of the text information is correct (such as the format of the date of birth is correct), etc. When the ID image is a valid ID photo and the text information of the ID meets the preset conditions, it indicates that the OCR recognition result of the server is correct or valid. At this time, the ID photo optical character recognition module sends the text information that passes the check and the type of the ID image to the terminal.

[0118] S404. The ID photo optical character recognition module of the server sends the type of the ID image and the text information that passes the check to the terminal, so that the terminal fills the text information that passes the check into the target position, where the target position matches the type of the ID image.

[0119] In the embodiment of the present application, after the check passes, the ID photo optical character recognition module sends the text information that passes the check in step S403 and the type of the ID image to the terminal. Then, the terminal adjusts the style, format, etc. of the target position according to the type of the ID image, so that the target position matches the type of the ID image; then, the terminal automatically fills the text information that passes the check into the target position (such as the text filling area corresponding to the ID image, etc., which can be preset in advance) to assist the user in subsequent operations such as identity authentication, saving the time for the user to manually fill in personal information.

[0120] Optionally, the target position matches the type of the certificate image, and can be but is not limited to: pre-establishing a target position template corresponding to each type of certificate, and after receiving the type of the certificate image from the server, the terminal then finds the corresponding target position template according to the type as the matching target position (i.e., the adjusted target position); or, pre-establishing a target position feature description corresponding to each type of certificate (the description content includes style, format, font, size), and after receiving the type of the certificate image from the server, the terminal then finds the corresponding target position feature description according to the type, and then generates a matching target position (i.e., the adjusted target position) according to the found target position feature description. Optionally, the target position feature description can adopt Scale Invariant Feature Transform (SIFT) descriptors, Speed Up Robust Features (SURF) descriptors, Histogram of Oriented Gradients (HOG) descriptors, etc.

[0121] It can be understood that assisting the user in subsequent operations such as identity authentication can be but is not limited to: the user modifies or confirms the text information and other content automatically filled in the target position, and the user submits the certificate image and the filled text information to the background or the server for review to complete the identity authentication.

[0122] As can be seen from the above content, after the server in the embodiment of the present application obtains the certificate image uploaded by the terminal, it calls the optical character recognition interface through the certificate photo optical character recognition module to recognize the certificate image, obtains the text information of the certificate image and returns it to the terminal, so that the terminal fills the text information into the target position. By using the OCR recognition technology of the server, the text information of the certificate is automatically recognized and the terminal automatically fills the text information into the target position, eliminating the need for the user to manually fill in all personal information, reducing the operation time and complexity of the user in identity authentication, and improving the user experience; the server triggers the information call instruction through the certificate photo optical character recognition module to trigger the control instruction, and executes the control instruction by recognizing the certificate image according to the interface call instruction through the optical character recognition interface, separating the triggering of the control instruction and the execution of the instruction in the text recognition function of the certificate image, further improving the text recognition efficiency of the certificate image; moving the inspection of the filled text information to the certificate photo optical character recognition module of the server can automatically check the result of optical character recognition, reducing the occurrence of information filling errors and being more accurate; the server recognizes the type of the certificate image and sends it to the terminal, enabling the terminal to automatically match the corresponding target position according to the type, and being able to automatically adjust the format, style, etc. of the target position according to the types of different certificates, facilitating user operation. In addition, for the solution of the embodiment of the present application, the terminal only needs to have the function of photographing and uploading the certificate, and the recognition and acquisition of the text information of the certificate are implemented by the server, which can greatly reduce the requirements for the terminal configuration (such as the occupied memory) of the deployed terminal and improve the user experience.

[0123] Based on the description of the above embodiment of the identity authentication information filling system, an embodiment of the present invention provides an identity authentication information filling method, which can be applied to Figures 1 - 3 the identity authentication information filling system shown, and specifically can be executed by Figures 1 - 3 the terminal shown. Please refer to Figure 5 , and the identity authentication information filling method may include the following steps S501 - S502:

[0124] S501. The terminal displays a first user interface, where the first user interface displays an image upload button for the certificate image.

[0125] S502. In response to the identity authentication instruction, the terminal displays a second user interface, where the second user interface displays an image display frame and a text information filling area. The certificate image uploaded is displayed in the image display frame, and the text information filled in the text information filling area is obtained through Figure 4 the identity authentication information filling method shown.

[0126] In the embodiments of the present application, the identity authentication instruction may be triggered after the user clicks an identity authentication button or control, or may be triggered after the user selects it from a drop-down menu. The present application does not make specific limitations on this.

[0127] Specifically, the certificate may be an identity card, a driver's license, a residence permit, a Hong Kong and Macao permit, an officer's certificate, a home return permit, a social security card, a medical insurance card, etc., which can represent the user's identity.

[0128] Optionally, the front end 301 may be an application or a small program (such as a WeChat small program) installed on the terminal, and the application or the small program has an identity authentication function. After the application or the small program is started, it will enter Figure 6 the identity authentication interface shown. Figure 6 The upper side of the interface shown has the text description of the "identity authentication" function and the text of "return" to the application or the small program and the corresponding return control ( Figure 6 the return arrow in it). The middle part of the interface is provided with an information display box 601 for displaying the associated information of the identity authentication. Exemplarily, if the application scenario is a financial payment scenario, the information display box 601 may display the user's current available payment limit (such as 10,000 yuan), the newly obtained rights and interests after successful identity authentication (such as the increase in the available payment limit, etc.). The bottom of the interface is provided with an identity authentication button 602 of "upgrade to a certified user". Clicking this identity authentication button can trigger the identity authentication instruction to enter Figure 7 the first user interface shown. The function description area 701 of the application interface is displayed on the first user interface. The function description area 701 uses the text "Please select your nationality and upload a photo of your certificate" to describe that the function of the application interface is to select the nationality and upload the photo of the certificate. The rectangular area where the words "Hong Kong, China" are located on the right side of the text "Nationality / Region" below the function description area 701 is the display area of the nationality / region, which can be used for the user to replace the displayed content (nationality / region) through the replacement cursor or control on the rightmost side. 702 on the first user interface is the image upload button for the certificate image. After this button 702 is triggered by the user's click, the certificate image (such as Figure 7 the front photo of the Hong Kong identity card in it) can be uploaded to the server: If the certificate image of the user is pre-stored in the local database of the terminal, it can be directly uploaded to the server through the button 502 and the certificate image to be uploaded can be previewed in the preview area 703; if the certificate image of the user is not pre-stored in the local database of the terminal, the camera of the terminal where the terminal is located can be called through the certificate shooting button (such as Figure 7 the ID card shooting button in it) 704 to capture the user's certificate image in real time. During the shooting process, the captured certificate image can be previewed through the preview area 703 to obtain a clear and complete certificate image. After shooting, the user can click the image upload button 702 to upload the certificate image captured in real time. Figure 7After the upload of the ID image is completed, you can enter Figure 8 the second user interface shown in Figure 8 . On the basis of the first display interface, the second user interface adds an image re-upload button 801, a text filling area 802, and a confirmation and submission button 803. Clicking the image re-upload button 801 will trigger a re-upload instruction to re-obtain the uploaded ID image and display it in the image display frame (i.e., Figure 7 the preview area 703 of Figure 7 ). Exemplarily, if the ID is an ID card, the text filling area 802 is the personal information filling area corresponding to the user's ID card, used to fill in text information such as name, gender, date of birth, and ID number. The text information in the text filling area 602 can be obtained through Figure 4 the identity authentication information filling method shown in Figure 4 . Figure 9 Figure Figure 9 shows the interface diagram after the text information on the ID card is obtained through Figure 4 the identity authentication information filling method shown in Figure 4 and automatically filled in the corresponding positions in the text filling area 802. After the text filling area 802 is automatically filled with the text information recognized by the server OCR, the user can review and modify the text information in the text filling area 802. When the text information in the text filling area 802 is filled correctly and the ID image displayed in the preview area is correct, the ID image and the filled text information can be submitted through Figure 8 , Figure 9 the confirmation and submission button 803 of Figure 9 . Therefore, in a possible implementation manner, the identity authentication information filling method of the terminal may further include at least one of the following steps:

[0129] Modify the text information recognized by OCR in the text information filling area 802;

[0130] Or, in response to the re-upload instruction of the image re-upload button 801, re-obtain the uploaded ID image and display it in the image display frame;

[0131] Or, when the text information in the text information filling area 802 is filled correctly and the ID image displayed in the image display frame is correct, in response to the submission instruction of the confirmation and submission button 803, submit the ID image and the filled text information.

[0132] To further improve the security and reliability of identity authentication, the embodiment of the present application can also perform mobile phone verification code verification through Figure 10 the third user interface shown in Figure 10 . As shown in Figure 10 Figure 10 , the user can enter the mobile phone number (usually 8 or 11 digits) in the mobile phone number filling box with the prompt text "Please fill in the mobile phone number", and then click the mobile phone verification code sending button with the display text "Send verification code" to send the mobile phone verification code to the user's mobile phone in the form of a text message, etc. Then the third user interface becomes Figure 11In the interface shown, the user can fill in the mobile verification code received on the mobile phone in the mobile verification code input box that displays "Please enter the verification code" (which can be a combination of numbers, letters, etc.). After filling in the mobile verification code and confirming that it is correct, the user can click the submit button that displays the text "Confirm and submit" to submit the mobile verification code.

[0133] As can be seen from the above, the terminal in the embodiment of the present application executes Figure 6 、 Figure 7 、 Figure 8 、 Figure 10 and Figure 11 in the relatively simple human-computer interaction operations to implement the user identity authentication function. In addition, the embodiment of the present application can also use Figure 4 the embodiment of the server identity authentication information filling method shown to automatically obtain Figure 9 the interface of the user personal information corresponding to the filled-in document image shown, and also has Figure 4 the functions and beneficial effects to be achieved by the embodiment of the server identity authentication information filling method shown.

[0134] Based on the description of the embodiment of the above identity authentication information filling system, the embodiment of the present application provides an identity authentication information filling method, which can be applied to Figures 1 - 3 the identity authentication information filling system shown, and specifically can be interactively executed by Figures 1 - 3 the front end 301 and the server unit 302 shown. Please refer to Figure 12 , the identity authentication information filling method may include the following steps S1201-S1205:

[0135] S1201. The terminal obtains a document image and uploads the document image to the server.

[0136] Specifically, the document can be an identity card, a driving license, a residence permit, a Hong Kong and Macau permit, an officer's certificate, a homecoming permit, a social security card, a medical insurance card, etc. that can represent the user's identity. The document image can be the front image of the document, the back image of the document, or can also include both the front image and the back image of the document. The present application does not make specific limitations on this.

[0137] Optionally, the document image obtained and uploaded by the terminal can be a document image pre-shot and stored by the terminal, or a document image shot in real time by the terminal.

[0138] In the embodiments of the present application, after receiving the certificate image uploaded by the terminal, the server may store the certificate image in the first service unit, generate a unique identifier for the certificate image, and return it to the terminal. The unique identifier of the certificate image is used to uniquely (globally) identify the certificate image, facilitating the subsequent optical character recognition interface to retrieve the corresponding certificate image from the first service unit through the unique identifier. Optionally, the unique identifier of the certificate image can be a combination of numbers, letters, symbols, etc. Exemplarily, if the first service unit is a WeChat server, the unique identifier of the certificate image can be mediaID.

[0139] Taking the terminal as a mobile phone, the front-end 301 as the WeChat client deployed on the mobile phone, and the first service unit as the WeChat server as an example, Access_token can be used to call the WeChat client to activate the camera of the user's mobile phone, capture the user's certificate image and upload it to the WeChat server. After receiving the certificate image, the WeChat server will return the corresponding mediaID to the terminal.

[0140] S1202. The certificate photo optical character recognition module of the server calls the optical character recognition interface to recognize the uploaded certificate image, and obtains the recognition result of whether the certificate image is a valid certificate photo, the type of the certificate image, and the text information of the certificate image.

[0141] For the specific implementation process of step S1202, please refer to the description part of the previous step S402, which will not be elaborated here.

[0142] S1203. The certificate photo optical character recognition module checks the obtained recognition result and text information.

[0143] For the specific implementation process of step S1203, please refer to the description part of the previous step S403, which will not be elaborated here.

[0144] S1204. The certificate photo optical character recognition module sends the type of the certificate image and the text information that passes the check to the terminal.

[0145] S1205. The terminal fills the text information that passes the check into the target position, where the target position matches the type of the certificate image.

[0146] In the embodiments of the present application, after passing the check, the certificate photo optical character recognition module sends the type of the certificate image and the text information that passes the check in step S1203 to the terminal. Then, the terminal adjusts the style, format, etc. of the target position according to the type of the certificate image, so that the target position matches the type of the certificate image. Next, the terminal automatically fills the text information that passes the check into the target position (such as the text filling area corresponding to the certificate image, which can be set in advance), to assist the user in subsequent operations such as identity authentication, saving the time for the user to manually fill in personal information.

[0147] Optionally, the target position matches the type of the certificate image, and can be but is not limited to: pre-establishing a target position template corresponding to each type of certificate, and after receiving the type of the certificate image from the server, the terminal then finds the corresponding target position template according to this type as the matching target position (i.e., the adjusted target position); or, pre-establishing a target position feature description corresponding to each type of certificate (the description content includes style, format, font, size), and after receiving the type of the certificate image from the server, the terminal then finds the corresponding target position feature description according to this type, and then generates a matching target position (i.e., the adjusted target position) according to the found target position feature description. Optionally, the target position feature description can adopt Scale Invariant Feature Transform (SIFT) descriptors, Speed Up Robust Features (SURF) descriptors, Histogram of Oriented Gradients (HOG) descriptors, and so on.

[0148] It can be understood that assisting the user in subsequent operations such as identity authentication can be but is not limited to: the user modifies or confirms the text information and other content automatically filled in the target position, and the user submits the certificate image and the filled-in text information to the background or the server for review to complete the identity authentication.

[0149] As can be seen from the above content, after the terminal of the embodiment of the present application uploads the user's ID image to the server, the server calls the optical character recognition interface through the ID photo optical character recognition module to recognize the ID image, obtains the text information of the ID image and returns it to the terminal, and the terminal fills in the text information to the target location, using the server's OCR recognition technology to automatically recognize the text information of the ID and automatically fill it in the target location, so that the user no longer needs to manually fill in all personal information, reducing the user's operation time and complexity in identity authentication and improving the user experience; the server triggers the information call instruction through the ID photo optical character recognition module to realize the triggering of the control instruction, and the optical character recognition module triggers the information call instruction through the optical character recognition module to realize the triggering of the control instruction. The interface recognizes the document image according to the interface call instruction to realize the execution of the control instruction, and divides the triggering of the control instruction and the execution of the instruction in the document image text recognition function into two, further improving the text recognition efficiency of the document image; the check of the filled-in text information is moved to the document photo optical character recognition module of the server, which can automatically check the results of the optical character recognition, reduce the occurrence of information filling errors, and be more accurate; the server recognizes the type of the document image and sends it to the terminal, and the terminal can automatically match the corresponding target location according to the type, and can automatically adjust the format, style and other contents of the target location according to the type of different documents, which is convenient for user operation. In addition, the terminal of the solution embodiment of the present application only needs to have the function of shooting and uploading the document photo, and the text information recognition of the document is realized by the server, which can greatly reduce the terminal configuration requirements (such as the memory occupied) for the deployed terminal and improve the user experience.

[0150] Taking the Hong Kong Identity Card as an example, application Figure 12 The implementation process of payment identity authentication by the method includes the following steps:

[0151] Step 1: The front end initiates an identity request and starts the identity authentication process.

[0152] Step 2: Automatically fill in the personal information for identity authentication through the identity authentication information filling method of the embodiment of the present application.

[0153] Step 2 can be further divided into the following steps (a)-(d):

[0154] (a) Upload the Hong Kong ID card photo as the ID card image to the server through the front end;

[0155] (b) The ID photo optical character recognition module of the server determines whether the uploaded Hong Kong ID card photo is available. If so, step (c) is executed; otherwise, step (a) is returned to re-upload the Hong Kong ID card photo;

[0156] (c) The ID photo optical character recognition module calls the optical character recognition to recognize and check the text information of the ID card image, and then returns the text information that passes the check to the front end. The front end automatically fills in the target position with the text information;

[0157] (d) The user reviews, modifies, and confirms the automatically filled text information through the front end to obtain the personal information of the ID card;

[0158] Step 3: Verify the user's mobile phone number;

[0159] Step 4: Submit the identity authentication image, personal information, and mobile phone number as identity authentication materials.

[0160] Taking the front end as a WeChat mini-program deployed on a mobile phone, the first service unit as the WeChat server, and the second service unit as including the ID photo optical character recognition module ewallet_cdd_idcard_ocr.cgi, the user information query module ia_ui_quer_userinfo_service, the authentication information acquisition module ia_query_addjsapiticket_service, and the OCR recognition interface of the optical character recognition interface implemented using Node.js as the back-end development platform as an example, as Figure 11 shown, the corresponding interaction process of the above Step 2 is as follows:

[0161] (1) The front end uses the Access_token to call the js sdk interface of the WeChat client, pulls up the native camera of the user's mobile phone, and enables the user to take a photo of the Hong Kong ID card and upload it to the WeChat server;

[0162] (2) The WeChat server returns the mediaID to the front end, which is used to uniquely identify the ID card photo uploaded by the user;

[0163] (3) The front end calls the back-end ewallet_cdd_idcard_ocr.cgi module and passes in the mediaID returned by the WeChat server;

[0164] (4) The ewallet_cdd_idcard_ocr.cgi module calls the service of the background ia_ui_quer_userinfo_service module to query the user account information and determine whether the user status is normal;

[0165] (5) The service of the ia_ui_quer_userinfo_service module returns the user information;

[0166] (6) The ewallet_cdd_idcard_ocr.cgi module calls the service of the ia_query_addjsapiticket_service module to obtain the latest Access_token information;

[0167] (7) The service of the ia_query_addjsapiticket_service module returns the Access_token information;

[0168] (8) Call the underlying OCR recognition interface, and pass in the Acess_token and the mediaID corresponding to the photo;

[0169] (9) Return the OCR recognition result and the basic information on the ID photo uploaded by the user;

[0170] (10) Check whether the information recognized by OCR is complete and in the correct format;

[0171] (11) If the recognized photo is a valid ID photo and the OCR information is completely recognized, return the OCR information to the front end and automatically fill it in the target position to assist the user in filling; if the recognized photo is a valid ID photo but the OCR information is incomplete, then degrade, do not fill back the user information, and provide prompt information to guide the user to fill in by themselves;

[0172] (12) If the OCR recognizes that the photo is an invalid ID photo (including but not limited to non-ID photos, fake photos, unrecognizable pictures, etc.), then return an error code to the front end to guide the user to re-upload the correct ID photo.

[0173] As Figure 14 shown, an identity authentication information filling device is further provided in an embodiment of the present application, which is applied to a server and includes:

[0174] An image acquisition module 1401, configured to acquire an ID image;

[0175] A recognition module 1402, configured to recognize the ID image by calling an optical character recognition interface through an ID photo optical character recognition module, where the ID photo optical character recognition module is used to trigger an information call instruction, and the information call instruction includes an interface call instruction; the optical character recognition interface recognizes the ID image according to the interface call instruction to obtain the recognition result of whether the ID image is a valid ID photo, the type of the ID image, and the text information of the ID image;

[0176] An inspection module 1403, configured to inspect the recognition result and the text information of the ID image through the ID photo optical character recognition module;

[0177] An identification result sending module 1404, configured to send the type of the certificate image and the text information passed the check to a terminal through an optical character recognition module for certificate photos, so that the terminal fills the text information passed the check into a target position, where the target position matches the type of the certificate image.

[0178] Figure 4 The content in the filling method embodiments shown is applicable to the embodiments of this identity authentication information filling device. The functions specifically implemented by the embodiments of this identity authentication information filling device are the same as those of Figure 4 the filling method embodiments shown, and the beneficial effects achieved are the same as those of Figure 4 the filling method embodiments shown.

[0179] As Figure 15 shown, an embodiment of this application further provides an identity authentication information filling device, which is applied to a terminal and includes:

[0180] A first user interface display module 1501, configured to display a first user interface of the terminal, where a certificate image upload box is displayed on the first user interface;

[0181] A second user interface display module 1502, configured to display a second user interface of the terminal in response to an identity authentication instruction, where an image display box and a text information filling area are displayed on the second user interface, the uploaded certificate image is displayed in the image display box, and the text information of the certificate image filled in the text information filling area is obtained through the Figure 4 method shown.

[0182] Figure 5 The content in the filling method embodiments shown is applicable to the embodiments of this identity authentication information filling device. The functions specifically implemented by the embodiments of this identity authentication information filling device are the same as those of Figure 5 the filling method embodiments shown, and the beneficial effects achieved are the same as those of Figure 5 the filling method embodiments shown.

[0183] As Figure 16 shown, an embodiment of this application further provides a computer device, including:

[0184] At least one processor 1601;

[0185] At least one memory 1602, configured to store at least one program;

[0186] When the at least one program is executed by the at least one processor, the at least one processor implements Figure 4 or Figure 5 the method shown.

[0187] Figure 4 or Figure 5 The content in the filling method embodiments shown above is applicable to the computer device embodiments of the present application. The functions specifically implemented by the computer device embodiments are the same as those of Figure 4 or Figure 5 the filling method embodiments shown above, and the beneficial effects achieved are the same as those of Figure 4 or Figure 5 the beneficial effects achieved by the filling method embodiments shown above.

[0188] The embodiments of the present application also provide a computer-readable storage medium, in which a program executable by a processor is stored. The program executable by the processor, when executed by the processor, is used to implement Figure 4 or Figure 5 the method shown above.

[0189] Figure 4 or Figure 5 The content in the filling method embodiments shown above is applicable to the computer-readable storage medium embodiments of the present application. The functions specifically implemented by the computer-readable storage medium embodiments are the same as those of Figure 4 or Figure 5 the filling method embodiments shown above, and the beneficial effects achieved are the same as those of Figure 4 or Figure 5 the beneficial effects achieved by the filling method embodiments shown above.

[0190] The embodiments of the present application also disclose a computer program product or a computer program. The computer program product or the computer program includes computer instructions, and the computer instructions are stored in a computer-readable storage medium. The processor of the computer device can read the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes Figure 4 or Figure 5 the method shown above.

[0191] It is understandable that all or some of the steps and systems disclosed in the above methods can be implemented as software, firmware, hardware, and their appropriate combinations. Some physical components or all physical components can be implemented as software executed by a processor, such as a central processing unit, a digital signal processor, or a microprocessor, or implemented as hardware, or implemented as an integrated circuit, such as an application-specific integrated circuit. Such software can be distributed on a computer-readable medium, which can include a computer storage medium (or non-transitory medium) and a communication medium (or transitory medium). As is well known to those of ordinary skill in the art, the term computer storage medium includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information, such as computer-readable instructions, data structures, program modules, or other data. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technologies, CD-ROM, digital versatile disk (DVD) or other optical disk storage, magnetic cassettes, tapes, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to store the desired information and can be accessed by a computer. In addition, as is well known to those of ordinary skill in the art, communication media typically includes computer-readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transmission mechanism, and can include any information delivery medium.

[0192] The embodiments of the present application have been described in detail above in conjunction with the accompanying drawings. However, the present application is not limited to the above embodiments. Within the scope of knowledge possessed by those of ordinary skill in the art, various changes can be made without departing from the purpose of the present application.

Claims

1. A method for filling in identity authentication information, characterized in that, It includes the following steps: Obtain a certificate image; Receive, through the certificate photo optical character recognition module, the unique identifier of the certificate image sent by the terminal; wherein, the unique identifier is generated after the first service unit receives and stores the certificate image uploaded by the terminal, and the certificate photo optical character recognition module is used to trigger an information invocation instruction, and the information invocation instruction includes an interface invocation instruction, an authentication information invocation instruction, and a user information invocation instruction; Through the certificate photo optical character recognition module, call the user information query module according to the user information invocation instruction to obtain user information and determine the user status; when the user status is normal, send the unique identifier and authentication information to the optical character recognition interface through the certificate photo optical character recognition module, so that the optical character recognition interface recognizes the certificate image according to the interface invocation instruction, and obtain the recognition result of whether the certificate image is a valid certificate photo, the type of the certificate image, and the text information of the certificate image; receive, through the certificate photo optical character recognition module, the recognition result, the type, and the text information returned by the optical character recognition interface; wherein, the authentication information is obtained by the certificate photo optical character recognition module calling the authentication information acquisition module according to the authentication information invocation instruction; Check the recognition result and the text information through the certificate photo optical character recognition module; Send the type and the text information that passes the check to the terminal through the certificate photo optical character recognition module, so that the terminal fills the text information that passes the check into the target position, and the target position matches the type.

2. The method for filling in identity authentication information according to claim 1, characterized in that, The obtaining of the certificate image includes: Receive and store the certificate image uploaded by the terminal through the first service unit, generate the unique identifier of the certificate image and return it to the terminal; Call the authentication information acquisition module to obtain authentication information through the certificate photo optical character recognition module according to the authentication information invocation instruction; Obtain the certificate image from the first service unit through the optical character recognition interface according to the unique identifier and the authentication information.

3. The method for filling in identity authentication information according to claim 1, characterized in that, The checking of the recognition result and the text information through the certificate photo optical character recognition module includes: When the certificate image is an invalid certificate photo, determine that the check fails and generate an error code returned to the terminal; Or, when the certificate image is a valid certificate photo and the text information does not meet the preset conditions, determine that the check fails and generate a manual filling prompt information returned to the terminal; Or, when the certificate image is a valid certificate photo and the text information meets the preset conditions, determine that the check passes, and execute the step of sending the type and the text information that passes the check to the terminal through the certificate photo optical character recognition module, so that the terminal fills the text information that passes the check into the target position; Wherein, the preset conditions include at least one of the text information being complete, the content of the text information being correct, or the format of the text information being correct.

4. A method for filling in identity authentication information, characterized in that, It includes the following steps: The first user interface of the display terminal, and an image upload button for the document image is displayed on the first user interface; In response to the identity authentication instruction, the second user interface of the terminal is displayed. The second user interface displays an image display frame and a text information filling area. The document image is displayed in the image display frame, and the text information filled in the text information filling area is obtained by the method according to any one of claims 1-3.

5. The method for filling in identity authentication information according to claim 4, characterized in that, The second user interface also displays an image retransmission button and a confirmation submission button. The identity authentication information filling method further includes at least one of the following steps: Modify the text information in the text information filling area; Or, in response to the retransmission instruction of the image retransmission button, re-obtain the uploaded document image and display it in the image display frame; Or, when the text information filled in the text information filling area is correct and the document image displayed in the image display frame is correct, in response to the submission instruction of the confirmation submission button, submit the text information and the document image.

6. The method for filling in identity authentication information according to claim 4, characterized in that, The identity authentication information filling method further includes the following steps: In response to the identity authentication instruction, the third user interface of the terminal is displayed. The third user interface displays a mobile phone number filling box, a mobile phone verification code sending button, and a mobile phone verification code input box.

7. A method for filling in identity authentication information, characterized in that, It includes the following steps: The terminal obtains a document image and uploads the document image to the server; The document photo optical character recognition module of the server receives the unique identifier of the document image sent by the terminal; wherein, the unique identifier is generated after the first service unit of the server receives and stores the document image uploaded by the terminal. The document photo optical character recognition module is used to trigger an information invocation instruction, and the information invocation instruction includes an interface invocation instruction, an authentication information invocation instruction, and a user information invocation instruction; The document photo optical character recognition module invokes the user information query module of the server according to the user information invocation instruction to obtain user information and determine the user status; when the user status is normal, the unique identifier and authentication information are sent to the optical character recognition interface of the server through the document photo optical character recognition module, so that the optical character recognition interface recognizes the document image according to the interface invocation instruction, and obtains the recognition result of whether the document image is a valid document photo, the type of the document image, and the text information of the document image; the document photo optical character recognition module receives the recognition result, the type, and the text information returned by the optical character recognition interface; wherein, the authentication information is obtained by the document photo optical character recognition module invoking the authentication information acquisition module of the server according to the authentication information invocation instruction; The document photo optical character recognition module checks the recognition result and the text information; The document photo optical character recognition module sends the type and the text information that pass the check to the terminal; The terminal fills the text information that passes the check into the target position, and the target position matches the type.

8. An identity authentication information filling device, characterized in that, It includes: An image acquisition module for acquiring a document image; An identification module for receiving, through a document photo optical character recognition module, a unique identifier of the document image sent by a terminal; wherein the unique identifier is generated after the first service unit receives and stores the document image uploaded by the terminal, and the document photo optical character recognition module is used to trigger information invocation instructions, and the information invocation instructions include an interface invocation instruction, an authentication information invocation instruction, and a user information invocation instruction; The identification module is further configured to, through the document photo optical character recognition module, call a user information query module according to the user information invocation instruction to obtain user information and determine the user status; when the user status is a normal status, send the unique identifier and authentication information to an optical character recognition interface through the document photo optical character recognition module, so that the optical character recognition interface recognizes the document image according to the interface invocation instruction to obtain an identification result as to whether the document image is a valid document photo, the type of the document image, and the text information of the document image; receive, through the document photo optical character recognition module, the identification result, the type, and the text information returned by the optical character recognition interface; wherein the authentication information is obtained by the document photo optical character recognition module calling an authentication information acquisition module according to the authentication information invocation instruction; An inspection module for inspecting the identification result and the text information through the document photo optical character recognition module; An identification result sending module for sending, through the document photo optical character recognition module, the type and the text information that passes the inspection to the terminal, so that the terminal fills the text information that passes the inspection into a target position, and the target position matches the type.

9. An identity authentication information filling device, characterized in that, Including: A first user interface display module for displaying a first user interface of the terminal, and an image upload box for the document image is displayed on the first user interface; A second user interface display module for, in response to an identity authentication instruction, displaying a second user interface of the terminal, an image display box and a text information filling area are displayed on the second user interface, the uploaded document image is displayed in the image display box, and the text information of the document image filled in the text information filling area is obtained by the method according to any one of claims 1-3.

10. An identity authentication information filling system, characterized in that, Including a terminal and a server, The terminal is configured to acquire a document image and upload the document image to the server; The server includes a first service unit, a document photo optical character recognition module, and an optical character recognition interface; The document photo optical character recognition module is configured to receive a unique identifier of the document image sent by the terminal; wherein the unique identifier is generated after the first service unit receives and stores the document image uploaded by the terminal, and the document photo optical character recognition module is further configured to trigger information invocation instructions, and the information invocation instructions include an interface invocation instruction, an authentication information invocation instruction, and a user information invocation instruction; The ID photo optical character recognition module is further configured to call the user information query module according to the user information call instruction to obtain user information and determine the user status; when the user status is the normal status, the unique identifier and the authentication information are sent to the optical character recognition interface through the ID photo optical character recognition module; wherein, the authentication information is obtained by the ID photo optical character recognition module calling the authentication information acquisition module according to the authentication information call instruction; The optical character recognition interface is configured to recognize the ID image according to the interface call instruction, and obtain the recognition result of whether the ID image is a valid ID photo, the type of the ID image, and the text information of the ID image; The ID photo optical character recognition module is further configured to receive the recognition result, the type, and the text information returned by the optical character recognition interface; The ID photo optical character recognition module is further configured to check the recognition result and the text information, and send the type and the text information that pass the check to the terminal; The terminal is further configured to fill the text information that passes the check into a target position, and the target position matches the type.

11. A computer device, characterized in that, Comprising: At least one processor; At least one memory for storing at least one program; When the at least one program is executed by the at least one processor, the at least one processor implements the method according to any one of claims 1-6.

12. A computer-readable storage medium storing a program executable by a processor, characterized in that, The program executable by the processor, when executed by the processor, is used to implement the method according to any one of claims 1-6.

Citation Information

Patent Citations

  • Information collection method and terminal of identity document

    CN106022330A

  • OCR-based certificate information input method and related device

    CN110728272A