Application form filling method and device, electronic equipment and computer storage medium

Abstract

The embodiment of the invention provides an application form filling method and device, electronic equipment and a computer storage medium. The application form filling method comprises the steps of obtaining to-be-identified information; inputting the to-be-identified information into an identification model to obtain to-be-filled information output by the identification model; and filling an application form according to the to-be-filled information. According to the application form filling method provided by the embodiment of the invention, the to-be-filled information can be obtained by identifying the to-be-identified information without manually inputting characters to fill the application form, so that the filling efficiency of the application form can be improved.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of data processing technology, and in particular to a method, device, electronic device and computer storage medium for filling out an application form. Background Art

[0002] With the upgrading of the domestic consumer market, there has been a surge in outbound travel in recent years. A visa is a permit that allows entry. Tourists who want to enter a country generally need to apply for a visa for that country. Visas can be applied for online through electronic devices such as mobile phones and computers, or manually offline.

[0003] Currently, when applying for a visa online through an electronic device, one manually enters text to fill out an application form, and then applies for a visa online through the filled-in application form.

[0004] However, when manually filling out an application form online, users need to enter personal information, work experience and other information. This requires a lot of text to be entered, which takes a long time and results in a poor user experience. Summary of the invention

[0005] In view of this, embodiments of the present application provide an application form filling method, device, electronic device and computer storage medium to at least partially solve the above problems.

[0006] According to a first aspect of an embodiment of the present application, a method for filling out an application form is provided, comprising: obtaining information to be identified; inputting the information to be identified into a recognition model to obtain information to be filled out output by the recognition model; and filling out an application form according to the information to be filled out.

[0007] In a possible implementation manner, the information to be identified includes: at least one of image information, table information and voice information.

[0008] In a possible implementation, obtaining the information to be identified includes: calling an image acquisition unit to acquire image information in response to an image acquisition instruction, acquiring uploaded table information or image information in response to a file upload instruction, and calling a voice acquisition unit to acquire voice information in response to a recording instruction.

[0009] In a possible implementation, the step of inputting the information to be identified into a recognition model to obtain the information to be filled in output by the recognition model includes: inputting the information to be identified and prompt words corresponding to the application form into the recognition model to obtain the information to be filled in output by the recognition model.

[0010] In one possible implementation, the method further includes: displaying the filled-in application form; if confirmation information is received, the application form is completed; if modification information is received, modifying at least part of the application form according to the modification information, and displaying the modified application form until the confirmation information is obtained.

[0011] In a possible implementation, modifying at least a portion of the application form according to the modification information includes: modifying at least a portion of the application form according to the modification information in text format input by the user; or, inputting the modification information and the prompt word into the recognition model, obtaining the modification information to be filled in output by the recognition model, and modifying at least a portion of the application form according to the modification information to be filled in, wherein the modification information includes image information, form information,

[0012] [HZTC-HXJKJD241015][HS2411247CCN] At least one of information and voice information.

[0013] According to the second aspect of an embodiment of the present application, a device for filling out an application form is provided, comprising: an acquisition unit for acquiring information to be identified; an input unit for inputting the information to be identified into a recognition model to obtain information to be filled out output by the recognition model; and a writing unit for filling out an application form according to the information to be filled out.

[0014] According to a third aspect of an embodiment of the present application, there is provided an electronic device, comprising: a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface communicate with each other via the communication bus; the memory is used to store at least one executable instruction, and the executable instruction enables the processor to perform an operation corresponding to the method described in the first aspect.

[0015] According to a fourth aspect of an embodiment of the present application, a computer storage medium is provided, on which a computer program is stored. When the program is executed by a processor, the method described in the first aspect is implemented.

[0016] According to a fifth aspect of an embodiment of the present application, a computer program product is provided, comprising computer instructions, wherein the computer instructions instruct a computing device to execute the method as described in the first aspect.

[0017] According to the application form filling scheme provided in the embodiment of the present application, the information to be identified is obtained, the information to be identified is input into the recognition model, the information to be filled in is obtained, and the application form is filled in according to the information to be filled in, thereby completing the filling in of the application form. Since the user directly inputs the information to be identified into the system, the system can identify the information to be filled in according to the information to be identified. Therefore, when filling in the application form, the user does not need to enter each item of the application form in text. Compared with the prior art, the time required to fill in the application form can be reduced, and the user experience can be improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in the embodiments of the present application. For ordinary technicians in this field, other drawings can also be obtained based on these drawings.

[0019] Figure 1 It is a flow chart of a method for filling out an application form provided in an embodiment of the present application;

[0020] Figure 2 It is a schematic diagram of an application form filling device provided in an embodiment of the present application;

[0021] Figure 3 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0022] In order to enable those skilled in the art to better understand the technical solutions in the embodiments of the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the embodiments of the present application should fall within the scope of protection of the embodiments of the present application.

[0023] The terms used in this application are for the purpose of describing specific embodiments only and are not intended to limit the present application. The singular forms "a", "an", "said", and "the" used in this application and the appended claims are also intended to include the plural forms, unless the context clearly indicates otherwise. It should also be understood that the terms "and / or" used herein are not intended to limit the present application.

[0024] [HZTC-HXJKJD241015][HS2411247CCN] refers to and includes any or all possible combinations of one or more of the associated listed items.

[0025] It should be understood that although the terms first, second, third, etc. may be used in the present application to describe various information, these information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of the present application, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the word "if" as used herein may be interpreted as "at the time of" or "when" or "in response to determining".

[0026] Figure 1 is a flow chart of a method for filling out an application form provided in an embodiment of the present application, such as Figure 1 As shown, the method for filling in the application form includes the following steps 101 to 103:

[0027] Step 101: Obtain information to be identified.

[0028] The information to be identified input or uploaded by the user is obtained. The information to be identified may be in various formats, such as a captured image.

[0029] Step 102: input the information to be identified into the identification model to obtain the information to be filled in output by the identification model.

[0030] The information to be recognized is input into the recognition model. The recognition model can recognize the information to be recognized and output the information to be filled in included in the information to be recognized. The information to be filled in can be information in JSON format. For example, when the information to be recognized is an image, the recognition model can be used to perform optical character recognition (OCR) on the image to obtain the information to be filled in the image.

[0031] Step 103: Fill in the application form according to the information to be filled in.

[0032] Fill in the information to be filled in output by the recognition model into the corresponding position of the application form. For example, fill in the name, gender, nationality and other information output by the recognition model into the corresponding position of the application form. In one example, the application form can be a visa application form, and the specific application form type is not limited.

[0033] In an embodiment of the present application, information to be identified is obtained, input into a recognition model, information to be filled in is obtained, and an application form is filled in according to the information to be filled in, thereby completing the filling in of the application form. Since the user directly inputs the information to be identified into the system, the system can identify the information to be filled in according to the information to be identified. Therefore, when filling in the application form, the user does not need to enter each item of the application form in text. Compared with the prior art, the time required to fill in the application form can be reduced, thereby improving the user experience.

[0034] In a possible implementation manner, the information to be recognized includes at least one of image information, table information, and voice information.

[0035] The information to be identified may be information in image format, such as ID card photos, passport photos, etc., or may be handwritten information, such as manually writing information on paper and obtaining image information of the paper, etc. The information to be identified may also be table information, such as a table in Excel format, which may include travel information, work experience, etc. The information to be identified may also include voice information, for example, obtaining voice information dictated by the user, obtaining recording files uploaded by the user, etc.

[0036] When the information to be recognized is image information, the recognition model can perform image recognition on the input image information, for example, perform OCR recognition on the image information to determine the information to be filled in the image information. For Excel format tables, the recognition model can parse Excel format tables, for example, parse the work experience in the Excel table to obtain the company name, position, working hours and other information to be filled in. For voice information, it can be converted into

[0037] [HZTC-HXJKJD241015][HS2411247CCN] text information, and then extract the information to be filled in.

[0038] In an embodiment of the present application, the information to be recognized includes at least one of image information, form information and voice information. The user can upload the information to be recognized as needed, and the recognition model can recognize and obtain the information to be filled in based on at least one of the image information, form information and voice information. Therefore, the user only needs to upload the information to be recognized to obtain the information to be filled in, without manually entering text information, which can improve the efficiency of filling out the application form.

[0039] In a possible implementation, when acquiring the information to be identified, at least one of the following can be achieved: calling an image acquisition unit to acquire image information in response to an image acquisition instruction, acquiring uploaded table information or image information in response to a file upload instruction, and calling a voice acquisition unit to acquire voice information in response to a recording instruction.

[0040] When acquiring image information, the image acquisition unit can be called to acquire image information in response to an image acquisition instruction generated by a user clicking a photo button. For example, after the user clicks the photo button, the camera can be called to take a photo and acquire image information. Image information uploaded by the user clicking an upload button can also be acquired. For example, a user uploads a photo of his ID card or passport in his mobile phone, etc.

[0041] When acquiring table information, the table file uploaded by the user can be acquired in response to a file upload instruction generated by the user clicking an upload button, for example, the user clicks the upload button to upload a table file in Excel format.

[0042] When acquiring voice information, the voice acquisition unit may be called to acquire the user's voice information in response to a recording instruction generated by the user clicking a recording button. In one example, the recording file uploaded by the user may also be acquired in response to an upload instruction clicked by the user.

[0043] It should be noted that at least one of the above-mentioned acquisition of image information, acquisition of table information and acquisition of voice information can be executed to obtain at least one of the image information, table information and voice information as the information to be identified. The specific content to be obtained can be based on the user's choice and is not limited here.

[0044] In an embodiment of the present application, when acquiring the information to be identified, the image acquisition unit can be called in response to an image acquisition instruction to acquire image information, the uploaded form information or image information can be acquired in response to a file upload instruction, and the voice acquisition unit can be called in response to a recording instruction to acquire voice information. In this way, at least one of the image information, form information and voice information can be acquired. The recognition model can identify the information to be filled in based on the acquired information to be identified. When filling in the application form, the user does not need to manually enter text information, which can improve the efficiency of filling in the application form.

[0045] In one possible implementation, when the information to be identified is input into the recognition model and the information to be filled in is obtained as output by the recognition model, the prompt words corresponding to the information to be identified and the application form can be input into the recognition model to obtain the information to be filled in as output by the recognition model.

[0046] When inputting the information to be identified into the recognition model, the information to be identified and the prompt word corresponding to the application form can be input into the recognition model. The prompt word is the Prompt constructed according to the application form. The Prompt can guide the recognition model to output the information to be filled in the application form corresponding to the Prompt.

[0047] Take the identification information as image information and the application form as a visa application form as an example. After collecting the passport image, the passport image and the prompt corresponding to the visa application form are input into the recognition model. The recognition model performs image OCR recognition on the passport image according to the prompt, and obtains the information to be filled in the passport image. For example, the name, nationality, date of birth, and issuing country information are extracted from the passport image, and the information to be filled in in JSON format is output as follows:

[0048] {

[0049] [HZTC-HXJKJD241015][HS2411247CCN]

[0050] "name":"xxx",

[0051] "county":"xxx",

[0052] "birthday":"yyyy-mm-dd",

[0053] "issuingCounty":"xxx"

[0054] }

[0055] In one example, the recognition model can be a large language model. After the recognition model outputs the information to be filled in, the information to be filled in in JSON format is filled in the corresponding position of the application form, for example: fill in the name in the corresponding position of the name, fill in the country in the corresponding position of the country, fill in the date of birth in the corresponding position of the date of birth, and so on.

[0056] In an embodiment of the present application, the prompt words corresponding to the information to be identified and the application form are input into the recognition model to obtain the information to be filled in output by the recognition model. The recognition model can be guided by the prompt words to identify the information to be identified, so that the recognition model can output the required information to be filled in. When filling in the application form, the user does not need to manually enter text information, which can improve the efficiency of filling in the application form.

[0057] In one possible implementation, the application form filling method can also display the filled-in application form. If confirmation information is received, the application form is completed. If modification information is received, at least part of the application form is modified according to the modification information, and the modified application form is displayed until confirmation information is obtained.

[0058] After the application form is completed, the completed application form will be displayed. The user can confirm whether the information filled in the displayed application form is correct. If it is correct, the user can click the confirmation button. After the system receives the confirmation information, the application form is completed. If there are errors in the displayed application form, the user can modify the erroneous part. After the system receives the user's modification information, it will modify the application form according to the modification information and display the modified application form. If there are still errors, it will continue to receive the modification information entered by the user until the user confirms that the application form is correct.

[0059] In an embodiment of the present application, the filled-in application form is displayed. If confirmation information is received, the application form is completed. If modification information is received, at least part of the application form is modified according to the modification information, and the modified application form is displayed until confirmation information is obtained. In this way, the user can modify the application form to prevent errors in filling out the application form due to recognition errors, thereby improving the efficiency of filling out the application form while ensuring the accuracy of filling out the application form.

[0060] In one possible implementation, when modifying at least a portion of the application form based on the modification information, at least a portion of the application form can be modified based on the modification information in text format input by the user, or the modification information and prompt words can be input into the recognition model to obtain the modification information to be filled in output by the recognition model, and at least a portion of the application form can be modified based on the modification information to be filled in, wherein the modification information includes at least one of image information, form information and voice information.

[0061] If the user finds that there is an error in filling out the application form, he or she can enter the modification information in text format to modify the application form. For example, if the user finds that there is an error in filling out the name, he or she can click on the corresponding position of the name and modify the name in the application form by entering the correct name in text format.

[0062] Alternatively, the user can upload or collect at least one of the image information, form information and voice information as the modification information again. The recognition model recognizes the modification information based on the modification information and the prompt word, obtains the modification information to be filled in, and replaces the information filled in the application form based on the modification information to be filled in, thereby modifying the information in the application form. It should be noted that the following acquisition methods can be performed when acquiring the modification information: in response to the image acquisition instruction, calling the image acquisition unit to acquire image information, in response to the file upload instruction, acquiring the uploaded form information or image information, and in response to the recording.

[0063] The [HZTC-HXJKJD241015][HS2411247CCN] instruction calls the voice collection unit to collect at least one of the voice information.

[0064] In an embodiment of the present application, at least a portion of the application form can be modified according to the modification information in text format input by the user, or the modification information and prompt words can be input into the recognition model to obtain the modification information to be filled in output by the recognition model, and at least a portion of the application form can be modified according to the modification information to be filled in. In this way, an incorrectly filled-in application form can be modified, and the incorrect application form can be modified in different modification methods according to the user's choice, thereby improving the user experience.

[0065] Figure 2 is a schematic diagram of an application form filling device provided in an embodiment of the present application, such as Figure 2 As shown, the device 200 includes:

[0066] An acquisition unit 201 is used to acquire information to be identified;

[0067] An input unit 202, used to input the information to be identified into a recognition model, and obtain the information to be filled in output by the recognition model;

[0068] The writing unit 203 is used to fill in the application form according to the information to be filled in.

[0069] In the embodiment of the present application, the acquisition unit 201 can be used to execute step 101 in the above method embodiment, the input unit 202 can be used to execute step 102 in the above method embodiment, and the writing unit 203 can be used to execute step 103 in the above method embodiment.

[0070] In a possible implementation manner, the information to be identified includes: at least one of image information, table information and voice information.

[0071] In a possible implementation, the acquisition unit 201 can also be used to call the image acquisition unit to acquire image information in response to an image acquisition instruction, acquire uploaded table information or image information in response to a file upload instruction, and call the voice acquisition unit to acquire voice information in response to a recording instruction.

[0072] In a possible implementation, the input unit 202 may also be used to input the information to be identified and the prompt words corresponding to the application form into the recognition model to obtain the information to be filled in output by the recognition model.

[0073] In one possible implementation, the application form filling device 200 can also display the filled-in application form; if confirmation information is received, the application form is completed; if modification information is received, at least part of the application form is modified according to the modification information, and the modified application form is displayed until the confirmation information is obtained.

[0074] In one possible implementation, the application form filling device 200 can also modify at least part of the application form according to the modification information in text format input by the user; or, input the modification information and the prompt word into the recognition model, obtain the modification information to be filled in output by the recognition model, and modify at least part of the application form according to the modification information to be filled in, wherein the modification information includes at least one of image information, form information and voice information.

[0075] Reference Figure 3 , shows a schematic diagram of the structure of an electronic device according to an embodiment of the present application. The specific embodiment of the present application does not limit the specific implementation of the electronic device.

[0076] like Figure 3 As shown, the electronic device may include: a processor (processor) 302 , a communication interface (Communications Interface) 304 , a memory (memory) 306 , and a communication bus 308 .

[0077] in:

[0078] The processor 302 , the communication interface 304 , and the memory 306 communicate with each other via the communication bus 308 .

[0079] The communication interface 304 is used to communicate with other electronic devices or servers.

[0080] [HZTC-HXJKJD241015][HS2411247CCN]

[0081] The processor 302 is used to execute the program 310, and specifically can execute the relevant steps in the above-mentioned application form filling method embodiment.

[0082] Specifically, the program 310 may include program codes, which include computer operation instructions.

[0083] The processor 302 may be a central processing unit (CPU), a graphics processing unit (GPU), an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present application. The one or more processors included in the smart device may be processors of the same type, such as one or more CPUs; one or more GPUs; or processors of different types, such as one or more CPUs, one or more GPUs, and one or more ASICs.

[0084] The memory 306 is used to store the program 310. The memory 306 may include a high-speed RAM memory, and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory.

[0085] The program 310 may be specifically configured to enable the processor 302 to execute the application form filling method in any of the aforementioned embodiments.

[0086] The specific implementation of each step in program 310 can refer to the corresponding description of the corresponding steps and units in any of the aforementioned application form filling method embodiments, which will not be repeated here. Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working process of the above-described devices and modules can refer to the corresponding process description in the aforementioned method embodiments, which will not be repeated here.

[0087] In an embodiment of the present application, information to be identified is obtained, input into a recognition model, information to be filled in is obtained, and an application form is filled in according to the information to be filled in, thereby completing the filling in of the application form. Since the user directly inputs the information to be identified into the system, the system can identify the information to be filled in according to the information to be identified. Therefore, when filling in the application form, the user does not need to enter each item of the application form in text. Compared with the prior art, the time required to fill in the application form can be reduced, thereby improving the user experience.

[0088] An embodiment of the present application also provides a computer program product, including computer instructions, which instruct a computing device to execute operations corresponding to any one of the above-mentioned multiple method embodiments.

[0089] It should be pointed out that, according to the needs of implementation, the various components / steps described in the embodiments of the present application can be split into more components / steps, or two or more components / steps or partial operations of components / steps can be combined into new components / steps to achieve the purpose of the embodiments of the present application.

[0090] The above-mentioned method according to the embodiment of the present application can be implemented in hardware, firmware, or implemented as software or computer code that can be stored in a recording medium (such as a CD ROM, RAM, floppy disk, hard disk or magneto-optical disk), or implemented as a computer code originally stored in a remote recording medium or a non-temporary machine-readable medium downloaded through a network and to be stored in a local recording medium, so that the method described herein can be stored in such software processing on a recording medium using a general-purpose computer, a dedicated processor or programmable or dedicated hardware (such as an ASIC or FPGA). It can be understood that a computer, a processor, a microprocessor controller or programmable hardware includes a storage component (e.g., RAM, ROM, flash memory, etc.) that can store or receive software or computer code, and when the software or computer code is accessed and executed by a computer, a processor or hardware, the application form filling method described herein is implemented. In addition, when a general-purpose computer accesses the code for implementing the application form filling method shown here, the execution of the code converts the general-purpose computer into a dedicated computer for executing the application form filling method shown here.

[0091] Those skilled in the art can appreciate that the units of the various examples described in conjunction with the embodiments disclosed herein are

[0092] [HZTC-HXJKJD241015][HS2411247CCN] and method steps can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the embodiments of this application.

[0093] The above implementation methods are only used to illustrate the embodiments of the present application, and are not limitations on the embodiments of the present application. Ordinary technicians in the relevant technical field can make various changes and modifications without departing from the spirit and scope of the embodiments of the present application. Therefore, all equivalent technical solutions also belong to the scope of the embodiments of the present application. The scope of patent protection of the embodiments of the present application should be limited by the claims.

Claims

1. A method for filling out an application form, characterized in that: include: Obtaining information to be identified; Input the information to be identified into the identification model to obtain the information to be filled in output by the identification model; Fill in the application form according to the information to be filled in.

2. The method according to claim 1, characterized in that The information to be identified includes: At least one of image information, table information, and voice information.

3. The method according to claim 2, characterized in that The obtaining of the information to be identified includes: At least one of calling an image acquisition unit to acquire image information in response to an image acquisition instruction, acquiring uploaded table information or image information in response to a file upload instruction, and calling a voice acquisition unit to acquire voice information in response to a recording instruction.

4. The method according to claim 1, characterized in that The step of inputting the information to be identified into the identification model to obtain the information to be filled in output by the identification model includes: The information to be identified and the prompt words corresponding to the application form are input into the recognition model to obtain the information to be filled in output by the recognition model.

5. The method according to claim 4, characterized in that The method further comprises: Display the completed application form; If a confirmation message is received, the application form is completed; If modification information is received, at least a portion of the application form is modified according to the modification information, and the modified application form is displayed until the confirmation information is obtained.

6. The method according to claim 5, characterized in that The step of modifying at least part of the application form according to the modification information comprises: Modifying at least a portion of the application form according to modification information in text format input by a user; Alternatively, the modification information and the prompt word are input into the recognition model, the modification information to be filled in output by the recognition model is obtained, and at least a portion of the application form is modified according to the modification information to be filled in, wherein the modification information includes at least one of image information, form information and voice information.

7. An application form filling device, characterized in that: include: An acquisition unit, used for acquiring information to be identified; An input unit, used to input the information to be identified into a recognition model, and obtain the information to be filled in output by the recognition model; The writing unit is used to fill in the application form according to the information to be filled in.

8. An electronic device, characterized in that: include: A processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface communicate with each other via the communication bus; [HZTC-HXJKJD241015][HS2411247CCN] The memory is used to store at least one executable instruction, and the executable instruction enables the processor to execute the application form filling method as described in any one of claims 1-6.

9. A computer storage medium, characterized in that: A computer program is stored thereon, and when the program is executed by a processor, the application form filling method as described in any one of claims 1-6 is implemented.

10. A computer program product, characterized in that The method comprises computer instructions, wherein the computer instructions instruct a computing device to execute the application form filling method as described in any one of claims 1 to 6.

Images