Form filling method and device based on artificial intelligence, equipment and storage medium

Abstract

The artificial intelligence-based form filling method and device, equipment and storage medium provided in the present application relate to the field of artificial intelligence technology. In the present application, firstly, in response to the form access operation and based on the form configuration data obtained from the smart form background server, the form to be filled in is displayed on the target form filling page, and a pre-configured smart form component is embedded in the target form filling page to display the smart form dialogue window on the target form filling page; secondly, in response to the dialogue data submission operation, the original dialogue data is obtained; then, the original dialogue data is sent to the artificial intelligence server, so that the artificial intelligence server outputs a form field item set; finally, each form field item in the form field item set is filled in the form to be filled in to form a filled form. Based on the above content, the problem of low efficiency and accuracy of form filling in the prior art can be improved.

Description

Technical Field

[0001] The present application relates to the field of artificial intelligence technology, and more specifically, to an artificial intelligence-based form filling method and apparatus, device, and storage medium. Background Art

[0002] Currently, in conventional forms, external users may not be familiar with the form when using it for the first time. Therefore, corresponding guidance operations are required. Sometimes, even with guidance, users still do not know how to fill in the form or fill in the form incorrectly, resulting in low efficiency in form filling, deviation in understanding of information, incorrect filling or random filling. In other words, in the prior art, there is a problem of low efficiency and accuracy in form filling. Summary of the invention

[0003] In view of this, the purpose of this application is to provide a form filling method and apparatus, device and storage medium based on artificial intelligence to improve the problem of low efficiency and accuracy of form filling in the prior art.

[0004] To achieve the above objectives, this application adopts the following technical solutions:

[0005] A form filling method based on artificial intelligence is applied to an electronic device, wherein the electronic device is connected to a smart form backend server and an artificial intelligence server respectively, and the form filling method based on artificial intelligence comprises:

[0006] In response to a form access operation performed by a target form filling user, and based on the form configuration data obtained from the smart form backend server, a corresponding form to be filled in is displayed on a pre-configured target form filling page, and a pre-configured smart form component is embedded in the target form filling page to display a corresponding smart form dialog window on the target form filling page;

[0007] In response to a dialog data submission operation performed by the target form filling user on the form to be filled in and the smart form dialog window, corresponding original dialog data is acquired, wherein the original dialog data is the form content filled in by the target form filling user based on the form to be filled in and the smart form dialog window, and the original dialog data includes at least one of text data, image data and voice data;

[0008] Sending the original conversation data to the artificial intelligence server, so that the artificial intelligence server analyzes the original conversation data using a pre-deployed artificial intelligence model to output a corresponding form field item set, and sending the form field item set to the electronic device;

[0009] Each form field item in the form field item set is filled into the form to be filled in to form a corresponding filled form, and the filled form is displayed on the target form filling page to complete the form filling operation.

[0010] In a preferred embodiment of the present application, in the above-mentioned artificial intelligence-based form filling method, the step of sending the original conversation data to the artificial intelligence server so that the artificial intelligence server analyzes the original conversation data using a pre-deployed artificial intelligence model to output a corresponding form field item set, and sending the form field item set to the electronic device includes:

[0011] When the original conversation data is image data, performing line segment detection processing on the image data to obtain a line segment set in the image data, wherein the line segment set includes at least one detected line segment detected from the image data;

[0012] For each detection line segment in the line segment set, segment an image region including the detection line segment in the image data to obtain a local image region corresponding to the detection line segment, wherein the pixel points included in the detection line segment belong to some pixel points in the corresponding local image region, and each of the local image regions can be spliced ​​to form the image data;

[0013] For each of the local image regions, a line segment shrinkage process is performed on the local image region to form a shrunken image region corresponding to the local image region, and a line segment expansion process is performed on the local image region to form an expanded image region corresponding to the local image region, wherein the line segment shrinkage process at least includes morphological erosion, and the line segment expansion process at least includes morphological dilation;

[0014] splicing the contracted image areas corresponding to each of the local image areas according to the relative positional relationship between the local image areas to form contracted image data corresponding to the image data, and splicing the expanded image areas corresponding to each of the local image areas according to the relative positional relationship between the local image areas to form expanded image data corresponding to the image data;

[0015] The image data, the shrunk image data and the expanded image data are sent to the artificial intelligence server, so that the artificial intelligence server uses a pre-deployed artificial intelligence model to analyze the image data, the shrunk image data and the expanded image data to output a corresponding set of form field items, and sends the set of form field items to the electronic device, wherein the artificial intelligence model is used to perform feature mining on the image data, the shrunk image data and the expanded image data respectively to obtain a corresponding first feature, a second feature and a third feature, and to associate and fuse the first feature based on the second feature and the third feature respectively to form a corresponding first fused feature and a second fused feature, and to output a corresponding set of form field items based on the first fused feature and the second fused feature.

[0016] In a preferred embodiment of the present application, in the above-mentioned artificial intelligence-based form filling method, the step of responding to the form access operation performed by the target form filling user and based on the form configuration data obtained from the smart form backend server, displaying the corresponding form to be filled in on the pre-configured target form filling page, and embedding the pre-configured smart form component in the target form filling page to display the corresponding smart form dialog window on the target form filling page includes:

[0017] In response to a form access operation performed by a target form filling user on a pre-configured target form filling page, a pre-configured smart form component is acquired, and the smart form component is embedded into the target form filling page;

[0018] In response to a dialog window opening operation performed by the target form filling user on the target form filling page, a corresponding smart form dialog window is displayed on the target form filling page based on the smart form component, and form initialization parameters are acquired based on the smart form component;

[0019] Based on the form initialization parameters, corresponding form configuration data is obtained from the intelligent form server, and based on the form configuration data, a to-be-filled form corresponding to the form configuration data is displayed on the target form filling page.

[0020] In a preferred embodiment of the present application, in the above-mentioned artificial intelligence-based form filling method, the step of obtaining corresponding form configuration data from the intelligent form server based on the form initialization parameters, and displaying the form to be filled in corresponding to the form configuration data on the target form filling page based on the form configuration data includes:

[0021] Based on the form initialization parameters, corresponding form configuration data is obtained from the intelligent form server, and based on the form configuration data, form interface fields are initialized;

[0022] The initialized form interface fields are displayed so as to display the to-be-filled form corresponding to the initialized form interface fields on the target form filling page.

[0023] In a preferred embodiment of the present application, in the above-mentioned artificial intelligence-based form filling method, the step of filling each form field item in the form field item set into the form to be filled in to form a corresponding filled form, and displaying the filled form on the target form filling page to complete the form filling operation includes:

[0024] For each form field item in the form field item set, the form field item is inspected to obtain a field item inspection result corresponding to the form field item;

[0025] For each form field item in the form field item set, after the field item inspection result corresponding to the form field item reflects that the form field item inspection is successful, fill the form field item into the corresponding field in the form to be filled in to form a corresponding filled form, and display the filled form on the target form filling page to complete the form filling operation;

[0026] For each form field item in the form field item set, after the field item inspection result corresponding to the form field item reflects that the form field item inspection has failed, corresponding inspection failure prompt information is generated and displayed, so that the target form filling user re-performs the dialogue data submission operation to generate a new form field item, until the field item inspection result corresponding to the new form field item reflects that the form field item inspection has succeeded.

[0027] In a preferred embodiment of the present application, in the above-mentioned artificial intelligence-based form filling method, the step of performing a verification process on each form field item in the form field item set to obtain a field item verification result corresponding to the form field item includes:

[0028] For each form field item in the form field item set, determining a field item verification rule corresponding to the form field item, and performing a correctness verification process on the form field item based on the field item verification rule to obtain a correctness verification result corresponding to the form field item;

[0029] For each form field item in the form field item set, determining a field item verification dictionary corresponding to the form field item, and performing validity verification processing on the form field item based on the field item verification dictionary to obtain a validity verification result corresponding to the form field item;

[0030] For each form field item in the form field item set, when the correctness check result corresponding to the form field item reflects that the correctness check is successful, and the validity check result corresponding to the form field item reflects that the validity check is successful, a field item check result reflecting that the form field item check is successful is generated; when the correctness check result corresponding to the form field item reflects that the correctness check fails, or the validity check result corresponding to the form field item reflects that the validity check fails, a field item check result reflecting that the form field item check fails is generated.

[0031] In a preferred embodiment of the present application, in the above-mentioned artificial intelligence-based form filling method, before executing the step of filling each form field item in the form field item set into the form to be filled in to form a corresponding filled form, and displaying the filled form on the target form filling page to complete the form filling operation, the artificial intelligence-based form filling method further includes:

[0032] Sending the filled-in form to the smart form backend server, so that the smart form backend server stores the filled-in form as a historical session record, wherein the smart form backend server stores at least one historical session record;

[0033] In response to a historical session selection operation performed by the target form filling user, a target historical session record is acquired from at least one historical session record stored in the smart form backend server, and the target historical session record is displayed;

[0034] In response to the target form filling user performing a form refilling or supplementing operation on the target historical conversation record, corresponding refilling or supplementing conversation data is acquired, and based on the refilling or supplementing conversation data, a form refilling or supplementing process is performed on the filled form corresponding to the target historical conversation record to form a refilled or supplemented form; or

[0035] In response to a deletion operation performed by the target form filling user on the target historical session record, the target historical session record is deleted from the smart form backend server.

[0036] The present application also provides an artificial intelligence-based form filling device, which is applied to an electronic device, wherein the electronic device is connected to a smart form backend server and an artificial intelligence server respectively, and the artificial intelligence-based form filling device includes:

[0037] A form access module, for responding to a form access operation performed by a target form filling user and displaying a corresponding form to be filled in on a pre-configured target form filling page based on form configuration data obtained from the smart form backend server, and embedding a pre-configured smart form component in the target form filling page to display a corresponding smart form dialog window on the target form filling page;

[0038] a dialog data submission module, configured to obtain corresponding original dialog data in response to a dialog data submission operation performed by the target form filling user on the form to be filled in and the smart form dialog window, wherein the original dialog data is the form content filled in by the target form filling user based on the form to be filled in and the smart form dialog window, and the original dialog data includes at least one of text data, image data and voice data;

[0039] a dialogue data sending module, configured to send the original dialogue data to the artificial intelligence server, so that the artificial intelligence server analyzes the original dialogue data using a pre-deployed artificial intelligence model to output a corresponding form field item set, and sends the form field item set to the electronic device;

[0040] The form filling module is used to fill each form field item in the form field item set into the form to be filled in to form a corresponding filled form, and display the filled form on the target form filling page to complete the form filling operation.

[0041] Based on the above, the present application also provides an electronic device, including:

[0042] Memory for storing computer programs;

[0043] A processor connected to the memory is used to execute the computer program stored in the memory to implement the above-mentioned artificial intelligence-based form filling method.

[0044] On the basis of the above, the present application also provides a computer-readable storage medium, in which a computer program is stored, and when the computer program is run, each step of the above-mentioned artificial intelligence-based form filling method is executed.

[0045] The form filling method and apparatus, device and storage medium based on artificial intelligence provided by the present application, firstly, in response to the form access operation and based on the form configuration data obtained from the intelligent form background server, the form to be filled in is displayed on the target form filling page, and a pre-configured intelligent form component is embedded in the target form filling page to display the intelligent form dialogue window on the target form filling page; secondly, in response to the dialogue data submission operation, the original dialogue data is obtained; then, the original dialogue data is sent to the artificial intelligence server, so that the artificial intelligence server outputs a form field item set; finally, each form field item in the form field item set is filled in the form to be filled in to form a filled form. Based on the above content, since the original dialogue data can be sent to the artificial intelligence server, the artificial intelligence server can perform corresponding analysis to output the corresponding form field item set, thereby realizing automatic intelligent filling of the form, therefore, the accuracy of form filling can be improved to a certain extent, and the efficiency of form filling can also be taken into account, thereby improving the problem of low efficiency and accuracy of form filling in the prior art. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] In order to make the above-mentioned objects, features and advantages of the present application more obvious and easy to understand, preferred embodiments are specifically cited below and described in detail with reference to the attached drawings.

[0047] Figure 1 A structural block diagram of an electronic device provided in an embodiment of the present application.

[0048] Figure 2 A schematic diagram of an artificial intelligence-based form filling method provided in an embodiment of the present application.

[0049] Figure 3 A timing diagram for filling out a form provided in an embodiment of the present application.

[0050] Figure 4 A schematic diagram of an artificial intelligence-based form filling device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0051] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. The components of the embodiments of the present application described and shown in the drawings here can be arranged and designed in various different configurations.

[0052] Therefore, the following detailed description of the embodiments of the present application provided in the accompanying drawings is not intended to limit the scope of the present application for which protection is sought, but merely represents selected embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without creative work are within the scope of protection of the present application.

[0053] like Figure 1 As shown, an embodiment of the present application provides an electronic device, wherein the electronic device may include a memory, a processor, and an artificial intelligence-based form filling device.

[0054] In detail, the memory and the processor are electrically connected directly or indirectly to achieve data transmission or interaction. For example, the memory and the processor can be electrically connected through one or more communication buses or signal lines. The artificial intelligence-based form filling device includes at least one software function module stored in the memory in the form of software or firmware. The processor is used to execute an executable computer program stored in the memory, for example, the software function modules and computer programs included in the artificial intelligence-based form filling device, so as to implement the artificial intelligence-based form filling method provided in the embodiment of the present application.

[0055] Optionally, the memory may be, but is not limited to, a random access memory (RAM), a read only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable read-only memory (EEPROM), etc.

[0056] Furthermore, the processor may be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), a system on chip (SoC), etc.; it may also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.

[0057] Understandably, Figure 1The structure shown is for illustration only, and the electronic device may also include Figure 1 More or fewer components as shown, or with Figure 1 The different configurations shown, for example, may also include a communication unit for exchanging information with other devices (such as a server).

[0058] It can be understood that the electronic device can be a terminal device such as a computer.

[0059] Combination Figure 2 , the embodiment of the present application also provides an artificial intelligence-based form filling method applicable to the above electronic device. Among them, the method steps defined in the process related to the artificial intelligence-based form filling method can be implemented by the electronic device, and the electronic device has established communication connections with the smart form background server and the artificial intelligence server respectively.

[0060] The following will Figure 2 The specific process shown is explained in detail.

[0061] Step S110, in response to the form access operation performed by the target form filling user, and based on the form configuration data obtained from the smart form backend server, the corresponding form to be filled in is displayed on the pre-configured target form filling page, and a pre-configured smart form component is embedded in the target form filling page to display the corresponding smart form dialog window on the target form filling page.

[0062] In an embodiment of the present application, the electronic device can respond to the form access operation performed by the target form filling user, and based on the form configuration data obtained from the smart form background server, display the corresponding form to be filled in on the pre-configured target form filling page, and embed the pre-configured smart form component in the target form filling page to display the corresponding smart form dialogue window on the target form filling page. In other words, the front-end AI dialogue window (i.e., the smart form dialogue window) can be integrated into the third-party business system (such as the target form filling page) in the form of component (i.e., smart form component) embedding, and the component can use iframe embedding (iframe (inline frame) is an HTML tag used to embed another HTML page in a web page. Using iframe, an independent document can be embedded in the main document so that the two documents can be displayed in parallel in the same browser window) to provide a user dialogue window, thereby ensuring that the update of the smart form component will not affect the third-party business system. At the same time, the component provides data transmission and event interfaces for internal and external interactions.

[0063] Step S120, in response to the target form filling user performing a dialog data submission operation on the form to be filled in and the smart form dialog window, the corresponding original dialog data is acquired.

[0064] In an embodiment of the present application, the electronic device can obtain the corresponding original dialogue data in response to the dialogue data submission operation performed by the target form filling user on the form to be filled in and the smart form dialogue window. The original dialogue data is the form content filled in by the target form filling user based on the form to be filled in and the smart form dialogue window, and the original dialogue data includes at least one of text data, image data and voice data.

[0065] Step S130, sending the original conversation data to the artificial intelligence server, so that the artificial intelligence server uses a pre-deployed artificial intelligence model to analyze the original conversation data to output a corresponding form field item set, and sends the form field item set to the electronic device.

[0066] In an embodiment of the present application, the electronic device may send the original conversation data to the artificial intelligence server, so that the artificial intelligence server analyzes the original conversation data using a pre-deployed artificial intelligence model to output a corresponding form field item set, and sends the form field item set to the electronic device. The artificial intelligence model may be an existing neural network model, and its specific composition is not specifically limited herein.

[0067] Step S140, fill each form field item in the form field item set into the form to be filled in to form a corresponding filled form, and display the filled form on the target form filling page to complete the form filling operation.

[0068] In an embodiment of the present application, the electronic device can fill in each form field item in the form field item set into the form to be filled in to form a corresponding filled form, and display the filled form on the target form filling page to complete the form filling operation.

[0069] Based on the above content, since the original conversation data can be sent to the artificial intelligence server, the artificial intelligence server can perform corresponding analysis to output the corresponding set of form field items, thereby realizing automatic intelligent filling of the form. Therefore, the accuracy of form filling can be improved to a certain extent, and the efficiency of form filling can also be taken into account, thereby improving the problem of low efficiency and accuracy of form filling in the prior art.

[0070] It should be noted that for step S110 , the specific processing method in response to the form access operation is not limited and can be selected according to actual needs.

[0071] For example, in an alternative implementation, in order to ensure that the user filling out the target form can reliably submit data in subsequent steps, the above-mentioned step S110 may further include step S111, step S112 and step S113, and the specific content of each step is described as follows.

[0072] Step S111 , in response to a form access operation performed by a target form filling user on a pre-configured target form filling page, a pre-configured smart form component is acquired, and the smart form component is embedded into the target form filling page.

[0073] In an embodiment of the present application, in response to a form access operation performed by a target form filling user on a preconfigured target form filling page, a preconfigured smart form component can be acquired and the smart form component can be embedded into the target form filling page.

[0074] Step S112, in response to the target form filling user performing a dialog window opening operation on the target form filling page, a corresponding smart form dialog window is displayed on the target form filling page based on the smart form component, and form initialization parameters are acquired based on the smart form component.

[0075] In an embodiment of the present application, after the smart form component is embedded in the target form filling page, in response to the target form filling user performing a dialog window opening operation on the target form filling page, a corresponding smart form dialog window can be displayed on the target form filling page based on the smart form component, and form initialization parameters can be obtained based on the smart form component.

[0076] Step S113, based on the form initialization parameters, corresponding form configuration data is obtained from the intelligent form server, and based on the form configuration data, a to-be-filled form corresponding to the form configuration data is displayed on the target form filling page.

[0077] In an embodiment of the present application, after obtaining the form initialization parameters, corresponding form configuration data can be obtained from the intelligent form server based on the form initialization parameters, and based on the form configuration data, the form to be filled in corresponding to the form configuration data can be displayed on the target form filling page.

[0078] It is understandable that, in the above step S113, the specific method of forming and displaying the form to be filled in is not limited and can be selected according to actual needs.

[0079] For example, in an alternative implementation, in order to ensure reliable display of the form to be filled in so that the target form filling user can reliably fill in the form to be filled in, the above step S113 may further include the following steps:

[0080] First, based on the form initialization parameters, corresponding form configuration data can be obtained from the smart form server, and based on the form configuration data, the form interface fields can be initialized; illustratively, based on the AK key included in the form initialization parameters, corresponding form configuration data (such as field attributes, field guides and other parameters) can be obtained from the smart form server, and based on the form configuration data, the form interface fields can be initialized;

[0081] Secondly, the initialized form interface fields may be displayed so as to display the to-be-filled form corresponding to the initialized form interface fields on the target form filling page.

[0082] It should be noted that for step S130, the specific method of sending the original conversation data to the artificial intelligence server is not limited and can be selected according to actual needs.

[0083] For example, in an alternative implementation, the acquired original conversation data may be directly sent to the artificial intelligence server, so that the artificial intelligence server performs corresponding analysis on the original conversation data to obtain the required set of form field items.

[0084] For example, in another alternative implementation, in order to further improve the reliability of the artificial intelligence server performing corresponding analysis on the original conversation data, the above step S130 may further include the following steps:

[0085] First, when the original conversation data is image data, line segment detection processing may be performed on the image data to obtain a line segment set in the image data, wherein the line segment set includes at least one detected line segment detected from the image data; illustratively, in a specific application, line segment detection processing may be performed on the image data based on Hough Transform technology to obtain a corresponding line segment set;

[0086] Secondly, for each detection line segment in the line segment set, an image area including the detection line segment can be segmented out in the image data to obtain a local image area corresponding to the detection line segment, wherein the pixel points included in the detection line segment belong to some pixel points in the corresponding local image area, and each of the local image areas can be spliced ​​to form the image data. It should be noted that, in order to facilitate subsequent line segment expansion processing, each pixel point on the detection line segment does not belong to an edge pixel point of the corresponding local image area (a pixel point on a region boundary line, for example, a pixel point distance between a pixel point on a detection line segment and an edge pixel point is greater than a preset distance, and the specific value of the preset distance is not limited, such as 2, 3, 4, 5, etc.);

[0087] Then, for each of the local image regions, a line segment contraction process may be performed on the local image region to form a contracted image region corresponding to the local image region, and a line segment expansion process may be performed on the local image region to form an expanded image region corresponding to the local image region, wherein the line segment contraction process at least includes morphological erosion (for example, a morphological erosion may be performed once, or a morphological erosion may be performed once, then a morphological expansion may be performed once, and then a morphological erosion may be performed once), and the line segment expansion process at least includes morphological expansion (for example, a morphological expansion may be performed once, or a morphological expansion may be performed once, then a morphological erosion may be performed once, and then a morphological expansion may be performed once);

[0088] Further, the contracted image areas corresponding to each of the local image areas may be spliced ​​according to the relative positional relationship between the local image areas to form contracted image data corresponding to the image data, and the expanded image areas corresponding to each of the local image areas may be spliced ​​according to the relative positional relationship between the local image areas to form expanded image data corresponding to the image data;

[0089] Finally, the image data, the shrunk image data and the expanded image data can be sent to the artificial intelligence server, so that the artificial intelligence server uses a pre-deployed artificial intelligence model to analyze the image data, the shrunk image data and the expanded image data to output a corresponding set of form field items, and sends the set of form field items to the electronic device, wherein the artificial intelligence model is used to perform feature mining on the image data, the shrunk image data and the expanded image data respectively to obtain the corresponding first feature, the second feature and the third feature, and to associate and fuse the first feature based on the second feature and the third feature to form the corresponding first fused feature and the second fused feature, and to output the corresponding set of form field items based on the first fused feature and the second fused feature; for example, the image data, the shrunk image data and the expanded image data can be convoluted to obtain the corresponding first feature, the second feature and the third feature, and then the first feature can be processed based on the second feature to obtain the first fused feature, and the first feature can be processed based on the third feature to obtain the second fused feature, and finally, the first fused feature and the second fused feature can be spliced ​​or superimposed to obtain the target feature, and the corresponding form field item can be output based on the target feature.

[0090] It should be noted that for step S140 , the specific method of filling each form field item in the form field item set into the form to be filled in is not limited and can be selected according to actual needs.

[0091] For example, in an alternative implementation, in order to ensure the reliability of the filling operation on the form to be filled in, the above-mentioned step S140 may further include step S141, step S142 and step S143, and the specific content of each step is described as follows.

[0092] Step S141 : for each form field item in the form field item set, a verification process is performed on the form field item to obtain a field item verification result corresponding to the form field item.

[0093] In the embodiment of the present application, for each form field item in the form field item set, the form field item is inspected to obtain a field item inspection result corresponding to the form field item. The field item inspection result is used to reflect whether the inspection is successful.

[0094] Step S142, for each form field item in the form field item set, after the field item inspection result corresponding to the form field item reflects that the form field item inspection is successful, fill the form field item into the corresponding field in the form to be filled in to form a corresponding filled form, and display the filled form on the target form filling page to complete the form filling operation.

[0095] In an embodiment of the present application, after the verification process is performed, for each form field item in the form field item set, after the field item verification result corresponding to the form field item reflects that the form field item verification is successful, the form field item can be filled in the corresponding field in the form to be filled in to form a corresponding filled form, and the filled form can be displayed on the target form filling page to complete the form filling operation.

[0096] Step S143, for each form field item in the form field item set, after the field item inspection result corresponding to the form field item reflects that the form field item inspection has failed, a corresponding inspection failure prompt message is generated and displayed, so that the target form filling user re-submits the dialogue data to generate a new form field item, until the field item inspection result corresponding to the new form field item reflects that the form field item inspection has succeeded.

[0097] In an embodiment of the present application, after the verification process is performed, for each form field item in the form field item set, after the field item verification result corresponding to the form field item reflects that the form field item verification has failed, corresponding verification failure prompt information can be generated and displayed, so that the target form filling user re-performs the dialogue data submission operation to generate a new form field item, until the field item verification result corresponding to the new form field item reflects that the form field item verification has succeeded.

[0098] It is understandable that in the above step S141, the specific method of checking the form field items is not limited and can be selected according to actual needs. For example, in an alternative implementation, in order to improve the reliability of the checking process and make the form filling operation more reliable, the above step S141 can further include the following steps:

[0099] On the one hand, for each form field item in the form field item set, a field item verification rule corresponding to the form field item is determined, and the form field item is subjected to a correctness verification process based on the field item verification rule to obtain a correctness verification result corresponding to the form field item; it should be noted that when processing the form data input by the user, data correctness verification is required for the required fields, which can be specifically verified through configured rules, wherein the rules are divided into public rules and private rules, public rules are allowed to be used by all business systems, and private rules are only allowed to be used by the corresponding system of the tenant; in addition, a rule is composed of multiple sub-rule entries, and the entries are allowed to be rule entries of regular verification mode and rule entries of function verification mode. For example, format verification can be performed, such as an email field to verify whether it conforms to the format of the email;

[0100] On the other hand, for each form field item in the form field item set, a field item verification dictionary corresponding to the form field item is determined, and a validity verification process is performed on the form field item based on the field item verification dictionary to obtain a validity verification result corresponding to the form field item; wherein the dictionary can also be divided into a public dictionary and a private dictionary, and the dictionary items cover conventional dictionaries and cascade dictionary expressions, and the cascade dictionary is expressed as a tree structure dictionary; in addition, the validity verification process refers to limiting the input data to a limited and limited value range;

[0101] Finally, for each form field item in the form field item set, when the correctness check result corresponding to the form field item reflects that the correctness check is successful, and the validity check result corresponding to the form field item reflects that the validity check is successful, a field item check result reflecting that the form field item check is successful is generated; when the correctness check result corresponding to the form field item reflects that the correctness check fails, or the validity check result corresponding to the form field item reflects that the validity check fails, a field item check result reflecting that the form field item check fails is generated.

[0102] It should be noted that, after the above step S140, the form filling method based on artificial intelligence may further include the following steps:

[0103] First, the filled-in form may be sent to the smart form backend server, so that the smart form backend server stores the filled-in form as a historical session record, wherein the smart form backend server stores at least one historical session record;

[0104] Secondly, in response to the historical session selection operation performed by the target form filling user, a target historical session record can be obtained from at least one historical session record stored in the smart form backend server, and the target historical session record can be displayed;

[0105] Then, in response to the target form filling user's form refilling or supplementing operation on the target historical session record, the corresponding refilling or supplementing dialogue data can be obtained, and the filled-in form corresponding to the target historical session record can be refilled or supplemented based on the refilling or supplementing dialogue data to form a refilled or supplemented form; or, in response to the target form filling user's deletion operation on the target historical session record, the target historical session record is deleted from the smart form backend server.

[0106] Combination Figure 3 Based on the above-mentioned artificial intelligence-based form filling method, in a specific application scenario, the following contents may be included:

[0107] 1. Configure products and scenarios for subsequent creation of private rules, private dictionaries, and forms;

[0108] 2. Configure rules (optional). Select products and application scenarios for private rules. Set regular validation rule expressions in the rule entry list, or add custom functions to implement function injection verification.

[0109] 3. Configure dictionaries and dictionary items (optional). For private dictionaries, select products and application scenarios. Dictionary types are divided into regular dictionaries and cascade dictionaries.

[0110] 4. Create a form and generate a form key AK, which is globally unique;

[0111] 5. Create a new form configuration, automatically fill in or manually modify the configuration version number;

[0112] 6. Modify the form field item configuration, fill in the field information, field guide, paging information, OCR matching rules, verification rules, dictionary items, display conditions and other form item parameters, or import the configuration;

[0113] 7. Activate the form configuration version;

[0114] 8. The business system form page is embedded into the page using the smart form component, and the AK key in step 3 is passed to the smart form component;

[0115] 9. The smart form receives the AK key and uses the AK key to pull the corresponding form configuration;

[0116] 10.Paginate the form items by configuring the form items in groups;

[0117] 11. Output welcome message and form input suggestions in the dialog window;

[0118] 12. The user submits text to the form, which is sent to AI for analysis and the values ​​of the form fields are extracted;

[0119] 13. The user uploads a picture, AI recognizes and analyzes the picture, displays the OCR recognition card, and extracts the field values ​​required by the form;

[0120] 14. The user inputs the voice, which is sent to AI for voice recognition. The AI ​​then analyzes the recognition results and extracts the form fields and field values.

[0121] 15. After the smart form receives the form field value, if there is a field verification rule list, the field value will be checked cyclically. When all the rule items of this field pass the test, it is considered a valid value, otherwise it will output relevant prompts;

[0122] 16. When the input value is generated, the smart form sends an event notification to the business system page;

[0123] 17. After receiving the event notification, the business system fills in the page form;

[0124] 18. When exiting or switching pages, save the historical conversation records so that the unfinished conversation content can be continued the next time you enter the form.

[0125] Combination Figure 4 The embodiment of the present application also provides an artificial intelligence-based form filling device applicable to the above electronic device. The artificial intelligence-based form filling device may include a form access module, a dialogue data submission module, a dialogue data sending module and a form filling module.

[0126] The form access module can be used to respond to the form access operation performed by the target form filling user, and based on the form configuration data obtained from the smart form background server, display the corresponding form to be filled in on the pre-configured target form filling page, and embed the pre-configured smart form component in the target form filling page to display the corresponding smart form dialog window on the target form filling page. In the embodiment of the present application, the form access module can be used to perform Figure 2 As shown in step S110, the relevant contents of the form access module can refer to the above description of step S110.

[0127] The dialog data submission module can be used to respond to the dialog data submission operation performed by the target form filling user on the form to be filled in and the smart form dialog window, and obtain the corresponding original dialog data, wherein the original dialog data is the form content filled in by the target form filling user based on the form to be filled in and the smart form dialog window, and the original dialog data includes at least one of text data, image data and voice data. In the embodiment of the present application, the dialog data submission module can be used to perform Figure 2 As shown in step S120, the relevant contents of the dialogue data submission module can refer to the above description of step S120.

[0128] The conversation data sending module can be used to send the original conversation data to the artificial intelligence server, so that the artificial intelligence server uses the pre-deployed artificial intelligence model to analyze the original conversation data to output a corresponding form field item set, and send the form field item set to the electronic device. Figure 2 As shown in step S130, the relevant contents of the dialogue data sending module can refer to the above description of step S130.

[0129] The form filling module can be used to fill each form field item in the form field item set into the form to be filled in to form a corresponding filled form, and display the filled form on the target form filling page to complete the form filling operation. Figure 2 As shown in step S140, the relevant contents of the form filling module can refer to the description of step S140 above.

[0130] In an embodiment of the present application, corresponding to the above-mentioned artificial intelligence-based form filling method applied to the electronic device, a computer-readable storage medium is also provided, in which a computer program is stored, and when the computer program is run, each step of the artificial intelligence-based form filling method is executed.

[0131] Among them, the steps executed when the aforementioned computer program is running will not be described one by one here, and reference can be made to the explanation of the aforementioned artificial intelligence-based form filling method in the previous article.

[0132] In summary, the form filling method and apparatus, device and storage medium based on artificial intelligence provided by the present application, first, in response to the form access operation, and based on the form configuration data obtained from the smart form background server, the form to be filled in is displayed on the target form filling page, and a pre-configured smart form component is embedded in the target form filling page to display the smart form dialogue window on the target form filling page; secondly, in response to the dialogue data submission operation, the original dialogue data is obtained; then, the original dialogue data is sent to the artificial intelligence server, so that the artificial intelligence server outputs a form field item set; finally, each form field item in the form field item set is filled in the form to be filled in to form a filled form. Based on the above content, since the original dialogue data can be sent to the artificial intelligence server, the artificial intelligence server can perform corresponding analysis to output the corresponding form field item set, thereby realizing automatic intelligent filling of the form, therefore, the accuracy of form filling can be improved to a certain extent, and the efficiency of form filling can also be taken into account, thereby improving the problem of low efficiency and accuracy of form filling in the prior art.

[0133] In several embodiments provided in the embodiments of the present application, it should be understood that the disclosed device and method can also be implemented in other ways. The device and method embodiments described above are merely schematic, for example, the flowcharts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the device, method and computer program product according to multiple embodiments of the present application. In this regard, each box in the flowchart or block diagram can represent a module, a program segment or a part of a code, and the module, a program segment or a part of a code contains one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of boxes in the block diagram and / or flowchart can be implemented with a dedicated hardware-based system that performs a specified function or action, or can be implemented with a combination of dedicated hardware and computer instructions.

[0134] In addition, the functional modules in the various embodiments of the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.

[0135] If the function is implemented in the form of a software function module and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or the part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium, including several instructions to enable a computer device (which can be a personal computer, electronic device, or network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk and other media that can store program code. It should be noted that in this article, the term "include", "include" or any other variant thereof is intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements that are not explicitly listed, or also includes elements inherent to such process, method, article or device. Without more constraints, an element defined by the phrase "comprising a..." does not exclude the existence of other identical elements in the process, method, article or apparatus comprising the element.

[0136] The above description is only the preferred embodiment of the present application and is not intended to limit the present application. For those skilled in the art, the present application may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.

Claims

1. A form filling method based on artificial intelligence, characterized in that: Applied to an electronic device, the electronic device is connected to a smart form backend server and an artificial intelligence server respectively, and the form filling method based on artificial intelligence includes: In response to a form access operation performed by a target form filling user, and based on the form configuration data obtained from the smart form backend server, a corresponding form to be filled in is displayed on a pre-configured target form filling page, and a pre-configured smart form component is embedded in the target form filling page to display a corresponding smart form dialog window on the target form filling page; In response to a dialog data submission operation performed by the target form filling user on the form to be filled in and the smart form dialog window, corresponding original dialog data is acquired, wherein the original dialog data is the form content filled in by the target form filling user based on the form to be filled in and the smart form dialog window, and the original dialog data includes at least one of text data, image data and voice data; Sending the original conversation data to the artificial intelligence server, so that the artificial intelligence server analyzes the original conversation data using a pre-deployed artificial intelligence model to output a corresponding form field item set, and sending the form field item set to the electronic device; Fill each form field item in the form field item set into the form to be filled in to form a corresponding filled form, and display the filled form on the target form filling page to complete the form filling operation; The step of sending the original conversation data to the artificial intelligence server so that the artificial intelligence server analyzes the original conversation data using a pre-deployed artificial intelligence model to output a corresponding form field item set, and sending the form field item set to the electronic device includes: When the original conversation data is image data, performing line segment detection processing on the image data to obtain a line segment set in the image data, wherein the line segment set includes at least one detected line segment detected from the image data; For each detection line segment in the line segment set, segment an image region including the detection line segment in the image data to obtain a local image region corresponding to the detection line segment, wherein the pixel points included in the detection line segment belong to some pixel points in the corresponding local image region, and each of the local image regions can be spliced ​​to form the image data; For each of the local image regions, a line segment shrinkage process is performed on the local image region to form a shrunken image region corresponding to the local image region, and a line segment expansion process is performed on the local image region to form an expanded image region corresponding to the local image region, wherein the line segment shrinkage process at least includes morphological erosion, and the line segment expansion process at least includes morphological dilation; splicing the contracted image areas corresponding to each of the local image areas according to the relative positional relationship between the local image areas to form contracted image data corresponding to the image data, and splicing the expanded image areas corresponding to each of the local image areas according to the relative positional relationship between the local image areas to form expanded image data corresponding to the image data; The image data, the shrunk image data and the expanded image data are sent to the artificial intelligence server, so that the artificial intelligence server uses a pre-deployed artificial intelligence model to analyze the image data, the shrunk image data and the expanded image data to output a corresponding set of form field items, and sends the set of form field items to the electronic device, wherein the artificial intelligence model is used to perform feature mining on the image data, the shrunk image data and the expanded image data respectively to obtain a corresponding first feature, a second feature and a third feature, and to associate and fuse the first feature based on the second feature and the third feature respectively to form a corresponding first fused feature and a second fused feature, and to output a corresponding set of form field items based on the first fused feature and the second fused feature.

2. The form filling method based on artificial intelligence according to claim 1, characterized in that: The step of displaying the corresponding form to be filled in on a pre-configured target form filling page in response to a form access operation performed by a target form filling user and based on the form configuration data obtained from the smart form backend server, and embedding a pre-configured smart form component in the target form filling page to display a corresponding smart form dialog window on the target form filling page includes: In response to a form access operation performed by a target form filling user on a pre-configured target form filling page, a pre-configured smart form component is acquired, and the smart form component is embedded into the target form filling page; In response to a dialog window opening operation performed by the target form filling user on the target form filling page, a corresponding smart form dialog window is displayed on the target form filling page based on the smart form component, and form initialization parameters are acquired based on the smart form component; Based on the form initialization parameters, corresponding form configuration data is obtained from the intelligent form server, and based on the form configuration data, a to-be-filled form corresponding to the form configuration data is displayed on the target form filling page.

3. The form filling method based on artificial intelligence according to claim 2, characterized in that: The step of acquiring corresponding form configuration data from the intelligent form server based on the form initialization parameters, and displaying the form to be filled in corresponding to the form configuration data on the target form filling page based on the form configuration data, comprises: Based on the form initialization parameters, corresponding form configuration data is obtained from the intelligent form server, and based on the form configuration data, form interface fields are initialized; The initialized form interface fields are displayed so as to display the to-be-filled form corresponding to the initialized form interface fields on the target form filling page.

4. The form filling method based on artificial intelligence according to claim 1, characterized in that: The step of filling each form field item in the form field item set into the form to be filled in to form a corresponding filled form, and displaying the filled form on the target form filling page to complete the form filling operation includes: For each form field item in the form field item set, the form field item is inspected to obtain a field item inspection result corresponding to the form field item; For each form field item in the form field item set, after the field item inspection result corresponding to the form field item reflects that the form field item inspection is successful, fill the form field item into the corresponding field in the form to be filled in to form a corresponding filled form, and display the filled form on the target form filling page to complete the form filling operation; For each form field item in the form field item set, after the field item inspection result corresponding to the form field item reflects that the form field item inspection has failed, corresponding inspection failure prompt information is generated and displayed, so that the target form filling user re-performs the dialogue data submission operation to generate a new form field item, until the field item inspection result corresponding to the new form field item reflects that the form field item inspection has succeeded.

5. The form filling method based on artificial intelligence according to claim 4 is characterized in that: The step of performing inspection processing on each form field item in the form field item set to obtain a field item inspection result corresponding to the form field item includes: For each form field item in the form field item set, determining a field item verification rule corresponding to the form field item, and performing a correctness verification process on the form field item based on the field item verification rule to obtain a correctness verification result corresponding to the form field item; For each form field item in the form field item set, determining a field item verification dictionary corresponding to the form field item, and performing validity verification processing on the form field item based on the field item verification dictionary to obtain a validity verification result corresponding to the form field item; For each form field item in the form field item set, when the correctness check result corresponding to the form field item reflects that the correctness check is successful, and the validity check result corresponding to the form field item reflects that the validity check is successful, a field item check result reflecting that the form field item check is successful is generated; when the correctness check result corresponding to the form field item reflects that the correctness check fails, or the validity check result corresponding to the form field item reflects that the validity check fails, a field item check result reflecting that the form field item check fails is generated.

6. The form filling method based on artificial intelligence according to any one of claims 1 to 5, characterized in that: Before executing the step of filling each form field item in the form field item set into the form to be filled in to form a corresponding filled form, and displaying the filled form on the target form filling page to complete the form filling operation, the artificial intelligence-based form filling method further includes: Sending the filled-in form to the smart form backend server, so that the smart form backend server stores the filled-in form as a historical session record, wherein the smart form backend server stores at least one historical session record; In response to a historical session selection operation performed by the target form filling user, a target historical session record is acquired from at least one historical session record stored in the smart form backend server, and the target historical session record is displayed; In response to the target form filling user performing a form refilling or supplementing operation on the target historical conversation record, corresponding refilling or supplementing conversation data is acquired, and based on the refilling or supplementing conversation data, a form refilling or supplementing process is performed on the filled form corresponding to the target historical conversation record to form a refilled or supplemented form; or In response to a deletion operation performed by the target form filling user on the target historical session record, the target historical session record is deleted from the smart form backend server.

7. A form filling device based on artificial intelligence, characterized in that: Applied to an electronic device, the electronic device is connected to a smart form backend server and an artificial intelligence server respectively, and the form filling device based on artificial intelligence includes: A form access module, for responding to a form access operation performed by a target form filling user and displaying a corresponding form to be filled in on a pre-configured target form filling page based on form configuration data obtained from the smart form backend server, and embedding a pre-configured smart form component in the target form filling page to display a corresponding smart form dialog window on the target form filling page; a dialog data submission module, configured to obtain corresponding original dialog data in response to a dialog data submission operation performed by the target form filling user on the form to be filled in and the smart form dialog window, wherein the original dialog data is the form content filled in by the target form filling user based on the form to be filled in and the smart form dialog window, and the original dialog data includes at least one of text data, image data and voice data; a dialogue data sending module, configured to send the original dialogue data to the artificial intelligence server, so that the artificial intelligence server analyzes the original dialogue data using a pre-deployed artificial intelligence model to output a corresponding form field item set, and sends the form field item set to the electronic device; A form filling module, used to fill each form field item in the form field item set into the form to be filled in, so as to form a corresponding filled form, and display the filled form on the target form filling page, so as to complete the form filling operation; The sending of the original conversation data to the artificial intelligence server so that the artificial intelligence server analyzes the original conversation data using a pre-deployed artificial intelligence model to output a corresponding form field item set, and sending the form field item set to the electronic device includes: When the original conversation data is image data, performing line segment detection processing on the image data to obtain a line segment set in the image data, wherein the line segment set includes at least one detected line segment detected from the image data; For each detection line segment in the line segment set, segment an image region including the detection line segment in the image data to obtain a local image region corresponding to the detection line segment, wherein the pixel points included in the detection line segment belong to some pixel points in the corresponding local image region, and each of the local image regions can be spliced ​​to form the image data; For each of the local image regions, a line segment shrinkage process is performed on the local image region to form a shrunken image region corresponding to the local image region, and a line segment expansion process is performed on the local image region to form an expanded image region corresponding to the local image region, wherein the line segment shrinkage process at least includes morphological erosion, and the line segment expansion process at least includes morphological dilation; splicing the contracted image areas corresponding to each of the local image areas according to the relative positional relationship between the local image areas to form contracted image data corresponding to the image data, and splicing the expanded image areas corresponding to each of the local image areas according to the relative positional relationship between the local image areas to form expanded image data corresponding to the image data; The image data, the shrunk image data and the expanded image data are sent to the artificial intelligence server, so that the artificial intelligence server uses a pre-deployed artificial intelligence model to analyze the image data, the shrunk image data and the expanded image data to output a corresponding set of form field items, and sends the set of form field items to the electronic device, wherein the artificial intelligence model is used to perform feature mining on the image data, the shrunk image data and the expanded image data respectively to obtain a corresponding first feature, a second feature and a third feature, and to associate and fuse the first feature based on the second feature and the third feature respectively to form a corresponding first fused feature and a second fused feature, and to output a corresponding set of form field items based on the first fused feature and the second fused feature.

8. An electronic device, characterized in that: include: Memory for storing computer programs; A processor connected to the memory, used to execute the computer program stored in the memory to implement the artificial intelligence-based form filling method described in any one of claims 1-6.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, which, when running, executes the artificial intelligence-based form filling method described in any one of claims 1 to 6.

Images