Automatic input system and automatic input program

Abstract

To provide an automatic input system that can automatically input a form field on the basis of information that can be acquired from an information terminal used by a user.SOLUTION: An automatic input system 1 comprises: a user information acquisition unit 14 that acquires user information from a user terminal 3 or a database 5 stored in a peripheral device 4 connected to the user terminal 3 directly or via a network 2; and an automatic input unit 15 that selects appropriate user data from the user information acquired by the user information acquisition unit 14 and inputs the user data to a form field of a website.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to an auto-fill system and an auto-fill program for automatically filling in form fields. [Background technology]

[0002] In recent years, the number of transactions, such as purchasing goods and reserving services, using the Internet has increased. When conducting transactions over the Internet or creating an account for conducting transactions over the Internet, users must repeatedly enter user information, such as their name, address, email address, and telephone number, into form fields that differ for each transaction site.

[0003] To simplify the input of user information into such form fields, an auto-fill system has been developed for automatically inputting user information into form fields (see, for example, Patent Document 1). The auto-fill system of Patent Document 1 includes a machine learning component and an auto-fill component. The machine learning component is trained using a set of inputs to facilitate automatic input of form fields. The auto-fill component selectively inputs appropriate data into the form fields based on information generated by the machine learning component. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2005-327260 Summary of the Invention [Problem to be solved by the invention]

[0005] However, the auto-fill system of Patent Document 1 uses training data consisting of correct input characteristics and output characteristics collected in some way to learn what and how to enter data into form fields through machine learning, and then enters data into the form fields based on the information generated through this learning.As a result, there is a problem in that appropriate data cannot be entered into the form fields without the information generated through machine learning.

[0006] The present invention has been made in consideration of the above-mentioned problems, and aims to provide an automatic input system and an automatic input program that can automatically fill in form fields based on information that can be obtained from the information terminal used by the user, even if information generated by machine learning is not available. [Means for solving the problem]

[0007] The automatic input system of the present invention comprises a user information acquisition unit that acquires user information from a database stored on a user terminal or a peripheral device connected to the user terminal directly or via a network, and an automatic input unit that selects and inputs appropriate user data into form fields on a website from the user information acquired by the user information acquisition unit.

[0008] In addition, the automatic input program of the present invention causes a computer to execute processing including the steps of acquiring user information from a database stored on a user terminal or a peripheral device connected to the user terminal directly or via a network, and selecting and inputting appropriate user data from the acquired user information into form fields on a website. [Effects of the Invention]

[0009] According to the automatic input system and automatic input program of the present invention, form fields can be automatically filled in based on information that can be obtained from the information terminal used by the user, even if information generated by machine learning is not available. [Brief explanation of the drawings]

[0010] [Figure 1] 1 is a configuration diagram showing a configuration of an automatic input system according to an embodiment of the present invention; [Figure 2] FIG. 1 is a functional block diagram showing functions of an automatic input system according to an embodiment of the present invention. [Figure 3] FIG. 2 is a diagram showing an example of an operation screen of the automatic input system of the present invention. [Figure 4] 10 is a flowchart illustrating an automatic input process of the automatic input system according to an embodiment of the present invention. [Figure 5] FIG. 2 is a diagram showing an example of an operation screen of the automatic input system of the present invention. [Figure 6] FIG. 2 is a diagram showing an example of an operation screen of the automatic input system of the present invention. [Figure 7] FIG. 2 is a diagram showing an example of an operation screen of the automatic input system of the present invention. [Figure 8] FIG. 2 is a diagram showing an example of an operation screen of the automatic input system of the present invention. [Figure 9] FIG. 10 is a functional block diagram showing functions of an automatic input system according to another embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the drawings, the same or corresponding parts are designated by the same reference characters and description thereof will not be repeated.

[0012] The automatic input system 1 will be described with reference to Fig. 1 to Fig. 3. Fig. 1 is a configuration diagram showing the configuration of the automatic input system 1 according to this embodiment. Fig. 2 is a functional block diagram showing the functions of the automatic input system 1 according to this embodiment. Fig. 3 is a diagram showing an example of an operation screen 30 of the automatic input system 1 of this embodiment.

[0013] The automatic input system 1 is a system that automatically inputs user data into form fields on a website using data stored in a user terminal 3 or a peripheral device 4 connected to the user terminal 3 directly or via a network 2. The automatic input system 1 is realized by installing an automatic input program in the user terminal 3 or a processing device 10 connected to the user terminal 3 via the network 2. As shown in FIG. 1 , in this embodiment, the automatic input program is installed in the processing device 10.

[0014] The user terminal 3 is a terminal used by a user who wants to automatically fill in form fields on a website. The user terminal 3 is equipped with a display device such as a display for the user to check the website screen and the operation screen 30 of the automatic input system 1, and input devices such as a keyboard, mouse, and touch panel for specifying the operation of the automatic input system 1. The user terminal 3 also has storage for storing data, such as a hard disk drive (HDD), a solid state drive (SSD), a read only memory (ROM), and a random access memory (RAM). The user terminal 3 is, for example, a terminal such as a personal computer, a tablet computer, or a smartphone.

[0015] The peripheral device 4 is a storage device for storing data. Examples of the peripheral device 4 include a USB memory (Universal Serial Bus Memory) that is directly connected to the user terminal 3, an external hard disk, and cloud storage that is connected to the user terminal 3 via the network 2.

[0016] The storage of the user terminal 3 and peripheral device 4 stores a database 5 containing user information that is typically required to be entered in form fields on a website. User information includes the user's name, age, address, email address, telephone number, website membership number, etc. The database 5 is created in advance by the user and stored on the user terminal 3 or peripheral device 4, or it is created by obtaining the account information used when the user logged in to the website and stored on the user terminal 3.

[0017] The processing device 10 is a device installed with an automatic input system 1 that automatically inputs form fields on a website using data stored in a user terminal 3 or a peripheral device 4. The processing device 10 is, for example, a server equipped with a CPU (Central Processing Unit) and storage.

[0018] As shown in FIG. 2, the automatic input system 1 includes a field detection unit 11, a database information acquisition unit 12, a preview display unit 13, a user information acquisition unit 14, an automatic input unit 15, a screen output unit 16, a control unit 21, and a memory unit 22.

[0019] The field detection unit 11 detects blank form fields and input items for blank form fields among the form fields of a website. The field detection unit 11 is configured to be able to perform OCR (Optical Character Recognition) processing. The field detection unit 11 performs OCR processing on an image of a website to detect all blank form fields and input items for all blank form fields. The input items are items that explain what to input into blank form fields, such as the user's name and contact information.

[0020] The database information acquisition unit 12 acquires information regarding the storage location of the database 5 specified by the user. The user can specify the storage location of the database 5 using an input device provided in the user terminal 3. Specifically, the user can specify the database 5 to be used, such as a database 5 created from account information, a database 5 stored in the user terminal 3, or a database 5 stored in a peripheral device 4. The peripheral device 4 can be specified in detail, such as a USB memory 4 or cloud storage 4. The database information acquisition unit 12 acquires information regarding the storage location of the database 5 specified by the user. The information regarding the storage location of the database 5 acquired by the database information acquisition unit 12 is sent to the user information acquisition unit 14.

[0021] The preview display unit 13 displays a preview screen 33 (see FIG. 3) consisting of blank form fields and input items detected by the field detection unit 11. Only blank form fields and input items on the website are picked up and displayed in an aligned order on the preview screen 33. In addition, appropriate user data has been entered into blank form fields on the preview screen 33 by the automatic input unit 15, which will be described later. In FIG. 3, input items are displayed on the left side, and blank form fields with user data entered into them are displayed on the right side. The user can edit the preview screen 33 using the input device of the user terminal 3.

[0022] The user information acquisition unit 14 acquires user information from the database 5 stored in the user terminal 3 or the peripheral device 4. Specifically, the user information acquisition unit 14 acquires the user information from the database 5 stored in the storage location acquired by the database information acquisition unit 12. The acquired user information is sent to the automatic input unit 15.

[0023] The automatic input unit 15 selects and inputs appropriate user data into form fields of the website from the user information acquired by the user information acquisition unit 14. The automatic input unit 15 also selects and inputs appropriate user data into form fields on the preview screen 33. The automatic input unit 15 is equipped with a machine learning algorithm that learns what to input into input items of blank form fields using a machine learning technique such as an artificial neural network. The automatic input unit 15 acquires input items for blank form fields and uses the machine learning algorithm to select user data appropriate for the input items from the user information. That is, if the input item is a name, the automatic input unit 15 selects the user's name from the user information as user data. The automatic input unit 15 also inputs the selected user data into form fields of the website and the form fields on the preview screen 33.

[0024] The screen output unit 16 outputs the website screen with appropriate user data entered into the website form fields. Specifically, the screen output unit 16 outputs the website image based on an output method selected by the user from among output methods such as printing onto a medium such as a sheet using an image forming device such as a printer, or saving as electronic data in the user terminal 3 or peripheral device 4.

[0025] The control unit 21 is configured by a processor such as a CPU (Central Processing Unit). The control unit 21 executes an automatic input program to control the operations of the field detection unit 11, the database information acquisition unit 12, the preview display unit 13, the user information acquisition unit 14, the automatic input unit 15, and the screen output unit 16.

[0026] The storage unit 22 stores various information, data, programs, etc. The storage unit 22 is configured with a ROM (Read Only Memory) and a RAM (Random Access Memory). The storage unit 22 stores an automatic input program.

[0027] Next, the flow of the automatic input process of the automatic input system 1 according to the embodiment of the present invention will be described using a flowchart with reference to Fig. 3 to Fig. 8. Fig. 4 is a flowchart illustrating the automatic input process of the automatic input system 1 according to the present embodiment. Figs. 5 to 8 are diagrams showing an example of an operation screen 30 of the automatic input system 1 according to the present embodiment. The automatic input process is executed by an automatic input program stored in the processing device 10.

[0028] A user uses user terminal 3 to browse a website, such as an internet shopping website, using a web browser. When the user is about to make a transaction over the internet and is required to input user information, the user activates the auto-input program, thereby operating auto-input system 1. When auto-input system 1 is activated, operation screen 30 is displayed on the web browser, as shown in FIG. 5. A "load" icon 41 is displayed on operation screen 30. When the user selects "load" icon 41, control unit 21 loads the website image displayed on the web browser, and displays website image 31 and an icon 42 for specifying an operation for website image 31 on operation screen 30, as shown in FIG. 6.

[0029] The user selects the "input" icon 42 to input user information into the form fields of the website. When the "input" icon 42 is selected, the field detection unit 11 detects all blank form fields and input items for all blank form fields of the website from the website image 31 (step S10). Information about all blank form fields and input items detected by the field detection unit 11 is sent to the preview display unit 13 and the automatic input unit 15.

[0030] Furthermore, when the "input" icon 42 on the operation screen 30 is selected, as shown in FIG. 7, the control unit 21 displays a database designation screen 32 on the operation screen 30 to allow the user to designate a storage location for the database 5. An icon 43 indicating the storage location of the database 5 is displayed on the database designation screen 32. In the embodiment of FIG. 7, a database 5 created and stored from account information, a database 5 stored in the USB memory 4, and a database 5 stored in the cloud storage 4 can be used. Therefore, the database designation screen 32 displays an "account" icon 43 indicating the database 5 created and stored from account information, a "memory" icon 43 indicating the database 5 stored in the USB memory 4, and a "cloud" icon 43 indicating the database 5 stored in the cloud storage 4.

[0031] The user specifies the database 5 from which user information is to be acquired on the database specification screen 32 (step S12). When the user specifies the storage location of the database 5, the database information acquisition unit 12 acquires information relating to the storage location of the database 5 specified by the user. That is, when the "account" icon 43 is selected, information is acquired that the database 5 created from the account information and stored in the user terminal 3 will be used. The acquired information relating to the storage location of the database 5 is sent to the user information acquisition unit 14.

[0032] When the user information acquisition unit 14 receives information regarding the storage location of the database 5, it acquires the user information from the database 5 stored in the storage location (step S14). For example, when it is specified to acquire the user information from the account information, it acquires the user information from the database 5 created from the account information and stored on the user terminal 3. When it is specified to acquire the user information from the cloud storage 4, it accesses the cloud storage 4 via the network 2 and acquires the user information from the database 5 stored in the cloud storage 4. At this time, all the user information stored in the database 5, such as the user's name, age, address, email address, telephone number, and website membership number, is acquired. The acquired user information is sent to the automatic input unit 15.

[0033] Upon receiving the information about all blank form fields and input items and the user information, the automatic input unit 15 uses a machine learning algorithm to select user data suitable for the input items from the user information (step S16). The automatic input unit 15 selects suitable user data for all input items and inputs the selected user data into the form fields of the preview screen 33.

[0034] On the other hand, when the preview display unit 13 receives information about blank form fields and input items, it displays a preview screen 33 on the operation screen 30, in which all blank form fields and input items are aligned, as shown in Fig. 3 (step S18). At this time, the automatic input unit 15 inputs appropriate user data into the blank form fields on the preview screen 33.

[0035] The user checks on the preview screen 33 whether the information entered by the automatic input unit 15 for the input items in the form fields is appropriate (step S20). If the information entered by the automatic input unit 15 for the input items is not appropriate (No in step S22), the user edits the input information on the preview screen 33 (step S20). For example, if the user data in the name field is incorrect, the name is corrected to the correct name. If the database does not contain the corresponding user information and blank form fields remain, the user manually enters user data into the blank form fields. Specifically, the preview screen 33 displays icons 44 for specifying operations on the preview screen 33. When the "Edit" icon 44 is selected, the preview screen 33 becomes editable. In this state, the form field to be edited is selected and edited using the input device of the user terminal 3.

[0036] The preview screen 33 can be edited manually by the user, or the user information can be acquired and replaced from another database 5. Screens 31, 32, and 33 displayed on the operation screen 30 each display an icon 40 for returning to the previous screen. By selecting the icon 40 on the preview screen 33 to return to the database designation screen 32 and selecting the save location of the database 5 again (step S12), the user information from the other database 5 can be acquired (step S14).

[0037] When the user confirms that appropriate user data has been entered into all form fields on the preview screen 33 (Yes in step S22), the user selects the "Save" icon 44 displayed on the preview screen 33. When the "Save" icon 44 is selected, the website image 31 into which the automatic input unit 15 has entered the user data is displayed, as shown in FIG. 8 (step S24). At this time, if the user data has been edited by the user on the preview screen 33, the automatic input unit 15 stores the user data edited by the user, and the user data edited by the user is entered into the form fields of the website image 31.

[0038] Thereafter, the user selects an icon 42 for specifying an operation for the website image 31 displayed on the operation screen 30, and instructs processing for the website image 31 into which the user data has been input (step S26). That is, if there is no problem with the input items and the website image 31 is to be saved or printed, the user selects the "Save" or "Print" icon 42. On the other hand, if the user wishes to correct the input items again, the user selects the "Input" icon 42.

[0039] When "Save" or "Print" is clicked (Save / Print in step S28), screen output unit 16 follows the instruction to save website image 31 as electronic data in user terminal 3 or peripheral device 4, or prints website image 31 onto a medium such as a sheet using an image forming device such as a printer. Then, the process ends.

[0040] When the "Input" icon 42 is selected (input in step S28), the screen returns to the database specification screen 32. The user then performs the processes from specifying the database 5 (step S12) to issuing instructions for processing the website image 31 (step S26), and corrects the input items.

[0041] When performing automatic input for another website, the automatic input process for the current website is terminated, and the automatic input system 1 is started on the other website, and automatic input is performed in the same manner as above.

[0042] As described above, the automatic input system 1 of the present invention acquires user information using a database 5 created and stored from account information logged in by the user, or a database 5 stored in the user terminal 3 used by the user or a peripheral device 4 connected to the user terminal 3. Then, appropriate user data is entered into form fields on a website based on the acquired user information. This makes it possible to automatically fill in form fields based on information that can be acquired by the user terminal 3 used by the user, even without information generated by machine learning.

[0043] Furthermore, the automatic input system 1 of the present invention allows the user to specify the database 5 to be used. This allows the user to select an appropriate database 5 depending on the content of the user information required on the website, and allows appropriate user data to be automatically input.

[0044] Furthermore, in the automatic input system 1 of the present invention, the input items are input into the form fields of the website after being confirmed on the preview screen 33. On the preview screen 33, only the form fields that require input are picked up and displayed in an aligned order, making the input items easy to see and allowing for easy correction of any incorrectly input items.

[0045] The embodiments of the present invention have been described above with reference to the drawings. However, the present invention is not limited to the above embodiments and can be implemented in various forms without departing from the spirit of the present invention. Furthermore, various inventions can be formed by appropriately combining multiple components disclosed in the above embodiments. For example, some components may be deleted from all the components shown in the embodiments. Furthermore, the components shown in the above embodiments are merely examples and are not particularly limited, and various modifications are possible within a range that does not substantially deviate from the configuration of the present invention.

[0046] In the above embodiment, the automatic input system 1 includes the field detection unit 11, the database information acquisition unit 12, the preview display unit 13, the user information acquisition unit 14, the automatic input unit 15, the screen output unit 16, the control unit 21, and the storage unit 22, but the present invention is not limited to this. For example, if input is made directly into a form field on a website without displaying the preview screen 33, the preview display unit 13 may not be provided.

[0047] The automatic input system 1 may also be configured as shown in Fig. 9. Fig. 9 is a functional block diagram showing functions of an automatic input system according to another embodiment of the present invention. That is, the automatic input system 1 may further include a signature data acquisition unit 17 that acquires user signature data stored as image data in the user terminal 3 or the peripheral device 4. In this embodiment, when the automatic input unit 15 determines that a user signature is requested in a form field of a website, it causes the signature data acquisition unit 17 to acquire the signature data. Then, the automatic input unit 15 inserts the signature data acquired by the signature data acquisition unit 17 into the form field of the website. The user can edit the position of the inserted signature data on the website image 31.

[0048] In the above embodiment, the website image 31 is output by printing on a medium or saving on the user terminal 3 or peripheral device 4, but the present invention is not limited thereto. For example, if the user data includes the user's email address, the screen output unit 16 can output the website image based on an output method selected by the user from among printing on a medium, saving on the user terminal 3 or peripheral device 4, and sending to an email address. Specifically, when the automatic input unit 15 determines that the user data includes the user's email address, the control unit 21 displays an "email" icon 42 for sending to an email address among the icons 42 for specifying operations for the website image 31. When the user selects the "email" icon 42, the screen output unit 16 sends the electronic data of the website image 31 to the user's email address in accordance with the instructions. [Industrial Applicability]

[0049] The present invention can be used in the field of automatic entry systems that use stored data to automatically fill in forms. [Explanation of symbols]

[0050] 1. Auto-fill system 2 Network 3. User terminal 4 Peripherals 5 Database 11 Field detection section 12 Database information acquisition section 13 Preview display area 14 User information acquisition unit 15 Automatic input section 16 Screen output section 17 Signature data acquisition unit 33 Preview screen

Claims

1. a user information acquisition unit that acquires user information from a database stored in a user terminal or a peripheral device connected to the user terminal directly or via a network; an automatic input unit that selects and inputs appropriate user data into form fields on a website from the user information acquired by the user information acquisition unit; An automatic input system comprising:

2. a database information acquisition unit that acquires information about a storage location of the database designated by a user; The automatic input system according to claim 1 , wherein the user information acquisition unit acquires the user information from the database stored in the storage location acquired by the database information acquisition unit.

3. a field detection unit that detects blank form fields among the form fields of the website and input items for the blank form fields; a preview display unit that displays a preview screen including the blank form fields and the input items detected by the field detection unit; Furthermore, 3. The automatic input system according to claim 1, wherein the automatic input unit selects and inputs appropriate user data into form fields on the preview screen.

4. a signature data acquisition unit that acquires user signature data stored as image data in the user terminal or the peripheral device; The automatic input system according to claim 3 , wherein the automatic input unit inserts the signature data acquired by the signature data acquisition unit into the form field of the website.

5. a screen output unit that outputs a screen of the website on which the appropriate user data has been entered into the form fields of the website; The automatic input system according to claim 3 , wherein the screen output unit outputs the website image based on an output method specified by the user, from among printing on a medium and saving on the user terminal or the peripheral device.

6. The automatic input system of claim 5, wherein if the user data includes the user's email address, the screen output unit outputs an image of the website based on an output method selected by the user from among printing on a medium, saving on the user terminal or peripheral device, and sending to the email address.

7. On the computer, acquiring user information from a database stored in a user terminal or a peripheral device connected to the user terminal directly or via a network; selecting and inputting appropriate user data into form fields of a website from the obtained user information; An auto-input program that performs a process including:

Images