Method for supporting data input of business form

Abstract

To provide a method for supporting the data input of a slip for efficiently performing the result report of a job site without forcing burdens on a person in charge of the job site who performs the result report in a manufacturing job site.SOLUTION: In a method in a system 1 for supporting data entry of a business form by user terminals 200A and 200B operated by a field person in charge user, a control part of a server terminal 1 refers to business form template data stored in a storage part, detects an item frame, an item name, and an input frame in the business form template data, determines a correspondence relation between the detected item frame and input frame, and converts them into electronic business form template data which can be input by handwriting.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a method for supporting data entry into a report form for reporting performance at a manufacturing site or the like. [Background technology]

[0002] Conventionally, in manufacturing and other workplaces, on-site personnel would handwrite necessary information onto paper forms, and another person would then manually enter the information written on the collected paper forms into digital-format forms.

[0003] In recent years, there has been a growing trend to digitize reports on the performance of on-site work. For example, Patent Document 1 discloses that on-site workers can input questions via an electronic chat screen displayed on a terminal. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent No. 6396561 Summary of the Invention [Problem to be solved by the invention]

[0005] However, the technology disclosed in Patent Document 1 imposes a burden on field workers in terms of input work and implementation. In particular, field workers who are accustomed to writing by hand on existing paper will face a large burden and resistance to "keyboard input," "typing input," and "flick input," which are required as input methods on tablet devices and smartphones.

[0006] Therefore, an object of the present invention is to provide a data entry support method that enables on-site performance reports to be made efficiently without imposing a burden on on-site personnel who make performance reports at the manufacturing site. [Means for solving the problem]

[0007] In one aspect of the present invention, there is provided a method for assisting field personnel in entering data into forms, in which a control unit of a server terminal references form template data stored in a memory unit, detects item boxes, item names, and input boxes in the form template data, determines correspondences between the detected item boxes and input boxes, and converts the data into electronic form template data that can be entered by hand. [Effects of the Invention]

[0008] According to the present invention, it is possible to provide a data entry support method that enables on-site performance reports to be made efficiently without imposing a burden on on-site personnel who make performance reports at the manufacturing site. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a block diagram showing a data entry support system according to a first embodiment of the present invention; [Figure 2] FIG. 2 is a functional block diagram showing the server terminal 100 of FIG. [Figure 3] FIG. 2 is a functional block diagram showing the user terminal 200 of FIG. [Figure 4] FIG. 2 is a diagram showing an example of user data stored in the server 100. [Figure 5] FIG. 2 is a diagram showing an example of form data stored in the server 100. [Figure 6] 3 is a flowchart showing an example of processing of a data entry assistance method according to the first embodiment of the present invention. [Figure 7] 10 is a flowchart showing another example of the process of the data entry assistance method according to the first embodiment of the present invention. [Figure 8] FIG. 3 is a diagram illustrating an example of form template data according to the first embodiment of the present invention. [Figure 9] FIG. 2 is a diagram illustrating an example of a user interface screen of an electronic form template displayed on a user terminal according to the first embodiment of the present invention. [Figure 10]FIG. 10 is a diagram illustrating another example of a user interface screen of an electronic form template displayed on a user terminal according to the first embodiment of the present invention. [Figure 11] FIG. 10 is a diagram illustrating another example of a user interface screen of an electronic form template displayed on a user terminal according to the first embodiment of the present invention. [Figure 12] 1A and 1B are diagrams illustrating a method for generating structured data from handwritten input data according to a first embodiment of the present invention. [Figure 13] FIG. 10 is another diagram illustrating the method for generating structured data from handwritten input data according to the first embodiment of the present invention. [Figure 14] FIG. 1 is a diagram illustrating a method for visualizing structured data according to a first embodiment of the present invention. [Figure 15] 1A and 1B are diagrams illustrating a method for character recognition of handwritten input data according to a first embodiment of the present invention. [Figure 16] 10 is a flowchart showing yet another example of the processing of the data entry assistance method according to the first embodiment of the present invention. [Figure 17] FIG. 3 is a diagram illustrating one step for creating an electronic form template according to the first embodiment of the present invention. [Figure 18] FIG. 10 is a diagram illustrating another process for creating an electronic form template according to the first embodiment of the present invention. [Figure 19] FIG. 10 is a diagram illustrating yet another process for creating an electronic form template according to the first embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, embodiments of the present invention will be described with reference to the drawings. Note that the embodiments described below do not unduly limit the content of the present invention described in the claims. Furthermore, not all of the components shown in the embodiments are necessarily essential components of the present invention.

[0011] <Configuration> 1 is a block diagram showing a data entry support system according to a first embodiment of the present invention. This system 1 includes a server terminal 100 that generates electronic form template data for handwritten input from pre-stored form template data, receives handwritten input data from on-site personnel in a factory or the like via a user terminal, generates structured data based on the handwritten input data using a method such as character recognition, and stores the structured data as final data, and user terminals 200A and 200B operated by the on-site personnel users. For ease of explanation, each terminal is described as being a single terminal or a specific number of terminals, but the number of each terminal is not limited.

[0012] The server terminal 100 and the user terminals 200A and 200B are connected to each other via a network NW1. The network NW is configured by the Internet, an intranet, a wireless LAN (Local Area Network), a WAN (Wide Area Network), or the like.

[0013] The server terminal 100 may be, for example, a general-purpose computer such as a workstation or a personal computer, or may be logically realized by cloud computing.

[0014] The user terminals 200A and 200B are, for example, information processing devices such as tablet terminals, but may also be configured as smartphones, mobile phones, PDAs, personal computers, or the like.

[0015] In this embodiment, the system 1 is described as having a configuration in which the user of each terminal uses the server terminal 100 and user terminals 200A and 200B to operate the server terminal 100, but the server terminal 100 may be configured as a standalone unit and may have a function for each user to directly operate the server terminal 100. Hereinafter, the user terminals 200A and 200B will be collectively referred to as user terminal 200, as necessary.

[0016] Fig. 2 is a functional block configuration diagram of the server terminal 100 of Fig. 1. The server terminal 100 includes a communication unit 110, a storage unit 120, and a control unit .

[0017] The communication unit 110 is a communication interface for communicating with the user terminal 200 via the network NW1, and communication is performed according to a communication protocol such as TCP / IP (Transmission Control Protocol / Internet Protocol).

[0018] The storage unit 120 stores input data, programs for executing various control processes and functions in the control unit 130, and is composed of RAM (Random Access Memory), ROM (Read Only Memory), etc. The storage unit 120 also has a user data storage unit 121 that stores various data related to users who are non-desk workers in companies engaged in, for example, manufacturing, building maintenance, construction, food service, field sales, etc. (hereinafter, manufacturing, etc.), and a form data storage unit 122 that stores various data related to forms such as work records at factory sites. Note that a database (not shown) storing various data may be constructed outside the storage unit 120 or the server terminal 100.

[0019] The control unit 130 controls the overall operation of the server terminal 100 by executing programs stored in the storage unit 120, and is composed of a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), etc. Functions of the control unit 130 include an information accepting unit 131 that accepts information such as handwritten input data from the user terminal of a field worker user at a factory or the like, a character recognition processing unit 132 that performs character recognition processing on the handwritten input data, and a form data processing unit 133 that stores form template data, electronic form template data for handwritten input, structured data, etc. The information accepting unit 131, character recognition processing unit 132, and form data processing unit 133 are activated by programs stored in the storage unit 120 and executed by the server terminal 100, which is a computer (electronic calculator).

[0020] The information receiving unit 131 receives information from the user terminal 200 via the communication unit 110. For example, data handwritten on an electronic document template is received from the user terminal 200 as coordinate data and handwriting data.

[0021] The character recognition processing unit 132 performs character recognition processing on the handwritten input data received from the user terminal 200, and generates digital data.

[0022] The form data processing unit 133 performs predetermined processing such as generating structured data based on the digital data generated as a result of character recognition and storing the generated structured data.

[0023] The control unit 130 may also have a screen generation unit (not shown), which generates screen information to be displayed via the user interface of the user terminal 200 upon request. For example, the control unit 130 generates a user interface by using image and text data (not shown) stored in the storage unit 120 as material and arranging various images and text in predetermined areas of the user interface based on predetermined layout rules. Processing related to the image generation unit may also be executed by a GPU (Graphics Processing Unit).

[0024] Fig. 3 is a functional block diagram showing the user terminal 200 of Fig. 1. The user terminal 200 includes a communication unit 210, a display operation unit 220, a storage unit 230, and a control unit 240.

[0025] The communication unit 210 is a communication interface for communicating with the server terminal 100 via the network NW, and communication is performed according to a communication protocol such as TCP / IP.

[0026] Display operation unit 220 is a user interface used for allowing a user to input instructions and for displaying text, images, etc. in accordance with input data from control unit 240, and is configured with a display, keyboard, and mouse when user terminal 200 is configured as a personal computer, and is configured with a touch panel, etc. when user terminal 200 is configured as a smartphone or tablet terminal. This display operation unit 220 is started up by a control program stored in storage unit 230 and executed by user terminal 200, which is a computer (electronic calculator).

[0027] The storage unit 230 stores input data, programs for executing various control processes and functions in the control unit 240, and is composed of RAM, ROM, etc. The storage unit 230 also temporarily stores the contents of communication with the server terminal 100.

[0028] The control unit 240 controls the overall operation of the user terminal 200 by executing the programs stored in the storage unit 230, and is composed of a CPU, a GPU, and the like.

[0029] FIG. 4 is a diagram showing an example of user data stored in the server 100. As shown in FIG.

[0030] The user data 1000 shown in Fig. 4 stores various data related to a user. For convenience of explanation, Fig. 4 shows an example of one user (a user identified by a user ID "10001"), but information on multiple users can be stored. The various data related to a user can include, but is not limited to, basic information about the user (e.g., company name, address, name of person in charge, department name, contact information, etc.) and report data such as work records from a factory site (IDs that identify reports stored as report data).

[0031] FIG. 5 is a diagram showing an example of form data stored in the server 100. As shown in FIG.

[0032] The form data 2000 stores various data related to forms such as work records from a factory site. For ease of explanation, FIG. 5 shows an example of one form (a form identified by form ID "20001"), but information related to multiple forms can be stored. The form data can include, but is not limited to, form template data, which is template data that defines input fields and input formats when a corporate user engaged in manufacturing or the like transcribes data handwritten into paper forms such as work records from a factory site into a file in a predetermined format such as Excel or CSV and records the data as structured data; electronic form template data, which is generated based on the form template data and displayed on a user terminal used by a site user, and converts data such as work records into a format that can be entered by hand; and structured data (text, numbers, symbols, identifiers, timestamps, etc.) generated through character recognition based on data handwritten by a site user into an electronic form template displayed on the user terminal. In addition, as document data, it is also possible to store the user's handwriting data and coordinate data, which are recognized as the handwritten input data necessary to perform character recognition during the character recognition process, and / or a learning model generated by learning the input items, input areas, and their coordinate information contained in the electronic document template data, as well as the text data and structured data as the character recognition results.

[0033] 6 is a flowchart showing an example of processing in a data entry support method according to the first embodiment of the present invention. A user in charge of a company engaged in manufacturing or the like refers to data handwritten on a paper form, such as a work record from a factory floor, and transcribes the data into a file in a predetermined format, such as Excel or CSV, in which data input items and input formats are predefined, to record the data as structured data. The user then transmits (uploads) the form template data in the predetermined format to the server terminal 100 via the user terminal 200. When the information accepting unit 131 of the control unit 130 of the server terminal 100 receives the form template data, the template data processing unit 133 of the control unit 130 associates the form template data with the user data and stores it in the form data storage unit 122 of the memory unit 120.

[0034] As the processing of step S101, the template data processing unit 133 of the control unit 130 of the server terminal 100 refers to the report data storage unit 122 and performs a read process of the report template data stored as report data 2000 based on a request from the user terminal 200 of the company's responsible user.

[0035] 8, a company user has form template data in a predetermined format such as Excel, and while referring to handwritten data entered on a paper form, transcribes the data into form template data 800. The company user requests the loading of a file uploaded in advance via a user interface screen displayed on the user terminal 200, and instructs the loading of the form template data.

[0036] Next, in the processing of step S102, the document data processing unit 133 of the control unit 130 of the server terminal 100 refers to the document data storage unit 122 of the memory unit 120, reads the document template data for which a read request has been made, and performs processing to convert it into electronic document template data that can be input by handwriting.

[0037] For example, as shown in Fig. 9, electronic form template data 900 is characterized by having input items and input areas common to the form template data 800 shown in Fig. 8 and being template data that allows handwritten input. The data format of the electronic form template data 900 can be the same format as the form template data 800 (in this example, Excel, CSV, etc.), or can be any format (PDF, etc.). In this way, by making the electronic form template data template data that allows handwritten input, on-site personnel at a factory or the like can input data while working. Furthermore, compared to digital data input, data input can be done intuitively, as if writing on a paper form, so there are no barriers to introducing tools and the introduction costs can be saved.

[0038] 7 is a flowchart showing another example of the processing of the data input support method according to the first embodiment of the present invention. In this example, a user in charge of a company engaged in manufacturing or the like installs a form input support application on a user terminal 200 such as a tablet, starts the application, and inputs a record of processing work as a manufacturing journal via the electronic form template shown in FIG. 6 and displayed on the user terminal 200.

[0039] In step S201, the user in charge handwrites data using a stylus pen or the like into the electronic form template displayed on the user terminal 200, and the information receiving unit 131 of the control unit 130 of the server terminal 100 receives the handwritten input data from the user terminal 200. Here, the handwritten input data includes the user's handwriting data and coordinate data, and / or input items, input areas, and their coordinate information included in the electronic form template data. For example, as shown in FIG. 9, the user can handwrite input data into predetermined input items of the electronic form template 900, such as processing time and number of defective products. Here, along with the handwritten character input, the user in charge can also transmit media data, such as images (including videos) captured on the site using the user terminal 200 or the like and / or recorded audio, to the server terminal 100.

[0040] In step S202, the character recognition processing unit 132 of the control unit 130 of the server terminal 100 generates digital text data based on the handwritten input data. The character recognition processing unit 132 recognizes the input characters using a method such as pattern matching based on the handwriting data and coordinate data as the handwritten input data, and performs processing to infer which characters have been input into which input field and / or input area based on the input coordinates in the electronic form template displayed on the user terminal 200. Furthermore, during character recognition, a learning model generated by machine learning based on the input handwriting data, coordinate data, and output text data and structured data can also be used. The processing performed by the character recognition processing unit 132 can also be executed by a program installed on the user terminal 200.

[0041] Here, when generating digital text data based on handwritten input data, the character recognition processing unit 132 can also generate digital text data by performing character recognition processing based on OCR processing on image data generated based on an electronic form template including the handwritten input data.The character recognition processing unit 132 then outputs the generated text data to the input box of the electronic form template.

[0042] Here, in the character recognition process, if the data handwritten by the user differs from data the user has previously entered or differs from a specified range, the character recognition processing unit 132 can notify the user terminal 200 of the person entering the data or the administrator of an error in real time or present predictive conversion candidates. Alternatively, if there is a possibility of an input error as described above, the character recognition processing unit 132 can convert the data based on the handwritten input data and distinguishably display the area where the output text data is displayed by color.

[0043] Furthermore, in the character recognition process, if handwritten input is made outside the input area (frame) on the electronic document template, the character recognition processing unit 132 recognizes the coordinates of the start point where the input was made and the end point where the first character input is completed on the electronic document template, determines that the input was made in the input area (frame) that includes these coordinates, and can output characters (numbers) converted from the handwritten input data so that they fit into the determined input frame.

[0044] Furthermore, in the character recognition process, characters handwritten by a user may be converted into similar characters (e.g., the number "2" and the letter "z," or the number "0" and the letter "o"). In such cases, as shown in FIG. 15, the input data can be predicted based on data previously entered in the same form type and in the same input field (box) and converted into text. For example, when "123.4" is handwritten, to prevent the handwritten input data from being recognized as "1z314," the character recognition processing unit 132 can predict that the accepted handwritten input data is a number including a decimal point based on a database of structured data previously entered in the same input field of the same form and stored in the form data storage unit 122 of the memory unit 120 and similar symbols. The input data can also be predicted based on data previously registered by the user, along with or instead of the previously entered data. Here, the user can pre-register input rules for a given entry box, such as that only numbers and "." can be entered in the entry box, that a choice of characters can be specified for the entry box (for example, allowing the selection of part name A, part name B, or part name C), that only the date can be entered in the entry box, or that only the worker's name or a unique ID that manages the worker can be entered.

[0045] Furthermore, after the character recognition process, the user in charge can check the displayed text data, such as characters and numbers, that is output to the input boxes of the electronic document template, and manually edit the text data for each input box, correcting, adding, or deleting the text data.

[0046] Next, in step S203, the character recognition processing unit 132 stores the recognized characters as structured data in the form data storage unit 122 of the storage unit 120. As an example of the process of recognizing as structured data, in an electronic form template 1200 displayed on the user terminal 200 shown in FIG. 12, the areas included in the template are divided into 1) an area 1210 where the user cannot fill in or select and where information indicating the type of form is displayed (in this example, the form name "Processing Quality Check Sheet" linked to the form ID, etc.), 2) an area 1220 where the user can fill in or select and where the input information affects all the information included in the form (in this example, "Part Number BK The input information is categorized into areas 1230 (in this example, "laser removal," "start and end checks," "work date," "operator," etc.) related to the information contained in the rows and columns of the form, and the information input for each area is recognized. When the above 2) and 3) are entered or selected, the input data (characters, numbers, symbols, etc.) recognized in each area is converted into structured data as shown in FIG. 13 together with the timestamps based on the timestamp assigned to the time of input, the timestamp assigned to the time of application for approval of the input contents, and the timestamp assigned to the time of approval.

[0047] 13, in a sheet 1300 output as structured data, the character recognition processor 132 displays the input data recognized in 1) above in an area 1310 that outputs a form ID, the input data recognized in 2) above in an area 1320 that displays records relating to the entire form, and the input data recognized in 3) above in an area 1330 that displays information identifying rows and columns (identifiers defined as column "A," row "1," column "B," row "1," column "A," row "3," etc.) and an area 1340 that displays information entered in the identified rows and columns, along with timestamps indicating the time of entry, application, and approval. This allows handwritten input data to be converted into structured data for recording and management. Furthermore, by recording and managing this input data together with the name of the person who entered it and a timestamp, the traceability of the recorded data can be ensured. As described above, each field in the electronic form template is assigned an identifier. For example, the field displaying the input data in 2) above is designated "1" (the field displaying "BK"), and the field displaying the input data in 3) above is designated "A1" (check at the start of laser punching), "B1" (check at the end of laser punching), "A3" (check at the start of nut press-fitting), etc., depending on the row and column. Using the form ID, identifier, and timestamp, the vertical axis represents the entry content (e.g., numerical value), the horizontal axis represents the entry date, and each row and column identifier ("check at the start of laser punching" or "check at the end of laser punching") is visualized as a legend, as shown in Figure 14. Furthermore, based on the above information, such as the "form ID," "identifier," and "timestamp," a company's responsible user or administrator user can perform a search to obtain the desired information.

[0048] As shown in FIG. 10 , when handwritten data is output as structured data to an electronic form template, the field staff user can issue a data recording request to the server terminal 100 via the user terminal 200. The form data processing unit 133 of the control unit 130 of the server terminal 100 stores the structured data in the form data storage unit 122 of the memory unit 120. At the same time, the form data processing unit 133 can also assign a timestamp to the time the structured data was recorded and store it in the form data storage unit 122 together with information about the person who filled it out. Furthermore, as shown in FIG. 11 , after recording the structured data, the field staff user can also submit an approval request for the input content to the administrator user, who is the approver. At the same time, the form data processing unit 133 can also assign a timestamp to the time the structured data was applied for and store it in the form data storage unit 122 together with information about the applicant. When the administrator user receives the approval request for the input data via the server terminal 100 on the administrator user's user terminal 200 (for example, a user terminal 200B different from the user terminal 200A of the field staff user) and performs the approval process, the server terminal 100 receives the approval information from the user terminal 200B, assigns an approved status to the structured data, and simultaneously assigns a timestamp, stores this information in the report data storage unit 122 of the memory unit 120, and sends a notification to the field staff user's user terminal 200A that the data input has been approved.

[0049] As described above, when the on-site staff user records the handwritten input data as structured data, the structured data is stored and accumulated in the form data storage unit 122 of the memory unit 120 of the server terminal 100. Using the accumulated structured data as a dataset, the server terminal 100 can generate a response to a question requested by the staff user by linking with a large-scale language model (e.g., chat GPT). For example, when the staff user inputs a question via a predetermined chat user interface displayed on the user terminal 200, such as "For product XD-112, please summarize the top three performance data items with the highest number of defects and consider the common cause," the server terminal 100 can refer to the dataset stored in the form data storage unit 122 and, based on the large-scale language model, generate a response such as "The top three are as follows. (Present the performance data for the top three.) The common cause is that worker A is working on it," and transmit the response to the user terminal 200. In addition, in response to a question such as "Please analyze the inventory change of part A in the inventory management form over the past 10 days and suggest the next order timing," it is possible to generate a response such as "200 units of part A have been used in 10 days. If this change continues, the next order will need to be placed in 40 days." Here, the form data that is the source of the data set can be managed for each company in the form data storage unit 122, which can improve the accuracy of answers to questions while ensuring security.

[0050] 10 is a flowchart showing yet another example of the processing of the data input support method according to the first embodiment of the present invention. In this example, in the processing of converting form template data into electronic form template data as described in FIG. 6, the object is to improve the detection accuracy of input items (item names) and input areas (entry frames), and further improve the input accuracy of the user.

[0051] Similarly to the above, a company user in charge transmits (uploads) form template data in a predetermined format such as Excel or CSV (or image data such as JPG) to the server terminal 100 via the user terminal 200. When the information receiving unit 131 of the control unit 130 of the server terminal 100 receives the form template data, the template data processing unit 133 of the control unit 130 stores the form template data in the form data storage unit 122 of the memory unit 120 in association with the user data.

[0052] In the processing of step S301, the template data processing unit 133 of the control unit 130 of the server terminal 100, based on a request from the user terminal 200, refers to the form data storage unit 122, performs a read process of the form template data stored as form data 2000, and detects an area in the form template data that will serve as an entry frame by image recognition.

[0053] 17, for example, template data processing unit 133 detects entry boxes and areas in form template data through image recognition processing. Here, information receiving unit 131 of control unit 130 of server terminal 100 can also determine the entry boxes by receiving input from the user adjusting the size of the rectangular frame that will serve as the entry box in the form template data displayed on user terminal 200. This can also improve the accuracy of the entry boxes in the template data.

[0054] Next, in the process of step S302, the character recognition processing unit 132 of the control unit 130 of the server terminal 100 detects item frames and item names in the form template data by character recognition based on OCR processing. For example, in Fig. 17, item frames and item names such as "Product Name," "Contact Person," and "Processing Details" are included.

[0055] Next, in step S303, the form data processing unit 133 of the control unit 130 of the server terminal 100 executes a matching process between the detected item boxes and item names in the form template data and entry boxes. This process determines which input box corresponds to which item box containing an item name. The correspondence between the item boxes and input boxes can be estimated based on the positional relationship between the item boxes and input boxes, or by referencing electronic form template data created by a previous user or another user. The form data processing unit 133 stores the correspondence between the item boxes and input boxes as multiple patterns and infers the correspondence from the patterns. For example, as shown in FIG. 18, the form data processing unit 133 determines entry boxes for each item in the "Defect Details" section, such as "Short," "Foreign Material," and "Bur," as well as entry boxes for "Abnormal Details (Immediate Report)," "Instructor," and "Entry Person," based on the positional relationship between each item box and entry box. After determining the correspondence between the item boxes and entry boxes, the form data processing unit 133 can determine the optimal entry method for each item. For example, when recognizing that a field is a field related to a date, such as "Entry Date," the corresponding input field can be set to allow the user to enter a calendar entry. Also, when recognizing that a field is a field named "Entry By," the corresponding input field can be set to allow the user to enter the name of the logged-in user. These processes can be estimated by the form data processing unit 132 by referencing input information for form template data and / or electronic form template data by past users or other users using machine learning or other methods. Also, as shown in FIG. 19 , the form data processing unit 133 can recognize the characters and size of input data (e.g., text data) for an input field, define a maximum rectangle and margins, and determine whether the input field is an entry field or an item field based on the definitions. The form data processing unit 133 determines the correspondence between the field and the input field in this way, and stores the determined correspondence in the form data storage unit 122 of the storage unit 120 as electronic form template data.On the other hand, for forms whose input method is difficult to infer from item names such as "product number," "product name," "task content," and "molding lot," input methods associated with each item frame (item name) can be stored in advance in the form data storage unit 122 of the storage unit 120, and the input method can be inferred based on a rule base, or by inferring using a learning model generated by machine learning based on data digitized by OCR processing or the like from the contents of paper forms entered by actual workers, or by combining inference by machine learning based on the above-mentioned item frame (item name) c. This makes it possible to infer the input method for items whose input method is difficult to understand at a glance from the item name, such as a method of connecting a predetermined number of digits with a hyphen for "product number," a method of entering "product name" in katakana, a method of selecting "task content," and a date method for "molding lot," by learning based on the contents actually entered on paper forms.

[0056] Furthermore, when the form data processing unit 133 receives handwritten input from a user into an input box of electronic form template data via the user terminal 200, it detects the trajectory of the user's input relative to the input box based on the input position of several strokes entered by the user, and can infer which input box the user is entering data into based on the proportion of the trajectory to the input box. This makes it possible to detect which input box the user is entering data into, even if the user enters data outside the input box. Furthermore, the form data processing unit 133 references previous user input information based on text information recognized by character recognition processing unit 132 in response to the user's handwritten input, and displays candidate text information within or adjacent to the input box of the electronic form template data displayed on the user terminal 200, thereby improving the accuracy of user data entry.

[0057] Furthermore, when the form data processing unit 133 receives handwritten input from a user into an input box of electronic form template data via the user terminal 200, it detects the trajectory of the user's input relative to the input box based on the input position of several strokes entered by the user, and can infer which input box the user is entering data into based on the proportion of the trajectory to the input box. This makes it possible to detect which input box the user is entering data into, even if the user enters data outside the input box. Furthermore, the form data processing unit 133 references previous user input information based on text information recognized by character recognition processing unit 132 in response to the user's handwritten input, and displays candidate text information within or adjacent to the input box of the electronic form template data displayed on the user terminal 200, thereby improving the accuracy of user data entry.

[0058] In this way, when the worker user completes data input into the electronic form template data, a report such as a work log is created, and an input completion instruction is received from the user, the form data processing unit 133 stores the data input into the electronic form template data as report data in the form data storage unit 122 of the memory unit 120 as structured data. The reporter data can be confirmed by a user such as an administrator on a management screen or the like displayed on the user terminal 200, and can also be output as PDF data. The administrator user can edit the report data displayed on the user terminal 200 and can finally perform approval processing. The report data edited and / or approved by the administrator user is updated as needed, and the worker user or administrator user can check the final report data in real time on their respective user terminals 200.

[0059] As described above, according to this embodiment, by inputting data into an electronic form template by handwriting, it is possible to structure and record the input data without imposing a burden on the on-site personnel who report performance at the manufacturing site, thereby realizing a data input support method that enables efficient performance reporting at the site. Furthermore, it is possible to improve the accuracy of generating an electronic form template from the original image data or form template data, and also to improve the accuracy of user input into the electronic form template.

[0060] Although the embodiments of the present invention have been described above, they can be embodied in various other forms, and various omissions, substitutions, and modifications can be made. These embodiments, modifications, and omissions, substitutions, and modifications are included in the technical scope of the claims and their equivalents. [Explanation of symbols]

[0061] 1 System 100 Server terminal, 110 Communication unit, 120 Storage unit, 130 Control unit, 200 User terminal, NW1 Network

Claims

1. A method for supporting a field staff member in entering data into a form, comprising: The control unit of the server terminal Refer to the form template data stored in the memory unit, Detecting each of the item frames, item names, and input frames in the form template data; determining a correspondence between the detected item box and the input box; A method for converting data into electronic document template data that can be input by hand.

2. 10. The method of claim 1, The method includes transmitting the electronic form template data to a user terminal of the on-site staff member.

3. 3. The method of claim 2, The control unit Accepting handwritten input data from the user terminal; generating structured data based on the input data; The method stores the structured data in the storage unit.

4. 4. The method of claim 3, The control unit A method for converting the input data into structured data based on which input field in the electronic form template the input data is entered into.

5. 5. The method of claim 4, The control unit A method in which the input areas are composed of areas that cannot be filled in or selected, areas that can be filled in or selected and affect the entire electronic form template, and areas that can be filled in or selected and affect rows and columns in the electronic form template.

Images