Image processing apparatus and image forming apparatus

Abstract

To reduce an amount of data necessary for storage of a file in which character strings read from a document image are recorded.SOLUTION: An image forming apparatus 1 comprises a control unit 100 that analyzes a document image obtained through reading performed by a document reading unit 5, based on predetermined format information, detects answer entry columns included in the document image and question items corresponding to the answer entry columns, extracts character strings as answers entered in the answer entry columns, and additionally writes the extracted character strings in a character string file already stored in a character string file storage unit 81 and designated by a user through operations to an operation unit 47 in association with character strings indicating question items recorded in the character string file.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present invention relates to an image processing apparatus and an image forming apparatus, and particularly to a technique for extracting necessary character strings from a document image.

Background Art

[0002] The following Patent Document 1 describes that in an image processing apparatus, character recognition processing is performed on an image obtained by scanning a questionnaire sheet, and the result of the recognition processing is stored in a memory.

Prior Art Document

Patent Document

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Documents such as questionnaire sheets (paper documents) have a layout in which a character string indicating a question item (for example, First Name, Last Name, E-mail) is associated with an answer entry field in which specific contents for the question item are entered.

[0005] If an image of such a document is read by an image processing apparatus, character recognition processing and the like are performed, a character string indicating a question item and a character string indicating an answer to the question item are detected, a file for recording these character strings is created and stored in a memory, and the document is digitized, then necessary information can be easily and quickly searched. Also, the storage space for the document can be made unnecessary.

[0006] However, if a file for recording these character strings is created every time a document is read (scanned), the amount of data required for file storage increases, and it may become difficult to effectively use the memory.

[0007] This invention has been made in view of the above circumstances, and aims to reduce the amount of data required to save a file in which a string of characters read from an original image is recorded. [Means for solving the problem]

[0008] An image processing apparatus according to one aspect of the present invention includes: a string file storage unit that stores a string file in which strings indicating question items and strings indicating answers to the question items are recorded in association; an operation unit that accepts operations; a document reading unit that reads an image of a document; and a control unit that analyzes the document image obtained by reading by the document reading unit, detects the answer entry field and the question items contained in the document image based on predetermined format information that indicates the answer to be extracted from the document image to be entered in the answer entry field and the question items corresponding to the answer entry field, extracts the string as the answer entered in the answer entry field, and adds and writes the extracted string to the string file already stored in the string file storage unit, which is specified by the user through an operation to the operation unit, in association with the string indicating the question items recorded in the string file.

[0009] Furthermore, an image forming apparatus according to one aspect of the present invention comprises the above-mentioned image processing apparatus and an image forming unit that forms an image on a recording medium. [Effects of the Invention]

[0010] According to the present invention, since the string read from the original image is added to an existing string file, it becomes possible to reduce the amount of data required to save the file on which the string is recorded. [Brief explanation of the drawing]

[0011] [Figure 1] This is a perspective view showing the appearance of an image forming apparatus to which an image processing apparatus according to one embodiment of the present invention is applied. [Figure 2]It is a functional block diagram schematically showing the main internal configuration of an image forming apparatus. [Figure 3] It is a diagram showing an example of a document image. [Figure 4] It is a diagram showing an example of format information. [Figure 5] It is a diagram showing an example of a CSV file. [Figure 6A] It is a flowchart showing the processing when the string save mode is executed. [Figure 6B] It is a flowchart showing the processing when the string save mode is executed. [Figure 6C] It is a flowchart showing the processing when the string save mode is executed. [Figure 7] It is a diagram showing an example of a selection screen displayed on a display unit. [Figure 8] It is a diagram showing an example of an original document image. [[ID=2环6]] [Figure 9] It is a diagram showing the original document image displayed on the display unit. [Figure 10] It is a diagram showing a state in which an answer entry field and a question item designated by a user are highlighted in the original document image displayed on the display unit. [Figure 11] It is a diagram showing the whole of the highlighted original document image. [Figure 12] It is a diagram showing a state in which image files are listed and displayed on a display unit. [Figure 13] It is a diagram showing an example of an expanded image file. [Figure 14] It is a diagram showing an example of a selection screen displayed on a display unit. [Figure 15] It is a diagram showing a state in which string files are listed and displayed on a display unit. [Figure 16] It is a diagram showing an example of an updated CSV file. [Figure 17] (A) is a diagram showing a state in which string files are listed and displayed on a display unit, and (B) is a diagram showing a state in which the string file selected by a user is highlighted. [Figure 18]It is a diagram showing an example of a selection screen displayed on a display unit. [Figure 19] (A) and (B) are diagrams showing a state in which string files are listed and displayed on a display unit.

Embodiment for Carrying Out the Invention

[0012] Hereinafter, an image processing apparatus and an image forming apparatus according to an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a perspective view showing the appearance of an image forming apparatus to which an image processing apparatus according to an embodiment of the present invention is applied. FIG. 2 is a functional block diagram schematically showing the main internal configuration of the image forming apparatus.

[0013] The image forming apparatus 1 is, for example, a multifunction machine having a plurality of functions such as a copying function, a printer function, a scanner function, and a facsimile function, and the apparatus main body 11 includes a control unit 10, a document feeder 6, a document reading unit 5, an image forming unit 12, a fixing unit 13, a paper feeding unit 14, an operation unit 47, and a storage device 8.

[0014] The document feeder 6 is configured to be openable and closable by hinges (not shown) on the upper surface of the document reading unit 5, and the document feeder 6 functions as a document pressing cover when reading a document placed on a platen glass (not shown). The document feeder 6 is an ADF (Auto Document Feeder), includes a document placement tray 61, and feeds the documents placed on the document placement tray 61 to the document reading unit 5 one by one.

[0015] The document feeder 6 is configured to mechanically reverse the front and back of the document after the front surface image of the document is read by the document reading unit 5, and to feed the document to the document reading unit 5 again. Thereby, double-sided reading of the document by the document reading unit 5 is realized.

[0016] The process of reading a document in the image forming apparatus 1 will now be explained. The document reading unit 5 optically reads the image of the document supplied to the document reading unit 5 by the document feeding unit 6, or the document placed on the platen glass, and generates image data. The image data generated by the document reading unit 5 is stored in an image memory (not shown) or the like.

[0017] The image forming operation performed by the image forming apparatus 1 will now be described. Based on the image data generated by the document reading operation, the image data stored in the image memory, the image data received from a network-connected computer, the image forming unit 12 forms a toner image on the recording paper, which is fed from the paper feeding unit 14.

[0018] The fixing unit 13 heats and pressurizes the recording paper on which the toner image has been formed by the image forming unit 12 to fix the toner image to the recording paper, and the fixing process is discharged into the output tray 151. The paper feeding unit 14 is equipped with multiple paper feed cassettes 141.

[0019] The operation unit 47 receives instructions from the operator, such as instructions to execute image forming operations, regarding various operations and processes that the image forming apparatus 1 can perform. The operation unit 47 is equipped with a display unit 473 that displays operation guidance to the operator. The operation unit 47 also receives input of instructions from the user based on user operations (touch operations) on the operation screen displayed on the display unit 473 via the touch panel of the display unit 473.

[0020] Furthermore, the operation unit 47 accepts user input based on user operations on physical keys provided on the operation unit 47. For example, the operation unit 47 is equipped with a physical key PK1, which is a "start" key for instructing the start of copy or scan operations, or for instructing the start of setting operations.

[0021] The display unit 473 consists of an LCD (Liquid Crystal Display) or the like. The display unit 473 is equipped with a touch panel. When the operator touches a button or key displayed on the screen, the touch panel receives an instruction corresponding to the touched location.

[0022] The storage device 8 is a high-capacity storage device such as an HDD (Hard Disk Drive) or SSD (Solid State Drive), and stores various control programs, etc., and also includes a string file storage unit 81 and a format information storage unit 82. The string file storage unit 81 and the format information storage unit 82 will be described in detail later.

[0023] The control unit 10 is composed of a processor, RAM (Random Access Memory), ROM (Read Only Memory), and dedicated hardware circuitry. The processor is, for example, a CPU (Central Processing Unit), an ASIC (Application Specific Integrated Circuit), or an MPU (Micro Processing Unit). We have 100 offerings.

[0024] The control unit 100 is responsible for the overall operation control of the image forming apparatus 1. The control unit 100 is connected to the document feeding unit 6, document reading unit 5, image forming unit 12, fixing unit 13, paper feeding unit 14, operation unit 47, and storage device 8, and performs drive control of each of these units. For example, the control unit 100 controls the operation of the image forming unit 12, etc., to form the document image obtained by reading by the document reading unit 5 onto the recording paper which serves as the recording medium.

[0025] The image forming apparatus has a string saving mode that "saves the string of characters read from the original image." The control unit 100 sets the image forming apparatus 1 to this string saving mode according to the mode setting instruction from the user entered into the operation unit 47.

[0026] When the image forming apparatus 1 is set to string saving mode, for example, a case in which a document image D1 as shown in Figure 3 is read by the document reading unit 5 will be described. The document image D1 shown in Figure 3 has strings representing each of the question items Q1 to Q7 (for example, First Name, Last Name, E-mail, Phone Number) and answer entry fields EF1 to EF7 in which the answers to the question items Q1 to Q7 are entered.

[0027] The control unit 100 analyzes the original image D1 using known OCR (Optical Character Recognition) technology and detects the answer fields EF1 to EF7 and the question items Q1 to Q7 contained in the original image D1, based on predetermined format information FM1 (see, for example, Figure 4), which indicates the answer fields in which answers to be extracted from the original image D1 are to be entered and the corresponding question items.

[0028] Figure 4 shows an example of the above format information. The format information FM1 shown in Figure 4 includes the size and position on the original image of each of the answer entry fields EF1 to EF7 in which the answers to be extracted are entered, and the size and position on the original image of the corresponding question items Q1 to Q7 in each of the answer entry fields EF1 to EF7.

[0029] Next, the control unit 100 extracts the strings entered in the answer fields EF1 to EF7 (for example, "Taro", "Sato", "taro@abc.xyz", "+811234567890"), creates a string file that records the extracted strings in association with the strings representing the question items Q1 to Q7 (for example, "First Name", "Last Name", "E-mail", "Phone Number"), and saves the created string file in the string file storage unit 81.

[0030] The above string file is a CSV (Comma Separated Value) file that can record, for example, strings representing question items and strings representing the answers to those questions in association. Figure 5 is an example of a CSV file. In the CSV file shown in Figure 5, the first row contains strings representing each question item Q1 to Q7 (question item names) separated by commas. The second row and subsequent rows contain strings representing the answers entered in the respective answer fields EF1 to EF7 for each question item Q1 to Q7, separated by commas and arranged in the same order as the corresponding question items. In other words, the first row represents the question items, and the second row and subsequent rows represent the answers to those questions.

[0031] CSV files separate data with commas, so if a comma is present within the data, the data will not be properly separated. Therefore, if a string extracted from the answer field contains a comma, the control unit 100 encloses the string in a predetermined symbol (for example, double quotes) and writes it to the string file. For example, as shown in Figure 5, strings such as "Kuala Lumpur, Malaysia" and "Taipei, Taiwan" as answers to question item Q7 are enclosed in double quotes.

[0032] Next, the process when the above string saving mode is executed will be explained with reference to the flowcharts shown in Figures 6A to 6C.

[0033] When a user inputs a setting instruction for the string saving mode via the touch panel, for example, by touching the GUI (Graphical User Interface) displayed on the screen of the display unit 473, the control unit 100 sets the image forming apparatus 1 to the string saving mode according to the setting instruction (S1). Then, the control unit 100 displays an operation screen G1 as a selection screen, as shown in Figure 7 as an example, on the display unit 473 (S2).

[0034] The operation screen G1 shown in Figure 7 displays a selection key K1 labeled "New Document" for setting new format information, and a selection key K2 labeled "Use Saved Format" for using existing format information stored in the format information storage unit 82.

[0035] When a user performs an operation on either of the selection keys K1 or K2 on the operation screen G1, the control unit 100 accepts a selection based on the information entered for the selected key that was operated, and accepts a choice of whether to set new format information or use existing format information.

[0036] When setting new format information, the user places the original document that will serve as the source of the format information into the document tray 61 and operates the physical key PK1, which is the "Start" key on the operation unit 47. Figure 8 shows an example of the original document image D11.

[0037] The control unit 100 receives a user selection to set new format information ("New" in S3), and then, when the operation unit 47 receives a user operation on the physical key PK1, the control unit 100 controls the operation of the document feeding unit 6 and the document reading unit 5 to cause the document reading unit 5 to read the image of the original document set in the document tray 61 (S4).

[0038] Next, the control unit 100 analyzes the original document image obtained by the document reading unit 5 and uses known OCR technology to detect text strings, objects composed of rectangular frames, and their size and position contained in the original document image (S5). Then, the control unit 100 displays the original document image on the display unit 473 (S6). For example, as shown in Figure 9, the original document image D11 is displayed on the display unit 473.

[0039] As shown in Figure 9, the control unit 100 displays the original document image D11, along with a selection key K3 labeled "OK" and a selection key K4 labeled "Cancel" on the screen of the display unit 473. If the entire original document image D11 cannot be displayed on the screen of the display unit 473, the control unit 100 scrolls the original document image D11 on the screen of the display unit 473 in response to swipe operations on the screen of the display unit 473, which are input via the touch panel provided on the display unit 473.

[0040] Here, when the user touches an object on the screen of the display unit 473 that is composed of a rectangular frame indicating an answer entry field in the original document image D11, the control unit 100, based on the result detected in S5, highlights the object displayed at the touched location on the screen of the display unit 473 (for example, highlights it in yellow) and accepts that object as an answer entry field from which the answer to be extracted should be entered (S7).

[0041] The control unit 100 can accept the designation of two or more adjacent answer fields as a single answer field. When a user touches adjacent objects composed of rectangular frames in quick succession on the display unit 473 screen while the original document image D11 is displayed, the control unit 100 highlights the multiple touched objects on the display unit 473 screen and accepts these objects as a single answer field (S7).

[0042] On the other hand, when a user touches an object on the screen of the display unit 473 that consists of a string of characters indicating a question item in the original document image D11, the control unit 100, based on the result detected in S5, highlights the touched object on the screen of the display unit 473 in a different display (for example, highlighting it in blue), and accepts the object as a question item corresponding to the answer entry field in which the answer to be extracted is entered (S7).

[0043] Figure 10 shows the original document image D11 displayed on the display unit 473 with the user-specified answer fields and question items highlighted. Figure 11 shows the entire highlighted original document image D11. In the original document image D11 shown in Figures 10 and 11, answer fields EF11 to EF17 are highlighted, and question items Q11 to Q17 are highlighted. Answer field EF14 consists of two answer fields EF141 and EF142.

[0044] The highlighted elements are the answer fields where the answers to be extracted are entered, and the strings indicating the corresponding question items. At this time, the control unit 100 incorporates format information into the original document image that indicates the highlighted answer fields and the strings indicating the corresponding question items. As a result, the highlighted original document image has format information incorporated that indicates the answer fields where the answers to be extracted are entered, and the corresponding question items.

[0045] When the user touches the selection key K3 labeled "OK" on the display screen shown in Figure 10, a file creation instruction is input, and the control unit 100 creates an image file containing the highlighted original document image (the original document image with the above format information incorporated) according to this instruction (S8), and saves the created image file to the format information storage unit 82 (S9). After this, the process ends.

[0046] When the control unit 100 receives a user selection to use existing format information ("existing" in S3), it displays an operation screen G2 on the display unit 473, which lists image files stored in the format information storage unit 82 that have the format information incorporated into the original document image, as shown in Figure 12 (S11).

[0047] Assuming that the operation screen G2 shown in Figure 12 displays image files JF1 to JF3, when the user performs a long-press touch operation on any of the image files JF1 to JF3 displayed on the display unit 473, the control unit 100 receives an expansion instruction from the user via the touch panel for the image file targeted by the long-press touch operation, and according to this instruction, displays the original document image D12, for example as shown in Figure 13, on the display unit 473, which represents the contents of the image file.

[0048] In the original document image D12 shown in Figure 13, the answer fields EF21 to EF25, where the answers to be extracted are entered, are highlighted (highlighted in yellow), and the strings "First Name," "Last Name," "E-mail," "Area Code," and "Mobile Number," which represent the corresponding question items Q21 to Q25, are highlighted (highlighted in blue). From this display, the user can confirm the format information.

[0049] When a user performs a touch operation (a so-called tap operation) on any of the image files JF1 to JF3 displayed on the display unit 473, the control unit 100 accepts the selection of the image file (original document image) that was the target of the touch operation (S12). Subsequently, the control unit 100 displays an operation screen G3 as a selection screen on the display unit 473, as exemplified in Figure 14 (S13).

[0050] The operation screen G3 shown in Figure 14 displays two selection keys: K5 labeled "New File" for creating a new string file and writing the string read from the original image to the new string file, and K6 labeled "Append to File" for adding the string read from the original image to an existing string file already stored in the string file storage unit 81.

[0051] When the user touches either selection key K5 or K6 on the operation screen G3, the control unit 100 accepts a selection based on the information entered for the touched selection key, indicating whether to record the string in a new string file or to add the string to an existing string file (S14). If the user chooses to record the string read from the original image into a string file, the user places the original document in the document tray 61.

[0052] The control unit 100 receives a user selection to record a string in a new string file (in S15, "New"), and then, when the operation unit 47 receives a read execution instruction based on the user's operation on the physical key PK1, it controls the operation of the document feeding unit 6 and the document reading unit 5 to cause the document reading unit 5 to read the image of the document set in the document tray 61 (S16). The control unit 100 analyzes the document image obtained by the document reading unit 5 and detects the answer entry fields and corresponding question items contained in the document image based on the format information embedded in the original document image, which was selected by the user in S12 (S17).

[0053] An example of a method by which the control unit 100 detects a combination of an answer entry field where the answer to be extracted is entered and a question item corresponding to the answer entry field, using, for example, the original document image D11 shown in Figure 11, will be explained.

[0054] The control unit 100 analyzes the original document image D11 and starts a process to detect a highlighted answer entry field from the upper left of the original document image D11. Once an answer entry field is detected, it detects the highlighted question item that is closest to the detected answer entry field and sets the detected question item to the question item corresponding to the answer entry field. In this way, the control unit 100 determines the combination of the answer entry field and the question item.

[0055] The control unit 100 first detects the answer entry field EF11 and sets the pair of the answer entry field EF11 with the question item Q11 that is closest to the answer entry field EF11. Next, the control unit 100 detects the answer entry field EF12 and sets the pair of the answer entry field EF12 with the question item Q12 that is closest to the answer entry field EF12.

[0056] Next, the control unit 100 detects the answer entry field EF13. The closest items to the answer entry field EF13 are question items Q11 and Q12. However, since question items Q11 and Q12 are already set as the pair of answer entry fields EF11 and EF12, the control unit 100 sets the pair of answer entry fields EF13 as question item Q13. The control unit 100 performs this process up to the lower right of the original document image D11.

[0057] Next, the control unit 100 extracts the strings entered in the detected answer fields (S18) and creates a string file (S19). The control unit 100 associates the strings indicating the detected question items with the strings indicating the answers to those question items (the extracted strings) and records them in the created string file (S20), and saves the string file to the string file storage unit 81 (S21). After this, the process ends.

[0058] On the other hand, in S15, if the control unit 100 receives a user selection to add a string to an existing string file and record it ("add" in S15), it displays an operation screen G4 on the display unit 473, which is a selection screen that lists the string files stored in the string file storage unit 81, as shown in Figure 15 (S31).

[0059] The operation screen G4 shown in Figure 15 displays string files CF1 to CF5. When a user performs a long-press touch operation on any of the string files CF1 to CF5 displayed on the display unit 473, the control unit 100 receives an input from the user to expand the string file and displays a CSV file on the display unit 473, for example, as shown in Figure 5, which shows the contents of the string file targeted by the touch operation.

[0060] When a user performs a touch operation (tap operation) other than a long press on any of the string files CF1 to CF5 displayed on the display unit 473, the control unit 100 accepts the selection for that string file (S32). Subsequently, when the operation unit 47 receives a user operation on the physical key PK1, the control unit 100 controls the operation of the document feeding unit 6 and the document reading unit 5 to cause the document reading unit 5 to read the image of the document set in the document tray 61 (S33).

[0061] The control unit 100 analyzes the document image obtained by reading by the document reading unit 5 and detects the answer entry fields and corresponding question items included in the document image based on the format information embedded in the original document image, which was selected by the user in S12 (Figure 6B) (S34).

[0062] Next, the control unit 100 extracts the string entered in the detected answer entry field (S35), associates the string indicating the detected question item with the string indicating the answer to that question item (the extracted string), and adds it to the string file selected by the user in S32 and writes it (S36). After this, the process ends. Figure 16 shows an example of the state after the newly extracted string has been added to the string file shown in Figure 5.

[0063] According to the above embodiment, it is possible to add the string read from the original image to an existing string file and store it, thereby reducing the amount of data required to save the file containing the string.

[0064] Next, we will explain how to concatenate strings stored in the string file storage unit 81.

[0065] When a user inputs a command to combine string files via the touch panel, for example, based on a touch operation on the GUI displayed on the screen of the display unit 473, the control unit 100 displays an operation screen G5 on the display unit 473, which is a selection screen that lists the string files stored in the string file storage unit 81, as shown in the example in Figure 17(A).

[0066] To combine string files, the user selects two or more string files from the string files CF1 to CF5 displayed on the operation screen G5, for example, by using the touch panel, and then operates the physical key PK1, which is the "Start" key on the operation unit 47. Figure 17(B) shows the state in which the control unit 100 highlights the string files selected by the user. In Figure 17(B), string files CF2, CF3, and CF5 are highlighted.

[0067] The control unit 100 accepts a selection from the user of a string file, and then, upon receiving a user operation on the physical key PK1, displays an operation screen G6 as a selection screen on the display unit 473, as shown in Figure 18 as an example.

[0068] The operation screen G6 shown in Figure 18 has a selection key K7 labeled "Merge Only" for combining multiple string files selected by the user, and a selection key K8 labeled "Merge and Delete" for combining multiple string files selected by the user and then deleting any unnecessary string files.

[0069] When a user touches either selection key K7 or K8 on the operation screen G6, the control unit 100 accepts a selection based on the information entered for the selected key that was touched, and accepts a choice of whether to perform only "combining" the string file or to perform "combining and deleting".

[0070] When the control unit 100 receives a user selection for "combine," it determines whether the question items recorded in the multiple string files selected by the user match. If it determines that they match, it adds strings indicating the answers to the question items recorded in the other string files to any one of these multiple string files (for example, the string file initially selected by the user), associating the strings indicating the question items recorded in that string file with the strings indicating the answers to the question items recorded in the other string files, and writes them to the string file merger.

[0071] For example, if the string file initially selected by the user is string file CF3, the control unit 100 updates string file CF3 to string file CF31. After the string files are merged, the control unit 100 displays a list of string files, as shown in the example in Figure 19(A).

[0072] On the other hand, when the control unit 100 receives a user selection of "combine and delete", it determines whether the question items recorded in the multiple string files selected by the user match. If it determines that they match, it adds strings indicating the answers to the question items recorded in the other string files to any one of these multiple string files, associating the strings indicating the question items recorded in that string file with the strings indicating the answers to the question items recorded in the other string files, and writes them to the string files, thereby combining the string files to create a new string file. Furthermore, it deletes the unnecessary string files from the string file storage unit 81.

[0073] For example, the control unit 100 creates a new string file CF11 and deletes string files CF2, CF3, and CF5. After combining and deleting the string files, the control unit 100 displays a list of string files, as shown in the example in Figure 19(B).

[0074] In this way, by combining string files and centralizing the information, the efficiency of search operations can be improved. Furthermore, by deleting unnecessary string files, the free space in the string file storage unit 81 can be increased.

[0075] In another embodiment, when a string file whose questions do not match is selected by the user via the display screen and touch panel of the display unit 473, the control unit 100 may display a warning message on the display unit 473. This informs the user that a string file whose questions do not match has been selected.

[0076] Incidentally, in the above embodiment, when the user selects the selection key K2 labeled "Use Saved Format" via the operation screen G1 shown in Figure 7, the control unit 100 displays an operation screen G2, as exemplified in Figure 12, on the display unit 473. When the user selects an image file via the operation screen G2, the control unit 100 displays an operation screen G3, as exemplified in Figure 14, on the display unit 473, providing the user with the opportunity to choose whether to record the string in a new string file or to add the string to an existing string file.

[0077] However, if the image file you want to use is stored in the format information storage unit 82, it is highly likely that the string file corresponding to the format indicated by that image file is already stored in the string file storage unit 81.

[0078] Therefore, in another embodiment, when an image file is selected by the user via the operation screen G2, the control unit 100 may not display the operation screen G3 on the display unit 473, but instead immediately select a string file corresponding to the format indicated by the image file from the string file storage unit 81, and add the string read from the original image to the string file and write it.

[0079] This makes it possible to ensure that only one string file (CSV file) is created for each format. In other words, it prevents the creation of multiple string files corresponding to a single format, thus eliminating the need for the merging process described above.

[0080] The present invention is not limited to the configuration of the above embodiment and various modifications are possible. Furthermore, in the above embodiment, an image forming apparatus comprising the image processing apparatus according to the present invention and at least an image forming unit 12 is shown as one embodiment of the present invention, but this is merely an example, and the image processing apparatus according to the present invention may be other electronic devices.

[0081] Furthermore, in the above embodiments, the configurations and processes shown in Figures 1 to 19 are merely one embodiment of the present invention, and the present invention is not intended to be limited to these configurations and processes. [Explanation of symbols]

[0082] 1. Image forming apparatus 5. Manuscript reading unit 12 Image forming unit 47 Operation section 81 String file storage section 82 Format information storage unit 100 Control Unit 473 Display section

Claims

1. A correspondence file storage unit that stores a correspondence file in which a string representing a question item and a string representing the answer to that question item are recorded in association, An operating unit that accepts commands, The image of the original document was read and the resulting image was analyzed. Based on predetermined format information that indicates the answer fields in which answers to be extracted from the original image are entered, and the corresponding question items, the answer fields and question items contained in the original image are detected, and the string of characters representing the answers entered in the answer fields is extracted. An image processing apparatus comprising: a control unit that adds and writes to the corresponding file specified by the user in an operation on the operation unit, which is already stored in the corresponding file storage unit, a string extracted as the answer, in association with a string indicating the question item already recorded in the corresponding file.

2. The image processing apparatus according to claim 1, wherein the corresponding file is a file in CSV (Comma Separated Value) format.

3. The image processing apparatus according to claim 2, wherein the control unit further, if the string extracted from the answer entry field contains a comma, encloses the string with predetermined symbols and writes it to the corresponding file.

4. The control unit further adds to any one of the plurality of corresponding files selected by the user through an operation on the operation unit, which contain the same recorded question items, a string indicating the answer to the question item recorded in the other corresponding file, and writes it to the corresponding file, and combines the corresponding files.

5. A format information storage unit that stores the aforementioned format information, It further includes a display unit, The image processing apparatus according to any one of claims 1 to 4, wherein the control unit further causes the original document image, which is the source of the format information, to be displayed on the display unit, and the information indicating the answer entry fields and question items included in the original document image, as specified by the user through the operation of the operation unit, to be stored in the format information storage unit as the format information.

6. The image processing apparatus according to claim 5, wherein the control unit incorporates the format information into the original document image and stores the original document image in the format information storage unit.

7. The image processing apparatus according to claim 5 or 6, wherein the control unit is capable of receiving a designation via the operation unit of two or more adjacent answer entry fields included in the original document image as a single answer entry field.

8. The image processing apparatus according to any one of claims 5 to 7, wherein the control unit further detects the answer entry fields and the question items corresponding to the answer entry fields included in the original image based on the format information specified by the user through an operation of the operation unit, and extracts the string of characters as answers entered in the answer entry fields.

9. An image processing apparatus according to any one of claims 1 to 8, An image forming apparatus comprising an image forming unit that forms an image on a recording medium.

Images