Image processing apparatus and image forming apparatus

Abstract

To reduce an amount of data necessary for storage of a file in which character strings read from a document image are recorded.SOLUTION: An image forming apparatus 1 comprises a control unit 100 that analyzes a document image obtained through reading performed by a document reading unit 5, based on predetermined format information, detects answer entry columns included in the document image and question items corresponding to the answer entry columns, extracts character strings as answers entered in the answer entry columns, and additionally writes the extracted character strings in a character string file already stored in a character string file storage unit 81 and designated by a user through operations to an operation unit 47 in association with character strings indicating question items recorded in the character string file.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to an image processing apparatus and an image forming apparatus, and more particularly to a technique for extracting a required character string from an original image. [Background technology]

[0002] The following Patent Document 1 describes an image processing device that performs character recognition processing on an image obtained by scanning a questionnaire form, and stores the results of the recognition processing in a memory. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2013-012223 Summary of the Invention [Problem to be solved by the invention]

[0004] Manuscripts (paper documents) such as questionnaires often have a layout that associates a string of characters indicating a question (e.g., first name, last name, email address) with a response field where specific details about the question can be entered.

[0005] By scanning such an image of a document using an image processing device, performing character recognition and other processes to detect the character strings indicating the questions and the character strings indicating the answers to those questions, creating a file recording these character strings and saving it in memory, and digitizing the document, it becomes possible to search for the necessary information easily and quickly. It also eliminates the need for storage space for the document.

[0006] However, if files recording these character strings are created every time a document is read (scanned), the amount of data required to store the files will increase, which may make it difficult to use memory effectively.

[0007] The present invention has been made in view of the above circumstances, and has as its object to reduce the amount of data required to save a file in which character strings read from an original image are recorded. [Means for solving the problem]

[0008] An image processing device according to one aspect of the present invention comprises a string file storage unit that stores string files in which strings indicating questions and strings indicating answers to the questions are recorded in association with each other; an operation unit that accepts operations; a document reading unit that reads an image of a document; and a control unit that analyzes the document image obtained by the document reading unit, and detects answer entry fields and questions included in the document image based on predetermined format information that indicates answer entry fields into which answers to be extracted from the document image are to be entered and the questions corresponding to the answer entry fields, extracts strings as answers entered in the answer entry fields, and writes the extracted strings to the string file already stored in the string file storage unit and specified by a user by operating the operation unit, by correlating them with strings indicating the questions recorded in the string file.

[0009] An image forming apparatus according to another aspect of the present invention includes the image processing apparatus described above and an image forming section that forms an image on a recording medium. [Effects of the Invention]

[0010] According to the present invention, a character string read from an original image is written to an already existing character string file, thereby reducing the amount of data required to save the file in which the character string is recorded. [Brief explanation of the drawings]

[0011] [Figure 1] 1 is a perspective view showing the appearance of an image forming apparatus to which an image processing apparatus according to an embodiment of the present invention is applied; [Figure 2]FIG. 2 is a functional block diagram illustrating a main internal configuration of the image forming apparatus. [Figure 3] FIG. 2 is a diagram illustrating an example of an original image. [Figure 4] FIG. 10 is a diagram illustrating an example of format information. [Figure 5] FIG. 10 is a diagram illustrating an example of a CSV file. [Figure 6A] 10 is a flowchart showing a process when a character string saving mode is executed. [Figure 6B] 10 is a flowchart showing a process when a character string saving mode is executed. [Figure 6C] 10 is a flowchart showing a process when a character string saving mode is executed. [Figure 7] FIG. 10 is a diagram showing an example of a selection screen displayed on a display unit. [Figure 8] FIG. 2 is a diagram showing an example of an original document image. [Figure 9] FIG. 2 is a diagram showing an original document image displayed on a display unit. [Figure 10] FIG. 10 is a diagram showing an original document image displayed on a display unit in which answer entry fields and question items designated by a user are highlighted. [Figure 11] FIG. 10 is a diagram showing the entire original document image that is highlighted. [Figure 12] FIG. 10 is a diagram showing a state in which a list of image files is displayed on the display unit. [Figure 13] FIG. 10 is a diagram showing an example of an image file displayed in an expanded form. [Figure 14] FIG. 10 is a diagram showing an example of a selection screen displayed on a display unit. [Figure 15] FIG. 10 is a diagram showing a state in which a list of character string files is displayed on the display unit. [Figure 16] FIG. 10 is a diagram illustrating an example of an updated CSV file. [Figure 17] 1A is a diagram showing a state in which a list of character string files is displayed on the display unit, and FIG. 1B is a diagram showing a state in which a character string file selected by the user is highlighted. [Figure 18]FIG. 10 is a diagram showing an example of a selection screen displayed on a display unit. [Figure 19] 10A and 10B are diagrams showing a state in which a list of character string files is displayed on a display unit. DETAILED DESCRIPTION OF THE INVENTION

[0012] An image processing device and an image forming device according to an embodiment of the present invention will be described below with reference to the drawings. Fig. 1 is a perspective view showing the appearance of an image forming device to which an image processing device according to an embodiment of the present invention is applied. Fig. 2 is a functional block diagram showing the main internal configuration of the image forming device.

[0013] The image forming device 1 is a multifunction device that combines multiple functions, such as a copy function, a printer function, a scanner function, and a facsimile function, and is configured to include a device main body 11 that includes a control unit 10, a document feeding section 6, a document reading section 5, an image forming section 12, a fixing section 13, a paper feeding section 14, an operation section 47, and a memory device 8.

[0014] The document feeder 6 is configured to be openable and closable by a hinge or the like (not shown) on the top surface of the document reading unit 5, and functions as a document pressing cover when reading a document placed on a platen glass (not shown). The document feeder 6 is an ADF (Auto Document Feeder) and includes a document placement tray 61. The document placed on the document placement tray 61 is fed to the document reading unit 5 one sheet at a time.

[0015] The document feed unit 6 is configured to be able to mechanically invert the document from front to back after the document reading unit 5 has read the image on the front side of the document and re-feed the document to the document reading unit 5. This allows the document reading unit 5 to read both sides of the document.

[0016] The following describes the case where a document is read by the image forming apparatus 1. The document reading unit 5 optically reads an image of a document supplied to the document reading unit 5 by the document feeding unit 6 or a document placed on the platen glass, and generates image data. The image data generated by the document reading unit 5 is stored in an image memory (not shown) or the like.

[0017] The following describes an image forming operation performed by image forming apparatus 1. Image forming unit 12 forms a toner image on recording paper as a recording medium fed from paper feed unit 14 based on image data generated by a document reading operation, image data stored in an image memory or the like, image data received from a computer connected via a network, and the like.

[0018] The fixing unit 13 applies heat and pressure to the recording paper on which the toner image has been formed by the image forming unit 12, thereby fixing the toner image to the recording paper, and the recording paper that has undergone the fixing process is discharged onto a discharge tray 151. The paper supply unit 14 includes a plurality of paper supply cassettes 141.

[0019] The operation unit 47 receives instructions, such as an instruction to perform an image forming operation, from the operator regarding various operations and processes that can be performed by the image forming apparatus 1. The operation unit 47 includes a display unit 473 that displays operation guides and the like to the operator. The operation unit 47 also receives input of instructions from the user via a touch panel included in the display unit 473, based on the user's operation (touch operation) on the operation screen displayed on the display unit 473.

[0020] Furthermore, the operation unit 47 accepts input of instructions from the user based on the user's operation of a physical key provided on the operation unit 47. For example, the operation unit 47 is provided with a physical key PK1 which is a "start" key for instructing the start of a copy or scan operation or the start of processing of a setting operation.

[0021] The display unit 473 is composed of an LCD (Liquid Crystal Display) or the like. The display unit 473 is equipped with a touch panel. When the operator touches a button or key displayed on the screen, the touch panel receives an instruction associated with the touched position.

[0022] The storage device 8 is a large-capacity storage device such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive), and stores various control programs and the like, and also includes a character string file storage unit 81 and a format information storage unit 82. The character string file storage unit 81 and the format information storage unit 82 will be described in detail later.

[0023] The control unit 10 includes a processor, a RAM (Random Access Memory), a ROM (Read Only Memory), and a dedicated hardware circuit. The processor is, for example, a CPU (Central Processing Unit), an ASIC (Application Specific Integrated Circuit), or an MPU (Micro Processing Unit). It is equipped with a control section 100.

[0024] The control unit 100 is responsible for overall operational control of the image forming apparatus 1. The control unit 100 is connected to the document feed unit 6, the document reading unit 5, the image forming unit 12, the fixing unit 13, the paper feed unit 14, the operation unit 47, and the storage device 8, and performs drive control of each of these units. For example, the control unit 100 controls the operation of the image forming unit 12, etc., and forms the document image obtained by reading by the document reading unit 5 on recording paper as a recording medium.

[0025] The image forming apparatus has a character string saving mode for “saving character strings read from an original image.” The control unit 100 sets the image forming apparatus 1 to the character string saving mode in accordance with a mode setting instruction input by the user to the operation unit 47.

[0026] When the image forming apparatus 1 is set to the character string saving mode, for example, a case will be described in which an original image D1 as shown in Fig. 3 is read by the original reading unit 5. The original image D1 shown in Fig. 3 has character strings (e.g., first name, last name, email address, phone number) indicating each of the question items Q1 to Q7, and answer entry fields EF1 to EF7 in which answers to the question items Q1 to Q7 are entered.

[0027] The control unit 100 analyzes the original image D1 using known OCR (Optical Character Recognition) technology, etc., and detects the answer entry fields EF1 to EF7 and question items Q1 to Q7 contained in the original image D1 based on predetermined format information FM1 (see, for example, Figure 4) that indicates the answer entry fields into which the answers to be extracted from the original image D1 should be entered and the question items corresponding to the answer entry fields.

[0028] Fig. 4 is a diagram showing an example of the format information. The format information FM1 shown in Fig. 4 includes the size and position on the original image of each of the answer entry fields EF1 to EF7 into which the answers to be extracted are entered, and the size and position on the original image of the questions Q1 to Q7 corresponding to each of the answer entry fields EF1 to EF7.

[0029] Next, the control unit 100 extracts the character strings entered in the answer entry fields EF1 to EF7 (for example, "Taro", "Sato", "taro@abc.xyz", "+811234567890"), creates a character string file in which the extracted character strings are recorded in association with the character strings indicating the question items Q1 to Q7 (for example, "First Name", "Last Name", "E-mail", "Phone Number"), and saves the created character string file in the character string file storage unit 81.

[0030] The character string file is, for example, a file in CSV (Comma Separated Value) format that can record character strings indicating questions and character strings indicating answers to those questions in association with each other. FIG. 5 is a diagram illustrating an example of a CSV file. In the CSV file shown in FIG. 5, the first line contains character strings (question item names) indicating each of the questions Q1 to Q7, separated by a comma (,) and arranged in sequence. In addition, the second and subsequent lines contain character strings as answers entered in the answer entry fields EF1 to EF7 for each of the questions Q1 to Q7, separated by a comma (,) and arranged in sequence in the same order as the corresponding questions. In other words, the first line contains the question items, and the second and subsequent lines contain the answers to those questions.

[0031] In a CSV file, data is separated by commas, so if a comma is included in the data, the data will not be separated correctly. Therefore, if a character string extracted from the answer entry field contains a comma, the control unit 100 surrounds the character string with a predetermined symbol (e.g., double quotation marks) and writes the character string to the character string file. For example, as shown in Figure 5, character strings such as "Kuala Lumpur, Malaysia" and "Taipei, Taiwan" that are answers to question Q7 are surrounded by double quotation marks.

[0032] Next, the processing performed when the character string storage mode is executed will be described with reference to the flowcharts shown in FIGS. 6A to 6C.

[0033] When a user inputs a setting instruction for the character string storage mode through a touch panel, for example, by touching a GUI (Graphical User Interface) displayed on the screen of display unit 473, control unit 100 sets image forming apparatus 1 to the character string storage mode in accordance with the setting instruction (S1). Then, control unit 100 causes display unit 473 to display operation screen G1 as a selection screen, such as the example shown in FIG. 7 (S2).

[0034] The operation screen G1 shown in Figure 7 displays a selection key K1 labeled "New Document" for setting new format information, and a selection key K2 labeled "Use Saved Format" for using existing format information stored in the format information storage unit 82.

[0035] When the user operates either the selection key K1 or K2 on the operation screen G1, the control unit 100 accepts the selection of whether to set new format information or use existing format information based on the information entered into the selected selection key.

[0036] When setting new format information, the user places an original document that is the source of the format information on the document tray 61 and operates the physical key PK1, which is the "start" key on the operation unit 47. Fig. 8 is a diagram showing an example of an original document image D11.

[0037] The control unit 100 accepts the user's selection to set new format information ("New" in S3), and then when the operation unit 47 accepts the user's operation on the physical key PK1, the control unit 100 controls the operation of the document feed unit 6 and the document reading unit 5 to cause the document reading unit 5 to read the image of the original document set on the document loading tray 61 (S4).

[0038] Next, the control unit 100 analyzes the original document image obtained by reading by the document reading unit 5, and detects objects formed of character strings and rectangular frames included in the original document image, as well as their sizes and positions, using known OCR technology or the like (S5). Then, the control unit 100 causes the original document image to be displayed on the display unit 473 (S6). For example, an original document image D11 is displayed on the display unit 473, as shown in the example of FIG. 9.

[0039] 9, the control unit 100 displays the original document image D11, a selection key K3 marked with "OK," and a selection key K4 marked with "Cancel." If the entire original document image D11 cannot be displayed on the screen of the display unit 473, the control unit 100 scrolls the original document image D11 on the screen of the display unit 473 in response to a swipe operation on the screen of the display unit 473, which is input via a touch panel provided on the display unit 473.

[0040] Here, when the user performs a touch operation on an object consisting of a rectangular frame indicating an answer entry field in the original manuscript image D11 on the screen of the display unit 473, the control unit 100, based on the result detected in S5, highlights (for example, highlights in yellow) the object displayed at the point where the touch operation was performed on the screen of the display unit 473, and accepts the object as an answer entry field in which the answer to be extracted will be entered (S7).

[0041] The control unit 100 can accept the designation of two or more adjacent answer entry fields as one answer entry field. When the user performs a touch operation on objects consisting of adjacent rectangular frames in quick succession on the screen of the display unit 473 while the original manuscript image D11 is being displayed, the control unit 100 highlights the multiple touched objects together on the screen of the display unit 473 and accepts these objects as one answer entry field (S7).

[0042] On the other hand, when the user performs a touch operation on an object consisting of a character string indicating a question item in the original manuscript image D11 on the screen of the display unit 473, the control unit 100, based on the result detected in S5, highlights the touched object on the screen of the display unit 473 in a different display from the above (for example, highlights it in blue), and accepts the object as a question item corresponding to the answer entry field in which the answer to be extracted is to be entered (S7).

[0043] Fig. 10 is a diagram showing an original document image D11 displayed on display unit 473 in which answer entry fields and question items specified by the user are highlighted. Fig. 11 is a diagram showing the entire original document image D11 in which highlighting is displayed. In original document image D11 shown in Figs. 10 and 11, answer entry fields EF11 to EF17 are highlighted, and question items Q11 to Q17 are highlighted. Answer entry field EF14 is made up of two answer entry fields EF141 and EF142.

[0044] The highlighted display is the answer entry field into which the answer to be extracted is to be entered and the character string indicating the question corresponding to that answer entry field. At this time, the control unit 100 incorporates format information indicating the highlighted answer entry field and the character string indicating the question corresponding to that answer entry field into the original manuscript image. As a result, the original manuscript image highlighted as described above has incorporated therein format information indicating the answer entry field into which the answer to be extracted is to be entered and the question corresponding to that answer entry field.

[0045] When the user touches the selection key K3 marked "OK" displayed on the display screen shown in Fig. 10, a file creation instruction is input, and the control unit 100 creates an image file containing the highlighted original document image (the original document image incorporating the above-mentioned format information) in accordance with this instruction (S8), and stores the created image file in the format information storage unit 82 (S9). After this, the process ends.

[0046] When the control unit 100 receives a user selection to use existing format information ("Existing" in S3), it causes the display unit 473 to display an operation screen G2 that lists image files containing original document images with format information incorporated therein, as shown in the example of FIG. 12 (S11).

[0047] It is assumed that image files JF1 to JF3 are displayed on operation screen G2 shown in Fig. 12. When the user performs a long press touch operation on one of image files JF1 to JF3 displayed on display unit 473, control unit 100 receives, via the touch panel, a display instruction from the user for the image file that is the target of the long press touch operation, and in accordance with this instruction, causes display unit 473 to display, for example, an original document image D12 as shown in Fig. 13, which shows the contents of the image file.

[0048] 13, answer fields EF21 to EF25 into which answers to be extracted are entered are highlighted (highlighted in yellow), and the character strings "First Name," "Last Name," "Email," "Area Code," and "Mobile Number" indicating the questions Q21 to Q25 corresponding to the answer fields EF21 to EF25 are highlighted (highlighted in blue). From this display, the user can confirm the format information.

[0049] When the user performs a touch operation (a so-called tap operation) that does not involve a long press on any of image files JF1 to JF3 displayed on display unit 473, control unit 100 accepts the selection of the image file (original document image) that is the target of the touch operation (S12). Subsequently, control unit 100 causes display unit 473 to display operation screen G3 as a selection screen, such as the example shown in FIG. 14 (S13).

[0050] The operation screen G3 shown in FIG. 14 displays a selection key K5 marked "New File" for creating a new character string file and writing and recording the character string read from the original image in the new character string file, and a selection key K6 marked "Append to File" for adding and writing the character string read from the original image to an existing character string file that is already stored in the character string file storage unit 81.

[0051] When the user touches either selection key K5 or K6 on operation screen G3, control unit 100 accepts a selection of whether to record a string in a new string file or to add and record a string to an existing string file, based on the information input to the selection key that was touched (S14). When recording a string read from a document image in a string file, the user places the target document on document tray 61.

[0052] The control unit 100 receives a user selection to record a character string in a new character string file ("New" in S15), and then, when the operation unit 47 receives a reading execution instruction based on the user's operation on the physical key PK1, it controls the operation of the document feed unit 6 and the document reading unit 5 to cause the document reading unit 5 to read the image of the document set on the document placement tray 61 (S16). The control unit 100 analyzes the document image obtained by reading by the document reading unit 5, and detects answer entry fields and question items corresponding to the answer entry fields included in the document image based on the format information incorporated in the original document image selected by the user in S12 (S17).

[0053] An example of a method in which the control unit 100 detects a combination of an answer entry field in which the answer to be extracted is entered and a question item corresponding to the answer entry field, for example, using an original manuscript image D11 such as that shown in FIG. 11, will be described.

[0054] The control unit 100 analyzes the original document image D11 and starts the process of detecting a highlighted answer entry field from the top left of the original document image D11. When an answer entry field is detected, the control unit 100 detects the highlighted question item that is closest to the detected answer entry field and sets the detected question item as the question item corresponding to the detected answer entry field. In this way, the control unit 100 determines the combination of answer entry fields and questions.

[0055] The control unit 100 first detects the answer entry field EF11 and sets the question item Q11 that is closest to the answer entry field EF11 as a pair with the answer entry field EF11. Next, the control unit 100 detects the answer entry field EF12 and sets the question item Q12 that is closest to the answer entry field EF12 as a pair with the answer entry field EF12.

[0056] Next, the control unit 100 detects the answer entry field EF13. The questions Q11 and Q12 are closest to the answer entry field EF13, but because the questions Q11 and Q12 have already been set as a pair with the answer entry fields EF11 and EF12, the control unit 100 sets the pair with the answer entry field EF13 as the question item Q13. The control unit 100 performs this process up to the bottom right of the original manuscript image D11.

[0057] Next, the control unit 100 extracts the character strings entered in the detected answer entry fields (S18) and creates a character string file (S19). The control unit 100 associates the character strings indicating the detected questions with the character strings indicating the answers to the questions (extracted character strings), records them in the created character string file (S20), and saves the character string file in the character string file storage unit 81 (S21). After this, the process ends.

[0058] On the other hand, in S15, when control unit 100 receives a user selection to add and record a character string to an existing character string file ("Add" in S15), control unit 100 causes display unit 473 to display operation screen G4 as a selection screen that displays a list of character string files stored in character string file storage unit 81, as shown in an example in FIG. 15 (S31).

[0059] Character string files CF1 to CF5 are displayed on operation screen G4 shown in Fig. 15. When the user performs a long press touch operation on one of character string files CF1 to CF5 displayed on display unit 473, control unit 100 accepts an instruction from the user to expand that character string file, and causes display unit 473 to display, for example, a CSV file such as that shown in Fig. 5, which indicates the contents of the character string file that was the target of the touch operation.

[0060] When the user performs a touch operation (tap operation) that is not a long press on any of the character string files CF1 to CF5 displayed on display unit 473, control unit 100 accepts the selection of that character string file (S32). Thereafter, when operation unit 47 accepts a user operation on physical key PK1, control unit 100 controls the operations of document feeder 6 and document reader 5 to cause document reader 5 to read the image of the document set on document placement tray 61 (S33).

[0061] The control unit 100 analyzes the document image obtained by reading by the document reading unit 5, and detects the answer entry fields and question items corresponding to the answer entry fields contained in the document image based on the format information incorporated in the original document image selected by the user in S12 (Figure 6B) (S34).

[0062] Next, the control unit 100 extracts the character string entered in the detected answer entry field (S35), associates the character string indicating the detected question item with the character string indicating the answer to that question item (the extracted character string), and adds and writes the associated character string to the character string file selected by the user in S32 (S36). After this, the process ends. Figure 16 is a diagram showing an example of the character string file shown in Figure 5 after the newly extracted character string has been added and written.

[0063] According to the above embodiment, it is possible to add and store a character string read from an original image to an already existing character string file, thereby reducing the amount of data required to save a file containing the character string.

[0064] Next, the joining of character string files stored in character string file storage unit 81 will be described.

[0065] When the user inputs an instruction to combine character string files via the touch panel, for example, based on a touch operation on the GUI displayed on the screen of display unit 473, control unit 100 causes display unit 473 to display operation screen G5 as a selection screen that lists the character string files stored in character string file storage unit 81, as shown in an example of FIG. 17(A), in response to the above-mentioned combining instruction.

[0066] When the user wishes to combine character string files, the user performs an operation on the touch panel, for example, to select two or more character string files from the character string files CF1 to CF5 displayed on operation screen G5, and operates physical key PK1, which is the "Start" key of operation unit 47. Fig. 17(B) shows the state in which control unit 100 has highlighted the character string files selected by the user. In Fig. 17(B), character string files CF2, CF3, and CF5 are highlighted.

[0067] When the control unit 100 receives a selection of a character string file from the user and then receives a user operation on the physical key PK1, it causes the display unit 473 to display an operation screen G6 as a selection screen, such as the example shown in FIG.

[0068] The operation screen G6 shown in FIG. 18 has a selection key K7 marked "Merge Only" for combining multiple character string files selected by the user, and a selection key K8 marked "Merge and Delete" for combining multiple character string files selected by the user and deleting unnecessary character string files.

[0069] When the user touches either of the selection keys K7 and K8 on the operation screen G6, the control unit 100 accepts a selection of whether to only "combine" the character string files or to "combine and delete" them, based on the information entered into the selection key that was touched.

[0070] When the control unit 100 receives a user selection of "combine", it determines whether the questions recorded in the multiple character string files selected by the user match, and if it determines that they match, it adds and writes strings indicating answers to the questions recorded in the other character string files to any one of the multiple character string files (for example, the character string file first selected by the user) in association with the strings indicating the questions recorded in that character string file, thereby combining the character string files.

[0071] For example, if the character string file initially selected by the user is character string file CF3, control unit 100 updates character string file CF3 to character string file CF31. After combining the character string files, control unit 100 displays a list of the character string files, as shown in the example of FIG. 19(A).

[0072] On the other hand, when the control unit 100 receives a user selection of "combine and delete," it determines whether or not the questions recorded in the multiple character string files selected by the user match, and if it determines that they match, it adds and writes to any one of the multiple character string files a string indicating the answer to the question recorded in the other character string file, in association with the string indicating the question recorded in that character string file, combines the character string files, creates a new character string file, and further deletes the unnecessary character string files from the character string file storage unit 81.

[0073] For example, control unit 100 creates a new character string file CF11 and deletes character string files CF2, CF3, and CF5. After combining and deleting the character string files, control unit 100 displays a list of the character string files, such as the example shown in FIG. 19(B).

[0074] In this way, combining character string files and unifying information can improve the efficiency of search operations. Also, deleting unnecessary character string files can increase the free space in character string file storage unit 81.

[0075] In another embodiment, when a character string file with an inconsistent question item is selected by the user via the display screen and touch panel of the display unit 473, the control unit 100 may display a warning message on the display unit 473. This notifies the user that a character string file with an inconsistent question item has been selected.

[0076] In the above embodiment, when the user selects selection key K2 labeled "Use Saved Format" via operation screen G1 shown in FIG. 7, control unit 100 causes display unit 473 to display operation screen G2 such as the example shown in FIG. 12, and when the user selects an image file via operation screen G2, control unit 100 causes display unit 473 to display operation screen G3 such as the example shown in FIG. 14, providing the user with an opportunity to select whether to record a string in a new string file or to record a string by adding it to an existing string file.

[0077] However, if the image file you want to use is stored in the format information storage unit 82, it is highly likely that the character string file corresponding to the format indicated by the image file is already stored in the character string file storage unit 81.

[0078] Therefore, in another embodiment, when an image file is selected by the user via operation screen G2, control unit 100 may immediately select a character string file corresponding to the format indicated by the image file from character string file storage unit 81 without displaying operation screen G3 on display unit 473, and add and write the character string read from the original image to the character string file.

[0079] This makes it possible to create only one character string file (CSV file) for one format. In other words, it is possible to prevent multiple character string files corresponding to one format from being created, making the above-mentioned combining process unnecessary.

[0080] The present invention is not limited to the configuration of the above embodiment, and various modifications are possible. In addition, in the above embodiment, an image forming apparatus including an image processing apparatus according to the present invention and at least an image forming unit 12 is shown as one embodiment of the present invention, but this is merely an example, and the image processing apparatus according to the present invention may be another electronic device.

[0081] Furthermore, in the above embodiment, the configuration and processing shown in the above embodiment using FIGS. 1 to 19 are merely one embodiment of the present invention, and the present invention is not intended to be limited to these configurations and processing. [Explanation of symbols]

[0082] 1. Image forming device 5 Document reading section 12 Image forming unit 47 Operation section 81 String file storage section 82 Format information storage unit 100 control section 473 Display section

Claims

1. a correspondence file storage unit that stores a correspondence file in which character strings indicating questions and character strings indicating answers to the questions are recorded in association with each other; an operation unit that accepts operations; An image of the original document is read and the obtained image of the original document is analyzed. detecting the answer entry fields and the questions included in the document image based on predetermined format information that indicates answer entry fields into which answers to be extracted from the document image are to be entered and the questions corresponding to the answer entry fields, and extracting character strings as answers entered in the answer entry fields; and a control unit that adds and writes the extracted character string as the answer to the correspondence file already stored in the correspondence file storage unit and specified by the user through an operation on the operation unit, in association with a character string indicating the question item already recorded in the correspondence file.

2. 2. The image processing apparatus according to claim 1, wherein the correspondence file is a file in CSV (Comma Separated Value) format.

3. 3. The image processing device according to claim 2, wherein the control unit further surrounds the character string extracted from the answer entry field with a predetermined symbol and writes the character string to the corresponding file if the character string contains a comma.

4. 4. The image processing device according to claim 1, wherein the control unit further writes, to any one of a plurality of correspondence files selected by a user through an operation on the operation unit and having the recorded question items matching, a character string indicating an answer to the question item recorded in another correspondence file, in association with the character string indicating the question item recorded in the correspondence file, thereby merging the correspondence files.

5. a format information storage unit that stores the format information; a display unit, 5. An image processing device according to claim 1, wherein the control unit further causes an original manuscript image that is the basis of the format information to be displayed on the display unit, and causes information indicating the answer entry fields and question items included in the original manuscript image, as specified by the user by operating the operation unit, to be stored in the format information storage unit as the format information.

6. The image processing apparatus according to claim 5 , wherein the control unit incorporates the format information into the original document image and stores the original document image in the format information storage unit.

7. 7. The image processing device according to claim 5, wherein the control unit is capable of accepting, via the operation unit, designation of two or more adjacent answer entry fields included in the original document image as one answer entry field.

8. 8. An image processing device according to claim 5, wherein the control unit further detects the answer entry field and the question item corresponding to the answer entry field included in the document image based on the format information specified by the user by operating the operation unit, and extracts a character string as an answer entered in the answer entry field.

9. an image processing device according to any one of claims 1 to 8; and an image forming unit that forms an image on a recording medium.

Images