IMAGE PROCESSING APPARATUS, INFORMATION PROCESSING PROGRAM, AND IMAGE PROCESSING METHOD

Abstract

To further facilitate use of a function of generating a plurality of data files by dividing a result of character recognition.SOLUTION: An image processing apparatus according to an embodiment of the present invention has a confirmation unit, a recognition unit, and a generating unit. The confirmation unit confirms that each of a plurality of pages of read images includes a predetermined element image at a predetermined position. The recognition unit recognizes characters indicated in a recognition region defined relatively to a region where the element image is formed. The generating unit generates, as a single file, a data file of a recognition result by the recognition unit relating to a page having a predetermined relation with a page of the read image in which the confirmation unit confirms that the element image is included.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The present invention relates to an image processing apparatus, an information processing program, and an image processing method. [Background technology]

[0002] For example, a character recognition function is known as a function of a multifunction device, which recognizes characters shown on a document by image processing of an image read from the document.Furthermore, a file division function is known, which divides the result of character recognition into multiple data files.In the case of a document in which the management code of the document can be read by a barcode, this file division function utilizes the fact that the top page contains a barcode, and divides the result of character recognition so that the document in which the barcode can be detected from the read image is set as the top page to generate a data file. However, the file division function described above cannot be used for documents that do not include a barcode on the top page. In view of these circumstances, it has been desirable to make it easier to use the function of dividing the results of character recognition to generate multiple data files. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2016-126796 A Summary of the Invention [Problem to be solved by the invention]

[0004] The problem to be solved by the present invention is to provide an image processing device, an information processing program, and an image processing method that can make it easier to use the function of dividing the results of character recognition and generating multiple data files. [Means for solving the problem]

[0005] The image processing device of the embodiment includes a recognition unit, a confirmation unit, a control unit, and a creation unit. The recognition unit recognizes characters shown in an image. The confirmation unit confirms that a predetermined element image is included in a partial area of ​​each of the scanned images of multiple pages. The control unit controls the recognition unit to recognize characters shown in a recognition area defined relatively to the area in which the element image is formed. The creation unit creates a page of the scanned image that has been confirmed by the confirmation unit to contain an element image. And this page Pages that have a predefined relationship to and A data file is generated that contains the recognition results by the recognition unit. [Brief description of the drawings]

[0006] [Figure 1] FIG. 2 is a block diagram showing the main circuit configuration of an MFP according to an embodiment. [Diagram 2] 1 is a flowchart of a zonal OCR process. [Diagram 3] 1 is a flowchart of a zonal OCR process. [Figure 4] 1 is a flowchart of a zonal OCR process. [Diagram 5] 1 is a flowchart of a zonal OCR process. [Figure 6] FIG. 4 is a diagram showing an example of the structure of a recognition setting table. [Figure 7] FIG. 4 is a diagram showing an example of the structure of an anchor setting table. [Figure 8] FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0007] An example of an embodiment will be described below with reference to the drawings. Note that in this embodiment, an MFP (multifunction peripheral) having a function as an image processing device will be described as an example. FIG. 1 is a block diagram showing the main circuit configuration of an MFP 1 according to this embodiment. The MFP1 includes a processor 10, a main memory 11, an auxiliary storage unit 12, an operation / display unit 13, a scan unit 14, a print unit 15, a facsimile unit 16, a recognition unit 17, a communication unit 18, and a transmission path 19. The processor 10, the main memory 11, the auxiliary storage unit 12, the operation / display unit 13, the scan unit 14, the print unit 15, the facsimile unit 16, the recognition unit 17, and the communication unit 18 are connected via the transmission path 19.

[0008] The processor 10, main memory 11, and auxiliary storage unit 12 are connected via a transmission line 19 to constitute a computer that performs information processing for controlling the MFP 1. The processor 10 corresponds to the central part of the computer. The processor 10 executes information processing for controlling each part to realize various functions of the MFP 1 in accordance with an operating system and information processing programs such as application programs.

[0009] The main memory 11 corresponds to the main storage portion of the computer. The main memory 11 includes a nonvolatile memory area and a volatile memory area. The main memory 11 stores the above-mentioned information processing program in the nonvolatile memory area. The main memory 11 may also store data required for the processor 10 to execute processes for controlling each part in the nonvolatile or volatile memory area. The main memory 11 uses the volatile memory area as a work area where data is appropriately rewritten by the processor 10.

[0010] The auxiliary storage unit 12 corresponds to the auxiliary storage portion of the computer. The auxiliary storage unit 12 may be, for example, an EEPROM (electric erasable programmable read-only memory), a HDD (hard disk drive), an SSD (solid state drive), or any other known storage device. The auxiliary storage unit 12 stores data used by the processor 10 in performing various processes and data generated by the processes in the processor 10. The auxiliary storage unit 12 may also store the information processing program. In this embodiment, the auxiliary storage unit 12 stores a zone OCR application APA, which is one of the information processing programs. The zone OCR application APA is an application program, and describes information processing for a zone OCR (optical character recognition) function, which will be described later. The storage area of ​​the auxiliary storage unit 12 is used as a template storage unit STA and a file storage unit STB. The template storage unit STA stores a template file that represents settings for the zone OCR function. The file storage unit STB stores a data file generated by the zone OCR function.

[0011] The operation / display unit 13 inputs operations by the user and displays various information to the user. The operation / display unit 13 may include various operation devices and display devices such as a touch panel, a keyboard, key switches, LED lamps, or a liquid crystal display panel, as appropriate.

[0012] The scan unit 14 reads an original document and generates image data of the image represented on the original document. The print unit 15 prints an image represented by the image data onto a recording sheet, and includes a known print device such as an electrophotographic image forming unit. The facsimile unit 16 performs various well-known processes for performing image communication conforming to facsimile standards via a communication network (not shown) such as the PSTN (public switched telephone network).

[0013] The recognition unit 17 recognizes characters shown in an image represented by the image data by performing image processing on the image data generated by the scan unit 14. The image processing performed by the recognition unit 17 may be, for example, a well-known process. The recognition unit 17 is an example of a recognition section. The communication unit 18 executes communication processing for performing data communication via the communication network 2. The communication unit 18 can use, for example, an existing communication device for a LAN (local area network).

[0014] The communication network 2 may be the Internet, a virtual private network (VPN), a LAN, a public communication network, a mobile communication network, or the like, either alone or in appropriate combination. As an example of the communication network 2, a LAN is used. The computer terminal 3 is an information processing device having a function of data communication via the communication network 2. The computer terminal 3 is operated by a user who uses the zone OCR function.

[0015] The hardware of the MFP1 can be, for example, that of an existing MFP of the same type. The zone OCR application APA may be stored in the auxiliary storage unit 12 when the hardware of the MFP1 is transferred, or may be transferred separately from the above-mentioned hardware. In the latter case, the zone OCR application APA is transferred by being recorded on a removable recording medium such as a magnetic disk, a magneto-optical disk, an optical disk, or a semiconductor memory, or via a network. In this case, the zone OCR application APA is provided as an optional program or an upgrade program, and is written into the main memory 11 or the auxiliary storage unit 12 as a new program, or by replacing another information processing program of the same type that is already stored.

[0016] Next, a description will be given of the operation of the MFP 1 configured as above. Note that the contents of the processes described below are merely examples, and it is possible to change the order of some of the processes, omit some of the processes, or add other processes as appropriate. In the MFP1, a processor 10 controls each part of the MFP1 to realize functions such as a print function, a copy function, a scan function, and a facsimile function in the same manner as in existing MFPs of the same type. A description of the information processing for this control is omitted. The following describes in detail the zone OCR function, which is a characteristic of this embodiment.

[0017] When an instruction to activate the zone OCR function is given by a predetermined operation on the operation / display unit 13, for example, the processor 10 starts information processing based on the zone OCR application APA (hereinafter referred to as zone OCR processing). 2, 3, 4 and 5 are flow charts of the zonal OCR process.

[0018] 2, the processor 10 checks whether or not a command to start setting has been issued. If the command has not been issued, the processor 10 judges the result to be NO and proceeds to ACT2. In ACT2, the processor 10 checks whether or not an instruction to start recognition has been issued. If the instruction has not been issued, the processor 10 determines that the answer is NO and returns to ACT1. Thus, the processor 10 as ACT1 and ACT2 waits for an instruction to start setting or recognition.

[0019] When the user wishes to register new settings related to the zone OCR function, the user instructs the start of setting, for example, by a predetermined operation on the operation / display unit 13. In response to this instruction, the processor 10 judges YES in ACT1 and proceeds to ACT3. In ACT3, the processor 10 waits for an instruction to read the document.

[0020] The user places an original to be used for the setting in the scan unit 14, and then instructs scanning by, for example, a predetermined operation on the operation / display unit 13. In response to this instruction, the processor 10 judges YES in ACT3 and proceeds to ACT4. As ACT4, the processor 10 captures an image for settings. The processor 10, for example, causes the scan unit 14 to read an original document, and stores the image thus obtained in the main memory 11 or the auxiliary storage unit 12 as an image for settings. The processor 10 as the ACT 5 waits for access from the computer terminal 3 via the communication network 2 .

[0021] A user operates computer terminal 3 to access MFP 1 via communication network 2. Computer terminal 3 uses a general-purpose web browser to access MFP 1 by an address assigned to MFP 1 via communication network 2. However, computer terminal 3 may also access MFP 1 by using a dedicated application for operating MFP 1. When the processor 10 receives an access from the computer terminal 3, the processor 10 judges YES in ACT5 and proceeds to ACT6. The processor 10 may authenticate the user who issued the read instruction received in ACT3, and also authenticate the user who operates the computer terminal 3, and judge YES in ACT5 only if the two users match.

[0022] As ACT6, the processor 10 instructs the computer terminal 3 to display an area setting screen. The area setting screen is a screen for receiving the designation of an arbitrary area within the setting image, including the image for setting captured in ACT4. The processor 10 transmits to the computer terminal 3, for example, data of a web page that represents the area setting screen and includes a command that specifies that the MFP 1 is notified upon receiving the designation of the area. Note that instructions to the computer terminal 3 by the processor 10 to display various screens, which will be described below, are transmitted by transmitting the web page data in the same manner as described above.

[0023] In ACT7, the processor 10 checks whether or not a recognition area has been designated. If the processor 10 cannot confirm the designation, it determines NO and proceeds to ACT8. In ACT8, the processor 10 checks whether or not an anchor region has been specified. If the processor 10 cannot confirm the specification, it judges the result as NO and proceeds to ACT9. In ACT 9, the processor 10 checks whether or not an instruction to end the setting has been given. If the instruction has not been given, the processor 10 judges the result to be NO and returns to ACT 7. Thus, in ACT7 to ACT9, the processor 10 waits for a recognition region or an anchor region to be designated, or for an instruction to end the setting.

[0024] The computer terminal 3 displays an area setting screen in response to an instruction from the MFP 1. The user specifies an area to be subjected to character recognition as a recognition area by a predetermined operation on the area setting screen on the computer terminal 3. The computer terminal 3 then notifies the MFP 1 of the designation of the recognition area, along with notification of coordinates indicating the position of the recognition area according to a coordinate system defined in the setting image. In response to this, the processor 10 determines YES in ACT7 and proceeds to ACT10 in FIG. 3. The processor 10 generates a recognition setting table in association with the currently specified recognition area as ACT 10. The recognition setting table is a data table that indicates settings for each of predetermined setting items for the associated recognition area.

[0025] FIG. 6 is a diagram showing an example of the structure of the recognition setting table TAA. The recognition setting table TAA includes fields FAA, FAB, FAC, FAD, and FAE. Field FAA contains an area code as an identifier for distinguishing the associated recognition area from other recognition areas. Field FAB contains the coordinates of the associated recognition area. Field FAC contains the area name given to the associated recognition area. Field FAD contains the type of recognition target in the associated recognition area. Field FAE contains settings related to the use of the recognition results in the associated recognition area.

[0026] The processor 10, for example, determines a code different from the area codes already assigned to other set recognition areas as the area code of the currently specified recognition area according to, for example, a predetermined rule, and sets the code in the field FAA. The processor 10, for example, sets the coordinates notified from the computer terminal 3 in the field FAB. The processor 10, for example, sets the area name determined according to the predetermined rule in the field FAC. The processor 10, for example, sets a type determined as a default among the options of the type of the recognition object in the field FAD. The options of the type of the recognition object are, for example, "text" and "barcode". The processor 10, for example, sets a setting determined as a default among the options of the setting related to the use of the recognition result in the field FAE. The options of the setting related to the use of the recognition result are, for example, "set as folder name", "set as file name", and "not used". The above various rules and various defaults may be arbitrarily determined by, for example, the designer of the MFP 1, the administrator of the MFP 1, or the user.

[0027] 3, the processor 10 instructs the computer terminal 3 to display a recognition setting screen. The recognition setting screen is a screen that displays the current settings regarding the recognition area according to the recognition setting table TAA, and is also a screen for receiving instructions to change the settings of some of the setting items.

[0028] The computer terminal 3 displays the recognition setting screen in response to an instruction from the MFP 1. The user checks the current settings by visually viewing the recognition setting screen. The user then instructs the MFP 3 to change the settings of any setting item by performing a predetermined operation on the recognition setting screen. For example, the user instructs the MFP 3 to change the area name to a name determined by the user. The computer terminal 3 then requests the MFP 1 to change the settings, along with a notification of the item to be changed and the changed settings.

[0029] In ACT 12, the processor 10 checks whether or not a request to change the settings related to the recognition area has been made. If the request is not confirmed, the processor 10 judges the result as NO and proceeds to ACT 13. In ACT13, the processor 10 checks whether or not a request to end the setting related to the recognition area has been made. If the request cannot be confirmed, the processor 10 judges the result as NO and returns to ACT12. Thus, the processor 10, as ACT12 and ACT13, waits for a change request or an end request to be made.

[0030] If a setting change is requested from the computer terminal 3 as described above, the processor 10 judges YES in ACT12 and proceeds to ACT14. In ACT14, the processor 10 updates the recognition setting table TAA to reflect the notification in the change request. For example, if the processor 10 is instructed to change the area name as described above, the processor 10 rewrites the field FAC to the specified area name. The processor 10 then returns to ACT11 and repeats the subsequent processes as described above.

[0031] If the user does not need to change the settings related to the recognition area, the user instructs the MFP 1 to end the settings by performing a predetermined operation on the recognition setting screen of the computer terminal 3. The computer terminal 3 then requests the MFP 1 to end the settings. In response to this request, the processor 10 determines YES in ACT13 and returns to ACT6 in FIG.

[0032] If a new recognition area is specified after returning from ACT13 to ACT6, the processor 10 proceeds from ACT7 to ACT10 in FIG. 3 as described above. Then, the processor 10 generates a new recognition setting table TAA while leaving the recognition setting table TAA generated so far as it is. Then, ACT11 and ACT14 are executed for the new recognition setting table TAA generated here. That is, the processor 10 receives settings for a plurality of recognition areas and generates a recognition setting table TAA corresponding to each of the plurality of recognition areas. However, if the recognition setting table TAA already exists, the processor 10 may replace it and generate a new recognition setting table TAA. Alternatively, the processor 10 may rewrite the field FAB of the existing recognition setting table TAA to the newly specified coordinates. Also, the processor 10 may not receive a new recognition area specification after returning from ACT13 to ACT6.

[0033] If the user uses the anchor function, the user specifies an area including an image to be used as an anchor as the anchor area by a predetermined operation on the area setting screen of the computer terminal 3. The computer terminal 3 then notifies the MFP1 of the designation of the anchor area along with notification of coordinates indicating the position of the anchor area according to the coordinate system defined in the setting image. In response to this, the processor 10 judges YES in ACT8 and proceeds to ACT15 in FIG. 3. Note that the type of image to be used as an anchor may be arbitrarily determined by the user. If the division function described later is used, an image displayed in the first page of multiple documents is used as the anchor. The image to be used as the anchor is, for example, a company logo.

[0034] The processor 10 generates an anchor setting table in association with the currently specified anchor region as ACT 15. The anchor setting table is a data table that indicates settings for each of predetermined setting items for the associated anchor region.

[0035] FIG. 7 is a diagram showing an example of the structure of the anchor setting table TAB. The anchor setting table TAB includes fields FBA, FBB, FBC, FBD, FBE, and FBF. The coordinates of the associated anchor region are set in field FBA. Image data of the image shown in the associated anchor region (hereinafter referred to as the anchor image) is set in field FBB. The enable / disable of the anchor function for the associated anchor region is set in field FBC. The enable / disable of the division function for the associated anchor region is set in field FBD. The enable / disable of the zone OCR for the associated anchor region is set in field FBE. The enable / disable of the full OCR for the associated anchor region is set in field FBF. The image data of the anchor image may be stored outside the anchor setting table TAB. In this case, the path of the image data is set in field FBB.

[0036] For example, the processor 10 sets the coordinates notified from the computer terminal 3 in the field FBA. For example, the processor 10 cuts out an image contained in the associated anchor region from the setting image, and sets image data representing the image in the field FBB. For example, the processor 10 sets a setting determined as a default from among "enabled" and "disabled" for each of the fields FBC to FBF in the corresponding field. Note that the default for each item may be arbitrarily determined by, for example, the designer of the MFP 1, the administrator of the MFP 1, or the user.

[0037] 3, the processor 10 instructs the computer terminal 3 to display an anchor setting screen. The anchor setting screen is a screen for displaying the current settings related to the anchor area according to the anchor setting table TAB, and for receiving instructions to change the settings of some of the setting items.

[0038] The computer terminal 3 displays an anchor setting screen in response to an instruction from the MFP 1. The user checks the current settings by visually viewing the anchor setting screen. The user then instructs the computer terminal 3 to change the settings of any setting item by performing a predetermined operation on the anchor setting screen. For example, if the user wants to change the enable / disable of the split function from the default setting, the user instructs the MFP 1 to do so. The computer terminal 3 then requests the MFP 1 to change the settings, along with a notification of the item to be changed and the changed setting.

[0039] In ACT 17, the processor 10 checks whether or not a change in the setting regarding the anchor region has been requested. If the request cannot be confirmed, the processor 10 judges the result as NO and proceeds to ACT 18. In ACT 18, the processor 10 checks whether or not a request to end the setting of the anchor region has been made. If the request cannot be confirmed, the processor 10 judges the result as NO and returns to ACT 17. Thus, the processor 10 waits as ACT17 and ACT18 for a change request or an end request to be made.

[0040] If a setting change is requested from the computer terminal 3 as described above, the processor 10 judges YES in ACT17 and proceeds to ACT19. In ACT19, the processor 10 updates the anchor setting table TAB to reflect the notification in the change request. For example, if a change to enable / disable of the division function is instructed as described above, the processor 10 rewrites the field FBD to the specified setting. Then, the processor 10 returns to ACT16 and repeats the subsequent processing as described above.

[0041] If the user does not need to change the setting related to the anchor region, the user instructs the end of the setting by a predetermined operation on the anchor setting screen of the computer terminal 3. Then, the computer terminal 3 requests the end of the setting to the MFP 1. In response to this request, the processor 10 judges YES in ACT18 and returns to ACT6 in FIG.

[0042] If a new anchor area is specified after returning from ACT18 to ACT6, the processor 10 proceeds from ACT8 to ACT15 in FIG. 3 in the same manner as described above. However, in this case, the processor 10 may generate a new anchor setting table TAB by replacing the existing anchor setting table TAB. Alternatively, the processor 10 rewrites the field FBA of the existing anchor setting table TAB to the newly specified coordinates. Also, the processor 10 may not accept the specification of a new anchor area after returning from ACT18 to ACT6. In other words, the processor 10 accepts settings related to only one anchor area. However, the processor 10 may generate a new anchor setting table TAB while leaving the anchor setting table TAB that has been generated so far as it is.

[0043] When the user has completed all the settings related to the recognition area and the anchor area, the user instructs the end of the settings by performing a predetermined operation on the area setting screen on the computer terminal 3. Then, the computer terminal 3 notifies the MFP 1 of the end of the settings. In response to this, the processor 10 judges YES in ACT9 in FIG. 2 and proceeds to ACT20.

[0044] In ACT20, the processor 10 generates a template file including the recognition setting table TAA and the anchor setting table TAB generated by the processes in ACT6 and after, and stores the template file in the template storage unit STA. Then, the processor 10 returns to the standby state of ACT1 and ACT2.

[0045] When reading an original using the zone OCR function, the user instructs the start of recognition, for example, by a predetermined operation on the operation / display unit 13. In response to this instruction, the processor 10 judges YES in ACT2 and proceeds to ACT21. The processor 10 as ACT21 displays a selection screen on the operation / display unit 13. The selection screen is a screen for allowing the user to select one of the templates corresponding to each of the template files stored in the template storage unit STA.

[0046] In ACT 22, the processor 10 waits for a template to be designated. If a template is designated by a predetermined operation by the user on the operation / display unit 13, the processor 10 judges the result as YES and proceeds to ACT 23. Note that the template designated here is hereinafter referred to as the applied template. As ACT23, the processor 10 waits for an instruction to read the document.

[0047] The user places a document to be recognized in the scan unit 14 and instructs the scanner to read the document, for example, by a predetermined operation on the operation / display unit 13. In response to this instruction, the processor 10 determines YES in ACT23 and proceeds to ACT24. In ACT 24, the processor 10 captures an image to be recognized (hereinafter referred to as a target image). The processor 10, for example, causes the scan unit 14 to read an original document, and stores the image thus obtained as a target image in the main memory 11 or the auxiliary storage unit 12. Note that, if there are multiple original documents, the images read by the scan unit 14 for each of the multiple original documents are stored as target images. After this, the processor 10 proceeds to ACT 25 in FIG. 4.

[0048] In ACT25, the processor 10 checks whether the anchor function is enabled. For example, the processor 10 checks whether the field FBC of the anchor setting table TAB included in the applied template is set to "enabled" or "disabled," and if "enabled" is set, the processor 10 judges the result as YES and proceeds to ACT26.

[0049] As ACT26, the processor 10 searches for an anchor from the target image. For example, the processor 10 selects one image from the target images in the reading order as a processing image. Then, the processor 10 searches the processing image for an anchor image set in the field FBB of the anchor setting table TAB included in the applied template. For example, the well-known template matching can be applied to this search.

[0050] In ACT 27, the processor 10 checks whether or not an anchor has been detected. If the anchor image is found in the above search, for example, the processor 10 judges the result as YES and proceeds to ACT 28. In this way, the processor 10 confirms that the anchor image, which is a predetermined element image, is included in the processed image. Then, as described below, the processor 10 repeats this confirmation for each of the scanned images of multiple pages as a processed image. In this way, the processor 10 executes information processing based on the zone OCR application APA, and the computer with the processor 10 as its central part functions as a confirmation unit.

[0051] In ACT28, the processor 10 checks whether or not zonal OCR is enabled. If the user wants to apply zonal OCR to a target image that includes an anchor image, the user sets zonal OCR to be enabled. For example, the processor 10 checks whether the field FBE of the anchor setting table TAB included in the applied template is set to "enabled" or "disabled," and if "enabled" is set, the processor 10 judges the result as YES and proceeds to ACT29.

[0052] As ACT29, the processor 10 corrects the coordinates of the recognition area so as to compensate for the deviation between the coordinates in the setting image used to set the applied template and the coordinates in the processed image. For example, the processor 10 obtains the deviation between the coordinates in the processed image and the coordinates in the setting image as the deviation between the coordinates of the area in which the anchor image is detected in the processed image and the coordinates set in the field FBA of the anchor setting table TAB included in the applied template, and changes the coordinates set in the field FAB of the recognition setting table TAA included in the applied template so as to reduce the deviation.

[0053] In ACT30, the processor 10 instructs the recognition unit 17 to execute zonal OCR. For example, the processor 10 instructs the recognition unit 17 to execute recognition, accompanied by notification of the corrected coordinates and the recognition type set in the field FAD of the recognition setting table TAA included in the applied template. If the applied template includes multiple recognition setting tables TAA, the processor 10 notifies the recognition unit 17 of the corrected coordinates and the recognition type for each of the multiple recognition setting tables TAA as a set.

[0054] The recognition unit 17 recognizes text within a region of the specified coordinates in the processing image if the specified recognition type is text, or recognizes a barcode if the specified recognition type is a barcode. In this way, the processor 10 instructs the execution of zonal OCR to control the recognition unit 17 as a recognition section so as to recognize characters shown in a recognition area defined relatively to an area in which an anchor image as an element image is formed. In this way, the processor 10 executes information processing based on the zonal OCR application APA, and the computer with the processor 10 as its central part functions as a control section.

[0055] As ACT31, the processor 10 generates page data in a predetermined data format that reflects the recognition result by the recognition unit 17. For example, the processor 10 generates page data including, as content, text data obtained as the recognition result by the recognition unit 17, with the character color made transparent, and pasted onto image data representing a processed image.

[0056] On the other hand, if the zonal OCR is disabled, the processor 10 judges NO in ACT28 and proceeds to ACT32. As ACT32, the processor 10 generates page data in a predetermined data format that is not related to the recognition result by the recognition unit 17. For example, the processor 10 generates page data that includes, as content, only image data representing a processed image.

[0057] The processor 10 proceeds from ACT31 or ACT32 to ACT33. In ACT 33, the processor 10 checks whether or not there is a data file being edited. If the image to be processed is the target image related to the first page, there is no data file being edited. Therefore, the processor 10 judges NO in this case and proceeds to ACT 34.

[0058] As ACT34, the processor 10 creates a new data file including the page data generated in ACT31 or ACT32. This data file is, for example, a multi-page document file. The data file is assumed to be in, for example, a portable document format (PDF). The processor 10 saves the data file created here outside the file storage unit STB of the main memory 11 or the auxiliary storage unit 12 as a data file being edited.

[0059] In ACT 35, the processor 10 checks whether there is a target image on the next page of the target image being processed. If there is a corresponding target image, the processor 10 judges it as YES, returns to ACT 25, changes the processing image to the target image on the next page, and executes the processing from ACT 25 onwards in the same manner as described above.

[0060] When the target image to be processed is the second page or later, when the processor 10 proceeds to ACT 33, a data file that has already been created as described above and is being edited exists. In this case, the processor 10 judges YES in ACT 33 and proceeds to ACT 36. In ACT36, the processor 10 checks whether the division function is enabled. For example, the processor 10 checks whether "enabled" or "disabled" is set in the field FBD of the anchor setting table TAB included in the applied template, and if "enabled" is set, the result is YES, and the process proceeds to ACT37.

[0061] In ACT37, the processor 10 stores the data file being processed at this point in the file storage unit STB. The processor 10 then proceeds to ACT34, where it creates a new data file including the page data generated in ACT31 or ACT32. In other words, the processor 10 divides the data file relating to the pages after the page where the anchor was detected into a separate file from the data file relating to the page before the page where the anchor was detected.

[0062] FIG. 8 is a diagram showing how a file is divided. The upper part of Fig. 8 shows a six-page document to be read. This document is a stack of a first document and a second document, each of which has three pages. The first page of the first document and the second document contain a common image IMA. In this case, when the image IMA is used as the anchor and the division function is enabled, a data file DFA relating to the first to third pages and a data file DFB relating to the fourth to sixth pages are created separately, as shown in the lower part of FIG.

[0063] In this way, the processor 10 includes in one data file the recognition results for each page from the page confirmed to contain an anchor image as an element image to the page immediately preceding the next page confirmed to contain an anchor image. In other words, the processor 10 creates a data file that includes in one file the recognition results for pages that have a predetermined relationship with the page confirmed to contain an anchor image as an element image. In this way, the processor 10 executes information processing based on the zone OCR application APA, and the computer with the processor 10 as its central part functions as a creation unit.

[0064] If the division function is disabled, the processor 10 judges NO in ACT36 and proceeds to ACT38. In ACT38, the processor 10 updates the data file being edited so as to include the page data generated in ACT31 or ACT32. In other words, if the division function is disabled, the processor 10 adds to the data file being edited even the page in which the anchor was detected.

[0065] Now, if the anchor function is disabled, the processor 10 judges NO in ACT25 and proceeds to ACT39 in FIG. In ACT39, the processor 10 instructs the recognition unit 17 to execute zone OCR. The processor 10 instructs the recognition unit 17 to execute recognition, for example, with notification of the coordinates and recognition type set in fields FAB and FAD of the recognition setting table TAA included in the applied template. If the applied template includes multiple recognition setting tables TAA, the processor 10 notifies the recognition unit 17 of the coordinates and recognition type for the multiple recognition setting tables TAA as a set. The coordinates notified at this time are those set in the recognition setting table TAA as described above, and have not been corrected. The recognition unit 17 recognizes text within a region of the specified coordinates in the processing image if the specified recognition type is text, or recognizes a barcode if the specified recognition type is a barcode.

[0066] As ACT40, the processor 10 generates page data in a predetermined data format that reflects the recognition result by the recognition unit 17. For example, the processor 10 generates page data including, as content, text data obtained as the recognition result by the recognition unit 17, with the character color made transparent, and pasted onto image data representing a processed image.

[0067] On the other hand, if the anchor function is enabled but the processor 10 cannot detect an anchor from the processed image, the processor 10 judges NO in ACT27 in FIG. 4 and proceeds to ACT41 in FIG. In ACT41, the processor 10 checks whether full-page OCR is enabled. If the user wants recognition to be performed on pages that do not contain anchors, the user sets full-page OCR to enabled. For example, the processor 10 checks whether "enabled" or "disabled" is set in the field FBF of the anchor setting table TAB included in the applied template, and if "enabled" is set, the processor 10 judges the result as YES and proceeds to ACT42.

[0068] In ACT42, the processor 10 instructs the recognition unit 17 to execute full-area OCR. When full-area OCR is instructed, the recognition unit 17 recognizes text within the entire area of ​​the processing image. The entire area is a fixed area that is predefined within the processing image, for example, an area excluding a part of the periphery of the processing image. The entire area is an area unrelated to the area in which the anchor is formed.

[0069] As ACT43, the processor 10 generates page data in a predetermined data format that reflects the recognition result by the recognition unit 17. For example, the processor 10 generates page data including, as content, text data obtained as the recognition result by the recognition unit 17, with the character color made transparent, and pasted onto image data representing a processed image.

[0070] If full-page OCR is disabled, the processor 10 judges NO in ACT41 and proceeds to ACT44. As ACT44, the processor 10 generates page data in a predetermined data format that is not related to the recognition result by the recognition unit 17. For example, the processor 10 generates page data that includes, as content, only image data representing a processed image.

[0071] When the processor 10 has finished generating the page data in ACT40, ACT43, or ACT44, it proceeds to ACT45 in any case. In ACT45, the processor 10 checks whether or not there is a data file being edited. If the image to be processed is the target image related to the first page, there is no data file being edited. Therefore, the processor 10 judges NO in this case and proceeds to ACT46. In ACT46, the processor 10 creates a new data file including the page data created in ACT40, ACT43, or ACT44 as the data file being edited.

[0072] Furthermore, if a data file being edited exists, the processor 10 judges YES in ACT45 and proceeds to ACT47. In ACT 47, the processor 10 updates the data file being edited so as to include the page data generated in ACT 40, ACT 43, or ACT 44. In other words, the processor 10 adds new page data to the data file being edited. When the processor 10 finishes ACT46 or ACT47, it proceeds to ACT35 in FIG. 4 and executes the subsequent steps in the same manner as described above.

[0073] If the processor 10 proceeds to ACT35 after completing the above-mentioned process with the target image on the final page as the processed image, the processor 10 judges NO in ACT35 and proceeds to ACT48. In ACT48, the processor 10 saves the data file being edited in the file storage unit STB. When the processor 10 saves the data file in the file storage unit STB in ACT48 or ACT37, if "Use as folder name" is set in the field FAE of the recognition setting table TAA included in the applied template, the processor 10 uses the result of character recognition to save the data file in a folder with a folder name determined by a predetermined rule. If "Use as file name" is set in the field FAE, the processor 10 uses the result of character recognition to save the data file as a data file with a file name determined by a predetermined rule. If "Do not use" is set in the field FAE, the processor 10 applies the folder name and file name determined by the predetermined rule regardless of the result of character recognition. Then, the processor 10 ends the zone OCR process.

[0074] As described above, the MFP1 operates in various ways depending on the settings, one of which is the following operation. The MFP1 reads a group of documents in which multiple pages of documents each containing an anchor, which is a common image, are stacked together at once. The MFP1 recognizes characters shown in a recognition area determined relatively to the area in which the anchor is formed, for at least some of the pages. The MFP1 then divides the recognition results into multiple data files, each of which has a page containing the common image as its first page, and includes the results in the multiple data files. In this way, the recognition results can be divided into multiple data files using various images that may be shown on the first page, such as a company logo, as anchors and sharing the anchor for determining the recognition area. As a result, the function of dividing the character recognition results to generate multiple data files can be made easier to use.

[0075] In addition, the MFP1 includes in one data file the recognition results from the page where the anchor was detected to the page just before the page where the next anchor was detected. This makes it possible to create multiple data files by dividing the recognition results for each document while overlapping and scanning multiple documents at the same time, each of which is made up of multiple pages whose first page contains a common image in a common position.

[0076] In the MFP1, when the division function is enabled, the division form of the data file is determined by the page including the anchor, so the page not including the anchor is included in the scanned document. When the MFP1 performs character recognition on a page not including an anchor, the recognition area is the entire area of ​​the page. This allows character recognition to be performed even if the recognition area cannot be specified as an area that is determined relatively to the area where the anchor is formed.

[0077] When using the MFP1, a page containing an anchor as a marker for file division may be inserted into the scanned document. This page may not contain content that is the subject of character recognition. If zone OCR is disabled, the MFP1 does not perform character recognition on pages that contain anchors. Therefore, in the above case, unnecessary recognition processing is not performed, and processing time can be reduced.

[0078] This embodiment can be modified in various ways as follows. After performing the coordinate correction in ACT29 of FIG. 4, the processor 10 may execute zonal OCR on the processed image in which no anchor is detected, based on the coordinates after the correction.

[0079] Processor 10 may also perform full-area OCR on the processed image in which the anchor is detected.

[0080] Instead of or in addition to the operation of the above embodiment, the processor 10 may create one data file by collecting page data related to the processed image in which the anchor is detected. This makes it possible to create a digest document that collects the first pages of multiple documents, for example. In other words, it is optional to create a data file in which the recognition results related to the page in which the anchor is detected are collected into one file, and may be determined appropriately by, for example, the designer of the MFP1, the administrator of the MFP1, or the user.

[0081] The processor 10 may create the data file without including image data representing the processed image, or the processor 10 may create the data file including the result of the recognition and any data other than the image data representing the processed image.

[0082] The recognition process performed by the recognition unit 17 may be executed by the processor 10 .

[0083] In the above embodiment, instructions received by the computer terminal 3 may be received by the operation / display unit 13. Also, instructions received by the operation / display unit 13 may be received by the computer terminal 3.

[0084] It can also be realized as an image processing device that processes image data obtained by another reading device or image data sent from another information processing device.

[0085] Each function realized by the processor 10 through information processing can be realized in part or in whole by hardware that executes information processing not based on a program, such as a logic circuit, etc. Also, each of the above functions can be realized by combining the above hardware, such as the logic circuit, with software control.

[0086] Although some embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope and spirit of the invention, and are included in the scope of the invention and its equivalents described in the claims. The invention as originally claimed in the present application is set forth below. [Appendix 1] A recognition unit that recognizes characters displayed in an image; a confirmation unit that confirms that a predetermined element image is included in each of the scanned images of the plurality of pages; a control unit that controls the recognition unit to recognize characters shown in a recognition area that is determined relatively to an area in which the element images are formed; a creating unit that creates a data file that includes a recognition result by the recognizing unit for a page that has a predetermined relationship with the page of the scanned image that has been confirmed by the confirming unit to include the element image; An image processing device comprising: [Additional Note 2] The creation unit creates the data file by treating the recognition results by the recognition unit for each page from the page of the scanned image confirmed by the confirmation unit to include the element image to the scanned image of a page immediately preceding the next page confirmed by the confirmation unit to include the element image as one file. 2. An image processing device as described in claim 1. [Appendix 3] The control unit controls the recognition unit to recognize characters shown in a predetermined area, regardless of an area in which the element image is formed, for the scanned image in which the confirmation unit cannot confirm that the element image is included. 3. An image processing device according to claim 1 or 2. [Appendix 4] A computer provided in an image processing device together with a recognition unit that recognizes characters represented in an image, a confirmation unit that confirms that a predetermined element image is included in each of the scanned images of the plurality of pages; a control unit that controls the recognition unit to recognize characters shown in a recognition area that is determined relatively to an area in which the element images are formed; a creating unit that creates a data file that includes a recognition result by the recognizing unit for a page that has a predetermined relationship with the page of the scanned image that has been confirmed by the confirming unit to include the element image; An information processing program that enables the system to function as such. [Appendix 5] The computer, It is confirmed that each of the scanned images of the plurality of pages contains a predetermined element image, controlling a recognition unit that recognizes characters shown in an image so as to recognize characters shown in a recognition area that is determined relatively to an area in which the element image is formed; creating a data file including, as one file, the recognition results for pages that have a predetermined relationship with the page of the scanned image that is confirmed to include the element image; Image processing methods. [Explanation of symbols]

[0087] 1...MFP, 2...communication network, 3...computer terminal, 10...processor, 11...main memory, 12...auxiliary storage unit, 13...operation and display unit, 14...scan unit, 15...print unit, 16...fax unit, 17...recognition unit, 18...communication unit, 19...transmission path.

Claims

1. a recognition unit that recognizes characters displayed in an image; a confirmation unit that confirms that a predetermined element image is included in a partial area of ​​each of the scanned images of the plurality of pages; a control unit that controls the recognition unit to recognize characters shown in a recognition area that is determined relatively to an area in which the element images are formed; a creating unit that creates a data file that combines the recognition results of the recognition unit with respect to the page of the scanned image that has been confirmed by the confirming unit to include the element image and a page that has a predetermined relationship with this page; An image processing device comprising:

2. the creation unit creates the data file by using, as one file, the recognition results by the recognition unit for the page of the scanned image confirmed by the confirmation unit to include the element image and each page of the scanned image that is a page subsequent to the page confirmed by the confirmation unit to include the element image and that is one page prior to the page next confirmed by the confirmation unit to include the element image. The image processing device according to claim 1 .

3. The control unit controls the recognition unit to recognize characters shown in a predetermined area, regardless of an area in which the element image is formed, for the read image in which the confirmation unit cannot confirm that the element image is included.

3. The image processing device according to claim 1 or 2.

4. A computer provided in an image processing device together with a recognition unit that recognizes characters displayed in an image, a confirmation unit that confirms that a predetermined element image is included in a partial area of ​​each of the scanned images of the plurality of pages; a control unit that controls the recognition unit to recognize characters shown in a recognition area that is determined relatively to an area in which the element images are formed; a creating unit that creates a data file that combines the recognition results of the recognition unit with respect to the page of the scanned image that has been confirmed by the confirming unit to include the element image and a page that has a predetermined relationship with this page; An information processing program that enables the system to function as such.

5. The computer For each of the multiple pages of scanned images, it is confirmed that a predetermined element image is included in a partial area of ​​the scanned image; controlling a recognition unit that recognizes characters shown in an image so as to recognize characters shown in a recognition area that is determined relatively to an area in which the element image is formed; creating a data file that includes, as one file, the recognition results for the page of the scanned image that has been confirmed to include the element image and a page that has a predetermined relationship with this page; Image processing methods.

Images