Image processing system

Abstract

[Problem] To provide an image processing system with which the effort of a user can be reduced. [Solution] Provided is an image processing system (20) characterized by comprising an image processing unit (25a) that processes image data by using storage destination determination information for determining the storage destination of the image data, wherein: the storage destination determination information includes a combination of the storage destination and a condition for determining the storage destination; the image processing unit (25a) stores the image data in a storage destination associated, in the storage destination determination information, with a condition satisfied by the result of performing character recognition on an image based on the image data; when the result does not satisfy any of the conditions in the storage destination determination information, the image processing unit (25a) has a user designate the storage destination for storing the image data and stores the image data in the storage destination designated by the user; and when the storage destination for storing the image data has been designated by the user, the image processing unit (25a) includes, in the storage destination determination information, a new combination of a new condition corresponding to the result and the storage destination designated by the user.

Description

Image processing system

[0001] The present invention relates to an image processing system that processes image data.

[0002] Conventionally, when characters extracted by character recognition for an image based on image data satisfy specific conditions regarding character type and character count, an image processing system automatically stores the image data in a folder corresponding to the characters extracted by character recognition; when the characters extracted by character recognition do not satisfy the specific conditions, the image processing system allows a user to specify a folder for storing the image data, and stores the image data in the folder specified by the user. Such an image processing system is known (see, for example, Patent Document 1).

[0003] Japanese Unexamined Patent Application Publication No. 2023-099211

[0004] However, in conventional image processing systems, when characters extracted by character recognition do not satisfy the specific conditions, the user is required to specify a folder for storing image data every time, which poses a problem of being burdensome for the user.

[0005] Accordingly, an object of the present invention is to provide an image processing system capable of reducing the burden on the user.

[0006] The image processing system of the present invention comprises an image processing unit that processes the image data using storage destination determination information for determining a storage destination of the image data, wherein the storage destination determination information includes combinations of conditions for determining the storage destination and the storage destination; the image processing unit stores the image data in the storage destination associated in the storage destination determination information with the condition satisfied by a result of character recognition performed on an image based on the image data; when the result does not satisfy any of the conditions in the storage destination determination information, the image processing unit prompts the user to specify the storage destination for storing the image data, and stores the image data in the storage destination specified by the user; and when the storage destination for storing the image data is specified by the user, the image processing unit adds the new combination of the new condition corresponding to the result and the storage destination specified by the user to the storage destination determination information.

[0007] With this configuration, the image processing system of the present invention stores image data in a storage location associated with the conditions that the character recognition result on the image data satisfies in the storage location determination information. If none of the conditions in the storage location determination information are satisfied by the character recognition result, the system allows the user to specify a storage location for the image data and stores the image data in the storage location specified by the user. When a storage location for the image data is specified by the user, the system includes a new combination of new conditions corresponding to the character recognition result and the storage location specified by the user in the storage location determination information. As a result, when a character recognition result similar to the result obtained when the storage location was previously specified by the user occurs, the image data can be automatically stored in the storage location previously specified by the user, thereby reducing the effort required from the user.

[0008] In the image processing system of the present invention, the image processing unit performs character recognition on the image using a format for performing character recognition, and if no format suitable for the image exists, the image processing unit may store the image data in the storage location associated in the unsuitable format storage location determination information, which is the storage location determination information for when no suitable format exists, with the condition satisfied by the result, which is the pattern of difference between the image and the format.

[0009] In the image processing system of the present invention, if no format suitable for the image exists, and none of the conditions in the information determining the storage location for the unsuitable format are satisfied by the result which is the pattern, the image processing unit may have the user specify the storage location for storing the image data and store the image data in the storage location specified by the user.

[0010] In the image processing system of the present invention, if no format suitable for the image exists, the image processing unit may include a new combination of the pattern as a new condition in the information determining the storage location for storing the image data when the storage location for storing the image data is specified by the user.

[0011] In the image processing system of the present invention, the format is defined as an area for character recognition, and the image processing unit may determine that the format is not suitable for the image if it is unable to extract characters from the area in the format for the image.

[0012] In the image processing system of the present invention, the format is defined as an area for character recognition, and the image processing unit may determine that the format is not suitable for the image if the font of at least one character extracted from the area in the format for the image is not included in the font set in the area.

[0013] In the image processing system of the present invention, the image processing unit performs character recognition on the image using a format for performing character recognition, and if a format suitable for the image exists, the image processing unit may store the image data in the storage location that is associated in the storage location determination information when a suitable format exists, which is storage location determination information when a suitable format exists, with the conditions that the result satisfies.

[0014] In the image processing system of the present invention, if a format suitable for the image exists, and none of the conditions in the information determining the storage location when a suitable format is available are met, the image processing unit may have the user specify the storage location for storing the image data and store the image data in the storage location specified by the user.

[0015] In the image processing system of the present invention, if a format suitable for the image exists, the image processing unit may, when a user specifies a storage location for storing the image data, include a new combination of new conditions corresponding to the result and the storage location specified by the user in the information determining the storage location when a suitable format exists.

[0016] The image processing system of the present invention can reduce the effort required of the user.

[0017] This is a block diagram of an example of a system according to one embodiment of the present invention. This is a block diagram of an example of the image processing system shown in Figure 1 when it is configured with one computer. This is a diagram showing an example of an image based on image data processed by the image processing system shown in Figure 2. This is a diagram showing an example of a format stored in the storage unit shown in Figure 2. This is a diagram showing a different example of a format stored in the storage unit shown in Figure 2, different from the example shown in Figure 4A. This is a diagram showing an example of format management information shown in Figure 2. This is a diagram showing an example of storage location determination information when a compatible format is found, as shown in Figure 2. This is a diagram showing an example of difference pattern information shown in Figure 2. This is a diagram showing an example of storage location determination information when a compatible format is not found, as shown in Figure 2. This is a block diagram of an example of an image reading device shown in Figure 1 when it is configured with an MFP. This is a sequence diagram of the operation of the system shown in Figure 1 when image data read from a document by the image reading device is processed by the image processing system. This is a flowchart showing a part of an example of image storage processing shown in Figure 10. This is a flowchart that continues from the flowchart shown in Figure 11. This is a flowchart showing the operation of the image reading device shown in Figure 9 when a folder specification is requested. This is a diagram showing a different example of storage location determination information when a compatible format is found, stored by the image processing system, different from the example shown in Figure 6. Figures 11 and 12 are flowcharts showing some variations of the operation shown in Figures 11 and 12.

[0018] Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[0019] First, the configuration of a system according to one embodiment of the present invention will be described.

[0020] Figure 1 is a block diagram of an example of the system 10 according to this embodiment.

[0021] As shown in Figure 1, system 10 includes an image processing system 20 for processing image data. The image processing system 20 may be composed of one computer, such as a PC (Personal Computer), or it may be composed of multiple computers. The image processing system 20 may be configured on the cloud.

[0022] System 10 includes an image reading device 30 that generates image data by reading a document. The image reading device may be configured as, for example, a dedicated scanner, or as an MFP (Multifunction Peripheral).

[0023] Figure 2 is a block diagram of an example of an image processing system 20 that is configured with a single computer.

[0024] As shown in Figure 2, the image processing system 20 includes an operation unit 21, which is an operation device such as a keyboard or mouse to which various operations are input; a display unit 22, which is a display device such as an LCD (Liquid Crystal Display) to which various information is displayed; a communication unit 23, which is a communication device that communicates with external devices via a network such as a LAN (Local Area Network) or the Internet, or directly by wired or wireless connection without going through a network; a storage unit 24, which is a non-volatile storage device such as a semiconductor memory or HDD (Hard Disk Drive) to store various types of information; and a control unit 25 that controls the entire image processing system 20.

[0025] The storage unit 24 can store an image processing program 24a for processing image data. The image processing program 24a may be installed in the image processing system 20 during the manufacturing stage, or it may be additionally installed in the image processing system 20 from an external storage medium such as a USB (Universal Serial Bus) memory, or it may be additionally installed in the image processing system 20 from a network.

[0026] Figure 3 shows an example of an image 70 based on image data processed by the image processing system 20.

[0027] The image 70 shown in Figure 3 is an image of an invoice. The image 70 includes a string 71 indicating the recipient of the invoice, a string 72 indicating one item, a string 73 indicating the invoice amount for the item indicated by string 72, a string 74 indicating one item different from the item indicated by string 72, a string 75 indicating the invoice amount for the item indicated by string 74, and a string 76 indicating the total invoice amount on the invoice.

[0028] As shown in Figure 2, the storage unit 24 can store a format 24b for performing optical character recognition on an image. The storage unit 24 can also store formats other than format 24b for performing optical character recognition on an image.

[0029] Figure 4A shows an example of a format stored in the storage unit 24. Figure 4B shows another example of a format stored in the storage unit 24, different from the example shown in Figure 4A.

[0030] The format 80 shown in Figure 4A is a format for an invoice. Format 80 includes two areas for character recognition (hereinafter referred to as "character recognition target areas"): a character recognition target area 81 for the recipient of the invoice and a character recognition target area 82 for the total amount billed on the invoice. The character types of characters included in the character recognition target areas where character recognition is performed include, for example, numbers, kanji, hiragana, and katakana. The character recognition target area 81 is set to contain all character types, and the number of characters included in the character recognition target area 81 is set to be 20 or less. The character recognition target area 82 is set to contain numbers, and the number of characters included in the character recognition target area 82 is set to be 10 or less.

[0031] The format 90 shown in Figure 4B is an invoice format, similar to the format 80 shown in Figure 4A. Format 90 includes two character recognition target areas: a character recognition target area 91 for the invoice recipient and a character recognition target area 92 for the total amount due on the invoice. The character recognition target area 91 is set to contain all character types, and the number of characters contained in the character recognition target area 91 is set to 20 or less. The character recognition target area 92 is set to contain numbers, and the number of characters contained in the character recognition target area 92 is set to 10 or less. The only difference between the format 90 shown in Figure 4B and the format 80 shown in Figure 4A is the position of the character recognition target area that indicates the total amount due on the invoice.

[0032] As shown in Figure 2, the storage unit 24 is capable of storing format management information 24c for managing the formats stored in the storage unit 24.

[0033] Figure 5 shows an example of format management information 24c.

[0034] As shown in Figure 5, the format management information 24c includes the format type (hereinafter referred to as "format type") and a format ID as identification information for each format. The format type may be the type of document to which the image is taken, such as an invoice or receipt. The format management information 24c shown in Figure 5 is depicted with some information omitted.

[0035] As shown in Figure 2, the storage unit 24 can store information 24d indicating the storage location when a suitable format exists for an image based on the image data, which is used to determine the storage location of the image data.

[0036] Figure 6 shows an example of the storage location determination information 24d when a compatible format is found.

[0037] As shown in Figure 6, the storage location determination information 24d when a compatible format is found includes the format ID and the folder where the image data will be stored, for each format. The storage location determination information 24d when a compatible format is found shown in Figure 6 is depicted with some information omitted.

[0038] As shown in Figure 2, the storage unit 24 can store difference pattern information 24e, which indicates the difference pattern between an image based on image data and the format. In addition to the difference pattern information 24e, the storage unit 24 can also store difference pattern information indicating the difference pattern between an image based on image data and the format.

[0039] Figure 7 shows an example of difference pattern information 24e.

[0040] As shown in Figure 7, the difference pattern information 24e includes differences in the position of each character recognition target area in the format, differences in the character type of each character recognition target area in the format, and differences in the number of characters of each character recognition target area in the format, for each format. The difference pattern information 24e shown in Figure 7 is depicted with some information omitted.

[0041] The difference in the position of the character recognition target area in the format may also be expressed as whether or not it was possible to extract characters from the target character recognition target area in the format for an image based on image data. In the example shown in Figure 7, "○" indicates that it was possible to extract characters from the target character recognition target area in the format for an image based on image data, and "×" indicates that it was not possible to extract characters from the target character recognition target area in the format for an image based on image data. Furthermore, when it was not possible to extract characters from the target character recognition target area in the format for an image based on image data, the difference in the position of the character recognition target area in the format may be expressed at multiple levels, distinguishing between the distance between the character closest to the target character recognition target area in the image based on image data and the target character recognition target area.

[0042] The difference in character types within the character recognition target area in the format may be whether or not the character types of all characters extracted from the target character recognition target area in the format for an image based on image data are included in the character types set for this character recognition target area. Furthermore, the difference in character types within the character recognition target area in the format may be that, if the character type of at least one character extracted from the target character recognition target area in the format for an image based on image data is not included in the character types set for this character recognition target area, then the character types of all characters extracted from the target character recognition target area in the format for an image based on image data that are not included in the character types set for this character recognition target area may be represented. In the example shown in Figure 7, a "○" indicates that all the character types extracted from the target character recognition area in the format for an image based on image data are included in the character types set for this character recognition area. If at least one character type extracted from the target character recognition area in the format for an image based on image data is not included in the character types set for this character recognition area, the figure indicates the character types of all the characters extracted from the target character recognition area in the format for an image based on image data that are not included in the character types set for this character recognition area.

[0043] The difference regarding the number of characters in the character recognition target area in a format may be based on whether the number of characters extracted from the target character recognition target area in the format for an image based on image data is within the number of characters set for this character recognition target area. In the example shown in FIG. 7, "○" indicates that the number of characters extracted from the target character recognition target area in the format for an image based on image data is within the number of characters set for this character recognition target area, and "×" indicates that the number of characters extracted from the target character recognition target area in the format for an image based on image data is not within the number of characters set for this character recognition target area. Furthermore, when the number of characters extracted from the target character recognition target area in the format for an image based on image data is not within the number of characters set for this character recognition target area, the difference regarding the number of characters in the character recognition target area in a format may be expressed by distinguishing, in multiple levels, how much the number of characters extracted from the target character recognition target area in the format for an image based on image data exceeds the number of characters set for this character recognition target area.

[0044] The difference pattern information 24e shown in FIG. 7 indicates a difference pattern between an image based on image data and a format for an invoice.

[0045] In the example shown in FIG. 7, for a format with a format ID "F0001", it is indicated that the position, character type, and number of characters match those of the image based on image data for the character recognition target area for the billing address. In the example shown in FIG. 7, for a format with a format ID "F0001", it is indicated that the position does not match that of the image based on image data for the character recognition target area for the total billed amount on the invoice.

[0046] In the example shown in FIG. 7, for the format whose format ID is "F0002", it is indicated that the position, character type, and number of characters of the character recognition target area for the destination of an invoice match the image based on image data. In the example shown in FIG. 7, for the format whose format ID is "F0002", the position and number of characters of the character recognition target area for the total billed amount in an invoice match the image based on image data, but it is indicated that hiragana that is not set in this character recognition target area is included in the image based on image data.

[0047] In the example shown in FIG. 7, for the format whose format ID is "F0003", the position and character type of the character recognition target area for the destination of an invoice match the image based on image data, but it is indicated that the number of characters does not match the image based on image data. In the example shown in FIG. 7, for the format whose format ID is "F0003", it is indicated that the position, character type, and number of characters of the character recognition target area for the total billed amount in an invoice match the image based on image data.

[0048] As shown in FIG. 2, the storage unit 24 can store non-matching format storage destination determination information 24f for determining the storage destination of image data when there is no format matching the image based on image data.

[0049] FIG. 8 is a diagram showing an example of the non-matching format storage destination determination information 24f.

[0050] As shown in FIG. 8, the non-matching format storage destination determination information 24f includes, for each difference pattern information, identification information of difference pattern information (hereinafter referred to as "pattern ID") and a folder as the storage destination of image data. In the non-matching format storage destination determination information 24f shown in FIG. 8, part of the information is drawn in an omitted manner.

[0051] The control unit 25 shown in Figure 2 includes, for example, a CPU (Central Processing Unit), a ROM (Read Only Memory) that stores programs and various data, and a RAM (Random Access Memory) used as a working area for the CPU of the control unit 25. The CPU of the control unit 25 executes programs stored in the storage unit 24 or the ROM of the control unit 25.

[0052] The control unit 25 implements an image processing unit 25a that processes image data by executing an image processing program 24a.

[0053] Figure 9 is a block diagram of an example of an image reading device 30 that is composed of an MFP.

[0054] As shown in Figure 9, the image reading device 30 is a computer comprising: an operation unit 31 which is an operation device such as buttons into which various operations are input; a display unit 32 which is a display device such as an LCD (Liquid Crystal Display) that displays various information; a printer 33 which is a printing device that prints images onto a recording medium such as paper; a scanner 34 which is a reading device that reads images from an original document; a communication unit 35 which is a communication device that communicates with external devices via a network such as a LAN or the Internet, or directly via wired or wireless connection without going through a network; a fax communication unit 36 ​​which is a fax device that performs fax communication with an external facsimile device (not shown) via a communication line such as a public telephone line; a storage unit 37 which is a non-volatile storage device such as a semiconductor memory or HDD (Hard Disk Drive) that stores various information; and a control unit 38 that controls the entire image reading device 30.

[0055] The storage unit 37 can store an image input program 37a for inputting image data to the image processing system 20. The image input program 37a may be installed in the image reader 30 during the manufacturing stage, or it may be additionally installed in the image reader 30 from an external storage medium such as a USB memory, or it may be additionally installed in the image reader 30 from a network.

[0056] The control unit 38 includes, for example, a CPU, a ROM that stores programs and various data, and RAM as memory used as a working area for the CPU of the control unit 38. The CPU of the control unit 38 executes programs stored in the storage unit 37 or the ROM of the control unit 38.

[0057] The control unit 38 implements an image input unit 38a that inputs image data to the image processing system 20 by executing an image input program 37a.

[0058] Next, we will explain the operation of system 10.

[0059] Figure 10 is a sequence diagram of the operation of system 10 when image data read from a document by the image reading device 30 is processed by the image processing system 20.

[0060] A user of the image reading device 30 can instruct the image reading device 30 via the operation unit 31 of the image reading device 30 to display a list of format types stored in the image processing system 20. When the image input unit 38a of the image reading device 30 is instructed to display a list of format types, it requests the list of format types from the image processing system 20, as shown in Figure 10 (S101).

[0061] When the image processing unit 25a of the image processing system 20 receives the request in S101, it notifies the image reading device 30 of the list of format types shown in the format management information 24c (S102).

[0062] When the image input unit 38a of the image reading device 30 receives the notification in S102, it displays the list notified in S102 on the display unit 32 (S103).

[0063] Therefore, the user of the image reading device 30 can specify one of the format types from the list displayed in S103 and then instruct the scanner 34 to read the document. When one of the format types is specified via the operation unit 31 from the list displayed on the display unit 32 and the scanner 34 is instructed to read the document via the operation unit 31, the image input unit 38a of the image reading device 30 reads the document with the scanner 34 and generates image data (S104).

[0064] When the processing in S104 is completed, the image input unit 38a transmits the specified format type and the image data generated in S104 to the image processing system 20 via the operation unit 31 (S105).

[0065] When the image processing unit 25a of the image processing system 20 receives the format type (hereinafter referred to as "target format type") and the image data (hereinafter referred to as "target image data") transmitted in S105, it executes an image storage process to store the target image data in a folder (S106).

[0066] Figure 11 is a flowchart showing a part of an example of the image storage process shown in Figure 10. Figure 12 is a flowchart that continues from the flowchart shown in Figure 11.

[0067] As shown in Figures 11 and 12, the image processing unit 25a generates difference pattern information for the target image data (S121). The difference pattern information generated in S121 (hereinafter referred to as "target difference pattern information" in the description of the operation shown in Figures 11 and 12) does not yet have a value entered at the time it is generated in S121.

[0068] When the processing in S121 is completed, the image processing unit 25a targets only one format ID that has not yet been targeted in the operations shown in Figures 11 and 12, from among the format IDs associated with the target format type in the format management information 24c (S122).

[0069] When the processing in S122 is completed, the image processing unit 25a sets a flag (hereinafter referred to as the "matching flag") that indicates whether or not the format identified by the current target format ID (hereinafter referred to as the "target format") is compatible with the image data (S123).

[0070] When the processing in S123 is completed, the image processing unit 25a performs character recognition in the target format on the image based on the target image data (S124).

[0071] When the processing in S124 is completed, the image processing unit 25a targets only one of the character recognition target areas in the target format that has not yet been targeted in the operations shown in Figures 11 and 12 (S125).

[0072] When processing in S125 is completed, the image processing unit 25a determines the difference between the image based on the target image data and the target format regarding the position of the current target character recognition area based on that image data, based on the character recognition result in S124 (S126). Here, if the image processing unit 25a was able to extract characters from the current target character recognition area in S124 for the image based on the target image data, it determines that the image based on the target image data and the target format are compatible with respect to the position of the current target character recognition area. On the other hand, if the image processing unit 25a was unable to extract characters from the current target character recognition area in S124 for the image based on the target image data, it determines that the image based on the target image data and the target format are not compatible with respect to the position of the current target character recognition area.

[0073] When the processing in S126 is completed, the image processing unit 25a writes the result of the determination in S126 to the target difference pattern information (S127).

[0074] When the processing in S127 is completed, the image processing unit 25a determines in S126 whether or not it has been determined that the image based on the target image data and the target format are compatible with the current position of the target character recognition area (S128).

[0075] If the image processing unit 25a determines in S126 that it did not determine that the image based on the target image data and the target format are compatible with the current position of the target character recognition area, it turns down the compatibility flag (S129).

[0076] If the image processing unit 25a determines in S128 that it has determined in S126 that the image based on the target image data and the target format are compatible with respect to the position of the current target character recognition target area, it determines the difference between the image based on the target image data and the target format regarding the character types of the current target character recognition target area based on the character recognition result in S124 (S130). Here, the image processing unit 25a determines that the image based on the target image data and the target format are compatible with respect to the character types of the current target character recognition target area if the character types of all characters extracted in S124 from the current target character recognition target area for the image based on the target image data are included in the character types set for this character recognition target area. On the other hand, if the image processing unit 25a determines that the image based on the target image data and the target format are not compatible with respect to the character types of the current target character recognition target area if the character types of at least one character extracted in S124 from the current target character recognition target area for the image based on the target image data are not included in the character types set for this character recognition target area.

[0077] When the processing in S130 is completed, the image processing unit 25a writes the result of the determination in S130 to the target difference pattern information (S131).

[0078] When the processing in S131 is completed, the image processing unit 25a determines in S130 whether or not it has been determined that the image based on the target image data and the target format are compatible with the character types of the current target character recognition area (S132).

[0079] If the image processing unit 25a determines in S130 that it did not determine in S130 that the image based on the target image data and the target format are compatible with the character types in the current target character recognition area, it turns down the compatibility flag (S133).

[0080] The image processing unit 25a determines in S132 that it has determined in S130 that the image based on the target image data and the target format are compatible with respect to the character types of the current target character recognition target area, or when the processing in S133 is completed, it determines the difference between the image based on the target image data and the target format regarding the number of characters in the current target character recognition target area based on the character recognition result in S124 (S134). Here, the image processing unit 25a determines that the image based on the target image data and the target format are compatible with respect to the number of characters in the current target character recognition target area if the number of characters extracted in S124 from the current target character recognition target area for the image based on the target image data is within the number of characters set in this character recognition target area. On the other hand, the image processing unit 25a determines that the image based on the target image data and the target format are not compatible with respect to the number of characters in the current target character recognition target area if the number of characters extracted in S124 from the current target character recognition target area for the image based on the target image data is not within the number of characters set in this character recognition target area.

[0081] When the processing in S134 is completed, the image processing unit 25a writes the result of the determination in S134 to the target difference pattern information (S135).

[0082] When the processing in S135 is completed, the image processing unit 25a determines in S134 whether or not it has been determined that the image based on the target image data and the target format are compatible with the number of characters in the current target character recognition area (S136).

[0083] If the image processing unit 25a determines in S134 that the image based on the target image data and the target format are not compatible with respect to the number of characters in the current target character recognition area, it turns down the compatibility flag (S137).

[0084] When the processing in S129 is completed, or when the image processing unit 25a determines in S136 that the image based on the target image data and the target format are compatible in terms of the number of characters in the current target character recognition area, or when the processing in S137 is completed, it determines whether there are any character recognition areas in the target format that have not yet been targeted in the operations shown in Figures 11 and 12 (S138).

[0085] If the image processing unit 25a determines in S138 that there are character recognition target areas in the target format that have not yet been targeted in the operations shown in Figures 11 and 12, it executes the process in S125.

[0086] If the image processing unit 25a determines in S138 that there are no character recognition target areas in the target format that have not yet been targeted in the operations shown in Figures 11 and 12, it determines whether the compatibility flag is set or not (S139).

[0087] If the image processing unit 25a determines in S139 that the compatibility flag is set, it stores the target image data in the folder associated with the current target format ID in the compatible format storage location determination information 24d (S140).

[0088] When the processing in S140 is completed, the image processing unit 25a deletes the target difference pattern information (S141) and terminates the operations shown in Figures 11 and 12.

[0089] If the image processing unit 25a determines in S139 that the compatibility flag is not set, it determines whether there are any format IDs among the format IDs associated with the target format type in the format management information 24c that have not yet been targeted in the operations shown in Figures 11 and 12 (S142).

[0090] If the image processing unit 25a determines in S142 that there are format IDs associated with the target format type in the format management information 24c that have not yet been targeted in the operations shown in Figures 11 and 12, it executes the process in S122.

[0091] If the image processing unit 25a determines in S142 that there are no format IDs among the format IDs associated with the target format type in the format management information 24c that have not yet been targeted in the operations shown in Figures 11 and 12, it determines in S143 whether there is any difference pattern information identified by the pattern ID in the compatible format storage location determination information 24f that has the same content as the target difference pattern information.

[0092] If the image processing unit 25a determines in S143 that there is a difference pattern information identified by a pattern ID in the conformance format storage location determination information 24f that has the same content as the target difference pattern information, it stores the target image data in the folder associated in the conformance format storage location determination information 24f with the pattern ID of the difference pattern information identified by a pattern ID in the conformance format storage location determination information 24f that has the same content as the target difference pattern information (S144), and then executes the process in S141.

[0093] If the image processing unit 25a determines in S143 that there is no difference pattern information with the same content as the target difference pattern information, identified by the pattern ID in the compatible format storage destination determination information 24f, it requests the image reading device 30 to specify a folder for storing the target image data (S145).

[0094] Figure 13 is a flowchart showing the operation of the image reading device 30 when a folder is requested.

[0095] When the image input unit 38a of the image reading device 30 receives the request in S145, it performs the operation shown in Figure 13.

[0096] As shown in Figure 13, the image input unit 38a displays a screen on the display unit 32 for specifying the folder to store the image data transmitted in S105 (see Figure 10) (hereinafter referred to as the "folder specification screen") (S161). The user of the image reading device 30 can specify the folder to store the image data transmitted in S105 via the operation unit 31 on the folder specification screen.

[0097] When the processing in S161 is completed, the image input unit 38a determines whether a folder has been specified on the folder specification screen until it determines that a folder has been specified on the folder specification screen (S162).

[0098] When the image input unit 38a determines in S162 that a folder has been specified on the folder selection screen, it notifies the image processing system 20 of the folder specified on the folder selection screen (S163) and terminates the operation shown in Figure 13.

[0099] As shown in Figures 11 and 12, after the processing in S145 is completed, the image processing unit 25a of the image processing system 20 determines whether or not a folder has been notified by the image reading device 30 until it determines that a folder has been notified by the image reading device 30 (S146).

[0100] If the image processing unit 25a determines in S146 that a folder has been notified by the image reading device 30, it stores the target image data in the folder notified by the image reading device 30 (S147).

[0101] When the processing in S147 is completed, the image processing unit 25a writes the combination of the pattern ID of the target difference pattern information and the folder in which the target image data was stored in S147 to the compatible format storage destination determination information 24f (S148), and terminates the operations shown in Figures 11 and 12.

[0102] In the above, the folder where the image data is stored is determined for each format. However, the image processing system 20 may also determine the folder where the image data is stored according to the string extracted from the character recognition target area.

[0103] When the image processing system 20 determines the storage location folder for image data according to the string extracted from the character recognition target area, it may store the storage location determination information 24g shown in Figure 14 in the storage unit 24 instead of the storage location determination information 24d shown in Figure 6.

[0104] Figure 14 shows an example of the storage location determination information 24g when a compatible format is found.

[0105] As shown in Figure 14, the storage location determination information 24g when a compatible format is found includes the format type, conditions for the string extracted from the character recognition target area corresponding to a specific item, and the folder where the image data will be stored, for each condition on the string. Examples of items in the character recognition target area include the recipient of the invoice and the total amount billed on the invoice. The storage location determination information 24g when a compatible format is found shown in Figure 14 is depicted with some information omitted. The following explanation will use the case where a specific item is the recipient of the invoice as an example.

[0106] Figure 15 is a flowchart showing some modified examples of the operations shown in Figures 11 and 12.

[0107] The operation shown in Figure 15 differs from the operations shown in Figures 11 and 12 in that the processing after it is determined in S139 that the compliance flag is set.

[0108] As shown in Figure 15, when the image processing unit 25a of the image processing system 20 determines in S139 that the compatibility flag is set, it determines whether there is a string extracted in S124 from the character recognition target area for the invoice address for the image based on the target image data that matches the conditions for the string associated with the compatible format storage location determination information 24g for the target format type (S181). The image processing unit 25a determines that the string extracted in S124 from the character recognition target area for the invoice address for the image based on the target image data matches the conditions in the compatible format storage location determination information 24g if the string extracted in S124 from the character recognition target area for the invoice address for the image based on the target image data matches the conditions in the compatible format storage location determination information 24g. On the other hand, the image processing unit 25a determines that the string extracted in S124 from the character recognition target area for the invoice recipient for the image based on the target image data does not match the conditions in the storage location determination information 24g when a suitable format is found.

[0109] If the image processing unit 25a determines in S181 that there is a string extracted in S124 from the character recognition target area for the invoice address for an image based on the target image data that matches the conditions for the string associated in the compatible format storage location determination information 24g for the target format type, then the image processing unit 25a stores the target image data in the folder associated in the compatible format storage location determination information 24g with the conditions for the string extracted in S124 from the character recognition target area for the invoice address for an image based on the target image data that matches the target format type (S182).

[0110] When the processing in S182 is completed, the image processing unit 25a deletes the target difference pattern information (S141) and terminates the operation shown in Figure 15.

[0111] If the image processing unit 25a determines in S181 that there is no string extracted in S124 from the character recognition target area for the invoice address for an image based on the target image data that matches the conditions for the string associated in the storage location determination information 24g when a compatible format is found for the target format type, it requests the image reading device 30 to specify a folder for storing the target image data (S183).

[0112] When the image input unit 38a of the image reading device 30 receives the request in S183, it performs the operation shown in Figure 13.

[0113] When the processing in S183 is completed, the image processing unit 25a of the image processing system 20 determines whether or not a folder has been notified by the image reading device 30 until it determines that a folder has been notified by the image reading device 30 (S184).

[0114] If the image processing unit 25a determines in S184 that a folder has been notified by the image reading device 30, it stores the target image data in the folder notified by the image reading device 30 (S185).

[0115] When the processing in S185 is completed, the image processing unit 25a writes the combination of the target format type, the string extracted in S124 from the character recognition target area for the invoice address for the image based on the target image data, and the folder in which the target image data is stored in S185 to the compatible format storage location determination information 24g (S186), and then executes the processing in S141.

[0116] In the operation shown in Figure 15, the user of the image reading device 30 is asked to specify a folder in the processing steps S183 to S185. However, if the image processing unit 25a determines in S181 that there is no string extracted in S124 from the character recognition target area for the invoice address for an image based on the target image data that matches the conditions for the string associated in the storage location determination information 24g when a compatible format is found for the target format type, the image processing unit 25a may automatically determine a folder based on the string extracted in S124 from the character recognition target area for the invoice address for an image based on the target image data, for example, a folder with the same name as this string, as the folder to store the target image data, without asking the image reading device 30 to specify a folder to store the target image data.

[0117] In the operation shown in Figure 15, the item in the string recognition target area of ​​the string in the conforming format storage location determination information 24g is the recipient of the invoice. However, the item in the string recognition target area of ​​the string in the conforming format storage location determination information 24g may be an item other than the recipient of the invoice. For example, the item in the string recognition target area of ​​the string in the conforming format storage location determination information 24g may be the total amount of the invoice. If the item in the string recognition target area of ​​the string in the conforming format storage location determination information 24g is the total amount of the invoice, the condition in the conforming format storage location determination information 24g may be, for example, a condition that it is less than or equal to a specific amount such as one million yen. The image processing unit 25a may then write the condition that it is greater than a specific amount to the conforming format storage location determination information 24g in the processing of S186.

[0118] In the operations shown in Figures 11 and 12, the image processing unit 25a determines the folder to store the target image data based on the position of the character recognition target area in the image based on the image data, the character type of the character extracted from the character recognition target area in the image based on the image data, and the number of characters extracted from the character recognition target area in the image based on the image data. However, the image processing unit 25a does not have to use at least one of the position of the character recognition target area in the image based on the image data, the character type of the character extracted from the character recognition target area in the image based on the image data, and the number of characters extracted from the character recognition target area in the image based on the image data to determine the folder to store the target image data. Alternatively, it may use an element other than the position of the character recognition target area in the image based on the image data, the character type of the character extracted from the character recognition target area in the image based on the image data, and the number of characters extracted from the character recognition target area in the image based on the image data to determine the folder to store the target image data. For example, the image processing unit 25a may use at least one of the font of characters extracted from the character recognition target area for an image based on image data, and the content of a string extracted from the character recognition target area for an image based on image data, to determine the folder in which the target image data is stored.

[0119] Examples of character fonts include MS Mincho and MS Gothic. For example, the image processing unit 25a determines that the image based on the current target image data and the current target format are compatible with respect to the font of the character recognition area of ​​the current target if the fonts of all characters extracted from the character recognition area of ​​the current target in the current target format are included in the font set in the character recognition area of ​​the current target. On the other hand, the image processing unit 25a determines that the image based on the current target image data and the current target format are not compatible with respect to the font of the character recognition area of ​​the current target if the font of at least one character extracted from the character recognition area of ​​the current target in the current target format is not included in the font set in the character recognition area of ​​the current target.

[0120] As explained above, if no suitable format exists for the image (NO in S139 and NO in S142), the image processing system 20 stores the image data in the folder associated with the suitable format storage location determination information 24f that satisfies the pattern of difference between the image and the format (YES in S143 and S144), thereby reducing the effort required from the user.

[0121] If no format suitable for the image exists (NO in S139 and NO in S142), and if none of the conditions in the storage location determination information 24f for the absence of a suitable format are met by the difference pattern between the image and the format (NO in S143), the image processing system 20 allows the user to specify a folder to store the image data (S145 and S146) and stores the image data in the folder specified by the user (S147). Thus, the image data can be stored in an appropriate storage location specified by the user.

[0122] When no suitable format exists for an image (NO in S139 and NO in S142), and when a folder for storing image data is specified by the user (YES in S146), the image processing system 20 includes a new combination of a new condition as a pattern of differences between the image and the format, and the folder specified by the user, in the information 24f for determining the storage location where a suitable format does not exist (S148). As a result, if the same character recognition result as when the folder was previously specified by the user occurs, the image data can be automatically stored in the folder previously specified by the user, thereby reducing the effort required from the user.

[0123] The image processing system 20 determines that the format is incompatible with the image if it is unable to extract characters from the character recognition target area in the format (S126), thereby improving the accuracy of determining the folder to store the image data.

[0124] The image processing system 20 can improve the accuracy of determining the folder to store the image data when it determines that the format is incompatible with the image if the font of at least one character extracted from the character recognition target area in the image format is not included in the font set in the character recognition target area.

[0125] The image processing system 20 automatically repeats the determination of whether a format is suitable for the image for each format (S122 to S139) until it determines that a format suitable for the image exists (YES in S139), or until the determination of whether a format is suitable for the image is completed for all formats that are subject to the determination of whether a format is suitable for the image (NO in S142). This improves the accuracy of determining the folder in which the image data will be stored.

[0126] The image processing system 20, when a format suitable for the image exists (YES in S139), stores the image data in the folder associated with the conditions satisfied by the character recognition result in the storage location determination information 24g when a suitable format exists (YES in S181 and S182), thereby reducing the effort required from the user.

[0127] The image processing system 20, when a format suitable for the image exists (YES in S139), and when none of the conditions in the storage location determination information 24g when a suitable format exists are met by the character recognition result (NO in S181), prompts the user to specify a folder to store the image data (S183 and S184), and stores the image data in the folder specified by the user (S185). Thus, the image data can be stored in an appropriate storage location specified by the user.

[0128] The image processing system 20, when a format suitable for the image exists (YES in S139) and when a folder for storing the image data is specified by the user (YES in S184), includes a new combination of new conditions corresponding to the character recognition result and the folder specified by the user in the storage destination determination information 24g when a suitable format exists (S186). As a result, when the same character recognition result as when the folder was previously specified by the user occurs, the image data can be automatically stored in the folder previously specified by the user, thereby reducing the effort required from the user.

[0129] In this embodiment, the image reading device 30 is provided separately from the image processing system 20. However, the image reading device may also have the functions of an image processing system. That is, the image reading device may function as an image processing system.

Claims

1. An image processing system comprising an image processing unit that processes image data using storage location determination information for determining the storage location of the image data, wherein the storage location determination information includes a combination of conditions for determining the storage location and the storage location, the image processing unit stores the image data in the storage location that is associated in the storage location determination information with the conditions satisfied by the result of character recognition on the image based on the image data, the image processing unit, if none of the conditions in the storage location determination information are satisfied by the result, has the user specify the storage location for storing the image data and stores the image data in the storage location specified by the user, and the image processing unit, when the user specifies the storage location for storing the image data, includes in the storage location determination information a new combination of new conditions corresponding to the result and the storage location specified by the user.

2. The image processing system according to claim 1, wherein the image processing unit performs character recognition on the image using a format for performing character recognition, and if no format suitable for the image exists, the image processing unit stores the image data in the storage location associated in the unsuitable format storage location determination information, which is the storage location determination information for when no suitable format exists, with the condition satisfied by the result, which is the pattern of difference between the image and the format.

3. The image processing system according to claim 2, characterized in that, if no format suitable for the image exists, and none of the conditions in the information determining the storage location for the unsuitable format are satisfied by the result which is the pattern, the image processing unit has the user specify the storage location for storing the image data and stores the image data in the storage location specified by the user.

4. The image processing system according to claim 3, characterized in that when no format suitable for the image exists, the image processing unit includes a new combination of the pattern as a new condition in the information for determining the storage location where no suitable format exists, when the storage location for storing the image data is specified by the user.

5. The image processing system according to claim 2, characterized in that the format has a region set for character recognition, and the image processing unit determines that the format is not suitable for the image if it is unable to extract characters from the region in the format for the image.

6. The image processing system according to claim 2, wherein the format has a region set as the target of character recognition, and the image processing unit determines that the format is not suitable for the image if the font of at least one character extracted from the region in the format for the image is not included in the font set in the region.

7. The image processing system according to claim 1, wherein the image processing unit performs character recognition on the image using the format for performing character recognition, and if a format suitable for the image exists, the image processing unit stores the image data in the storage location associated in the storage location determination information when a suitable format exists, which is the storage location determination information when a suitable format exists, according to the conditions that the result satisfies.

8. The image processing system according to claim 7, characterized in that, when a format suitable for the image exists, and none of the conditions in the information determining the storage location when a suitable format exists are met, the image processing unit has the user specify the storage location for storing the image data and stores the image data in the storage location specified by the user.

9. The image processing system according to claim 8, characterized in that when a format suitable for the image exists, and the storage location for storing the image data is specified by the user, the image processing unit includes a new combination of the new conditions corresponding to the result and the storage location specified by the user in the storage location determination information when a suitable format exists.

Images