Format definition device, format definition method, and program

The format definition system simplifies the specification of input areas on documents using color markers, expanding them based on context, enhancing OCR definition efficiency and accuracy.

JP7591915B2Active Publication Date: 2024-11-29PFU LTD
View PDF 9 Cites 0 Cited by

Patent Information

Application Number
JP2020202888
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2020-12-07
Publication Date
2024-11-29
Estimated Expiration
2040-12-07

AI Technical Summary

Technical Problem

Existing methods for defining formats, such as using color markers on documents, are cumbersome and require careful handling to avoid overlaps, leading to complex operations and potential omissions in specifying input areas for OCR processing.

Method used

A format definition system that uses color markers to specify input areas on documents, which are then expanded based on surrounding context, including ruled lines and color registration, to simplify the process and ensure accurate, expandable input areas.

Benefits of technology

Facilitates the creation of OCR definitions by simplifying the specification of input areas, allowing for easy expansion and attribute setting, thereby improving the efficiency and accuracy of OCR processing.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007591915000001
    Figure 0007591915000001
  • Figure 0007591915000002
    Figure 0007591915000002
  • Figure 0007591915000003
    Figure 0007591915000003
Patent Text Reader

Abstract

To provide a format defining device facilitating work for defining a format.SOLUTION: A format defining device includes: a color area specification unit which specifies, from an input image, an area in which a previously specified color is continuously present; an input area determination unit which determines an area including the area specified by the color area specification unit and a margin around this area, as an input area; and a format information output unit which outputs, as format information, the position of the input area determined by the input area determination unit.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a format definition device, a format definition method, and a program. [Background technology]

[0002] For example, Patent Document 1 describes an information processing device that analyzes overlapping added information using color markers as an attribute value setting process for a document, and analyzes the overlapping parts between the added information and the original information, analyzes which color combination was used to create the overlapping parts, repairs the added information that is interrupted in the overlapping parts, obtains information on a designated area of ​​the repaired added information, performs analysis such as character recognition, and stores the results in a database, etc. With this configuration, even if multiple color markers overlap or if color markers and original information overlap, accurate extraction of additional information and extraction and analysis of specific information by additional addition are possible. Characters with a score of a predetermined score or less are grouped into groups of characters with the same character code, and when an instruction is input to correct the character code of one character in the grouped character group, all character codes in the group to which this one character belongs are changed in accordance with the instruction. (Characters with a score of a predetermined score or less are grouped into groups of characters with the same character code, and when an instruction is input to correct the character code of one character in the grouped character group, all character codes in the group to which this one character belongs are changed in accordance with the instruction. The disclosed method includes: changing all character codes in a group to which a character belongs according to this instruction, grouping characters with a score of a predetermined score or less into groups of characters with the same character code, and when an instruction to correct the character code of one character from the grouped characters is input, changing all character codes in the group to which this one character belongs according to this instruction, grouping characters with a score of a predetermined score or less into groups of characters with the same character code, and when an instruction to correct the character code of one character from the grouped characters is input, changing all character codes in the group to which this one character belongs according to this instruction.

[0003] Patent Document 2 discloses an information processing device that includes an area recognition unit that recognizes, for areas specified by predetermined expressions in image data, a first area specified by a first area designation expression and a second area specified by a second area designation expression different from the first area designation expression, a position information acquisition unit that acquires position information of the first area as position information for specifying an area to be subject to character recognition in the image data, and an item name acquisition unit that acquires character information obtained by recognizing characters present in the second area as an item name for the area to be subject to character recognition specified by the position information acquired by the position information acquisition unit, and that classifies images with the same character strings in the OCR recognition results, overlays and composites the areas of the images corresponding to the character strings, compares the character strings on the classification axis with the character strings in the composite image, and performs correction processing on all of the composite images at once. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent Publication No. 2007-233900 [Patent Document 2] Patent Publication No. 2012-194879 Summary of the Invention [Problem to be solved by the invention]

[0005] An object of the present invention is to provide a format definition device that facilitates the work of defining a format. [Means for solving the problem]

[0006] The format definition device of the present invention has a color area identification unit that identifies an area in an input image where a predetermined specified color exists continuously, an input area determination unit that determines an area including the area identified by the color area identification unit and the margins surrounding this area as an input area, and a format information output unit that outputs the position of the input area determined by the input area determination unit in the input image as format information.

[0007] Preferably, the input image is a form image, and the input area determination section determines the area from the area specified by the color area specification section to the nearest ruled line as the input area.

[0008] Preferably, the input area determination section extends the input area upstream and downstream in a direction in which character strings are arranged, using the area specified by the color area specification section as a reference.

[0009] Preferably, the input device further comprises an expansion restriction section for restricting a range in which the input area can be expanded by the input area determination section to an area containing a color different from a background color.

[0010] Preferably, the input device further comprises an expansion restriction section which, with regard to the distance by which the input area can be expanded by the input area determination section, allows a greater expansion in a direction in which character strings are arranged than in a direction perpendicular to the arrangement direction of the character strings.

[0011] Preferably, the device further includes an attribute setting unit which sets attributes of the input area determined by the input area determination unit in accordance with the color of the area identified by the color area identification unit, and the format information output unit outputs the position of the input area determined by the input area determination unit and the attributes set by the attribute setting unit as format information.

[0012] Preferably, the input area determination unit further includes an attribute setting unit which sets a character type to be input into the input area determined by the input area determination unit in accordance with the color of the area identified by the color area identification unit, and the input area determination unit expands the input area upstream and downstream in the direction in which character strings are arranged and in a direction perpendicular to the arrangement direction of the character strings, based on the area identified by the color area identification unit, and the format information output unit outputs the position of the input area determined by the input area determination unit and the character type set by the attribute setting unit as format information, and when the character type set in the input area is handwritten characters, the input area determination unit increases the amount of expansion in the direction perpendicular to the arrangement direction of the character strings compared to when the set character type is typed characters.

[0013] Preferably, the device further includes a color registration unit that registers attributes to be set in the input area and colors in association with each other in response to user operation, and a warning display unit that displays a warning when a request is made to register a new color similar to a color registered in the color registration unit, and the attribute setting unit sets the attributes of the input area determined by the input area determination unit based on the color of the area identified by the color area identification unit and the color registered in the color registration unit.

[0014] Preferably, the format information is definition information for OCR processing, and the attribute setting unit sets the input area determined by the input area determination unit as outside the scope of OCR processing in accordance with the color of the area identified by the color area identification unit.

[0015] Preferably, the system further includes a filling unit that fills in, with a single color, an area of ​​the input image that has been determined to be an input area by the input area determination unit, and the format information output unit outputs format information in association with the input image that has been filled in by the filling unit.

[0016] In addition, the format definition method of the present invention includes a color area identification step in which a computer identifies an area from an input image where a pre-specified color exists continuously, an input area determination step in which the computer determines an area including the area identified by the color area identification step and the margins surrounding this area as an input area, and a format information output step in which the computer outputs the position of the input area determined by the input area determination step in the input image as format information.

[0017] In addition, the program of the present invention causes a computer to execute a color area identification step of identifying an area in an input image where a predetermined specified color exists continuously, an input area determination step of determining an area including the area identified by the color area identification step and the margins surrounding this area as an input area, and a format information output step of outputting the position of the input area determined by the input area determination step in the input image as format information. Effect of the Invention

[0018] It is possible to provide a format definition device that facilitates the task of defining a format. [Brief description of the drawings]

[0019] [Figure 1] 1 is a diagram illustrating an example of the overall configuration of a format definition system 1. [Diagram 2] 1A and 1B illustrate an example of a format definition task using color markers, and 1C and 1D are diagrams for explaining an overview of format definition in a format definition system 1. FIG. [Diagram 3] 2 is a diagram illustrating an example of a hardware configuration of a format definition device 2. [Figure 4] 2 is a diagram illustrating an example of a functional configuration of a format definition device 2. [Diagram 5] 10 is a flowchart for explaining a format definition process (S10) by the format definition device 2. [Figure 6] 13 is a flowchart for explaining a color registration process (S20) by the format definition device 2. [Figure 7] 6 is a flowchart illustrating the input area determination process (S120) of FIG. 5 in more detail. [Figure 8] 9A is a display example of a marker setting screen 900, and FIG. 9B is a diagram illustrating an example of marker setting information. [Figure 9] FIG. 13 is a diagram illustrating an example of a form image with a marker. [Figure 10] 13 is a diagram illustrating an example of an input area determined by the input area determination unit 310 when part of an input field of a form is filled with a color marker. FIG. [Figure 11] FIG. 13 is a diagram illustrating an example of an input area determined by the input area determination unit 310 when a character string is highlighted with a color marker in a form that does not have an input field. [Figure 12] FIG. 11 is a diagram illustrating an example of definition information for OCR processing. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0020] An embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a diagram illustrating an example of the overall configuration of a format definition system 1. 1, a format definition system 1 includes a format definition device 2 and a scanner device 4, which are connected to each other via a network 7. A plurality of scanner devices 4A and 4B are collectively referred to as scanner devices 4. The format definition device 2 is a computer terminal that defines a format based on image data received from the scanner device 4 and outputs format information indicating the defined format. The format definition device 2 in this example generates definition information that defines OCR (Optical Character Recognition) processing for the form based on the image data of the form received from the scanner device 4, and further processes the received image data to generate blank form image data, and transmits the generated blank form image data and definition information to the outside.

[0021] The scanner device 4 is an optical reading device, and transmits image data obtained from a document to the format definition device 2. In this example, the scanner device 4 scans a form marked with color markers.

[0022] In recent years, the use of OCR in business has expanded with the emergence of AI-OCR and other technologies. However, in order to use OCR software to recognize forms and convert them into text, it is necessary to create an OCR definition that matches the items to be read using the OCR software. However, depending on the form, such as the level of familiarity with the OCR software and the number of items to be recognized, creating an OCR definition can take time. Therefore, there is a demand for OCR software that simplifies operations and procedures as much as possible so that even first-time users can use it immediately. Generally, the area is specified on the image through a user interface, but it is necessary to understand the specifications of the OCR software, and the operation is difficult for first-time users. As a means to solve this problem, there is a method in which the recognition area is written directly on the original paper using a colored marker such as a highlighter, as in the configuration of Figure 1, but this has the following issues.

[0023] 2(A) and (B) illustrate an example of a format definition task using color markers, and FIGS. 2(C) and (D) are diagrams for explaining an overview of format definition in the format definition system 1. In FIG. As shown in Fig. 2(A), when specifying adjacent input items, it is necessary to write so that the color markers do not overlap. However, if you try to make the input area (recognition area) as wide as possible, the color markers will likely touch each other, so you will need to be careful when writing. Also, as shown in the example of FIG. 2(B), when an input area (identification area) is specified by encircling characters printed on a form, the number of characters may increase on other forms, and the input character string (numbers in this example) may overflow from the input area (identification area). Therefore, it is necessary to determine an input area with some margin before entering data. Doing this for each input item is cumbersome, and there is a risk of input items being overlooked. Also, when the surrounding margin is narrow, careful entry is required.

[0024] Therefore, in the format definition system 1 of this example, the work of specifying the input area (recognition area) by writing directly on the original paper with a color marker is simplified, making it possible to easily create an OCR definition. That is, in the format definition system 1 of this example, the input area (target area) is specified with a color marker by drawing a line on the target character on the original paper or by surrounding the target with a rectangle. The original paper is read by the format definition system 1 and the color marker specified area is identified, but rather than using the specified area as is, the area is expanded by looking at the situation of the surrounding area as follows, making it possible to automatically create an OCR definition with a wider input area (recognition area).

[0025] First, in the format definition system 1 of this example, when filling in a color marker, the marker is not drawn on the frame lines, but a rectangular area is filled in with the marker in the blank part of the frame, as shown in Fig. 2(C). Next, when performing the area determination process, if there is a ruled line around the rectangular area filled in with the marker, the input area (identification area) is expanded so that it is adjacent to the ruled line. This makes it possible to generate an input area (identification area) that fits the squares of the target item.

[0026] In addition, in the format definition system 1 of this example, as shown in Fig. 2(D), even if there is no frame around the target, if the identification target area can be made as wide as possible on both sides, it is possible to prevent the character string on the form from going outside the recognition target area (input area). Therefore, if there is blank space on the left and right of the rectangular area filled in with a marker, the rectangular area is extended on both sides. In this case, by expanding the area until some pixel (character, line, image, etc.) with a different color tone from the background appears, it is possible to generate an input area (identification area) that fits into the surrounding blank space.

[0027] Furthermore, in the format definition system 1 of this example, the reading area (input area) is identified and at the same time the color of the marker pen is identified, and the character identification type of the target item (for example, printed numbers, printed Japanese, handwritten Japanese, etc.) can be set according to the color. The color and character identification type can also be changed later by the user using the OCR software.

[0028] FIG. 3 is a diagram illustrating an example of the hardware configuration of the format definition device 2. As shown in FIG. As shown in FIG. 3, the format definition device 2 includes a CPU 200, a memory 202, a HDD 204, a network interface 206 (network IF 206), a display device 208, and an input device 210, which are connected to each other via a bus 212. The CPU 200 is, for example, a central processing unit. The memory 202 is, for example, a volatile memory, and functions as a main storage device. The HDD 204 is, for example, a hard disk drive device, and serves as a non-volatile storage device for storing computer programs (for example, the format definition program 3 in FIG. 4) and other data files. The network IF 206 is an interface for wired or wireless communication, and realizes communication with the scanner device 4, for example. The display device 208 is, for example, a liquid crystal display. The input device 210 is, for example, a keyboard and a mouse.

[0029] FIG. 4 is a diagram illustrating an example of the functional configuration of the format definition device 2. As shown in FIG. As shown in FIG. 4, a format definition program 3 is installed in the format definition device 2 of this example. The format definition program 3 has a color area specification unit 300 , an input area determination unit 310 , an expansion restriction unit 320 , a color registration unit 330 , a warning display unit 340 , an attribute setting unit 350 , a filling unit 360 , and a format information output unit 370 . Incidentally, a part or the whole of the format definition program 3 may be realized by hardware such as an ASIC, or may be realized by borrowing some of the functions of an OS (Operating System).

[0030] In the format definition program 3, the color area identification unit 300 identifies an area where a pre-specified color is present continuously from an input image. The color area identification unit 300 in this example identifies an area marked with a marker of a pre-specified color from image data of a form received from the scanner device 4. The pre-specified color is, for example, a color registered by the color registration unit 330.

[0031] The input area determination unit 310 determines an area including the area specified by the color area identification unit 300 and the margins around this area as an input area. The input area is an area in the image of the form where the user should input, for example, an OCR target area that is the target of OCR processing. More specifically, the input area determination unit 310 expands the area in the direction in which the character strings are arranged and in a direction perpendicular to the arrangement direction of the character strings based on the area specified by the color area identification unit 300, and sets it as an input area. The input area determination unit 310 of this example expands the area specified by the color area identification unit 300 in the direction in which the character strings are arranged and in a direction perpendicular to the arrangement direction of the character strings according to the restriction by the expansion restriction unit 320, and sets it as an input area.

[0032] The expansion restriction unit 320 restricts the area expansion by the input area determination unit 310 to the nearest ruled line. As a result, the input determination unit 310 determines the area from the area identified by the color area identification unit 300 to the nearest ruled line as the input area. In addition, the expansion restriction unit 320 limits the area expansion by the input area determination unit 310 to an area that contains a color different from the background color. This allows the input determination unit 310 to expand the area specified by the color area specification unit 300 until some pixel (character, line, image, etc.) with a color tone different from the background appears, and generate an input area that fits the surrounding margin.

[0033] Furthermore, the expansion restriction unit 320 allows the input area determination unit 310 to expand the area more in the direction in which the character strings are arranged than in the direction perpendicular to the arrangement direction of the character strings. This allows the input determination unit 310 to expand the area more to the upstream and downstream sides in the character string direction, thereby ensuring an input area in which the character strings are less likely to overflow. Furthermore, when the character type set in the input area is handwritten characters, the expansion restriction unit 320 allows a larger amount of expansion in a direction perpendicular to the arrangement direction of the character string than when the character type set is typed characters. As a result, when the character type set in the input area is handwritten characters, the input determination unit 310 generates a wider input area in the direction perpendicular to the arrangement direction of the character string than when the character type set is typed characters, and can provide an input field that is easy to input by handwriting. This is because handwritten characters are more easily displaced than typed characters and require a wider entry field.

[0034] The color registration unit 330 registers attributes and colors to be set in the input area in association with each other in response to a user's operation. The attributes to be set include, for example, character type (handwritten numbers, printed numbers, handwritten alphabets, printed alphabets, handwritten kanji, etc.), whether OCR processing is required, and the output destination of the OCR processing result. The color registration unit 330 of this example accepts registration of a combination of attributes and colors on a marker setting screen 900 illustrated in FIG. 8(A), and generates marker setting information illustrated in FIG. 8(B) based on the accepted information. For example, the marker setting information includes, in association with a color, the character type to be written in the input area, whether OCR processing is required for the input area, and whether filling in the input area is required.

[0035] The warning display unit 340 displays a warning when a new registration of a color similar to a color registered in the color registration unit is requested. In this example, the warning display unit 340 displays a warning when a color that is the same as or similar to an already registered color is selected on the marker setting screen 900 in FIG. 8(A).

[0036] The attribute setting unit 350 sets attributes of the input region determined by the input region determination unit 310 according to the color of the region identified by the color region identification unit 300. The attribute setting unit 350 in this example sets attributes corresponding to the color of the region identified by the color region identification unit 300 to the input region determined by the input region determination unit 310 based on the marker setting information registered by the color registration unit 330. For example, the attribute setting unit 350 sets the input region determined by the input region determination unit 310 as outside the target of OCR processing according to the color of the region identified by the color region identification unit 300. By actively defining the region outside the target of OCR processing, it is expected that the accuracy of the entire OCR processing can be improved.

[0037] The filling unit 360 fills in with a single color the area of ​​the input image that has been determined as the input area by the input area determination unit 310. In this example, the filling unit 360 fills in with the background color a part of the area of ​​the image data of the form received from the scanner device 4 that has been determined as the input area by the input area determination unit 310, according to the marker setting information in Fig. 8(B).

[0038] The format information output unit 370 outputs, as format information, the position of the input area determined by the input area determination unit 310 and the attribute set by the attribute setting unit 350. The format information output unit 370 in this example sets, as format information, the position of the input area determined by the input area determination unit 310 and the attribute set by the attribute setting unit 350, and outputs form image data in which part of the input area has been filled in by the filling unit 360 as a blank form.

[0039] Fig. 5 is a flow chart for explaining the format definition process (S10) by the format definition device 2. Note that in this example, it is assumed that the form (a highlighted form) shown in Fig. 9 is color scanned by the scanner device 4, and this image data is sent to the format definition device 2. Also, if the original form is colored, a monochrome copy is used to make a monochrome form, and then a marker is applied. As illustrated in FIG. 5, in step 100 (S100), the color region identifying section 300 (FIG. 4) of the format definition device 2 acquires form image data (FIG. 9) with markers from the scanner device 4.

[0040] In step 105 (S105), the color area identifying unit 300 identifies a color area (marker area) in which the colors registered in the color registration unit 330 are continuous from the acquired form image data (FIG. 9). In step 110 (S110), the attribute setting unit 350 refers to the marker setting information in Fig. 8(B) to identify attributes corresponding to the color of the color area identified by the color area identifying unit 300. The color is identified, for example, by extracting the color area, identifying the color information contained in the extracted image on a pixel-by-pixel basis, and determining the most frequent color excluding colors near black, white, and gray (colors excluded from judgment) as the color of the color area. The pixels used to identify the color information may be all pixels or sampled pixels. In step 115 (S115), the expansion restriction unit 320 identifies the string arrangement method based on the aspect ratio of the color region identified by the color region identification unit 300, and determines the upper limit range of expansion based on the identified string arrangement direction and the attribute (character type) identified by the attribute setting unit 350. The upper limit range is set in advance as the distance from the end of the color region, for example, and the string direction is a value larger than the direction perpendicular thereto. The upper limit range is a range that can be changed by the user.

[0041] In step 120 (S120), the input area determination unit 310 expands the color area identified by the color area identification unit 300 while following the restrictions (black pixels, lines, or upper limit range) imposed by the expansion restriction unit 320, as illustrated in Figures 10 and 11, and determines the expanded area as the input area.

[0042] In step 125 (S125), the format definition program 3 determines whether or not the processing of S105 to S120 has been completed for all color areas (marker areas) contained in the acquired form image data, and if there are any unprocessed color areas, it returns to the processing of S105 to identify the next color area, and if there are no unprocessed color areas, it proceeds to the processing of S130.

[0043] In step 130 (S130), the filling unit 360 fills in the input area determined by the input area determination unit 310 with the background color from the form image data acquired from the scanner device 4 in accordance with the marker setting information in Figure 8 (B) to generate image data of a blank form.

[0044] In step 135 (S135), the format information output unit 370 sets the combination of the coordinates of the input area determined by the input area determination unit 310 and the attributes of each input area specified by the attribute setting unit 350 as OCR definition information, as illustrated in FIG. 12. In step 140 (S140), the format information output unit 370 transmits the generated OCR definition information and the blank form image data generated by the filling-in unit 360 to the outside.

[0045] In this way, the format definition process (S10) expands the color areas marked with color markers to define input areas, and attributes (character type, etc.) corresponding to the color of the color area are set for each input area.

[0046] FIG. 6 is a flow chart for explaining the color registration process (S20) by the format definition device 2. As shown in Fig. 6, in step 200 (S200), the color registration unit 330 (Fig. 4) of the OCR processing device 2 displays the marker setting screen 900 of Fig. 8(A) and accepts a color designation operation by the user. For example, the color designation operation can specify any color using a color palette or the like. In step 205 (S205), the warning display unit 340 compares the color specified by the user with the colors registered by the color registration unit 330 to determine whether they are dissimilar. If it is determined that the color is dissimilar to the registered color, the format definition program 3 proceeds to processing at S210, and if it is determined that the color is the same as or similar to the registered color, the format definition program 3 proceeds to processing at S215. The color comparison is performed, for example, based on a measurement of color difference.

[0047] In step 210 (S210), the color registration unit 330 sets the character type, item name, whether or not OCR processing is required, and whether or not filling is required as attributes of the input area in association with the color specified by the user in response to the user's operation. The character type is, for example, type, handwritten, Japanese, numbers, English letters, symbols, etc., and the item name is, for example, a postal code, an address, a name, a product name, etc. In step 215 (S215), the warning display unit 340 displays a warning to the user, urging the user to change the designated color.

[0048] In this manner, the color registration process (S20) sets marker setting information that associates the color to be applied to the input area with the attribute.

[0049] FIG. 7 is a flowchart for explaining the input area determination process (S120) of FIG. 5 in more detail. As illustrated in FIG. 7, in step 1200 (S1200), the extension restriction unit 320 searches for a ruled line existing around the color area identified by the color area identification unit 300 within the set upper limit range. In step 1205 (S1205), if a ruled line is found within the upper limit range, the format definition program 3 proceeds to processing of S1210, and if a ruled line is not found within the upper limit range, the format definition program 3 proceeds to processing of S1215. In step 1210 (S1210), the input area determination unit 310 expands the input area up to the ruled line found by the expansion restriction unit 320.

[0050] In step 1215 (S1215), the extension restriction unit 320 searches for black pixels (non-background pixels) existing around the color region identified by the color region identification unit 300 within the set upper limit range. In step 1220 (S1220), if a black pixel (non-background pixel) is found within the upper limit range, the format definition program 3 proceeds to processing of S1225, and if a black pixel is not found within the upper limit range, the format definition program 3 proceeds to processing of S1230.

[0051] In step 1225 (S1225), the input region determination unit 310 expands the input region up to the black pixels (non-background pixels) found by the expansion restriction unit 320. In step 1230 (S1230), the input region determination unit 310 expands the input region up to the upper limit range set by the expansion restriction unit 320.

[0052] FIG. 10 is a diagram illustrating an example of an input area determined by input area determination unit 310 when part of an input field of a form is filled with a color marker. As shown in the example of Figure 10, whether the character string written in the input field is highlighted with a color marker or a rectangle is highlighted inside the input field with a color marker, the input field is expanded to the surrounding borders, and an input field that extends to the entire input field is similarly defined.

[0053] FIG. 11 is a diagram illustrating an example of an input area determined by the input area determination unit 310 when a character string is highlighted with a color marker in a form that does not have an input field. As shown in the example of Figure 11, when a horizontally written character string is filled with a color marker, it is determined to be written horizontally based on the aspect ratio of the color area, and an input area is defined that is expanded more in the left-right direction than in the up-down direction. On the other hand, when a vertically written character string is filled with a color marker, an input area is defined that is expanded more in the up-down direction than in the up-down direction. This makes it less likely that the character string will go outside the input area even if the length of the character string entered in the input area varies slightly.

[0054] As described above, according to the format definition system 1 of this embodiment, the input area is defined by using the color area filled in with a color marker as a reference and expanding it to the position where lines and black pixels exist, thereby simplifying the task of specifying using a color marker and defining an input area that is easy to fill in. Furthermore, according to the format definition system 1 of this embodiment, the attributes of the input area can be set by the color of the color marker.

[0055] [Variations] In the above embodiment, a specific example has been described in which definition information for OCR processing is generated, but the present invention is not limited to this, and a format may be defined for purposes other than OCR processing. Furthermore, in the above embodiment, the case has been described where the area marked with a marker of a specified color is excluded from the OCR processing, but all areas with no marker may be excluded from the OCR processing. In the above embodiment, the form definition information and the blank form image data are provided as a set, but the blank form image data may be used to create only the blank form image data. In this case, the input area may be filled not only with white, but also with the background color around the input area or with any color designated by the user. [Explanation of symbols]

[0056] 1...Format definition system 2...Form definition device 3...Format definition program 300...Color area identification section 310...input region determination unit 320…Expansion restriction section 330…Color registration section 340...Warning display section 350...Attribute setting section 360…filled area 370...Format information output section

Claims

1. a color region identifying unit that identifies a region in which a pre-specified color is present continuously from an input image; an input area determination unit that determines an area including the area specified by the color area specification unit and a margin surrounding this area as an input area; a format information output unit that outputs the position of the input area determined by the input area determination unit in the input image as format information; having The input area determination unit extends the input area upstream and downstream in a direction in which character strings are arranged, based on the area specified by the color area specification unit.

2. an extension restriction section that restricts a range in which the input area can be extended by the input area determination section to an area in which a color different from a background color exists; 2. The form definition device of claim 1, further comprising:

3. an expansion restriction section that, with respect to the distance by which the input area can be expanded by the input area determination section, allows a larger expansion in a direction in which character strings are arranged than in a direction perpendicular to the direction in which character strings are arranged; 2. The form definition device of claim 1, further comprising:

4. A color area specifying unit that specifies an area in which a pre-specified color is present consecutively from an input image; an input area determination unit that determines an area including the area specified by the color area specification unit and a margin surrounding this area as an input area; a format information output unit that outputs, as format information, the position of the input area determined by the input area determination unit in the input image; an attribute setting unit that sets an attribute of the input area determined by the input area determination unit in accordance with the color of the area identified by the color area identification unit; having The format definition device, wherein the format information output section outputs, as format information, the position of the input area determined by the input area determination section and the attribute set by the attribute setting section.

5. an attribute setting unit that sets a character type to be input into the input area determined by the input area determination unit in accordance with the color of the area specified by the color area specification unit; and the input area determination unit extends the input area on the upstream side and downstream side of a direction in which character strings are arranged and in a direction perpendicular to the direction in which character strings are arranged, based on the area specified by the color area specification unit; the format information output unit outputs, as format information, the position of the input area determined by the input area determination unit and the character type set by the attribute setting unit; When the character type set in the input area is handwritten characters, the input area determination unit increases the amount of expansion in a direction perpendicular to the arrangement direction of the character string to a larger amount than when the character type set in the input area is printed characters.

2. The format definition device according to claim 1.

6. a color registration unit that registers an attribute to be set in an input area and a color in association with each other in response to a user operation; a warning display unit that displays a warning when a new registration of a color similar to a color registered in the color registration unit is requested; and The attribute setting unit sets an attribute of the input area determined by the input area determination unit based on the color of the area specified by the color area specification unit and the color registered in the color registration unit.

5. A format definition device according to claim 4.

7. The format information is definition information for OCR processing, The attribute setting unit sets the input area determined by the input area determination unit to be outside the scope of OCR processing in accordance with the color of the area specified by the color area specification unit.

5. A format definition device according to claim 4.

8. A color area specifying unit that specifies an area in which a pre-specified color is present consecutively from an input image; an input area determination unit that determines an area including the area specified by the color area specification unit and a margin surrounding this area as an input area; a format information output unit that outputs, as format information, the position of the input area determined by the input area determination unit in the input image; a filling unit that fills, with a single color, a region of the input image that has been determined as an input region by the input region determination unit; having The format information output unit outputs format information in association with the input image filled by the filling unit.

9. A color region specifying step in which a computer specifies a region in which a pre-specified color is continuously present from an input image; an input area determination step in which the computer determines an area including the area specified by the color area specification step and a margin surrounding this area as an input area; a format information output step in which the computer outputs the position of the input area determined by the input area determination step as format information; having In the input area determination step, a computer extends the input area upstream and downstream in a direction in which character strings are arranged, based on the area specified in the color area specification step.

10. a color region identifying step of identifying a region in which a pre-specified color is continuously present from the input image; an input area determination step of determining an area including the area specified by the color area specification step and a margin surrounding the area as an input area; a format information output step of outputting the position of the input area determined in the input area determination step as format information; on the computer, In the input area determination step, the input area is expanded upstream and downstream in a direction in which character strings are arranged, based on the area specified in the color area specification step.

Citation Information

Patent Citations

  • optical character reader

    JP1993008670U

  • Image forming apparatus, and method of printing image forming apparatus

    JP2005167875A

  • Information processor, information processing method, and computer program

    JP2007233900A

  • Image processor and image processing program

    JP2007241355A

  • Image processing unit and image processing program

    JP2010021771A