Image processing device, image processing method, and program

Abstract

To provide an image processing device that allows a user to easily determine whether a document to be read is missing from a scanned image including the document.SOLUTION: An image processing device includes: a missing area detection unit that detects missing areas of a document included in a read image, which is an image obtained by reading the document; and an interpolation color specification unit that specifies whether a color that interpolates the missing areas of the document in the read image is made into the background color of the document.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to an image processing device, an image processing method, and a program. [Background technology]

[0002] In an image processing device, a technique for repairing missing parts and the like contained in a scanned document is known. Patent Document 1 discloses a technique related to an image processing device that replaces missing parts of a document contained in a scanned image with the background color of the document. Summary of the Invention [Problem to be solved by the invention]

[0003] For example, if the entire document to be scanned is not included in the scanned image, the document may be scanned again. When missing parts of the scanned image are replaced with the background color of the document, it may be difficult to visually confirm that missing parts are included in the output image.

[0004] SUMMARY OF THE INVENTION In order to solve the above-mentioned problems, an object of the present invention is to provide an image processing apparatus that makes it easy to determine whether or not a document included in a scanned image is missing. [Means for solving the problem]

[0005] An image processing apparatus according to one aspect of the present invention includes: a missing area detection unit that detects a missing area of ​​a document included in a read image obtained by reading the document; The image processing device further includes an interpolation color specifying unit that specifies whether or not a color that interpolates a missing area of ​​the document in the scanned image is to be used as a background color of the document. [Effects of the Invention]

[0006] According to the image processing apparatus of the present invention, it becomes easy to determine whether or not there is a missing part of the document included in the scanned image. [Brief explanation of the drawings]

[0007] [Figure 1] 1 is a hardware configuration diagram of an image processing device according to a first embodiment of the present invention. [Figure 2] 1 is a schematic configuration diagram of a scanner included in an image processing apparatus according to a first embodiment of the present invention. [Figure 3] 1 is a functional block diagram of an image processing apparatus according to a first embodiment of the present invention. [Figure 4] 3A to 3C are diagrams for explaining a method for calculating angle information and coordinate information in the image processing device according to the first embodiment of the present invention. [Figure 5] 3A to 3C are diagrams illustrating a method for interpolating missing areas of a document in the image processing apparatus according to the first embodiment of the present invention. [Figure 6] FIG. 3 is a flowchart of missing data interpolation processing in the image processing device according to the first embodiment of the present invention. [Figure 7] FIG. 10 is a flowchart of missing data interpolation processing in an image processing device according to a second embodiment of the present invention. [Figure 8] FIG. 11 is a flowchart of missing data interpolation processing in an image processing device according to a third embodiment of the present invention. [Figure 9] FIG. 10 is a diagram illustrating a method for calculating the size of a missing area in an image processing device according to a third embodiment of the present invention. [Figure 10] FIG. 10 is a flowchart of missing data interpolation processing in an image processing device according to a fourth embodiment of the present invention. [Figure 11] 10A and 10B are diagrams illustrating a method for specifying a color to fill in a missing area of ​​a document based on the presence or absence of printing at the edge of a scanned image, in an image processing apparatus according to a fourth embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0008] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The following describes the preferred embodiments of the present invention with reference to the accompanying drawings. In the drawings, the same components are designated by the same reference numerals, and redundant explanations may be omitted.

[0009] [First embodiment] <Configuration of image processing device 1> 1 is a hardware configuration diagram of an image processing device 1 according to a first embodiment of the present invention. The image processing device 1 includes an image processing unit 10, a scanner 20, a plotter 30, and an HDD (Hard Disk Drive) 40. The image processing device 1 may be, for example, an MFP (Multifunction Peripheral) including functions such as a printer, copy machine, and facsimile machine, or an electronic device including an image forming function such as a printer.

[0010] The image processing unit 10 performs predetermined processing on the document image read by the scanner 20. The image processing unit 10, the scanner 20, and an automatic document feeder (ADF) (not shown) constitute a skew detection device and a reading device.

[0011] Although the above configuration is applicable to a device consisting of a scanner alone, it may also be possible to provide a plotter 30 that outputs an image onto a print medium, thereby enabling copying and printing.

[0012] The image processing unit 10 includes a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, a main memory 13, a chipset 14, an image processing ASIC 15, a controller ASIC 16, a main memory 17, and an I / O ASIC (Application Specific Integrated Circuit) 18.

[0013] The CPU 11 controls the image processing device 1. The ROM 12 is a non-volatile memory such as a flash memory, and stores programs. The main memory 13 is used as a work area in which the programs used by the CPU 11 to control the image processing device 1 are loaded. The main memory 13 also temporarily stores data such as scanned images obtained by scanning a document. The chipset 14 is used together with the CPU 11, and controls access to the main memory 13 by the controller ASIC 16 and the I / O ASIC 18.

[0014] The program executed by the image processing device 1 may be configured to be provided by being recorded in an installable or executable file format on a computer-readable recording medium such as a CD-ROM, a flexible disk (FD), a CD-R, or a DVD (Digital Versatile Disk).

[0015] Furthermore, the program executed by the image processing device 1 may be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network. Also, the program executed by the image processing device 1 may be provided or distributed via a network such as the Internet.

[0016] The scanner 20 performs processes such as copying of the scanned image obtained by scanning an original document and outputs the scanned image to an external interface. The plotter 30 includes a function for printing the scanned image that has been subjected to image processing by the controller ASIC 16.

[0017] The image processing ASIC 15 performs image processing on the read image read by the scanner 20 and outputs the image to the controller ASIC 16. The image processing ASIC 15 also processes the read image acquired from the controller ASIC 16 so that it can be printed by the plotter 30. Furthermore, the image processing ASIC 15 transmits the read image in accordance with the timing at which the plotter 30 prints it.

[0018] The controller ASIC 16 rotates and edits the scanned image using the main memory 13. The controller ASIC 16 also stores the scanned image in the HDD 40, and transmits and receives the scanned image to and from the image processing ASIC 15.

[0019] The main memory 17 is used as an image memory for image processing of the scanned image by the controller ASIC 16. The HDD 40 temporarily stores the scanned image after image processing.

[0020] The I / O ASIC 18 is an external interface for providing additional functions to the image processing device 1. The additional functions include, for example, interfaces such as a network interface, USB, SD card, operation unit, SPI, I2C, and document width sensor, a hardware accelerator for speeding up image processing, and an encryption processing circuit.

[0021] 2 is a schematic diagram of a scanner 20 included in an image processing device 1 according to a first embodiment of the present invention. Inside a main body frame 21 of the scanner 20, a first rail and a second rail (not shown) extend in the sub-scanning direction (left-right direction in the figure). The first rail includes two rails arranged at a predetermined interval in the main scanning direction perpendicular to the sub-scanning direction. The second rail has the same configuration as the first rail.

[0022] The scanner 20 includes a first carriage 23, a second carriage 24, an imaging lens 25, and an imaging unit 26. Each of these components is disposed inside a main body frame 21 of the scanner 20.

[0023] The first carriage 23 is slidably mounted on the first rail and configured to be reciprocable in the sub-scanning direction by a drive motor (not shown) via a first carriage drive wire (not shown). The first carriage 23 includes a light source 22 and a first mirror member 23a.

[0024] The second carriage 24 is slidably mounted on the second rail and is configured to be reciprocable in the sub-scanning direction by a drive motor (not shown) via a second carriage drive wire (not shown). The second carriage 24 includes a second mirror member 24a and a third mirror member 24b.

[0025] Here, the first carriage 23 and the second carriage 24 move in the sub-scanning direction at a speed ratio of 2:1. Due to this relationship in movement speed, even if the first carriage 23 and the second carriage 24 move, the optical path length of the light from the document surface to the imaging lens 25 does not change.

[0026] The imaging lens 25 focuses the reflected light from the original that has entered through each mirror member onto the imaging unit 26. The imaging unit 26 is made up of an imaging element such as a CCD, and photoelectrically converts the reflected light image of the original that has been imaged through the imaging lens 25, and outputs an analog image signal that is the read image.

[0027] 3 is a functional block diagram of an image processing device 1 according to a first embodiment of the present invention. The image processing device 1 includes a reading unit 2, a missing area detection unit 3, an interpolation color identification unit 4, a tilt correction unit 5, a storage unit 6, and an output unit 7.

[0028] The reading unit 2 reads an original. The reading unit 2 corresponds to a scanner 20 and a plotter 30, but is not limited to these and may be various reading means. The reading unit 2 stores the read image, which is an image obtained by reading the original, in the storage unit 6.

[0029] The missing area detection unit 3 detects missing areas of the document included in the scanned image. The missing area detection unit 3 acquires angle information, which is the inclination of the document relative to the horizontal component of the scanned image, and coordinate information, which is the coordinates of the vertices of the document, and outputs these to the inclination correction unit 5. Note that below, the missing area of ​​the document may also be simply referred to as the "missing area."

[0030] The interpolation color specifying unit 4 specifies whether or not the color that fills the missing area of ​​the document in the scanned image is to be the background color of the document.

[0031] The tilt correction unit 5 corrects the tilt of the document relative to the horizontal component of the scanned image based on angle information. The tilt correction unit 5 also corrects the tilt of the scanned image stored in the storage unit 6 based on coordinate information, and transmits the corrected image to the output unit 7.

[0032] The storage unit 6 stores the read image and the image corrected by the tilt correction unit 5. The output unit 7 outputs the read image and the corrected read image.

[0033] <Calculation method of angle information and coordinate information> 4 is a diagram illustrating a method for calculating angle information and coordinate information in the image processing device 1 according to the first embodiment of the present invention. As shown in the figure, the scanned image 50 and the document 60 are assumed to have rectangular shapes, and the scanned image 50 includes the document 60. A missing region R1, which is a part of the document 60, extends beyond the scanned image 50. The missing region R1 of the document 60 is a triangular region corresponding to the region extending beyond the scanned image 50. Note that the shapes of the scanned image 50 and the document 60 are not limited to rectangular, and may be various shapes such as squares.

[0034] For clarity of explanation, the following description will be given using an XY Cartesian coordinate system. The coordinates of vertex A, which is one end of the scanned image 50 on the side of missing area R1 where the original 60 protrudes, are set to (0, 0). The coordinates of vertex B1 included in missing area R1 of the original 60 are set to (x, y). As shown in the figure, when missing area R1 is included in the original 60, vertex B1 has a value of y<0.

[0035] In the figure, straight line L1 is a straight line with one side passing through vertex B1 of document 60, and straight line L2 is a straight line with the other side passing through vertex B1 of document 60. The intersection of straight lines L1 and L2 coincides with vertex B1 of document 60, and the coordinates (x, y) of vertex B1 become coordinate information.

[0036] The lines L1 and L2 are expressed as linear functions y=ax+b using constants a and b in the XY Cartesian coordinate system. The constant a represents the inclination of the lines L1 and L2, and the constant b represents the intercept. The constant a represents the inclination of the document 60 relative to the horizontal component of the scanned image 50, and serves as angle information.

[0037] The constants a and b are obtained by determining the boundary between the scanned image 50 and the original 60 based on the edge strength, which indicates the degree of edge for each pixel value of the scanned image 50, and deriving a linear equation using the least squares method based on the coordinates determined to be edges.

[0038] 5 is a diagram illustrating a method for interpolating missing area R1 of document 60 in image processing device 1 according to the first embodiment of the present invention. In Fig. 5, (a) shows document 60 including missing area R1 in scanned image 50, and (b) shows scanned image 50 after interpolating missing area R1 of document 60. Vertex B1 of document 60 is a vertex included in missing area R1, and vertex B2 is a vertex included in scanned image 50 that is not adjacent to vertex B1.

[0039] 5(b) shows the document 60 after the inclination has been corrected by the inclination correction unit 5. As shown in the figure, the missing area R1 of the document 60 may be interpolated with, for example, black. By interpolating the missing area R1 with black, the user can easily determine the missing part of the document 60 included in the scanned image 50.

[0040] 6 is a flow diagram of missing part interpolation processing in the image processing device 1 according to the first embodiment of the present invention. First, the image processing device 1 calculates coordinate information of the read image 50 (step S101). The coordinate information may be calculated, for example, by setting the coordinates of vertex A of the read image 50 to (0,0). In this case, for example, when the angle information is 0° and the coordinate information is (0,0), vertex B1 of the document 60 and vertex A of the read image 50 coincide with each other.

[0041] Next, if the coordinates of the document 60 are within the area of ​​the scanned image 50 (Yes in step S102), the scanned image 50 is read from the memory at the address corresponding to the calculated coordinates of the document 60 in the storage unit 6 (step S103).

[0042] If the coordinates of the original 60 are not within the area of ​​the scanned image 50 (No in step S102), the interpolation color specification unit 4 generates color data to interpolate the missing area R1 (step S104). More specifically, if the coordinate information of the original 60 is (x, y), if either x or y is a negative value, then the missing area R1 exists, and therefore a color to interpolate the missing area R1 is generated and output.

[0043] In other words, whether the coordinates of the original 60 are within the readable area can be determined by calculating the coordinates of the read image 50 corresponding to the coordinates in the tilt-corrected image shown in Figure 5(b), and determining whether the calculated coordinates of the read image 50 exceed the range of the coordinates of the read image 50.

[0044] The color used to fill in the missing area R1 may be black, but is not limited to this. For example, since the background color of the document 60 is often white, such as in facsimile transmission data, if the color used to fill in the missing area R1 is black, the user can easily determine whether or not there is a missing part in the document 60.

[0045] On the other hand, when the scanned image 50 is output by copying or the like, there may be no problem even if part of the document 60 is missing. In this case, if the color to fill the missing area R1 is white, the same as the background color of the document 60, there are advantages in that it is good in terms of image quality and can reduce the consumption of ink, etc.

[0046] According to the image processing device 1 of this embodiment, the user can easily determine whether or not there is a missing part of the document 60 included in the scanned image 50.

[0047] [Second embodiment] 7 is a flow diagram of missing area interpolation processing in an image processing device 1 according to a second embodiment of the present invention. The interpolation color specification unit 4 of the image processing device 1 according to this embodiment specifies the background color of a document 60 included in a scanned image 50, and specifies a color to interpolate a missing area R1 of the document 60 according to the luminance value of the background color. Note that components that are the same as those already described are assigned the same reference numerals, and redundant description will be omitted.

[0048] First, the image processing device 1 calculates coordinate information of the scanned image 50 (step S201). Next, if the coordinates of the document 60 are within the area of ​​the scanned image 50 (Yes in step S202), the scanned image 50 is read from the memory of the storage unit 6 at the address corresponding to the calculated coordinates of the document 60 (step S203).

[0049] If the coordinates of the document 60 are not within the area of ​​the scanned image 50 (No in step S202), the interpolation color identification unit 4 identifies the background color of the document 60 (step S204). The background color may be identified, for example, by creating a histogram of the colors of each pixel based on the pixel values ​​of all the pixels included in the scanned image 50, and identifying the color with the highest frequency as the background color.

[0050] The interpolation color specifying unit 4 generates color data to fill the missing region R1 based on the specified background color of the document 60 (step S205). The color data is generated by comparing the brightness value of the background color of the document 60 with a threshold value, and if the brightness value is less than the threshold value, the color data can be set to, for example, white. If the brightness value of the background color of the document 60 is greater than the threshold value, the color data can be set to, for example, black. However, if the scanned image 50 is to be output by copying or the like, the color data can be set to gray to reduce the consumption of ink or the like.

[0051] According to the image processing device 1 of this embodiment, the interpolation color specifying unit 4 specifies the background color of the document 60. When the background color of the document 60 is a color with a low brightness value, such as black, the interpolation color specifying unit 4 specifies a color to interpolate the missing region R1 in accordance with the background color of the document 60, such as by interpolating the missing region R1 with white. This makes it easy for the user to determine whether or not there is a missing portion of the document 60 included in the scanned image 50.

[0052] [Third embodiment] 8 is a flow diagram of missing area interpolation processing in an image processing device 1 according to a third embodiment of the present invention. The missing area detection unit 3 of the image processing device 1 according to this embodiment calculates the size of a missing area R1 in an original document 60. The interpolation color identification unit 4 identifies a color to interpolate the missing area R1 in the original document 60 in accordance with the size of the missing area R1 calculated by the missing area detection unit 3. Note that components that are the same as those already described are assigned the same reference numerals, and redundant explanations will be omitted.

[0053] First, the image processing device 1 calculates coordinate information of the scanned image 50 (step S301). Next, if the coordinates of the document 60 are within the area of ​​the scanned image 50 (Yes in step S302), the scanned image 50 is read from the memory at the address corresponding to the calculated coordinates of the document 60 in the storage unit 6 (step S303).

[0054] If the coordinates of the document 60 are not within the region of the scanned image 50 (No in step S302), the interpolation color specifying unit 4 specifies the background color of the document 60 (step S304). Then, the missing region detecting unit 3 calculates the size of the missing region R1 (step S305).

[0055] Here, a method for calculating the size of the missing region R1 will be described with reference to Fig. 9. Fig. 9 is a diagram for explaining a method for calculating the size of the missing region R1 in the image processing device 1 according to the third embodiment of the present invention.

[0056] 9, the coordinates of vertex B1 included in missing region R1 of document 60 are (x, y). Points C1 and C2 are the intersections of missing region R1 and scanned image 50. The coordinates of points C1 and C2 are (x1, y1) and (x2, y2), respectively.

[0057] If the size of missing region R1 is defined as area S, area S is the area surrounded by vertices B1, C1, and C2. Since missing region R1 is a triangle, area S is expressed by the following formula (1).

[0058]

number

[0059] Next, the interpolation color specifying unit 4 generates color data for interpolating the missing region R1 (step S306). The interpolation color specifying unit 4 specifies a color for interpolating the missing region R1 of the document 60 based on the size of the missing region R1 and the background color of the document 60. If the size of the missing region R1 is less than a threshold, the interpolation color specifying unit 4 can set the color for interpolating the missing region R1 to the same color as the background color of the document 60.

[0060] In the image processing device 1 according to this embodiment, the interpolation color specification unit 4 specifies a color to interpolate the missing region R1 of the document 60 depending on the size of the missing region R1. If the missing region R1 is small, there is a low possibility that printing is missing. Therefore, the interpolation color specification unit 4 specifies the color to interpolate the missing region R1 as the background color of the document 60. Because the background color of the document 60 is often white, it is possible to reduce the consumption of ink and other materials during output. Furthermore, using the color to interpolate the missing region R1 as the background color of the document 60 is said to be favorable in terms of image quality.

[0061] [Fourth embodiment] 10 is a flow diagram of missing area interpolation processing in an image processing device 1 according to a fourth embodiment of the present invention. The interpolation color specifying unit 4 of the image processing device 1 according to this embodiment may specify a color to interpolate a missing area R1 of the document 60 based on the presence or absence of printing in a predetermined area R2 at the edge of the scanned image 50. Note that components that are the same as those already described are assigned the same reference numerals, and redundant description will be omitted.

[0062] First, the image processing device 1 calculates coordinate information of the scanned image 50 (step S401). Next, if the coordinates of the document 60 are within the area of ​​the scanned image 50 (Yes in step S402), the scanned image 50 is read from the memory of the storage unit 6 at the address corresponding to the calculated coordinates of the document 60 (step S403).

[0063] If the coordinates of the original 60 are not within the area of ​​the scanned image 50 (No in step S402), the interpolation color identification unit 4 identifies the background color of the original 60 (step S404). Then, the missing area detection unit 3 calculates the size of the missing area R1 (step S405). Furthermore, the interpolation color identification unit 4 identifies a color to interpolate the missing area R1 of the original 60 based on the presence or absence of printing in a predetermined area R2 at the edge of the scanned image 50 (step S406).

[0064] FIG. 11 is a diagram illustrating a method for identifying a color to fill in a missing area R1 of a document 60 based on the presence or absence of printing at the end of a scanned image 50 in an image processing device 1 according to a fourth embodiment of the present invention.

[0065] 11, a predetermined area R2 at the edge of the scanned image 50 is defined as an area surrounded by points A1, A2, A3, and A4. Points C1 and C2 are the intersections of the missing area R1 and the scanned image 50. Point C3 is the intersection of the perpendicular line from point C1 to the line L3 connecting points A2 and A3 with line L3, and point C4 is the intersection of the perpendicular line from point C2 to line L3 with line L3.

[0066] The coordinates of points C1 and C2 are (x1, y1) and (x2, y2), respectively, and the coordinates of points C3 and C4 are (x3, y3) and (x4, y4), respectively.

[0067] If there is printing in the predetermined area R2, it is likely that there is printing in the missing area R1. Therefore, the presence or absence of printing at the edge of the scanned image 50 is determined based on the presence or absence of printing in the predetermined area R2.

[0068] The presence or absence of printing in the predetermined region R2 is determined based on the edge strength, which indicates the degree of edge by differentiating the pixel value of each pixel in the predetermined region R2 from the pixel value of adjacent pixels. If the edge strength is high, it can be determined that there is printing, and if the edge strength is low, it can be determined that there is no printing.

[0069] Next, the interpolation color specifying unit 4 generates color data to interpolate the missing region R1 (step S407). If the size of the missing region R1 is equal to or greater than a threshold, or if it is determined that there is printing in the predetermined region R2, the interpolation color specifying unit 4 generates color data to interpolate the missing region R1 based on the background color of the document 60 specified in the same manner as in step S205. That is, the color data is generated by comparing the brightness value of the background color of the document 60 with a threshold, and if the brightness value is less than the threshold, the color data can be, for example, white. If the brightness value of the background color of the document 60 is greater than the threshold, the color data can be, for example, black. However, if the scanned image 50 is to be output by copying or the like, the color data can be gray to reduce ink consumption, etc.

[0070] If the size of the missing area R1 is less than a threshold value and if it is determined that there is no printing in the specified area R2, the interpolation color identification unit 4 can set the color to interpolate the missing area R1 to the same color as the background color of the document 60.

[0071] In the image processing device 1 according to this embodiment, the interpolation color specification unit 4 specifies a color to interpolate the missing region R1 of the document 60 depending on the size of the missing region R1 and the presence or absence of printing in a predetermined region R2 at the edge of the scanned image 50. The presence or absence of printing in the missing region R1 can be estimated depending on the presence or absence of printing in the predetermined region R2, and the color to interpolate can be specified based on the estimation result, so that the color to interpolate the missing region R1 can be efficiently specified.

[0072] Although the embodiments have been described above, the present invention is not limited to the above-described embodiments, and various modifications and improvements are possible within the scope of the present invention.

[0073] Each function of the above-described embodiments can be realized by one or more processing circuits. Here, the term "processing circuit" in this specification includes a processor programmed to perform each function by software, such as a processor implemented by an electronic circuit, as well as devices such as an ASIC (Application Specific Integrated Circuit), a DSP (Digital Signal Processor), an FPGA (Field Programmable Gate Array), and conventional circuit modules designed to perform each of the above-described functions.

[0074] For example, aspects of the present invention are as follows. <1> a missing area detection unit that detects a missing area of ​​a document included in a read image that is an image obtained by reading the document; an interpolation color specifying unit that specifies whether a color to interpolate a missing area of ​​the document in the scanned image is to be a background color of the document; An image processing device comprising: <2> The interpolation color specifying unit a background color of the document included in the scanned image is identified, and a color to be used to fill in a missing area of ​​the document is identified according to a luminance value of the background color; The aforementioned <1> The image processing device according to claim 1. <3> the missing area detection unit calculates the size of the missing area of ​​the document; the interpolation color specifying unit specifies a color to interpolate the missing area of ​​the document in accordance with the size of the missing area of ​​the document; The aforementioned <1> or the above <2> The image processing device according to claim 1. <4> the interpolation color specifying unit specifies a color to be used to interpolate the missing area of ​​the document based on the presence or absence of printing included in a predetermined area at an end of the scanned image; The aforementioned <3> The image processing device according to claim 1. <5> a tilt correction unit that corrects a tilt of the document included in the read image based on a tilt of the document relative to a horizontal component of the read image; The aforementioned <1> From the above <4> 10. The image processing device according to claim 9, wherein: <6> The missing area of ​​the document is a triangular area corresponding to an area that protrudes from the read image. The aforementioned <1> From the above <5> 10. The image processing device according to claim 9, wherein: <7> An image processing method performed by an image processing device, detecting a missing area of ​​a document included in a read image obtained by reading the document; specifying whether or not a color for interpolating a missing area of ​​the document in the scanned image is to be a background color of the document; An image processing method comprising: <8> A program for causing an image processing device to function, A process of detecting a missing area of ​​a document included in a read image, which is an image obtained by reading the document; a process of specifying whether or not a color to be used to fill in a missing area of ​​the document in the scanned image is to be a background color of the document; A program to execute. [Explanation of symbols]

[0075] 1. Image processing device 3. Missing area detection section 4. Interpolation color specification section 5 Tilt correction section 50 scanned images 60 manuscripts R1 Missing area R2 Predetermined area [Prior art documents] [Patent documents]

[0076] [Patent Document 1] Japanese Patent Application Publication No. 2019-016897

Claims

1. a missing area detection unit that detects a missing area of ​​a document included in a read image that is an image obtained by reading the document; an interpolation color specifying unit that specifies whether a color to interpolate a missing area of ​​the document in the scanned image is to be a background color of the document; An image processing device comprising:

2. The interpolation color specifying unit a background color of the document included in the scanned image is identified, and a color to be used to fill in a missing area of ​​the document is identified according to a luminance value of the background color; The image processing device according to claim 1 .

3. the missing area detection unit calculates the size of the missing area of ​​the document; the interpolation color specifying unit specifies a color to interpolate the missing area of ​​the document in accordance with the size of the missing area of ​​the document; The image processing device according to claim 1 .

4. the interpolation color specifying unit specifies a color to be used to interpolate the missing area of ​​the document based on the presence or absence of printing included in a predetermined area at an end of the scanned image; The image processing device according to claim 3 .

5. a tilt correction unit that corrects a tilt of the document included in the read image based on a tilt of the document relative to a horizontal component of the read image; The image processing device according to claim 1 .

6. The missing area of ​​the document is a triangular area corresponding to an area that protrudes from the read image. The image processing device according to claim 1 .

7. An image processing method performed by an image processing device, detecting a missing area of ​​a document included in a read image obtained by reading the document; specifying whether or not a color for interpolating a missing area of ​​the document in the scanned image is to be a background color of the document; An image processing method comprising:

8. A program for causing an image processing device to function, A process of detecting a missing area of ​​a document included in a read image, which is an image obtained by reading the document; a process of specifying whether or not a color to be used to fill in a missing area of ​​the document in the scanned image is to be a background color of the document; A program to execute.

Images