Image processing device and image processing method
The image processing device and method address the challenge of show-through by using color transmittance and gradation differences to detect and mitigate show-through, enhancing image quality by normalizing gradations and adjusting pixel densities.
Patent Information
- Application Number
- JP2023081817
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-17
- Publication Date
- 2024-11-28
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Conventional image processing devices struggle to accurately determine the presence of show-through, which occurs when the image on the back side of thin paper is visible through the paper, deteriorating image quality.
An image processing device and method that utilize differences in transmittance and gradation between red, green, and blue wavelengths to detect show-through, normalizing gradations to enhance detection accuracy, and then adjust or remove show-through by altering pixel densities or matching colors to the surrounding hue.
Accurately determines the presence of show-through and effectively reduces its impact on image quality by normalizing gradations and adjusting pixel densities, thereby improving image clarity.
Smart Images

Figure 2024165539000001_ABST
Abstract
Description
[Technical field]
[0001] The present disclosure relates to an image processing device and an image processing method for processing an image. [Background technology]
[0002] In recent years, image forming apparatuses are provided with image reading devices that read images of documents to obtain image data. In general, image reading devices that have both a mode for reading a placed document and a mode for reading a document by passing it through are widely known. Various types of paper have come to be used for documents, and when thin paper is used, the back side of the document can be seen through the paper, causing "show-through" in which the image printed on the back side is read, degrading image quality. Therefore, a method has been proposed for identifying show-through images and removing and restoring the show-through images (see, for example, Patent Document 1). [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2006-197445 A Summary of the Invention [Problem to be solved by the invention]
[0004] A conventional image processing device has an image quality detection means for comparing the density, edge strength, and density unevenness data of the read document image with reference values indicating the degree of show-through images, a show-through determination means for comprehensively determining the show-through images based on the image quality detection results obtained by the image quality detection means, and a means for suppressing the show-through images according to the determination results of the show-through determination means. The image quality detection means detects in binary terms whether or not the image has show-through image quality.
[0005] By the way, show-through occurs when an image on the back side is read through a sheet of paper. Therefore, there is a demand for a method of determining show-through by focusing on a specific item related to show-through, such as light transmittance, and by taking an approach different from that of conventional image processing devices.
[0006] The present disclosure has been made to solve the above-mentioned problems, and has an object to provide an image processing device and an image processing method that can accurately determine the presence or absence of show-through. [Means for solving the problem]
[0007] The image processing device of the present disclosure is an image processing device that includes a show-through determination unit that determines whether show-through is present in image data obtained by reading a document, and a processing unit that processes the image data based on the determination result of the show-through determination unit, and is characterized in that the show-through determination unit determines whether show-through is present based on the respective gradations of red, green, and blue in the image data.
[0008] In the image processing device according to the present disclosure, the show-through determination unit may be configured to determine that show-through occurs when a difference in gradation between red and blue in the image data exceeds a difference threshold value.
[0009] In the image processing device according to the present disclosure, the show-through determination unit may be configured to determine that show-through occurs when the saturation calculated from the gradation is lower than a saturation threshold value.
[0010] In the image processing device according to the present disclosure, the show-through determination unit may be configured to determine that show-through occurs when the density calculated from the gradation is lower than a density threshold value.
[0011] In the image processing device according to the present disclosure, the show-through determination unit may be configured to identify a background in the image data, and normalize the gradation of the entire image data based on the gradation of the background.
[0012] In the image processing device of the present disclosure, the show-through determination unit may be configured to normalize the red, green, and blue gradations of the parts identified as the base to be consistent, and determine that parts in the image data where the red gradation is smaller than the blue gradation are show-through.
[0013] In the image processing device according to the present disclosure, the processing unit may be configured to reduce the density of show-through of the image data.
[0014] In the image processing device according to the present disclosure, the processing unit may be configured to perform processing for offsetting the image data so as to match the color of the image data with the color of the surroundings.
[0015] The image processing method of the present disclosure is an image processing method including a show-through determination step of determining whether show-through is present in image data obtained by reading a document, and a processing step of processing the image data based on the determination result of the show-through determination step, characterized in that the show-through determination step determines whether show-through exists based on the respective gradations of red, green, and blue in the image data. Effect of the Invention
[0016] According to the present disclosure, by utilizing differences in transmittance due to color (wavelength) and referring to the gradation of image data, it is possible to accurately determine whether or not show-through occurs. [Brief description of the drawings]
[0017] [Figure 1] 1 is a schematic side view of an image forming apparatus according to an embodiment of the present disclosure. [Diagram 2] FIG. 2 is a schematic plan view showing an example of an original having images formed on both sides. [Diagram 3] FIG. 2 is a schematic side view showing an original to be read by the image reading device. [Figure 4] FIG. 2 is a schematic diagram illustrating the configuration of an image reading device and an image processing device. [Diagram 5]11 is a characteristics chart showing a first gradation table summarizing gradations in an example of image data. [Figure 6] 11 is a characteristic chart showing a second gradation table summarizing gradations in an example of normalized image data. [Figure 7] 11 is a characteristic chart showing an example of a histogram based on image data. [Figure 8] FIG. 11 is a flow diagram showing a process flow relating to show-through determination and image processing in the image processing device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0018] Hereinafter, an image forming apparatus according to an embodiment of the present disclosure will be described with reference to the drawings.
[0019] FIG. 1 is a schematic side view of an image forming apparatus according to an embodiment of the present disclosure.
[0020] Image forming device 100 is a multifunction device having a scanner function, a copy function, a printer function, a facsimile function, etc., and transmits an image of an original document read by an image reading device to the outside (corresponding to the scanner function), and also forms an image of the read original document or an image received from the outside on paper in color or monochrome (corresponding to the copy function, printer function, and facsimile function).
[0021] An original transport device 50 (ADF) is provided above the image reading device 41 and is supported so as to be freely opened and closed relative to the image reading device 41. When the original transport device 50 is opened, an original placement table 44 above the image reading device 41 is opened, and an original can be placed manually. The original transport device 50 automatically transports the placed original onto the image reading device 41. The image reading device 41 reads the placed original or the original transported from the original transport device 50 to generate image data. In the image reading device 41, a reading light source 42 irradiates light onto the original, and the image pickup element 43 receives the reflected light from the original guided via a mirror or the like. The method of reading an image in the image reading device 41 will be described with reference to FIG. 2 and FIG. 3 described later.
[0022] The image forming apparatus 100 includes an optical scanning device 1, a developing device 2, a photosensitive drum 3, a drum cleaning device 4, a charger 5, an intermediate transfer belt 7, a fixing unit 12, a paper transport path Sm, a paper feed cassette 10, a loading tray 15, and the like.
[0023] Image forming apparatus 100 handles image data corresponding to color images using the colors black (K), cyan (C), magenta (M), and yellow (Y), or monochrome images using a single color (e.g., black). Image forming apparatus 100 is provided with four developing devices 2, four photoconductor drums 3, four drum cleaning devices 4, and four chargers 5 for forming four types of toner images, each corresponding to black, cyan, magenta, and yellow, constituting four image stations Pa, Pb, Pc, and Pd.
[0024] The drum cleaning device 4 removes and collects residual toner on the surface of the photosensitive drum 3. The charger 5 uniformly charges the surface of the photosensitive drum 3 to a predetermined potential. The optical scanning device 1 exposes the surface of the photosensitive drum 3 to light to form an electrostatic latent image. The developing device 2 develops the electrostatic latent image on the surface of the photosensitive drum 3 to form a toner image on the surface of the photosensitive drum 3. Through the series of operations described above, a toner image of each color is formed on the surface of each photosensitive drum 3.
[0025] A transfer belt device 8 is provided above the photosensitive drums 3, and intermediate transfer rollers 6 are arranged with an intermediate transfer belt 7 interposed therebetween. The intermediate transfer belt 7 is stretched around a transfer drive roller 21 and a transfer driven roller 22, and moves in a circular motion in the direction of arrow C. Residual toner is removed and collected by a belt cleaning device 9, and the toner images of each color formed on the surface of each photosensitive drum 3 are transferred in sequence and superimposed on top of each other to form a color toner image on the surface of the intermediate transfer belt 7.
[0026] A nip area is formed between the transfer roller 11a of the secondary transfer unit 11 and the intermediate transfer belt 7, and the paper conveyed through the paper conveying path Sm is sandwiched in the nip area and conveyed. When the paper passes through the nip area, the toner image on the surface of the intermediate transfer belt 7 is transferred to the paper, and the paper is conveyed to the fixing unit 12.
[0027] The fixing unit 12 includes a fixing roller 31 and a pressure roller 32 that rotate while sandwiching the paper. The fixing unit 12 sandwiches the paper, onto which the toner image has been transferred, between the fixing roller 31 and the pressure roller 32 and applies heat and pressure to fix the toner image to the paper.
[0028] The paper feed cassette 10 is a cassette for storing paper to be used for image formation, and is provided below the optical scanning device 1. The paper is pulled out from the paper feed cassette 10 by a paper pickup roller 16, transported through a paper transport path Sm, passed through a secondary transfer unit 11 and a fixing unit 12, and discharged to a stack tray 15 via a paper discharge roller 17. On the paper transport path Sm, there are arranged a paper registration roller 14 that temporarily stops the paper, aligns the leading edge of the paper, and starts transporting the paper in accordance with the transfer timing of the color toner image in the nip area between the intermediate transfer belt 7 and the transfer roller 11a, a transport roller 13 that promotes the transport of the paper, and a paper discharge roller 17.
[0029] When an image is to be formed on the back side of the paper in addition to the front side, the paper is transported in the opposite direction from the paper discharge rollers 17 to the paper inversion path Sr. In the paper inversion path Sr, the paper is inverted by the inversion rollers 18 and guided again to the paper registration rollers 14. Thereafter, an image is formed on the back side in the same manner as on the front side, and the paper is conveyed to the stacking tray 15.
[0030] Next, a document having images formed on both sides and show-through that occurs when the document is read will be described with reference to FIGS. 2 and 3. FIG.
[0031] FIG. 2 is a schematic plan view showing an example of a document having images formed on both sides.
[0032] 2 shows an original GE with images formed on both sides as viewed from the front side, with a see-through view of the back side. A front side image FG is formed (printed) on the front side of the original GE, and a back side image RG is formed on the back side of the original GE. For the sake of explanation below, the part of the original GE where no images are formed on either the front or back side and where the original GE itself is visible may be referred to as the base SR.
[0033] 3 is a schematic side view showing an original to be read by an image reading device, in which an image formed (printed) on the original is hatched to emphasize it.
[0034] As described above, in the image reading device 41, light is irradiated from the reading light source 42 onto the surface of the document GE, and the image sensor 43 receives the light reflected from the document GE. When reading an image, the document GE is moved or the reading light source 42, etc. are moved so that light is irradiated onto the entire document GE. As a result, when light is irradiated onto the portion where the front image FG is formed (the left side in FIG. 3), the image sensor 43 receives reflected light (first reflected light HK1) corresponding to the front image FG.
[0035] Incidentally, when light is irradiated onto the portion where the back side image RG is formed (the right side in FIG. 3), the light is normally reflected by the surface of the document GE, generating reflected light corresponding to the base SR, but sometimes some of the light passes through the document GE. The light that passes through the document GE becomes reflected light corresponding to the back side image RG (second reflected light HK2), and is received by the imaging element 43. In this way, show-through occurs, in which the image (back side image RG) printed on the back side of the document GE is read.
[0036] The longer the wavelength of light, the higher the transmittance, and the more easily transmitted light is the infrared light, followed by red (R), green (G), and blue (B). In this embodiment, the difference in transmittance between red, green, and blue is used to determine whether or not show-through occurs.
[0037] In the image reading device 41, the color of each pixel in the read image data is specified using the gradations of red, green, and blue. For the sake of explanation, red, green, and blue may be collectively referred to as the three primary colors, and when distinguishing between them, red may be abbreviated as R, green as G, and blue as B. In this embodiment, the gradations of the three primary colors are expressed by values from 0 to 255. The color of a pixel is determined by a combination of the gradations of the three primary colors, and the higher the gradation value, the brighter the corresponding color becomes. For example, the gradation when the pixel is white is "R=255, G=255, B=255", and the gradation when the pixel is black is "R=0, G=0, B=0".
[0038] FIG. 4 is a schematic diagram of the image reading device and the image processing device.
[0039] As described above, the image reading device 41 includes the reading light source 42 and the image pickup element 43. Note that Fig. 4 shows only a part of the image reading device 41, and other members may be included as appropriate.
[0040] The image processing apparatus 60 includes a backside writing determination unit 61 that determines whether there is a backside writing in the image data obtained by reading the document GE (backside writing determination), and a processing unit 62 that performs processing on the image data based on the determination result of the backside writing determination unit 61. Note that the backside writing determination by the backside writing determination unit 61 and the image processing by the processing unit 62 will be described with reference to FIG. 8 described later.
[0041] Next, an example of the image data read by the image reading apparatus 41 will be described with reference to FIG. 5.
[0042] FIG. 5 is a characteristic chart showing a first gradation table summarizing the gradations in an example of the image data.
[0043] In FIG. 5, a first gradation table TB1 summarizing the gradations of some pixels in an example of the image data read by the image reading apparatus 41 is shown. In the first gradation table TB1, the "background" column shows the gradation of the pixels corresponding to the background SR of the document GE, the "backside writing" column shows the gradation of the pixels corresponding to the backside image RG of the document GE, and the "black characters" column shows the gradation of the pixels corresponding to the front surface image FG of the document GE.
[0044] Regarding the first gradation table TB1, focusing on the gradations of red (R) and blue (B) with a large wavelength difference, in the "background", R and B are substantially the same value, in the "black characters", R > B, but in the "backside writing", R < B. That is, on the front surface (front surface image FG) and the back surface (back surface image RG) of the document GE, the gradations of the pixels tend to be different depending on the color. Therefore, the backside writing determination unit 61 determines that there is backside writing when the difference in gradations between red and blue in the image data exceeds the difference threshold. In this way, by utilizing the difference in transmittance depending on the color (wavelength) and referring to the gradations of the image data, the presence or absence of backside writing can be accurately determined. Furthermore, by focusing on red and blue with a large difference in transmittance depending on the wavelength, the accuracy of the determination can be improved.
[0045] As described above, the backside copy determination may be performed by referring to the reading result of the image reading device 41 as it is, but is not limited thereto, and the backside copy determination may be performed after normalizing the reading result.
[0046] FIG. 6 is a characteristic chart showing a second gradation table summarizing the gradations in an example of the normalized image data.
[0047] In FIG. 6, for the same image data as the first gradation table TB1 shown in FIG. 5, a second gradation table TB2 summarizing the gradations after normalization is shown. In the normalization in the present embodiment, for the "background" and "black characters", the respective gradations in red, green, and blue are set to uniform values, and for the other parts, the values are converted based on a predetermined calculation formula. In the present embodiment, the "background" is set to R = G = B = 250, and the "black characters" are set to R = G = B = 50. As a result of the normalization, in the "backside copy" in the second gradation table TB2, the difference between R and B is large. That is, at the time of the backside copy determination, for the part identified as the background, normalization is performed so that the gradations in red, green, and blue are aligned, and the part where R < B may be determined as the backside copy. Thus, by normalizing with reference to the background SR having a uniform color tone, the difference in the gradation values becomes more prominent, and it becomes easier to determine whether there is a backside copy.
[0048] The image processing device 60 may perform a step of identifying the background SR in the image data when normalizing. In the present embodiment, the background SR is identified from the histogram based on the image data. Next, the histogram based on the image data will be described with reference to FIG. 7.
[0049] FIG. 7 is a characteristic chart showing an example of a histogram based on the image data.
[0050] In the histogram shown in Fig. 7, the horizontal axis indicates gradation, with the gradation value increasing as it moves to the right. The vertical axis indicates frequency, with the number of pixels in the image data increasing as it moves up. The image processing device 60 can count the number of corresponding pixels based on the gradation of each pixel in the image data to create a histogram.
[0051] The histogram only needs to show the distribution of the areas of the document GE where the image is printed and the areas where the base SR is exposed, and the image size may be reduced to reduce the number of pixels. Reducing the number of pixels in this way can speed up processing.
[0052] In the histogram shown in FIG. 7, there are three peaks with increasing frequency. Specifically, there is a first peak Pe1 with a low gradation, and a second peak Pe2 and a third peak Pe3 with high gradation. The first peak Pe1 has a large difference in gradation from the second peak Pe2 and the third peak Pe3, and corresponds to the "black characters" in the original GE. The third peak Pe3 has a higher gradation than the second peak Pe2 and a higher frequency, and corresponds to the "background" in the original GE. The second peak Pe2 has a slightly lower gradation than the third peak Pe3 and is the peak with the smallest frequency, and corresponds to the "bleed-through" in the original GE.
[0053] By referring to the histogram, it is possible to confirm which peak each pixel belongs to, and identify the pixels corresponding to "background," "black characters," and "show-through." In addition, the average density of "black characters" may be calculated based on the gradation of pixels corresponding to the first peak Pe1, and the average density of "background" may be calculated based on the gradation of pixels corresponding to the third peak Pe3.
[0054] Next, a process flow relating to show-through determination and image processing in the image processing device 60 will be described with reference to FIG.
[0055] FIG. 8 is a flow diagram showing a process flow relating to show-through determination and image processing in the image processing device.
[0056] In step S01, an image of an original GE is read by the image reading device 41. Note that the method of acquiring image data in the image forming apparatus 100 is not limited to reading an image by the image reading device 41, and image data may be received from an external source.
[0057] In step S02, the show-through determination unit 61 identifies the background SR and the effective portion. Here, the effective portion is the characters and photos printed on the document GE, and corresponds to the portion corresponding to the front image FG. The background SR and the effective portion may be identified simply based on the gradation of the pixels, or may be identified by creating a histogram as shown in FIG.
[0058] In step S03, the read result is normalized by the show-through determination unit 61. However, this is not limiting, and step S03 may be omitted and the process may proceed to step S04.
[0059] In step S04, the show-through determination unit 61 determines whether show-through exists in the image. Here, the show-through determination unit 61 may determine whether show-through exists for each pixel based on the gradation of each of red, green, and blue in the image data.
[0060] Also, in determining show-through, not only the difference in gradation between red and blue, but also saturation and density may be taken into consideration. Show-through occurs on the back side of the document GE, and has low saturation and density, so low saturation and low density can be determined to be highly likely to be show-through.
[0061] For saturation, the difference between the gradations of red, green, and blue may be calculated. For example, if any of the gradations is high, such as "R=120, G=214, B=119," the saturation will be higher than the set saturation threshold. If the saturation calculated in this way is lower than the saturation threshold, it is determined that there is show-through.
[0062] The density can be calculated based on the average value of the red, green, and blue gradations of the pixel, and in this embodiment, a gradation close to white is considered to be low density, and a gradation close to black is considered to be high density. If the density calculated in this way is lower than the density threshold, it is determined that there is show-through.
[0063] In this way, when a plurality of conditions are set, show-through is determined to occur if all of the conditions are satisfied with respect to the difference in tone between red and blue, saturation, and density.
[0064] In step S05, the processor 62 removes the show-through. Specifically, the processor 62 reduces (lowers) the density of the show-through in the image data. The show-through can be removed by reducing the density of the portion determined to be show-through to bring the color closer to the base SR. As a different processing method, the portion determined to be show-through may be subjected to processing to match the surrounding color. That is, the value may be changed so as to be closer to the gradation of the adjacent pixel. In this way, show-through can be appropriately removed by making it less noticeable by matching it to the surrounding color.
[0065] When the show-through determination and image processing are completed for the entire image, the processing ends.
[0066] As described above, the image processing method according to the present disclosure includes a show-through determination step of determining whether show-through is present in the image data obtained by reading the original GE, and a processing step of processing the image data based on the determination result of the show-through determination step, in which the show-through determination step is configured to determine whether show-through is present based on the respective gradations of red, green, and blue in the image data.
[0067] The image processing device 60 may create image data corresponding to the back side of the document GE based on the portion determined to be show-through. As described above, show-through corresponds to the back side image RG of the document GE, so image data corresponding to the back side of the document GE can be created from this. Therefore, the back side of the document GE can be read at the same time as reading the front side of the document GE.
[0068] It should be noted that the embodiments disclosed herein are illustrative in all respects and are not intended to provide a basis for a restrictive interpretation. Therefore, the technical scope of the present disclosure is not interpreted solely by the above-described embodiments, but is defined based on the claims. In addition, the present disclosure includes all modifications within the scope and meaning equivalent to the claims. [Explanation of symbols]
[0069] 41 Image reading device 42 Reading light source 43 Image sensor 60 Image processing device 61 Back-bleeding detection section 62 Processing section 100 Image forming device
Claims
1. a show-through determination unit that determines whether show-through exists in image data obtained by reading a document; a processing unit that processes the image data based on a determination result of the show-through determination unit, The show-through determination unit determines show-through based on the gradations of red, green, and blue in the image data. An image processing device comprising:
2. 2. The image processing device according to claim 1, The show-through determination unit determines that show-through occurs when a difference in gradation between red and blue in the image data exceeds a difference threshold value. An image processing device comprising:
3. 2. The image processing device according to claim 1, The show-through determination unit determines that show-through occurs when the saturation calculated from the gradation is lower than a saturation threshold value. An image processing device comprising:
4. 2. The image processing device according to claim 1, The show-through determination unit determines that show-through occurs when the density calculated from the gradation is lower than a density threshold value. An image processing device comprising:
5. 2. The image processing device according to claim 1, The show-through determination unit identifies a background in the image data, and normalizes gradations in the entire image data based on gradations in the background. An image processing device comprising:
6. 6. The image processing device according to claim 5, The show-through determination unit normalizes the portion identified as the background so that the gradations of red, green, and blue are uniform, and determines that a portion in which the gradation of red is smaller than the gradation of blue in the image data is show-through. An image processing device comprising:
7. 2. The image processing device according to claim 1, The processing unit reduces a density of the image data with respect to show-through. An image processing device comprising:
8. 2. The image processing device according to claim 1, The processing unit performs processing for matching the image data with a surrounding color with respect to show-through of the image data. An image processing device comprising:
9. a show-through determination step for determining whether show-through exists in image data obtained by reading a document; and a processing step of processing the image data based on a result of the show-through determination step, In the show-through determination step, show-through is determined based on the gradations of red, green, and blue in the image data. An image processing method comprising:
Citation Information
Patent Citations
Image processor
JP2006197445A
