Image processing device, image forming system, image processing method and program
The image processing device enhances color stabilization in printers by estimating and correcting color density through spectral reflection analysis, addressing resource consumption and accuracy issues in existing methods.
Patent Information
- Application Number
- JP2021027744
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-02-24
- Publication Date
- 2024-12-04
- Estimated Expiration
- 2041-02-24
AI Technical Summary
Inkjet and electrophotographic printers face challenges in maintaining color stability due to environmental factors, leading to increased costs and reduced accuracy in color stabilization processing, as existing methods require dedicated charts that consume resources and extend the interval between color corrections.
An image processing device that estimates the recording amount of each color in a multi-color image by analyzing spectral reflections and halftone dots, using a determination and correction mechanism to improve color stabilization processing efficiency and accuracy.
The solution shortens the estimation time for color stabilization and improves accuracy by efficiently correcting color density changes in inkjet printers, reducing resource consumption and maintaining printing speed.
Smart Images

Figure 0007594464000009 
Figure 0007594464000010 
Figure 0007594464000011
Abstract
Description
[Technical field]
[0001] The present invention relates to an image processing apparatus, an image forming system, an image processing method, and a program. [Background technology]
[0002] As an image forming apparatus for forming an arbitrary image on a paper surface, an inkjet printer that forms an image by ejecting ink from a plurality of nozzles is widely used. Alternatively, an electrophotographic printer that forms an image using a laser photosensitive body and a charged toner is also widely used. It is also known that the color of the formed image changes in an electrophotographic printer depending on the remaining amount of toner in the image forming apparatus and the environment such as the surrounding temperature and humidity. On the other hand, it is known that the color of the formed image changes due to factors such as ink adhesion around the nozzle, aging of the piezoelectric element and heater that control the ink ejection, and the surrounding environment such as temperature and humidity. To address the problem of color change due to factors such as the printer surrounding environment, there is a technology that suppresses the color change by, for example, executing a color stabilization process of the image at regular intervals.
[0003] The stabilization process requires outputting a dedicated chart to measure the characteristics of recording materials such as toner or ink of each color. However, the output of the dedicated chart consumes recording materials, paper, and time prepared by the user to output the image, which results in an unnecessary increase in costs. In order to suppress the increase in costs associated with the output of the dedicated chart, the user may increase the interval between outputting the dedicated chart, but this may result in the characteristics of the recording material of the printer not being measured sufficiently, which may reduce the accuracy of color stabilization. In consideration of these circumstances, Patent Document 1 discloses a technology that maintains the accuracy of color stabilization while avoiding unnecessary cost increases by performing color stabilization processing based on the color measurement results of a printed user image. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] JP 2012-155309 A Summary of the Invention [Problem to be solved by the invention]
[0005] However, in the color stabilization process for an image, the recording amount of each color is estimated from the color measurement results of the multi-color image, and the image creation conditions for each color are changed, so the color stabilization process takes time. As a result, there is a problem that the printing speed must be slowed down or the correction interval of the image color must be extended in the inkjet printer.
[0006] An object of the present invention is to reduce the estimation time required to estimate the printing amount of each color in an image containing multiple colors, and to improve the accuracy of color stabilization processing. [Means for solving the problem]
[0007] In order to achieve the object of the present invention, an image processing device according to an embodiment of the present invention has the following arrangement: Namely, an acquisition means for acquiring mixed reflections of an area where a first color and a second color are mixed in an image including the first color and the second color, a plurality of first spectral reflections of the first color, a plurality of first halftone dots respectively associated with the plurality of first spectral reflections, a plurality of second spectral reflections of a second color, and a plurality of second halftone dots respectively associated with the plurality of second spectral reflections, a determination means for determining a first wavelength region in which the plurality of first spectral reflections are lower than the plurality of second spectral reflections and a second wavelength region in which the plurality of first spectral reflections are higher than the plurality of second spectral reflections, and a determination means for determining, according to a degree of coincidence of the mixed reflections in the first wavelength region among the plurality of first spectral reflections. The optical system further comprises an estimation means for estimating a first halftone dot associated with one selected first spectral reflection, determining a third spectral reflection by dividing the mixed reflection by the selected first spectral reflection, and estimating a second halftone dot associated with one selected second spectral reflection from the plurality of second spectral reflections in accordance with a degree of coincidence of the third spectral reflection in the second wavelength region, and a correction means for correcting the first halftone dot and the second halftone dot of the first color and the second color, respectively, based on a difference from a preset target of the first halftone dot and the second halftone dot to the first halftone dot and the second halftone dot estimated by the estimation means. Effect of the Invention
[0008] According to the present invention, for an image made up of a plurality of colors, it is possible to shorten the estimation time required to estimate the printing amount of each color, and improve the accuracy of color stabilization processing. [Brief description of the drawings]
[0009] [Figure 1] 1 is a configuration diagram of an image forming system according to an embodiment of the present invention. [Diagram 2] 2 is a schematic diagram of an image forming unit and an image acquiring unit according to the embodiment of the present invention. [Diagram 3] 5A to 5C are views for explaining a primary color estimation process according to the embodiment of the present invention. [Figure 4] FIG. 2 is a functional block diagram of an image processing unit according to the embodiment of the present invention. [Diagram 5] FIG. 4 is a diagram showing an example of a correction table according to the embodiment of the present invention. [Figure 6] 5A to 5C are diagrams for explaining a process of creating a correction table according to the embodiment of the present invention. [Figure 7] 6 is a flowchart of a presetting process according to the first embodiment. [Figure 8] FIG. 4 is a diagram showing an example of a characteristic acquisition chart according to the first embodiment. [Figure 9] FIG. 4 is a diagram showing an example of a primary color spectral reflectance classification table according to the first embodiment. [Figure 10] FIG. 4 is a diagram showing the spectral reflectance characteristics of the head module according to the first embodiment. [Figure 11] 5 is a flowchart showing image printing processing by a user according to the first embodiment. [Figure 12] 5 is a flowchart showing a primary color estimation process according to the first embodiment. [Figure 13] 6 is a flowchart showing a correction table modification process according to the first embodiment. [Figure 14] FIG. 4 is a diagram showing an example of a spectral reflectance classification table according to the first embodiment. [Figure 15] 13A to 13C are views for explaining a primary color estimation process according to the second embodiment. [Figure 16] FIG. 11 is a functional block diagram of an image processing unit according to a second embodiment. [Figure 17] 11 is a flowchart of a presetting process according to the second and third embodiments. [Figure 18] FIG. 11 is a diagram showing an example of virtual spectral density of a primary color according to the second embodiment. [Figure 19] FIG. 11 is a graph showing an example of the relationship between color signal values and spectral densities according to the second embodiment. [Figure 20] 10 is a flowchart showing an image printing process according to a second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0010] Hereinafter, the embodiments will be described in detail with reference to the attached drawings. Note that the following embodiments do not limit the invention according to the claims. Although the embodiments describe a number of features, not all of these features are essential to the invention, and the features may be combined in any manner. Furthermore, in the attached drawings, the same reference numbers are used for the same or similar configurations, and duplicated descriptions are omitted.
[0011] (First embodiment) An image forming system 10 according to this embodiment will be described below.
[0012] 1 is a diagram showing an example of the configuration of an image forming system 10 according to this embodiment. The image forming system according to this embodiment is configured to include a CPU 100, a RAM 101, a ROM 102, an operation unit 103, a display unit 104, a storage unit 105, an image processing unit 106, an image forming unit 107, an image acquisition unit 108, an I / F unit 109, and a bus 110.
[0013] The CPU 100 is a processor representing a central processing unit, and executes computer programs stored in the RAM and ROM described later to control the operation of the entire image forming system 10. Although the case where the CPU 100 controls the entire image forming system 10 has been described as an example, a plurality of hardware (not shown) may control the entire image forming system 10 by sharing the processing. The RAM 101 is a main working memory, and has a storage area for temporarily storing computer programs and data read from the storage unit 105, and data received from the outside via the I / F unit 109. The RAM 101 is also used as a storage area used by the CPU 100 when executing various processes and as a storage area used by the image processing unit 106 when executing image processing. The ROM 102 is a readable memory, and has a storage area for storing setting parameters of each unit in the image forming system 10, a boot program, and the like.
[0014] The operation unit 103 is an input device such as a keyboard and a mouse, and accepts operations or instructions from a user. This allows the user to give various instructions to the CPU 100. The display unit 104 is a display device such as a CRT display and an LCD (liquid crystal display), and can display the results of processing by the CPU 100 as images and characters. If the display unit 104 has a touch panel that allows touch operation, the display unit 104 may function as a part of the operation unit 103. The storage unit 105 is a large-capacity information storage device such as an HDD (hard disk drive). The storage unit 105 stores an OS (operating system), computer programs and data for causing the CPU 100 to execute various processes, and the like. The storage unit 105 also holds temporary data (for example, input or output image data and a transformation matrix used in the image processing unit 106, and the like) generated by processing of each unit of the image forming system 10. The computer programs and data stored in the storage unit 105 are read as appropriate under the control of the CPU 100, and stored in the RAM 101.
[0015] The image processing unit 106 is a processor capable of executing a computer program and a dedicated image processing circuit. The image processing unit 106 executes various image processes for converting image data input as a print target into image data that can be output by the image forming unit 107 described later. The image processing unit 106 can also execute color stabilization processing based on the result of reading an image printed by a user. In this embodiment, instead of preparing a dedicated processor as the image processing unit 106, the CPU 100 may execute various image processes as a substitute for the image processing unit 106. The image forming unit 107 has a function of forming an image by discharging a recording material held by a recording head onto a recording medium. The image forming unit 107 forms an image by discharging a recording material onto a recording medium based on image data received via the image processing unit 106 or the RAM 101 and an external recording device (not shown). The recording medium is, for example, plain paper, coated paper, and glossy paper. The recording material is, for example, pigment ink or dye ink including cyan (C), magenta (M), yellow (Y), and black (K). The image forming unit 107 will be described in detail later.
[0016] The image acquisition unit 108 includes an image sensor (for example, a line sensor or an area sensor) for capturing an image formed on a recording medium by the image formation unit 107. In this embodiment, the image sensor is a spectral sensor capable of acquiring reflectance at each wavelength based on reflected light from the image formed on the recording medium. Spectral reflectance refers to the distribution of reflectance for each wavelength. The spectral density is obtained by converting the reciprocal of the spectral reflectance using the common logarithm. The image sensor is an RGB sensor that detects signal information of the three primary colors R (red), G (green), and B (blue) from the reflected light from the image formed on the recording medium.
[0017] The I / F unit 109 functions as an interface for connecting the image forming system 10 to an external device (not shown). The I / F unit 109 also functions as an interface for exchanging data with other communication devices (not shown) via infrared communication, wireless LAN (local area network), etc., and as an interface for connecting to the Internet. The bus 110 is a data transmission path for exchanging data between each unit in the image forming system 10. All units in the image forming system 10 are connected to the bus 110, and for example, the CPU 100 can exchange data with the ROM 102 via the bus 110.
[0018] FIG. 2 is a schematic diagram of the image forming unit 107 according to the present embodiment. The image forming unit 107 according to the present embodiment is an inkjet printer that forms an image by ejecting a recording material (e.g., ink) from a nozzle onto a recording medium. As shown in FIG. 2(a), the image forming unit 107 includes a recording head 201, a recording head 202, a recording head 203, and a recording head 204 on a frame (not shown), which is a structural member of the printer. The recording heads 201 to 204 each have black (K), cyan (C), magenta (M), and yellow (Y) inks. In FIG. 2(a), for example, the recording head 201 has black (K) ink, and the recording head 202 has cyan (C) ink. The recording head 203 has magenta (M), and the recording head 204 has yellow (Y).
[0019] The recording heads 201 to 204 are, for example, full-line type recording heads in which a plurality of nozzles for ejecting ink are arranged in a predetermined direction in a range corresponding to the width of the recording paper 206. The full-line type recording head is a recording head having the same length as the recording paper 206, so that a wide area of the recording paper 206 can be printed at once, enabling high-speed printing. Note that the image forming unit 107 is not limited to a full-line type recording head, and may be, for example, a serial type that records on a recording material by scanning the recording head back and forth in a direction perpendicular to the paper conveying direction 207 of the recording paper 206. Alternatively, the image forming unit 107 may be an electrophotographic type that forms an image using a laser photosensitive body and charged toner, or a thermal transfer type that vaporizes solid ink by heat and transfers it to a printing paper.
[0020] As shown in FIG. 2B, the recording head 201 to the recording head 204 are configured by combining a plurality of head modules. For example, the recording head 201 includes a head module 201a, a head module 201b, and a head module 201c. The head modules 201a to 201c are arranged, for example, in a staggered arrangement in which adjacent head modules are arranged in a staggered manner in the paper transport direction 207. Furthermore, as shown in FIG. 2C, for example, the head module 201a includes a chip module 201a-1, a chip module 201a-2, a chip module 201a-3, a chip module 201a-4, and a chip module 201a-5. The chip modules 201a-1 to 201a-5 are each independently connected to the base of the head module 201a. Head modules other than the head module 201a include the same configuration as the head module 201a, and therefore will not be described.
[0021] FIG. 2(d) is a diagram of one of the chip modules as viewed from the ink ejection side, showing that the chip module has a plurality of nozzles. The plurality of nozzles are indicated by circles. In the example shown in FIG. 2(d), the chip module has 16 nozzles. The nozzle arrangement resolution of each ink color nozzle row is, for example, 1200 dpi. A recording paper 206 as a recording medium is conveyed in a paper conveying direction 207 by a conveying roller 205 (and other rollers, not shown) rotating by a driving force of a motor (not shown). Next, while the recording paper 206 is being conveyed, the plurality of nozzles of the recording heads 201 to 204 respectively discharge an appropriate amount of ink of each ink color according to the recording data. As a result, an image of one raster (for example, one pixel, the smallest unit of an image, lined up in a horizontal row) corresponding to the nozzle row of each recording head is formed sequentially. By repeating ink ejection by each recording head on the conveyed recording paper 206, an image of, for example, one page can be recorded.
[0022] As shown in FIG. 2A, the image acquisition unit 108 is a line sensor that covers the entire surface of the recording paper 206 and is installed downstream of the recording head 201 to the recording head 204 in the paper transport direction 207. A line sensor is an imaging sensor that can continuously acquire one-dimensional images of one row and acquire a two-dimensional image. The image acquisition unit 108 sequentially acquires information on the spectral reflectance of the recording paper 206 that is transported after an image is formed by the recording head 201 to the recording head 204. The image acquisition unit 108 stores the acquired information on the spectral reflectance in the storage unit 105 as two-dimensional spectral image data. The resolution in the wavelength λ direction by the image acquisition unit 108 of this embodiment is 10 nm. The image acquisition unit 108 is not limited to the line sensor shown in FIG. 2A. The image acquisition unit 108 may be provided with a carriage that reciprocates in a direction perpendicular to the paper transport direction 207 of the recording paper 206 by 90°. The image acquisition unit 108 may be configured to acquire information on the spectral reflectance of an arbitrary image area having a width smaller than that of the recording paper 206 by using a carriage.
[0023] The color stabilization process of the image in this embodiment will be described below. Each recording head of the image forming unit 107 is affected by the surrounding environment such as, for example, ink adhesion around the nozzle, aging of the piezoelectric element and heater that control the ink discharge, and temperature and humidity. Therefore, it is known that the density of the image formed on the recording paper 206 changes with each printing even when the image forming unit 107 forms the same image. Such a change in density of the image is visually recognized as, for example, uneven density and color shift on the recording paper 206. Since uneven density and color shift cause deterioration of the image quality, they need to be suppressed as much as possible in order to maintain the image quality. As shown in FIG. 2(a), the image forming system 10 in this embodiment can read the image formed by the recording heads 201 to 204 by the image acquisition unit 108 (for example, a line sensor). That is, in this embodiment, the density change of the image can be suppressed by estimating the density change of the image from the two-dimensional image data acquired by the image acquisition unit 108 and performing color stabilization process of the image. Since the use of a dedicated chart in the color stabilization process for an image consumes additional costs such as the recording paper 206, recording material (ink), and time, the density change may be estimated from an image printed by a user.
[0024] In addition, the image forming system 10 in this embodiment of FIG. 2 arbitrarily mixes the four colors of recording material of CMYK inks and records it on a recording medium to form an arbitrary image. Therefore, the color density change due to the change over time occurs independently for each CMYK ink color. Therefore, by performing independent gamma correction processing corresponding to each ink color on the input image corresponding to each ink color, the color density change can be effectively reduced. Gamma correction processing refers to a process of relatively adjusting the input signal of each color data and the signal of the image that is actually output in a peripheral device that handles images (for example, a display and a printer). However, an arbitrary image printed by a user does not necessarily have an area that includes only each ink color. In such a case, the density change of each ink color needs to be estimated based on the density change of each ink color included in a multi-color area where multiple ink colors are mixed. Note that the density change of each ink color often changes in units of a head module or chip module that holds a recording material. Furthermore, even if the nozzles are in the same head module, the amount of density change of the ink color of each nozzle may differ. Therefore, when correcting each ink color in units of either the head module or the nozzle, it is necessary to estimate the density change of each ink color for each unit to be corrected, and perform gamma correction processing for the unit to be corrected. In this embodiment, gamma correction can be performed in units of correction of either the head module, the chip module, or the nozzle.
[0025] For example, in FIG. 2(a), when gamma correction is performed independently on four print heads, four estimation processes are required to estimate the density change of CMYK colors. In FIG. 2(b), when gamma correction is performed independently on three head modules each of four print heads, 12 estimation processes are required, obtained by multiplying the number of four print heads by the number of three head modules, to estimate the density change of each ink color. In FIG. 2(c), a case where gamma correction is performed independently on five chip modules each of the 12 head modules calculated above is described. 60 estimation processes are required, obtained by multiplying the number of 12 head modules by the number of five chip modules. In FIG. 2(d), a case where gamma correction is performed independently on 16 nozzles each of the 60 chip modules calculated above is described. 960 estimation processes are required, obtained by multiplying the number of 60 chip modules by the number of 16 chip modules.
[0026] In this way, the more the correction unit of the gamma correction is divided, the more the number of times the estimation process for estimating the density change of each ink color increases. In order to perform gamma correction in the divided correction units while maintaining the printing speed of the recording medium by the recording material, it is necessary to efficiently perform the estimation process for the density change of each ink color. Therefore, in this embodiment, the estimation order of each ink color for estimating the density change of each ink color and the corresponding estimated wavelength are determined based on the difference in the distribution of the spectral reflectance in the wavelength region of each ink color. In this way, this embodiment realizes a high-speed estimation process for estimating the density of each ink color. Below, an outline of the estimation process for estimating the density change of each ink color in this embodiment will be described with reference to FIG. 3. Note that in this embodiment, the estimation process is not performed in the multi-color region including the K ink.
[0027] FIG. 3A shows the spectral reflectance ρc(kc, λ) of the C ink discharged by the print head 202 as an example of this embodiment. The vertical axis of the figure shows the reflectance normalized by the paper white, and the horizontal axis shows the wavelength (nm). The spectral reflectance is the ratio of the spectral density of the reflected light beam to the spectral density of the incident radiation, and is expressed as a function of the wavelength. Here, λ is the wavelength (nm), and kc is the dot ratio (%) of the C ink. The wavelength λ indicates the wavelength of 380 nm to 730 nm in the visible light range that is perceptible by the human eye. The dot ratio indicates the ratio of ink dots discharged in each grid of an image with a nozzle resolution of, for example, 1200 dpi. For example, the dot ratio kc=100(%) of the C ink indicates a state in which the C ink is discharged to all grid points, while kc=0(%) indicates a white background state in which the C ink is not discharged to all grid points.
[0028] Curve 301 in FIG. 3(a) is a curve showing the spectral reflectance ρc(100, λ) when C ink is ejected at a dot ratio of 100%. In this embodiment, the reflectance normalized by the spectral reflectance of paper is used as the spectral reflectance of each ink. Next, curves 302, 303, and 304 correspond to ρc(50, λ), ρc(25, λ), and ρc(0, λ), respectively. Note that since normalization is performed by the spectral reflectance of paper, the spectral reflectance ρc(0, λ) is a reflectance of 1.0 over the entire wavelength range. FIG. 3(b) shows the spectral reflectance ρm(km, λ) of M ink ejected by the print head 203 as an example of this embodiment. Curves 305, 306, 307, and 308 in Fig. 3(b) represent the spectral reflectance ρm(km, λ) when M ink is ejected at dot rates of 100%, 50%, 25%, and 0%, respectively. Curves 309, 310, 311, and 312 in Fig. 3(c) represent the spectral reflectance ρy(ky, λ) when Y ink is ejected at dot rates of 100%, 50%, 25%, and 0%, respectively.
[0029] FIG. 3D shows the mixed spectral reflectance ρx(kx, λ) of the region where C ink, M ink, and Y ink are mixed as an example of this embodiment. Curves 313, 314, and 315 in FIG. 3D correspond to the mixed spectral reflectance of CMY ink, the mixed spectral reflectance of MY ink, and the mixed spectral reflectance of Y ink, respectively. Next, a method of estimating each of the spectral reflectances of the CMY inks from the spectral reflectance of the mixed region where the CMY inks are mixed will be described. Specifically, the spectral reflectance of each ink is estimated based on the dot ratio kc(%) of the C ink, the dot ratio km(%) of the M ink, and the dot ratio ky(%) of the Y ink, which satisfy the following equation 1. Note that ρx(λ) in equation 1 is the spectral reflectance of the mixed region of the C ink, M ink, and Y ink used for the estimation. In addition, the spectral reflectances ρc(kc, λ), ρm(km, λ), and ρy(ky, λ) of the CMY inks shown in Figures 3(a) to 3(c) are obtained in advance before estimating the dot ratios of the CMY inks.
[0030] (Number 1) ρx(λ)=ρc(kc,λ)×ρm(km,λ)×ρy(ky,λ)
[0031] For example, assume that the mixed spectral reflectance ρx(λ) of the mixed region of CMY inks is acquired as shown by the curve 313 in FIG. 3(d). In this case, when paying attention to the spectral reflectances of the CMY inks shown in FIG. 3(a) to FIG. 3(c), the reflectances of M ink and Y ink are approximately 1.0 in the wavelength range of 630 nm or more. In the wavelength range of 630 nm or more, M ink and Y ink reflect all light (have no sensitivity), but only C ink absorbs light (have sensitivity). Considering the difference in the spectral reflectance characteristics of each ink color, for example, if the wavelength λ in Equation 1 is set to 650 and the reflectances ρm and ρy of M ink and Y ink are each set to 1.0, the following Equation 2 is obtained. Next, the dot ratio kc of C ink is estimated based on Equation 2. Here, the spectral reflectance ρc(kc,650) and the dot ratio kc have a monotonically decreasing relationship in which the reflectance ρc decreases as the dot ratio kc increases, as shown in FIG. 3(a). Based on this relationship, the dot ratio kc of C ink that satisfies equation 1 can be calculated easily and quickly.
[0032] (Number 2) ρx(650)=ρc(kc,650)
[0033] Next, the dot rate km of the M ink is estimated based on the estimated dot rate kc of the C ink. For example, assume that the dot rate of the C ink is estimated to be kc=90% using equation 2. In this case, the mixed spectral reflectance ρx'(λ) obtained by dividing the mixed spectral reflectance ρx(λ) by the dot rate kc of the C ink is obtained as equation 3 below. Curve 314 in FIG. 3(d) is a curve that shows the mixed spectral reflectance ρx'(λ) obtained based on equation 3. The mixed spectral reflectance ρx'(λ) is also called the third spectral reflectance.
[0034] (Number 3) ρx´(λ)=ρx(λ) / ρc(90,λ)
[0035] Focusing on the spectral reflectance characteristics of M and Y inks shown in FIG. 3(b) and FIG. 3(c), the reflectance of Y ink is approximately 1.0 in the wavelength region around 550 nm, but the reflectance ρy of M ink is smaller than 1.0. In other words, in the wavelength region around 550 nm, Y ink reflects all light (has no sensitivity), but M ink absorbs light (has sensitivity). Based on the difference in the spectral reflectance characteristics of M ink and Y ink, for example, if the wavelength λ in Equation 3 is set to 550 and the reflectance ρy of Y ink is set to 1.0, the following Equation 4 is obtained. The dot ratio km of M ink is estimated based on Equation 4. Here, the spectral reflectance ρm(km,550) and the dot ratio km of M ink have a monotonically decreasing relationship in which the reflectance ρm decreases as the dot ratio km increases, as shown in FIG. 3(b). Based on this relationship, the dot ratio km of M ink that satisfies Equation 1 can be uniquely calculated.
[0036] (Number 4) ρx´(550)=ρm(km,550)
[0037] Next, the spectral reflectance ρx″(λ) obtained by dividing the spectral reflectance ρx′(λ) by the estimated dot ratio km of M ink is obtained as the following equation 5. Curve 315 in FIG. 3(d) shows the spectral reflectance ρx″(λ) obtained based on equation 5.
[0038] (Number 5) ρx´´(λ)=ρx´(λ) / ρm(km,λ)
[0039] In this case, the spectral reflectance ρx''(λ) is expressed by the following equation 6, since the influence of the dot rate kc and dot rate km of the C ink and M ink is eliminated from the mixed region of CMY inks. For example, the dot rate ky of the Y ink is estimated based on the wavelength λ=450 nm in equation 6. Here, the spectral reflectance ρy(ky,450) and dot rate ky of the Y ink have a monotonically decreasing relationship in which the reflectance ρm decreases as the dot rate ky of the Y ink increases, as shown in FIG. 3(c). Based on this relationship, the dot rate ky of the Y ink that satisfies equation 1 can be uniquely calculated.
[0040] (Number 6) ρx´´(λ)=ρy(ky,λ)
[0041] As described above, the estimation order and wavelengths that allow the reflectance of the CMY inks to be calculated can be selected based on the difference in the spectral reflectance characteristics for the wavelength ranges of the CMY inks. This makes it possible to easily and quickly estimate the dot rates kc, km, and ky associated with the reflectance ρc, reflectance ρm, and reflectance ρy of the CMY inks that satisfy the formula 1. The above estimation process can be performed for each head module, for example, to obtain the reflectance of each ink color corresponding to each head module. Furthermore, based on each obtained reflectance, it is possible to create a gamma correction table so that the reflectance between head modules is approximately equal, using either the head module or the wavelength as a reference. In addition, when creating the gamma correction table, by using the above monotonically decreasing relationship, it is possible to easily obtain a correction value that approximately matches the reflectance of the ink of the reference module. By applying the gamma correction value obtained above to the input image, it is possible to suppress changes in color density due to changes over time.
[0042] FIG. 4 is a diagram for explaining the function of the image processing unit 106 according to this embodiment. The functional configuration of the image processing unit 106 that executes color stabilization processing will be explained with reference to FIG. 4. The image processing unit 106 includes a color conversion processing unit 401, a correction processing unit 402, an HT processing unit 403, an estimated parameter setting unit 404, and a primary color estimation processing unit 405. The image processing unit 106 also includes a correction table creation unit 406, a correction table 407, a target setting unit 408, and a target characteristic 409. Furthermore, the estimated parameter setting unit 404 is configured to include an ink characteristic acquisition unit 4041, a processing order setting unit 4042, and a wavelength selection unit 4043. Moreover, the primary color estimation processing unit 405 is configured to include a primary color estimation unit 4051, ink characteristics 4052, a processing order 4053, and a selected wavelength 4054.
[0043] The color conversion processing unit 401 converts the input image data from the storage unit 105 into image data corresponding to the color reproduction range of the printer. The input image data is, for example, data indicating color coordinates (R, G, B) in a color space coordinate such as sRGB, which is the display color of the monitor. sRGB is a standard established by the IEC (International Electrotechnical Commission), an international standardization organization. The color conversion processing unit 401 performs a process of converting into color signals corresponding to a plurality of ink colors used in the image forming unit 107. For example, when the image forming unit 107 uses black (K), cyan (C), magenta (M), and yellow (Y) inks, the image data of the RGB signal is converted into image data including 8-bit color signals for each of K, C, M, and Y. The conversion of the image data may be performed by a known method such as a matrix calculation process and a process using a three-dimensional LUT (lookup table). The input image data is not limited to data indicating RGB, and may be data directly indicating each color of CMYK ink. However, in order to limit the total amount of each ink and for color management, the color conversion processing unit 401 may perform processing using a four-dimensional LUT that converts CYMK to C'M'Y'K'. The correction processing unit 402 performs correction processing to stabilize the color of the image according to changes in the image data over time. More specifically, the correction processing unit 402 can perform gamma correction on each image data of CMYK by using a correction table 407 for each ink color calculated for each module or nozzle.
[0044] 5 is a diagram showing an example of the correction table 407 in this embodiment. The correction table 407 stores the corrected color signal values of the head modules 201a to 204c corresponding to the input color signals from 0 to 255. The printhead 201 has head modules 201a, 201b, and 201c, and the printhead 202 has head modules 202a, 202b, and 202c. The printhead 203 has head modules 203a, 203b, and 203c, and the printhead 204 has head modules 204a, 204b, and 204c. In FIG. 5, for example, if the printhead 201 has K ink and the input color signal value of K is 32, the correction processing unit 402 changes the input color signal value from 32 to 28. In this embodiment, regarding conversion of color signals of CMYK inks, correction processing for each ink color can be performed using color signal values corresponding to the correction table of each head module corresponding to the ejection of CMYK inks.
[0045] When color correction processing is performed not on a head module basis but on a chip module basis or on a nozzle basis, the correction table 407 includes information on color signal values equal to the number of chip modules or the number of nozzles. An input color signal value that does not exist on the correction table (also called LUT) shown in FIG. 5 may be calculated by interpolating with nearby input color signal values stored in the LUT. Also, converted input color signal values corresponding to the input color signal values of all colors may be stored in the LUT without using the interpolation processing. Alternatively, the correction processing of the input color signal is not limited to conversion using the correction table 407, and may be performed, for example, by function conversion and matrix conversion.
[0046] Returning to FIG. 4, the HT processing unit 403 performs HT processing on the color signal image data after the color correction processing to convert it into a number of gradations that can be expressed by the image forming unit 107, and generates halftone image data. Specifically, the HT processing unit 403 converts 8-bit image data per pixel into 1-bit binary halftone image data having a value of either 0 or 1 for each pixel. The HT processing may be performed by, for example, a known method such as error diffusion processing and dither processing. The estimated parameter setting unit 404 acquires the spectral reflectance ρx(x,y,λ) corresponding to each pixel position (x,y) from the image acquisition unit 108, and calculates the spectral reflectances ρc(kc,λ), ρm(km,λ) and ρy(ky,λ) of each ink color. Furthermore, the image acquisition unit 108 determines the estimated order of each ink color and the estimated wavelength for estimating each ink color in order to calculate the halftone dot ratio of each ink color based on the calculated spectral reflectance of each ink. Details of the processing by the estimated parameter setting unit 404 will be described later.
[0047] The primary color estimation processing unit 405 acquires the spectral reflectance ρx(x,y,λ) corresponding to each pixel position (x,y) from the image acquisition unit 108, and estimates the reflectances ρc, ρm, and ρy of each ink at each pixel position. Details of the estimation process performed by the primary color estimation processing unit 405 will be described later. The correction table creation unit 406 creates a correction table 407 based on the reflectance of each ink at each pixel position (x,y) estimated by the primary color estimation unit and the corrected color signal value. Details of the correction table creation process will be described later.
[0048] In the image forming system 10 of this embodiment, various settings are performed before the user prints an image. Specifically, the primary color estimation processing unit 405 sets parameters required for the estimation process, the target characteristics of each ink color when creating a correction table, and creates the correction table 407. FIG. 7 shows a flow of presetting in this embodiment. Each step of the presetting flow will be described below with reference to FIG. 7. First, in S701, the image processing unit 106 outputs and reads a characteristic acquisition chart 800 for calculating setting parameters. Specifically, the image processing unit 106 performs HT processing on the characteristic acquisition chart 800 shown in FIG. 8, and the image forming unit 107 forms the chart as an image on a recording medium. Furthermore, the image acquisition unit 108 reads the formed image and obtains the spectral reflectance ρx(x,y,λ) corresponding to each pixel position (x,y). The characteristic acquisition chart 800 shown in FIG. 8 is configured to include a block 801, a block 802, a block 803, and a block 804 on a two-dimensional paper surface. Each of the print heads 201 to 204 forms a block 801 to a block 804 on the paper surface. The block 801 is configured to include a pattern 805 to a pattern 810. The blocks 802 to 804 include a similar configuration to the block 801 and have the patterns 805 to 810, respectively.
[0049] For example, a block 801 is formed by only the print head 201 filled with K ink discharging K ink onto the paper surface. A block 802 is formed by only the print head 202 filled with C ink discharging C ink onto the paper surface. A block 803 is formed by only the print head 203 filled with M ink discharging M ink onto the paper surface. A block 804 is formed by only the print head 204 filled with Y ink discharging Y ink onto the paper surface. Incidentally, in FIG. 8, a pattern 805 and a pattern 810, which are displayed as multiple vertical dotted lines in a band shape, indicate a non-ejecting nozzle detection pattern. A non-ejecting nozzle refers to a nozzle in a print head that is clogged with ink due to leaving the print head for a long time, etc., and is in a state where it is unable to eject ink. In this embodiment, a line-shaped pattern is used to determine the presence or absence of ink ejection for each nozzle in the print head. Also, patterns 806 to 809 are uniform patterns in which K ink is printed on the paper surface with different K ink color signal values. The color signal values are, for example, 0, 64, 128, and 255, which correspond to dot ratios of 0%, 25%, 50%, and 100%, respectively. For example, pattern 806 is recorded with a color signal value of 0, and pattern 807 is recorded with a color signal value of 64. Furthermore, pattern 808 is recorded with a color signal value of 128, and pattern 809 is recorded with a color signal value of 255.
[0050] Returning to FIG. 7, in S702, the ink characteristic acquisition unit 4041 extracts an image area corresponding to one of the patterns 806 to 809 from the spectral reflectance ρx(x,y,λ) of the formed image, and averages it in the paper transport direction 207 to make it one-dimensional. The extraction of each image area is performed based on the pixel position (x,y). Alternatively, it is possible to extract the image area based on the x position of the line pattern output by the same nozzle in the non-discharge detection pattern shown in the pattern 805 and the pattern 810 in FIG. 8. Alternatively, in this embodiment, a marker for facilitating the extraction of the image area may be embedded on the paper surface. The obtained one-dimensional image data is averaged in the image area corresponding to each head module. As a result, the spectral reflectance characteristics ρc(kc,λ), ρm(km,λ), ρy(ky,λ), and ρk(kk,λ) of each ink shown in the curves 301 to 312 in FIG. 3, respectively, are obtained for each head module.
[0051] The obtained spectral reflectance of each ink color is stored in the primary color estimation processing unit 405 as the ink characteristic 4052, and is used in the primary color estimation processing described later. If a non-discharging nozzle occurs when the characteristic acquisition chart 800 is output, the spectral reflectance characteristic of each ink may contain an error due to blanking. The primary color of the formed image is estimated based on the spectral reflectance including the error due to blanking, and color correction processing is performed, which may cause density unevenness and color shift, for example. Therefore, before acquiring the spectral reflectance characteristic of each ink color, a non-discharging detection processing is performed based on the patterns 805 and 810 for detecting non-discharging nozzles. Specifically, the spectral reflectance of the image area corresponding to the patterns 805 and 810 for detecting non-discharging nozzles in the scanned image is referenced, and the nozzle corresponding to the position where the reflectance is equal to or greater than the threshold value is determined to be a non-discharging nozzle. When a non-discharging nozzle is detected, the spectral reflectance of the image area corresponding to the non-discharging nozzle is deleted, and then the spectral reflectance from which the error is eliminated is obtained by performing an interpolation processing using the spectral reflectance around the image area. Alternatively, after performing recovery operations such as sucking up and wiping off the ink adhering to the non-ejecting nozzles, the characteristics acquisition chart 800 may be output again. In this way, this embodiment can prevent inaccurate acquisition of spectral reflectance due to the influence of non-ejecting nozzles.
[0052] Next, in S703, the processing order setting unit 4042 determines the order in which the primary color estimation processing unit estimates the spectral reflectance. Specifically, when the spectral reflectance of each ink is divided into a certain wavelength range, the processing order setting unit 4042 increases the processing order of inks that have many wavelength ranges in which the reflectance of each ink is smaller than about 1.0 in the divided wavelength range. In other words, if there is a wavelength range in which the reflectance of each ink is smaller than about 1.0, each ink is determined to have sensitivity in that wavelength range. FIG. 9 is a diagram showing the reflectance sensitivity distribution for each wavelength range of CMY inks. The determination of the estimated processing order of CMY inks will be specifically described with reference to FIG. 9. FIG. 9 shows information in which the reflectance sensitivity of each ink in each wavelength range is classified into three levels (◯, △, ×) based on the spectral reflectance of the CMY inks shown in FIG. 3(a) to FIG. 3(c). The unit of each wavelength range is nm.
[0053] In FIG. 9, the inks are classified as ◯ if the average reflectance in the wavelength range is 0.9 or more, △ if the average reflectance is 0.8 or more, and × if the average reflectance is less than 0.8. Here, the order of the estimation process for each ink is determined so that the ink having a large number of wavelength ranges to which it is sensitive (i.e., the number of ×s is large) is processed preferentially. In the example shown in FIG. 9, the C ink has 5 ×s, the M ink has 4 ×s, and the Y ink has 2 ×s, so the estimation process is performed in the order of C, M, and Y. Note that, when there are multiple inks with the same number of ×s, which is an index for determining the order of the estimation process, the ink with the largest number of △s among the multiple inks may be set as the order of processing preferentially. The estimation order for each color obtained based on the determination result of the sensitivity distribution is stored as a processing order 4053 in the primary color estimation processing unit 405, and is used in the primary color estimation process described later.
[0054] Returning to FIG. 7, the flow of the presetting will be described. In S704, the wavelength selection unit 4043 determines an estimated wavelength for estimating the reflectance of each ink in the primary color estimation process. At this time, the wavelength is determined according to the estimation process order of each ink color determined above. Specifically, based on the classification shown in FIG. 9, if there is a circle in the wavelength range of all inks processed later than the target ink, and there is a wavelength range that is not selected for all inks processed earlier than the target ink, the wavelength with the lowest reflectance may be selected. For example, when determining the wavelength for C ink based on FIG. 3(a) and FIG. 9, the wavelength ranges in which both M ink and Y ink are circled are 630-680 nm and 680-730 nm. The wavelength with the lowest reflectance of C ink within this range may be selected. In other words, a wavelength λ=700 nm may be selected as the wavelength for C ink.
[0055] Next, the selection of the estimated wavelength for M ink will be described. In FIG. 9, the wavelength ranges for Y ink with ◯ are 530-580 nm, 580-630 nm, 630-680 nm, and 680-730 nm. Here, the wavelength for M ink may be selected from the wavelength with the lowest reflectance in the range of 530-680 nm, excluding 680-730 nm, which is the wavelength range including the wavelength selected for C ink. As a result, the wavelength for M ink is selected as, for example, λ=560 nm. Finally, the wavelength for Y ink is determined. That is, the wavelength with the lowest reflectance may be selected, excluding 680-730 nm and 530-580 nm, which include the wavelengths selected for C ink and M ink, respectively. Therefore, the wavelength for Y ink is selected as, for example, 450 nm. The wavelengths obtained for each ink are stored as selected wavelengths 4054 in the primary color estimation processing unit 405, and are used in the primary color estimation processing described later.
[0056] 7, in S705, the target setting unit 408 determines the target characteristics 409 for each ink based on the above-mentioned ink characteristics, processing order, and selected wavelength. For example, the target ink characteristics may be determined so that the color signal value and reflectance of each ink color are linear. Alternatively, either the head module or the nozzle may be used as the reference, and the ink characteristics of the head module or the nozzle may be set as the target characteristics.
[0057] FIG. 10 is a diagram showing the reflectance of ink held by a head module. In the following description, an example will be described in which the target characteristics of C ink are determined based on the ink characteristics of the head modules 201a, 201b, and 201c when performing color correction processing in units of head modules. Curves 1001a to 1001c in FIG. 10(a) show the reflectance ρ corresponding to each of the head modules 201a to 201c. The vertical axis of FIG. 10(a) shows the reflectance, and the horizontal axis shows the color signal value. For example, when the wavelength selection unit 4043 determines that the wavelength λc for C ink is 700 nm, the reflectance ρ can be calculated by using a known interpolation method for the dot ratio kc and the spectral reflectance ρc(kc,700) at each color signal value.
[0058] At this time, in order to determine the target characteristic of C ink in which the color signal value and the reflectance are linear, the reflectance ρ_min of the head module with the largest reflectance for the maximum color signal 255 is acquired. In the example shown in FIG. 10, the reflectance of the curve 1001a for the color signal 255 is set to ρ_min (shown by point 1002). A straight line 1003 (shown by a dashed line) obtained by connecting the two points of the reflectance 1.0 for the color signal value 0 and the reflectance ρ_min for the maximum color signal 255 may be set to the target characteristic 409. Alternatively, in the head module configuration shown in FIG. 2(b), the curve 1001b corresponding to the head module 201b located at the center among the multiple head modules may be set to the target characteristic 409. Alternatively, the average reflectance of all the head modules or some of the head modules may be set to the target characteristic.
[0059] For example, the target characteristic 409 may be a curve (not shown) obtained by averaging the curves 1001a to 1001c by the color signal values of each color. Also, the target characteristic 409 may be determined based on a value other than the reflectance characteristic. For example, the target characteristic 409 may be determined so that the distance D from the recording medium color (paper white) in the CIELab space and the color signal value are linear. The CIELab space is one of the uniform color spaces defined by the CIE (International Commission on Illumination), and refers to a color space using three-dimensional orthogonal coordinates. The distance D from the paper white can be calculated by the following equation 7. The equation 7 represents the lightness difference and the two chromaticity differences of two colors on the Lab space coordinates. In the equation 7, Lw, La, and Lb are the Lab values (color values) of the recording medium color. L and Lw represent the lightness of the color, a and aw represent the saturation of the color from green to red, and b and bw represent the saturation of the color from blue to yellow.
[0060]
number
[0061] Specifically, as shown in FIG. 10B, as a straight line 1004 (shown as a dashed line), the target characteristic 409 can be determined so that the straight line 1004 passes through the origin and has a maximum distance D_Max at the maximum color signal of 255. The maximum distance D_max is the distance D calculated from the reflectance ρ_min. In this case, in order to calculate the reflectance ρ_x for the input color signal value In_x, the distance D_x from the paper white for the input color signal value In_x is obtained as shown in FIG. 10B. Furthermore, as shown in FIG. 10C, the reflectance ρ_x corresponding to the obtained distance D_x can be obtained from a curve 1005 that associates the distance D with the reflectance ρ. The curve 1005 can be calculated by using a known interpolation method for the Lab value calculated from the spectral reflectance ρc(kc, λ) of C ink according to the CIELab number 7 and the halftone dot ratio at each color signal value. By setting the curve (not shown) of reflectance ρ_x versus input color signal value In_x obtained in this manner as the target characteristic 409, the target characteristic 409 of the ink can be determined so that the distance D from the paper white and the color signal value are linear.
[0062] Returning to FIG. 7, in S706, the correction table creation unit 406 creates the correction table 407 based on the ink characteristics 4052, the selected wavelength 4054, and the target characteristics 409. The process of creating the correction table 407 will be described with reference to FIG. 6. A curve 601 in FIG. 6 is a curve showing the ink characteristics of either the head module or the print head that performs the color correction process. Also, a dashed line 602 is the target characteristic 409 that is the target of the color correction process. First, the target reflectance ρ_t corresponding to the input color signal value In is calculated using the dashed line 602. Next, the color signal value corresponding to the target reflectance ρ_t on the curve 601 is obtained as the correction value out. The correction table creation unit 406 can create the correction table 407 by associating the correction value out obtained above with the input color signal value In and storing them in the storage unit 105. The correction table creation unit 406 may hold, as a table for nozzles to be corrected, a correction table 407 in which correction values out are calculated for all input color signal values In from 0 to 255. Alternatively, the correction table creation unit 406 may create a correction table 407 in which only correction values out corresponding to, for example, 0, 16, 32, . . . , 240, and 255 as the predetermined input color signal shown in FIG.
[0063] Although FIG. 6 shows the ink characteristics of one of the head modules or the recording head, the curves of the ink characteristics are obtained in the number equal to the number of the head modules or the nozzles. By repeating the process of creating the correction table 407 for all of those ink characteristics, the correction value out corresponding to each head module or each nozzle can be calculated. In addition, before the user prints an image, the correction table 407 is created in which the input color signal value In of each color calculated in advance by the characteristic acquisition chart 800 shown in FIG. 8 is associated with the correction value out. As a result, this embodiment can reduce the possibility of falling into a local optimum solution when correcting the user's read image, which will be described later. This embodiment can also suppress the color correction being performed significantly immediately after the start of printing the image and the color density becoming unintended every time printing is performed.
[0064] Hereinafter, a printing flow of an image printed by a user will be described with reference to FIG. 11. First, in S1101, the user inputs an operation on the operation unit 103 to cause the image forming system 10 to execute a print job. Specifically, the user specifies the input image file name stored in the storage unit 105 and the number of output sheets N. In S1102, the image forming unit 107 outputs (prints) the image, and the image acquisition unit 108 reads the printed image. Specifically, the image processing unit 106 acquires an image stored in advance in the storage unit 105 based on the file name specified by the user. The image acquired by the image processing unit 106 is sent to the color conversion processing unit 401, where it is subjected to color conversion processing. After the color conversion processing, the color-converted image is sent to the HT processing unit 403 via the correction processing unit 402. The correction processing unit 402 performs gradation conversion of each ink color to suppress uneven density of the image using a correction table 407 that differs for each head module or each nozzle. The HT processing unit 403 converts the color signal image data after the color tone conversion into a number of tones that can be expressed by the image forming unit 107, and generates halftone image data. The image forming unit 107 forms the image data after the halftone processing on a paper surface. The image formed by the image forming unit 107 is called a formed image 400. The image acquisition unit 108 acquires the spectral reflectance ρx(x, y, λ) by reading the formed image 400.
[0065] In addition, when the resolution of the formed image 400 acquired by the image acquisition unit 108 is different from the resolution of the input image, the image processing unit 106 may convert the resolution of the acquired formed image 400 to match the resolution of both. The resolution conversion may be performed, for example, by a nearest neighbor method, bilinear interpolation, bicubic interpolation, or the like. In addition, the image processing unit 106 may perform geometric correction on the acquired formed image 400, for example, when the paper is skewed when the image is formed and when the aberration of the spectroscopic sensor is large. The geometric correction may be performed, for example, by affine transformation and projective transformation. When the image processing unit 106 performs resolution conversion and geometric correction on the acquired formed image 400, the image processing unit 106 may be provided with a resolution conversion processing unit (not shown) and a geometric correction processing unit (not shown) in advance. Alternatively, the image acquisition unit 108 may calculate the spectral reflectance ρx by performing resolution conversion and geometric correction of the image in units of a predetermined number of lines when acquiring a raster image. At this time, markers that facilitate resolution conversion and geometric correction of the acquired formed image 400 may be included in the characteristic acquisition chart 800 in advance.
[0066] In S1103, the primary color estimation unit 4051 estimates the reflectance of each ink based on the spectral reflectance ρx(x,y,λ) at each pixel position. In S1104, the correction table creation unit 406 corrects the correction table 407 based on the input color signal value of each ink after the correction process and the reflectance of each ink estimated by the primary color estimation unit 4051. The correction process of the correction table 407 will be described in detail later. Next, in S1105, the CPU 100 determines whether the user has finished outputting all jobs input to the image forming system 10. If all jobs have been completed, the CPU 100 ends the printing process of the image by the user (Yes in S1105). On the other hand, if the jobs have not been completed, the process returns to S1102 and printing continues (No in S1105).
[0067] The primary color estimation process in S1103 will be specifically described with reference to FIG. 12. In S1201, the primary color estimation unit 4051 determines the pixel position (xi, yi) of the image. For example, the primary color estimation unit 4051 acquires the spectral reflectance ρx(xi, yi, λ) at the position where the coordinate xi=0 and the coordinate yi=0. Incidentally, the spectral reflectance ρx represents the reflectance of the image area where all the inks are mixed. Next, in S1202, the primary color estimation unit 4051 refers to the processing order 4053 and selects the estimated color of the ink at the pixel position (xi, yi). For example, if the order of the estimated colors of the inks stored in the processing order 4053 is C, M, Y, the primary color estimation unit 4051 selects C as the estimated color. In S1203, the primary color estimation unit 4051 acquires the wavelength corresponding to the estimated color (for example, C ink) from the selected wavelength 4054. For example, if the estimated color is C, the primary color estimation unit 4051 acquires a wavelength λ=700 nm corresponding to C. In S1204, the primary color estimation unit 4051 estimates the reflectance of the estimated color based on the acquired estimated color and its corresponding wavelength. In other words, the primary color estimation unit 4051 can estimate the spectral reflectance ρx(xi, yi, 700) as the reflectance of C ink at pixel position (xi, yi).
[0068] In S1205, the primary color estimation unit 4051 determines whether or not the estimation process of the reflectance of all ink colors determined in the processing order 4053 has been completed. If the estimation process has not been completed, the process proceeds to S1206 (No in S1205). On the other hand, if all the estimation processes have been completed, the process proceeds to S1207 (Yes in S1205). In S1206, the primary color estimation unit 4051 removes the influence of the C ink estimated in S1204 (e.g., spectral reflectance) from the spectral reflectance ρx(xi, yi, λ). Specifically, the primary color estimation unit 4051 acquires the ink characteristics of the estimated color by referring to the ink characteristics 4052. The ink characteristics acquired are, for example, the spectral reflectance ρc(kc, λ). Furthermore, the primary color estimation unit 4051 calculates the dot ratio kc of the C ink such that ρx(xi, yi, 700)=ρc(kc, 700). The primary color estimation unit 4051 obtains a new spectral reflectance ρx'=ρx(xi, yi, λ) / ρc(kc, λ) by eliminating the influence of the spectral reflectance of C ink. In the subsequent processing, the newly obtained spectral reflectance ρx' is used in the estimation processing, and the processing returns to S1202. Next, in S1202, the primary color estimation unit 4051 selects M ink, and the processing proceeds to S1203.
[0069] In S1207, the primary color estimation unit 4051 determines whether or not the reflectance of each selected ink color at all image positions (xi, yi) has been estimated. If the estimation of reflectance has been completed, the process ends (Yes in S1207). If the estimation of reflectance has not been completed, the process returns to S1201, and the primary color estimation unit 4051 selects a new pixel position (xi, yi) where the estimation of reflectance has not been processed. Note that in this embodiment, the pixel position is used as the processing unit to estimate the reflectance of the primary color of the entire image, but the estimation process may be performed only at a representative pixel position corresponding to the correction unit of each ink color (for example, a head module and a nozzle). Alternatively, the reflectance of each ink color may be estimated in block units obtained by averaging pixel block units including two or more pixels.
[0070] The correction process of the correction table 407 in S1104 will be specifically described with reference to Fig. 13. Fig. 13(a) is a diagram plotting the relationship between the reflectance at each pixel position (x, y) estimated in S1103 and the correction value out of the color signal obtained by the correction processing unit 402. Note that the horizontal axis of Fig. 13(a) is the color signal value of any of the CMY inks, and the vertical axis is the estimated reflectance ρc, ρm, or ρy of each ink. A curve 1301 in Fig. 13(a) is a curve indicating the ink characteristics of a head module or nozzle, calculated based on each point on which the relationship between the spectral reflectance and the color signal value is plotted.
[0071] The curve 1301 is obtained by, for example, interpolating each point with a polynomial function obtained by the least squares method. Alternatively, as shown in FIG. 13(b), an interpolation operation may be performed on the reflectance obtained by averaging each point of the color signal value in an interval in which the color signal value is divided at a predetermined interval, and the representative value of the corresponding color signal value. The curve 1302 in FIG. 13(c) is a curve approximating continuous values obtained by interpolating each point in FIG. 13(b). Note that, for example, piecewise linear interpolation and spline curves may be used for the interpolation of continuous values. After the ink characteristics of all the head modules or nozzles are acquired, the correction table 407 is created in the same manner as in the correction table creation process in S706 and FIG. 6. In this embodiment, the newly obtained correction table can be used as the correction table 407 after correction.
[0072] The characteristic acquisition chart 800 is not limited to the chart shown in FIG. 8, and may have, for example, nine uniform patterns corresponding to values (0, 32, 64..., 224, 255) obtained by equally dividing the color signal value range (0 to 255). The pattern for detecting non-discharge nozzles is not limited to the line chart shown in pattern 805 and pattern 810 in FIG. 8, and may be a known non-discharge nozzle detection pattern. Alternatively, the detection criterion for detecting non-discharge nozzles may be a case in which the difference between the average color signal value obtained by scanning the gradation pattern of each color and the color signal value measured at the pixel position exceeds a threshold value. Alternatively, non-discharge nozzles may be detected by visually checking the gradation pattern of each color.
[0073] 8, patterns of each ink color corresponding to recording head 201 to recording head 204 are formed on a single recording medium, but a configuration in which each recording head records on a different recording medium is also possible. That is, instead of recording blocks 801 to 804 on a single sheet of recording paper, each block may be recorded on a different recording paper. The advantage of the method of forming patterns of each ink color on the same recording paper is that it is possible to reduce errors due to recording paper lots and paper transport deviations caused by transport roller 205. For this reason, it is preferable to record all patterns of each ink color on the same recording paper as much as possible.
[0074] In this embodiment, the ink characteristics, the ink color estimated processing order, the estimated wavelength, the target ink color characteristics, and the ink color correction table are acquired based on the characteristic acquisition chart 800, but a different characteristic acquisition chart 800 may be used depending on the acquisition items. For example, the acquisition of ink characteristics and the creation of the correction table may be performed using a characteristic acquisition chart 800 having a different number of uniform color patterns related to the ink. Alternatively, the characteristic acquisition chart 800 may be formed using only a single head module in order to eliminate the influence of overlapping portions between head modules of the same print head. Alternatively, the characteristic acquisition chart 800 may be one in which no boundaries are provided between the head modules.
[0075] In this embodiment, a filter process may be performed on the two-dimensional plane of x and y for the spectral reflectance ρx(x, y, λ) of the formed image 400 acquired by the image acquisition unit 108. In this embodiment, when correcting each ink color on a nozzle-by-nozzle basis, if a filter process corresponding to a visual transfer function (VTF) representing human visual characteristics is performed on the formed image 400, it is possible to prioritize correction of banded unevenness in a frequency band that is easily visible to the user. In addition, in this embodiment, a plurality of processing orders 4053 and selected wavelengths 4054 may be provided in the estimation parameter setting unit 404 based on the difference in the spectral reflectance characteristics in each wavelength range of each ink color. In this embodiment, by preparing a plurality of estimation processing orders for estimating each ink color and the corresponding estimated wavelengths in advance, it is possible to continue the estimation process even if the reflectance of both the K ink and the C ink is not approximately 1.0, for example. According to this embodiment, even if there is no difference in the spectral reflectance characteristics in the wavelength range between each ink, the reflectance of each ink color can be calculated with high accuracy.
[0076] FIG. 14 shows, for example, the ink characteristics of CMYK colors acquired in S702. The vertical axis of FIG. 14 shows CMYK, which are the ink colors, and the horizontal axis shows the wavelength range intervals, with the wavelength range unit being nm. In FIG. 14, ◯ indicates that there is sensitivity to the reflectance of the ink in the wavelength range, and × indicates that there is no sensitivity to the reflectance of the ink in the wavelength range. For example, the wavelength range of 430-480 nm for C ink is ◯, which indicates that the reflectance of C ink has sensitivity in that wavelength range. On the other hand, the wavelength range of 380-430 nm for C ink is ×, which indicates that there is no sensitivity to the reflectance of C ink in that wavelength range. In FIG. 14, the primary color estimation unit 4051 can estimate the reflectance of each ink in the following three processing orders based on the classification of the reflectance sensitivity in each wavelength range of each ink. For example, the first processing order is the order of K ink (corresponding to a wavelength of 500 nm), Y ink (corresponding to a wavelength of 450 nm), and C ink (corresponding to a wavelength of 700 nm). The second processing order is the order of K ink (wavelength 700 nm), M ink (corresponding to wavelength 550 nm), and Y ink (corresponding to wavelength 400 nm). The third processing order is the order of C ink (corresponding to wavelength 700 nm), M ink (wavelength 550 nm), and Y ink (corresponding to wavelength 400 nm). Note that the wavelengths described in combination with each of the above inks indicate estimated wavelengths for uniquely estimating each ink. The primary color estimation unit 4051 can change the estimation processing order of each ink color and the corresponding estimated wavelengths according to the mixed color contained in the formed image 400 and the reflectance of each ink contained therein. As a result, according to this embodiment, the reflectance for many combinations of ink colors can be estimated.
[0077] The estimation of the reflectance of each ink was performed by selecting an estimated wavelength for identifying each ink color after determining the estimated processing order of each ink color. However, the selection of the estimation processing of each ink color and the corresponding estimated wavelength may be determined simultaneously. For example, all combinations of the estimated processing order of each ink and the corresponding estimated wavelength may be determined based on the product of each reflectance at the estimated wavelength of each ink other than the ink to be finally selected. It is preferable to adopt a combination of the wavelength with the largest product of each reflectance at the estimated wavelength of each ink and the estimated processing order of each color corresponding thereto. In this way, if the estimated processing order of each ink and the corresponding estimated wavelength are obtained simultaneously, it takes time to determine the reflectance of each ink, but the reflectance of each ink can be calculated with higher accuracy. Note that the target setting unit 408 and the target characteristic 409 are not essential components when the target setting of the ink characteristics is based on a specific nozzle and module alone or an average value of the nozzle and head module. For example, the reflectance of each module as shown in the curve 1301 of FIG. 13(a) calculated by the correction table creation unit 406 in S1103 may be set as the target characteristic. In this embodiment, the spectral reflectance is used as an index for evaluating the ink characteristics, but for example, the spectral density may also be used.
[0078] As described above, according to the first embodiment, it is possible to determine a first wavelength region in which the plurality of first spectral reflections are lower than the plurality of second spectral reflections, and a second wavelength region in which the plurality of first spectral reflections are higher than the plurality of second spectral reflections. According to the first embodiment, it is possible to estimate a first halftone dot associated with a first spectral reflection selected from the plurality of first spectral reflections according to the degree of agreement of the mixed reflection in the first wavelength region. According to the first embodiment, it is possible to obtain a third spectral reflection by dividing the mixed reflection by the selected first spectral reflection. According to the first embodiment, it is possible to estimate a second halftone dot associated with a second spectral reflection selected from the plurality of second spectral reflections according to the degree of agreement of the third spectral reflection in the second wavelength region. This makes it possible to reduce the estimation time for estimating the recording amount of each color in an image including multiple colors, and improve the accuracy of the color stabilization process.
[0079] Second embodiment In the second embodiment, the difference from the first embodiment will be described below. In the first embodiment, the estimation order and the corresponding estimated wavelengths that can be calculated exclusively for each ink are determined in advance based on the difference in the spectral reflectance characteristics that differ for each wavelength range for each ink. As a result, the first embodiment can calculate the reflectance of each ink in a mixed region where a plurality of ink colors are mixed faster than conventional methods. However, there are cases where inks that do not have a wavelength range that can uniquely determine the spectral reflectance of each ink included in the mixed region are used in combination. For example, there is a case where one ink color has some sensitivity to a wavelength range in which the other ink color has sensitivity (reflectance is not 1.0) among two ink colors. In this case, the influence of the spectral reflectance of the other ink color cannot be eliminated, so the spectral reflectance of one ink color cannot be uniquely determined.
[0080] FIG. 15 is a diagram for explaining the process of estimating a primary color in this embodiment. FIG. 15(a) shows the spectral reflectance of C ink with respect to the wavelength. FIG. 15(b) shows the spectral reflectance of M ink with respect to the wavelength. FIG. 15(e) shows the spectral reflectance of mixed ink with respect to the wavelength. Returning to the above description, the spectral reflectances of C ink and M ink shown in FIG. 15(a) and FIG. 15(b) respectively do not have a wavelength range in which the spectral reflectance of both inks is about 1.0. In addition, in order to estimate the reflectances of C ink and M ink, there is a method of estimating the reflectance of each ink by approximating the spectral reflectance of either the wavelength range of C ink or M ink to 1.0. However, the estimation of the reflectance of each ink using this method includes an error due to approximation, and may cause unnecessary unevenness in density.
[0081] On the other hand, if the reflectance of each ink is estimated without using the approximation of the reflectance, it is necessary to estimate the reflectance of each ink simultaneously while taking into consideration the spectral reflectance of each ink, and this takes time for calculation. Therefore, in this embodiment, the spectral reflectance of each ink that has already been acquired is converted into a virtual ink (or virtual ink) that exhibits reflectance only in a predetermined wavelength range. Details of the virtual ink will be described later. FIG. 15(c) shows the spectral reflectance of the virtual C ink with respect to the wavelength. FIG. 15(d) shows the spectral reflectance of the virtual M ink with respect to the wavelength. FIG. 15(f) shows the spectral reflectance of the virtual mixed ink with respect to the wavelength. In FIG. 15(c), the virtual C ink has sensitivity only in a predetermined wavelength range of, for example, 600 nm or more (reflectance is about 1.0). Similarly, in FIG. 15(d), the virtual ink M has sensitivity only in a wavelength range of 500-600 nm, which is different from the virtual C ink (reflectance is about 1.0). The methods of acquiring the virtual mixed ink, virtual C ink, and virtual M ink will be described below.
[0082] First, the spectral reflectance of the C ink is converted to that of the virtual C ink, and a matrix is calculated to simultaneously convert the spectral reflectance of the M ink to that of the virtual M ink. In this embodiment, the reflectance of each ink in the mixed region is calculated at high speed by using the obtained conversion matrix. FIG. 15(e) shows, for example, the spectral reflectance of a mixed region including C ink and M ink. Here, by converting the spectral reflectance of the mixed region with the above conversion matrix, the spectral reflectance shown in FIG. 15(f) is obtained. FIG. 15(f) shows a mixed virtual spectral reflectance in which the spectral reflectances of the virtual C ink and the virtual M ink are mixed. Therefore, in FIG. 15(d) and FIG. 15(d), for example, the reflectances at wavelengths of 550 nm and 650 nm are focused on. As in the first embodiment, the reflectances of the virtual C ink and the virtual M ink can be uniquely calculated by a monotonically decreasing relationship in which the reflectance of the C or M ink decreases as the dot ratio of the C or M ink increases.
[0083] The dot ratio of each ink in the mixed region can be corrected at high speed based on the obtained virtual C ink and virtual M ink. Note that in the following explanation, an example will be explained in which correction is made based on the spectral density rather than the spectral reflectance. Since the spectral density has a higher linearity with respect to the dot ratio of each ink than the spectral reflectance, it is possible to reduce errors in the calculation of the matrix described below.
[0084] FIG. 16 shows a functional block of the image processing unit 106 in the second embodiment. Hereinafter, the functional configuration of the image processing unit 106 that executes the estimation process using virtual ink will be described with reference to FIG. 16. Note that the same components as those in the first embodiment are given the same reference numerals, and the description will be omitted. In FIG. 16, the image processing unit 106 includes a color conversion processing unit 401, a correction processing unit 402, an HT processing unit 403, and an estimated parameter setting unit 404. The image processing unit 106 also includes a primary color estimation processing unit 405, a correction table creation unit 406, a correction table 407, a target setting unit 408, and a target characteristic 409. Furthermore, the estimated parameter setting unit 404 is configured to include a color conversion matrix calculation unit 4044, a primary color characteristic calculation unit 4045, and a primary color characteristic 4046. Furthermore, the primary color estimation processing unit 405 is configured to include a primary color estimation unit 4051, a color exclusion processing unit 4055, and a color conversion matrix 4056.
[0085] In the image forming system 10 of this embodiment, various settings are performed before the user prints an image. The various settings specifically include parameter settings required for the estimation process in the primary color estimation processing unit 405, setting of target characteristics in the correction table creation, and creation of the correction table. FIG. 17 shows a flow of presetting in this embodiment. Each step of the presetting flow will be described below with reference to FIG. 17. First, in S1701, the image processing unit 106 outputs the characteristic acquisition chart 800 and reads the output result in order to calculate the setting parameters. In this embodiment, the characteristic acquisition chart 800 can be used as in the first embodiment. Next, in S1702, the color conversion matrix calculation unit 4044 calculates a color conversion matrix 4056 for converting the spectral density of each ink color into a virtual spectral density. For example, the color conversion matrix 4056 can be calculated as a conversion matrix X that minimizes the error in the following equation 8.
[0086]
number
[0087] Here, d(x, λ) on the right side of equation 8 is the spectral density of ink x at wavelength λ (nm). The spectral density is calculated by converting the spectral reflectance ρ(x, λ) for the maximum color signal of 255 using d=log10(1 / ρ). Note that, as an example of this embodiment, ink x may be any of the CMYK inks. The range of wavelength λ includes the visible light range, for example, wavelengths from 380 to 730 nm, and the wavelength λ is expressed in increments of 10 nm.
[0088] Fig. 18 shows the spectral density for the wavelength of each virtual ink. Fig. 18 shows that if density 1801 is the spectral density d(vc, λ) of virtual C ink, for example, then only the wavelength band corresponding to λ=630 to 680 nm shows 1.0, and the spectral density is 0 in other wavelength ranges. In Fig. 18, density 1802 may be set as the spectral density of virtual M ink, density 1803 may be set as the spectral density of virtual Y ink, and density 1804 may be set as the spectral density of virtual K ink. Returning to the explanation of equation 8, d(vx, λ) on the left side is the virtual spectral density of each ink, and is, for example, the spectral density shown in density 1801 to density 1804.
[0089] The conversion matrix X obtained above is stored in the primary color estimation processing unit 405 as a color conversion matrix 4056, and is used in the primary color estimation processing described below. Returning to the explanation of the flow in FIG. 17, in S1703 the primary color characteristic calculation unit 4045 obtains the spectral density when converted into a virtual CMYK ink corresponding to each CMYK ink. FIG. 19 is a diagram showing the characteristics of the spectral density with respect to the color signal value. Specifically, the relationship between the color signal value of each ink and the virtual ink density d corresponding to that ink is obtained, as shown in a curve 1901 in FIG. 19. The primary color characteristic calculation unit 4045 calculates, for example, the virtual C ink density d_c from 630 to 680 nm of the virtual C ink with respect to the color signal value of C ink.
[0090] In order to obtain the curve 1901, the primary color characteristic calculation unit 4045 performs logarithmic conversion of the spectral reflectance ρ(kc, λ) of C ink obtained based on the uniform patch of the pattern 806 to the pattern 809 in FIG. 8. As a result, the primary color characteristic calculation unit 4045 can obtain the spectral density d(c, λ) for the dot ratio kc of C ink. Furthermore, the primary color characteristic calculation unit 4045 converts the spectral density d(c, λ) by the conversion matrix X, and can obtain the spectral density d(vc, λ) of the virtual C ink for the dot ratio kc of C ink. After that, the primary color characteristic calculation unit 4045 averages the obtained spectral density d(vc, λ) in the wavelength range (630 to 680 nm) to which it is sensitive, thereby obtaining the virtual C ink density d_c. Note that the wavelength range (630 to 680 nm) is used in which the spectral density of the virtual C ink, 1.0, which corresponds to the maximum color signal 255 shown in FIG. 18, is obtained. By interpolating the plot of the obtained hypothetical C ink density d_c and the color signal value used to calculate that density using a known interpolation method, a curve 1901 showing the correspondence between the color signal value and the spectral density shown in Figure 19 is obtained.
[0091] Returning to FIG. 17, in S1704, the target setting unit 408 determines the target characteristic 409 based on the primary color characteristic 4046. For example, as shown by a straight line 1902 in FIG. 19, the target setting unit 408 can determine the target characteristic by linearly interpolating the color signal value and the spectral density. Alternatively, the target setting unit 408 may use the target characteristic of either the module or the nozzle as a reference, and use the primary color characteristic 4046 of the reference module or nozzle as the target characteristic. In S1705, the correction table creation unit 406 creates the correction table 407 based on the primary color characteristic 4057 and the target characteristic 409. The correction table creation unit 406 calculates the target density d_t corresponding to the input color signal value In on the straight line 1902 indicating the target characteristic in FIG. 19. The correction table creation unit 406 acquires the color signal value out corresponding to the target density d_t on the curve 1901 indicating the primary color characteristic as a correction value. In this way, the correction table creation unit 406 can create the correction table 407 by storing information in which the acquired correction values out and the input color signal values In correspond to each other in the storage unit 105 .
[0092] The flow of printing an image by a user follows the flow shown in FIG. 11. FIG. 20 is a flow showing the image printing process of this embodiment. Hereinafter, the primary color estimation in S1103 of FIG. 11 will be specifically described with reference to FIG. 20. First, in S2001, the color exclusion processing unit 4055 determines a pixel position (xi, yi) for estimating a primary color. The color exclusion processing unit 4055 acquires a mixed spectral reflectance ρx(xi, yi, λ) of a pixel position where, for example, xi=0 and yi=0. Next, in S2002, the primary color estimation unit 4051 calculates a mixed spectral density d(λ) by performing a logarithmic transformation on the mixed spectral reflectance ρx(xi, yi, λ). Furthermore, the primary color estimation unit 4051 refers to the color transformation matrix 4056, and converts the mixed spectral density d(λ) with the transformation matrix X to acquire a mixed virtual spectral density d'(λ). The mixed virtual spectral density d'(λ) is also called a mixed virtual density.
[0093] In S2003, the primary color estimation unit 4051 calculates each virtual ink density based on the converted mixed virtual spectral density d'(λ). The primary color estimation unit 4051 can set the average value of the spectral density d'(λ) in the wavelength range of 630 to 680 nm as the virtual C ink density. The primary color estimation unit 4051 can also estimate the average value of the spectral density d'(λ) in the wavelength range of 530 to 580 nm as the density of the virtual M ink. The primary color estimation unit 4051 can estimate the average value of the spectral density d'(λ) in the wavelength range of 430 to 480 nm as the density of the virtual Y ink. The primary color estimation unit 4051 can estimate the average value of the spectral density d'(λ) in the wavelength range of 380 to 430 nm as the density of the virtual K ink. In S1207, the primary color estimation unit 4051 determines whether or not the virtual ink densities of all pixel positions (xi, yi) have been estimated. If all virtual ink densities have been estimated, the primary color estimation process ends (Yes in S2004). If all virtual ink densities have not been estimated, the process returns to S1201, and the color exclusion processor 4055 selects one of the unprocessed pixel positions as a new pixel position (No in S2004).
[0094] The following describes how to update the correction table 407 in S1104. In this embodiment, the correction table 407 is calculated based on each virtual ink density at each pixel position (x, y) estimated in S2003 and the color signal value that is the target of correction processing obtained from the correction processing unit 402. FIG. 19B is a diagram in which the virtual ink density is plotted against the color signal value of the head module or nozzle to be corrected. Note that the horizontal axis of the figure is one of the color signal values CMYK, and the vertical axis is one of the estimated virtual ink densities vc, vm, vy, and vk corresponding to the color signal value. A curve 1903 in FIG. 19B is a curve that indicates the ink characteristics of the head module or nozzle, calculated based on each point at which the virtual ink density corresponding to the color signal value is plotted.
[0095] The curve 1901 is obtained by, for example, interpolating each point with a polynomial function obtained by the least squares method. Alternatively, an interpolation operation may be performed on the spectral density obtained by averaging each point of the color signal value within an interval in which the color signal value is divided at a predetermined interval and the representative value of the corresponding color signal value. A continuous value may be obtained by performing an interpolation operation on the representative value of each interval. After obtaining each spectral density, a correction table 407 is created for all head modules or nozzles, similar to the process shown in S1705 and FIG. 19(a). In this embodiment, the newly obtained correction table can be used as the corrected correction table 407.
[0096] As described above, the spectral density d'(λ) is obtained by converting the mixed spectral density d(λ) obtained from the spectral reflectance ρx(xi, yi, λ) with a conversion matrix. When calculating the ink characteristics of each head module or each nozzle shown in FIG. 19, for example, the average value of the mixed spectral density d(λ) at wavelengths from 630 to 680 nm is used to calculate the spectral density of C ink. At this time, instead of calculating the spectral density d'(λ) with a conversion matrix, a conversion matrix that directly converts into a virtual ink density used to calculate each ink characteristic may be used. In that case, in S1702, the color conversion matrix calculation unit 4044 may calculate a conversion matrix X that satisfies the following equation 9. At this time, Vc, Vm, Vy, and Vk on the left side of equation 9 are virtual ink densities for calculating the ink characteristics. Alternatively, the following equation 10 may be used to calculate the virtual ink density.
[0097]
number
[0098]
number
[0099] Similarly to the first embodiment, Equation 10 can be used to calculate the virtual ink density in a mixed region where K ink is not mixed. Alternatively, at least one of the virtual ink densities Vc, Vm, and Vy may be calculated based on the number and type of mixed colors generated by combining each ink color, and the K ink may be calculated from the calculated virtual ink density. Furthermore, the right-hand sides of Equations 8, 9, and 10 include only a first-order term for the spectral density d(λ) of each ink color, but if the error between the left-hand and right-hand sides of each equation is large, second-order and third-order terms may be further provided for the spectral density d(λ) on the right-hand side. For example, the following Equation 11, which adds a second-order term to the right-hand side of Equation 10, may be used to use a conversion matrix X that minimizes the error between the left-hand and right-hand sides.
[0100]
number
[0101] In this embodiment, the spectral density d(λ) corresponding to the color signal value shown in FIG. 19 is used as the ink characteristic, but instead of the spectral density, an index such as the reflectance, the distance D from the paper white, or the optical density shown in FIG. 10 may be used. In this case, the ink characteristic is calculated using an LUT or a function that defines a relationship between the virtual ink density and either the reflectance, the distance D, or the optical density in advance, with the virtual ink density as a parameter. The virtual ink may be based on Lambert's law in which the thickness or amount of each ink is always proportional to the optical density. In this way, even when a virtual ink is defined and used as a parameter, the ink characteristic can be calculated more quickly. Incidentally, in S1703 and S2003, the real ink and the virtual ink are associated one-to-one, but one virtual ink density may be associated with multiple real ink densities. For example, a conversion table that converts the virtual C ink density per pixel unit into each of the real ink CMY densities is held in advance. The density of each ink converted by the conversion table may be the ink characteristic.
[0102] Specifically, a conversion table that associates a virtual C ink density of 0.1 with a corresponding conversion amount, for example, a C ink dot rate of 10% and an M ink dot rate of 8%, is stored in the storage unit 105. At this time, if the virtual C ink density calculated in S2003 is 0.3, a C ink dot rate of 30% is obtained based on the virtual C ink density ratio (calculated value 0.3 / reference value 0.1) and the conversion amount (a dot rate of 10% for a virtual C ink density of 0.1). If the virtual C ink density is 0.3, a M ink dot rate of 24% is obtained by the same calculation method as above. The calculation of the C ink dot rate based on the virtual C ink density has been described, but further assume that the C ink dot rate calculated based on the virtual M ink density is 5% and the C ink dot rate calculated based on the virtual K ink density is 6%. At this time, the total C ink dot rate is obtained as 41%, which is the sum of 30%, 5%, and 6%. The sum of the dot ratios of each ink thus obtained may be used as an ink characteristic.
[0103] As described above, according to the second embodiment, it is possible to obtain a conversion matrix that eliminates a plurality of second spectral reflections in the first wavelength region and eliminates a plurality of first spectral reflections in the second wavelength region. According to the second embodiment, it is possible to convert a plurality of first spectral reflections in a part of the first wavelength region into a plurality of first virtual spectral reflections. According to the second embodiment, it is possible to convert a plurality of second spectral reflections in a part of the second wavelength region into a plurality of second virtual spectral reflections. According to the second embodiment, it is possible to convert a mixed reflection of a part of the first wavelength region and a part of the second wavelength region into a first mixed virtual reflection and a second mixed virtual reflection, respectively. This makes it possible to shorten the estimation time for estimating the recording amount of each color in an image including a plurality of colors and improve the accuracy of the color stabilization process.
[0104] Third embodiment In the first and second embodiments, the image acquisition unit 108 can acquire the spectral reflectance for each formed image 400. However, the spectral sensor requires a long time to acquire image data compared to a general RGB sensor, for example. As a result, the time to acquire the spectral reflectance is longer than the time to calculate each ink characteristic (for example, halftone dot ratio) from the mixed region, so the time to acquire image data by the spectral sensor is a constraint when setting the color correction interval. In addition, due to cost constraints, the acquisition range of image data by the spectral sensor may be only a part of the paper surface, rather than the entire paper surface width. Therefore, in this embodiment, an example is described in which the image acquisition unit 108 including the spectral sensor and an RGB sensor that covers the entire paper surface width is used. Hereinafter, the third embodiment will be described with respect to differences different from the first and second embodiments.
[0105] In this embodiment, before a user prints an image, a matrix is generated that associates output values (RGB values) read from an image by the RGB sensor with the spectral reflectance at each wavelength acquired by the spectral sensor. In this embodiment, the correction table 407 is corrected based on the RGB values of the read image and the matrix. The presetting may be performed based on the flow shown in FIG. 17. The presetting will be described below with reference to the flow shown in FIG. 17. First, in S1701, the image processing unit 106 outputs and reads the characteristic acquisition chart 800. At this time, this embodiment includes reading the characteristic acquisition chart 800 by the RGB sensor and the spectral sensor, and acquiring the spectral reflectance ρ and each RGB value of each ink. Next, in S1702, the color conversion matrix calculation unit 4044 calculates a color conversion matrix 4056 for converting the RGB values into the spectral reflectance characteristics of each ink.
[0106] Specifically, the estimation process order for each ink color and the estimated wavelength for estimating each ink are determined based on the difference in reflectance that differs for each wavelength range in the spectral reflectance characteristics of each ink. These are determined in accordance with S702 to S704 in Fig. 7. Furthermore, the reflectance ρ_c(kc) of C ink, the reflectance ρ_m(km) of M ink, and the reflectance ρ_y(km) of Y ink are calculated based on the estimation process order for each ink color and the spectral reflectance of each ink obtained using the estimated wavelength of each ink. The matrix Y is calculated so that the error between the reflectance characteristic ρ_x(kx) on the left side of the following equation 12 and the RGB value on the right side is minimized.
[0107]
number
[0108] Note that R(kc) on the right hand side of equation 12 is the output value of the R sensor of the RGB sensor for the dot rate kc of C ink. Note that in this embodiment, a conversion matrix may be obtained that converts R'G'B' obtained by performing conversion using a one-dimensional LUT and logarithmic conversion on the RGB values. Also, in this embodiment, a matrix Y that constitutes the following equation 13 may be used instead of the above equation 12.
[0109]
number
[0110] Note that the left side of Equation 12 and Equation 13 may not be the estimated spectral reflectance characteristic of each ink, but may be the spectral density characteristic obtained by logarithmically converting it. Next, in S1703, the primary color characteristic calculation unit 4045 uses the above matrix Y to obtain the reflectance (ρ_c, ρ_m, ρ_y) of each ink at the wavelength used in the ink color estimation for the color signal value of each ink as the primary color characteristic 4046. The primary color characteristic calculation unit 4045 calculates the primary color characteristic 4046 of each head module or each nozzle. Furthermore, in S1704, the target setting unit 408 determines the target characteristic 409 of each ink based on the primary color characteristic 4046. In S1705, the correction table creation unit 406 creates the correction table 407 based on the primary color characteristic 4057 and the target characteristic 409.
[0111] The printing flow of an image by a user may be performed according to the flow shown in FIG. 11. However, in this embodiment, instead of the spectral reflectance ρx(xi, yi, λ) of each ink, the RGB value corresponding to the pixel position (xi, yi) of the image is acquired. Here, the reflectance (ρ_c, ρ_m, ρ_y) of each ink at the wavelength used in estimating the color of each ink corresponding to the pixel position (xi, yi) is calculated by applying the above-mentioned matrix Y to the acquired RGB value. Thereafter, the correction table creation unit 406 creates a correction table 407 in the same manner as in the step of S1104, and stores this in the storage unit 105.
[0112] In this embodiment, a matrix Y that associates the reflectance of each ink at the wavelength used when estimating each ink color with the corresponding RGB value is calculated. Note that this embodiment may also use a matrix Z that associates the RGB value with the virtual ink density using the following equation 14.
[0113]
number
[0114] The target setting unit 408 sets a common target characteristic 409 for the head module and nozzle, which are the correction units for each ink color. The correction at the time of presetting in S706 and the correction at the time of printing an image by the user in S1705 are performed using the common target characteristic 409. However, a different target characteristic 409 may be set for each head module and each nozzle. Alternatively, different target characteristics 409 may be set for the time of presetting and the time of printing an image by the user. For example, the correction at the time of printing an image by the user in S1705 may be performed based on the ink characteristics of each head module obtained by reading the first image of each print image. Images printed thereafter may be corrected using the above ink characteristics as target characteristics. The correction processing unit 402 corrects the halftone dot ratio of each ink color CMYK included in the input image data. The correction process of tone conversion performed by the HT processing unit 403 based on the threshold matrix of each image data can obtain the same effect as the correction process performed by the correction processing unit 402.
[0115] As described above, according to the third embodiment, it is possible to obtain in advance a plurality of first spectral reflectances, a plurality of second spectral reflectances, and RGB values associated with a plurality of first halftone dots and a plurality of second halftone dots. According to the third embodiment, it is possible to have a conversion matrix that converts RGB values associated with a plurality of first halftone dots and a plurality of second halftone dots into a plurality of first spectral reflectances and a plurality of second spectral reflectances, respectively. According to the third embodiment, it is possible to correct a plurality of first spectral reflectances and a plurality of second spectral reflectances based on the obtained RGB values and conversion matrix. This makes it possible to shorten the estimation time for estimating the recording amount of each color in an image containing a plurality of colors, and improve the accuracy of the color stabilization process.
[0116] (Other Examples) The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions.
[0117] The invention is not limited to the above-described embodiments, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, the following claims are appended to apprise the public of the scope of the invention. [Explanation of symbols]
[0118] 10: image forming system, 100: CPU, 101: RAM, 102: ROM, 103: operation unit, 104: display unit, 105: storage unit
Claims
1. an acquisition means for acquiring a mixed reflection of an area where a first color and a second color are mixed in an image including the first color and the second color, a plurality of first spectral reflections of the first color, a plurality of first halftone dots respectively associated with the plurality of first spectral reflections, a plurality of second spectral reflections of a second color, and a plurality of second halftone dots respectively associated with the plurality of second spectral reflections; a determination unit for determining a first wavelength region in which the plurality of first spectral reflectances are lower than the plurality of second spectral reflectances, and a second wavelength region in which the plurality of first spectral reflectances are higher than the plurality of second spectral reflectances; an estimation means for estimating a first halftone dot associated with a first spectral reflection selected from the plurality of first spectral reflections according to a degree of coincidence of the mixed reflection in the first wavelength region, determining a third spectral reflection by dividing the mixed reflection by the selected first spectral reflection, and estimating a second halftone dot associated with a second spectral reflection selected from the plurality of second spectral reflections according to a degree of coincidence of the third spectral reflection in the second wavelength region; a correction unit that corrects the first halftone dot and the second halftone dot of the first color and the second color, respectively, based on a difference between the first halftone dot and the second halftone dot estimated by the estimation unit and a preset target of the first halftone dot and the second halftone dot, 1. An image processing device comprising:
2. the determining means determines the first wavelength region and the second wavelength region based on whether a difference between the plurality of first spectral reflectances and the plurality of second spectral reflectances exceeds a threshold value.
2. The image processing device according to claim 1 .
3. a conversion means for converting the plurality of first spectral reflections of a part of the first wavelength region into a plurality of first virtual spectral reflections by a conversion matrix that excludes the plurality of second spectral reflections in the first wavelength region and excludes the plurality of first spectral reflections in the second wavelength region, converting the plurality of second spectral reflections of a part of the second wavelength region into a plurality of second virtual spectral reflections, and converting the mixed reflection of the part of the first wavelength region and the part of the second wavelength region into a first mixed virtual reflection and a second mixed virtual reflection, respectively, when the determination means determines that the difference between the plurality of first spectral reflections and the plurality of second spectral reflections does not exceed a threshold value, the estimation means estimates a first halftone dot associated with a first virtual spectral reflection selected from the plurality of first virtual spectral reflections in accordance with a degree of agreement of the first mixed virtual reflection in the first wavelength region, and estimates a second halftone dot associated with a second virtual spectral reflection selected from the plurality of second virtual spectral reflections in accordance with a degree of agreement of the second mixed virtual reflection in the second wavelength region.
3. The image processing device according to claim 2, wherein the image processing device is a digital camera.
4. the converting means converts the mixed reflection, the plurality of first spectral reflections, and the plurality of second spectral reflections into a mixed spectral densities, a plurality of first spectral densities, and a plurality of second spectral densities, respectively; and converting the mixed spectral density, the plurality of first spectral densities, and the plurality of second spectral densities into a mixed virtual density, a plurality of first virtual spectral densities, and a plurality of second virtual spectral densities, respectively.
4. The image processing device according to claim 3, wherein the image processing device further comprises:
5. a storage means for storing a sensitivity distribution in which the sensitivity of each of the plurality of first spectral reflections of the first color and the plurality of second spectral reflections of the second color to each wavelength region is determined based on a threshold value; a setting means for setting an estimation order of the first color and the second color and an estimated wavelength including the first wavelength region for estimating the first color and the second wavelength region for estimating the second color, based on a result of determining the sensitivity for each wavelength region in the sensitivity distribution, 5. The image processing device according to claim 1, wherein the image processing device further comprises: a first input unit;
6. the storage means stores a plurality of first spectral reflectances of a first color, a plurality of first halftone dots associated with the plurality of first spectral reflectances, respectively, a plurality of second spectral reflectances of a second color, and a plurality of second halftone dots associated with the plurality of second spectral reflectances, respectively; 6. The image processing device according to claim 5,
7. the acquiring means acquires in advance the first spectral reflectances, the second spectral reflectances, and RGB values associated with the first halftone dots and the second halftone dots, respectively; the conversion means has a conversion matrix for converting RGB values associated with the first halftone dots and the second halftone dots into the first spectral reflectances and the second spectral reflectances, respectively; the correction means corrects the plurality of first spectral reflections and the plurality of second spectral reflections based on the RGB values acquired by the acquisition means and the conversion matrix.
5. The image processing device according to claim 3, wherein the image processing device further comprises:
8. an image forming means including a head module having either the first color or the second color, a chip module included in the head module, and a nozzle included in the chip module; the correction means corrects the first halftone dots and the second halftone dots of the image forming means, The image processing device according to claim 1 , wherein the image processing device is a computer.
9. Imaging device A plurality of image processing devices according to any one of claims 1 to 8, An image forming system comprising:
10. an acquiring step of acquiring a mixed reflection of an area where a first color and a second color are mixed in an image including the first color and the second color, a plurality of first spectral reflections of the first color, a plurality of first halftone dots respectively associated with the plurality of first spectral reflections, a plurality of second spectral reflections of a second color, and a plurality of second halftone dots respectively associated with the plurality of second spectral reflections; a determining step of determining a first wavelength region in which the plurality of first spectral reflectances are lower than the plurality of second spectral reflectances, and a second wavelength region in which the plurality of first spectral reflectances are higher than the plurality of second spectral reflectances; an estimation step of estimating a first halftone dot associated with a first spectral reflection selected from the plurality of first spectral reflections according to a degree of coincidence of the mixed reflection in the first wavelength region, obtaining a third spectral reflection by dividing the mixed reflection by the selected first spectral reflection, and estimating a second halftone dot associated with a second spectral reflection selected from the plurality of second spectral reflections according to a degree of coincidence of the third spectral reflection in the second wavelength region; a correction step of correcting the first halftone dot and the second halftone dot of the first color and the second color based on differences between the first halftone dot and the second halftone dot estimated in the estimation step and targets of the first halftone dot and the second halftone dot that are preset, 13. An image processing method comprising:
11. A program for causing a computer to function as each of the means of the image processing apparatus according to any one of claims 1 to 8.
Citation Information
Patent Citations
Image processing system, apparatus, and method
JP2004064542A
Method and device for controlling color tone of printer
JP2005262887A
Image forming device
JP2012155309A
