Image processing device, image processing method and program

The image processing device addresses gamut mapping challenges in PDL documents by generating intermediate data and applying region-specific gamut mapping tables, enhancing color reproduction accuracy.

JP2024169177AActive Publication Date: 2024-12-05CANON KK
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2023086426
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-25
Publication Date
2024-12-05
Estimated Expiration
2043-05-25

AI Technical Summary

Technical Problem

Existing image processing systems struggle to perform appropriate gamut mapping on documents described in Page Description Language (PDL) due to inconsistencies in object information acquisition and color distribution, leading to difficulties in determining optimal mapping methods.

Method used

An image processing device that generates intermediate data from PDL data, performs region analysis, and applies gamut mapping tables based on color distribution and object type to ensure accurate color reproduction.

Benefits of technology

Enables effective gamut mapping by selecting appropriate mapping methods for different regions within an image, improving color accuracy and reducing color differences in printed documents.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024169177000001_ABST
    Figure 2024169177000001_ABST
Patent Text Reader

Abstract

To provide a technique for appropriately performing gamut mapping on a manuscript described using PDL.SOLUTION: Intermediate data are generated based on PDL data. First bit map data and second bit map data that are different from the first bit map data are generated based on the intermediate data. A gamut mapping table which associates the second bit map data with a printing color area is obtained on the basis of an analyzed result of the first bit map data. The second bit map data are corrected based on the gamut mapping table. Quantization image data are generated based on the corrected second bit map data.SELECTED DRAWING: Figure 3
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an image processing device, an image processing method, and a program. [Background technology]

[0002] There is a known printer that receives a digital document described in a specific color space, maps each color in the specific color space to a color gamut that can be reproduced by the printer, and outputs the result. There are multiple possible methods for mapping to a color gamut that can be reproduced by the printer (hereinafter, gamut mapping). For example, for multiple gamut mapping methods from the viewpoints of "perceptual" and "absolute colorimetric", the optimal method differs depending on the content information in the document.

[0003] Patent Document 1 discloses a method of acquiring object information in a document from description data in a page description language (hereinafter, PDL), and applying an optimal lookup table (hereinafter, LUT) to the object. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2004-306465 A Summary of the Invention [Problem to be solved by the invention]

[0005] However, in Patent Document 1, the acquisition of object information is realized by deciphering the PDL description. Even if information such as "text", "photo (JPEG embedded)", and "line" can be acquired from the PDL description, this information cannot be linked to the gamut mapping means. The PDL may be described differently depending on the PC application, not on the printer or printer system. For example, whether or not table lines are included in the "line" information depends on the application. Also, the optimal gamut mapping means differs depending not only on the object information but also on the color distribution. When objects are overlaid and drawn, it is difficult to determine the color distribution present in the object from the PDL description.

[0006] Therefore, an object of the present invention is to provide a technique for performing appropriate gamut mapping for an original described in a PDL. [Means for solving the problem]

[0007] In order to achieve the object of the present invention, an image processing device according to one embodiment of the present invention is characterized in that it comprises a first generation means for generating intermediate data based on PDL data, a second generation means for generating first bitmap data and second bitmap data different from the first bitmap data based on the intermediate data, an acquisition means for acquiring a gamut mapping table that corresponds the second bitmap data to a printing color gamut based on an analysis result of the first bitmap data, a correction means for correcting the second bitmap data based on the gamut mapping table, and a quantization means for generating quantized image data based on the corrected second bitmap data. Effect of the Invention

[0008] According to the present invention, it is possible to provide a technique for performing appropriate gamut mapping for an original described in a PDL. [Brief description of the drawings]

[0009] [Figure 1] 1 is a diagram showing the arrangement of a printing unit of a serial type image processing apparatus 100 according to a first embodiment. [Diagram 2] 1 is a schematic diagram of a controller unit of the image processing device 100. [Diagram 3] 4 is a flowchart for explaining the overall processing of the image processing device according to the first embodiment. [Figure 4] 11 is a flowchart for explaining image analysis processing in S303 according to the first embodiment. [Diagram 5] 6 is a flowchart for explaining the area division processing in S401 according to the first embodiment. [Figure 6A] FIG. 11 is a view showing an example of a region analysis result in S402 according to the first embodiment. [Figure 6B] FIG. 11 is a view showing an example of a region analysis result in S402 according to the first embodiment. [Figure 6C] FIG. 11 is a view showing an example of a region analysis result in S402 according to the first embodiment. [Figure 7] 11 is a flowchart for explaining a mapping table creation process in S403 according to the first embodiment. [Figure 8] 10 is a flowchart for describing the correction process of print image data in S305 according to the first embodiment. [Figure 9] 3A to 3C are diagrams for explaining an overview of print image data and analysis image data according to the first embodiment. [Figure 10] FIG. [Figure 11] 10 is a flowchart for explaining the overall processing of an image processing device according to a second embodiment. [Figure 12] 13 is a flowchart for explaining the overall process of an image processing device according to a third embodiment. [Figure 13] 13A to 13C are views for explaining an example of a reduction process of print image data according to the third embodiment. [Figure 14] 13 is a flowchart illustrating a case where a fallback process occurs during a builder process according to the fourth embodiment. [Figure 15] 15A to 15C are diagrams for explaining the contents of intermediate data in each state in the processing of FIG. 14. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, the embodiments will be described in detail with reference to the attached drawings. Note that the following embodiments do not limit the disclosure according to the claims. Although the embodiments describe a plurality of features, not all of these features are essential to the disclosure, and the plurality of features may be combined in any manner. Furthermore, in the attached drawings, the same reference numbers are used for the same or similar configurations, and duplicated descriptions are omitted.

[0011] (First embodiment) FIG. 1 is a diagram showing the configuration of a printing unit of a serial type image processing device 100 according to the first embodiment.

[0012] The print head unit 101 is mounted on a carriage 102 that moves at a constant speed in a main-scanning direction 110, and ejects ink droplets at a frequency corresponding to the constant speed.

[0013] After each print main scan, the print paper 103 is transported a predetermined distance in the sub-scanning direction 111. During transport, the print paper 103 is sandwiched between a roller pair of a feed roller 104 and an auxiliary roller 105, and a roller pair of a transport roller 106 and an auxiliary roller 107. By intermittently repeating such print main scan and transport operations, an image is printed on the print paper 103 in stages.

[0014] In the print head unit 101, black (K), cyan (C), magenta (M), and yellow (Y) recording heads are arranged in parallel in a main scanning direction 110 as shown in Figure 1. In the recording head of each color, multiple recording elements are arranged in a sub-scanning direction 111.

[0015] FIG. 2 is a schematic diagram of the controller unit of the image processing device 100. As shown in FIG.

[0016] The host computer 201 is an information processing device (e.g., a PC) that creates print jobs consisting of PDL (Page Description Language) data and printing condition information required for printing. The printing condition information includes information such as the type and size of printing paper and print quality.

[0017] The controller 202 is a control device that controls the image processing device 100. Next, the internal configuration of the controller 202 will be described.

[0018] The ROM 203 is a readable memory that stores a program for controlling the image processing device 100 .

[0019] The CPU 204 controls the image processing device 100 by executing a program stored in the ROM 203 .

[0020] A host IF control unit 206 communicates with the host computer 201 , receives print jobs and the like, and stores the print jobs and the like in the RAM 205 .

[0021] The RAM 205 is a readable and writable memory used as an area for executing programs and storing data.

[0022] The image processing unit 207 performs quantization processing to generate printable quantized image data from the PDL data in the RAM 205 in accordance with the printing conditions included in the print job, and stores the generated quantized image data in the RAM 205. The configurations of the RAM 205 and the image processing unit 207 will be described later.

[0023] The head IF control unit 208 transmits the quantized image data in the RAM 205 to the head control unit 209 .

[0024] The head control unit 209 outputs print data 210 based on information obtained from the controller 202 (head IF control unit 208 ), and controls the print head unit 101 to record an image on the printing paper 103 .

[0025] The shared bus 211a is connected to the ROM 203, the CPU 204, the RAM 205, the host IF control unit 206, the image processing unit 207, and the head IF control unit 208. Through this shared bus 211a, the connected components can communicate with each other.

[0026] Furthermore, each of the main data processing units and each area of ​​the RAM 205 in this embodiment will be described.

[0027] The RAM 205 includes a PDL area 220, an intermediate data area 221, a bitmap data area 222, and a correction data area 223. The RAM 205 also includes other areas, but the description thereof will be omitted.

[0028] The PDL area 220 is an area that holds the PDL data of a print job.

[0029] The intermediate data area 221 is an area for holding intermediate data generated by the CPU 204 from PDL data.

[0030] The bitmap data area 222 is an area for holding bitmap data generated by the renderer unit 211 from the intermediate data.

[0031] The correction data area 223 is an area for holding the correction value table data generated by the analysis unit 212. The renderer unit 211 reads the intermediate data from the intermediate data area 221, generates bitmap data for each band, and stores the bitmap data in the bitmap data area 222. Here, the bitmap data refers to information in which an image is recorded as a continuous value of pixel values. The number of channels of the bitmap data is 1Ch, 3Ch, and 4Ch, for example. The number of bits of the bitmap data is 8 bits and 16 bits, for example. For example, when the bitmap data is represented by RGB information, the pixel value information may be a sequential data sequence such as RGBRGBRGB..., or a data sequence such as RRRRR...RRGGGGGG...GGBBBBB...BB.

[0032] The analysis unit 212 reads and analyzes bitmap data from the bitmap data area 222, calculates correction data based on the analysis result, and stores the correction data in the correction data area 223.

[0033] The correction unit 213 reads the bitmap data of the printing target and the correction data for the corresponding area from the bitmap data area 222 and the correction data area 223, and performs correction processing on the bitmap data using the correction data.

[0034] The quantization unit 214 performs quantization processing on the corrected bitmap data, and stores the quantized image data in an area different from the PDL area 220 to the correction data area 223 of the RAM 205.

[0035] The JPEG encoder 215 performs JPEG compression on bitmap data under specific conditions. The JPEG decoder 216 performs JPEG decoding on JPEG data under specific conditions.

[0036] <Bitmap data conversion of PDL data (builder process and rendering)> A method of generating bitmap data from PDL data in this embodiment will be described. PDL data is data that describes print contents by combining information such as characters and images on a page-by-page basis. Unless one page of PDL is inspected, it is not known which drawing data is drawn at which position on the page. On the other hand, in order to generate bitmap data at high speed, a method of processing consecutive pixel positions is good, and this method has good memory access efficiency to the RAM 205, and it is also expected that equivalent pixels can be generated at high speed. Therefore, the PDL is inspected, and "intermediate data" that processes the PDL data is generated as drawing information that enables easy generation of bitmap data. In this way, a method of efficiently generating bitmap data based on intermediate data is common. In this embodiment, the process up to the generation of intermediate data is called "builder processing", and the process up to the generation of bitmap data is called "rendering". In addition, in this embodiment, the builder processing is performed by the CPU 204, and the rendering is performed by the renderer unit 211. In addition, the intermediate data is in a format in which drawing commands are executed, and it is desirable to be able to generate bitmap data in raster units from the top of the page by executing the intermediate data on top of the intermediate data. Therefore, in this embodiment, the intermediate data is described as information including drawing commands, but the intermediate data is not limited to the above-mentioned intermediate data as long as it is information converted from PDL data into information that can be efficiently processed by the renderer unit 211.

[0037] Fig. 3 is a flowchart explaining the overall processing of the image processing device according to the first embodiment. By executing the processing in Fig. 3, it becomes possible to set areas in the analysis image data to which the gamut mapping means should be applied, and to select an appropriate gamut mapping means for each area according to the analysis results of each area.

[0038] In S301, the CPU 204 obtains PDL data from the PDL area 220 of the RAM 205. The CPU 204 performs builder processing on the PDL data to generate intermediate data. The CPU 204 stores the intermediate data in the intermediate data area 221. After completing generation of all intermediate data, the CPU 204 deletes the PDL data from the PDL area 220.

[0039] In S302, the CPU 204 reads the intermediate data from the intermediate data area 221 of the RAM 205, and causes the renderer unit 211 to perform rendering for image analysis on the intermediate data. The CPU 204 stores the bitmap data (first bitmap data) obtained by rendering in the bitmap data area 222. The bitmap data (image) is generated in a bitmap format, and pixel values ​​corresponding to each coordinate can be obtained. In S302, the intermediate data may be rendered at a resolution required for image analysis in S303. When image analysis is performed on bitmap data with a print resolution, the image is analyzed on a pixel-by-pixel basis, so the processing load is high. In addition, in an analysis process that requires a judgment from the entire image, the bitmap data with the print resolution must be held in the RAM 205. Therefore, the rendering resolution in S303 may be determined based on the characteristics of the analysis process and the required performance of the system. In this embodiment, the print resolution is set to 600 dpi and the analysis resolution is set to 150 dpi as an example, but the present invention is not limited to this.

[0040] In S303, the CPU 204 reads out the bitmap data rendered at the analysis resolution, and performs image analysis of the bitmap data using the analysis unit 212. Details of the image analysis process will be described with reference to FIG.

[0041] FIG. 4 is a flowchart illustrating the image analysis process of S303 according to the first embodiment.

[0042] In S401, the analysis unit 212 divides the analysis image data into one or more regions using bitmap data rendered at the analysis resolution (hereinafter, analysis image data). Details of the region division process will be described later with reference to FIG.

[0043] In S402, the analysis unit 212 performs type analysis for each region based on the region information divided in S401. Details of the region analysis process will be described later with reference to Figs. 6A to 6C.

[0044] In S403, the analysis unit 212 creates an appropriate mapping table for each region based on the region information and pixel values ​​of the region analyzed in S402. The analysis unit 212 stores the created mapping table in the correction data area 223 of the RAM 205. A specific process for creating a region mapping table for each region of the analysis image data will be described later with reference to FIG.

[0045] FIG. 5 is a flowchart illustrating the region division process in S401 according to the first embodiment.

[0046] In S501 , the CPU 204 acquires image data for analysis from the bitmap data area 222 .

[0047] In S502, the analysis unit 212 determines whether or not there is a blank for each pixel in the analysis image data. In this embodiment, pixels whose pixel values ​​are all R=G=B=255 are regarded as blank.

[0048] In S503, the analysis unit 212 sets an initial value for each pixel of the analysis image data based on the following setting conditions. (Setting conditions) - Set region number "-1" for non-blank pixels - Set the maximum area number to "0" Specifically, the analysis unit 212 sets the initial value of each pixel as follows. Blank pixel(x1,y1) area_number[x1][y1]=0 Non-blank pixel (x2,y2)area_number[x2][y2]=-1 Maximum area number max_area_number=0 At the time when the process of S503 is completed, the region numbers of all pixels will have been set to "0" or "-1".

[0049] In S504, the analysis unit 212 detects pixels having the region number "-1" in the analysis image data based on the following determination condition. Specifically, the determination is performed as follows. (Determination condition) if(area_number[x][y]=-1) → Detected else → Not detected When the analysis unit 212 detects the first pixel with the region number "-1", the process proceeds to S505.

[0050] If the analysis unit 212 does not determine in S505 that no pixel with region number "-1" exists in the analysis image data (No in S505), the process proceeds to S506. On the other hand, if the analysis unit 212 determines that no pixel with region number "-1" exists in the analysis image data (Yes in S505), the process proceeds to S510. Here, if it is determined that the region numbers of all pixels are not "-1", this means that all pixels are blank pixels or any region number (except "-1") has been set.

[0051] In S506, the analysis unit 212 increments the maximum region number by +1 and sets the updated maximum region number as the region number of the pixel. Specifically, the maximum region number is set for the detected pixel (x3, y3) as follows: max_area_number=max_area_number+1 area_number[x3][y3]=max_area_number For example, since this is the first area detected after the process of S506 is executed, the maximum area number is "1" and the area number of the pixel is also "1". After that, each time the process of S506 is executed again, the number of areas increases by 1. After that, in S507 to S509, the process of expanding consecutive non-blank pixels into the same area is performed.

[0052] In S507, the analysis unit 212 searches for a pixel that is an adjacent pixel to the pixel with the maximum region number and has the region number "-1." Specifically, the following determination is made. if (area_number[x][y]=max_area_number) if((area_number[x-1][y]=-1)or (area_number[x+1][y]=-1)or (area_number[x][y-1]=-1)or (area_number[x][y+1]=-1)) → Detected else → Not detected

[0053] In S508, when the analysis unit 212 detects the first adjacent pixel with the region number "-1", it determines that the adjacent pixel with region number "-1" has been detected (Yes in S508), and proceeds to the process of S509. On the other hand, if the region numbers of all adjacent pixels are not "-1" (No in S508), the analysis unit 212 determines that the adjacent pixel with region number "-1" has not been detected (No in S508), and returns the process to S504.

[0054] In S509, the analysis unit 212 sets the region number of the adjacent pixel (pixel with region number "-1") to the maximum region number. Specifically, the analysis unit 212 sets the maximum region number for the detected adjacent pixel by performing the following process, with the pixel position of interest set to (x4, y4). if((area_number[x4-1][y4]=-1) area_number[x4-1][y4]=max_area_number if((area_number[x4+1][y4]=-1) area_number[x4+1][y4]=max_area_number if((area_number[x4][y4-1]=-1) area_number[x4][y4-1]=max_area_number if((area_number[x4][y4+1]=-1) area_number[x4][y4+1]=max_area_number After updating the region number of the adjacent pixel in S509, the analysis unit 212 returns the process to S507 and determines whether or not there is another adjacent non-blank pixel. Then, when there is no more non-blank adjacent pixel (i.e., there is no pixel to which the maximum region number should be assigned), the analysis unit 212 returns the process to S504.

[0055] In S510, the analysis unit 212 sets the maximum region number value as the number of regions. That is, the maximum region number value set so far becomes the number of regions present in the analysis image data. This ends the region division process for the analysis image data.

[0056] Fig. 9 is a diagram for explaining an overview of the printing image data and the analysis image data according to the first embodiment. Fig. 9 shows the printing image data 901, the analysis image data 902, and the distribution of each area after the area division of the analysis image data 902 is completed.

[0057] Print image data 901 is image data with a printing resolution. Analysis image data 902 is image data with an analysis resolution. Areas 903, 904, and 905 represent areas after area division of analysis image data 902 is completed. Area 903 (shown as area 1) contains photograph data. Area 904 (shown as area 2) contains gradation data. Area 905 (shown as area 3) contains text data. Therefore, the result of area division in analysis image data 902 indicates the number of areas is 3.

[0058] 9, the analysis unit 212 (area division means) divides the areas so that they are spatially separated by providing at least one blank tile between one area (e.g., area 903) and another area (e.g., area 904). In other words, the analysis unit 212 determines that a plurality of pixels not separated by even one blank tile are adjacent to each other, and therefore performs area division processing by regarding them as the same area.

[0059] The analysis unit 212 may use other methods to divide the analysis image data 902. For example, the area may be divided based on a non-blank pixel, or the area may be divided based on the tendency values ​​of not only adjacent pixels but also wider surrounding pixels.

[0060] 6A to 6C are diagrams showing an example of the region type analysis result in S402 according to the first embodiment.

[0061] Fig. 6A shows a state in which one area 600 is set for the character "i" as a result of the area division process in S401. Fig. 6B shows a state in which one area 601 is set for the circular gradation as a result of the area division process in S401.

[0062] Area 600 or area 601 is a rectangle that surrounds the character or circular gradation, but if the area division method described in S401 is used, it will be divided at the boundary with the white pixels. For ease of understanding, a rectangular area is set based on the Y coordinates of the topmost and bottommost pixels of the area and the X coordinates of the rightmost and leftmost pixels of the area, for the result of area division performed in S401.

[0063] In this embodiment, the presence or absence of an edge in the halftone frame region is determined using an edge detection area 602 and an edge detection area 603. There are various methods for determining the presence or absence of an edge, but here, as an example, edge determination processing is performed using "same pixels," "similar pixels," and "different pixels."

[0064] As shown in FIG. 6C, pixels included in THa to THb are classified as same pixels, pixels included in THc to THd are classified as similar pixels, and other pixels are classified as different pixels. Here, the value to be compared with TH may be RGB information, YCbCr information, or information of any one CH, and there is no limit to the number and type of CH. The values ​​of THa to THd may be changed for each color information, and for example, different thresholds may be set for all RGB. By comparing all pixels of the edge detection area 602 and the edge detection area 603 with the central pixel, it is possible to know how many same pixels, similar pixels, and different pixels are included in the edge detection area 602 and the edge detection area 603. The analysis unit 212 scans the entire area of ​​the edge detection area 602 and the edge detection area 603, and creates a histogram that accumulates the numbers of same pixels, similar pixels, and different pixels. Since the central pixel (shown as a rectangular area including diagonal lines) of the edge detection area 602 needs to scan the entire area 600, the end of the edge detection area 602 can be a scanning target even if it is outside the area 600. Similarly, the end of the edge detection area 603 can be a scanning target even if it is outside the area 601.

[0065] Histogram 604 shows the results of edge detection processing on region 600. Histogram 605 shows the results of edge detection processing on region 601. According to the frequency distribution of histogram 604, region 600 (including "I") in FIG. 6A has many same pixels and different pixels, and few similar pixels. According to the frequency distribution of histogram 605, region 601 (including circular gradation) in FIG. 6B has more similar pixels than region 600.

[0066] Based on the frequency distribution of the three types of pixels in the histograms 604 and 605, it can be determined whether the regions 600 and 601 contain "characters or graphics" or "photographs or gradations." For example, the analysis unit 212 determines that the region 600 contains "characters or graphics" when the similar pixels in the histogram 604 are low. In this way, by setting thresholds for the same pixels, similar pixels, and different pixels, it can be determined whether each region contains "characters or graphics" or "photographs or gradations." For example, the analysis unit 212 determines whether each region contains "characters or graphics" based on whether the following conditions are met. Based on the results of the determination of each pixel in each region, the type that is most widely distributed in the region may be used as the type determination result for the region, or, for example, if the region has even a small amount of the characteristics of "photographs or gradations," the type determination result for the region may be "photographs or gradations." Same pixel index > TH same && Similar pixel index < TH near && Different pixel index > TH other

[0067] The above edge detection analysis process is an example, and is not limited thereto. For example, the same pixel, similar pixel, and different pixel may be compared using the cumulative value obtained from the number of pixels of the judgment result of all pixels and the above formula, or the number of pixels of the judgment result may be converted into the area ratio of the region and then compared using the above formula. In this embodiment, the edge detection process using the edge detection area 602 and the edge detection area 603 has been described, but the edge may be detected using the color distribution within the region.

[0068] FIG. 7 is a flowchart illustrating the mapping table creation process in S403 according to the first embodiment.

[0069] In step S701, the CPU 204 acquires image data for analysis from the bitmap data area 222.

[0070] In S702, the analysis unit 212 acquires the print gamut required to create the mapping table. The print gamut is information indicating the range of colors that can be reproduced when printing with a printer, and differs depending on the printing paper (plain paper, photo paper) and printing mode (draft, standard, fine, etc.). In general, the print gamut is wider when printing on photo paper than when printing on plain paper. The print gamut becomes wider in the order of draft mode, standard mode, and fine mode. This is because the more ink used in printing and the more of the printed ink that is present on the surface of the printing paper, the better the color development of the printed result.

[0071] Various methods may be used to express the print color gamut, but for example, a method of expressing it as a set of lightness (L: Lightness), chroma (C: Chroma), and hue (H: Hue) is used. Specifically, the method of expressing the print color gamut is a method of describing the maximum chroma for each lightness and hue, and is a method using a table such as that shown below. Cmax_Table[L][H] (L=0~100, H=0~360)

[0072] Here, since there are 101 types of L and 360 types of H, there are 36,360 (=101×360) sets of C information. Note that the number of gradations of L and H may be reduced in order to reduce the capacity of the mapping table.

[0073] For example, the print gamut is stored in advance in the ROM 203 of the printer, and the CPU 204 reads out the print gamut from the ROM 203. As described above, the print gamut is determined in advance as the performance of the printer (printing device). Therefore, for example, print patches are printed in advance with each RGB value, and the maximum saturation for each lightness and hue is set based on the measurement results of the print patches.

[0074] In S703, the analysis unit 212 determines whether the area of ​​the analysis image data includes "text or graphics" based on the area analysis result of S402. If the analysis unit 212 determines that the area includes "text or graphics" (Yes in S703), the process proceeds to S704. If the analysis unit 212 determines that the area does not include "text or graphics" (No in S703), the process proceeds to S708.

[0075] In S704, the analysis unit 212 acquires the pixel value of one pixel in the area of ​​the analysis image data.

[0076] In S705, the analysis unit 212 determines whether or not the pixel value acquired in S704 is present in the print gamut acquired in S702. Specifically, the analysis unit 212 converts the RGB value, which is the acquired pixel value, into lightness, saturation, and hue. Since RGB values ​​are generally sRGB values, the present embodiment will be described using sRGB values ​​as an example. For example, a conversion table sRGBtoLCH[Rin][Gin][Bin][0-2] that converts sRGB values ​​into lightness, saturation, and hue is stored in advance in the ROM 203 of the printer. Then, the analysis unit 212 calculates Lin, Cin, and Hin using the sRGB values ​​as follows: Lin=sRGBtoLCH[Rin][Gin][Bin][0] Cin=sRGBtoLCH[Rin][Gin][Bin][1] Hin=sRGBtoLCH[Rin][Gin][Bin][2] Then, the analysis unit 212 performs a comparison process shown in the following formula to determine whether or not Lin, Cin, and Hin are present in the print gamut. If(Cin<=Cmax_Table[Lin][Hin]) → within printing color gamut Else → Outside the print gamut

[0077] If the analysis unit 212 determines that Lin, Cin, and Hin are present in the print gamut (Yes in S705), the process proceeds to S706. On the other hand, if the analysis unit 212 determines that Lin, Cin, and Hin are not present in the print gamut (No in S705), the process proceeds to S708.

[0078] In S706, the analysis unit 212 determines whether the determination of all pixels in the region has been completed. If the analysis unit 212 determines that the determination of all pixels in the region has been completed (Yes in S706), the process proceeds to S707. On the other hand, if the analysis unit 212 determines that the determination of all pixels in the region has not been completed (No in S706), the process returns to S704, and the above process is performed on the next pixel in the partial page.

[0079] In S707, the analysis unit 212 sets the "colorimetric" mapping table as the mapping table for the region, and ends the process. Setting the "colorimetric" mapping table will be described later with reference to FIG. 10. The process of S707 is performed when all pixels in the region are in the print gamut. Therefore, when the "colorimetric" mapping table is used for a region made up of multiple colors within the printer's reproduction gamut, no reduction in color difference occurs in the region.

[0080] In S708, the analysis unit 212 sets the "perceptual" mapping table as the mapping table for the region, and ends the process. The setting of the "perceptual" mapping table will be described later with reference to FIG. 10. The process of S708 is performed when there is a pixel outside the print gamut among the pixels of the region. Therefore, when the "colorimetric" mapping table is used for a region composed of multiple colors outside the reproduction color gamut of the printer, there is a possibility that a decrease in color difference occurs in the region. In addition, another condition for performing the process of S708 includes a case where the region includes a "photo or gradation". A "photo or gradation" often has a characteristic that pixel gradation changes gradually, and there is a possibility that a decrease in gradation that may occur when the "colorimetric" mapping table is used also occurs in the region. Therefore, in S708, the analysis unit 212 sets the "perceptual" mapping table as the mapping table for the region.

[0081] FIG. 10 is a diagram for explaining mapping.

[0082] Fig. 10(a) is a diagram showing the relationship between the color space of a standard display and the color space of a printer. That is, the solid line 1001 in Fig. 10(a) indicates the sRGB color space defined as IEC 61966-2-1:1999 in the L*a*b* uniform color space. The solid line 1001 also indicates the color space that the original data (PDL data) from the host computer 201 can take. The print gamut 1002 (shown by a dashed line) in Fig. 10(a) is the color reproduction range of the printer.

[0083] When the colors displayed on the standard display are output by the image processing device 100, it is necessary to map the colors outside the color reproduction range of the image processing device 100 to appropriate colors within the reproduction range. This mapping is generally called color space compression (color mapping). Generally, there are multiple methods of color space compression, and they are used according to the purpose. In FIG. 10(a), WP10011 and WP10021 are the brightest colors (WP: white point) within the reproduction range of the standard display and the printer, respectively. Also, BP10012 and BP10022 are the darkest colors (BP: black point) within the reproduction range of the standard display and the printer, respectively.

[0084] FIG. 10(b) is a diagram for explaining the "perceptual" mapping. As shown in the thick solid line 1011 in FIG. 10(b), the white point (WP10011) and black point (BP10012) of the standard display are mapped to the white point (WP10021) and black point (BP10022) of the printer, respectively. Other colors are converted so that the correlation between the white point and the black point is maintained. The entire color space 1001 of the standard display is converted (so that saturation is compressed in the color direction) so that it fits into the printing gamut 1002 of the printer. Therefore, the colors in the color space 1001 of the standard display are converted to the thick solid line 1011, and the colors in the original printing gamut 1002 are converted to the thick dashed line 1012. The "perceptual" mapping in FIG. 10(b) is suitable for processing photos with a large number of colors. As shown in FIG. 10(b), the color gamut of the standard display is compressed in both lightness and saturation.

[0085] Fig. 10(c) is a diagram for explaining absolute colorimetric mapping. As shown in Fig. 10(c), this method does not compress colors within the printer's print gamut, but compresses colors outside the print gamut in both lightness and saturation. The thick arrow 1021 in Fig. 10(c) indicates the direction of the color compression process. The multiple colors included in the area of ​​the thick arrow 1021 are displayed as different colors on a standard display, but after mapping, they become the same color at the end of the arrow.

[0086] FIG. 10(d) is a diagram for explaining relative colorimetric mapping. As shown in FIG. 10(d), only the white point of the standard display is mapped to the white point of the printer. After that, the colors within the printer's print gamut are not compressed, and the colors outside the print gamut are compressed in both lightness and saturation. "Relative colorimetric mapping" can reproduce the relative color difference between each color on the standard display and white as the relative color difference between each color and paper white at the time of printing. In FIG. 10(d), the multiple colors included in the area of ​​the thick arrow 1031 were expressed as different colors on the standard display, but after mapping, they become the same color at the end of the arrow.

[0087] There is also a method in which the white point and black point of the standard display are mapped to the white point and black point of the printer, respectively, and then the colors within the printer's print gamut are not compressed, and the colors outside the print gamut are saturation compressed. The "colorimetric mapping" set in S707 of FIG. 7 includes the "absolute colorimetric mapping" described in FIG. 10(c) and the "relative colorimetric mapping" described in FIG. 10(d), but other methods may be used. Here, when using the "relative colorimetric mapping" or other methods, it is necessary to perform mapping to the white point and black point before the processing of S705. Specifically, in FIG. 10(d) (mapping only the white point), if the L value of the white point of the printer's print gamut is set to Lmax (the value range of L is 0 to 100), the determination is made according to the following formula. Lin2 = Lin-(100-Lmax) If(Cin<=Cmax_Table[Lin2][Hin]) →Within printing color gamut Else → Outside the print gamut

[0088] When mapping both the white point and the black point, the L value of the white point of the printer's print gamut is set to Lmax (the L value range is 0 to 100), and the L value of the black point is set to Lmin. In this case, the determination is made according to the following formula. Lin2=(Lmax-Lmin)*Lin / 100+Lmin If(Cin<=Cmax_Table[Lin2][Hin]) →Within printing color gamut Else → Outside the print gamut

[0089] As described above, an appropriate mapping method can be selected for each area of ​​the analysis image data. In other words, "perceptual" mapping is set for areas including color information outside the print gamut and areas including photographs or gradations, and "colorimetric" mapping is set for areas not including color information outside the print gamut. This makes it possible to perform mapping with reduced loss of saturation for digital documents made up of colors that can be reproduced by the printer. Also, it is possible to perform mapping with reduced loss of color difference between colors for digital documents made up of multiple colors outside the printer's reproduction gamut. Returning to the explanation of FIG. 3.

[0090] In S304, CPU 204 reads the intermediate data from intermediate data area 221, and performs print rendering on the intermediate data using renderer unit 211 to generate bitmap data (second bitmap data). CPU 204 stores the bitmap data in bitmap data area 222. An image obtained by rendering the intermediate data is generated in bitmap format, and CPU 204 can obtain pixel values ​​corresponding to each coordinate. In S304, the intermediate data is rendered at a resolution required for printing. When the rendering process has been completed using all of the information in the intermediate data, CPU 204 deletes the intermediate data from intermediate data area 221.

[0091] In S305, the correction unit 213 corrects the bitmap data rendered at the printing resolution (hereinafter, image data for printing) using the gamut mapping table in the correction data area 223. The correction process for image data for printing will be described in detail with reference to FIG.

[0092] FIG. 8 is a flowchart illustrating the print image data correction process in S305 according to the first embodiment.

[0093] In step S801 , the CPU 204 obtains print image data from the bitmap data area 222 .

[0094] In S802, the correction unit 213 obtains the pixel value of one pixel from the print image data.

[0095] In S803, the correction unit 213 obtains a mapping table linked to the area number corresponding to the obtained pixel value from the correction data area 223. When the resolutions of the analysis image data and the print image data are different, it is necessary to perform correspondence of pixel values ​​taking into account the difference in resolution. For example, the resolution of the analysis image data is 150 dpi, and the resolution of the print image data is 600 dpi. In this case, each pixel of the analysis image data is enlarged to 4×4 pixels, and the pixels are assigned to the print image data. Even if the resolution of the analysis image data is small, non-blank pixels are not lost even when reduced by interpreting the drawing command at the time of rendering and rendering at a low resolution. Therefore, the corresponding area of ​​the print image data can be covered by enlarging the analysis result (analysis image data). On the other hand, there are cases where pixel values ​​are directly described in the drawing command. In this case, rendering at a reduced resolution may result in pixel loss. Therefore, the numerical value of the reduced resolution can be set according to how accurately the image is to be converted and the required speed.

[0096] In S804, the correction unit 213 performs gamut mapping on the target pixel using the corresponding gamut mapping table.

[0097] In S805, the correction unit 213 determines whether or not the gamut mapping process for all pixels has been completed. If the correction unit 213 determines that the determination for all pixels has been completed (Yes in S805), the process ends. On the other hand, if the correction unit 213 determines that the determination for all pixels has not been completed (No in S805), the process returns to S802, and the above process is performed on the next pixel.

[0098] The image correction means is not limited to the above, and may perform colorimetric gamut mapping for all pixels in the print image data for which "colorimetric" gamut mapping is preferable, and then perform perceptual gamut mapping for all pixels for which "perceptual" gamut mapping is preferable. In this case, the number of gamut mapping table read processes can be reduced, improving processing efficiency.

[0099] In S306, the CPU 204 performs a predetermined process on the print image data corrected in S305. Specifically, the CPU 204 performs ink color separation, output characteristic conversion, and quantization processes on each pixel of the corrected print image data using the quantization unit 214. The CPU 204 stores the quantized image data in the RAM 205. The head control unit 209 reads the quantized image data via the head IF control unit 208, and outputs the quantized image data (information capable of ejecting ink droplets) to the print head unit 101, and printing begins.

[0100] As described above, in the first embodiment, analysis processing is performed on intermediate data obtained by builder processing of PDL data, using analysis image data generated by further rendering. Since the analysis image data has the minimum resolution required for analysis processing, memory size can be reduced. By analyzing the analysis image data, stable analysis results can be obtained without relying on external applications, making it possible to select gamut mapping with a granularity different from that of the PDL (description language).

[0101] Second embodiment In the second embodiment, differences from the first embodiment will be described. In the first embodiment, PDL data is converted into intermediate data by builder processing. By storing the intermediate data, rendering processing at the respective resolutions for analysis and printing is realized. In the first embodiment, image analysis is performed at an appropriate resolution within the image processing device 100, satisfying the processing speed and obtaining stable analysis results that are not dependent on external applications. In the second embodiment, a configuration will be described in which data is stored in the form of PDL data rather than intermediate data.

[0102] 11 is a flowchart for explaining the overall process of the image processing device according to the second embodiment. Note that in the second embodiment, differences from the first embodiment will be explained.

[0103] In S1101, the CPU 204 obtains PDL data transmitted by an application from the PDL area 220. The CPU 204 interprets the PDL data by a builder process and generates intermediate data. Here, the CPU 204 does not delete the PDL data from the PDL area 220, but holds the PDL data.

[0104] In S302, the CPU 204 performs rendering for image analysis based on the intermediate data. In S302, the intermediate data is rendered at a resolution required for image analysis in S303. If the intermediate data was saved in the intermediate data area 221 in S1101, it is deleted when rendering is completed.

[0105] In S1102, the CPU 204 acquires the PDL data from the PDL area 220. The CPU 204 interprets the PDL data by a builder process and generates intermediate data. After generating the intermediate data, the CPU 204 deletes the PDL data from the PDL area 220.

[0106] In S304, the CPU 204 performs printing rendering based on the intermediate data. In S304, rendering is performed at a resolution required for image correction in S305. If the intermediate data is saved in the intermediate data area 221 as of S1102, it is deleted when rendering is completed.

[0107] The difference from the first embodiment is that the data held during the image analysis process is not the intermediate data in the intermediate data area 221 but the PDL data in the PDL area 220.

[0108] In the second embodiment, PDL data is stored in memory (RAM 205), and rendering to the PDL data is performed twice in total, once during image analysis and once during printing. Compared to the first embodiment, the second embodiment has the effect of further reducing memory size because it stores PDL data instead of intermediate data.

[0109] Third embodiment In the third embodiment, the difference between the first and second embodiments will be described. In the first embodiment, PDL data is converted into intermediate data by a builder process, and the intermediate data is stored. In the second embodiment, PDL data is stored, and intermediate data for analysis and printing is generated. In the third embodiment, bitmap data is stored instead of intermediate data and PDL data.

[0110] 12 is a flowchart for explaining the overall process of the image processing device according to the third embodiment. Note that in the third embodiment, the difference between the first and second embodiments will be explained.

[0111] In S1201, the CPU 204 performs rendering based on the intermediate data. The rendering resolution is a printing resolution (600 dpi) that is greater than the analysis resolution (150 dpi). The CPU 204 may delete the PDL data at the end of S301, and may also delete the intermediate data at the end of S1201. The CPU 204 holds the 600 dpi bitmap data (hereinafter, print image data) in the bitmap data area 222.

[0112] In step S1202, the CPU 204 reduces the image for analysis processing based on the print image data. The resolution of the analysis image data is 150 dpi.

[0113] FIG. 13 is a diagram illustrating an example of a reduction process of print image data according to the third embodiment.

[0114] The CPU 204 generates 150 dpi analysis image data by extracting one pixel from the 600 dpi print image data in FIG. 13 in increments of 4 pixels x 4 pixels. The reduction method is not limited to the method of extracting pixels. For example, the print image data may be reduced by outputting the average value of 4 x 4 pixels as the output value instead of extracting pixels. Extraction processing has the advantage of being efficient in terms of processing speed, but the reduction method may be appropriately determined based on the target processing speed required for the reduced image generation processing and the compatibility with the analysis content performed in the analysis processing. When the reduction method is extraction processing, the characteristics of the original image (print image data) may not be obtained. For example, when the content of the original image repeats white and black at a specific frequency, the extraction result may be only white or only black depending on the frequency and phase of the extraction interval. When it is desired to perform global area discrimination as part of the analysis processing, it is better to perform average value reduction and output the intermediate value between white and black to retain the characteristics of the area of ​​the original image.

[0115] On the other hand, there may be a way to output the maximum and minimum pixel values ​​for the 4x4 pixels of the print image data. When the maximum pixel value is used, white (255 in 8 bits) is output preferentially over black (0 in 8 bits). Using the maximum pixel value is effective when the aim is to extract only solid areas that are 4x4 pixels or larger, without extracting areas such as dots and lines from the original image (600 dpi bitmap data) during output. For example, when switching the quantization threshold matrix through analysis, it may be desirable to only target solids, since it is easy for the quantization algorithm to design graininess and density for solids.

[0116] When the minimum pixel value is used, black is output preferentially over white. Like the average value, this is effective when you want to perform global area discrimination, and is characterized by the fact that the pixel values ​​at the time of input are not changed relative to the average value. For example, when analyzing what colors are composed within an area, it is preferable to output the pixel reduced value rather than a method in which the reduced pixel value changes due to averaging.

[0117] The CPU 204 stores the analysis image data, which is obtained by reducing the print image data, on the recording medium. The CPU 204 also maintains the print image data stored on the recording medium. If the analysis image data can be generated by a sampling process as in this method, the process can be substituted by skipping and reading the print image data when obtaining pixel values ​​used for image analysis from the recording medium in S303. Return to the explanation of FIG. 12.

[0118] In S305, the CPU 204 uses 600 dpi print image data. As described above, in the third embodiment, the print image data after rendering is stored in memory. During image analysis, analysis image data obtained by enlarging or reducing the print image data to a resolution required for analysis is used. During printing, the analysis image data is corrected. Compared to the first embodiment, the third embodiment has the effect of reducing the processing load because the rendering process is not performed twice. Compared to the second embodiment, the third embodiment has the effect of reducing the processing load because the build process and rendering are not performed twice.

[0119] (Fourth embodiment) It has been described that the intermediate data in the first embodiment is generated as a result of the builder process of the CPU 204, and that the intermediate data is generated based on the PDL data. It has also been described that the intermediate data becomes bitmap data through the rendering process of the renderer unit 211. In the fourth embodiment, a "fallback process" will be described in the case where the capacity of the RAM 205 is insufficient when generating intermediate data.

[0120] <Fallback processing during rendering> The fallback process will be described below. When intermediate data is generated, if the capacity of the intermediate data exceeds a certain data capacity, or if it is determined that the work area of ​​the RAM 205 for processing the intermediate data exceeds the certain data capacity, the generated intermediate data is rendered to generate bitmap data. Then, the intermediate data created so far is deleted. This bitmap data is used as the background image of the drawing area, and the background image is compressed to reduce the capacity of the RAM 205. The series of processes described above is the fallback process.

[0121] After that, when one page's worth of intermediate data has been generated, the compressed background image is expanded and converted into bitmap data, and the remaining intermediate data for one page is also rendered into the bitmap data, and finally one page's worth of bitmap data is generated.

[0122] Usually, the background image is compressed, so the capacity of the added intermediate data is smaller than the capacity of the original intermediate data. Therefore, by generating the remaining intermediate data in the free space created by compressing the background image, it is possible to process large-sized intermediate data in the limited area of ​​the RAM 205.

[0123] <Flowchart for fallback processing> FIG. 14 is a flowchart illustrating a case where a fallback process occurs during a builder process according to the fourth embodiment.

[0124] 3, the CPU 204 acquires PDL data from the PDL area 220. The CPU 204 then inspects the PDL data and generates multiple drawing commands so that bitmap data can be generated from the top of the page. A collection of drawing commands is called a "drawing command group." Data that includes the drawing command group becomes intermediate data.

[0125] In S2002, the CPU 204 generates drawing commands one by one from the PDL data.

[0126] In S2003, the CPU 204 calculates the free space in the intermediate data area 221.

[0127] In S2004, CPU 204 compares the capacity for storing the drawing commands generated in S2002 with the free space calculated in S2003, and determines whether the drawing commands can be saved in intermediate data area 221. If CPU 204 determines that the drawing commands can be saved in intermediate data area 221 (Yes in S2004), it proceeds to S2009. On the other hand, if CPU 204 determines that the drawing commands cannot be saved in intermediate data area 221 (No in S2004), it proceeds to S2005. Since there is sufficient free space in intermediate data area 221 when generating the first drawing command, the case where the drawing commands are saved in intermediate data area 221 will be described first.

[0128] In S2009, the CPU 204 saves the group of drawing commands in the intermediate data area 221. At this time, if there is a drawing command for the same page, the CPU 204 adds a newly generated drawing command so that it can be placed following the previous drawing command, and places it as a group of drawing commands.

[0129] In S2010, the CPU 204 determines whether or not generation of intermediate data for one page has been completed. If the CPU 204 determines that generation of intermediate data for one page has been completed (Yes in S2010), the CPU 204 ends the builder process and deletes the PDL data from the PDL area 220. On the other hand, if the CPU 204 determines that generation of intermediate data for one page has not been completed (No in S2010), the CPU 204 returns the process to S2002 and generates the next drawing command.

[0130] Continuing with the explanation of the case where generation of one page of intermediate data is not complete, the processes of S2002 and S2003 are executed again. If the CPU 204 determines in S2004 that there is no free space in the intermediate data area 221 or that the free space is small, the process proceeds to S2005. In many cases, the process proceeds to S2005 when a command with a large capacity has been generated, such as when image data is embedded in the generated drawing command.

[0131] In S2005, the CPU 204 instructs the renderer unit 211 to generate bitmap data using the intermediate data. Based on the instruction to generate bitmap data, the renderer unit 211 performs rendering using the drawing commands in the intermediate data area 221 and the drawing commands newly generated in S2002, and writes out the bitmap data to the bitmap data area 222. This bitmap data becomes the "background image."

[0132] In S2006, the CPU 204 instructs the JPEG encoder 215 to JPEG-compress the bitmap data (background image) generated in S2005 and generate compressed data of the background image.

[0133] In S2007, the CPU 204 deletes various data used in generating the background image. Specifically, the various data includes the group of drawing commands and the drawing commands used in S2005, and the bitmap data generated in S2005. The capacity of the background image generated in S2007 is smaller than the capacity of the group of drawing commands and the drawing commands used in S2005. Therefore, by deleting the various data, the capacity of the drawing commands that could not be saved in the intermediate data area 221 can be newly secured. If the capacity of the background image is larger than the capacity of the group of drawing commands and the drawing commands used in S2005, or if the capacity of the background image is larger than a predetermined capacity, the compression rate used in S2006 may be increased and the compression process may be performed again. Note that, although it has been described that the various data are "deleted," it is only necessary to set the area of ​​unnecessary data as a free area, and there is no need to overwrite the area of ​​unnecessary data with zero data.

[0134] In S2008, the CPU 204 saves the background image generated in S2007 in the intermediate data area 221, and the process proceeds to S2010. A case will be described where the CPU 204 determines in S2010 that generation of intermediate data has not been completed and the process proceeds to S2002.

[0135] The processes of S2002 and S2003 are executed again, and if the CPU 204 determines in S2004 that there is free space in the intermediate data area 221, the process proceeds to S2009. At this time, because there is a background image in the intermediate data area 221, the drawing commands are arranged so as not to overwrite the background image. Then, the above process is repeated until the generation of the intermediate data is completed or the drawing commands can no longer be saved in the intermediate data area 221.

[0136] Again, a case will be described where the CPU 204 determines in S2004 that the drawing command cannot be saved in the intermediate data area 221 and the process proceeds to S2005.

[0137] In S2005, CPU 204 instructs renderer unit 211 to generate bitmap data using the intermediate data. Based on the instruction from CPU 204, renderer unit 211 performs rendering using the drawing commands in intermediate data area 221, the drawing commands newly generated in S2002, and the compressed background image, and writes the bitmap data to bitmap data area 222. At this time, the background image is decoded by JPEG decoder 216, but the decoding instruction may be directed to either CPU 204 or renderer unit 211 as long as rendering can be performed on the decoded background image.

[0138] Next, the process of S2006 is executed. In S2007, since the number of old background images to be deleted increases, the group of drawing commands used in S2005, the drawing commands, the background image, and the bitmap data generated in S2005 are deleted. In S2008, the background image generated in S2007 is saved again in the intermediate data area 221. Thereafter, the process proceeds to S2010, and if it is determined that the generation process of the intermediate data has not yet been completed, the processes described up to this point are performed.

[0139] In this way, when fallback processing occurs, the last generated background image and the group of drawing commands that were not deleted are saved in the intermediate data area 221 as intermediate data.

[0140] The process of S302 (rendering for image analysis) in the fourth embodiment will be described. In the first embodiment, the intermediate data was described as being "read out", but when fallback processing occurs, the intermediate data includes a compressed background image in addition to the group of drawing commands. Therefore, CPU 204 causes renderer unit 211 to perform rendering for image analysis using the group of drawing commands in intermediate data area 221 and the compressed background image. At this time, the background image is decoded by JPEG decoder 216, but the decoding instruction target may be either CPU 204 or renderer unit 211 as long as rendering can be performed on the decoded background image.

[0141] The process of S304 (rendering for printing) of the fourth embodiment will be described. In the first embodiment, the intermediate data is described as being "read out", but when fallback processing occurs, the intermediate data includes a compressed background image in addition to the drawing commands. Therefore, the CPU 204 causes the renderer unit 211 to perform rendering for image analysis using the drawing commands in the intermediate data area 221 and the compressed background image. At this time, the background image is decoded by the JPEG decoder 216, but the instruction target for decoding may be the CPU 204 or the renderer unit 211 as long as rendering can be performed on the decoded background image. Also, similar to the first embodiment, when all rendering processing is completed, the CPU 204 can delete the intermediate data from the intermediate data area 221 at this point.

[0142] <Explanation of intermediate data during fallback processing> FIG. 15 is a diagram for explaining the contents of the intermediate data in each state in the process of FIG.

[0143] The horizontal axis of table 2100 indicates the state of the intermediate data (state 1 to state 5). Intermediate data represents a group of drawing commands and a background image. Table 2100 shows how the group of drawing commands and background image of the intermediate data are generated and deleted. Below, it will be explained what kind of intermediate data is stored in intermediate data area 221 in each state.

[0144] 14, when there is free space in the intermediate data area 221, and the first drawing command group is generated and stored in the intermediate data area 221. In the intermediate data area 221, there is no background image as intermediate data, but there is the first drawing command group, which is a collection of multiple drawing commands.

[0145] State 2 is a state in which, while maintaining State 1, fallback rendering processing is performed in the next S2004 when there is no free space in the intermediate data area 221, and a compressed background image (first background image) is stored in the intermediate data area 221. Note that, since the first background image has been generated, the first drawing command group has been deleted from the intermediate data area 221.

[0146] State 3 is a state in which state 2 is maintained while a second group of drawing commands is generated in the next S2004 when there is free space in the intermediate data area 221, and the second group of drawing commands is stored in the intermediate data area 221. Therefore, the first background image and the second group of drawing commands exist in the intermediate data area 221.

[0147] State 4 is a state in which, while maintaining State 3, fallback rendering processing is performed when there is no free space in the next S2004, and a compressed background image (second background image) is stored in the intermediate data area 221. Note that, since the second background image has been generated, the first background image and the second drawing command group have been deleted from the intermediate data area 221.

[0148] State 5 is a state in which state 4 is maintained while a third group of drawing commands is generated in S2004 when there is free space, and the third group of drawing commands is stored in intermediate data area 221. Therefore, the second background image and the third group of drawing commands exist in intermediate data area 221. Then, when the intermediate data is completed in state 5, CPU 204 performs rendering for image analysis and rendering for printing using the intermediate data in state 5.

[0149] As described above, in the fourth embodiment, when the volume of intermediate data generated during builder processing becomes large and fallback processing occurs, intermediate data including drawing commands and background images is generated. As a result, the fourth embodiment can perform rendering for image analysis, rendering for printing, and image correction in the same way as the first embodiment, without depending on the contents of the PDL data.

[0150] (Other embodiments) In the first to fourth embodiments, the analysis process for selecting the mapping table and the correction process for individual application of the color design table have been described as an example. However, the present invention is effective in a system that configures the analysis process and correction process of an image, but is not limited to the analysis process and correction process of an image. For example, an analysis process for distinguishing between solid areas and other areas in an original image may be performed, and the quantization threshold matrix may be switched according to the analysis result. When determining whether a solid is a solid, as described in the explanation of FIG. 13, halftone dots and lines can be easily removed by selecting the maximum pixel value in the reduction method when reducing the image. Although the size of the reduction window is limited in the removal means when reducing, it is also possible to determine whether a solid is a solid for a wider area in the analysis of a reduced image. For the threshold matrix, a matrix can be selected that disperses dots within the area for a solid area and maintains the graininess and density at the time of input. For a non-solid area, a matrix can be selected that prioritizes shape over graininess and concentrates dots.

[0151] In the above embodiment, the serial type image processing device 100 has been described, but the present invention is not limited to this as long as the characteristics and configuration are similar. The image processing device 100 may use a line head, or may have a configuration in which serial types are arranged vertically.

[0152] Furthermore, in the above embodiment, the printer is described as an inkjet printer, but the present invention is not limited to this as long as the printer has similar features and configuration. For example, the present invention may be a laser printer using toner, or a copier.

[0153] Furthermore, in the above embodiment, the term PDL is used, but any PDL that can generate intermediate data in the builder process may be used, such as PostScript and PDF, or a printer manufacturer's own PDL.

[0154] Furthermore, in the above embodiment, the image processing unit 207 is described as being equipped with the renderer unit 211, the analysis unit 212, and the like as a hardware processing unit, but as long as the processing of each flowchart described in this embodiment can be realized, some of the processing in the image processing unit 207 may be processed by the CPU 204. For example, the processing of the renderer unit 211 and the analysis unit 212 may be software processing by the CPU 204.

[0155] Furthermore, in the above embodiment, the PDL area 220, the intermediate data area 221, the bitmap data area 222, and the correction data area 223 are arranged in the RAM 205, but as long as they are rewritable storage devices, they are not limited to the RAM 205. For example, an HDD and an eMMC separate from the RAM 205 may have all or part of the PDL area 220 to the correction data area 223.

[0156] (Other Examples) The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions.

[0157] The disclosure of this specification includes the following image processing device, image processing method, and program. (Item 1) A first generating means for generating intermediate data based on the PDL data; a second generating means for generating first bitmap data and second bitmap data different from the first bitmap data based on the intermediate data; an acquisition means for acquiring a gamut mapping table that associates the second bitmap data with a print gamut based on an analysis result of the first bitmap data; a correction means for correcting the second bitmap data based on the gamut mapping table; and a quantization means for generating quantized image data based on the corrected second bitmap data. 13. An image processing device comprising: (Item 2) The resolution of the first bitmap data is lower than the resolution of the second bitmap data. 2. The image processing device according to item 1, (Item 3) the gamut mapping table includes a perceptual mapping table and a colorimetric mapping table; 3. The image processing device according to item 1 or 2. (Item 4) After the acquisition means acquires the gamut mapping table, the correction means deletes the first bitmap data and corrects the second bitmap data based on the gamut mapping table. 4. The image processing device according to any one of items 1 to 3, (Item 5) A first storage means for storing the PDL data is further provided, The first generating means generates the intermediate data based on the PDL data stored in the first storing means, The second means generates the first bitmap data and the second bitmap data based on the generated intermediate data. 5. The image processing device according to any one of items 1 to 4, (Item 6) A second storage means for storing the intermediate data generated by the first generation means, the second generating means generates the first bitmap data and the second bitmap data based on the intermediate data held by the second holding means. 6. The image processing device according to any one of items 1 to 5, (Item 7) the second generating means, when the second holding means holds a first intermediate data group which is a part of the intermediate data, and a capacity of a second intermediate data group which the second holding means receives after the first intermediate data group exceeds a free capacity of the second holding means, generates a first background image based on the first intermediate data group and the second intermediate data group; the second storage means deletes the first intermediate data group and stores the first background image. 7. The image processing device according to item 6, (Item 8) the second storage means stores the first background image and the third intermediate data group when a size of a third intermediate data group received after the second intermediate data group does not exceed an available space of the second storage means. 8. The image processing device according to item 7, (Item 9) the second generation means, when a capacity of a fourth intermediate data group received by the second storage means after the third intermediate data group exceeds an available capacity of the second storage means, generates a second background image different from the first background image based on the third intermediate data group and the fourth intermediate data group; the second storage means deletes the first background image and the third intermediate data group, and stores the second background image. 9. The image processing device according to item 8, (Item 10) the second generating means generates the first bitmap data and the second bitmap data based on the final storage result of the second storage means. 10. The image processing device according to any one of items 7 to 9, (Item 11) a compression processing means for performing an image compression process on the first background image and the second background image; and a decoding means for decoding the first background image and the second background image that have been subjected to image compression processing. 10. The image processing device according to item 9, (Item 12) the second generating means generates the first bitmap data by rendering based on the intermediate data, and generates the second bitmap data by performing predetermined image processing using the generated first bitmap data. 12. The image processing device according to any one of items 1 to 11, (Item 13) the predetermined image processing is processing for reducing the size of the second bitmap data; 13. The image processing device according to item 12, (Item 14) a first generation step of generating intermediate data based on the PDL data; a second generating step of generating first bitmap data and second bitmap data different from the first bitmap data based on the intermediate data; an acquisition step of acquiring a gamut mapping table that associates the second bitmap data with a print gamut based on an analysis result of the first bitmap data; a correction step of correcting the second bitmap data based on the gamut mapping table; A quantization step of generating quantized image data based on the corrected second bitmap data. 13. An image processing method comprising: (Item 15) 14. A program for causing a computer to function as the image processing device according to any one of items 1 to 13.

[0158] The invention is not limited to the above-described embodiments, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, the following claims are appended to apprise the public of the scope of the invention. [Explanation of symbols]

[0159] 201: Host computer 202: Controller 203:ROM 204: CPU 205:RAM 206: Host IF control unit 207: Image processing unit 208: Head IF control unit 209: Head control unit 210: Print data 211: Rendering Department 212: Analysis Department 213: Correction section 214: Quantization section 215: JPEG encoder 216: JPEG decoder 220:PDL area 221: Intermediate data area 222: Bitmap data area 223: Correction data area

Claims

1. a first generating means for generating intermediate data based on the PDL data; a second generating means for generating first bitmap data and second bitmap data different from the first bitmap data based on the intermediate data; an acquisition means for acquiring a gamut mapping table that associates the second bitmap data with a print gamut based on an analysis result of the first bitmap data; a correction means for correcting the second bitmap data based on the gamut mapping table; and a quantization means for generating quantized image data based on the corrected second bitmap data.

13. An image processing device comprising:

2. The resolution of the first bitmap data is lower than the resolution of the second bitmap data.

2. The image processing device according to claim 1,

3. the gamut mapping table includes a perceptual mapping table and a colorimetric mapping table; 2. The image processing device according to claim 1,

4. After the acquisition means acquires the gamut mapping table, the correction means deletes the first bitmap data and corrects the second bitmap data based on the gamut mapping table.

2. The image processing device according to claim 1,

5. A first storage unit for storing the PDL data is further provided, The first generating means generates the intermediate data based on the PDL data stored in the first storing means, the second generating means generates the first bitmap data and the second bitmap data based on the generated intermediate data.

2. The image processing device according to claim 1,

6. A second storage means for storing the intermediate data generated by the first generation means, the second generating means generates the first bitmap data and the second bitmap data based on the intermediate data held by the second holding means.

2. The image processing device according to claim 1,

7. the second generating means, when the second holding means holds a first intermediate data group which is a part of the intermediate data, and a capacity of a second intermediate data group which the second holding means receives after the first intermediate data group exceeds a free capacity of the second holding means, generates a first background image based on the first intermediate data group and the second intermediate data group; the second storage means deletes the first intermediate data group and stores the first background image.

7. The image processing device according to claim 6,

8. the second storage means stores the first background image and the third intermediate data group when a size of a third intermediate data group received after the second intermediate data group does not exceed an available space of the second storage means.

8. The image processing device according to claim 7,

9. the second generating means, when a capacity of a fourth intermediate data group received by the second holding means after the third intermediate data group exceeds an available capacity of the second holding means, generates a second background image different from the first background image based on the third intermediate data group and the fourth intermediate data group; the second storage means deletes the first background image and the third intermediate data group, and stores the second background image.

9. The image processing device according to claim 8,

10. the second generating means generates the first bitmap data and the second bitmap data based on the final storage result of the second storage means.

8. The image processing device according to claim 7,

11. a compression processing means for performing an image compression process on the first background image and the second background image; a decoding means for decoding the first background image and the second background image that have been subjected to image compression processing, 10. The image processing device according to claim 9,

12. the second generating means generates the first bitmap data by rendering based on the intermediate data, and generates the second bitmap data by performing predetermined image processing using the generated first bitmap data.

2. The image processing device according to claim 1,

13. the predetermined image processing is processing for reducing a size of the second bitmap data; The image processing device according to claim 12 .

14. a first generation step of generating intermediate data based on the PDL data; a second generating step of generating first bitmap data and second bitmap data different from the first bitmap data based on the intermediate data; an acquisition step of acquiring a gamut mapping table that associates the second bitmap data with a print gamut based on an analysis result of the first bitmap data; a correcting step of correcting the second bitmap data based on the gamut mapping table; A quantization step of generating quantized image data based on the corrected second bitmap data.

13. An image processing method comprising:

15. A program for causing a computer to function as the image processing device according to any one of claims 1 to 13.

Citation Information

Patent Citations

  • Printer and printing method

    JP2007276425A

  • Color gamut conversion device, digital camera, color gamut conversion program, and color gamut conversion method

    JP2014033275A

  • Image processing apparatus, image processing method, and program

    JP2023060805A

  • Method of correcting color in printer, incidental information extracting device, and printer

    JP2004306465A