Program, information processing apparatus, and method for controlling the same

Abstract

To solve the problem in which: in performing color matching of color samples, a large number of colors used in print image data of a color matching target may increase the number of colors outside a color reproduction range of an image forming apparatus; in this case, visibility of an image to be displayed deteriorates in a prior art, which makes it difficult to grasp the colors outside the color reproduction range themselves in association with portions thereof.SOLUTION: A program causes a computer to execute a control method, and the control method includes acquiring print image data, and specifying colors to be outside a color reproduction range of a printing device from among colors used in the print image data. The control method includes displaying, for each of the specified colors, an area to be outside the color reproduction range in the print image data.SELECTED DRAWING: Figure 5

Description

[Technical Field]

[0001] The present invention relates to a program, an information processing device, and a control method thereof. [Background technology]

[0002] To achieve the same color reproduction as previously printed materials or color samples on an image forming device, methods for achieving color matching include adjusting the color quality of the image forming device or changing the colors of the print image data itself. Another method involves scanning a color sample using a color measurement device or scanner that measures or scans the color of printed materials to obtain scan data of the color sample. Then, based on the scan data and an output profile that defines the characteristics of the printed material, a color matching input profile is created that defines the colors to be output. In this way, a user can reproduce the colors of the color sample by printing on an image forming device using the created color matching input profile. However, color matching between the original color sample and the printed material is often performed based on the user's subjective evaluation.

[0003] The colors that can be reproduced by each image forming device are represented by a color reproduction range, which is a range plotted in a device-independent color space. Colors outside the color reproduction range of an image forming device are colors that cannot be reproduced by that image forming device. Therefore, when printing a color sample with an image forming device, depending on the image forming device, there is a possibility that some colors in the color sample can be reproduced and some cannot be reproduced.

[0004] If a user determines that the colors of the color sample cannot be reproduced properly when viewing a printed product obtained by performing color matching on the color sample as described above, it is necessary to identify from the colors of the color sample any colors that are outside the color reproduction range of the image forming device in order to perform color adjustment for the colors that cannot be reproduced. Patent Document 1 describes a method for identifying from the colors of the color sample any colors that are outside the color reproduction range of the image forming device, in which, among the colors in the print image data, colors that are outside the color reproduction range of the image forming device are determined, and the area of ​​those colors is displayed on the print image data to distinguish them from the others.

[0005] The above example focuses on checking for colors outside the color reproduction range of an image forming device when matching the colors of a color sample with a printed product when printing the color sample. However, this is not limited to color matching of color samples. For example, when a user prints print image data input from a client computer using an image forming device, there are cases where the user wants to check the differences between the colors of the printed product and the colors of the print image data. As a specific example, the user may want to check whether the colors of the print image data of a design created on the client computer match the colors of the printed product printed by the image forming device. Even in such cases, the technology described in Patent Document 1 can be used to check whether the colors of the print image data are outside the color reproduction range of the image forming device. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] Japanese Patent Application Laid-Open No. 2002-125133 Summary of the Invention [Problem to be solved by the invention]

[0007] However, with the above-described conventional technology, if the number of colors used in the print image data is large, there is a possibility that many of the colors will be outside the color reproduction range of the image forming device. In such a case, if the area determined to be a color outside the color reproduction range of the image forming device is displayed on the print image data in a way that distinguishes it from other areas, the area determined to be a color outside the color reproduction range will become larger. As a result, the visibility of the displayed print image data will be reduced, making it difficult for users to associate the colors outside the color reproduction range of the image forming device with the area.

[0008] An object of the present invention is to solve at least one of the problems of the prior art.

[0009] The object of the present invention is to provide a technology that makes it easier to grasp colors that are outside the color reproduction range of an image forming device on the print image data, even if there are a large number of colors used in the print image data that are outside the color reproduction range of the image forming device. [Means for solving the problem]

[0010] In order to achieve the above object, a program according to one aspect of the present invention has the following configuration: A program for causing a computer to execute a control method, The control method includes: an acquisition step of acquiring print image data; a specifying step of specifying colors that are outside the color reproduction range of the printing device among the colors used in the print image data; and a display control step of displaying, for each of the identified colors, an area outside the color reproduction range in the print image data. [Effects of the Invention]

[0011] According to the present invention, even if many of the colors used in the print image data are outside the color reproduction range of the image forming device, it is possible to confirm the correspondence between the colors outside the color reproduction range of the image forming device and the corresponding areas in the print image data.

[0012] Other features and advantages of the present invention will become apparent from the following description taken in conjunction with the accompanying drawings, in which the same or similar elements are designated by the same reference numerals. [Brief explanation of the drawings]

[0013] The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the invention and, together with the description, serve to explain the principles of the invention. [Figure 1] FIG. 1 is a diagram illustrating the configuration of a printing system including a client computer and an image forming apparatus according to a first embodiment of the present invention. [Figure 2]FIG. 2 is a block diagram illustrating the hardware configuration of a client computer, an image forming apparatus, and a paper discharge device according to the first embodiment. [Figure 3] FIG. 2 is a functional block diagram illustrating functions realized by software of the client computer, the image forming apparatus, and the paper discharge device according to the first embodiment. [Figure 4] 5A and 5B are diagrams showing an example of print image data and a color area determined to be outside the color reproduction range of the image forming apparatus according to the first embodiment. [Figure 5] 10 is a flowchart for explaining processing by a client computer according to the first embodiment to display colors and their areas outside the color reproduction range of the image forming apparatus on the print image data. [Figure 6] 10A and 10B are views showing an example of a UI screen for displaying print image data, colors outside the color reproduction range, and their areas displayed on a client computer according to the first embodiment. [Figure 7A] 7 is a diagram showing a state in which print image data and an input profile are received and displayed on the UI screen of FIG. 6 in the first embodiment. [Figure 7B] 10A and 10B are diagrams showing examples of a UI screen in the first embodiment when an output profile has been specified, making it possible to determine color reproducibility, and when no colors outside the color reproducibility range exist in the print image data. [Figure 8] 5A and 5B are diagrams showing examples of tables that define colors and areas outside the color reproduction range of print image data in the first embodiment. [Figure 9] FIG. 10 is a diagram showing an example in which areas corresponding to colors outside the color reproduction range on print image data are grouped and their representative colors are displayed, and when a representative color is specified, the corresponding area is highlighted in the first embodiment. [Figure 10] 10 is a flowchart for explaining processing by a client computer according to a second embodiment to display colors and their areas outside the color reproduction range of an image forming apparatus on print image data. [Figure 11] 10A and 10B are diagrams showing an example of a display of print image data and a combined area of ​​colors outside the color reproduction range, displayed on a client computer according to the second embodiment. [Figure 12] 10 is a flowchart for explaining processing by a client computer according to a third embodiment to display colors and their areas outside the color reproduction range of an image forming apparatus on print image data. [Figure 13] FIG. 11 is a diagram showing an example of a UI screen displayed on a client computer in the third embodiment. [Figure 14] FIG. 10 is a diagram showing an example of a UI for confirming whether the colors used in the design image data generated by the design generation AI in the poster production application are colors outside the color reproduction range of the image forming device in the fourth embodiment. [Figure 15] 10 is a flowchart for explaining processing when a client computer according to a fourth embodiment executes a poster creation application. DETAILED DESCRIPTION OF THE INVENTION

[0014] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. It should be noted that the following embodiments do not limit the scope of the claimed invention. Although the embodiments describe multiple features, not all of these features are necessarily essential to the invention, and multiple features may be combined in any desired manner. Furthermore, in the accompanying drawings, the same or similar components are designated by the same reference numerals, and redundant description will be omitted. In the following description, an example of the device configuration and control of an information processing device according to an embodiment of the present invention will be described using a client computer as an example, but the present invention is not limited to such a client computer.

[0015] [Embodiment 1] FIG. 1 is a diagram illustrating the configuration of a printing system including a client computer and an image forming apparatus according to a first embodiment of the present invention.

[0016] A client computer 101 is connected to an image forming apparatus 102 on the same network via a network 110. When the client computer 101 associates colors used in print image data that fall outside the color reproduction range of the image forming apparatus 102 to be used in printing with the print image data and displays the associated colors on a screen, the client computer 101 requests data from the image forming apparatus 102. Specifically, the client computer 101 requests the image forming apparatus 102 to obtain profile information via the network 110 based on the set information. This is executed by a control unit, which will be described later with reference to FIG. 3.

[0017] The image forming apparatus 102 includes a UI (user interface) panel 103, paper feed decks 104 and 105, and a scanner 106. An option 107 consisting of three paper feed stages is also connected. The image forming apparatus 102 is, for example, an electrophotographic image forming apparatus. The UI panel 103 is, for example, a user interface equipped with a capacitive touch panel. The scanner 106 has a platen on which a printed material is placed, and is capable of scanning the printed material placed thereon using a sensor and managing the scan data obtained by the scanning.

[0018] Furthermore, the image forming apparatus 102 includes a paper discharge device 108 that receives and discharges printed materials printed by the image forming apparatus 102. The paper discharge device 108 is also connected to the image forming apparatus 102 via a cable 109. The paper discharge device 108 includes several paper discharge trays, and is capable of stacking and discharging printed materials printed by the image forming apparatus 102.

[0019] A print job is generated by the client computer 101 and transmitted to the image forming apparatus 102 via the network 110. The image forming apparatus 102 then performs processing to print an image on a recording medium such as paper in accordance with the print job. Note that there may be not just one image forming apparatus 102, but multiple image forming apparatuses 102 on the network 110. Note that the connection between the client computer 101 and the image forming apparatus 102 according to the embodiment is merely an example, and it goes without saying that there are various other connection configurations besides that shown in this embodiment.

[0020] FIG. 2 is a block diagram illustrating the hardware configuration of the client computer 101, the image forming apparatus 102, and the paper discharge apparatus 108 according to the first embodiment.

[0021] First, the configuration of the client computer 101 will be described.

[0022] The CPU (Central Processing Unit) 201 controls and performs calculations in each component of the client computer 101 via a system bus 207. The CPU 201 executes programs stored in a storage unit 203 and deployed in a random access memory (RAM) 202. The RAM 202 is a type of general volatile storage device that can be directly accessed by the CPU 201 and is used as a work area for the CPU 201 or other temporary data storage areas. The storage unit 203 functions as a temporary storage area and work memory during operation of the client computer 101. The network interface (hereinafter referred to as NW I / F) 204 is connected to an NW I / F 210 of the image forming apparatus 102 on the network 110 via the network 110 and controls communication between the client computer 101 and the image forming apparatus 102. The display unit 205 is a hardware configuration that provides a user interface for visually displaying information in the client computer 101, such as a monitor display. The input unit 206 is a hardware configuration and is a user interface for inputting data to the client computer 101. For example, the input unit 206 includes a keyboard, a pointing device, etc. Depending on the form of the input unit 206, it may be a touch panel integrated with the display unit 205.

[0023] Next, the configuration of the image forming apparatus 102 will be described.

[0024] The CPU 208 controls and performs calculations in each section of the image forming apparatus 102 via a system bus 219. The CPU 208 executes programs stored in a storage unit 210 and deployed in a RAM 209. The RAM 209 is a type of general volatile storage device that can be directly accessed by the CPU 208, and is used as a work area for the CPU 208 or other temporary data storage areas. The storage unit 210 functions as a temporary storage area and work memory when the image forming apparatus 102 is in operation. The NW I / F 211 is connected to the NW I / F 204 of the client computer 101 via a cable 110, and controls communication between the client computer 101 and the image forming apparatus 102.

[0025] The scanner 212 is the hardware configuration of the scanner 106 in FIG. 1 and uses a sensor to scan printed materials and handle them as scan data. Some scanners are equipped with an ADF, a mechanism that automatically scans printed materials, while others are equipped with only a platen for reading printed materials. The UI panel 213 is the hardware configuration of the UI panel 103 in FIG. 1 and provides a user interface for performing overall operations on the image forming apparatus 102. In the first embodiment, the UI panel 212 is equipped with a capacitive touch panel. The paper feed deck I / F 214 controls communication with and control of the paper feed deck 215. The paper feed deck 215 collectively refers to the paper feed decks 104, 105, and option deck 107 in FIG. 1 as a hardware configuration. The engine I / F 216 controls communication with and control of the printer engine 217. The accessory I / F 218 is connected to the accessory I / F 224 of the paper output device 108 via the cable 109. That is, the image forming apparatus 102 communicates with the paper discharge device 108 via the accessory I / Fs 218 and 224 .

[0026] Next, the configuration of the paper discharge device 108 will be described.

[0027] The CPU 220 controls and performs calculations for each component within the paper discharge device 108 via a system bus 225, and executes programs stored in a memory unit 222 and deployed in a RAM 221. The RAM 221 is a type of general volatile storage device that can be directly accessed by the CPU 220, and is used as a work area for the CPU 220 or other temporary data storage area. The memory unit 222 functions as a temporary storage area and work memory when the paper discharge device 108 is operating. The paper discharge unit 223 monitors and controls the paper discharge operation to the paper discharge trays provided in the paper discharge device 108, as well as the loading status of each tray. The accessory I / F 224 is connected to an accessory I / F 218 of the image forming apparatus 102 via a cable 109. That is, the paper discharge device 108 communicates with the image forming apparatus 102 via the accessory I / Fs 224 and 218.

[0028] FIG. 3 is a functional block diagram for explaining functions realized by software of the client computer 101, the image forming apparatus 102, and the paper discharge apparatus 108 according to the first embodiment.

[0029] First, the functional configuration of the client computer 101 will be described.

[0030] The client computer 101 includes a data management unit 301, a data request unit 302, a UI control unit 303, a print image data input reception unit 304, a color conversion unit 305, a color classification unit 306, a representative color extraction unit 307, and a print image data input unit 308. The client computer 101 also includes a color reproduction range extraction unit 309, a color reproduction range / outside determination unit 310, a specified region extraction unit 311, and a region combination unit 312. The functions of these processing units exist as programs in the RAM 202 (hereinafter referred to as RAM 202) of the client computer 101 or in the storage unit 203 (hereinafter referred to as storage unit 203) of the client computer 101. The functions of these processing units are realized by the CPU 201 (hereinafter referred to as CPU 201) of the client computer 101 loading and executing the programs in the RAM 202. The following describes the processing of each processing unit (hereinafter referred to as each control unit) of the client computer 101. If there is insufficient data when each control unit attempts to execute a process independently, the missing data is made up by the control units executing the processes of each other.

[0031] The data management unit 301 manages profiles, print image data, and data required for each control unit to execute processing within the client computer 101. When the data management unit 301 receives a data request from each control unit, it transfers the data managed within the data management unit 301, RAM 202, or storage unit 203 to the control unit. When the data management unit 301 receives a data storage request from each control unit, it manages the received data within the data management unit 301, RAM 202, or storage unit 203.

[0032] The data request unit 302 acquires a profile (described later) stored in the RAM 209 or the storage unit 210 of the image forming apparatus 102. The data request unit 302 also stores the profile and data acquired from the image forming apparatus 102 in the data management unit 301, the RAM 202, or the storage unit 203.

[0033] The UI control unit 303 performs control to display a UI on the display unit 205 of the client computer 101. The UI control unit 303 also performs control to display a UI based on an input signal from the input unit 206.

[0034] The print image data input receiving unit 304 receives, from a user, input of print image data that the user wishes to print on the image forming apparatus 102. The print image data input receiving unit 304 also stores the received print image data in the data management unit 301.

[0035] The color conversion unit 305 converts device-dependent color values ​​into device-independent color values ​​using signal values ​​(hereinafter referred to as color values) and profiles that represent colors specified by the CPU 201. The color conversion unit 305 also converts device-independent color values ​​into device-dependent color values ​​using signal values ​​and profiles that are specified by the CPU 201.

[0036] Here, device-independent color values ​​refer to color values ​​that can be expressed without depending on the device, such as the Lab color space, while device-dependent color values ​​refer to signal values ​​that express color depending on the device, such as R (Red) G (Green) B (Blue) or C (Cyan) M (Magenta) Y (Yellow) K (Black).

[0037] Furthermore, there are various types of profiles, such as input profiles and output profiles. The input profile defines a color conversion table that indicates how device-independent color values ​​should be converted when device-dependent color values ​​are input, for example, a color conversion table from RGB values ​​to Lab color space. The output profile defines a color conversion table that indicates how device-dependent color values ​​should be converted when device-independent color values ​​are input, for example, a color conversion table from Lab color space to CMYK values. The output profile also defines a color conversion table similar to the input profile, for example, a color conversion table from CMYK values ​​to Lab color space. Generally, the output profile defines a color conversion table based on the characteristics of prints that can be output by the image forming device 102.

[0038] The color conversion unit 305 uses an input profile when converting device-dependent color values ​​to device-independent color values. The color conversion unit 305 also uses an output profile when converting device-independent color values ​​to device-dependent color values. Furthermore, the color conversion unit 305 may store signal values ​​before conversion and signal values ​​after conversion in the data management unit 301 in association with each other.

[0039] The color classification unit 306 receives at least one color value from the CPU 201 and classifies colors that are similar for the at least one color value received from the CPU 201 into at least one group. For example, the color classification unit 306 receives at least one CMYK (color signal) value from the CPU 201, calculates the Euclidean distance between the CMYK values, and determines whether the compared CMYK values ​​are similar based on whether the Euclidean distance is equal to or less than an arbitrary threshold. The color classification unit 306 classifies colors that are determined to be similar into the same group. Alternatively, the color classification unit 306 classifies at least one color value received from the CPU 201 into at least one group by applying a technique such as clustering using machine learning.

[0040] The representative color extraction unit 307 receives at least one color value from the CPU 201 and extracts a representative color. For example, the representative color extraction unit 307 receives at least one RGB value from the CPU 201, calculates the average value of the received RGB (color signal) values, and treats the calculated average value as the representative color. The representative color does not have to be the average value of the RGB values ​​received from the CPU 201, and may be, for example, the median value of the RGB values ​​received from the CPU 201.

[0041] The print image data input unit 308 performs RIP (Raster Image Processor) processing on the print image data, and inputs the RIP-processed data to the image forming apparatus 102 .

[0042] The color gamut extraction unit 309 extracts the color gamut of the image forming device 102 using an output profile based on the image forming device 102. Specifically, the color gamut extraction unit 309 extracts the color gamut of the image forming device 102 using a color conversion table that converts device-dependent color values ​​defined in the output profile based on the image forming device 102 into device-independent color values. The color gamut extraction unit 309 extracts the color gamut of the image forming device 102 using device-independent color values ​​by extracting all combinations of device-independent color values ​​listed in the color conversion table that converts device-dependent color values ​​into device-independent color values.

[0043] The color reproduction range determination unit 310 receives a color value from the CPU 201 and determines whether the color value received from the CPU 201 is inside or outside the color reproduction range of the image forming device 102 extracted by the color reproduction range extraction unit 309.

[0044] The designated area extraction unit 311 receives color values ​​from the CPU 201 and extracts an area of ​​the color values ​​received from the CPU 201 within the print image data. The designated area extraction unit 311 associates the signal values ​​received from the CPU 201 with the extracted area and stores them in the data management unit 301.

[0045] The region combining unit 312 receives at least one color value from the CPU 201 and combines the regions extracted by the designated region extracting unit 311 that correspond to the at least one color value received from the CPU 201 .

[0046] Next, the functional configuration of the image forming apparatus 102 will be described.

[0047] The image forming apparatus 102 has a print processing unit 313, a scanner control unit 314, and a data management unit 315. The functions of these processing units exist as programs in the RAM 209 or storage unit 210 of the image forming apparatus 102. The functions of these processing units are realized by the CPU 208 of the image forming apparatus 102 expanding the programs into the RAM 209 and executing them.

[0048] A print processing unit 313 controls print processing of the image forming apparatus 102. A scanner control unit 314 controls scanning of printed materials using the scanner 212 in the image forming apparatus 102. A data management unit 315 manages the configuration and capability information of the image forming apparatus 102, print jobs, scan data, and profile data.

[0049] Next, the functional configuration of the paper discharge device 108 will be described.

[0050] The paper discharge device 108 has a post-processing control unit 316. The function of the post-processing control unit 316 exists as a program in the RAM 221 or storage unit 222 of the paper discharge device 108. The function of the post-processing control unit 316 is realized by the CPU 220 of the paper discharge device 108 expanding the program in the RAM 221 and executing it, and controls the discharge of printed paper to a tray.

[0051] An example of display control in the first embodiment for displaying colors outside the color reproduction range of the image forming apparatus 102 and areas of those colors on the print image data will be described with reference to FIGS.

[0052] FIG. 4 is a diagram showing an example of print image data 401 and a color area determined to be outside the color reproduction range of the image forming apparatus 102 in the first embodiment.

[0053] Fig. 4(a) shows an example of print image data 401 according to the first embodiment. In the first embodiment, it is assumed that the print image data 401 includes values ​​based on CMYK values. Fig. 4(b) shows an example of color areas 402, 403, 404, 405, and 406 that have been determined to be outside the color reproduction range of the image forming device 102 by the color reproduction range / outside determination unit 310 of the client computer 101. Details will be described later.

[0054] 5 is a flowchart illustrating processing performed by the client computer 101 according to the first embodiment to display colors and areas outside the color reproduction range of the image forming device 102 on the print image data 401. The processing shown in this flowchart is achieved by the CPU 201 of the client computer 101 loading a program stored in the storage unit 203 into the RAM 202 and executing the program.

[0055] As a prerequisite before starting this processing, the CPU 201 displays print image data 401 on the display unit 205 (hereinafter referred to as the display unit 205) of the client computer 101. Then, colors and their areas outside the color reproduction range of the image forming device 102 are displayed for the print image data 401. The CPU 201 then accepts a request to confirm the color reproducibility between the print image data 401 and the image forming device 102. When the CPU 201 starts the processing shown in the flowchart of FIG. 5, a window 601 shown in FIG. 6 is displayed on the display unit 205.

[0056] FIG. 6 is a diagram showing an example of a UI screen for displaying print image data, colors outside the color reproduction range, and their areas, displayed on the client computer 101 according to the first embodiment.

[0057] Window 601 shows an example of a UI for displaying colors outside the color reproduction range of the image forming device 102 and areas of those colors on the print image data 401. Text 602 indicates that this is an item for setting an input profile. Button 603 is a button for selecting an input profile. The CPU 201 acquires a list of input profiles as selection candidates from the data management unit 301 of the client computer 101. When the CPU 201 detects that button 603 has been pressed, it displays the list of input profiles as selection candidates in a drop-down list. Text 604 indicates that this is an item for setting an output profile. Button 605 is a button for selecting an output profile. The CPU 201 acquires a list of output profiles as selection candidates from the data management unit 301, and when it detects that button 605 has been pressed, it displays the list of output profiles as selection candidates in a drop-down list.

[0058] Text 606 indicates that this is an item that displays print image data 401. Area 607 indicates that this is an area that displays print image data 401. Text 608 indicates that CPU 201 is accepting input of print image data 401. Text 609 indicates that this is an item that displays, in a rectangular area, colors determined to be outside the color reproduction range of image forming device 102 for print image data. Display area 610 indicates that this is an area that displays, in a rectangular area, colors determined to be outside the color reproduction range of image forming device 102 for print image data.

[0059] The following describes the processing of the flowchart in Fig. 5. Note that the order of processing and the configuration of processing of the flowchart described in the first embodiment are merely examples, and the order of processing of the flowchart may be reversed or some of the configuration of processing may be skipped.

[0060] Fig. 7A, which will be referred to in the description of the flowchart in Fig. 5, shows the print image data 401 and input profile received and displayed on the screen in Fig. 6. Fig. 7B shows an example of a UI screen in a state where color reproducibility can be determined due to the output profile being specified, and when the print image data 401 does not contain any colors outside the color reproducibility range.

[0061] First, in S501, the CPU 201 accepts input of print image data and displays the accepted print image data on the display unit 205. For example, the CPU 201 detects drag-and-drop of the print image data 401 into area 607 in FIG. 6. Specifically, the CPU 201 detects drag-and-drop of the print image data 401 using the input unit 206 and UI control unit 303 of the client computer 101. Thereafter, the CPU 201 accepts input of the print image data. Note that drag-and-drop of the print image data 401 is just one example, and other methods such as the CPU 201 displaying a file selection dialog may also be used. Upon accepting input of the print image data, the CPU 201 displays the print image data 401 in area 607, as shown in FIG. 7A(a).

[0062] Next, the process proceeds to S502, where the CPU 201 accepts the selection of an input profile. For example, the CPU 201 detects the pressing of the button 603, displays a list of input profiles as selection candidates in a drop-down list, and accepts the selection of the input profile. When the CPU 201 accepts the selection of the input profile, it displays the selected input profile on the button 603 (FIG. 7A(b)). On the other hand, there are cases where an input profile is embedded in the print image data 401. In that case, the CPU 201 may detect in S501 that the print image data 401 has an embedded input profile, and automatically accept that the embedded input profile has been selected in the print image data 401 without accepting the selection of the input profile. In the first embodiment, it is assumed that the input profile accepted in S502 includes a color conversion table from CMYK values ​​to the Lab color space.

[0063] Next, the process proceeds to S503, where the CPU 201 determines whether there is consistency between the print image data 401 and the input profile accepted in S502. Specifically, if the signal values ​​included in the print image data 401 are values ​​based on CMYK values, the CPU 201 determines whether the input profile accepted in S502 includes a color conversion table from CMYK values ​​to device-independent color values. For example, the CPU 201 determines consistency if the print image data 401 includes signal values ​​based on CMYK values ​​and the input profile accepted in S502 includes a color conversion table that converts CMYK values ​​to Lab color space. If the CPU 201 determines there is consistency between the print image data 401 and the input profile accepted in S502, the process proceeds to S504. On the other hand, if the CPU 201 determines there is no consistency between the print image data 401 and the input profile accepted in S502, the process proceeds to S502.

[0064] In S504, the CPU 201 uses the input profile received in S502 to convert the signal values ​​included in the print image data 401 into device-independent color values ​​using the color conversion unit 305 of the client computer 101. For example, the CPU 201 converts signal values ​​based on the CMYK values ​​included in the print image data 401 into Lab values ​​by using a color conversion table included in the input profile received in S502. The CPU 201 associates the signal values ​​included in the print image data 401 with the device-independent color values ​​converted in S504 and stores them in the data management unit 301, RAM 202, or storage unit 203.

[0065] 8A shows an example of a table associating signal values ​​included in the print image data 401 with device-independent color values ​​converted in S504. Column 801 shows signal values ​​included in the print image data 401. Column 802 shows color values ​​obtained by converting the signal values ​​included in the print image data 401 into device-independent color values ​​by the color conversion unit 305 of the client computer 101. Data 803 shows data associating the color values ​​before and after conversion in S504.

[0066] Next, the process proceeds to S505, where the CPU 201 accepts the selection of an output profile based on the image forming apparatus 102 that will print the print image data 401. For example, the CPU 201 detects the pressing of the button 605, displays a list of output profiles as selection candidates in a drop-down list, and accepts the selection of the output profile. When the CPU 201 accepts the selection of the output profile, it displays the selected output profile on the button 605 (FIG. 7B(a)). In the first embodiment, it is assumed that the output profile accepted in S505 includes a color conversion table from the Lab color space to CMYK values ​​and a color conversion table from CMYK values ​​to the Lab color space.

[0067] Next, the process proceeds to S506, and the CPU 201 uses the output profile received in S505 to extract the color gamut of the image forming device 201 using the color gamut extraction unit 309 of the client computer 101. When the CPU 201 has completed the extraction of the color gamut of the image forming device 201, it displays a button 701 shown in FIG. 7B(a).

[0068] Next, the process proceeds to S507, where the CPU 201 determines whether an instruction to start processing to determine whether the color is within or outside the color reproduction range has been detected. For example, when the CPU 201 detects that the button 701 has been pressed, the CPU 201 determines that an instruction to start processing to determine whether the color is within or outside the color reproduction range has been detected. When the CPU 201 detects an instruction to start processing to determine whether the color is within or outside the color reproduction range, the CPU 201 proceeds to processing in S508. When the CPU 201 does not detect an instruction to start processing to determine whether the color is within or outside the color reproduction range, the CPU 201 performs the processing in S507 again.

[0069] In S508, the CPU 201 determines, via the color gamut / outside determination unit 310 of the client computer 101, whether the color values ​​converted in S504 are outside the color gamut extracted in S506. If the CPU 201 determines that at least one color value converted in S504 is outside the color gamut extracted in S506, the process proceeds to S509. On the other hand, if the CPU 201 determines that none of the color values ​​converted in S504 are outside the color gamut extracted in S506, the process proceeds to S520, displaying text 702, as shown in FIG. 7B(b), indicating that there are no color values ​​outside the color gamut. Note that the text 702 is an example of a UI, and other text or UI display may be used.

[0070] In S509, the CPU 201 associates and acquires the signal values ​​included in the print image data 401 corresponding to the color values ​​converted in S504 that were determined in S508 to be outside the color reproduction range of the image forming device 102 with the areas of those signal values ​​within the print image data 401. Here, the tables in Figures 8(b) and 8(c) created by the CPU 201 as the results of the association and acquisition in S509 will be described.

[0071] 8B shows an example of a table associating color values ​​converted in S504 that were determined in S508 to be outside the color reproduction range of the image forming device 102 with signal values ​​included in the print image data 401 and areas within the print image data 401. Data 807 shows data associating color values ​​converted in S504 that were determined in S508 to be outside the color reproduction range of the image forming device 102 with signal values ​​included in the print image data 401 and areas within the print image data 401. Column 804 shows color values ​​converted in S504 that were determined in S508 to be outside the color reproduction range of the image forming device 102. Column 805 shows signal values ​​included in the print image data 401 before conversion in S504 for color values ​​determined in S508 to be outside the color reproduction range of the image forming device 102. The CPU 201 searches for the color values ​​determined to be outside the color reproduction range of the image forming device 102 in S508 among the device-independent color values ​​in column 802 of the table in FIG. 8A. As a result of this search, the CPU 201 stores the signal values ​​contained in the print image data 401 in column 801 on the same row as the signal values ​​contained in the print image data 401 in column 805. Column 806 contains data indicating the area of ​​the print image data 401 in which the signal values ​​contained in the print image data in column 805 are located. Specifically, the CPU 201 uses the designated area extraction unit 311 of the client computer 101 to extract the area of ​​the signal values ​​contained in the print image data 401 in column 805 and stores it as the area within the print image data 401 in column 806. Furthermore, the CPU 201 uses the designated area extraction unit 311 of the client computer 101 to create the table shown in FIG. 8C.

[0072] 8(c) shows an example of a table for explaining in detail the areas in column 806 within the print image data 401. Column 808 shows data that lists the areas in column 806 within the print image data 401 without overlapping. Column 809 shows the coordinates of where each area in column 808 is located on the print image data 401. Note that in the first embodiment, specific data in columns 806 and 808 is shown as area A, area B, etc., but other formats such as sequential numbers, random numerical values, or character strings may be used as long as they can be distinguished from each other.

[0073] The CPU 201 stores the tables of FIGS. 8(b) and 8(c) obtained in association in S509 in the data management unit 301, RAM 202, or storage unit 203. In the first embodiment, the tables are divided into two tables, FIGS. 8(b) and 8(c), but they may be combined into one table, or may be divided into three or more tables. In the first embodiment, the CPU 201 determines in S508 that the areas 402, 403, 404, 405, and 406 in FIG. 4(b) and the signal values ​​used in each area are outside the color reproduction range extracted in S506. In the first embodiment, the CPU 201 obtains the tables of FIGS. 8(b) and 8(c) as the results of S509 for the areas 402, 403, 404, 405, and 406 and the signal values ​​used in each area. 8(b) and 8(c), it will be explained that area A corresponds to area 402, area B corresponds to area 403, area C corresponds to area 404, area D corresponds to area 405, and area E corresponds to area 406. It will also be explained that the signal values ​​used in each of areas 402, 403, 404, 405, and 406 correspond to the signal values ​​included in the print image data 401 in column 805 on the same row in FIG.

[0074] Next, the process proceeds to S510, and the CPU 201 causes the color classification unit 306 of the client computer 101 to classify the signal values ​​included in the print image data 401 into at least one or more groups. Specifically, the CPU 201 causes the color classification unit 306 of the client computer 101 to classify the signal values ​​included in the print image data 401 in column 805 into at least one or more groups, and creates a table such as that shown in FIG. 8(d).

[0075] 8(d) shows an example of a table showing signal values ​​included in the print image data 401 in column 805 and the results of classification of those signal values ​​by the color classification unit 306 of the client computer 101. Column 811 is the same as the signal values ​​included in the print image data 401 in column 805. Column 812 indicates which group the signal values ​​included in the print image data 401 in column 811 have been classified into. Data 813 indicates data associating the signal values ​​included in the print image data 401 with the classified group. In the first embodiment, the description will be given assuming that the CPU 201 classifies the signal values ​​used in areas 402, 403, and 404 into group 1, and the signal values ​​used in areas 405 and 406 into group 2.

[0076] Next, the process proceeds to S511, where the CPU 201 extracts a representative color for each group classified in S510 using the representative color extraction unit 307 of the client computer 101. Specifically, the CPU 201 extracts a representative color using the representative color extraction unit 307 of the client computer 101 from the signal values ​​included in the print image data 401 of the column 811 of the same group.

[0077] Next, the process proceeds to S512, where the CPU 201 uses the area combination unit 312 of the client computer 101 to combine areas corresponding to signal values ​​included in the print image data 401 that were classified into the same group in S510. Specifically, the CPU 201 uses the area combination unit 312 of the client computer 101 to combine areas within the print image data 401 that are in the same group, based on the tables of Figures 8(b) and 8(d).

[0078] The process then proceeds to S513, where the CPU 201 associates the groups classified in S510, the representative colors extracted in S511 (hereinafter referred to as representative colors), and the areas combined in S512 (hereinafter referred to as combined areas). Specifically, the CPU 201 creates the table shown in Fig. 8(e) and stores the table shown in Fig. 8(e) in the data management unit 301, the RAM 202, or the storage unit 203.

[0079] FIG. 8(e) shows an example of a table associating groups classified in S510 with representative colors and combined areas. Column 814 shows data enumerating the groups classified in column 812 without overlapping. Column 815 shows representative colors corresponding to the groups in column 814. Column 816 shows combined areas corresponding to the groups in column 814. Data 817 shows data associating groups classified in S510 with representative colors and combined areas. Note that in the first embodiment, the combined area of ​​group 1 is shown as (area A + area B + area C) in the table of FIG. 8(e), but it may also be shown as a new area F. In that case, CPU 201 adds to the table of FIG. 8(c) information that area F is an area formed by combining areas A, B, and C.

[0080] Next, the process proceeds to step S514 , and the CPU 201 displays a list of rectangular areas of representative colors on the display unit 205 based on the representative colors in the column 815 , separately from the print image data 401 .

[0081] Figure 9 is a diagram showing an example in which, in embodiment 1, areas corresponding to colors outside the color reproduction range on the print image data are grouped and their representative colors are displayed, and when the representative color is specified, the corresponding area is highlighted.

[0082] 9A shows an example of a UI in which the CPU 201 displays rectangular areas 901 and 902, which display information indicating representative colors, in the display area 610. In the first embodiment, the CPU 201 displays rectangular area 901 corresponding to the representative color of group 1, and rectangular area 902 corresponding to the representative color of group 2. Note that the rectangular areas 901 and 902 may display the representative colors themselves, or may be any display that allows the colors to be distinguished. Also, although the display is shown as a rectangular area here, it is not limited to a rectangle.

[0083] Next, the process proceeds to S515, where the CPU 201 determines, via the input unit 206 and the UI control unit 303, whether a predetermined operation on the rectangular area displayed in S514 has been detected. For example, FIG. 9B shows that the rectangular area 901 and the mouse cursor 903 are overlapping. In the first embodiment, the determination criterion for S515 is whether the mouse cursor 903 is overlapping the rectangular area 901 or 902 displayed in S514. However, the determination may be based on an operation such as a double-click on the rectangular area 901 or 902 displayed in S514. If the CPU 201 detects that the rectangular area 901 and the mouse cursor 903 are overlapping in S514, the process proceeds to S516. On the other hand, if the CPU 201 does not detect that the rectangular area 901 or 902 and the mouse cursor 903 are overlapping in S514, the process proceeds to S519.

[0084] In S516, the CPU 201 acquires the representative color corresponding to the rectangular area 901 specified by the predetermined operation in S515, acquires the combined area associated in S513 based on the representative color, and highlights the combined area on the print image data 401.

[0085] In Fig. 9(b), the CPU 201 detects that the mouse cursor 903 has overlapped the rectangular area 901, obtains the combined area corresponding to group 1 classified in S510 from the table of Fig. 8(e), and highlights areas 904 and 905. Areas 904 and 905 are the combined area (area A + area B + area C) in column 816 of the table of Fig. 8(e) displayed as an area on the print image data 401. Note that the highlighting of areas 904 and 905 shown in Fig. 9(b) is just an example, and it is also possible to display areas by changing the outlines of areas 904 and 905 to a different color, for example.

[0086] Next, the process proceeds to S517, and the CPU 201 determines, via the input unit 206 and the UI control unit 303, whether an operation to end the highlighting of S516 has been detected. For example, the CPU 201 determines that an operation to end the highlighting has been performed by detecting that the mouse cursor 903 has moved and transitioned from a state in which it was superimposed on the rectangular region 901 displayed in S514 to a state in which it is not superimposed. In the first embodiment, the determination criterion for S517 is described as whether the mouse cursor 903 has transitioned from a state in which it was superimposed on the rectangular region 901 displayed in S514 to a state in which it is not superimposed. However, the determination criterion for S517 may also be an operation such as whether a double-click has been performed on an empty area on the window 601. When the CPU 201 detects that the mouse cursor 903 has moved and transitioned from a state in which it was superimposed on the rectangular region 901 displayed in S514 to a state in which it is not superimposed, the process proceeds to S518. If the mouse cursor 903 remains superimposed on the rectangular area 901 displayed in S514, the CPU 201 performs the process of S517 again.

[0087] In S518, the CPU 201 ends the highlighting started in S516. For example, the CPU 201 ends the highlighting in S516 and displays the display shown in FIG.

[0088] Next, the process proceeds to S519, where the CPU 201 determines whether the input unit 206 has detected an operation to end the display of the print image data 401 and the rectangular areas 901 and 902. For example, if the CPU 201 detects input of the Esc key from the input unit 206, it determines that an operation to end the display has been performed. Note that the operation to end the display of the print image data 401 and the rectangular areas 901 and 902 by input of the Esc key is one example. For example, a button for ending the display of the print image data 401 and the rectangular areas 901 and 902 may be displayed on the window 601, and the CPU 201 may detect that the button has been pressed. If the CPU 201 detects an operation to end the display of the print image data 401 and the rectangular areas 901 and 902 in S519, the process proceeds to S520. On the other hand, if the CPU 201 has not detected an operation to end the display of the print image data 401 and the rectangular areas 901 and 902, the process proceeds to S515.

[0089] In S520, the CPU 201 ends the display of the print image data 401 and rectangular areas 901 and 902, and resets the input profile received in S502 and the output profile received in S505. For example, the CPU 201 ends the display of the print image data 401 and rectangular areas 901 and 902, resets the input profile received in S502 and the output profile received in S505, and displays the UI shown in FIG.

[0090] As described above, according to the first embodiment, if any colors in the print image data 401 are outside the color reproduction range of the image forming device 102, representative colors are extracted by classifying similar colors that are outside the color reproduction range into the same group. Then, the representative colors are displayed as rectangular areas 901, 902 separate from the print image data 401, and when a predetermined operation on the displayed rectangular area 901 is detected, an area of ​​a color corresponding to the representative color of the rectangular area 901 is highlighted on the print image data 401.

[0091] There may be cases where many of the colors in the print image data 401 are outside the color reproduction range of the image forming device 102. However, the user can confirm the colors in the print image data 401 that are outside the color reproduction range of the image forming device 102 by associating them with the print image data 401. This has the effect of making it easy to identify colors that are outside the color reproduction range of the image forming device 102 when it is not possible to reproduce the colors with the color sample when matching colors with a color sample.

[0092] [Embodiment 2] If the number of colors determined to be outside the color reproduction range of the image forming apparatus 102 in S508 in the first embodiment described above increases, the number of representative color rectangular areas displayed in S514 will also increase. If the user has determined a portion of the print image data 401 for which color matching is important, it becomes difficult for the user to associate and grasp the representative color with the corresponding area in the print image data 401. As a result, it becomes difficult for the user to determine which color should be adjusted. In other words, it is time-consuming for the user to check each of the representative color rectangular areas displayed in S514 and determine whether the area highlighted in S516 matches the portion for which color matching is important.

[0093] Therefore, in the second embodiment, when a predetermined operation on a combined area corresponding to a representative color is detected, the rectangular area of ​​the representative color corresponding to the combined area is highlighted, thereby reducing the above-mentioned effort and facilitating the determination of which color should be adjusted. Note that the system configuration according to the second embodiment and the hardware configuration of each device constituting the system are the same as those of the first embodiment, and therefore their description will be omitted.

[0094] 10 is a flowchart illustrating processing by the client computer 101 according to the second embodiment to display colors and areas outside the color reproduction range of the image forming apparatus 102 on the print image data 401. The processing illustrated in this flowchart is achieved by the CPU 201 of the client computer 101 loading a program stored in the storage unit 203 into the RAM 202 and executing it. Note that steps S1001 to S1014 in FIG. 10 are similar to steps S501 to S514 in FIG. 5 of the first embodiment, and therefore description thereof will be omitted.

[0095] In S1015, the CPU 201 determines whether the input unit 206 and the UI control unit 303 have detected a predetermined operation on the area combined in S1012 on the print image data 401. From now on, the area combined in S1012 will be referred to as the combined area of ​​S1012 to distinguish it from the combined area in the first embodiment, but the combined area of ​​S1012 will be the same as that defined in the tables of Figures 8(c) and 8(e), for example.

[0096] FIG. 11 is a diagram showing an example of a display of print image data and a combined area of ​​a color outside the color reproduction range, displayed on the client computer 101 according to the second embodiment. Here, the mouse cursor 903 is shown overlapping the combined area of ​​group 1, among the combined areas combined in S1012, on the print image data 401. In the second embodiment, the determination in S1015 is based on whether the mouse cursor 903 overlaps the combined area combined in S1012 on the print image data 401. However, the determination may also be based on a double-click operation on the combined area combined in S1012. When the CPU 201 detects that the combined area of ​​S1012 on the print image data 401 overlaps with the mouse cursor 903, the CPU 201 proceeds to processing in S1016. When the CPU 201 does not detect that the combined area of ​​S1012 on the print image data 401 overlaps with the mouse cursor 903, the CPU 201 proceeds to processing in S1019.

[0097] In S1016, the CPU 201 acquires the representative color corresponding to the combined area on the print image data 401 that was specified by the predetermined operation in S1015 and that corresponds to the combined area combined in S1012, and highlights a rectangular area 1101 that corresponds to the representative color. FIG. 11 shows an example in which the CPU 201 detects that the mouse cursor 903 is overlapping with the combined area of ​​group 1 that was combined in S1012, and highlights the rectangular area 901 ( FIG. 9 ) of the representative color of group 1 that was displayed in S1014, and displays it as the rectangular area 1101. The rectangular area 1101 is highlighted by double-lining the border of the rectangular area 901, but the border color of the rectangular area 901 may also be changed. The processing in S1017 to S1020 is the same as S517 to S520 in FIG. 5 of the first embodiment, and therefore a description thereof will be omitted.

[0098] As described above, according to the second embodiment, if any colors in the print image data 401 are outside the color reproduction range of the image forming device 102, colors similar to the colors outside the color reproduction range are grouped together to extract representative colors. The representative colors are displayed as rectangular areas 901, 902 separate from the print image data 401, and when a predetermined operation on an area of ​​a color outside the color reproduction range on the print image data 401 is detected, a rectangular area 1101 of the representative color corresponding to that area is highlighted. In this way, it is possible to confirm that the colors outside the color reproduction range are associated with the corresponding areas on the print image data 401. This has the effect of making it easier to determine which colors in the print image data 401 should be adjusted when a portion of the print image data 401 for which color matching is important has been determined.

[0099] [Embodiment 3] In Patent Document 1, colors used in print image data 401 that are outside the color reproduction range of the image forming device 102 are identified, and the identified colors are displayed on the print image data 401 to be distinguished from other colors, for example, by filling them in with another color. However, if the area in the print image data 401 where the identified colors are displayed to be distinguished from other colors (hereinafter referred to as the "identified area") is large, it is visually impossible to distinguish the colors that are outside the color reproduction range of the image forming device 102. This makes it difficult for the user to grasp how many colors are outside the color reproduction range of the image forming device 102 in the identified area. Furthermore, simply distinguishing between the colors identified on the print image data 401 and other colors on the print image data 401 does not allow the user to grasp the details of the identified area when analyzing the cause of the inability to reproduce the colors of the color sample during color matching of the color sample.

[0100] Therefore, in the third embodiment, an example will be described in which the combined area corresponding to the representative color is displayed in a distinctive manner, so that even if the area of ​​the identified area is large, colors that are outside the color reproduction range of the image forming device 102 can be distinguished and recognized. Note that the system configuration according to the third embodiment and the hardware configuration of each device that constitutes the system are the same as those of the first embodiment, and therefore description thereof will be omitted.

[0101] 12 is a flowchart illustrating processing by the client computer 101 according to the third embodiment to display colors and areas outside the color reproduction range of the image forming device 102 on the print image data 401. The processing illustrated in this flowchart is achieved by the CPU 201 of the client computer 101 loading a program stored in the storage unit 203 into the RAM 202 and executing it. This processing is started when the CPU 201 receives a request to confirm the color reproducibility between the print image data 401 and the image forming device 102. Note that the processing of S1201 to S1213 in FIG. 12 is the same as the processing of S501 to S513 in FIG. 5 of the first embodiment, and therefore description thereof will be omitted.

[0102] FIG. 13 is a diagram showing an example of a UI screen displayed on the client computer 101 in the third embodiment.

[0103] 13(a) is a diagram showing an example of a UI displayed on the client computer 101 when the processes of S1201 to S1213 are completed in the third embodiment. The display switching button 1301 will be described later. Here, the CPU 201 may display rectangular areas 901 and 902 of the representative colors extracted in S1211 by executing the same process as S514 in the first embodiment.

[0104] In S1214, the CPU 201 determines whether an operation to switch the highlight display of the combined regions in S1212 has been detected via the input unit 206 and the UI control unit 303. For example, the CPU 201 makes this determination based on whether a press of the display switch button 1301 shown in Fig. 13(a) has been detected. If the CPU 201 detects in S1214 that a press of the display switch button 1301 for switching the highlight display of the combined regions in S1212 has been detected, the process proceeds to S1215. On the other hand, if the CPU 201 does not detect an operation to switch the highlight display of the combined regions in S1212, the process proceeds to S1218.

[0105] From here on, to distinguish it from the combined area in embodiment 1, the area combined in S1212 will be referred to as the combined area of ​​S1212, but the combined area of ​​S1212 will be the same as that defined in the tables of Figures 8(c) and 8(e).

[0106] In S1215, the CPU 201 highlights the binding region of S1212 so that it can be identified.

[0107] FIG. 13B shows an example in which the combined region of S1212 is highlighted in step S1215. In FIG. 13B, the CPU 201 highlights the combined regions of S1212 of all groups listed in the table of FIG. 8E on the print image data 401. Here, regions 1302 and 1303 correspond to the combined region of S1212 of group 1 in FIG. 8E (region A + region B + region C). Regions 1304 and 1305 correspond to the combined region of S1212 of group 2 in FIG. 8E (region D + region E). Because regions 1302 and 1303 and regions 1304 and 1305 belong to different groups, the CPU 201 highlights each region with a different pattern. The highlighting shown in FIG. 13B is merely an example, and the borders of the combined regions of S1212 of group 1 and group 2 may be displayed in different colors. Furthermore, the CPU 201 may display a rectangular region 901 of the representative color of group 1 and a rectangular region 902 of the representative color of group 2 in the display area 610 .

[0108] Next, the process proceeds to S1216, where the CPU 201 determines whether the input unit 206 and the UI control unit 303 have detected an operation to end the highlighting performed in S1215. For example, the CPU 201 makes this determination based on whether the display switching button 1301 has been pressed. If the CPU 201 detects an operation to end the highlighting performed in S1215, the process proceeds to S1217. On the other hand, if the CPU 201 has not detected an operation to end the highlighting performed in S1215, the process proceeds to S1214. In S1217, the CPU 201 ends the highlighting performed in S1215. For example, the CPU 201 ends the highlighting performed in S1215 and displays the display shown in FIG. 13(a), for example. The processes in S1218 to S1219 are the same as the processes in S519 to S520 in FIG. 5 of the first embodiment, and therefore their description will be omitted.

[0109] As described above, according to the third embodiment, if any colors in the print image data 401 are outside the color reproduction range of the image forming device 102, the areas of colors that are outside the color reproduction range on the print image data 401 are highlighted and displayed one by one. Therefore, even if the area of ​​the areas of colors that are outside the color reproduction range on the print image data 401 is large, it is possible to identify the areas of colors that are outside the color reproduction range on the print image data 401. This allows the user to easily grasp how many colors are outside the color reproduction range within the areas of colors that are outside the color reproduction range on the print image data 401. Another advantage is that when analyzing the cause of inability to reproduce the colors of a color sample in color matching with the color sample, the user can easily grasp the details of the areas of colors that are outside the color reproduction range on the print image data.

[0110] [Embodiment 4] There is layout software that creates design image data by arranging objects such as shapes, image data, and text boxes. For example, there is a poster creation application. There is also existing technology of AI (Artificial Intelligence) (hereinafter referred to as design generation AI) that generates design image data based on the input information by inputting image data and several strings of characters. For example, image data, a string such as the title of the design (hereinafter referred to as content string), and a string describing the type of design you want to create (hereinafter referred to as design instruction string) are input, and the design generation AI generates design image data based on the input information. Specifically, there is a method that determines how many points the input design instruction string corresponds to on multiple predetermined evaluation axes, and generates design image data based on the determined points.

[0111] Services that combine such layout software and design generation AI are available. However, even if a design generation AI generates design image data that a user prefers, there are cases in which the colors used in the design image data generated by the design generation AI are colors that the user did not intend. As a result, when the user attempts to print on an image forming device, the colors used in the design image data may be outside the color reproduction range of the image forming device. Therefore, in a third embodiment, a method for checking the color reproducibility of design image data generated by a design generation AI and an image forming device is described. Note that the system configuration of the fourth embodiment and the hardware configuration of each device constituting the system are the same as those of the first embodiment, and therefore a description thereof will be omitted.

[0112] Figure 14 is a diagram showing an example of a UI for confirming whether the colors used in the design image data 1402 generated by the design generation AI in the poster production application 1401 are colors outside the color reproduction range of the image forming device 102 in embodiment 4.

[0113] 14(a), a poster creation application 1401, using the configuration described in the first embodiment, determines that a color 1403 within an area of ​​design image data 1402 and a color 1404 within an area are outside the color reproduction range of the image forming device 201. Then, the respective colors are displayed in rectangular areas 1405 and 1406.

[0114] 14(b) shows an example of a UI in which the mouse cursor 903 is superimposed on a rectangular area 1405 in a poster creation application 1401. The poster creation application 1401, using the configuration described in the first embodiment, detects that the mouse cursor 903 is superimposed on the rectangular area 1405, and highlights areas 1408 and 1409 of the color 1403 within the area corresponding to the rectangular area 1405.

[0115] For example, when the poster production application 1401 receives an instruction from a user, the poster production application 1401 may regenerate the design image data 1402 using a design generation AI based on the received instruction. Specifically, the process is as shown in the flowchart in FIG.

[0116] 15 is a flowchart illustrating the processing performed when the client computer 101 according to the fourth embodiment executes the poster creation application 1401. The processing illustrated in this flowchart is initiated when an instruction to regenerate design image data is received. For example, when the poster creation application 1401 detects that the button 1407 for regenerating the design in FIG. 14 has been pressed, the processing illustrated in the flowchart in FIG. 15 is initiated.

[0117] In S1501, CPU 201 executing poster production application 1401 accepts the selection of at least one color determined to be outside the color reproduction range (color within area 1403, color within area 1404, or both colors). Next, the process proceeds to S1502, and CPU 201 executing poster production application 1401 instructs design generation AI to generate design image data 1402 so as not to use the color accepted in S1501.

[0118] According to the fourth embodiment, the poster production application 1401 can check whether the colors used in the design image data 1402 generated by the design generation AI are outside the color reproduction range of the image forming device 102. Furthermore, the poster production application 1401 can instruct the design generation AI to regenerate the design image data 1402 so as not to use colors outside the color reproduction range of the image forming device 102. Therefore, the possibility that colors outside the color reproduction range of the image forming device 102 will be used in the design image data 1402 generated the second time or later is reduced. As a result, the colors used in the design image data 1402 generated by the design generation AI are colors that are likely to be printable by the image forming device 102. In this way, the user can check the color reproducibility of the design image data 1402 displayed by the poster production application 1401 on the image forming device 102.

[0119] (Other embodiments) The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0120] The present specification and drawings disclose the following information processing device, its control method, and program.

[0121] (Item 1) A program for causing a computer to execute a control method, The control method includes: an acquisition step of acquiring print image data; a specifying step of specifying colors that are outside the color reproduction range of the printing device among the colors used in the print image data; a display control step of displaying, for each of the identified colors, an area that is outside the color reproduction range in the print image data; A program comprising:

[0122] (Item 2) The control method further comprises: an acquisition step of associating and acquiring the color identified as being outside the color reproduction range in the identification step with an area of ​​the identified color included in the print image data; a combining step of grouping areas of colors similar to the colors identified as being outside the color reproduction range, which are included in the print image data, and combining areas belonging to the same group; an extraction step of extracting a representative color of the areas belonging to the same group, The program described in item 1 is characterized in that the display control process displays the print image data and information indicating the representative color extracted by the extraction process side by side, and highlights an area included in the print image data that belongs to the group corresponding to the representative color in response to a predetermined operation on the information indicating the representative color.

[0123] (Item 3) The program described in item 1, characterized in that the identification process identifies colors used in the print image data that are outside the color reproduction range of the printing device based on the input profile of the print image data and the output profile of the printing device.

[0124] (Item 4) 3. The program according to item 2, wherein the extracting step extracts an average value of the values ​​of color signals included in the areas belonging to the same group as the representative color.

[0125] (Item 5) 3. The program according to item 2, wherein the extracting step extracts a median value of the values ​​of color signals included in the areas belonging to the same group as the representative color.

[0126] (Item 6) 3. The program according to item 2, wherein the similar colors are colors in which the Euclidean distance between the color signal values ​​of the colors determined to be outside the color reproduction range is equal to or less than a predetermined threshold value.

[0127] (Item 7) The program described in any one of items 2 to 6, characterized in that the information indicating the representative color is displayed in a display area separate from the area displaying the print image data, and the specified operation on the information indicating the representative color is moving a cursor to the display area of ​​the information indicating the representative color.

[0128] (Item 8) The program described in any one of items 2 to 6, characterized in that the information indicating the representative color is displayed in a display area separate from the area displaying the print image data, and the specified operation on the information indicating the representative color is a click operation on the display area of ​​the information indicating the representative color.

[0129] (Item 9) The bonding step a classification step of classifying the similar colors into the same group for the colors determined to be outside the color reproduction range, 9. The program according to any one of items 2 to 8, characterized in that for each color belonging to the same group classified by the classification step, areas of colors determined to be outside the color reproduction range are combined.

[0130] (Item 10) The control method further comprises: 10. The program according to any one of items 2 to 9, further comprising a step of storing the representative color extracted in the extraction step and the combined area combined in the combining step in association with each other.

[0131] (Item 11) The program described in item 10 is characterized in that the display control process further highlights an area showing the representative color corresponding to the combined area in accordance with a predetermined operation on the combined area included in the print image data.

[0132] (Item 12) 12. The program according to any one of items 2 to 11, wherein the display control step further highlights the combined regions that belong to the same group and are combined in the combining step so that they can be identified.

[0133] (Item 13) The control method further comprises: accepting a selection of at least one color from among the colors determined to be outside the color reproduction range; 13. The program according to any one of items 1 to 12, further comprising an instruction step of instructing generation of the print image data so as not to use the accepted color.

[0134] (Item 14) An information processing device, An acquisition means for acquiring print image data; a specifying means for specifying colors that are outside the color reproduction range of the printing device among the colors used in the print image data; a display control means for displaying an area outside the color reproduction range in the print image data for each color identified by the identification means; An information processing device comprising:

[0135] (Item 15) an acquisition unit that acquires a color identified by the identification unit as being outside the color reproduction range and an area of ​​the identified color included in the print image data in association with the color; a combining unit that groups areas of colors similar to the color identified as being outside the color reproduction range and that are included in the print image data, and combines areas that belong to the same group; and extracting means for extracting representative colors of the areas belonging to the same group, The information processing device described in item 14 is characterized in that the display control means displays the print image data and information indicating the representative color extracted by the extraction means side by side, and in response to a predetermined operation on the information indicating the representative color, highlights an area included in the print image data that belongs to the group corresponding to the representative color.

[0136] (Item 16) The information processing device described in item 14, characterized in that the identification means identifies colors used in the print image data that are outside the color reproduction range of the printing device based on the input profile of the print image data and the output profile of the printing device.

[0137] (Item 17) Item 16. The information processing device according to item 15, wherein the extraction means extracts an average value of the values ​​of color signals included in the areas belonging to the same group as the representative color.

[0138] (Item 18) Item 16. The information processing device according to item 15, wherein the extraction means extracts a median value of the values ​​of color signals included in the areas belonging to the same group as the representative color.

[0139] (Item 19) 19. The information processing device according to any one of items 15 to 18, characterized in that the similar colors are colors in which the Euclidean distance between the color signal values ​​of the colors determined to be outside the color reproduction range is less than a predetermined threshold.

[0140] (Item 20) An information processing device described in any one of items 15 to 19, characterized in that the information indicating the representative color is displayed in a display area separate from the area displaying the print image data, and the specified operation on the information indicating the representative color is moving a cursor to the display area of ​​the information indicating the representative color.

[0141] (Item 21) An information processing device described in any one of items 15 to 19, characterized in that the information indicating the representative color is displayed in a display area separate from the area displaying the print image data, and the specified operation on the information indicating the representative color is a click operation on the display area of ​​the information indicating the representative color.

[0142] (Item 22) The coupling means a classification means for classifying the similar colors into the same group with respect to the colors determined to be outside the color reproduction range, 22. The information processing device according to any one of items 15 to 21, characterized in that for each color belonging to the same group classified by the classification means, areas of colors determined to be outside the color reproduction range are combined.

[0143] (Item 23) 23. The information processing device according to any one of items 15 to 22, further comprising: a storage unit that stores the representative color extracted by the extraction unit and the combined area combined by the combination unit in association with each other.

[0144] (Item 24) The information processing device described in item 23 is further characterized in that the display control means highlights an area showing the representative color corresponding to the combined area in accordance with a predetermined operation on the combined area included in the print image data.

[0145] (Item 25) 25. The information processing device according to any one of items 15 to 24, wherein the display control means further highlights the combined regions that belong to the same group and are combined by the combining means so that they can be identified.

[0146] (Item 26) a means for accepting a selection of at least one color from among the colors determined to be outside the color reproduction range; 26. The information processing apparatus according to any one of items 14 to 25, further comprising an instruction unit that instructs generation of the print image data so as not to use the accepted color.

[0147] (Item 27) A control method for controlling an information processing device, comprising: an acquisition step of acquiring print image data; a specifying step of specifying colors that are outside the color reproduction range of the printing device among the colors used in the print image data; a display control step of displaying, for each of the identified colors, an area that is outside the color reproduction range in the print image data; A control method comprising:

[0148] (Item 28) an acquisition step of associating and acquiring the color identified as being outside the color reproduction range in the identification step with an area of ​​the identified color included in the print image data; a combining step of grouping areas of colors similar to the colors identified as being outside the color reproduction range, which are included in the print image data, and combining areas belonging to the same group; and extracting a representative color of the areas belonging to the same group, Item 28 is a control method described in item 27, characterized in that the display control process displays the print image data and information indicating the representative color extracted by the extraction process side by side, and highlights an area included in the print image data that belongs to the group corresponding to the representative color in response to a predetermined operation on the information indicating the representative color.

[0149] (Item 29) Item 28. The control method described in item 27, wherein the identification process identifies colors used in the print image data that are outside the color reproduction range of the printing device based on the input profile of the print image data and the output profile of the printing device.

[0150] (Item 30) Item 29. The control method according to item 28, wherein the extracting step extracts an average value of the values ​​of the color signals included in the areas belonging to the same group as the representative color.

[0151] (Item 31) Item 29. The control method according to item 28, wherein the extraction step extracts a median value of the color signal values ​​included in the areas belonging to the same group as the representative color.

[0152] (Item 32) Item 29. A control method according to item 28, characterized in that the similar colors are colors in which the Euclidean distance between the color signal values ​​of the colors determined to be outside the color reproduction range is equal to or less than a predetermined threshold value.

[0153] (Item 33) A control method described in any one of items 28 to 32, characterized in that the information indicating the representative color is displayed in a display area separate from the area displaying the print image data, and the specified operation on the information indicating the representative color is moving a cursor to the display area of ​​the information indicating the representative color.

[0154] (Item 34) A control method described in any one of items 28 to 32, characterized in that the information indicating the representative color is displayed in a display area separate from the area displaying the print image data, and the specified operation on the information indicating the representative color is a click operation on the display area of ​​the information indicating the representative color.

[0155] (Item 35) The bonding step a classification step of classifying the similar colors into the same group for the colors determined to be outside the color reproduction range, 35. A control method according to any one of items 28 to 34, characterized in that for each color belonging to the same group classified by the classification step, areas of colors determined to be outside the color reproduction range are combined.

[0156] (Item 36) 36. A control method according to any one of items 28 to 35, further comprising a step of storing the representative color extracted by the extraction step and the combined area combined by the combination step in association with each other.

[0157] (Item 37) The control method described in item 36, characterized in that the display control process further highlights an area showing the representative color corresponding to the combined area included in the print image data in accordance with a predetermined operation on the combined area.

[0158] (Item 38) The control method according to any one of items 28 to 37, wherein the display control step further highlights the combined regions that belong to the same group and are combined by the combining step so that they can be identified.

[0159] (Item 39) accepting a selection of at least one color from among the colors determined to be outside the color reproduction range; 39. The control method according to any one of items 27 to 38, further comprising an instruction step of instructing generation of the print image data so as not to use the accepted color.

[0160] The present invention is not limited to the above-described embodiments, and various modifications and variations can be made without departing from the spirit and scope of the present invention. Therefore, the following claims are appended to apprise the public of the scope of the present invention. [Explanation of symbols]

[0161] 101...client computer, 102...image forming apparatus, 103...UI panel, 201...CPU (client computer), 205...display unit, 206...storage unit (client computer), 301...data management unit, 306...color classification unit, 307...representative color extraction unit, 309...color reproduction range extraction unit, 310...color reproduction range / outside determination unit, 311...designated region extraction unit, 312...region combination unit

Claims

1. A program for causing a computer to execute a control method, The control method includes: an acquisition step of acquiring print image data; a specifying step of specifying colors that are outside the color reproduction range of the printing device among the colors used in the print image data; a display control step of displaying, for each of the identified colors, an area that is outside the color reproduction range in the print image data; A program comprising:

2. The control method further comprises: an acquisition step of associating and acquiring the color identified as being outside the color reproduction range in the identification step with an area of ​​the identified color included in the print image data; a combining step of grouping areas of colors similar to the colors identified as being outside the color reproduction range, which are included in the print image data, and combining areas belonging to the same group; an extraction step of extracting a representative color of the areas belonging to the same group, The program described in claim 1, characterized in that the display control process displays the print image data and information indicating the representative color extracted by the extraction process side by side, and highlights an area included in the print image data that belongs to the group corresponding to the representative color in response to a predetermined operation on the information indicating the representative color.

3. The program according to claim 1, characterized in that the identification step identifies, among the colors used in the print image data, colors that fall outside the color reproduction range of the printing device based on the input profile of the print image data and the output profile of the printing device.

4. 3. The program according to claim 2, wherein the extracting step extracts an average value of the values ​​of the color signals included in the areas belonging to the same group as the representative color.

5. 3. The program according to claim 2, wherein the extracting step extracts a median value of the values ​​of color signals included in the areas belonging to the same group as the representative color.

6. 3. The program according to claim 2, wherein the similar colors are colors in which the Euclidean distance between the color signal values ​​of the colors determined to be outside the color reproduction range is equal to or less than a predetermined threshold value.

7. The program according to claim 2, characterized in that the information indicating the representative color is displayed in a display area separate from the area displaying the print image data, and the specified operation on the information indicating the representative color is moving a cursor to the display area of ​​the information indicating the representative color.

8. The program described in claim 2, characterized in that the information indicating the representative color is displayed in a display area separate from the area displaying the print image data, and the specified operation on the information indicating the representative color is a click operation on the display area of ​​the information indicating the representative color.

9. The bonding step comprises: a classification step of classifying the similar colors into the same group for the colors determined to be outside the color reproduction range, 3. The program according to claim 2, wherein for each color belonging to the same group classified in the classification step, areas of colors determined to be outside the color reproduction range are combined.

10. The control method further comprises:

3. The program according to claim 2, further comprising a step of storing the representative color extracted in the extracting step and the combined area combined in the combining step in association with each other.

11. The program according to claim 10, characterized in that the display control process further highlights an area showing the representative color corresponding to the combined area included in the print image data in accordance with a predetermined operation on the combined area.

12. 3. The program according to claim 2, wherein the display control step further highlights the combined regions that belong to the same group and are combined in the combining step so that the combined regions can be identified.

13. The control method further comprises: accepting a selection of at least one color from among the colors determined to be outside the color reproduction range; 2. The program according to claim 1, further comprising an instruction step of instructing generation of the print image data so as not to use the accepted color.

14. An information processing device, An acquisition means for acquiring print image data; a specifying means for specifying colors that are outside the color reproduction range of the printing device among the colors used in the print image data; a display control means for displaying an area outside the color reproduction range in the print image data for each color identified by the identification means; An information processing device comprising:

15. an acquisition unit that acquires a color identified by the identification unit as being outside the color reproduction range and an area of ​​the identified color included in the print image data in association with the color; a combining unit that groups areas of colors similar to the color identified as being outside the color reproduction range and that are included in the print image data, and combines areas that belong to the same group; and extracting means for extracting representative colors of the areas belonging to the same group, The information processing device according to claim 14, characterized in that the display control means displays the print image data and information indicating the representative color extracted by the extraction means side by side, and highlights an area included in the print image data that belongs to the group corresponding to the representative color in response to a predetermined operation on the information indicating the representative color.

16. 15. The information processing apparatus according to claim 14, wherein the specifying unit specifies, from among the colors used in the print image data, colors that fall outside the color reproduction range of the printing device, based on an input profile of the print image data and an output profile of the printing device.

17. 16. The information processing apparatus according to claim 15, wherein the extracting means extracts an average value of the values ​​of color signals included in the areas belonging to the same group as the representative color.

18. 16. The information processing apparatus according to claim 15, wherein said extracting means extracts a median value of the values ​​of color signals included in the areas belonging to the same group as said representative color.

19. 16. The information processing apparatus according to claim 15, wherein the similar colors are colors in which the Euclidean distance between the values ​​of the color signals of the colors determined to be outside the color reproduction range is equal to or less than a predetermined threshold value.

20. 16. The information processing device according to claim 15, wherein the information indicating the representative color is displayed in a display area separate from the area displaying the print image data, and the predetermined operation on the information indicating the representative color is moving a cursor to the display area of ​​the information indicating the representative color.

21. 16. The information processing device according to claim 15, wherein the information indicating the representative color is displayed in a display area separate from the area displaying the print image data, and the predetermined operation on the information indicating the representative color is a click operation on the display area of ​​the information indicating the representative color.

22. The coupling means is a classification means for classifying the similar colors into the same group with respect to the colors determined to be outside the color reproduction range, 16. The information processing apparatus according to claim 15, wherein, for each color belonging to the same group classified by the classification means, areas of colors determined to be outside the color reproduction range are combined.

23. 16. The information processing apparatus according to claim 15, further comprising: means for storing the representative color extracted by the extracting means and the combined area combined by the combining means in association with each other.

24. 24. The information processing apparatus according to claim 23, wherein the display control means further highlights an area showing the representative color corresponding to the combined area in response to a predetermined operation on the combined area included in the print image data.

25. 16. The information processing apparatus according to claim 15, wherein the display control means further highlights the combined regions that belong to the same group and are combined by the combining means so that the combined regions can be identified.

26. a means for accepting a selection of at least one color from among the colors determined to be outside the color reproduction range; 15. The information processing apparatus according to claim 14, further comprising an instruction unit for instructing generation of the print image data so as not to use the accepted color.

27. A control method for controlling an information processing device, comprising: an acquisition step of acquiring print image data; a specifying step of specifying colors that are outside the color reproduction range of the printing device among the colors used in the print image data; a display control step of displaying, for each of the identified colors, an area that is outside the color reproduction range in the print image data; A control method comprising:

28. an acquisition step of associating and acquiring the color identified as being outside the color reproduction range in the identification step with an area of ​​the identified color included in the print image data; a combining step of grouping areas of colors similar to the colors identified as being outside the color reproduction range, which are included in the print image data, and combining areas belonging to the same group; and extracting a representative color of the areas belonging to the same group, The control method described in claim 27, characterized in that the display control process displays the print image data and information indicating the representative color extracted by the extraction process side by side, and highlights an area included in the print image data that belongs to the group corresponding to the representative color in response to a predetermined operation on the information indicating the representative color.

29. The control method according to claim 27, wherein the specifying step specifies, among the colors used in the print image data, colors that fall outside the color reproduction range of the printing device based on an input profile of the print image data and an output profile of the printing device.

30. 29. The control method according to claim 28, wherein said extracting step extracts an average value of values ​​of color signals included in the areas belonging to the same group as said representative color.

31. 29. The control method according to claim 28, wherein said extracting step extracts a median value of the values ​​of color signals included in the areas belonging to the same group as said representative color.

32. 29. The control method according to claim 28, wherein the similar colors are colors in which the Euclidean distance between the values ​​of the color signals of the colors determined to be outside the color reproduction range is equal to or less than a predetermined threshold value.

33. The control method according to claim 28, characterized in that the information indicating the representative color is displayed in a display area separate from the area displaying the print image data, and the specified operation on the information indicating the representative color is moving a cursor to the display area of ​​the information indicating the representative color.

34. The control method described in claim 28, characterized in that the information indicating the representative color is displayed in a display area separate from the area displaying the print image data, and the specified operation on the information indicating the representative color is a click operation on the display area of ​​the information indicating the representative color.

35. The bonding step comprises: a classification step of classifying the similar colors into the same group for the colors determined to be outside the color reproduction range, 29. The control method according to claim 28, wherein, for each color belonging to the same group classified in the classification step, the areas of the colors determined to be outside the color reproduction range are combined.

36. 29. The control method according to claim 28, further comprising the step of storing the representative color extracted in the extracting step and the combined region combined in the combining step in association with each other.

37. The control method according to claim 36, characterized in that the display control step further highlights an area showing the representative color corresponding to the combined area included in the print image data in accordance with a predetermined operation on the combined area.

38. 29. The control method according to claim 28, wherein the display control step further highlights the combined regions that belong to the same group and are combined in the combining step so as to be identifiable.

39. accepting a selection of at least one color from among the colors determined to be outside the color reproduction range; 28. The control method according to claim 27, further comprising an instruction step of instructing generation of the print image data so as not to use the accepted color.

Images