Extraction device, extraction method, and extraction program

Abstract

To provide an extraction device, an extraction method, and an extraction program with which an appropriate colorimetric portion can be extracted.SOLUTION: An extraction device comprises: an acquisition unit that acquires information on a portion to which people pay attention in image information based on image data; and an extraction unit that, on the basis of the information on the portion to which people pay attention, extracts a colorimetric portion of an image formed by an image forming apparatus on the basis of the image data.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an extraction device, an extraction method, and an extraction program. [Background technology]

[0002] Printing processes using image forming devices require color stability in continuous output. However, color fluctuates over time during printing, making color adjustment necessary. Color adjustment is typically performed by printing a color chart with an array of color adjustment patches and measuring the color chart using the image forming device's sensor (colorimetry unit) or an external colorimetry device. The colorimetric values ​​obtained by measuring the color chart are compared with reference values, and color adjustment is performed based on the difference between the colorimetric values ​​and the reference values.

[0003] Furthermore, Patent Document 1 discloses a configuration in which a color measurement target area is extracted from a printed image, rather than a color chart, and the color measurement target area is measured using a sensor in an image forming device to perform color adjustment. In this configuration, the color measurement target area is extracted by calculating flatness for an area with little density change from the printed image (an area suitable for color measurement), and extracting the color measurement points. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Publication No. 2019-149639 Summary of the Invention [Problem to be solved by the invention]

[0005] However, there are cases where the area extracted by the device as an area suitable for colorimetry, as in the configuration described in Patent Document 1, differs from the area that humans focus on in the image. Color variations in areas that humans focus on are more easily recognized by humans, so the configuration described in Patent Document 1 may not be able to extract an appropriate area for colorimetry.

[0006] An object of the present invention is to provide an extraction device, an extraction method, and an extraction program that are capable of extracting appropriate color measurement points. [Means for solving the problem]

[0007] The extraction device according to the present invention comprises: an acquisition unit that acquires information about a point of interest of a person in image information based on image data; an extraction unit that extracts color measurement points of an image formed based on the image data by an image forming apparatus based on information about the target points; Equipped with.

[0008] The extraction method according to the present invention comprises: An extraction method using an extraction device, acquiring information about a location of interest of a person in image information based on image data; extracting a color measurement point of an image formed based on the image data by an image forming apparatus based on information about the target point; Includes.

[0009] The extraction program according to the present invention comprises: An extraction program executed by an extraction device, On the computer, A process of acquiring information about a location of interest of a person in image information based on image data; A process of extracting a color measurement point of an image formed based on the image data by an image forming apparatus based on information about the target point; Execute the following. [Effects of the Invention]

[0010] According to the present invention, it is possible to extract appropriate color measurement points. [Brief explanation of the drawings]

[0011] [Figure 1] 1 is a block diagram showing an extraction system including an extraction device according to an embodiment of the present invention. [Figure 2] FIG. 10 is a diagram illustrating an example of image information. [Figure 3] FIG. 10 is a diagram showing an example of displaying information about a point of interest in the extraction device. [Figure 4] 10A and 10B are diagrams illustrating an example of display of information related to colorimetry of a first image in the extraction device. [Figure 5] 10 is a flowchart illustrating an example of an extraction control operation in the extraction device. [Figure 6] FIG. 10 is a block diagram showing an extraction system including an extraction device according to a modified example. [Figure 7] 10 is a flowchart illustrating an example of an operation of extraction control in an extraction device according to a modified example. [Figure 8] 10A and 10B are diagrams illustrating an example of display of information on color measurement intervals in the extraction device. [Figure 9] 10 is a flowchart illustrating an example of an operation of colorimetry interval calculation control in an extraction device according to a modified example. DETAILED DESCRIPTION OF THE INVENTION

[0012] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the present invention will now be described in detail with reference to the accompanying drawings. Fig. 1 is a block diagram showing an extraction system 1 including an extraction device according to an embodiment of the present invention.

[0013] As shown in FIG. 1, the extraction system 1 is a system that extracts color measurement points of a printed image formed by an image forming device 2, and includes the image forming device 2, a storage device 3, an analysis device 4, and an extraction device 100.

[0014] The image forming device 2 is an apparatus capable of successively forming images on each of a plurality of recording media, and is connected to the extraction device 100 via a known network. In addition to an image forming unit having an image forming function, the image forming device 2 has a communication unit 2A, a color measurement unit 2B, and an image formation control unit 2C.

[0015] The communication unit 2A transmits image information based on predetermined image data to the extraction device 100 via a network, and receives information on color measurement locations from the extraction device 100.

[0016] The colorimetry unit 2B is a colorimetry device such as a scanner connected to the image forming apparatus 2. The colorimetry unit 2B measures the color of a print image formed on a recording medium by the image forming apparatus 2 at a preset colorimetry interval. The colorimetry interval is the interval (number of recording media) between colorimetry measurements in a print job. For example, if the colorimetry interval is set to 10 sheets, colorimetry by the colorimetry unit 2B is performed every time 10 sheets are printed in the print job.

[0017] The image formation control unit 2C includes a CPU (Central Processing Unit), ROM (Read Only Memory), RAM (Random Access Memory), etc. The CPU reads a program corresponding to the processing content from the ROM, loads it into the RAM, and works with the loaded program to centrally control the operation of each block of the image forming device 2. The image formation control unit 2C controls the image formation processing in the image forming unit as well as the colorimetric processing in the colorimetric unit 2B.

[0018] Specifically, the image formation control unit 2C controls the colorimetric unit 2B to measure the colorimetry points extracted by the extraction device 100 in the first image (print image) formed by the image forming unit. Then, the image formation control unit 2C executes correction processing for the second image, which is formed after the first image, based on the colorimetric information of the colorimetric points of the first image. More specifically, if the difference between the colorimetric values ​​of the colorimetric points of the first image and the reference values ​​(reference information) exceeds the allowable range, the image formation control unit 2C executes correction processing for the second image so that the color values ​​of the image data related to the colorimetric values ​​become the reference values ​​when printed on a recording medium.

[0019] The reference information is information indicating the reference color values ​​of the print image on the recording medium on which the image is formed. The reference information may be, for example, the colorimetric values ​​of the print image on the first recording medium in the print job, or may be values ​​defined based on the image data.

[0020] The tolerance is a permissible range of deviation from a reference value, and can be set appropriately by the user or the device.

[0021] The correction process for the second image is a process for correcting image data so as to cancel out the difference between the colorimetric values ​​and the reference values. The correction process for the second image may be any correction process as long as it is an adjustment related to color adjustment, such as profile creation, tone curve adjustment, engine adjustment, controller calibration, etc.

[0022] In this way, in the image forming apparatus 2, correction processing is performed based on the colorimetric information of the colorimetric points extracted from the extraction apparatus 100, thereby performing color adjustment for color variations over time in a print job.

[0023] The storage device 3 is, for example, a cloud server or the like, and stores information related to the colorimetry of the first image transmitted from the extraction device 100 via a known network. The information related to the colorimetry of the first image may include colorimetry history information, such as information on the colorimetry values ​​of the colorimetry points of the first image, information indicating whether the difference between the colorimetry values ​​and the reference values ​​exceeds an allowable range, and information indicating the difference between the colorimetry values ​​and the reference values.

[0024] The analysis device 4 is a device that analyzes the degree of human attention based on image information and extracts parts that attract human attention (parts of interest) from the image information. The analysis device 4 has an input unit 4A, an output unit 4B, and an analysis control unit 4C.

[0025] The input unit 4A acquires image information based on the image data of the print job from the extraction device 100 via the network and inputs it to the analysis control unit 4C. In this embodiment, the image information is information obtained by converting the image data of the print job for image formation (RIP (raster image processor) image). Note that the input unit 4A may also acquire the image data of the print job from the image forming device 2.

[0026] The output unit 4B outputs to the extraction device 100 information on the portion of interest extracted based on the analysis result of the analysis control unit 4C of the degree of human attention to the image information.

[0027] The analysis control unit 4C includes a CPU, a ROM, a RAM, etc. The CPU reads out a program corresponding to the processing content from the ROM, loads it into the RAM, and works with the loaded program to centrally control the operation of each block of the analysis device 4. The analysis control unit 4C analyzes the degree of human attention based on the image feature amounts in the image information input by the input unit 4A.

[0028] Specifically, the analysis control unit 4C extracts feature amounts based on human sensibility from the image information. The feature amounts based on human sensibility include, for example, low-order image feature amounts and high-order image feature amounts.

[0029] Low-level image features are physical image features including, for example, color, brightness, and orientation (edge ​​direction, shape), and are components that guide the human gaze to direct or passive attention. Low-level image features may be a concept that broadly includes color, brightness distribution, contrast, and / or at least one of face, font, and action. The impact and degree of attention (prominence, salience) that an image gives to a viewer differs depending on factors such as the colors (e.g., complementary color difference, etc.) used in each part of the image, the brightness (luminance) distribution of each part, orientation (direction), and contrast.

[0030] For example, areas with large complementary color differences (e.g., the boundary between red and green, blue and yellow, etc.) tend to attract human gaze and become more salient. For example, if an object that extends entirely horizontally has a vertical branch, human gaze tends to be focused on that part. Furthermore, if an image contains a part that is recognized as a face, humans generally tend to focus on that part. Furthermore, when the elements that make up an image are characters, the degree to which viewers focus their gaze also varies depending on the type and size of the font. Fonts contain characters of a specific typeface, and there are various typefaces such as print, block, and cursive. The degree to which viewers pay attention to a character can vary depending on the font used. Furthermore, even within the same typeface, larger characters tend to attract more attention than smaller characters.

[0031] Higher-order image features are physiological and psychological image features that reflect human memory, experience, knowledge, etc., and are components that guide the human gaze to intrinsically and actively focus. Specifically, higher-order image features are components derived from the human mental and psychological tendencies and gaze movement tendencies that are thought to affect the impact an image has on the viewer and the degree of gaze (prominence, salience). Higher-order image features may include at least the degree of position bias and processing fluency.

[0032] For example, positional bias affects the degree of fixation of a viewer of an image, and may be a concept that includes "center bias," a tendency of human gaze to be drawn to objects at the center of an image. Positional bias may also include the tendency of human gaze to move from the upper left to the lower right of an image, such as in magazines or web pages, with the upper left tending to be the focus. Positional bias may also include the tendency of human gaze to move from the upper right to the lower left when viewing a vertically written document, with the upper right tending to be the focus. Positional bias may also include the tendency of human gaze to be drawn to areas of the store layout, such as in supermarkets, that are close to eye level.

[0033] Processing fluency generally means that humans find it easy to process simple things that are easy to recognize, and difficult to process complex things that are difficult to understand. For example, parts of an image that are easy to recognize and have high processing fluency tend to attract the human gaze and be easily fixed on. On the other hand, parts of an image that are difficult to recognize and have low processing fluency tend not to attract the human gaze and are not easily fixed on.

[0034] The degree of processing fluency may be determined by at least one of complexity, design density, and spatial frequency. Parts that are difficult to recognize are cluttered and complex parts, or parts where designs are densely packed and difficult to understand. Parts of an image where designs are densely packed have sudden changes, such as edges, in the image, and such parts have high spatial frequency. Therefore, such parts have low processing fluency. Furthermore, parts that do not contain information, such as parts with too low complexity, design density, or spatial frequency, are difficult for humans to interpret information from and tend not to be focused on.

[0035] The analysis control unit 4C calculates the attention level of each part in the image based on the above-mentioned low-order image feature amount and high-order image feature amount. For example, the analysis control unit 4C may calculate the low-order image feature amount and high-order image feature amount separately, and use a value based on the sum of values ​​obtained by weighting the calculated values ​​as the attention level.

[0036] In the following, the low-order image features are based on the color differences between adjacent regions, and the high-order image features are based on the position bias related to the center bias. The weighting coefficients are set to 0.5 for the low-order image features and 0.5 for the high-order image features.

[0037] The low-order image feature amount is a score of 1 to 5. The analysis control unit 4C calculates the low-order image feature amount so that the score increases as the color difference increases, for example.

[0038] The high-order image feature amount is a score of 1 to 5. For example, the analysis control unit 4C calculates the high-order image feature amount so that the closer the position in the image is to the center, the higher the score.

[0039] For example, suppose there is an image containing objects A, B, and C, as shown in Figure 2. The background color of the image is white, object A is black, object B is a lighter color than object A, and object C is a lighter color than object B. Object A is located in the lower center of the image, object B is located near the center of the image, and object C is located above object B in the image.

[0040] Because object A has an extremely large color difference from the background color, the analysis control unit 4C sets the low-order image feature to 5. Furthermore, because object A is located in the lower center of the image, the analysis control unit 4C sets the high-order image feature to 3. The analysis control unit 4C multiplies each of the low-order image feature and the high-order image feature by a weighting coefficient (0.5) and adds the multiplied values. In this case, the sum is 4 (5 × 0.5 + 3 × 0.5). The analysis control unit 4C then determines the ratio of the maximum score (5) to the sum as the attention level. The attention level for object A is 80%.

[0041] Because object B has a smaller color difference from the background color than object A, the analysis control unit 4C sets the low-order image feature quantity to 2. Furthermore, because object B is located near the center of the image, the analysis control unit 4C sets the high-order image feature quantity to 5. In this case, the sum of the values ​​obtained by multiplying each image feature quantity by the weighting coefficient is 3.5 (2 × 0.5 + 5 × 0.5), and the attention level for object B is 70%.

[0042] Because object C has a smaller color difference from the background color than object B, the analysis control unit 4C sets the low-order image feature to 1. Also, because object B is located higher in the image than object B, the analysis control unit 4C sets the high-order image feature to 4. In this case, the sum of the values ​​obtained by multiplying each image feature by the weighting coefficient is 2.5 (1 x 0.5 + 4 x 0.5), and the attention level for object C is 50%.

[0043] In this way, the analysis control unit 4C calculates the degree of attention of each part in the image. The low-order image feature may include features related to luminance and orientation in addition to color difference. The high-order image feature may include features related to position bias other than center bias and processing fluency. The weighting coefficients may be different for the low-order image feature and the high-order image feature.

[0044] Although low-order image features and high-order image features have been exemplified as features based on human sensibility, the features are not limited to these. For example, the features may be either low-order image features or high-order image features, or may be image features other than low-order image features and high-order image features.

[0045] The analysis control unit 4C controls the output unit 4B to output information about the points of interest for which the attention level has been calculated to the extraction device 100. The information about the points of interest includes color information corresponding to the points of interest, position information corresponding to the points of interest in the image, and information about the attention level of the points of interest.

[0046] The analysis control unit 4C may calculate the attention level for all locations in the image, or may calculate the attention level for locations other than locations that are unlikely to attract human attention (for example, locations where both low-order image features and high-order image features are 1).

[0047] Next, the extraction device 100 will be described.

[0048] As shown in FIG. 1, extraction device 100 is a device that extracts colorimetric measurement points of an image formed by image forming device 2 based on information about a human attention point in image information. Extraction device 100 is a computer device such as a personal computer, and includes a CPU, ROM, RAM, etc. In extraction device 100, the CPU reads a program corresponding to the processing content from ROM and loads it into RAM, and works with the loaded program to centrally control the operation of each block of extraction device 100. Extraction device 100 includes a communication unit 110, a display processing unit 120, an extraction unit 130, and a storage processing unit 140.

[0049] The communication unit 110 is a part that transmits and receives information to external devices via a network. The communication unit 110 receives image information based on predetermined image data from the image forming device 2 and transmits the received image information to the analysis device 4. Note that the image information is converted into a RIP image and then transmitted to the analysis device 4, but the conversion process into a RIP image may be performed by the image forming device 2 or by the extraction device 100.

[0050] Then, the communication unit 110 receives (acquires) information on the points of interest analyzed by the analysis device 4 based on the image information from the analysis device 4. The communication unit 110 corresponds to the "acquisition unit" of the present invention.

[0051] The display processing unit 120 processes and displays on a display device the information on the points of interest acquired from the analysis device 4. For example, if the extraction device 100 has a display unit, the display device may be the display unit, or may be a display device provided separately from the extraction device 100.

[0052] Specifically, the display processing unit 120 controls the information of the points of interest to be displayed based on the information of the points of interest. For example, the display processing unit 120 displays the information of the points of interest on the display device in descending order of attention level.

[0053] For example, in the example shown in Fig. 2, the display processing unit 120 displays information on a point of interest related to object A, information on a point of interest related to object B, and information on a point of interest related to object C in descending order of attention level, as shown in Fig. 3. In the example shown in Fig. 3, each piece of information on a point of interest displayed on the display device is displayed with information on the color of the point of interest, information on the attention level, and information on the position of the point of interest lined up horizontally.

[0054] This makes it easier for the user to identify which parts of interest are attracting a lot of attention.

[0055] Furthermore, the display processing unit 120 displays information indicating a point of interest superimposed on the image. For example, Fig. 3 shows an example in which a circle surrounding the point of interest is displayed on the image.

[0056] This makes it easier for the user to identify the location of the point of interest within the image.

[0057] Furthermore, the display processing unit 120 may perform control so that information about points of interest whose attention level is equal to or greater than a predetermined threshold is displayed on the display device, and information about points of interest whose attention level is less than the predetermined threshold is not displayed on the display device. The predetermined threshold may be a value that can be set as appropriate, such as 65%. The predetermined threshold may also be changeable by the user changing the settings of the extraction device 100.

[0058] By doing so, it is possible to omit displaying points of interest that are less noticeable.

[0059] Based on the information on the attention point, the extraction unit 130 extracts the colorimetry point of the image formed by the image forming device 2. Specifically, the extraction unit 130 extracts the attention point selected by the user from all the attention points acquired from the analysis device 4 as information on the colorimetry point.

[0060] For example, the user's selection may be made via an operation unit (not shown) of the extraction device 100, such as by checking a check box displayed corresponding to each piece of information about a point of interest displayed on the screen of the display device.

[0061] Furthermore, the extraction unit 130 may automatically extract, from all of the points of interest acquired from the analysis device 4, information on points of interest that are equal to or greater than the predetermined threshold value, as information on the color measurement points.

[0062] The communication unit 110 transmits the information on the colorimetry points extracted by the extraction unit 130 to the image forming apparatus 2. The information on the colorimetry points includes information on the attention level, information on the color of the colorimetry points, and information on the position of the colorimetry points.

[0063] In the image forming apparatus 2 that has acquired the information on the colorimetry locations, as described above, correction processing is performed on the second image that is formed after the first image, based on the colorimetry information on the colorimetry locations of the first image.

[0064] Furthermore, the communication unit 110 acquires the above-described information relating to the colorimetry of the first image from the image forming device 2. Then, the storage processing unit 140 executes a process of storing the acquired information relating to the colorimetry of the first image in the storage device 3 via the communication unit 110. The storage processing unit 140 corresponds to the "first storage processing unit" of the present invention.

[0065] Information relating to colorimetry of the first image may be stored in the storage device 3 via the communication unit 110 and the storage processing unit 140 each time colorimetry is performed by the image forming device 2. Also, after the print job is completed, all information relating to colorimetry may be stored in the storage device 3 via the communication unit 110 and the storage processing unit 140.

[0066] Furthermore, the display processing unit 120 may display information related to the colorimetry of the first image on the display device. The information displayed on the display device may be, for example, information indicating the relationship between the difference between the colorimetry value and the reference value (amount of color misregistration) and the number of printed sheets (or the elapsed printing time). Fig. 4 shows an example in which information indicating a graph with the amount of color misregistration on the vertical axis and the number of printed sheets on the horizontal axis is displayed together with information on the target area.

[0067] Furthermore, the information about the colorimetry of the first image displayed on the display device may be acquired by the user through a user operation. For example, Fig. 4 shows an example in which the user can acquire the information by operating a button labeled "Download." The information acquired by the user may include related information such as the above-mentioned tolerance information and reference information.

[0068] This allows the user to easily check information related to colorimetry.

[0069] An example of the operation of extraction control in the extraction device 100 configured as above will be described. Fig. 5 is a flowchart showing an example of the operation of extraction control in the extraction device 100. The flowchart shown in Fig. 5 is executed as appropriate when a print job is executed and image information is input to the analysis device 4.

[0070] 5, the extraction device 100 acquires information about the area of ​​interest from the analysis device 4 (step S101). After acquiring the information about the area of ​​interest, the extraction device 100 extracts a color measurement area from the information about the area of ​​interest (step S102).

[0071] After extracting the colorimetry points, the extraction device 100 transmits information about the colorimetry points to the image forming device 2 (step S103). After the information about the colorimetry points is transmitted and a print job is started, the extraction device 100 acquires colorimetry values ​​(step S104).

[0072] After acquiring the colorimetric values, the extraction device 100 stores the information of the colorimetric values ​​in the storage device (step S105). After storing the information in the storage device, the extraction device 100 determines whether the print job has ended (step S106).

[0073] If the print job is not completed (step S106, NO), the process returns to step S104. On the other hand, if the print job is completed (step S106, YES), the process ends.

[0074] According to the present embodiment configured as described above, the colorimetry points of an image formed based on image data by the image forming device 2 are extracted based on information about a human attention point in image information based on the image data.

[0075] This allows the extracted colorimetry points to be the points that people pay attention to. Color variations in points that people pay attention to are more easily recognized by people, so in this embodiment, points that are highly recognizable by people can be selected as colorimetry points. As a result, appropriate colorimetry points can be extracted.

[0076] Then, the image forming apparatus 2 executes the correction process for the second image using such color measurement points, so that the portions of the image that are highly recognizable by humans can be accurately corrected.

[0077] Furthermore, since information on the points of interest is obtained from the analysis device 4 that analyzes the degree of human attention based on the feature amount based on human sensitivity in the image information, it is possible to extract color measurement points that take human sensitivity into consideration.

[0078] For example, when performing analysis based on artificial intelligence, statistical data is required, which may prevent an accurate approach from being taken in analyzing the level of attention given to new image data.

[0079] In contrast, in this embodiment, the degree of human attention is analyzed based on features based on human sensibility in image information, so that an accurate approach can be taken in analyzing the degree of attention even for new image data.

[0080] Furthermore, since the image information is a RIP image that has been converted from image data for image formation, there is less deviation in the positions and colors of the image compared to, for example, a configuration in which a point of interest is extracted from an image formed on a recording medium, and as a result, information on the point of interest can be accurately extracted from the image information.

[0081] Since the information on the points of interest is displayed on the display device, the user can grasp the information on the points of interest. Also, since the points of colorimetry are extracted based on the information on the points of interest displayed on the display device, the points of colorimetry can be matched with the points that the user is aware of, and thus the points can be appropriately corrected.

[0082] Furthermore, since the display processing unit 120 controls the information of the attention area to be displayed based on the information of the attention area, it is possible to omit displaying areas that are of low interest and that people do not pay attention to.

[0083] Furthermore, since the storage processing unit 140 executes a process of storing information related to the colorimetry of the first image in the storage device 3, the information related to the colorimetry of the first image can be saved as colorimetry history information. As a result, after the print job is completed, information such as color variations based on the colorimetry can be provided to the user.

[0084] In the above embodiment, the image forming apparatus 2 performs the correction process, such as calculating the difference between the colorimetric information and the reference information, but the present invention is not limited to this. For example, the extraction apparatus 100 may perform the correction process.

[0085] As shown in FIG. 6, the extraction device 100 according to this configuration includes a calculation unit 150 and a setting unit 160 in addition to the components shown in FIG.

[0086] The calculation unit 150 calculates the difference between the colorimetric information of the first image and the reference information. The calculation unit 150 corresponds to the "first calculation unit" of the present invention.

[0087] The setting unit 160 is a part of the extraction device 100 that sets the processing related to the correction processing of the image forming device 2. If the difference calculated by the calculation unit 150 exceeds the above-mentioned allowable range, the setting unit 160 sets the correction of the image forming device 2. Specifically, the setting unit 160 sets the above-mentioned correction processing of the second image in the image forming device 2 via the communication unit 110.

[0088] This allows the extraction device 100 to set corrections for the image forming device 2.

[0089] The above-mentioned allowable range may be changeable by the user operating the setting unit 160. In this way, the standard for the correction process of the second image can be easily changed according to the user's intention. The setting unit 160 corresponds to the "first setting unit" of the present invention.

[0090] The above-mentioned allowable range may be changeable for each attention level of each color measurement location. That is, the setting unit 160 may set an allowable range for each of a plurality of color measurement locations.

[0091] For example, when the attention level is 80% or higher, the setting unit 160 sets the allowable range to a color misregistration amount of less than 3. The color misregistration amount is, for example, the absolute value of the difference between a color value and a value corresponding to a reference value. When the attention level is within a range of 50 to 80%, the setting unit 160 sets the allowable range to a color misregistration amount of less than 5. Furthermore, when the attention level is less than 50%, the setting unit 160 sets the allowable range to a color misregistration amount of less than 7.

[0092] For example, if the difference between the colorimetric value and the reference value is 3 for a color measurement location with an attention level of 80 percent or more, the color measurement location will be corrected because it exceeds the allowable range of color misalignment (less than 3). Also, if the difference between the colorimetric value and the reference value is 3 for a color measurement location with an attention level of less than 50 percent, the color misalignment does not exceed the allowable range of color misalignment (less than 7), so the color measurement location will not be corrected.

[0093] This allows the tolerance range for each color measurement point to be different depending on the level of attention, eliminating the need to correct color measurement points with relatively low attention levels using the same standards as for color measurement points with relatively high attention levels, thereby preventing unnecessary correction of image data for color measurement points with low attention levels.

[0094] If the difference calculated by the calculation unit 150 is not within the allowable range, the display processing unit 120 notifies the user of the information by displaying information to that effect on the display device. The information may be text information to be displayed on the display device of the extraction device 100. The display processing unit 120 corresponds to the "first notification unit" of the present invention.

[0095] This allows the user to easily grasp the information on the difference between the colorimetric value and the reference value. Furthermore, based on this information on the difference, the user can determine whether or not to perform correction and change the correction settings via the setting unit 160, thereby improving the degree of freedom in correcting the second image.

[0096] An example of the operation of extraction control in the extraction device 100 according to the modified example configured as above will be described below. FIG. 7 is a flowchart showing an example of the operation of extraction control in the extraction device 100 according to the modified example. The flowchart shown in FIG. 7 is executed as appropriate when a print job is executed and image information is input to the analysis device 4. In addition, the processing of steps S101 to S106 in the flowchart shown in FIG. 7 is the same as that in the flowchart shown in FIG. 5.

[0097] 7, after step S104, the extraction device 100 determines whether the difference between the colorimetric value and the reference value is within the allowable range (step S107). If the result of the determination is that the difference is within the allowable range (step S107, YES), the process proceeds to step S105.

[0098] On the other hand, if the difference is not within the allowable range (step S107, NO), the extraction device 100 sets the correction of the image data in the image forming device 2 (step S108). After step S108, the process returns to step S104.

[0099] In the above embodiment, the color measurement interval of the colorimetric unit 2B is set in advance, but the present invention is not limited to this. For example, the extraction device 100 may calculate the color measurement interval.

[0100] Specifically, the calculation unit 150 calculates the colorimetry interval for the print job of the image forming device 2 based on the attention level of the attention point corresponding to the colorimetry point. Specifically, the calculation unit 150 calculates the colorimetry interval so that the colorimetry interval becomes shorter as the attention level increases. The calculation unit 150 corresponds to the "second calculation unit" of the present invention.

[0101] 8, for example, object A has the highest attention level, so the calculation unit 150 calculates the colorimetry interval to be 5 sheets. For object B, the attention level is lower than that of object A, so the calculation unit 150 calculates the colorimetry interval to be 10 sheets. For object C, the attention level is lowest, so the calculation unit 150 calculates the colorimetry interval to be 20 sheets. The calculation of the colorimetry interval may be performed, for example, by referring to a table that lists colorimetry intervals associated with attention levels.

[0102] This allows the timing of colorimetry at each measurement point to differ depending on the level of attention, so that it is possible to increase the frequency of colorimetry at points with relatively high attention while decreasing the frequency of colorimetry at points with relatively low attention, thereby improving the efficiency of colorimetry compared to a configuration in which all measurement points are measured in one measurement.

[0103] Furthermore, the calculation unit 150 may calculate a predicted time for printing a print job based on the calculated colorimetry interval. The predicted time is calculated, for example, based on the following formula (1).

[0104] Estimated time = time until the colorimetry unit of the image forming device operates + time for moving the colorimetry unit in the main scanning direction + time for moving the colorimetry unit in the sub-scanning direction + colorimetry time + time required from printing to output without colorimetry operation (1)

[0105] The predicted time corresponds to the time it takes to print, measure, and output one sheet of recording medium. The movement time of the colorimetry unit in the main scanning direction is the sum of the movement time when the colorimetry unit moves in the main scanning direction for each measurement location. The movement time in the sub-scanning direction is the sum of the time it takes to transport the recording medium in the sub-scanning direction for colorimetry. The colorimetry time is the sum of the colorimetry time for each measurement location.

[0106] Information other than the movement time of the colorimetry unit in the main scanning direction may be acquired from the image forming apparatus 2 via the communication unit 110. Furthermore, the movement time of the colorimetry unit in the main scanning direction may be calculated from the storage device 3 based on past printing information. For example, the calculation unit 150 selects, from the printing information of past print jobs, printing information having the closest number of colorimetry points on the image in the new print job and the closest positions of the colorimetry points on the image in the new print job. Then, from the selected printing information, the calculation unit 150 selects printing information having the smallest difference between the predicted time for the past print job and the actual printing time required for that print job.

[0107] The calculation unit 150 acquires the position information of the colorimetry location from the selected past print information, and calculates the movement time of the colorimetry unit in the main scanning direction. The movement time is calculated based on the following equation (2).

[0108] Time required for moving the colorimetry unit in the main scanning direction for the previous print job = | Actual printing time - (time until colorimetry operation + time for moving in the sub-scanning direction + time for colorimetry + time required from printing to output without colorimetry operation)|··(2)

[0109] The movement time in the sub-scanning direction in formula (2) is the time it takes to transport the recording medium, and is therefore information held by the image forming device 2, but may also be calculated by the extraction device 100. The movement time in the sub-scanning direction can be calculated, for example, by dividing the distance from the top of the recording medium to the colorimetry point by the speed at which the recording medium passes through the colorimetry unit 2B.

[0110] The calculation unit 150 calculates the movement speed of the colorimetric unit in the main scanning direction in the past print job based on the movement time calculated by equation (2). The movement speed is calculated based on the following equation (3).

[0111] Movement speed of the colorimeter in the main scanning direction in a past print job = Movement distance of the colorimeter in the main scanning direction / Past movement time of the colorimeter in the main scanning direction (3)

[0112] The calculation unit 150 calculates the movement time of the colorimetry unit in the main scanning direction for the new print job based on the movement speed calculated using equation (3). The movement time is calculated based on the following equation (4). The movement distance of the colorimetry unit in the main scanning direction in equation (4) is calculated based on the colorimetry locations for the new print job.

[0113] Movement time of the colorimeter in the main scanning direction for a new print job = Movement distance of the colorimeter in the main scanning direction / Movement speed of the colorimeter in the main scanning direction for a previous print job (4)

[0114] The travel time of the colorimetry unit in the main scanning direction for calculating the predicted time may be calculated based on information acquired from the image forming apparatus 2. For example, before a print job, the image forming apparatus 2 may be used to output an image for time calculation, thereby calculating information such as the travel time.

[0115] The time calculation image may be an image used in a print job or may be a predetermined chart image.

[0116] The storage processing unit 140 may execute a process of storing the colorimetry interval and predicted time (information about the colorimetry interval) calculated by the calculation unit 150 in the storage device 3. The information about the colorimetry interval may include not only the colorimetry interval and predicted time, but also position information about the colorimetry location, etc. The storage processing unit 140 corresponds to the "second storage processing unit" of the present invention.

[0117] By doing so, the predicted time of a new print job can be saved as a history, and can be used as a past predicted time when calculating a predicted time for a new print job.

[0118] Furthermore, the user may be able to set the printing time of a print job via the setting unit 160. In this case, the calculation unit 150 may calculate the colorimetry interval based on the printing time set by the user.

[0119] This allows the color measurement interval to be set to a value suitable for the printing time desired by the user.

[0120] The display processing unit 120 may also display the colorimetry interval calculated by the calculation unit 150 on the display device to notify the user of the colorimetry interval. The display processing unit 120 may also notify the user of information about the predicted time in addition to the colorimetry interval. For example, FIG. 8 shows an example in which the colorimetry interval and the printing time (predicted time) are displayed. The display processing unit 120 corresponds to the "second notification unit" of the present invention.

[0121] This allows the user to understand the color measurement interval and estimated time.

[0122] Furthermore, the display processing unit 120 may notify the user of the maximum printing time when all the color measurement points are measured, in addition to the color measurement interval and predicted time.

[0123] By notifying the user of the maximum printing time, the user can understand that the printing time will be reduced to some extent depending on the colorimetry interval and the predicted time.

[0124] The user may also change the colorimetry location or the colorimetry interval via the setting unit 160. The setting unit 160 corresponds to the "second setting unit" of the present invention. Furthermore, if the user changes the colorimetry interval, the calculation unit 150 may recalculate the predicted printing time based on the changed colorimetry interval.

[0125] Furthermore, the information on the colorimetry interval calculated by the calculation unit 150 as described above is set as the colorimetry interval of the colorimetry unit 2B of the image forming device 2 via the communication unit 110. After the colorimetry interval is set, a print job is performed. Furthermore, in the print job, colorimetry is performed at the set colorimetry interval. Furthermore, after the print job is completed, the storage processing unit 140 performs processing to store the actual printing time in the storage device 3.

[0126] An example of the operation of the colorimetry interval calculation control in the extraction device 100 according to the modified example configured as above will be described. Fig. 9 is a flowchart showing an example of the operation of the colorimetry interval calculation control in the extraction device 100 according to the modified example. The flowchart shown in Fig. 9 is executed as appropriate when information on a location of interest is acquired from the analysis device 4.

[0127] 9, the extraction device 100 calculates the color measurement interval and the predicted time (step S201). After calculating the color measurement interval and the predicted time, the extraction device 100 displays the calculated color measurement interval and the predicted time (step S202).

[0128] After displaying the colorimetry interval and the predicted time, the extraction device 100 determines whether the colorimetry interval has been changed (step S203). If the determination result shows that the colorimetry interval has not been changed (step S203, YES), the extraction device 100 transmits information about the colorimetry interval to the image forming device 2 (step S204).

[0129] On the other hand, if the colorimetry interval has been changed (step S203, NO), the extraction device 100 recalculates the predicted time based on the changed colorimetry interval (step S205).

[0130] After recalculating the predicted time, the extraction apparatus 100 displays the colorimetry interval and the predicted time (step S206). After step S206, the process proceeds to step S204.

[0131] After step S204, the extraction device 100 stores the calculated colorimetry interval and predicted time in the storage device 3 (step S207). After step S207, this control ends. Note that the extraction device 100 may obtain information on the actual printing time after the print job by the image forming device 2 is completed, and store the information in the storage device 3.

[0132] Furthermore, the calculation unit 150 may calculate the colorimetry interval based on information other than the attention level information, in addition to the attention level information. For example, the calculation unit 150 may calculate the colorimetry interval based on the colorimetry history information of the image forming apparatus 2 in addition to the attention level information. The colorimetry history information is, for example, information indicating the difference between the colorimetry value of a predetermined color and the reference value, and information linked to the information indicating the difference. The information linked to the information indicating the difference may be, for example, information on the number of printed sheets when the difference between the colorimetry value and the reference value exceeds the allowable range.

[0133] Specifically, for each color of each color measurement location in the current print job, the calculation unit 150 extracts from the colorimetry history information information on the number of prints when the difference between the colorimetry value of a color equivalent to that color and the reference value exceeds the tolerance range. The calculation unit 150 extracts the CMYK values ​​for each color from the extracted information, and based on the characteristics of the C value, M value, Y value, and K value, groups the information on the number of prints for each characteristic, and sorts each group in order of the number of prints.

[0134] For example, suppose that a group including colors with a C value of 100%, a group including colors with an M value of 80%, and a group including colors with a C value of 60% are sorted in descending order of the number of printed sheets.

[0135] Among these, for the colorimetry locations related to the group including the color with a C value of 100%, which is the group with the fewest number of prints, the calculation unit 150 calculates an interval that is smaller than the colorimetry interval calculated based on the attention level information. For example, if the colorimetry interval calculated based on the attention level information is 30 sheets, an interval smaller than that interval (for example, 15 sheets) is set as the colorimetry interval.

[0136] In this case, the calculation unit 150 may set the color measurement interval so that the difference between the predicted time and the predicted time calculated based only on the attention level information does not exceed a predetermined time.

[0137] In this case, the color measurement interval may be set by the user via the setting unit 160.

[0138] In addition, the display processing unit 120 may display information on the display device indicating that the color measurement location contains a color where the difference between the color measurement value and the reference value is likely to exceed the acceptable range, or that the color measurement interval has become even smaller, thereby notifying the user of this information.

[0139] Furthermore, in the above embodiment, the storage device 3 stores information related to colorimetry of the first image (information about the area of ​​interest), etc., but it may also store job information about a print job. That is, the storage processing unit 140 may associate the information about the area of ​​interest with the job information of the image forming device 2 and perform storage processing in the storage device 3. The storage processing unit 140 corresponds to the "third storage processing unit" of the present invention.

[0140] The job information includes, for example, image information, image color information (CMYK values, L*a*b* values, etc.), type of recording medium, type of image forming device 2, attention level, user name, job name, and the like.

[0141] Furthermore, when information about a point of interest analyzed by the analysis device 4 is notified to the user as a colorimetric point via the extraction device 100, there may be a difference between the colorimetric point and the point that the user actually focused on. For example, when a recording medium with a special background color, such as a transparent film, is used, the color of the image formed on the recording medium may change.

[0142] For example, suppose that the user pays the most attention to object B among objects A, B, and C in the image shown in Fig. 2. However, if analysis device 4 determines that the attention level of object B is lower than that of object A, as in the example described above, a discrepancy will arise between the analysis result of analysis device 4 and the location of the user's attention.

[0143] In this case, the user may set the attention level of the color measurement location via the setting unit 160. This setting may be performed by the user inputting the attention level via the setting unit 160, for example.

[0144] The extraction unit 130 extracts the points of interest corresponding to the user's settings as colorimetry points. That is, the extraction unit 130 changes the information on the points of interest acquired from the analysis device 4 from before the user's settings, based on the user's settings. Then, the extraction unit 130 feeds back the changed information to the analysis device 4 via the communication unit 110.

[0145] When the analysis device 4 receives feedback of changed information from the extraction device 100, the analysis device 4 may change the analysis settings so that the fed back information is used in the next analysis. When analyzing a print job similar to the print job that is the subject of the feedback, the analysis settings may be settings that match the changes made by the user, such as changing the weighting coefficient settings described above from the normal settings.

[0146] Examples of similar print jobs include a job with the same user name as the print job that is the subject of feedback, and a job with the same color measurement location as the print job that is the subject of feedback.

[0147] Furthermore, the analysis device 4 may store information about the attention areas whose attention level has been changed by the user based on the feedback information, and analyze similar print jobs based on a list of the stored information.

[0148] Furthermore, when the analysis device 4 performs analysis based on the fed-back information, the extraction device 100 may display a list of the stored information (past job information) on the display device.

[0149] Furthermore, when the analysis device 4 receives feedback of changed information, the analysis device 4 may re-analyze the portion of interest based on the feedback information and output the result to the extraction device 100.

[0150] Furthermore, in the above embodiment, information on human attention points in image information is acquired from the analysis device 4, but the present invention is not limited to this. For example, the extraction device 100 may acquire information acquired by referring to a table that associates boundary portions of two different colors in an image with survey results, such as a five-point scale rating by multiple evaluators, on how easily the boundary portions are noticed, as information on human attention points. The survey results may be the average or median of the evaluation points assigned by each of the multiple evaluators.

[0151] Furthermore, in the above embodiment, the display processing unit 120 notifies the user of information by displaying it on the display device, but the present invention is not limited to this, and for example, the user may be notified of information by audio output from the audio output unit.

[0152] In the above embodiment, the process of storing data in the storage device 3 is executed by the extraction device 100, but the present invention is not limited to this.

[0153] Furthermore, in the above embodiment, a storage processing unit is provided, but the present invention is not limited to this. For example, if a storage device is not provided, the storage processing unit may not be provided.

[0154] In the above embodiment, the image information is a RIP image, but the present invention is not limited to this. For example, the image information may be information on a read image obtained by reading a print image based on image data.

[0155] Furthermore, in the above embodiment, the extraction device 100 is a device separate from the image forming device 2, but the present invention is not limited to this, and the extraction device 100 may be a device included in the image forming device.

[0156] Furthermore, the above-described embodiments are merely examples of specific embodiments for carrying out the present invention, and the technical scope of the present invention should not be construed as being limited by these embodiments. In other words, the present invention can be carried out in various forms without departing from the gist or main features thereof. [Explanation of symbols]

[0157] 1 Extraction System 2. Image forming device 2A Communication Department 2B Color measurement section 2C Image formation control unit 3 Storage device 4 Analyzer 4A input section 4B Output section 4C Analysis and Control Unit 100 extraction equipment 110 Communications Department 120 Display processing unit 130 Extraction part 140 Memory Processing Unit 150 Calculation Unit 160 Setting section

Claims

1. an acquisition unit that acquires information about a point of interest of a person in image information based on image data; an extraction unit that extracts color measurement points of an image formed based on the image data by an image forming apparatus based on information about the target points; An extraction device comprising:

2. the acquisition unit acquires information about the point of interest from an analysis device; the analysis device analyzes the degree of attention of the person based on a feature quantity based on human sensibility in the image information, and outputs information on the attention part to the extraction device based on the analysis result. The extraction device of claim 1.

3. the image forming apparatus performs correction processing on a second image based on the same image data as the first image, based on the colorimetric information of the colorimetric portion of the first image formed on the recording medium, the second image being formed on the recording medium after the first image. The extraction device of claim 1.

4. The image information is information obtained by converting the image data for image formation. The extraction device of claim 1.

5. a display processing unit that displays the information about the point of interest acquired by the acquisition unit on a display device; the extraction unit extracts the color measurement location based on information about the location of interest displayed on the display device. The extraction device of claim 1.

6. the display processing unit controls the information of the point of interest to be displayed based on the information of the point of interest.

6. The extraction device of claim 5.

7. the acquisition unit acquires the colorimetric information of the first image; The extraction device comprises: a first calculation unit that calculates a difference between the colorimetric information of the first image and reference information; a first notification unit that notifies a user of information indicating that the difference is not within an allowable range; Further provided with 4. The extraction device of claim 3.

8. Further comprising a first setting unit that sets the allowable range.

8. The extraction device of claim 7.

9. The color measurement points are a plurality of points, the first setting unit sets an allowable range for each of a plurality of color measurement points; 9. The extraction device of claim 8.

10. a first storage processing unit that executes a process of storing information about the colorimetry of the first image in a storage device; 8. The extraction device of claim 7.

11. a second calculation unit that calculates a colorimetry interval for a print job of the image forming apparatus based on the attention level of the attention point corresponding to the colorimetry point; 4. The extraction device of claim 3.

12. the second calculation unit calculates a predicted printing time for the print job; 12. The extraction device of claim 11.

13. a second notification unit that notifies a user of the calculated color measurement interval; a second setting unit that sets the color measurement interval; Further provided with 12. The extraction device of claim 11.

14. a second storage processing unit that stores information about the colorimetry interval in the print job in a storage device; 12. The extraction device of claim 11.

15. the second calculation unit calculates the color measurement interval based on color measurement history information of the image forming apparatus in addition to the attention level.

12. The extraction device of claim 11.

16. the image forming apparatus includes a colorimetric unit that measures the color of a print image that has been printed according to a print job; the extraction device further includes an output unit that outputs information about the colorimetry interval calculated by the second calculation unit to the image forming device, the image forming apparatus controls the colorimetric unit based on the information on the colorimetric interval.

12. The extraction device of claim 11.

17. a third storage processing unit that associates the information about the target location with job information of the image forming apparatus and stores the information in a storage device; The extraction device of claim 1.

18. The extraction unit changing the information of the point of interest acquired from the analysis device according to a user setting from before the user setting; feeding back the changed information to the analysis device; The extraction device of claim 2.

19. An extraction method using an extraction device, acquiring information about a location of interest of a person in image information based on image data; extracting a color measurement point of an image formed based on the image data by an image forming apparatus based on information about the target point; Including, Extraction method.

20. An extraction program executed by an extraction device, On the computer, A process of acquiring information about a location of interest of a person in image information based on image data; A process of extracting a color measurement point of an image formed based on the image data by an image forming apparatus based on information about the target point; Execute Extraction program.

Images