Image processing apparatus, image processing method, and program

Abstract

To provide a technique for allowing a user to easily recognize unevenness.SOLUTION: An image processing apparatus includes an unevenness cycle determiner that determines an unevenness cycle, which is a cycle of positions of unevenness occurring in an input image, based on a predetermined cycle list, an unevenness position determiner that determines, based on the unevenness cycle and the input image, any of a plurality of first unevenness positions, which are positions of unevenness for each unevenness cycle, as a second unevenness position based on a recognition degree, and a superimposed image creator that creates an output image including a marker image including a marker indicating an unevenness position based on the unevenness cycle and the second unevenness position.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to an image processing device, an image processing method, and a program. [Background technology]

[0002] There is an image inspection technology that uses a reader attached to the image forming device or post-processing device to read prints formed on media by an image forming device and determine the quality of the prints. Technologies are also emerging that automatically request service if the print quality is determined to be below the required level. The service provider will identify replacement parts while examining the prints. However, if the defective part in the print is difficult to identify, such as when the density difference in the defective part on the image is small, there is a lot of noise, or there are multiple irregularities with different periods, there is a problem that the improvement in print quality due to the service response will vary.

[0003] In order to address the above-mentioned issues, Patent Document 1 describes a method for diagnosing the cause of a defective part and generating the diagnostic results as a diagnostic report. The diagnostic report includes an image in which a marking image is superimposed on the defective part of the read image. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Publication No. 2023-19941 Summary of the Invention [Problem to be solved by the invention]

[0005] However, Patent Document 1 only superimposes a ladder-shaped line diagram corresponding to the unevenness period, which is one type of defective image, but does not present noteworthy points in the unevenness period. As a result, this technology is not easy for users to recognize unevenness, and there are individual differences in recognition of the unevenness position and unevenness period. As a result, this may affect the replacement of parts that cause unevenness.

[0006] Therefore, the present invention provides a technique that makes it easier for the user to recognize unevenness. [Means for solving the problem]

[0007] In order to solve this problem, for example, an image processing device of the present invention has the following arrangement: an unevenness period determination means for determining an unevenness period, which is a period of positions of unevenness occurring in an input image, based on a predetermined period list; an unevenness position determining means for determining, based on the unevenness period and the input image, one of a plurality of first unevenness positions, which are positions of unevenness for each unevenness period, as a second unevenness position based on a degree of recognition; a superimposed image creating means for creating an output image including a marker image including a marker indicating the unevenness position based on the unevenness period and the second unevenness position; Equipped with. [Effects of the Invention]

[0008] According to the present invention, it is possible to make the user more aware of unevenness. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram showing an example of the hardware configuration of an image forming system according to a first embodiment. [Figure 2] FIG. 2 is a functional block diagram showing functions of the image processing apparatus according to the first embodiment. [Figure 3] FIG. 4 is a flowchart showing a determination process according to the first embodiment. [Figure 4] Charts and printed matter in the first embodiment. [Figure 5] An example of a color conversion LUT. [Figure 6] FIG. 10 is a detailed flowchart of step S105 in the first embodiment. [Figure 7] 5A to 5C are diagrams showing an example of the transition of processing of a profile generated from a printed material in the first embodiment. [Figure 8] FIG. 10 is a diagram showing an example of a periodic list. [Figure 9] FIG. 10 is a detailed flowchart of step S108 in the first embodiment. [Figure 10] 10A and 10B are diagrams showing the transition of an image and a profile in the process of determining the position of unevenness. [Figure 11] 5A to 5C are views showing examples of a marker image and an output image according to the first embodiment. [Figure 12] FIG. 4 is a diagram showing an example of a display image including a determination result in the first embodiment. [Figure 13] FIG. 10 is a functional block diagram showing functions of an image processing apparatus according to a second embodiment. [Figure 14] FIG. 10 is a flowchart showing a determination process according to the second embodiment. [Figure 15] FIG. 10 is a diagram showing an example of a captured image to be processed in the second embodiment. [Figure 16] 10A and 10B are diagrams showing examples of a marker image and an output image in the second embodiment. [Figure 17] FIG. 10 is a diagram showing an example of a display image including a determination result in the second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the invention according to the claims. Although multiple features are described in the embodiments, not all of these multiple features are necessarily essential to the invention, and multiple features may be combined arbitrarily. Furthermore, in the accompanying drawings, the same reference numerals are used to designate the same or similar components, and redundant explanations will be omitted.

[0011] (First embodiment) In this embodiment, we will describe an image forming system that presents at least one of the most recognizable unevenness period and unevenness position, which are the period and position of image unevenness (hereinafter simply referred to as unevenness) that occurs in an image.

[0012] <Hardware configuration in the first embodiment> FIG. 1 is a diagram illustrating an example of a hardware configuration of an image forming system according to the first embodiment.

[0013] The image forming system of this embodiment includes an image processing device 110 , an input device 120 , a display device 130 , an image forming device 140 , an image capturing device 150 , and a general-purpose bus 160 .

[0014] The image processing device 110 may be a computer. The image processing device 110 includes a CPU 111, a main memory 112, a storage device 113, a general-purpose I / F 114, and a bus 115. The CPU 111, the main memory 112, the storage device 113, and the general-purpose I / F 114 are connected via the bus 115 so as to be able to send and receive information to and from each other.

[0015] The CPU 111 is an abbreviation for Central Processing Unit and is a processor. The CPU 111 performs arithmetic processing and executes various programs. For example, the CPU 111 reads out a program stored in the storage device 113, deploys it in the main memory 112, and executes it to realize various functions and execute various processes. Instead of or in addition to the CPU 111, the image processing device 110 may have other processors such as an MPU (Micro Processing Unit), a GPU (Graphics Processing Unit), an NPU (Neural Processing Unit), and a QPU (Quantum Processing Unit).

[0016] The main memory 112 may be a memory that can read and write data at high speed, such as a random access memory (RAM). The main memory 112 stores programs and data required for processing. The main memory 112 provides the CPU 111 with a working area and the like.

[0017] The storage device 113 is a non-volatile storage device such as a hard disk drive (HDD) or a solid state drive (SSD), etc. The storage device 113 stores various programs (also called computer programs), parameters required for executing the programs, data to be processed by the programs, and the like.

[0018] The general-purpose I / F 114 is an interface for connecting an external device to the image processing device 110. The general-purpose I / F 114 may be, for example, an interface for a Universal Serial Bus (USB), a High-Definition Multimedia Interface (HDMI), a registered trademark, a wired local area network (LAN), or a wireless LAN.

[0019] The input device 120 is a device through which a user inputs operations. The input device 120 is, for example, a keyboard, a mouse, or a touchpad. The input device 120 is connected to the image processing device 110 via a general-purpose bus 160. The input device 120 transmits input received from a user to the CPU 111.

[0020] The display device 130 displays images, numerical data, etc. generated by the CPU 111. The display device 130 is, for example, a CRT (Cathode Ray Tube), a liquid crystal display, a head-mounted display, etc. The display device 130 is connected to the image processing device 110 via a general-purpose bus 160. The display device 130 receives image data to be displayed, etc., via the general-purpose bus 160.

[0021] Image forming device 140 is an example of a printing unit, and forms an image by printing image data generated by CPU 111 on a medium (also called a recording medium) such as paper. Image forming device 140 is, for example, either an inkjet printer that forms a two-dimensional image on a medium, or an electrophotographic printer. In this embodiment, image forming device 140 is an electrophotographic printer. Image forming device 140 is connected to image processing device 110 via general-purpose bus 160. Image forming device 140 receives image data to be printed via general-purpose bus 160.

[0022] The image capturing device 150 is, for example, a line scan sensor located on the same media transport as the image forming device 140. The image capturing device 150 may be a camera such as a digital camera. The image capturing device 150 may have an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) sensor or a CCD (Charge Coupled Device) sensor. The image capturing device 150 receives light from a subject, converts it into an electrical signal, and generates data of a captured image (hereinafter also referred to as captured data) as a two-dimensional optical image. Note that the term "image" may include both an image and image data. The captured image is an example of an input image and is also referred to as a scanned image. The captured data is, for example, data in an image format with 8 bits for each of the RGB colors, scanned at a resolution of 1200 dpi, of the entire image of an A3-sized paper. The image capturing device 150 is connected to the image processing device 110 via a general-purpose bus. The image capturing device 150 transmits the generated captured data to the image processing device 110.

[0023] The general-purpose bus 160 is a bus that connects the above-mentioned devices so that information can be transmitted and received. The type of the general-purpose bus 160 changes depending on the type of the general-purpose I / F 114. If the general-purpose I / F 114 is a wired system such as USB, HDMI, or wired LAN, a cable corresponding to that system is applied to the general-purpose bus 160. If the general-purpose I / F 114 is a wireless system such as wireless LAN, a communication method corresponding to the system is used.

[0024] The image forming system may have various other hardware configurations in addition to those described above, and is not limited to the configuration described above.

[0025] <Functional configuration in the first embodiment> 2 is a functional block diagram showing the functions of the image processing device 110 of the first embodiment. The functional configuration of this embodiment will be described with reference to FIG.

[0026] The image processing device 110 processes input data representing an image such as a chart, and generates image data (also referred to as output data) to be used for printing the image by the image forming device 140. The image processing device 110 has an image unevenness detection instruction unit 1101, a chart printing unit 1102, an image reading unit 1103, an image color conversion unit 1104, a period list holding unit 1105, an unevenness period determination unit 1106, an unevenness position determination unit 1107, a superimposed image creation unit 1108, and a display unit 1109.

[0027] Some or all of the functions of the image unevenness detection instruction unit 1101, chart printing unit 1102, image reading unit 1103, image color conversion unit 1104, period list holding unit 1105, unevenness period determination unit 1106, unevenness position determination unit 1107, superimposed image creation unit 1108, and display unit 1109 are realized by one or more processors including a CPU 111 reading out a program stored in a storage device 113, expanding it into a main memory 112, and executing it. In addition, some or all of the functions of the image unevenness detection instruction unit 1101, chart printing unit 1102, image reading unit 1103, image color conversion unit 1104, period list holding unit 1105, unevenness period determination unit 1106, unevenness position determination unit 1107, superimposed image creation unit 1108, and display unit 1109 may be realized by one or more circuits such as an ASIC (Application Specific Integrated Circuit) and a PLD (Programmable Logic Device) including an FPGA (Field Programmable Gate Array).

[0028] An image unevenness detection instruction unit 1101 instructs a chart printing unit 1102 to start image unevenness detection.

[0029] In response to a start instruction from the image unevenness detection instruction unit 1101, the chart printing unit 1102 reads out a chart (an example of input data) for detecting image unevenness from the chart storage unit, and outputs image data of the chart (an example of output data) and a print request for printing the chart to the image forming device 140. The chart storage unit may be part of the storage device 113.

[0030] The image forming device 140 prints an image of the chart on a medium in response to the print request for printing the chart and the image data of the chart acquired from the chart printing unit 1102 , and generates a printed matter 170 .

[0031] The image capturing device 150 captures an image of the printed matter 170 formed by the image forming device 140 , generates data of the captured image of the printed matter 170 , and outputs the data to the image processing device 110 .

[0032] The image reading unit 1103 acquires image data including data of a captured image from the image capturing device 150 .

[0033] An image color conversion unit 1104 acquires the captured image data from the image reading unit 1103 and performs color conversion on the image data.

[0034] The unevenness cycle determination unit 1106 determines and identifies the unevenness cycle, which is the cycle of unevenness in the image, based on the color-converted image data color-converted by the image color conversion unit 1104 and the cycle list acquired from the cycle list holding unit 1105. The unevenness cycle determination unit 1106 is also an example of a determination means.

[0035] The unevenness position determination unit 1107 obtains the color-converted image data from the image color conversion unit 1104 and the unevenness period from the unevenness period determination unit 1106, and determines and identifies one or more unevenness positions, which are the positions of unevenness in the image that exist for each unevenness period. Of the identified unevenness positions, the unevenness position determination unit 1107 determines and identifies the unevenness position of the most recognizable unevenness, which represents at least a portion of the unevenness. The unevenness position determination unit 1107 is also an example of an identification means.

[0036] The superimposed image creation unit 1108 acquires image data from the image reading unit 1103, the unevenness period from the unevenness period determination unit 1106, and the unevenness position from the unevenness position determination unit 1107, and generates either a superimposed image or a composite image as an output image. The superimposed image creation unit 1108 creates, for example, a marker image including a marker indicating the unevenness position, and creates an output image by superimposing or combining the marker image on the captured image. Here, the superimposed image creation unit 1108 creates the output image based on the most recognizable unevenness position. The superimposed image creation unit 1108 is also an example of a generation means.

[0037] The display unit 1109 acquires the superimposed image generated by the superimposed image generation unit 1108 and outputs it to the display device 130 .

[0038] The display device 130 displays a display image including the superimposed image acquired from the display unit 1109. The display device 130 may be, for example, a device capable of displaying an image, such as a liquid crystal display device.

[0039] <Processing flow in the first embodiment> Fig. 3 is a flowchart showing the determination process of the first embodiment. The determination process of the first embodiment will be described with reference to Fig. 3. Each process (step) in the flowchart is indicated by a reference number beginning with S.

[0040] First, in step S101, the image unevenness detection instruction unit 1101 transmits an image unevenness detection instruction to the chart printing unit 1102. The image unevenness detection instruction unit 1101 may transmit the image unevenness detection instruction periodically in accordance with the number of sheets output by the image forming apparatus 140.

[0041] Next, in step S102, when the chart printing unit 1102 receives an instruction to detect image unevenness, it reads out a chart (here, a full-surface uniform gradation chart) from the chart storage unit. The chart printing unit 1102 sends image data corresponding to the chart and a print request instructing printing of the chart to the image forming device 140, causing it to print. Upon receiving the image data, the image forming device 140 prints the chart on media based on the image data, generating a printed matter 170. The image forming device 140 is an electrophotographic printer.

[0042] The printed chart will now be described. FIG. 4(a) shows an example of a full-area uniform gradation chart. FIG. 4(b) shows an example of a printed matter 170 on which a full-area uniform gradation chart has been printed. The printed chart is a full-area uniform gradation chart, as shown in FIG. 4(a), which makes it easy to determine image unevenness. The full-area uniform gradation chart 400 has a 25% black gradation arranged over almost the entire surface of the A3 paper medium. The printed matter 170 shown in FIG. 4(b) includes four dark irregularities 402, 403, 404, and 405 within a printed area 401, which is the area where the chart is printed. The four irregularities 402, 403, 404, and 405 are periodically arranged along the paper feed direction. Of the four irregularities 402, 403, 404, and 405, the irregularity 404 is darker than the other three.

[0043] Next, in step S103, the image reading unit 1103 acquires a captured image of the printed matter 170 on which the chart is printed. Specifically, the image capturing device 150 captures an image of the printed matter 170, generates data of the captured image of the chart, and outputs the data to the image processing device 110. As a result, the image reading unit 1103 acquires the captured image of the chart. The captured data is, for example, in an image format in which each of RGB is 8 bits, and is data obtained by scanning an image of the entire surface of an A3-sized paper at a resolution of 1200 dpi. The image reading unit 1103 outputs the acquired captured data to the image color conversion unit 1104 and the superimposed image creation unit 1108.

[0044] Next, in step S104, the image color conversion unit 1104 performs color conversion processing on the captured image acquired from the image reading unit 1103, converting the color to brightness. Specifically, the image color conversion unit 1104 acquires a color conversion lookup table (hereinafter referred to as color conversion LUT) to be used from a color conversion lookup table storage unit. The image color conversion unit 1104 performs color conversion on the captured image using the color conversion LUT. The image color conversion unit 1104 outputs data of the captured image after color conversion (also referred to as color-converted image) to the unevenness period determination unit 1106 and the unevenness position determination unit 1107.

[0045] The color conversion LUT will now be described. FIG. 5 is a diagram showing an example of a color conversion LUT. The color conversion LUT shows the correspondence between the input 8-bit RGB pixel values ​​for each plate and the converted output 16-bit Float-type L*a*b* values ​​for each plate. The color conversion LUT is created by measuring the color of a printed material on which color patches are printed using a colorimeter. Even for the same image forming device 140, the color development varies depending on the medium of the printed material. Therefore, a color conversion LUT is prepared for each medium, and one created for the same medium as the printed material 170 is selected and applied. The image color conversion unit 1104, for example, converts the 8-bit RGB pixel values ​​of the captured image into 16-bit L*a*b* values ​​based on the color conversion LUT.

[0046] Next, in step S105, the unevenness cycle determination unit 1106 estimates an unevenness cycle candidate that can be recognized on the printed chart based on the captured image, for example, the most recognizable unevenness cycle candidate. Fig. 6 is a flowchart showing detailed processing of step S105 in the first embodiment. Fig. 7 is a diagram showing an example of the transition of processing of a profile generated from a printed material in the first embodiment. The estimation processing of step S105 will be described with reference to Figs. 6 and 7.

[0047] As shown in FIG. 6, in step S1051, the unevenness period determination unit 1106 averages the L* values ​​(also called brightness) of the captured image after color conversion in the main scanning direction to create a profile 700 in the paper feed direction. FIG. 7(a) is a schematic diagram of the profile 700 created from the printout of FIG. 4(b). The horizontal axis of FIG. 7(a) represents the position [mm] in the paper feed direction. The vertical axis represents the average value of the L* values ​​at each position (hereinafter referred to as the average L* value). The profile 700 at position 701 in FIG. 7(a) corresponds to the unevenness 402 in FIG. 4(b). Similarly, the profile 700 at position 702 corresponds to the unevenness 403, the profile 700 at position 703 corresponds to the unevenness 404, and the profile 700 at position 704 corresponds to the unevenness 405. The distance between each unevenness is approximately 94 [mm].

[0048] In step S1052, the unevenness period determination unit 1106 converts the created profile 700 into frequency data 705 using a Fourier transform. Since the Fourier transform process is common knowledge, a description thereof will be omitted here. Fig. 7(b) is a diagram showing frequency data 705 obtained by performing a Fourier transform on the profile 700 of Fig. 7(a).

[0049] In step S1053, the unevenness period determination unit 1106 multiplies the created frequency data 705 by VTF 706 of the Dooly visual characteristic shown in Fig. 7(b) to convert it into a psychophysical quantity. VTF stands for Visual Transfer Function. Fig. 7(c) shows a multiplication result 707 obtained by multiplying the frequency data 705 by VTF 706 of Dooly.

[0050] In step S1054, the unevenness period determination unit 1106 selects the frequency band with the highest peak from the frequency data multiplied by the visual characteristic VTF. As shown in Fig. 7(c), the unevenness period determination unit 1106 estimates the selected frequency band as the recognized unevenness period candidate 708. The value of the recognized unevenness period candidate 708 is approximately 0.01 [cycle / mm].

[0051] This concludes the detailed description of step S105.

[0052] Next, in step S106, the unevenness cycle determination unit 1106 compares the selected, recognized unevenness cycle candidate with a pre-prepared cycle list. The unevenness cycle determination unit 1106 then determines and identifies the unevenness cycle corresponding to the unevenness cycle candidate from the cycle list. FIG. 8 is a diagram showing an example of the cycle list in the first embodiment. The cycle list associates the names of components of the image forming apparatus 140 with their on-image cycles. The on-image cycles are listed in units of mm and cycles / mm. The unevenness cycle determination unit 1106 selects the drum whose on-image cycle value is closest to the selected unevenness cycle candidate, 0.01 cycles / mm. The unevenness cycle determination unit 1106 determines and identifies the unevenness cycle corresponding to the unevenness cycle candidate as 94.25 mm and 0.0106 cycles / mm, which are the on-image cycles of the drum. The unevenness cycle determining unit 1106 outputs the identified unevenness cycle as a determination result to the superimposed image creating unit 1108 .

[0053] If there is no on-image period value close to the candidate unevenness period and a component cannot be selected, the unevenness period determination unit 1106 determines that there is no unevenness period corresponding to the candidate unevenness period. Note that the unevenness period determination unit 1106 may determine whether there is an on-image period value close to the candidate unevenness period based on a predetermined determination threshold. For example, if the difference between the candidate unevenness period and the on-image period value is equal to or greater than the determination threshold, the unevenness period determination unit 1106 may determine that there is no on-image period close to the candidate unevenness period, i.e., that there is no unevenness period.

[0054] Next, in step S107, the unevenness cycle determination unit 1106 determines whether or not there is an unevenness cycle. If the unevenness cycle determination unit 1106 determines, based on the determination result of the previous step, that there is an unevenness cycle corresponding to the unevenness cycle candidate, the process proceeds to step S108. On the other hand, if the unevenness cycle determination unit 1106 determines that there is no unevenness cycle, the process proceeds to step S111.

[0055] Next, in step S108, the unevenness position determination unit 1107 determines and identifies the unevenness position, which is the position of unevenness that the user can most easily recognize, based on the degree of recognition. Here, multiple unevennesses exist for each unevenness period. The multiple unevenness positions indicating the positions of unevenness for each unevenness period are an example of a first unevenness position. The most recognizable unevenness position among the multiple first unevenness positions is an example of a second unevenness position. The degree of recognition may be, for example, a degree corresponding to the ease of recognition by the user. The degree of recognition may be information based on, for example, the L* value. For example, the degree of recognition may be information corresponding to the ease of recognition by the user based on the L* value itself, the size of an area with a high L* value, or the like. FIG. 9 is a detailed flowchart of step S108 in the first embodiment. FIG. 10 is a diagram illustrating the transition of an image and a profile in the unevenness position determination process. FIG. 10(a) is a diagram illustrating the transition of a captured image after color conversion in the unevenness position determination process. Fig. 10(b) is a diagram showing a profile 910 of the average L* value. Fig. 10(c) is a diagram showing a profile 911 generated by performing second differentiation on the profile 910 of the average L* value. The process of determining the position of unevenness will be described with reference to Figs. 9 and 10.

[0056] In step S1081, the unevenness position determination unit 1107 performs a Fourier transform on the L* value of the color-converted captured image to convert the L* value into a Fourier spectrum. As a result, the color-converted captured image 901 shown in Fig. 10(a) is transformed into a Fourier spectrum image 902 shown in Fig. 10(a) by the Fourier transform.

[0057] In step S1082, the unevenness position determination unit 1107 applies a low-frequency filter 903, which passes frequency components lower than the determined unevenness period, to the Fourier spectrum image 902. As a result, the unevenness position determination unit 1107 generates a Fourier spectrum after the low-frequency filter shown in Fig. 10(a) has been applied. Here, since the unevenness period determination unit 1106 has determined that the unevenness period is 0.01 [cycle / mm], the unevenness position determination unit 1107 uses a low-frequency filter that passes spectra (frequency components) of 0.01 [cycle / mm] or less.

[0058] In step S1083, the unevenness position determining unit 1107 performs an inverse Fourier transform on the Fourier spectrum to which the low-frequency filter has been applied, to generate a transformed image 904 shown in FIG. 10(a).

[0059] In step S1084, the unevenness position determination unit 1107 averages the L* values ​​in the main scanning direction for the converted image 904 to create a profile 910 of the average L* values ​​shown in FIG. 10(b). The horizontal axis in FIG. 10(b) represents the position [mm] in the paper feed direction, and the vertical axis represents the average L* value. By applying a low-frequency filter to the L* values ​​of the captured image, the period determined to be an unevenness period stands out in the profile 910.

[0060] In step S1085, the unevenness position determination unit 1107 determines the position where the gradient of the L* value is strongest in the profile 910 as the most recognizable unevenness position. Specifically, the unevenness position determination unit 1107 performs second differentiation on the profile 910 to generate the profile 911 shown in FIG. 10(c). The unevenness position determination unit 1107 determines the position 905 of the highest peak among the multiple peaks in the profile 911 generated by the second differentiation as the unevenness position. The unevenness position determination unit 1107 determines and identifies 290 [mm] as the unevenness position. The unevenness position determination unit 1107 outputs the identified unevenness position as the determination result to the superimposed image creation unit 1108.

[0061] This concludes the detailed description of step S108.

[0062] Next, in step S109, the superimposed image creation unit 1108 creates a marker image from the determined unevenness period and unevenness position. The marker image is an image that is superimposed on the captured image to present the most easily recognizable unevenness position on the captured image and the unevenness period based on that unevenness position. The superimposed image creation unit 1108 creates the marker image with the same resolution and image format as the captured image. The superimposed image creation unit 1108 sets the size of the marker image in the paper feed direction to the same size as the captured image. In this embodiment, the marker image and the captured image are in an image format with 8 bits and 1200 dpi for each of RGB, and the size in the paper feed direction is A3 size.

[0063] FIG. 11 illustrates examples of marker images and output images in the first embodiment. The output image includes a superimposed image and a composite image, which will be described below. FIG. 11(a) illustrates an example of a line-based marker image 1005. As shown in FIG. 11(a), the superimposed image creation unit 1108 may generate a marker image 1005 including line-based markers 1001 and 1002 drawn every 94.25 mm, which is the unevenness period. In this case, the markers 1001 and 1002 are drawn every 3,353 pixels. In creating the marker image 1005, the superimposed image creation unit 1108 first places a marker 1001, which represents the most recognizable unevenness position and is part of the marker image 1005, at the most recognizable unevenness position. The superimposed image creation unit 1108 then places another marker 1002 representing the unevenness position at a position spaced apart by the distance of the unevenness period from the marker 1001 representing the most recognizable unevenness position. The superimposed image creation unit 1108 may create and arrange multiple markers 1002 for indicating the position of unevenness. The superimposed image creation unit 1108 may make the marker 1001 different from the other markers 1002 so that it can be distinguished. For example, the superimposed image creation unit 1108 may create the marker 1001 thicker than the other markers 1002 or in a different color than the other markers 1002. The superimposed image creation unit 1108 may also add an explanation of the unevenness period next to the line diagram. In this way, the superimposed image creation unit 1108 creates a marker image 1005 including the markers 1001, 1002, and the explanation. The name of the component corresponding to the identified unevenness may also be referenced from the period list and displayed together, such as "Drum 94 mm" in FIG. 11.

[0064] On the other hand, FIG. 11(b) is a diagram showing an example of a marker image 1006 different from that shown in FIG. 11(a). The superimposed image creation unit 1108 may generate a marker image 1006 including markers 1003 and 1004 having shapes different from those of the markers 1001 and 1002. The superimposed image creation unit 1108 may further draw the marker 1003 for indicating the most recognizable unevenness position and the markers 1004 for indicating other unevenness positions in different colors. The superimposed image creation unit 1108 may draw the markers 1003 and 1004 in different shapes. FIG. 11(b) shows an example in which the marker 1003 for indicating the most recognizable unevenness position is drawn in black. In FIG. 11(b) as well, the superimposed image creation unit 1108 may place the markers 1004 at intervals equal to the unevenness period after placing the marker 1003.

[0065] Next, in step S110, the superimposed image creation unit 1108 creates an output image by superimposing or combining the created marker image on the unevenness position on the captured image to create a superimposed image or a composite image. In other words, the superimposed image creation unit 1108 creates an output image (an example of a display image) for displaying at least some of the identified unevenness by adding markers indicating the positions of the some unevenness. FIG. 11(c) is a diagram showing an example of a superimposed image. FIG. 11(d) is a diagram showing an example of a composite image. The superimposed image creation unit 1108 may create a superimposed image 1011 as shown in FIG. 11(c) by superimposing a marker image 1005 including the markers 1001 and 1002 of FIG. 11(a) on the captured image 1010. In addition, the superimposed image creation unit 1108 may create a composite image 1012 as shown in FIG. 11(d) by combining a marker image 1006 including markers 1003 and 1004 of FIG. 11(b) on the outside of the captured image 1010 inside the media.

[0066] Finally, in step S111, the display unit 1109 creates a detection result from the superimposed image and generates data of a display image as a detection result together with the superimposed image or composite image. The display unit 1109 transmits display image data to the display device 130, causing the display image to be displayed as a detection result.

[0067] 12A and 12B are diagrams showing examples of a display image including a determination result in the first embodiment. Fig. 12A is a diagram showing an example of a display image when unevenness is not detected or identified. Fig. 12B is a diagram showing an example of a display image when unevenness is detected and identified.

[0068] The display image will be described with reference to Fig. 12. When the unevenness period determination unit 1106 determines that there is no unevenness, the display unit 1109 may generate a display image 1201 including a captured image 1200 and a detection result indicating that no unevenness was detected, as shown in Fig. 12(a), and cause the display device 130 to display the display image 1201. When the unevenness period determination unit 1106 determines that there is unevenness, the display unit 1109 may generate a display image 1202 including the captured image 1200 and a detection result indicating that unevenness has been detected, as shown in Fig. 12(b), and cause the display device 130 to display the display image 1202. When there is unevenness, the display unit 1109 may include a superimposed image 1011 including the captured image 1010 and the marker image 1005 in the display image 1202.

[0069] This concludes the description of the determination process flow.

[0070] In step S101, the image unevenness detection instruction is automatically issued periodically according to the number of sheets output by the image forming apparatus, but the method of issuing the instruction is not limited to this. For example, the instruction may be based on an instruction from a user, or may be issued when a quality defect is determined during another image inspection.

[0071] Although the image forming device 140 is described as an electrophotographic printer, it may be any device that forms an image on a medium, such as an inkjet printer or an offset printing printer. In this case, the period list used in step S106 describes the periods of the rotating body used in the selected printing method.

[0072] In step S102, the chart was assumed to be a full-area uniform gradation chart with 25% black gradation arranged across the entire surface of an A3 sheet of paper, but any chart that can be used to determine image unevenness is acceptable, and the chart is not limited to a full-area uniform gradation chart. For example, the chart may be a full-area uniform chart for each color, a full-area uniform chart with all colors mixed together, or a uniform gradation chart in only a partial area rather than the entire area. The size of the chart may be any size greater than or equal to the unevenness period to be obtained.

[0073] Although the image capturing device 150 has been described as a line scan sensor arranged on the same media transport as the image forming device 140, the present invention is not limited to this. For example, the image capturing device 150 may be a camera arranged on the paper transport, a camera arranged in a photography booth for extracted printed matter, or a camera in a head-mounted display worn by a user or service provider, as long as it can capture an image of the highest frequency image irregularity that the user desires. The captured image may have any resolution, bit count, and size that can capture the highest frequency image irregularity that the user desires.

[0074] In step S104, the image color conversion unit 1104 performed color conversion processing using a color conversion LUT, but the color conversion method is not limited to this. For example, the image color conversion unit 1104 may perform color conversion processing using a color conversion formula and an ICC profile. Also, while the image color conversion unit 1104 converted RGB data into L*a*b* data, the color data after conversion is not limited to this. The image color conversion unit 1104 may convert into a color space other than the L*a*b* color space as long as it converts into a color that reflects visual characteristics.

[0075] In step S105, the unevenness period determination unit 1106 averaged the L* values ​​in the paper feed direction to create a profile, then performed a Fourier transform to convert the data into one-dimensional frequency data, and estimated the recognized unevenness period candidate. However, the estimation method is not limited to this. Any estimation method may be used as long as it converts the data into spatial frequency and takes into account the visual characteristic VTF. The unevenness period determination unit 1106 may determine the unevenness period using the visual spatial frequency characteristic in addition to the L* value (lightness). Therefore, the unevenness period determination unit 1106 may, for example, perform a short-time Fourier transform on the profile, multiply it by a filter that takes into account the visual characteristic VTF, and estimate the recognized unevenness period candidate from the result. Furthermore, in estimating the unevenness period candidate, the unevenness period determination unit 1106 may create a profile using the maximum L* value instead of the average L* value, or may apply the visual characteristic VTF to two-dimensional frequency data.

[0076] In step S1053, the unevenness cycle determination unit 1106 uses the Dooly formula for the visual characteristic VTF, but is not limited to this. The unevenness cycle determination unit 1106 may use any expression of the visual characteristic VTF, such as Barten's VTF or an actually measured VTF.

[0077] In step S106, the unevenness period determination unit 1106 selected the component whose period is closest to the unevenness period candidate, but the selection method is not limited to this. For example, the unevenness period determination unit 1106 may select the component whose integral multiple of the period on the image is closest to the unevenness period candidate.

[0078] In step S108, the unevenness position determination unit 1107 performed filtering, average profiling, and second-order differentiation after two-dimensional Fourier transform to determine the unevenness position, but the method for determining the unevenness position is not limited to this. The unevenness position determination unit 1107 only needs to determine the unevenness position with the largest gradient of the L* value. Therefore, the unevenness position determination unit 1107 may employ, for example, a method using a short-time Fourier transform to determine the unevenness position. Furthermore, the unevenness position determination unit 1107 may determine the unevenness position using the visual spatial frequency characteristics in addition to the L* value (lightness). In the above example, the unevenness position determination unit 1107 determines the unevenness position in the paper feed direction, but it may also determine the unevenness position that is easily recognized in the main scanning direction.

[0079] In step S109, two examples of marker images generated by the superimposed image generating unit 1108 are given, but the marker images are not limited to the above examples and may be any images that can present the most easily recognizable unevenness position and unevenness period.

[0080] In step S110, two examples were given in which the superimposed image creation unit 1108 creates a superimposed image by superimposing a marker image on a captured image. However, the superimposed image is not limited to these examples. The superimposed image creation unit 1108 may convert the pixel values, resolution, size, etc. of the marker image and the captured image during superimposition. Furthermore, if the display device 130 is a head-mounted display that displays a surrounding image captured by an attached camera, the marker image may be superimposed on a printed material included in the surrounding image. Furthermore, if the display device 130 is a head-mounted display that allows the user to visually confirm the surrounding environment and display only the image to be superimposed, the superimposed image creation unit 1108 may recognize the position of the printed material including the captured image and display only the marker image in accordance with the position of the printed material. Furthermore, if the image forming device 140 has an overprinting function for printing the detection results, the superimposed image creation unit 1108 may generate an image by printing the marker image on the printed material itself in which unevenness is detected.

[0081] In step S111, the display unit 1109 creates a display image including the detection result and displays it on the display device 130, but the display image is not limited to this format. The display image may at least display the detection result together with the superimposed image when it is determined that unevenness exists.

[0082] <Effects of the first embodiment> The image processing device 110 of the first embodiment determines the unevenness period, and determines the unevenness position that is easy to recognize based on the recognition degree from among a plurality of unevenness positions for each unevenness period, generates a marker based on the unevenness position, and outputs an image including the marker. This allows the first embodiment to make the user easily recognize unevenness.

[0083] In the first embodiment, an example was described in which the most easily recognizable position and period of image unevenness, which is one of the causes of defective images, were calculated and displayed. This made it possible to reduce individual differences in the recognition of image unevenness among users. As a result, the first embodiment can provide an impact on parts replacement, etc., determined based on the degree of the unevenness period.

[0084] In the first embodiment, the most recognizable unevenness position among a plurality of unevenness positions is used as a reference, and markers indicating other unevenness positions are placed. This makes it possible to suppress deviations between at least the most recognizable unevenness position and the marker positions.

[0085] In the first embodiment, the marker indicating the most recognizable unevenness position among a plurality of unevenness positions is made different from the other markers, thereby enabling the user to recognize the most recognizable unevenness position.

[0086] In the first embodiment, the marker that indicates the most recognizable unevenness position is made different from the other markers in at least one of color and shape, thereby enabling the user to more easily recognize the most recognizable unevenness position.

[0087] In the first embodiment, the unevenness period and the component causing the unevenness are displayed together with the marker. This allows the first embodiment to notify the user not only of the unevenness period and unevenness location but also of the cause of the unevenness, thereby further reducing the burden on the user of repairing the unevenness.

[0088] In the first embodiment, the RGB pixel values ​​of the captured image are converted into L*a*b* values ​​that take into account the color characteristics of the human eye, and the unevenness period is determined. This allows the first embodiment to place markers on unevenness that are easier for the user to recognize.

[0089] In the first embodiment, an unevenness period candidate is estimated, and the unevenness period is determined based on the estimated unevenness period candidate and periods registered in the period list. This enables the first embodiment to further improve the accuracy of determining the unevenness period.

[0090] In the first embodiment, the position of the most noticeable unevenness is determined based on the L* value, which uses the spatial frequency characteristics of vision. This allows the first embodiment to determine the position of unevenness that is most easily noticeable by the user.

[0091] (Second embodiment) In this embodiment, an image forming system including an image processing device that presents a plurality of most recognizable unevenness periods will be described.

[0092] <Hardware configuration in the second embodiment> FIG. 13 is a functional block diagram showing the functions of the image processing device 110 of the second embodiment. The functional configuration of the second embodiment will be described with reference to Fig. 13. The differences between the second embodiment and the first embodiment are three functional units: a multiple unevenness period determination unit 1110, a multiple unevenness position determination unit 1111, and a multiple unevenness compatible superimposed image creation unit 1112. The differences from the first embodiment will be mainly described in the second embodiment.

[0093] The multiple unevenness cycle determining unit 1110 determines multiple unevenness cycles based on the color-converted image data that has been color-converted by the image color converting unit 1104 and the cycle list acquired from the cycle list holding unit 1105 .

[0094] The multiple unevenness position determining unit 1111 obtains the captured image after color conversion from the image color converting unit 1104 and multiple unevenness periods from the multiple unevenness period determining unit 1110, and determines the unevenness positions of each.

[0095] A multiple unevenness compatible superimposed image creating unit 1112 acquires image data from an image reading unit 1103, multiple unevenness periods from a multiple unevenness period determining unit 1110, and multiple unevenness positions from a multiple unevenness position determining unit 1111, and generates a superimposed image.

[0096] <Processing flow in the second embodiment> Fig. 14 is a flowchart showing the determination process of the second embodiment. The determination process of the second embodiment will be described with reference to Fig. 14. The differences between the second embodiment and the first embodiment are seven steps: step S201, step S202, step S203, step S204, step S205, step S206, and step S207. The differences between the second embodiment and the first embodiment will be mainly described.

[0097] Fig. 15 is a diagram showing an example of a captured image 1501 to be processed in the second embodiment. Before describing each step, the printed matter in this embodiment will be described with reference to Fig. 15. The printed matter in this embodiment is a printed matter on which the full-area uniform gradation chart (see Fig. 4(a)) described in the first embodiment is printed, and is characterized by the presence of a mixture of unevenness with two different cycles.

[0098] In step S201, the multiple unevenness period determination unit 1110 estimates multiple recognizable unevenness period candidates. In the first embodiment described above, the single frequency band with the highest peak from the frequency data multiplied by the visual characteristic VTF was selected as the unevenness period candidate recognized in step S105. In this embodiment, the multiple unevenness period determination unit 1110 uses a threshold value to select multiple frequency bands with peaks equal to or greater than the threshold value as unevenness period candidates.

[0099] In step S202, the multiple unevenness period determination unit 1110 repeats steps up to S205 the number of times equal to the number of unevenness period candidates selected in the previous step.

[0100] In step S203, the multiple unevenness period determination unit 1110 determines the unevenness period candidates in order from the highest frequency. In the first embodiment described above, in step S106, one unevenness period is determined for one unevenness period candidate using the period list, but in this embodiment, determination using the period list is performed on the multiple unevenness period candidates in order from the highest frequency unevenness period candidate.

[0101] In step S108, the multiple unevenness position determining unit 1111 determines and identifies the most recognizable unevenness position from among the multiple unevenness positions identified by the unevenness period.

[0102] In step S204, the multiple unevenness cycle determination unit 1110 creates a color-converted image by removing the determined unevenness cycles selected in step S203 from the captured image. The multiple unevenness cycle determination unit 1110 performs a two-dimensional Fourier transform on the captured image, and then multiplies it by a high-frequency filter that removes frequencies higher than the selected unevenness cycles. The multiple unevenness cycle determination unit 1110 performs an inverse Fourier transform on the captured image that has been multiplied by the high-frequency filter, to create a captured image from which the selected unevenness cycles have been removed. Through this step, the multiple unevenness cycle determination unit 1110 can determine multiple unevenness cycles in order from high frequency.

[0103] In step S205, the multiple unevenness cycle determination unit 1110 determines whether the processing from S202 onwards has been repeated a number of times equal to the number of multiple unevenness cycle candidates. If the multiple unevenness cycle determination unit 1110 determines that the processing has not been repeated a number of times equal to the number of multiple unevenness cycle candidates, it repeats S202 onwards. On the other hand, if the multiple unevenness cycle determination unit 1110 determines that the processing has been repeated a number of times equal to the number of multiple unevenness cycle candidates, it proceeds to S206.

[0104] In step S109, the multiple unevenness corresponding superimposed image creating unit 1112 creates a marker image based on the unevenness period and the unevenness position. In the second embodiment, the multiple unevenness corresponding superimposed image creating unit 1112 creates as many marker images as there are unevenness period candidates.

[0105] In step S206, the multiple unevenness-compatible superimposed image creation unit 1112 arranges multiple marker images based on the most recognizable unevenness position. FIG. 16 is a diagram showing examples of marker images and an output image in the second embodiment. First, a description will be given using marker images 1601 and 1602 in FIG. 16(a) and the superimposed image in FIG. 16(c). In this example, two unevenness periods are determined, and the multiple unevenness-compatible superimposed image creation unit 1112 creates two types of marker images, 1601 and 1602. The superimposed images are arranged by performing the processing contents of step S110 in the first embodiment described above on the two unevenness periods. To prevent the two marker images 1601 and 1602 from overlapping and making them difficult to recognize, the multiple unevenness-compatible superimposed image creation unit 1112 shifts them in the main scanning direction and adjusts them so that they do not overlap and arranges them on the captured image 1501.

[0106] Next, an example of marker images 1603 and 1604 in FIG. 16(b) and a composite image in FIG. 16(d) will be described. In this example, two unevenness periods are determined, and the multiple unevenness-compatible superimposed image creating unit 1112 creates two types of marker images: 1603 and 1604. The multiple unevenness-compatible superimposed image creating unit 1112 generates marker images 1603 and 1604 including markers 1605 and 1606 that indicate the most recognizable unevenness positions. The multiple unevenness-compatible superimposed image creating unit 1112 assigns a number (also referred to as an index number or identification information) to each unevenness period to identify the unevenness period. The multiple unevenness-compatible superimposed image creating unit 1112 may assign numbers in order of frequency. The multiple unevenness-compatible superimposed image creating unit 1112 may assign a number to each unevenness position to identify the unevenness position. The multiple unevenness corresponding superimposed image creating unit 1112 creates a composite image by arranging the marker images 1603 and 1604 side by side without overlapping them on the photographed image 1501. In this example as well, the multiple unevenness corresponding superimposed image creating unit 1112 adjusts and arranges the two marker images by shifting them in the main scanning direction so that they do not overlap.

[0107] Finally, in step S207, the display unit 1109 causes the display device 130 to display a superimposed image or composite image including marker images of multiple unevenness periods and multiple unevenness positions, and a display image including the determination results, as detection results. Fig. 17 is a diagram showing an example of a display image including the determination results in the second embodiment. In this example, in addition to a superimposed image including marker images 1601 and 1602 and the captured image 1501, a list of the determined unevenness and the components that cause the unevenness is displayed.

[0108] This concludes the description of the determination process flow in this embodiment.

[0109] In steps S201, S202, S203, and S204, multiple candidates for the unevenness period are estimated, and then the unevenness period and the unevenness position are determined in order from the high frequency. However, the method for determining multiple different unevenness periods is not limited to this method.

[0110] In this embodiment, an example has been described in which irregularities with different periods are judged as independent irregularities, but even if the periods are the same, they may be judged as different irregularities if the phases are different.

[0111] <Effects of the second embodiment> In the second embodiment, an example was described in which the most easily recognizable unevenness position and unevenness period for each of multiple unevenness periods in an image were calculated and displayed, thereby making it possible to reduce individual differences in the recognition of unevenness in an image even when a printed matter contains a mixture of multiple unevenness periods caused by different factors.

[0112] In the second embodiment, even when multiple unevenness cycles are determined and multiple marker images are created, the multiple marker images are shifted and arranged to generate a superimposed image or a composite image, which allows the user to easily recognize each unevenness even when multiple unevenness cycles are determined.

[0113] (Other embodiments) The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0114] The disclosure of this specification includes the following image processing device, image processing method, and program. (Item 1) an unevenness period determination means for determining an unevenness period, which is a period of positions of unevenness occurring in an input image, based on a predetermined period list; an unevenness position determining means for determining, based on the unevenness period and the input image, one of a plurality of first unevenness positions, which are positions of unevenness for each unevenness period, as a second unevenness position based on a degree of recognition; a superimposed image creating means for creating an output image including a marker image including a marker indicating the unevenness position based on the unevenness period and the second unevenness position; An image processing device comprising: (Item 2) image reading means for reading an image to be processed and generating image data; a color conversion means for converting the color of the input image data to generate color-converted image data; Item 2. The image processing device according to item 1, comprising: (Item 3) The superimposed image creating means creates the marker image by arranging the markers at the plurality of first unevenness positions based on the second unevenness position. 3. The image processing device according to item 1 or 2, (Item 4) The superimposed image creating means creates the marker image by differentiating the marker indicating the second unevenness position from the marker indicating the first unevenness position. 4. The image processing device according to any one of items 1 to 3, wherein: (Item 5) The superimposed image creating means creates the marker image by differentiating at least one of the color and the shape of the marker indicating the second unevenness position and the marker indicating the first unevenness position. 5. The image processing device according to any one of items 1 to 4, wherein: (Item 6) The superimposed image creating means creates an image including, together with the marker image, identification information of the unevenness period, and information regarding at least one of the unevenness period and the unevenness position. 6. The image processing device according to any one of items 1 to 5, wherein: (Item 7) When a plurality of unevenness periods are determined, the superimposed image creating means arranges the marker images corresponding to the plurality of unevenness periods so as not to overlap each other. 7. The image processing device according to any one of items 1 to 6, wherein: (Item 8) The color conversion means converts pixel values ​​of the input image data into a color space that takes into account the color characteristics of human vision. 3. The image processing device according to item 2, (Item 9) The unevenness period determination means estimates candidates for the unevenness period using visual spatial frequency characteristics, and determines the unevenness period based on the candidates for the unevenness period and the period list. 9. The image processing device according to any one of items 1 to 8, wherein: (Item 10) At least one of the unevenness position determining means makes a determination using visual spatial frequency characteristics and brightness. 10. The image processing device according to any one of items 1 to 9, wherein: (Item 11) a chart printing unit that instructs an image forming device that forms an image on a medium to print a chart; an image reading means for reading the printed chart into an image capturing device for capturing an image; a display unit for displaying the output image on a display device that displays an image; 11. The image processing device according to claim 1, further comprising: (Item 12) The display device is any one of a display, a head-mounted display, and an image forming device that performs overprinting. Item 12. The image processing device according to item 11. (Item 13) The unevenness position determining means determines the most recognizable unevenness position from among the plurality of first unevenness positions as the second unevenness position based on the degree of recognition. 13. The image processing device according to any one of items 1 to 12, wherein: (Item 14) The unevenness position determining means differentiates a profile of the average brightness of the input image and determines the most recognizable unevenness position from the plurality of first unevenness positions as the second unevenness position. 13. The image processing device according to any one of items 1 to 12, wherein: (Item 15) an unevenness period determination step of determining an unevenness period, which is a period of positions of unevenness occurring in an input image, based on a predetermined period list; an unevenness position determining step of determining, based on the unevenness period and the input image, one of a plurality of first unevenness positions, which is the position of unevenness for each unevenness period, as a second unevenness position based on a degree of recognition; a superimposed image creating step of creating an output image including a marker image including a marker indicating the unevenness position based on the unevenness period and the second unevenness position; An image processing method comprising: (Item 16) 15. A program for causing a computer to function as each means of the image processing device according to any one of items 1 to 14. (Item 17) 1. An image processing device that processes input data representing an image and generates output data for use in printing the image by a printing unit, comprising: an identification unit that identifies a plurality of periodic irregularities in the printed image; a generating means for generating a display image for displaying at least a part of the identified unevenness by adding a marker indicating the position of the part of the unevenness; 1. An image processing device comprising: (Item 18) 1. A method of image processing for processing input data representing an image to generate output data for use in printing the image by a printing unit, comprising: an identifying step of identifying a plurality of periodic irregularities in the printed image; a generating step of generating a display image for displaying at least some of the identified unevenness by adding markers indicating the positions of the some unevenness; 1. An image processing device comprising: (Item 19) Item 18. A program for causing a computer to function as each means of the image processing device described in Item 17.

[0115] The invention is not limited to the above-described embodiments, and various changes and modifications can be made without departing from the spirit and scope of the invention. Accordingly, the following claims are appended to apprise the public of the scope of the invention. [Explanation of symbols]

[0116] 110: Image processing device, 130: Display device, 140: Image forming device, 150: Image capturing device, 1101: Image unevenness detection instruction unit, 1102: Chart printing unit, 1103: Image reading unit, 1104: Image color conversion unit, 1105: Period list holding unit, 1106: Unevenness period determination unit, 1107: Unevenness position determination unit, 1108: Superimposed image creation unit, 1109: Display unit, 1005, 1006, 1601, 1602, 1603, 1604: Marker image, 1001, 1002, 1003, 1004, 1605: Marker, 1010, 1200, 1501: Captured image, 1011: Superimposed image; 1012: Composite image; 1201, 1202: Display image; 1110: Multiple unevenness period determination unit; 1111: Multiple unevenness position determination unit; 1112: Multiple unevenness compatible superimposed image creation unit.

Claims

1. an unevenness period determination means for determining an unevenness period, which is a period of positions of unevenness occurring in an input image, based on a predetermined period list; an unevenness position determining means for determining, based on the unevenness period and the input image, one of a plurality of first unevenness positions, which are positions of unevenness for each unevenness period, as a second unevenness position based on a degree of recognition; a superimposed image creating means for creating an output image including a marker image including a marker indicating the unevenness position based on the unevenness period and the second unevenness position; An image processing device comprising:

2. image reading means for reading an image to be processed and generating image data; a color conversion means for converting the color of the input image data to generate color-converted image data; The image processing device according to claim 1 , comprising:

3. The superimposed image creating means creates the marker image by arranging the markers at the plurality of first unevenness positions based on the second unevenness position.

2. The image processing device according to claim 1, wherein:

4. The superimposed image creating means creates the marker image by differentiating the marker indicating the second unevenness position from the marker indicating the first unevenness position.

2. The image processing device according to claim 1, wherein:

5. The superimposed image creating means creates the marker image by differentiating at least one of the color and the shape of the marker indicating the second unevenness position and the marker indicating the first unevenness position.

2. The image processing device according to claim 1, wherein:

6. The superimposed image creating means creates an image including, together with the marker image, identification information of the unevenness period, and information regarding at least one of the unevenness period and the unevenness position.

2. The image processing device according to claim 1, wherein:

7. When a plurality of unevenness periods are determined, the superimposed image creating means arranges the marker images corresponding to the plurality of unevenness periods so as not to overlap each other.

2. The image processing device according to claim 1, wherein:

8. The color conversion means converts pixel values ​​of the input image data into a color space that takes into account the color characteristics of human vision.

3. The image processing device according to claim 2.

9. The unevenness period determination means estimates candidates for the unevenness period using visual spatial frequency characteristics, and determines the unevenness period based on the candidates for the unevenness period and the period list.

2. The image processing device according to claim 1, wherein:

10. At least one of the unevenness position determining means makes a determination using visual spatial frequency characteristics and brightness.

2. The image processing device according to claim 1, wherein:

11. a chart printing unit that instructs an image forming device that forms an image on a medium to print a chart; an image reading means for reading the printed chart into an image capturing device for capturing an image; a display unit for displaying the output image on a display device that displays an image; The image processing device according to claim 1 , further comprising:

12. The display device is any one of a display, a head-mounted display, and an image forming device that performs overprinting.

12. The image processing device according to claim 11.

13. The unevenness position determining means determines the most recognizable unevenness position from among the plurality of first unevenness positions as the second unevenness position based on the degree of recognition.

2. The image processing device according to claim 1, wherein:

14. The unevenness position determining means differentiates a profile of the average brightness of the input image and determines the most recognizable unevenness position from the plurality of first unevenness positions as the second unevenness position.

2. The image processing device according to claim 1, wherein:

15. an unevenness period determination step of determining an unevenness period, which is a period of positions of unevenness occurring in an input image, based on a predetermined period list; an unevenness position determining step of determining, based on the unevenness period and the input image, one of a plurality of first unevenness positions, which are positions of unevenness for each unevenness period, as a second unevenness position based on a degree of recognition; a superimposed image creating step of creating an output image including a marker image including a marker indicating the unevenness position based on the unevenness period and the second unevenness position; An image processing method comprising:

16. A program for causing a computer to function as each of the means of the image processing device according to any one of claims 1 to 14.

17. 1. An image processing device that processes input data representing an image and generates output data for use in printing the image by a printing unit, comprising: an identification unit that identifies a plurality of periodic irregularities in the printed image; a generating means for generating a display image for displaying at least a part of the identified unevenness by adding a marker indicating the position of the part of unevenness; 1. An image processing device comprising:

18. 1. A method of image processing for processing input data representing an image to generate output data for use in printing the image by a printing unit, comprising: an identifying step of identifying a plurality of periodic irregularities in the printed image; a generating step of generating a display image for displaying at least some of the identified unevennesses by adding markers indicating the positions of the some unevennesses; 1. An image processing device comprising:

19. A program for causing a computer to function as each of the means of the image processing apparatus according to claim 17.

Images