Printing method, printing apparatus, and program product

Abstract

The invention provides a printing method, a printing apparatus, and a program product capable of reducing the possibility of a reduction in correction accuracy of a printed image. The printing method comprises the following control performed by a computer: obtaining a shot image, a first template image and a second template image; extracting a first corresponding region corresponding to the first region of interest by matching the first template image with the captured image; calculating a first deviation, which is a deviation between the position coordinates of the first region of interest and the position coordinates of the first corresponding region; correcting the second template image based on the first deviation; extracting a second corresponding region corresponding to the second region of interest by matching the corrected second template image with the captured image; calculating a second deviation, which is a deviation between the position coordinates of the second region of interest and the position coordinates of the second corresponding region; correcting the printing image based on the second deviation; and printing the corrected printing image by the printing device.

Description

Technical Field

[0001] This invention relates to a printing method, a printing apparatus, and a process product. Background Technology

[0002] Patent Document 1 describes a printing method for detecting deformation of a medium by matching a template image containing feature points of a pattern with an image obtained by photographing a patterned medium. This printing method corrects the printed image to match the deformation of the medium, thereby printing an image on the medium that matches the pattern.

[0003] In this printing method, if the medium deforms significantly, the matching accuracy between the captured image and the template image may decrease. In this case, the correction accuracy of the printed image may also decrease.

[0004] Patent Document 1: Japanese Patent Application Publication No. 2021-84360 Summary of the Invention

[0005] The printing method for solving the above-mentioned problem is a printing method implemented by a computer-controlled printing apparatus for printing on a medium. The method includes the computer controlling the following steps: acquiring a photographic image obtained by photographing a medium with a pattern; acquiring a first template image containing a first region of interest set on a pattern image representing the pattern; acquiring a second template image containing a second region of interest set on the pattern image; extracting a first corresponding region corresponding to the first region of interest by matching the first template image with the photographic image; calculating a first deviation, i.e., a deviation between the position coordinates of the first region of interest in the pattern image and the position coordinates of the first corresponding region in the photographic image; correcting the second template image based on the first deviation; extracting a second corresponding region corresponding to the second region of interest by matching the corrected second template image with the photographic image; calculating a second deviation, i.e., a deviation between the position coordinates of the second region of interest in the pattern image and the position coordinates of the second corresponding region in the photographic image; correcting a printed image representing an image printed on the medium based on the second deviation; and having the printing apparatus print the corrected printed image.

[0006] A printing apparatus for solving the above-mentioned problems includes: a printing unit that prints an image on a medium; and a control unit configured to perform the following control: acquiring a captured image obtained by photographing a medium having a pattern; acquiring a first template image including a first region of interest set on a pattern image representing the pattern; acquiring a second template image including a second region of interest set on the pattern image; extracting a first corresponding region corresponding to the first region of interest by matching the first template image with the captured image; calculating a first deviation, i.e., a deviation between the position coordinates of the first region of interest in the pattern image and the position coordinates of the first corresponding region in the captured image; correcting the second template image based on the first deviation; extracting a second corresponding region corresponding to the second region of interest by matching the corrected second template image with the captured image; calculating a second deviation, i.e., a deviation between the position coordinates of the second region of interest in the pattern image and the position coordinates of the second corresponding region in the captured image; correcting a printed image representing an image printed on the medium based on the second deviation; and having the printing unit print the corrected printed image.

[0007] A program product for solving the above-mentioned problems includes a program that causes a computer controlling a printing apparatus for printing on a medium to perform the following control: acquiring a photographic image obtained by photographing a patterned medium; acquiring a first template image containing a first region of interest set on a pattern image representing the pattern; acquiring a second template image containing a second region of interest set on the pattern image; extracting a first corresponding region corresponding to the first region of interest by matching the first template image with the photographed image; calculating a first deviation, i.e., a deviation between the position coordinates of the first region of interest in the pattern image and the position coordinates of the first corresponding region in the photographed image; correcting the second template image based on the first deviation; extracting a second corresponding region corresponding to the second region of interest by matching the corrected second template image with the photographed image; calculating a second deviation, i.e., a deviation between the position coordinates of the second region of interest in the pattern image and the position coordinates of the second corresponding region in the photographed image; correcting a printed image representing an image printed on a medium based on the second deviation; and causing the printing apparatus to print the corrected printed image. Attached Figure Description

[0008] Figure 1 A block diagram illustrating an example of a printing apparatus.

[0009] Figure 2A top view showing an example of a patterned medium.

[0010] Figure 3 A diagram showing an example of a patterned image.

[0011] Figure 4 This is a diagram illustrating an example of a captured image.

[0012] Figure 5 A diagram showing an example of a printed image.

[0013] Figure 6 A diagram representing an example of mapped data.

[0014] Figure 7 This is a diagram representing an example of a template image.

[0015] Figure 8 A graph representing the corresponding region based on template matching.

[0016] Figure 9 A graph representing the deviation between the region of interest and the corresponding region.

[0017] Figure 10 This is a diagram representing the corrected template image.

[0018] Figure 11 To indicate and Figure 9 Graphs showing different deviations.

[0019] Figure 12 To indicate and Figure 10 Images of different corrected template images.

[0020] Figure 13 This is a diagram representing the corresponding region after correction based on template matching.

[0021] Figure 14 A flowchart illustrating an example of the printing process. Detailed Implementation

[0022] Hereinafter, an example of a printing apparatus and printing method will be described with reference to the accompanying drawings. First, the printing apparatus will be described. The printing apparatus is, for example, an inkjet printer that prints images such as text and photographs by spraying ink, which is an example of a liquid, onto a medium such as paper, cloth, or film.

[0023] Printing apparatus

[0024] like Figure 1As shown, the printing apparatus 11 includes a printing unit 12. The printing unit 12 is configured to print an image on a medium 99. Specifically, the printing unit 12 prints an image on the medium 99 by spraying liquid onto the medium 99. The printing unit 12 has a head for spraying liquid. In one example, the printing unit 12 has a serial head that scans relative to the medium 99. The printing unit 12 may also have a line head capable of spraying liquid across the width of the medium 99. The printing unit 12 may also print an image on the medium 99 by fixing powder onto the medium 99. The printing apparatus 11 may also be, for example, a laser printer.

[0025] like Figure 2 As shown, medium 99 has a pattern P1. Pattern P1 is composed of graphics, designs, etc., pre-implanted on medium 99 to give it an aesthetically pleasing appearance. Pattern P1 is formed periodically on medium 99. In one example, pattern P1 is formed periodically on medium 99 in a manner that repeats in the transport direction Y1. The transport direction Y1 is the direction in which medium 99 is transported. Pattern P1 can also be formed periodically in the width direction X1. The width direction X1 is a direction different from the transport direction Y1. The width direction X1 is a direction that serves as an indicator of the width of medium 99. The width direction X1 and the transport direction Y1 are directions that extend on the plane of medium 99.

[0026] The medium 99 can also be fabric. For example, the medium 99 can be jacquard fabric. Jacquard fabric is fabric in which the pattern P1 is formed through weaving. The pattern P1 can be formed either by the raised or recessed areas created by weaving, or by the color of the thread used in the weaving. The pattern P1 can also be formed by pre-dyeing the medium 99. The pattern P1 can also be formed by pre-printing the medium 99. The medium 99 is not limited to jacquard fabric; it can also be simple fabric. The medium 99 is not limited to fabric; it can also be paper, film, etc.

[0027] The medium 99 can also be a strip in the conveying direction Y1. The medium 99 can be, for example, cloth, paper, film, etc., unwound from a roll. The medium 99 is not limited to being a strip in the conveying direction Y1; it can also be a single sheet.

[0028] like Figure 1 As shown, the printing apparatus 11 may also include a conveying unit 13. The conveying unit 13 is configured to convey the medium 99. The conveying unit 13 may also include a belt, rollers, etc. In one example, the conveying unit 13 conveys the medium 99 intermittently. The conveying unit 13 may also convey the medium 99 continuously.

[0029] The printing apparatus 11 may also include an imaging unit 14. The imaging unit 14 is configured to photograph the medium 99. The imaging unit 14 includes, for example, a camera. The imaging unit 14 photographs the medium 99 before printing is performed by the printing unit 12.

[0030] The imaging unit 14 may also be configured to photograph the medium 99 conveyed by the transport unit 13. In one example, the imaging unit 14 is located upstream of the printing unit 12 in the transport direction Y1. The imaging unit 14 may also be configured to photograph the medium 99 placed on the imaging stage.

[0031] The imaging unit 14 captures images of the medium 99 in a manner that reflects the existing pattern P1. In one example, the imaging unit 14 spans the entire width to capture images of the medium 99. The imaging unit 14 can be configured to scan relative to the medium 99, or it can be configured to be a strip in the width direction X1.

[0032] The printing apparatus 11 includes a storage unit 15. The storage unit 15 is configured to store one or more programs. The storage unit 15 includes memory such as ROM and RAM. The storage unit 15 may also include storage media such as SSD and HDD.

[0033] In addition to the program, the storage unit 15 also stores various data used during printing. In one example, the storage unit 15 stores the pattern image D1. The storage unit 15 stores the captured image D2. The storage unit 15 stores the printed image D3. The storage unit 15 stores the mapping data D4. The storage unit 15 stores multiple template images T0. For example, the storage unit 15 stores the first template image T1. For example, the storage unit 15 stores the second template image T2. For example, the storage unit 15 stores the third template image T3.

[0034] like Figure 3 As shown, pattern image D1 represents pattern P1. Pattern image D1 contains the basic data of pattern P1. Alternatively, pattern image D1 can be described as representing the ideal pattern P1. More specifically, pattern image D1 represents the ideal shape of pattern P1. Pattern image D1 can also be generated by printing apparatus 11. Pattern image D1 can also be input into printing apparatus 11 from an external device different from printing apparatus 11.

[0035] The pattern image D1 can also be generated based on CAD data representing the pattern P1 created by software. In one example, the pattern image D1 is obtained based on the CAD data of the pattern P1 and a pre-scanned image obtained by pre-capturing the medium 99. For example, the pattern image D1 is obtained by correcting the brightness of the image represented by the CAD data based on the brightness represented by the pre-scanned image. The CAD data is used to obtain the medium 99 with the pattern P1. Based on the CAD data, the medium 99 with the pattern P1 can be produced either by a loom or by a printing apparatus 11. The pre-scanned image can also be obtained by pre-capturing the medium 99 with the pattern P1 using the imaging unit 14. The pre-scanned image can also be obtained by pre-capturing the medium 99 with the pattern P1 using an imaging device different from the imaging unit 14.

[0036] like Figure 4 As shown, image D2 is an image obtained by photographing medium 99. Image D2 is an image reflecting pattern P1. Image D2 is an image obtained by photographing medium 99 across its entire width. Image D2 is an image obtained by photographing medium 99 with pattern P1 containing at least one periodicity. Image D2 can also be generated by printing apparatus 11. In one example, image D2 is generated by photographing medium 99 using photographing unit 14. Image D2 can also be input into printing apparatus 11 from an external device. Image D2 can also be an image obtained by photographing medium 99 using a photographing device different from photographing unit 14.

[0037] Image D2 is a different image from the pre-scanned image. Image D2 is an image captured during printing. In one example, image D2 is an image captured during transport by the transport unit 13. Image D2 can also be described as an image showing the state of the medium 99 during printing. Therefore, in image D2, deformation may sometimes occur on the medium 99 due to tension applied to it during transport, the posture of the medium 99 during printing, etc.

[0038] like Figure 5As shown, the printed image D3 is an image printed on the medium 99. The printed image D3 represents the shape, color, etc., of the image printed on the medium 99 having the pattern P1. The printed image D3 is printed on the medium 99 by the printing unit 12. The printing unit 12 prints the printed image D3 according to the pattern P1. The printed image D3 is, for example, an image that colors the pattern P1. The printed image D3 is not limited to an image that colors the pattern P1; it can be an image showing a pattern different from the pattern P1, or an image that reverses the surface of the pattern P1. The printed image D3 can be printed on the same surface of the medium 99 as the surface to which the pattern P1 is applied, or it can be printed on the opposite surface. The printed image D3 can also be generated by the printing apparatus 11. The printed image D3 can also be input into the printing apparatus 11 from an external device.

[0039] like Figure 6 As shown, mapping data D4 represents multiple regions of interest R0 set in the pattern image D1. A region of interest R0 is a region containing characteristic parts of the pattern image D1. For example, a region containing feature points in the pattern image D1. Mapping data D4 represents the position, size, etc., of each of the multiple regions of interest R0 in the pattern image D1. Alternatively, mapping data D4 can be described as data defining the multiple regions of interest R0. Mapping data D4 can also be data attached to the pattern image D1. Mapping data D4 can also be generated by the printing apparatus 11. For example, mapping data D4 can be generated by the printing apparatus 11 setting multiple regions of interest R0 in the pattern image D1. Mapping data D4 can also be input into the printing apparatus 11 from an external device.

[0040] The region of interest R0 can be set manually or automatically. R0 can also be set manually by the user operating the computer. Alternatively, R0 can be set automatically by the computer performing actions according to a prescribed algorithm. In this case, R0 is set by the computer extracting feature points from the pattern image D1.

[0041] The region of interest R0 can also be set in areas of high brightness gradient in the pattern image D1. For example, R0 can also be set at the edges or corners of pattern P1. Figure 6 In the example shown, for ease of understanding, it is not limited to the edges and corners of the pattern P1, but is set to have multiple regions of interest R0 scattered in the pattern image D1.

[0042] Mapping data D4 may also include a first region of interest R1. That is, multiple regions of interest R0 may also include the first region of interest R1. The first region of interest R1 is the region containing the first feature point in the pattern image D1. Mapping data D4 may also include a second region of interest R2. That is, multiple regions of interest R0 may also include the second region of interest R2. The second region of interest R2 is the region containing the second feature point in the pattern image D1. Mapping data D4 may also include a third region of interest R3. That is, multiple regions of interest R0 may also include the third region of interest R3. The third region of interest R3 is the region containing the third feature point in the pattern image D1.

[0043] One of the multiple regions of interest R0 is designated as the first region of interest R1. One of the other regions of interest R0 besides the first region of interest R1 is designated as the second region of interest R2. One of the other regions of interest R0 besides the first region of interest R1 and the second region of interest R2 is designated as the third region of interest R3.

[0044] The first region of interest R1, the second region of interest R2, and the third region of interest R3 are any regions among multiple regions of interest R0. Therefore, the first region of interest R1, the second region of interest R2, and the third region of interest R3 are not limited to those located in... Figure 6 The area is located as shown. The first area of ​​concern R1 can also be an area upstream of the second area of ​​concern R2 in the conveying direction Y1. The first area of ​​concern R1 can also be a area downstream of the second area of ​​concern R2 in the conveying direction Y1. The first area of ​​concern R1 can also be an area located at a different position from the second area of ​​concern R2 in the width direction X1. The first area of ​​concern R1 can also be an area upstream of the third area of ​​concern R3 in the conveying direction Y1. The first area of ​​concern R1 can also be a area downstream of the third area of ​​concern R3 in the conveying direction Y1. The first area of ​​concern R1 can also be an area located at a different position from the third area of ​​concern R3 in the width direction X1. The second area of ​​concern R2 can also be an area upstream of the third area of ​​concern R3 in the conveying direction Y1. The second area of ​​concern R2 can also be a area downstream of the third area of ​​concern R3 in the conveying direction Y1. The second area of ​​concern R2 can also be an area located at a different position from the third area of ​​concern R3 in the width direction X1.

[0045] like Figure 7As shown, template image T0 is an image containing regions of interest R0. That is, template image T0 is an image containing feature points in pattern image D1. Template image T0 is an image extracted from pattern image D1. Template image T0 is extracted from pattern image D1 for each region of interest R0. First template image T1 is an image containing a first region of interest R1. Second template image T2 is an image containing a second region of interest R2. Third template image T3 is an image containing a third region of interest R3. Template image T0 can also be extracted from pattern image D1 by printing device 11. Template image T0 can also be extracted from pattern image D1 by external device. Template image T0 is used for template matching with captured image D2.

[0046] like Figure 1 As shown, the printing apparatus 11 includes a control unit 16. The control unit 16 is configured to execute processing according to a program stored in the storage unit 15. The control unit 16 includes a processor such as a CPU or GPU. The control unit 16 may also include hardware circuitry such as an ASIC. In this way, the control unit 16 and the storage unit 15 together realize a computer. Therefore, the printing apparatus 11 includes a computer. In other words, the computer controls the printing apparatus 11.

[0047] The control unit 16 controls various structures included in the printing apparatus 11. For example, the control unit 16 controls the printing unit 12, the transport unit 13, and the imaging unit 14. Therefore, the control unit 16 can acquire pattern image D1, image D2, printed image D3, mapping data D4, and template image T0. The control unit 16 can also acquire image D2 from the imaging unit 14. The control unit 16 can also acquire mapping data D4 by setting multiple regions of interest R0 on pattern image D1. The control unit 16 can also acquire template image T0 from pattern image D1. The control unit 16 can also communicate with external devices. The control unit 16 can also acquire pattern image D1, image D2, printed image D3, mapping data D4, and template image T0 from external devices.

[0048] The control unit 16 is configured to correct the printed image D3. Specifically, the control unit 16 is configured to correct the printed image D3 based on the deformation of the medium 99. By correcting the printed image D3, the control unit 16 prints the printed image D3 in a manner consistent with the pattern P1. The control unit 16 performs template matching on the captured image D2 to detect the deformation of the medium 99. Specifically, the control unit 16 matches the template image T0 with the captured image D2. The control unit 16 performs template matching for each template image T0 for the captured image D2. The control unit 16 matches the first template image T1 with the captured image D2. The control unit 16 matches the second template image T2 with the captured image D2. The control unit 16 matches the third template image T3 with the captured image D2.

[0049] like Figure 8 As shown, the control unit 16 extracts the corresponding region S0 by matching the template image T0 with the captured image D2. The corresponding region S0 is the region in the captured image D2 that is matched by the template image T0. The corresponding region S0 is the region corresponding to the region of interest R0 contained in the template image T0. That is, the corresponding region S0 is the region containing feature points corresponding to the feature points contained in the region of interest R0.

[0050] The control unit 16 extracts multiple corresponding regions S0 by performing template matching on the captured image D2. The control unit 16 can also extract a first corresponding region S1 by matching a first template image T1 with the captured image D2. The first corresponding region S1 is the region corresponding to a first region of interest R1. The first corresponding region S1 is the region containing a feature point corresponding to a first feature point. The control unit 16 can also extract a second corresponding region S2 by matching a second template image T2 with the captured image D2. The second corresponding region S2 is the region corresponding to a second region of interest R2. The second corresponding region S2 is the region containing a feature point corresponding to a second feature point. The control unit 16 can also extract a third corresponding region S3 by matching a third template image T3 with the captured image D2. The third corresponding region S3 is the region corresponding to a third region of interest R3. The third corresponding region S3 is the region containing a feature point corresponding to a third feature point. In this way, the multiple corresponding regions S0 can also include the first corresponding region S1, the second corresponding region S2, the third corresponding region S3, etc. The control unit 16 extracts multiple corresponding regions S0 to determine the position of the pattern P1 in the captured image D2. Thus, the control unit 16 determines the deformation of the medium 99.

[0051] The first corresponding region S1 can also be an area located upstream of the second corresponding region S2 in the conveying direction Y1. The first corresponding region S1 can also be a area located downstream of the second corresponding region S2 in the conveying direction Y1. The first corresponding region S1 can also be an area located at a different position from the second corresponding region S2 in the width direction X1. The first corresponding region S1 can also be an area located upstream of the third corresponding region S3 in the conveying direction Y1. The first corresponding region S1 can also be a area located downstream of the third corresponding region S3 in the conveying direction Y1. The first corresponding region S1 can also be an area located at a different position from the third corresponding region S3 in the width direction X1. The second corresponding region S2 can also be an area located upstream of the third corresponding region S3 in the conveying direction Y1. The second corresponding region S2 can also be a area located downstream of the third corresponding region S3 in the conveying direction Y1. The second corresponding region S2 can also be an area located at a different position from the third corresponding region S3 in the width direction X1. The positional relationship between the first corresponding region S1, the second corresponding region S2, and the third corresponding region S3 is defined by the positional relationship between the first region of interest R1, the second region of interest R2, and the third region of interest R3.

[0052] In the printing apparatus 11, to improve printing quality, tension is sometimes applied to the medium 99 during transport. Therefore, deformation sometimes occurs on the medium 99 during printing. Furthermore, deformation can occur on the medium 99 depending on its orientation during printing, its storage condition, etc. If the deformation of the medium 99 is significant, the accuracy of the template matching may decrease. That is, because the pattern P1 reflected in the captured image D2 is deformed, the matching accuracy with the template image T0 may decrease. In this case, since the printing apparatus 11 cannot accurately determine the position of the pattern P1, it may be unable to accurately correct the printed image D3.

[0053] Printing methods

[0054] Next, a printing method that suppresses the reduction in template matching accuracy will be described. Frankly, the printing apparatus 11 reduces the possibility of reduced template matching accuracy by correcting the template image T0 in accordance with the deformation of the medium 99.

[0055] like Figure 9As shown, when deformation occurs on medium 99, if template image T0 is matched with captured image D2, sometimes the position coordinates of region R0 represented by mapping data D4 deviate from the position coordinates of the corresponding region S0 in captured image D2. Specifically, sometimes a deviation V0 occurs between the position coordinates of region R0 and the corresponding region S0. Deviation V0 represents the deformation of medium 99. When no deformation occurs on medium 99, the position coordinates of region R0 and the corresponding region S0 are consistent.

[0056] The printing apparatus 11 calculates the deviation V0 by matching a template image T0 with an captured image D2. Specifically, the printing apparatus 11 calculates the deviation V0 for each corresponding region S0 by performing template matching on the captured image D2 for each template image T0. The printing apparatus 11 can also calculate a first deviation V1 by matching a first template image T1 with the captured image D2. The first deviation V1 is the offset of the first corresponding region S1 relative to the first region of interest R1. The printing apparatus 11 can also calculate a second deviation V2 by matching a second template image T2 with the captured image D2. The second deviation V2 is the offset of the second corresponding region S2 relative to the second region of interest R2. The printing apparatus 11 can also calculate a third deviation V3 by matching a third template image T3 with the captured image D2. The third deviation V3 is the offset of the third corresponding region S3 relative to the third region of interest R3.

[0057] The printing apparatus 11 corrects the template image T0 based on one or more deviations V0. Specifically, the printing apparatus 11 corrects one of the multiple template images T0 based on the deviation V0 of the corresponding region S0 corresponding to the region of interest R0 contained in other template images T0. For example, the printing apparatus 11 corrects the template image T0 based on the deviation V0 in the region of interest R0 surrounding the region of interest contained in that template image T0.

[0058] Consider the case where the printing apparatus 11 extracts N corresponding regions S0 through template matching. N is a natural number greater than or equal to 2. In this case, the printing apparatus 11 performs correction on the template image T0 corresponding to the Mth corresponding region S0 among the N corresponding regions S0, based on the deviation V0 of one or more corresponding regions S0 other than the Mth corresponding region S0. M is a natural number greater than or equal to 1 and less than or equal to N. That is, the printing apparatus 11 corrects the template image T0 based on the deviation V0 of the other corresponding regions S0 besides the corresponding region S0 corresponding to the template image T0 that is the object of correction.

[0059] The printing apparatus 11 can also correct the template image T0 based on the deviation V0 of other corresponding regions S0 located downstream in the transport direction Y1 compared to the corresponding region S0 corresponding to the template image T0 to be corrected. The printing apparatus 11 can also correct the template image T0 based on the deviation V0 of other corresponding regions S0 located at different positions in the width direction X1 relative to the corresponding region S0 corresponding to the template image T0 to be corrected. The printing apparatus 11 can also correct the template image T0 based on the deviation V0 of other corresponding regions S0 located upstream in the transport direction Y1 compared to the corresponding region S0 corresponding to the template image T0 to be corrected. The printing apparatus 11 only needs to correct the template image T0 based on the deviation V0 in the region of interest R0 that is close to the region of interest R0 contained in the template image T0 to be corrected. In this case, the template image T0 can be corrected with high precision.

[0060] The printing apparatus 11 can also correct the second template image T2 based on deviations other than the second deviation V2 among multiple deviations V0. The printing apparatus 11 can also correct the second template image T2 based on the first deviation V1. The printing apparatus 11 can also correct the second template image T2 based on the first deviation V1 and the third deviation V3. If the distance between the second region of interest R2 and the first region of interest R1 is small, the second template image T2 will be corrected with high precision. If the distance between the second region of interest R2 and the third region of interest R3 is small, the second template image T2 will be corrected with high precision. The printing apparatus 11 can also correct the first template image T1 based on the second deviation V2, the third deviation V3, etc. The printing apparatus 11 can also correct the third template image T3 based on the first deviation V1, the second deviation V2, etc.

[0061] like Figure 10 As shown, the printing apparatus 11 corrects the template image T0 based on one or more deviations V0. Figure 10 In the image shown by the dashed line, the template image T0 before correction is represented. Figure 10 In the image shown by solid lines, the corrected template image T0′ is represented. The printing apparatus 11 performs a projection transformation on the template image T0, for example, based on one or more deviations V0. That is, the printing apparatus 11 corrects the template image T0 by moving the vertices of the template image T0. In one example, the printing apparatus 11 corrects the second template image T2 based on a first deviation V1 and a third deviation V3.

[0062] The printing apparatus 11 can also use a prescribed algorithm to determine the correspondence between the vertices of the template image T0 and the deviation V0. Alternatively, the printing apparatus 11 can make each deviation V0 correspond one-to-one with one of the four corners of the template image T0. Or, the printing apparatus 11 can make multiple deviations V0 correspond to one of the four corners of the template image T0.

[0063] The printing apparatus 11 obtains a template image T0′ reflecting the deformation of the medium 99 by correcting the template image T0. Alternatively, the printing apparatus 11 updates the template image T0 to the template image T0′. The printing apparatus 11 can update all template images T0 to the template image T0′, or it can update a portion of the template images T0 to the template image T0′. In one example, the printing apparatus 11 obtains the second template image T2′ by correcting the second template image T2. The printing apparatus 11 can also obtain the first template image T1′ by correcting the first template image T1. The printing apparatus 11 can also obtain the third template image T3′ by correcting the third template image T3. The printing apparatus 11 can also correct all of the multiple template images T0. The printing apparatus 11 can also correct a portion of the multiple template images T0.

[0064] like Figure 11 as well as Figure 12 As shown, the printing apparatus 11 can also correct the template image T0 based on three or more deviations V0. For example, the printing apparatus 11 can also correct the template image T0 based on deviations V0A, V0B, V0C, and V0D among the multiple deviations V0. In one example, the printing apparatus 11 corrects the template image T0 by moving the four corners of the template image T0 respectively based on deviations V0A, V0B, V0C, and V0D.

[0065] like Figure 13As shown, the printing apparatus 11 extracts the corresponding region S0' by matching the template image T0' with the captured image D2. The corresponding region S0' is the region matched by the corrected template image T0' in the captured image D2. The corresponding region S0' is the region corresponding to the region of interest R0 contained in the template image T0'. Alternatively, the printing apparatus 11 updates the corresponding region S0 to the corresponding region S0'. The printing apparatus 11 can update all corresponding regions S0 to the corresponding region S0', or it can update a portion of the corresponding regions S0 to the corresponding region S0'. The offset of the corresponding region S0' relative to the region of interest R0 is the deviation V0'. Compared to the template image T0 before correction, the corrected template image T0' improves the matching accuracy relative to the region of interest R0. Therefore, the deviation V0' accurately represents the deformation of the medium 99 compared to the deviation V0. The printing apparatus 11 can accurately determine the position of the pattern P1 based on the deviation V0'. Therefore, the printing apparatus 11 can accurately control the deformation of the medium 99 based on the deviation V0′.

[0066] The printing apparatus 11 can also extract the first corresponding region S1' by matching the corrected first template image T1' with the captured image D2. The printing apparatus 11 can also calculate the offset of the first corresponding region S1' relative to the first region of interest R1, i.e., the first deviation V1'. The printing apparatus 11 can also extract the second corresponding region S2' by matching the corrected second template image T2' with the captured image D2. The printing apparatus 11 can also calculate the offset of the second corresponding region S2' relative to the second region of interest R2, i.e., the second deviation V2'. The printing apparatus 11 can also extract the third corresponding region S3' by matching the corrected third template image T3' with the captured image D2. The printing apparatus 11 can also calculate the offset of the third corresponding region S3' relative to the third region of interest R3, i.e., the third deviation V3'.

[0067] The positional relationships of the first corresponding region S1′, the second corresponding region S2′, and the third corresponding region S3′ are not significantly different from those of the first corresponding region S1, the second corresponding region S2, and the third corresponding region S3. Therefore, the positional relationships of the first corresponding region S1′ and the second corresponding region S2′ are not significantly different from those of the first corresponding region S1 and the second corresponding region S2. The positional relationships of the first corresponding region S1′ and the third corresponding region S3′ are not significantly different from those of the first corresponding region S1 and the third corresponding region S3. The positional relationships of the second corresponding region S2′ and the third corresponding region S3′ are not significantly different from those of the second corresponding region S2 and the third corresponding region S3. Furthermore, the positional relationships of the first corresponding region S1 and the second corresponding region S2′, and the second corresponding region S2 and the first corresponding region S1′, are not significantly different from those of the first corresponding region S1 and the second corresponding region S2. The positional relationships of the first corresponding region S1 and the third corresponding region S3′, and the third corresponding region S3 and the first corresponding region S1′, are not significantly different from those of the first corresponding region S1 and the third corresponding region S3. The positional relationships between the second corresponding region S2 and the third corresponding region S3′, and the positional relationships between the third corresponding region S3 and the second corresponding region S2′, are not significantly different from those between the second corresponding region S2 and the third corresponding region S3. For example, the second corresponding region S2′ could also be located upstream of the first corresponding region S1 in the conveying direction Y1. Alternatively, the second corresponding region S2′ could be located downstream of the first corresponding region S1 in the conveying direction Y1. The second corresponding region S2′ could also be located at a different position from the first corresponding region S1 in the width direction X1. The second corresponding region S2′ could also be located upstream of the third corresponding region S3 in the conveying direction Y1. Alternatively, the second corresponding region S2′ could be located downstream of the third corresponding region S3 in the conveying direction Y1. Alternatively, the second corresponding region S2′ could also be located at a different position from the third corresponding region S3 in the width direction X1.

[0068] The printing apparatus 11 corrects the printed image D3 based on a calculated deviation V0′. In one example, the printing apparatus 11 corrects the printed image D3 based on a second deviation V2′. The printing apparatus 11 may also correct the printed image D3 based on a first deviation V1′. The printing apparatus 11 may also correct the printed image D3 based on a third deviation V3′. The printing apparatus 11 corrects the printed image D3, for example, through an affine transformation.

[0069] The printing apparatus 11 can also correct the printed image D3 based on multiple deviations V0′. The more deviations V0′ used in the correction of the printed image D3, the more accurately the printed image D3 is corrected. In addition to deviations V0′, the printing apparatus 11 can also correct the printed image D3 based on deviation V0. For example, the printing apparatus 11 can also consider the portion of the medium 99 that is inferred to have relatively small deformation, and determine that the deformation of the medium 99 is accurately represented by the deviation V0 based on the template image T0 before correction. The printing apparatus 11 can also use such deviation V0 in the correction of the printed image D3. The printing apparatus 11 prints the corrected printed image D3 on the medium 99. Thus, the printed image D3 is printed on the medium 99 in accordance with the pattern P1.

[0070] Next, an example of printing processing will be described. Printing processing is a process performed by a computer. Printing processing can be performed by the computer included in the printing apparatus 11, or by an external computer connected to the printing apparatus 11. In one example, printing processing is performed by the control unit 16. Printing processing is performed, for example, by the control unit 16 according to a program stored in the storage unit 15. Printing processing begins when the control unit 16 receives a printing instruction from the user.

[0071] like Figure 14 As shown, in step S11, the control unit 16 acquires the captured image D2 and the template image T0. The control unit 16 acquires the captured image D2 and the template image T0 from the storage unit 15. The control unit 16 may also acquire multiple template images T0. In one example, the control unit 16 acquires a first template image T1 and a second template image T2. The control unit 16 may also acquire a third template image T3.

[0072] In step S12, the control unit 16 performs template matching on the captured image D2. Specifically, the control unit 16 matches the template image T0 with the captured image D2. The control unit 16 may also match multiple template images T0 with the captured image D2 sequentially. In one example, the control unit 16 matches the first template image T1 with the captured image D2. The control unit 16 may also match the second template image T2 with the captured image D2. The control unit 16 may also match the third template image T3 with the captured image D2.

[0073] In step S13, the control unit 16 extracts the corresponding region S0 from the captured image D2. Specifically, the control unit 16 extracts the corresponding region S0 from the captured image D2 that corresponds to the region of interest R0 contained in the template image T0. At this time, the control unit 16 extracts the same number of corresponding regions S0 as the template image T0 used for template matching. In one example, the control unit 16 extracts the first corresponding region S1. The control unit 16 may also extract the second corresponding region S2. The control unit 16 may also extract the third corresponding region S3.

[0074] In step S14, the control unit 16 calculates the deviation V0 between the region of interest R0 and the corresponding region S0. Specifically, the control unit 16 calculates the deviation V0 between the position coordinates of the region of interest R0 and the position coordinates of the corresponding region S0. At this time, the control unit 16 calculates the same number of deviations V0 as the extracted corresponding region S0. In one example, the control unit 16 calculates a first deviation V1. The control unit 16 may also calculate a second deviation V2. The control unit 16 may also calculate a third deviation V3.

[0075] In step S15, the control unit 16 corrects the template image T0 based on the deviation V0. The control unit 16 obtains a template image T0′ by correcting the template image T0 based on one or more deviations V0. Alternatively, the control unit 16 can correct multiple template images T0′ by correcting multiple template images T0. In one example, the control unit 16 corrects the second template image T2 based on a first deviation V1. The control unit 16 can also correct the second template image T2 based on both the first deviation V1 and a third deviation V3. The control unit 16 obtains the second template image T2′ by correcting the second template image T2. The control unit 16 can also obtain the first template image T1′ by correcting the first template image T1. The control unit 16 can also obtain the third template image T3′ by correcting the third template image T3.

[0076] The control unit 16 can also accept the specification of the deviation V0 used in the correction of the template image T0 when correcting the template image T0. For example, in step S15, the control unit 16 can also accept whether to use the third deviation V3 when correcting the second template image T2. If the use of the third deviation V3 is accepted, the control unit 16 can also correct the second template image T2 based on the first deviation V1 and the third deviation V3. If the use of the third deviation V3 is not accepted, the control unit 16 can also correct the second template image T2 based on the first deviation V1. By not using the third deviation V3, the computational load of the control unit 16 can be reduced compared to the case where the third deviation V3 is used.

[0077] In step S16, the control unit 16 performs template matching on the captured image D2. Specifically, the control unit 16 matches the corrected template image T0′ with the captured image D2. The control unit 16 may also match multiple template images T0′ with the captured image D2 sequentially. In one example, the control unit 16 matches the second template image T2′ with the captured image D2. The control unit 16 may also match the first template image T1′ with the captured image D2. The control unit 16 may also match the third template image T3′ with the captured image D2.

[0078] In step S17, control unit 16 extracts the corresponding region S0′ from the captured image D2. Specifically, control unit 16 extracts the corresponding region S0′ from the captured image D2 that corresponds to the region of interest R0 contained in the template image T0′. At this time, control unit 16 extracts the same number of corresponding regions S0′ as the template image T0′ used for template matching. In one example, control unit 16 extracts the second corresponding region S2′. Control unit 16 may also extract the first corresponding region S1′. Control unit 16 may also extract the third corresponding region S3′.

[0079] In step S18, the control unit 16 calculates the deviation V0′ between the region of interest R0 and the corresponding region S0′. Specifically, the control unit 16 calculates the deviation V0′ between the position coordinates of the region of interest R0 and the position coordinates of the corresponding region S0′. At this time, the control unit 16 calculates the same number of deviations V0′ as the extracted corresponding region S0′. In one example, the control unit 16 calculates the second deviation V2′. The control unit 16 may also calculate the first deviation V1′. The control unit 16 may also calculate the third deviation V3′.

[0080] In step S19, the control unit 16 corrects the printed image D3 based on the deviation V0′. In one example, the control unit 16 corrects the printed image D3 based on the second deviation V2′. The control unit 16 may also correct the printed image D3 based on the first deviation V1′ and the second deviation V2′. The control unit 16 may also correct the printed image D3 based on the second deviation V2′ and the third deviation V3′. The control unit 16 may also correct the printed image D3 based on the first deviation V1′, the second deviation V2′, and the third deviation V3′. In addition to the deviation V0′, the control unit 16 may also correct the printed image D3 based on the deviation V0. In this case, compared with the case where the printed image D3 is corrected based on multiple deviations V0′, the computational load of the printing apparatus 11 is reduced.

[0081] In step S20, the control unit 16 causes the printing unit 12 to print the corrected printed image D3. Thus, the printed image D3, matching the pattern P1, is printed on the medium 99.

[0082] In step S21, the control unit 16 determines whether printing is complete. Specifically, the control unit 16 determines whether printing is complete for the entire area of ​​the medium 99. The control unit 16 determines whether printing is complete, for example, based on the printing task. If printing is complete, the control unit 16 ends the printing process. If printing is incomplete, the control unit 16 returns the process to step S11. By repeatedly performing steps S11 to S20, the control unit 16 sequentially prints the printed image D3 onto the medium 99, matching the pattern P1.

[0083] The role and effects of the embodiments

[0084] Next, the function and effects of the above embodiments will be explained.

[0085] (1) The printing method includes a computer correcting a second template image T2 based on a first deviation V1. The printing method also includes a computer extracting a second corresponding region S2' by matching the corrected second template image T2' with the captured image D2. The printing method further includes a computer calculating the second deviation V2'. The printing method also includes a computer correcting a printed image D3 based on the second deviation V2'. The printing method further includes a printing apparatus 11 printing the computer-corrected printed image D3. According to the above method, the matching accuracy of the second template image T2' relative to the captured image D2 is improved. Therefore, the printed image D3 can be corrected with high precision.

[0086] (2) In the captured image D2, the first corresponding region S1 is the region located downstream of the second corresponding region S2′ in the transport direction Y1. According to the above method, the extraction accuracy of the second corresponding region S2′ is improved by the first deviation V1.

[0087] (3) The printing method includes a computer correcting the second template image T2 based on a first deviation V1 and a third deviation V3. According to the above method, the extraction accuracy of the second corresponding region S2′ is improved by using the first deviation V1 and the third deviation V3.

[0088] (4) The printing method includes a computer determining whether to use the third deviation V3 in the correction of the second template image T2. The printing method includes the following: if the computer determines that the third deviation V3 is being used, it corrects the second template image T2 based on the first deviation V1 and the third deviation V3. If the computer determines that the third deviation V3 is not being used, it corrects the second template image T2 based on the first deviation V1. According to the above method, by not using the third deviation V3, the computational load on the computer is reduced.

[0089] (5) In the captured image D2, the second corresponding region S2′ is a region located at a different position from the first corresponding region S1 in the width direction X1. According to the above method, the extraction accuracy of the second corresponding region S2′ is improved by the first deviation V1.

[0090] Change Example

[0091] The above embodiments can be modified and implemented in the following ways. The above embodiments and the following modifications can be combined with each other within a technically consistent scope.

[0092] The printing apparatus 11 can also set a region of interest R0 in the captured image D2. The printing apparatus 11 can also extract a template image T0 from the captured image D2. The printing apparatus 11 can also match the template image T0 with the pattern image D1. The printing apparatus 11 can also extract the corresponding region S0 from the pattern image D1. In this case, the same effect as in the above embodiment can be obtained.

[0093] The printing apparatus 11 can also be controlled by a computer located in an external device different from the printing apparatus 11. The external device can also acquire the captured image D2. The external device can also match the template image T0 with the captured image D2. The external device can also extract the corresponding region S0 from the captured image D2. The external device can also calculate the deviation V0 between the region of interest R0 and the corresponding region S0. The external device can also correct the template image T0 based on the deviation V0. The external device can also acquire the corrected template image T0′. The external device can also match the template image T0′ with the captured image D2. The external device can also extract the corresponding region S0′ from the captured image D2. The external device can also calculate the deviation V0′ between the region of interest R0 and the corresponding region S0′. The external device can also correct the printed image D3 based on the deviation V0′. The external device can also provide the corrected printed image D3 to the printing apparatus 11.

[0094] The liquid ejected by the printing section 12 is not limited to ink; for example, it can be a liquid formed by dispersing or mixing functional material particles in a liquid. For example, the printing section 12 can also eject a liquid containing materials such as electrode materials or pixel materials used in the manufacture of liquid crystal displays, electroluminescent displays, and surface-emitting displays in a dispersed or dissolved form.

[0095] Technical ideas

[0096] The following will describe the technical ideas and their effects learned from the above-described implementation methods and modifications.

[0097] (A) A printing method implemented by a computer-controlled printing apparatus for printing on a medium, the printing method comprising the computer controlling the following actions: acquiring a photographic image obtained by photographing a patterned medium; acquiring a first template image containing a first region of interest set on a pattern image representing the pattern; acquiring a second template image containing a second region of interest set on the pattern image; extracting a first corresponding region corresponding to the first region of interest by matching the first template image with the photographed image; calculating a first deviation, i.e., a deviation between the position coordinates of the first region of interest in the pattern image and the position coordinates of the first corresponding region in the photographed image; correcting the second template image based on the first deviation; extracting a second corresponding region corresponding to the second region of interest by matching the corrected second template image with the photographed image; calculating a second deviation, i.e., a deviation between the position coordinates of the second region of interest in the pattern image and the position coordinates of the second corresponding region in the photographed image; correcting a printed image representing an image printed on a medium based on the second deviation; and having the printing apparatus print the corrected printed image. The method described above improves the matching accuracy of the second template image relative to the captured image. This allows for high-precision correction of the printed image.

[0098] (B) In the above printing method, the first corresponding region in the captured image can also be a region located downstream of the second corresponding region in the transport direction of the medium. According to the above method, the extraction accuracy of the second corresponding region is improved by the first deviation.

[0099] (C) The above printing method can also be implemented in the following manner: the computer includes the following controls: acquiring a third template image containing a third region of interest set on the pattern image; extracting a third corresponding region by matching the third template image with the captured image, the third corresponding region being a region corresponding to the third region of interest and located at a different position from the first corresponding region in a width direction different from the transport direction of the medium; calculating the deviation, i.e., the third deviation, between the position coordinates of the third region of interest in the pattern image and the position coordinates of the third corresponding region in the captured image; and correcting the second template image based on the first deviation and the third deviation. According to the above method, the extraction accuracy of the second corresponding region is improved by using the first deviation and the third deviation.

[0100] (D) The above printing method can also be implemented in such a way that the computer includes control over whether to use the third deviation in the correction of the second template image; if the use of the third deviation is accepted, the second template image is corrected based on the first deviation and the third deviation; and if the use of the third deviation is not accepted, the second template image is corrected based on the first deviation. According to the above method, by not using the third deviation, the computational load on the computer is reduced.

[0101] (E) In the above printing method, the second corresponding region in the captured image can also be a region located at a different position from the first corresponding region in the width direction of the medium. According to the above method, the extraction accuracy of the second corresponding region is improved by using the first deviation.

[0102] (F) A printing apparatus comprising: a printing unit that prints an image on a medium; and a control unit configured to perform the following control: acquiring a captured image obtained by photographing a medium having a pattern; acquiring a first template image including a first region of interest set on a pattern image representing the pattern; acquiring a second template image including a second region of interest set on the pattern image; extracting a first corresponding region corresponding to the first region of interest by matching the first template image with the captured image; calculating a first deviation, i.e., a deviation between the position coordinates of the first region of interest in the pattern image and the position coordinates of the first corresponding region in the captured image; correcting the second template image based on the first deviation; extracting a second corresponding region corresponding to the second region of interest by matching the corrected second template image with the captured image; calculating a second deviation, i.e., a deviation between the position coordinates of the second region of interest in the pattern image and the position coordinates of the second corresponding region in the captured image; correcting a printed image representing an image printed on a medium based on the second deviation; and having the printing unit print the corrected printed image. Based on the above structure, the same effect as the printing method described above can be obtained.

[0103] (G) A program product comprising a program that causes a computer controlling a printing apparatus for printing on a medium to perform the following controls: acquiring a photographic image obtained by photographing a patterned medium; acquiring a first template image containing a first region of interest set on a pattern image representing the pattern; acquiring a second template image containing a second region of interest set on the pattern image; extracting a first corresponding region corresponding to the first region of interest by matching the first template image with the photographed image; calculating a first deviation, i.e., a deviation between the position coordinates of the first region of interest in the pattern image and the position coordinates of the first corresponding region in the photographed image; correcting the second template image based on the first deviation; extracting a second corresponding region corresponding to the second region of interest by matching the corrected second template image with the photographed image; calculating a second deviation, i.e., a deviation between the position coordinates of the second region of interest in the pattern image and the position coordinates of the second corresponding region in the photographed image; correcting a printed image representing an image printed on a medium based on the second deviation; and causing the printing apparatus to print the corrected printed image. The product produced using the above-described procedure can achieve the same effect as the printing method described above.

[0104] Symbol Explanation

[0105] 11…Printing apparatus, 12…Printing section, 13…Transportation section, 14…Illumination section, 15…Storage section, 16…Control section, 99…Media, D1…Pattern image, D2…Illuminated image, D3…Printed image, D4…Mapped data, P1…Pattern, R0…Region of interest, R1…First region of interest, R2…Second region of interest, R3…Third region of interest, S0…Corresponding region, S0′…Corresponding region, S1…First corresponding region, S1′…First corresponding region, S2…Second corresponding region, S2′…Second corresponding region, S3…Third corresponding region, S3… ′…Third corresponding area, T0…Template image, T0′…Template image, T1…First template image, T1′…First template image, T2…Second template image, T2′…Second template image, T3…Third template image, T3′…Third template image, V0…deviation, V0′…deviation, V0A…deviation, V0B…deviation, V0C…deviation, V0D…deviation, V1…First deviation, V1′…First deviation, V2…Second deviation, V2′…Second deviation, V3…Third deviation, V3′…Third deviation, X1…Width direction, Y1…Conveying direction.

Claims

1. A printing method, characterized in that, It is a method implemented by a printing apparatus that is controlled by a computer to print on a medium. The printing method includes control performed by the computer as follows: To obtain a photographic image by photographing a patterned medium; Obtain a first template image containing a first region of interest set on a pattern image representing the pattern; Obtain a second template image containing a second region of interest set on the pattern image; By matching the first template image with the captured image, a first corresponding region corresponding to the first region of interest is extracted; The deviation between the position coordinates of the first region of interest in the pattern image and the position coordinates of the first corresponding region in the captured image, i.e., the first deviation, is calculated. The second template image is corrected based on the first deviation; By matching the corrected second template image with the captured image, a second corresponding region corresponding to the second region of interest is extracted; The deviation between the position coordinates of the second region of interest in the pattern image and the position coordinates of the second corresponding region in the captured image, i.e., the second deviation, is calculated. The printed image representing the image printed on the medium is corrected based on the second deviation; and The printing device prints the corrected image.

2. The printing method as described in claim 1, characterized in that, In the captured image, the first corresponding region is a region located downstream of the second corresponding region in the transport direction in which the medium is transported.

3. The printing method as described in claim 1 or claim 2, characterized in that, The printing method includes control performed by the computer as follows: Obtain a third template image containing a third region of interest set on the pattern image; By matching the third template image with the captured image, a third corresponding region is extracted. The third corresponding region is the region corresponding to the third region of interest and is located at a different position from the first corresponding region in a width direction that is different from the transport direction of the medium. The deviation between the position coordinates of the third region of interest in the pattern image and the position coordinates of the third corresponding region in the captured image, i.e., the third deviation, is calculated; and The second template image is corrected based on the first deviation and the third deviation.

4. The printing method as described in claim 3, characterized in that, The printing method includes control performed by the computer as follows: The decision is whether to apply the third deviation to the correction of the second template image. When the use of the third deviation is accepted, the second template image is corrected based on the first deviation and the third deviation; and If the use of the third deviation is not accepted, the second template image is corrected based on the first deviation.

5. The printing method as described in claim 1, characterized in that, In the captured image, the second corresponding region is a region located at a different position from the first corresponding region in the width direction of the medium.

6. A printing apparatus, characterized in that, have: The printing department, which prints images on a medium; Control Department The control unit is configured to perform the following control: To obtain a photographic image by photographing a patterned medium; Obtain a first template image containing a first region of interest set on a pattern image representing the pattern; Obtain a second template image containing a second region of interest set on the pattern image; By matching the first template image with the captured image, a first corresponding region corresponding to the first region of interest is extracted; The deviation between the position coordinates of the first region of interest in the pattern image and the position coordinates of the first corresponding region in the captured image, i.e., the first deviation, is calculated. The second template image is corrected based on the first deviation; By matching the corrected second template image with the captured image, a second corresponding region corresponding to the second region of interest is extracted; The deviation between the position coordinates of the second region of interest in the pattern image and the position coordinates of the second corresponding region in the captured image, i.e., the second deviation, is calculated. The printed image representing the image printed on the medium is corrected based on the second deviation; and The printing section prints the corrected image.

7. A program product, characterized in that, It includes a program that causes a computer controlling a printing apparatus for printing on a medium to perform the following controls: To obtain a photographic image by photographing a patterned medium; Obtain a first template image containing a first region of interest set on a pattern image representing the pattern; Obtain a second template image containing a second region of interest set on the pattern image; By matching the first template image with the captured image, a first corresponding region corresponding to the first region of interest is extracted; The deviation between the position coordinates of the first region of interest in the pattern image and the position coordinates of the first corresponding region in the captured image, i.e., the first deviation, is calculated. The second template image is corrected based on the first deviation; By matching the corrected second template image with the captured image, a second corresponding region corresponding to the second region of interest is extracted; The deviation between the position coordinates of the second region of interest in the pattern image and the position coordinates of the second corresponding region in the captured image, i.e., the second deviation, is calculated. The printed image representing the image printed on the medium is corrected based on the second deviation; and The printing device prints the corrected image.

Images