Printing apparatus and printing method

Abstract

A printing apparatus and a printing method are executed as pre-processing: determining first and second characteristic colors from first captured image data of a medium; binarizing first pattern image data having information on the shape of the pattern of the medium to generate binary image data based on the first color and the second color; generating second pattern image data by replacing the first color of the binary image data with the first feature color and replacing the second color with the second feature color; and setting a feature point on an edge of a pattern in the second pattern image data, and executing as a printed matter production process: comparing second captured image data of the medium with the second pattern image data; calculating a correction value of a feature point required to align the shape of the pattern in the second pattern image data with the shape of the pattern in the second captured image data; applying the correction value to the colored image of the pattern to deform the colored image; and performing printing of the deformed colored image on the medium which has been captured in order to generate the second captured image data.

Description

Technical Field

[0001] The invention relates to a printing device and a printing method. Background Art

[0002] There is known an inkjet printer that prints on a medium using a head having nozzles capable of ejecting liquid droplets, and is configured to include an imaging device as a surface information acquisition device for acquiring information on the surface of the medium (see Patent Document 1).

[0003] Patent Document 1: Japanese Patent Application Publication No. 2023-63795

[0004] Here, a cloth with a pattern formed thereon is used as a medium, and it is assumed that printing is performed on the conveyed cloth. In many cases, a pattern is periodically formed on the cloth. The user prepares a coloring image of the pattern to be colored on the cloth. The conveyed cloth may deform or expand and contract (hereinafter collectively referred to as "deformation"). Even if the coloring image is superimposed on the pattern of the cloth that has undergone such deformation and printed, there will be a deviation in the shape of the pattern and the coloring pixels. Therefore, the user needs to perform an editing operation by operating an image editing software to align and merge the shape of the coloring image with the shape of the pattern in the captured image obtained by capturing the conveyed cloth.

[0005] However, the above-mentioned editing operation is a great burden on the user. In view of such a situation, an improvement is required to reduce the burden on the user required in printing on a medium that may include deformation and to improve the quality of the printed matter. Summary of the invention

[0006] The printing device comprises: a conveying unit for conveying a medium with a pattern formed thereon in a conveying direction; a photographing unit for photographing the medium conveyed by the conveying unit; a printing unit for printing on the medium conveyed by the conveying unit; and a control unit, wherein a printed matter production process includes printing by the printing unit, and the control unit performs the following steps as a preparatory process for the printed matter production process: acquiring first pattern image data and first photographed image data, wherein the first pattern image data has information on the shape of the pattern, and the first photographed image data is generated based on photographing the medium by the photographing unit; determining a first characteristic color and a second characteristic color brighter than the first characteristic color based on the first photographed image data; binarizing the first pattern image data and generating binary image data based on a first color and a second color brighter than the first color; and replacing the first color of the binary image data with the first color of the binary image data. The control unit performs the following steps as the printed matter production process: obtaining second captured image data, wherein the second captured image data is generated based on the photographing of the medium by the photographing unit; calculating, based on the comparison between the second captured image data and the second pattern image data, a correction value of the feature point required to align the shape of the pattern in the second pattern image data with the shape of the pattern in the second captured image data; applying the correction value to a coloring image used to color the pattern to deform the coloring image; and causing the printing unit to print the deformed coloring image on the medium photographed by the photographing unit to generate the second captured image data.

[0007] The printing method comprises: a photographing step of photographing a medium formed with a pattern and conveyed in a conveying direction; a printed matter production step, including printing on the medium conveyed in the conveying direction; and a preparatory step for the printed matter production step, in which the following steps are performed: acquiring first pattern image data and first photographed image data, the first pattern image data having information on the shape of the pattern, the first photographed image data being generated based on photographing the medium in the first photographing step; determining a first characteristic color and a second characteristic color brighter than the first characteristic color based on the first photographed image data; binarizing the first pattern image data and generating binary image data based on the first color and the second color brighter than the first color; and Characteristic color, and the second color is replaced by the second characteristic color, thereby generating a second pattern image data; and setting feature points for the edge of the pattern in the second pattern image data, in the printed matter production process, performing the following steps: acquiring second captured image data, the second captured image data being generated based on the capturing of the medium in the second capturing process; calculating, based on the comparison between the second captured image data and the second pattern image data, the correction value of the feature point required to align the shape of the pattern in the second pattern image data with the shape of the pattern in the second captured image data; applying the correction value to a colored image used to color the pattern to deform the colored image; and printing the deformed colored image on the medium photographed in the second capturing process. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] Figure 1 This is a block diagram simply showing the structure of a printing device.

[0009] Figure 2A is a diagram showing the conveyed cloth and the surrounding structures from a perspective from above, Figure 2B Shown from the upstream perspective Figure 2A A diagram of a portion of the structure shown.

[0010] Figure 3 is a flowchart showing the printing process.

[0011] Figure 4A is a diagram showing an example of first pattern image data, Figure 4B is a diagram showing an example of first captured image data.

[0012] Figure 5 2 is a diagram illustrating an example of a histogram of the first captured image data.

[0013] Fig. 6Ais a diagram showing an example of binary image data, Figure 6B is a diagram showing an example of second pattern image data, Figure 6C This is a diagram illustrating a state in which feature points are set in the second pattern image data.

[0014] Figure 7 It is a diagram for explaining step S170.

[0015] Figure 8 It is a diagram for explaining a specific example of steps S170 and S180.

[0016] Fig. 9 It is a diagram for explaining the second embodiment.

[0017] Description of Reference Numerals

[0018] 10…printing device, 11…control unit, 12…program, 15…shooting unit, 16…transport unit, 17…printing unit, 18…storage unit, 19…communication IF, 20…slide, 22…printing head, 30…cloth, 40…first pattern image data, 44…binary image data, 45…second pattern image data, 50…first shot image data, 54…second shot image data, 60…colored image data. DETAILED DESCRIPTION

[0019] Hereinafter, the embodiments of the present invention will be described with reference to the drawings. It should be noted that the drawings are merely examples for describing the present embodiments. Since the drawings are examples, there are cases where the proportions, shapes, shades are inaccurate, they are not integrated with each other, and some parts are omitted.

[0020] 1. Device structure:

[0021] Figure 1 The structure of the printing device 10 involved in this embodiment is briefly shown. The printing device 10 executes the printing method. The printing device 10 includes a control unit 11, a display unit 13, an operation receiving unit 14, a shooting unit 15, a conveying unit 16, a printing unit 17, a storage unit 18, a communication IF 19, etc. IF is an abbreviation of an interface. The control unit 11 is configured to include a CPU 11a as a processor, ROM 11b, RAM 11c, etc., one or more ICs, other non-volatile memories, etc.

[0022] In the control unit 11, a processor, namely a CPU 11a, uses a RAM 11c or the like as a work area and executes arithmetic processing in accordance with one or more programs 12 stored in a ROM 11b or other memory, thereby controlling the printing device 10. It should be noted that the processor is not limited to a single CPU, and may be a configuration in which processing is performed by a plurality of CPUs, a hardware circuit such as an ASIC, or a configuration in which processing is performed in cooperation between a CPU and a hardware circuit.

[0023] The display unit 13 is a unit for displaying visual information, and is composed of, for example, a liquid crystal display, an organic EL display, etc. The display unit 13 may also be a structure including a display and a drive circuit for driving the display. The operation receiving unit 14 is a unit for receiving user operations, and is implemented, for example, by physical buttons, a touch panel, a mouse, a keyboard, etc. Of course, the touch panel may also be implemented as a function of the display unit 13. The display unit 13 and the operation receiving unit 14 may also be part of the structure of the printing device 10, or may be peripheral devices installed outside the printing device 10.

[0024] For example, the storage unit 18 is a storage unit based on a hard disk drive, a solid state drive, or other memory. A part of the memory included in the control unit 11 may also be understood as the storage unit 18. The storage unit 18 may also be understood as a part of the control unit 11.

[0025] The communication IF 19 is a general term for one or more IFs used by the printing device 10 to communicate with an external device (not shown) in a wired or wireless manner according to a predetermined communication protocol, and the predetermined communication protocol includes a well-known communication standard. For example, the external device is a personal computer (PC), a server, a smart phone, a tablet terminal, a scanner, etc.

[0026] The conveying unit 16 is a mechanism for conveying the medium in a predetermined conveying direction under the control of the control unit 11. In the present embodiment, the medium is mainly assumed to be a cloth with a three-dimensional pattern formed by studying the weaving method of threads and fibers, such as jacquard woven cloth and lace cloth. One or a set of certain patterns are formed on the cloth in a repeated arrangement. In the following, one or a set of patterns are treated as one pattern. However, if the medium is a material that may be deformed during transportation, it can also be a material other than cloth, for example, it can also be a paper with a pattern formed on it.

[0027] For example, the conveying unit 16 includes a delivery roller that delivers the rolled-up cloth before printing to the downstream of the conveying; a belt and a roller that further deliver the delivered cloth; a winding roller that rewinds the cloth after printing into a roll and recovers it; a motor for rotating each roller and belt, etc. Hereinafter, the upstream and downstream based on the conveying direction of the conveying unit 16 are also simply referred to as upstream and downstream.

[0028] The imaging unit 15 images the medium transported by the transport unit 16 under the control of the control unit 11. The imaging unit 15 includes: a light source for irradiating the medium; an image sensor for receiving reflected light from the medium and outputting an electrical signal as a result of the imaging; and a circuit for performing analog-to-digital conversion on the output electrical signal to generate image data. A part of the circuit included in the control unit 11 may also be understood as a part of the imaging unit 15.

[0029] The printing unit 17 performs printing on the medium transported by the transport unit 16 under the control of the control unit 11. The printing unit 17 is provided at a position downstream of the imaging unit 15. The printing unit 17 performs printing on the medium based on the printing data sent from the control unit 11. For example, the printing unit 17 can perform printing by ejecting a plurality of colors of ink such as cyan, magenta, yellow, and black by an inkjet method. According to the inkjet method, the printing unit 17 performs printing on the medium by ejecting or not ejecting dots of ink from nozzles not shown based on the printing data that specifies dot on or dot off of each ink for each pixel.

[0030] The printing device 10 may be a single printer or may be implemented by a plurality of devices connected in a manner that allows them to communicate with each other. The printing device 10 composed of a plurality of devices may also be referred to as a printing system 10. For example, the printing system 10 is configured to include a photographing unit 15, a printer including a conveying unit 16 and a printing unit 17, and one or more information processing devices that function as a control unit 11. For example, the information processing device is a PC, a server, a smart phone, a tablet terminal, or a device having the same degree of processing power as these. In the printing system 10, the device that serves as the control unit 11 may also be referred to as an image processing device, a printing control device, or the like. A device that constitutes a part of the printing system 10 may also be understood as an invention.

[0031] Figure 2A The cloth 30 as the medium to be transported and the structure near it are shown from a perspective from above to below. Figure 2A , the pattern formed in advance on the cloth 30 is omitted. Reference numeral D1 indicates the conveying direction of the cloth 30 by the conveying unit 16. Reference numeral 23 is an endless belt 23 as a part of the conveying unit 16. The cloth 30 carried on the endless belt 23 is conveyed from upstream to downstream by the rotation of the endless belt 23.

[0032] A carriage 20 is disposed above the endless belt 23. The carriage 20 can reciprocate along a direction D2 that intersects the conveying direction D1. The intersection mentioned here means orthogonal, but it can be understood that orthogonal includes not only strict orthogonality but also errors caused in the manufacture of products. The carriage 20 moves in the direction D2 along the long guide member 21. The direction D2 is also referred to as the main scanning direction of the carriage 20 and the print head 22. In addition, the direction D2 is also referred to as the width direction of the cloth 30.

[0033] The carriage 20 is equipped with a print head 22 capable of ejecting ink. That is, the print head 22 reciprocates along the width direction D2 together with the carriage 20. Such a carriage 20 and the print head 22 constitute the printing unit 17. Although not shown, the print head 22 has a plurality of nozzles opened on the lower surface facing the endless belt 23. The print head 22 ejects ink from the nozzles based on the printing data while moving along the width direction D2 together with the carriage 20.

[0034] like Figure 2A As shown, the imaging unit 15 is disposed above the endless belt 23 at a predetermined position upstream of the carriage 20 and the print head 22 .

[0035] Figure 2B Shown from upstream to downstream Figure 2A The imaging unit 15 uses the lower surface opposite to the endless belt 23 as the imaging surface 15a, and images the cloth 30 on the endless belt 23 via the imaging surface 15a. For example, the imaging unit 15 is a line scanning camera having a plurality of imaging elements arranged along the width direction D2. The imaging unit 15 repeatedly performs imaging of line units via a lens and an imaging element (not shown) provided on the imaging surface 15a. Figure 2B In FIG. 1 , the imaging range in the width direction D2 by the imaging unit 15 is illustrated by a dotted line. The imaging unit 15 can image substantially the entire range of the endless belt 23 in the width direction D2 by the function of the lens.

[0036] The structure of the imaging unit 15 is not limited to Figure 2A , Figure 2BFor example, the following structure may be adopted: a plurality of imaging units 15 are arranged above the endless belt 23 along the width direction D2, and each of the plurality of imaging units 15 shares and images a part of the full range of the endless belt 23 in the width direction D2. Alternatively, the imaging unit 15 may be a line sensor composed of a plurality of imaging elements arranged in a substantially full range of the endless belt 23 in the width direction D2. Alternatively, the imaging unit 15 may be a structure that is mounted on a carriage that can move along the width direction D2, similarly to the printing head 22 being mounted on the carriage 20, and that images the endless belt 23 while the carriage moves in the width direction D2. In addition, the printing head 22 may not be a structure that moves along the width direction D2 by the carriage 20, but may be a so-called line head that has a size that can eject ink to substantially the full range of the endless belt 23 in the width direction D2 in a stationary state.

[0037] 2. Printing method:

[0038] Figure 3 The flowchart shows the printing process executed by the control unit 11 according to the program 12. The flowchart schematically includes a printed matter production process S2 and a preparatory process S1 for the printed matter production process S2. The preparatory process S1 is also called a preparatory step, and the printed matter production process S2 is also called a printed matter production step. Figure 3 In the flowchart, the preparation process S1 and the printed matter production process S2 are recorded continuously, but time may be left between the preparation process S1 and the printed matter production process S2, and the printed matter production process S2 may be repeatedly executed multiple times after the preparation process S1.

[0039] In step S100, the control unit 11 obtains pattern image data having information on the shape of the pattern in the cloth 30. The pattern image data obtained in step S100 is also referred to as "first pattern image data". The first pattern image data may have information on the shape of the pattern in any manner, whether directly or indirectly. For example, the first pattern image data is image data that expresses the shape of the pattern by color. "Expressing the shape of the pattern by color" means expressing the difference between the patterned area and the non-patterned area, and the difference in the pattern according to the presence or absence of color and the difference in color. Therefore, the color in the first pattern image data has nothing to do with the printed color. The color system used by the first pattern image data to express the color is a variety of color systems such as the RGB color system and the L*a*b* color system. The first pattern image data may also be image data in raster form or in vector form. In addition, the first pattern image data may also be CAD data.

[0040] In the present embodiment, the first pattern image data and the "colored image data" described later are set as pre-generated data. There is no limitation on the method for generating the first pattern image data and the colored image data, but they are generally generated by a designer. For example, the first pattern image data is pre-stored in the storage unit 18, and the control unit 11 obtains the first pattern image data from the storage unit 18. Alternatively, the first pattern image data is input from an external device via the communication IF19, and the control unit 11 obtains the input first pattern image data. The control unit 11 can also obtain the first pattern image data from a storage medium such as a memory card not shown in the figure that is externally mounted on the printing device 10. Step S100 can be executed earlier than step S130 described later.

[0041] Figure 4A An example of the first pattern image data 40 is shown. The file format of the first pattern image data 40 is not limited. For example, the first pattern image data 40 is an image file created by CAD software. Figure 4A , the first pattern image data 40 is represented by a first area 41 of white, a second area 42 of a predetermined color darker than white, and a third area 43 of another predetermined color darker than the second area 42. That is, in the first pattern image data 40, the second area 42 and the third area 43 represent a pattern, and the first area 41 becomes a non-patterned area, i.e., a background. There are many actual pattern designs, and of course there are more complex patterns, but here the pattern is set to a simple triangle for easy understanding. Figure 4A The orthogonal X-axis and Y-axis in the diagram are two axes for defining the coordinates of the image data. The Y-axis direction corresponds to the conveying direction D1 , and the X-axis direction corresponds to the width direction D2 .

[0042] In step S110, the control unit 11 performs a photographing of the cloth 30. That is, the conveying unit 16 starts conveying the medium 30, and the photographing unit 15 performs photographing. As a result of such photographing, photographed image data is generated, and the control unit 11 obtains the photographed image data. The photographed image data is bitmap data having a grayscale value for each pixel. For example, the grayscale value is represented by 256 grayscales of 0 to 255. The photographed image data obtained in step S110 is also referred to as "first photographed image data". In step S110, it is sufficient to be able to photograph the pattern of the cloth 30, so the conveying unit 16 only transports the cloth 30 to the extent that it passes through the position of the photographing unit 15 downstream by a predetermined distance.

[0043] Figure 4B FIG. 5 shows an example of the first captured image data 50. The first captured image data 50 is a result of capturing the cloth 30, so to be precise, Figure 4B Only a partial range including one pattern in the first captured image data 50 is shown. Figure 4B, the first captured image data 50 is represented by a fourth region 51, a fifth region 52, and a sixth region 53 with different colors. According to the comparison with Figure 4A , it can be seen that in the first captured image data 50, the fifth region 52 and the sixth region 53 represent a pattern, and the fourth region 51 becomes the background of the pattern. The color of the fourth region 51 can also be understood as the color of the fabric 30 itself.

[0044] According to the comparison with Figure 4A , it can be seen that the triangular pattern formed by the fifth region 52 and the sixth region 53 of the first captured image data 50 is deformed compared to the triangular pattern formed by the second region 42 and the third region 43 of the first pattern image data 40. This deformation is because the fabric 30 being conveyed is deformed during the shooting in step S110. The first pattern image data 40 and the colored image data respectively represent ideal patterns without deformation.

[0045] In step S120, the control unit 11 determines a first characteristic color and a second characteristic color that is brighter than the first characteristic color based on the first captured image data. The characteristic color refers to the color that is relatively more distributed in the image data. Specifically, the control unit 11 generates a histogram of the colors in the first captured image data, and determines each color corresponding to each peak of the distribution represented in the histogram as the first characteristic color and the second characteristic color.

[0046] Figure 5 An example of the histogram of the first captured image data 50 is shown. Here, the first captured image data 50 that is the generation source of the histogram is set as grayscale image data having a luminance value for each pixel. That is to say, the luminance value is regarded as the color. For example, if the first captured image data 50 generated by the imaging unit 15 is color image data having grayscale values of red (R), green (G), and blue (B) for each pixel, the control unit 11 can generate a histogram on the basis of converting the RGB values of each pixel of the first captured image data 50 into luminance values and performing grayscaling.

[0047] According to Figure 5 , the histogram sets the horizontal axis as the grayscale value of the luminance value and the vertical axis as the frequency distribution of the number of pixels. According to the histogram, peaks of the number of pixels are generated at luminance values L1 and L2 respectively. In addition, L1 < L2. Thus, in the example of Figure 5 , the control unit 11 can determine the luminance value L1 as the first characteristic color and the luminance value L2 as the second characteristic color. According to Figure 4B and Figure 5, the brightness value L1 is a brightness value corresponding to the peak value of the peak where the brightness values ​​of the colors corresponding to the fifth area 52 and the sixth area 53 are concentrated and distributed, and the fifth area 52 and the sixth area 53 match the pattern. On the other hand, the brightness value L2 is a brightness value corresponding to the peak value of the peak where the brightness values ​​of the colors corresponding to the fourth area 51 brighter than the fifth area 52 and the sixth area 53 are concentrated and distributed. When three or more peaks are generated in the histogram generated based on the first captured image data 50, the control unit 11 can select two higher peaks from them to determine the first characteristic color and the second characteristic color.

[0048] In step S130, the control unit 11 binarizes the first pattern image data to generate "binary image data". The control unit 11 first grayscales the first pattern image data. The control unit 11 converts the file format of the first pattern image data into a bitmap and then grayscales it as needed. On this basis, the control unit 11 binarizes each pixel of the first pattern image data into a black pixel with a brightness value = 0 or a white pixel with a brightness value = 255 by comparing its brightness value with a predetermined threshold, thereby setting it as binary image data. The black pixels in the binary image data match the first color, and the white pixels match the second color.

[0049] like Figure 4A As shown, the first pattern image data 40 is composed of a background based on a first area 41, a second area 42 of a darker color than the background, and a pattern based on a third area 43. Therefore, the threshold is set to a grayscale value such as a brightness value = 200 that can separate the background from the pattern, and the control unit 11 converts pixels whose brightness values ​​are below the threshold value among the pixels of the first pattern image data into black pixels, and converts pixels whose brightness values ​​are higher than the threshold value into white pixels.

[0050] Fig. 6A The binary image data 44 obtained by binarizing the first pattern image data 40 in step S130 is shown as an example. Figure 4A By comparing the binary image data 44 with the first pattern image data 40 , it can be seen that in the binary image data 44 , the entire pattern becomes black pixels, and the area outside the pattern becomes white pixels.

[0051] In step S140, the control unit 11 applies the first characteristic color and the second characteristic color determined in step S120 to the binary image data generated in step S130. The application mentioned here refers to the process of replacing the first color, that is, black pixels of the binary image data with the first characteristic color, and replacing the second color, that is, white pixels of the binary image data with the second characteristic color. The binary image data after the first characteristic color and the second characteristic color are applied is called "second pattern image data".

[0052] Figure 6BThe second pattern image data 45 generated in step S140 is exemplified. In the second pattern image data 45, Fig. 6A The area of ​​the pattern that was once a black pixel in the binary image data 44 becomes the first characteristic color, and the background area that was once a white pixel in the binary image data 44 becomes the second characteristic color. Figure 4B As can be seen from the comparison, the second pattern image data 45 has a color combination that is very similar to the color combination of the first captured image data 50 .

[0053] In step S150, the control unit 11 sets feature points for the edge of the pattern in the second pattern image data. The edge of the pattern is the pixel at the position where the second feature color switches to the first feature color, so it can be easily determined. The feature point can also be called a control point.

[0054] Figure 6C FIG. 4 shows a state where characteristic points P1, P2, and P3 are set for the edge of the pattern in the second pattern image data 45. Figure 6C , an example is shown in which feature points P1, P2, and P3 are set at the intersections between the edges of the pattern, i.e., the vertices of the triangle of the pattern. Of course, there is no limit to the number of feature points that can be set. The control unit 11 pre-stores the second pattern image data with the feature points set in the storage unit 18 so that it can be used at any timing later.

[0055] The above steps S100 to S150 constitute the preliminary process S1.

[0056] Next, the printed matter production process S2 of steps S160 to S190 will be described.

[0057] In step S160, the control unit 11 photographs the cloth 30. The description of step S160 basically follows the description of step S110. The cloth 30 photographed in step S110 and the cloth 30 photographed in step S160 are of course of the same pattern. The photographed image data acquired in step S160 is referred to as "second photographed image data". As one scheme, it is considered that the conveyance of the cloth 30 that has stopped after the photographing in step S110 is restarted and photographed in step S160. In addition, as another scheme, it is considered that the cloth 30 with the same pattern as the cloth 30 photographed in step S110 is newly placed on the conveying unit 16, and the conveyance and photographing are started in step S160.

[0058] The first captured image data and the second captured image data obtained as a result of capturing the cloth 30 of the same pattern are of course substantially the same image data, but due to the different timings of capturing, there may be a subtle difference in color tone between them, or the presence or absence and degree of deformation of the cloth 30 during capturing may be different. The conveyance of the cloth 30 started in step S160 is also the conveyance for printing in step S190, so the control unit 11 terminates the conveyance after the printing in step 190 is completed.

[0059] In step S170 , the control unit 11 calculates correction values ​​of feature points required to align the shape of the pattern in the second pattern image data with the shape of the pattern in the second captured image data based on comparison between the second captured image data and the second pattern image data.

[0060] Figure 7 In order to explain step S170, the second pattern image data 45 and the second captured image data 54 are exemplified. The observation method of the second captured image data 54 is the same as the observation method of the first captured image data 50. The control unit 11 sets rectangular areas W1, W2, and W3, and the rectangular areas W1, W2, and W3 respectively include the feature points P1, P2, and P3 in the second pattern image data 45 at the approximate center. Such rectangular areas W1, W2, and W3 are also called ROI (Region of Interest), focus area, object area, etc.

[0061] The control unit 11 uses an image comparison technique such as template matching to extract regions similar to the images of the rectangular regions W1, W2, and W3 from the second captured image data 54. As a result, a region similar to the rectangular region W1 is extracted as a rectangular region W4, a region similar to the rectangular region W2 is extracted as a rectangular region W5, and a region similar to the rectangular region W3 is extracted as a rectangular region W6 from the second captured image data 54. As described above, the color of the second pattern image data 45 is close to that of the first captured image data 50, and similarly, the color of the second captured image data 54 is also close. Therefore, step S170 becomes a comparison operation between images with similar colors, and its accuracy is improved.

[0062] That is, even if the deformation of the cloth 30 affects the shape of the pattern in the second captured image data 54, the area corresponding to the rectangular areas W1, W2, and W3 including the feature points P1, P2, and P3 in the second pattern image data 45 can be extracted with high accuracy from the second captured image data 54. For example, the control unit 11 calculates the correction values ​​with respect to the coordinates of the feature points P1, P2, and P3 required to make the relative positional relationship of the rectangular areas W1, W2, and W3 in the XY coordinate system consistent with the relative positional relationship of the rectangular areas W4, W5, and W6. The so-called correction value refers to the movement amount and movement direction in the XY coordinate system.

[0063] In step S180, the control unit 11 obtains coloring image data representing a coloring image for coloring the pattern. That is, the color of the coloring image is the color that should be printed by overlapping the pattern on the cloth 30. The shape of the coloring image represented by the coloring image data is congruent with the shape of the pattern represented by the first pattern image data and the second pattern image data. For example, the coloring image data is pre-stored in the storage unit 18, and the control unit 11 obtains the coloring image data from the storage unit 18. Alternatively, the coloring image data is input from an external device via the communication IF 19, and the control unit 11 obtains the input coloring image data. The control unit 11 can also obtain the coloring image data from a storage medium such as a memory card not shown in the figure that is external to the printing device 10.

[0064] Then, the control unit 11 applies the correction value calculated in step S170 to the colored image of the colored image data, and deforms the colored image. That is, the control unit 11 applies the correction value of the feature point to the control point in the colored image data, which corresponds to the feature point of the second pattern image data, and moves the control point. The control unit 11 deforms the colored image, which is a region surrounded by the plurality of control points, as each of the plurality of control points moves. The process of deforming a region as the control points move is well known.

[0065] In step S190, the control unit 11 causes the printing unit 17 to print the deformed colored image of step S180 on the cloth 30 conveyed by the conveying unit 16. The cloth 30 conveyed at this time is a medium photographed by the imaging unit 15 in order to generate the second captured image data. Needless to say, the printing of the deformed colored image refers to printing based on the printing data generated based on the colored image data including the deformed colored image. The processing of generating the printing data from the image data by the control unit 11 is a general image processing such as color conversion processing and halftone processing, and the details are omitted.

[0066] Figure 8 1 is a diagram for explaining a specific example of the printed matter production process S2, particularly steps S170 and S180. Figure 8The second pattern image data 45 and the second captured image data 54 are shown in FIG. Figure 8 The second captured image data 54 shown is the result of capturing the full width of the cloth 30 in the width direction D2 and a range (hereinafter referred to as a fixed range) including the length of one pattern in the conveying direction D1. In the second captured image data 54, a plurality of patterns are arranged along the width direction D2, i.e., the X-axis direction. Figure 8 In FIG. 1 , the second captured image data 54 is divided into pattern unit regions 54a, 54b, 54c, ... each including one pattern, and is shown to be easily understood. The dotted lines dividing the pattern unit regions 54a, 54b, 54c, ... do not actually exist. Figure 7 The second captured image data 54 shown matches one pattern unit area.

[0067] In step S170, the control unit 11 compares the second pattern image data 45 with each of the pattern unit areas 54a, 54b, 54c, ... of the second captured image data 54 one-to-one, and calculates the correction value in the above-mentioned manner for each of the pattern unit areas 54a, 54b, 54c, ... The deformation degree of the cloth 30 may be different for each of the pattern unit areas 54a, 54b, 54c, ..., so the calculated correction value may also be different for each of the pattern unit areas 54a, 54b, 54c, ...

[0068] exist Figure 8 In step S180, the control unit 11 arranges the colored image data 60 corresponding to one pattern in the X-axis direction so as to correspond to each pattern of the second captured image data 54 of a fixed range, and generates a set of the plurality of colored image data 60. Then, the correction value calculated for each of the pattern unit areas 54a, 54b, 54c, ... is applied to each of the colored image data 60 in the set of the plurality of colored image data 60, so as to deform the colored image.

[0069] For example, the control unit 11 will Figure 8 The correction value calculated by comparing the leftmost pattern unit area 54a with the second pattern image data 45 in the viewing angle is applied to the leftmost colored image data 60 in the set of multiple colored image data 60 to generate the colored image data 60 after the colored image is deformed, that is, the colored image data 61a. Figure 8The correction value calculated by comparing the second pattern unit area 54b located second from the left in the viewing angle with the second pattern image data 45 is applied to the second colored image data 60 located second from the left in the set of multiple colored image data 60, and the colored image data 60 after the colored image deformation, that is, the colored image data 61b, is generated. The same process is repeated below, and the correction value calculated by comparing the third pattern unit area 54c located third from the left with the second pattern image data 45 is applied to the third colored image data 60 from the left in the set of multiple colored image data 60, and the colored image data 60 after the colored image deformation, that is, the colored image data 61c, is generated.

[0070] In step S190, the control unit 11 causes the printing unit 17 to print a set of color image data of a fixed range in which the color image data 61a, 61b, 61c, ... are arranged on a fixed range of the cloth 30. Thus, the color image is printed in a shape that is not offset from the shape of the pattern in the conveyed cloth 30. The conveying speed of the medium by the conveying unit 16 and the distance from the imaging unit 15 to the printing head 22 in the conveying direction D1 are known to the control unit 11. Therefore, the control unit 11 executes steps S170 and S180 during the period from the fixed range of the cloth 30 photographed by the imaging unit 15 in step S160 to the position of the printing head 22, and the control unit 11 executes the printing of step S190 at a predetermined timing when the fixed range reaches the position of the printing head 22. In addition, the control unit 11 repeatedly loops through steps S160 to S190 for the fixed range in the cloth 30, so that it is possible to continue printing on a plurality of fixed ranges of the cloth 30 that are continuous in the conveying direction D1.

[0071] 3. Summary:

[0072] As described above, according to the present embodiment, the printing device 10 includes: a conveying unit 16 that conveys a medium having a pattern formed thereon in a conveying direction D1; an imaging unit 15 that images the medium conveyed by the conveying unit 16; a printing unit 17 that prints on the medium conveyed by the conveying unit 16; and a control unit 11. The printed matter production process S2 includes printing by the printing unit 17, and the control unit 11 performs the following steps as a preliminary process S1 for the printed matter production process S2: acquiring first pattern image data and first image data, the first pattern image data having information on the shape of the pattern, the first image data being generated based on the imaging of the medium by the imaging unit 15; determining a first characteristic color and a second characteristic color brighter than the first characteristic color based on the first image data; binarizing the first pattern image data and generating binary image data based on the first color and the second color brighter than the first color; generating second pattern image data by replacing the first color of the binary image data with the first characteristic color and the second color with the second characteristic color; and setting characteristic points for the edge of the pattern in the second pattern image data. Furthermore, the control unit 11 performs the following steps as a printed matter production process S2: acquiring second captured image data, the second captured image data being generated based on the capturing of the medium by the capturing unit 15; calculating correction values ​​of feature points required to align the shape of a pattern in the second pattern image data with the shape of a pattern in the second captured image data based on a comparison between the second captured image data and the second pattern image data; applying the correction values ​​to a coloring image used to color the pattern to deform the coloring image; and causing the printing unit 17 to print the deformed coloring image on the medium photographed by the capturing unit 15 to generate the second captured image data.

[0073] According to the structure, the control unit 11 applies the first characteristic color and the second characteristic color determined according to the first captured image data to the binary image data of the first pattern image data, and generates the second pattern image data. As a result, the color matching of the second captured image data and the color matching of the second pattern image data become similar, and the accuracy of the comparison of the template matching between the second captured image data and the second pattern image data is improved, thereby obtaining an appropriate correction value. As a result, a colored image accurately deformed according to the correction value is printed on the medium, so even if the medium being transported is deformed, a high-quality printing result without deviation in which the pattern of the medium is consistent with the shape of the colored image is obtained. In addition, according to the present embodiment, the user does not need to manually perform the editing operation of aligning and incorporating the shape of the colored image with the shape of the pattern in the captured image data of the medium being transported, thereby obtaining a high-quality printing result with less burden than before.

[0074] Furthermore, according to the present embodiment, the control unit 11 generates a histogram of colors in the first captured image data in the preliminary process S1 and specifies colors corresponding to peaks of the distribution represented by the histogram as the first characteristic color and the second characteristic color.

[0075] According to the above configuration, the control unit 11 can easily and accurately identify the main color, ie, the characteristic color, in the medium having a pattern.

[0076] 4. Second implementation method:

[0077] The embodiment described above is referred to as the first embodiment, and the second embodiment will be described below. Regarding the second embodiment, the description common to the first embodiment will be omitted.

[0078] Alternatively, the control unit 11 generates a plurality of second pattern image data as the second pattern image data in the preliminary process S1, wherein the plurality of second pattern image data have different patterns according to the degree of deformation of the medium, the degree of deformation of the medium corresponding to the position in the width direction D2, and the width direction D2 intersects the conveying direction D1. Furthermore, in the printed matter production process S2, the correction value is calculated based on the comparison between the second captured image data and each position in the width direction D2 of the second pattern image data, and the correction value corresponding to the position in the width direction D2 is applied to each of the colored images, that is, to each of the plurality of colored images that are deformed in advance according to the degree of deformation corresponding to the position in the width direction D2.

[0079] The so-called "degree of deformation of the medium corresponding to the position in the width direction D2" refers to the tendency of deformation determined in advance based on the curl of the conveying unit 16 and the characteristics of the medium, for example, in the width direction D2, the cloth 30 extends more at a position closer to the end of the endless belt 23, and the cloth 30 deforms to the right side on the right side in the perspective from upstream to downstream. Here, regardless of the tendency of deformation, it is assumed that the control unit 11 has recognized the tendency of deformation corresponding to the position in the width direction D2 in advance. In addition, the control unit 11 further applies a process of making the shape of the pattern different according to the degree of deformation of the medium corresponding to the position in the width direction D2 to the second pattern image data generated by applying the first characteristic color and the second characteristic color to the binary image data as described above in step S140, thereby generating a plurality of second pattern image data corresponding to the position in the width direction D2. That is, the shape of the pattern of the second pattern image data is deformed in advance.

[0080] Fig. 9 FIG. 2 is a diagram for explaining the second embodiment. Fig. 9 Main description and Figure 8 Different points. Fig. 9, a plurality of second pattern image data 45a, 45b, 45c ... are generated as the second pattern image data 45. The plurality of second pattern image data 45a, 45b, 45c ... are a plurality of second pattern image data generated in the preliminary processing S1 by making the shapes of the patterns different according to the degree of deformation of the medium corresponding to the position in the width direction D2.

[0081] from Fig. 9 It can be seen that the control unit 11 compares the pattern unit area 54a of the second captured image data 54 corresponding to the position in the width direction D2 with the second pattern image data 45a and calculates the correction value in step S170. Similarly, the pattern unit area 54b corresponding to the position in the width direction D2 is compared with the second pattern image data 45b and calculates the correction value, and the pattern unit area 54c corresponding to the position in the width direction D2 is compared with the second pattern image data 45c and calculates the correction value.

[0082] Further based on Fig. 9 , as a set of a plurality of colored image data 60 arranged along the X-axis direction, a set of colored image data 60a, 60b, 60c... is generated. That is, each of the colored image data 60a, 60b, 60c... represents a colored image that is pre-deformed according to the degree of the deformation corresponding to the position in the width direction D2. In the second embodiment, the colored image data 60a, 60b, 60c... are pre-generated, and the control unit 11 may acquire them from a predetermined acquisition source in step S180, or may generate the colored image data 60a, 60b, 60c... according to the colored image data 60 acquired by the control unit 11 at the timing of step S180.

[0083] Furthermore, in step S180, the control unit 11 applies the correction value calculated by comparing the pattern unit area 54a with the second pattern image data 45a to the coloring image data 60a, and generates the coloring image data 61a after the coloring image is deformed. Similarly, the control unit 11 applies the correction value calculated by comparing the pattern unit area 54b with the second pattern image data 45b to the coloring image data 60b, and generates the coloring image data 61b after the coloring image is deformed. The same process is repeated below, and the correction value calculated by comparing the pattern unit area 54c with the second pattern image data 45c is applied to the coloring image data 60c, and generates the coloring image data 61c after the coloring image is deformed.

[0084] According to such a second embodiment, the control unit 11 uses a plurality of second pattern image data whose shapes of patterns are different according to the degree of deformation of the medium corresponding to the position in the width direction D2 as the second pattern image data, and uses a plurality of coloring images that are pre-deformed according to the degree of deformation corresponding to the position in the width direction D2 as the coloring images. Thus, compared to the case where the same second pattern image data and coloring image data are used regardless of the position in the width direction D2, the calculation of the correction value and the deformation based on the correction value can be simplified, and it is easy to avoid undesirable situations such as errors caused by excessive deformation of the coloring image. Depending on the situation, the deformation amount based on the correction value becomes almost zero. In Fig. 9 In the example, the differences among the second pattern image data 45a, 45b, 45c, ... and the differences among the colored image data 60a, 60b, 60c, ... are preferentially expressed, and the deformation to a degree that can be visually seen based on the correction value is not expressed.

[0085] 5. Other instructions:

[0086] Even if only a part of the combinations of claims are described in the scope of the claims, in addition to the one-to-one combination of the independent claim and the dependent claim, various combinations of a plurality of dependent claims are naturally included in the disclosure scope of the present embodiment.

[0087] This embodiment discloses various types of inventions other than the printing apparatus, such as a system, a method, and a program for implementing the method in cooperation with a processor.

[0088] For example, the printing method includes: a photographing process for photographing a medium formed with a pattern and conveyed in a conveying direction; a printed matter production process, including printing the medium conveyed in the conveying direction; and a preparatory process for the printed matter production process. The photographing process is included in step S110 and step S160. The photographing process of step S110 is referred to as a first photographing process, and the photographing process of step S160 is referred to as a second photographing process. In the preparatory process, the following steps are performed: obtaining first pattern image data and first photographed image data, the first pattern image data having information on the shape of the pattern, the first photographed image data being generated based on photographing the medium in the first photographing process; determining a first characteristic color and a second characteristic color brighter than the first characteristic color based on the first photographed image data; binarizing the first pattern image data and generating binary image data based on the first color and the second color brighter than the first color; generating second pattern image data by replacing the first color of the binary image data with the first characteristic color and the second color with the second characteristic color; and setting characteristic points for the edge of the pattern in the second pattern image data. Furthermore, in the printed matter production process, the following steps are performed: obtaining second captured image data, which is generated based on the capturing of the medium in the second capturing process; calculating correction values ​​of feature points required to align the shape of a pattern in the second pattern image data with the shape of a pattern in the second captured image data based on a comparison between the second captured image data and the second pattern image data; applying the correction values ​​to a coloring image used to color the pattern to deform the coloring image; and printing the deformed coloring image on the medium captured in the second capturing process.

Claims

1. A printing device, characterized in that: have: A conveying unit, for conveying the medium having the pattern formed thereon in a conveying direction; a photographing unit, for photographing the medium transported by the transporting unit; a printing unit for printing the medium transported by the transport unit; and Control Department, The printed matter production process includes printing by the printing unit, and the control unit executes the following steps as a preparatory process for the printed matter production process: Acquire first pattern image data and first captured image data, wherein the first pattern image data has information on the shape of the pattern, and the first captured image data is generated based on the capturing of the medium by the capturing unit; determining a first characteristic color and a second characteristic color brighter than the first characteristic color according to the first captured image data; Binarizing the first pattern image data and generating binary image data based on a first color and a second color brighter than the first color; generating second pattern image data by replacing the first color of the binary image data with the first characteristic color and replacing the second color with the second characteristic color; and Setting feature points on the edge of the pattern in the second pattern image data, The control unit executes the following steps as the printed matter production process: acquiring second captured image data, wherein the second captured image data is generated based on the capturing of the medium by the capturing unit; calculating, based on a comparison between the second captured image data and the second pattern image data, a correction value of the feature point required to align a shape of a pattern in the second pattern image data with a shape of a pattern in the second captured image data; applying the correction value to a coloring image used for coloring the pattern to deform the coloring image; as well as The printing unit is caused to print the deformed colored image on the medium imaged by the imaging unit in order to generate the second captured image data.

2. The printing device according to claim 1, characterized in that In the preliminary process, the control unit generates a histogram of colors in the first captured image data, and specifies colors corresponding to peaks of distribution represented by the histogram as the first characteristic color and the second characteristic color.

3. The printing device according to claim 1 or 2, characterized in that: In the preparatory process, the control unit generates a plurality of second pattern image data as the second pattern image data, the plurality of second pattern image data making the shapes of the patterns different according to the degree of deformation of the medium, the degree of deformation of the medium corresponding to the position in the width direction intersecting the conveying direction, In the printed material production process, the control unit calculates the correction value based on the comparison between the second captured image data and the second pattern image data at each position in the width direction, and applies the correction value corresponding to the position in the width direction to each of the colored images, that is, the multiple colored images that are pre-deformed according to the degree of deformation corresponding to the position in the width direction.

4. A printing method, characterized in that: have: The photographing step is to photograph the medium with the pattern formed thereon which is transported in the transport direction. A printed matter production process, comprising printing on the medium transported in the transport direction, and For the preparatory process of the printed matter production process, In the preparatory process, the following steps are performed: Acquire first pattern image data and first captured image data, wherein the first pattern image data has information on the shape of the pattern, and the first captured image data is generated based on capturing the medium in the first capturing step; determining a first characteristic color and a second characteristic color brighter than the first characteristic color according to the first captured image data; Binarizing the first pattern image data and generating binary image data based on a first color and a second color brighter than the first color; generating second pattern image data by replacing the first color of the binary image data with the first characteristic color and replacing the second color with the second characteristic color; and Setting feature points on the edge of the pattern in the second pattern image data, In the printed matter production process, the following steps are performed: Acquire second captured image data, where the second captured image data is generated based on capturing the medium in the second capturing step; calculating, based on a comparison between the second captured image data and the second pattern image data, a correction value of the feature point required to align a shape of a pattern in the second pattern image data with a shape of a pattern in the second captured image data; applying the correction value to a coloring image used for coloring the pattern to deform the coloring image; as well as Printing of the deformed colored image is performed on the medium imaged in the second imaging step.

Images