Computer program and method for producing printed products

Abstract

To accurately print an image on a matter to be printed.SOLUTION: A target image obtained by imaging a print substrate in a first state in which the print substrate is disposed in a printing apparatus is acquired. The target image indicates at least a portion of the print substrate to which the plurality of marks are added. The positional relationship of the target printing material with respect to the printing device in the first state is specified using the positions of the plurality of marks in the target image and the positional relationship of the plurality of points. The pretreatment is performed in accordance with the positional relationship of the target printing material with respect to the printing apparatus. After the pretreatment, the specific image is printed on the substrate. The positional relationship of the plurality of points may be, for example, a point on the print substrate including a point at which the plurality of marks are positioned in a reference image obtained by imaging the print substrate to which the plurality of marks are added in a second state different from the first state.SELECTED DRAWING: Figure 7

Description

[Technical Field]

[0001] TECHNICAL FIELD This specification relates to techniques for printing images on a substrate. [Background technology]

[0002] In the technology described in Patent Document 1, when printing an image on fabric, a positioning member with four marking holes is used to make four marks on the area of ​​the fabric to be printed.When setting the fabric in the printing device, the fabric is positioned so that the four marks are located at the four corners of a rectangular platen member.This is said to enable the part of the fabric to be printed to be accurately set on the platen member. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2019-206132 Summary of the Invention [Problem to be solved by the invention]

[0004] Thus, there is a need for a technique for printing an image at a predetermined position on a substrate such as a product made of cloth or leather material.

[0005] This specification discloses a technique that can print an image on a printing substrate with high precision. [Means for solving the problem]

[0006] The techniques disclosed in this specification can be implemented in the following application examples.

[0007] [Application Example 1] A computer program comprising: a reference image acquisition function that acquires a reference image obtained by photographing a printing substrate to which multiple marks have been added in a second state different from a first state in which the printing substrate is placed in a printing device, the reference image showing at least the portion of the printing substrate to which the multiple marks have been added; a target image acquisition function that acquires a target image obtained by re-photographing the printing substrate in the first state, the target image showing at least the portion of the printing substrate to which the multiple marks have been added; an identification function that identifies the positional relationship of the printing substrate with respect to the printing device in the first state using the positions of the multiple marks in the target image and the positional relationship of multiple points in the reference image, the multiple points in the reference image being points on the printing substrate including points at which the multiple marks are located; a preprocessing execution function that executes preprocessing in accordance with the positional relationship of the printing substrate with respect to the printing device; and a print execution function that prints the specific image on the printing substrate after the preprocessing.

[0008] In a first state in which the printing substrate is placed at the printing position, it may be difficult to determine the positional relationship (e.g., position and orientation) of the printing substrate relative to the printing device due to deformation of the printing substrate, etc. According to the above configuration, the positional relationship of multiple points, including the positions of multiple marks, in a reference image obtained by photographing the printing substrate in a second state different from the first state and a target image obtained by photographing the printing substrate again in the first state are acquired. Then, the positional relationship of the printing substrate relative to the printing device in the first state is determined using the positions of the multiple marks in the target image and the positional relationship of the multiple points in the reference image. As a result, the positional relationship of the printing substrate relative to the printing device in the first state can be determined with high accuracy. As a result, a specific image can be printed on the printing substrate with high accuracy.

[0009] [Application Example 2] A computer program, the recording function of which is to record in a memory positional relationship information indicating a positional relationship of a plurality of points on a printing substrate in a second state different from a first state in which the printing substrate is placed in a printing device, the plurality of points being points on the printing substrate including points at which a plurality of marks added to the printing substrate are located, the positional relationship on the printing substrate including a positional relationship between the points at which the plurality of marks are located and a reference point on the printing substrate, the reference point being a point for defining a position on the printing substrate at which the specific image is to be printed, the first state being a state in which the printing substrate is supported by a specific member for holding the printing substrate, the plurality of marks being recorded in a memory a recording function for recording a target image obtained by photographing the printing substrate in the first state, the target image showing at least a portion of the printing substrate to which the plurality of marks have been added; a preprocessing execution function for executing preprocessing in accordance with the positional relationship of the printing substrate to the printing device in the first state using the positions of the plurality of marks in the target image and the positional relationship information; and a print execution function for printing the specific image on the printing substrate after the preprocessing.

[0010] In a first state in which the substrate is placed at the printing position, it may be difficult to determine the positional relationship of the substrate relative to the printing device due to deformation of the substrate, etc. According to the above configuration, positional relationship information indicating the positional relationship of multiple points, including the positions of multiple marks, in a second state different from the first state is recorded. Then, the positional relationship of the substrate relative to the printing device in the first state is determined using the positions of the multiple marks in the target image obtained by photographing the substrate in the first state and the positional relationship information. As a result, the positional relationship of the substrate relative to the printing device in the first state can be determined with high accuracy. As a result, a specific image can be printed on the substrate with high accuracy.

[0011] The technology disclosed in this specification can be realized in various forms, such as a method for manufacturing a cloth product, an image processing device, a printing device, a printing method, a computer program for realizing the functions of these methods or devices, a recording medium (e.g., a non-temporary recording medium) on which the computer program is recorded, etc. [Brief explanation of the drawings]

[0012] [Figure 1] FIG. 1 is a block diagram showing the configuration of a printing system 1000 according to an embodiment. [Figure 2] FIG. 1 is a perspective view showing a schematic configuration of a printing system 1000. [Figure 3] Flowchart of the manufacturing process for printed T-shirts. [Figure 4] FIG. 3 is an explanatory diagram of a reference image and a target image according to the first embodiment. [Figure 5] FIG. 2 is a diagram showing information recorded in a database DB. [Figure 6] 10 is a flowchart of a positional relationship information acquisition process according to the first embodiment. [Figure 7] 10 is a flowchart of a print-related process according to the first embodiment. [Figure 8] FIG. 10 is an explanatory diagram of a reference image according to the second embodiment. [Figure 9] 10 is a flowchart of a positional relationship information acquisition process according to the second and third embodiments. [Figure 10] 10 is a flowchart of a print-related process according to a second embodiment. [Figure 11] FIG. 10 is an explanatory diagram of a target image according to the second embodiment. [Figure 12] 10 is a flowchart of a print-related process according to a third embodiment. [Figure 13] FIG. 13 is an explanatory diagram of a reference image and a target image according to the fourth embodiment. [Figure 14] 13 is a flowchart of a positional relationship information acquisition process according to the fourth embodiment. [Figure 15] 10 is a flowchart of a print-related process according to a fourth embodiment. [Figure 16]13 is a flowchart of a positional relationship information acquisition process according to the fifth embodiment. [Figure 17] FIG. DETAILED DESCRIPTION OF THE INVENTION

[0013] A. First Example: A-1: Configuration of printing system 1000 Next, an embodiment will be described based on an example. Fig. 1 is a block diagram showing the configuration of a printing system 1000 according to the example. The printing system 1000 includes a printer 200, a terminal device 300 as an image processing device according to the example, a first camera 400a, and a second camera 400b. The printer 200 and the terminal device 300, and the two cameras 400a and 400b and the terminal device 300 are communicably connected.

[0014] The terminal device 300 is a computer used by a user of the printer 200, such as a personal computer or a smartphone. The terminal device 300 includes a CPU 310 as a controller for the terminal device 300, and two types of memory (a non-volatile storage device 320 such as a hard disk drive, and a volatile storage device 330 such as RAM). The terminal device 300 also includes an operation unit 360 such as a mouse and a keyboard, a display unit 370 such as a liquid crystal display, and a communication unit 380. The communication unit 380 includes a wired or wireless interface for communicatively connecting to an external device, such as the printer 200 or the first camera 400a.

[0015] The volatile storage device 330 provides a buffer area 331 that temporarily stores various intermediate data generated when the CPU 310 performs processing. The non-volatile storage device 320 stores a computer program PG1 and a database DB. The computer program PG1 is provided by the manufacturer of the printer 200, for example, in a form downloaded from a server or stored on a USB memory or DVD-ROM. The CPU 310 executes the computer program PG1 to perform image processing and control the printer 200. Specifically, the CPU 310 executes, for example, positional relationship information acquisition processing and printing-related processing, which will be described later.

[0016] The first camera 400a and the second camera 400b are digital cameras that generate image data (also called captured image data) representing a subject by optically capturing the subject using an image sensor. For example, the cameras 400a and 400b generate the captured image data and transmit it to the terminal device 300 under the control of the terminal device 300.

[0017] The printer 200 includes, for example, a printing mechanism 100, a CPU 210 as a controller for the printer 200, a non-volatile storage device 220 such as a hard disk drive, a volatile storage device 230 such as RAM, an operation unit 260 such as buttons or a touch panel for acquiring user operations, a display unit 270 such as a liquid crystal display, and a communication unit 280. The communication unit 280 includes a wired or wireless interface for communicatively connecting to an external device, for example, a terminal device 300.

[0018] The volatile storage device 230 provides a buffer area 231 that temporarily stores various intermediate data generated when the CPU 210 performs processing. The non-volatile storage device 220 stores a computer program PG2. In this embodiment, the computer program PG2 is a control program for controlling the printer 200 and may be stored in the non-volatile storage device 220 before shipping the printer 200. Alternatively, the computer program PG2 may be provided in a form downloaded from a server or stored on a USB memory stick, DVD-ROM, or the like. By executing the computer program PG2, the CPU 210 controls the printing mechanism 100 to print an image on a print substrate, for example, according to print data transmitted from the terminal device 300. Note that the printer 200 in this embodiment is intended to print on clothing, specifically, T-shirts, as a print substrate.

[0019] The printing mechanism 100 is an inkjet printing mechanism that performs printing by ejecting ink (droplets) of each of the colors C, M, Y, and K. The printing mechanism 100 includes a print head 110, a head drive unit 120, a main scanning unit 130, and a transport unit 140.

[0020] Further description will be made with reference to Fig. 2. Fig. 2 is a perspective view showing a schematic configuration of the printing system 1000. The +X direction, -X direction, +Y direction, -Y direction, +Z direction, and -Z direction in Fig. 2 correspond to the left, right, front, rear, above, and below the printer 200, respectively.

[0021] The main scanning unit 130 uses the power of a main scanning motor (not shown) inside the housing 201 to reciprocate a carriage (not shown) carrying the print head 110 along the main scanning direction (X direction in FIG. 2). This achieves main scanning by reciprocating the print head 110 along the main scanning direction (X direction) relative to the printing substrate such as a T-shirt S.

[0022] The transport unit 140 includes a platen 142 and a tray 144 provided in the center of the housing 201 in the X direction. The platen 142 is a plate-shaped member for holding a printing substrate such as a T-shirt S so that it can be printed on. The platen 142 is fixed to a plate-shaped tray 144 arranged in the -Z direction of the platen 142. The tray 144 is slightly larger than the platen 142. The platen 142 and tray 144 hold a printing substrate such as a T-shirt S. The platen 142 and tray 144 are transported in a transport direction (Y direction in FIG. 2) that intersects with the main operation direction using the power of a sub-scanning motor (not shown). This achieves sub-scanning, which transports the printing substrate such as a T-shirt S in the transport direction relative to the print head 110.

[0023] The head drive unit 120 (FIG. 1) supplies a drive signal to the print head 110 to drive the print head 110 while the main scanning unit 130 is performing a main scan of the print head 110. The print head 110 has a plurality of nozzles (not shown), and ejects ink onto a printing substrate transported by the transport unit 140 in accordance with the drive signal to form dots.

[0024] 2, the first camera 400a is supported by a support (not shown) and is disposed in the +Z direction of the workbench 600. The first camera 400a is provided facing the upper surface of the workbench 600 and is capable of photographing a T-shirt S placed on the upper surface of the workbench 600. This allows the first camera 400a to generate photographed image data that indicates a reference image (described later) that includes the T-shirt S.

[0025] 2, the second camera 400b is supported by a support (not shown) and is disposed in the +Z direction of the printer 200. The second camera 400b is located at a location away from the printer 200, is provided facing the upper surface of the platen 142, and is capable of capturing an image of the T-shirt S placed on the upper surface of the platen 142. This allows the second camera 400b to generate captured image data that shows a target image (described later) that includes the T-shirt S.

[0026] A-2. Manufacturing process of printed T-shirts Next, the manufacturing process for printed T-shirts will be explained. Printed T-shirts are manufactured by printing a specific image on the chest area of ​​T-shirt S using printing system 1000. Figure 3 is a flowchart of the manufacturing process for printed T-shirts. Figure 4 is an explanatory diagram of the reference image and target image in the first embodiment.

[0027] In S100, a worker prepares a T-shirt S before printing. The T-shirt S is, for example, a plain T-shirt, and is a ready-made product manufactured by a known method. FIG. 4(A) shows the prepared T-shirt S. A sticker 10 with a printed QR code (registered trademark) is attached to the T-shirt S. The QR code (registered trademark) is a known two-dimensional code that encodes the identification number of the T-shirt S (for example, a serial number) and attribute information of the T-shirt S (for example, size, material, gender).

[0028] In S105, the worker registers information about the T-shirt S in the database DB. Specifically, the worker reads the QR code (registered trademark) on the T-shirt S using a reading device (not shown) connected to the terminal device 300. As a result, the serial number and attribute information of the T-shirt S are transmitted from the reading device to the terminal device 300. The CPU 310 of the terminal device 300 records the information received from the reading device in the database DB.

[0029] Fig. 5 is a diagram showing information recorded in the database DB. In the database DB, attribute information of the T-shirt S and positional relationship information, which will be described later, are recorded in association with the identification number of the T-shirt S. In S105, for example, as indicated by the symbol RD1 in Fig. 5, the identification number and attribute information are recorded in association with each other in the database DB. The positional relationship information is recorded in a positional relationship information acquisition process, which will be described later.

[0030] In S110, the worker places the T-shirt S on the workbench 600. The workbench 600 is a flat plate large enough to allow the T-shirt S to be spread out and placed on its upper surface. The T-shirt S is placed spread out on the workbench 600 so as not to cause wrinkles. FIG. 4(A) shows the T-shirt S placed on the workbench 600. The T-shirt S is placed on the workbench 600 so that its length direction (the Y direction in FIG. 4(A)) coincides with a predetermined direction of the workbench 600 (specifically, the direction of the long side of the rectangular workbench 600). The state in which the T-shirt S is placed on the workbench 600 is also referred to as the workbench-placed state. In the workbench-placed state, the entire T-shirt S is supported by the workbench 600. For this reason, in the workbench-placed state, the T-shirt S is less likely to undergo unpredictable deformation, and the T-shirt S is maintained in a spread-out state without wrinkles.

[0031] In S115, the worker applies a mark to the T-shirt S using the chalk pen 500. In this embodiment, the ink of the chalk pen 500 is water-based ink that easily evaporates with the heat of an iron. The mark applied to the T-shirt S with the chalk pen 500 can be easily erased by ironing.

[0032] In the first embodiment, three marks Mr, Ma, and Mb are added to the T-shirt S. The three marks Mr, Ma, and Mb include one reference mark Mr and two arbitrary marks Ma and Mb. The reference mark Mr is added to a reference point Ms on the T-shirt S. The reference point Ms is a point for defining the position on the T-shirt S of the printing area where a specific image (the image to be printed) is to be printed. As shown in FIG. 4A, the reference point Ms is a point along the front neckline and is located at the center of the T-shirt S in the X direction (the left-right direction in FIG. 4A). The arbitrary marks Ma and Mb are added to two arbitrary points on the platen support portion PA of the T-shirt S. The platen support portion PA is the portion supported by the platen 142 during printing. These marks Ma, Mb, and Mr are added to have predetermined colors, shapes, and sizes. In this embodiment, the marks Ma, Mb, and Mr are added using a red chalk pen 500 and have a red circular shape with a diameter of 0.5 to 1 centimeter. If the T-shirt S includes a red portion, a color other than red is used for the marks.

[0033] In S125, the CPU 310 of the terminal device 300 executes a positional relationship information acquisition process. Specifically, after the worker adds a mark to the T-shirt S, the worker operates the operation unit 360 of the terminal device 300 to input an instruction to start the positional relationship information acquisition process. Upon receiving the start instruction, the CPU 310 of the terminal device 300 starts the positional relationship information acquisition process.

[0034] 6 is a flowchart of the positional relationship information acquisition process of the first embodiment. In S210, the CPU 310 acquires a reference image RI showing the T-shirt S using the first camera 400a. Specifically, the CPU 310 sends a shooting instruction to the first camera 400a. The first camera 400a takes an image of the T-shirt S placed on the workbench 600 and generates captured image data. The first camera 400a transmits the generated captured image data to the terminal device 300. The image represented by the captured image data acquired from the first camera 400a is the reference image RI. The data of the reference image RI is, for example, RGB image data including a plurality of RGB values ​​corresponding to a plurality of pixels and indicating the color of each pixel using the RGB values.

[0035] 4(B) shows an example of the reference image RI. The reference image RI includes an image of the entire T-shirt S. In this embodiment, the vertical direction of the reference image RI (the Y direction in FIG. 4(B)) coincides with the length direction of the T-shirt S, and the horizontal direction of the reference image RI (the X direction in FIG. 4(B)) coincides with the width direction of the T-shirt S.

[0036] In S220, the CPU 310 detects two arbitrary marks Ma and Mb and one reference mark Mr included in the reference image RI. For example, the CPU 310 identifies, as object pixels, pixels having RGB values ​​within a predetermined color range among the pixels included in the reference image RI. The predetermined color range is a predetermined range of RGB values ​​that indicates the color of the mark (e.g., red). The CPU 310 identifies multiple object regions by performing a known labeling process on the identified object pixels. The labeling process is, for example, a process of assigning one identifier to one object region consisting of one or more contiguous object pixels and assigning different identifiers to multiple object regions that are separated from each other. The CPU 310 detects, from among the identified object regions, object regions having the size and shape that a mark should have (e.g., a circle with a diameter of 0.5 to 1 centimeter) as marks Ma, Mb, and Mr. At this stage, typically, three marks are detected. If the three marks are not detected, CPU 310 displays a predetermined error notification and interrupts the positional relationship information acquisition process (not shown in the flowchart of FIG. 6).

[0037] The CPU 310 determines the uppermost mark (in the +Y direction in FIG. 4(B)) of the three detected marks as the reference mark Mr, and determines the remaining two marks as arbitrary marks Ma and Mb. Note that various other methods of detecting marks may be used. For example, the CPU 310 may detect an edge indicating the neckline NL of the reference image RI and determine a mark located near the edge as the reference mark Mr. Alternatively, the CPU 310 may determine the mark selected by the operator from the three detected marks as the reference mark Mr.

[0038] In S240, the CPU 310 calculates the angle α (FIG. 4B) formed by the line segments Ma-Mb and Ma-Mr, and the angle β (FIG. 4B) formed by the line segments Ma-Mb and Mb-Mr. The line segment Ma-Mb is a line segment connecting the point where the arbitrary mark Ma is located and the point where the arbitrary mark Mb is located. For example, the points where the arbitrary marks Ma and Mb are located are the centers of gravity of the detected arbitrary marks Ma and Mb, respectively. Similarly, the line segment Ma-Mr is a line segment connecting the point where the arbitrary mark Ma is located and the point where the reference mark Mr is located. The line segment Mb-Mr is a line segment connecting the point where the arbitrary mark Mb is located and the point where the reference mark Mr is located. The point where the reference mark Mr is located is, for example, the center of gravity of the detected reference mark Mr (the reference point Ms described above).

[0039] In S250, CPU 310 calculates the angle θ (FIG. 4B) formed between reference line L1 and line segment Ma-Mb. Reference line L1 is a line that passes through reference point Ms where reference mark Mr is located and is parallel to the length direction of the T-shirt S. Reference image RI is captured so that the length direction of the T-shirt S and the vertical direction of reference image RI (Y direction in FIG. 4B) are parallel. For this reason, CPU 310 calculates angle θ using, for example, a straight line that passes through reference point Ms and is parallel to the vertical direction of reference image RI as reference line L1. As will be described later, the printing area is set so that reference line L1 and one side of the specific image to be printed are parallel.

[0040] In S260, the CPU 310 records the calculated angles α, β, and θ as positional relationship information in the database DB. For example, as shown by the symbol RD2 in Fig. 5, in this step, the positional relationship information is recorded in association with the identification number and attribute information (RD1 in Fig. 5) of the T-shirt S recorded in the database DB in S105 in Fig. 3. Once the positional relationship information is recorded in the database DB, the positional relationship information acquisition process ends.

[0041] When the positional relationship information acquisition process is completed, in S130 of Fig. 3, the worker places the T-shirt S on the platen 142. Fig. 4(C) is a diagram showing the state in which the T-shirt S is placed on the platen 142. The worker places the T-shirt S on the platen 142, for example, so that the portion on which the specific image is to be printed is located in the center of the upper surface of the platen 142. The state in which the T-shirt S is placed on the platen 142 of the printer 200 is also referred to as a platen-placed state.

[0042] In this embodiment, the T-shirt S is larger than the upper surface of the platen 142. Therefore, in the platen-mounted state, the center of the T-shirt S is supported by the platen 142, but the edges of the T-shirt S (the top, bottom, left, and right edges in FIG. 4C) are not supported by the platen 142. Therefore, in the platen-mounted state, the edges of the T-shirt S deform and droop, making it difficult to accurately position and place the T-shirt S on the platen 142, unlike the workbench-mounted state (FIG. 4A). In this embodiment, in the printing-related processing described below, the position and direction of the print area can be adjusted depending on the positional relationship of the T-shirt S with respect to the platen 142 in the platen-mounted state. Therefore, some deviation from the ideal position of the T-shirt S with respect to the platen 142 is acceptable. As shown in FIG. 4C, the T-shirt S is positioned with respect to the platen 142 so that the two arbitrary marks Ma and Mb are located on the platen 142.

[0043] In S135, the CPU 310 of the terminal device 300 executes print-related processing. Specifically, after placing the T-shirt S on the platen 142, the worker operates the operation unit 360 of the terminal device 300 to input an instruction to start the print-related processing. Upon receiving the start instruction, the CPU 310 of the terminal device 300 starts the print-related processing.

[0044] 7 is a flowchart of the print-related processing of the first embodiment. In S310, the CPU 310 acquires a target image SI showing a T-shirt S using the second camera 400b. Specifically, the CPU 310 sends a shooting instruction to the second camera 400b. The second camera 400b takes an image of the T-shirt S placed on the platen 142 and generates captured image data. The second camera 400b transmits the generated captured image data to the terminal device 300. The image represented by the captured image data acquired from the second camera 400b is the target image SI. The data of the target image SI is, for example, RGB image data, similar to the data of the reference image RI.

[0045] 4(D) and (E) show an example of the target image SI. The target image SI includes an image of the entire portion of the T-shirt S that is supported by the platen 142. The target image SI does not include the edge portion of the T-shirt S that is not supported by the platen 142. For this reason, the target image SI includes two arbitrary marks Ma and Mb out of the three marks Ma, Mb, and Mr, but does not include the reference mark Mr.

[0046] In S320, CPU 310 detects two arbitrary marks Ma and Mb included in target image SI. The method for detecting the two arbitrary marks Ma and Mb is, for example, the same as the method for detecting marks Ma, Mb, and Mr in S220 of FIG. 6 described above. This usually results in detection of two arbitrary marks Ma and Mb. If two marks are not detected, CPU 310 displays a predetermined error notification and interrupts the print-related processing (not shown in the flowchart of FIG. 7).

[0047] In S330, the CPU 310 acquires the positional relationship information (angles α, β, θ) recorded in S260 of the positional relationship information acquisition process (FIG. 6) from the database DB. In S340, the CPU 310 calculates the coordinates of the reference point Ms in the coordinate system of the target image SI based on the angles α and β included in the positional relationship information. The coordinate system of the target image SI is, for example, a coordinate system with the lower left vertex of the target image SI as the origin and vectors of unit length in the X and Y directions as unit vectors. For example, the CPU 310 identifies a line segment Ma-Mb that passes through the center of gravity of the detected arbitrary mark Ma and the center of gravity of the detected arbitrary mark Mb. The CPU 310 identifies a line Lα (FIG. 4D) that passes through the center of gravity of the arbitrary mark Ma and forms an angle α with the line segment Ma-Mb. The CPU 310 identifies a line Lβ (FIG. 4D) that passes through the center of gravity of the arbitrary mark Mb and forms an angle β with the line segment Ma-Mb. The CPU 310 calculates the coordinates of the intersection of the lines Lα and Lβ as the coordinates of the reference point Ms. The target image SI is an image captured by the second camera 400b, which is located at a fixed position relative to the platen 142, and therefore the target image SI is an image that is fixed relative to the platen 142. For this reason, calculating the coordinates of the reference point Ms in the target image SI means identifying the position of the T-shirt S relative to the platen 142 of the printer 200.

[0048] In S350, the CPU 310 identifies a reference line L1 that forms an angle θ with the line segment Ma-Mb and passes through the reference point Ms. The reference line L1 is parallel to the Y direction in the reference image RI (FIG. 4A), but is not parallel to the Y direction in the target image SI (FIG. 4B). This means that the length direction of the T-shirt S (parallel to the reference line L1) is inclined with respect to the longitudinal direction of the platen 142 (FIG. 4A).

[0049] In this way, by calculating the reference point Ms and the reference line L1, the positional relationship of the T-shirt S with respect to the platen 142 of the printer 200 is determined. Here, the positional relationship of the T-shirt S with respect to the platen 142 of the printer 200 refers to the relative position and orientation of the T-shirt S with respect to the platen 142 in this embodiment.

[0050] In S360, the CPU 310 sets the print area IA where the specific image is to be printed based on the identified reference point Ms and reference line L1. Because the printer 200 prints on a printing substrate placed on the platen 142, the position and angle of the print area IA are expressed as the position and angle relative to the platen 142. Specifically, as shown in FIG. 4(E), the CPU 310 specifies an auxiliary line VL2 that is perpendicular to the reference line L1 and is a predetermined distance Dr from the reference point Ms. The CPU 310 determines the position of the print area IA relative to the platen 142 so that the intersection Px of the reference line L1 and the auxiliary line VL2 coincides with the center of gravity Pc of the print area IA and the left and right sides of the print area IA are parallel to the reference line L1. The print area IA is set to the same size as the specific image to be printed. In this way, the direction parallel to the reference line L1 indicates the orientation of the specific image to be printed relative to the T-shirt S and is the reference direction when setting the print area IA. For this reason, the direction parallel to the reference line L1 is also called the reference direction. Therefore, it can be said that the reference line L1 is a line that passes through the reference point Ms and extends in the reference direction.

[0051] In S370, the CPU 310 determines whether the set print area IA is within the printable range. In this embodiment, the printable range of the printer 200 is the range above the platen 142 (FIG. 4E). If the set print area IA is outside the printable range (S370: NO), the specific image cannot be printed entirely in the print area IA. Therefore, in S380, the CPU 310 displays an error message (not shown) on the display unit 370 and interrupts the print-related processing. The error message may include, for example, a message indicating that printing is not possible because the T-shirt S is not correctly positioned on the platen 142. In this case, for example, the operator restarts the printed T-shirt manufacturing process, starting from the step of placing the T-shirt S on the platen 142 in S130 of FIG. 3.

[0052] If the set print area IA is within the printable range (S370: YES), CPU 310 generates print data in S385 so that the specific image will be printed in the set print area IA. Specifically, CPU 310 obtains data for the specific image (e.g., RGB image data) from nonvolatile storage device 320, and performs rotation and translation processing on the specific image data to adjust the position and angle of the specific image so that it matches the set print area IA. CPU 310 then performs known color conversion and halftone processing on the adjusted specific image to generate print data.

[0053] In S390, CPU 310 controls printer 200 to print the specific image within the print area IA. For example, CPU 310 transmits the print data generated in S385 to printer 200. Printer 200 controls printing mechanism 100 in accordance with the received print data to print the specific image on T-shirt S. Once the specific image is printed, the print-related processing ends.

[0054] 3 is completed and the specific image is printed on the T-shirt S, the worker irons the printed T-shirt S in S140. For ironing, for example, a known heat press machine is used. By applying heat to the T-shirt S through ironing, the arbitrary marks Ma, Mb, and Mr added to the T-shirt S are erased. In addition, the ink constituting the specific image printed on the T-shirt S is fixed to the surface of the T-shirt S.

[0055] According to the first embodiment described above, the CPU 310 acquires a reference image RI obtained by photographing the T-shirt S, to which multiple marks Ma, Mb, and Mr have been added, in a workbench state (FIG. 4A) different from the platen state (FIG. 4C) (S210 in FIG. 6). The CPU 310 acquires the positional relationships (angles α, β, θ) of multiple points on the T-shirt S in the reference image RI, specifically, the points where the marks Ma, Mb, and Ms are located (S240-S260 in FIG. 6). The CPU 310 acquires a target image SI obtained by photographing the T-shirt S again in the platen state (S310 in FIG. 7). CPU 310 uses the positions of multiple marks Ma and Mb in target image SI and the positional relationship (angles α, β, θ) of multiple points in reference image RI to determine the positional relationship of the T-shirt S with respect to platen 142 of printer 200 when the platen is placed (specifically, the coordinates of reference point Ms and reference line L1) (320-S350 in FIG. 7). CPU 310 sets print area IA with respect to platen 142 according to the positional relationship of the T-shirt S with respect to platen 142 (specifically, the coordinates of reference point Ms and reference line L1) (S360 in FIG. 7), and generates print data to print in print area IA (S385 in FIG. 7). Printer 100 then uses the print data to print a specific image on the T-shirt S (S390 in FIG. 7).

[0056] When the T-shirt S is placed on the platen, it may be difficult to determine the positional relationship of the T-shirt S with respect to the platen 142 due to deformation of the T-shirt S ( FIG. 4(C) ), etc. According to this embodiment, positional relationship information for multiple points where multiple marks Ma, Mb, and Ms are located within a reference image RI obtained by capturing an image with the T-shirt placed on the work table is recorded. Then, the positional relationship information for the multiple marks Ma and Mb within a target image SI obtained by re-capturing an image of the T-shirt S with the T-shirt placed on the platen is used to determine the positional relationship of the T-shirt S with respect to the platen 142 in the platen-placed state. As a result, the positional relationship of the T-shirt S with respect to the platen 142 in the platen-placed state can be determined with high accuracy. As a result, a specific image can be printed on the T-shirt S with high accuracy. Ultimately, a printed T-shirt S with a specific image printed in an appropriate position can be manufactured.

[0057] Furthermore, according to this embodiment, the positional relationship of multiple points in the target image SI includes the positional relationship (angles α, β, θ) between the points where the multiple arbitrary marks Ma and Mb are located and the reference point Ms (the point where the reference mark Mr is located) on the T-shirt S. As a result, even if the target image SI does not include the reference point Ms, as in the target image SI in FIG. 4B, or if the positional relationship between the multiple arbitrary marks Ma and Mb and the reference point Ms has changed due to deformation of the T-shirt S, the positional relationship between the platen 142 and the T-shirt S can be determined with high accuracy, and the print area IA can be appropriately set relative to the platen 142.

[0058] Furthermore, according to this embodiment, the multiple arbitrary marks Ma, Mb are located in the portion of the T-shirt S that is supported by the platen 142 when the T-shirt S is placed on the platen (FIG. 4(C)). As a result, the multiple arbitrary marks Ma, Mb are included in the target image SI obtained by capturing an image of the area where the platen 142 is located, and the arbitrary marks Ma, Mb can be detected by analyzing the target image SI (S220 in FIG. 6).

[0059] Furthermore, in the platen-mounted state, the reference point Ms (reference mark Mr) is located in a portion of the T-shirt S that is not supported by the platen 142 (FIG. 4C). In such a case, the portion of the T-shirt S where the reference point Ms (reference mark Mr) is located may be deformed into a shape that is difficult to predict. Therefore, in the platen-mounted state, it is difficult to set the print area IA based on the reference point Ms. Even in such a case, in this embodiment, the coordinates of the reference point Ms are calculated based on the positional relationship between the arbitrary marks Ma and Mb and the reference point Ms (reference mark Mr) in the workbench-mounted state (S340 in FIG. 7). The calculated coordinates of the reference point Ms are the coordinates of the reference point Ms when it is assumed that the T-shirt S maintains the same shape in the platen-mounted state as in the workbench-mounted state. Therefore, by setting the print area IA based on the calculated coordinates of the reference point Ms, the print area IA can be set appropriately even if the edge of the T-shirt S is deformed in the platen-mounted state.

[0060] Furthermore, according to this embodiment, the target image SI does not include an image of the portion of the T-shirt S where the reference point Ms is located (FIGS. 4(D) and 4(E)). In such a case, using only the target image SI makes it difficult to determine the positional relationship between the platen 142 and the T-shirt S, and it is also difficult to accurately set the printing area IA relative to the platen 142. According to this embodiment, positional relationship information generated using the reference image RI is used in addition to the target image SI. Therefore, even if the target image SI does not include the reference point Ms, it is possible to determine the positional relationship between the platen 142 and the T-shirt S, and ultimately to accurately set the printing area IA relative to the platen 142.

[0061] Furthermore, in this embodiment, the reference point Ms is a point located along the neckline NL of the T-shirt S. Because the neckline NL is far from the printing area IA (chest area of ​​the T-shirt S), it is highly likely that it will not be supported by the platen 142. For this reason, the area where the reference point Ms is located is easily deformed, and is highly likely not to be included in the target image SI. Even in such a case, this embodiment makes it possible to identify the positional relationship between the platen 142 and the T-shirt S, and ultimately to set the printing area IA with respect to the platen 142 with high accuracy.

[0062] Furthermore, according to this embodiment, the multiple arbitrary marks Ma, Mb are added to the T-shirt S at arbitrary positions on the platen support portion PA that is supported by the platen 142 (S115 in FIG. 3). As a result, the worker need only add the marks Ma, Mb at arbitrary positions on the portion that is supported by the platen 142, which reduces the burden on the worker compared to, for example, a case where marks must be placed at precise positions. Furthermore, the positional relationship of the T-shirt S with respect to the platen 142 when placed on the platen can be accurately determined without relying on the skill of the worker.

[0063] Furthermore, in this embodiment, the positional relationship between multiple points in the reference image RI includes the angle θ. The angle θ can be said to be information indicating the positional relationship between the arbitrary marks Ma and Mb and the reference direction (the direction parallel to the reference line L1) on the T-shirt S (FIG. 4(D)). By using the angle θ, the angle of the T-shirt S relative to the platen 142 when the platen is placed can be determined with high accuracy. Therefore, a specific image can be printed on the T-shirt S at an appropriate angle.

[0064] As can be seen from the above explanation, the platen placement state in this embodiment is an example of State 1, and the workbench placement state is an example of State 2. Furthermore, the process of setting the print area IA for the platen 142 in this embodiment and generating print data to print in the print area IA (S360 and S385 in FIG. 7) is an example of preprocessing.

[0065] B. Second Example 8A and 8B are explanatory diagrams of a reference image in the second embodiment. Fig. 8A shows a T-shirt S placed on a workbench. In the first embodiment, in S115 of Fig. 3, the worker uses a chalk pen 500 to add two arbitrary marks Ma and Mb and a reference mark Mr. Instead, in the second embodiment, as shown in Fig. 4A, the worker adds only two arbitrary marks Ma and Mb, and does not add a reference mark.

[0066] In the second embodiment, the contents of the positional relationship information acquisition process of S125 in Fig. 3 and the print-related process of S135 in Fig. 3 are also different from those of the first embodiment. The other configurations of the second embodiment are the same as those of the first embodiment.

[0067] First, the positional relationship information acquisition process of the second embodiment will be described. Fig. 9 is a flowchart of the positional relationship information acquisition process of the second and third embodiments. In S210B, similar to S210 in Fig. 6, the CPU 310 acquires a reference image RIb showing the T-shirt S by using the first camera 400a to capture an image of the T-shirt S placed on the workbench 600.

[0068] FIG. 8B shows an example of the reference image RIb of the second embodiment. The reference image RIb includes an image of the entire T-shirt S. Unlike the first embodiment, in the second embodiment, the vertical direction of the reference image RIb (the Y direction in FIG. 8B) does not need to strictly match the length direction of the T-shirt S, and may be offset. In the example of FIG. 8B, the length direction of the T-shirt S is slightly tilted with respect to the vertical direction of the reference image RIb.

[0069] In S220B, the CPU 310 detects two arbitrary marks Ma and Mb included in the reference image RIb. The method for detecting the arbitrary marks Ma and Mb is the same as the method for detecting the three marks Ma, Mb, and Mr in S220 of the first embodiment in Fig. 6. In the second embodiment, since the reference mark Mr does not exist, only the two arbitrary marks Ma and Mb are detected.

[0070] In S230B, the CPU 310 performs edge analysis to detect feature points SPa and SPb on both shoulders of the T-shirt S. Various specific methods may be employed for edge analysis.

[0071] For example, the T-shirt S is placed at a predetermined position on the workbench 600 and photographed by the first camera 400a, whose position relative to the workbench 600 is fixed. Therefore, the approximate positions of both shoulders in the reference image RIb are determined. For example, the feature point SPa of the right shoulder is located within a predetermined area EA near the upper right corner of the reference image RIb. The feature point SPa of the right shoulder is the intersection of a contour line EL1 extending from the right shoulder to the right sleeve of the T-shirt S and a joining line EL2 between the fabric of the right sleeve and the fabric of the chest. For example, the CPU 310 performs a known edge detection process, such as a canny function, on the image within the area EA to generate an edge image showing the edges within the area EA. The CPU 310 can identify the feature point SPa of the right shoulder by performing a known process, such as pattern matching, on the edge image to search for the T-shaped intersection of the contour line EL1 and the joining line EL2 in the edge image. The CPU 310 can identify the feature point SPb of the left shoulder using a similar method.

[0072] In S240B, the CPU 310 specifies the midpoint between the feature points SPa and SPb on both shoulders as the first reference point Ms1. As a result, for example, as shown in FIG. 8B, the first reference point Ms1 along the neckline NL of the T-shirt S is specified.

[0073] In S250B, the CPU 310 analyzes the reference image RIb to identify the reference line L1. Specifically, the CPU 310 identifies, as the reference line L1, a straight line that passes through the first reference point Ms1 and is equidistant to the side lines RL and LL on both sides.

[0074] For example, the CPU 310 performs a known edge detection process, such as a canny function, on the reference image RIb to detect contours including the side lines RL and LL of the T-shirt S. The CPU 310 provisionally determines a line that passes through the first reference point Ms1 and is parallel to the Y direction of the reference image RIb (FIG. 8B) as the reference line L1. The CPU 310 sets a measurement point Vp located on the provisionally determined reference line L1 and a predetermined distance downward (in the -Y direction) from the first reference point Ms1. The CPU 310 sets an auxiliary line Lh that passes through the measurement point Vp and is perpendicular to the provisionally determined reference line L1. The CPU 310 identifies an intersection point pr between the auxiliary line Lh and the right side line RL and an intersection point pl between the auxiliary line Lh and the left side line LL. The CPU 310 calculates the distance DR between the measurement point Vp and the intersection point pr and the distance DL between the measurement point Vp and the intersection point pl, and compares the distances DR and DL. If the distance DR and the distance DL are equal, the CPU 310 determines the provisionally determined reference line L1 as the final reference line L1. If the distance DR and the distance DL are different, the CPU 310 adjusts the inclination (angle with respect to the Y direction) of the provisionally determined reference line L1 so that the distances DR and DL become closer to each other. The CPU 310 repeats this adjustment of the inclination of the reference line L1 until the distances DR and DL become equal, thereby identifying the final reference line L1.

[0075] In S260B, the CPU 310 determines a second reference point Ms2 on the reference line L1. The second reference point Ms2 is determined, for example, so that the distance between the first reference point Ms1 and the second reference point Ms2 is a specific distance Ds. The specific distance Ds is, for example, approximately the same length as the length of the platen 142 in the Y direction.

[0076] In S270B, the CPU 310 calculates the angle a (FIG. 8C) formed by the line segments Ma-Mb and Ma-Ms1, and the angle b (FIG. 8C) formed by the line segments Ma-Mb and Mb-Ms1. The line segment Ma-Mb is a line segment connecting the point where the arbitrary mark Ma is located and the point where the arbitrary mark Mb is located. The line segment Ma-Ms1 is a line segment connecting the point where the arbitrary mark Ma is located and the first reference point Ms1. The line segment Mb-Ms1 is a line segment connecting the point where the arbitrary mark Mb is located and the first reference point Ms1.

[0077] In S280B, the CPU 310 calculates the angle c (FIG. 8C) formed by the line segments Ma-Mb and Ma-Ms2, and the angle d (FIG. 8C) formed by the line segments Ma-Mb and Mb-Ms2. The line segment Ma-Ms2 is a line segment connecting the point where the arbitrary mark Ma is located and the second reference point Ms2. The line segment Mb-Ms2 is a line segment connecting the point where the arbitrary mark Mb is located and the second reference point Ms2.

[0078] In S290B, CPU 310 records calculated angles a, b, c, and d as positional relationship information in database DB. When the positional relationship information is recorded in database DB, the positional relationship information acquisition process ends.

[0079] Next, the print-related processing of the second embodiment will be described. Fig. 10 is a flowchart of the print-related processing of the second embodiment. Fig. 11 is an explanatory diagram of a target image of the second embodiment.

[0080] In S310B, similar to S310 in Fig. 7, the CPU 310 acquires a target image SIb showing the T-shirt S using the second camera 400b. An example of the target image SIb is shown in Fig. 11(B) and (C). The target image SIb is an image obtained by photographing the T-shirt S placed on the platen as shown in Fig. 11(A). The target image SIb includes two arbitrary marks Ma and Mb.

[0081] In S320B, the CPU 310 detects two arbitrary marks Ma and Mb included in the target image SIb, similarly to S320 in Fig. 7. The method for detecting the two arbitrary marks Ma and Mb is, for example, the same as the detection method in S320 in Fig. 7.

[0082] In S330B, CPU 310 acquires the positional relationship information (angles a, b, c, d) recorded in S290B of the positional relationship information acquisition process (FIG. 9) from database DB.

[0083] In S340B, the CPU 310 calculates the coordinates of the first reference point Ms1 in the coordinate system of the target image SI based on the angles a and b included in the positional relationship information. The coordinate system of the target image SIb is, for example, a coordinate system with the lower left vertex of the target image SIb as the origin and vectors of unit length in the X and Y directions as unit vectors. For example, the CPU 310 identifies a line segment Ma-Mb that passes through the center of gravity of the detected arbitrary mark Ma and the center of gravity of the detected arbitrary mark Mb. The CPU 310 identifies a line La (FIG. 11C) that passes through the center of gravity of the arbitrary mark Ma and forms an angle a with the line segment Ma-Mb. The CPU 310 identifies a line Lb (FIG. 11C) that passes through the center of gravity of the arbitrary mark Mb and forms an angle b with the line segment Ma-Mb. The CPU 310 calculates the coordinates of the intersection of the line La and the line Lb as the coordinates of the first reference point Ms1.

[0084] In S350B, the CPU 310 calculates the coordinates of the second reference point Ms2 in the coordinate system of the target image SI based on the angles c and d included in the positional relationship information. For example, the CPU 310 identifies a line Lc (FIG. 11C) that passes through the center of gravity of the arbitrary mark Ma and forms an angle c with the line segment Ma-Mb. The CPU 310 identifies a line Ld (FIG. 11C) that passes through the center of gravity of the arbitrary mark Mb and forms an angle d with the line segment Ma-Mb. The CPU 310 calculates the coordinates of the intersection of the line Lc and the line Ld as the coordinates of the second reference point Ms2.

[0085] In S360B, the CPU 310 specifies a straight line passing through the first reference point Ms1 and the second reference point Ms2 as the reference line L1. In this way, by calculating the first reference point Ms1 and the reference line L1, the positional relationship of the T-shirt S with respect to the platen 142 of the printer 200 is specified.

[0086] In S365B, similar to S360 in FIG. 7, the CPU 310 sets the print area IA in which the specific image should be printed based on the identified first reference point Ms1 and reference line L1. Specifically, as shown in FIG. 11C, the CPU 310 specifies an auxiliary line VL2 that is perpendicular to the reference line L1 and is a predetermined distance Dr from the first reference point Ms1. The CPU 310 determines the position of the print area IA relative to the platen 142 so that the intersection Px of the reference line L1 and the auxiliary line VL2 coincides with the center of gravity Pc of the print area IA and the left and right sides of the print area IA are parallel to the reference line L1. As in the first embodiment, the direction parallel to the reference line L1 is the reference direction that serves as the basis for setting the print area IA. Therefore, the reference line L1 in the second embodiment can be said to be a line that passes through the first reference point Ms1 and extends in the reference direction.

[0087] The processing of S370B-S390B is the same as that of S370-S390 in FIG. 7. In S370B, CPU 310 determines whether the set print area IA is within the printable range. If the set print area IA is outside the printable range (S370B: NO), CPU 310 displays an error notification on display unit 370 and interrupts the print-related processing in S380B. If the set print area IA is within the printable range (S370B: YES), CPU 310 generates print data to print in print area IA in S385B, and controls printer 200 using the print data to print the specific image within print area IA in S390B. Once the specific image has been printed, the print-related processing ends.

[0088] According to the second embodiment described above, the CPU 310 determines the first reference point Ms1 by analyzing the reference image RIb (S220B, S240B in FIG. 9). The CPU 310 determines the positional relationship of the T-shirt S with respect to the platen 142 in the platen-mounted state using the positional relationship between the first reference point Ms1 determined by analyzing the reference image RIb and the points at which the multiple arbitrary marks Ma and Mb are located (S320B-S340B in FIG. 10). As a result, unlike the first embodiment, the operator does not need to add a reference mark to the T-shirt S when generating the reference image RIb. Because the reference mark needs to be added so as to accurately indicate the first reference point Ms1, this may impose a heavy burden on the operator or require a high level of skill. According to this embodiment, the operator's burden can be reduced compared to the first embodiment. Furthermore, compared to the first embodiment, a specific image can be printed accurately on the T-shirt S without relying on the operator's skill.

[0089] Furthermore, according to this embodiment, the CPU 310 determines the reference direction by analyzing the reference image RIb (S250B, S260B in FIG. 9). Specifically, the CPU 310 identifies a reference line L1 parallel to the reference direction by analyzing the reference image RIb. As a result, compared to the first embodiment in which the reference line L1 is determined to be parallel to the Y direction, for example, an appropriate reference line L1 can be determined even if the T-shirt S is tilted with respect to the Y direction of the reference image RIb. Therefore, when placing the T-shirt S on the work table 600, the worker does not need to place it strictly so that the length direction of the T-shirt S coincides with the longitudinal direction of the work table 600. As a result, compared to the first embodiment, the burden on the worker can be reduced. Furthermore, compared to the first embodiment, a specific image can be printed accurately on the T-shirt S without relying on the worker's skill.

[0090] More specifically, CPU 310 determines first reference point Ms1 and second reference point Ms2 so that the direction from first reference point Ms1 to second reference point Ms2 is the reference direction (S240B-S260B in FIG. 9). CPU 310 calculates information (angles a, b, c, d) indicating the positional relationship between the points where multiple arbitrary marks Ma and Mb are located and the first reference point Ms1 and second reference point Ms2 (S270B and S280B in FIG. 9). As a result, the angles a, b, c, and d alone can appropriately indicate the positional relationship between the points where arbitrary marks Ma and Mb are located and the reference point and reference direction for arranging print area IA.

[0091] C. Third Example In the positional relationship information acquisition process of the third embodiment, the positional relationship information acquisition process already described with reference to FIG. 9 is executed in S125 of FIG. 3. However, in the second embodiment, in S290B of FIG. 9, the CPU 310 records only the angle information (angles a, b, c, and d (FIG. 8C)) as positional relationship information in the database DB. Instead, in the third embodiment, in S290B, the CPU 310 acquires coordinate information in addition to the angle information (angles a, b, c, and d (FIG. 8C)). The coordinate information is the coordinates of the points where the arbitrary marks Ma and Mb are located in the target image SI and the reference points Ms1 and Ms2. These coordinates are coordinates of the coordinate system of the reference image RIb. The coordinate system of the reference image RIb is, for example, a coordinate system with the lower left vertex of the reference image RIb as the origin and vectors of unit length in the X and Y directions as unit vectors.

[0092] In the third embodiment, the content of the print-related processing in S135 in Fig. 3 is also different from that in the second embodiment. The other configurations of the third embodiment are the same as those of the second embodiment.

[0093] The print-related processing of the third embodiment will now be described with reference to Fig. 12, which is a flowchart of the print-related processing of the third embodiment.

[0094] In S310C, the CPU 310 executes the processes of S310B to S350B in Fig. 10. As a result, the coordinates of the reference points Ms1 and Ms2 are calculated (340B and S350B in Fig. 10) based on the angle information (angles a, b, c, and d (Fig. 8C)).

[0095] In S320C, the CPU 310 acquires the coordinate information included in the positional relationship information from the database DB. That is, the coordinates of the points where the arbitrary marks Ma and Mb are located and the reference points Ms1 and Ms2 in the coordinate system of the reference image RIb are acquired.

[0096] In S330C, the CPU 310 converts the coordinates of the reference points Ms1 and Ms2 in the coordinate system of the reference image RIb included in the coordinate information into coordinates in the coordinate system of the target image SIb. For example, the coordinates of the arbitrary marks Ma and Mb in the coordinate system of the reference image RIb have already been acquired from the database DB in S320C. Then, in S320B of FIG. 10, the arbitrary marks Ma and Mb have already been detected in the target image SIb. To this end, the CPU 310 calculates a transformation matrix that transforms the coordinates in the coordinate system of the reference image RIb into the coordinates in the coordinate system of the target image SIb based on the coordinates of the arbitrary marks Ma and Mb in the coordinate system of the reference image RIb and the coordinates of the arbitrary marks Ma and Mb in the target image SIb. The CPU 310 uses the transformation matrix to transform the coordinates of the reference points Ms1 and Ms2 in the coordinate system of the reference image RIb into coordinates in the coordinate system of the target image SIb.

[0097] At this point, two types of coordinates have been calculated: the coordinates of reference points Ms1 and Ms2 based on angle information (angles a, b, c, d (Figure 8(C)), and the coordinates of reference points Ms1 and Ms2 based on coordinate information. These two types of coordinates both indicate reference points Ms1 and Ms2 in the coordinate system of the target image SIb, and therefore ideally will be the same values. However, for example, there may be cases where the portions of the T-shirt S near the arbitrary marks Ma and Mb are deformed in at least one of the workbench-placed state and the platen-placed state. In this case, the positional relationship of the arbitrary marks Ma and Mb on the T-shirt S may have changed between the workbench-placed state and the platen-placed state. In this case, a difference will occur between the coordinates of reference points Ms1 and Ms2 based on angle information and the coordinates of reference points Ms1 and Ms2 based on coordinate information.

[0098] In S340C, the CPU 310 calculates a difference ΔRV between the coordinates of the reference points Ms1 and Ms2 based on the angle information and the coordinates of the reference points Ms1 and Ms2 based on the coordinate information. For example, ΔRV is the sum of the Euclidean distance ΔD1 between the first reference point Ms1 based on the angle information and the first reference point Ms1 based on the coordinate information, and the Euclidean distance ΔD2 between the second reference point Ms2 based on the angle information and the second reference point Ms2 based on the coordinate information (ΔRV=ΔD1+ΔD2).

[0099] In S350C, CPU 310 determines whether calculated difference ΔRV is equal to or smaller than threshold value THd, which is a value determined experimentally in advance.

[0100] If the difference ΔRV is greater than the threshold value THd (S350C: NO), the CPU 310 displays an error notification (not shown) on the display unit 370 in S355C and suspends the print-related processing. The error notification may include, for example, a message indicating that the T-shirt S is deformed and printing is not possible. In this case, for example, the operator may restart the printed T-shirt manufacturing process, starting from the step of placing the T-shirt S on the platen 142 in S130 of FIG. 3.

[0101] If the difference ΔRV is equal to or smaller than the threshold value THd (S350C: YES), the CPU 310 proceeds to S360B. The processes from S360B onwards in Fig. 12, i.e., the processes of S360B-S390B, are the same as the processes of the same reference numerals in Fig. 10 (the processes of S360B-S390B in Fig. 10), and therefore description thereof will be omitted.

[0102] According to the third embodiment described above, the positional relationship information recorded in the database DB includes angle information and coordinate information (FIG. 9). The CPU 310 calculates the coordinates of the reference points Ms1 and Ms2 using the angle information, i.e., specifies a first positional relationship of the T-shirt S with respect to the platen 142 (S310C in FIG. 12). The CPU 310 calculates the coordinates of the reference points Ms1 and Ms2 using the coordinate information, i.e., specifies a second positional relationship of the T-shirt S with respect to the platen 142 (S320C, S330C in FIG. 12). If the difference between the first positional relationship specified using the angle information and the second positional relationship specified using the coordinate information is greater than a reference value (e.g., threshold value THd) (NO in S350C in FIG. 12), the CPU 310 notifies the user of an error (S380B in FIG. 12).

[0103] For example, a fabric product such as a T-shirt S is made of a soft material and is therefore prone to deformation when placed on a platen. If the vicinity of the arbitrary marks Ma and Mb is deformed when placed on a platen, there is a high possibility that an image will not be printed properly. For example, if the vicinity of the arbitrary marks Ma and Mb is deformed when placed on a platen and the positional relationship between the arbitrary marks Ma and Mb (the distance between the two arbitrary marks Ma and Mb) fluctuates, the difference between the first positional relationship determined using the angle information and the second positional relationship determined using the coordinate information is likely to become large. According to this embodiment, if the difference between the first positional relationship determined using the angle information and the second positional relationship determined using the coordinate information is greater than a reference value, an error notification is issued, thereby preventing improper printing.

[0104] As can be seen from the above explanation, the angle information in this embodiment is an example of the first information, and the coordinate information is an example of the second information.

[0105] D. Fourth Example FIG. 13 is an explanatory diagram of a reference image and a target image in the fourth embodiment. FIG. 13(A) shows a T-shirt S placed on a workbench. In the first embodiment, in step S115 of FIG. 3, the worker uses a chalk pen 500 to add two arbitrary marks Ma and Mb and one reference mark Mr. Instead, in the fourth embodiment, as shown in FIG. 13(A), the worker adds two reference line marks Mla and Mlb on the reference line L1. For example, in this embodiment, the worker folds the T-shirt S so that the left and right sleeves and left and right side seams of the T-shirt S are perfectly aligned, thereby forming a crease at the position of the reference line L1 of the T-shirt S. The worker adds marks at two points on the crease (reference line L1) and located on the platen support portion PA. FIG. 13(A) shows the two reference line marks Mla and Mlb thus added.

[0106] In the fourth embodiment, the contents of the positional relationship information acquisition process of S125 in Fig. 3 and the print-related process of S135 in Fig. 3 are also different from those of the first embodiment. The other configurations of the fourth embodiment are the same as those of the first embodiment.

[0107] First, the positional relationship information acquisition process of the fourth embodiment will be described. Fig. 14 is a flowchart of the positional relationship information acquisition process of the fourth embodiment. In S210D, similar to S210 in Fig. 6, CPU 310 acquires a reference image RId showing T-shirt S by using first camera 400a to capture an image of T-shirt S placed on workbench 600.

[0108] An example of the reference image RId of the fourth embodiment is shown in Fig. 13(B). The reference image RId includes an image of the entire T-shirt S. Unlike the first embodiment, the vertical direction of the reference image RId (the Y direction in Fig. 13(B)) does not need to strictly match the length direction of the T-shirt S, and may be misaligned. In the example of Fig. 13(B), the length direction of the T-shirt S is slightly tilted with respect to the vertical direction of the reference image RId.

[0109] In S220D, CPU 310 detects two reference line marks Mla and Mlb included in reference image RId. The method for detecting reference line marks Mla and Mlb is the same as the method for detecting three marks Ma, Mb, and Mr in S220 of FIG. 6 in the first embodiment. In the fourth embodiment, since only two reference line marks Mla and Mlb exist, only the two reference line marks Mla and Mlb are detected.

[0110] In S230D, the CPU 310 specifies a straight line passing through the points where the two reference line marks Mla and Mlb are located as the reference line L1 (FIG. 13(B)).

[0111] In S240D, the CPU 310 identifies the intersection of the identified reference line L1 and the edge EG of the neckline NL as the reference point Ms. For example, the T-shirt S is placed at a predetermined position on the workbench 600 and photographed by the first camera 400a, whose position relative to the workbench 600 is fixed. Therefore, the approximate position of the neckline NL in the reference image RId is determined. For example, the neckline NL is located within a predetermined area EAd near the center of the upper side of the reference image RId (FIG. 13B). For example, the CPU 310 performs a known edge detection process, such as a canny function, on the image within the area EAd to generate an edge image showing the edges within the area EAd. The CPU 310 performs a known process, such as pattern matching, on the edge image to detect arc-shaped edges EG in the edge image. As a result, for example, three arc-shaped edges EG are detected within the area EAd (FIG. 13B). The CPU 310 identifies the lowest point among the intersections of the detected edge EG and the reference line L1 as the reference point Ms.

[0112] In S250D, the distance DL between the upper reference line mark Mla of the two reference line marks Mla and Mlb and the reference point Ms is calculated (FIG. 13(B)).

[0113] In S260D, CPU 310 records calculated distance DL as positional relationship information in database DB. When the positional relationship information is recorded in database DB, the positional relationship information acquisition process ends.

[0114] Next, the print-related processing of the fourth embodiment will be described with reference to Fig. 15, which is a flowchart of the print-related processing of the fourth embodiment.

[0115] In S310D, similar to S310 in Fig. 7, the CPU 310 acquires a target image SId showing the T-shirt S using the second camera 400b. Fig. 13(D) shows an example of the target image SId. The target image SId is an image obtained by photographing the T-shirt S placed on the platen as shown in Fig. 13(C). The target image SId includes two reference line marks Mla and Mlb.

[0116] In S320D, the CPU 310 detects two reference line marks Mla and Mlb included in the target image SId. The method for detecting the two reference line marks Mla and Mlb is the same as the method for detecting the two arbitrary marks Ma and Mb in S320 of FIG. 7, for example.

[0117] In S330D, the CPU 310 specifies a straight line passing through the points where the two reference line marks Mla and Mlb are located as the reference line L1 (FIG. 13(D)).

[0118] In S340D, CPU 310 acquires the positional relationship information (distance DL) recorded in S260D of the positional relationship information acquisition process (FIG. 14) from database DB.

[0119] In S350D, the CPU 310 calculates the coordinates of the reference point Ms on the reference line L1 in the coordinate system of the target image SId using the acquired distance DL. Specifically, as shown in Fig. 13(D), the CPU 310 calculates the coordinates of the point on the reference line L1 that is the distance DL above the reference line mark Mla as the coordinates of the reference point Ms.

[0120] Once the coordinates of the reference point Ms are calculated, the CPU 310 proceeds to S360. The processes from S360 onwards in Fig. 15, i.e., the processes of S360-S390, are the same as the processes of the same reference numerals in Fig. 7 (the processes of S360-S390 in Fig. 7), and therefore description thereof will be omitted.

[0121] According to the fourth embodiment described above, multiple reference line marks Mla, Mlb are added to the reference line L1 at the platen support portion PA of the T-shirt S that is supported by the platen 142 (FIG. 13(A)). As a result, in the positional relationship information acquisition process (FIG. 14), the necessary positional relationship information (distance DL) can be calculated and recorded in the database DB with simpler processing than in the first to third embodiments. Furthermore, by using the distance DL in the print-related process (FIG. 14), the positional relationship of the T-shirt S with respect to the platen 142 (specifically, the reference point Ms and the reference line L1) can be identified with simpler processing than in the first to third embodiments.

[0122] E. Fifth Example In the positional relationship information acquisition process of the fourth embodiment (FIG. 14), the CPU 310 acquires a reference image RId and analyzes the reference image RId to acquire positional relationship information (distance DL) (S210-S250D in FIG. 14). In the positional relationship information acquisition process of the fifth embodiment, the positional relationship information (distance DL) is acquired without using the reference image RId. Other configurations of the fifth embodiment are the same as those of the fourth embodiment.

[0123] FIG. 16 is a flowchart of the positional relationship information acquisition process of the fifth embodiment. In S250E, the CPU 310 displays an input screen and acquires the distance DL from the worker. Specifically, the CPU 310 displays an input screen (not shown) on the display unit 370 for receiving input of the distance DL. The worker identifies the reference point Ms, which is the intersection of the seam of the neckline and the reference line L1 (fold) on the T-shirt S (FIG. 13(A)) after adding the two reference line marks Mla and Mlb. The worker measures the distance DL between the reference line mark Mla and the reference point Ms using, for example, a ruler or a tape measure. The worker operates the operation unit 360 to input the measured distance DL into the input screen. The CPU 310 acquires the distance DL input into the input screen.

[0124] In S260E, CPU 310 records the acquired distance DL as positional relationship information in database DB, similarly to S260D in Fig. 14. When the positional relationship information (distance DL) is recorded in database DB, the positional relationship information acquisition process ends.

[0125] According to the fifth embodiment described above, the CPU 310 records in the database DB positional relationship information (distance DL) indicating the positional relationship between the reference point Ms on the T-shirt S and the reference line marks Mla and Mlb when the T-shirt S is placed on the work table (S260E in FIG. 16). The multiple reference line marks Mla and Mlb are positioned on the platen support portion PA of the T-shirt S and are added on the reference line L1 (FIG. 13A). The reference line L1 is a line that passes through the reference point Ms and extends in the reference direction (FIG. 13A). The CPU 310 acquires a target image SId obtained by photographing the T-shirt S when placed on the platen (S310D in FIG. 15). CPU 310 uses the positions of multiple reference line marks Mla, Mlb in target image SId and positional relationship information (distance DL) to determine the positional relationship of the T-shirt S with respect to platen 142 of printer 200 when the platen is placed (specifically, the coordinates of reference point Ms and reference line L1) (330D, S350D in FIG. 15). CPU 310 sets print area IA with respect to platen 142 according to the positional relationship of the T-shirt S with respect to platen 142 (specifically, the coordinates of reference point Ms and reference line L1) (S360 in FIG. 15), and generates print data to print in print area IA (S385 in FIG. 15). Printer 100 then prints a specific image on the T-shirt S using the print data (S390 in FIG. 15). In this way, the positional relationship of the T-shirt S with respect to the platen 142 in the platen-placed state is identified using the positions of the multiple reference line marks Mla, Mlb in the target image SId obtained by photographing the T-shirt S with the platen placed on it, and the positional relationship information (distance DL), so the positional relationship of the T-shirt S with respect to the platen 142 in the platen-placed state can be identified with high accuracy. As a result, a specific image can be printed with high accuracy on the T-shirt S. Ultimately, it is possible to manufacture printed T-shirts S with a specific image printed with high accuracy.

[0126] F. Variations (1) In the printing-related processing of each of the above embodiments (for example, FIG. 7), after the positional relationship of the T-shirt S with respect to the platen 142 (the coordinates of the reference point Ms and the reference line L1) is identified, the processing of S360 and S385 of FIG. 7 is executed as pre-processing for printing (S390 of FIG. 7). That is, in each of the above embodiments, as pre-processing, a print area IA is set (S360 of FIG. 7) according to the positional relationship of the T-shirt S with respect to the platen 142, and print data is generated to print in the print area IA (S385 of FIG. 7). This is not limiting, and various pre-processing operations may be executed to print a specific image on the T-shirt S with high accuracy.

[0127] Fig. 17 is an explanatory diagram of a modified example. Fig. 17 shows the platen 142, a T-shirt S placed on the platen, the print area IA set in S360, and the default print area DPA. The default print area DPA is the area on the platen 142 where a specific image is printed when printing using print data prepared in advance, for example.

[0128] For example, the preprocessing in the modified example may be processing that sets a print area IA and moves the platen 142 so that the print area IA coincides with the default print area DPA. In this case, for example, the platen 142 is configured to be able to translate in the X and Y directions and rotate around the Z direction as the axis of rotation using the power of a motor. The CPU 310 may calculate the amount of rotation and translation based on, for example, the reference point Ms and the reference line L1, and move the platen 142 accordingly. In this case, in S390 of FIG. 7, printing may be performed using print data prepared in advance.

[0129] Note that the print area is determined by the relative positional relationship between the platen 142 and the print head 110, so the preprocessing may be a process of moving the print head 110 and the main scanning unit 130 so that the print area IA coincides with the default print area DPA. In this case, the print head 110 and the main scanning unit 130 as a whole are configured to be able to move in parallel and rotational motion using the power of a motor.

[0130] Furthermore, the pre-processing may be processing for having the worker adjust the position of the T-shirt S relative to the platen 142. For example, the CPU 310 may execute processing for displaying instruction marks RMa and RMb ( FIG. 17 ) that instruct the worker on the positions where the arbitrary marks Ma and Mb should be positioned when the T-shirt S is positioned so that the print area IA and the default print area DPA coincide. For example, the instruction marks RMa and RMb may be displayed on the T-shirt S placed on the platen using, for example, a laser marker or a projector, under the control of the CPU 310. Alternatively, the instruction marks RMa and RMb may be superimposed on a target image SI showing the T-shirt S placed on the platen and displayed on the display unit 370. Alternatively, the instruction marks RMa and RMb may be superimposed on the T-shirt S placed on the platen, which is displayed on the display unit of VR goggles worn by the worker.

[0131] (2) The positional relationship information used in each of the above embodiments is merely an example and is not limited to this. For example, the positional relationship information in the first embodiment is angles α, β, and θ. Instead of angles α and β, the lengths of each side of a triangle with the three marks Ma, Mb, and Ms as vertices may be used as the positional relationship information. In this case, in the positional relationship information acquisition process, the CPU 310 records the lengths of each side of the triangle and the angle θ in the database DB. In the printing-related process, the CPU 310 calculates the coordinates of the reference point Ms in the coordinate system of the target image SI using the lengths of each side of the triangle and the positions of the arbitrary marks Ma and Mb detected in the target image SI.

[0132] Similarly, in the positional relationship information of the second embodiment, instead of angles a, b, c, and d, the length of each side of a triangle having vertices at two arbitrary marks Ma, Mb and the first reference point Ms1, and the length of each side of a triangle having vertices at two arbitrary marks Ma, Mb and the second reference point Ms2 may be used as the positional relationship information.

[0133] Generally, in the first embodiment, it is sufficient to adopt positional relationship information that allows the coordinates of the reference point Ms in the coordinate system of the target image SI to be calculated using the positions of the arbitrary marks Ma and Mb detected in the target image SI and the positional relationship information. In the second embodiment, it is sufficient to adopt positional relationship information that allows the coordinates of the first reference point Ms1 and the second reference point Ms2 in the coordinate system of the target image SI to be calculated using the positions of the arbitrary marks Ma and Mb detected in the target image SI and the positional relationship information.

[0134] (3) In the print-related processing of the third embodiment, if the difference between two positional relationships (specifically, the coordinates of reference points Ms1 and Ms2) calculated using the angle information and coordinate information recorded as positional relationship information exceeds a certain threshold, an error notification is issued (S310C-S355 in FIG. 12). In addition to or instead of this, the coordinates of reference points Ms1 and Ms2 may be calculated using other information. For example, the lengths of each side of the triangle with the two arbitrary marks Ma and Mb and the first reference point Ms1 as vertices and the lengths of each side of the triangle with the two arbitrary marks Ma and Mb and the second reference point Ms2 as vertices may be recorded as positional relationship information. In this case, the CPU 310 may calculate the coordinates of reference points Ms1 and Ms2 using these side lengths. Even in this case, if the difference between the coordinates of the reference points Ms1 and Ms2 calculated using the lengths of these sides and the coordinates of the reference points Ms1 and Ms2 calculated using other information is greater than the standard, it is preferable to issue an error notification.

[0135] Alternatively, for example, the CPU 310 may calculate the lengths of the sides of two triangles formed by the reference points Ms1 and Ms2 calculated using the angle information and the arbitrary marks Ma and Mb detected in the target image SIc. The CPU 310 may then compare the calculated lengths of the sides of the triangle with the lengths of the sides of the triangle recorded as the positional relationship information. If the difference between the calculated lengths of the sides of the triangle and the lengths of the sides of the triangle recorded as the positional relationship information is greater than a reference value, it is preferable to issue an error notification.

[0136] (4) In the above embodiment, a T-shirt S is used as the printing substrate, but this is not limiting. For example, a type of clothing other than a T-shirt S, such as a collared shirt such as a dress shirt, or a jacket may be used as the printing substrate.

[0137] The printing substrate is not limited to clothing, and an image may be printed on the brim of a hat. In this case, for example, the joining line between the brim and the main body may be used as the reference line, or the arc-shaped outer edge of the brim may be used as the reference line. Also, a predetermined point located on the reference line (for example, the circumferential center point of the arc-shaped outer edge) may be used as the reference point.

[0138] Alternatively, an image may be printed on the outer surface of a shoe using the shoe as the printing substrate. In this case, for example, the boundary line between the bottom and side of the shoe may be used as the reference line. Alternatively, the center of the hole through which the shoelace is threaded may be used as the reference point. Images may also be printed on a bag such as a tote bag, a storage case such as a wallet, or a handkerchief using the printing substrate.

[0139] In general, various products made from cloth materials or leather materials, including the products exemplified above, are preferably used as the printing substrate.

[0140] (5) In the first embodiment described above, the reference image RI is captured so as to include the entire T-shirt S. Alternatively, the reference image RI may include a portion of the T-shirt S that includes the three marks Ma, Mb, and Ms, and may not include the entire T-shirt S. In the first embodiment, the target image SI is captured so as to include the platen support portion PA of the T-shirt S, but not the edges. Alternatively, the target image SI may include the entire T-shirt S. For example, the target image SI may include the portion of the T-shirt S where the reference point Ms is located. In general, it is preferable that the reference image include at least a portion necessary for analysis in the positional relationship information acquisition process. Furthermore, it is preferable that the target image include at least a portion to which the marks to be detected (e.g., the arbitrary marks Ma and Mb) are added. The same applies to the other embodiments.

[0141] (6) In each of the above embodiments, when the T-shirt S is placed on the platen, only the center of the T-shirt S is supported by the platen 142, and the edges of the T-shirt S are not supported by the platen 142. This is not limiting, and for example, if the platen 142 is sufficiently large relative to the printing material, such as the T-shirt S, the entire printing material may be supported by the platen 142.

[0142] (7) In the fifth embodiment, the distance DL, which is positional relationship information, is input to the terminal device 300 by the worker each time printing is performed on the T-shirt S (S250E in FIG. 16). Alternatively, the distance DL may be a fixed value pre-stored in the memory of the terminal device 300 (e.g., the non-volatile storage device 320). In this case, for example, when adding the reference line marks Mla and Mlb to the T-shirt S, the worker precisely measures the distance from the reference point Ms of the T-shirt S to the reference line mark Mla so that it becomes the fixed value distance DL, and then adds the reference line mark Mla.

[0143] (8) The device that executes all or part of the positional relationship information acquisition process and the print-related process in each embodiment may be various other devices instead of the terminal device 300. For example, the CPU 210 of the printer 200 or the CPU of the cameras 400a and 400b may execute the positional relationship information acquisition process and the print-related process. In this case, the terminal device 300 is not required. Furthermore, the device that executes the positional relationship information acquisition process and the print-related process may be a server connected to at least one of the printer 200, the terminal device 300, and the cameras 400a and 400b via the Internet. In this case, the server may be a so-called cloud server composed of multiple computers that can communicate with each other.

[0144] (9) In each of the above embodiments, part of the configuration realized by hardware may be replaced by software, and conversely, part or all of the configuration realized by software may be replaced by hardware.

[0145] Furthermore, when some or all of the functions of the present invention are realized by a computer program, the program can be provided in a form stored on a computer-readable recording medium (e.g., a non-transitory recording medium). The program can be used while stored on the same or a different recording medium (computer-readable recording medium) from when it was provided. The "computer-readable recording medium" is not limited to portable recording media such as memory cards and CD-ROMs, but can also include internal storage devices within a computer, such as various ROMs, and external storage devices connected to a computer, such as a hard disk drive.

[0146] The present invention has been described above based on examples and modifications, but the above-described embodiments of the invention are intended to facilitate understanding of the present invention and are not intended to limit the present invention. The present invention may be modified or improved without departing from the spirit of the invention, and equivalents thereof are also included within the scope of the present invention. [Explanation of symbols]

[0147] 1000...printing system, 100...printing mechanism, 100...printer, 110...print head, 120...head drive unit, 130...main scanning unit, 140...conveying unit, 142...platen, 144...tray, 200...printer, 201...casing, 210...CPU, 220...nonvolatile storage device, 230...volatile storage device, 231...buffer area, 260...operation unit, 270...display unit, 280...communication unit, 300...terminal device, 310...CPU, 320...nonvolatile storage device, 33 0...volatile storage device, 331...buffer area, 360...operation unit, 370...display unit, 380...communication unit, 400a...first camera, 400b...second camera, 500...charcoal pen, 600...work table, DB...database, Ma, Mb...arbitrary mark, Mr...reference mark, Mla, Mlb...reference line mark, Ms, Ms1, Ms2...reference point, PG1, PG2...computer program, RI, RIb, RId...reference image, SI, SIb, SIc, SId...target image,

Claims

1. A computer program comprising: a reference image acquisition function that acquires a reference image obtained by photographing a printing substrate to which a plurality of marks have been added in a second state different from a first state in which the printing substrate is placed in a printing device, the reference image showing at least the portion of the printing substrate to which the plurality of marks have been added; a target image acquisition function that acquires a target image obtained by photographing the printing substrate again in the first state, the target image showing at least a portion of the printing substrate to which the plurality of marks are added; a pre-processing execution function that executes pre-processing according to the positional relationship of the printing substrate with respect to the printing device in the first state using the positions of the plurality of marks in the target image and the positional relationship of the plurality of points in the reference image, the plurality of points in the reference image being points on the printing substrate including points at which the plurality of marks are located; a print execution function of printing a specific image on the printing substrate after the pre-processing; A computer program comprising:

2. 2. The computer program of claim 1, the positional relationship of the plurality of points in the reference image includes a positional relationship between points at which the plurality of marks are located and a reference point on the printing substrate; A computer program, wherein the reference point is a point for defining a position on the printing substrate where the specific image is to be printed.

3. 3. A computer program according to claim 2, comprising: the first state is a state in which the printing substrate is supported by a specific member for holding the printing substrate, A computer program, wherein the plurality of marks are located in a portion of the printing substrate that is supported by the specific member in the first state.

4. 4. A computer program according to claim 3, comprising: the reference point is located in a portion of the printing substrate that is not supported by the specific member in the first state; A computer program in which the target image does not include an image of the portion of the printing substrate where the reference point is located.

5. 4. A computer program according to claim 3, comprising: A computer program that adds the plurality of marks to any position in a portion of the printing substrate that is supported by the specific member.

6. 4. A computer program according to claim 3, comprising: the plurality of marks are added on a reference line in a portion of the printing substrate that is supported by the specific member; the reference line is a line that passes through the reference point and extends in a reference direction, The computer program product, wherein the reference direction indicates an orientation of the specific image to be printed relative to the substrate.

7. 3. A computer program according to claim 2, comprising: the printing substrate is a garment having a neckline, The computer program, wherein the reference point is a point located along the neckline.

8. 3. The computer program of claim 2, further comprising: causing a computer to realize a reference point determination function for determining the reference point by analyzing the reference image; A computer program, wherein the positional relationship of the multiple points in the reference image includes the positional relationship between the reference points determined by analyzing the reference image and points at which the multiple marks are located.

9. 2. The computer program of claim 1, the positional relationship of the plurality of points in the reference image includes a positional relationship between points at which the plurality of marks are located and a reference direction on the printing substrate; The computer program product, wherein the reference direction indicates an orientation of the specific image to be printed relative to the substrate.

10. 10. A computer program according to claim 9, comprising: the positional relationship of the plurality of points in the reference image includes a positional relationship between points at which the plurality of marks are located and a first point and a second point on the printing substrate; The first point and the second point are determined such that a direction from the first point to the second point becomes the reference direction.

11. 10. A computer program according to claim 9, comprising: a reference direction determination function for determining the reference direction by analyzing the reference image; A computer program, wherein the positional relationship of multiple points in the reference image includes the positional relationship between the reference direction identified by analyzing the reference image and the points at which the multiple marks are located.

12. 2. The computer program of claim 1, the information indicating the positional relationship of the plurality of points in the reference image includes first information and second information; the specifying function specifies a first positional relationship of the printing substrate with respect to the printing device using the first information, and specifies a second positional relationship of the printing substrate with respect to the printing device using the second information; The computer program further comprises: a computer program that causes a computer to realize an error notification function of notifying a user of an error when a difference between the first positional relationship and the second positional relationship is greater than a reference value;

13. A computer program comprising: a recording function for recording in a memory positional relationship information indicating a positional relationship of a plurality of points on the printing substrate in a second state different from a first state in which the printing substrate is placed in a printing device, the plurality of points being points on the printing substrate including points at which a plurality of marks added to the printing substrate are located, the positional relationship on the printing substrate including a positional relationship between the points at which the plurality of marks are located and a reference point on the printing substrate, the reference point being a point for defining a position on the printing substrate at which the specific image is to be printed, the first state being a state in which the printing substrate is supported by a specific member for holding the printing substrate, the plurality of marks being located on a portion of the printing substrate that is supported by the specific member in the first state and being added on a reference line, the reference line being a line that passes through the reference point and extends in a reference direction, and the reference direction indicating a direction of the specific image to be printed relative to the printing substrate; a target image acquisition function that acquires a target image obtained by photographing the printing substrate in the first state, the target image showing at least a portion of the printing substrate to which the plurality of marks are added; a pre-processing execution function that executes pre-processing according to the positional relationship of the printing substrate with respect to the printing device in the first state using the positions of the plurality of marks in the target image and the positional relationship information; a print execution function of printing a specific image on the printing substrate after the pre-processing; A computer program comprising:

14. A method for manufacturing a printed product made using a cloth or leather material, comprising: a reference image acquisition step of acquiring a reference image obtained by photographing the product to which a plurality of marks have been added in a second state different from a first state in which the product is placed in a printing device before printing, the reference image showing at least the portion of the product to which the plurality of marks have been added; a target image acquisition step of acquiring a target image obtained by photographing the product again in the first state, the target image showing at least a portion of the product to which the plurality of marks are added; a pre-processing execution step of executing pre-processing according to a positional relationship of the product with respect to the printing device in the first state using positions of the plurality of marks in the target image and a positional relationship of a plurality of points in the reference image, the plurality of points in the reference image being points on the product including points at which the plurality of marks are located; a printing step of printing a specific image on the product after the pre-processing; A method for producing a printed product, comprising:

Images