Non-transitory computer-readable storage medium and printing system

Abstract

To provide a configuration capable of acquiring a highly reliable imaging result of a test pattern.SOLUTION: The determination function determines whether or not an imaging condition for causing the imaging unit to execute imaging of the imaging target region including the test pattern is satisfied. The imaging control function acquires a captured image by causing the imaging unit to execute imaging of the imaging target region with satisfaction of the imaging condition as a trigger. The imaging condition is a condition in which at least one basic condition of a first condition that a change amount of a relative positional relationship between the imaging unit and a medium is equal to or less than a reference change amount and a second condition that a distortion amount indicating distortion of the test pattern included in a frame repeatedly acquired from the imaging unit is equal to or less than a reference distortion amount is continuously satisfied for a predetermined time or more. The determination function determines that the imaging condition is satisfied when at least the basic condition is continuously satisfied for the predetermined time or more.SELECTED DRAWING: Figure 5

Description

[Technical Field]

[0001] The present invention relates to an imaging control program for imaging a medium having a test pattern for adjusting print characteristics, and a printing system. [Background technology]

[0002] 2. Description of the Related Art Test patterns for adjusting the printing characteristics of printing devices such as inkjet printers are read by scanners. Patent Document 1 discloses a print correction method that generates print correction data by photographing a print correction test pattern printed by a printer with a digital camera. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2006-121486 Summary of the Invention [Problem to be solved by the invention]

[0004] In order to obtain appropriate imaging results for the test pattern in a user's environment, various problems may arise. For example, when a user takes a picture while holding a camera-equipped mobile terminal such as a smartphone in their hand, camera shake may occur. However, due to processing reasons, many camera-equipped mobile terminals have a time lag between when the image capture button is pressed and when the captured image is acquired. Therefore, even if there is no camera shake when the image capture button is pressed, camera shake may occur when the image is actually captured, resulting in a camera-shake-infused captured image. Furthermore, even with an imaging device with a small time lag, such as a digital camera, if a user takes an image while holding a medium with a test pattern in their hand toward a fixed imaging device, the medium may be distorted, such as flexed. As a result, the medium may be distorted at the time of image capture, resulting in a distorted captured image. In either case, highly reliable imaging results of the test pattern cannot be obtained. [Means for solving the problem]

[0005] An imaging control program according to the present invention is an imaging control program for imaging a medium having a test pattern for adjusting printing characteristics of a printing device equipped with a recording head, the program comprising: a determination function for determining whether or not an imaging condition for causing an imaging unit to capture an image of an imaging target area including the test pattern is satisfied; an imaging control function of acquiring a captured image by causing the imaging unit to capture an image of the imaging target area when the imaging condition is satisfied; The imaging condition is a condition in which at least one of the following basic conditions continues to be satisfied for a predetermined time or longer: a first condition that a change amount in the relative positional relationship between the imaging unit and the medium is equal to or less than a reference change amount; and a second condition that a distortion amount indicating distortion of the test pattern included in frames repeatedly acquired from the imaging unit is equal to or less than a reference distortion amount. The determination function is When determining whether the first condition is satisfied, the amount of change is repeatedly acquired, and whether the first condition is satisfied is determined based on the acquired amount of change; When determining whether the second condition is satisfied, determining whether the second condition is satisfied based on a shape of the test pattern included in the frame; The imaging condition is determined to be satisfied when at least the basic condition continues to be satisfied for the predetermined time or longer.

[0006] A printing system of the present invention is a printing system including a printing device including a recording head, and an information terminal that captures an image of a medium having a test pattern for adjusting the printing characteristics of the printing device, The information terminal An imaging unit; a control unit including a memory for storing an image obtained from the imaging unit, and causing the imaging unit to capture an image of an imaging target area including the test pattern; the control unit determines whether or not an imaging condition for causing the imaging unit to capture an image of the imaging target area is satisfied, and acquires the captured image by causing the imaging unit to capture an image of the imaging target area using the satisfaction of the imaging condition as a trigger; The imaging condition is a condition in which at least one of the following basic conditions continues to be satisfied for a predetermined time or longer: a first condition that a change amount in the relative positional relationship between the imaging unit and the medium is equal to or less than a reference change amount; and a second condition that a distortion amount indicating distortion of the test pattern included in frames repeatedly acquired from the imaging unit is equal to or less than a reference distortion amount. The control unit When determining whether the first condition is satisfied, the amount of change is repeatedly acquired, and whether the first condition is satisfied is determined based on the acquired amount of change; When determining whether the second condition is satisfied, determining whether the second condition is satisfied based on a shape of the test pattern included in the frame; The imaging condition is determined to be satisfied when at least the basic condition continues to be satisfied for the predetermined time or longer. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 is a diagram schematically illustrating an example of a printing system. [Figure 2] FIG. 1 is a diagram schematically illustrating an example of the configuration of a printing system. [Figure 3] FIG. 10 is a diagram schematically illustrating an example of a medium having a test pattern. [Figure 4]FIG. 10 is a diagram schematically illustrating an example of the operation of an information terminal during imaging. [Figure 5] 10 is a flowchart schematically illustrating an example of an imaging control process. [Figure 6] 10A and 10B are diagrams illustrating examples of whether or not a first condition, that is, the amount of change in the relative positional relationship between the imaging unit and the medium is equal to or less than a reference amount of change, is satisfied. [Figure 7] 10A and 10B are diagrams illustrating examples of whether a second condition, that is, the distortion amount of a test pattern included in a frame is equal to or less than a reference distortion amount, is satisfied. [Figure 8] 10A and 10B are diagrams illustrating examples of whether or not a third condition is satisfied in which the imaging target area is included in the angle of view of the imaging unit. [Figure 9] 10A and 10B are diagrams illustrating examples of whether a fourth condition, that is, the imaging unit is within a predetermined range of direct facing relative to the imaging target area, is satisfied. [Figure 10] FIG. 10 is a diagram schematically showing an example of whether a fifth condition, that is, the distance between the imaging unit and the medium is equal to or less than a reference distance, is satisfied. [Figure 11] 11A and 11B are diagrams schematically showing examples of whether or not the sixth condition, that is, the brightness amount of the background color of the medium is equal to or greater than the reference brightness amount, is satisfied. [Figure 12] FIG. 10 is a diagram schematically showing an example of criteria for determining imaging conditions. [Figure 13] 5A to 5C are diagrams illustrating examples of adjustment of printing characteristics. [Figure 14] FIG. 10 is a plan view schematically showing another example of a printing system. [Figure 15] 10 is a flowchart schematically illustrating an example of a determination wait time determination process. [Figure 16] 10 is a flowchart schematically illustrating another example of the determination wait time determination process. [Figure 17] FIG. 10 is a diagram illustrating an example of a process for changing criteria for condition determination during a determination waiting time. DETAILED DESCRIPTION OF THE INVENTION

[0008] The following describes embodiments of the present invention. Of course, the following embodiments are merely examples of the present invention, and not all of the features shown in the embodiments are necessarily essential to the solution of the invention.

[0009] (1) Summary of the aspects included in the present invention: First, an overview of the embodiments included in the present invention will be described with reference to the examples shown in Figures 1 to 17. Note that the figures in this application are diagrams showing schematic examples, and the magnifications in each direction shown in these figures may differ, and the figures may not be consistent with each other. Of course, each element of the present embodiment is not limited to the specific example indicated by the symbol. In the "Outline of the embodiments included in the present invention," the words in parentheses indicate supplementary explanations for the immediately preceding words.

[0010] [Aspect 1] 2, 5, etc., an imaging control program PR0 according to one embodiment is an imaging control program PR0 for imaging a medium ME0 having a test pattern TP0 for adjusting the printing characteristics of a printing device 2 equipped with a recording head 220, and causes a computer (e.g., information terminal 1) to realize a determination function FU1 and an imaging control function FU2. The determination function FU1 determines whether or not imaging conditions for causing the imaging unit 120 to capture an imaging target area AR0 including the test pattern TP0 are satisfied. The imaging control function FU2, triggered by the imaging conditions being satisfied, causes the imaging unit 120 to capture an imaging target area AR0, thereby acquiring a captured image IM0. The imaging condition is a condition in which at least one of the following basic conditions continues to be satisfied for a predetermined time TO or more: a first condition (see, for example, FIG. 6 ) that a change amount V in the relative positional relationship between the imaging unit 120 and the medium ME0 is equal to or less than a reference change amount (e.g., a threshold value THV); and a second condition (see, for example, FIG. 7 ) that a distortion amount DS indicating distortion of the test pattern TP0 included in the frame FR0 repeatedly acquired from the imaging unit 120 is equal to or less than a reference distortion amount (e.g., a threshold value THDS). When determining whether the first condition is satisfied, the determination function FU1 repeatedly acquires the change amount V and determines whether the first condition is satisfied based on the acquired change amount V. When determining whether the second condition is satisfied, the determination function FU1 determines whether the second condition is satisfied based on the shape of the test pattern TP0 included in the frame FR0. The determination function FU1 determines that the imaging condition is satisfied if at least the basic condition continues to be satisfied for the predetermined time TO or more.

[0011] As shown in FIG. 1, when an information terminal 1 separate from the printing device 2 is used to capture the test pattern TP0, the captured image IM0 may be blurred. In particular, if there is a time lag between when the user US1 aims the imaging unit 120 at the test pattern TP0 and assumes a position to capture the image and when the captured image IM0 is acquired, blur may occur at the time of actual capture, even if there is no initial blur. As shown in FIG. 14, when the user US1 holds the medium ME0 bearing the test pattern TP0 over the imaging device, the test pattern TP0 may be significantly distorted. If blurring occurs in the captured image IM0 or the test pattern TP0 is significantly distorted, the position and color of the test pattern TP0 will not be captured correctly, making it impossible to obtain a reliable image of the test pattern TP0. This also means that reliable adjustment values ​​(e.g., adjustment values ​​A1 to A3 shown in FIG. 13) cannot be obtained from the test pattern TP0.

[0012] In the above-described first aspect, imaging is triggered by the fact that at least the basic condition has been satisfied for a predetermined time TO or longer. As described above, the basic condition is at least one of the following: a first condition that the change amount V in the relative positional relationship between the imaging unit 120 and the medium ME0 is equal to or less than a reference change amount (THV); and a second condition that the distortion amount DS, which indicates the distortion of the test pattern TP0 included in the frame FR0 repeatedly acquired from the imaging unit 120, is equal to or less than a reference distortion amount (THDS). If the first condition is satisfied for a predetermined time TO or longer, even if there is a time lag between getting into the imaging position and actually acquiring the captured image IM0 of the test pattern TP0, the continued small blur state means that there is a high probability that the blur will remain small even after the time lag has elapsed. Because blur is unlikely to occur at the time of actual imaging, an appropriate captured image of the test pattern can be used to adjust printing characteristics. If imaging is triggered by the fact that at least the second condition has been satisfied for a predetermined time TO or longer, there is a high probability that the distortion of the test pattern TP0 will be small at the time of imaging because the small distortion state of the medium ME0 has continued. By suppressing distortion of the test pattern TP0 at the time of capturing the image, an appropriate captured image of the test pattern can be used to adjust the printing characteristics. As described above, the above aspect can provide an imaging control program that can acquire highly reliable imaging results of a test pattern.

[0013] There are various examples of the above-described aspects. Examples of printing characteristics include the density of the printed image, the landing position of the droplets, the transport amount of the medium, and the droplet ejection state of each nozzle. Examples of test patterns include density patterns for adjusting the density of the printed image, Bi-d adjustment patterns for performing Bi-d adjustment (bidirectional adjustment) to align the landing position of droplets on the forward and return paths, transport amount adjustment patterns for adjusting the transport amount of the medium on which the printed image is formed, and nozzle check patterns that show the droplet ejection status of each nozzle of the recording head. Examples of the imaging target area include the entire medium, an area partitioned by a plurality of position detection patterns, and the like. Acquiring a captured image may involve storing the captured image obtained from the imaging unit in memory, or may involve controlling a DMA (Direct Memory Access) controller to store the captured image in memory, etc. Storing in memory includes storing in RAM (Random Access Memory), storing in non-volatile memory, etc. A frame refers to an image represented by a signal output from an imaging unit for each frame period. Examples of the amount of change in the relative positional relationship between the imaging unit and the medium include the amount of movement of the medium between frames, the speed detected by a speed sensor, and the acceleration detected by an acceleration sensor. In this application, the terms "first", "second", etc. are terms for distinguishing between elements among a plurality of elements having similarities, and do not imply any order. Of course, the above remarks also apply to the following aspects.

[0014] [Aspect 2] The imaging condition may be a condition in which the basic condition and the additional condition are satisfied for a predetermined time period T0 or longer. The additional condition may be at least one of a third condition (see, for example, FIG. 8) in which the imaging target area AR0 is included in the angle of view FA of the imaging unit 120; a fourth condition (see, for example, FIG. 9) in which the imaging unit 120 is within a predetermined range facing the imaging target area AR0; a fifth condition (see, for example, FIG. 10) in which a distance D corresponding to the distance between the imaging unit 120 and the medium ME0 is equal to or less than a reference distance (e.g., a threshold value THD); and a sixth condition (see, for example, FIG. 11) in which a brightness L0 indicating the brightness L of the background color of the medium ME0 is equal to or greater than a reference brightness (e.g., a threshold value THL). The angle of view refers to an imaging range. When determining whether the third condition is satisfied, the determination function FU1 may determine whether the third condition is satisfied based on the frame FR0. When determining whether the fourth condition is satisfied, the determination function FU1 may determine whether the fourth condition is satisfied based on the shape of the imaging target area AR0 included in the frame FR0. When determining whether the fifth condition is satisfied, the determination function FU1 may repeatedly detect the distance D and determine whether the fifth condition is satisfied based on the detected distance D. When determining whether the sixth condition is satisfied, the determination function FU1 may acquire the brightness amount L0 based on the frame FR0 and determine whether the sixth condition is satisfied based on the acquired brightness amount L0. The determination function FU1 may determine that the imaging condition is satisfied when the basic condition and the additional condition continue to be satisfied for the predetermined time T0 or more.

[0015] In the above embodiment, imaging is triggered when the basic condition and the additional condition continue to be satisfied for a predetermined time period T0 or longer. For example, if the imaging range is an unintended range, the position and color of the test pattern TP0 will not be acquired correctly, which will cause the test pattern TP0 to function improperly. If imaging is performed when the third condition is met, a captured image IM0 with an appropriate imaging range will be obtained, and the appropriate test pattern captured image can be used to adjust the printing characteristics. If the imaging unit 120 is not within the range directly facing the test pattern TP0, the resolution of the test pattern TP0 may differ between the side closer to the imaging unit 120 and the side farther from the imaging unit 120, and the adjustment values ​​obtained may differ between the side closer to the imaging unit 120 and the side farther from the imaging unit 120. If imaging is performed when the fourth condition is met, the aforementioned change in adjustment values ​​is suppressed, and a more appropriate captured image of the test pattern can be used to adjust the printing characteristics.

[0016] If the imaging unit 120 is too far from the medium ME0, the resolution of the captured test pattern TP0 will be low, resulting in a large error in the adjustment value. If imaging is performed when the fifth condition is met, the error in the adjustment value described above will be suppressed, and a more appropriate captured image of the test pattern can be used to adjust the printing characteristics. For example, if the captured image IM0 is dark due to the influence of a shadow or the like, the density of the captured test pattern TP0 will be high, and the color, etc. of the test pattern TP0 will not be captured correctly. If an image is captured when the sixth condition above is met, the color, etc. of the test pattern TP0 will be captured correctly, and an appropriate captured test pattern image can be used to adjust the printing characteristics. As a result, the above aspect can provide an imaging control program that can acquire imaging results of a test pattern with higher reliability.

[0017] [Aspect 3] 15, the determination function FU1 may be able to change the predetermined time T0. The determination function FU1 may acquire blur correction correspondence information IN1 indicating whether or not a blur correction function for correcting blur in the captured image IM0 is available, and may set the predetermined time T0 shorter when the blur correction function is available than when the blur correction function is not available, based on the blur correction correspondence information IN1. If the imaging device has a shake correction function, even if shake occurs because the basic conditions are satisfied for a relatively short period of time, the shake is corrected. This makes it possible to obtain highly reliable imaging results for the test pattern TP0 even if the predetermined time T0 is short. Therefore, when the imaging device has a shake correction function, the above aspect can shorten the waiting time and improve usability. Here, the determination function FU1 may acquire the blur correction compatibility information IN1 from the control unit 110 that controls the imaging unit 120, or may acquire the blur correction compatibility information IN1 according to a selection operation by the user US1 via the operation unit 115 as to whether or not the blur correction function is available. Furthermore, the determination function FU1 may acquire the blur correction compatibility information IN1 according to a selection operation by the user US1 via the operation unit 115 as to whether to set the predetermined time T0 to a "short time" or a "long time." In this case, the selection operation of "short time" means the selection operation of the blur correction function, and the selection operation of "long time" means the selection operation of the blur correction function is available, and the selection operation of "long time" means the selection operation of the blur correction function is not available.

[0018] [Aspect 4] 16, the exposure time (also referred to as shutter speed) applied to the imaging unit 120 may be changeable. The determination function FU1 may be able to change the predetermined time T0. The determination function FU1 may acquire exposure time information IN2 indicating the exposure time from the control unit 110 that controls the imaging unit 120, and may set the predetermined time T0 shorter when the exposure time is a second time (e.g., exposure time TE2) shorter than a first time (e.g., exposure time TE1) based on the exposure time information IN2 than when the exposure time is the first time (TE1). If the imaging device is capable of changing the exposure time of the imaging unit 120, a relatively short exposure time reduces the impact of blurring on the captured image IM0, because the duration during which at least the basic conditions are satisfied is relatively short. This allows for highly reliable imaging results of the test pattern TP0 to be obtained. Therefore, the above-described aspect can reduce waiting time and improve usability when the imaging device is capable of changing the exposure time of the imaging unit 120.

[0019] [Aspect 5] As illustrated in FIG. 5, the judgment function FU1 may cause an output unit (e.g., display unit 116) to output information (e.g., shooting standby information IN3) indicating that at least the basic conditions continue to be satisfied. In the above cases, the user can grasp the information (IN3) indicating that at least the basic conditions continue to be satisfied, thereby improving usability. Here, the output unit may be a display unit that displays information, or an audio output unit that outputs information by voice.

[0020] [Aspect 6] 17, the predetermined time T0 may include a first period PT1 and a second period PT2 that follows the first period PT1. When determining whether the first condition is satisfied, the determination function FU1 may set the reference variation (THV) to be applied to the second period PT2 to be smaller than the reference variation (THV) to be applied to the first period PT1. When determining whether the second condition is satisfied, the determination function FU1 may set the reference distortion amount (THDS) to be applied to the second period PT2 to be smaller than the reference distortion amount (THDS) to be applied to the first period PT1. During the period of time during which it is continuously monitored that at least the basic conditions are satisfied, if the reference variation (THV) and the reference distortion (THDS) are relatively small in the second period PT2, which is relatively later, a highly reliable image of the test pattern TP0 can be obtained even if the reference variation (THV) and the reference distortion (THDS) are relatively large in the first period PT1, which is relatively earlier. Therefore, the above-described embodiment can shorten the time required for image capture. Here, the predetermined time may include a third period that follows the second period, etc. The determination function FU1 may set a lower standard to be applied to the third period than to the second period.

[0021] [Aspect 7] 1, 2, and 14, a printing system SY1 according to one embodiment includes a printing device 2 including a recording head 220 and an information terminal 1 that captures an image of a medium ME0 having a test pattern TP0 for adjusting the printing characteristics of the printing device 2. The information terminal 1 includes an imaging unit 120 and a control unit 110 that includes a memory (e.g., RAM 113) for storing a captured image IM0 obtained from the imaging unit 120 and causes the imaging unit 120 to capture an image of an imaging target area AR0 that includes the test pattern TP0. The control unit 110 determines whether imaging conditions for causing the imaging unit 120 to capture an image of the imaging target area AR0 are satisfied, and, when the imaging conditions are satisfied, causes the imaging unit 120 to capture an image of the imaging target area AR0, thereby acquiring the captured image IM0. The imaging condition is a condition in which at least one of the following basic conditions continues to be satisfied for a predetermined time T0 or more: a first condition that a change amount V in the relative positional relationship between the imaging unit 120 and the medium ME0 is equal to or less than a reference change amount (THV); and a second condition that a distortion amount DS indicating distortion of the test pattern TP0 included in frames FR0 repeatedly acquired from the imaging unit 120 is equal to or less than a reference distortion amount (THDS). When determining whether the first condition is satisfied, the control unit 110 repeatedly acquires the change amount V and determines whether the first condition is satisfied based on the acquired change amount V. When determining whether the second condition is satisfied, the control unit 110 determines whether the second condition is satisfied based on the shape of the test pattern TP0 included in the frames FR0. The control unit 110 determines that the imaging condition is satisfied when at least the basic condition continues to be satisfied for the predetermined time T0 or more. The above aspect can provide a printing system that can acquire highly reliable imaging results of test patterns.

[0022] Furthermore, the above-described aspects are applicable to a computer-readable non-transitory medium on which the above-described imaging control program is recorded, the above-described information terminal, a control method for the information terminal, a printing method implemented by the above-described printing system, a control program for the above-described printing system, a computer-readable non-transitory medium on which the control program is recorded, etc. Any of the above-described devices may be composed of multiple distributed parts.

[0023] (2) Example of imaging control program: 1 and 14 schematically illustrate a printing system SY1 including an information terminal 1 and a printing device 2. Fig. 2 schematically illustrates the configuration of the printing system SY1. Fig. 3 schematically illustrates a medium ME0 having a test pattern TP0. Examples of the information terminal 1 shown in FIG. 1 include a mobile phone such as a smartphone, a tablet terminal, etc. The information terminal 1 may be composed of multiple devices separated so as to be able to communicate with each other, or may be a stationary device with an imaging unit removably connected to it. The information terminal 1 may also be a digital camera, as shown in the plan view of FIG. 14. The mobile terminal 1 shown in FIG. 14 is fixed and captures an image of a medium ME0 held by a user US1. The printing device 2 is an inkjet printer equipped with a recording head 220 capable of ejecting droplets 280. Of course, the printing device 2 may also be a thermal printer (including a thermal transfer printer) equipped with a thermal head as a recording head, an electrophotographic printer (e.g., a laser printer) equipped with a recording head that deposits toner on the medium ME0, a 3D printer, or the like. The printing device 2 may also be composed of multiple devices separated so as to be able to communicate with each other. The printing device 2 is capable of forming a print image PI0 on the medium ME0, including a test pattern TP0 for adjusting the printing characteristics of the printing device 2.

[0024] In the printing system SY1 shown in FIG. 1, a user US1 can adjust the printing characteristics of a printing device 2 by capturing a test pattern TP0 with an information terminal 1 equipped with an imaging unit 120. When the user US1 captures the test pattern TP0 while holding the information terminal 1 in his or her hand, camera shake may occur, a portion of the test pattern TP0 may fall outside the field of view (i.e., the imaging range) of the imaging unit 120, the test pattern TP0 may be tilted, the test pattern TP0 may be too far from the imaging unit 120, or the imaging environment may be too dark. In particular, many camera-equipped mobile devices, such as smartphones and tablet devices, experience a time lag between the operation of the imaging button and the acquisition of a captured image IM0 due to processing reasons. Therefore, even if there is no camera shake when the imaging button is operated, camera shake may occur when the image is actually captured. In this case, a camera-shake-affected captured image IM0 is obtained. A test pattern TP0 included in a camera-shake-affected captured image IM0 cannot provide reliable adjustment values ​​A1 to A3 (see FIG. 13 ).

[0025] As shown in FIG. 14, when the information terminal 1 is an imaging device such as a digital camera, the time lag described above is small. However, even with an imaging device with a small time lag, when a user US1 captures an image of the medium ME0 while holding it in their hand over the imaging device, the medium ME0 may bend or otherwise distorted. Because the shape of the medium ME0 may change from moment to moment, the medium ME0 may be distorted at the time of capture, resulting in a distorted captured image IM0. The test pattern TP0 included in the distorted captured image IM0 does not provide reliable adjustment values ​​A1 to A3 (see FIG. 13).

[0026] Therefore, the imaging control program PR0 shown in Fig. 2 is triggered by the satisfaction of an imaging condition, meaning that imaging is possible for a certain period of time, causing the imaging unit 120 to automatically capture an image, thereby enabling the information terminal 1 to capture an appropriate image of the test pattern TP0. For example, if a state in which no camera shake occurs continues for a certain period of time, it is highly likely that no camera shake will occur even after the time lag has elapsed. If a state in which no distortion occurs in the test pattern TP0 continues for a certain period of time, it is highly likely that no distortion occurs in the test pattern TP0 at the time of capture. It can be said that the information terminal 1 executing the imaging control program PR0 realizes an auto-shutter system.

[0027] The communication I / F (interface) 117 of the information terminal 1 is capable of communicating with the communication I / F 230 of the printing device 2. The information terminal 1 is capable of transmitting adjustment values ​​for printing characteristics and the like to the printing device 2 via the communication I / Fs 117 and 230. Upon receiving the adjustment values, the printing device 2 stores the adjustment values ​​and adjusts the printing characteristics based on the adjustment values. Communication via the communication I / Fs 117 and 230 may be wireless communication in accordance with wireless LAN (Local Area Network) standards or the like, wired communication, or even network communication such as the Internet.

[0028] The information terminal 1 shown in FIG. 2 includes a control unit 110, a storage unit 114, an operation unit 115, a display unit 116, a communication I / F 117, and an imaging unit 120. The information terminal 1 may also include sensors SS1 and SS2 connected to the control unit 110. The control unit 110 includes a CPU (Central Processing Unit) 111, which is a processor, a ROM (Read Only Memory) 112, and a RAM (Random Access Memory) 113. The RAM 113 is an example of a memory for storing a captured image IM0 obtained from the imaging unit 120. The control unit 110 may also include an exposure control unit 130 that controls exposure of the imaging unit 120. Some information terminals 1 can release the shutter with a longer exposure time to capture low-light scenes, such as a starry sky, in high image quality. Details of the exposure control unit 130 will be described later.

[0029] The storage unit 114 stores an operating system (OS), application programs, blur correction support information IN1 indicating whether the imaging unit 120 includes a blur correction unit 124, exposure time information IN2 indicating the exposure time, and other information. When the OS receives an instruction to capture an image from the application program, it causes the information terminal 1 to implement a function that causes the imaging unit 120 to capture an image. The time lag described above can also be interpreted as the time lag between receiving an instruction to capture an image from the OS and acquiring the captured image IM0. The application program includes an imaging control program PR0 for capturing an image of a medium ME0 having a test pattern TP0. The blur correction support information IN1 indicates whether a blur correction function for correcting blur in the captured image IM0 is available. The storage unit 114 can be a nonvolatile semiconductor memory such as a flash memory. The storage unit 114 may be detachably attached to the main body of the information terminal 1. The display unit 116 displays a screen corresponding to the display information based on the display information. The display unit 116 can be a liquid crystal display panel or the like. The operation unit 115 may be a touch panel, hard keys, or the like attached to the surface of the display unit 116. The display unit 116 displays a screen corresponding to the display information based on the display information. The display unit 116 is an example of an output unit.

[0030] The imaging control program PR0 causes the information terminal 1 to realize the determination function FU1 and the imaging control function FU2. The CPU 111 performs various processes by appropriately reading information stored in the storage unit 114 into the RAM 113 and executing the read program. The CPU 111 performs processes corresponding to the above-mentioned functions (FU1, FU2) by executing the imaging control program PR0 read into the RAM 113. The information terminal 1 that executes the imaging control program PR0 performs a determination step corresponding to the determination function FU1 and an imaging control step corresponding to the imaging control function FU2. The computer-readable medium that stores the imaging control program PR0 that causes a computer to realize the above-mentioned functions (FU1, FU2) is not limited to the storage unit 114, and may be a recording medium external to the information terminal 1.

[0031] The imaging unit 120 includes a lens 121, an AF (autofocus) unit 122, an image sensor 123, and the like. The image sensor 123 converts an image of light incident via the lens 121 and the AF unit 122 into an electrical signal. The image sensor 123 in this specific example outputs digital data corresponding to the electrical signal of each light receiving element. The digital data is stored in the RAM 113 as a frame FR0 or a captured image IM0. The image sensor 123 may be a CMOS (Complementary Metal-Oxide Semiconductor) image sensor, a CCD (Charge Coupled Devices) image sensor, or the like.

[0032] The imaging unit 120 may also include a known blur correction unit 124 that corrects blur in the captured image IM0. The blur correction unit 124 may perform electronic blur correction by controlling the output range of the image sensor 123, optical blur correction by controlling the movement of a correction lens, or image sensor movement blur correction by controlling the movement of the image sensor 123. The blur correction unit 124 detects blur in the information terminal 1 using a blur sensor such as an acceleration sensor or an angular velocity sensor, and corrects blur in the captured image IM0 by controlling the output range of the image sensor 123 or the movement of a correction lens, etc., in accordance with the detection result. The application program can implement in the information terminal 1 a function of acquiring blur correction support information IN1 from the OS by requesting the OS to output blur correction support information IN1.

[0033] The exposure control unit 130 can change the exposure time applied to the imaging unit 120. The exposure time, also known as shutter speed, refers to the time that light is applied to the image sensor 123 and is expressed as ..., 1 second, 1 / 2 second, 1 / 4 second, 1 / 8 second, 1 / 15 second, .... The shutter used to change the exposure time may be an electronic shutter or a mechanical shutter. If the exposure control unit 130 has an electronic shutter, the exposure control unit 130 controls each light-receiving element of the image sensor 123 so that each light-receiving element performs photoelectric conversion for the set exposure time. Because the image sensor 123 includes many light-receiving elements, the process of generating the captured image IM0 takes time, resulting in a time lag between the start of the imaging process and the generation of the captured image IM0. If the exposure control unit 130 has a mechanical shutter, the exposure control unit 130 controls the operation of the shutter so that light is applied to the image sensor 123 for the set exposure time. The application program can implement a function in the information terminal 1 to acquire exposure time information IN2 from the OS by requesting the OS to output exposure time information IN2.

[0034] The sensors SS1 and SS2 can be used to determine whether the imaging conditions are met. For example, the sensor SS1 may be a speed sensor that measures the moving speed of the imaging unit 120, or an acceleration sensor that measures the acceleration of the imaging unit 120. In this case, the magnitude of blur in the captured image IM0 can be detected based on the measurement value from the sensor SS1. The sensor SS2 may also be a distance sensor that measures the distance from the imaging unit 120 to the medium ME0. In this case, the distance from the imaging unit 120 to the medium ME0 can be detected based on the measurement value from the sensor SS2.

[0035] The printing device 2 ejects C (cyan) ink, M (magenta) ink, Y (yellow) ink, and K (black) ink as color materials from a recording head 220 as droplets 280 to form a print image PI0 corresponding to print data. The recording head 220 has multiple nozzles Nc capable of ejecting C ink droplets onto the medium ME0, multiple nozzles Nm capable of ejecting M ink droplets onto the medium ME0, multiple nozzles Ny capable of ejecting Y ink droplets onto the medium ME0, and multiple nozzles Nk capable of ejecting K ink droplets onto the medium ME0. C, M, Y, and K inks are supplied to the recording head 220 from ink cartridges Cc, Cm, Cy, and Ck, respectively. The recording head 220 ejects C, M, Y, and K droplets 280 from the nozzles Nc, Nm, Ny, and Nk, respectively, under the control of the controller 210. When the droplets 280 land on the medium ME0, ink dots are formed on the medium ME0. The printing device 2 also includes a drive unit that changes the relative positional relationship between the recording head 220 and the medium ME0 under the control of the controller 210, such as a transport unit 225 that transports the medium ME0 in a predetermined transport direction. As a result, a printed matter is obtained having a pattern of ink dots on the medium ME0 as a print image PI0. The material of the medium ME0 is not particularly limited, and may be paper, fabric, resin, metal, or the like. The shape of the medium ME0 may be a two-dimensional cut shape, a roll, or a three-dimensional shape.

[0036] The medium ME0 shown in FIG. 3 has a test pattern TP0 including multiple individual patterns TP1 and multiple position detection patterns MK0. The test pattern TP0 may be a density pattern, a Bi-d adjustment pattern, a conveyance distance adjustment pattern, a nozzle check pattern, or the like. Each position detection pattern MK0 is located at a corner C0 of a rectangle on the medium ME0 that includes the test pattern TP0. When the position detection patterns MK0 are located at the four corners of the rectangle, the imaging target area AR0 including the test pattern TP0 becomes a rectangular area on the medium ME0 with each position detection pattern MK0 at its corner C0. In FIG. 3, the rectangular imaging target area AR0 with vertical sides S1 and S2 and horizontal sides S3 and S4 is indicated by a two-dot chain line. The position detection pattern MK0 may be a square-shaped ArUco marker, a triangular pattern, or the like, that has specific geometric characteristics. If there is no position detection pattern MK0 on the medium ME0, the medium ME0 itself becomes the imaging target area AR0. In this case, the medium ME0 is preferably cut like a cut sheet of paper, and is preferably, but not limited to, rectangular.

[0037] Next, an example of the operation of the information terminal 1 when capturing an image will be described with reference to Fig. 4. Normally, capturing an image is triggered by an operation on a shutter button included in the operation unit 115. Frames FR0 constituting the moving image VD0 are transferred from the image sensor 123 of the imaging unit 120 to the RAM 113 of the control unit 110 for each frame period. At this time, the CPU 111 may store the frames FR0 in the RAM 113, or a DMA controller (not shown) may store the frames FR0 in the RAM 113. Each frame FR0 represents a still image for each frame period, but may also contain information indicating a difference from the previous frame. Due to the processing capacity of the information terminal 1, each frame FR0 has a lower resolution than the captured image IM0. It can also be said that the frame FR0 has fewer pixels than the captured image IM0. The control unit 110 controls the AF unit 122 and the like based on the group of frames FR0. The control unit 110 may display each frame FR0 on the display unit 116.

[0038] When the user US1 presses or touches the shutter button, the operation unit 115 accepts the operation, and the operation unit 115 notifies the control unit 110 that the shutter button has been operated. The control unit 110 then issues an image capture instruction IS1 to the image capture unit 120, causing the image capture unit 120 to capture an image. A captured image IM0 generated by this image capture has a higher resolution than the frame FR0, and is stored in the RAM 113. Here again, the CPU 111 may perform the process of storing the captured image IM0 in the RAM 113, or a DMA controller (not shown) may perform the process of storing the captured image IM0 in the RAM 113. When the user US1 performs an operation to save the captured image IM0, the operation unit 115 accepts the operation and notifies the control unit 110 of a save instruction IS2. The control unit 110 then converts the captured image IM0 into a file FL0 format and saves it in the storage unit 114. That is, the storage unit 114 stores the file FL0. Examples of file formats include the JPEG (Joint Photographic Experts Group) format and bitmap format. The control unit 110 may accept settings such as the file format and the resolution of the captured image IM0 included in the file FL0 via the operation unit 115, and save the file FL0 in accordance with the settings in the storage unit 114. The control unit 110 may also automatically generate a file FL0 of the captured image IM0 and store it in the storage unit 114 when the captured image IM0 is stored in the RAM 113.

[0039] In this example, to prevent camera shake caused by button operation for capturing images, automatic capturing is triggered when the capturing conditions are satisfied. However, even if automatic capturing is performed, if there is a time lag between when user US1 points the imaging unit 120 toward the test pattern TP0 and assumes a capturing position and when captured image IM0 is acquired, camera shake may occur at the time of actual capturing. In this example, by confirming that a certain period of time has passed since the user US1 assumed a camera shake-free state, the possibility of camera shake at the time of actual capturing is reduced. Furthermore, as shown in FIG. 14 , when user US1 holds medium ME0 in his / her hand toward the imaging device, there is a possibility that medium ME0 may become distorted. In this example, by confirming that a certain period of time has passed since the test pattern TP0 was distorted, the possibility of test pattern TP0 becoming distorted at the time of actual capturing is reduced.

[0040] (3) Specific examples of imaging control processing: FIG. 5 shows a schematic example of the imaging control process performed by the control unit 110. Here, steps S102 to S116 correspond to the determination function FU1, and step S118 corresponds to the imaging control function. Hereinafter, the word "step" may be omitted, and the step code may be shown in parentheses. The imaging control process starts when the control unit 110 receives an instruction to capture an image of the imaging target area AR0 via the operation unit 115. The imaging instruction may be an operation on the imaging instruction area displayed after the imaging control program PR0 is started, an operation on the shutter button, or an operation to start the imaging control program PR0. FIGS. 6 to 12 show schematic examples of each condition included in the imaging conditions.

[0041] When the imaging control process starts, the control unit 110 determines whether a new frame FR0 has been transferred from the image sensor 123 to the RAM 113 (S102). The determination process of S102 is repeated until a new frame FR0 is transferred. The determination process of S102 can also be said to be a process of determining whether a new frame FR0 has been acquired from the imaging unit 120. When a new frame FR0 is transferred, the control unit 110 acquires condition satisfaction determination information for determining whether or not an imaging condition for causing the imaging unit 120 to capture an image of the imaging target area AR0 including the test pattern TP0 has been satisfied (S104). The condition satisfaction determination information includes a change amount V in the relative positional relationship between the imaging unit 120 and the medium ME0, and a distance amount D corresponding to the distance between the imaging unit 120 and the medium ME0. Details of the condition satisfaction determination information will be described later.

[0042] After acquiring the condition satisfaction determination information, the control unit 110 determines whether the basic conditions for image capture and the like are satisfied based on the frame FR0 and the condition satisfaction determination information (S106). The basic conditions refer to at least one of the first conditions illustrated in FIGS. 6 and 12 and the second conditions illustrated in FIGS. 7 and 12. The basic conditions and the like may also include additional conditions. The additional conditions refer to at least one of the third conditions illustrated in FIGS. 8 and 12, the fourth conditions illustrated in FIGS. 9 and 12, the fifth conditions illustrated in FIGS. 10 and 12, and the sixth conditions illustrated in FIGS. 11 and 12. If the basic conditions and the like are satisfied, the control unit 110 proceeds to S108. If the basic conditions and the like are not satisfied, the control unit 110 returns the process to S102. If the basic conditions, etc. include multiple conditions, control unit 110 determines whether all of the multiple conditions are met, and if all of the multiple conditions are met, proceeds to S108, and if any of the multiple conditions are not met, returns to S102. When returning to S102, control unit 110 may output guidance for meeting the unmet conditions. The guidance may be displayed on display unit 116, or may be output as audio to an audio output unit (not shown), etc. As described above, the processes of S102 to S106 are repeated until the basic conditions and the like are satisfied, and the control unit 110 repeatedly acquires the frame FR0 from the imaging unit 120 and repeatedly acquires the condition satisfaction determination information.

[0043] 6 shows a schematic example of whether the first condition, that is, the amount of change V in the relative positional relationship between the image capture unit 120 and the medium ME0 is equal to or less than a threshold value THV, is satisfied. The threshold value THV is an example of a reference amount of change and is a positive value. The control unit 110 repeatedly acquires a frame FR0 from the imaging unit 120. Here, the previously acquired frame FR0 will be referred to as the “previous frame FR1,” and the currently acquired frame FR0 will be referred to as the “current frame FR2.” The control unit 110 may acquire, as the amount of change V, the distance that a feature point included in the previous frame FR1 and the current frame FR2 has moved between the previous frame FR1 and the current frame FR2. Examples of feature points include the position detection pattern MK0 and the corners of the individual pattern TP1. When there are multiple feature points, the control unit 110 may acquire, as the amount of change V, the average value of multiple movement distances calculated for each of the multiple feature points. FIG. 6 shows how movement distances V1, V2, V3, and V4 of four position detection patterns MK0 are calculated based on the previous frame FR1 and the current frame FR2, and the amount of change V is acquired by averaging the movement distances Vi.

[0044] If the information terminal 1 is equipped with a sensor SS1, for example, a speed sensor or an acceleration sensor, the control unit 110 may acquire a detection value of the sensor SS1, for example, a speed value or an acceleration value, as the amount of change V. In this case, it is assumed that the medium ME0 is stationary.

[0045] The control unit 110 can repeatedly acquire the amount of change V and determine whether the first condition is satisfied based on the acquired amount of change V. If the amount of change V is equal to or less than the threshold value THV, the control unit 110 determines that the first condition is satisfied. If the amount of change V is greater than the threshold value THV, the control unit 110 determines that the first condition is not satisfied. If the first condition is not met, the control unit 110 may output guidance for meeting the first condition. Examples of outputting this guidance include displaying or outputting audio information such as "Please keep the camera steady."

[0046] FIG. 7 schematically shows an example of whether or not a second condition that a distortion amount DS indicating distortion of a test pattern TP0 included in a frame FR0 corresponding to a shooting angle FA is less than or equal to a threshold value THDS is satisfied. As shown in the middle part of FIG. 7, the shape of the test pattern TP0 included in the frame FR0 may be a shape distorted from the shape of the test pattern TP0 on the medium ME0 as shown in the upper part of FIG. 7. The control unit 110 can determine whether or not the second condition is satisfied based on the shape of the test pattern TP0 included in the frame FR0. The threshold value THDS is an example of a reference distortion amount and is a positive value.

[0047] When the region of the test pattern TP0 is rectangular and the test pattern TP0 is included in the frame FR0, the control unit 110 can obtain the distance between adjacent corners C1 in the rectangular region of the test pattern TP0 included in the frame FR0 based on the frame FR0. In FIG. 7, lengths LT1 and LT2 corresponding to the vertical sides and lengths LT3 and LT4 corresponding to the horizontal sides are shown. The distortion amount DS for the vertical side can be represented by a value greater than 1, for example, LT1 / LT2 when LT1 > LT2 and LT2 / LT1 when LT1 < LT2. The distortion amount DS for the horizontal side can be represented by a value greater than 1, for example, LT3 / LT4 when LT3 > LT4 and LT4 / LT3 when LT3 < LT4. When the threshold value THDS is set to a value greater than 1 and the distortion amount DS for the vertical side is less than or equal to the threshold value THDS and the distortion amount DS for the horizontal side is less than or equal to the threshold value THDS, the control unit 110 determines that the second condition is satisfied. The threshold value THDS is not particularly limited and can be set to 1.2 or the like. When the distortion amount DS for the vertical side is greater than the threshold value THDS or the distortion amount DS for the horizontal side is greater than the threshold value THDS, the control unit 110 determines that the second condition is not satisfied. Of course, it is also possible to use a percentage instead of the ratio of the lengths.

[0048] The control unit 110 may also determine angles α1, α2, α3, and α4 of the four corners C1 of the rectangular region of the test pattern TP0 based on the frame FR0. The distortion amount DS for the four corners C1 can be expressed, for example, as the difference |α1-90°|, |α2-90°|, |α3-90°|, and |α4-90°| between the angles α1, α2, α3, and α4 and the angle 90°. For example, assuming that the threshold value THDS is greater than 0° and less than 45°, if the differences |α1-90°|, |α2-90°|, |α3-90°|, and |α4-90°| are all equal to or less than the threshold value THDS, the control unit 110 can determine that the second condition is satisfied. When at least one of the differences |α1-90°|, |α2-90°|, |α3-90°|, and |α4-90°| is greater than the threshold value THDS, the control unit 110 can determine that the second condition is not satisfied. The control unit 110 may determine that the second condition is satisfied when both the conditions regarding the lengths LT1 to LT4 and the conditions regarding the angles α1 to α4 are satisfied.

[0049] Furthermore, if the frame FR0 includes a rectangular medium ME0, the control unit 110 may determine the angles θ1, θ2, θ3, and θ4 (see FIG. 9) of the four corners C0 of the medium ME0 based on the frame FR0. The distortion amount DS for the four corners C0 can be expressed, for example, as the difference |θ1-90°|, |θ2-90°|, |θ3-90°|, and |θ4-90°| between the angles θ1, θ2, θ3, and θ4 and the angle 90°. If any of these differences is equal to or less than the threshold THDS, the control unit 110 can determine that the second condition is satisfied. If at least one of the differences |θ1-90°|, |θ2-90°|, |θ3-90°|, and |θ4-90°| is greater than the threshold THDS, the control unit 110 can determine that the second condition is not satisfied.

[0050] In this way, the control unit 110 determines whether the second condition is met based on the shape of the test pattern TP0 included in the frame FR0. If the second condition is not met, the control unit 110 may output guidance for meeting the second condition. Examples of output guidance include displaying or outputting audio information such as "Please point the camera so that the test pattern is not distorted."

[0051] FIG. 8 schematically illustrates an example of whether the third condition, that is, whether the imaging target area AR0 is included in the angle of view FA of the imaging unit 120, is satisfied. Whether the third condition is satisfied can be determined by determining whether the imaging target area AR0 is completely included in the frame FR0 corresponding to the angle of view FA. If the imaging range falls within an unintended range, the third condition is not satisfied. If the third condition is satisfied, the imaging range is appropriate.

[0052] For example, suppose that medium ME0 has position detection patterns MK0 at the four corners of imaging target area AR0. In this case, control unit 110 can determine that the third condition is met if it can detect position detection patterns MK0 at four locations in frame FR0. Furthermore, control unit 110 can determine that the third condition is not met if it cannot detect even one of the four position detection patterns MK0 at frame FR0. If the medium ME0 does not have a position detection pattern MK0, the medium ME0 itself becomes the imaging target area AR0. If the medium ME0 is rectangular, the control unit 110 can determine that the third condition is met if it can detect multiple edges from the frame FR0 and detect a rectangle surrounded by two edges determined to be vertically oriented and two edges determined to be horizontally oriented. Because the medium ME0 included in the frame FR0 may be tilted, "vertical orientation" includes orientations that deviate from the strictly vertical orientation within a predetermined allowable angle range, and "horizontal orientation" includes orientations that deviate from the strictly horizontal orientation within a predetermined allowable angle range. Well-known rectangle recognition techniques, such as business card recognition, can be used to recognize the medium ME0 from the frame FR0.

[0053] In this way, the control unit 110 determines whether the third condition is met based on the frame FR0 repeatedly acquired from the imaging unit 120. If the third condition is not met, the control unit 110 may output guidance for meeting the third condition. Examples of outputting this guidance include displaying information such as "Please fit the entire test pattern on the screen" or outputting a voice.

[0054] FIG. 9 schematically illustrates an example of whether the fourth condition, that is, whether the image capture target area AR0 of the image capture unit 120 is within a predetermined facing range, is satisfied. FIG. 9 illustrates the shape of the image capture target area AR0 included in the frame FR0. The control unit 110 can determine whether the fourth condition is satisfied based on the shape of the image capture target area AR0 included in the frame FR0. If the image capture unit 120 is not within the facing range of the test pattern TP0, the resolution of the test pattern TP0 may differ between the sides closer to and farther from the image capture unit 120, potentially resulting in different adjustment values ​​being obtained between the sides closer to and farther from the image capture unit 120. If the fourth condition is satisfied, a more appropriate test pattern captured image may be used to adjust the printing characteristics.

[0055] As described above, the control unit 110 determines whether the imaging target area AR0 is included in the frame FR0. When the imaging target area AR0 is rectangular and the imaging target area AR0 is included in the frame FR0, the control unit 110 can obtain the distance between adjacent corners C0 based on the frame FR0. In FIG. 9, the length LS1 corresponding to the vertical side S1 (see FIG. 3), the length LS2 corresponding to the vertical side S2 (see FIG. 3), the length LS3 corresponding to the horizontal side S3 (see FIG. 3), and the length LS4 corresponding to the horizontal side S4 (see FIG. 3) are shown. That the imaging unit 120 is within a predetermined facing range with respect to the imaging target area AR0 means that the difference between the length LS1 of the vertical side S1 and the length LS2 of the vertical side S2 is small, and the difference between the length LS3 of the horizontal side S3 and the length LS4 of the horizontal side S4 is small. In order to quantitatively define the facing range, threshold values TH1 and TH2 are applied to the length ratio LS1 / LS2 of the vertical side and the length ratio LS3 / LS4 of the horizontal side. The threshold value TH1 is a positive value smaller than 1, and in the example shown in FIG. 9, 0.5 < TH1 < 1. The closer the threshold value TH1 is to 1, the more directly the imaging unit 120 faces the imaging target area AR0. The threshold value TH2 is a value larger than 1, and in the example shown in FIG. 9, 1 < TH1 < 2. The closer the threshold value TH2 is to 1, the more directly the imaging unit 120 faces the imaging target area AR0. When within the facing range, that is, TH1 ≤ LS1 / LS2 ≤ TH2 and TH1 ≤ LS3 / LS4 ≤ TH2, the control unit 110 determines that the fourth condition is satisfied. When LS1 / LS2 < TH1, LS1 / LS2 > TH2, LS3 / LS4 < TH1, or LS3 / LS4 > TH2, the control unit 110 determines that the fourth condition is not satisfied. Of course, it is also possible to use the percentages 100×LS1 / LS2 (%), 100×LS3 / LS4 (%) instead of the length ratios LS1 / LS2, LS3 / LS4.

[0056] Further, the control unit 110 may obtain the angles θ1, θ2, θ3, θ4 of the four corners C0 of the imaging target area AR0 based on the frame FR0. The imaging unit 120 being within a predetermined direct-facing range with respect to the imaging target area AR0 means that all of the angles θ1, θ2, θ3, θ4 are near 90°. To quantitatively define the direct-facing range, threshold values TH3 and TH4 will be applied to the angles θ1, θ2, θ3, θ4. The threshold value TH3 is a positive value smaller than 90°, and in the example shown in FIG. 9, 45° < TH3 < 90°. The closer the threshold value TH3 is to 90°, the more it can be said that the imaging unit 120 is more directly facing the imaging target area AR0. The threshold value TH4 is a value larger than 90°, and in the example shown in FIG. 9, 90° < TH1 < 135°. The closer the threshold value TH4 is to 90°, the more it can be said that the imaging unit 120 is more directly facing the imaging target area AR0. When within the direct-facing range, that is, TH3 ≤ θ1 ≤ TH4 and TH3 ≤ θ2 ≤ TH4 and TH3 ≤ θ3 ≤ TH4 and TH3 ≤ θ4 ≤ TH4, the control unit 110 determines that the fourth condition is satisfied. When θ1 < TH3, θ1 > TH4, θ2 < TH3, θ2 > TH4, θ3 < TH3, θ3 > TH4, θ4 < TH3, or θ4 > TH4, the control unit 110 determines that the fourth condition is not satisfied. In addition, the control unit 110 may determine that the fourth condition is satisfied when both the conditions regarding the length ratios LS1 / LS2 and LS3 / LS4 and the conditions regarding the angles θ1 to θ4 are satisfied.

[0057] As described above, the control unit 110 determines whether the fourth condition is satisfied based on the shape of the imaging target area AR0 included in the frame FR0. When the fourth condition is not satisfied, the control unit 110 may output guidance for satisfying the fourth condition. Examples of such output of guidance include display of information such as "Please direct the camera towards the test pattern." or audio output.

[0058] FIG. 10 shows an example of whether the fifth condition, in which the distance D corresponding to the distance between the image capture unit 120 and the medium ME0 is equal to or less than the threshold value THD, is satisfied. The threshold value THD is an example of a reference distance and is a positive value. If the image capture unit 120 is too far from the medium ME0, the resolution of the captured test pattern TP0 will be low, resulting in a large error in the adjustment value. If the fifth condition is satisfied, a more appropriate captured image of the test pattern can be used to adjust the printing characteristics. As described above, the control unit 110 determines whether the imaging target area AR0 is included in the frame FR0. If the imaging target area AR0 is included in the frame FR0, the control unit 110 can calculate the area Sa of the imaging target area AR0 based on the frame FR0. Here, the area of ​​the frame FR0 is assumed to be Sf. The area ratio Sa / Sf of the imaging target area AR0 to the frame FR0 increases as the imaging unit 120 gets closer to the medium ME0, and decreases as the imaging unit 120 gets farther away from the medium ME0. Since the maximum value of the area ratio Sa / Sf is 1, the distance D can be expressed as 1-(Sa / Sf).

[0059] If the information terminal 1 is equipped with a sensor SS2, for example, a distance measurement sensor, the control unit 110 may acquire, as the distance amount D, a detection value of the sensor SS2, for example, the distance from the imaging unit 120 to the medium ME0.

[0060] The control unit 110 can repeatedly detect the interval amount D and determine whether the fifth condition is met based on the detected interval amount D. If the interval amount D is equal to or less than the threshold value THD, the control unit 110 determines that the fifth condition is met. If the interval amount D is greater than the threshold value THD, the control unit 110 determines that the fifth condition is not met. Note that if the interval amount D is extremely close to 0, the third condition (see FIG. 8) is not met, so it is sufficient to have a threshold value THD that indicates the upper limit of the interval amount D. The control unit 110 may determine that the fifth condition is satisfied when both the condition based on the area ratio Sa / Sf and the condition based on the detection value of the sensor SS2 are satisfied.

[0061] If the fifth condition is not met, the control unit 110 may output guidance for meeting the fifth condition. Examples of outputting this guidance include displaying information such as "Please move the camera closer to the test pattern" or outputting a voice message.

[0062] 11A and 11B show examples of whether the sixth condition, in which the brightness amount L0 indicating the brightness L of the background color of the medium ME0 is equal to or greater than the threshold value THL, is satisfied. The brightness L may be a luminance value calculated from the pixel values ​​of the frame FR0, such as the average value of the R (red), G (green), and B (blue) values, or a brightness value calculated from the pixel values ​​of the frame FR0. The threshold value THL is an example of a reference brightness amount and is a positive value. For example, if the captured image IM0 is dark due to the influence of a shadow or the like, the density of the captured test pattern TP0 will be high, and the color of the test pattern TP0 will not be accurately acquired. If the sixth condition is satisfied, a more appropriate captured test pattern image can be used to adjust the printing characteristics.

[0063] Generally, the background color of the medium ME0 is brighter than the test pattern TP0. When the number of pixels Np is plotted against brightness L in a frame FR0 obtained from the imaging unit 120 facing the medium ME0, a peak P1 of brightness LP1 corresponding to the background color of the medium ME0 and a peak P2 of brightness corresponding to the test pattern TP0 appear. Peak P1 is brighter than peak P2. As shown in FIG. 11A, if the brightness LP1 of peak P1 is defined as a brightness amount L0, a threshold value for this brightness amount L0 can be set as THL. This threshold value THL is a positive value smaller than the upper limit of brightness L. If the brightness amount L0 is equal to or greater than the threshold THL, the control unit 110 can determine that the sixth condition is satisfied. If the brightness amount L0 is smaller than the threshold THL, the control unit 110 can determine that the sixth condition is not satisfied. Instead of the brightness LP1 of the peak P1, a statistically representative value such as the average value of the number of pixels Np at the brightness L where the number of pixels Np exceeds a predetermined value can also be used.

[0064] As shown in FIG. 11B, the control unit 110 may calculate the area St of the graph equal to or greater than a positive threshold THS that is smaller than the upper limit of brightness L, for example, the sum of the number of pixels Np equal to or greater than the threshold THS. The area St increases as the background color of the medium ME0 increases, and decreases as the background color of the medium ME0 decreases. If the area St is defined as the brightness amount L0, then the threshold for this brightness amount L0 can be set to THL. This threshold THL is a positive value smaller than the area Sh of the entire graph, for example, the number of pixels in frame FR0. Furthermore, the area ratio St / Sh of the entire graph equal to or greater than the threshold THS increases as the background color of the medium ME0 increases, and decreases as the background color of the medium ME0 decreases. If the area ratio St / Sh is defined as the brightness amount L0, then the threshold for this brightness amount L0 can be set to THL. This threshold THL is a positive value smaller than 1. Of course, the area ratio St / Sh can also be replaced by the percentage 100×St / Sh (%). If the brightness amount L0 is equal to or greater than the threshold value THL, the control unit 110 can determine that the sixth condition is met. If the brightness amount L0 is less than the threshold value THL, the control unit 110 can determine that the sixth condition is not met.

[0065] Furthermore, the determination of whether the sixth condition is met may be performed by a known method other than the above-described method. In this way, the control unit 110 acquires the brightness level L0 of the background color of the medium ME0 based on the frame FR0, and determines whether the sixth condition is met based on the acquired brightness level L0. If the sixth condition is not met, the control unit 110 may output guidance for meeting the sixth condition. Examples of output guidance include displaying or outputting audio information such as "Please make the test pattern a bright environment."

[0066] FIG. 12 schematically illustrates examples of criteria for determining basic conditions and additional conditions. The basic conditions refer to at least one of the first and second conditions. The additional conditions refer to at least one of the third, fourth, fifth, and sixth conditions. The basic conditions may be AND conditions of six conditions, but as long as they include at least one of the first and second conditions, they may not include the first, second, third, fourth, fifth, or sixth conditions. In the printing system SY1 shown in FIG. 1, the basic conditions may include at least the first condition. In the printing system SY1 shown in FIG. 14, the basic conditions may include at least the second condition.

[0067] 5, if the basic conditions and the like are met, the control unit 110 starts counting the waiting time Tc (S108). When this waiting time Tc reaches the predetermined time T0, the imaging condition for causing the imaging unit 120 to capture an image of the imaging target area AR0 is met. The predetermined time T0, which is the criterion for determining the imaging conditions including the first condition, is not particularly limited, but can be about 1 to 2 seconds when the imaging unit 120 does not include the blur correction unit 124, and can be about 0.5 to 1 second when the imaging unit 120 includes the blur correction unit 124.

[0068] Next, the control unit 110 causes the display unit 116 to display shooting standby information IN3 indicating that the basic conditions, etc., continue to be satisfied (S110). The shooting standby information IN3 may be text information urging the subject to remain still because it is within the still time, or may be numerical information counting down the remaining time for remaining still. The remaining time is the predetermined time T0 minus the waiting time Tc. The control unit 110 may also cause an audio output unit (not shown) to output the shooting standby information IN3 as audio. The shooting standby information IN3 is information indicating that at least the basic conditions continue to be satisfied. If the basic conditions, etc., include additional conditions, the shooting standby information IN3 is information indicating that the basic conditions and the additional conditions continue to be satisfied.

[0069] The control unit 110 also determines whether a predetermined time T0 has elapsed since the basic conditions, etc. were satisfied in S106, i.e., whether the waiting time Tc has reached the predetermined time T0 (S112). If the waiting time Tc has not reached the predetermined time T0, the control unit 110 updates the condition satisfaction determination information, including the change amount V and the interval amount D (S114), and determines whether the basic conditions, etc. are satisfied based on the frame FR0 and the condition satisfaction determination information (S116). If a new frame FR0 is transferred from the image sensor 123 to the RAM 113, the control unit 110 determines whether the basic conditions, etc. are satisfied based on the new frame FR0 and the condition satisfaction determination information. If the basic conditions, etc. are satisfied, the control unit 110 returns the process to S110. In this case, the processes of S110 to S116 are repeated until the waiting time Tc reaches the predetermined time T0. If the basic conditions, etc. are not satisfied in S116, the control unit 110 returns the process to the initial step S102. In this case, the waiting time Tc is reset, and in order for the imaging conditions to be satisfied, the basic conditions and the like must be satisfied again for a predetermined time T0.

[0070] When the waiting time Tc reaches the predetermined time T0, the imaging condition is met, and the control unit 110 acquires the captured image IM0 by causing the imaging unit 120 to capture an image of the imaging target area AR0 (S118). At this time, the CPU 111 may store the captured image IM0 from the image sensor 123 in the RAM 113, or the DMA controller may store the captured image IM0 from the image sensor 123 in the RAM 113. The captured image IM0 has a higher resolution than the frame FR0.

[0071] As described above, the control unit 110 acquires the captured image IM0 by causing the imaging unit 120 to capture the imaging target area AR0 when the imaging conditions are satisfied. This imaging condition is a condition in which at least one of the basic conditions, the first condition and the second condition, is continuously satisfied for a predetermined time T0 or more. The control unit 110 determines that the imaging condition is satisfied when at least the basic condition is continuously satisfied for a predetermined time T0 or more. If the basic conditions include at least one additional condition, the third condition, the fourth condition, the fifth condition, and the sixth condition, the imaging condition is a condition in which the basic condition and the additional condition are continuously satisfied for a predetermined time T0 or more. The control unit 110 determines that the imaging condition is satisfied when the basic condition and the additional condition are continuously satisfied for a predetermined time T0 or more.

[0072] After acquiring the captured image IM0, the control unit 110 determines whether or not to save the captured image IM0 as a file FL0 (S120). For example, when the operation unit 115 accepts an operation to save the captured image IM0, the control unit 110 causes the storage unit 114 to store the captured image IM0 in the format of file FL0 (S122), and ends the imaging control process. That is, the storage unit 114 stores the file FL0. When the operation unit 115 accepts an operation to discard the captured image IM0, the control unit 110 ends the imaging control process without performing the saving process of S122. Furthermore, in S120, the control unit 110 may determine whether the test pattern TP0 included in the captured image IM0 is appropriate for adjusting the printing characteristics. In this case, the control unit 110 may perform the saving process of S122 if it determines that the test pattern TP0 is appropriate, or may return the process to S102 if it determines that the test pattern TP0 is inappropriate. Furthermore, the control unit 110 may perform the process of S122 without performing the determination process of S120, thereby automatically generating a file FL0 for the captured image IM0 and storing it in the storage unit 114, triggered by the storage of the captured image IM0 in RAM 113.

[0073] In the printing system SY1 shown in Fig. 1, the first condition that the amount of change V shown in Figs. 6 and 12 is equal to or less than the threshold value THV is included in the basic conditions, etc., so that the imaging condition is met after the imaging unit 120 continues to have a small amount of shake for a predetermined time T0. As a result, even if there is a time lag between getting into position to capture the image and actually acquiring the captured image IM0 of the test pattern TP0, the continued small amount of shake makes it highly likely that the shake will remain small even after the time lag has elapsed. Because the test pattern TP0 included in the captured image IM0 has a small amount of shake, an appropriate test pattern TP0 can be used to adjust the printing characteristics.

[0074] In the printing system SY1 shown in Figure 14, because the second condition that the distortion amount DS shown in Figures 7 and 12 is less than or equal to the threshold value THDS is included in the basic conditions, etc., the imaging condition is met after a state in which distortion, such as bending, of the medium ME0 having the test pattern TP0 continues for a predetermined time T0. As a result, even if the user US1 holds the medium ME0 in his or her hand over the imaging device, the medium ME0 continues to have a small distortion, so there is a high possibility that the distortion of the test pattern TP0 will be small at the time of imaging. Because the distortion of the test pattern TP0 included in the captured image IM0 is small, an appropriate test pattern captured image can be used to adjust the printing characteristics.

[0075] Furthermore, in the printing system SY1 shown in FIGS. 1 and 14, the additional condition is a third condition that the imaging target area AR0 is included in the angle of view FA of the imaging unit 120, as shown in FIGS. 8 and 12. This means that the imaging condition is met after the state in which the imaging target area AR0 is included in the angle of view FA continues for a predetermined time T0. This means that the imaging target area AR0 is likely to be included in the captured image IM0 at the time of imaging. As shown in FIGS. 9 and 12, the additional condition is a fourth condition that the imaging unit 120 is within a predetermined direct facing range with respect to the imaging target area AR0, as shown in FIGS. 9 and 12. This means that the imaging condition is met after the direct facing state continues for a predetermined time T0. This means that the captured image IM0 is likely to be generated in a state in which the imaging unit 120 is within the predetermined direct facing range with respect to the imaging target area AR0 at the time of imaging. As shown in FIGS. 10 and 12, the additional condition is a fifth condition that the distance D is equal to or less than the threshold THD, as shown in FIGS. 10 and 12. This means that the additional condition is a fifth condition that the imaging unit 120 is not too far from the medium ME0 ... distance D is equal to or less than the threshold THD, as shown in FIGS. 10 and 12. This means that the additional condition is a third condition that the imaging unit 120 is not too far from the medium ME0 at the time of imaging. This means that the captured image IM0 is likely to 11 and 12, the sixth condition that the brightness L0 is equal to or greater than the threshold THL is included in the additional conditions, and the imaging condition is satisfied after the test pattern TP0 has not been too dark for a predetermined time T0. This means that there is a high possibility that the captured image IM0 will be generated in which the test pattern TP0 is not too dark at the time of imaging.

[0076] As a result, this example can obtain highly reliable captured images of the test pattern TP0. This allows the appropriate captured image of the test pattern to be used to adjust the printing characteristics, and prevents unnecessary captured images from overwhelming the memory.

[0077] The control unit 110 can acquire adjustment values ​​for adjusting the printing characteristics of the printing device 2 based on the pixel values ​​of the test pattern TP0 included in the captured image IM0. If the test pattern TP0 is a density pattern for adjusting the density of the print image PI0, the control unit 110 can acquire density adjustment values ​​for adjusting the density of the print image PI0 based on the pixel values ​​of the test pattern TP0. If the test pattern TP0 is a Bi-d adjustment pattern for Bi-d adjustment, the control unit 110 can acquire Bi-d adjustment values ​​for performing the Bi-d adjustment based on the pixel values ​​of the test pattern TP0. If the test pattern TP0 is a transport distance adjustment pattern for adjusting the transport distance of the medium ME0, the control unit 110 can acquire transport distance adjustment values ​​for adjusting the transport distance of the medium ME0 based on the pixel values ​​of the test pattern TP0.

[0078] FIG. 13 shows a schematic example of the adjustment of printing characteristics. Density adjustment refers to setting an adjustment value A1 to match the density of the print image PI0 to that of the input image. For example, as shown in FIG. 13, assume that the print image PI0 is darker than the input image. In this case, the output density of the individual pattern TP1 is darker than the density of the individual pattern data DA1 used to form the individual pattern TP1. The control unit 110 can cause the printing device 2 to perform density adjustment by, for example, setting an adjustment value A1 corresponding to the deviation in the output density of the individual pattern TP1 from the density of the individual pattern data DA1 in the controller 210 of the printing device 2. The controller 210 can match the density of the print image PI0 to that of the input image by lightening the output density of the individual pattern TP1 corresponding to the individual pattern data DA1 to that of the individual pattern data DA1 in accordance with the adjustment value A1. Of course, even if the print image PI0 is lighter than the input image, the density of the print image PI0 can be matched to that of the input image by setting the adjustment value A1.

[0079] Bi-d adjustment refers to setting an adjustment value A2 to align the landing positions of droplets 280 on the forward pass with the landing positions of droplets 280 on the backward pass in the main scanning direction D1 when the printing device 2 repeats main and sub scans during printing. Here, the forward pass refers to a main scan in which the recording head 220 moves in the forward direction D11, and the backward pass refers to a main scan in which the recording head 220 moves in the backward direction D12. For example, as shown in FIG. 13 , the landing positions on the backward pass that should be aligned with the landing positions on the forward pass in the main scanning direction D1 are shifted in the forward direction D11 from the landing positions on the forward pass. In this case, the position of the individual pattern TP1 formed on the medium ME0 on the backward pass is shifted in the forward direction D11 from the position of the individual pattern TP1 formed on the medium ME0 on the forward pass. The control unit 110 can cause the printing device 2 to perform Bi-d adjustment, for example, by setting an adjustment value A2 corresponding to the positional deviation of the individual pattern TP1 in the controller 210 of the printing device 2. The controller 210 can align the landing positions of the droplets 280 in the main scanning direction D1 between the forward and backward passes by delaying the ejection timing of the droplets 280 from the recording head 220 on the backward pass in accordance with the adjustment value A2. Of course, even if the landing position on the backward pass that should be aligned with the landing position on the forward pass in the main scanning direction D1 is shifted in the backward direction D12 from the landing position on the forward pass, the setting of the adjustment value A2 can align the landing positions of the droplets 280 in the main scanning direction D1 between the forward and backward passes.

[0080] PF adjustment, which is used to adjust the transport distance, involves setting an adjustment value A3 to accurately adjust the transport distance of medium ME0 during sub-scanning in the sub-scanning direction D2. Note that sub-scanning direction D2 refers to the direction in which the recording head 220 moves relative to medium ME0, and the transport direction in which medium ME0 moves relative to the recording head 220 is opposite to sub-scanning direction D2. If the transport distance of medium ME0 during sub-scanning is too large, gaps between band regions will appear, e.g., light streaks. If the transport distance of medium ME0 during sub-scanning is too small, overlapping dots will appear between band regions, e.g., dark streaks. For example, as shown in FIG. 13, the spacing between the landing positions of droplets 280 between sub-scans in the sub-scanning direction D2 is assumed to be wider than the design width WB of the band region. In this case, the spacing between individual patterns TP1 formed on medium ME0 during a certain pass and individual patterns TP1 formed on medium ME0 during the previous pass will be wider than the width WB of the band region. The control unit 110 can cause the printing device 2 to perform PF adjustment by, for example, setting an adjustment value A3 in the controller 210 of the printing device 2, which corresponds to the deviation in the spacing between the individual patterns TP1 relative to the width WB of the band area. The controller 210 can adjust the transport amount of the medium ME0 during sub-scans in the sub-scanning direction D2 so that it is neither too much nor too little, by reducing the transport amount of the medium ME0 during sub-scans in accordance with the adjustment value A3. Of course, even if the distance between the landing positions of the droplets 280 between sub-scans in the sub-scanning direction D2 is narrower than the designed width WB of the band area, the setting of the adjustment value A3 can also adjust the transport amount of the medium ME0 during sub-scans so that it is neither too much nor too little.

[0081] As described above, the user US1 can easily adjust various printing characteristics by capturing an image of the test pattern TP0 with the information terminal 1.

[0082] (4) Variation: The present invention can be embodied in various modifications. For example, the above-described processes can be changed as appropriate by changing the order, etc. For example, in the imaging control process shown in Fig. 5, the process of obtaining information on whether the condition is satisfied in S104 can be performed before the process of S102.

[0083] As shown in Fig. 15, the predetermined time T0 used as a criterion for determining the imaging conditions may be changed depending on whether or not the mobile terminal 1 has a shake correction function. Fig. 15 schematically shows an example of a determination wait time determination process performed in accordance with the imaging control program PR0. The determination wait time determination process is a process for determining the predetermined time T0 as the determination wait time, and is performed by the control unit 110 before the imaging control process shown in Fig. 5, and corresponds to the determination function FU1 that the imaging control program PR0 causes the information terminal 1 to realize. When the judgment wait time determination process starts, the control unit 110 acquires blur correction compatibility information IN1 indicating whether the imaging unit 120 is equipped with the blur correction unit 124 (S202). The imaging control program PR0, which serves as an application program, causes the information terminal 1 to realize a function for acquiring the blur correction compatibility information IN1 from the OS by requesting the OS to output the blur correction compatibility information IN1. Furthermore, the control unit 110 executing the imaging control program PR0 may accept a selection operation from the user US1 via the operation unit 115 as to whether or not the blur correction function is available. Then, the control unit 110 may acquire blur correction compatibility information IN1 indicating the availability of the blur correction function when the availability of the blur correction function is selected, and may acquire blur correction compatibility information IN1 indicating the absence of the blur correction function when the absence of the blur correction function is selected. Furthermore, the control unit 110 may display "long standby time mode" and "short standby time mode" in a selection field on the display unit 116, and acquire blur correction compatibility information IN1 indicating that a blur correction function is available when the "long standby time mode" is selected, and acquire blur correction compatibility information IN1 indicating that a blur correction function is not available when the "short standby time mode" is selected.

[0084] After acquiring the blur correction support information IN1, the control unit 110 determines whether the image capture unit 120 has a blur correction function, i.e., whether the blur correction support information IN1 indicates the presence of a blur correction function, based on the blur correction support information IN1 (S204). If the blur correction support information IN1 indicates the absence of a blur correction function, the control unit 110 sets the predetermined time T0 as the determination wait time to the predetermined time T1 (S206) and ends the determination wait time determination process. The control unit 110 applies the predetermined time T1 as the predetermined time T0 in the image capture control process shown in FIG. 5. If the blur correction support information IN1 indicates the presence of a blur correction function, the control unit 110 sets the predetermined time T0 as the determination wait time to the predetermined time T2, which is shorter than the predetermined time T1 (S208), and ends the determination wait time determination process. The control unit 110 applies the predetermined time T2 as the predetermined time T0 in the image capture control process shown in FIG. 5. In this way, the determination function FU1 shortens the predetermined time T0 as the determination waiting time when the shake correction function is present compared to when the shake correction function is not present, based on the shake correction correspondence information IN1.

[0085] If the imaging unit 120 has a shake correction function, even if shake occurs because the time during which the basic conditions, etc., are continuously satisfied is relatively short, the shake is corrected. As a result, if the imaging unit 120 has a shake correction function, highly reliable imaging results of the test pattern TP0 can be obtained even if the predetermined time T0 is shortened, and usability can be improved.

[0086] As shown in Fig. 16, the predetermined time T0 used as a criterion for determining the imaging conditions may be changed according to the exposure time. Fig. 16 schematically shows another example of the determination wait time determination process performed in accordance with the imaging control program PR0. This determination wait time determination process is also a process for determining the predetermined time T0 as the determination wait time, and is performed by the control unit 110 before the imaging control process shown in Fig. 5, and corresponds to the determination function FU1 that the imaging control program PR0 causes the information terminal 1 to realize. When it is determined that the determination standby time determination process starts, the control unit 110 acquires exposure time information IN2 from the storage unit 114 (S302). The imaging control program PR0 as an application program causes the information terminal 1 to realize a function of acquiring the exposure time information IN2 from the OS by requesting the OS to output the exposure time information IN2.

[0087] After acquiring the exposure time information IN2, the control unit 110 sets a predetermined time T0 as the determination standby time based on the exposure time information IN2 (S304), and ends the determination standby time determination process. As shown in FIG. 16, it is assumed that a predetermined time T3 (seconds) is associated with the exposure time of TE1 seconds as the first time, and a predetermined time T4 (seconds) is associated with the exposure time of TE2 seconds as the second time. Here, TE2 < TE1 and T4 < T3. When the exposure time indicated by the exposure time information IN2 is TE1 seconds, the control unit 110 sets the predetermined time T0 as the determination standby time to the predetermined time T3, and applies the predetermined time T3 as the predetermined time T0 in the imaging control process shown in FIG. 5. When the exposure time indicated by the exposure time information IN2 is TE2 seconds, the control unit 110 sets the predetermined time T0 as the determination standby time to the predetermined time T4, and applies the predetermined time T4 as the predetermined time T0 in the imaging control process shown in FIG. 5. As described above, based on the exposure time information IN2, the determination function FU1 shortens the predetermined time T0 as the determination standby time when the exposure time is the second time (TE2) shorter than the first time (TE1) compared to the case where the exposure time is the first time (TE1).

[0088] When the exposure time is relatively short, even if blurring occurs due to the relatively short time during which the basic conditions and the like are continuously satisfied, the influence of the blurring on the captured image IM0 is small. Thereby, even if the predetermined time T0 is shortened when the exposure time is relatively short, it is possible to obtain an imaging result of a highly reliable test pattern TP0, and the usability can be improved. In the process of S304, the predetermined time T0 may be changed depending on whether the imaging unit 120 has a shake correction function. For example, when the exposure time is a first time (TE1) and the control unit 110 acquires shake correction support information IN1, the control unit 110 may set the predetermined time T3 shorter when the shake correction function is present based on the shake correction support information IN1 than when the shake correction function is not present. Furthermore, when the exposure time is a second time (TE2), the control unit 110 may set the predetermined time T4 shorter when the shake correction function is present based on the shake correction support information IN1 than when the shake correction function is not present.

[0089] As shown in Fig. 17, the criteria for determining the condition may be changed during the predetermined time T0 shown in Fig. 5. Fig. 17 shows a schematic example of a process for changing the criteria for determining the condition during the determination waiting time. This process corresponds to the determination function FU1. 17 includes a first period PT1 from the beginning to the middle, and a second period PT2 from the middle to the end. Therefore, it can be said that the predetermined time T0 includes the first period PT1 and the second period PT2 that comes after the first period PT1.

[0090] After the imaging control process shown in FIG. 5 starts and the process of S108 is performed to start counting the waiting time Tc, the threshold values ​​shown in FIG. 17 are used in the process of S116 to determine whether the basic conditions etc. are satisfied.

[0091] 6 and 12 is satisfied, the control unit 110 uses threshold value THV1 as the threshold value THV if the waiting time Tc falls within the first period PT1, and uses threshold value THV2 if the waiting time Tc falls within the second period PT2. Here, threshold value THV2 is smaller than threshold value THV1. Therefore, the control unit 110 sets threshold value THV2 as the reference change amount to be applied to the second period PT2 to be smaller than threshold value THV1 as the reference change amount to be applied to the first period PT1. When user US1 points the imaging unit 120 toward the test pattern TP0 to capture an image, camera shake often gradually decreases. From this, even if camera shake is relatively large at the start of the waiting time Tc, it is clear that user US1 is beginning to try to suppress camera shake, and it is sufficient if camera shake eventually decreases. If the threshold value THV is relatively small during the second period PT2, which is relatively later within the predetermined time T0 serving as the determination waiting time, a highly reliable image of the test pattern TP0 can be obtained even if the threshold value THV is relatively large during the first period PT1, which is relatively earlier. Therefore, the time required for image capture can be shortened.

[0092] 7 and 12 is satisfied, the control unit 110 uses the threshold value THDS1 as the threshold value THDS if the waiting time Tc falls within the first period PT1, and uses the threshold value THDS2 if the waiting time Tc falls within the second period PT2. Here, the threshold value THDS2 is smaller than the threshold value THDS1. Therefore, the control unit 110 sets the threshold value THDS2 as the reference change amount to be applied to the second period PT2 to be smaller than the threshold value THDS1 as the reference change amount to be applied to the first period PT1. When user US1 holds medium ME0 in his / her hand over the imaging unit 120 for imaging, the distortion of medium ME0 often decreases. From this, even if the distortion of test pattern TP0 is relatively large at the start of waiting time Tc, it is clear that user US1 has begun to try to reduce the distortion of medium ME0, and it can be said that it is sufficient if the distortion of test pattern TP0 eventually decreases. If the threshold value THDS is relatively small in the second period PT2, which is relatively later in the predetermined time T0 as the determination waiting time, a reliable imaging result of test pattern TP0 can be obtained even if the threshold value THDS is relatively large in the first period PT1, which is relatively earlier. Therefore, the time required for imaging can be shortened.

[0093] The above-described mode 1 includes the following modes 1A and 1B. Either mode can provide an imaging control program that can acquire highly reliable imaging results of a test pattern.

[0094] [Aspect 1A] An imaging control program PR0 for imaging a medium ME0 having a test pattern TP0 for adjusting the printing characteristics of a printing device 2 equipped with a recording head 220, a determination function FU1 that determines whether or not an imaging condition for causing the imaging unit 120 to capture an image of the imaging target area AR0 including the test pattern TP0 is satisfied; an imaging control function FU2 that acquires a captured image IM0 by causing the imaging unit 120 to capture an image of the imaging target area AR0 when the imaging condition is satisfied, The imaging condition is a condition in which at least a first condition, that is, a change amount V in the relative positional relationship between the imaging unit 120 and the medium ME0 is equal to or less than a reference change amount (THV), is satisfied for a predetermined time period T0 or more, The judgment function FU1 is repeatedly acquiring the change amount V, and determining whether or not the first condition is satisfied based on the acquired change amount V; If the first condition continues to be satisfied for the predetermined time period T0 or more, it is determined that the imaging condition is satisfied. Imaging control program PR0.

[0095] [Aspect 1B] An imaging control program PR0 for imaging a medium ME0 having a test pattern TP0 for adjusting the printing characteristics of a printing device 2 equipped with a recording head 220, a determination function FU1 that determines whether or not an imaging condition for causing the imaging unit 120 to capture an image of the imaging target area AR0 including the test pattern TP0 is satisfied; an imaging control function FU2 that acquires a captured image IM0 by causing the imaging unit 120 to capture an image of the imaging target area AR0 when the imaging condition is satisfied, The imaging condition is a condition in which at least a second condition, that is, a distortion amount DS indicating distortion of the test pattern TP0 included in a frame FR0 repeatedly acquired from the imaging unit 120 is equal to or less than a reference distortion amount (THDS), is satisfied for a predetermined time T0 or more, and The judgment function FU1 is determining whether the second condition is satisfied based on the shape of the test pattern TP0 included in the frame FR0; If the second condition is satisfied for the predetermined time period T0 or more, it is determined that the imaging condition is satisfied. Imaging control program PR0.

[0096] It is also possible to implement a printing system SY1 corresponding to the above-mentioned aspect 1A, and a printing system SY1 corresponding to the above-mentioned aspect 1B. In either case, it is possible to provide a printing system capable of obtaining highly reliable imaging results of test patterns.

[0097] (5) Conclusion: As described above, the present invention provides a configuration capable of obtaining highly reliable imaging results of a test pattern through various aspects. Of course, even in an aspect consisting only of the features of the independent claims, the basic functions and effects described above can be obtained. Furthermore, it is possible to implement configurations in which the components disclosed in the above examples are substituted with each other or the combination is changed, or configurations in which the components disclosed in the publicly known techniques and the above examples are substituted with each other or the combination is changed, etc. The present invention also includes these configurations. [Explanation of symbols]

[0098] 1...information terminal, 2...printing device, 110...controller, 111...CPU, 113...RAM, 114...storage unit, 115...operation unit, 116...display unit, 120...imaging unit, 123...image sensor, 124...blur correction unit, 130...exposure control unit, 210...controller, 220...recording head, AR0...imaging target area, C0...corner, D...spacing amount, DS...distortion amount, FA...angle of view, FR0...frame, FU1...determination function, FU2...imaging control function, IN1...blur correction support information, IN2...exposure time information, IN3...shooting standby information, IM0...captured image, L ...brightness, L0...amount of brightness, LS1 to LS4, LT1 to LT4...length, ME0...medium, MK0...position detection pattern, Np...number of pixels, P1, P2...peak, PT1...first period, PT2...second period, PI0...printed image, PR0...imaging control program, S1, S2...vertical side, S3, S4...horizontal side, Sa, Sf, Sh, St...area, SS1, SS2...sensor, SY1...printing system, T0, T1, T2, T3, T4...specified time, TP0...test pattern, TP1...individual pattern, US1...user, V...amount of change, VD0...video.

Claims

1. 1. An imaging control program for imaging a medium having a test pattern for adjusting printing characteristics of a printing device having a recording head, comprising: a determination function for determining whether or not an imaging condition for causing an imaging unit to capture an image of an imaging target area including the test pattern is satisfied; an imaging control function of acquiring a captured image by causing the imaging unit to capture an image of the imaging target area when the imaging condition is satisfied; The imaging condition is a condition in which at least one of the following basic conditions continues to be satisfied for a predetermined time or longer: a first condition that a change amount in the relative positional relationship between the imaging unit and the medium is equal to or less than a reference change amount; and a second condition that a distortion amount indicating distortion of the test pattern included in frames repeatedly acquired from the imaging unit is equal to or less than a reference distortion amount. The determination function is When determining whether the first condition is satisfied, the amount of change is repeatedly acquired, and whether the first condition is satisfied is determined based on the acquired amount of change; When determining whether the second condition is satisfied, determining whether the second condition is satisfied based on a shape of the test pattern included in the frame; If the basic conditions are satisfied for the predetermined time or longer, it is determined that the imaging conditions are satisfied. Imaging control program.

2. the imaging condition is a condition in which the basic condition and the additional condition are continuously satisfied for the predetermined time or more, The additional condition is at least one of a third condition that the imaging target area is included in the angle of view of the imaging unit, a fourth condition that the imaging unit is within a predetermined range facing the imaging target area, a fifth condition that a gap amount corresponding to a gap between the imaging unit and the medium is equal to or less than a reference gap amount, and a sixth condition that a brightness amount indicating brightness of a background color of the medium is equal to or greater than a reference brightness amount, The determination function is When determining whether the third condition is satisfied, determining whether the third condition is satisfied based on the frame; When determining whether the fourth condition is satisfied, determining whether the fourth condition is satisfied based on a shape of the imaging target area included in the frame; When determining whether the fifth condition is satisfied, the distance is repeatedly detected, and based on the detected distance, the fifth condition is determined to be satisfied; When determining whether the sixth condition is satisfied, the brightness amount is obtained based on the frame, and whether the sixth condition is satisfied is determined based on the obtained brightness amount; If the basic condition and the additional condition continue to be satisfied for the predetermined time or longer, it is determined that the imaging condition is satisfied. The imaging control program according to claim 1 .

3. The determination function is The predetermined time period can be changed, acquiring blur correction support information indicating whether or not a blur correction function for correcting blur in the captured image is available, and shortening the predetermined time based on the blur correction support information when the blur correction function is available compared to when the blur correction function is not available; 3. The imaging control program according to claim 1.

4. The exposure time applied to the imaging unit is changeable, The determination function is The predetermined time period can be changed, acquiring exposure time information indicating the exposure time from a control unit that controls the imaging unit, and, based on the exposure time information, shortening the predetermined time when the exposure time is a second time that is shorter than the first time compared to when the exposure time is the first time; 3. The imaging control program according to claim 1.

5. 3. The imaging control program according to claim 1, wherein the determining function causes an output unit to output information indicating that at least the basic condition continues to be satisfied.

6. the predetermined time period includes a first period and a second period that follows the first period, The determination function is When determining whether the first condition is satisfied, the reference change amount to be applied to the second period is set to be smaller than the reference change amount to be applied to the first period; when determining whether the second condition is satisfied, the reference distortion amount to be applied to the second period is set to be smaller than the reference distortion amount to be applied to the first period; 3. The imaging control program according to claim 1.

7. A printing system including a printing device including a recording head and an information terminal that captures an image of a medium having a test pattern for adjusting the printing characteristics of the printing device, The information terminal An imaging unit; a control unit including a memory for storing an image obtained from the imaging unit, and causing the imaging unit to capture an image of an imaging target area including the test pattern; the control unit determines whether or not an imaging condition for causing the imaging unit to capture an image of the imaging target area is satisfied, and acquires the captured image by causing the imaging unit to capture an image of the imaging target area using the satisfaction of the imaging condition as a trigger; The imaging condition is a condition in which at least one of the following basic conditions continues to be satisfied for a predetermined time or longer: a first condition that a change amount in the relative positional relationship between the imaging unit and the medium is equal to or less than a reference change amount; and a second condition that a distortion amount indicating distortion of the test pattern included in frames repeatedly acquired from the imaging unit is equal to or less than a reference distortion amount. The control unit When determining whether the first condition is satisfied, the amount of change is repeatedly acquired, and whether the first condition is satisfied is determined based on the acquired amount of change; When determining whether the second condition is satisfied, determining whether the second condition is satisfied based on a shape of the test pattern included in the frame; If the basic conditions are satisfied for the predetermined time or longer, it is determined that the imaging conditions are satisfied. Printing system.

Images