Printing Support Device, Printing Support Method, and Program

Abstract

To allow a user to immediately recognize a state of ink.SOLUTION: A printing device 1 includes: a printing part 4 for printing a liquid agent on a printing target; an imaging device 5 for imaging a printing target; and a control unit. The control unit acquires color information of a liquid agent which is printed on a printing target and imaged by the imaging device 5 and displays an image including a region indicating the color information.SELECTED DRAWING: Figure 5

Description

Technical Field

[0001] The present invention relates to Printing support device, printing support method and P a program.

Background Art

[0002] In recent years, printing devices that eject cosmetic ink by an inkjet method and perform makeup on the skin and nails on behalf of a person have been put into practical use. In the printing device described in Patent Document 1, a makeup advice system including arithmetic processing means for outputting a simulation image of the makeup face of a target person together with the face image of the target person is applied, and a makeup simulation image using a color prepared in advance before applying makeup can be obtained.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, cosmetics (cosmetic ink) may change color or deteriorate over time. Therefore, for example, even if a makeup simulation is performed based on the color information of the cosmetics registered in advance before makeup, if the cosmetics have changed color, there may be a difference in the color tone between the actually applied cosmetics and the skin. That is, when the usage frequency of cosmetics is low, etc., there is a problem that the user will unexpectedly recognize this difference in color tone (that is, the state change of the cosmetic ink).

[0005] The present invention has been made in view of the above circumstances, and an object thereof is to promptly let the user recognize the state of the ink.

Means for Solving the Problems

[0006] To achieve the above object, in the present invention, When a printing medium for test printing is set as a printing target, by taking pictures under each of a plurality of different lighting conditions when taking pictures with a predetermined imaging means, the printing performed on the printing medium for test printing the color information of the liquid agent For each of the lighting conditions is obtained First by an obtaining means, When a human skin is set as the printing target, before printing the liquid agent on the human skin, by taking a picture with the imaging means under the lighting condition selected by the user among the plurality of lighting conditions, a second acquisition means for acquiring an image of the human skin before the liquid agent is printed; when a preview image in which the liquid agent is temporarily printed is displayed by applying the image of the human skin before the liquid agent is printed, a display control means for displaying the preview image by applying the color information obtained by taking a picture under the same lighting condition as the lighting condition selected by the user among the color information obtained by the first acquisition means to the liquid agent and is characterized by comprising the same.

Effect of the Invention

[0007] According to the present invention, the state of the ink can be quickly recognized by the user.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Modes for Carrying Out the Invention

[0009] An embodiment of a printing apparatus according to the present invention will be described with reference to FIGS. 1 to 7. Note that, although various technically preferable limitations are imposed on the embodiments described below for carrying out the present invention, the scope of the present invention is not limited to the following embodiments and illustrated examples.

[0010] First, a printing apparatus 1 according to the first embodiment of the present invention will be described. Figure 1 is a schematic cross-sectional view of a main part of a printing apparatus according to the present embodiment. In the following embodiments, the X direction and the Z direction shall refer to the directions shown in FIG. 1. The printing apparatus 1 according to the first embodiment is a handy-type printing apparatus that is formed to be small enough to be held in one hand and can be used while being held by hand. The printing apparatus 1 applies (prints), for example, a liquid agent 3 (cosmetic ink) assuming the skin color onto the surface of a human skin as a printing target (coating target), and is used by being moved onto the printing target by the user. Note that the printing target of the printing apparatus according to the present invention is not limited to the surface of a human skin.

[0011] As shown in FIG. 1, the printing apparatus 1 has a housing 2 formed in a substantially box shape. An opening 21 is provided at a middle position in the X direction on the lower surface of the housing 2. The opening 21 is formed to be large enough to expose the discharge part 412 of the printing head 41 described later to the outside. However, the specific shape, size, etc. of the opening 21 are not particularly limited. Note that the printing apparatus 1 is placed on a stand (not shown) when not in use (during non-printing). The stand is provided with a cap mechanism or the like that covers and protects the discharge part (discharge surface) 412 of the printing head 41 described later.

[0012] A printing unit 4, a photographing device 5, etc. are provided inside the housing 2. The printing unit 4 includes a printing head 41 and a head movement mechanism 45 (see FIG. 2) for moving the printing head 41 in the X direction of the apparatus. The printing head 41 performs printing on a printing target (in this embodiment, the skin surface or the paper T). As the printing head 41, a cartridge-integrated printing head including a storage part 411 for storing the liquid agent 3 (cosmetic ink such as skin color in this embodiment) and a discharge part 412 (a discharge surface provided with nozzles not shown) for discharging this liquid agent 3 is assumed.

[0013] The ejection unit 412 is provided on the lower surface of the print head 41 (the surface facing the skin surface to be printed), and the ejection unit 412 is normally exposed downward from the opening 21 of the housing 2. Note that the print head 41 is not limited to a configuration in which the storage unit 411 and the ejection unit 412 (ejection mechanism part) are integrated. For example, the storage unit 411 and the ejection unit 412 may be separately configured, and may be configured such that the storage unit 411 and the ejection unit 412 are connected via a supply pipe or the like during printing.

[0014] The print head 41 of the present embodiment is an inkjet head of an inkjet method that performs printing by spraying the liquid agent 3 (ink) atomized from the ejection unit 412 onto the printing target. The liquid agent 3 of the present embodiment is a mixture in which various solutes are dissolved in a solvent. Specifically, the liquid agent 3 is a cosmetic ink using water or the like as a solvent and titanium oxide or the like as a solute, and is a liquid agent of a color from white to the color of the skin or a color close thereto (for example, light pink, light yellow, light orange, etc.). Note that when printing a single-color ink without using a plurality of inks in a single printing as in the present embodiment, fine color adjustment by color combination cannot be performed.

[0015] The print head 41 is supported by an X-direction guide 43 for moving (scanning) the carriage 42 in the X direction while being mounted (held) on the carriage 42 as a holding unit. The head movement mechanism 45 (see FIG. 2) includes an X-direction movement motor 46 (see FIG. 2) or the like as a drive unit that appropriately moves the print head 41 (carriage 42) in the X direction. When the X-direction movement motor 46 is driven, the print head 41 mounted on the carriage 42 moves in the X direction along the X-direction guide 43.

[0016] The imaging device 5 images a printing target (skin surface, paper T, etc. in the present embodiment), and includes an imaging device (imaging means) 51 and an illumination device (illumination means) 52. The imaging device 5 is disposed within the housing 2 above the opening 21, and while illuminating an object to be printed or the like from the opening 21 with the illumination device 52, captures an image with the imaging unit 51 and acquires the image. The imaging unit 51 is, for example, a small camera configured to include a solid-state imaging device such as a CCD (Charge Coupled Device) type or a CMOS (Complementary Metal Oxide Semiconductor) type having 2 million pixels or more, and a lens or the like. Further, the illumination device 52 is, for example, an illumination lamp such as a white LED.

[0017] FIG. 2 is a main part block diagram showing the functional configuration of a printing system including the printing device 1 and a terminal device 8 described later. As shown in this figure, in addition to the printing unit 4 and the imaging device 5 described above, the printing device 1 includes an operation unit 11, various lamps 12, a communication unit 13, and a control device 7.

[0018] The operation unit 11 is provided on the surface of the housing 2 and is for the user to perform various inputs. The operation unit 11 is composed of, for example, operation buttons for performing various inputs such as a power switch button for turning on / off the power of the printing device 1, a stop button for stopping the operation, and a print start button for instructing print start. For example, when the operation unit 11 is a power switch button, when the user performs a button operation, an instruction signal corresponding to the operation is output to the control device 7 described later, and the power of the printing device 1 is turned on / off.

[0019] The lamp 12 is configured to include, for example, a plurality of LEDs or the like, and is provided on the surface of the housing 2. For example, the lamp 12 can be lit in various colors, the number of lamps 12 to be lit can be changed, or it can be blinked in various patterns, and various information and the like are notified to the user according to such lighting colors, lighting numbers, blinking conditions, etc. Note that, instead of or together with the lamp 12, an indicator, a display unit, or the like (not shown) may be provided, and in this case, the indicator, the display unit, or the like may function as a notification unit.

[0020] The communication unit 13 is configured to be able to transmit and receive information to and from a terminal device 8 described later that operates in cooperation with the printing device 1. The communication between the printing device 1 and the terminal device 8 is performed, for example, by a wireless LAN or the like. Note that the communication between the printing device 1 and the terminal device 8 is not limited to this, and any method may be used. For example, it may use a network line such as the Internet, or may perform wireless communication based on a short-range wireless communication standard such as Bluetooth (registered trademark) or Wi-Fi. Further, this communication is not limited to wireless, and it may be configured such that various data can be transmitted and received between the two by a wired connection. The communication unit 13 includes an antenna chip or the like corresponding to the communication method of the terminal device 8.

[0021] The control device 7 is a computer including a control unit 71 configured by a processor such as a CPU (Central Processing Unit), and a storage unit 72 configured by a ROM (Read Only Memory) and a RAM (Random Access Memory) (both not shown). Note that part or all of the storage unit 72 may be configured separately and provided outside the control device 7.

[0022] The storage unit 72 stores various programs for operating the printing device 1 (for example, programs for performing display processing and the like described later) and various data. The control unit 71 comprehensively controls each part of the printing device 1 by, for example, expanding and executing these programs stored in the storage unit 72 in a work area of the RAM. In particular, in the present embodiment, the control unit 71 controls the printing unit 4 to perform a printing operation or the like, and controls the imaging device 5 to image a printing target or the like. Each function of the control unit 71 is realized by the cooperation of the CPU of the control unit 71 and the programs stored in the ROM of the storage unit 72.

[0023] Further, the printing device 1 of the present embodiment cooperates with a terminal device 8 which is an external device, and operates according to an instruction input from the terminal device 8. As the terminal device 8, for example, a mobile terminal device such as a smartphone or a tablet is assumed, but it is not limited thereto. The terminal device 8 is not particularly limited as long as it is an information processing device capable of communicating with the printing device 1, and may be, for example, a notebook or stationary personal computer, a terminal device for games, or the like. Specifically, the terminal device 8 includes an operation unit 83, a communication unit 84, a display unit 85, a control device 80, and the like.

[0024] The operation unit 83 is capable of performing various inputs and settings according to the user's operation. When the operation unit 83 is operated, an input signal corresponding to the operation is transmitted to the control device 80. In this embodiment, a touch panel is integrally provided on the surface of the display unit 85, and the user can also perform operations such as various inputs and settings by performing a touch operation on the touch panel. Note that the operation unit 83 for performing operations such as various inputs and settings is not limited to a touch panel. For example, various operation buttons, a keyboard, a pointing device, or the like may be provided as the operation unit 83. By operating the operation unit 83, various inputs and settings may be performed in the printing device 1. For example, by the user operating the operation unit 83, the printing operation of the printing device 1 may be started.

[0025] The communication unit 84 communicates with the communication unit 13 of the printing device 1. For example, when data such as various images is transmitted from the printing device 1, it receives this. The communication unit 84 includes a wireless communication module or the like capable of communicating with the communication unit 13 of the printing device 1. Note that the communication unit 84 only needs to be capable of communicating with the printing device 1, and one that conforms to the communication standard of the communication unit 13 of the printing device 1 is applied.

[0026] The display unit 85 is composed of, for example, a liquid crystal display (LCD), an organic electroluminescence display, or other flat displays. The display unit 85 can display various display screens including, for example, images transmitted from the printing device 1 in accordance with the control of the control unit 81 described later. As described above, a touch panel for performing various inputs may be integrally formed on the surface of the display unit 85. In this case, the touch panel also functions as the operation unit 83 and the like.

[0027] The control device 80 is a computer including a control unit 81 constituted by a CPU (Central Processing Unit) or the like (not shown) and a storage unit 82 constituted by a ROM (Read Only Memory), a RAM (Random Access Memory), or the like (not shown).

[0028] The storage unit 82 stores various programs, various data, and the like for operating each part of the terminal device 8. Specifically, in the ROM or the like of the present embodiment, in addition to the operation program for overall control of each part of the terminal device 8, various programs (none of which are shown), such as application programs for performing printing processes or the like using the printing device 1, are stored. The control device 80 expands and executes these programs in the work area of the RAM, for example, so that the terminal device 8 is controlled.

[0029] The control unit 81 integrally controls the operations of each part of the terminal device 8. The control unit 81 realizes various functions for the printing device 1 to perform printing on a printing target (such as the skin surface) in cooperation with the programs stored in the storage unit 82.

[0030] Subsequently, a display process (display method) for displaying an image of an image or the like when the agent 3, which is a concealer line, is applied onto a stain using the printing device 1 will be described. FIG. 3 is a flowchart showing the flow of this display process, and FIGS. 4 and 5 are diagrams for explaining the display process. In FIG. 4, a distance is provided between the printing apparatus 1 and the paper T for ease of understanding. However, since the influence of external light can be suppressed by covering the opening 21, it is preferable that they are actually in contact. Further, in the following description, the display process is executed by the cooperation between the printing apparatus 1 and the terminal device 8. Specifically, the terminal device 8 functions as a user interface, and the printing apparatus 1 undertakes the main process. The degree of this cooperation (the degree of sharing of the process) is not particularly limited. For example, the terminal device 8 may undertake almost all processes other than printing.

[0031] As shown in FIG. 3, first, the user attaches a cartridge (print head 41) filled with the liquid agent 3 of the concealer link to the carriage 42 of the printing apparatus 1 (step S1). Then, a test-printing paper T is placed at the printing position (coating position) facing the opening 21 (step S2; FIG. 4(a)). The paper T is not particularly limited as long as it can be coated with the liquid agent 3, but plain paper with almost no unevenness is preferable. Also, the color of the paper T is not particularly limited, and it may be white or a color close to white.

[0032] Next, the control unit 71 starts test printing (coating) on the paper T based on a user operation (step S3). Here, when the user operates the operation unit 83 of the terminal device 8, an execution command for test printing is transmitted to the printing apparatus 1 and printing (coating) is started. Then, droplets of the liquid agent 3 are ejected from the ejection unit 412 of the print head 41, and a predetermined printing pattern is printed on the paper T (FIG. 4(b)), and the printing is completed (step S4). The printing pattern at this time is not particularly limited, and it may be, for example, solid filling.

[0033] Next, while changing the illumination intensity by the illumination device 52, the imaging unit 51 captures the coating result. Specifically, first, the control unit 71 sets the lighting setting value i = 1 of the lighting device 52 (step S5). The lighting setting value i is the setting value of the illuminance by the lighting device 52, and in this embodiment, it is set in five steps (lighting setting number n = 5, lighting setting value i = 1 to 5). In this embodiment, for example, in order to be able to respond to the user's desired settings regarding brightness and the like, five levels of illuminance are provided. However, it is not necessary to provide a plurality of these setting values, and for example, one setting value may be determined in advance. Also, a plurality of lighting setting values may be provided according to the usage situation, such as an indoor mode or an outdoor mode.

[0034] Next, the control unit 71 causes the imaging unit 51 to capture an image of the printed pattern applied on the sheet T while illuminating it with the illuminance of the lighting setting value i by the lighting device 52 (step S6). At this time, in advance, the print head 41 (carriage 42) moves in the X direction from the printable position exposed from the opening 21, and the sheet T is exposed through the opening 21 to the imaging device 5 (a state where illumination and imaging by the imaging device 5 are possible) (Fig. 4(c)).

[0035] Next, the control unit 71 obtains the color coordinates CA[i] of the liquid agent 3 at the lighting setting value i based on the image obtained in step S6 (step S7). The color coordinates are color information for specifying a color and are coordinate information in a predetermined color space. The color space in this case is not particularly limited, and in this embodiment, it is RGB. When the printed pattern of the liquid agent 3 extends over a predetermined area range, the color coordinates of its representative value (for example, the average value) are obtained. The obtained color coordinates are recorded in the storage unit 72 of the printing device 1 or the storage unit 82 of the terminal device 8.

[0036] Next, the control unit 71 determines whether the lighting setting value i is equal to the lighting setting number n (that is, whether the lighting setting value i is the maximum) (step S8). If it is determined to be equal (step S8; Yes), the process proceeds to step S10 described later. On the other hand, when it is determined that the lighting setting value i is not equal to the number of lighting settings n (step S8; No), the control unit 71 increments the lighting setting value i (step S9), and then transfers the process to step S6 described above.

[0037] In this way, by repeating steps S6 to S9, the color coordinates of the print pattern for all lighting setting values i are obtained. For example, the average color coordinates for lighting setting value i = 1 are (R = 50, G = 41, B = 35), the average color coordinates for lighting setting value i = 2 are (R = 99, G = 81, B = 69), the average color coordinates for lighting setting value i = 3 are (R = 149, G = 122, B = 104), the average color coordinates for lighting setting value i = 4 are (R = 198, G = 162, B = 138), and the average color coordinates for lighting setting value i = 5 are (R = 248, G = 203, B = 173), etc., which are calculated and recorded respectively.

[0038] Next, the user applies the printing device 1 to the skin blemish P (step S10). Specifically, the user holds the printing device 1 by hand and moves it on the skin surface with the device bottom surface applied to the skin surface so that the imaging device 5 faces the skin surface through the opening 21 (Fig. 5(a)). Then, the skin surface including the blemish P is photographed, and the blemish P is detected based on the photographed image (step S11). Here, the control unit 71 controls the imaging device 5 to photograph the skin surface and obtains an image of the skin surface including the blemish P. Then, the control unit 71 analyzes the obtained image data and detects, for example, a portion having a deviation of a predetermined value or more in color shading as the blemish P. Note that the detection targets in steps S10 and S11 are not limited to the skin blemish P on the skin surface, but widely include characteristic regions (e.g., blemishes, freckles, shadows, color unevenness, etc.) having a deviation of a predetermined value or more in color shading on the skin surface. Also, the method for detecting this characteristic region is not particularly limited as long as it is based on a photographed image of the skin surface.

[0039] Next, based on the image of the skin surface acquired in step S11, the control unit 71 calculates the color coordinates SA[is] of the portion S other than the stain P (hereinafter simply referred to as "skin S") on the skin surface at an arbitrary illumination setting value is (step S12). The color coordinates SA[is] calculated here are the average values of the color coordinates of the skin S at the illumination setting value is. Note that the illumination setting value is is the illumination setting value i selected by the user from among the illumination setting numbers n, and in step S11 (or step S10 before it), the state of photographing the skin S by the photographing unit 51 is displayed on the display unit 85 of the terminal device 8, etc., and is changed to, for example, an illumination setting value of the brightness preferred by the user, an illumination setting value that the user feels easy to see, etc.

[0040] Next, the control unit 71 generates an image M when the liquid agent 3 is applied onto the stain P, and causes it to be preview-displayed on the display unit 85 of the terminal device 8 (step S13). Specifically, the control unit 71 reads out the color coordinates CA[is] at the illumination setting value is among the color coordinates CA[i] of the liquid agent 3 acquired in step S7, and generates the image M after application by superimposing the color of the color coordinates CA[is] on the portion of the stain P in the image of the skin surface acquired in step S11. Then, the control unit 71 transmits the generated image M to the terminal device 8 via the communication unit 13. Then, the control unit 81 of the terminal device 8 causes this image M to be displayed on the display unit 85 (Fig. 5(b)). At this time, the image of the skin surface acquired in step S11 may also be displayed. Note that the image M may be an image in which a region indicating the color coordinates CA[is] is superimposed on at least a part of the stain P in the image including the stain P. As a result, before printing, the user can visually recognize, based on the image M or by comparing it with an image having the stain P, the appearance when the liquid agent 3 is actually applied (such as the sense of incongruity between the liquid agent 3 and the skin S, the degree of concealment of the stain P, etc.). When displaying the finished image based on the color coordinates registered in advance for each liquid agent 3 (cosmetic ink), depending on the discoloration or deterioration of the liquid agent 3, after printing the liquid agent 3 on the skin S, a difference from the finished image will be recognized. On the other hand, with the configuration of the present embodiment, the image M reflecting the state of the liquid agent 3 at that time can be created and displayed, and the difference between the finished image caused by the state of the liquid agent 3 and the skin S on which the liquid agent 3 is printed can be suppressed.

[0041] Further, the control unit 81 causes the display unit 85 to display numerical data D including each numerical value of, for example, the color coordinates CA[is] of the liquid agent 3 at the time of the lighting setting value is, the color coordinates SA[is] of the skin S, and the difference therebetween (step S14: FIG. 5(c)). As a result, before actually printing on the skin S, the user can quantitatively recognize the difference in color between the liquid agent 3 (concealer ink) on the stain P and the skin S. That is, based on the image M and the numerical data D, it is possible to recognize not only qualitatively but also quantitatively whether the color of the liquid agent 3 at that time is not incongruous with the skin S. Note that the numerical data D may include at least one of the color coordinates CA[is] of the liquid agent 3 and the difference between these and the color coordinates SA[is] of the skin S.

[0042] At this time, the control unit 81 may cause the display unit 85 to display (output) advice regarding the use of the liquid agent 3 based on the difference between the color coordinates CA[is] of the liquid agent 3 and the color coordinates SA[is] of the skin S. For example, it may display a numerical judgment standard such as "If the difference in RGB is ○○ or less, the concealer has an effect". Alternatively, if the difference between the color coordinates CA[is] and SA[is] is greater than a predetermined threshold, it is possible that the liquid agent 3 is old (discolored and deteriorated over time). Therefore, advice to prompt replacement with a new liquid agent 3 may be displayed. Even if you don't feel any discomfort just by looking at the image M, the change over time of the liquid agent 3 may be progressing gradually. By quantitatively confirming the color coordinates of the liquid agent 3 (or the skin S) that can change gradually in this way, the user can quickly recognize the change over time of the liquid agent 3 and the color difference from the skin S. Also, if the difference between the color coordinates CA[is] and SA[is] is greater than a predetermined threshold, it is possible that the currently used liquid agent 3 does not match the current skin. Therefore, based on this difference, advice to recommend replacement with another liquid agent 3 that better suits the current state of the skin S may be displayed. Note that even if the difference between the color coordinates CA[is] and SA[is] is large, it may be possible to solve the problem by simply stirring the liquid agent 3. Therefore, advice to prompt stirring of the liquid agent 3 may be displayed first. Also, based on the difference between the color coordinates CA[is] and SA[is], an estimate of the expiration date of the liquid agent 3 may be displayed.

[0043] Also at this time, the color coordinates of the stain P may be acquired, and the color coordinates of the complementary color to this color coordinate may be displayed. The display mode is not particularly limited, and an image including a region showing the color coordinates of the complementary color may be displayed, or an image obtained by superimposing the complementary color on the stain P may be generated and displayed, or the complementary color may be simply notified to the user by characters or voice.

[0044] After that, the control units 71 and 81 end the display process. Note that if the difference between the color coordinates CA[is] and SA[is] displayed in step S14 is smaller than a predetermined threshold, or if the user approves the display content such as the image M, the printing process of actually applying the liquid agent 3 to the skin may be continued. That is, the display process may be configured as part of the printing process.

[0045] As described above, according to the first embodiment, the color information (color coordinates CA) of the printed liquid agent 3 is acquired, and an image including a region indicating this color information is displayed. Thus, unlike the conventional case where the color information of the default cosmetic ink is referred to, the state of the liquid agent 3 is displayed by referring to the color information of the actually discharged liquid agent 3. Therefore, the state of the liquid agent 3 (ink) can be quickly recognized by the user.

[0046] Also, according to the first embodiment, the color coordinates SA of the skin S excluding the stain P are acquired, and an image M of an image when the liquid agent 3 having the color coordinates CA is printed in the skin region having the color coordinates SA is displayed. Thereby, the appearance when the liquid agent 3 is actually applied can be visually recognized by the user.

[0047] Also, according to the first embodiment, the difference between the color coordinates CA of the liquid agent 3 and the color coordinates SA of the skin S excluding the stain P is displayed numerically. Thereby, the difference in color between the actually applied liquid agent 3 and the skin S can be quantitatively recognized by the user.

[0048] Also, according to the first embodiment, advice regarding the use of the liquid agent 3 is displayed based on the color coordinates CA of the liquid agent 3 and the color coordinates SA of the skin S. Thereby, the user can suitably acquire information such as the degree of the concealer effect by applying the liquid agent 3 and the necessity of replacing or stirring the liquid agent 3.

[0049] Subsequently, the printing device 9 according to the second embodiment of the present invention will be described. The printing device 9 according to the second embodiment is a nail printing device that uses the nail of a finger as a printing target and applies (prints) color ink or the like as the liquid agent 3 thereto, unlike the printing device 1 according to the first embodiment. Hereinafter, mainly the differences from the first embodiment will be described, and the same reference numerals will be given to the common components as those in the first embodiment, and the description thereof will be omitted.

[0050] As shown in Fig. 2, the main configuration of the printing device 9 is substantially the same as that of the printing device 1 according to the first embodiment. However, the printing device 9 is a handy type nail printing device, and has an opening (corresponding to the opening 21 in the first embodiment, such as circular or elliptical) on the lower surface that is close to the size of a human nail. Further, in the printing device 9, the print head 41 can individually eject, as the liquid agent 3, color inks such as cyan (C), magenta (M), and yellow (Y), and a white base ink. In inkjet printing, since the color of the base has a great influence on the color tone, if the base ink such as white is printed on the nail first, a beautiful color development can be obtained without being affected by the original color of the nail. However, in the following description, unless otherwise specified, the liquid agent 3 refers to the base ink. Note that the white base ink in this embodiment is a pigment ink mainly composed of titanium oxide. Further, the printing device 9 may be configured as a stationary type instead of a handy type. In that case, a finger fixing part (finger placement table) for fixing the finger (printing finger) having the nail to be printed and placing the nail at the printing position is provided.

[0051] Subsequently, a printing process (printing method) for performing printing on the nail using the printing device 9 will be described. Fig. 6 is a flowchart showing the flow of this printing process.

[0052] As shown in Fig. 6, first, the user attaches a cartridge (print head 41) filled with the liquid agent 3 of the base ink to the printing device 9 (step T1). Then, a test printing paper is placed at the printing position (coating position) facing the opening on the lower surface (step T2). The paper is not particularly limited as long as it can be coated with the liquid agent 3, but plain paper with almost no unevenness is preferred. Also, the color of the paper T is not particularly limited, and it may be white or a color close to it, or when the color of the ink is white as in this embodiment, it may be a color such as black to make it easier for the user to visually confirm whether the ink is normally coated.

[0053] Next, the control unit 71 starts test printing (coating) on the paper based on the user operation (step T3). Here, similar to the first embodiment, when the user operates the operation unit 83 of the terminal device 8, an execution command for test printing is transmitted to the printing device 9 and printing (coating) is started. Then, droplets of the base ink liquid 3 are ejected from the print head 41, a predetermined print pattern is printed on the paper, and the printing is completed (step T4). Note that the print pattern at this time is not particularly limited and may be, for example, solid filling.

[0054] Next, while changing the illumination intensity by the illumination device 52, the imaging unit 51 captures an image of the coating result, and based on the image, the color coordinates CA[i] of the liquid 3 (base ink) at the illumination setting value i are acquired (steps T5 to T9). The processing of steps T5 to T9 is performed in the same manner as steps S5 to S9 in the first embodiment. Thereby, the color coordinates of the print pattern at all illumination setting values i are acquired.

[0055] Next, the user applies the printing device 9 to the nail to capture the nail (step T10). Specifically, the user holds the printing device 9 by hand and moves it on the printing finger while pressing the lower surface against the printing finger so that the imaging device 5 faces the entire nail through the opening on the lower surface. Then, the printing finger is photographed, and based on the photographed image, detection of the printing area of the nail is performed (step T11). Here, the control unit 71 controls the imaging device 5 to photograph the nail to be printed and acquires the image (nail image). Then, the control unit 71 analyzes the acquired image data and detects the range of the nail (i.e., the nail contour) as the printing area to be printed. The acquired nail image and data of the printing area are recorded in the storage unit 72 of the printing device 1 or the storage unit 82 of the terminal device 8. The illumination setting value at this time is is.

[0056] Next, the control unit 71 generates an image of the liquid 3 (base ink) applied to the printing area and causes it to be preview-displayed on the display unit 85 of the terminal device 8 (step T12). Specifically, the control unit 71 reads out the color coordinates CA[is] at the time of a predetermined lighting setting value is set at that time (at the time of step T12) among the color coordinates CA[i] of the liquid agent 3 acquired in step T7, and generates an image after coating by overlapping the color of the color coordinates CA[is] within the printing area (nail contour) acquired in step T11. Then, when the control unit 71 transmits the image to the terminal device 8 via the communication unit 13, the control unit 81 of the terminal device 8 causes the display unit 85 to display this image. Thereby, before printing, the user can visually recognize, via the image, the appearance and the like when the base ink is actually applied to the nail.

[0057] Next, the control unit 81 determines whether to execute printing on the nail based on the color coordinates CA[is] of the liquid agent 3 (step T13). Here, the control unit 81 evaluates by comparing the color coordinates CA[is] of the liquid agent 3 with a predetermined threshold value set in advance, and based on this, causes the display unit 85 to display a message asking for the user's judgment (for example, "Although the finish will be slightly darker, do you want to perform color printing as it is?"). Then, the control unit 81 determines whether to execute printing on the nail based on the user operation in response to this display.

[0058] Note that in step T13, the control unit 81 may display (output) advice regarding the use of the liquid agent 3 based on the color coordinates CA[is] of the liquid agent 3. For example, depending on the value of the color coordinates CA[is], since the liquid agent 3 may be old (discolored and deteriorated over time), advice to prompt replacement with a new liquid agent 3 (base ink) may be displayed. Alternatively, since it may be solved by simply stirring the liquid agent 3 (the color coordinates CA are improved), advice to first prompt stirring of the liquid agent 3 may be displayed. Note that when the liquid agent 3 is replaced or stirred, the printing process may be executed again from the beginning.

[0059] In step T13, when it is determined not to perform printing on the nails (step T13; No), the control unit 81 proceeds to other processes. On the other hand, in step T13, when it is determined to perform printing on the nails based on a user operation (step T13; Yes), the control unit 71 performs base printing with base ink and design printing with color ink (step T14). Here, the control unit 71 controls the printing unit 4 to eject the base ink from the print head 41 to perform base printing on the printing area, and then ejects the color ink from the print head 41 to print a nail design preselected by the user operation within the printing area. Thereafter, the control units 71 and 81 end the printing process.

[0060] As described above, according to the second embodiment, the color information (color coordinates) of the printed base ink is acquired, and an image including the area indicating this color information is displayed. Therefore, even when the state of the base ink changes and its color changes, etc., the user can quickly recognize the state of the base ink.

[0061] Although the embodiments of the present invention have been described above, it goes without saying that the present invention is not limited to such embodiments, and various modifications can be made without departing from the gist thereof.

[0062] For example, in the above embodiment, color coordinates in a predetermined (RGB) color space are used as the color information according to the present invention, but the color information is not particularly limited as long as it can specify a color. If the RGB color coordinates are read, conversion to HSV or HSB representing a color in terms of three elements of hue, saturation, and lightness can be performed by a known method.

[0063] Also, in the first embodiment, in steps S13 and S14, the image image M and the numerical data D based on the color information of the liquid agent 3 are displayed. Here, however, it is sufficient that the state of the liquid agent 3 (ink) is displayed based on the color information of the liquid agent 3 (ink). The display mode at that time is not particularly limited. Also, the state of the ink may be notified by a notification means (voice output) such as a speaker.

[0064] Also, in the first embodiment, after displaying the numerical data D in step S14, the user may be able to freely arrange the image image M after application. Specifically, for example, as shown in FIG. 7, the control unit 81 causes the display unit 85 to display a concealer color adjustment bar CB corresponding to the RGB values of the numerical data D. When the adjustment bar CB is changed, the RGB values of the numerical data D and the image image M are changed correspondingly. In the example of FIG. 7, the HSV values corresponding to the RGB values and the adjustment bar CB thereof are also displayed. Also, by pressing the "complementary color" button, the RGB values and the image image that are the complementary color of the feature area may be displayed. Thereby, after the user grasps the state of the current liquid agent 3 or the like, the user can obtain the desired color information of the liquid agent 3 by adjusting the color tone of the liquid agent 3 while checking the image image M after application. That is, the user can visually and quickly recognize "what color tone of concealer suits the current skin condition (color tone)", and as a result, the efficiency of selecting ink (concealer) is improved.

[0065] Also, in the second embodiment, white ink is used for the base paint, but a base color other than white may be used. For example, an opaque color containing white such as a light pink color or a light blue color may be used as the base color.

[0066] Also, in this embodiment, the case where the printing device 1 performs printing in cooperation with the terminal device 8 is illustrated, but the printing device 1 is not limited to the one shown here, and may be configured such that the printing operation is completed alone. For example, in the present embodiment, it is assumed that the user operation is exclusively performed on the terminal device 8. However, the user may perform various operations on the operation unit and display unit of the printing device 1, and the control device of the printing device 1 may perform these processes. In this case, a touch panel type operation unit and display unit may be provided on the printing device 1.

[0067] Although some embodiments of the present invention have been described above, the scope of the present invention is not limited to the above-described embodiments, and includes the scope of the invention described in the claims and the equivalent scope thereof. The invention described in the claims first attached to the application form of this application is appended below. The claim numbers described in the appendix are as in the claims first attached to the application form of this application. 〔Appendix〕 <Claim 1> Printing means for printing a liquid agent on a printing target; Imaging means for imaging the printing target; Acquisition means for acquiring, as first color information, the color information of the liquid agent printed on the printing target imaged by the imaging means; Display means for displaying an image including a region indicating the first color information; A printing device characterized by comprising the above. <Claim 2> The display means displays an image in which a region indicating the first color information is superimposed on at least a part of the feature region in an image including at least the feature region imaged by the imaging means. The printing device according to claim 1, characterized by the above. <Claim 3> The acquisition means acquires, as second color information, the color information of a region excluding the feature region among the regions imaged by the imaging means, The display means displays the difference between the first color information and the second color information numerically. The printing device according to claim 1 or claim 2, characterized by the above. <Claim 4> Output means for outputting advice regarding the state of the liquid agent based on the first color information and the second color information displayed on the display unit. The printing apparatus according to claim 3, characterized in that. <Claim 5> The acquisition means acquires, as third color information, the color information of the feature area among the areas photographed by the photographing means. The display means displays an image including an area indicating complementary color information with respect to the third color information. The printing apparatus according to any one of claims 1 to 4, characterized in that. <Claim 6> At least a printing means for printing a liquid agent on a printing target, a photographing means for photographing the printing target, and a communication means for communicating with a printing apparatus comprising the same. Acquisition means for acquiring, as first color information, the color information of the liquid agent printed on the printing target photographed by the photographing means from the printing apparatus via the communication means. Display means for displaying an image including an area indicating the first color information. An information processing apparatus characterized by comprising. <Claim 7> The control means of the printing apparatus. A printing step of printing a liquid agent on a printing target. A photographing step of photographing the printing target. An acquisition step of acquiring, as first color information, the color information of the liquid agent printed on the printing target photographed in the photographing step. A display step of displaying an image including an area indicating the first color information. A control method for a printing apparatus, characterized by executing. <Claim 8> A computer. Printing means for printing a liquid agent on a printing target. Photographing means for photographing the printing target. Acquisition means for acquiring, as first color information, the color information of the liquid agent printed on the printing target photographed by the photographing means. Display means for displaying an image including an area indicating the first color information. A control program for a printing apparatus, characterized by causing it to function as such.

Explanation of symbols

[0068] 1, 9 Printing apparatus 3 Liquid agent (ink) 4 Printing unit (printing means) 5 Photographing apparatus (photographing means) 7 Control apparatus 8 Terminal device 41 Print head 51 Photographing apparatus 52 Lighting device 71 Control unit (acquisition means) 80 Control apparatus 81 Control unit 84 Communication unit (communication means) 85 Display unit (display means, output means) D Numerical data i Lighting setting value M Image n Number of lighting settings P Shimi (feature area) S Skin CA Color coordinates of the liquid agent (first color information) SA Color coordinates of the skin (second color information) T Paper

Claims

Claim 1: When a printing medium for test printing is set as the printing target, by taking pictures under each of a plurality of different lighting conditions when taking pictures with a predetermined imaging means, a first acquisition means for acquiring color information of the liquid agent printed on the printing medium for test printing for each of the lighting conditions; When a human skin is set as the printing target, before printing the liquid agent on the human skin, by taking pictures with the imaging means under the lighting condition selected by the user from the plurality of lighting conditions, a second acquisition means for acquiring an image of the human skin before the liquid agent is printed; When displaying a preview image obtained by applying the image of the human skin before the liquid agent is printed and assuming that the liquid agent is printed, a display control means for applying the color information obtained by taking pictures under the same lighting condition as the lighting condition selected by the user from the color information obtained by the first acquisition means to the liquid agent and displaying the preview image; A printing support device, characterized by comprising the above. Claim 2: An output control means for outputting predetermined advice information based on the image of the human skin before the liquid agent is printed and the color information obtained by taking pictures under the same lighting condition as the lighting condition selected by the user from the color information obtained by the first acquisition means. The printing support device according to claim 1, characterized by comprising the above. Claim 3: A printing support method executed by a printing support device, A first acquisition process for acquiring color information of the liquid agent printed on the printing medium for test printing for each of the lighting conditions by taking pictures under each of a plurality of different lighting conditions when taking pictures with a predetermined imaging means when a printing medium for test printing is set as the printing target; A second acquisition process for acquiring an image of the human skin before the liquid agent is printed by taking pictures with the imaging means under the lighting condition selected by the user from the plurality of lighting conditions before printing the liquid agent on the human skin when the human skin is set as the printing target; A display control process for displaying the preview image by applying the color information obtained by taking pictures under the same lighting condition as the lighting condition selected by the user from the color information obtained by the first acquisition process to the liquid agent when displaying a preview image obtained by applying the image of the human skin before the liquid agent is printed and assuming that the liquid agent is printed; A printing support method characterized by including

4. When a printing medium for test printing is set as a printing target, a computer is caused to perform imaging by means of a predetermined imaging means under each of a plurality of different illumination conditions during imaging, thereby obtaining color information of a liquid agent printed on the printing medium for test printing for each of the illumination conditions, a first acquisition means When a human skin is set as the printing target, before printing the liquid agent on the human skin, by imaging with the imaging means under the illumination condition selected by the user from the plurality of illumination conditions, a second acquisition means for obtaining an image of the human skin before the liquid agent is printed When a preview image in which the liquid agent is hypothetically printed by applying the image of the human skin before the liquid agent is printed is to be displayed, display control means for applying the color information obtained by imaging under the same illumination condition as the illumination condition selected by the user among the color information obtained by the first acquisition means to the liquid agent and displaying the preview image A program characterized by functioning as ​

Images