Electronic device, determination method, and recording medium

Abstract

The present application provides an electronic device, a determination method, and a recording medium, which can suppress reduction in recognition accuracy of a printed object. The electronic device includes an image acquisition unit that acquires a nail image containing a nail as a printed object and a photographed image containing a specific portion whose state changes over time, and a determination unit that determines the state of the specific portion by comparing a comparison image obtained by photographing a range containing a first state of the specific portion and the photographed image.

Description

Technical Field

[0001] This invention relates to electronic devices, determination methods, and recording media. Background Technology

[0002] In recent years, printing devices (nail printing devices) have been developed for printing various designs on objects such as human fingernails.

[0003] In such a printing apparatus, it is necessary to position fingers, such as fingernails, which are the objects of printing, in specific positions and to print based on proper alignment.

[0004] For example, Patent Document 1 describes a mirror placed near the part where the printing object is arranged in order to facilitate the alignment of the printing object (e.g., fingernail).

[0005] Existing technical documents

[0006] Patent documents

[0007] Patent Document 1: JP 2020-103448

[0008] However, the area around the printed object, such as the mirror or other printed objects, can become dirty due to ink splattering during printing or contact with fingers. If the area around the printed object becomes dirty, it may affect the identification of the printed object. Summary of the Invention

[0009] The present invention was made in view of the above-mentioned circumstances, and its object is to provide an electronic device, a determination method, and a recording medium that can suppress the reduction of the recognition accuracy of printed objects.

[0010] To address the aforementioned problem, one aspect of the electronic device of the present invention is characterized by comprising: a placement table for placing a nail as a printing object and a finger corresponding to the nail; an imaging unit for acquiring an image of the finger including the nail; an auxiliary reflective unit for assisting in the imaging of the finger placed on the placement table; an image acquisition unit for acquiring a first image obtained by imaging a specific portion including the placement table and the auxiliary reflective unit when the placement table is not configured with the finger including the nail, and acquiring a second image obtained by imaging the placement table from a direction different from the imaging direction of the first image via the auxiliary reflective unit when the placement table is not configured with the finger including the nail; and a determination unit for determining whether the placement table and / or the auxiliary reflective unit in the specific portion changes over time by comparing a comparison image obtained by imaging a range including the specific portion in the first state with each of the first image and the second image.

[0011] The effects of the invention

[0012] According to the present invention, it can suppress the reduction of the recognition accuracy of printed objects. Attached Figure Description

[0013] Figure 1 This is a perspective view showing the main parts of the external structure of the printing apparatus according to this embodiment.

[0014] Figure 2 This is a block diagram showing the main parts of the control structure of the printing apparatus and the terminal device that cooperates with it according to this embodiment.

[0015] Figure 3 This is a top view showing an example of a finger image obtained by photographing a finger including the fingernail.

[0016] Figure 4 This is a top view representing an example of an image used for comparison.

[0017] Figure 5 This is a top view showing an example of a captured image.

[0018] Figure 6 This is a top view showing an example of a captured image.

[0019] Figure 7 This is a flowchart illustrating the determination process in this embodiment. Detailed Implementation

[0020] refer to Figures 1 to 7 This invention will be used to illustrate one embodiment of the electronic device, determination method, and recording medium involved in the present invention.

[0021] Furthermore, in the embodiments described below, various technically preferred limitations have been added for the purpose of implementing the invention, but the scope of the invention is not limited to the following embodiments and illustrated examples.

[0022] Furthermore, in the following embodiments, an example will be described using a printing device (fingernail printing device) that prints onto the fingernails or similar objects. However, the electronic device of the present invention is not limited to printing devices that print onto fingernails or similar objects.

[0023] Figure 1 This is a perspective view showing the main external structure of the printing apparatus, which is the electronic device in this embodiment. Figure 2 This is a block diagram illustrating the functional structure of the printing apparatus and the terminal device that cooperates with it in this embodiment.

[0024] Furthermore, in the following embodiments, up and down, left and right, and front and back refer to... Figure 1The orientation shown is as indicated. Furthermore, the X and Y directions refer to... Figure 1 The directions indicated by etc.

[0025] like Figure 1 As shown, the printing device 1 has a housing 2 that is formed in a generally box shape.

[0026] On the front side of the outer casing 2 (the front side of the printing device 1, Figure 1 The lower part of the (front side) is formed in the left-right direction (the horizontal direction of the printing device 1, the middle front side) Figure 1 An opening 21 is formed approximately at the center of the device (in the left-right direction and the X direction). The opening 21 has a width that allows a finger to enter and exit the device. The opening 21 may also have a width that allows a hand to enter and exit the device.

[0027] An operation section 22 is provided on the upper surface (top plate), sides, etc. of the outer casing 2. The operation section 22 is a functional part for users to perform various inputs. In this embodiment, an example is shown where the operation section 22 is provided on the upper surface of the outer casing 2.

[0028] The operation unit 22 may be, for example, a power switch button that turns on the power to the printing device 1, or a stop switch button that stops the operation. If the operation unit 22 is operated, an indication signal corresponding to the operation will be output to the control unit 11, which will be described later.

[0029] In addition, the example shown in the figure shows the operation unit 22 consisting of a single button, but the operation unit 22 may also consist of multiple buttons or the like provided on the upper surface of the housing 2.

[0030] Furthermore, when the touch panel is integrally formed on the surface of the display unit 6 (described later), the touch panel also functions as the operation unit 22.

[0031] In addition, a display unit 6 is provided on the outer casing 2. In the example shown in the figure, the display unit 6 is arranged on the upper surface (top plate) of the outer casing 2.

[0032] Display unit 6 is a display unit that displays various screens based on image data output from control unit 11 (described later). The size and specific location of display unit 6 are not limited to the example shown in the figure.

[0033] The display unit 6 may be composed of, for example, a liquid crystal display (LCD), an organic light-emitting diode (OLED), or other flat panel displays. Alternatively, a touch panel may be integrally formed on the surface of the display unit 6. In this case, the touch panel also functions as the operation unit 22.

[0034] In this embodiment, a finger image PI (hereinafter referred to as the first finger image PIt, the second finger image PIs, and the reference image PIs) is obtained by photographing a finger U containing a fingernail T disposed in the printing apparatus 1. Figure 3 The images are displayed on the display unit 6. Additionally, as described later, in this embodiment, the camera 51 captures an area including the "specific portion," obtaining captured images PT (the first captured image PTt, the second captured image PTs, and the reference image PTs, described later). Figure 5 , Figure 6 The captured image PT can be displayed on the display unit 6. Additionally, a comparison image PS (first comparison image PST, second comparison image PSs, and reference image PSs, described later) can be displayed on the display unit 6 to visually confirm the range of the captured "specific portion" including the initial state (first state). Figure 4 Compare the captured image PT with the image and display them side by side.

[0035] The content displayed on the display unit 6 is not limited to images such as finger images (PI). For example, the display unit 6 may also display nail designs input / selected by the user from the operation unit 22, various instructions, guidance, warnings, etc.

[0036] Furthermore, in this embodiment, as described later, the control unit 11, which is a determination unit, determines the state of a "specific part" (the state of stains in this embodiment), and the display unit 6 also functions as a notification unit that notifies the user of the response in accordance with the determination result.

[0037] Inside the outer casing 2, at a position corresponding to the opening 21, there is a finger configuration part 3 for configuring a finger U that is inserted from the opening 21.

[0038] The finger placement section 3 has a placement section body 31 that serves as the part for mounting the finger U. The central portion of the placement section body 31 in the width direction is slightly recessed along the long side direction, thereby stably mounting the finger U. In addition, a cushioning member made of a soft material such as resin may be provided in the placement section body 31.

[0039] The front side of the configuration unit 3 ( Figure 1 The front side of the finger in the Y direction is surrounded by a frame-shaped part 32. The top surface of the frame-shaped part 32 is disposed on the upper side of the finger U of the finger placement part 3, and functions as a finger pressure to constrain the position of the finger U in the upper direction.

[0040] For the inside of the configuration section 3 ( Figure 1 The surface of the nail T of the finger U, which is inserted into and positioned within the finger configuration section 3 from the opening 21, is exposed (inside the Y direction of the finger).

[0041] Furthermore, a top contact portion 33 is provided on the inner side of the finger placement portion 3. The front end of the finger U disposed in the finger placement portion 3 abuts against the top contact portion 33. When the nail T is longer than the front end of the finger U, the front end of the nail T will hook onto the top contact portion 33 and also function as a nail holder.

[0042] Furthermore, the frame-shaped portion 32 and the top joint portion 33 are not mandatory. The structure can also be configured without the frame-shaped portion 32 and the top joint portion 33.

[0043] Furthermore, a mirror 35 is disposed near the position of the finger U. In this embodiment, the mirror 35 is provided on the left side of the main body 31 of the configuration section. However, the number and placement of the mirrors 35 are not limited to this, and mirrors may also be provided on the right side of the main body 31 of the configuration section, the front end side of the finger U, etc.

[0044] Mirror 35 can be, for example, a mirror made of synthetic resin such as acrylic resin in the substrate. Furthermore, the material of mirror 35 is not particularly limited; for example, it can be a glass mirror in the substrate.

[0045] The mirror 35 is an auxiliary reflective part used to assist in capturing images of the finger U disposed on the finger arrangement unit 3 when the camera 51, described later, is used. Specifically, the mirror 35 is an optical element that can capture images of the finger from a direction different from the direction that the camera 51 can directly capture (e.g., the upward direction) within the shooting range of the camera 51.

[0046] Since the camera 51 can obtain an image of the fingernail T from a horizontal perspective via the mirror 35, it can detect the position of the fingernail T in the height direction.

[0047] The pointer configuration unit 3 and the mirror 35 are "specific parts" in this embodiment. As "specific parts", the pointer configuration unit 3 and the mirror 35 change their state over time.

[0048] The state of a "specific part" is, for example, the state of stains on a "specific part". As will be described later, in this embodiment, the printing device 1, which is an electronic device, is equipped with a print head 41 that sprays ink for printing, and the ink (ink mist, etc.) is scattered during printing.

[0049] As a "specific part," the state of the finger placement section 3 and the mirror 35 changes over time due to the adhesion of ink (such as ink mist from the nail T that did not hit the object being printed), sebum from the finger U placed inside the device, and various dust particles. (In addition, in Figure 5 , Figure 6(The image shows the appearance of the attached stain D). Furthermore, the reasons for the change in the state of the "specific part" over time are not limited to those shown here. For example, it is also conceivable that ink may adhere to the ink surface when it comes into contact with the finger arrangement part 3 or the mirror 35 during disassembly or assembly from the device, such as when replacing the print head 41.

[0050] In this embodiment, the camera 51 (described later) captures images of the finger U, including the nail T, disposed on the finger placement unit 3, and the captured images (finger image PI, described later, reference image PI) are obtained from the captured images. Figure 3 Identify (detect) the shape and position of the nail T as a printed object.

[0051] Therefore, the placement section 3, especially the main body 31 of the placement section for mounting the finger U, or its surrounding area, is formed of a component of a color that is easily distinguishable from skin tone, such as black, so that the contrast with the nail T, etc., becomes clear (see reference). Figures 3-6 ).

[0052] For example, if the finger placement part 3, which is a "specific part", becomes dirty due to ink or the like, the black component gradually turns white, thereby reducing the contrast and making it difficult to identify the outline of the area that defines the nail T.

[0053] Furthermore, if mirror 35 becomes dirty due to ink or other reasons, the image reflected in mirror 35 becomes unclear, making it difficult to obtain an image from the photographing mirror 3 (hereinafter referred to as image PI (second refers to image PIs), reference). Figure 3 Identify (detect) nail T as a printed object.

[0054] Therefore, when specific parts such as the finger assembly section 3 and mirror 35 become dirty, it is preferable to remove stain D (see reference). Figure 5 , Figure 6 ).

[0055] Figure 2 This is a block diagram showing the main parts of the control structure of the printing apparatus and the terminal device cooperating therewith in this embodiment.

[0056] like Figure 2 As shown, in addition to the aforementioned operation unit 22 and display unit 6, the printing apparatus 1 also includes a printing mechanism 4, a shooting unit 5, and a communication unit 25.

[0057] The shooting unit 5 is equipped with a camera 51 and a light source 52.

[0058] The camera 51 and the light source 52 are surrounded by a protective member (not shown) made of a transparent resin material such as an acrylic sheet, so that stains such as ink (ink mist) will not directly adhere to the lens of the camera 51.

[0059] Furthermore, the shape and range of the protective member are not particularly limited, but it is preferable to place it at least on the side opposite to the finger placement part 3 in both the camera 51 and the light source 52. In addition, the material forming the protective member is not limited to acrylic sheet. The protective member can be made of glass, for example, as long as it does not obstruct the shooting by the camera 51 or the illumination by the light source 52.

[0060] The camera 51 is, for example, a small imaging device equipped with a solid-state imaging element and lens with at least 2 million pixels. It is an image acquisition unit that captures various images of a finger U including a fingernail T, a finger placement section 3 as a "specific part", a mirror 35, etc., arranged in the printing device 1. Furthermore, the light source 52 is, for example, a white LED or other illumination lamp.

[0061] The imaging unit 5 illuminates the object to be photographed, such as the finger U, nail T, and "specific part," which is placed on the finger placement unit 3, using the light source 52. Then, the camera 51 captures images of the finger U, "specific part," etc., to obtain a finger image PI (an image of the finger U including the nail image, a reference image, etc.). Figure 3 ), captured image PT (image containing "specific parts" but excluding finger U, nail T, reference) Figure 5 , Figure 6 (Images of the subject being photographed).

[0062] Figure 3 This is an example of a finger image captured by a camera.

[0063] In this embodiment, the camera 51 is disposed on the inner side of the upper surface of the printing apparatus 1, etc. Figure 3 As shown, it is possible to obtain the finger image PI (upper surface image, first finger image PIt, reference) when viewing finger U from above. Figure 3 (on the right side).

[0064] Furthermore, the camera 51 is configured to acquire finger images PI (in this embodiment, finger images when viewing finger U from the side, side images, second finger images PIs, and reference images PIs) that are captured by the mirror 35, which serves as an auxiliary reflector, within the capture range. Figure 3 (Left side).

[0065] Thus, by capturing images not only directly from the position of the camera 51 but also via the mirror 35, without changing the position or angle of the camera 51 itself, images of the finger when viewed from multiple directions (upward in this embodiment) can be obtained through shooting from one direction. Furthermore, the shooting itself can be performed once, or it can be performed multiple times by changing the illuminance and focus of the light source 52.

[0066] In the case where image data can be obtained that includes the first finger image P1t (upper surface image) and the second finger image P1s (side view image) in a single image, for example, it can be done as follows: Figure 3 As shown, the first finger image P1t (top surface image) and the second finger image P1s (side image) are displayed side by side as a single image on the display unit 6, etc.

[0067] Alternatively, the first finger image P1t (top surface image) and the second finger image P1s (side image) can be extracted from a single image and displayed separately on the display unit 6. Furthermore, the first finger image P1t (top surface image) and the second finger image P1s (side image) can be obtained as different images and displayed separately on the display unit 6.

[0068] Furthermore, in this embodiment, such as Figure 5 as well as Figure 6 As shown, in the state where the finger U containing the nail T is not configured, the imaging unit 5 captures the finger configuration part 3 and its surrounding area to obtain an image PT containing a "specific part". That is, it can obtain an image PT of the surrounding area of ​​the finger configuration part 3 viewed from above (upper surface image, first image PTt, reference). Figure 5 , Figure 6 The images PT (side image, second image PTs, reference image) taken from the right side of the finger arrangement unit 3 and from the periphery of the finger arrangement unit 3 viewed laterally via mirror 35. Figure 5 , Figure 6 (Left side).

[0069] The captured image PT is an image required for determining (diagnosing) the condition of stains on a "specific part". The timing for obtaining the captured image PT is, for example, when the use of each day begins (e.g., when the power is turned on), when the user switches to using the printing device 1, or when the printing device 1 has exceeded a certain cumulative usage time, etc.

[0070] In addition, image data such as the finger image PI and the captured image PT obtained by the imaging unit 5 can be stored in the storage unit 12, which will be described later.

[0071] Furthermore, in this embodiment, the comparison images PS obtained by the camera 51 of the imaging unit 5, which capture a range including the "specific part" of the first state, are (the comparison image PS pointing to the periphery of the arrangement unit 3 when viewed from above, i.e., the first comparison image PSt, and the comparison image PS pointing to the periphery of the arrangement unit 3 when viewed from the side, i.e., the second comparison image PSs, and the comparison image PS pointing to the periphery of the arrangement unit 3 when viewed from the side, are referenced). Figure 4 ) are stored in storage unit 12, etc., which will be described later.

[0072] Here, "first state" refers to, for example, the initial state of the printing apparatus 1 when it leaves the factory, or the state before the user uses the device. The comparison image PS is obtained, for example, in the stage before leaving the factory and stored in the storage unit 12.

[0073] Furthermore, the comparison image PS can be any image of a state where no stain D is attached to the "specific part" such as the finger placement section 3. The timing of acquiring the comparison image PS by capturing a range including the "specific part" of the first state is not limited to the factory delivery stage (before or at the factory delivery stage). For example, the comparison image PS can also be acquired after the printing device 1 is delivered to the user and before the printing operation.

[0074] Since the comparison image PS is to be compared with the captured image PT, it is preferable to take the image under the same conditions as when the captured image PT was taken (e.g., illumination, angle at which the image was taken).

[0075] Printing facility 4, etc. Figure 2 As shown, it includes a printing head 41, an X-direction moving motor 45 as a head moving unit, and a Y-direction moving motor 47 (see reference). Figure 2 )wait.

[0076] The printhead 41 in this embodiment is an inkjet printing unit. The surface facing the nail surface (the lower surface) becomes an ink ejection surface (not shown) equipped with multiple nozzles for ejecting ink. Ink is micro-dropletized and directly sprayed (ejected) from the ink ejection surface onto the nail surface for printing. Furthermore, the specific ink ejection method is not particularly limited. Moreover, the structure of the printhead 41 is not particularly limited; for example, it can be a cartridge-integrated printhead where the ink ejection surface and other ejection mechanism are integrated with the ink cartridge for storing ink.

[0077] The printhead 41 can eject colored inks such as cyan (C), magenta (M), and yellow (Y). Furthermore, the type and number of printheads 41 are not particularly limited. For example, in addition to printheads that eject colored inks as described above, there may also be printheads for printing a substrate (such as white ink) before printing the design.

[0078] The X-direction moving motor 45 constitutes an X-direction moving mechanism that moves the print head 41 in the left-right direction (X-direction) of the device, and the Y-direction moving motor 47 constitutes a directional moving mechanism that moves the print head 41 in the front-back direction (Y-direction) of the device. The X-direction moving motor 45 and the Y-direction moving motor 47 are, for example, stepper motors, and are suitably used to move the print head 41 in the XY direction.

[0079] In addition, the printing mechanism 4 has a position detection sensor 48 for detecting the position of the print head 41. The position detection sensor 48 may be, for example, an origin sensor that detects the origin position of the print head 41 in the X and Y directions, or an encoder sensor that monitors the movement of the print head 41.

[0080] In addition, there are no particular limitations on the specific type or structure of the position detection sensor 48.

[0081] Furthermore, in this embodiment, the printing apparatus 1 acquires data such as the design (nail design) to be printed on the nail T via an external device, and the printing apparatus 1 has a communication unit 25 for transmitting and receiving information with the external device. Here, the external device is, for example, the terminal device 8 described later or various servers.

[0082] Communication between the printing device 1 and external devices is conducted, for example, via a wireless LAN. However, the communication between the printing device 1 and external devices is not limited to this and can be conducted in any manner. For example, a network line such as the Internet can be used, or wireless communication based on short-range wireless communication standards such as Bluetooth (registered trademark) and Wi-Fi can be performed. Furthermore, this communication is not limited to a wireless connection; it can also be configured to allow for the transmission and reception of various data between the two via a wired connection. The communication unit 25 includes communication methods for various external devices intended for communication, antenna chips corresponding to communication standards, etc.

[0083] The control unit 10 mounted on the printing apparatus 1 is a computer having a control unit 11 with a processor such as a CPU (Central Processing Unit) (not shown) and a storage unit 12 (not shown) with ROM (Read Only Memory) and RAM (Random Access Memory) (both not shown).

[0084] The storage unit 12 stores various programs and data for operating the printing device 1 in the ROM or the like.

[0085] In particular, in this embodiment, the comparison images PS taken at the factory (i.e., the first comparison image PSt, viewed from above, showing the periphery of the pointer arrangement 3, and the second comparison image PSs, viewed from the side, showing the periphery of the pointer arrangement 3, and reference images PSs) are used for comparison. Figure 4 The data is stored in a non-volatile memory in the storage unit 12 that will not be reset even if the power is cut off.

[0086] The control unit 11 expands and executes various programs stored in ROM, which functions as a storage medium, in the working area of ​​RAM, thereby comprehensively controlling the operation of each part of the printing apparatus 1.

[0087] That is, the control unit 11 works in conjunction with programs (such as printing processing applications, decision processing applications, etc.) to perform various functions such as enabling the printing device 1 to perform printing or decision processing in this embodiment.

[0088] In addition, the functions of the control unit 11 can be implemented by having the control unit 11 execute programs (software), or by using dedicated modules (hardware).

[0089] In this embodiment, the control unit 11 functions primarily as a printing control unit for controlling the operation of each part of the printing mechanism 4, a shooting control unit for controlling the operation of each part of the shooting unit 5, and a display control unit for controlling the operation of the display unit 6. In addition, it also functions as a determination unit for determining the state (stain condition, etc.) of a "specific part" from an image.

[0090] The control unit 11, which serves as the printing control unit, operates the printing head 41 of the printing mechanism 4 and various motors (X-direction movement motor 45, Y-direction movement motor 47, etc.) to print various designs (nail designs) on the nail T of the finger U arranged in the finger arrangement unit 3 according to the printing data. In addition, the printing data can be generated in the control unit 11 or received from external devices such as the terminal device 8 via the communication unit 25.

[0091] The control unit 11, which is the display control unit, controls the operation of the display unit 6 and displays various image data.

[0092] Furthermore, the control unit 11, which is a display control unit, causes the display unit 6 to display various messages, warnings, etc., in accordance with the determination result of the control unit 11, which is a determination unit, so that the display unit 6 functions as a notification unit that responds to user notifications and determination results.

[0093] Furthermore, the control unit 11, which serves as the shooting control unit, controls the operation of the camera 51 and the light source 52 of the shooting unit 5 to acquire index images (PI), captured images (PT), etc.

[0094] In addition, for various stains D (see reference) adhering to "specific parts" such as the finger assembly part 3 and the mirror 35 Figure 5 , Figure 6Imagine various appearances and reflective forms, such as those easily visible under high illumination and those easily visible under slightly reduced illumination. Therefore, the control unit 11, acting as the shooting control unit, controls the shooting unit 5 to change the illumination (illuminance condition) of the light source 52 and other shooting conditions to perform multiple shots, so that when shooting image PT, an image can be obtained under the optimal shooting conditions corresponding to each stain D.

[0095] The control unit 11, which is the determination unit, determines the state of the "specific part" (the stain condition in this embodiment) by comparing a comparison image PS (first comparison image PSt, second comparison image PSs) obtained by capturing the range of the "specific part" in the first state (initial state) with a capture image PT (an image capturing the current state of the area around the pointer 3 in the state of not being configured, the first capture image PTt, and the second capture image PTs) that contains the "specific part".

[0096] The method for determining the stain condition of a "specific part" performed by the control unit 11 as the determination unit is not particularly limited. It uses a difference method (comparison method) to evaluate the difference between the current state image, i.e., the captured image PT (first captured image PTt, second captured image PTs), and the normal state (clean state before it becomes dirty due to use), i.e., the comparison image PS (first comparison image PSt, second comparison image PSs).

[0097] Furthermore, considering the different optimal image processing conditions for each "specific part" such as the pointer configuration unit 3 and the mirror 35, the control unit 11 preferably crops each "specific part" from the image and compares the same parts with each other.

[0098] The specific processing method of the difference method (comparison method) is not particularly limited, but a difference filter is used to extract the part of the image in the captured image PT that changes from the first state (initial state) state, i.e. the part in the comparison image PS, by using a difference filter to output the difference image of the gray level difference obtained by superimposing the comparison image PS and the image being captured.

[0099] For example, the RGB values ​​of the image PS and the captured image PT are compared point by point (dots), and the differences between points with grayscale differences (differences in the intensity and brightness of each RGB color) are extracted. Additionally, in Figures 4-6 In this illustration, for ease of understanding, the smallest unit (e.g., 1 pixel, 1 dot, etc.) for comparing images is shown schematically using a grid, but the actual objects being compared are much smaller grid units.

[0100] By extracting the difference between the comparison image PS and the captured image PT in this way, it is possible to identify the parts that have changed from the first state (initial state).

[0101] In this embodiment, a threshold for determining the condition of stains is predetermined, and the control unit 11, which is the determination unit, determines the condition of a "specific part" based on this threshold.

[0102] That is, for example, if the area of ​​the detected difference region in the whole image (total area, total points) exceeds a certain threshold and becomes a certain area value, the control unit 11 determines that the stain condition is of a degree that needs to be cleaned.

[0103] Furthermore, the criteria for determining the stain condition of the control unit 11, which serves as the determination unit, are not limited to the size of the detected difference area. For example, the size of the difference (i.e., the intensity of the stain) can also be used as the determination criteria, and the stain condition can be determined by considering both the size of the area and the size of the difference.

[0104] Furthermore, it is appropriate to set a threshold for determining the area value and the magnitude of the difference that requires cleaning. In addition, the threshold can be set to different values ​​in the first captured image PTt obtained around the periphery of the shooting pointer 3 and the second captured image PTs obtained by the shooting lens 35.

[0105] Furthermore, the control unit 11 can also function as a print data generation unit. By performing image processing on the finger image PI, it detects the nail outline of the area of ​​the nail T of the finger U disposed in the finger placement unit 3 from the finger image PI, and generates print data by matching the desired design (nail design) to the inner area of ​​the nail outline. In this case, various corrections can be made to the print data according to the curvature of the nail.

[0106] Specifically, the control unit 11 cuts out the image data of the design (nail design) selected by the user, performs appropriate enlargement and reduction, configuration adjustments, etc., and adapts it to the nail outline obtained from the finger image.

[0107] Furthermore, having obtained information such as the curvature of the nail T, the control unit 11 can perform appropriate surface corrections on the printing data based on the curvature of the nail T. After surface corrections are performed, printing data that better matches the shape of the nail can be generated.

[0108] Furthermore, the printing apparatus 1 of this embodiment cooperates with the terminal device 8, which is an external device.

[0109] In this embodiment, the terminal device 8 is envisioned as a portable terminal device such as a smartphone or tablet. Furthermore, the terminal device 8 is not limited to smartphones, as long as it can communicate with the printing device 1. For example, it could also be a gaming terminal device.

[0110] like Figure 2As shown, the terminal device 8 includes an operation unit 83, a communication unit 84, a display unit 85, a control unit 80, etc.

[0111] The operation unit 83 can perform various inputs / settings in response to user operations. If the operation unit 83 is operated, an input signal corresponding to that operation is sent to the control device 80. In addition, in this embodiment, a touch panel is integrally provided on the surface of the display unit 85, and the user can also perform various inputs / settings by touching the touch panel.

[0112] Furthermore, the operation unit 83, which performs various input / setting operations, is not limited to a touch panel. For example, it can be configured as various operation buttons, a keyboard, a pointing device, etc.

[0113] Furthermore, various inputs and settings can be performed on the printing apparatus 1 by operating the operation unit 83 of the terminal device 8. For example, the printing operation of the printing apparatus 1 can be started by the user operating the operation unit 83.

[0114] The communication unit 84 is a communication unit that communicates with the communication unit 25 of the printing apparatus 1. For example, the communication unit 84 receives data such as finger image PI and captured image PT obtained by the camera 51 capturing a finger containing a fingernail disposed in the printing apparatus 1 from the printing apparatus 1.

[0115] The communication unit 84 includes a wireless communication module that enables communication with the communication unit 25 of the printing device 1.

[0116] In addition, as long as the communication unit 84 can communicate with the printing device 1, a communication unit that conforms to the communication standard of the communication unit 25 of the printing device 1 can be used.

[0117] The display unit 85 may be composed of, for example, a liquid crystal display (LCD), an organic light-emitting diode display (OLED), or other flat panel displays. Under the control of the control unit 81, the display unit 85 may display, for example, images based on various image data, message screens for the user, various guide screens, warning display screens, etc.

[0118] Message screens and warning screens for users can also be displayed on the display unit 6 of the printing device 1, or displayed on the display unit 85 of the terminal device 8 instead of the display unit 6.

[0119] For example, when the control unit 11, which serves as the determination unit, determines the condition of the stain, a notification screen indicating the response to the user is displayed on the display unit 85 of the terminal device 8 based on the determination result. In this case, the display unit 85 of the terminal device 8 functions as the notification unit.

[0120] Alternatively, as mentioned above, a touch panel for various inputs can be integrally formed on the surface of the display unit 85. In this case, the touch panel also functions as an operation unit 83.

[0121] The control device 80 is a computer that includes a control unit 81 consisting of a CPU (Central Processing Unit) (not shown) and a storage unit 82 consisting of ROM (Read Only Memory) and RAM (Random Access Memory) (not shown).

[0122] The storage unit 82 stores various programs and data used to operate the various parts of the terminal device 8.

[0123] Specifically, in the ROM of this embodiment, in addition to storing the operation program for comprehensively controlling each part of the terminal device 8, various programs (not shown) such as printing processing application program and display control processing application program for performing printing processing using the printing device 1 are also stored. The control device 80 expands and executes these programs in, for example, the working area of ​​RAM to control the terminal device 8.

[0124] In addition, the storage unit 82 can store data on the design (nail design) for nail T printing in the printing device 1.

[0125] The control unit 81 comprehensively controls the operation of each part of the terminal device 8. The control unit 81, in conjunction with the program (printing processing application, etc.) stored in the storage unit 82, realizes various functions such as processing for printing of the printing device 1 and displaying images for display on the display unit 85.

[0126] Next, refer to Figure 7 The determination method of this embodiment will be explained below.

[0127] Figure 7 This is a flowchart illustrating the determination process in this embodiment.

[0128] In this embodiment, as described above, the determination process for the state (stain condition) of "specific parts" such as the indicator unit 3 and the mirror 35 is performed before the start of a printing operation for one day, when the power is turned on, when the user switches to the printing device 1, and when the printing operation for one day ends.

[0129] Specifically, firstly, the camera 51 of the shooting unit 5 captures the periphery of the pointer configuration unit 3 as a "specific part" (the periphery of the pointer configuration unit 3 in the state of not having a pointer U), and obtains the captured image PT (first captured image PTt, second captured image PTs) (step S1, image acquisition process).

[0130] The captured image PT is preferably captured multiple times while changing shooting conditions such as the illuminance of the light source 52, resulting in multiple captured images PT under different conditions. It is appropriate to set the conditions and the number of shots to be taken. The captured images PT are acquired by the control unit 11.

[0131] If the captured image PT is obtained, the control unit 11, which is the determination unit, reads the comparison image PS (first comparison image PST, second comparison image PSs) from the storage unit 12, compares the comparison image PS and the captured image PT in each corresponding part, and calculates their difference (step S2, determination process).

[0132] When taking multiple shots under varying conditions, the total number of captured images (PT) is compared with the image (PS) used for comparison.

[0133] Specifically, regarding each captured image PT, the first captured image PTt, viewed from above, is compared with the first comparative image PST, viewed from the same direction; and the second captured image PTs, viewed from the side, is compared with the second comparative image PSS, viewed from the same direction.

[0134] Then, the control unit 11 obtains the total area of ​​the points that were detected as differences by comparing with the first image PTt and the second image PTs, respectively.

[0135] The control unit 11 determines whether there is a change above a threshold in the captured image PT during comparison with the comparison image PS. That is, it compares the image with the comparison image PS to determine whether the number of points generating differences is greater than a predetermined threshold (step S3). Then, if there is no change above the threshold (step S3; "No"), the determination process ends and the system moves to standby mode (step S4). Specifically, if a printing action instruction is received after this, the printing action of the printing mechanism 4 is started. If the power is cut off, all actions are stopped in this state.

[0136] For example, in each captured image PT (first captured image PTt, second captured image PTs) such as Figure 5If the area is only slightly dirty as shown, the total area of ​​the detected differential points is also small and does not exceed the threshold (step S3; "No"). In this case, it is not to the extent that the user should clean the device, and the printing apparatus 1 can continue to be used in this state.

[0137] On the other hand, if there is a change above a threshold in the captured image PT (step S3; "Yes"), the control unit 11 determines that the area around the pointer configuration unit 3, which is a "specific part", is dirty (step S5), and displays a message prompting the user to clean it on the display unit 6 of the printing device 1, and informs the user of the corresponding response to the determination result (step S6). In addition, at this time, the same display can also be performed on the display unit 85 of the terminal device.

[0138] For example, in each captured image PT (first captured image PTt, second captured image PTs) as Figure 6 As shown, when the area around the finger placement part 3 of the component, which was originally black, turns white due to ink (see reference). Figure 6 In the case where the "first captured image PTt" and the lens 35 becomes so dirty that it can only vaguely reflect the periphery of the finger placement unit 3 (see reference), Figure 6 Even when capturing the finger image PI in this state ("second captured image PTs"), there is a possibility that the nail outline cannot be accurately detected from the finger image PI. Furthermore, if the user places their finger U on the finger placement section 3 in this state, the finger U and nail T may become dirty due to ink or other contaminants. In such cases, the user should be prompted to clean the stains, and the total area of ​​the detected differential points also increases.

[0139] Furthermore, in this embodiment, it is determined whether there is a change exceeding a threshold in the first captured image PTt, which is viewed from above, and the second captured image PTs, which is viewed from the side, regarding the periphery of the finger arrangement 3. If there is a change in the first captured image PTt, it is considered that the finger arrangement 3 and its periphery have become dirty. In contrast, if there is a change in the second captured image PTs, it is considered that the mirror 35 reflecting the side of the finger arrangement 3 has become dirty.

[0140] In this embodiment, even if either the stain D of the finger placement part 3 or the stain D of the mirror 35 appearing in the first captured image PTt is present, the control unit 11 determines that the periphery of the finger placement part 3, which is a "specific part", is dirty.

[0141] In addition, the display unit 6 can also display the image if either the first captured image PTt or the second captured image PTs exceeds a certain threshold.

[0142] For example, if the PTt of the first captured image does not significantly exceed the threshold, but the PTs of the second captured image significantly exceeds the threshold, the system can specifically notify the user that the lens 35 is dirty. In this way, the user can be specifically informed of where cleaning is needed.

[0143] If the user cleans according to the reported content, the operation unit 22 or similar device will input the meaning of "cleaning completed". For example, a "cleaning completed button" can be provided on a touch panel or similar device, and the user can press the "cleaning completed button" after cleaning.

[0144] If an input operation indicating that cleaning is complete is performed (such as pressing the "cleaning complete button"), a signal corresponding to the input will be output to the control unit 11.

[0145] The control unit 11 determines whether there is an input indicating that cleaning is complete (step S7). If no input is received (step S7; "No"), it returns to step S6 and repeats the message display process.

[0146] On the other hand, when there is an input indicating that cleaning is complete (step S7; "Yes"), the camera 51 of the shooting unit 5 takes another picture of the area around the pointer placement unit 3 as the "specific part" and obtains the captured image PT (first captured image PTt, second captured image PTs) (step S8).

[0147] If the control unit 11, which is the determination unit, obtains the captured image PT that shows the current state, it reads the comparison image PS (first comparison image PST, second comparison image PSs) from the storage unit 12, compares the comparison image PS and the captured image PT again, and calculates their difference (step S9).

[0148] Then, the control unit 11 determines whether the changes above the threshold generated in the captured image PT have been eliminated (step S10).

[0149] If the user cleans correctly, the stains D around the designated area 3, which is a "specific part", should be removed, and the difference relative to the comparison image PS will be eliminated. If the changes above the threshold generated in the captured image PT are eliminated (step S10; "Yes"), proceed to step S4 and end the determination process.

[0150] On the other hand, if the changes above the threshold generated in the captured image PT have not been eliminated (step S10; "No"), when the number of cleaning cycles (the number of cycles from step S7 to step S10) is set to "n", the control unit 11 determines whether "n" is less than 3 times (step S11).

[0151] In this embodiment, the user's cleaning and stain condition determination is repeated until the changes above the threshold are eliminated, and the number of times the determination is repeated is stored.

[0152] If "n" is 1 or 2 times (step S11; "Yes"), the user is notified by displaying the meaning that the camera unit 5 may also get dirty on the display unit 6, etc. (step S12), and a message prompting the user to clean is displayed on the display unit 6, etc. (step S6), and the subsequent processing is repeated.

[0153] If changes exceeding the threshold (the state of residual stain D) are not eliminated regardless of whether the user cleans the sensor unit 3, the cause may be the camera unit 5, which is not the target of cleaning. Therefore, the possibility of the camera unit 5 becoming dirty is shown to the user, further prompting them to clean it.

[0154] On the other hand, if "n" is 3 times or more (step S11; "No"), messages such as explanations related to the treatment method and instructions for reference in the user manual are displayed on the display unit 6 (step S13), and the user is informed that the camera unit 5 may also get dirty (step S12). A message prompting the user to clean the camera unit is displayed on the display unit 6 (step S6), and the subsequent processing is repeated.

[0155] Even after cleaning the camera lens 5 more than three times, stains exceeding the threshold D still remain, which may have caused the lens 5 to become dirty. This is in the case of situations where the user's cleaning method is incorrect, or where the lens 35 is cracked and has scratches, resulting in a situation where the stains cannot be removed even after cleaning.

[0156] Therefore, suggestions are given to users on proper cleaning methods, such as how to replace the 35 mirror, and other alternatives to cleaning, so as to inform users how to deal with these issues.

[0157] Additionally, if the situation cannot be improved after repeating the process an arbitrary number of times (e.g., 6 times), settings may be implemented such as displaying contact information for the service department and suspending the process.

[0158] If printing is performed while the finger placement section 3, mirror 35, and other "specific parts" are dirty, the nail outline cannot be accurately recognized even if a finger image PI is captured, potentially resulting in inadequate nail printing. To address this, by determining the state of the "specific parts" as in this embodiment and instructing the user to respond accordingly, the finger placement section 3, mirror 35, and other "specific parts" can be kept in a suitable state free of stains D, suppressing any decrease in the recognition accuracy of the nail T to be printed.

[0159] Furthermore, if ink adheres to or around the area where the finger is positioned, such as the finger placement section 3, it may stain the user's finger and nail during the next use. By monitoring the condition of the finger placement section 3 and other surfaces as in this embodiment and cleaning accordingly, dirt on the finger can be prevented.

[0160] As described above, the printing apparatus 1 of the electronic device in this embodiment includes: a camera 51, which is an image acquisition unit that acquires an image PT containing a fingernail as the object of printing and a "specific part" (e.g., finger placement unit 3, mirror 35, etc.) whose state changes over time; and a control unit 11, which is a determination unit that determines the state of the "specific part" by comparing a comparison image PS obtained by capturing a range of the "specific part" containing the first state (initial state) and the captured image PT.

[0161] A printing apparatus 1 for printing objects such as nails (T) has a camera 51 that captures images of the object (nail T) to accurately determine the range, shape, and position of the object (nail T) and obtains finger images (PI) to recognize the object (nail T).

[0162] In order to accurately identify the area of ​​the nail T from the finger image PI, the finger and nail are arranged in the finger arrangement part 3, which has excellent contrast with the finger U and the nail T, to obtain the upper surface image of the nail T (first finger image PIt), and it is also necessary to obtain the side image of the nail T (second finger image PIs) via the mirror 35 to accurately determine the position of the nail T in the height direction.

[0163] Regarding this, if ink or sebum from the fingernail adheres to the finger placement section 3, the finger placement section 3, which should be black, will appear white, resulting in a decreased contrast with the fingernail and nail (see reference). Figure 6 The first captured image PTt). Furthermore, depending on the adhesion method of stain D, it is possible to also identify the portion of stain D as nail T. If a finger image PI is captured in this state (first finger image PIt, reference...),... Figure 3 This could lead to misperceptions of the nail's outline. Furthermore, if ink or sebum from the fingernail adheres to the mirror 35, it will become blurry (see reference). Figure 6 The first captured image (PTt) can no longer produce a clear image. In this case, if a finger image (PI) (the second finger image (PIs), or a reference image (PIs) is captured in this state...) Figure 3 This could lead to misunderstandings.

[0164] In this embodiment, the change (stain condition) is determined by comparing a comparison image PS of the first state (initial state) before shooting with a captured image PT showing the current state of the "specific part". Therefore, it is possible to properly anticipate a decrease in the accuracy of recognizing nails T, etc. Furthermore, since the determination of this change (stain condition) is performed through image comparison processing by the control unit 11, a more accurate judgment can be made compared to the situation where the user visually judges the presence or absence of stains D, etc.

[0165] In addition, it can prevent the finger assembly part 3 from being used in a dirty state, and can also prevent the finger U and other parts from getting dirty.

[0166] Furthermore, in this embodiment, since the determination process is based on the image obtained by the camera 51 that is already present in the printing device 1, it is not necessary to add a new device structure, and the reduction in the recognition accuracy of nail T, etc. can be easily prevented.

[0167] Furthermore, according to this embodiment, the "specific part" includes a finger placement part 3 that is configured with a finger U corresponding to the nail T which is the object of printing, and a mirror 35 that serves as an auxiliary reflector for photographing the finger U and the nail T, which are configured in the finger placement part 3.

[0168] If the finger configuration section 3 and the mirror 35 become dirty, the possibility of not being able to correctly recognize the outline of the nail T from the finger image PI increases.

[0169] In this regard, since the state changes (stain condition) of the finger arrangement section 3 and the mirror 35 can be seen as a "specific part", the reduction in the recognition accuracy of the nail T as the printing object can be suppressed.

[0170] Furthermore, according to this embodiment, the state of a "specific part" is the stain condition of the "specific part".

[0171] Even when a "specific part" becomes increasingly dirty over time with use, the ability to determine the condition of the stain allows for advance awareness of the reduced accuracy of nail polish and other related products.

[0172] Furthermore, according to this embodiment, the control unit 11, which is a determination unit, determines the state of a "specific part" based on a predetermined threshold.

[0173] Therefore, one can objectively judge the condition (stain condition and extent) and respond appropriately.

[0174] Furthermore, according to this embodiment, it also includes a notification unit that notifies the user in response to the determination result of the control unit 11, which is a determination unit.

[0175] Specifically, by displaying the stain condition and treatment method of a "specific part" on the display unit 6 and the display unit 85 of the terminal device, the user is encouraged to perform cleaning and other treatments.

[0176] Therefore, when the staining condition of a "specific area" is severe (e.g., exceeding a threshold), cleaning can be performed to eliminate conditions that affect the recognition of nail texture. This allows for the ability to anticipate situations where the accuracy of nail texture recognition is reduced.

[0177] Furthermore, according to this embodiment, a printing unit is provided that sprays ink for printing, and the state of the "specific part" changes over time due to ink adhesion.

[0178] When printing by spraying ink, the ink (ink mist) may spread during printing and adhere to items around the nail T (such as the nail mounting part 3).

[0179] If nail identification or printing is performed with such ink stains, the outline of the nail T may be misinterpreted, or the ink may smudge the U and T of the nail.

[0180] In this respect, this embodiment can monitor and address the changes in the finger placement part 3, etc., caused by such ink stains over time. Therefore, it suppresses the decrease in the accuracy of recognizing the nail T, etc., and prevents the nail U, etc., from becoming dirty due to ink.

[0181] Furthermore, the embodiments of the present invention have been described above, but the present invention is not limited to the relevant embodiments. Various modifications can be made without departing from its spirit, which is self-evident.

[0182] For example, in this embodiment, "specific part" refers to the configuration unit 3, mirror 35, etc., but "specific part" is not limited to this.

[0183] Any part surrounding the U-shaped or T-shaped nail can be broadly included in the "specific part".

[0184] Furthermore, in this embodiment, the state of "specific part" is an example of the stain condition of "specific part", but the state of "specific part" is not limited to the stain condition.

[0185] For example, in cases of breakage, loss, or deformation of the lens 35 due to various factors, normal nail recognition may be impaired. In these cases, it can also be determined as a change in the state of a "specific part".

[0186] Furthermore, in this embodiment, the user is notified by displaying the display unit 6 (or display unit 85) when the state change of the "specific part" exceeds a certain threshold, but the notification unit is not limited to the display unit 6 (or display unit 85).

[0187] For example, if the printing device 1 and the terminal device 8 are equipped with a sound output unit, the user can be notified by sounding alarms or other audio prompts. Furthermore, the need for cleaning can be indicated by lighting up lights or other similar means.

[0188] In these cases, the sound output unit, lights, etc., become the notification unit.

[0189] Furthermore, in the implementation, an example is given where, when the user prompts the user to clean and there is an input indicating that cleaning is complete, a comparison image PS taken at the time of factory departure is compared with a current image PT. However, the image being compared with the current image PT is not limited to the comparison image PS taken at the time of factory departure.

[0190] For example, after a user has cleaned a "specific area" and indicated that cleaning is complete, a new image PT can be taken to confirm the state of that "specific area," and this image PT can be compared with the image PT taken before cleaning. By comparing the image PT with the image PT taken before cleaning, it is possible to compare how much dirt D has been removed and how much dirt D remains. If such a comparison image is displayed on the display unit 6, the user can easily determine where the cleaning was performed.

[0191] Furthermore, in this embodiment, the auxiliary reflector is illustrated as a mirror 35, but the auxiliary reflector is not limited to a mirror. The auxiliary reflector can be any means that enables the camera 51 to obtain an image of the finger when it is observed from a direction different from the direction that can be directly obtained by the camera 51, such as a prism or various optical elements.

[0192] Furthermore, in this embodiment, the printing device 1 is shown to operate as a standalone unit, but the printing device 1 can also cooperate with various external devices such as the terminal device 8 to perform judgment processing, printing processing, etc.

[0193] For example, the start instruction for the determination process in the printing device 1, the input of the start instruction for the printing process, and the selection of nail design can be performed from the operation unit 83 of the terminal device 8.

[0194] Furthermore, various data processing techniques, such as generating printing data and image processing, can be performed on external devices like the terminal device 8. In this case, the finger image PI captured by the camera 51 of the printing device 1 is sent to the terminal device 8.

[0195] Furthermore, the determination process in this embodiment can also be performed in an external device such as the terminal device 8. In this case, for example, a program for performing the determination process can be stored in the storage unit 82 of the terminal device 8, and the control unit 81 of the terminal device 8 can function as a determination unit by working together with the program.

[0196] In this case, the captured image PT and the comparison image PS, taken by the camera 51 of the printing apparatus 1, are sent to the terminal device 8. The control unit 81 on the terminal device 8 performs decision processing based on this data. In addition, the data of the comparison image PS can also be pre-stored in the storage unit 82 on the terminal device 8.

[0197] In this way, while having external devices such as terminal device 8 handle various processes, the control unit 11 of printing device 1 can be implemented with a simpler structure.

[0198] Furthermore, the nail design data can be stored in the storage unit 12 of the printing device 1, or data stored in the storage unit of various external devices such as the terminal device 8 can be used. Alternatively, the nail design image data can be stored in a server device or the like that can be connected via a network line, allowing access to the server device or the like to reference the nail design data.

[0199] In this way, without increasing the capacity of the storage unit 12, it is possible to choose from a wider range of nail designs for printing.

Claims

1. An electronic device, characterized in that, have: A configuration table for configuring the nails to be printed and the fingers corresponding to the nails; The imaging unit acquires a finger image including the fingernail; An auxiliary reflector is provided to assist in the imaging of the finger, which is positioned on the mounting platform. The image acquisition unit acquires a first captured image of a specific portion including the configuration table and the auxiliary reflector when the finger containing the nail is not configured on the configuration table, and acquires a second captured image of the configuration table captured by the auxiliary reflector from a direction different from the shooting direction of the first captured image when the finger containing the nail is not configured on the configuration table. and The determination unit determines whether the configuration platform and / or the auxiliary reflector in the specific part changes over time by comparing a comparison image obtained by capturing a range of the specific part containing the initial state with each of the first captured image and the second captured image.

2. The electronic device according to claim 1, characterized in that, The determination unit determines, based on a predetermined threshold, whether either the specific part or the auxiliary reflective part changes over time.

3. The electronic device according to claim 1 or 2, characterized in that, The electronic device also includes: The notification unit responds to the user based on the determination result of the determination unit.

4. The electronic device according to claim 3, characterized in that, The electronic device also includes: The input unit is for inputting information that the user has already performed to complete the cleaning process. The determination unit performs the determination when the input unit indicates that the cleaning process has been completed. The reporting unit reports that the image acquisition unit has become dirty if the determination unit determines that either the specific part or the auxiliary reflective part has changed over time.

5. The electronic device according to claim 1 or 2, characterized in that, The electronic device includes: a printing unit that ejects ink for printing. The state of the specific portion changes over time due to the adhesion of the ink.

6. A determination method, characterized in that, Include: The image acquisition process involves acquiring a first image by photographing a specific portion including the mounting table and an auxiliary reflector when the mounting table is not configured with a finger containing a nail, and acquiring a second image by photographing the mounting table from the auxiliary reflector from a direction different from the photographing direction of the first image when the mounting table is not configured with the finger containing the nail, wherein the mounting table is used to configure the nail as the printing object and the finger corresponding to the nail, the auxiliary reflector assists the photographing unit in photographing the finger configured on the mounting table, and the photographing unit acquires an image of the finger containing the nail; The determination process involves comparing a comparison image obtained by capturing a range of the specific portion containing the initial state with each of the first captured image and the second captured image to determine whether the placement platform and / or the auxiliary reflector in the specific portion changes over time.

7. A recording medium, which is a computer-readable, non-transitory recording medium, characterized in that, Enable the computer to achieve: The image acquisition function acquires a first image of a specific portion including the mounting table and an auxiliary reflector when the mounting table is not configured with a finger containing a nail, and acquires a second image of the mounting table taken by the auxiliary reflector from a direction different from the shooting direction of the first image when the mounting table is not configured with the finger containing the nail, wherein the mounting table is used to configure the nail (the object of printing) and the finger corresponding to the nail, the auxiliary reflector assists the imaging unit in capturing the finger configured on the mounting table, and the imaging unit acquires an image of the finger including the nail; and The determination function determines whether the configuration table and / or the auxiliary reflector in the specific part changes over time by comparing a comparison image obtained by capturing a range of the specific part containing the initial state with each of the first captured image and the second captured image.

Images