Automatic makeup machine, method, program, and control device

Abstract

The present invention applies cosmetics based on the features of the face of an individual to whom the cosmetics are to be applied. The present invention comprises a control unit and an applicator unit. The control unit comprises: a region determination unit that determines a region for the application of a cosmetic on the basis of at least two application feature points on the face and a selected application pattern; and an instruction unit that issues instructions to the applicator unit so as to apply the cosmetic to said region. The applicator unit applies the cosmetic to said region in accordance with the instructions of the control unit.

Description

Technical Field

[0001] The present invention relates to an auto makeup machine, method, program, and control device.

Background Art

[0002] Conventionally, devices for making up humans have been disclosed. For example, Patent Document 1 discloses a method and device for making up or coloring a human body.

[0003] By the way, when a person applies makeup to their own or another person's face, the person applying the makeup determines the shape and position of the area to apply the makeup (hereinafter, the shape and the type of the position on the face of the area to apply the makeup are also referred to as "application pattern") according to the face of the person being made up. For example, in the case of blush, the person applying the makeup may apply blush in an ellipse along the cheekbones of the person being made up, or apply blush horizontally from the center of the cheek of the person being made up.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] In Patent Document 1, it is only disclosed that a treatment product is applied according to a design selected by a user (paragraph

[0052] of Patent Document 1). If a plurality of users select the same design, the design is used as it is for any user. That is, the design is not adjusted according to the person being made up.

[0006] Therefore, an object of one embodiment of the present invention is to apply makeup based on the characteristics of the face of the person being made up. [Means for solving the problem]

[0007] One aspect of the present invention comprises a control unit and an application unit, the control unit comprising a region determination unit that determines a region to which cosmetics are to be applied based on at least two application feature points on the face and a selected application pattern, and an instruction unit that instructs the application unit to apply cosmetics to the region, the application unit applying cosmetics to the region in accordance with the instructions of the control unit. [Effects of the Invention]

[0008] According to the present invention, it is possible to apply makeup based on the facial features of the person receiving the makeup. [Brief explanation of the drawing]

[0009] [Figure 1] This is an example of an overall configuration diagram of an automatic makeup machine according to one embodiment of the present invention. [Figure 2] This is an example of a functional block diagram of an automatic makeup machine according to one embodiment of the present invention. [Figure 3] This figure illustrates feature points for application and feature points for face fixation according to one embodiment of the present invention. [Figure 4] This is an example of a coating pattern according to one embodiment of the present invention. [Figure 5] This figure illustrates the affine transformation of a coating pattern according to one embodiment of the present invention. [Figure 6] This is an example of fixing a user's face in one embodiment of the present invention. [Figure 7] This flowchart shows an example of a pre-registration process for coating feature points according to one embodiment of the present invention. [Figure 8] This flowchart shows an example of a pre-registration process for feature points used for face fixation according to one embodiment of the present invention. [Figure 9] This flowchart shows an example of a makeup treatment process related to one embodiment of the present invention. [Figure 10]This flowchart shows an example of a region determination process related to one embodiment of the present invention. [Figure 11] This is a block diagram showing an example of the hardware configuration of the processing unit and processing unit of an automatic makeup machine according to one embodiment of the present invention. [Modes for carrying out the invention]

[0010] <Overall Structure Diagram> Figure 1 is an example of an overall configuration diagram of an automatic makeup machine 10 according to one embodiment of the present invention. The automatic makeup machine 10 is intended to apply makeup to a user 30. As shown in Figure 1, the automatic makeup machine 10 includes a control unit 11 and an application unit 12. The control unit 11 and the application unit 12 are connected in a communicative manner. Each of them will be described below.

[0011] In this specification, we will mainly describe the case where the cosmetic applied by the automatic makeup machine 10 is blush, but the cosmetic applied by the automatic makeup machine 10 may be any cosmetic such as foundation, eyebrow pencil, eyeshadow, or lipstick.

[0012] The control unit 11 determines the area to which the cosmetic product will be applied based on at least two application feature points on the user's face and the selected application pattern. The control unit 11 also instructs the application unit 12 to apply the cosmetic product to the determined area. Specifically, the control unit 11 extracts at least two application feature points from the user's face based on the three-dimensional shape information (coordinate information of the X, Y, and Z axes) of the user's face measured by the 3D scanner 20. The control unit 11 will be described in more detail later with reference to Figure 2.

[0013] The application unit 12 applies cosmetics to an area on the surface of the user 30's face according to the instructions of the control unit 11. For example, the application unit 12 can apply cosmetics by spraying them onto the face using an airbrush. In this case, the automatic makeup machine 10 does not come into contact with the user 30's face, making it hygienic.

[0014] Incidentally, the application unit 12 can also be configured to apply cosmetics by bringing the cosmetics into contact with the face using an arbitrary cosmetic tool (for example, a sponge, a puff, a chip, a brush, etc.).

[0015] As described above, in FIG. 1, the control unit 11 and the application unit 12 have been described as one device (that is, the auto makeup machine 10), but they may be implemented as separate devices (for example, a control device and an application device). Further, the auto makeup machine 10 may have the function of the 3D scanner 20.

[0016] <Functional configuration> FIG. 2 is an example of a functional block diagram of the auto makeup machine 10 according to an embodiment of the present invention. The control unit 11 of the auto makeup machine 10 can include a feature point registration unit 101, a region determination unit 102, an instruction unit 103, a feature point storage unit 104, and an application pattern storage unit 105.The control unit 11 of the auto makeup machine 10 can function as the feature point registration unit 101, the region determination unit 102, and the instruction unit 103 by executing a program. Hereinafter, each will be described.

[0017] The feature point registration unit 101 extracts and registers at least two application feature points on the face of the user 30 and the face fixing feature points of the user 30. Hereinafter, they will be described separately as <application feature points> and <face fixing feature points>.

[0018] <Application feature points> Application feature points are feature points used to determine the area to which cosmetics are applied. The feature point registration unit 101 acquires information on the three-dimensional shape of the user 30's face (coordinate information for the X, Y, and Z axes) measured by the 3D scanner 20. The feature point registration unit 101 also extracts feature points that indicate parts of the user 30's face, such as the contour of the face, eyes, nose, mouth, and eyebrows, based on the information on the three-dimensional shape of the user 30's face. The feature point registration unit 101 also extracts at least two application feature points from among the feature points that indicate parts of the user 30's face, such as the contour of the face, eyes, nose, mouth, and eyebrows. The feature point registration unit 101 also registers information on at least two application feature points (coordinate information for the X, Y, and Z axes) in the feature point storage unit 104.

[0019] <Feature points for facial fixation> Facial fixation feature points are feature points used to calculate coordinates for identifying the area to which cosmetics will be applied. As described later, when applying cosmetics, coordinates for identifying the area to which cosmetics will be applied are calculated based on the coordinates of the facial fixation feature points and the relative positional relationship between at least two application feature points and the facial fixation feature points.

[0020] The feature point registration unit 101 acquires information on the three-dimensional shape of the user 30's face (coordinate information for the X, Y, and Z axes) measured by the 3D scanner 20. The feature point registration unit 101 also extracts feature points that indicate parts of the user 30's face, such as the contour, eyes, nose, mouth, and eyebrows, based on the information on the three-dimensional shape of the user 30's face. The feature point registration unit 101 also extracts face-fixing feature points (for example, two face-fixing feature points) from among the feature points that indicate parts of the user 30's face, such as the contour, eyes, nose, mouth, and eyebrows, which are different from the feature points used for application. The feature point registration unit 101 also registers the information on the face-fixing feature points (coordinate information for the X, Y, and Z axes) in the feature point storage unit 104.

[0021] The feature points used for facial fixation should ideally be those that are less affected by changes in weight or facial expression. Note that the feature points used for facial fixation may coincide with the feature points used for application.

[0022] Figure 3 is a diagram illustrating the application feature points and face fixation feature points according to one embodiment of the present invention.

[0023] As shown in Figure 3 (1) Acquisition of 3D shape information, the 3D scanner 20 acquires 3D shape information (coordinate information of the X, Y, and Z axes) of the user's face.

[0024] Next, as shown in Figure 3 (2) Extraction of Feature Points, feature points representing parts of User 30's face such as the contour, eyes, nose, mouth, and eyebrows are extracted. Then, at least two application feature points (Figure 3 (a) Application Feature Points) are extracted from among the feature points representing parts of User 30's face such as the contour, eyes, nose, mouth, and eyebrows. Additionally, face-fixing feature points (Figure 3 (b) Face-Fixing Feature Points) are extracted from among the feature points representing parts of User 30's face such as the contour, eyes, nose, mouth, and eyebrows.

[0025] Next, as shown in (3) Registration of Feature Point Coordinate Information in Figure 3, the X, Y, and Z axis coordinate information of the application feature points and face fixing feature points is registered. In Figure 3, at least two application feature points are registered to determine the area to which one type of cosmetic (e.g., blush) is applied, but at least two application feature points (i.e., application feature points for each cosmetic) may be registered to determine each area to which multiple types of cosmetic (e.g., blush, foundation, eyebrow pencil, eyeshadow, lipstick, etc.) are applied.

[0026] In addition, feature points other than those for application and face fixing (i.e., feature points indicating parts of the user 30's face such as the contour, eyes, nose, mouth, and eyebrows) may also be registered. In this case, since all of the user 30's feature points have already been extracted, it becomes easy to add and register new feature points for application.

[0027] Returning to Figure 2, the feature point storage unit 104 stores at least two coating feature points extracted by the feature point registration unit 101. The feature point storage unit 104 also stores face-fixing feature points extracted by the feature point registration unit 101.

[0028] The application pattern storage unit 105 stores information about application patterns (types of the shape of the area to be coated with cosmetics and their positions on the face). Specifically, for each application pattern, it stores information about the shape of the area to be coated with cosmetics and the positional relationship between the area to be coated with cosmetics and the application feature points. The application pattern information may be two-dimensional information (coordinate information of the X and Y axes, i.e., without considering the contours of the face) or three-dimensional information (coordinate information of the X, Y, and Z axes, i.e., considering the contours of the face).

[0029] Figure 4 shows an example of an application pattern according to one embodiment of the present invention. For example, if the cosmetic product applied by the automatic makeup machine 10 is blush, information on the shape and position on the face of the application patterns such as (1) application pattern 1 which gives a "cool" impression, (2) application pattern 2 which gives a "cute" impression, and (3) application pattern 3 which gives a "fresh" impression is stored in the application pattern storage unit 105.

[0030] Returning to Figure 2, the region determination unit 102 determines the region to which the cosmetic will be applied based on at least two application feature points on the face and the selected application pattern. The following will be explained in the order of <Selection of Application Pattern>, <Affine Transformation of Application Pattern>, and <Coordinate Calculation>.

[0031] <Selection of coating pattern> The area determination unit 102 selects the coating pattern. This will be explained below in two parts: <<user selection>> and <<automatic selection>>.

[0032] <<Selection by the user>> The area determination unit 102 selects an application pattern according to the user 30's specifications. Specifically, the area determination unit 102 displays information on multiple application patterns on the display means of the automatic makeup machine 10 (or, if the automatic makeup machine 10 is implemented as separate devices (control device and application device), the display means of the control device). For example, information on the impression each application pattern gives (such as "cool," "cute," and "fresh" in Figure 4) and information on the shape and position of each application pattern on the face are displayed. The area determination unit 102 also acquires information on the application pattern specified by the user 30 using the input means of the automatic makeup machine 10 (or, if the automatic makeup machine 10 is implemented as separate devices (control device and application device), the input means of the control device). The area determination unit 102 then selects the application pattern specified by the user 30 as the application pattern for determining the area to which the cosmetic will be applied.

[0033] <<Automatic Selection>> The region determination unit 102 selects an application pattern based on the feature points of the user 30's face. Specifically, the region determination unit 102 selects an application pattern suitable for the user 30's face based on feature points that indicate the contour of the user 30's face, eyes, nose, mouth, eyebrows, and other parts of the face.

[0034] For example, the region determination unit 102 can select a suitable application pattern for the user 30's face based on the correspondence between pre-registered feature points representing facial contours, eyes, nose, mouth, eyebrows, etc., and application patterns suitable for that face. Alternatively, the region determination unit 102 may use AI (artificial intelligence) to infer a suitable application pattern for that face from feature points representing facial contours, eyes, nose, mouth, eyebrows, etc.

[0035] <Affine transformation of coating patterns> Next, the affine transformation of the coating pattern will be explained. The region determination unit 102 performs an affine transformation of the selected coating pattern based on the positions of at least two coating feature points on the user's face 30. The affine transformation of the coating pattern will be explained in detail below with reference to Figure 5.

[0036] Figure 5 is a diagram illustrating the affine transformation of a coating pattern according to one embodiment of the present invention.

[0037] The region determination unit 102 performs an affine transformation of the coating pattern on the user 30's face. Specifically, the region determination unit 102 performs at least one of the following on the user 30's face: translation of the coating pattern, expansion of the coating pattern, contraction of the coating pattern, and rotation of the coating pattern, so as to superimpose at least two coating feature points on the user 30's face with at least two coating feature points on the coating pattern.

[0038] More specifically, the region determination unit 102 refers to the information of the coating pattern selected in the above-mentioned <<Selection of Coating Pattern>> within the coating pattern storage unit 105. In other words, the region determination unit 102 refers to the shape of the area to which the cosmetic is to be applied and the positional relationship between the area to which the cosmetic is to be applied and the coating feature points.

[0039] The region determination unit 102 can expand or contract the shape of the application pattern (i.e., the shape of the area to which the cosmetic is applied) in the vertical or horizontal direction so that the application feature points of the user 30 and the application feature points of the application pattern overlap, and then position it on the user 30's face. For example, the region determination unit 102 can expand or contract the shape of the application pattern in the vertical direction (Y-axis direction) based on the positions of at least two application feature points on the user 30's face. The region determination unit 102 can also expand or contract the shape of the application pattern in the horizontal direction (X-axis direction) based on the positions of at least two application feature points on the user 30's face.

[0040] Furthermore, the region determination unit 102 can rotate the coating pattern so that the coating feature points of the user 30 and the coating feature points of the coating pattern overlap, and position it on the user 30's face.

[0041] <Coordinate calculation> Next, we will explain how to calculate the coordinates. Below, we will explain two cases: one where the cosmetic is applied at the same time as the extraction of the feature points for application, and another where the cosmetic is applied separately after the extraction of the feature points for application.

[0042] <<When applying cosmetics at the same time as extracting feature points for application>> The region determination unit 102 calculates coordinates for identifying the region to which the cosmetic product is applied (i.e., the region of the application pattern that is affine-transformed and placed on the face) based on the coordinates of at least two application feature points.

[0043] <<When applying cosmetics separately after extracting feature points for application>> The region determination unit 102 calculates coordinates to identify the region to which the cosmetic product is applied (i.e., the region of the application pattern that is affine-transformed and placed on the face) based on the coordinates of the face-fixing feature points and the relative positional relationship between at least two application feature points and the face-fixing feature points. The calculation of the coordinates will be described in detail below with reference to Figure 6.

[0044] Figure 6 shows an example of fixing the face of user 30 according to one embodiment of the present invention.

[0045] <Example 1 of fixed positioning (when the user faces the designated location)> As shown in Figure 6, <Fixing Example 1>, the user 30 fixes their face on the face fixing device 40. Specifically, the user 30 aligns a facial fixing feature point (e.g., between the eyebrows) with a predetermined position on the face fixing device 40, adjusts a predetermined position on the face fixing device 40 (e.g., the position where the chin rests), and then aligns the facial fixing feature point (e.g., the chin) with the predetermined position. The region determination unit 102 identifies the coordinates of the predetermined position on the face fixing device 40 as the coordinates of the facial fixing feature point. Based on the coordinates of the facial fixing feature point and the relative positional relationship between at least two application feature points and the facial fixing feature point, the region determination unit 102 calculates information on the three-dimensional shape of the area where the application unit 12 applies cosmetics (coordinate information of the X, Y, and Z axes).

[0046] <Example 1 of fixing (when searching for feature points for fixing the user's face)> As shown in Figure 6, <Fixing Example 1>, the user 30 fixes their face on the face fixing device 40. The region determination unit 102 identifies the coordinates of the face fixing feature points from the 3D shape information measured of the user 30. Based on the coordinates of the face fixing feature points and the relative positional relationship between at least two application feature points and the face fixing feature points, the region determination unit 102 calculates 3D shape information (coordinate information of the X, Y, and Z axes) of the area where the application unit 12 applies cosmetics.

[0047] <Example 2 of fixed positioning (when the user faces the designated location)> As shown in Figure 6, <Fixed Example 2>, the user 30 wears a wearable device having an application unit 12 and a 3D scanner 20. Specifically, the user 30 aligns a facial fixation feature point (e.g., between the eyebrows) with a predetermined position on the wearable device, and adjusts a predetermined position on the wearable device (e.g., a movable part of the wearable device) to align a facial fixation feature point (e.g., the chin) with a predetermined position. The region determination unit 102 identifies the coordinates of the predetermined position on the wearable device as the coordinates of the facial fixation feature point. Based on the coordinates of the facial fixation feature point and the relative positional relationship between at least two application feature points and the facial fixation feature point, the region determination unit 102 calculates information about the three-dimensional shape of the area where the application unit 12 applies cosmetics (coordinate information of the X, Y, and Z axes).

[0048] <Example 2 of fixing (when searching for feature points for fixing the user's face)> As shown in Figure 6, <Fixed Example 2>, the user 30 wears a wearable device having an application unit 12 and a 3D scanner 20. The region determination unit 102 identifies the coordinates of the face-fixing feature points from the 3D shape information measured of the user 30. Based on the coordinates of the face-fixing feature points and the relative positional relationship between at least two application feature points and the face-fixing feature points, the region determination unit 102 calculates 3D shape information (coordinate information of the X, Y, and Z axes) of the area where the application unit 12 applies cosmetics.

[0049] Thus, in cases where cosmetics are applied separately after the extraction of feature points for application, the feature points that were registered in advance (i.e., before the user 30 applies makeup using the auto makeup machine 10) can be used, eliminating the need to extract feature points.

[0050] Returning to Figure 2, the instruction unit 103 instructs the application unit 12 to apply the cosmetic to the area determined by the area determination unit 102. The application unit 12, having received the instruction, applies the cosmetic to the indicated area according to the instructions of the instruction unit 103.

[0051] The instruction unit 103 may instruct the system to apply a uniform amount of cosmetic to all parts of the area where the cosmetic is to be applied, or it may instruct the system to apply a large amount of cosmetic to one part of the area where the cosmetic is to be applied and a small amount to another part.

[0052] The instruction unit 103 can also be configured to instruct the application of cosmetics in a color selected according to the user 30's specifications, or in a color selected by the control unit 11 as suitable for the user 30's face.

[0053] <Makeup using multiple types of cosmetics> In one embodiment of the present invention, the automatic makeup machine 10 can be configured to apply multiple cosmetics (e.g., foundation, eyebrow pencil, eyeshadow, lipstick, etc.). In this case, the area determination unit 102 determines the area for each cosmetic based on at least two application feature points for each of the multiple types of cosmetics and a selected application pattern. The instruction unit 103 instructs the application unit 12 to apply each cosmetic to the area for each cosmetic. The application pattern storage unit 105 stores information on the application pattern for each cosmetic (the shape of the area to which each cosmetic is applied and the type of its position on the face).

[0054] <Simulation> In one embodiment of the present invention, the automatic makeup machine 10 may be configured to display an image simulating the application of cosmetics to the user 30's face before the application unit 12 applies the cosmetics. In this case, the area determination unit 102 displays the image simulating the application of cosmetics to the user 30's face on the display means of the automatic makeup machine 10 or on a display means connected to the automatic makeup machine 10. In this way, in one embodiment of the present invention, the automatic makeup machine 10 can present the user 30 with a prediction of the finished look of the makeup.

[0055] Figure 7 is a flowchart showing an example of a pre-registration process for coating feature points according to one embodiment of the present invention.

[0056] In step 11 (S11), the feature point registration unit 101 acquires information on the three-dimensional shape of the user's face (coordinate information for the X, Y, and Z axes) measured by the 3D scanner 20.

[0057] In step 12 (S12), the feature point registration unit 101 extracts feature points that represent the contours of the user's face, eyes, nose, mouth, eyebrows, and other parts of the user's face, based on the 3D shape information of the user's face acquired in S11.

[0058] In step 13 (S13), the feature point registration unit 101 extracts at least two feature points for application from among the feature points that represent the contour of the user's face, eyes, nose, mouth, eyebrows, and other parts of the face extracted in S12.

[0059] In step 14 (S14), the feature point registration unit 101 registers at least two coating feature points extracted in S13 in the feature point storage unit 104.

[0060] Figure 8 is a flowchart showing an example of the pre-registration process for feature points for face fixation according to one embodiment of the present invention.

[0061] In step 21 (S21), the feature point registration unit 101 acquires information on the three-dimensional shape of the user's face (coordinate information for the X, Y, and Z axes) measured by the 3D scanner 20.

[0062] In step 22 (S22), the feature point registration unit 101 extracts feature points that represent the contours of the user's face, eyes, nose, mouth, eyebrows, and other parts of the user's face, based on the 3D shape information of the user's face acquired in S21.

[0063] In step 23 (S23), the feature point registration unit 101 extracts face-fixing feature points (for example, two face-fixing feature points) from among the feature points that represent the contour of the user's face, eyes, nose, mouth, eyebrows, etc., extracted in S22.

[0064] In step 24 (S24), the feature point registration unit 101 registers the face-fixing feature points extracted in S23 in the feature point storage unit 104.

[0065] Figure 9 is a flowchart showing an example of a makeup process according to one embodiment of the present invention.

[0066] In step 31 (S31), the region determination unit 102 of the control unit 11 determines the region to which the cosmetic product will be applied.

[0067] In step 32 (S32), the instruction unit 103 of the control unit 11 instructs the application unit 12 to apply the cosmetic to the area determined in S31.

[0068] In step 33 (S33), the application unit 12 applies the cosmetic product to the area indicated in S32, in accordance with the instructions of the instruction unit 103 in S32.

[0069] Figure 10 is a flowchart showing an example of the region determination process (S31 in Figure 9) according to one embodiment of the present invention.

[0070] In step 41 (S41), the region determination unit 102 selects a coating pattern. For example, the region determination unit 102 can select a coating pattern according to a specification from the user 30. Alternatively, for example, the region determination unit 102 can select a coating pattern based on the facial feature points of the user 30.

[0071] In step 42 (S42), the region determination unit 102 performs an affine transformation of the coating pattern selected in S41 based on the positions of at least two coating feature points on the user's face 30.

[0072] In step 43 (S43), the region determination unit 102 calculates coordinates for identifying the area to which the cosmetic will be applied. If the cosmetic is applied at the same time as the extraction of the application feature points, the region determination unit 102 calculates coordinates for identifying the area to which the cosmetic will be applied (i.e., the area of ​​the application pattern that has been affine-transformed in S42 and placed on the face) based on the coordinates of at least two application feature points. If the cosmetic is applied separately after the extraction of the application feature points, the region determination unit 102 calculates coordinates for identifying the area to which the cosmetic will be applied (i.e., the area of ​​the application pattern that has been affine-transformed in S42 and placed on the face) based on the coordinates of the face-fixing feature points and the relative positional relationship between at least two application feature points and the face-fixing feature points.

[0073] <Effects> Thus, in one embodiment of the present invention, an area suitable for each person's face to be made up can be determined by performing an affine transformation on an application pattern selected by the user 30 or the auto makeup machine 10 based on the positions of at least two application feature points and then arranging it.

[0074] <Hardware Configuration> Figure 11 is a block diagram showing an example of the hardware configuration of a control unit 11 (or a control device if the automatic makeup machine 10 is implemented as separate devices (control device and coating device)) according to one embodiment of the present invention. The control unit 11 and the control device have a CPU (Central Processing Unit) 1001, a ROM (Read Only Memory) 1002, and a RAM (Random Access Memory) 1003. The CPU 1001, ROM 1002, and RAM 1003 form a so-called computer.

[0075] Furthermore, the control unit 11 and the control device may include an auxiliary storage device 1004, a display device 1005, an operating device 1006, an I / F (Interface) device 1007, and a drive device 1008. The hardware components of the control unit 11 and the control device are interconnected via bus B.

[0076] The CPU 1001 is a computing device that executes various programs installed on the auxiliary storage device 1004.

[0077] ROM1002 is non-volatile memory. ROM1002 functions as a main memory device that stores various programs, data, etc., necessary for the CPU1001 to execute the various programs installed on the auxiliary storage device 1004. Specifically, ROM1002 functions as a main memory device that stores boot programs such as BIOS (Basic Input / Output System) and EFI (Extensible Firmware Interface).

[0078] RAM1003 is a volatile memory such as DRAM (Dynamic Random Access Memory) or SRAM (Static Random Access Memory). RAM1003 functions as a main memory device that provides a working area that is expanded when various programs installed on the auxiliary storage device 1004 are executed by the CPU 1001.

[0079] The auxiliary storage device 1004 is an auxiliary storage device that stores various programs and information used when various programs are executed.

[0080] The display device 1005 is a display device that displays the internal status of the control unit 11 and the control device.

[0081] The operating device 1006 is an input device that allows the user 30 to input various instructions to the control unit 11 and the control device.

[0082] The I / F device 1007 is a communication device that connects to a network and communicates with the coating unit 12 and the 3D scanner 20.

[0083] The drive device 1008 is a device for setting the storage medium 1009. The storage medium 1009 here includes media that record information optically, electrically, or magnetically, such as CD-ROMs, flexible disks, and magneto-optical disks. The storage medium 1009 may also include semiconductor memories that record information electrically, such as EPROMs (Erasable Programmable Read Only Memory) and flash memory.

[0084] The various programs to be installed in the auxiliary storage device 1004 are installed, for example, when the distributed storage medium 1009 is set in the drive device 1008, and the various programs recorded on the storage medium 1009 are read by the drive device 1008. Alternatively, the various programs to be installed in the auxiliary storage device 1004 may be installed by downloading them from the network via the I / F device 1007.

[0085] Although embodiments of the present invention have been described in detail above, the present invention is not limited to the specific embodiments described above, and various modifications and changes are possible within the scope of the gist of the present invention as described in the claims.

[0086] This international application claims priority based on Japanese Patent Application No. 2019-187736, filed on 11 October 2019, and the entire contents of No. 2019-187736 are incorporated herein by reference. [Explanation of Symbols]

[0087] 10 Automatic Makeup Machines 11 Control Unit 12. Coating area 20 3D scanners 30 users 40. Facial Fixation Device 101 Feature Point Registration Section 102 Area determination part 103 Instruction section 104 Feature Point Storage Section 105 Coating pattern storage section

Claims

1. It comprises a control unit and a coating unit, The control unit, A feature point registration unit stores coordinate information of at least two feature points for application on the face, and coordinate information of a face-fixing feature point that is a different feature point from the application feature point, Identify the location of the feature points used to fix the user's face, A region determination unit that determines the area to which the selected application pattern of cosmetics will be applied, based on the position of the user's face-fixing feature point identified above, and the relative positional relationship between the stored coordinate information of the application feature point and the coordinate information of the face-fixing feature point, An instruction unit that instructs the application unit to apply cosmetics to the aforementioned area. Equipped with, The application unit is an automatic makeup machine that applies cosmetics to the area according to the instructions of the control unit.

2. The auto makeup machine according to claim 1, wherein the region determination unit performs an affine transformation of the application pattern and places it on the face.

3. The automatic makeup machine according to claim 1 or 2, wherein the application unit applies cosmetics to the area by spraying the cosmetics.

4. The aforementioned cosmetics include multiple types of cosmetics, The region determination unit determines the region of each cosmetic product based on at least two application feature points of each cosmetic product and a selected application pattern. The automatic makeup machine according to any one of claims 1 to 3, wherein the instruction unit instructs the application unit to apply each cosmetic to the respective cosmetic area.

5. An automatic makeup machine according to any one of claims 1 to 4, which displays an image simulating the application of the aforementioned cosmetic product.

6. The control unit stores coordinate information of at least two feature points for application on the face, and coordinate information of a feature point for face fixing, which is a feature point different from the application feature points, in the feature point storage unit of the control unit. The control unit performs the steps of identifying the position of the feature points for fixing the user's face, The control unit determines the area to which the selected application pattern of cosmetics will be applied, based on the position of the identified user's facial fixation feature point and the relative positional relationship between the stored coordinate information of the application feature point and the coordinate information of the facial fixation feature point. The application unit performs the step of applying cosmetics to the area. A method that includes this.

7. The control unit that gives instructions to the coating part A feature point registration unit stores coordinate information of at least two feature points for application on the face, and coordinate information of a feature point for fixing the face, which is a feature point different from the application feature points, in the feature point storage unit. Identify the location of the feature points used to fix the user's face, A region determination unit determines the area to which the selected application pattern of cosmetics will be applied, based on the position of the user's facial fixation feature point identified above, and the relative positional relationship between the stored coordinate information of the application feature point and the coordinate information of the facial fixation feature point. An instruction unit that instructs the application unit to apply cosmetics to the aforementioned area. A program designed to function as such.

8. A feature point registration unit stores coordinate information of at least two feature points for application on the face, and coordinate information of a face-fixing feature point that is a different feature point from the application feature point, Identify the location of the feature points used to fix the user's face, A region determination unit that determines the area to which the selected application pattern of cosmetics will be applied, based on the position of the user's face-fixing feature point identified above, and the relative positional relationship between the stored coordinate information of the application feature point and the coordinate information of the face-fixing feature point, An instruction unit that instructs the application device to apply cosmetics to the aforementioned area. A control device equipped with the following features.

Images