Face classification method, classification device, program, classification diagram, and method for presenting image by beauty care

Abstract

To classify a face.SOLUTION: A face classification method includes the steps of: comparing a face of a user with an average face formed from a plurality of faces to position the same on the basis of a first index indicating opening of his or her eyes; comparing the face of the user with the average face to position the same on the basis of a second index indicating at least one of angles of his or her eyes and / or eyebrows, an area of his or her chin, and centripetal and / or centrifugal eyes; and comparing the face of the user with the average face to position the same on the basis of a third index indicating at least one of a relative length of the face of the user and a relative length of his or her nose.SELECTED DRAWING: Figure 11

Description

[Technical field]

[0001] The present invention relates to a face classification method, a classification device, a program, a classification chart, and a method for creating an image through beauty. [Background technology]

[0002] Conventionally, a classification method for classifying human facial features according to their characteristics has been known. In Patent Document 1, human facial features are classified according to their characteristics based on the length of the face, the arrangement of the facial morphological elements including the eyes, eyebrows, mouth, and nose, the contour shape of the face, and the contour shapes of the facial morphological elements. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 3529954 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the face classification method in Patent Document 1 was for creating an image of women using makeup, and so there was a problem that the face classification method in Patent Document 1 could not be applied to men in some cases.

[0005] Therefore, the present invention aims to classify male faces. [Means for solving the problem]

[0006] One aspect of the present invention includes the steps of positioning a user's face in comparison to an average face formed from a plurality of faces based on a first indicator indicating eye opening; positioning the user's face in comparison to the average face based on a second indicator indicating at least one of an angle of the eyes and / or eyebrows, an area of ​​the chin, and a centripetal and / or centrifugal angle of the eyes; and positioning the user's face in comparison to the average face based on a third indicator indicating at least one of a verticality of the face and a verticality of the nose. Effect of the Invention

[0007] According to the present invention, male faces can be classified. [Brief description of the drawings]

[0008] [Figure 1] FIG. 2 is a face classification diagram according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a face classification diagram according to an embodiment of the present invention. [Diagram 3] FIG. 2 is a face classification diagram according to an embodiment of the present invention. [Figure 4] FIG. 2 is a face classification diagram according to an embodiment of the present invention. [Diagram 5] FIG. 2 is a face classification diagram according to an embodiment of the present invention. [Figure 6] 11 is a flowchart of a determination process based on a first index according to one embodiment of the present invention. [Figure 7] 13 is a flowchart of a determination process based on a second index according to an embodiment of the present invention. [Figure 8] 13 is a flowchart of a determination process based on a third index according to an embodiment of the present invention. [Figure 9] 4 is a flowchart of a face classification process according to an embodiment of the present invention. [Figure 10] 1 is an overall configuration diagram according to an embodiment of the present invention; [Figure 11] FIG. 1 is a functional block diagram of a classification device according to an embodiment of the present invention. [Figure 12]FIG. 2 is a block diagram showing an example of a hardware configuration of a classification device according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0010] In the present invention, human (also called user) faces can be classified into 12 categories based on three indices.

[0011] <Experiment details> In the present invention, a user's face can be classified into 12 categories based on a classification chart as shown in Figures 1 to 5. First, the details of an experiment carried out to create such a classification chart will be described.

[0012] Using multidimensional scaling (MDS), the 24 male facial images were positioned in 3D space based on their similarity to each other, as shown below. The subjects took the test on a personal computer. Specifically, the subjects looked at two face images (presentation time: 4 seconds) displayed on the personal computer, one on each side, and rated the two face images on a 6-point scale from 0 (not similar) to 5 (very similar) (time required: about 30-40 minutes).

[0013] Next, 22 types of composite faces were created based on the coordinates of the images of the faces of 24 men positioned in three-dimensional space (by creating an average face (composite face) for each axis or quadrant, common features of the faces on the axis or quadrant are emphasized), and the subjects evaluated the impression of each composite face. As a result, a first index, a second index, and a third index for classifying faces in three-dimensional space, and the impression of faces located in each quadrant in three-dimensional space were found. The first index, the second index, the third index, and the impression of faces located in each quadrant in three-dimensional space are described in detail below.

[0014] <Classification diagram> FIG. 1 is a face classification diagram according to an embodiment of the present invention. As shown in FIG. 1, the classification diagram is a three-dimensional space with coordinate axes of a first axis indicating a first index (eye opening), a second axis indicating a second index (at least one of the angle of the eyes and / or eyebrows, the area of ​​the chin, and the centripetal and / or centrifugal of the eyes), and a third axis indicating a third index (at least one of the verticality of the face and the verticality of the nose). An average face is placed at the origin (i.e., the point where the first axis, the second axis, and the third axis intersect). The average face and each index and each axis will be described below.

[0015] <<Average face>> The average face is a face created by synthesizing multiple facial images using computer graphics technology. For example, the average face is a representative male face that averages the facial features of multiple males. For example, average faces classified by age, race, etc. may be created, and the average face classified by the same category as the user may be used.

[0016] <<First indicator>> Eye opening is the ratio of the vertical width (for example, the longest distance between the upper and lower eyelids) to the horizontal width (for example, the distance between the inner corner and outer corner of the eye); the longer the vertical width compared to the horizontal width, the larger the eye opening is said to be, and the shorter the vertical width compared to the horizontal width, the smaller the eye opening is said to be.

[0017] <<First axis (dimension I)>> One side of the first axis represents the degree to which the eyes are wide open, and the other side of the first axis represents the degree to which the eyes are narrow open.

[0018] The first axis indicates friendliness: when the eyes are wide open, the friendliness increases.

[0019] <<Second indicator>> The angle of the eyes and / or eyebrows is the angle between the eyes and / or eyebrows and a horizontal line (a line perpendicular to the midline that passes through the center of the face) (the angle when moved toward the top of the head is positive, and the angle when moved toward the chin is negative). The larger the angle (the eye and / or eyebrows are raised at the outer corners), the larger the angle of the eyes and / or eyebrows is, and the smaller the angle (the eye and / or eyebrows are lowered at the outer corners), the smaller the angle of the eyes and / or eyebrows is. The area of ​​the chin is the area of ​​the front of the chin (for example, the area of ​​the area surrounded by the horizontal line passing through the left and right nostrils and the face line on the chin side as seen from the front). The larger the area of ​​the front of the chin, the larger the area of ​​the chin, and the smaller the area of ​​the front of the chin, the smaller the area of ​​the chin. The centripetal and / or centrifugal of the eyes is the distance between the eyes, and the shorter the distance between the eyes, the more centripetal, and the longer the distance between the eyes, the more centrifugal.

[0020] <<Second Axis (Dimension II)>> One of the second axes represents the degree to which the angle of the eyes and / or eyebrows is large, the area of ​​the chin is small, and the distance between the eyes is short, while the other of the second axes represents the degree to which the angle of the eyes and / or eyebrows is small, the area of ​​the chin is large, and the distance between the eyes is long.

[0021] The second axis indicates sophistication and agility. The larger the angle of the eyes and / or eyebrows, the smaller the chin area, and the closer the distance between the eyes, the greater the impression of sophistication and / or agility. The smaller the angle of the eyes and / or eyebrows, the larger the chin area, and the greater the distance between the eyes, the greater the impression of simplicity and / or calm.

[0022] <<Third indicator>> The verticality of a face is the ratio of its vertical width (e.g., the distance between the hairline and the midline at the tip of the chin) to its horizontal width (e.g., the distance between the horizontal line passing through the root of the nose and the intersection of the left and right face lines), and the longer the vertical width is compared to the horizontal width, the greater the verticality of the face, and the shorter the vertical width is compared to the horizontal width, the smaller the verticality of the face. The verticality of a nose is the ratio of its vertical width (e.g., the distance between the two nostrils) to its horizontal width (e.g., the distance between the root of the nose and the tip of the nose), and the longer the vertical width is compared to the horizontal width, the greater the verticality of the nose, and the shorter the vertical width is compared to the horizontal width, the smaller the verticality of the nose.

[0023] <<The Third Axis (Dimension III)>> One of the third axes represents the degree to which the face is elongated vertically and the nose is elongated vertically, while the other of the third axis represents the degree to which the face is elongated vertically and the nose is elongated vertically.

[0024] The third axis indicates muscularity. When at least one of the face length and nose length is small, muscularity increases. When at least one of the face length and nose length is large, delicacy increases.

[0025] FIG. 2 is a classification diagram of faces according to an embodiment of the present invention. FIG. 2 is a classification diagram in which representative face images located in each quadrant of the three-dimensional space in FIG. 1 are arranged, and the representative impressions of the faces located in each quadrant are displayed in words. Hereinafter, each quadrant in FIG. 2 will be described separately in FIG. 3, FIG. 4, and FIG. 5. FIG. 3 is a plane where the first axis and the second axis intersect. FIG. 4 is a plane where the first axis and the second axis intersect, and is a quadrant where the third index (at least one of the verticality of the face and the verticality of the nose) is larger than that of the average face. FIG. 5 is a plane where the first axis and the second axis intersect, and is a quadrant where the third index (at least one of the verticality of the face and the verticality of the nose) is smaller than that of the average face.

[0026] Fig. 3 is a face classification diagram according to an embodiment of the present invention. As described above, Fig. 3 is a plane where the first axis and the second axis intersect.

[0027] <Makoto> The faces classified in the upper left of FIG. 3 are faces with eyes that are wider than the average face. The faces classified in the upper left of FIG. 3 are faces with eyes and / or eyebrows that are angled wider than the average face. Alternatively, the faces classified in the upper left of FIG. 3 are faces with a smaller chin area than the average face. Alternatively, the faces classified in the upper left of FIG. 3 are faces with eyes that are closer to each other than the average face. The faces classified in the upper left of FIG. 3 give the impression of being friendly and at least one of refined and agile (hereinafter also referred to as refined and agile). The impression given by the faces classified in the upper left of FIG. 3 is expressed by the word <sincerity>.

[0028] <Rin> Faces classified in the upper right of Figure 3 are faces with eyes that are less open than the average face. Faces classified in the upper right of Figure 3 are faces with eyes and / or eyebrows that are angled larger than the average face. Alternatively, faces classified in the upper right of Figure 3 are faces with a smaller jaw area than the average face. Alternatively, faces classified in the upper right of Figure 3 are faces with eyes that are closer to each other than the average face. Faces classified in the upper right of Figure 3 give the impression of being unfriendly, sophisticated, and agile. The impression given by faces classified in the upper right of Figure 3 is expressed by the word <dignified>.

[0029] <Craftsman> Faces classified in the lower right of Fig. 3 are faces with eyes that are smaller than the average face. Faces classified in the lower right of Fig. 3 are faces with eyes and / or eyebrows that are angled smaller than the average face. Alternatively, faces classified in the lower right of Fig. 3 are faces with a larger chin area than the average face. Alternatively, faces classified in the lower right of Fig. 3 are faces with a longer distance between the eyes than the average face. Faces classified in the lower right of Fig. 3 give the impression of being unfriendly and at least one of simple and gentle (hereinafter also referred to as simple / gentle). The impression given by faces classified in the lower right of Fig. 3 is expressed by the word <artisan>.

[0030] <Healing> Faces classified in the lower left of Figure 3 are faces with eyes that are wider than the average face. Faces classified in the lower left of Figure 3 are faces with eyes and / or eyebrows that are angled smaller than the average face. Alternatively, faces classified in the lower left of Figure 3 are faces with a larger chin area than the average face. Alternatively, faces classified in the lower left of Figure 3 are faces with a longer distance between the eyes than the average face. Faces classified in the lower left of Figure 3 give the impression of being friendly, simple, and calm. The impression given by faces classified in the lower left of Figure 3 is expressed by the word <healing>.

[0031] Fig. 4 is a diagram showing a classification of faces according to an embodiment of the present invention. Specifically, the faces shown in Fig. 4 are faces in which at least one of the vertical elongation of the face and the vertical elongation of the nose is greater than that of an average face.

[0032] <Sincerity x Delicacy> A face classified in the upper left of FIG. 4 is a face with eyes that are wider than the average face. A face classified in the upper left of FIG. 4 is a face with eyes and / or eyebrows that are angled wider than the average face. Alternatively, a face classified in the upper left of FIG. 4 is a face with a smaller chin area than the average face. Alternatively, a face classified in the upper left of FIG. 4 is a face with eyes that are closer to each other than the average face. A face classified in the upper left of FIG. 4 gives the impression of being friendly, sophisticated, agile, and delicate. The impression given by a face classified in the upper left of FIG. 4 is expressed by the words <sincerity x sensitivity>.

[0033] <Dignified x Delicate> Faces classified in the upper right of FIG. 4 are faces with eyes that are smaller than the average face. Faces classified in the upper right of FIG. 4 are faces with eyes and / or eyebrows that are angled larger than the average face. Alternatively, faces classified in the upper right of FIG. 4 are faces with a smaller chin area than the average face. Alternatively, faces classified in the upper right of FIG. 4 are faces with eyes that are closer to each other than the average face. Faces classified in the upper right of FIG. 4 give the impression of being unfriendly, sophisticated, agile, and delicate. The impression given by faces classified in the upper right of FIG. 4 can be expressed with the words <dignified x delicate>.

[0034] <Masterful x Delicate> Faces classified in the lower right of Fig. 4 are faces with eyes that are less open than the average face. Faces classified in the lower right of Fig. 4 are faces with eyes and / or eyebrows that are angled less than the average face. Alternatively, faces classified in the lower right of Fig. 4 are faces with a larger chin area than the average face. Alternatively, faces classified in the lower right of Fig. 4 are faces with a longer distance between the eyes than the average face. Faces classified in the lower right of Fig. 4 give the impression of being unfriendly, simple, calm, and delicate. The impression given by faces classified in the lower right of Fig. 4 can be expressed with the words <artisan x delicate>.

[0035] <Soothing x Delicate> Faces classified in the lower left of Fig. 4 are faces with eyes that are wider than the average face. Faces classified in the lower left of Fig. 4 are faces with eyes and / or eyebrows that are angled smaller than the average face. Alternatively, faces classified in the lower left of Fig. 4 are faces with a larger chin area than the average face. Alternatively, faces classified in the lower left of Fig. 4 are faces with a longer distance between the eyes than the average face. Faces classified in the lower left of Fig. 4 give the impression of being friendly, simple, calm, and delicate. The impression given by faces classified in the lower left of Fig. 4 is expressed by the words <soothing x delicate>.

[0036] Fig. 5 is a diagram showing a classification of faces according to an embodiment of the present invention. Specifically, the faces shown in Fig. 5 are faces in which at least one of the vertical elongation of the face and the vertical elongation of the nose is smaller than that of an average face.

[0037] <Sincerity x Toughness> The faces classified in the upper left of FIG. 5 are faces with eyes that are wider than the average face. The faces classified in the upper left of FIG. 5 are faces with eyes and / or eyebrows that are angled wider than the average face. Alternatively, the faces classified in the upper left of FIG. 5 are faces with a smaller chin area than the average face. Alternatively, the faces classified in the upper left of FIG. 5 are faces with eyes that are closer to each other than the average face. The faces classified in the upper left of FIG. 5 give the impression of being friendly, sophisticated, agile, and robust. The impression given by the faces classified in the upper left of FIG. 5 is expressed by the words <sincerity x robust>.

[0038] <Dignified x Tough> Faces classified in the upper right of FIG. 5 are faces with eyes that are smaller than the average face. Faces classified in the upper right of FIG. 5 are faces with eyes and / or eyebrows that are angled larger than the average face. Alternatively, faces classified in the upper right of FIG. 5 are faces with a smaller chin area than the average face. Alternatively, faces classified in the upper right of FIG. 5 are faces with eyes that are closer to each other than the average face. Faces classified in the upper right of FIG. 5 give an impression of being unfriendly, sophisticated, agile, and robust. The impression given by faces classified in the upper right of FIG. 5 can be expressed with the words <dignified x robust>.

[0039] <Craftsmanship x Toughness> Faces classified in the lower right of Figure 5 are faces with eyes that are less open than the average face. Faces classified in the lower right of Figure 5 are faces with eyes and / or eyebrows that are angled less than the average face. Alternatively, faces classified in the lower right of Figure 5 are faces with a larger chin area than the average face. Alternatively, faces classified in the lower right of Figure 5 are faces with a longer distance between the eyes than the average face. Faces classified in the lower right of Figure 5 give an impression of being unfriendly, simple, gentle, and robust. The impression given by faces classified in the lower right of Figure 5 can be expressed with the words <artisan x robust>.

[0040] <Comfortable x Strong> Faces classified in the lower left of Figure 5 are faces with eyes that are wider than the average face. Faces classified in the lower left of Figure 5 are faces with eyes and / or eyebrows that are angled smaller than the average face. Alternatively, faces classified in the lower left of Figure 5 are faces with a larger chin area than the average face. Alternatively, faces classified in the lower left of Figure 5 are faces with a longer distance between the eyes than the average face. Faces classified in the lower left of Figure 5 give the impression of being friendly, simple, calm, and robust. The impression given by faces classified in the lower left of Figure 5 can be expressed with the words <soothing x robust>.

[0041] As shown in Figures 2 to 5, the face classification diagram can arrange representative face images located in each quadrant (i.e., each category) in a three-dimensional space. Also, the face classification diagram can display in words the representative impression of the face located in each quadrant.

[0042] <Method> Below, with reference to Figures 6 to 9, the face classification method will be explained, divided into <judgment processing based on a first indicator>, <judgment processing based on a second indicator>, <judgment processing based on a third indicator> and <classification processing>.

[0043] Note that, although Figures 6 to 9 illustrate an example in which a beauty consultant classifies the face of a user (e.g., a customer who is about to purchase a beauty product), the present invention can be applied to cases in which any person classifies the face of any user.

[0044] <Decision-making process based on the first indicator> FIG. 6 is a flowchart of a determination process based on a first index according to an embodiment of the present invention.

[0045] In step 11 (S11), the beauty consultant visually checks the opening of the user's eyes (first index). As described above, the opening of the eyes is the ratio of the vertical width to the horizontal width of the eyes, and the longer the vertical width is compared to the horizontal width, the larger the opening of the eyes is, and the shorter the vertical width is compared to the horizontal width, the smaller the opening of the eyes is.

[0046] In step 12 (S12), the beauty consultant compares the eye opening of the user confirmed in S11 with the eye opening of an average face.

[0047] In step 13 (S13), the beauty consultant positions the user's face on a first axis indicating the eye opening (first index). Specifically, if the user's eye opening is larger than that of an average face, the beauty consultant positions the user's face on the first axis in the direction of the larger eye opening. Also, if the user's eye opening is smaller than that of an average face, the beauty consultant positions the user's face on the first axis in the direction of the smaller eye opening.

[0048] <Decision-making process based on the second indicator> FIG. 7 is a flowchart of a determination process based on the second index according to an embodiment of the present invention.

[0049] In step 21 (S21), the beauty consultant visually checks at least one of the user's eye and / or eyebrow angle, chin area, and eye centripetal and / or centrifugal angles (second indicators). As described above, the eye and / or eyebrow angle is the angle between the eye and / or eyebrow and a horizontal line (a line perpendicular to the midline that passes through the center of the face) (the angle when moved toward the top of the head is positive, and the angle when moved toward the chin is negative), and the larger the angle (the eye and / or eyebrow is raised at the outer corner), the larger the eye and / or eyebrow angle is, and the smaller the angle (the eye and / or eyebrow is lowered at the outer corner), the smaller the eye and / or eyebrow angle is. The chin area is the area of ​​the front of the chin, and the larger the area of ​​the front of the chin is, the larger the chin area is, and the smaller the area of ​​the front of the chin is, the smaller the chin area is. In addition, the centripetal and / or centrifugal of the eyes refers to the distance between the eyes; the closer the distance between the eyes, the more centripetal it is, and the longer the distance between the eyes, the more centrifugal it is.

[0050] In step 22 (S22), the beauty consultant compares the angle of the user's eyes and / or eyebrows confirmed in S21 with the angle of the eyes and / or eyebrows of the average face. The beauty consultant also compares the area of ​​the user's chin confirmed in S21 with the area of ​​the chin of the average face. The beauty consultant also compares the centripetal and / or centrifugal of the user's eyes confirmed in S21 with the centripetal and / or centrifugal of the eyes of the average face.

[0051] In step 23 (S23), the beauty consultant positions the user's face on a second axis indicating at least one of the following (second indicators): eye and / or eyebrow angle, chin area, and eye centripetal and / or centrifugal.

[0052] Specifically, if the angle of the user's eyes and / or eyebrows is larger than that of the average face, the beauty consultant positions the user's face in a direction in which the angle of the eyes and / or eyebrows on the second axis is larger. Also, if the angle of the user's eyes and / or eyebrows is smaller than that of the average face, the beauty consultant positions the user's face in a direction in which the angle of the eyes and / or eyebrows on the second axis is smaller.

[0053] Furthermore, if the user's chin area is smaller than that of the average face, the beauty consultant positions the user's face in the direction on the second axis where the chin area is smaller. Furthermore, if the user's chin area is larger than that of the average face, the beauty consultant positions the user's face in the direction on the second axis where the chin area is larger.

[0054] Furthermore, if the distance between the user's eyes is shorter than that of the average face, the beauty consultant positions the user's face in the centripetal direction on the second axis, and if the distance between the user's eyes is longer than that of the average face, the beauty consultant positions the user's face in the centrifugal direction on the second axis.

[0055] When multiple second indices are used (for example, when "eye angle" and "brow angle" are used, or when "eye angle" and "chin area" are used), the direction on the second axis may be determined for each indices, and the direction in which the user's face is positioned may be determined by majority vote (i.e., the direction determined by the most indices is adopted). Indices may also be weighted (for example, "eye angle" may be weighted more heavily than "brow angle" in evaluation, or "eye angle" may be weighted more heavily than "chin area" in evaluation, etc.).

[0056] <Decision-making process based on the third indicator> FIG. 8 is a flowchart of a determination process based on the third index according to an embodiment of the present invention.

[0057] In step 31 (S31), the beauty consultant visually checks at least one of the face length and nose length (third index). As described above, the face length is the ratio of the length to the width of the face, and the longer the length is compared to the width, the greater the face length, and the shorter the length is compared to the width, the smaller the face length. The nose length is the ratio of the length to the width of the nose, and the longer the length is compared to the width, the greater the nose length, and the shorter the length is compared to the width, the smaller the nose length.

[0058] In step 32 (S32), the beauty consultant compares the face elongation confirmed in S31 with the face elongation of an average face, and also compares the nose elongation confirmed in S31 with the nose elongation of an average face.

[0059] In step 33 (S33), the beauty consultant positions the user's face on a third axis indicating at least one of the face elongation and the nose elongation (third index).

[0060] Specifically, if the vertical length of the user's face is greater than that of the average face, the beauty consultant positions the user's face in the direction of greater vertical length on the third axis, and if the vertical length of the user's face is less than that of the average face, the beauty consultant positions the user's face in the direction of less vertical length on the third axis.

[0061] Furthermore, if the vertical length of the user's nose is greater than that of the average face, the beauty consultant positions the user's face in a direction on the third axis where the vertical length of the nose is greater. Furthermore, if the vertical length of the user's nose is less than that of the average face, the beauty consultant positions the user's face in a direction on the third axis where the vertical length of the nose is smaller.

[0062] In addition, when multiple third indices are used (i.e., when "vertical length of face" and "vertical length of nose" are used), the direction on the third axis may be determined for each indices, and the direction in which the user's face is positioned may be determined by majority vote (i.e., the direction determined by the greater number of indices is adopted). Indices may also be weighted (for example, "vertical length of face" may be weighted more heavily in evaluation than "vertical length of nose", or "vertical length of nose" may be weighted more heavily in evaluation than "vertical length of face").

[0063] <Classification process> FIG. 9 is a flowchart of a face classification process according to an embodiment of the present invention.

[0064] In step 41 (S41), the beauty consultant executes the <determination process based on the first index> described with reference to FIG.

[0065] In step 42 (S42), the beauty consultant executes the <determination process based on the second index> described with reference to FIG.

[0066] In step 43 (S43), the beauty consultant executes the <determination process based on the third index> described with reference to FIG.

[0067] It should be noted that S41 to S43 may be executed in any order.

[0068] In step 44 (S44), the beauty consultant positions the user's face in a three-dimensional space having a first axis, a second axis, and a third axis as coordinate axes based on the results of the judgments made in S41 to S43. Specifically, the beauty consultant positions the user's face in a space that is in the direction of the first axis positioned in S41, the direction of the second axis positioned in S42, and the direction of the third axis positioned in S43. In other words, the beauty consultant can classify the user's face into one of at least 12 categories.

[0069] The method of classifying faces (i.e., the above-mentioned <judgment process based on the first index>, <judgment process based on the second index>, <judgment process based on the third index>, and <classification process>) may be performed by a person such as a beauty consultant, or may be performed by the classification device 10 described in Figures 10 to 12.

[0070] <System configuration> Fig. 10 is a diagram showing an overall configuration according to an embodiment of the present invention. As shown in Fig. 10, a classification device 10 is communicably connected to one or more user terminals 20 via an arbitrary network 30. Each of them will be described below.

[0071] The classification device 10 executes a face classification method in response to a request from a user terminal 20. The classification device 10 is composed of one or more computers. The classification device 10 can also transmit and receive data to and from the user terminal 20 via an arbitrary network 30. The classification device 10 will be described in detail later with reference to FIG. 11.

[0072] The user terminal 20 transmits the face image input to the user terminal 20 to the classification device 10. The user terminal 20 also receives the face classification result from the classification device 10 and displays it on the display. The user terminal 20 may be any terminal such as a personal computer, a tablet terminal, or a smartphone.

[0073] In addition, in FIG. 10, the classification device 10 and the user terminal 20 are described as separate devices, but the classification device 10 and the user terminal 20 may be implemented in a single device.

[0074] <Function block> Fig. 11 is a functional block diagram of a classification device 10 according to an embodiment of the present invention. As shown in Fig. 11, the classification device 10 includes a receiving unit 100, a first determination unit 101, a second determination unit 102, a third determination unit 103, a classification unit 104, and a transmission unit 105. Furthermore, the classification device 10 executes a program to function as the receiving unit 100, the first determination unit 101, the second determination unit 102, the third determination unit 103, the classification unit 104, and the transmission unit 105. Each of these units will be described below.

[0075] The receiving unit 100 receives an image of the user's face from the user terminal 20.

[0076] The first determination unit 101 can execute the <Determination process based on the first index> in Fig. 6. Specifically, the first determination unit 101 analyzes the image of the user's face received by the receiving unit 100 to calculate the opening of the user's eyes. The first determination unit 101 also compares the opening of the user's eyes with the opening of the average face. The first determination unit 101 also positions the user's face on a first axis indicating the opening of the eyes (first index).

[0077] The first determination unit 101 may be configured to position the user's face on the first axis depending on the degree to which the user's eyes are opened, or the degree to which the user's eyes are opened.

[0078] The second determination unit 102 can execute the <Determination process based on the second index> of FIG. 7. Specifically, the second determination unit 102 analyzes the image of the user's face received by the receiving unit 100 to calculate at least one of the user's eye and / or eyebrow angle, the chin area, and the eye centripetal and / or centrifugal of the eye. The second determination unit 102 also compares the user's eye and / or eyebrow angle with the eye and / or eyebrow angle of the average face. The second determination unit 102 also compares the user's chin area with the chin area of ​​the average face. The second determination unit 102 also compares the user's eye centripetal and / or centrifugal of the eye with the eye centripetal and / or centrifugal of the average face. In addition, the second judgment unit 102 positions the user's face on a second axis indicating at least one (second indicator) of the angle of the eyes and / or eyebrows, the area of ​​the chin, and the centripetal and / or centrifugal orientation of the eyes.

[0079] The second determination unit 102 may be configured to position the user's face on the second axis depending on the degree to which the angle of the user's eyes and / or eyebrows is large or the degree to which the angle of the user's eyes and / or eyebrows is small. The second determination unit 102 may be configured to position the user's face on the second axis depending on the degree to which the area of ​​the user's chin is small or the degree to which the area of ​​the user's chin is large. The second determination unit 102 may be configured to position the user's face on the second axis depending on the degree to which the distance between the user's eyes is short or the degree to which the distance between the user's eyes is long.

[0080] The third determination unit 103 can execute the <Determination process based on the third index> in Fig. 8. Specifically, the third determination unit 103 analyzes the image of the user's face received by the receiving unit 100, and calculates at least one of the user's face length and nose length. The third determination unit 103 also compares the user's face length with the face length of an average face. The third determination unit 103 also compares the user's nose length with the nose length of an average face. The third determination unit 103 also positions the user's face on a third axis indicating at least one of the face length and nose length (third index).

[0081] The third determination unit 103 may be configured to position the user's face on the third axis depending on the degree to which the vertical elongation of the user's face is large or small. The third determination unit 103 may be configured to position the user's face on the third axis depending on the degree to which the vertical elongation of the user's nose is large or small.

[0082] The average face may be created in advance, or may be created each time a face is classified. The average face may also be updated periodically.

[0083] The classification unit 104 classifies the user's face based on the result of the judgment by the first judgment unit 101, the result of the judgment by the second judgment unit 102, and the result of the judgment by the third judgment unit 103. Specifically, the classification unit 104 positions the user's face in a space that is in the direction of the first axis positioned by the first judgment unit 101, the direction of the second axis positioned by the second judgment unit 102, and the direction of the third axis positioned by the third judgment unit 103 in a three-dimensional space having a first axis, a second axis, and a third axis as coordinate axes.

[0084] In addition, the classification unit 104 can also be configured to further classify within each category depending on the degree of difference between each index between the user's face and the average face (for example, very friendly, slightly friendly, slightly unfriendly, very unfriendly, etc.).

[0085] The transmitting unit 105 notifies the user terminal 20 of the classification result by the classifying unit 104 (i.e., which of the 12 categories the user's face belongs to). Note that the transmitting unit 105 can also be configured to notify information on friendliness, sophistication / agileness, and toughness in addition to the information on which of the 12 categories the user's face belongs to.

[0086] <Effects> Thus, in one embodiment of the present invention, by comparing a person's face (e.g., a male face) with an average face, the face of the person can be classified into one of at least 12 categories. For example, a beauty consultant can apply beauty treatments to a customer to change the impression of the customer's face (create an image) based on the result of classifying the customer's face.

[0087] <Hardware configuration> 12 is a block diagram showing an example of a hardware configuration of a classification device 10 according to an embodiment of the present invention. The classification device 10 has a CPU (Central Processing Unit) 1, a ROM (Read Only Memory) 2, and a RAM (Random Access Memory) 3. The CPU 1, the ROM 2, and the RAM 3 form a so-called computer.

[0088] The classification device 10 may also have an auxiliary storage device 4, a display device 5, an operation device 6, an I / F (Interface) device 7, and a drive device 8. The hardware components of the classification device 10 are connected to each other via a bus B.

[0089] The CPU 1 is a computing device that executes various programs installed in the auxiliary storage device 4 .

[0090] The ROM 2 is a non-volatile memory. The ROM 2 functions as a main storage device that stores various programs, data, etc. required for the CPU 1 to execute various programs installed in the auxiliary storage device 4. Specifically, the ROM 2 functions as a main storage device that stores boot programs such as a BIOS (Basic Input / Output System) and an EFI (Extensible Firmware Interface).

[0091] The RAM 3 is a volatile memory such as a dynamic random access memory (DRAM) or a static random access memory (SRAM). The RAM 3 functions as a main storage device that provides a working area in which various programs installed in the auxiliary storage device 4 are expanded when the CPU 1 executes them.

[0092] The auxiliary storage device 4 is an auxiliary storage device that stores various programs (for example, the program according to the present invention) and information used when the various programs are executed.

[0093] The display device 5 is a display device that displays the internal state of the classification device 10 and the like.

[0094] The operation device 6 is an input device through which an administrator of the classification device 10 inputs various instructions to the classification device 10 .

[0095] The I / F device 7 is a communication device for connecting to a network and communicating with the user terminal 20 .

[0096] The drive device 8 is a device for setting the storage medium 9. The storage medium 9 here includes media that record information optically, electrically, or magnetically, such as a CD-ROM, a flexible disk, a magneto-optical disk, etc. The storage medium 9 may also include semiconductor memories that record information electrically, such as an EPROM (Erasable Programmable Read Only Memory), a flash memory, etc.

[0097] The various programs to be installed in the auxiliary storage device 4 are installed, for example, by setting the distributed storage medium 9 in the drive device 8 and reading out the various programs recorded in the storage medium 9 by the drive device 8. Alternatively, the various programs to be installed in the auxiliary storage device 4 may be installed by being downloaded from a network via the I / F device 7.

[0098] Although the embodiments of the present invention have been described in detail above, the present invention is not limited to the specific embodiments described above, and various modifications and variations are possible within the scope of the gist of the present invention as defined in the claims.

[0099] <Additional Notes> (Item 1) 1. A method for computerized face classification, comprising: A first axis indicating a first index indicating the opening of the eyes; a second axis indicating a second index indicative of at least one of the eye and / or brow angle, the chin area, and the eye centripetal and / or centripetal; a third axis indicating a third index indicating at least one of face elongation and nose elongation; forming a coordinate system with coordinate axes of placing an average face formed from a plurality of faces based on the first index, the second index, and the third index at the origin of the coordinate system; determining in which position of the coordinate system a user's face is located based on the first index, the second index, and the third index; classifying the user's facial features into features or impressions based on the positions; Includes Face classification. (Item 2) positioning the user's face relative to the average face based on the first metric; positioning the user's face relative to the average face based on the second metric; positioning the user's face relative to the average face based on the third metric; Includes The face classification method described in item 1. (Item 3) A method for classifying faces according to item 1 for creating a beauty image. (Item 4) The above coordinate system is The first axis indicates the first index indicating the opening of the eye; the second axis indicating the second index indicating the centripetal and / or centrifugal of the eye; The third axis indicates the third index indicating the vertical elongation of the face. The face classification method described in item 1. (Item 5) Further classifying the user's face into each feature or impression category according to the degree of difference between each index of the user's face and the average face; The classification method described in item 1. (Item 6) (a) a first axis indicating a first index indicating the opening of the eyes; a second axis indicating a second index indicative of at least one of the eye and / or brow angle, the chin area, and the eye centripetal and / or centripetal; a third axis indicating a third index indicating at least one of face elongation and nose elongation; A coordinate system is formed with the coordinate axes as (b) locating an average face formed from a plurality of faces based on the first index, the second index, and the third index at the origin of the coordinate system; (c) determining in which position of the coordinate system the user's face is located based on the first index, the second index, and the third index; (d) classifying the user's facial features into features or impressions based on the location; Device. (Item 7) On the computer, A first axis indicating a first index indicating the opening of the eyes; a second axis indicating a second index indicative of at least one of the eye and / or brow angle, the chin area, and the eye centripetal and / or centripetal; a third axis indicating a third index indicating at least one of face elongation and nose elongation; A process of forming a coordinate system with the coordinate axes being a process of locating an average face formed from a plurality of faces on the basis of the first index, the second index, and the third index at the origin of the coordinate system; A process of determining in which position of the coordinate system a user's face is located based on the first index, the second index, and the third index; A process of classifying the facial features of the user into features or impressions based on the position. A program for executing the above. (Item 8) 1. A method for computerized face classification, comprising: A first axis indicating a first index indicating the opening of the eyes; a second axis indicating a second index indicative of at least one of the eye and / or brow angle, the chin area, and the eye centripetal and / or centripetal; a third axis indicating a third index indicating at least one of face elongation and nose elongation; forming a coordinate system with coordinate axes of determining in which position of the coordinate system the user's face is located based on the first index, the second index, and the third index; A facial classification method including. (Item 9) The above coordinate system is a first plane that passes through a first point on the third axis and where the first axis and the second axis intersect; a second plane passing through a second point on the third axis and intersecting the first axis and the second axis; a third plane that passes through a third point on the third axis and where the first axis and the second axis intersect; is a three-dimensional coordinate system including the value of the third index at the second point is greater than the value of the third index at the first point; 9. The classification method according to item 8, wherein the value of the third index at the third point is smaller than the value of the third index at the first point. (Item 10) (a) The first axis indicates the degree of eye opening; a second axis indicating a degree of at least one of the angle of the eyes and / or eyebrows, the area of ​​the chin, and the centripetal and / or centrifugal of the eyes; a third axis indicating a degree of at least one of face elongation and nose elongation; A coordinate system with the coordinate axes as (b) an average face that is placed at the origin of the coordinate system and is created by synthesizing multiple facial images using computer graphics technology; and Consists of: A classification diagram for classifying faces. (Item 11) the first axis indicates a degree to which the mesh opening is large on one side and a degree to which the mesh opening is small on the other side; the second axis indicates, on one side, the degree to which the angle of the eyes and / or eyebrows is large, the degree to which the area of ​​the chin is small, and the degree to which the distance between the eyes is short, and the other axis indicates, on the other side, the degree to which the angle of the eyes and / or eyebrows is small, the degree to which the area of ​​the chin is large, and the degree to which the distance between the eyes is long, the third axis indicates, on one side, a degree to which the vertical elongation of the face is large and a degree to which the vertical elongation of the nose is large, and the other axis indicates, on the other side, a degree to which the vertical elongation of the face is small and a degree to which the vertical elongation of the nose is small, Classification diagram described in item 10. (Item 12) The first axis indicates the degree of familiarity on one side and the degree of unfamiliarity on the other side, The second axis indicates, on the one hand, the degree of sophistication and / or agility, and, on the other hand, the degree of simplicity and / or gentleness; The third axis indicates the degree of toughness on the one hand and the degree of delicacy on the other. Item 10 or 11. Classification diagram according to item 10 or 11. (Item 13) In each quadrant, a representative face image located in that quadrant is placed. Classification diagram described in item 12. (Item 14) In each quadrant, a typical impression of the face located in that quadrant is displayed in words. 14. A classification diagram according to any one of items 11 to 13. (Item 15) A step in which a computer creates a classification diagram according to item 11; positioning the user's face in said classification map relative to an average face; a step of applying beauty treatment according to the first axis, the second axis, and the third axis to change an impression of the face; A method for creating an image using beauty. (Item 16) The above coordinate system is The first axis indicating the degree of opening of the eye; the second axis indicating the degree of centripetal and / or centrifugal motion of the eye; The third axis indicates the degree of vertical elongation of the face. Classification diagram described in item 10. (Item 17) Depending on the degree of each, the face is classified into each category according to features or impressions. Classification diagram described in item 10. (Item 18) The first axis indicates the degree of eye opening, a second axis indicating a degree of at least one of the angle of the eyes and / or eyebrows, the area of ​​the chin, and the centripetal and / or centrifugal of the eyes; a third axis indicating a degree of at least one of face elongation and nose elongation; Including a coordinate system with the coordinate axes A classification diagram for classifying faces. (Item 19) The above coordinate system is a first plane that passes through a first point on the third axis and where the first axis and the second axis intersect; a second plane passing through a second point on the third axis and intersecting the first axis and the second axis; a third plane that passes through a third point on the third axis and where the first axis and the second axis intersect; is a three-dimensional coordinate system including the value of the index indicated by the third axis at the second point is greater than the value of the index indicated by the third axis at the first point; Item 19. The classification diagram according to item 18, wherein the value of the index indicated by the third axis at the third point is smaller than the value of the index indicated by the third axis at the first point. (Item 20) (a) a first axis indicating a first index indicating the opening of the eyes; a second axis indicating a second index indicative of at least one of the eye and / or brow angle, the chin area, and the eye centripetal and / or centripetal; a third axis indicating a third index indicating at least one of face elongation and nose elongation; A coordinate system is formed with the coordinate axes as (b) determining in which position of the coordinate system the user's face is located based on the first index, the second index, and the third index; Device. (Item 21) The above coordinate system is a first plane that passes through a first point on the third axis and where the first axis and the second axis intersect; a second plane passing through a second point on the third axis and intersecting the first axis and the second axis; a third plane that passes through a third point on the third axis and where the first axis and the second axis intersect; is a three-dimensional coordinate system including the value of the third index at the second point is greater than the value of the third index at the first point; 21. The apparatus of claim 20, wherein the value of the third index at the third point is smaller than the value of the third index at the first point. (Item 22) On the computer, A first axis indicating a first index indicating the opening of the eyes; a second axis indicating a second index indicative of at least one of the eye and / or brow angle, the chin area, and the eye centripetal and / or centripetal; a third axis indicating a third index indicating at least one of face elongation and nose elongation; A process of forming a coordinate system with the coordinate axes being A process of determining in which position of the coordinate system the user's face is located based on the first index, the second index, and the third index. A program for executing. (Item 23) The above coordinate system is a first plane that passes through a first point on the third axis and where the first axis and the second axis intersect; a second plane passing through a second point on the third axis and intersecting the first axis and the second axis; a third plane that passes through a third point on the third axis and where the first axis and the second axis intersect; is a three-dimensional coordinate system including the value of the third index at the second point is greater than the value of the third index at the first point; Item 23. The program according to item 22, wherein the value of the third index at the third point is smaller than the value of the third index at the first point. (Item 24) A first axis indicating a first index indicating the opening of the eyes; a second axis indicating a second index indicative of at least one of the eye and / or brow angle, the chin area, and the eye centripetal and / or centripetal; a third axis indicating a third index indicating at least one of face elongation and nose elongation; forming a coordinate system having coordinate axes of x, y, and z by a computer; a step of placing an average face formed from a plurality of faces based on the first index, the second index, and the third index at an origin of the coordinate system by the computer; determining in which position of the coordinate system a user's face is located based on the first index, the second index, and the third index; classifying the user's facial features into features or impressions based on the positions; Includes Face classification. (Item 25) A first axis indicating a first index indicating the opening of the eyes; a second axis indicating a second index indicative of at least one of the eye and / or brow angle, the chin area, and the eye centripetal and / or centripetal; a third axis indicating a third index indicating at least one of face elongation and nose elongation; forming a coordinate system having coordinate axes of x, y, and z by a computer; determining in which position of the coordinate system the user's face is located based on the first index, the second index, and the third index; A facial classification method including. (Item 26) The above coordinate system is a first plane that passes through a first point on the third axis and where the first axis and the second axis intersect; a second plane passing through a second point on the third axis and intersecting the first axis and the second axis; a third plane that passes through a third point on the third axis and where the first axis and the second axis intersect; is a three-dimensional coordinate system including the value of the third index at the second point is greater than the value of the third index at the first point; 26. The classification method according to Item 25, wherein the value of the third index at the third point is smaller than the value of the third index at the first point. (Item 27) (a) forming a coordinate system with (i) a first axis indicating a first index indicating eye opening, (ii) a second axis indicating a second index indicating at least one of the angle of the eyes and / or eyebrows, the area of ​​the chin, and the centripetal and / or centrifugal of the eyes, and (iii) a third axis indicating a third index indicating at least one of the verticality of the face and the verticality of the nose; (b) determining in which position of the coordinate system the user's face is located based on the first index, the second index, and the third index; (c) applying beauty treatment according to the first axis, the second axis, and the third axis to change the impression of the face; A method for creating an image using beauty. [Explanation of symbols]

[0100] 10 Classifier 20 User terminal 30 Network 100 Receiver 101 First Judgment Section 102 Second Judgment Section 103 Third Judgment Division 104 Classification Department 105 Transmitter

Claims

1. A computer-based method for classifying faces, The first axis shows the first indicator of eye opening, A second axis showing a second index indicating at least one of the angles of the eye and / or eyebrow, the area of ​​the chin, and the centripetal and / or centrifugal aspects of the eye, A third axis showing a third indicator that shows at least one of the vertical length of the face and the vertical length of the nose, The step of forming a coordinate system with coordinate axes, The step of determining where the user's face is positioned in the coordinate system based on the first indicator, the second indicator, and the third indicator. A classification method for faces that includes [specific features / features].

2. The method for classifying faces according to claim 1, wherein the face is classified into one of the twelve categories.

3. Based on the first index, the second index, and the third index, the average face formed from multiple faces is placed at the origin of the coordinate system. The method for classifying faces according to claim 1, comprising creating average faces categorized by age and using the average face categorized in the same way as the user.

4. Based on the first index, the second index, and the third index, the average face formed from multiple faces is placed at the origin of the coordinate system. The face classification method according to claim 1, wherein the average face is created each time a face is classified.

5. The step of determining the position of the user's face in the coordinate system is as follows: (a) When multiple second indicators are used, A step in which a direction determined based on more of the second indicators is adopted as the direction in which the user's face is positioned on the second axis, A step of evaluating the position on the second axis by assigning weights to each of the plurality of second indicators, including and / or, (b) When multiple third indicators are used, In the step of adopting a direction determined based on more of the third indicators as the direction in which the user's face is positioned on the third axis, A step of evaluating the position on the third axis by assigning weights to each of the plurality of third indicators, including, The method for classifying faces according to claim 1.

6. A step of classifying the shape of the user's face by characteristic or impression based on the position, The process includes the step of presenting the user with a two-dimensional screen formed by the first axis and the second axis, in order to change the impression of the user's face by applying cosmetic treatment, In each quadrant of the aforementioned two-dimensional screen, the typical impression of the face located in that quadrant is displayed in words. The method for classifying faces according to claim 1, wherein the aforementioned words differ according to the third indicator.

7. The word includes a first word corresponding to the first index and the second index, and a second word corresponding to the third index, The method for classifying faces according to claim 6, wherein the second word is different according to the third indicator.

8. The face classification method according to claim 6, wherein representative face images located in each quadrant of the two-dimensional screen are placed in each quadrant.

9. The first axis is such that one side indicates the degree of friendliness and the other side indicates the degree of unfriendliness. The second axis, on one hand, indicates the degree to which something is at least one of refinement and agility, and on the other hand, indicates the degree to which something is at least one of simplicity and gentleness. The method for classifying faces according to claim 1, wherein the third axis indicates the degree of robustness on one side and the degree of delicacy on the other side.

10. A first axis that shows a first indicator of eye opening, A second axis showing a second index indicating at least one of the angles of the eye and / or eyebrow, the area of ​​the chin, and the centripetal and / or centrifugal aspects of the eye, A third axis showing a third indicator that shows at least one of the vertical length of the face and the vertical length of the nose, Form a coordinate system with coordinate axes, A computer that determines the position of a user's face in the coordinate system based on the first indicator, the second indicator, and the third indicator.

11. A computer, The first axis shows the first indicator of eye opening, A second axis showing a second index indicating at least one of the angles of the eye and / or eyebrow, the area of ​​the chin, and the centripetal and / or centrifugal aspects of the eye, A third axis showing a third indicator that shows at least one of the vertical length of the face and the vertical length of the nose, To form a coordinate system with coordinate axes, A program for determining the position of the user's face in the coordinate system based on the first indicator, the second indicator, and the third indicator.

Images