Facial classification methods, classification devices, programs, classification diagrams, and methods for creating images through beauty treatments.

Abstract

The present invention involves: a stage in which, on the basis of a first indicator indicating the opening of the eyes, a user's face is mapped in comparison with an average face formed from a plurality of faces; a stage in which, on the basis of a second indicator indicating at least one from among the angle of the eyes and / or eyebrows, the area of the chin, and the eyes being close together or far apart, the user's face is mapped in comparison with the average face; and a third stage in which, on the basis of a third indicator indicating at least one from among the verticality of the face and the verticality of the nose, the user's face is mapped in comparison with the average face.

Description

Technical Field

[0001] The present invention relates to a face classification method, a classification device, a program, a classification diagram, and an image production method by beauty treatment.

Background Art

[0002] Conventionally, a classification method for classifying human face types by characteristics is known. In Patent Document 1, based on the length of the face and the arrangement state of the facial form elements including eyes, eyebrows, mouth, and nose, and the contour shape of the face and the contour shapes of the facial form elements, human face types are classified by characteristics.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, Patent Document 1 is a face classification method for image production by women's makeup. Therefore, there is a problem that when trying to apply the face classification method of Patent Document 1 to men, it may not be classified well.

[0005] Therefore, an object of the present invention is to classify men's faces.

Means for Solving the Problems

[0006] One aspect of the present invention includes the steps of: positioning a user's face in comparison to an average face formed from a plurality of faces based on a first index indicating eye opening; positioning the user's face in comparison to the average face based on a second index indicating at least one of the angle of the eyes and / or eyebrows, the area of ​​the chin, and the centripetal and / or centrifugal distance of the eyes; and positioning the user's face in comparison to the average face based on a third index indicating at least one of the vertical length of the face and the vertical length of the nose. [Effects of the Invention]

[0007] According to the present invention, it is possible to classify men's faces. [Brief explanation of the drawing]

[0008] [Figure 1] This is a classification diagram of faces related to one embodiment of the present invention. [Figure 2] This is a classification diagram of faces related to one embodiment of the present invention. [Figure 3] This is a classification diagram of faces related to one embodiment of the present invention. [Figure 4] This is a classification diagram of faces related to one embodiment of the present invention. [Figure 5] This is a classification diagram of faces related to one embodiment of the present invention. [Figure 6] This is a flowchart of the decision-making process based on the first indicator related to one embodiment of the present invention. [Figure 7] This is a flowchart of the decision-making process based on a second indicator in one embodiment of the present invention. [Figure 8] This is a flowchart of the decision-making process based on a third indicator related to one embodiment of the present invention. [Figure 9] This is a flowchart of the face classification process related to one embodiment of the present invention. [Figure 10] This is an overall configuration diagram of one embodiment of the present invention. [Figure 11] This is a functional block diagram of a classification device according to one embodiment of the present invention. [Figure 12]A block diagram showing an example of the hardware configuration of a classification device according to one embodiment of the present invention. [Modes for carrying out the invention]

[0009] Embodiments of the present invention will be described below with reference to the drawings.

[0010] In this invention, a person's (also called a user's) face can be classified into 12 categories based on three indicators.

[0011] <Experiment details> In this invention, a user's face can be classified into 12 categories based on the classification diagrams shown in Figures 1 to 5. First, we will explain the details of the experiments conducted to create such classification diagrams.

[0012] As shown below, using multidimensional scaling (MDS), images of 24 men's faces were positioned in a three-dimensional space based on their similarity. The subjects performed the test on a personal computer. Specifically, the subjects viewed two images of faces displayed side-by-side on the personal computer (presentation time: 4 seconds) and evaluated the two images on a 6-point scale from 0 (not similar) to 5 (very similar) (total time: approximately 30-40 minutes).

[0013] Next, 22 composite faces were created based on the coordinates of images of 24 men's faces positioned in 3D space (to emphasize common features of faces on an axis or quadrant by creating average faces (composite faces) for each axis or quadrant), and subjects evaluated the impression of each composite face. As a result, a first, second, and third index for classifying faces in 3D space, and the impression of faces located in each quadrant in 3D space were identified. The first, second, and third indexes and the impression of faces located in each quadrant in 3D space are described in detail below.

[0014] <Classification Chart> Figure 1 is a face classification diagram according to an embodiment of the present invention. As shown in Figure 1, the classification diagram is a three-dimensional space with coordinate axes including a first axis indicating a first index (eye opening), a second axis indicating a second index (at least one of the angle of the eyes and / or eyebrows, the area of the jaw, and the centroid and / or eccentricity of the eyes), and a third axis indicating a third index (at least one of the vertical length of the face and the vertical length of the nose). And an average face is arranged at the origin (that is, the point where the first axis, the second axis, and the third axis intersect). Hereinafter, the average face and each index / each axis will be described.

[0015] <<Average face>> The average face is a face created by synthesizing images of a plurality of faces using computer graphics technology. For example, the average face is a representative face of men obtained by averaging the features of a plurality of men's faces. For example, average faces classified by age, race, etc. may be created and the average face of the same classification as the user may be used.

[0016] <<First index>> The eye opening is the ratio of the vertical width (for example, the longest distance between the upper eyelid and the lower eyelid) to the horizontal width of the eye (for example, the distance between the inner corner and the outer corner of the eye). It is said that the larger the vertical width is relative to the horizontal width, the larger the eye opening is, and the smaller the vertical width is relative to the horizontal width, the smaller the eye opening is.

[0017] <<First axis (dimension I)>> [[ID=​​​​​​​​​The angle of the eyes and / or eyebrows is the angle between the eyes and / or eyebrows and the horizontal line (a line perpendicular to the midline, which is the line that passes through the center of the face) (the angle is positive when moving towards the top of the head and negative when moving towards the chin). The larger the angle (the higher the outer corner of the eye and / or eyebrow is), the larger the angle of the eyes and / or eyebrows, and the smaller the angle (the lower the outer corner of the eye and / or eyebrow is), the smaller the angle of the eyes and / or eyebrows. The area of ​​the chin is the frontal area of ​​the chin (for example, the area enclosed by the horizontal line passing through the left and right nostrils as seen from the front, and the jawline on the chin side). The larger the frontal area of ​​the chin, the larger the chin area, and the smaller the frontal area of ​​the chin, the smaller the chin area. The centripetal and / or centrifugal distance of the eyes is the distance between the two eyes. The shorter the distance between the two eyes, the more centripetal, and the longer the distance between the two eyes, the more centrifugal.

[0020] <<Second Axis (Dimension II)>> One side of the second axis indicates the degree to which the angle of the eyes and / or eyebrows is large, the degree to which the area of ​​the chin is small, and the degree to which the distance between the eyes is short. The other side of the second axis indicates the degree to which the angle of the eyes and / or eyebrows is small, the degree to which the area of ​​the chin is large, and the degree to which the distance between the eyes is long.

[0021] The second axis indicates sophistication and agility. When the angle of the eyes and / or eyebrows is large, the area of ​​the chin is small, and the distance between the eyes is short, the impression of sophistication and / or agility increases. When the angle of the eyes and / or eyebrows is small, the area of ​​the chin is large, and the distance between the eyes is long, the impression of simplicity and / or gentleness increases.

[0022] <<Third indicator>> The vertical length of the face is the ratio of the vertical length (for example, the distance from the hairline to the chin) to the horizontal width (for example, the distance between the horizontal line passing through the bridge of the nose and the intersection points of the left and right jawlines). The longer the vertical length is relative to the horizontal width, the greater the vertical length of the face; the shorter the vertical length is relative to the horizontal width, the less the vertical length of the face. Similarly, the vertical length of the nose is the ratio of the vertical length (for example, the distance from the bridge of the nose to the tip of the nose) to the horizontal width (for example, the distance between the nostrils). The longer the vertical length is relative to the horizontal width, the greater the vertical length of the nose; the shorter the vertical length is relative to the horizontal width, the less the vertical length of the nose.

[0023] <<The Third Axis (Dimension III)>> One side of the third axis indicates the degree of vertical length of the face and the degree of vertical length of the nose. The other side of the third axis indicates the degree of vertical length of the face and the degree of vertical length of the nose.

[0024] The third axis indicates strength. Strength increases when at least one of the facial length and the nose length is small. Delicacy increases when at least one of the facial length and the nose length is large.

[0025] Figure 2 is a classification diagram of faces according to one embodiment of the present invention. Figure 2 is a classification diagram in which representative face images are placed in each quadrant of the three-dimensional space of Figure 1, and the representative impression of the face in each quadrant is expressed in words. Hereinafter, each quadrant of Figure 2 will be explained separately in Figures 3, 4, and 5. Figure 3 is the plane where the first axis and the second axis intersect. Figure 4 is the plane where the first axis and the second axis intersect, and is the quadrant in which the third index (at least one of the face length and the nose length) is greater than the average face. Figure 5 is the plane where the first axis and the second axis intersect, and is the quadrant in which the third index (at least one of the face length and the nose length) is smaller than the average face.

[0026] Figure 3 is a classification diagram of faces according to one embodiment of the present invention. As described above, Figure 3 is a plane in which the first axis and the second axis intersect.

[0027] <Makoto> Faces classified in the upper left of Figure 3 are those with eyes that are wider than average. Faces classified in the upper left of Figure 3 are those with eyes and / or eyebrows that are wider than average. Alternatively, faces classified in the upper left of Figure 3 are those with a smaller jaw area than average. Alternatively, faces classified in the upper left of Figure 3 are those with eyes that are closer together than average. Faces classified in the upper left of Figure 3 give an impression of being approachable and at least one of being refined and quick (hereinafter also referred to as refined and quick). The impression given by faces classified in the upper left of Figure 3 can be expressed by the word "sincerity".

[0028] <Rin> Faces classified in the upper right of Figure 3 are those with smaller-than-average eye openings. Faces classified in the upper right of Figure 3 are those with larger-than-average eye and / or eyebrow angles. Alternatively, faces classified in the upper right of Figure 3 are those with smaller-than-average jaw area. Alternatively, faces classified in the upper right of Figure 3 are those with shorter-than-average distances between the eyes. Faces classified in the upper right of Figure 3 give an impression of being unapproachable, yet refined and agile. The impression given by faces classified in the upper right of Figure 3 can be expressed by the word "dignified."

[0029] <Craftsman> Faces classified in the lower right of Figure 3 are those with smaller-than-average eye openings. Faces classified in the lower right of Figure 3 are those with smaller-than-average eye and / or eyebrow angles. Alternatively, faces classified in the lower right of Figure 3 are those with larger-than-average jaw area. Alternatively, faces classified in the lower right of Figure 3 are those with longer-than-average eye spacing. Faces classified in the lower right of Figure 3 give an impression of being unapproachable and at least one of being simple and gentle (hereinafter also referred to as simple and gentle). The impression given by faces classified in the lower right of Figure 3 can be expressed by the word "master craftsman."

[0030] <healing> Faces classified in the lower left of Figure 3 are those with eyes that are wider than average. Faces classified in the lower left of Figure 3 are those with eyes and / or eyebrows that are narrower than average. Alternatively, faces classified in the lower left of Figure 3 are those with a larger jaw area than average. Alternatively, faces classified in the lower left of Figure 3 are those with eyes that are further apart than average. Faces classified in the lower left of Figure 3 give an impression of being approachable, simple, and gentle. The impression given by faces classified in the lower left of Figure 3 can be expressed by the word "healing."

[0031] Figure 4 is a classification diagram of faces according to one embodiment of the present invention. Specifically, the faces shown in Figure 4 are faces in which at least one of the vertical length of the face and the vertical length of the nose is greater than that of the average face.

[0032] <Sincerity x Delicacy> Faces classified in the upper left of Figure 4 are those with eyes that are wider than average. Faces classified in the upper left of Figure 4 are those with eyes and / or eyebrows that are wider than average. Alternatively, faces classified in the upper left of Figure 4 are those with a smaller jaw area than average. Alternatively, faces classified in the upper left of Figure 4 are those with eyes that are closer together than average. Faces classified in the upper left of Figure 4 give the impression of being approachable, yet refined, quick, and delicate. The impression given by faces classified in the upper left of Figure 4 can be expressed with the words <Sincerity × Delicacy>.

[0033] <Dignified x Delicate> Faces classified in the upper right of Figure 4 are those with smaller-than-average eye openings. Faces classified in the upper right of Figure 4 are those with larger-than-average eye and / or eyebrow angles. Alternatively, faces classified in the upper right of Figure 4 are those with smaller-than-average jaw area. Alternatively, faces classified in the upper right of Figure 4 are those with shorter-than-average distance between the eyes. Faces classified in the upper right of Figure 4 give the impression of being unapproachable, yet refined, quick, and delicate. The impression given by faces classified in the upper right of Figure 4 can be expressed with the words "dignified x delicate".

[0034] <Masterful Craftsmanship × Delicacy> Faces classified in the lower right of Figure 4 are those with smaller-than-average eye openings. Faces classified in the lower right of Figure 4 are those with smaller-than-average eye and / or eyebrow angles. Alternatively, faces classified in the lower right of Figure 4 are those with larger-than-average jaw area. Alternatively, faces classified in the lower right of Figure 4 are those with longer-than-average distance between the eyes. Faces classified in the lower right of Figure 4 give the impression of being unapproachable, simple, gentle, and delicate. The impression given by faces classified in the lower right of Figure 4 can be expressed with the words "masterful x delicate".

[0035] <Healing x Delicacy> Faces classified in the lower left of Figure 4 are those with eyes that are wider than average. Faces classified in the lower left of Figure 4 are those with eyes and / or eyebrows that are narrower than average. Alternatively, faces classified in the lower left of Figure 4 are those with a larger jaw area than average. Alternatively, faces classified in the lower left of Figure 4 are those with eyes that are further apart than average. Faces classified in the lower left of Figure 4 give an impression of being approachable, simple, gentle, and delicate. The impression given by faces classified in the lower left of Figure 4 can be described with the words <healing × delicate>.

[0036] Figure 5 is a classification diagram of faces according to one embodiment of the present invention. Specifically, the faces shown in Figure 5 are faces in which at least one of the vertical length of the face and the vertical length of the nose is smaller than that of the average face.

[0037] <Sincerity x Strength> Faces classified in the upper left of Figure 5 are those with wider-than-average eye openings. Faces classified in the upper left of Figure 5 are those with wider-than-average eye and / or eyebrow angles. Alternatively, faces classified in the upper left of Figure 5 are those with smaller-than-average jaw area. Alternatively, faces classified in the upper left of Figure 5 are those with shorter-than-average eye spacing. Faces classified in the upper left of Figure 5 give an impression of being approachable, sophisticated, agile, and strong. The impression given by faces classified in the upper left of Figure 5 can be expressed with the words "sincere" and "strong."

[0038] <Dignified x Strong> Faces classified in the upper right of Figure 5 are those with smaller-than-average eye openings. Faces classified in the upper right of Figure 5 are those with larger-than-average eye and / or eyebrow angles. Alternatively, faces classified in the upper right of Figure 5 are those with smaller-than-average jaw area. Alternatively, faces classified in the upper right of Figure 5 are those with shorter-than-average eye spacing. Faces classified in the upper right of Figure 5 give an impression of being unapproachable, yet refined, agile, and strong. The impression given by faces classified in the upper right of Figure 5 can be described with the words "dignified and strong."

[0039] <Craftsmanship x Strength> Faces classified in the lower right of Figure 5 are those with smaller-than-average eye openings. Faces classified in the lower right of Figure 5 are those with smaller-than-average eye and / or eyebrow angles. Alternatively, faces classified in the lower right of Figure 5 are those with larger-than-average jaw area. Alternatively, faces classified in the lower right of Figure 5 are those with longer-than-average eye spacing. Faces classified in the lower right of Figure 5 give an impression of being unapproachable, simple, gentle, and strong. The impression given by faces classified in the lower right of Figure 5 can be expressed with the words "craftsmanship x strength".

[0040] <Healing x Strength> Faces classified in the lower left of Figure 5 are those with eyes that are wider than average. Faces classified in the lower left of Figure 5 are those with eyes and / or eyebrows that are narrower than average. Alternatively, faces classified in the lower left of Figure 5 are those with a larger jaw area than average. Alternatively, faces classified in the lower left of Figure 5 are those with eyes that are further apart than average. Faces classified in the lower left of Figure 5 give an impression of being approachable, simple, gentle, and strong. The impression given by faces classified in the lower left of Figure 5 can be described as <healing x strong>.

[0041] As shown in Figures 2 to 5, the face classification diagram can contain images of representative faces located in each quadrant (i.e., each category) in three-dimensional space. Furthermore, the face classification diagram can display a verbal description of the typical impression associated with each face in each quadrant.

[0042] <Method> The method of classifying faces will be explained below, referring to Figures 6 to 9, by dividing it into three parts: <Judgment processing based on the first indicator>, <Judgment processing based on the second indicator>, <Judgment processing based on the third indicator>, and <Classification processing>.

[0043] Figures 6 to 9 illustrate an example in which a beauty consultant classifies the faces of users (for example, customers who are about to purchase beauty products), but the present invention can be applied to any case where any person classifies the faces of any user.

[0044] <Decision-making process based on the first indicator> Figure 6 is a flowchart of the decision-making process based on the first indicator according to one embodiment of the present invention.

[0045] In step 11 (S11), the beauty consultant visually checks the user's eye opening (the first indicator). As mentioned above, eye opening is the ratio of the vertical width to the horizontal width of the eye; the longer the vertical width is relative to the horizontal width, the greater the eye opening, and the shorter the vertical width is relative to the horizontal width, the smaller the eye opening.

[0046] In step 12 (S12), the beauty consultant compares the user's eye opening, which was confirmed in S11, with the average eye opening of a face.

[0047] In step 13 (S13), the beauty consultant positions the user's face on a first axis that indicates eye opening (first indicator). Specifically, if the user's eye opening is larger than the average face's eye opening, the beauty consultant positions the user's face in the direction of larger eye opening on the first axis. Conversely, if the user's eye opening is smaller than the average face's eye opening, the beauty consultant positions the user's face in the direction of smaller eye opening on the first axis.

[0048] <Decision-making process based on the second indicator> Figure 7 is a flowchart of the decision-making process based on the second indicator according to one embodiment of the present invention.

[0049] In step 21 (S21), the beauty consultant visually confirms at least one of the following (the second indicator): the angle of the user's eyes and / or eyebrows, the area of ​​the chin, and the centripetal and / or centrifugal aspect of the eyes. As mentioned above, the angle of the eyes and / or eyebrows is the angle made between the eyes and / or eyebrows and the horizontal line (a line perpendicular to the midline, which is the line that passes through the center of the face) (the angle is positive when moving towards the top of the head and negative when moving towards the chin). The larger the angle (the higher the outer corner of the eye and / or eyebrow), the larger the angle of the eyes and / or eyebrows, and the smaller the angle (the lower the outer corner of the eye and / or eyebrow), the smaller the angle of the eyes and / or eyebrows. The area of ​​the chin is the area of ​​the front of the chin. The larger the area of ​​the front of the chin, the larger the chin area, and the smaller the area of ​​the front of the chin, the smaller the chin area. Furthermore, the centripetal and / or centrifugal distance of the eyes refers to the distance between the two eyes; the shorter the distance between the eyes, the more centripetal the distance, and the longer the distance between the eyes, the more centrifugal the distance.

[0050] In step 22 (S22), the beauty consultant compares the angle of the user's eyes and / or eyebrows, as confirmed in S21, with the angle of the eyes and / or eyebrows of the average face. The beauty consultant also compares the area of ​​the user's chin, as confirmed in S21, with the area of ​​the chin of the average face. Furthermore, the beauty consultant compares the centripetal and / or centrifugal aspects of the user's eyes, as confirmed in S21, with the centripetal and / or centrifugal aspects of the eyes of the average face.

[0051] In step 23 (S23), the beauty consultant positions the user's face on a second axis that indicates at least one of the following (the second indicator): the angle of the eyes and / or eyebrows, the area of ​​the chin, and the centripetal and / or centrifugal aspect of the eyes.

[0052] Specifically, if the angle of the user's eyes and / or eyebrows is greater than the average angle of the eyes and / or eyebrows on a face, the beauty consultant will position the user's face in the direction of the greater eye and / or eyebrow angle on the second axis. Conversely, if the angle of the user's eyes and / or eyebrows is smaller than the average angle of the eyes and / or eyebrows on a face, the beauty consultant will position the user's face in the direction of the smaller eye and / or eyebrow angle on the second axis.

[0053] Furthermore, if the user's jaw area is smaller than the average jaw area, the beauty consultant will position the user's face on the second axis in the direction of smaller jaw area. Conversely, if the user's jaw area is larger than the average jaw area, the beauty consultant will position the user's face on the second axis in the direction of larger jaw area.

[0054] Furthermore, if the user's distance between their eyes is shorter than the average distance between the eyes on a face, the beauty consultant will position the user's face in the centripetal direction on the second axis. Conversely, if the user's distance between their eyes is longer than the average distance between the eyes on a face, the beauty consultant will position the user's face in the centrifugal direction on the second axis.

[0055] Furthermore, when using multiple second indicators (for example, using "eye angle" and "eyebrow angle," or using "eye angle" and "chin area"), the direction on the second axis can be determined for each indicator, and the direction in which the user's face is positioned can be determined by majority vote (i.e., the direction determined by the most indicators is adopted). Alternatively, the indicators can be weighted (for example, "eye angle" can be weighted more highly than "eyebrow angle," or "eye angle" can be weighted more highly than "chin area").

[0056] <Decision-making process based on the third indicator> Figure 8 is a flowchart of the decision-making process based on the third indicator in one embodiment of the present invention.

[0057] In step 31 (S31), the beauty consultant visually checks at least one of the following (the third indicator): the length of the face and the length of the nose. As mentioned above, the length of the face is the ratio of the length to the width of the face; the longer the length relative to the width, the greater the length of the face, and the shorter the length relative to the width, the smaller the length of the face. Similarly, the length of the nose is the ratio of the length to the width of the nose; the longer the length relative to the width, the greater the length of the nose, and the shorter the length relative to the width, the smaller the length of the nose.

[0058] In step 32 (S32), the beauty consultant compares the facial length of the face confirmed in S31 with the facial length of the average face. The beauty consultant also compares the nose length of the nose confirmed in S31 with the nose length of the average face.

[0059] In step 33 (S33), the beauty consultant positions the user's face on a third axis that indicates at least one of the vertical length of the face and the vertical length of the nose (a third indicator).

[0060] Specifically, if the vertical length of the user's face is greater than that of the average face, the beauty consultant will position the user's face in the direction of greater vertical length on the third axis. Conversely, if the vertical length of the user's face is less than that of the average face, the beauty consultant will position the user's face in the direction of less vertical length on the third axis.

[0061] Furthermore, if the vertical length of the user's nose is greater than that of the average face, the beauty consultant will position the user's face in the direction of greater vertical length of the nose on the third axis. Conversely, if the vertical length of the user's nose is smaller than that of the average face, the beauty consultant will position the user's face in the direction of less vertical length of the nose on the third axis.

[0062] Furthermore, when using multiple third indicators (i.e., using "face length" and "nose length"), the direction on the third axis can be determined for each indicator, and the direction in which the user's face is positioned can be determined by majority vote (i.e., the direction determined by the most indicators is adopted). Alternatively, the indicators can be weighted (for example, "face length" can be weighted more highly than "nose length," or "nose length" can be weighted more highly than "face length").

[0063] <Classification Processing> Figure 9 is a flowchart of the face classification process according to one embodiment of the present invention.

[0064] In step 41 (S41), the beauty consultant performs the <decision-making process based on the first indicator> as explained in Figure 6.

[0065] In step 42 (S42), the beauty consultant performs the <decision-making process based on the second indicator> as explained in Figure 7.

[0066] In step 43 (S43), the beauty consultant performs the <decision-making process based on the third indicator> as explained in Figure 8.

[0067] Note that steps S41 to S43 may be executed in any order.

[0068] In step 44 (S44), the beauty consultant positions the user's face in a three-dimensional space with the first axis, second axis, and third axis as coordinate axes, based on the results of the judgments in S41 to S43. Specifically, the beauty consultant positions the user's face in the space located in the direction of the first axis positioned in S41, the direction of the second axis positioned in S42, and the direction of the third axis positioned in S43. In other words, the beauty consultant can classify the user's face into at least one of 12 categories.

[0069] The method of classifying faces (i.e., the <judgment processing based on the first indicator>, <judgment processing based on the second indicator>, <judgment processing based on the third indicator>, and <classification processing> described above) may be performed by a person such as a beauty consultant, or by the classification device 10 described in Figures 10 to 12.

[0070] <System Configuration> Figure 10 is an overall configuration diagram of one embodiment of the present invention. As shown in Figure 10, the classification device 10 is communicably connected to one or more user terminals 20 via an arbitrary network 30. Each of these will be described below.

[0071] The classification device 10 performs a face classification method in response to a request from the user terminal 20. The classification device 10 consists of one or more computers. The classification device 10 can also send and receive data with the user terminal 20 via any network 30. The classification device 10 will be described in detail later with reference to Figure 11.

[0072] The user terminal 20 transmits the facial image input to the user terminal 20 to the classification device 10. The user terminal 20 also receives the facial classification results from the classification device 10 and displays them on its display. The user terminal 20 may be any device such as a personal computer, tablet, or smartphone.

[0073] Although Figure 10 describes the classification device 10 and the user terminal 20 as separate devices, they may also be implemented as a single device.

[0074] <Function Block> Figure 11 is a functional block diagram of a classification device 10 according to one embodiment of the present invention. As shown in Figure 11, the classification device 10 comprises a receiving unit 100, a first determination unit 101, a second determination unit 102, a third determination unit 103, a classification unit 104, and a transmitting unit 105. Furthermore, the classification device 10 functions as the receiving unit 100, the first determination unit 101, the second determination unit 102, the third determination unit 103, the classification unit 104, and the transmitting unit 105 by executing a program. Each of these will be described below.

[0075] The receiving unit 100 receives an image of the user's face from the user terminal 20.

[0076] The first decision unit 101 can perform the <decision processing based on the first indicator> shown in Figure 6. Specifically, the first decision unit 101 analyzes the image of the user's face received by the receiving unit 100 and calculates the user's eye opening. The first decision unit 101 also compares the user's eye opening with the eye opening of the average face. Furthermore, the first decision unit 101 positions the user's face on a first axis that represents the eye opening (first indicator).

[0077] Furthermore, the first determination unit 101 can also be configured to position the user's face on the first axis according to the degree to which the user's eyes are wide open or narrowly open.

[0078] The second determination unit 102 can perform the <Decision Processing Based on the Second Indicator> shown in Figure 7. Specifically, the second determination unit 102 analyzes the user's face image received by the receiving unit 100 and calculates at least one of the following: the angle of the user's eyes and / or eyebrows, the area of ​​the chin, and the centripetal and / or centrifugal distance of the eyes. The second determination unit 102 also compares the angle of the user's eyes and / or eyebrows with the angle of the eyes and / or eyebrows of the average face. The second determination unit 102 also compares the area of ​​the user's chin with the area of ​​the chin of the average face. The second determination unit 102 also compares the centripetal and / or centrifugal distance of the user's eyes with the centripetal and / or centrifugal distance of the eyes of the average face. Furthermore, the second determination unit 102 positions the user's face on a second axis that indicates at least one of the following (the second indicator): the angle of the eyes and / or eyebrows, the area of ​​the chin, and the centripetal and / or centrifugal aspect of the eyes.

[0079] Furthermore, the second determination unit 102 can be configured to position the user's face on the second axis according to the degree to which the angle of the user's eyes and / or eyebrows is large, or the degree to which the angle of the user's eyes and / or eyebrows is small. Also, the second determination unit 102 can be configured to position the user's face on the second axis according to the degree to which the area of ​​the user's chin is small, or the degree to which the area of ​​the user's chin is large. Also, the second determination unit 102 can be configured to position the user's face on the second axis according to the degree to which the distance between the user's eyes is short, or the degree to which the distance between the user's eyes is long.

[0080] The third decision unit 103 can perform the <decision processing based on the third indicator> shown in Figure 8. Specifically, the third decision unit 103 analyzes the image of the user's face received by the receiving unit 100 and calculates at least one of the vertical length of the user's face and the vertical length of the user's nose. The third decision unit 103 also compares the vertical length of the user's face with the vertical length of the average face. The third decision unit 103 also compares the vertical length of the user's nose with the vertical length of the average face. Furthermore, the third decision unit 103 positions the user's face on a third axis that represents at least one of the vertical length of the face and the vertical length of the nose (the third indicator).

[0081] Furthermore, the third determination unit 103 can be configured to position the user's face on the third axis according to the degree to which the user's face is vertically elongated or to the degree to which the user's face is vertically elongated. In addition, the third determination unit 103 can be configured to position the user's face on the third axis according to the degree to which the user's nose is vertically elongated or to the degree to which the user's nose is vertically elongated.

[0082] The average face may be created in advance, or it may be created each time a face is classified. Furthermore, the average face may be updated periodically.

[0083] The classification unit 104 classifies the user's face based on the results of the judgment by the first judgment unit 101, the results of the judgment by the second judgment unit 102, and the results of the judgment by the third judgment unit 103. Specifically, the classification unit 104 positions the user's face in a three-dimensional space with the first axis, second axis, and third axis as coordinate axes, in the space located in the direction of the first axis positioned by the first judgment unit 101, the direction of the second axis positioned by the second judgment unit 102, and the direction of the third axis positioned by the third judgment unit 103.

[0084] Furthermore, the classification unit 104 can also be configured to further classify within each category according to the degree of difference between the user's face and the average face for each indicator (for example, very friendly, slightly friendly, slightly unfriendly, very unfriendly, etc.).

[0085] The transmitting unit 105 notifies the user terminal 20 of the classification result from the classification unit 104 (i.e., which of the 12 categories the user's face belongs to). In addition to the information on which of the 12 categories the user's face belongs to, the transmitting unit 105 can also be configured to notify information on friendliness, sophistication / agility, and robustness.

[0086] <Effects> Thus, in one embodiment of the present invention, a person's face (for example, a man's face) can be classified into at least 12 categories by comparing it with an average face. For example, a beauty consultant can use the results of classifying a customer's face to perform beauty treatments on that customer to change the impression of their face (create an image).

[0087] <Hardware Configuration> Figure 12 is a block diagram showing an example of the hardware configuration of a classification device 10 according to one embodiment of the present invention. The classification device 10 has a CPU (Central Processing Unit) 1, a ROM (Read Only Memory) 2, and a RAM (Random Access Memory) 3. The CPU 1, ROM 2, and RAM 3 form a so-called computer.

[0088] Furthermore, the classification device 10 may include an auxiliary storage device 4, a display device 5, an operating device 6, an I / F (Interface) device 7, and a drive device 8. The hardware components of the classification device 10 are interconnected via bus B.

[0089] CPU1 is a computing device that executes various programs installed on auxiliary storage device 4.

[0090] ROM2 is non-volatile memory. ROM2 functions as a main memory device that stores various programs, data, etc., necessary for the CPU1 to execute the various programs installed on the auxiliary storage device 4. Specifically, ROM2 functions as a main memory device that stores boot programs such as BIOS (Basic Input / Output System) and EFI (Extensible Firmware Interface).

[0091] RAM3 is a volatile memory such as DRAM (Dynamic Random Access Memory) or SRAM (Static Random Access Memory). RAM3 functions as a main memory device that provides a working area that is expanded when various programs installed on auxiliary storage device 4 are executed by CPU 1.

[0092] The auxiliary storage device 4 is an auxiliary storage device that stores various programs (for example, the program according to the present invention) and information used when various programs are executed.

[0093] Display device 5 is a display device that displays the internal state of the classification device 10, etc.

[0094] The operating device 6 is an input device that allows the administrator of the classification device 10 to input various instructions to the classification device 10.

[0095] The I / F device 7 is a communication device that connects to the network and communicates with the user terminal 20.

[0096] The drive device 8 is a device for setting the storage medium 9. The storage medium 9 here includes media that record information optically, electrically, or magnetically, such as CD-ROMs, flexible disks, and magneto-optical disks. The storage medium 9 may also include semiconductor memories that record information electrically, such as EPROMs (Erasable Programmable Read Only Memory) and flash memory.

[0097] The various programs to be installed on the auxiliary storage device 4 are installed, for example, when the distributed storage medium 9 is set in the drive device 8 and the various programs recorded on the storage medium 9 are read by the drive device 8. Alternatively, the various programs to be installed on the auxiliary storage device 4 may be installed by downloading them from the network via the I / F device 7.

[0098] Although embodiments of the present invention have been described in detail above, the present invention is not limited to the specific embodiments described above, and various modifications and changes are possible within the scope of the gist of the present invention as described in the claims. [Explanation of Symbols]

[0099] 10 Classifier 20 User Terminals 30 Networks 100 Receiver 101 First Judgment Unit 102 Second Judgment Unit 103 Third Decision Unit 104 Classification Department 105 Transmitter

Claims

1. A computer-based method for classifying faces, The first axis shows the first indicator of eye opening, A second axis showing a second index indicating at least one of the angles of the eye and / or eyebrow, the area of ​​the chin, and the centripetal and / or centrifugal aspects of the eye, A third axis showing a third indicator that shows at least one of the vertical length of the face and the vertical length of the nose, The steps include forming a three-dimensional coordinate system with coordinate axes, A step of placing the average face formed from a plurality of faces at the origin of the three-dimensional coordinate system based on the first index, the second index, and the third index, The steps include determining the position of the male user's face in the three-dimensional coordinate system based on the first indicator, the second indicator, and the third indicator, A step of classifying the user's facial features or impression based on the aforementioned position. including A method of classifying faces.

2. Depending on the degree of difference between the user's face and the average face for each indicator, the user is further classified within each category based on characteristics or impression. The classification method according to claim 1.

3. The aforementioned three-dimensional coordinate system is A first plane passing through a first point on the third axis, where the first axis and the second axis intersect, A second plane passing through a second point on the third axis, where the first axis and the second axis intersect, A third plane passing through a third point on the third axis, and intersecting the first axis and the second axis, It is a three-dimensional coordinate system that includes, The value of the third index at the second point is greater than the value of the third index at the first point. The classification method according to claim 1 or 2, wherein the value of the third index at the third point is smaller than the value of the third index at the first point.

4. (a) A first axis showing a first indicator of eye opening, A second axis showing a second index indicating at least one of the angles of the eye and / or eyebrow, the area of ​​the chin, and the centripetal and / or centrifugal aspects of the eye, A third axis showing a third indicator that shows at least one of the vertical length of the face and the vertical length of the nose, A three-dimensional coordinate system is formed with the coordinate axes as follows: (b) Based on the first index, the second index, and the third index, the average face formed from the multiple faces is placed at the origin of the three-dimensional coordinate system. (c) Determine the position of the male user's face in the three-dimensional coordinate system based on the first indicator, the second indicator, and the third indicator, (d) Classify the user's facial features or impression based on the position. Device.

5. The aforementioned three-dimensional coordinate system is A first plane passing through a first point on the third axis, where the first axis and the second axis intersect, A second plane passing through a second point on the third axis, where the first axis and the second axis intersect, A third plane passing through a third point on the third axis, and intersecting the first axis and the second axis, It is a three-dimensional coordinate system that includes, The value of the third index at the second point is greater than the value of the third index at the first point. The apparatus according to claim 4, wherein the value of the third index at the third point is smaller than the value of the third index at the first point.

6. On the computer, The first axis shows the first indicator of eye opening, A second axis showing a second index indicating at least one of the angles of the eye and / or eyebrow, the area of ​​the chin, and the centripetal and / or centrifugal aspects of the eye, A third axis showing a third indicator that shows at least one of the vertical length of the face and the vertical length of the nose, A process to form a three-dimensional coordinate system with coordinate axes, A process of positioning the average face formed from multiple faces at the origin of the three-dimensional coordinate system based on the first index, the second index, and the third index. A process for determining the position of a male user's face in the three-dimensional coordinate system based on the first, second, and third indicators. A process to classify the user's facial features or impression based on the aforementioned position. A program to execute.

7. The aforementioned three-dimensional coordinate system is A first plane passing through a first point on the third axis, where the first axis and the second axis intersect, A second plane passing through a second point on the third axis, where the first axis and the second axis intersect, A third plane passing through a third point on the third axis, and intersecting the first axis and the second axis, It is a three-dimensional coordinate system that includes, The value of the third index at the second point is greater than the value of the third index at the first point. The program according to claim 6, wherein the value of the third index at the third point is smaller than the value of the third index at the first point.

8. (a) A first axis indicating the degree of eye opening, A second axis indicating the degree of at least one of the angles of the eye and / or eyebrow, the area of ​​the chin, and the centripetal and / or centrifugal aspect of the eye, A third axis representing the degree of at least one of the following: the length of the face and the length of the nose, A three-dimensional coordinate system with coordinate axes, (b) An average face, which is placed at the origin of the three-dimensional coordinate system and created by combining multiple face images using computer graphics technology, Consists of, A classification chart for categorizing male faces.

9. Depending on the degree, faces are classified within each category based on their characteristics or impression. The classification diagram according to claim 8.

10. The aforementioned three-dimensional coordinate system is A first plane passing through a first point on the third axis, where the first axis and the second axis intersect, A second plane passing through a second point on the third axis, where the first axis and the second axis intersect, A third plane passing through a third point on the third axis, and intersecting the first axis and the second axis, It is a three-dimensional coordinate system that includes, The value of the index indicated by the third axis at the second point is greater than the value of the index indicated by the third axis at the first point. The classification diagram according to claim 8 or 9, wherein the value of the index indicated by the third axis at the third point is smaller than the value of the index indicated by the third axis at the first point.

11. (a) A step in which a computer forms a three-dimensional coordinate system with coordinate axes: (i) a first axis indicating a first index indicating the opening of the eye; (ii) a second axis indicating a second index indicating at least one of the angle of the eye and / or eyebrow, the area of ​​the chin, and the centripetal and / or centrifugal aspect of the eye; and (iii) a third axis indicating a third index indicating at least one of the vertical length of the face and the vertical length of the nose. (b) The step of determining where in the three-dimensional coordinate system the face of a male user is positioned based on the first indicator, the second indicator, and the third indicator, (c) A step of changing the appearance of the face by applying cosmetic treatment according to the first axis, the second axis, and the third axis, (d) A step of classifying the user's facial features or impression based on the position, It has, A method of image creation through beauty, wherein an average face formed from multiple faces is placed at the origin of the aforementioned three-dimensional coordinate system.

Images