Sagging evaluation method, device, program, and system

Abstract

Factors generating sagging in the appearance are identified, and the sagging is evaluated on the basis of the identified factors. A method that is one embodiment of the present invention includes: a step for acquiring a gravity swelling amount and a gravity dimpling amount obtained based on three-dimensional shape changes between horizontal and vertical three-dimensional shape face images of a subject; a step for calculating the sagging amount within the face and the sagging amount in front of and behind the cheeks, based on the gravity swelling amount and the gravity dimpling amount; and a step for evaluating the sagging type and degree using the sagging amount within the face and the sagging amount in front of and behind the cheeks as indices.

Description

[Technical field]

[0001] The present invention relates to a sag evaluation method, an apparatus, a program, and a system. [Background technology]

[0002] Conventionally, methods for evaluating facial sagging have been known. For example, in Patent Document 1, the area of ​​a closed curve drawn on the skin surface is measured in two positions, horizontal and vertical, and the area ratio or area difference is measured as the amount of sagging skin. Thus, conventional evaluation of sagging was performed under the assumption that the face appears sagging because the face shape droops in the direction of gravity. Non-Patent Document 1 reports a method of evaluating sagging in each part of the face (upper cheek, lower cheek, rear cheek) on a six-level scale from 0 to 5, based on the sagging that progresses in proportion to age. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 6473959 [Non-patent literature]

[0004] [Non-Patent Document 1] T. Ezure, J. Hosoi, S. Amano and T. Tsuchiya, Skin Research and Technology 2009; 15: 299-305 Summary of the Invention [Problem to be solved by the invention]

[0005] However, it has not been fully elucidated why the face appears sagging, and therefore there has been a need for an evaluation based on what factors cause the appearance of sagging.

[0006] Therefore, an object of the present invention is to find factors that cause the appearance of sagging and to evaluate sagging based on the found factors. [Means for solving the problem]

[0007] A method according to one aspect of the present invention includes the steps of acquiring gravitational bulge and gravitational depression amounts obtained from three-dimensional shape changes between three-dimensional facial images of a subject in horizontal and vertical positions, calculating the amount of intra-facial movement sagging and the amount of anterior-posterior cheek sagging from the gravitational bulge and gravitational depression amounts, and evaluating the type and degree of sagging using the amount of intra-facial movement sagging and the amount of anterior-posterior cheek sagging as indicators. Effect of the Invention

[0008] According to the present invention, factors that cause the appearance of sagging can be found, and sagging can be evaluated based on the found factors. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram for explaining gravity bulge in one embodiment of the present invention. [Diagram 2] 1A and 1B are diagrams for explaining gravity depression according to one embodiment of the present invention. [Diagram 3] FIG. 2 is a diagram showing the relationship between gravity bulge and gravity depression in one embodiment of the present invention. [Figure 4] FIG. 13 is a diagram for explaining intra-facial moving sagging according to one embodiment of the present invention. [Diagram 5] FIG. 1 is a diagram for explaining anterior and posterior cheek sagging in one embodiment of the present invention. [Figure 6] FIG. 11 is a diagram comparing intra-facial sagging with anterior and posterior cheek sagging according to one embodiment of the present invention. [Figure 7] FIG. 13 is a diagram showing the relationship between gravity bulge and visual score according to one embodiment of the present invention. [Figure 8] FIG. 11 is a diagram for explaining a sagging skin coefficient according to an embodiment of the present invention. [Figure 9] 11 is a diagram comparing the correlation between the sagging skin coefficient and the visual score according to one embodiment of the present invention, the correlation between intra-face movement sagging and the visual score, and the correlation between anterior and posterior cheek sagging and the visual score. FIG. [Figure 10] 11 is a diagram comparing the correlation between the sagging skin coefficient and age according to one embodiment of the present invention, the correlation between intra-face moving sagging and age, and the correlation between anterior / posterior cheek sagging and age. FIG. [Figure 11] 1 is a configuration diagram of an evaluation system according to an embodiment of the present invention. [Figure 12] 1 is a functional block diagram of an evaluation device according to an embodiment of the present invention; [Figure 13] 2 is a functional block diagram of an imaging terminal according to an embodiment of the present invention; FIG. [Figure 14] FIG. 2 is a functional block diagram of an analysis terminal according to an embodiment of the present invention. [Figure 15] FIG. 11 is a sequence diagram of an evaluation process according to an embodiment of the present invention. [Figure 16] 1 is a flowchart of an evaluation process according to an embodiment of the present invention. [Figure 17] 13 is a flowchart of intra-face movement sagging evaluation processing according to an embodiment of the present invention. [Figure 18] 13 is a flowchart of intra-face movement sagging evaluation processing according to an embodiment of the present invention. [Figure 19] 1 is a flowchart of an anterior-posterior cheek sagging evaluation process according to an embodiment of the present invention. [Figure 20] 1 is a flowchart of an anterior-posterior cheek sagging evaluation process according to an embodiment of the present invention. [Figure 21] 11 is a flowchart of a sagging skin coefficient evaluation process according to an embodiment of the present invention. [Figure 22] 1 is a flowchart of a visual score evaluation process according to an embodiment of the present invention. [Figure 23] 2 is a block diagram showing an example of a hardware configuration of an evaluation device and an analysis terminal according to an embodiment of the present invention; FIG. [Figure 24]FIG. 13 is a diagram showing a case in which a sagging skin coefficient is calculated using one of the skin viscoelasticity parameters acquired by a viscoelasticity acquisition device according to one embodiment of the present invention, and the visual score calculated using equation (4) is compared with the visual score obtained from an actual visual evaluation. [Diagram 25] FIG. 13 is a diagram showing a case in which a sagging skin coefficient is calculated using two or more of the skin viscoelasticity parameters acquired by a viscoelasticity acquisition device according to one embodiment of the present invention, and the visual score calculated using equation (4) is compared with the visual score obtained from an actual visual evaluation. [Figure 26] 1A and 1B are diagrams showing three-dimensional face images captured at the same time and place on the same day according to an embodiment of the present invention. [Figure 27] FIG. 13 illustrates the variation in gravity bulge and gravity depression according to one embodiment of the present invention. [Figure 28] 1 is a diagram for explaining repeated acquisition of a three-dimensional face image according to an embodiment of the present invention; [Figure 29] This figure explains representative values ​​of at least one of the gravitational swelling amount (VCswelling), the gravitational depression amount (VCshrinking), the amount of intra-facial sagging (Sf), and the amount of anterior-posterior cheek sagging (Sc) calculated using three-dimensional facial images repeatedly acquired according to one embodiment of the present invention. [Diagram 30] This figure is for explaining the daily difference in representative values ​​of at least one of the gravitational swelling amount (VCswelling), the gravitational depression amount (VCshrinking), the amount of intra-facial sagging (Sf), and the amount of anterior-posterior cheek sagging (Sc), calculated using three-dimensional facial images repeatedly acquired, in one embodiment of the present invention. [Diagram 31]This figure explains the results of comparing subjects or groups of subjects who have undergone different treatments, with or without treatment and with different strengths, for the purpose of measuring the effect on sagging by obtaining a representative value of at least one of the following values ​​calculated using repeatedly acquired three-dimensional facial images: the amount of gravitational bulge (VCswelling), the amount of gravitational depression (VCshrinking), the amount of intra-facial sagging (Sf), and the amount of anterior-posterior cheek sagging (Sc) according to one embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0011] <Terminology explanation> "Three-dimensional facial image" refers to an image that represents the three-dimensional shape of the face of the person who is the subject of the sagging evaluation. "Horizontal position" refers to the state in which the midline of the face is stationary and perpendicular to the direction of gravity. "Vertical position" refers to the state in which the midline of the face is stationary and parallel to the direction of gravity. "Visual score (visual evaluation, also called Sss)" is a numerical value of the visual evaluation of sagging. As described in Non-Patent Document 1, the visual score is calculated by the judge's judgment of which of the reference photos 1 to 5 the face of the person to be evaluated for sagging is closest to. For example, the visual score is calculated from an image of the oblique profile (an image of the face taken from an angle of 45 degrees to the left and right from the front of the face) when the face of the person to be evaluated for sagging is in a vertical position (i.e., a state in which the midline of the face is kept stationary parallel to the direction of gravity). The visual score of the face of the person to be evaluated for sagging may be calculated using a trained model generated by machine learning using the image of the oblique profile for which the visual score was determined as training data. The visual score is determined for each part of the upper cheek, lower cheek, and back of the cheek, but may be newly generated by averaging any of them. Sss is the average of the visual scores in particular for the upper and lower cheeks, and indicates the apparent sagging in the upper and lower cheeks.

[0012] Hereinafter, factors constituting the apparent sagging (that is, the visual score) will be described with reference to Figs. 1 to 10.

[0013] First, referring to Figures 1 and 2, the facial parts whose volumes change when the face is in a horizontal position (i.e., the face's midline is held at a right angle to the direction of gravity) and when the face is in a vertical position (i.e., the face's midline is held at a right angle to the direction of gravity) will be described. As described below, the change in volume was calculated using an image showing the three-dimensional shape of the face of the person to be evaluated for sagging (hereinafter, also referred to as a three-dimensional face image).

[0014] <Gravity Bulge> Fig. 1 is a diagram for explaining gravitational swelling according to an embodiment of the present invention. A three-dimensional face image when the subject's face is in a horizontal position and a three-dimensional face image when the subject's face is in a vertical position are obtained, and the three-dimensional shape when the face is in the horizontal position and the three-dimensional shape when the face is in the vertical position are compared, and the volume of the part within the broken line in Fig. 1 is larger when the face is in the vertical position. Thus, the difference between the volumes of the parts that are larger when the face is in the vertical position (i.e., the horizontal position and the vertical position) is defined as the gravitational swelling amount (VCswelling).

[0015] <Gravity Crack> Fig. 2 is a diagram for explaining gravity depression according to an embodiment of the present invention. A three-dimensional face image when the subject's face is in a horizontal position and a three-dimensional face image when the subject's face is in a vertical position are obtained, and the three-dimensional shape when the face is in the horizontal position and the three-dimensional shape when the face is in the vertical position are compared. In this way, the difference in volume between the two positions (i.e., the horizontal position and the vertical position) of the part that has a smaller volume when the face is in the vertical position is defined as the gravity depression amount (VCshrinking).

[0016] FIG. 3 is a diagram showing the relationship between the phenomenon of facial deformation caused by the influence of gravity from gravitational bulge and gravitational depression according to an embodiment of the present invention and two types of sagging that occur on the face ("amount of sagging in the face (Sf)" and "amount of sagging in the front and back of the cheek (Sc)"; details will be described later). From the amount of gravitational bulge (VCswelling) in FIG. 1 and the amount of gravitational depression (VCshrinking) in FIG. 2, the two types of sagging ("amount of sagging in the face (Sf)" and "amount of sagging in the front and back of the cheek (Sc)") can be calculated using the following formula (1). The following formula (1) shows that when the amount of gravitational depression (VCshrinking) is the x-axis and the amount of gravitational bulge (VCswelling) is the y-axis, the two types of sagging ("amount of sagging in the face (Sf)" and "amount of sagging in the front and back of the cheek (Sc)") can be quantified by converting the coordinates by 45 degrees counterclockwise.

[0017]

number

[0018] Intra-facial sagging and anterior and posterior cheek sagging will be described in detail below with reference to Figs.

[0019] Fig. 4 is a diagram for explaining intra-face moving sagging according to one embodiment of the present invention. As shown in Fig. 4, intra-face moving sagging is sagging that hangs down from the upper cheek to the lower cheek.

[0020] Fig. 5 is a diagram for explaining anterior-posterior cheek sagging according to one embodiment of the present invention. As shown in Fig. 5, posterior-posterior cheek sagging is sagging other than sagging from the upper part of the cheek to the lower part (for example, sagging in which the cheek moves back and forth from the oral cavity side due to deformation of the cheek around the mouth).

[0021] 6 is a diagram comparing intra-facial moving sagging and anterior and posterior cheek sagging according to one embodiment of the present invention. Each comparison item will be explained below.

[0022] <Location of occurrence> Intra-facial sagging occurs across the entire cheek, while anterior-posterior cheek sagging occurs locally (around the mouth).

[0023] <Contribution rate to visual score> From the correlation R between intra-facial sagging and the visual score, which will be described with reference to Fig. 9, the contribution rate R2 (also called the coefficient of determination) of intra-facial sagging to the visual score is 53 percent. On the other hand, from the correlation R between anterior-posterior cheek sagging and the visual score, which will be described with reference to Fig. 9, the contribution rate R2 (also called the coefficient of determination) of anterior-posterior cheek sagging to the visual score is 9 percent or 0.4 percent, respectively, in the groups determined to have or not have anterior-posterior cheek sagging. The visual score is a numerical value obtained by visually evaluating sagging.

[0024] <Correlation with age> From the relationship between intra-facial sagging and age, which will be explained with reference to Figure 10, there is a correlation between intra-facial sagging and age (correlation coefficient is 0.64). On the other hand, from the relationship between anterior-posterior cheek sagging and age, which will be explained with reference to Figure 10, there is surprisingly no correlation between anterior-posterior cheek sagging and age, and it can be said that anterior-posterior cheek sagging is caused by individual differences that are unrelated to age.

[0025] <Volume change per visual evaluation of 0.5 and its meaning> From the relationship between intra-face sagging, visual score, and age, which will be explained with reference to Figures 9 and 10, the change in volume of intra-face sagging per visual evaluation (visual score) of 0.5 is 1.3 cc, which corresponds to 14 years of aging. On the other hand, from the relationship between anterior-posterior cheek sagging, visual score, and age, which will be explained with reference to Figures 9 and 10, the change in volume of anterior-posterior cheek sagging per visual evaluation (visual score) of 0.5 is 1.8 cc. This volume corresponds to the presence or absence of anterior-posterior cheek sagging. The visual score is a numerical value obtained by visually evaluating sagging.

[0026] <Characteristics of sagging> Intrafacial sagging is caused by gravity and progresses gradually over the long term across the entire face, whereas anterior and posterior cheek sagging is caused by gravity and occurs locally (around the mouth) regardless of age.

[0027] In this way, two factors that make up apparent sagging (i.e., two types of sagging, "intra-facial shift sagging" and "anterior and posterior cheek sagging") were found. In addition, the two factors that make up apparent sagging (i.e., two types of sagging, "intra-facial shift sagging" and "anterior and posterior cheek sagging") can be evaluated according to the change in facial volume when a person's face is in a horizontal position and when it is in a vertical position.

[0028] Furthermore, the sagging skin coefficient, which is a third factor that contributes to the appearance of sagging and is different from "intra-facial sagging" and "anteroposterior cheek sagging", will be described with reference to Figs. 7 and 8.

[0029] FIG. 7 is a diagram showing the relationship between gravitational swelling and visual evaluation (visual score) according to an embodiment of the present invention. Even if the gravitational swelling amount (VCswelling) is the same, there are people whose visual scores (Sss) differ. For example, when looking at people whose gravitational swelling amount is about 5cc, it can be seen that the visual scores vary from about 1 to about 4. From the relationship between the gravitational swelling amount (VCswelling) and the visual score (Sss), the sagging skin coefficient (Cs) can be defined using the following formula (2). Since VCswelling≠0 is required to directly calculate Cs from the following formula (2), the sagging skin coefficients shown in FIG. 8 were calculated for subjects whose VCswelling is >3.5 (cc), which is the average value that a 30-year-old can have. As described below, the sagging skin coefficient can be calculated directly from the gravitational swelling amount (VCswelling) and the visual score (Sss) using the following formula (2).In addition, as described below, the sagging skin coefficient (Cs) may be calculated from the skin viscoelasticity parameters using formulas (5) and (6) by taking advantage of the property that the sagging skin coefficient (Cs) correlates well with the skin viscoelasticity parameters.

[0030]

number

[0031] In addition, the following formula (3) was found from the relationship between the amount of gravitational swelling (VCswelling), the amount of intra-facial sagging (Sf), and the amount of anterior-posterior cheek sagging (Sc).

[0032]

number

[0033] From the above equations (2) and (3), the relationship between the apparent sagging (i.e., the visual score (Sss)), the sagging skin coefficient (Cs), the amount of intra-facial sagging (Sf), and the amount of anterior-posterior cheek sagging (Sc) can be expressed by the following equation (4).

[0034]

number

[0035] 8 is a diagram for explaining the sagging skin coefficient according to one embodiment of the present invention. When the correlation between the sagging skin coefficient (Cs) and each parameter of the viscoelasticity acquisition device was examined, the sagging skin coefficient (Cs) was correlated with the parameters of skin viscoelasticity acquired by the viscoelasticity acquisition device. In other words, people with a high sagging skin coefficient (Cs) are people with no firmness, and even if the sagging is caused by the same gravity, the sagging of such skin appears emphasized.

[0036] Fig. 24 shows a comparison between the visual score calculated using formula (4) and the visual score obtained from an actual visual evaluation, in which the sagging skin coefficient is calculated using one of the parameters of the skin viscoelasticity acquired by the viscoelasticity acquisition device according to one embodiment of the present invention, and Fig. 25 shows a comparison between the visual score calculated using formula (4) and the visual score obtained from an actual visual evaluation, in which the sagging skin coefficient is calculated using two or more parameters of the skin viscoelasticity acquired by the viscoelasticity acquisition device according to one embodiment of the present invention. Comparing Fig. 24 and Fig. 25, it can be seen that the correlation coefficient in Fig. 25 (i.e., the case where the sagging skin coefficient is calculated using two or more parameters of the skin viscoelasticity) is larger than that in Fig. 24 (i.e., the case where the sagging skin coefficient is calculated using one parameter of the skin viscoelasticity).

[0037] Fig. 24(a) shows fitting coefficients calculated from skin viscoelasticity parameters using the property that the sagging skin coefficient (Cs) correlates well with the skin viscoelasticity parameters using the formula (5) shown below. ai and bi were calculated from Cs and Ei of a group of subjects with VCswelling>3.5(cc), which is the average for a 30-year-old.

[0038]

number

[0039] Fig. 24(b) shows how Cs is calculated from Ei for the entire subject group using ai and bi shown in Fig. 24(a), and how Sss calculated using formula (4) is compared with the actual visual score Sss calculated using a reference photograph as described in Non-Patent Document 1. Although the correlation coefficient between Sss calculated using formula (4) and the actual Sss differs depending on the skin viscoelasticity parameters used, it can be seen that by using appropriate parameters, Sss can be calculated with high accuracy from three factors: "sagging skin coefficient (Cs)," "amount of intra-facial sagging (Sf)," and "amount of front-rear sagging of the cheeks (Sc)."

[0040] Figure 25(a) shows fitting coefficients calculated from two or more skin viscoelasticity parameters using the property that the sagging skin coefficient (Cs) correlates well with the skin viscoelasticity parameters using the formula (6) shown below. ai and b were calculated from Cs and Ei of the subject group with VCswelling>3.5(cc), which is the average for a 30-year-old.

[0041]

number

[0042] In Fig. 25(b), Cs is calculated from Ei for the entire subject group using ai and b shown in Fig. 25(a), and Sss calculated using formula (4) is compared with the actual visual score Sss calculated using a reference photograph as described in Non-Patent Document 1. Although the correlation coefficient between Sss calculated using formula (4) and the actual Sss differs depending on the skin viscoelasticity parameters used, it can be seen that by using appropriate parameters and two or more skin viscoelasticity parameters, Sss can be calculated more accurately from three factors, namely "sagging skin coefficient (Cs)", "amount of intra-facial sagging (Sf)", and "amount of front-rear sagging of cheeks (Sc)", rather than using one.

[0043] In this way, the apparent sagging (i.e., the visual score (Sss)) is composed of three factors: "sagging skin coefficient (Cs)," "amount of sagging within the face (Sf)," and "amount of sagging in the front and back of the cheeks (Sc)."

[0044] Hereinafter, the "sagging skin coefficient (Cs)", "intra-facial movement sagging amount (Sf)", and "front-rear cheek sagging amount (Sc)" will be compared and explained with reference to FIG. 9 and FIG.

[0045] FIG. 9 is a graph comparing the correlation between the sagging skin coefficient (Cs) and visual evaluation (visual score (Sss)) in one embodiment of the present invention, the correlation between the amount of intra-face movement sagging (Sf) and the visual score (Sss), and the correlation between the amount of front and rear cheek sagging (Sc) and the visual score (Sss).

[0046] As shown in the left graph (a1) of Fig. 9, the correlation coefficient between the sagging skin coefficient (Cs) and the visual score (Sss) is 0.72, and the coefficient of determination is 0.5184. Therefore, it can be said that the contribution rate of the sagging skin coefficient (Cs) to the visual score (Sss) is 52 percent.

[0047] 9, the correlation coefficient between the amount of intra-facial movement sagging (Sf) and the visual score (Sss) is 0.73, and the coefficient of determination is 0.5305. Therefore, it can be said that the contribution rate of the amount of intra-facial movement sagging (Sf) to the visual score (Sss) is 53 percent.

[0048] As shown in the right graph (c1) of Figure 9, the correlation coefficient between the amount of anterior and posterior cheek sagging (Sc) and the visual score (Sss) was 0.30 in the group with anterior and posterior cheek sagging, and the coefficient of determination was 0.09. Therefore, it can be said that the contribution rate of the amount of anterior and posterior cheek sagging (Sc) to the visual score (Sss) was 9 percent in the group with anterior and posterior cheek sagging.

[0049] In addition, the total contribution rate of the sagging skin coefficient (Cs), the contribution rate of the intra-facial sagging amount (Sf), and the contribution rate of the anterior-posterior cheek sagging amount (Sc) is 114 percent. This is due to the multicollinearity (strong correlation between explanatory variables) of the sagging skin coefficient (Cs) and the intra-facial sagging amount (Sf), which stems from the fact that both the sagging skin coefficient (Cs) and the intra-facial sagging amount (Sf) are strongly correlated with age, as shown in Figure 10.

[0050] FIG. 10 is a graph comparing the correlation between the sagging skin coefficient (Cs) and age in one embodiment of the present invention, the correlation between the amount of intra-facial sagging (Sf) and age, and the correlation between the amount of anterior / posterior cheek sagging (Sc) and age.

[0051] As shown in the left graph (a2) of Figure 10, the sagging skin coefficient (Cs) increases with age, with a correlation coefficient of 0.66. This shows that the sagging skin coefficient (Cs), which is a factor that determines the appearance of sagging, is a phenomenon caused by aging.

[0052] As shown in the center graph (b2) of Figure 10, the amount of intra-facial sagging (Sf) increases with age, with a correlation coefficient of 0.64. This indicates that intra-facial sagging (Sf), which is a factor that constitutes apparent sagging, is a phenomenon caused by aging.

[0053] As shown in the right graph (c2) of Figure 10, people with a lot of anterior / posterior cheek sagging (Sc) (group with anterior / posterior cheek sagging) and people with little anterior / posterior cheek sagging (Sc) (group without anterior / posterior cheek sagging) are distributed across all age groups. This shows that the amount of anterior / posterior cheek sagging (Sc), which is a factor that determines the appearance of sagging, is something that varies from person to person.

[0054] <System configuration> 11 is a configuration diagram of an evaluation system 1 according to an embodiment of the present invention. The evaluation system 1 according to an embodiment of the present invention (also referred to as an evaluation system that evaluates the type and degree of sagging) includes an evaluation device 10 (also referred to as an evaluation device that evaluates the type and degree of sagging), an imaging terminal 20, and an analysis terminal 30. The evaluation device 10 and the analysis terminal 30 can transmit and receive data via an arbitrary network. Each will be described below.

[0055] The imaging terminal 20 is a terminal that generates data of an image (three-dimensional shape face image) that shows the three-dimensional shape of the face of a person who is the subject of sagging evaluation. For example, the imaging terminal 20 is a measuring device that captures 3D (three-dimensional) images. Specifically, the imaging terminal 20 generates data of the three-dimensional shape face image when the face of the person who is the subject of sagging evaluation is in a horizontal position (specifically, when the midline of the face is made to rest perpendicular to the direction of gravity) and when the face is in a vertical position (specifically, when the midline of the face is made to rest parallel to the direction of gravity). The imaging terminal 20 will be described in detail later with reference to FIG. 13.

[0056] The analysis terminal 30 is a computer (e.g., a personal computer, a tablet, a smartphone, etc.) for calculating information used in evaluating sagging based on data generated by the imaging terminal 20. Specifically, the analysis terminal 30 calculates a gravitational swelling amount (VCswelling) and a gravitational depression amount (VCshrinking) based on a change in three-dimensional shape between a three-dimensional shape face image when the face of a person to be evaluated for sagging is in a horizontal position and a three-dimensional shape face image when the face is in a vertical position. The analysis terminal 30 will be described in detail later with reference to FIG. 14.

[0057] The evaluation device 10 is a computer (e.g., a server) for evaluating sagging. For example, the evaluation device 10 calculates the amount of intra-face movement sagging (Sf) and the amount of front-rear cheek sagging (Sc) based on the amount of gravitational swelling (VCswelling) and the amount of gravitational depression (VCshrinking). The evaluation device 10 will be described in detail later with reference to FIG. 12.

[0058] In FIG. 11, the evaluation device 10 and the analysis terminal 30 are described as separate computers, but they may be implemented as one computer.

[0059] Fig. 12 is a functional block diagram of an evaluation device 10 according to an embodiment of the present invention. As shown in Fig. 12, the evaluation device 10 can include an acquisition unit 101, a calculation unit 102, an evaluation unit 103, and an output unit 104. Furthermore, the evaluation device 10 can function as the acquisition unit 101, the calculation unit 102, the evaluation unit 103, and the output unit 104 by executing a program. Each of these will be described below.

[0060] The acquisition unit 101 acquires the gravity swelling amount (VCswelling) and the gravity collapse amount (VCshrinking) calculated by the analysis terminal 30. The acquisition unit 101 also stores the acquired gravity swelling amount (VCswelling) and gravity collapse amount (VCshrinking) in a memory so that the calculation unit 102 can refer to them.

[0061] The calculation unit 102 calculates the amount of intra-face movement sagging (Sf) and the amount of front-back cheek sagging (Sc) from the amount of gravity swelling (VCswelling) and the amount of gravity collapsing (VCshrinking). The calculation unit 102 also stores the calculated amount of intra-face movement sagging (Sf) and the amount of front-back cheek sagging (Sc) in memory so that the evaluation unit 103 and the output unit 104 can refer to them. Hereinafter, a method for calculating the amount of intra-face movement sagging (Sf) and the amount of front-back cheek sagging (Sc) will be described in detail.

[0062] <<Calculation of intra-facial sagging (Sf) and anterior-posterior cheek sagging (Sc)>> When the amount of gravitational depression (VCshrinking) is the x-axis and the amount of gravitational expansion (VCswelling) is the y-axis, the calculation unit 102 calculates the amount of intra-facial sagging (Sf) and the amount of anterior and posterior cheek sagging (Sc) by converting the coordinates by 45 degrees counterclockwise as represented by the following equation (1).

[0063]

number

[0064] The evaluation unit 103 evaluates the type and degree of sagging using the amount of intra-facial shift sagging (Sf) and the amount of front-rear cheek sagging (Sc) as indicators.

[0065] The output unit 104 outputs the values ​​of the amount of sagging movement within the face (Sf) and the amount of sagging before and after the cheeks (Sc), the type of sagging and its degree. For example, the output unit 104 can be configured to transmit the values ​​of the amount of sagging movement within the face (Sf) and the amount of sagging before and after the cheeks (Sc), the type of sagging and its degree to the analysis terminal 30, or can be configured to display the values ​​of the amount of sagging movement within the face (Sf) and the amount of sagging before and after the cheeks (Sc), the type of sagging and its degree on the display means of the evaluation device 10.

[0066] Fig. 13 is a functional block diagram of the imaging terminal 20 according to one embodiment of the present invention. As shown in Fig. 13, the imaging terminal 20 can include a generation unit 201. Moreover, the imaging terminal 20 can function as the generation unit 201 by executing a program. This will be described in detail below.

[0067] The generating unit 201 generates data of three-dimensional facial image when the face of the person to be evaluated for sagging is in a horizontal position and when the face is in a vertical position. The generating unit 201 also transmits the generated data to the analysis terminal 30.

[0068] Fig. 14 is a functional block diagram of the analysis terminal 30 according to one embodiment of the present invention. As shown in Fig. 14, the analysis terminal 30 can include a calculation unit 301. Moreover, the analysis terminal 30 can function as the calculation unit 301 by executing a program. This will be described in detail below.

[0069] The calculation unit 301 acquires data generated by the imaging terminal 20. The calculation unit 301 also calculates a gravity swelling amount (VCswelling) and a gravity collapse amount (VCshrinking) based on a change in three-dimensional shape between a three-dimensional shape face image of a person to be evaluated for sagging generated by the imaging terminal 20 when the face is in a horizontal position and a three-dimensional shape face image of the person when the face is in a vertical position. The calculation unit 301 can also transmit the calculated gravity swelling amount (VCswelling) and gravity collapse amount (VCshrinking) to the evaluation device 10. Hereinafter, a method for calculating the gravity swelling amount (VCswelling) and a method for calculating the gravity collapse amount (VCshrinking) will be described in detail.

[0070] <<Calculation of gravitational swelling (VCswelling)>> The calculation unit 301 compares the three-dimensional shape when in the horizontal position with the three-dimensional shape when in the vertical position, and determines the difference in volume between the two (i.e., horizontal and vertical positions) of the parts that have a larger volume when in the vertical position (the parts described in FIG. 1) as the gravitational swelling amount (VCswelling).

[0071] <<Calculation of gravity shrinkage (VCshrinking)>> The calculation unit 301 compares the three-dimensional shape in the horizontal position with the three-dimensional shape in the vertical position, and determines the difference in volume between the two (i.e., the horizontal and vertical positions) of the parts whose volume is small in the vertical position (the parts described in FIG. 2) as the amount of gravity shrinkage (VC shrinking).

[0072] <Method> Various methods for evaluating sagging will be described below with reference to Figures 15 to 22. Note that some of the methods in Figures 15 to 22 may be performed by a person.

[0073] Fig. 15 is a sequence diagram of the evaluation process according to an embodiment of the present invention, in which the amount of intra-face movement sagging (Sf) and the amount of front-back cheek sagging (Sc) are calculated.

[0074] In step 1 (S1), the imaging terminal 20 generates data of a three-dimensional facial image when the face of the person to be evaluated for sagging is in a horizontal position (i.e., the midline of the face is held still perpendicular to the direction of gravity), and data of a three-dimensional facial image when the face of the person to be evaluated for sagging is in a vertical position (i.e., the midline of the face is held still parallel to the direction of gravity).

[0075] In step 2 (S2), the imaging terminal 20 transmits the data generated in S1 to the analysis terminal 30.

[0076] In step 3 (S3), the analysis terminal 30 calculates the amount of gravity swelling (VCswelling) and the amount of gravity collapsing (VCshrinking) based on the change in three-dimensional shape between the three-dimensional shape face image in the horizontal position and the three-dimensional shape face image in the vertical position obtained in S2.

[0077] <<Calculation of gravitational swelling (VCswelling)>> Specifically, the analysis terminal 30 compares the three-dimensional shape when in a horizontal position with the three-dimensional shape when in a vertical position, and determines the difference in volume between the two (i.e., horizontal and vertical positions) of the parts that have a larger volume when in the vertical position (the parts described in Figure 1) as the gravitational swelling amount (VCswelling).

[0078] <<Calculation of gravity shrinkage (VCshrinking)>> Specifically, the analysis terminal 30 compares the three-dimensional shape when in a horizontal position with the three-dimensional shape when in a vertical position, and determines the difference in volume between the two (i.e., the horizontal and vertical positions) of the parts whose volume is small when in the vertical position (the parts described in FIG. 2) as the amount of gravity shrinkage (VC shrinking).

[0079] In step 4 (S4), the analysis terminal 30 transmits to the evaluation device 10 the gravity swelling amount (VCswelling) and the gravity shrinking amount (VCshrinking) calculated in S3.

[0080] In step 5 (S5), the evaluation device 10 calculates the amount of intra-face movement sagging (Sf) and the amount of front-back cheek sagging (Sc) from the amount of gravitational swelling (VCswelling) and the amount of gravitational depression (VCshrinking) acquired in S4. Specifically, the evaluation device 10 calculates the amount of intra-face movement sagging (Sf) and the amount of front-back cheek sagging (Sc) from the amount of gravitational swelling (VCswelling) and the amount of gravitational depression (VCshrinking) by the coordinate conversion of the above-mentioned formula (1).

[0081] The evaluation device 10 may be configured to evaluate the type and degree of sagging using the calculated amount of intra-face shift sagging (Sf) and amount of front-back cheek sagging (Sc) as indicators. For example, the evaluation device 10 may evaluate the type of sagging as follows, using the percentage of the amount of intra-face shift sagging (Sf) as the percentage of sagging caused by aging and the percentage of the amount of front-back cheek sagging (Sc) as the percentage of sagging caused by individual differences. Type (intra-facial sagging, front and back cheek sagging) Type 1 (Yes, No): Age-related sagging type Type 2, (without, with): Partial sagging type Type 3, (Yes, Yes): Sagging face type Type 4, (none, none): Zero sagging type The degree of facial sagging may be expressed as (large, medium, small) etc., compared to the average for the subject's age. Type 1, (Medium): Age-appropriate sagging type Type 2, (small): Young-looking sagging type Type 3 (large): Sagging type that makes you look older.

[0082] In step 6 (S6), the evaluation device 10 transmits the amount of intra-facial moving sagging (Sf) and the amount of front-rear cheek sagging (Sc) calculated in S5 to the analysis terminal 30. The evaluation device 10 may also be configured to transmit the type of sagging evaluated in S5 and its degree to the analysis terminal 30.

[0083] Fig. 16 is a flowchart of an evaluation process according to an embodiment of the present invention, in which the amount of intra-face movement sagging (Sf) and the amount of front-rear cheek sagging (Sc) are calculated.

[0084] In step 11 (S11), the acquisition unit 101 of the evaluation device 10 acquires the gravity swelling amount (VCswelling) and the gravity collapse amount (VCshrinking). For example, the acquisition unit 101 of the evaluation device 10 acquires the gravity swelling amount (VCswelling) and the gravity collapse amount (VCshrinking) from the analysis terminal 30.

[0085] In step 12 (S12), the calculation unit 102 of the evaluation device 10 calculates the amount of intra-face movement sagging (Sf) and the amount of front-rear cheek sagging (Sc) from the amount of gravitational swelling (VCswelling) and the amount of gravitational depression (VCshrinking) acquired in S11. Specifically, the calculation unit 102 of the evaluation device 10 calculates the amount of intra-face movement sagging (Sf) and the amount of front-rear cheek sagging (Sc) from the amount of gravitational swelling (VCswelling) and the amount of gravitational depression (VCshrinking) by the coordinate conversion of the above-mentioned formula (1).

[0086] The evaluation unit 103 of the evaluation device 10 can also be configured to evaluate the type and degree of sagging using as indexes the amount of intra-facial movement sagging (Sf) and the amount of front-back cheek sagging (Sc) calculated by the calculation unit 102. For example, the evaluation unit 103 of the evaluation device 10 can evaluate the degree of facial sagging by considering the proportion of the amount of intra-facial movement sagging (Sf) as the proportion of sagging caused by aging and the proportion of the amount of front-back cheek sagging (Sc) as the proportion of sagging caused by individual differences.

[0087] In step 13 (S13), the output unit 104 of the evaluation device 10 outputs (for example, transmits to the analysis terminal 30, etc., displays on the display means of the evaluation device 10, etc.) the amount of intra-facial movement sagging (Sf) and the amount of front-rear cheek sagging (Sc) calculated in S12. Note that the output unit 104 of the evaluation device 10 can also be configured to output (for example, transmits to the analysis terminal 30, etc., displays on the display means of the evaluation device 10, etc.) the type of sagging evaluated in S12 and its degree.

[0088] 17 is a flowchart of an intra-face movement sagging evaluation process according to an embodiment of the present invention, in which the amount of intra-face movement sagging (Sf) is calculated.

[0089] In step 101 (S101), the acquisition unit 101 of the evaluation device 10 acquires the gravity swelling amount (VCswelling) and the gravity collapse amount (VCshrinking). For example, the acquisition unit 101 of the evaluation device 10 acquires the gravity swelling amount (VCswelling) and the gravity collapse amount (VCshrinking) from the analysis terminal 30.

[0090] In step 102 (S102), the calculation unit 102 of the evaluation device 10 calculates the amount of intra-face movement sagging (Sf) from the amount of gravity swelling (VCswelling) and the amount of gravity collapsing (VCshrinking) acquired in S101. Specifically, the calculation unit 102 of the evaluation device 10 calculates the amount of intra-face movement sagging (Sf) from the amount of gravity swelling (VCswelling) and the amount of gravity collapsing (VCshrinking) by the coordinate conversion of the above-mentioned formula (1).

[0091] In step 103 (S103), the output unit 104 of the evaluation device 10 outputs (for example, transmits to the analysis terminal 30 or displays on the display means of the evaluation device 10) the intra-facial movement sagging amount (Sf) calculated in S102.

[0092] 18 is a flowchart of an intra-face movement sagging evaluation process according to an embodiment of the present invention, in which the amount of intra-face movement sagging (Sf) is calculated.

[0093] In step 111 (S111), the acquisition unit 101 of the evaluation device 10 acquires the visual score (Sss), the amount of front and rear cheek sagging (Sc), and the sagging skin coefficient (Cs) of the face of a person who is the subject of sagging evaluation.

[0094] For example, the acquisition unit 101 of the evaluation device 10 can acquire a visual score (Sss) calculated from an image of a face of a person who is the subject of sagging evaluation when the face is in a vertical position (i.e., a state in which the midline of the face is stationary and parallel to the direction of gravity). Note that the visual score (Sss) may be calculated using a trained model generated by machine learning.

[0095] For example, the acquisition unit 101 of the evaluation device 10 can acquire the amount of front and rear cheek sagging (Sc) calculated from the amount of gravitational swelling (VCswelling) and the amount of gravitational depression (VCshrinking).

[0096] For example, the acquisition unit 101 of the evaluation device 10 can acquire a sagging skin coefficient (Cs) based on skin viscoelasticity acquired by a device for acquiring skin viscoelasticity (viscoelasticity acquisition device).

[0097] In step 112 (S112), the calculation unit 102 of the evaluation device 10 calculates the amount of intra-face movement sagging (Sf) from the visual score (Sss), the amount of front and rear cheek sagging (Sc), and the sagging skin coefficient (Cs) acquired in S111. Specifically, the calculation unit 102 of the evaluation device 10 calculates the amount of intra-face movement sagging (Sf) from the visual score (Sss), the amount of front and rear cheek sagging (Sc), and the sagging skin coefficient (Cs) using the above-mentioned formula (4).

[0098] In step 113 (S113), the output unit 104 of the evaluation device 10 outputs (for example, transmits to the analysis terminal 30 or the like, displays on the display means of the evaluation device 10, etc.) the intra-facial movement sagging amount (Sf) calculated in S112.

[0099] 19 is a flowchart of an evaluation process for anterior and posterior cheek sagging according to an embodiment of the present invention, in which the amount of posterior and posterior cheek sagging (Sc) is calculated.

[0100] In step 201 (S201), the acquisition unit 101 of the evaluation device 10 acquires the gravity swelling amount (VCswelling) and the gravity collapse amount (VCshrinking). For example, the acquisition unit 101 of the evaluation device 10 acquires the gravity swelling amount (VCswelling) and the gravity collapse amount (VCshrinking) from the analysis terminal 30.

[0101] In step 202 (S202), the calculation unit 102 of the evaluation device 10 calculates the amount of front-rear cheek sagging (Sc) from the amount of gravitational swelling (VCswelling) and the amount of gravitational depression (VCshrinking) acquired in S201. Specifically, the calculation unit 102 of the evaluation device 10 calculates the amount of front-rear cheek sagging (Sc) from the amount of gravitational swelling (VCswelling) and the amount of gravitational depression (VCshrinking) by the coordinate conversion of the above-mentioned formula (1).

[0102] The evaluation unit 103 of the evaluation device 10 can also be configured to evaluate the type and degree of sagging using as an index the amount of front and rear cheek sagging (Sc) calculated by the calculation unit 102. For example, the evaluation unit 103 of the evaluation device 10 can evaluate the degree of facial sagging based on an increase or decrease from the past amount of front and rear cheek sagging (Sc).

[0103] In step 203 (S203), the output unit 104 of the evaluation device 10 outputs (e.g., transmits to the analysis terminal 30, etc., displays on the display means of the evaluation device 10, etc.) the amount of front and rear cheek sagging calculated in S202. Note that the output unit 104 of the evaluation device 10 can also be configured to output (e.g., transmits to the analysis terminal 30, etc., displays on the display means of the evaluation device 10, etc.) the type of sagging evaluated in S202 and its degree.

[0104] 20 is a flowchart of an evaluation process for anterior and posterior cheek sagging according to an embodiment of the present invention, in which the amount of posterior and posterior cheek sagging (Sc) is calculated.

[0105] In step 211 (S211), the acquiring unit 101 of the evaluation device 10 acquires the visual score (Sss), the in-face movement sagging amount (Sf), and the sagging skin coefficient (Cs) of the face of the person who is the subject of the sagging evaluation.

[0106] For example, the acquisition unit 101 of the evaluation device 10 can acquire a visual score (Sss) calculated from an image of a face of a person who is the subject of sagging evaluation when the face is in a vertical position (i.e., a state in which the midline of the face is stationary and parallel to the direction of gravity). Note that the visual score (Sss) may be calculated using a trained model generated by machine learning.

[0107] For example, the acquiring unit 101 of the evaluation device 10 can acquire the amount of intra-facial movement sagging (Sf) calculated from the amount of gravitational swelling (VCswelling) and the amount of gravitational depression (VCshrinking).

[0108] For example, the acquisition unit 101 of the evaluation device 10 can acquire a sagging skin coefficient (Cs) based on skin viscoelasticity acquired by a device for acquiring skin viscoelasticity (viscoelasticity acquisition device).

[0109] In step 212 (S212), the calculation unit 102 of the evaluation device 10 calculates the amount of front-rear cheek sagging (Sc) from the visual score (Sss), the amount of in-face moving sagging (Sf), and the sagging skin coefficient (Cs) acquired in S211. Specifically, the calculation unit 102 of the evaluation device 10 calculates the amount of front-rear cheek sagging (Sc) from the visual score (Sss), the amount of in-face moving sagging (Sf), and the sagging skin coefficient (Cs) using the above-mentioned formula (4).

[0110] The evaluation unit 103 of the evaluation device 10 can also be configured to evaluate the type and degree of sagging using as an index the amount of front and rear cheek sagging (Sc) calculated by the calculation unit 102. For example, the evaluation unit 103 of the evaluation device 10 can evaluate the degree of facial sagging based on an increase or decrease from the past amount of front and rear cheek sagging (Sc).

[0111] In step 213 (S213), the output unit 104 of the evaluation device 10 outputs (e.g., transmits to the analysis terminal 30, etc., displays on the display means of the evaluation device 10, etc.) the amount of front and rear cheek sagging calculated in S212. Note that the output unit 104 of the evaluation device 10 can also be configured to output (e.g., transmits to the analysis terminal 30, etc., displays on the display means of the evaluation device 10, etc.) the type of sagging evaluated in S212 and its degree.

[0112] Fig. 21 is a flowchart of a sagging skin coefficient evaluation process according to an embodiment of the present invention. In Fig. 21, the sagging skin coefficient (Cs) is calculated. The sagging skin coefficient (Cs) can be calculated directly using the above-mentioned formula (5) or formula (6) based on the skin viscoelasticity acquired by the viscoelasticity acquisition device, or can be calculated using the above-mentioned formula (2).

[0113] In step 301 (S301), the acquisition unit 101 of the evaluation device 10 acquires the amount of intra-face movement sagging (Sf). For example, the acquisition unit 101 of the evaluation device 10 can acquire the amount of intra-face movement sagging (Sf) calculated from the amount of gravity swelling (VCswelling) and the amount of gravity collapsing (VCshrinking).

[0114] In step 302 (S302), the acquisition unit 101 of the evaluation device 10 acquires the amount of front-rear cheek sagging (Sc). For example, the acquisition unit 101 of the evaluation device 10 can acquire the amount of front-rear cheek sagging (Sc) calculated from the amount of gravitational swelling (VCswelling) and the amount of gravitational depression (VCshrinking).

[0115] In step 303 (S303), the acquisition unit 101 of the evaluation device 10 acquires the visual score (Sss). For example, the acquisition unit 101 of the evaluation device 10 can acquire the visual score (Sss) calculated from an image of the face of a person who is the subject of sagging evaluation when the face is in a vertical position (i.e., a state in which the midline of the face is stationary and parallel to the direction of gravity). Note that the visual score (Sss) may be calculated using a trained model generated by machine learning.

[0116] It should be noted that S301 to S303 may be performed in any order and simultaneously.

[0117] In step 304 (S304), the calculation unit 102 of the evaluation device 10 calculates the sagging skin coefficient (Cs) from the amount of intra-face movement sagging (Sf), the amount of front-back cheek sagging (Sc), and the visual score (Sss) acquired in S301 to S303. Specifically, the calculation unit 102 of the evaluation device 10 calculates the sagging skin coefficient (Cs) from the amount of intra-face movement sagging (Sf), the amount of front-back cheek sagging (Sc), and the visual score (Sss) using the above-mentioned formula (4).

[0118] The evaluation unit 103 of the evaluation device 10 may be configured to evaluate the type and degree of sagging using the sagging skin coefficient (Cs) calculated by the calculation unit 102 as an index. For example, the evaluation unit 103 of the evaluation device 10 may evaluate the degree of facial sagging based on an increase or decrease from the past sagging skin coefficient (Cs). The degree of facial sagging may be evaluated based on whether the subject's sagging skin coefficient is large or small compared to the average of the actual age.

[0119] In step 305 (S305), the output unit 104 of the evaluation device 10 outputs the sagging skin coefficient (Cs) calculated in S304 (e.g., transmits it to the analysis terminal 30 or the like, displays it on the display means of the evaluation device 10, etc.). Note that the output unit 104 of the evaluation device 10 can also be configured to output the sagging type and its degree evaluated in S304 (e.g., transmits it to the analysis terminal 30 or the like, displays it on the display means of the evaluation device 10, etc.).

[0120] 22 is a flowchart of a visual score evaluation process according to an embodiment of the present invention, in which the visual score (Sss) is calculated.

[0121] In step 401 (S401), the acquisition unit 101 of the evaluation device 10 acquires the amount of intra-face movement sagging (Sf). For example, the acquisition unit 101 of the evaluation device 10 can acquire the amount of intra-face movement sagging (Sf) calculated from the amount of gravity swelling (VCswelling) and the amount of gravity collapsing (VCshrinking).

[0122] In step 402 (S402), the acquisition unit 101 of the evaluation device 10 acquires the amount of front-rear cheek sagging (Sc). For example, the acquisition unit 101 of the evaluation device 10 can acquire the amount of front-rear cheek sagging (Sc) calculated from the amount of gravity swelling (VCswelling) and the amount of gravity depression (VCshrinking).

[0123] In step 403 (S403), the acquisition unit 101 of the evaluation device 10 acquires the sagging skin coefficient (Cs). For example, the acquisition unit 101 of the evaluation device 10 can acquire the sagging skin coefficient (Cs) based on the skin viscoelasticity acquired by an apparatus for acquiring the viscoelasticity of the skin (viscoelasticity acquisition apparatus).

[0124] It should be noted that S401 to S403 may be performed in any order and simultaneously.

[0125] In step 404 (S404), the calculation unit 102 of the evaluation device 10 calculates the visual score (Sss) from the amount of intra-face movement sagging (Sf), the amount of front-back cheek sagging (Sc), and the sagging skin coefficient (Cs) acquired in S401 to S403. Specifically, the calculation unit 102 of the evaluation device 10 calculates the visual score (Sss) from the amount of intra-face movement sagging (Sf), the amount of front-back cheek sagging (Sc), and the sagging skin coefficient (Cs) using the above-mentioned formula (4).

[0126] In step 405 (S405), the output unit 104 of the evaluation device 10 outputs (for example, transmits to the analysis terminal 30 or the like, displays on the display means of the evaluation device 10, etc.) the visual score (Sss) calculated in S404.

[0127] <<Recommendations for solutions to sagging>> In the above-mentioned sagging evaluation method, it is also possible to output a solution to the sagging together with the evaluation result (each value, sagging type, and its degree). Specifically, the output unit 104 of the evaluation device 10 outputs a solution corresponding to the evaluation result (each value, sagging type, and its degree) that is determined in advance. For example, when the ratio of the intra-face movement sagging amount (Sf) is high, the output unit 104 of the evaluation device 10 recommends cosmetics, supplements, beauty treatments including massage, and training that eliminate intra-face movement sagging, and when the ratio of the cheek front-back sagging amount (Sc) is high, the output unit 104 of the evaluation device 10 recommends cosmetics, supplements, beauty treatments including massage, and training that eliminate the cheek front-back sagging. For example, the output unit 104 of the evaluation device 10 recommends cosmetics, supplements, beauty treatments including massage, and training that correspond to the intra-face movement sagging amount (Sf) and the cheek front-back sagging amount (Sc).

[0128] <<Weighting>> In evaluating the above-mentioned type and degree of sagging, the evaluation of each factor may be weighted based on the contribution rate of the sagging skin coefficient (Cs) to the visual score (Sss), the contribution rate of the amount of intra-facial sagging (Sf) to the visual score (Sss), and the contribution rate of the amount of anterior / posterior cheek sagging (Sc) to the visual score (Sss).

[0129] <<Iterative Acquisition of 3D Face Images>> In one embodiment of the present invention, three-dimensional facial images of a subject in horizontal and vertical positions are repeatedly acquired, and at least one of the gravitational swelling amount (VCswelling), the gravitational depression amount (VCshrinking), the intra-facial movement sagging amount (Sf), and the cheek anterior-posterior sagging amount (Sc) can be set as a representative value calculated using the three-dimensional facial images repeatedly acquired. This will be described in detail below.

[0130] Fig. 26 is a diagram showing three-dimensional face images acquired at the same time at the same place on the same day according to an embodiment of the present invention. The three three-dimensional face images (1), (2), and (3) in Fig. 26 are three-dimensional face images of the same person acquired at the same time at the same place on the same day. As shown in Fig. 26, even on the same day, place, and time, the shapes of the faces are different, and it can be seen that the mouth in particular is moving.

[0131] In other words, even if three-dimensional facial images of the same person are obtained at the same place and time on the same day with the aim of obtaining the same three-dimensional facial image, there will be variations in the amount of gravitational swelling (VCswelling) and the amount of gravitational depression (VCshrinking).

[0132] FIG. 27 is a diagram showing the variation of gravity swelling and gravity depression according to an embodiment of the present invention. The triangle marks in FIG. 27 indicate the gravity swelling amount (VCswelling) and gravity depression amount (VCshrinking) of a certain subject before the implementation of a solution to sagging (specifically, a massage to the scalp). The square marks in FIG. 27 indicate the gravity swelling amount (VCswelling) and gravity depression amount (VCshrinking) of the subject after the implementation of a solution to sagging (specifically, a massage to the scalp). As shown in FIG. 27, the gravity swelling amount (VCswelling) and gravity depression amount (VCshrinking) vary both before and after the implementation of the solution to sagging. Therefore, if the three-dimensional shape face images of the subject in the horizontal and vertical positions are not repeatedly acquired, the subject may be evaluated as being more sagging after the implementation of the solution to sagging than before the implementation. The average value of gravity swelling (VCswelling) is represented by a large triangle symbol, and the average value of gravity shrinking (VCshrinking) is represented by a large square symbol.

[0133] Therefore, in one embodiment of the present invention, three-dimensional facial images of the subject in horizontal and vertical positions are repeatedly obtained, and at least one of the gravitational swelling amount (VCswelling), the gravitational depression amount (VCshrinking), the amount of intra-facial sagging (Sf), and the amount of anterior-posterior cheek sagging (Sc) can be set as a representative value calculated using the repeatedly obtained three-dimensional facial images.

[0134] FIG. 28 is a diagram for explaining the repeated acquisition of a three-dimensional face image according to an embodiment of the present invention. The case of intra-face movement sagging amount (Sf) will be described below. The evaluation device 10 repeatedly acquires three-dimensional face images in horizontal and vertical positions of the target (in the example of FIG. 28, a total of six three-dimensional face images are acquired, three three-dimensional face images in horizontal positions and three three-dimensional face images in vertical positions). Then, the evaluation device 10 obtains the gravity swelling amount (VCswelling) and the gravity depression amount (VCshrinking) from the three-dimensional shape change between the three-dimensional face images for each of the three-dimensional face images repeatedly acquired (in the example of FIG. 28, nine combinations of three three-dimensional face images in horizontal positions and three three-dimensional face images in vertical positions) (that is, nine pairs of the gravity swelling amount (VCswelling) and the gravity depression amount (VCshrinking) are obtained). Then, the evaluation device 10 calculates a representative value of the intra-face movement sagging amount (Sf) calculated from each gravitational swelling amount (VCswelling) and gravitational depression amount (VCshrinking) as the intra-face movement sagging amount (Sf). Note that the representative value is, for example, an average value, but may also be a median value, a mode value, or the like.

[0135] Fig. 29 is a diagram for explaining a representative value of at least one of the gravity swelling amount (VCswelling), gravity depression amount (VCshrinking), intra-face movement sagging amount (Sf), and cheek front and rear sagging amount (Sc) calculated using a three-dimensional shape face image repeatedly acquired according to an embodiment of the present invention. The case of intra-face movement sagging amount (Sf) will be explained below. The average value of nine intra-face movement sagging amounts (Sf) calculated from nine pairs of gravity swelling amount (VCswelling) and gravity depression amount (VCshrinking) before the implementation of a solution to sagging of a certain subject (specifically, a massage to the scalp) shown in Fig. 27 is compared with the average value of nine intra-face movement sagging amounts (Sf) calculated from nine pairs of gravity swelling amount (VCswelling) and gravity depression amount (VCshrinking) after the implementation of a solution to sagging of a certain subject (specifically, a massage to the scalp). It can be seen that by implementing solutions to sagging (specifically, scalp massage), there is a slight but significant reduction in the amount of sagging movement in the face (Sf).

[0136] FIG. 30 is a diagram for explaining the daily difference in the representative value of at least one of the gravitational swelling amount (VCswelling), the gravitational depression amount (VCshrinking), the intra-face movement sagging amount (Sf), and the cheek front and rear sagging amount (Sc) calculated using a three-dimensional shape face image repeatedly acquired according to an embodiment of the present invention. The case of intra-face movement sagging amount (Sf) will be explained below. In FIG. 30, the average value of nine intra-face movement sagging amounts (Sf) calculated from nine pairs of gravitational swelling amount (VCswelling) and gravitational depression amount (VCshrinking) of four subjects was acquired on one day and the next day. During that time, no treatment that would affect sagging (such as using a facial beauty device or massaging the scalp) was performed. Therefore, it is expected that there will be no change in the sagging of each subject, and it is expected that there will be no significant difference in the average value of intra-face movement sagging amount (Sf). In fact, since there was no significant difference in the amount of intra-facial sagging (Sf) of all four subjects, it is possible to track changes in sagging for each individual. Furthermore, since the daily difference in the average amount of intra-facial sagging (Sf) of the four subjects was also not significantly different (p=0.38), it is also possible to compare subjects or groups of subjects who have had treatment with or without treatment or with different strengths in order to measure the effect on sagging.

[0137] FIG. 31 is a diagram for explaining the results of comparing subjects or groups of subjects with or without treatment or with different strengths of treatment for the purpose of measuring the effect on sagging by obtaining a representative value of at least one of the gravitational swelling amount (VCswelling), the gravitational depression amount (VCshrinking), the intra-face sagging amount (Sf), and the cheek anterior-posterior sagging amount (Sc) using a three-dimensional shape face image repeatedly acquired according to an embodiment of the present invention. The case of intra-face sagging amount (Sf) will be explained below. In FIG. 31, in order to measure the effect on sagging, a treatment was performed on two subjects using a commercially available facial beauty device (Denki Bali Brush, ELECTRON EVERYONE Co., Ltd.), and the average values ​​of intra-face sagging amount (Sf) calculated using three-dimensional shape face images repeatedly acquired immediately before, immediately after, and the next day were compared. For subject E, no significant difference was observed between all of the intra-face sagging amount (Sf) calculated using three-dimensional shape face images repeatedly acquired immediately before, immediately after, and the next day. This result means that for subject E, treatment with a commercially available facial beauty device (Denki Bali Brush, ELECTRON EVERYONE) for the purpose of measuring the effect on sagging was ineffective. For subject F, no significant difference was observed between the amount of sagging movement in the face (Sf) calculated using three-dimensional shape face images repeatedly acquired immediately before and the next day, but a significant increase was observed between the amount of sagging movement in the face (Sf) calculated using three-dimensional shape face images repeatedly acquired immediately before and immediately after, and immediately after and the next day. This result means that for subject F, treatment with a commercially available facial beauty device (Denki Bali Brush, ELECTRON EVERYONE) for the purpose of measuring the effect on sagging had the opposite effect immediately after, but the effect disappeared the next day and the original appearance returned.

[0138] In addition, in one embodiment of the present invention, the method may further include selecting a substance or a cosmetic treatment that increases or decreases the representative value of the value calculated using the three-dimensional face images repeatedly acquired. In this way, in one embodiment of the present invention, a substance or a cosmetic treatment that increases or decreases the representative value of the value calculated using the three-dimensional face images repeatedly acquired can be selected and obtained. For example, the substance is a material intended to be blended into cosmetics, such as a plant extract or a compound. Also, for example, the substance is cosmetics, medicine, food, etc. In addition, in one embodiment of the present invention, the method may further include presenting a cosmetic method that increases the representative value of the value calculated using the three-dimensional face images repeatedly acquired based on the representative value of the value calculated using the three-dimensional face images repeatedly acquired.

[0139] <Hardware configuration> 23 is a block diagram showing an example of a hardware configuration of the evaluation device 10 and the analysis terminal 30 according to an embodiment of the present invention. The evaluation device 10 and the analysis terminal 30 have a CPU (Central Processing Unit) 1001, a ROM (Read Only Memory) 1002, and a RAM (Random Access Memory) 1003. The CPU 1001, the ROM 1002, and the RAM 1003 form a so-called computer.

[0140] Moreover, the evaluation device 10 and the analysis terminal 30 may have an auxiliary storage device 1004, a display device 1005, an operation device 1006, an I / F (Interface) device 1007, and a drive device 1008. The hardware components of the evaluation device 10 and the analysis terminal 30 are connected to each other via a bus B.

[0141] The CPU 1001 is a computing device that executes various programs installed in the auxiliary storage device 1004 .

[0142] The ROM 1002 is a non-volatile memory. The ROM 1002 functions as a main storage device that stores various programs, data, etc. required for the CPU 1001 to execute various programs installed in the auxiliary storage device 1004. Specifically, the ROM 1002 functions as a main storage device that stores boot programs such as a BIOS (Basic Input / Output System) and an EFI (Extensible Firmware Interface).

[0143] The RAM 1003 is a volatile memory such as a dynamic random access memory (DRAM) or a static random access memory (SRAM). The RAM 1003 functions as a main storage device that provides a working area in which various programs installed in the auxiliary storage device 1004 are expanded when the CPU 1001 executes them.

[0144] The auxiliary storage device 1004 is an auxiliary storage device that stores various programs and information used when the various programs are executed.

[0145] The display device 1005 is a display device that displays the internal states of the evaluation device 10 and the analysis terminal 30, etc.

[0146] The operation device 1006 is an input device through which an administrator of the evaluation device 10 and the analysis terminal 30 inputs various instructions to the evaluation device 10 and the analysis terminal 30 .

[0147] The I / F device 1007 is a communication device for connecting to a network and communicating with other devices.

[0148] The drive device 1008 is a device for setting the storage medium 1009. The storage medium 1009 here includes media that record information optically, electrically, or magnetically, such as a CD-ROM, a flexible disk, a magneto-optical disk, etc. The storage medium 1009 may also include semiconductor memories that record information electrically, such as an EPROM (Erasable Programmable Read Only Memory), a flash memory, etc.

[0149] The various programs to be installed in the auxiliary storage device 1004 are installed, for example, by setting the distributed storage medium 1009 in the drive device 1008 and reading out the various programs recorded in the storage medium 1009 by the drive device 1008. Alternatively, the various programs to be installed in the auxiliary storage device 1004 may be installed by being downloaded from a network via the I / F device 1007.

[0150] Although the embodiments of the present invention have been described in detail above, the present invention is not limited to the specific embodiments described above, and various modifications and variations are possible within the scope of the gist of the present invention as defined in the claims.

[0151] This international application claims priority based on Japanese Patent Application No. 2020-092470, filed on May 27, 2020, and Japanese Patent Application No. 2020-209513, filed on December 17, 2020, the entire contents of which are hereby incorporated by reference into this international application. [Explanation of symbols]

[0152] 1. Rating System 10 Evaluation equipment 20 Imaging terminal 30 Analysis terminal 101 Acquisition Department 102 Calculation section 103 Evaluation Department 104 Output section 201 Generation part 301 Calculation Department 1001 CPU 1002 ROM 1003 RAM 1004 Auxiliary storage device 1005 Display device 1006 Operating device 1007 I / F device 1008 Drive device 1009 Storage medium

Claims

1. obtaining a gravity bulge amount and a gravity depression amount obtained from a three-dimensional shape change between a horizontal position and a vertical position of a three-dimensional shape face image of a target; calculating at least one of an amount of intra-face movement sagging and an amount of front and rear cheek sagging from the amount of gravitational bulge and the amount of gravitational depression; a step of evaluating the type and degree of sagging using at least one of the amount of intra-face movement sagging and the amount of front-rear cheek sagging as an index; Including, The gravitational expansion amount is a difference between the volume of a portion that is larger in the vertical position than in the horizontal position when the portion is in the horizontal position and the volume of the portion that is in the vertical position, The gravity depression amount is a difference between the volume of a portion that is smaller in the vertical position than in the horizontal position, between the horizontal position and the vertical position, The intra-facial sagging is sagging that hangs down from the upper to lower cheeks, The method for evaluating sagging, wherein the anterior and posterior cheek sagging is sagging other than sagging from the upper part of the cheek to the lower part.

2. The gravity swelling amount is VCswelling, the gravity depression amount is VCshrinking, and the intra-face movement sagging amount is S ｆ , the amount of cheek sagging is S ｃ , the amount of intra-face movement sagging and the amount of front and rear cheek sagging can be calculated by the following formula: [0010] (Wherein, VCshrinking = gravity shrinkage, VCswelling = gravity swelling, S ｆ = Amount of sagging movement within the face, S ｃ The method according to claim 1, wherein θ=the amount of sagging in the front and rear of the cheeks, and θ=π / 4.

3. obtaining a visual score from the vertical facial image of the subject; From the visual score, the following formula: [0025] (Wherein, Sss = visual score, S ｆ = Amount of sagging movement within the face, S ｃ = amount of sagging in front and back of cheeks, Cs = sagging skin coefficient) The method of claim 2 , further comprising the step of calculating a sagging skin coefficient according to:

4. Acquire a sagging skin coefficient based on the skin viscoelasticity of the subject acquired by a viscoelasticity acquisition device; From the sagging skin coefficient, the following formula: [0030] (Wherein, Sss = visual score, S ｆ = Amount of sagging movement within the face, S ｃ = amount of sagging in front and back of cheeks, Cs = sagging skin coefficient) The method of claim 2 , further comprising the step of calculating a visual score according to:

5. The method further includes repeatedly acquiring three-dimensional shape face images of the subject in horizontal and vertical positions; 5. The method according to claim 1, wherein at least one of the amount of gravitational bulge, the amount of gravitational depression, the amount of intra-facial sagging, and the amount of front-back cheek sagging is a representative value of values ​​calculated using the repeatedly acquired three-dimensional facial shape images.

6. The method further includes repeatedly acquiring three-dimensional shape face images of the subject in horizontal and vertical positions; the gravity bulge amount and the gravity depression amount are obtained from a three-dimensional shape change between three-dimensional shape face images for each of the three-dimensional shape face images acquired in the repeated manner; 5. A method according to claim 1, wherein the step of calculating the amount of intra-facial sagging comprises calculating a representative value of the amount of intra-facial sagging calculated from each of the gravitational bulge and gravitational depression amounts as the amount of intra-facial sagging.

7. The method according to claim 5 or 6, further comprising selecting substances or cosmetic treatments that increase or decrease the representative value of the value calculated using the repeatedly acquired three-dimensional shape face images.

8. The method according to claim 5 or 6, further comprising presenting a beauty method for increasing a representative value of the value calculated using the three-dimensional shape face images obtained repeatedly based on a representative value of the value calculated using the three-dimensional shape face images obtained repeatedly.

9. An acquisition unit that acquires a gravity bulge amount and a gravity depression amount obtained from a three-dimensional shape change between a horizontal position and a vertical position of a three-dimensional shape face image of a target; a calculation unit that calculates an amount of intra-face movement sagging and an amount of front and rear cheek sagging from the amount of gravitational bulge and the amount of gravitational depression; an output unit that outputs the amount of intra-face movement sagging and the amount of front and rear cheek sagging; having The gravitational expansion amount is a difference between the volume of a portion that is larger in the vertical position than in the horizontal position when the portion is in the horizontal position and the volume of the portion that is in the vertical position, The gravity depression amount is a difference between the volume of a portion that is smaller in the vertical position than in the horizontal position, between the horizontal position and the vertical position, The intra-facial sagging is sagging that hangs down from the upper to lower cheeks, The anterior and posterior cheek sagging is sagging other than sagging from the upper part of the cheek to the lower part, and this is an apparatus for evaluating the type and degree of sagging.

10. The device for evaluating the type and degree of sagging is Obtaining a gravitational bulge amount and a gravitational dent amount obtained from a three-dimensional shape change between the three-dimensional shape face images of the subject in the horizontal position and the vertical position; Calculating the amount of intra-face movement sagging and the amount of front and rear cheek sagging from the amount of gravitational bulge and the amount of gravitational depression; Outputting the amount of intra-face movement sagging and the amount of front and rear cheek sagging Execute the process, The gravitational expansion amount is a difference between the volume of a portion that is larger in the vertical position than in the horizontal position when the portion is in the horizontal position and the volume of the portion that is in the vertical position, The gravity depression amount is a difference between the volume of a portion that is smaller in the vertical position than in the horizontal position, between the horizontal position and the vertical position, The intra-facial sagging is sagging that hangs down from the upper to lower cheeks, The program, wherein the anterior and posterior cheek sagging is sagging other than sagging that hangs down from the upper to lower parts of the cheek.

11. A system for evaluating a type and a degree of sagging, the system including an imaging terminal, an analysis terminal, and a server, The imaging terminal generates data of a three-dimensional shape face image of a subject in a horizontal position and a vertical position; The analysis terminal calculates a gravitational bulge amount and a gravitational dent amount obtained from a three-dimensional shape change between the three-dimensional shape face images of the subject in the horizontal position and the vertical position from the data, The server, An acquisition unit that acquires the gravity bulge amount and the gravity depression amount; a calculation unit that calculates an amount of intra-face movement sagging and an amount of front and rear cheek sagging from the amount of gravitational bulge and the amount of gravitational depression; an output unit that outputs the amount of intra-face movement sagging and the amount of front and rear cheek sagging; having The gravitational expansion amount is a difference between the volume of a portion that is larger in the vertical position than in the horizontal position when the portion is in the horizontal position and the volume of the portion that is in the vertical position, The gravity depression amount is a difference between the volume of a portion that is smaller in the vertical position than in the horizontal position, between the horizontal position and the vertical position, The intra-facial sagging is sagging that hangs down from the upper to lower cheeks, This is an evaluation system in which the anterior and posterior cheek sagging is sagging other than sagging from the upper to lower parts of the cheek.

12. A step of evaluating three of a visual score of facial sagging, an amount of intra-facial movement sagging of the face, an amount of front-rear cheek sagging of the face, and a sagging skin coefficient of the face; evaluating one other than the three based on the three evaluations; The method of any one of claims 1 to 8, comprising:

13. Obtaining a gravitational bulge amount obtained from a three-dimensional shape change between a horizontal position and a vertical position of a three-dimensional shape face image of a target; obtaining a visual score from a vertical facial image of the subject; The gravity bulge amount and the visual score are calculated using the following formula: [0045] (wherein VCswelling = gravitational swelling, Sss = visual score, Cs = sagging skin coefficient) Calculating the sagging skin coefficient according to the above; a step of evaluating the type and degree of sagging skin using the sagging skin coefficient as an index; Including, The gravitational bulge amount is the difference in volume between the horizontal and vertical positions of a part whose volume is larger in the vertical position than in the horizontal position, in this method for evaluating the type and degree of sagging.

Images