Program, method, impression evaluation apparatus, and impression evaluation system

Abstract

The facial impression of the subject is evaluated based on their skin concerns or skin tone. [Solution] A program according to one embodiment of the present invention causes a computer to perform the following actions: obtain one of the subject's residential area, the subject's age, and the subject's gender; obtain at least one of the subject's skin concerns and the subject's skin color; evaluate the subject's impression based on the residential area, the age, the gender, and at least one of the skin concerns and skin color; and output the result of the evaluation.

Description

Technical Field

[0004] , , , , , , , , ,

[0001] The present invention relates to a program, a method, an impression evaluation device, and an impression evaluation system.

Background Art

[0002] Conventionally, an online impression survey method using computer graphics (CG) images has been established (Non-Patent Document 1). Also, it has been clarified that facial impressions deteriorate due to psychological stress load (Non-Patent Document 2).

Prior Art Documents

Non-Patent Documents

[0003]

Non-Patent Document 1

Non-Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, the influence of the skin problems and stress-induced skin color changes of the subject on the impression of the subject's face is not clear, and furthermore, it may not be clear whether there are differences due to the subject's residential area such as country, age, and gender.

[0005] Therefore, the present invention aims to evaluate the facial impression of a subject based on their skin concerns or skin tone. [Means for solving the problem]

[0006] One embodiment of the present invention is a program that causes a computer to perform the following actions: obtain one of the subject's residential area, age, and gender; obtain at least one of the subject's skin concerns and skin color; evaluate the subject's impression based on the residential area, age, gender, and at least one of the skin concerns and skin color; and output the result of the evaluation. [Effects of the Invention]

[0007] According to the present invention, the facial impression of a subject can be evaluated based on their skin concerns or skin tone. [Brief explanation of the drawing]

[0008] [Figure 1] This figure illustrates the results of a survey on impressions related to one embodiment of the present invention. [Figure 2] This figure illustrates the results of a survey on impressions related to one embodiment of the present invention. [Figure 3] This figure illustrates the results of a survey on impressions related to one embodiment of the present invention. [Figure 4] This figure illustrates the results of a survey on impressions related to one embodiment of the present invention. [Figure 5] This figure illustrates the results of a survey on impressions related to one embodiment of the present invention. [Figure 6] This figure illustrates the results of a survey on impressions related to one embodiment of the present invention. [Figure 7] This figure illustrates the results of a survey on impressions related to one embodiment of the present invention. [Figure 8]It is a diagram for explaining the result of the impression survey according to an embodiment of the present invention. [Figure 9] It is a diagram for explaining the result of the impression survey according to an embodiment of the present invention. [Figure 10] It is an example of the overall configuration according to an embodiment of the present invention. [Figure 11] It is a functional configuration diagram of an impression evaluation device according to an embodiment of the present invention. [Figure 12] It is a flowchart of an impression evaluation process according to an embodiment of the present invention. [Figure 13] It is a hardware configuration diagram of a server device and a client device according to an embodiment of the present invention.

Mode for Carrying Out the Invention

[0009] Hereinafter, embodiments of the present invention will be described based on the drawings.

[0010] <Overview> In the present invention, based on the facial features (specifically, skin problems and skin color) of a face, the impression of the face from others, and the skin problems and skin color of the face of the subject, as well as the residence area, age, and gender of the subject, the impression of the face of the subject is evaluated using the results of an investigation of the relationship.

[0011] <Investigation> The content of the investigation is as follows. Evaluated person: · First, images of average faces (faces having the average values of the facial features of persons of each age and each gender. Composite faces created using face photos collected so that the distribution is uniform based on the distribution of the morphological features of the face) of women in their 20s, women in their 40s, men in their 20s, and men in their 40s living in various countries were created. Images of faces with each skin problem applied to each average face were created. Also, images of faces with each skin color applied to each average face were created. Evaluators: · Men and women of multiple ages living in the same country as the evaluated person evaluated. Evaluation of impression: ·The evaluators evaluated the degree (specifically, five levels: strongly think so, think so, neither think so nor not think so, don't think so, don't think so at all) of each impression (looking tired, trustworthy, confident, charming, looking old, attractive to the opposite sex, looking happy, having a clean feeling, being healthy) from the images of each face of the evaluated person.

[0012] First, the tables in FIGS. 1 to 9 will be described. FIGS. 1 to 3 show the results of the impression survey in Japan, FIGS. 4 to 6 show the results of the impression survey in China, and FIGS. 7 to 9 show the results of the impression survey in Italy.

[0013] FIGS. 1 to 2, FIGS. 4 to 5, and FIGS. 7 to 8 show the results of the survey on whether the impression of the face changes due to the change of skin color. The vertical axis of each table in FIGS. 1 to 2, FIGS. 4 to 5, and FIGS. 7 to 8 indicates the gender and age, which are the attributes of the face image, and the horizontal axis of each table indicates the skin color, which is the attribute of the face image. Each cell in the table shows the result of the impression evaluation when each skin color is applied to people of each gender and each age.

[0014] The "+", "++", and "+++" of the skin color in each table are based on the average value of the skin color obtained in past research. "+" is the average change rate of the skin color within the same day, "++" is the average change rate of the skin color within the same day + standard deviation 1SD, and "+++" is the average change rate of the skin color within the same day + standard deviation 2SD.

[0015] FIGS. 3, FIGS. 6, and FIGS. 9 show the results of the survey on whether the impression of the face changes due to the presence or absence of skin problems (dark circles, pores, shine, acne, sagging, wrinkles). The vertical axis of each table in FIGS. 3, FIGS. 6, and FIGS. 9 indicates the gender and age, which are the attributes of the face image, and the horizontal axis of each table indicates the skin problems, which are the attributes of the face image. Each cell in the table shows the result of the impression evaluation when each skin problem is applied to people of each gender and each age.

[0016] For example, the skin problems are as follows. Dark circles: The state where the skin around the eyes becomes dark Pores: The state where the pores on the cheeks, forehead, nose, and chin are large Shine: There is gloss on the cheeks, forehead, and nose Acne: Red pimples on the cheeks, around the mouth, forehead, and nose. Sagging: A condition where the skin on the cheeks, jawline, and around the mouth droops and becomes loose. Wrinkles: Noticeable wrinkles on the forehead, around the eyes, and around the mouth.

[0017] Referring to Figures 1 to 3, I will explain the results of the survey on impressions in Japan.

[0018] Figures 1 and 2 show the results of evaluations of impressions for each image with different skin tones applied to each subject (a woman in her 20s, a woman in her 40s, a man in his 20s, and a man in his 40s). These images include images with increased redness (a*) and decreased yellowness (b*), images with decreased brightness (L*), and images with increased redness (a*), decreased yellowness (b*), and decreased brightness (L*). Figures 1 and 2 show whether the number of people who selected "strongly agree" or "agree" for a specific face image significantly increased, significantly decreased, or showed no significant difference compared to the number of people who selected "strongly agree" or "agree" for the average face.

[0019] As shown in Figures 1 and 2, it was found that adjusting skin tone changes the proportion of ratings for impressions (looks tired, trustworthy, confident, attractive, looks older, likely to be popular with the opposite sex, looks cheerful, clean, healthy) (i.e., the impression changes).

[0020] Figure 3 shows the results of evaluations of impressions of images with each skin concern applied to each subject (a woman in her 20s, a woman in her 40s, a man in his 20s, and a man in his 40s) (images with dark circles, oiliness, acne, pores, sagging, and wrinkles applied). It shows whether the number of people who selected "strongly agree" or "agree" for a specific face image significantly increased, significantly decreased, or showed no significant difference compared to the number of people who selected "strongly agree" or "agree" for the average face.

[0021] As shown in Figure 3, it was found that skin concerns (dark circles, oiliness, acne, pores, sagging, wrinkles) affect the proportion of ratings for impressions (looks tired, trustworthy, confident, attractive, looks older, likely to be popular with the opposite sex, looks cheerful, clean, healthy) (i.e., the impression changes).

[0022] In Japan, it was found that increased redness in skin tone creates a positive impression (except when redness increases and brightness decreases). Furthermore, among women in their 20s, it was found that oiliness creates a positive impression, rather than making them look tired or older.

[0023] Referring to Figures 4-6, I will explain the results of the impression survey in China.

[0024] Figures 4 and 5 show the results of evaluations of impressions for each image applied to each skin tone of each subject (female in her 20s, female in her 40s, male in his 20s, male in his 40s) (image with increased redness (a*) and decreased yellowness (b*), image with decreased brightness (L*), and image with increased redness (a*), decreased yellowness (b*), and decreased brightness (L*)). They show whether the number of people who selected "strongly agree" and "agree" for a specific face image significantly increased, significantly decreased, or showed no significant difference compared to the number of people who selected "strongly agree" and "agree" for the average face.

[0025] As shown in Figures 4 and 5, it was found that adjusting skin tone changes the proportion of ratings for impressions (looks tired, trustworthy, confident, attractive, looks older, likely to be popular with the opposite sex, looks cheerful, clean, healthy) (i.e., the impression changes).

[0026] Figure 6 shows the results of evaluations of impressions of images with each skin concern applied to each subject (a woman in her 20s, a woman in her 40s, a man in his 20s, and a man in his 40s) (images with dark circles, oiliness, acne, pores, sagging, and wrinkles applied). It shows whether the number of people who selected "strongly agree" or "agree" for a specific face image significantly increased, significantly decreased, or showed no significant difference compared to the number of people who selected "strongly agree" or "agree" for the average face.

[0027] As shown in Figure 6, it was found that skin concerns (dark circles, oiliness, acne, pores, sagging, wrinkles) affect the proportion of ratings for impressions (looks tired, trustworthy, confident, attractive, looks older, likely to be popular with the opposite sex, looks cheerful, clean, healthy) (i.e., the impression changes).

[0028] Referring to Figures 7-9, I will explain the results of the impression survey in Italy.

[0029] Figures 7 and 8 show the results of evaluations of impressions for each image applied to each skin tone of each subject (female in her 20s, female in her 40s, male in his 20s, male in his 40s) (image with increased redness (a*) and decreased yellowness (b*), image with decreased brightness (L*), and image with increased redness (a*), decreased yellowness (b*), and decreased brightness (L*)). They indicate whether the number of people who selected "strongly agree" or "agree" for a specific face image significantly increased, significantly decreased, or showed no significant difference compared to the number of people who selected "strongly agree" or "agree" for the average face.

[0030] As shown in Figures 7 and 8, it was found that adjusting skin tone changes the proportion of ratings for impressions (looks tired, trustworthy, confident, attractive, looks older, likely to be popular with the opposite sex, looks cheerful, clean, healthy) (i.e., the impression changes).

[0031] Figure 9 shows the results of evaluations of impressions of images with each skin concern applied to each subject (a woman in her 20s, a woman in her 40s, a man in his 20s, and a man in his 40s) (images with dark circles, oiliness, acne, pores, sagging, and wrinkles applied). It shows whether the number of people who selected "strongly agree" or "agree" for a specific face image significantly increased, significantly decreased, or showed no significant difference compared to the number of people who selected "strongly agree" or "agree" for the average face.

[0032] As shown in Figure 9, it was found that skin concerns (dark circles, oiliness, acne, pores, sagging, wrinkles) affect the proportion of ratings for impressions (looks tired, trustworthy, confident, attractive, looks older, likely to be popular with the opposite sex, looks cheerful, clean, healthy) (i.e., the impression changes).

[0033] In Italy, it has been found that a reddish complexion in women in their 20s gives a good impression.

[0034] Thus, it was found that the impression a person gives varies depending on the region in which they live. Furthermore, it was found that the impression a person gives also varies depending on the age and gender of the person being evaluated. In particular, it was found that certain skin tones can give a good impression, have no effect (the impression remains unchanged), or give a bad impression. It was also found that certain skin concerns can have a good effect, have no effect (the impression remains unchanged), or give a bad impression.

[0035] Furthermore, it was found that the impression a particular skin concern or skin tone gives differs depending on whether the evaluator and the person being evaluated are the same gender or different, and whether the evaluator is the same age, older, or younger than the person being evaluated.

[0036] Using the results of the impression survey explained with reference to Figures 1 to 10, we can evaluate the facial impression of the subjects based on their facial skin concerns and skin tone, as well as their residential area, age, and gender. Further details are provided below.

[0037] <Example of overall structure> Figure 10 shows an example of the overall configuration according to one embodiment of the present invention.

[0038] [Configuration Example 1] In Configuration Example 1, the client device 10 evaluates the impression of the subject 11. The client device 10 is a personal computer, tablet terminal, smartphone, etc. The client device 10 may also be equipped with imaging means for capturing the face of the subject 11.

[0039] Specifically, the client device 10 acquires the subject 11's residential area, age, gender (one of these), and at least one of the subject 11's skin concerns and skin tone. Based on the subject 11's residential area, age, gender (one of these), and at least one of the subject 11's skin concerns and skin tone, the client device 10 evaluates the subject 11's impression and outputs the evaluation result (for example, displays it on the client device 10).

[0040] For example, the client device 10 acquires one of the following: the subject's residential area, age, or gender, which is entered into the client device 10 by the subject 11 or a beauty consultant. The client device 10 also acquires at least one of the subject 11's skin concerns and skin tone, which is entered into the client device 10 by the subject 11 or a beauty consultant. Alternatively, the client device 10 takes a picture of the subject 11's face and determines at least one of the subject 11's skin concerns and skin tone based on the captured image. The client device 10 displays the results of the evaluation of the subject 11's impression, etc.

[0041] [Configuration Example 2] The impression evaluation system 1 includes a client device 10 and a server device 20. In configuration example 2, the server device 20 evaluates the impression of the subject 11. Each of these will be explained below.

[0042] <<Server device>> The server device 20 is a device for evaluating the impressions of the subjects 11. The server device 20 consists of one or more computers.

[0043] Specifically, the server device 20 receives from the client device 10 the subject's residential area, age, gender (one of these), skin concerns and skin tone, or an image of the subject 11. Based on the subject's residential area, age, gender, and skin concerns and skin tone, the server device 20 evaluates the subject's impression. The server device 20 then transmits the results of the evaluation of the subject's impression to the client device 10.

[0044] <<Client device>> The client device 10 is a device operated by the subject 11 or a beauty consultant, etc. The client device 10 is a personal computer, tablet terminal, smartphone, etc. The client device 10 may be equipped with imaging means for photographing the face of the subject 11. The client device 10 may also perform some of the processing of the server device 20 as described herein.

[0045] For example, the client device 10 transmits to the server device 20 one of the following: the subject's residential area, age, or gender, which the subject 11 or a beauty consultant has entered into the client device 10. The client device 10 also transmits to the server device 20 at least one of the subject 11's skin concerns or skin tone, which the subject 11 or a beauty consultant has entered into the client device 10. Alternatively, the client device 10 takes a picture of the subject 11's face and transmits the captured image to the server device 20. The client device 10 receives and displays the results of the evaluation of the subject 11's impression from the server device 20.

[0046] <Functional Configuration> Figure 11 is a functional configuration diagram of impression evaluation devices 10 and 20 according to one embodiment of the present invention.

[0047] The impression evaluation devices 10 and 20 may include a skin concern / skin tone specification unit 101, an image judgment unit 102, an acquisition unit 103, an impression evaluation unit 104, an evaluation result output unit 105, and a beauty information recommendation unit 106. By executing a program, the impression evaluation devices 10 and 20 can function as the skin concern / skin tone specification unit 101, the image judgment unit 102, the acquisition unit 103, the impression evaluation unit 104, the evaluation result output unit 105, and the beauty information recommendation unit 106.

[0048] First, let's discuss skin concerns and skin tone.

[0049] [Skin concerns] Skin problems refer to conditions that are not good for the skin. For example, skin problems include at least one of the following: dark circles, oiliness, acne, enlarged pores, sagging, and wrinkles.

[0050] [Skin tone] Skin tone refers to the color of the skin that changes within an individual due to various factors such as stress. For example, skin tone can be represented by hue, lightness, and saturation. For instance, skin tone can be represented by the L, a, and b values ​​in the Lab color space (for example, the L*, a*, and b* values ​​in the L*a*b* color space).

[0051] The skin concern / skin tone specification unit 101 obtains at least one of the skin concerns of the subject 11 (or the beauty consultant at the store, etc.) and the skin tone of the subject 11, which are specified by the subject 11 (i.e., entered into the client device 10).

[0052] For example, subject 11 may specify skin tone by inputting hue, lightness, and saturation values; or by inputting L, a, and b values ​​in the Lab color space (for example, L*, a*, and b* values ​​in the L*a*b* color space); or by selecting a desired color patch from among multiple color patches. For example, L*, a*, and b* values ​​estimated from the RGB(HSB) of an image taken of subject 11 may be used.

[0053] The image determination unit 102 determines at least one of the subject 11's skin concerns and the subject 11's skin color based on the image of the subject 11. Specifically, the image determination unit 102 acquires an image of the subject 11's face, performs image processing on the image, and determines at least one of the subject 11's skin concerns and the subject 11's skin color.

[0054] [Skin concerns and skin tone information] The acquisition unit 103 acquires at least one of the subject 11's skin concerns and the subject 11's skin color. Specifically, the acquisition unit 103 acquires the skin concerns and skin color acquired by the skin concerns / skin color specification unit 101, or the skin concerns and skin color determined by the image judgment unit 102.

[0055] [Acquisition of residential area, age, and gender] The acquisition unit 103 acquires one of the following: the residential area (e.g., country) of the subject 11, the age of the subject 11, or the gender of the subject 11. Specifically, the acquisition unit 103 acquires the residential area of ​​the subject 11, the age of the subject 11, and the gender of the subject 11, which were specified by the subject 11 (or the beauty consultant at the store, etc.) (i.e., entered into the client device 10).

[0056] In this specification, the case in which one of the following is used: the residential area of ​​the subject 11, the age of the subject 11, or the gender of the subject 11, is mainly described. However, the present invention can also be applied to cases in which two or all three of the following are used: the residential area of ​​the subject 11, the age of the subject 11, or the gender of the subject 11.

[0057] The impression evaluation unit 104 evaluates the impression of the subject 11 based on one of the following: the subject 11's residential area, the subject 11's age, or the subject 11's gender, and at least one of the subject 11's skin concerns or the subject 11's skin color. The method of impression evaluation will be described in detail later.

[0058] [impression] An impression is the impression others have of the subject. For example, an impression may include at least one of the following: looks tired, trustworthy, confident, attractive, looks older than one's age, seems popular with the opposite sex, seems fun, clean, or healthy.

[0059] The evaluation result output unit 105 outputs the evaluation results from the impression evaluation unit 104 (for example, displayed on the client device 10).

[0060] The beauty information recommendation unit 106 recommends beauty information (for example, displayed on the client device 10) in accordance with the evaluation results from the impression evaluation unit 104. For example, beauty information includes information on cosmetics, food and beverages, beauty devices, beauty methods, etc., to improve or maintain the impression of the subject 11. A correspondence between the impression and the beauty information (beauty information to improve or maintain the impression) is predetermined, and the beauty information recommendation unit 106 can recommend beauty information by referring to this correspondence.

[0061] Here, we will explain the method for evaluating impressions. The impression evaluation unit 104 can pre-create (based on survey results) a correspondence between "the person being evaluated's age, gender, skin concerns (e.g., presence and degree of skin concerns), and skin color" and "the impression others have of the person being evaluated" for each residential area (e.g., country), and can evaluate by referring to this correspondence. Furthermore, the impression evaluation unit 104 may create this correspondence for cases where the person being evaluated and the evaluator are of the same gender, where the person being evaluated and the evaluator are of different genders, where the evaluator is the same age as the person being evaluated, where the evaluator is older than the person being evaluated, and where the evaluator is younger than the person being evaluated.

[0062] [Current Impression] For example, the impression evaluation unit 104 can evaluate the impression others have of the subject 11 (i.e., the impression based on the subject 11's current skin concerns, skin color, residential area, age, and gender) using at least one of the subject 11's skin concerns and skin color at a first time (e.g., the present).

[0063] [Current impression (impression from a specific person)] For example, the impression evaluation unit 104 can use at least one of the subject 11's skin concerns and the subject 11's skin color at a first time (for example, the present) to evaluate the impression of the subject from a specific person (for example, someone of the same age, older, younger, same sex, opposite sex, etc.) (i.e., the impression according to the subject 11's current skin concerns, skin color, residential area, age, and gender). The subject 11 may also specify the age (same age, older, younger) and gender (same sex, opposite sex) of a specific person (i.e., the evaluator).

[0064] [Impression when skin problems disappear] For example, in one embodiment of the present invention, it is possible to know what kind of impression a subject 11 would make if their skin problems disappeared (improved) at a first time (for example, the present). The impression evaluation unit 104 can evaluate the impression others have of subject 11 when their skin problems disappear (that is, the difference between the evaluation when they have skin problems and when they do not. For example, the impression may increase by 10 percent, or decrease by 10 percent). In this way, it is possible to know the difference in facial impression depending on whether or not they have skin problems.

[0065] [Impression when skin problems disappear (impression from specific individuals)] For example, in one embodiment of the present invention, if the skin problems of subject 11 at a first time (for example, the present) disappear (improve), it is possible to know what kind of impression the subject will have on specific people (for example, people of the same age, older people, younger people, same sex, opposite sex, etc.). The impression evaluation unit 104 evaluates the impression of subject 11 from the evaluator when the subject 11's skin problems disappear, according to at least one of the difference between the subject 11's age and the evaluator's age, and the difference between the subject 11's gender and the evaluator's gender (i.e., the difference between the evaluation when the subject 11 has skin problems and when they do not. For example, the evaluation from the opposite sex of the same age increases by 10 percent, and the evaluation from older people of the same sex decreases by 10 percent). Subject 11, etc., may also specify the age (same age, older, younger) and gender (same sex, opposite sex) of specific people (i.e., evaluators). In this way, it is possible to know the difference in facial impressions from specific people depending on whether or not the subject has skin problems.

[0066] [The impression when skin tone changes] For example, in one embodiment of the present invention, it is possible to know what kind of impression a subject 11 will give if their skin color changes (improves) at a first time (for example, the present). The impression evaluation unit 104 can evaluate the impression that others have of subject 11 when their skin color changes (that is, the difference in evaluation before and after the change in skin color; for example, the impression improves by 10 percent, or the impression deteriorates by 10 percent). In this way, it is possible to know the difference in facial impression due to a change in skin color.

[0067] [Impression when skin tone changes (impression from a specific person)] For example, in one embodiment of the present invention, if the skin color of subject 11 changes (improves) at a first time (for example, the present), it is possible to know what kind of impression will be made by specific people (for example, people of the same age, older people, younger people, same sex, opposite sex, etc.). The impression evaluation unit 104 evaluates the impression of subject 11 from evaluators when the skin color of subject 11 changes, according to at least one of the difference between the age of subject 11 and the age of the evaluator who has the impression, and the difference between the gender of subject 11 and the gender of the evaluator who has the impression (i.e., the difference in evaluation before and after the change in skin color. For example, the evaluation from the opposite sex of the same age increases by 10 percent, and the evaluation from older people of the same sex decreases by 10 percent). Subject 11, etc., may also specify the age (same age, older, younger) and gender (same sex, opposite sex) of specific people (i.e., evaluators). In this way, it is possible to know the difference in facial impression from specific people due to a change in skin color.

[0068] [Changes in appearance due to changes in skin concerns over time] For example, in one embodiment of the present invention, it is possible to know how the impression of a subject 11 has changed due to changes in their skin concerns from the past to the present. The acquisition unit 103 acquires the changes in the subject 11's skin concerns over time (i.e., data from multiple points in time, for example, changes within a few hours, changes in a day, changes in a year, etc.), and the impression evaluation unit 104 can evaluate the changes in the impression over time based on the changes in the subject 11's skin concerns (i.e., changes from past evaluations to current evaluations, for example, the impression improves by 10 percent, or the impression deteriorates by 10 percent). In this way, it is possible to know the changes in the impression of the face over time due to changes in skin concerns.

[0069] [Changes in impression due to changes in skin concerns over time (impression from specific individuals)] For example, in one embodiment of the present invention, it is possible to know how the impression given to a subject 11 by a specific person (e.g., same age, older, younger, same sex, opposite sex, etc.) has changed due to changes in the subject 11's skin concerns from the past to the present. The acquisition unit 103 acquires the subject 11's skin concerns over time (i.e., data from multiple points in time, e.g., changes within a few hours, changes in a day, changes in a year, etc.), and the impression evaluation unit 104 evaluates the change in impression over time based on the change in the subject 11's skin concerns, according to at least one of the difference between the subject 11's age and the age of the evaluator who has the impression, and the difference between the subject 11's gender and the gender of the evaluator who has the impression (i.e., a change from past evaluation to current evaluation, e.g., an evaluation from the opposite sex of the same age increases by 10 percent, and an evaluation from an older person of the same sex decreases by 10 percent). The subject 11, etc., may specify the age (same age, older, younger) and gender (same sex, opposite sex) of a specific person (i.e., evaluator). In this way, it is possible to understand how the impression of a particular person's face changes over time due to changes in skin concerns.

[0070] [Changes in appearance due to changes in skin tone over time] For example, in one embodiment of the present invention, it is possible to know how the impression of a subject 11 has changed due to changes in their skin color from the past to the present. The acquisition unit 103 acquires the subject 11's skin color over time (i.e., data from multiple points in time, for example, changes within a few hours, changes in a day, changes in a year, etc.), and the impression evaluation unit 104 can evaluate the change in impression over time based on the subject 11's skin color over time (i.e., a change from past evaluation to current evaluation, for example, an impression that has improved by 10 percent, or an impression that has deteriorated by 10 percent). In this way, it is possible to know the change in facial impression over time due to changes in skin color over time.

[0071] [Changes in impression due to changes in skin tone over time (impression from a specific person)] For example, in one embodiment of the present invention, it is possible to know how the impression given to a subject 11 by a specific person (e.g., same age, older, younger, same sex, opposite sex, etc.) has changed based on the change in the subject 11's skin color from the past to the present. The acquisition unit 103 acquires the subject 11's skin color change over time (i.e., data from multiple time points, e.g., changes within a few hours, changes in a day, changes in a year, etc.), and the impression evaluation unit 104 evaluates the change in impression over time based on the change in the subject 11's skin color, according to at least one of the difference between the subject 11's age and the age of the evaluator who has the impression, and the difference between the subject 11's gender and the gender of the evaluator who has the impression (i.e., a change from past evaluation to current evaluation, e.g., an evaluation from the opposite sex of the same age increases by 10 percent, and an evaluation from an older person of the same sex decreases by 10 percent). The subject 11, etc., may specify the age (same age, older, younger) and gender (same sex, opposite sex) of a specific person (i.e., evaluator). In this way, it is possible to understand how the impression of a particular person's face changes over time based on changes in skin color.

[0072] [Stress Assessment] In one embodiment of the present invention, along with the evaluation of stress, the change in impression due to the change in skin color caused by that stress may also be evaluated.

[0073] <Method> Figure 12 is a flowchart of the impression evaluation process according to one embodiment of the present invention.

[0074] In step 1 (S1), the acquisition unit 103 acquires one of the following (or two or all three): the residential area of ​​the subject 11, the age of the subject 11, or the gender of the subject 11. For example, the acquisition unit 103 acquires one of the following input to the client device 10: the residential area of ​​the subject 11, the age of the subject 11, or the gender of the subject 11.

[0075] In step 2 (S2), the acquisition unit 103 acquires at least one of the subject 11's skin concerns and the subject 11's skin color. The subject 11's skin concerns and skin color may be specified by the subject 11, or they may be determined based on images taken of the subject 11.

[0076] Note that the order of S1 and S2 can be reversed, or they can be executed simultaneously.

[0077] In step 3 (S3), the impression evaluation unit 104 evaluates the impression of subject 11 based on one of the subject 11's residential area, subject 11's age, or subject 11's gender, and at least one of the subject 11's skin concerns or subject 11's skin color, which were obtained in S2.

[0078] In step 4 (S4), the evaluation result output unit 105 outputs the results of the evaluation of the subject 11's impression in S4 (for example, displayed on the client device 10).

[0079] In step 5 (S5), the beauty information recommendation unit 106 recommends beauty information such as cosmetics (for example, displayed on the client device 10) in accordance with the results of the impression evaluation of the subject 11 in S4.

[0080] <Hardware Configuration> Figure 13 is a hardware configuration diagram of a client device 10 and a server device 20 according to one embodiment of the present invention. The client device 10 and the server device 20 may include a control unit 1001, a main memory unit 1002, an auxiliary memory unit 1003, an input unit 1004, an output unit 1005, and an interface unit 1006. Each of these will be described below.

[0081] The control unit 1001 is a processor (for example, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), etc.) that executes various programs installed in the auxiliary storage unit 1003.

[0082] The main memory unit 1002 includes non-volatile memory (ROM (Read Only Memory)) and volatile memory (RAM (Random Access Memory)). The ROM stores various programs, data, etc., necessary for the control unit 1001 to execute various programs installed in the auxiliary memory unit 1003. The RAM provides a work area that is expanded when the various programs installed in the auxiliary memory unit 1003 are executed by the control unit 1001.

[0083] The auxiliary storage unit 1003 is an auxiliary storage device that stores various programs and information used when various programs are executed.

[0084] The input unit 1004 is an input device that allows operators of the client device 10 and the server device 20 to input various instructions to the client device 10 and the server device 20.

[0085] The output unit 1005 is an output device that outputs the internal status of the client device 10 and the server device 20.

[0086] The interface unit 1006 is a communication device for connecting to a network and communicating with other devices.

[0087] Although embodiments of the present invention have been described in detail above, the present invention is not limited to the specific embodiments described above, and various modifications and changes are possible within the scope of the gist of the present invention as described in the claims. [Explanation of Symbols]

[0088] 1. Impression Evaluation System 10 Client devices 20 Server Devices 11 Target Persons 101 Skin Concerns / Skin Tone Specification Section 102 Image determination unit 103 Acquisition Department 104 Impression Evaluation Department 105 Evaluation Result Output Unit 106 Beauty Information Recommendation Section 1001 Control Unit 1002 Main memory 1003 Auxiliary storage unit 1004 Input section 1005 Output section 1006 Interface section

Claims

1. to the computer To obtain one of the following: the subject's residential area, the subject's age, or the subject's gender. To obtain at least one of the subject's skin concerns and the subject's skin color, Evaluating the impression of the subject based on the residential area, age, gender (any one of these), skin concerns, and skin color, Output the results of the aforementioned evaluation. A program that executes the command.

2. The program according to claim 1, wherein evaluating the impression of the subject is equivalent to evaluating the impression of the subject from others.

3. The program according to claim 1, wherein evaluating the impression of the subject means evaluating the impression of the subject from others when the subject's skin problems disappear, or evaluating the impression of the subject from others when the subject's skin color changes.

4. The program according to claim 1, wherein obtaining at least one of the skin concerns and the skin color is equivalent to obtaining the change over time of at least one of the skin concerns and the skin color.

5. The program according to claim 4, wherein evaluating the impression of the subject means evaluating the change in the impression of the subject over time.

6. The program according to claim 1, wherein the impression of the subject is evaluated according to at least one of the difference between the age of the subject and the age of the evaluator who holds the impression, and the difference between the gender of the subject and the gender of the evaluator who holds the impression.

7. The program according to claim 1, wherein the aforementioned impression includes at least one of: looking tired, trustworthy, confident, attractive, looking older than one's age, likely to be popular with the opposite sex, looking cheerful, clean, and healthy.

8. The program according to claim 1, wherein the skin concerns include at least one of dark circles, oiliness, acne, pores, sagging, and wrinkles.

9. The program according to claim 1, wherein the skin concerns and skin color are specified by the computer operator or determined based on an image taken of the subject.

10. The program according to claim 1, further comprising recommending beauty information in accordance with the results of the aforementioned evaluation.

11. A method by which a computer performs an action. To obtain one of the following: the subject's residential area, the subject's age, or the subject's gender. To obtain at least one of the subject's skin concerns and the subject's skin color, Evaluating the impression of the subject based on the residential area, age, gender (any one of these), skin concerns, and skin color, Output the results of the aforementioned evaluation. A method that includes this.

12. Obtain one of the following: the subject's residential area, the subject's age, or the subject's gender. An acquisition unit that acquires at least one of the subject's skin concerns and the subject's skin color, An impression evaluation unit that evaluates the impression of the subject based on the residential area, age, gender (any one of these), skin concerns, and skin color, An evaluation result output unit that outputs the results of the evaluation, An impression evaluation device equipped with [specific features / equipment].

13. An impression evaluation system including a server device and a client device, The server device is Obtain one of the following: the subject's residential area, the subject's age, or the subject's gender. An acquisition unit that acquires at least one of the subject's skin concerns and the subject's skin color, An impression evaluation unit that evaluates the impression of the subject based on the residential area, age, gender (any one of these), skin concerns, and skin color, An evaluation result output unit that outputs the results of the evaluation, Equipped with, The aforementioned client device The following are transmitted to the server device: the residential area, the age, the gender, at least one of the skin concerns and skin color, or an image of the subject. An impression evaluation system that receives and displays the results of the aforementioned evaluation from the server device.

Images