Information processing device and program

Abstract

The present invention provides an information processing device and program that can obtain an evaluation of a subject using either the subject's facial condition and / or skin condition and / or impression, along with the subject's age information. [Solution] Server 1 comprises a user information receiving unit 11 that acquires the age information of the subject and status information relating to the condition of the subject's face and / or skin condition; an impression information storage unit 22 that stores evaluations of impression items associated with the status information in the age information; an impression extraction unit 12 that extracts impression items and evaluations by referring to the impression information storage unit 22 based on the age information and status information acquired by the user information receiving unit 11; and an impression output unit 13 that outputs the impression items and evaluations extracted by the impression extraction unit 12.

Description

Technical Field

[0004] , , , ,

[0005] , , , , ,

[0003] , , ,

[0001] The present invention relates to an information processing apparatus and a program.

Background Art

[0002] Conventionally, there has been a method of analyzing a person's impression and outputting a result. For example, an impression analysis system for evaluating each impression item from a face image, which is described for application to the cosmetics industry, has been disclosed (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] What is described in Patent Document 1 is to extract a feature part from a face image, generate an evaluation criterion by referring to the evaluation information of an impression evaluator for the face image, and create an impression analysis result based on the face image of the evaluation target person according to the generated evaluation criterion. This time, the applicants investigated the impressions of various ages and face conditions and / or skin conditions, and found that the impressions differ depending on the age, face condition and / or skin condition of the target person. That is, it was found that even with the same face condition and / or skin condition, depending on the age, there is a tendency to give a positive impression rather than a negative impression. However, what is described in Patent Document 1 does not use the age, face condition and / or skin condition of the target person.

[0005] An object of the present invention is to provide an information processing apparatus and a program capable of obtaining an evaluation regarding a target person by using either one of the face condition and / or skin condition of the target person and the impression, and the age information of the target person.

Means for Solving the Problems

[0006] An information processing apparatus according to one aspect of the present invention comprises: a subject information acquisition means for acquiring age information of a subject and state information relating to the state of the subject's face and / or skin; an impression information storage unit for storing evaluations of impression items associated with the state information in the age information; an impression extraction means for extracting the impression items and evaluations by referring to the impression information storage unit based on the age information and state information acquired by the subject information acquisition means; and an impression output means for outputting the impression items and evaluations extracted by the impression extraction means.

[0007] Furthermore, an information processing device according to one aspect of the present invention includes: a subject information acquisition means for acquiring age information of a subject and state information relating to the state of the subject's face and / or skin; an impression item acquisition means for acquiring impression items desired by the subject; a proposal information storage unit for storing proposal information of a beauty method corresponding to one or more of the impression items, state information, and age information; a proposal extraction means for extracting the proposal information by referring to the proposal information storage unit based on the age information and state information acquired by the subject information acquisition means and the impression items acquired by the impression item acquisition means; and a proposal output means for outputting the proposal information extracted by the proposal extraction means.

[0008] Furthermore, an information processing device according to one aspect of the present invention includes: an information acquisition means for acquiring age information of a subject and impression items desired by the subject; an impression information storage unit for storing evaluations of the impression items associated with the facial and / or skin condition in the age information; a state extraction means for extracting the state information and the evaluations by referring to the impression information storage unit based on the age information and impression items acquired by the information acquisition means; and a state output means for outputting the state information and the evaluations extracted by the state extraction means. [Effects of the Invention]

[0009] According to the present invention, it is possible to provide an information processing device and program that can obtain an evaluation of a subject using either the facial condition and / or skin condition and impression of the subject, and the subject's age information. [Brief explanation of the drawing]

[0010] [Figure 1] This is an overall configuration diagram of the information processing system according to the first embodiment. [Figure 2] This is a functional block diagram of the server and terminal according to the first embodiment. [Figure 3] This figure shows an example of a storage unit of a server according to the first embodiment. [Figure 4] This is a flowchart showing the facial impression processing of the information processing system according to the first embodiment. [Figure 5] This is a continuation of Figure 4. [Figure 6] This figure shows an example of the display on a terminal according to the first embodiment. [Figure 7] This figure shows an example of the display on a terminal according to the first embodiment. [Figure 8] This is a diagram illustrating an example of processing by a server according to the first embodiment. [Figure 9] This figure shows another display example on the terminal according to the first embodiment. [Figure 10] This diagram shows the overall configuration of the information processing system and the functional block diagram of the server according to the second embodiment. [Figure 11] This is a flowchart showing the facial impression processing of the information processing system according to the second embodiment. [Figure 12] This is a continuation of Figure 11. [Figure 13] This figure shows an example of the display on a terminal according to the second embodiment. [Figure 14] This figure shows an example of how the transformed form is displayed on a terminal. [Modes for carrying out the invention]

[0011] Hereinafter, embodiments for implementing the present invention will be described with reference to the drawings. Note that this is merely an example, and the technical scope of the present invention is not limited thereto. (First Embodiment) [Overall Configuration of Information Processing System 100] FIG. 1 is an overall configuration diagram of an information processing system 100 according to the first embodiment. The information processing system 100 shown in FIG. 1 is a system that provides a user (target person) with an impression of skin problems according to the user's age by inputting the user's age (age information) and skin problems (status information) using the terminal 3. Further, the information processing system 100 is a system that provides the user with a proposal for makeup that approaches the desired impression by inputting the impression the user wants to create (impression items desired by the target person) using the terminal 3.

[0012] The information processing system 100 includes a server 1 (information processing device) and a terminal 3. The server 1 and the terminal 3 can perform data communication via a data communication network N. In FIG. 1, a smartphone 3a, a notebook PC (personal computer) 3b, and a tablet 3c are illustrated as the terminal 3. These are merely examples, and in reality, a plurality of types of a plurality of terminals 3 are communicably connected to the server 1.

[0013] [Server 1] FIG. 2 is a functional block diagram of the server 1 and the terminal 3 according to the first embodiment. FIG. 3 is a diagram showing an example of the storage unit 20 of the server 1 according to the first embodiment. As shown in FIG. 2(A), the server 1 includes a control unit 10, a storage unit 20, and a data communication IF (interface) 29. The control unit 10 is a CPU (central processing unit) that controls the entire server 1. The control unit 10 appropriately reads and executes the OS (operating system) and application programs stored in the storage unit 20, and cooperates with the above-described hardware to execute various functions. Before explaining the control unit 10, let's explain the storage unit 20.

[0014] The storage unit 20 is a storage area such as a hard disk or semiconductor memory element for storing programs, data, etc., necessary for the control unit 10 to perform various processes. The memory unit 20 stores the program memory unit 21, the impression information memory unit 22, and the proposal information memory unit 23. The program storage unit 21 is a storage area that stores various programs, including application programs for executing various functions performed by the control unit 10, which will be described later.

[0015] The impression information storage unit 22 is a memory area that stores evaluations of impression items associated with skin concerns at different ages. The evaluation of impression items stored in the impression information storage unit 22 is based, for example, on the results of a study investigating the impact of age-specific skin concerns on impressions. The survey results revealed that, for example, age-related skin concerns include not only negative but also positive ones. Furthermore, it was found that whether a concern is positive or negative differs depending on the age group being evaluated. For example, among those in their 60s, "nasolabial folds" and "crow's feet" tended to receive positive evaluations not only in the negative category but also in the "trustworthiness" impression category. Also, among those in their 40s and 50s, "crow's feet" tended to receive positive evaluations in the "trustworthiness" impression category. In addition, regarding "hollows above the eyes," those in their 40s and 50s tended to receive positive evaluations in the "trustworthiness" impression category, while those in their 60s tended to receive negative evaluations. The impression information storage unit 22 stores information based on the survey results described above.

[0016] Figure 3(A) shows an example of the impression information storage unit 22. The impression information storage unit 22 shown in Figure 3(A) lists some skin concerns of people in their 50s and displays evaluations of impression items associated with these skin concerns. Here, skin concerns include information about skin morphology and / or color and texture on the face. Skin morphology includes, for example, skin conditions such as "sagging under the eyes (three-dimensional dark circles / sagging dark circles)," "nasolabial folds," "marionette lines," "crow's feet," "hollows above the eyes," "drooping corners of the mouth," "pores," "unevenness from acne scars," and "facial sagging." Skin morphology may also include the size of the volume that constitutes the skin condition. The color and texture of the face include conditions such as "blemishes," "dullness," "dark circles," "redness," "uneven skin tone," "dullness of the whites of the eyes," "redness of the whites of the eyes," "freckles," and "acne scar color." Here, "dullness of the whites of the eyes" refers to the whites of the eyes becoming yellowish or brownish. Also, "acne scar color" includes red and brown scars. Furthermore, the color and texture of the face may also include the size of the area that constitutes the condition of the face and / or skin condition.

[0017] Furthermore, impression items include, for example, "trustworthiness," "cleanliness," "attractiveness," "activeness," "youthfulness," "tired appearance," and "three-dimensionality." Here, "three-dimensionality" refers to the overall impression obtained from the depth, bone structure, and fullness of the face, as well as the jawline and cheek fullness. Evaluations of impression items may include, for example, positive and negative ratings, and may also include variations in intensity to indicate the magnitude of these ratings. A negative impression indicates a deterioration in perception or a decline in evaluation, while a positive impression indicates an improvement in perception or an increase in evaluation.

[0018] For example, in impression categories such as "trustworthiness" and "cleanliness," "strongly negative" indicates a state where trustworthiness or cleanliness appears significantly low, while "strongly positive" indicates a state where trustworthiness or cleanliness appears significantly high. Furthermore, for example, in the impression category "Attractive," "Strongly Negative" indicates a state where the attractive impression appears significantly worse, while "Slightly Negative" indicates a state where the attractive impression appears slightly worse. Furthermore, for example, "strong negative" in the impression category "active" means that the person does not appear remarkably active (does not appear lively), "strong negative" in the impression category "youthful" means that the person does not appear remarkably youthful, "strong negative" in the impression category "tired-looking" means that the person looks remarkably tired, and "strong negative" in the impression category "three-dimensionality" means that the person does not perceive three-dimensionality at all.

[0019] As an example of the impression information storage unit 22 shown in Figure 3(A), for instance, in the case of "blemishes," which are a skin concern for people in their 50s, if the area is large and / or the color is dark, it gives a strong negative impression in all impression items. Furthermore, for example, regarding "nasolabial folds," a common skin concern for people in their 50s, the study shows that when these folds are large, they give a weakly negative impression in all impression categories except "trustworthiness" and "cleanliness," while giving a strong positive impression in "trustworthiness" and "cleanliness." In the example in Figure 3(A), a separate table is used for each age group, with the 50s being used as an example, but this is not the only way. For example, tables could be set for each age group from the teens to the 70s. Alternatively, a single table could include multiple age groups, and the method of storing data is not limited to what is shown in Figure 3(A).

[0020] The suggestion information storage unit 23 is a memory area that stores suggestion information for beauty methods corresponding to impression items, skin concerns, and age. The information stored in the proposed information storage unit 23 is based, for example, on the results of a survey that investigated whether combining skin concerns and beauty methods for each age group resulted in a positive impression. The survey results showed that it is possible to change negative perceptions into positive ones through beauty methods. Furthermore, even if skin problems are not completely concealed by makeup, simply applying natural makeup such as blush and highlighter tends to improve one's appearance. Natural makeup includes adding color and radiance, and beauty methods include not only makeup but also skincare and massages to improve blood circulation. In other words, the term "beauty methods" here is a concept that encompasses makeup, skincare, and massage. The proposed information storage unit 23 stores information based on the survey results described above.

[0021] Figure 3(B) shows an example of the proposed information storage unit 23. The suggestion information storage unit 23 shown in Figure 3(B) is an example of a suggestion for beauty methods to enhance an active impression, and it shows suggestions for beauty methods that correspond to skin concerns and age. In the suggestion information storage unit 23 shown in Figure 3(B), possible makeup suggestions are indicated with a "○" as an example of a beauty method. For example, if a woman in her 50s has skin concerns such as "blemishes" that are large in area and dark in color, it is indicated that "blush," "under-eye & cheek highlighter," and "five-point highlighter" can be suggested to enhance an active impression. Furthermore, for example, if a woman in her 50s has a skin concern such as "spots" that are small in area and light in color, it is possible to suggest makeup that covers them with "foundation," and uses "blush" and "five-point highlighting" to enhance her active appearance. Furthermore, "high coverage" may be interpreted as corresponding to the "thorough coverage" makeup method described later, and "natural coverage" may be interpreted as corresponding to the "natural" makeup method.

[0022] In the example in Figure 3(B), a table is used for each desired impression item, with "active" being an example, but it is not limited to this. For example, there may be tables for various impression items such as "trustworthy" and "clean." Furthermore, impression items may be included in a single table, or tables may be created for each impression item and age group, or tables may be created for each impression item and skin concern. The method of storing data is not limited to what is shown in Figure 3(B). Furthermore, while suggested makeup looks are indicated with a "○", if multiple makeup looks are possible, information regarding their relative merits may be included. Similarly, if multiple makeup looks are applied simultaneously to create a synergistic effect, this may be indicated.

[0023] Next, the control unit 10 of server 1 will be described. The control unit 10 includes a user information receiving unit 11, an impression extraction unit 12, an impression output unit 13, an impression item receiving unit 14, a makeup method receiving unit 15, a beauty suggestion extraction unit 16, and a beauty suggestion output unit 17.

[0024] The user information receiving unit 11 functions as a means for acquiring target information. The user information receiving unit 11 receives information about the user, such as the user's age (age information) and skin concerns (condition information) related to the user's facial skin condition, from, for example, terminal 3. The user information receiving unit 11 may accept the user's actual age or apparent age instead of the user's age. The user information receiving unit 11 may also accept the facial condition and / or skin condition instead of skin concerns related to the facial skin condition. The facial condition and / or skin condition may not be something the user is concerned about, but may be a characteristic of the user's face and / or skin. The impression extraction unit 12 functions as an impression extraction means. Based on the age and skin concerns received by the user information receiving unit 11, the impression extraction unit 12 refers to the impression information storage unit 22 to extract impression items and evaluations. The impression output unit 13 functions as an impression output means. The impression output unit 13 outputs the impression items and evaluations extracted by the impression extraction unit 12 to, for example, the terminal 3.

[0025] The impression item receiving unit 14 functions as a means for acquiring impression items. The impression item receiving unit 14 receives impression items related to the impression the user wants to make, for example from the terminal 3. The makeup method reception unit 15 functions as a means of acquiring makeup information. The makeup method reception unit 15 receives information about the makeup method desired by the user, for example, from terminal 3. The information about the makeup method desired by the user is information about preferences regarding makeup, such as wanting full coverage or preferring a natural look. The beauty suggestion extraction unit 16 functions as a suggestion extraction means. Based on the age and skin concerns acquired by the user information reception unit 11 and the impression items received by the impression item reception unit 14, the beauty suggestion extraction unit 16 extracts suggestion information for beauty methods by referring to the suggestion information storage unit 23. The beauty suggestion output unit 17 functions as a suggestion output means. The beauty suggestion output unit 17 outputs the beauty method suggestion information extracted by the beauty suggestion extraction unit 16 to, for example, the terminal 3. The beauty suggestion output unit 17 may also output the suggestion information for at least one beauty method if there are multiple beauty method suggestion pieces extracted by the beauty suggestion extraction unit 16.

[0026] In the above description, the user information receiving unit 11, the impression item receiving unit 14, and the makeup method receiving unit 15 were described as functional units that receive information from terminal 3, but the system is not limited to these, and the receiving unit may be a single functional unit. Similarly, the impression output unit 13 and the beauty suggestion output unit 17 were described as functional units that output information to terminal 3, but the system is not limited to these, and the output unit may be a single functional unit.

[0027] Data communication IF29 ​​is the interface with the data communication network N. Furthermore, a computer refers to an information processing device equipped with a control unit, memory device, etc., and Server 1 is an information processing device equipped with a control unit 10, a memory unit 20, etc., and is included in the concept of a computer. Furthermore, Server 1 may not be a single server device, but rather a combination of multiple server devices, or it may be a cloud server.

[0028] [Terminal 3] Terminal 3 is the terminal used by the user. As shown in Figure 2(B), the terminal 3 comprises a control unit 30, a storage unit 35, a touch panel 38, and a data communication IF 39. The control unit 30 is a CPU that controls the entire terminal 3. The control unit 30 works in cooperation with the aforementioned hardware to perform various functions by appropriately reading and executing the OS and application programs stored in the memory unit 35. The control unit 30 includes an input reception processing unit 31 and a reception output processing unit 32.

[0029] The input processing unit 31 receives the user's age and skin concerns via the touch panel 38. The input processing unit 31 then transmits the received user's age and skin concerns to the server 1. The input processing unit 31 also receives the impression items desired by the user via the touch panel 38. The input processing unit 31 then transmits the received impression items to the server 1. Furthermore, the input processing unit 31 receives information about the makeup method desired by the user via the touch panel 38. The input processing unit 31 then transmits the received information about the makeup method to the server 1. The receiving and output processing unit 32 receives impression items and evaluations from the server 1 and outputs them to the touch panel 38. The receiving and output processing unit 32 also receives suggestion information from the server 1 and outputs it to the touch panel 38.

[0030] The memory unit 35 is a storage area such as a semiconductor memory element for storing programs, data, etc., necessary for the control unit 30 to perform various processes. The memory unit 35 stores the program memory unit 36. The program memory unit 36 ​​is a memory area for storing various programs. The program memory unit 36 ​​stores application programs (hereinafter also referred to as "apps") for executing the various functions performed by the control unit 30 described above. The apps stored in the program memory unit 36 ​​may be pre-stored in the program memory unit 36 ​​of the terminal 3, or they may be downloaded and installed from an external app server, etc. (not shown) that is connected to the terminal 3 in a communication manner. The touch panel 38 has the function of an input unit that accepts touch operations from the user, and the function of a display unit composed of an LCD panel or the like. Alternatively, instead of the touch panel 38, an input device such as a keyboard or mouse and an output device such as a display may be provided. Data communication IF39 is the interface with the data communication network N.

[0031] [Explanation of the process] Next, we will explain the processing performed by the information processing system 100. Figures 4 and 5 are flowcharts showing the facial impression processing of the information processing system 100 according to the first embodiment. Figures 6 and 7 show examples of displays on terminal 3 according to the first embodiment. First, a user who wants to know the impression resulting from their own skin concerns will, for example, run the application stored in the program storage unit 36 ​​of terminal 3. In doing so, in step S (hereinafter, "step S" will be simply referred to as "S") 11 of Figure 4, the control unit 30 outputs the input screen 41 shown in Figure 6(A) to the touch panel 38. The input screen 41 shown in Figure 6(A) is for the user to input their age group (age information). The user selects the age group to which their age belongs from the age groups displayed on the input screen 41.

[0032] When the user selects a time period, the input reception processing unit 31 accepts the time period in S12 of Figure 4. Next, the control unit 30 outputs the input screen 42 shown in Figure 6(B) to the touch panel 38. The input screen 42 shown in Figure 6(B) is a screen for the user to input their skin concerns (condition information). The user selects, for example, the skin concerns they are concerned about from the skin concerns listed on the input screen 42. The input screen 42 may allow the user to select multiple skin concerns. Furthermore, the input screen 42 may have a link 42a, and when link 42a is selected, the control unit 30 may output the explanatory screen 49 exemplified in Figure 6(E) to the touch panel 38. The explanatory screen 49 shown in Figure 6(E) illustrates skin problems, making it easy for the user to understand the content of their skin problems.

[0033] When the user gives, for example, the instruction to proceed on the input screen 42, the control unit 30 outputs the input screen 43 shown in Figure 6(C) to the touch panel 38 for the user to input details about the skin concern selected by the user, such as size. The user can then determine the details about the skin concern on the input screen 43 through selection operations. Alternatively, instead of separating the screens for skin concerns and details, it may be possible to allow users to input both the skin concerns and the details of the selected skin concerns on a single input screen. When the user gives the instruction to proceed on the input screen 43, the input reception processing unit 31 receives the information about skin concerns in S13 of Figure 4. The input reception processing unit 31 then sends the entered age and skin concern information to the server 1.

[0034] In Server 1, when the User Information Reception Unit 11 receives information on age and skin concerns, in S14, the Impression Extraction Unit 12 extracts impressions. More specifically, the Impression Extraction Unit 12 extracts impression items and evaluations based on age and skin concerns by referring to the Impression Information Storage Unit 22. In the example shown in Figure 6, the user is in their 50s and their skin concern is "large blemishes." In that case, referring to the Impression Information Storage Unit 22 shown in Figure 3(A), when extracting evaluations for each impression item of "large blemishes" under "Impressions of skin concerns in one's 50s," the evaluation for all items is "strongly negative." In step S15 of Figure 4, the impression output unit 13 transmits impression information consisting of extracted impression items and evaluations to the terminal 3.

[0035] When the receiving output processing unit 32 of terminal 3 receives impression information from server 1, in S16 it outputs the impression information to the touch panel 38. Figure 6(D) shows an example of the impression evaluation screen 44. The impression evaluation screen 44 is a screen that shows the evaluation of impressions regarding age and skin concerns in text. Note that the display example shown on the impression evaluation screen 44 is just one example. For example, negative evaluations may be set to low values ​​and positive evaluations to high values, and the evaluation values ​​for each impression item may be displayed in a table format. Alternatively, each evaluation value may be displayed in a radar chart format with each impression item at the vertices of a regular polygon. Specific examples of these will be described later. The user can review the impression evaluation screen 44 and proceed to suggestions for beauty methods to achieve their desired impression, return to the input screen 42 for other skin concerns, or exit the app after reviewing the evaluation for each impression item.

[0036] In step S17 of Figure 4, the control unit 30 determines whether or not to proceed with the suggestion of beauty methods. For example, if the user selects "Proceed to makeup suggestion" on the impression evaluation screen 44 (Figure 6(D)), the control unit 30 determines to proceed with the suggestion of beauty methods. If the user decides to proceed with the suggestion of beauty methods (S17: YES), the control unit 30 moves the process to step S21 of Figure 5. On the other hand, if the user decides not to proceed with the suggestion of beauty methods (S17: NO), the control unit 30 moves the process to step S18. In S18, the control unit 30 decides whether or not to restart from the skin concerns. For example, if the user selects "Return to skin concerns of concern" on the impression evaluation screen 44 (Figure 6(D)), the control unit 30 decides to restart from the skin concerns. If the user decides to restart from the skin concerns (S18: YES), the control unit 30 moves the process to S13. On the other hand, if the user decides not to restart from the skin concerns (S18: NO), the control unit 30 terminates this process.

[0037] When the user selects "Proceed to Makeup Suggestion" on the impression evaluation screen 44 (Figure 6(D)), the control unit 30 outputs the input screen 51 shown in Figure 7(A) to the touch panel 38. The user can select the impression items that represent the impression they want to achieve from the impression items displayed on the input screen 51. Here, the impression items displayed on the input screen 51 are the same as, for example, the impression items stored in the impression information storage unit 22.

[0038] When the user selects an impression, in S21 of Figure 5, the input reception processing unit 31 receives the input for the desired impression. Next, the control unit 30 outputs the input screen 52 shown in Figure 7(B) to the touch panel 38. The input screen 52 shown in Figure 7(B) is a screen for the user to input their makeup method. The user can select their preferred makeup method from the input screen 52. When the user selects their preferred makeup method on the input screen 52, the input receiving processing unit 31 receives information about the makeup method at S22 in Figure 5. The input receiving processing unit 31 then sends the impression items of the desired look and the information about the makeup method to the server 1.

[0039] In Server 1, the Impression Item Reception Unit 14 receives the impression items of the desired impression, and the Makeup Method Reception Unit 15 receives information on the makeup method. In S23, the Beauty Proposal Extraction Unit 16 extracts beauty method suggestions. More specifically, the Beauty Proposal Extraction Unit 16 extracts beauty method suggestion information by referring to the Proposal Information Storage Unit 23, based on the already received age and skin concerns, as well as the impression items of the desired impression and information on the makeup method. In the example shown in Figure 7, the user is in their "50s" and has "large blemishes." Also, the impression item of the desired impression is "active," and the information on the makeup method is "natural." In this case, the Control Unit 10 refers to the Proposal Information Storage Unit 23 shown in Figure 3(B) and extracts makeup suggestions for enhancing the active impression, specifically for a 50-year-old with "large blemishes." As a result, the makeup suggestions extracted are "blush," "under-eye & cheek highlight," and "5-point highlight." In S24 of Figure 5, the beauty suggestion output unit 17 transmits the extracted beauty method suggestion information to the terminal 3.

[0040] When the receiving output processing unit 32 of terminal 3 receives the suggested beauty method information from server 1, in S25 it outputs the suggested beauty method information to the touch panel 38. Figure 7(C) shows an example of the makeup suggestion screen 53. The makeup suggestion screen 53 is a screen that displays the suggested makeup in text. In the makeup suggestion screen 53, suggestion information 53a and 53b are linked, and when the user selects suggestion information 53a, the control unit 30 may output the explanation screen 54 exemplified in Figure 7(D) to the touch panel 38. Alternatively, when the user selects suggestion information 53b, the control unit 30 may output the explanation screen 55 exemplified in Figure 7(E) to the touch panel 38.

[0041] In the explanation screens 54 and 55, examples are shown where makeup suggestions are output as illustrations, with dotted lines indicating the makeup placement; however, the system is not limited to this. For example, it may also output a finished look image. In this example, the makeup suggestion screen 53 and the explanation screens 54 and 55 were described as separate screens, but it is also perfectly acceptable to include the explanation screens within the makeup suggestion screen 53. The user can review the makeup suggestion screen 53 and return to the desired impression input screen 51 if they have a different impression they would like to achieve, return to the skin concern input screen 42 (see Figure 6(B)) if they have other skin concerns they are interested in, or close the app.

[0042] In S26 of Figure 5, the control unit 30 determines whether or not to restart from the desired impression. For example, if the user selects "Return to desired impression" on the makeup suggestion screen 53 (Figure 7(C)), the control unit 30 determines to restart from the desired impression. If the user decides to restart from the desired impression (S26: YES), the control unit 30 moves the process to S21. On the other hand, if the user decides not to restart from the desired impression (S26: NO), the control unit 30 moves the process to S27.

[0043] In S27, the control unit 30 determines whether or not to restart from the skin concerns. For example, if the user selects "Return to the skin concerns of concern" on the makeup suggestion screen 53 (Figure 7(C)), the control unit 30 determines to restart from the skin concerns. If the user chooses to restart from the skin concerns (S27: YES), the control unit 30 moves the process to S13 in Figure 4. On the other hand, if the user chooses not to restart from the skin concerns (S27: NO), the control unit 30 terminates this process.

[0044] Next, we will explain examples of user input and the resulting output. Figure 8 is a diagram illustrating an example of processing 60 by the server 1 according to the first embodiment. Processing Example 60 shows four cases, from Case 1 to Case 4. Case 1 is an example where the user is in their 50s and their skin concern is nasolabial folds. In this case, the control unit 10 of server 1 refers to the impression information storage unit 22 and outputs evaluations for the impression items for a user in their 50s with nasolabial folds. The evaluations are positive for the impression items "trustworthiness" and "cleanliness." In cases where the evaluation includes positive items, terminal 3 may output only the evaluations for the impression items and not proceed to further processing. More specifically, in the impression evaluation screen 44 (Figure 6(D)) which outputs evaluations for each impression item, the option to "Proceed to makeup suggestion" may be omitted. Instead of displaying the "Proceed to makeup suggestion" option, a message such as "Even natural makeup can give a positive impression" may be displayed.

[0045] Examples 2 through 4 are all in their 40s. Examples 2 and 3 involve one skin concern, while example 4 involves two skin concerns. The makeup methods also differ between examples 2 and 3 and example 4. Comparing Cases 2 through 4, regarding the makeup suggestions, Cases 2 and 3 suggest "proper coverage with foundation" because the makeup method is "proper coverage," while Case 4 suggests "natural coverage with foundation" because the makeup method is "natural." Also, in Case 2, multiple makeup options are suggested, but in Case 4, despite having the same skin concern of "large blemishes," only one makeup option is suggested. This is because the system outputs makeup suggestions that are common to both "large blemishes" and "pores."

[0046] Although the processing flow in the information processing system 100 has been explained above, the screens displayed on terminal 3 are not limited to those shown in Figures 6 and 7, and various variations are possible. The following explanation includes other screen examples. Figure 9 shows another display example on terminal 3 according to the first embodiment.

[0047] Figure 9(A) shows an example of a screen displayed on terminal 3 regarding the input of the user's age and skin concerns. The input screen 61 in Figure 9(A) prompts the user to input their actual age and their skin concerns. As shown in input screen 61, the age information that the user is asked to input may be their actual age. The skin concerns that the user is asked to input may be entered as text, or the user may select from options displayed in a dropdown menu or similar.

[0048] The input screen 62 in Figure 9(A) prompts the user to input a facial image. The user's facial image can be one taken using a camera (not shown) installed in terminal 3. For example, when the input screen 62 is displayed on terminal 3, the camera is activated and a picture of the user's face is taken. After the captured facial image is displayed, the user selects the "Start Analysis" button, at which point the control unit 10 of server 1 acquires the facial image and estimates the user's age and skin concerns from the acquired image. Note that the facial image does not have to be one taken on the spot; for example, one that has been previously stored in the memory unit 35 of terminal 3 can be used.

[0049] Various publicly known techniques can be used to estimate age information from facial images. Furthermore, for estimating skin information from facial images, see, for example, Chen J., He M., Cai W., “Facial Wrinkle Detection with Multiscale Spatial Feature Fusion Based on Image Enhancement and ASFF-SEUnet”, Electronics. 12(24):4897.<https: / / doi.org / 10.3390 / electronics12244897> , Chau AT.T., Nguyen DM., Hoang NK., Phan MP., Dong PA., Tran KS., “Facial Skin Condition Detection Using Deep Learning-Building Skin Care System”, Industrial Networks and Intelligent Systems, INISCOM 2023, Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 531. Springer, Cham.<https: / / doi.org / 10.1007 / 978-3-031-47359-3_10> The technologies described in the above, as well as known technologies such as those in Patent 5116965, can be used.

[0050] Terminal 3 may output either input screen 61 or input screen 62 as a screen for user input. In this case, terminal 3 may select which screen to output based on the user's request. Alternatively, both input screen 61 and input screen 62 may be output, utilizing the user's actual age and skin concerns entered by the user, as well as the estimation of age and skin concerns based on the analysis of the user's facial image.

[0051] Figure 9(B) is an example of a screen output to terminal 3 as a result of processing by server 1 after the user has entered information into the screen shown in Figure 9(A). The impression evaluation screen 63 in Figure 9(B) is a screen that displays each impression item arranged vertically and plots its evaluation value. The impression evaluation screen 64 in Figure 9(B) is a screen that displays the evaluation value of each impression item using a radar chart with each impression item at the vertices of a regular polygon. The impression information to be output does not have to be a written evaluation of the impression; instead, the evaluation for each impression item may be presented visually, as in the impression evaluation screen 63 and impression evaluation screen 64.

[0052] Figure 9(C) shows an example of a screen displayed on terminal 3 for inputting the user's desired impression and makeup method. The input screen 65 in Figure 9(C) allows the user to input their desired look and makeup method. This input can be done by the user entering text, or by selecting from options displayed in a dropdown menu or similar.

[0053] Figure 9(D) is an example of a screen output to terminal 3 as a result of processing by server 1 after the user has entered information into the screen shown in Figure 9(C). The makeup suggestion screen 66 in Figure 9(D) is a screen where suggested makeup looks are overlaid on the user's own face image. The makeup suggestion screen 67 in Figure 9(D) is a screen that shows suggested makeup looks on an illustration of a face. The makeup suggestion screen 68 in Figure 9(D) shows a face illustration with suggested makeup, as well as descriptions of the makeup's characteristics, how to apply it, and suggested cosmetics and other items for achieving that makeup.

[0054] Terminal 3 may output any of the makeup suggestion screens from makeup suggestion screen 66 to makeup suggestion screen 68, or it may allow the user to choose. Furthermore, if a face image is obtained via input screen 62, it may output a makeup suggestion screen 66 with the suggested makeup overlaid on the user's own face image. Thus, when proposing beauty methods, various output methods can be used to suggest them to the user of terminal 3.

[0055] Thus, the server 1 of the first embodiment has the following effects. (1) The system acquires the user's age information and status information regarding the user's facial and / or skin condition. Based on the acquired age information and status information, it refers to an impression information storage unit 22 that stores evaluations of impression items associated with the status information in the age information, extracts impression items and evaluations, and outputs the extracted impression items and evaluations. Therefore, users can obtain an evaluation of their impression based on their age information and status information.

[0056] (2) Condition information is defined as information on skin morphology and / or color and texture on the face. Skin morphology includes at least one of the following skin conditions: sagging under the eyes, nasolabial folds, marionette lines, crow's feet, hollows above the eyes, drooping corners of the mouth, pores, unevenness of acne scars, and facial sagging. Color and texture on the face includes at least one of the following facial conditions and / or skin conditions: blemishes, dullness, dark circles, redness, uneven skin tone, dullness of the whites of the eyes, redness of the whites of the eyes, freckles, and the color of acne scars. Furthermore, skin morphology includes the volume of the skin condition, and color and texture on the face include the area of ​​the facial condition and / or skin condition. Therefore, users can primarily obtain evaluations regarding impressions of various skin concerns based on age. In this process, since evaluations are obtained from detailed information about various skin concerns, users can obtain evaluations that better reflect their own perceptions of their skin concerns.

[0057] (3) Each impression item should include at least one of the following: trustworthiness, cleanliness, attractiveness, activeness, youthfulness, tired appearance, and three-dimensionality. Therefore, users can evaluate various impressions based on their own age and condition information.

[0058] (4) The system obtains impression items requested by the user, and based on the obtained age information and status information and impression items, it extracts suggested beauty methods by referring to the suggested beauty method storage unit 23 which stores suggested beauty methods corresponding to one or more of the impression items, status information and age information, and outputs the extracted suggested beauty methods. Therefore, users can obtain information suggesting beauty methods based on their age information, condition information, and the impression they desire.

[0059] (5) The system obtains information about the makeup method desired by the user, and based on the obtained information about the makeup method, it extracts suggested beauty method information by referring to the suggested beauty method storage unit 23, which stores information about the makeup method associated with the suggested beauty method information. Therefore, users can obtain beauty method suggestions that match the information they desire regarding makeup techniques.

[0060] (6) When multiple beauty method suggestions are extracted, the system is configured to output suggestions for at least one beauty method. Therefore, if there are multiple beauty method suggestions that suit the user, the user can obtain information on at least one beauty method suggestion.

[0061] (Second Embodiment) In the second embodiment, a system is described that takes the user's age information and the impression the user desires as input and outputs an evaluation of the user. In the following description, parts that perform the same functions as in the first embodiment described above will be denoted by the same reference numerals or the same reference numerals at the end, and redundant explanations will be omitted as appropriate.

[0062] [Overall configuration of information processing system 200] Figure 10 is an overall configuration diagram of the information processing system 200 according to the second embodiment and a functional block diagram of the server 201. The information processing system 200 shown in Figure 10 is a system that provides users with an evaluation of their skin concerns (condition information) in relation to the impression of their age group, based on the user's input of their age group (age information) and desired impression (impression items) using terminal 3. Furthermore, the information processing system 200 is a system that provides users with suggestions for makeup to cover their skin concerns (condition information desired by the target person), based on the user's input of their skin concerns (condition information desired by the target person) using terminal 3. The information processing system 200 includes a server 201 and a terminal 3.

[0063] [Server 201] The server 201 comprises a control unit 210, a storage unit 220, and a data communication interface 29. The control unit 210 includes a first information receiving unit 211, a state extraction unit 212, a state output unit 213, a second information receiving unit 214, a makeup method receiving unit 15, a beauty suggestion extraction unit 216, and a beauty suggestion output unit 17.

[0064] The first information receiving unit 211 functions as a means of acquiring information. The first information receiving unit 211 receives, for example, the user's age (age information) and the impression items desired by the user from, for example, the terminal 3. The first information receiving unit 211 may also accept the user's actual age or apparent age instead of the user's age. The state extraction unit 212 functions as a state extraction means. Based on the age and impression items received by the first information receiving unit 211, the state extraction unit 212 refers to the impression information storage unit 22 and extracts state information and evaluations related to the state of the face and / or skin. The status output unit 213 functions as a status output means. The status output unit 213 outputs status information and evaluations regarding the facial and / or skin condition extracted by the status extraction unit 212 to, for example, the terminal 3.

[0065] The second information receiving unit 214 functions as a means for acquiring status. The second information receiving unit 214 receives status information regarding the facial and / or skin condition desired by the user, for example, from terminal 3. The status information regarding the facial and / or skin condition desired by the user is, for example, status information regarding the facial and / or skin condition that the user wants to cover. The beauty suggestion extraction unit 216 functions as a suggestion extraction means. Based on the age and impression items desired by the user acquired by the first information receiving unit 211 and the condition information regarding the facial condition and / or skin condition desired by the user received by the second information receiving unit 214, the beauty suggestion extraction unit 216 extracts suggestion information for beauty methods by referring to the suggestion information storage unit 23.

[0066] In the above description, the first information receiving unit 211, the second information receiving unit 214, and the makeup method receiving unit 15 were described as functional units that receive information from terminal 3, but the system is not limited to these, and may consist of a single functional unit as the receiving unit. Similarly, the status output unit 213 and the beauty suggestion output unit 17 were described as functional units that output information to terminal 3, but the system is not limited to these, and may consist of a single functional unit as the output unit.

[0067] The memory unit 220 stores the program memory unit 221, the impression information memory unit 22, and the proposal information memory unit 23. The program storage unit 221 is a storage area for various programs, including application programs for executing the various functions performed by the control unit 210 described above.

[0068] [Explanation of the process] Next, we will explain the processing performed by the information processing system 200. Figures 11 and 12 are flowcharts showing the facial impression processing of the information processing system 200 according to the second embodiment. First, when the user executes the application stored in the program storage unit 36 ​​of terminal 3, in S211 of Figure 11, the control unit 30 of terminal 3 outputs an input screen to the touch panel 38. This input screen is, for example, a screen that allows the user to select their age group.

[0069] When the user selects an age group from the input screen, in S212, the input reception processing unit 31 receives the age group and outputs an input screen to the touch panel 38 that allows the user to select the impression items they wish to project. When the user selects an impression item from the input screen, in S213, the input reception processing unit 31 accepts the impression item. The input reception processing unit 31 then sends the entered age and impression item to the server 201.

[0070] In server 201, when the first information receiving unit 211 receives the age and impression items, in S214, the state extraction unit 212 extracts state information. More specifically, based on the age and impression items, the state extraction unit 212 refers to the impression information storage unit 22 to extract state information and evaluations related to the face and / or skin condition. For example, referring to the example of the impression information storage unit 22 illustrated in Figure 3(A), if the user's age is "50s" and the impression item the user wants to project is "trustworthiness," then "strong negative" for "blemishes (large area, dark color)" and "strong positive" for "nasolabial folds (large shape)" are extracted. In step S215 of Figure 11, the status output unit 213 transmits status result information, consisting of extracted status information and evaluations regarding the facial and / or skin condition, to the terminal 3.

[0071] When the receiving output processing unit 32 of terminal 3 receives status result information from the server 201, in S216 it outputs the status result information to the touch panel 38. For example, if the user's age is "50s" and the desired impression is "trustworthiness," the output status result information would be: "For people in their 50s, having large age spots decreases trustworthiness, while having nasolabial folds increases trustworthiness." The user can review the outputted status result information and proceed to the suggestion of beauty methods to address that status, return to the impression item input screen if there are other impression items of interest, or close the app after reviewing the status result information.

[0072] In S217 of Figure 11, the control unit 30 determines whether or not to proceed to propose a beauty method. If the process proceeds to propose a beauty method (S217: YES), the control unit 30 moves the process to S221 of Figure 12. On the other hand, if the process does not proceed to propose a beauty method (S217: NO), the control unit 30 moves the process to S218. In S218, the control unit 30 determines whether to restart the input of impression items. If it is decided to restart the input of impression items (S218: YES), the control unit 30 moves the process to S213. On the other hand, if it is decided not to restart the input of impression items (S218: NO), the control unit 30 terminates this process.

[0073] If the system proceeds to suggest a beauty treatment method, the control unit 30 outputs a screen to the touch panel 38 for inputting information about the condition to be covered and the makeup method. The user inputs the information about the condition to be covered and the makeup method from this screen, and in S221 of Figure 12, the input reception processing unit 31 receives the input information about the condition to be covered and the makeup method. The input reception processing unit 31 then transmits the information about the condition to be covered and the makeup method to the server 201.

[0074] In server 201, when the second information receiving unit 214 receives status information to be covered and the makeup method receiving unit 15 receives information about makeup methods, in S222, the beauty suggestion extraction unit 216 extracts beauty method suggestions. More specifically, the beauty suggestion extraction unit 16 extracts beauty method suggestion information by referring to the suggestion information storage unit 23, based on the already received age and impression items, as well as the status information to be covered and the information about makeup methods. For example, suppose the user is in their 50s and the desired impression item is "trustworthy." Also, suppose the status information to be covered is "large blemishes" and the information about makeup methods is "natural." In that case, the control unit 210 refers to the suggestion information storage unit 23 and extracts makeup suggestions for a 50-year-old with "large blemishes" to enhance trustworthiness. In S223, the beauty suggestion output unit 17 transmits the extracted beauty method suggestion information to the terminal 3.

[0075] When the receiving output processing unit 32 of terminal 3 receives suggested beauty method information from the server 201, in S224 it outputs the suggested beauty method information to the touch panel 38. In S225, the control unit 30 determines whether to restart from the state information to be covered. If it decides to restart from the state information to be covered (S225: YES), the control unit 30 moves the process to S221. On the other hand, if it decides not to restart from the state information to be covered (S225: NO), the control unit 30 moves the process to S226.

[0076] In S226, the control unit 30 determines whether to restart from the impression item. If it is decided to restart from the impression item (S226: YES), the control unit 30 moves the process to S213 in Figure 11. On the other hand, if it is decided not to restart from the impression item (S226: NO), the control unit 30 terminates this process.

[0077] The following describes an example of output from terminal 3 corresponding to the processing flow described above. Figure 13 shows an example of the display on terminal 3 according to the second embodiment. The input screen 271 shown in Figure 13(A) prompts the user to input a facial image. The user's facial image can be one taken using a camera (not shown) installed in terminal 3. For example, when the input screen 271 is displayed in terminal 3, the camera is activated and a picture of the user's face is taken. After the captured facial image is displayed, the user selects the "Start Analysis" button, at which point the control unit 210 of server 201 acquires the facial image and estimates the user's age from the acquired image. Note that the facial image does not have to be one taken on the spot; for example, one that has been previously stored in the memory unit 35 of terminal 3 can be used.

[0078] Figure 10(B) is an example of a screen output to terminal 3 as a result of processing by server 201 after the user has made input on the screen shown in Figure 10(A). Here, server 201 estimates skin condition, eye information, and some attribute information from the face image acquired by control unit 210. Attribute information may also be obtained by conducting a questionnaire or similar survey with the user in advance. The impression selection screen 272 in Figure 10(B) is a screen that outputs face images that correspond to each impression item based on the user's own face image entered on the input screen 271. The impression selection screen 272 has face images corresponding to impression items such as "cleanliness," "youthfulness," and "trustworthiness," and each can be selected. The server 201 may have a database for creating impressions and be capable of creating face images that correspond to each impression using this database. For example, if the server 201 has data such as "having nasolabial folds gives a ○● impression," the control unit 210 of the server 201 will use the database to create an image from this data.

[0079] The facial impression result screen 273 shown in Figure 10(C) is an example of a screen output to terminal 3 as a result of processing by server 201 after the user has selected the "Select" area corresponding to the desired impression item output on the impression selection screen 272. In server 201, the control unit 210 extracts the result of the selected impression from the impression item selected by the user and the age estimated from the facial image, and performs processing to superimpose several variations of simulation images on the user's own facial image. In addition, server 201's control unit 210 presents an objective impression score and explanation based on information stored in the memory unit 220. The user can view the facial impression results screen 273 shown in Figure 10(C) to confirm the objective impression of their own face. The age bar shown on the facial impression results screen 273 is marked with an estimated age. Furthermore, moving this mark horizontally may display objective impression information for each age corresponding to the position of the mark.

[0080] The makeup face selection screen 274 shown in Figure 10(D) is output to terminal 3 after the user has confirmed the face impression results screen 273 and has selected to proceed to the next screen (not shown), for example. The makeup face selection screen 274 displays the user's own face image with variations in makeup coverage (shade). After the user has confirmed, for example, a simulated face image that matches their own skin concerns and selected their preferred coverage, the makeup suggestion screen 275 shown in Figure 10(E) is then output to terminal 3. Makeup suggestion screens 275 to 277 may be the same as makeup suggestion screens 66 to 68 shown in Figure 9(D).

[0081] Thus, the server 201 of the second embodiment has the following effects. (1) The system acquires the user's age information and the impression items the user desires. Based on the acquired age information and impression items, it refers to the impression information storage unit 22, which stores evaluations of impression items associated with the state information in the age information, to extract state information and evaluations related to the state of the face and / or skin, and outputs the extracted state information and evaluations. Therefore, users can obtain an evaluation of their state information from their age information and impression items.

[0082] (2) The system obtains status information requested by the user, and based on the obtained age information and impression items and status information, it extracts beauty method suggestion information by referring to the suggestion information storage unit 23 which stores suggestion information for beauty methods corresponding to one or more of the impression items, status information and age information, and outputs the extracted beauty method suggestion information. Therefore, users can obtain information suggesting beauty methods based on their age information, desired impression items, and desired condition information.

[0083] Although embodiments of the present invention have been described above, the present invention is not limited to the embodiments described above. Furthermore, the effects described in the embodiments are merely a list of the most preferred effects arising from the present invention, and the effects of the present invention are not limited to those described in the embodiments. The embodiments described above and the modified forms described later can be used in combination as appropriate, but a detailed explanation is omitted.

[0084] (Transformed form) (1) In the first embodiment, an example was described in which, after receiving input of age information and skin concerns, an evaluation for each impression item is output and then the system proceeds to suggest beauty methods, but it is not limited to this. In addition to input of age information and skin concerns, the system may also receive input of impression items about the desired impression and output suggestions for beauty methods without outputting an evaluation for each impression item.

[0085] (2) In the first embodiment, the impression items for the desired impression were described as being the same as the impression items in the impression information storage unit 22, but the embodiment is not limited to this. Other impression items may be included, or only other impression items may be included. For example, if your skin concern is "sagging skin," there is evidence that arched eyebrows make you look more approachable and brighten the entire face, while angled eyebrows make the entire face appear less saggy, less aged, and more vibrant. Therefore, when a user's skin concern is "sagging face" and the desired impression is "approachable," the server should suggest arched eyebrows. However, when the user's desired impression is "lively," the server should suggest angled eyebrows.

[0086] Figure 14 shows an example of the display on terminal 3 related to the transformed form. The screen 81 shown in Figure 14 is an example of a makeup suggestion screen for a user whose skin concern is "sagging face" and whose desired impression is to "look more vibrant." Screen 81 shows suggested eyebrow shapes for the user's own face image or a face illustration. Point 81a indicates the inner corner of the eyebrow, and point 81b indicates the arch of the eyebrow. Furthermore, line segment 81c is a parallel line starting from point 81a, and line segment 81d is a perpendicular line passing through point 81b. Line segment 81e is a line indicating the angle below the eyebrow, starting from point 81a. Thus, screen 81 may present the characteristics of the eyebrows, including how they are drawn.

[0087] Furthermore, regarding the whites of the eyes, there is evidence that highlights above and below the eyes can make the whites of the eyes appear perceptually whiter, thereby giving the impression of "approachability" and "youthfulness." Therefore, if the user's skin concern is "dullness of the whites of the eyes," and the desired impression is "approachability" or "youthfulness," the server should suggest highlighting the area above and below the eyes.

[0088] (3) In the first embodiment, an example was described in which the option "Proceed to makeup suggestion" is output on the impression evaluation screen 44 (Figure 6(D)) which outputs evaluations for each impression item, but the embodiment is not limited to this. For example, the option "Proceed to makeup suggestion" may be output only when a specific skin concern is selected.

[0089] (4) In the first embodiment, we explained an example in which the user inputs the impression items they want to achieve and their preferred makeup method, but inputting the preferred makeup method is not mandatory. In that case, the server may extract and output suggestion information for both "full coverage" and "natural" beauty methods.

[0090] (5) In the first embodiment, an example was given in which the foundation suggestion changes depending on whether the information about the makeup method is "full coverage" or "natural," but the system is not limited to this. For example, information about the makeup method may be further associated with the suggestion information storage unit.

[0091] (6) In the first embodiment, facial skin concerns were used as an example, but the embodiment is not limited to this. Wrinkles on the neck, etc., are also thought to affect the impression. Therefore, for example, "wrinkles on the neck," etc., may be included as a skin concern, and the neck and décolleté may also be included. Also, although it was described as a skin concern, it is of course also fine to describe skin conditions that the user does not have any concerns about.

[0092] (7) In the first embodiment, an evaluation of impression items was described based on the user's age information and condition information regarding the condition of the face and / or skin, but the system is not limited to this. For example, the impression information storage unit may be further associated with BMI (Body Mass Index), lifestyle habits, gender, region, etc., and the evaluation of impression items may be output including this information. BMI is a body mass index that represents the degree of obesity calculated from weight and height. Lifestyle habits include eating habits, exercise habits, rest, whether or not the user drinks alcohol or smokes, etc. Gender is male or female, and region may be, for example, a country, or Asia, Europe, etc.

[0093] (8) In the first embodiment, the input for suggesting beauty methods was described as an impression item to achieve, and in the second embodiment, the input for suggesting beauty methods was described as condition information to be covered, but the invention is not limited to these. The input for suggesting beauty methods may also include various information such as favorite items, items used, whether or not items are used, the number of items used, the time and time of day spent on skincare and makeup, the frequency of skincare and makeup, behavioral patterns and aesthetic sense, what kind of makeup suggestions the user wants to know, and what areas they want to cover and to what extent. By doing so, it is possible to make suggestions for beauty methods that the user desires even more.

[0094] (9) In each embodiment, an example was described in which an evaluation of impression items corresponding to skin concerns for each age group is output, and an example was described in which age groups are used in 10-year increments, but the invention is not limited to this. For example, it may be for a range of ages, or for each age (actual age or apparent age).

[0095] (10) In each embodiment, the description has been based on the premise that data is registered in advance in the impression information storage unit 22 and the proposal information storage unit 23, but this is not limited to this. Addition and updating of data in the impression information storage unit and the proposal information storage unit may be done as appropriate. For example, diagnostic information from skin diagnosis may be added to the impression information storage unit.

[0096] (11) In each embodiment, the suggested information storage unit 23 was described as an example in which the suggested makeup is marked with "○", but it is not limited to this. For example, makeup that will not receive a negative evaluation when suggested may be marked with "△", etc. Also, for example, makeup that will receive a negative evaluation when suggested may be marked with "×", etc. Furthermore, in addition to makeup that is common to multiple skin concerns and is consistently marked with "○", makeup that is marked with "○" on one side and "△" on the other side may also be included in the output. Furthermore, if there are multiple makeup products that address several common skin concerns and are all marked with a "○", you may suggest all of them, or you may suggest just one.

[0097] (12) In each embodiment, an example has been described using a server 1 or server 201 and a terminal 3, but the embodiment is not limited thereto. A standalone device having the functions of both a server and a terminal may also be used.

[0098] (13) In each embodiment, the storage unit 20 of server 1 or the storage unit 220 of server 201 has been described as having an impression information storage unit 22 and a proposal information storage unit 23, but the embodiment is not limited thereto. For example, an external device that is communicably connected to the server may have an impression information storage unit and a proposal information storage unit.

[0099] (14) In each embodiment, a system that launches an application has been described as an example, but it is not limited to this. The system may be constructed in any way, for example, it may be a web-based system. In that case, the program executed on terminal 3 may be, for example, a web browser. [Explanation of Symbols]

[0100] 1. 201 Server (Information Processing Device) 3 terminals 10, 30, 210 Control Unit 11. User Information Reception Department 12 Impression extraction section 13. Impression Output Section 14. Impression Item Reception Department 15 Makeup Instructions Reception Department 16, 216 Beauty suggestion extraction section 17. Beauty Proposal Output Unit 20,35,220 storage section 21, 36, 221 Program storage 22 Impression information storage section 23 Proposal information storage unit 38 Touch Panel 100, 200 Information Processing Systems 211 First Information Reception Department 212 State extraction unit 213 Status Output Section 214 Second Information Reception Department N Data Communication Network

Claims

1. A subject information acquisition means that acquires the subject's age information and condition information relating to the subject's facial and / or skin condition, An impression information storage unit that stores evaluations of impression items associated with the state information in the age information, An impression extraction means extracts the impression items and the evaluation based on the age information and status information acquired by the subject information acquisition means by referring to the impression information storage unit, An impression output means that outputs the impression items and evaluation extracted by the impression extraction means, An information processing device equipped with the following features.

2. In the information processing apparatus according to claim 1, The subject information acquisition means is an information processing device that acquires the age information and status information estimated by analyzing the facial image of the subject.

3. In the information processing apparatus according to claim 1, The aforementioned state information is information about the morphology of the skin and / or the color and texture of the face, in an information processing device.

4. In the information processing apparatus described in claim 3, The aforementioned skin morphology includes at least one of the following skin conditions: sagging under the eyes, nasolabial folds, marionette lines, crow's feet, hollows above the eyes, drooping corners of the mouth, enlarged pores, unevenness from acne scars, and facial sagging. An information processing device in which the color and texture of the face include at least one of the following facial and / or skin conditions: blemishes, dullness, dark circles, redness, uneven skin tone, dullness of the whites of the eyes, redness of the whites of the eyes, freckles, and acne scars.

5. In the information processing apparatus according to claim 4, The aforementioned skin morphology includes the size of the volume that constitutes the aforementioned skin condition, An information processing device in which the color and texture of the face include the size of the area constituting the state of the face and / or the state of the skin.

6. In the information processing apparatus according to claim 1, An information processing device in which the aforementioned impression items include at least one of the following: trustworthiness, cleanliness, attractiveness, activeness, youthfulness, tired appearance, and three-dimensionality.

7. In the information processing apparatus according to claim 1, A suggestion information storage unit that stores suggestion information for beauty methods corresponding to one or more of the impression items, the state information, and the age information, An impression item acquisition means for acquiring the impression items desired by the subject, A proposal extraction means extracts the proposal information by referring to the proposal information storage unit, based on the age information and status information acquired by the subject information acquisition means and the impression items acquired by the impression item acquisition means. A proposal output means that outputs the proposal information extracted by the proposal extraction means, An information processing device equipped with the following features.

8. A subject information acquisition means that acquires the subject's age information and condition information relating to the subject's facial and / or skin condition, An impression item acquisition means for acquiring impression items desired by the subject, A suggestion information storage unit that stores suggestion information for beauty methods corresponding to one or more of the impression items, the state information, and the age information, A proposal extraction means extracts the proposal information by referring to the proposal information storage unit, based on the age information and status information acquired by the subject information acquisition means and the impression items acquired by the impression item acquisition means. A proposal output means that outputs the proposal information extracted by the proposal extraction means, An information processing device equipped with the following features.

9. In the information processing apparatus according to claim 8, The system includes a makeup information acquisition means for acquiring information about the makeup method desired by the subject, The aforementioned proposal information storage unit stores the proposal information in association with information regarding the makeup method. The proposal extraction means is an information processing device that extracts the proposal information by referring to the proposal information storage unit, based on the information about the makeup method acquired by the makeup information acquisition means.

10. In the information processing apparatus according to claim 8, The proposal output means is an information processing device that outputs at least one of the proposal pieces of information when there are multiple proposal pieces of information extracted by the proposal extraction means.

11. Information acquisition means for acquiring the age information of the subject and the impression items desired by the subject, An impression information storage unit that stores evaluations of the impression items associated with the condition information regarding the facial and / or skin condition in the aforementioned age information, A state extraction means extracts the state information and the evaluation by referring to the impression information storage unit based on the age information and impression items acquired by the information acquisition means, A state output means that outputs the state information extracted by the state extraction means and the evaluation, An information processing device equipped with the following features.

12. In the information processing apparatus according to claim 11, A suggestion information storage unit that stores suggestion information for beauty methods corresponding to one or more of the impression items, the state information, and the age information, A state acquisition means for acquiring the state information desired by the subject, A proposal extraction means extracts the proposal information by referring to the proposal information storage unit, based on the age information and impression items acquired by the information acquisition means and the state information acquired by the state acquisition means. A proposal output means that outputs the proposal information extracted by the proposal extraction means, An information processing device equipped with the following features.

13. Computers, A subject information acquisition means that acquires the subject's age information and condition information relating to the subject's facial and / or skin condition, An impression extraction means extracts the impression items and their evaluations by referring to an impression information storage unit that stores evaluations of impression items associated with the state information in the age information, based on the age information and state information acquired by the subject information acquisition means. An impression output means that outputs the impression items and evaluation extracted by the impression extraction means, A program that makes a computer function.

14. Computers, A subject information acquisition means that acquires the subject's age information and condition information relating to the subject's facial and / or skin condition, An impression item acquisition means for acquiring impression items desired by the subject, A proposal extraction means extracts proposal information by referring to a proposal information storage unit that stores proposal information for beauty methods corresponding to one or more of the impression items, the state information, and the age information, based on the age information and state information acquired by the subject information acquisition means and the impression items acquired by the impression item acquisition means. A proposal output means that outputs the proposal information extracted by the proposal extraction means, A program that makes a computer function.

15. Computers, Information acquisition means for acquiring the age information of the subject and the impression items desired by the subject, A state extraction means extracts the state information and the evaluation by referring to an impression information storage unit that stores evaluations of the impression items associated with the state information relating to the facial condition and / or skin condition in the age information, based on the age information and the impression items acquired by the information acquisition means. A state output means that outputs the state information extracted by the state extraction means and the evaluation, A program that makes a computer function.

Images