Information processing systems, information processing methods, and programs

Abstract

To provide information that shows the characteristic features of each individual eyebrow hair of the user. [Solution] The information processing system has a control unit. The control unit acquires an eyebrow image including the user's eyebrows, calculates a feature quantity from the eyebrow image that indicates the state of each individual eyebrow hair included in the eyebrows, generates eyebrow evaluation information that evaluates the user's eyebrows based on the calculated feature quantity, and outputs the generated eyebrow evaluation information.

Description

Technical Field

[0001] The present invention relates to an information processing system, an information processing method, and a program that provide information regarding the characteristics of a user's eyebrows.

Background Art

[0002] Conventionally, techniques for assisting eyebrow makeup have been known.

[0003] For example, in Patent Document 1 below, the user's eyebrows are classified based on the characteristic amounts of the eyebrows such as the thickness, width, angle, and length from the image of the user's eyebrows, and based on the classification result, a guide for eyebrow makeup (cosmetics and tools to be used, drawing method, drawing area, drawing order, how to use cosmetics and tools) for making the eyebrows into predetermined eyebrows is disclosed.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, with the technique of Patent Document 1 above, although information indicating characteristic amounts such as thickness and width can be provided for the overall shape of the user's eyebrows, information indicating characteristic amounts of the eyebrows based on the state of each individual eyebrow cannot be provided.

[0006] In view of the above circumstances, the problem of the present invention relates to providing an information processing system, an information processing method, and a program that can provide information indicating characteristic amounts of the eyebrows based on the state of each individual eyebrow of the user.

Means for Solving the Problems

[0007] An information processing system according to one embodiment of the present invention includes a control unit. The control unit acquires an eyebrow image including the user's eyebrows, calculates a feature quantity from the eyebrow image that indicates the state of each individual eyebrow hair included in the eyebrows, generates eyebrow evaluation information that evaluates the user's eyebrows based on the calculated feature quantity, and outputs the generated eyebrow evaluation information.

[0008] Information processing methods according to other embodiments of the present invention are: Obtain an eyebrow image including the user's eyebrows, From the aforementioned eyebrow image, a feature quantity indicating the condition of each individual eyebrow hair included in the eyebrow area is calculated. Based on the calculated features, eyebrow evaluation information is generated that evaluates the user's eyebrows. This includes outputting the generated eyebrow evaluation information.

[0009] A program according to yet another embodiment of the present invention is provided for an information processing device. The steps include obtaining an eyebrow image that includes the user's eyebrows, The steps include: calculating a feature quantity from the aforementioned eyebrow image that indicates the condition of each individual eyebrow hair included in the eyebrow area; The steps include generating eyebrow evaluation information that evaluates the user's eyebrows based on the calculated feature quantities, The process involves executing the step of outputting the generated eyebrow evaluation information. [Effects of the Invention]

[0010] According to an information processing system in one embodiment of the present invention, it is possible to provide information indicating the characteristic quantity of each eyebrow based on the condition of each individual eyebrow of the user. However, this effect is not limited to the present invention. [Brief explanation of the drawing]

[0011] [Figure 1] This diagram shows the configuration of an eyebrow makeup support information provision system according to one embodiment of the present invention. [Figure 2] This diagram shows the hardware configuration of an eyebrow makeup support information provision server according to one embodiment of the present invention. [Figure 3]It is a diagram showing the configuration of a database possessed by an eyebrow makeup support information providing server according to an embodiment of the present invention. [Figure 4] It is a flowchart showing the flow of eyebrow makeup support information providing processing by an eyebrow makeup support information providing server according to an embodiment of the present invention. [Figure 5] It is a flowchart showing the detailed flow of the feature quantity calculation processing of the eyebrows in FIG. 4. [Figure 6] It is a diagram conceptually showing the flow of the feature quantity calculation processing of the eyebrows in FIG. 5. [Figure 7] It is a diagram showing an example of display of eyebrow makeup support information provided by an eyebrow makeup support information providing server according to an embodiment of the present invention. [Figure 8] It is a diagram showing an example of display of eyebrow makeup support information provided by an eyebrow makeup support information providing server according to an embodiment of the present invention. [Figure 9] It is a diagram showing an example of display of eyebrow makeup support information provided by an eyebrow makeup support information providing server according to another embodiment of the present invention. [Figure 10] It is a diagram showing an example of display of the impression score of eyebrows predicted by an eyebrow makeup support information providing server according to another embodiment of the present invention. [Figure 11] It is a diagram showing an example of display of the feature quantity score of eyebrows calculated by an eyebrow makeup support information providing server according to another embodiment of the present invention. [Figure 12] It is a diagram explaining the process of predicting the impression of eyebrows from the feature quantities of eyebrows calculated by an eyebrow makeup support information providing server according to another embodiment of the present invention. [Figure 13] It is a diagram showing an example of display of eyebrow makeup support information provided by an eyebrow makeup support information providing server according to another embodiment of the present invention. [Figure 14] It is a diagram explaining the binarization processing of an eyebrow image by an eyebrow makeup support information providing server according to another embodiment of the present invention.

Embodiments for Carrying Out the Invention

[0012] Hereinafter, embodiments of the present invention will be described while referring to the drawings.

[0013] [System Configuration] As shown in FIG. 1, this system includes a brow makeup support information providing server 100 on the Internet 50 and a plurality of user terminals 200.

[0014] The brow makeup support information providing server 100 (hereinafter, also simply referred to as server 100) is a server (information processing device) capable of providing information (such as advice information regarding the state of the brows and makeup methods) for supporting a user's brow makeup to the user terminal 200. The server 100 is connected to a plurality of user terminals 200 via the Internet 50.

[0015] The user terminals 200 (200A, 200B, 200C...) are terminals used by users and are, for example, smartphones, mobile phones, tablet PCs (Personal Computers), notebook PCs, desktop PCs, etc. When performing brow makeup, the user terminal 200 accesses the server 100 via an application (brow makeup support application) installed on the user terminal 200, transmits a brow makeup support request together with the user's face image, and receives and displays the above-mentioned brow makeup support information (brow evaluation information) on the screen.

[0016] [Hardware Configuration of Brow Makeup Support Information Providing Server] As shown in FIG. 2, the server 100 includes a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, an input / output interface 15, and a bus 14 that connects these to each other.

[0017] The CPU 11 is a control unit that comprehensively controls all blocks of the server 100 while performing various calculations by appropriately accessing RAM 13 and other memory as needed. ROM 12 is a non-volatile memory in which the OS, programs, and firmware such as various parameters to be executed by the CPU 11 are permanently stored. RAM 13 is used as a working area for the CPU 11 and temporarily holds the OS, various running applications, and various data being processed.

[0018] The input / output interface 15 is connected to a display unit 16, an operation reception unit 17, a storage unit 18, a communication unit 19, and the like.

[0019] The display unit 16 is a display device that uses, for example, an LCD (Liquid Crystal Display), an OLED (Organic ElectroLuminescence Display), or a CRT (Cathode Ray Tube).

[0020] The operation reception unit 17 is, for example, a pointing device such as a mouse, a keyboard, a touch panel, or other input device. If the operation reception unit 17 is a touch panel, the touch panel may be integrated with the display unit 16.

[0021] The storage unit 18 is a non-volatile memory such as an HDD (Hard Disk Drive), flash memory (SSD; Solid State Drive), or other solid-state memory. The OS, various applications, and various data are stored in this storage unit 18.

[0022] As will be described later, in this embodiment in particular, the storage unit 18 has a user information database, an eyebrow image database, an eyebrow feature database, and an eyebrow evaluation information database, in addition to programs such as applications necessary for the eyebrow makeup support information provision process described later.

[0023] The communication unit 19 consists of various modules for wireless communication, such as a NIC (Network Interface Card) for Ethernet or a wireless LAN, and is responsible for communication processing with the user terminal 200.

[0024] Although not shown in the diagram, the basic hardware configuration of the user terminal 200 is substantially the same as that of the server 100. The user terminal 200 has a makeup support application installed in its storage unit that corresponds to the eyebrow makeup support information service provided by the server 100.

[0025] [Database configuration of the eyebrow makeup support information server] As shown in Figure 3, the eyebrow makeup support information providing server 100 has a user information database 31, an eyebrow image database 32, an eyebrow feature database 33, and an eyebrow evaluation information database 34 in its storage unit 18. Note that each of these databases may be stored in a storage device or server externally connected to the server 100, rather than in the storage unit 18.

[0026] The user information database 31 stores attribute information for each user who is a member of the support service provided by the eyebrow makeup support information server 100. User attribute information includes general information such as name, user ID to identify the user, age (age group), occupation, address (residential area), gender, and email address, as well as information related to the user's skin (makeup), such as the user's skin type, cosmetic preferences, and any skin problems the user has.

[0027] The eyebrow image database 32 stores eyebrow images extracted from face images received from the user terminal 200 for each user ID. The eyebrow image database 32 also stores binarized images obtained by binarizing the eyebrow images (described later) for each user ID.

[0028] The eyebrow feature database 33 stores score data for each user ID, which represents the feature quantities (hair uniformity and density sparseness) of each individual eyebrow hair, calculated based on the binarized image of the eyebrows mentioned above.

[0029] The eyebrow evaluation information database 34 stores eyebrow evaluation information generated based on the eyebrow features stored in the eyebrow feature database 33. This eyebrow evaluation information includes, but is not limited to, a heat map that maps the scores of the above eyebrow features to the entire eyebrow, information on (recommended) makeup methods and cosmetics corresponding to the above eyebrow features, and information that shows the impression of the user's eyebrows (such as radar chart information that visualizes the impression score).

[0030] These databases are referenced and used as needed in the eyebrow makeup support information provision process by the eyebrow makeup support information provision server 100, which will be described later.

[0031] [Operation of the eyebrow makeup support information server] Next, the operation of the server 100 configured as described above will be explained. This operation is performed through the cooperation of the server 100's hardware, such as the CPU 11 and communication unit 19, and the software stored in the storage unit 18. For convenience, the following explanation will refer to the CPU 11 as the primary operator.

[0032] Figure 4 is a flowchart showing the process of providing eyebrow makeup support information (eyebrow evaluation information) by the eyebrow makeup support information provision server.

[0033] As shown in the figure, the CPU 11 of the server 100 first determines whether or not it has received a request for eyebrow makeup assistance along with a user's face image from the user terminal 200 (step 41). The face image is, for example, one taken by the user using the makeup assistance application.

[0034] If the CPU determines that it has received the above request for eyebrow makeup assistance (Yes in step 41), the CPU 11 extracts the user's eyebrows from the above face image (step 42). The extracted eyebrow image is stored in the above eyebrow image database 32.

[0035] Next, CPU 11 calculates feature quantities that represent the state of each individual eyebrow hair included in the above eyebrow image (step 43).

[0036] Figure 5 is a flowchart showing the detailed flow of the eyebrow feature calculation process in step 43. Figure 6 is a conceptual diagram illustrating the flow of the eyebrow feature calculation process.

[0037] As shown in both figures, the CPU 11 first performs a binarization process on the eyebrow image and detects pixels that are recognized as eyebrows from the image (step 51 in Figure 5, (A) in Figure 6). At this time, by changing the threshold setting using adaptive thresholding, the pixels to be recognized as eyebrows can be fine-tuned.

[0038] Next, the CPU 11 performs texture analysis on the eyebrow image after the binarization process using local frequency characteristics from a Gabor filter to detect the angle of each individual eyebrow hair (step 52 in Figure 5). In other words, the CPU 11 estimates the angle of the hairs in the pixels corresponding to eyebrows from the features extracted as a response to the Gabor filter bank.

[0039] Next, the CPU 11 extracts images of only the eyebrows whose angles were detected (estimated) with high accuracy (with accuracy above a predetermined threshold) (step 53 in Figure 5, (B) in Figure 6). In other words, by using an index to evaluate the robustness of hair angle estimation for each pixel, and adopting only the hair angle data of pixels that score above a certain threshold, highly accurate hair estimation data can be secured. For the robustness of angle estimation, statistics such as the variance and kurtosis of the response to the Gabor filter bank may be used, or a method of iteratively executing the extraction process using the extraction results of hair angle data of pixels that score above the threshold as new input may be used, as disclosed in a previous research paper (Chai et al., "Single-View Hair Modeling for Portrait Manipulation", ACM Transactions on Graphics, 31(4), 2012), but it is also possible to evaluate using other indices. These methods have the advantage of reducing the risk that some inaccurate angle estimation data could inaccurate the mean or variance of local eyebrow angles when scoring features related to angles such as hair alignment.

[0040] In this embodiment, when calculating the eyebrow angle, a calculation method based on angle statistics (Circular Statistics / Directional Statistics) is employed. That is, because angles have periodicity and simple statistical processing or numerical calculations cannot be performed, the score is calculated according to a method for calculating the mean and variance that takes the periodicity of the angle into account. While calculating representative values ​​based on such angle statistics is preferable, other methods besides angle statistics can also be used, such as a method that calculates representative values ​​using the mode of an angle that is commonly used.

[0041] Next, CPU 11 calculates the variation in hair angle and hair density within small patch regions (white frames in Figure 6(C)) for the extracted images, and then calculates the scores for hair alignment and hair density sparseness as feature quantities for each individual eyebrow hair (step 54). Hair alignment indicates how closely the angle of a hair matches (or varies from) the angle of the surrounding hairs, and hair density sparseness indicates how many (or how few) hairs there are in a localized area of ​​the eyebrow.

[0042] Returning to Figure 4, the CPU 11 generates user eyebrow evaluation information (eyebrow evaluation information) based on the calculated features (hair uniformity / hair density sparseness) (step 44). In this embodiment, the eyebrow evaluation information generates a heatmap that maps the scores for hair uniformity and hair density sparseness onto the entire eyebrow.

[0043] The CPU 11 then sends the generated eyebrow evaluation information to the user terminal 200 for display (step 45).

[0044] Figure 7 shows an example of eyebrow evaluation information displayed on the user terminal 200. As shown in the figure, a hair alignment heatmap 61 indicating the evenness of the eyebrow hairs and a hair density heatmap 62 indicating the sparseness of the eyebrow hairs are displayed.

[0045] In the example shown in the figure, regarding hair uniformity, the hair is relatively even in the eyebrow head and tail areas, while it is uneven in the central area of ​​the eyebrow. Regarding hair density, the hair is dense near the center of the central area of ​​the eyebrow, while it is relatively sparse in the eyebrow head and tail areas, as well as the upper and lower edges of the central area.

[0046] Figure 8 shows another example of how eyebrow evaluation information can be displayed using the heatmap described above. As shown in the figure, the CPU 11 receives face images before and after the user applies eyebrow makeup, extracts eyebrow images from each face image, calculates a score for each eyebrow image indicating the above-mentioned feature quantities (hair uniformity / density sparseness), and displays the heatmap along with the eyebrow images before and after makeup as information about the improvement of the makeup. In the figure, only the hair uniformity heatmap 61 before and after makeup is shown, but the hair density heatmap 62 may also be displayed in the same way.

[0047] The figure shows that in the pre-makeup hair alignment heatmap 61, there were areas from the inner corner of the eyebrow to the central region where the hair angles were uneven, whereas in the post-makeup hair alignment heatmap 61, the degree of hair alignment in those areas has improved. The CPU 11 may also generate comments in the pre-makeup eyebrow image that indicate areas where the hair angles are uneven as correction points and display them together with the heatmap.

[0048] In this way, users can refer to the heatmap before makeup application to improve the evenness and density of their eyebrows, and then check the improved effect using the heatmap after makeup application.

[0049] In this case, as shown in the lower part of the figure, the CPU 11 may also obtain recommended cosmetic information 63 regarding cosmetics (e.g., eyebrow gel) recommended for improving areas where the hair angles are not uniform (to straighten the hair flow) from the eyebrow evaluation information database 34 and display it together with the hair alignment heatmap 61.

[0050] Furthermore, the recommended cosmetic information stored in the eyebrow evaluation information database 34 may be selected and stored according to the score (range) of hair uniformity and density sparseness (depending on the degree to which improvement is needed).

[0051] As shown in Figure 9, the same applies to the sparseness of eyebrow density. Recommended cosmetic information 63 regarding cosmetics (e.g., eyebrow pencils) recommended to improve the sparseness of density (filling in areas with no or sparse hair with makeup) may be obtained from the eyebrow evaluation information database 34 and displayed together with the hair density heatmap 62. In this case as well, the CPU 11 may generate comments that indicate areas with low hair density (e.g., below a predetermined threshold) as correction points and display them together with the hair density heatmap 62.

[0052] As described above, according to this embodiment, the eyebrow makeup support information providing server 100 can provide information indicating the characteristic quantities of eyebrows based on the condition of each individual eyebrow hair of the user.

[0053] [Differentiation] Although embodiments of the present invention have been described above, the present invention is not limited to the embodiments described above, and various modifications can be made without departing from the spirit of the present invention.

[0054] In the embodiment described above, the eyebrow makeup support information providing server 100 may, in addition to or instead of the heatmap, generate information indicating the impression of the user's eyebrows based on the calculated feature scores as eyebrow evaluation information, and send it to the user terminal 200 for display.

[0055] In this case, the eyebrow makeup support information server 100 may calculate scores for various features related to the shape and color of the eyebrows (thickness, area, curvature, length, position, L*a*b, etc.) in addition to the feature quantities related to the arrangement and density of the hairs mentioned above, and may also store information in advance that shows the relationship between the trends of these scores and the impression of the eyebrows (for example, natural, cool, cute, mature, intelligent, elegant, etc.), and generate information indicating the impression of the eyebrows based on this information.

[0056] For example, the more evenly the eyebrow hairs are and the less sparse the hair density, the more refined the impression can be associated with. Regarding eyebrow shape, arched eyebrows can be associated with a cute impression, angled straight eyebrows with an intellectual impression, and parallel eyebrows with a natural impression. Regarding eyebrow color, lighter eyebrows can be associated with a more natural impression.

[0057] Information that indicates the impression of eyebrows includes, for example, a radar chart that simultaneously displays scores for multiple impression items of eyebrows, as shown in Figure 10, but is not limited to this.

[0058] Furthermore, the eyebrow makeup support information server 100 may display scores for multiple items of the eyebrow features themselves, as well as the overall impression of the eyebrows, as shown in Figure 11, for example, as a radar chart.

[0059] Here, when the eyebrow makeup support information server 100 generates information indicating the impression of the eyebrows, it may use the feature score of the eyebrow tail region or the central region between the eyebrow tail and the eyebrow head region.

[0060] Figure 12 is a table (Figure (b)) showing the results of a regression analysis to determine how well the visual evaluation of eyebrow impression can be predicted by the measurement scores of the eyebrow features in the above embodiment. The eyebrows were divided into three regions: the inner corner, the middle, and the outer corner (see Figure (a)), and the scores for each region were analyzed.

[0061] As shown in Figure (b), regarding hair uniformity, the higher the feature scores in the inner and middle regions of the eyebrow (higher scores indicate less uniformity), the lower the visual evaluation of hair uniformity and strength tends to be. Similarly, regarding sparse hair density, the higher the feature scores in the middle and outer regions of the eyebrow (higher scores indicate sparser hair), the lower the visual evaluation score. Therefore, it can be seen that the influence of eyebrow features on impression differs depending on the region of the eyebrow. The eyebrow makeup support information server 100 utilizes this trend to calculate an eyebrow impression score by preferentially using (or weighting) the feature scores of different eyebrow regions for each impression to be predicted.

[0062] In the above embodiment, the eyebrow makeup support information server 100 calculated scores indicating hair uniformity and hair density sparseness as feature quantities representing the state of each individual eyebrow hair. Alternatively, or in addition to this, the server may calculate scores indicating the thickness, curvature (straightness / curvature), and hair direction angle of each individual eyebrow hair as feature quantities, generate eyebrow evaluation information such as the heat map, and display it on the user terminal 200. For example, regarding the hair direction angle, as shown in Figure 13(A), the average hair angle within a local area of ​​the eyebrow may be calculated and that value displayed as a heat map. In that case, as shown in Figure 13(B), arrow guide lines may be displayed to improve visibility.

[0063] In the above embodiment, the eyebrow makeup support information server 100 generated a heatmap based on the calculated eyebrow feature quantities. In this case, annotations (for example, text or marks such as "This area is uneven / sparse, so please apply makeup carefully") may be added to the heatmap and displayed.

[0064] In the embodiment described above, the eyebrow makeup support information server 100 generated and displayed information indicating points for correcting eyebrow makeup based on calculated feature quantities as eyebrow evaluation information (makeup information). Alternatively, the eyebrow makeup support information server 100 may receive an image of the user's ideal eyebrows or makeup concerns from the user terminal 200 and store it in the user information database 31, and also calculate the average value of the feature quantities calculated for many users, compare the feature quantities calculated for a particular user with the average feature quantities for many users, and display a guide showing the ideal points for improvement, for example, on the eyebrow image or on a heat map.

[0065] In the above-described embodiment, the binarization process for eyebrow images was based on the assumption that no eyebrow makeup was applied. However, even for eyebrows with eyebrow makeup, by adjusting the adaptive threshold, it is possible to detect features from the eyebrow portion excluding the eyebrow makeup, or to detect the eyebrow portion including the eyebrow makeup and calculate features. For example, in an eyebrow image where the tail of the eyebrow is corrected with eyebrow makeup, as shown in Figure 14(A), by setting a low threshold for detecting eyebrow hairs and performing binarization as shown in Figure 14(B), it is possible to recognize the correction due to eyebrow makeup as shown in Figure 14(A). On the other hand, as shown in Figure 14(C), by setting a high threshold for detecting eyebrow hairs and performing binarization, it is possible to detect only the actual eyebrow hairs as hairs.

[0066] Furthermore, in eyebrow makeup, there is a technique that uses liquid eyebrow cosmetics to create the illusion of drawing in individual hairs. The eyebrow analysis in this invention can also be used to evaluate the makeup effect of such artificially drawn-in eyebrows. For example, by calculating the density sparseness from the eyebrow area detected, including eyebrow makeup, using the adaptive binarization process described above, it is possible to evaluate the effect of eyebrow makeup in reducing sparseness.

[0067] In the above-described embodiment, as a method for estimating the angle of a pixel's hair from the responses to filter banks with different angles, images were extracted only from the eyebrows whose angles could be estimated accurately, as explained in step 53 of Figure 5 and Figure 6(B). While this processing step is preferred, other methods may also be used. For example, instead of the above method, the responses to all filter banks may be compared, and for each pixel of the eyebrow image, the angle with the maximum response may be adopted as the representative angle for that hair. This method allows for simpler processing than the method in the above-described embodiment.

[0068] In the embodiment described above, only one eyebrow makeup support information server 100 is shown, but the processing performed by the eyebrow makeup support information server 100 may be distributed and executed across multiple servers. For example, the binarization of the eyebrow image, the angle detection processing using a Gabor filter, and the subsequent calculation of the eyebrow feature score may be performed on separate servers.

[0069] Of the inventions described in the claims of this application, the invention described as "information processing method" is one in which each step is performed automatically by at least one device such as a computer through information processing by software, and not by a human using a computer or other device. In other words, the "information processing method" is an information processing method using computer software, and not a method in which a human operates a computer as a calculating tool. [Explanation of Symbols]

[0070] 11…CPU 18...Storage section 19… Communications Department 31…User Information Database 32…Eyebrow Image Database 33…Eyebrow Feature Database 34…Eyebrow Evaluation Information Database 61…Hair Alignment Heatmap 62…Hair density heatmap 63…Recommended Cosmetics Information 100...Eyebrow Makeup Support Information Server 200... User terminals

Claims

1. Obtain an eyebrow image including the user's eyebrows, From the aforementioned eyebrow image, a feature quantity indicating the condition of each individual eyebrow hair included in the eyebrow area is calculated. Based on the calculated features, eyebrow evaluation information is generated that evaluates the user's eyebrows. Output the eyebrow evaluation information generated above. control unit An information processing system equipped with the following features.

2. The control unit calculates a score as the feature quantity that represents one or more selected from the following: the evenness of the eyebrow hairs, the sparseness of the density, the thickness of the hairs, the curvature, and the angle of the hair flow. The information processing system according to claim 1.

3. The control unit generates and outputs a heatmap of the entire eyebrow based on the score as eyebrow evaluation information. The information processing system according to claim 2.

4. The control unit adds annotations to the portion of the heatmap corresponding to a score above a predetermined value. The information processing system according to claim 3.

5. The control unit identifies the eyebrow area from the eyebrow image, binarizes the eyebrow area to detect multiple pixels representing the state of each individual eyebrow hair, and applies a predetermined filter to the pixels to estimate the angle of each eyebrow hair represented by each pixel, thereby detecting the state of each individual eyebrow hair. The information processing system according to claim 1.

6. The control unit, Makeup information related to eyebrow makeup is stored for each of the aforementioned feature quantities. As eyebrow evaluation information, the makeup information corresponding to the calculated feature quantity is output. The information processing system according to claim 1.

7. The control unit calculates the feature quantities for the eyebrow images before and after makeup application, and outputs the makeup information. The information processing system according to claim 6.

8. The control unit, The aforementioned makeup information stores cosmetic information indicating cosmetics corresponding to the aforementioned feature quantities. Output the cosmetic information corresponding to the calculated feature quantities. The information processing system according to claim 6.

9. The control unit generates and outputs information indicating the impression of the user's eyebrows based on the calculated score, as eyebrow evaluation information. The information processing system according to claim 2 or 3.

10. The control unit generates information indicating the impression of the eyebrows from the score of the eyebrow tail region or the central region between the eyebrow tail and the eyebrow head region. The information processing system according to claim 9.

11. Obtain an eyebrow image including the user's eyebrows, From the aforementioned eyebrow image, a feature quantity indicating the condition of each individual eyebrow hair included in the eyebrow area is calculated. Based on the calculated features, eyebrow evaluation information is generated that evaluates the user's eyebrows. Output the eyebrow evaluation information generated above. Information processing methods.

12. In an information processing device, The steps include obtaining an eyebrow image that includes the user's eyebrows, The steps include: calculating a feature quantity from the aforementioned eyebrow image that indicates the condition of each individual eyebrow hair included in the eyebrow area; The steps include generating eyebrow evaluation information that evaluates the user's eyebrows based on the calculated feature quantities, The steps include outputting the generated eyebrow evaluation information, A program that executes the command.

Images