Estimation method, estimation apparatus, estimation system, and program

MYPI2025006574A0Undetermined Publication Date: 2025-01-07KAO CORP
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
MYPI2025006574
Authority / Receiving Office
MY · MY
Patent Type
Applications
Current Assignee / Owner
Priority Date
2024-03-29
Filing Date
2024-07-05
Publication Date
2025-01-07

AI Technical Summary

Technical Problem

Existing methods fail to effectively diagnose the state of a cosmetic coating film on the skin after application, limiting the understanding of its uniformity and effectiveness.

Method used

An estimation method using a skin condition index and mathematical models to predict the formation state of a cosmetic coating film without applying the cosmetic, by acquiring skin characteristics and correlating them with the coating film's formation state, utilizing UV reflectance and machine learning algorithms.

Benefits of technology

Enables accurate estimation of the cosmetic coating film's formation state and its UV protection properties, allowing users to assess the film's quality and expected effectiveness without direct application, improving user satisfaction and product suitability.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure PI2025006574_DRAWING_001
    Figure PI2025006574_DRAWING_001
  • Figure PI2025006574_DRAWING_002
    Figure PI2025006574_DRAWING_002
  • Figure PI2025006574_DRAWING_003
    Figure PI2025006574_DRAWING_003
Patent Text Reader

Abstract

An estimation method includes acquiring skin condition indicators indicating skin characteristics of a user and estimating, by using the acquired skin condition indicators, a formation state of a coating film of a composition when assuming that a predetermined composition is applied to a skin of the user. (Fig. 4)
Need to check novelty before this filing date? Find Prior Art

Description

Estimation method, estimation device, estimation system, and program

[0001] The present invention relates to a method for estimating the state of a coating of a composition when the composition is applied to a user's skin.

[0002] There is a system that diagnoses the skin or scalp from medical interview data and image data of keratin and / or sebum (Patent Document 1).

[0003] JP 2018-97899 A

[0004] Incidentally, when a user applies a composition, for example, a cosmetic, to the skin, if the cosmetic forms a uniform coating, the ingredients contained in the cosmetic spread evenly over the skin, making it easier for the cosmetic to exert its full effects, so whether the cosmetic has formed a sufficient coating is an item of great interest to users. However, while Patent Document 1 was able to diagnose the skin or scalp from interview data and image data, it did not diagnose the state of the cosmetic coating when the cosmetic is applied.

[0005] The present invention has been made in consideration of the above-mentioned problems, and relates to a method for estimating the formation state of a coating film of a composition that would be formed on the skin when a specified composition is applied, without applying the specified composition to the user's skin.

[0006] The present invention relates to an estimation method for estimating the state of a coating film of a composition when a predetermined composition is applied to the skin of a user, by acquiring a skin condition index that indicates the skin characteristics of the user and using a mathematical model that indicates the relationship between the acquired skin condition index and the state of a coating film of the composition when the predetermined composition is applied to the skin of the user.

[0007] The present invention also relates to an estimation device that includes a skin condition index that indicates a user's skin characteristics, a memory means that stores information that indicates the correlation between the skin condition index and the state of a coating film of a specified composition when the specified composition is applied to the user's skin, a skin condition acquisition means that acquires the skin condition index, and a coating film estimation means that references the memory means and uses the acquired skin condition index to estimate the state of a coating film of the composition when the specified composition is applied to the user's skin.

[0008] The present invention also relates to an application program for operating an estimation device that estimates the state of a coating of a composition when a predetermined composition is applied to a user's skin, the application program including a skin condition acquisition process that acquires a skin condition index that indicates the user's skin characteristics, and a coating estimation process that uses the acquired skin condition index to estimate the state of a coating of the composition on the user's skin.

[0009] The present invention also relates to an estimation system including: a storage means for storing a skin condition index indicating a user's skin characteristics; information indicating the correlation between the skin condition index and the state of a coating film of a specified composition when the specified composition is applied to the user's skin; a skin condition acquisition means for acquiring the skin condition index; and a coating film estimation means for referencing the storage means and using the acquired skin condition index to estimate the state of a coating film of the composition when the specified composition is applied to the user's skin.

[0010] The method provided by the present invention makes it possible to estimate the state of formation of a coating of a composition when a predetermined composition is applied to a user's skin.

[0011] 2A and 2B are conceptual diagrams illustrating the process of acquiring a skin condition index in embodiment 1.

[0034] FIG. 2B is a conceptual diagram illustrating the process of acquiring the reflectance of skin to which a predetermined cosmetic has been applied in embodiments 1 and 2. (a) is a facial image of bare skin photographed in FIG. 2-1, and (b) is a facial image of a face to which a cosmetic has been applied photographed in FIG. 2-1. (a) is a conceptual diagram illustrating the process of irradiating bare skin with a 320 nm wavelength in the UVB region, and (b) is a conceptual diagram illustrating the process of irradiating skin to which a cosmetic has been applied with a 320 nm wavelength in the UVB region. (a) shows the results of predicting whether the quality of the cosmetic film formation state falls into a low or high group using the coating film estimation mathematical model 1, and (b) is a diagram illustrating the accuracy rate of the predicted group and the actual group using the coating film estimation mathematical model 1.

[0035] FIG. 2C is a conceptual diagram illustrating the process of acquiring a skin image (bare skin image) in embodiments 2 and 3. 1A shows the results of predicting whether the quality of the coating film formation state of a cosmetic product will fall into the low or high group using the coating film estimation mathematical model 2, and FIG. 1B shows the degree of agreement, as an accuracy rate, between the group predicted using the coating film estimation mathematical model 2 and the actual group. This is an image diagram of obtaining an evaluation value for a comprehensive evaluation of skin to which a predetermined cosmetic product has been applied in embodiment 3. This is a diagram of predicting whether the quality of the coating film formation state of a cosmetic product will fall into the low or high group using the coating film estimation mathematical model 3, and FIG. 1B shows the degree of agreement, as an accuracy rate, between the group predicted using the coating film estimation mathematical model 3 and the actual group. This is a diagram for estimating the effects of cosmetics 1 to 3, assuming that the cosmetics 1 to 3 are applied. This is a block diagram of an estimation device. This is a block diagram of an estimation device. This is a block diagram of an estimation system. This is a block diagram of an estimation system. (a-1) to (a-3) are examples of display forms of skin information classification images, (b-1) to (b-3) are examples of display forms of composition classification images, (c-1) is an example of display forms of skin information classification images and composition classification images, and (d-1) and (d-2) are examples of display forms of skin information classification images and composition classification images. A diagram showing the results of a comparison test of the UV protection effects of cosmetics C to E. A diagram showing the results of another comparison test of the UV protection effects of cosmetics C to E. A flowchart showing the flow of a process for presenting skin type characteristic information and cosmetic score information based on skin images by an estimation device or estimation system.1 is a diagram showing an example of skin type characteristic information generated and stored by an estimation device or an estimation system, a diagram showing an example of score information related to the UV protection effect of cosmetics for each skin type generated and stored by an estimation device or an estimation system, and a diagram showing an example of skin type characteristic information and cosmetic score information displayed on a user's information processing terminal by an estimation device or an estimation system.

[0012] Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings. Note that the drawings of the present embodiments are intended to explain the technical concept, configuration, and operation of the present invention, and are not intended to specifically limit the configuration. In addition, in all drawings, similar components are designated by similar reference numerals, and duplicated descriptions will be omitted as appropriate.

[0013] An outline of the estimation method of this embodiment (hereinafter sometimes referred to as the present method) will be described. The estimation method of this embodiment acquires a skin condition index indicating a user's skin characteristics, and estimates the state of a composition film formed when a predetermined composition is applied to the user's skin using a mathematical model indicating the relationship between the acquired skin condition index and the state of a composition film formed when a predetermined composition is applied to the user's skin. The "skin condition index indicating the user's skin characteristics" is an index indicating the skin characteristics of the user's bare skin, i.e., skin to which a predetermined composition or a predetermined cosmetic has not been applied, or skin after face washing. Here, "skin characteristics" refer to the nature of skin, such as skin types such as dry skin, normal skin, oily skin, and combination skin, and an index indicating these skin characteristics is a "skin condition index." Examples of such indices include stratum corneum moisture content, moisture evaporation rate, skin viscoelasticity, softness such as skin flexibility, contact angle, color, melanin content, melanin density, skin temperature, moisture content, moisture / oil balance, surface shape, texture, wrinkles, acne, and moles, but also include skin impressions indicating skin conditions such as skin age, makeup feel, masculinity / femininity, makeup smudge rate, and powdery feel. In addition to the commonly known skin types described above, skin types can be classified as appropriate based on the above skin condition index. Furthermore, skin types are classified based on predetermined elements included in the skin condition index (e.g., the three elements of "texture," "moisture / oil balance," and "softness"). Any method for classifying skin types may be used. For example, conditions for classifying skin into each skin type may be predetermined, such as when the value of a specific element among the values ​​of the three elements is equal to or greater than a specific value, when all elements are equal to or greater than a specific value, or when the value of a specific element is equal to or greater than a specific value and the values ​​of the other elements are equal to or less than a specific value. Alternatively, for example, five clusters may be created by cluster analysis based on the values ​​of the three elements, "texture," "moisture / oil balance," and "softness," and a corresponding skin type may be associated with each of the created clusters. The values ​​of the three elements included in the user's skin condition index may be analyzed to determine which cluster the user belongs to, and the skin may be classified into the corresponding cluster. Note that the above three elements are merely examples, and the types and number of elements are not limited to these."User's skin" refers to the soft tissue on the surface of a living body, regardless of the part of the body, such as the face, arms, or hands. "Specified composition" refers to a composition intended to be applied to the skin, and broadly encompasses, for example, cosmetics known as lotions, skin lotions, creams, and emulsions, as well as quasi-drugs and pharmaceuticals. Specific examples include, but are not limited to, skin care cosmetics such as lotions, skin lotions, creams, serums, massage packs, and lip balms; makeup cosmetics such as foundations, makeup bases, liquid foundations, oil-based foundations, powder foundations, concealers, color control, eye shadows, blushers, lipsticks, lip glosses, lip liners, and body décolleté products; UV protection cosmetics such as sunscreen emulsions, sunscreen gels, and sunscreen creams; bath cosmetics such as bath oils and bath additives; and ointments containing antibacterial, anti-itch, and anti-inflammatory ingredients. A "composition coating film" refers to a coating film formed on skin by applying a specific composition to the skin. As will be described in detail later, even when the same amount of the same composition is applied, the state of the composition coating film formed varies depending on the condition of the skin to which it is applied. Furthermore, even when the same amount of the composition is applied to the same skin, the state of the composition coating film formed varies depending on the type (components) of the composition and the amount applied. The "state of coating film formed" refers to how the composition coating film is formed on the skin, and is evaluated by the thickness of the coating film formed, the unevenness of the thickness of the coating film formed, and the uniformity of the coating film formed. For example, when the composition to be applied contains a color, it refers to a state in which the composition coating film is formed without uneven color; when the composition to be applied contains particles, it refers to a state in which the composition coating film is formed with uniform particles; when the composition to be applied contains an ultraviolet absorber, it refers to a state in which the composition coating film absorbs ultraviolet light regardless of the position; and when the composition to be applied contains an ultraviolet scattering agent, it refers to a state in which the composition coating film is formed without ultraviolet light regardless of the position. "Estimating" means estimating the state of a coating film of a composition that would be formed if a specified composition were applied without applying the specified composition to the user's skin, and the estimated results can be output in any form, such as numerical output, graphical output, or simulation image output.A "skin information classification image" is any image showing skin types classified based on the skin condition index. A "composition classification image" is any image showing composition classifications classified based on composition characteristics. "Composition characteristics" are not particularly limited as long as they are factors related to the state of formation of a composition coating, and examples include the composition's formulation, physical properties such as wettability, viscosity, and color. The skin information classification image and composition classification image are each created based on shape, pattern, color, or shade, or a combination of these, and the estimated results can be output by combining these images, such as by overlaying them.

[0014] When creating the coating film mathematical model prepared in this embodiment, the specific composition applied to the subject's skin was a cosmetic containing at least one of a component that absorbs wavelengths in the ultraviolet range (hereinafter sometimes referred to as an "UV absorber") and a component that scatters wavelengths in the ultraviolet range (hereinafter sometimes referred to as an "UV scattering agent"). Here, "added cosmetic" includes not only a cosmetic containing at least one of an UV absorber or an UV scattering agent already added (i.e., containing these components), but also a cosmetic containing no such component but to which a predetermined proportion of the component has been added. This makes it possible to estimate the state of a cosmetic coating film formed when a cosmetic containing no components that absorb and / or scatter wavelengths in the ultraviolet range is applied to the user's skin. In this embodiment, for example, a cosmetic containing a W / O cosmetic (water-in-oil cosmetic) or an O / W cosmetic (oil-in-water cosmetic) to which an UV absorber or a UV scattering agent has been added was used. Therefore, when a cosmetic containing an ultraviolet absorber or an ultraviolet scattering agent is applied to a user's skin, the UV protection provided by the cosmetic can be estimated by using the estimated results of the coating film formed on the skin of the cosmetic. When creating a coating film mathematical model, the cosmetic may contain only an ultraviolet absorber, only an ultraviolet scattering agent, or both an ultraviolet scattering agent and an ultraviolet absorber. In these cases, the UV protection provided by the cosmetic can be estimated based on the estimated results. Some cosmetic products containing an ultraviolet absorber or an ultraviolet scattering agent have a clearly indicated index of UV protection (a publicly-disclosed UV protection value). The most widely known index of UV protection is the Sun Protection Factor (SPF) for UVB rays, and the UV protection effect is expressed as an SPF value (e.g., "SPF 30"). Furthermore, for ultraviolet rays in the UVA region, PFA (Protection Factor of UVA) or UVAPF (UVA Protection factor of product) is used.When evaluating the UV protection properties of a cosmetic product, evaluation may be performed using a clearly indicated index indicating UV protection properties. In this embodiment, the specified composition for which the coating film formation state is estimated is a cosmetic product to which at least one of a component that absorbs wavelengths in the UV region or a component that scatters wavelengths in the UV region has been added, and the estimated coating film formation state of the composition is described as the coating film formation state of the cosmetic product. Furthermore, this description will explain how to estimate whether the cosmetic product can exhibit its intended functions (for example, whether the desired UV protection function can be expected) based on the estimated coating film formation state of the cosmetic product.

[0015] First Embodiment As shown in FIG. 1 , the first embodiment is a method for measuring (acquiring) a skin condition index on a user's skin (bare skin) using a predetermined measuring device 10, and estimating the state of a coating film formed on the skin by a predetermined cosmetic when the cosmetic is applied based on the measured skin condition index. The state of a coating film formed by the cosmetic is estimated based on the measured skin condition index and a mathematical model created in advance (the mathematical model used for coating film estimation in the first embodiment is referred to as "coating film estimation mathematical model 1"). In the first embodiment, the state of a coating film formed on the skin when the cosmetic A (SPF 50) and the cosmetic B (SPF 50+) are applied as the predetermined cosmetic is estimated. The skin condition index acquired in the first embodiment is a physical property value indicating the skin condition measured on the user's skin using the predetermined measuring device 10. The physical property value includes, for example, stratum corneum moisture content, water evaporation rate, skin viscoelasticity, skin flexibility, and contact angle.

[0016] Figure 1 shows how the amount of water evaporation is measured by placing a contactor on the skin. The skin condition indicators obtained are as follows: - Stratum corneum moisture content: Values ​​measured using a stratum corneum moisture meter (Corneometer, manufactured by Courage+Khazaka) are used. - Water evaporation rate: Values ​​measured using a water evaporation meter (Tewameter, manufactured by Courage+Khazaka) are used. - Skin viscoelasticity: Values ​​measured using a skin viscoelasticity measuring device (Cutometer, manufactured by Courage+Khazaka) are used. - Skin flexibility: Values ​​measured using a skin viscoelasticity measuring device (Cutometer, manufactured by Courage+Khazaka) are used. - Contact angle: Values ​​measured using a contact angle meter (Contact angle meter PCA-11, manufactured by Kyowa Interface Science Co., Ltd.) are used. Note that the above-mentioned measuring devices are merely examples, and values ​​measured using other measuring devices or values ​​calculated by photographing the skin and processing the image may also be used. Thus, in embodiment 1, the skin condition index includes at least one evaluation item of stratum corneum moisture content, moisture evaporation rate, skin viscoelasticity, skin flexibility, and contact angle measured by a specified measuring device.

[0017] Next, we will explain the coating film estimation mathematical model 1. The training data and conditions used to create the coating film estimation mathematical model 1 are as follows: - Specified composition 20: Cosmetic A (SPF 50, formulation W / O) Cosmetic B (SPF 50+, formulation W / O) - Application area: 4 cm x 4 cm - Application amount: 16 mg per 4 cm x 4 cm - Subjects: Cosmetic A was applied to the forehead or cheek of 19 men and women, and Cosmetic B was applied to the forehead or cheek of 20 men and women - Camera used: UV camera 30 - Application method: A trained tester applied the composition evenly - Light source: MAX-303, manufactured by Asahi Spectroscopy - Bandpass filter (320 nm ± 5 nm) - Polarizing plate As shown in Figure 2-1, the specified composition 20 was applied to the skin of the subject, and image data (ultraviolet skin image) of the subject's skin taken with the UV camera 30 under UV irradiation was used. A paint film estimation mathematical model 1 is created from the captured image data using the following procedure.

[0018] 1) Calculating the UV Reflectance of the Coating Film of Each Cosmetic Formed on the Skin A predetermined composition 20 (cosmetic A) was applied to the skin (skin 15) of a subject, and the UV reflectance of the coating film formed on the skin by cosmetic A (referred to as "UV Reflectance A") was calculated. Also, a predetermined composition 20 (cosmetic B) was applied to the skin of a subject, and the UV reflectance of the coating film formed on the skin by cosmetic B (referred to as "UV Reflectance B") was calculated. The calculation method is described below. FIG. 3( a) shows the case where the subject's skin (bare skin) was irradiated with ultraviolet light having a wavelength of 320 nm, which is included in the UVB range (hereinafter referred to as "ultraviolet light"). In the figure, "incident light" represents the irradiated UV light, "specularly reflected light" represents the UV light reflected from the skin surface, and "internal scattered light" represents the UV light that was not reflected from the skin surface, penetrated the skin, diffused within the skin, and emerged from the skin. The intensity of the internal scattered light, from which the specular reflected light was removed, was obtained. This is the internal scattered light intensity of bare skin. 3(b) shows the case where a predetermined composition 20 is applied to the skin of a subject and ultraviolet light is irradiated. In the figure, "incident light" refers to the irradiated ultraviolet light, "specularly reflected light" refers to the ultraviolet light reflected from the surface of the predetermined composition 20 and the ultraviolet light reflected from the surface of the skin, and "internal scattered light" refers to the ultraviolet light that is not reflected from the surface of the predetermined composition 20 and the surface of the skin, penetrates the interior of the skin, spreads within the skin, and emerges from the skin. The intensities of internal scattered light from which specular reflected light is removed when cosmetic A is applied as the predetermined composition 20, and internal scattered light from which specular reflected light is removed when cosmetic B is applied as the predetermined composition 20, are obtained. The internal scattered light intensity of the applied skin when cosmetic A is applied is designated A, and the internal scattered light intensity of the applied skin when cosmetic B is applied is designated B. Then, the internal scattered light intensity of the applied skin when the specified composition 20 is applied is divided by the internal scattered light intensity of the bare skin to calculate the ultraviolet reflectance of the composition present at the site where the specified composition 20 has been applied (internal scattered light intensity A of the applied skin when cosmetic A is applied / internal scattered light intensity of the bare skin = ultraviolet reflectance of the coating film formed by cosmetic A present at the site where cosmetic A has been applied (ultraviolet reflectance A); internal scattered light intensity B of the applied skin when cosmetic B is applied / internal scattered light intensity of the bare skin = ultraviolet reflectance of the coating film formed by cosmetic B present at the site where cosmetic B has been applied (ultraviolet reflectance B)).In this way, by removing specularly reflected light and calculating UV reflectance using the intensity of internally scattered light, it is possible to accurately estimate the application state of a coating film formed on the skin (the formation state of the coating film). Here, polarizing plates are attached to the light source and UV camera, UV light is irradiated onto skin to which cosmetic A (or cosmetic B) has been applied, the specularly reflected light is removed, and the reflected internally scattered light is captured by the UV camera 30, thereby measuring the internal scattering intensity. In this embodiment, the UV reflectance at a wavelength of 320 nm is calculated, taking into account that the wavelength range of the UVB region is 320 to 280 nm. However, the wavelength range is not limited to this. For example, when estimating the formation state of a coating film formed on the skin by a cosmetic product and estimating the UV protection effect in the UVA region from the estimation results, the UV reflectance may be calculated using UV light with a wavelength of 380 to 320 nm, for example, UV light with a wavelength of 350 nm. 2) Dividing into two groups according to UV reflectance The calculated UV reflectance of the coating film formed on the skin by each cosmetic was sorted in order of UV reflectance, and each subject was divided into two groups: those with high UV reflectance (50%) and those with low UV reflectance (50%). The group with high UV reflectance was designated the "group with low quality of cosmetic coating film formation," and the group with low UV reflectance was designated the "group with high quality of cosmetic coating film formation." Generally, when UV reflectance is high, the cosmetic coating film is thin, and when UV reflectance is low, the cosmetic coating film is thick. This difference occurs when the area to which the cosmetic is applied and the amount of cosmetic applied are constant, as in this embodiment. For example, if there are depressions on the skin surface to which the cosmetic is applied, such as wrinkles or acne scars, the cosmetic will be applied in a way that fills the depressions, resulting in a thin cosmetic coating film formed on the skin. This is because the state of the cosmetic coating film formation is affected by the condition of the skin to which it is applied. Therefore, the UV reflectance of the coating film formed on the skin by each cosmetic calculated for each subject will differ (they will be ranked). Note that while the shape of the skin surface has been described as a factor that affects the state of formation of a cosmetic coating film, this is merely one example, and other skin conditions and differences in skin physical properties also affect the state of formation of a cosmetic coating film. 3) Measuring the skin condition index of the subject The above-mentioned skin condition indexes (stratum corneum moisture content, water evaporation rate, skin viscoelasticity, skin flexibility, and contact angle) are measured for the above subject using a specified measuring device.4) Creating training data to be used in machine learning Training data for creating a coating film estimation mathematical model 1 is created using the results of the division into two groups in 2) and the measurement results in 3). 5) Creating a coating film estimation mathematical model 1 A standardization process is performed on each evaluation value, and the most appropriate model is selected from multiple classification models (e.g., naive Bayes (NB), logistic regression (LR), linear discriminant analysis (LDA), random forest (RF), gradient boosting (GB), support vector machine (SVM), Gaussian process (GP)) to create a prediction model, and the prediction model is used to predict whether the cosmetic coating film formation state falls into a low or high group. The degree of agreement between the predicted group and the actual group is calculated as the accuracy rate. The generalization performance of the classification models was evaluated using leave-one-out cross-validation (LOOCV), and the calculation model with the highest accuracy rate was designated as the optimal model: coating film estimation mathematical model 1. In this embodiment, classification model GB was used as coating film estimation mathematical model 1 for cosmetic A, and classification model LDA was used as coating film estimation mathematical model 1 for cosmetic B.

[0019] Figure 4(a) shows the results of predicting whether the quality of the film formed on the skin by a cosmetic product falls into the low or high group using the coating film estimation mathematical model 1, as well as the actual results, and Figure 4(b) shows the results of calculating the accuracy rate, which is the degree of agreement between the predicted group and the actual group using the coating film estimation mathematical model 1. Figures 4(a) and 4(b) show that a high accuracy rate can be obtained when the coating film formation state formed on the skin by a cosmetic product is predicted using the coating film estimation mathematical model 1. Therefore, by using the user's skin condition index obtained using a specified measuring device and the coating film estimation mathematical model 1, it is possible to estimate the coating film formation state of a specified cosmetic without applying the cosmetic to the skin.As a result, even without applying the specified cosmetic (cosmetics containing an ultraviolet absorber or an ultraviolet scattering agent) to the skin, it is possible to estimate the coating film formation state of the cosmetic that will be formed on the skin when the specified cosmetic is applied to the user's skin (the quality of the coating film formed by the cosmetic on the skin), and this makes it possible to evaluate the extent to which an effect based on the function possessed by the specified cosmetic (for example, the ultraviolet protection function in the case of cosmetics containing an ultraviolet absorber or an ultraviolet scattering agent) can be expected.

[0020] As described above, in the first embodiment, a mathematical model (film estimation mathematical model 1) showing the relationship between the skin condition indexes and the UV reflectance of a film formed by a cosmetic on the skin is created using skin condition indexes (e.g., stratum corneum moisture content, water evaporation rate, skin viscoelasticity, skin flexibility, and contact angle measured by the measuring device 10) of each of a plurality of subjects (e.g., 19 to 20 men and women) and UV reflectance of a film formed by a cosmetic on the skin calculated from UV skin images of the plurality of subjects (e.g., images shown in FIG. 2-2 taken with the imaging device shown in FIG. 2-1). Using the created film estimation mathematical model 1 and the user's skin condition indexes (e.g., stratum corneum moisture content, water evaporation rate, skin viscoelasticity, skin flexibility, and contact angle) measured by the measuring device 10, it is possible to estimate the state of a film formed by the cosmetic on the skin when the cosmetic is hypothesized to be applied to the user's skin, and to estimate and evaluate the functions of the cosmetic.

[0021] Furthermore, because the state of the coating film formed on the skin by the cosmetic was estimated using the reflectance of ultraviolet light with a wavelength of 320 nm in the UVB wavelength range, it is possible to directly estimate and evaluate the function of the cosmetic (for a cosmetic with UVB protection function, the UVB protection function) based on the state of the coating film formed on the skin by the cosmetic. Specifically, for example, in the case of cosmetic A (SPF 50), the UV reflectance of each of multiple subjects (19 people) was calculated, and a standard value for the calculated UV reflectance was identified. In this embodiment, the "standard value" refers to the UV reflectance that is located in the middle when the UV reflectances are sorted in order of UV reflectance, as described in "2) Dividing into two groups according to UV reflectance." If the state of formation of the coating film (ultraviolet reflectance) formed on the skin of the subject by the cosmetic estimated by the above-mentioned method is a standard value, it can be expected that cosmetic A will have the desired effect (equivalent to SPF 50), if it is higher than the standard value, it can be inferred that the desired effect of cosmetic A (equivalent to SPF 50) can be fully expected, and if it is lower than the standard value, it can be inferred that the desired effect of cosmetic A (equivalent to SPF 50) cannot be expected very well. In this way, the user can determine whether or not a cosmetic is suitable for their skin based on the estimated state of formation of the coating film formed on the skin by the cosmetic.

[0022] Generally, as time passes after a predetermined cosmetic product is applied to the skin, the state of the film formed by the cosmetic product on the skin changes. This is due to various factors, such as external factors such as humidity, temperature, and wind, factors due to the skin characteristics of the subject (user), and the subject (user)'s constitution (whether the subject (user) sweats easily, whether the skin surface moves a lot (in the case of the face, whether the facial expression changes a lot)). Therefore, the film estimation mathematical model 1 may be configured to estimate the state of the film formed by the cosmetic product on the skin in a first time period after the application of the predetermined cosmetic product to the user's skin (hereinafter referred to as the "first film formation state"), and the state of the film formed by the cosmetic product on the skin in a second time period after the first time period (hereinafter referred to as the "second film formation state").

[0023] A method for estimating the first and second formation states will now be described. Here, the first time period is, for example, one minute after application, and the second time period is, for example, eight hours after application. Then, the coating film estimation mathematical model 1 can be created for each time period. Specifically, the above-described step "1) Calculating the UV reflectance of the coating film of each cosmetic formed on the skin" can be performed by calculating the UV reflectance of each cosmetic one minute after application of a given cosmetic to the skin of multiple subjects and eight hours after application of a given cosmetic to the skin of multiple subjects, and then performing the above-described steps "2) Dividing into two groups based on UV reflectance" through "5) Creating the coating film estimation mathematical model 1." This allows for the creation of a coating film estimation mathematical model 1 that estimates the formation state of a coating film formed on the skin by a cosmetic one minute after application (first formation state), and a coating film estimation mathematical model 1 that estimates the formation state of a coating film formed on the skin by a cosmetic eight hours after application (second formation state). In this way, a coating film estimation mathematical model 1 is created that estimates the formation state of a coating film formed on the skin by a cosmetic one minute after application (first formation state), and a coating film estimation mathematical model 1 is created that estimates the formation state of a coating film formed on the skin by a cosmetic eight hours after application (second formation state). By using the two created coating film estimation mathematical models 1 and a user's skin condition index obtained using a predetermined measuring device, it is possible to estimate the formation state of a coating film formed on the skin by a cosmetic a predetermined time after application, without applying the predetermined cosmetic to the user's skin and even before a predetermined time has passed since application (in this embodiment, a first time period: 1 minute or a second time period: 8 hours). In this way, it is possible to estimate the formation state of a coating film formed on the skin by a predetermined composition (e.g., cosmetic A, cosmetic B) in a first time period after application (e.g., 1 minute after application) and the formation state of a coating film formed on the skin by the composition in a second time period after the first time period (e.g., 8 hours after application) (second formation state). It is not necessary to estimate both the first and second formation states, and only one of them may be estimated depending on the purpose. It is also possible to add a third time period, a fourth time period, etc.

[0024] Furthermore, by using the first and second formation states, it is possible to estimate the effects that can be expected in the first time period and the second time period, respectively, with respect to the effects that the applied composition claims. In this way, a given cosmetic is a cosmetic (e.g., cosmetic A, cosmetic B) to which an ultraviolet absorber or an ultraviolet scattering agent has been added. By estimating the first and second formation states, it is possible to estimate and evaluate the function of the cosmetic (evaluate the extent to which the effect of the cosmetic can be expected). Therefore, for example, if one wishes to estimate and evaluate the UV protection effect when a cosmetic is applied before going out and then engaged in activities eight hours later in a situation where UV exposure is likely, it is sufficient to estimate the state of the film formed by the cosmetic on the skin in the second time period. Alternatively, if one wishes to evaluate the UV protection effect when a cosmetic is applied before going out and then engaged in activities eight hours later in a situation where UV exposure is likely, it is sufficient to estimate both the state of the film formed by the cosmetic on the skin in the first and second time periods and use both to perform the estimate and evaluation. In this way, it is possible to use the coating film estimation mathematical model 1 appropriately depending on the purpose.

[0025] <Embodiment 2> Embodiment 2 is a method for estimating the formation state of a coating film formed on skin when a predetermined composition is applied, based on a skin condition index generated using a mathematical model from an image of a user's skin (bare skin) and a mathematical model showing the relationship between this skin condition index and the UV reflectance when a predetermined composition is applied to the skin. In this embodiment, the mathematical model used to generate the skin condition index is referred to as a "skin condition index mathematical model." Furthermore, the mathematical model showing the relationship between the skin condition index obtained in Embodiment 2 and the UV reflectance of a coating film of the composition when a predetermined composition is applied to the skin is referred to as a "coating film estimation mathematical model 2." In Embodiment 2, the "skin condition index mathematical model" and the "coating film estimation mathematical model 2" are used to estimate the formation state of a coating film formed on the user's skin by a composition, without applying the composition to the skin. In embodiment 2, assuming that cosmetic C (SPF50+, formulation O / W) is applied as a predetermined composition, the state of a coating film formed on the skin is estimated using two mathematical models: a "skin condition index mathematical model" and a "coating film estimation mathematical model 2." The skin condition index mathematical model and coating film estimation mathematical model 2 will be described below.

[0026] The "skin condition index mathematical model" is a trained discrimination model that is trained based on multiple training data and is trained to acquire at least the following seven skin condition indices: Overall evaluation (overall skin condition) Skin color (skin whiteness) Makeup appearance (whether the skin appears to have been made up) Skin age (an index indicating the degree of skin aging) Masculinity / femininity (whether the skin texture resembles that of a man or a woman) Makeup smudge level (an index indicating the degree of makeup smudge) Powdery feel (an index indicating the smoothness of the skin) These seven skin condition indices are acquired as the skin condition indices in embodiment 2. These skin condition indices can be acquired by photographing the user's skin (bare skin) with an imaging device 40 and based on the captured skin image (bare skin image) and the skin condition index mathematical model, as shown in FIG. 5 . The imaging device 40 used in this embodiment may be any type, and may be an independent digital camera, a video camera, or an imaging device included in a mobile phone, tablet terminal, or personal computer, which are generally referred to as mobile terminals. However, since the user's skin image (bare skin image) is used to determine the appearance or attributes of the skin, it is preferable that the imaging device 40 be a camera capable of capturing color images that capture visible light. In this way, the skin condition index is an evaluation item (the above seven items) obtained using a skin image (bare skin image) captured of the user's skin and a skin condition index mathematical model that shows the relationship between the skin condition index.

[0027] Here, a method for creating a skin condition index mathematical model will be described. The training data used to create the skin condition index mathematical model is a combination of bare skin facial images of multiple people, facial images with a predetermined cosmetic applied, and correct answer information indicating the skin condition of the human faces reflected in each facial image. The facial images may include the target subject's face to an extent that allows for analysis of the skin condition of the estimation item, and may include the entire or part of the target subject's face. The acquired facial images may include parts other than the target subject's face, such as hair or neck, or the background. Furthermore, as long as the skin condition of the human face reflected in the facial images can be estimated, they may be color images or grayscale images. Furthermore, they may be normalized to a predetermined rectangular shape, or may include facial images with an image size or shape different from the predetermined image size of the predetermined rectangular shape. The predetermined cosmetic may be any type, and may or may not contain an ultraviolet absorber or an ultraviolet scattering agent. In this embodiment, a foundation is used. The correct answer information is information indicating the skin condition of a human face obtained by a professional evaluator visually evaluating the corresponding face image or the subject of the face image itself using a measuring instrument, etc. In this embodiment, information on the above-mentioned skin condition indexes (seven items) obtained by visually evaluating face images by five professional evaluators was used. Overall evaluation (overall skin condition): Overall skin condition was evaluated on a 7-point scale. Skin color (skin whiteness): The whiteness of the skin was evaluated on a 7-point scale. Makeup appearance (appears to be made-up skin): Evaluation of whether the skin appears to be made-up skin. Skin age (an index indicating the degree of skin aging): The degree of skin aging was evaluated on a 5-point scale. Masculinity / femininity (whether the skin texture resembles that of a man or woman): Evaluation of whether the skin texture resembles that of a man or woman. Makeup smudge (an index indicating the degree of makeup smudge): Evaluation of whether the makeup smudged to a high degree. Powdery feel (an index indicating the smoothness of the skin): Evaluation of whether the skin has a smooth feel. In this embodiment, the above seven items were evaluated for both bare skin images and face images with a specified cosmetic applied. Next, for each acquired face image, the position coordinates (predetermined position coordinates) of multiple predetermined locations in the face region of the human face captured in the target face image are identified. The predetermined position coordinates include at least the position coordinates of the shape feature points of the face region.Next, the position of each pixel of the target facial image is converted so that the facial area takes on a predetermined rectangular shape based on the identified multiple predetermined position coordinates, and the position of each pixel of the original facial image corresponds to the input rule of the skin condition index mathematical model. Then, using training data including the converted facial image, a skin condition index mathematical model is created. While the learning algorithm is not limited, in this embodiment, deep learning was used. Thus, the "skin condition index mathematical model" used in this embodiment was created using both a bare facial image and a facial image with a predetermined cosmetic applied, and the evaluation results obtained by evaluating the above seven items for each of the images. In this embodiment, the above-described skin condition indices (seven items) are suitable for estimating the state of a coating film formed on the skin by a cosmetic containing an ultraviolet absorber or an ultraviolet scattering agent when the cosmetic is applied, and therefore a skin condition index mathematical model for calculating these indices was used. However, when estimating the state of a coating film formed on the skin by a cosmetic other than a cosmetic containing an ultraviolet absorber or an ultraviolet scattering agent when the cosmetic is applied, any skin condition index mathematical model capable of calculating a skin condition indices suitable for estimating the state of a coating film formed on the skin by the cosmetic can be used. Furthermore, the "skin condition index mathematical model" may be either or both of a skin condition index mathematical model (bare skin) created using a face image of bare skin and evaluation results obtained by evaluating the above seven items on the bare skin face image, and a skin condition index mathematical model (application) created using a face image with a predetermined cosmetic applied and evaluation results obtained by evaluating the above seven items on the face image with the predetermined cosmetic applied, and the skin condition index (seven items) may be obtained using either or both of these. However, in embodiment 2, since a user's skin image (bare skin image) is used when obtaining the user's skin condition index, it is preferable to include at least a skin condition index mathematical model (bare skin) that includes a bare skin face image and evaluation results obtained by evaluating the bare skin face image for seven items.

[0028] Next, the coating film estimation mathematical model 2 will be described. The training data and conditions used to create the coating film estimation mathematical model 2 are as follows: Predetermined composition 20: Cosmetic C (SPF 50+, formulation: O / W) Application area: 4 cm x 4 cm Application amount: 16 mg per 4 cm x 4 cm Subjects: Foreheads or cheeks of 20 women Camera used: UV camera 30 Application method: A trained tester applies the coating evenly Light source: MAX-303, manufactured by Asahi Spectroscopy Bandpass filter (320 nm ± 5 nm) Polarizer As shown in Figure 2-1, the predetermined composition 20 is applied to the skin of a subject, and image data (ultraviolet skin image) of the subject's skin under UV irradiation is captured by the UV camera 30. The coating film estimation mathematical model 2 is created from the captured image data using the following procedure. The method for acquiring the UV reflectance of the predetermined composition 20 (cosmetic C) is the same as in embodiment 1.

[0029] 1) Calculating the UV Reflectance of a Cosmetic Coating Film Formed on Skin When a predetermined composition 20 (cosmetic C) is applied to a subject's skin (skin 15), the UV reflectance of the coating film formed by cosmetic C on the skin (referred to as "UV Reflectance C") is calculated. The calculation method is described below. FIG. 3(a) shows the case where a subject's skin (bare skin) is irradiated with ultraviolet light having a wavelength of 320 nm (hereinafter referred to as "ultraviolet light") included in the UVB region. In the figure, "incident light" represents the irradiated UV light, "specularly reflected light" represents the UV light reflected from the skin surface, and "internal scattered light" represents the UV light that is not reflected from the skin surface, penetrates the skin, spreads within the skin, and emerges from the skin. The intensity of the internal scattered light from which the specular reflected light has been removed is obtained. This is referred to as the internal scattered light intensity of bare skin. FIG. 3(b) shows the case where a predetermined composition 20 is applied to a subject's skin and irradiated with UV light. In the figure, "incident light" refers to the irradiated ultraviolet light, "specularly reflected light" refers to the ultraviolet light reflected from the surface of the specified composition 20 and the surface of the skin, and "internal scattered light" refers to the ultraviolet light that is not reflected from the surface of the specified composition 20 and the surface of the skin, penetrates the skin, spreads within the skin, and emerges from the skin. The intensity of internal scattered light from which specular reflected light has been removed is obtained when cosmetic C is applied as the specified composition 20. This is designated as the internal scattered light intensity C of the applied skin. The ultraviolet reflectance of the composition present at the site where the specified composition 20 has been applied is then calculated by dividing the internal scattered light intensity C of the applied skin when the specified composition 20 has been applied by the internal scattered light intensity C of bare skin (internal scattered light intensity C of applied skin where cosmetic C has been applied / internal scattered light intensity of bare skin = ultraviolet reflectance of the coating film formed by cosmetic C present at the site where cosmetic C has been applied (ultraviolet reflectance C)). In this way, by removing specularly reflected light and calculating the UV reflectance using the intensity of internally scattered light, it is possible to accurately estimate the application state of the coating film formed on the skin (the state of coating film formation). Here, by attaching polarizing plates to the light source and UV camera, UV light is irradiated onto skin to which cosmetic C has been applied, specularly reflected light is removed, and the reflected internally scattered light is photographed with the UV camera 30, thereby making it possible to measure the internal scattering intensity.In this embodiment, the UV reflectance at a wavelength of 320 nm is calculated taking into account that the wavelength range of the UVB region is 320 to 280 nm. However, the wavelength range is not limited to this. For example, when estimating the state of a coating film formed on the skin by a cosmetic product and estimating and evaluating the UVA UV protection effect from the estimation results, the UV reflectance may be calculated using UV light with a wavelength between 380 and 320 nm, for example, UV light with a wavelength of 350 nm. 2) Dividing into Two Groups According to UV Reflectance The calculated UV reflectance of the coating film formed on the skin by each cosmetic product is sorted in order of UV reflectance, and each subject is divided into two groups: one with a high UV reflectance (50%) and one with a low UV reflectance (50%). The group with the high UV reflectance is designated the "group with poor cosmetic film formation," and the group with the low UV reflectance is designated the "group with high cosmetic film formation." The UV reflectance of the coating film formed on the skin by each cosmetic calculated for each subject differs (they are ranked) because the coating film of each cosmetic differs depending on the condition of the skin to which the cosmetic is applied. As explained in embodiment 1, the condition of the skin to which the cosmetic is applied affects the state of the coating film formed by the cosmetic. 3) Measuring the skin condition index of the subject: Skin condition indexes (7 items) are obtained using the above-mentioned skin condition index mathematical model and a captured skin image (bare skin image) of the subject. 4) Creating training data to be used in machine learning: Training data for creating a coating film estimation mathematical model 2 is created using the results of dividing the subjects into two groups in 2) and the results obtained in 3). 5) Creating a coating film estimation mathematical model 2 A standardization process is performed on each evaluation value, and the most appropriate model is selected from multiple classification models (e.g., naive Bayes (NB), logistic regression (LR), linear discriminant analysis (LDA), random forest (RF), gradient boosting (GB), support vector machine (SVM), Gaussian process (GP)) to create a prediction model. The prediction model is used to predict whether the quality of the coating film formation state of the cosmetic falls into a low or high group. The degree of agreement between the predicted group and the actual group is calculated as the accuracy rate.The generalization performance of the classification model was evaluated using leave-one-out cross-validation (LOOCV), and the calculation model with the highest accuracy rate was designated as the optimal model: coating film estimation mathematical model 2. In this embodiment, classification model RF was used as the coating film estimation mathematical model 2 for cosmetic C.

[0030] Fig. 6(a) shows the results of predicting whether the quality of the film formed on the skin by a cosmetic product falls into the low or high group using the coating film estimation mathematical model 2, as well as the actual results, and Fig. 6(b) shows the results of calculating the accuracy rate, which is the degree of agreement between the predicted group and the actual group using the coating film estimation mathematical model 2. Figs. 6(a) and 6(b) show that a high accuracy rate can be obtained when the coating film formation state formed on the skin by a cosmetic product is predicted using the coating film estimation mathematical model 2. Therefore, by using the user's skin condition index estimated using the skin condition index mathematical model and the coating film estimation mathematical model 2, it is possible to estimate the state of formation of a coating film that a specific composition will form on the skin without applying the composition to the skin.Therefore, even without applying the specific composition (a cosmetic product to which an ultraviolet absorber or an ultraviolet scattering agent has been added) to the skin, it is possible to estimate the quality of the state of formation of a coating film that a specific composition will form on the skin when the specific composition is applied to the user's skin.This makes it possible to evaluate the extent to which an effect based on the function of the specific composition (for example, the ultraviolet protection function in the case of a cosmetic product to which an ultraviolet absorber or an ultraviolet scattering agent has been added) can be expected.

[0031] As described above, in the second embodiment, a mathematical model (film estimation mathematical model 2) is created that shows the relationship between the skin condition indexes and the UV reflectance of a coating film of a cosmetic, based on the skin condition indexes (e.g., seven items calculated using the skin images of the subjects and the skin condition index mathematical model) of each of a plurality of subjects (e.g., 20 women) and the UV reflectance of a coating film formed on the skin by the cosmetic calculated from UV skin images of the plurality of subjects (e.g., the images shown in FIG. 2-2 taken with the imaging device shown in FIG. 2-1 ). Using the created film estimation mathematical model 2, the user's skin image (bare skin image), and the user's skin condition indexes (e.g., the above seven items) obtained from the skin condition mathematical model, it is possible to estimate the state of formation of a coating film that the cosmetic will form on the skin when the cosmetic is hypothesized to be applied to the user's skin, and to estimate and evaluate the functions exhibited by the cosmetic.

[0032] Furthermore, as in the first embodiment, the state of formation of the coating film formed by the cosmetic on the skin was estimated using the reflectance of ultraviolet light with a wavelength of 320 nm in the UVB wavelength range. Therefore, it is possible to directly estimate and evaluate the function of the cosmetic (for a cosmetic with UVB protection function, the UVB protection function) based on the state of formation of the coating film formed by the cosmetic on the skin. Specifically, for example, in the case of cosmetic C (SPF50+), the UV reflectance of each of multiple subjects (20 people) was calculated, and a standard value for the calculated UV reflectance was identified. In this embodiment, the "standard value" refers to the UV reflectance that is located in the middle when the UV reflectances are sorted in order of UV reflectance, as described in "2) Dividing into two groups according to UV reflectance." If the state of formation of the coating film (ultraviolet reflectance) formed on the skin of the subject by the cosmetic estimated by the above-mentioned method is a standard value, it can be expected that cosmetic C will have the desired effect (equivalent to SPF 50+), if it is higher than the standard value, it can be inferred that the desired effect of cosmetic C (equivalent to SPF 50+) can be fully expected, and if it is lower than the standard value, it can be inferred that the desired effect of cosmetic C (equivalent to SPF 50+) cannot be expected very well. Therefore, the user can judge whether or not the cosmetic is suitable for their own skin based on the estimated state of formation of the coating film formed on the skin by the cosmetic.

[0033] Furthermore, similarly to embodiment 1, it is possible to estimate the first formation state and the second formation state by creating the coating film estimation mathematical model 2, where the first time period is, for example, one minute after immediately after application, and the second time period is, for example, eight hours after immediately after application. Note that the creation method, similarly to embodiment 1, can be achieved by calculating the UV reflectance of the cosmetic coating film formed on the skin one minute after application of the specified cosmetic to the subject's skin and eight hours after application of the specified cosmetic to the subject's skin, in addition to the step of “1) calculating the UV reflectance of the cosmetic coating film formed on the skin,” as described in embodiment 2, and then performing the steps of “2) dividing into two groups according to the UV reflectance” to “5) creating the coating film estimation mathematical model 2,” thereby creating a coating film estimation mathematical model 2 that estimates the formation state of the coating film formed on the skin by the cosmetic one minute after application (first formation state), and a coating film estimation mathematical model 2 that estimates the formation state of the coating film formed on the skin by the cosmetic eight hours after application (first formation state). In this way, a coating film estimation mathematical model 2 is created that estimates the formation state of a coating film formed on the skin by a cosmetic one minute after application (first formation state), and a coating film estimation mathematical model 2 is created that estimates the formation state of a coating film formed on the skin by a cosmetic eight hours after application (second formation state). By using the two created coating film estimation mathematical models 2 and a user's skin condition index obtained using the skin condition index mathematical model, it is possible to estimate the formation state of a coating film formed on the skin by a cosmetic a predetermined time after application, without applying a predetermined cosmetic to the user's skin and even before a predetermined time has passed since application (in this embodiment, a first time period: 1 minute or a second time period: 8 hours). In this way, it is possible to estimate the formation state of a coating film formed on the skin by a predetermined composition (e.g., cosmetic C) in a first time period after application (e.g., 1 minute after application) and the formation state of a coating film formed on the skin by the composition in a second time period after the first time period (e.g., 8 hours after application) (second formation state). It is not necessary to estimate both the first and second formation states, and only one of them may be estimated depending on the purpose. It is also possible to add a third time period, a fourth time period, etc.

[0034] Furthermore, as in Embodiment 1, by using the first and second formation states, it is possible to estimate the effects that can be expected in the first time period and the second time period, respectively, with respect to the effects that the applied composition claims. In this way, the specified cosmetic is a cosmetic to which an ultraviolet absorber or an ultraviolet scattering agent has been added (e.g., cosmetic C), and it is possible to estimate the first and second formation states and estimate and evaluate the function of the cosmetic (evaluate the extent to which the effect of the cosmetic can be expected) based on the estimated first and second formation states. Therefore, for example, if one wishes to estimate and evaluate the UV protection effect when a cosmetic is applied before going out and then engaged in activities eight hours later in a situation where UV exposure is likely, it is sufficient to estimate the state of the coating film formed on the skin by the cosmetic in the second time period. Alternatively, if one wishes to evaluate the UV protection effect when a cosmetic is applied before going out and then engaged in activities eight hours later in a situation where UV exposure is likely, it is sufficient to estimate both the state of the coating film formed on the skin by the cosmetic in the first and second time periods and use both to perform the estimate and evaluation. In this way, it is possible to use the coating film estimation mathematical model 2 appropriately depending on the purpose.

[0035] <Embodiment 3> Embodiment 3 is a method for estimating the state of a coating film formed on skin by a predetermined composition when the composition is applied, based on a skin condition index generated using a mathematical model from an image of a user's skin (bare skin) and a mathematical model showing the relationship between this skin condition index and the state of a coating film formed by the composition when the predetermined composition is applied to the skin. In this embodiment, the mathematical model used to generate the skin condition index is referred to as a "skin condition index mathematical model" and is the same as the "skin condition index mathematical model" described in Embodiment 2. The mathematical model showing the relationship between the acquired skin condition index and the state of a coating film formed by the composition when the predetermined composition is applied to the skin is referred to as a "coating film estimation mathematical model 3." In Embodiment 3, the "skin condition index mathematical model" and the "coating film estimation mathematical model 3" are used to estimate the state of a coating film formed by the composition on the user's skin without applying the composition to the skin. The skin condition index mathematical model and the coating film estimation model 3 will now be described.

[0036] The "skin condition index mathematical model" is a trained discrimination model that is trained based on multiple training data sets and is trained to acquire at least the following seven skin condition indices, and is similar to the "skin condition index mathematical model" described in embodiment 2: - Overall evaluation (overall skin condition quality) - Skin color (skin whiteness) - Makeup appearance (whether or not the skin appears to have been made up) - Skin age (an index indicating the degree of skin aging) - Masculinity / femininity (whether the skin texture is closer to male or female) - Makeup smudge level (an index indicating the degree of makeup smudge) - Powdery feel (an index indicating the smoothness of the skin) Note that, since the "skin condition index mathematical model" is similar to the "skin condition index mathematical model" described in embodiment 2, it was created using both images of a face with bare skin and an image of a face with a predetermined cosmetic applied, and the evaluation results obtained by evaluating the above seven items for each of the images. A description of how the "skin condition index mathematical model" was created will be omitted.

[0037] Next, the coating film estimation mathematical model 3 will be described. The training data and conditions used to create the coating film estimation mathematical model 3 are as follows: - Predetermined composition 20: Cosmetic D (SPF50+, formulation O / W) Cosmetic E (SPF50+, formulation W / O) - Application area: Whole face - Application amount: 300 mg per whole face - Subjects: Whole faces of 20 women for both Cosmetic D and Cosmetic E - Camera used: Visible light camera - Application method: Subjects applied the composition evenly over their entire faces As shown in FIG. 7 , the predetermined compositions 20 (cosmetic D, cosmetic E) were applied to the skin of the subjects, and image data (applied skin image) captured with a photographing device 40 (smartphone 40) was used. Note that the photographing device 40 (smartphone 40) may be any type, and may be a digital camera, a video camera, or a photographing device included in a mobile phone, tablet terminal, or personal computer, which are commonly referred to as mobile terminals. Preferably, the photographing device is a camera capable of capturing color images using visible light. In this embodiment, the image is taken using a camera mounted on a smartphone. From the captured image data (image of the applied skin), a paint film estimation mathematical model 3 is created in the following manner.

[0038] 1) Obtaining an Evaluation Value for the Overall Applied Skin Evaluation As described above, images of the entire faces of multiple subjects (20 women in this embodiment) to which cosmetic D and cosmetic E have been applied are obtained. An evaluation value for the overall applied skin evaluation is obtained using the obtained images of the entire faces that have been applied and the "skin condition index mathematical model." The "evaluation value for the overall applied skin evaluation" is an evaluation value for the "overall evaluation" among the skin condition indices (the above seven items (overall evaluation, skin color, makeup feel, skin age, masculinity / femininity, makeup smudge level, and powdery feel)) calculated using the obtained images of the entire faces that have been applied and the "skin condition index mathematical model." In this embodiment, the "overall evaluation" calculated using the images of the entire faces that have been applied with cosmetic D (or cosmetic E) and the "skin condition index mathematical model" is referred to as the "overall applied skin evaluation" in order to distinguish it from the "overall evaluation," which is one item among the "skin condition indices" calculated using the user's skin image (bare skin image) and the "skin condition index mathematical model." The evaluation value of the overall skin application evaluation is referred to as the "overall skin application evaluation value." 2) Divide into two groups according to the overall skin application evaluation value The overall skin application evaluation values ​​for each cosmetic calculated for each subject are sorted in order of the overall skin application evaluation value, and the subjects are divided into two groups: those with the highest overall skin application evaluation value (50%) and those with the lowest overall skin application evaluation value (50%). The group with the highest overall skin application evaluation value is designated the "group with a high quality of the cosmetic film formation state," and the group with the lowest overall skin application evaluation value is designated the "group with a low quality of the cosmetic film formation state." 3) Measure the skin condition index of the subject The skin condition index (7 items) is obtained for the subject using the skin condition index mathematical model described in embodiment 2 and an image of the subject's skin (bare skin) taken with a visible light camera. 4) Create training data to be used in machine learning Training data is created using the results of dividing the subjects into two groups in 2) and the results obtained in 3).5) Creating a coating film estimation mathematical model 3 A standardization process is performed on each evaluation value, and the most appropriate classification model is selected from multiple classification models (e.g., naive Bayes (NB), logistic regression (LR), linear discriminant analysis (LDA), random forest (RF), gradient boosting (GB), support vector machine (SVM), Gaussian process (GP)) to create a prediction model. This prediction model is used to predict whether the quality of the coating film formation state of the cosmetic falls into a low or high group. The degree of agreement between the predicted group and the actual group is calculated as the accuracy rate. The generalization performance of the classification model is evaluated using leave-one-out cross validation (LOOCV), and the calculation model with the highest accuracy rate is designated as the optimal model: coating film estimation mathematical model 3. In this embodiment, the coating film estimation mathematical model 3 for cosmetic D uses the classification model NB, and the coating film estimation mathematical model 3 for cosmetic E uses the classification model LDA.

[0039] In this way, the coating film estimation mathematical model 3 is created by learning using "skin condition indices (7 items)" generated using the skin condition index mathematical model and skin images (bare skin images) of multiple subjects, and "applied skin overall evaluation value" generated using the skin condition index inference model and applied skin images of multiple subjects' full faces with cosmetic D (or cosmetic E) applied to their skin. The skin condition indices (7 items) include items that change depending on skin physical properties (e.g., moisture content of each layer, moisture evaporation value, etc.) that affect the formation of a cosmetic coating on the skin. Therefore, as a result of further research, it has been found that a coating film estimation mathematical model 3 with a high accuracy rate can be created by using all of the calculated skin condition indices (7 items). Furthermore, while items similar to the skin condition indices (7 items) can be calculated using applied skin images of the full face of a subject with cosmetic D (or cosmetic E) applied to their skin and the skin condition index inference model, in this embodiment, only the "applied skin overall evaluation value," which is the evaluation value of the applied skin overall evaluation corresponding to the overall evaluation, is used. This is because, in order to estimate the state of formation of a coating film formed on the skin when a cosmetic product is applied to the skin, research has shown that the evaluation results of the appearance and finish of the skin to which the cosmetic product has been applied are the most important when estimating the state of formation of a coating film formed on the skin, and as a result, it has been found that a mathematical model for estimating the state of formation of a coating film with a high accuracy rate can be created by using the "overall evaluation value of applied skin," which is an evaluation value of the overall evaluation that indicates the overall quality of the skin condition.

[0040] 8(a) shows the results of predicting whether the quality of the coating film formation state of a cosmetic product falls into the low or high group using the coating film estimation mathematical model 3, as well as the actual results. FIG. 8(b) shows the results of calculating the accuracy rate, which is the degree of agreement between the group predicted using the coating film estimation mathematical model 3 and the actual group. FIGS. 8(a) and 8(b) show that a high accuracy rate can be obtained when the coating film formation state of a cosmetic product is predicted using the coating film estimation mathematical model 3. Therefore, by using the user's skin condition indexes (7 items) obtained using the skin condition index mathematical model and the coating film estimation mathematical model 3, it is possible to estimate the coating film formation state of a given composition. Therefore, even without applying the given composition (a cosmetic product to which an ultraviolet absorber or an ultraviolet scattering agent has been added) to the skin, it is possible to estimate the quality of the coating film formation state assuming that the given composition is applied to the user's skin. This also makes it possible to estimate the degree of effect that can be expected based on the function possessed by the given composition (e.g., the ultraviolet protection function in the case of a cosmetic product to which an ultraviolet absorber or an ultraviolet scattering agent has been added). As described above, in the third embodiment, skin condition indices (e.g., seven items calculated using skin images (bare skin images) of the subjects and a skin condition index mathematical model) are acquired for each of a plurality of subjects (e.g., 20 women). A comprehensive skin-applied evaluation value is calculated using skin images (e.g., skin images (applied skin images) captured with the imaging device shown in FIG. 7 ) of the skin (applied skin) of the plurality of subjects to which cosmetics (e.g., cosmetics D and E) have been applied, and the skin condition index mathematical model. A mathematical model (coating film estimation mathematical model 3) showing the relationship between the skin condition indices and the state of formation of a cosmetic coating film is created from the acquired skin condition indices (seven items) and the comprehensive skin-applied evaluation value. Using a user's skin image (bare skin image), the user's skin condition indicators (e.g., the seven items mentioned above) obtained from the skin condition mathematical model, and the coating film estimation mathematical model 3, it is possible to estimate the state of the coating film that a cosmetic (e.g., cosmetic D, cosmetic E) will form on the skin when it is applied to the user's skin, thereby making it possible to estimate and evaluate the functions of the cosmetic.

[0041] Furthermore, similarly to Embodiments 1 and 2, it is possible to estimate the first and second formation states by creating the coating film estimation mathematical model 3, where the first time period is, for example, one minute after immediately after application, and the second time period is, for example, eight hours after immediately after application. The creation method, similarly to Embodiments 1 and 2, involves performing the step of “1) obtaining an evaluation value for each overall skin application evaluation” described in Embodiment 3, obtaining evaluation values ​​for each overall skin application evaluation one minute after application of a predetermined cosmetic to the skin of the subject, and eight hours after application of the predetermined cosmetic to the skin of the subject, and then performing the steps of “2) dividing into two groups according to the evaluation value for the overall skin application evaluation” to “5) creating a coating film estimation mathematical model 3” described in Embodiment 3, thereby constructing a coating film estimation mathematical model 3 that estimates the formation state of a cosmetic coating film one minute after application (first formation state) and a coating film estimation mathematical model 3 that estimates the formation state of a cosmetic coating film eight hours after application (second formation state), respectively. In this way, a coating film estimation mathematical model 3 is created that estimates the formation state of a coating film formed on the skin by a cosmetic one minute after application (first formation state), and a coating film estimation mathematical model 3 that estimates the formation state of a coating film formed on the skin by a cosmetic eight hours after application (second formation state). By using the two created coating film estimation mathematical models 3 and a user's skin condition index obtained using the skin condition index mathematical model, it is possible to estimate the formation state of a coating film formed on the skin by a cosmetic a predetermined time after application, without applying the specified cosmetic to the user's skin and even before a predetermined time has passed since application (in this embodiment, a first time period: 1 minute or a second time period: 8 hours). In this way, it is possible to estimate the formation state of a coating film formed on the skin by a specified composition (e.g., cosmetic D or cosmetic E) in a first time period after application (e.g., 1 minute after application) and the formation state of a coating film formed on the skin by the composition in a second time period after the first time period (e.g., 8 hours after application) (second formation state). It is not necessary to estimate both the first and second formation states, and only one of them may be estimated depending on the purpose. It is also possible to add a third time period, a fourth time period, etc.

[0042] Furthermore, similarly to Embodiments 1 and 2, by using the first and second formation states, it is possible to estimate the effects that can be expected in a first time period and the effects that can be expected in a second time period with respect to the effects that the applied cosmetic product claims. In this way, the specified cosmetic product is a cosmetic product to which an ultraviolet absorber or an ultraviolet scattering agent has been added (e.g., cosmetic product D, cosmetic product E), and by estimating the first and second formation states, it is possible to estimate and evaluate the functions that the cosmetic product will exert (evaluate the extent to which the effects that the cosmetic product's functions can be expected to have) based on the estimated first and second formation states.

[0043] Next, a method for evaluating the compatibility of a cosmetic having a predetermined function with a user's skin will be described, using the state of formation of a coating film formed on the skin by the cosmetic estimated by the methods of Embodiments 1 to 3. As described above, all of the embodiments estimate the state of formation of a coating film that the cosmetic would form on the skin if actually applied, without actually applying the cosmetic to the user's skin to which an ultraviolet absorber or an ultraviolet scattering agent has been added. The predetermined cosmetic is a cosmetic to which an ultraviolet absorber or an ultraviolet scattering agent has been added, and Embodiments 1 and 2 estimate the state of formation of a coating film that the cosmetic would form on the skin based on the ultraviolet reflectance at a wavelength of 320 nm, which is included in the UVB region, making it possible to estimate whether the predetermined cosmetic can be expected to have the effect of protecting against ultraviolet rays in the UVB wavelength region. Furthermore, as described above, it is also possible to estimate a first formation state, which is the state of the film formed on the skin by the cosmetic in a first time period (e.g., one minute after application), and a second formation state, which is the state of the film formed on the skin by the cosmetic in a second time period (e.g., eight hours after application), and therefore, by using the first formation state and the second formation state, it is possible to estimate the effects that can be expected in the first time period and the effects that can be expected in the second time period with respect to the effects claimed by the applied cosmetic. Next, a method for using these estimation results to suggest cosmetics that are suitable for the user will be described.

[0044] FIG. 9 shows an example in which the estimated first formation state in a first time period (after 1 minute) and the estimated second formation state in a second time period (after 8 hours) when three types of cosmetics, Cosmetics 1 to 3, are applied are shown to be higher or lower than the standard values. Here, Cosmetics 1 to 3 all have the same published UV protection value (in this embodiment, all are SPF 50). This method estimates the state of the coating film that the cosmetics will form on the skin when hypothetically applied, making it possible to predict whether the cosmetics can be expected to achieve their claimed effects. Therefore, comparing cosmetics with the same published UV protection value is effective. However, because the standard value differs depending on the cosmetic, it cannot be said that, for example, Cosmetics 1 and Cosmetics 2 can be expected to have similar UV protection values ​​even if they are both around the standard value. However, this information is useful when suggesting cosmetics suitable for the user. From Figure 9, for example, it can be inferred that cosmetic 2 has difficulty in applying evenly to the user because both the first and second formation states are lower than the standard values, and therefore it can be inferred that it is difficult to expect the effects that cosmetic 2 claims. Furthermore, cosmetic 1 has a first formation state higher than the standard value and a second formation state that is about the standard value, while cosmetic 3 has a first formation state that is about the standard value but a second formation state that is higher than the standard value. Therefore, if a user expects UV protection effects immediately after applying the cosmetic, cosmetic 1 can be recommended, and if the user applies the cosmetic before going out and will be exposed to UV rays after a predetermined time, cosmetic 3 can be recommended. In this way, it is possible to use this information as reference when recommending cosmetics. Thus, cosmetics (e.g., cosmetics 1 to 3) have publicly published UV protection values ​​(e.g., SPF values), and it is possible to estimate and evaluate the UV protection function as a predetermined function based on the estimated state of the coating film formed on the skin by the cosmetic and the publicly published UV protection values.

[0045] <Estimation Device> The estimation device 200 will be described using FIGS. 10-1 and 10-2. FIG. 10-1 illustrates the case of embodiment 1, and FIG. 10-2 illustrates the cases of embodiments 2 and 3. The estimation device 200 in this embodiment is composed of a skin condition acquisition unit 130 and a coating film estimation unit 140. The estimation device 200 is a general-purpose personal computer and includes input devices such as a keyboard and a pointing device, a calculation processing unit including an MPU (a CPU implemented as an integrated circuit), an input / output interface, a memory unit, etc. The skin condition acquisition unit 130 is realized by the calculation processing unit executing predetermined processing of a program via the input / output interface, and the coating film estimation unit 140 is realized by the calculation processing unit executing predetermined processing of a program. Furthermore, the estimation device 200 preferably includes an evaluation unit 150 and a display unit 160 (display device), but the display unit 160 may be provided external to the estimation device 200 and connected via a network or the like. Furthermore, in the case of embodiment 1, a measuring device 10 that measures the skin condition index is required as shown in Fig. 10-1, and in the cases of embodiments 2 and 3, an imaging device 40 that captures a skin image (bare skin image) for calculating the skin condition index is required as shown in Fig. 10-2. When recommending cosmetics by estimating the degree of effect of a predetermined cosmetic (a cosmetic containing an ultraviolet absorber or an ultraviolet scattering agent) on the user's skin without actually applying it to the user's skin in a store or the like, by providing the measuring device 10 and / or the imaging device 40 in addition to the estimation device 200, it is possible to sequentially suggest to the user the expected degree of ultraviolet protection effect of the predetermined cosmetic and to recommend cosmetics.

[0046] The skin condition acquisition unit 130 is a means (skin condition acquisition means) for acquiring skin condition indices (seven items) from measurements taken by the measuring instrument 10 (Embodiment 1) or using a skin image (bare skin image) captured by the imaging device 40 and a skin condition index mathematical model (Embodiment 2 or 3). Note that in Embodiments 2 and 3, an information processing terminal (not shown) different from the estimation device 200 may calculate the skin condition indices using a skin image (bare skin image) captured of the user and the skin condition index mathematical model, and the calculated skin condition indices may be acquired by the estimation device 200 via a network line, medium, or the like. Alternatively, the skin condition index mathematical model may be stored in the estimation device 200, a skin image (bare skin image) captured by the imaging device 40 may be acquired, and the skin condition indices may be calculated and acquired by the estimation device 200. The coating film estimation unit 140 is a means (coating film state estimation means) that uses the acquired skin condition index and one of the coating film estimation mathematical models 1 to 3 to estimate the state of a coating film formed on the skin of a predetermined cosmetic when applied to a user's skin. The estimation method is the same as that described above. The evaluation unit 150 is a means that uses the state of a coating film formed on the skin of a cosmetic estimated by the coating film estimation unit 140 to perform a comparative evaluation of cosmetics containing UV absorbers or UV scatterers that have published UV protection values, or to suggest cosmetics containing UV absorbers or UV scatterers that are suitable for the user's skin. The evaluation results by the evaluation unit 150 are preferably displayed on the display unit 160 so that the user can easily understand them. Displaying the evaluation results by the evaluation unit 150, such as the diagram shown in FIG. 9, on the display unit 160 makes it easier for the user to understand the estimation and evaluation results. The memory unit of the estimation device 200 stores the above-mentioned mathematical models and programs for executing the above-mentioned estimation methods, and the program uses the skin condition index acquired by the skin condition acquisition unit 130 and the mathematical models to cause the coating film estimation unit 140 to estimate the formation state of the coating film formed by the composition on the skin, causes the evaluation unit 150 to make an evaluation, and causes the evaluation result to be displayed on the display unit 160.In addition, some functions may be assigned to another information processing device, such as storing each mathematical model in another device, for example, a specified server (not shown), and accessing the server from the estimation device 200 via the Internet, for example, and having the other device estimate the formation state of the cosmetic coating film using the skin condition index acquired by the estimation device 200.

[0047] <Estimation System> The estimation system 400 will be described using FIGS. 11-1 and 11-2. FIG. 11-1 illustrates the case of embodiment 1, and FIG. 11-2 illustrates the cases of embodiments 2 and 3. The estimation system 400 in this embodiment is composed of a skin condition acquisition unit 330 and a coating film estimation unit 340. The estimation system 400 includes an information processing terminal 300 capable of executing various processes, and the information processing terminal 300 is equipped with the skin condition acquisition unit 330 and the coating film estimation unit 340. The information processing terminal 300 is a general-purpose personal computer and includes input devices such as a keyboard and a pointing device, an arithmetic processing unit constituted by an MPU (a CPU implemented as an integrated circuit), an input / output interface, a memory unit, etc. The skin condition acquisition unit 330 is realized by the arithmetic processing unit executing predetermined processing of a program via the input / output interface, and the coating film estimation unit 340 is realized by the arithmetic processing unit executing predetermined processing of a program. Furthermore, the information processing terminal 300 preferably includes an evaluation unit 350 and a display unit 360 (display device), but the display unit 360 may be provided external to the information processing terminal 300 and connected via a network or the like. Furthermore, in the case of the first embodiment, a measuring device 10 that measures the skin condition index is required as shown in FIG. 11-1 , and in the cases of the second and third embodiments, a photographing device 40 that captures images for calculating the skin condition index is required as shown in FIG. 11-2 . When recommending a cosmetic product by estimating the effectiveness of a predetermined cosmetic product (a cosmetic product containing an ultraviolet absorber or an ultraviolet scattering agent) on a user's skin without actually applying it to the user's skin in a store or the like, and by providing the measuring device 10 and / or the photographing device 40 in addition to the estimation system 400, it is possible to sequentially provide the user with the expected UV protection effect of the predetermined cosmetic product and suggest recommended cosmetic products.

[0048] Skin condition acquisition unit 330 is a means (skin condition acquisition means) for acquiring a skin condition index from a measurement value measured by measuring instrument 10 (Embodiment 1) or using a skin image (bare skin image) captured by imaging device 40 and a skin condition index mathematical model (Embodiment 2 or 3). Note that in Embodiments 2 and 3, an information processing terminal (not shown) different from estimation system 400 may calculate a skin condition index using a skin image (bare skin image) captured of a user and the skin condition index mathematical model, and the calculated skin condition index may be acquired by information processing terminal 300 via a network line, medium, or the like. Alternatively, a skin condition index mathematical model may be stored in estimation system 400, a skin image (bare skin image) captured by imaging device 40 may be acquired, and the skin condition index may be calculated and acquired by estimation system 400. The coating film estimation unit 340 is a means (coating film estimation means) that uses the acquired skin condition index and one of the coating film estimation mathematical models 1 to 3 to estimate the state of a coating film that a cosmetic will form on the skin when a predetermined cosmetic is applied to the user's skin. The estimation method is the same as that described above. The evaluation unit 350 is a means that uses the state of a coating film that a cosmetic will form on the skin estimated by the coating film estimation unit 340 to comparatively evaluate cosmetics containing UV absorbers or UV scatterers that have published UV protection values, or to suggest cosmetics containing UV absorbers or UV scatterers that are suitable for the user's skin. The evaluation results by the evaluation unit 350 are preferably displayed on the display unit 360 so that the user can easily understand them. Displaying the evaluation results by the evaluation unit 350, such as the diagram shown in FIG. 9, on the display unit 360 makes it easier for the user to understand the estimation and evaluation results. The memory unit of the information processing terminal 300 stores programs for executing the above-mentioned mathematical models and the above-mentioned estimation methods, and the program uses the skin condition index acquired by the skin condition acquisition unit 330 and the mathematical models to cause the coating film estimation unit 340 to estimate the formation state of the coating film formed by the composition on the skin, cause the evaluation unit 350 to make an evaluation, and display the evaluation results on the display unit 360.In addition, some functions may be assigned to another information processing device, such as storing each mathematical model in another device, for example, a specified server (not shown), and accessing the server from the estimation system 400 via the Internet, for example, and having the other device estimate the state of formation of the cosmetic coating film using the skin condition index acquired by the estimation system 400.

[0049] <Application Program> An application program (hereinafter also referred to as the program) for causing the estimation device 200 to execute the above-described estimation method is installed in the estimation device 200. Similarly, an application program (hereinafter also referred to as the program) for causing the information processing terminal 300 to execute the above-described estimation method is installed in the information processing terminal 300. In this embodiment, the application program is application software that estimates the formation state of a coating film of a composition when applied to a user's skin without applying the composition itself. The program includes a skin condition acquisition process and a coating film estimation process. The skin condition acquisition process is a process for acquiring a skin condition index measured by the measuring instrument 10, a skin image (bare skin image) of the user captured by the imaging device 40, and a skin condition index mathematical model. In addition, in the second and third embodiments, the skin condition index may be calculated by an information processing terminal (not shown) different from the estimation device 200 or the information processing terminal 300 using a captured skin image (bare skin image) of the user and the skin condition index mathematical model, and the calculated skin condition index may be acquired by the estimation device 200 or the information processing terminal 300 via a network line, medium, etc. Alternatively, the skin condition index mathematical model may be stored in the estimation device 200 or the information processing terminal 300, a skin image (bare skin image) captured by the imaging device 40 may be acquired, and the skin condition index may be calculated and acquired by the estimation device 200 or the information processing terminal 300. The coating film estimation process is a process of estimating the formation state of a cosmetic coating film when a predetermined cosmetic is applied to the user's skin using the acquired skin condition index and one of the coating film estimation mathematical models 1 to 3. Preferably, the program further includes an evaluation process and a display process. The evaluation process uses the state of formation of a coating film formed on the skin by the cosmetic estimated in the estimation process to perform a comparative evaluation with cosmetics containing specified UV absorbers or UV scattering agents that have published UV protection values, or to suggest cosmetics containing UV absorbers or UV scattering agents that are suitable for the user. The display process displays the evaluation results from the evaluation process, for example, the diagram shown in Figure 9, making it easier for the user to understand the estimation results and evaluation results.The program may be realized as a computer program product containing the program.

[0050] <Information Processing Terminal> An information processing terminal (not shown) may be connected to the estimation system 400 via a network. The information processing terminal may be, for example, a tablet terminal installed in a store, a smartphone, or a tablet terminal or smartphone owned by the user. The information processing terminal includes a transmitting means (e.g., an input / output interface) that transmits data (e.g., a skin image (bare skin image)) for calculating a skin condition index indicating the user's skin characteristics, and a receiving means (e.g., an input / output interface) that receives an estimation result sent from the coating film estimation means (coating film estimation unit 340). In this way, if there is an information processing terminal equipped with a transmission means for transmitting data (e.g., a skin image (bare skin image)), for example, if the information processing terminal is a tablet terminal or smartphone owned by the user, a user who is reluctant to have their bare skin image taken in a store can take a facial image of the user's bare skin using the tablet terminal or smartphone owned by the user at home, etc., and transmit the facial image of the user's bare skin as a skin image (bare skin image) to the information processing terminal 300 equipped in the estimation system 400 located in the store, thereby making it possible to estimate the coating film formation state when a predetermined cosmetic is applied. Furthermore, if the information processing terminal has a receiving means for receiving the estimation results, the estimation results can also be confirmed on the tablet terminal or smartphone owned by the user. Note that, as described above, it is preferable that the estimation system 400 includes an evaluation unit 350, and therefore, if the evaluation unit 350 is included, it is preferable that the receiving means be able to receive the evaluation results.

[0051] <Method for Displaying Estimation Results> An image classified into skin types based on the skin condition index obtained using this estimation method can be displayed as a skin classification image. Furthermore, a predetermined composition can be displayed as a composition classification image, and an evaluation based on the estimation result of the state of the composition coating film formed when the predetermined composition is applied to the user's skin can be displayed by combining the skin classification image and the composition classification image. As described above, the results estimated by this estimation method or the results of evaluation using the estimated results are displayed on the display unit 160, the display unit 360, or an information processing terminal. The display format will be explained using Figures 12(a-1) to (d-2). The skin information classification image 50 in Figures 12(a-1) to (a-3) is an example of a skin information classification image 50 when a user's skin type is classified into three skin types (skin type A, skin type B, and skin type C). Figures 12(a-1) to (a-3) show skin information classification images 50, including skin type A, skin type B, and skin type C. Figures 12(b-1) to (b-3) show display examples of composition classification images 60 for three compositions (composition 1, composition 2, and composition 3), including composition 1 classification image 60, composition 2 classification image 60, and composition 3 classification image 60. As such, the skin information classification images 50 and composition classification images 60 are all different images. Furthermore, the skin information classification images 50 may be set to images evocative of skin types, and the composition classification images 60 may be set to images evocative of compositions. For example, if skin type A is a moisturized skin type, an image with a design or color evocative of moisture may be used. This allows users to more easily visualize their own classified skin type.

[0052] For example, the compatibility between a user's skin type and a composition can be displayed by combining the skin information classification image 50 and the composition classification image 60. For example, when the user's skin type is skin type A and composition 1 is selected, the skin information classification image 50 in FIG. 12(a-1) and the composition classification image 60 in FIG. 12(b-1) are displayed as a moving image gradually overlapping, making it possible to clearly display the compatibility results between skin type A and composition 1 to the user. FIG. 12(c-1) is an image showing the intermediate state when the skin information classification image 50 and the composition classification image 60 are overlapped. FIGS. 12(d-1) and (d-2) are compatibility images 70 showing the estimated results by combining the skin information classification image 50 and the composition classification image 60. FIG. 12(d-1) shows an image in which the skin information classification image 50 and the composition classification image 60 are perfectly overlapped, and is used when the user's skin type and the composition are highly compatible. On the other hand, FIG. 12(d-2) shows an image in which the skin information classification image 50 and the composition classification image 60 are misaligned, and is used when the user's skin type and the composition are poorly compatible. In this way, the user may grasp the compatibility between their skin type and the composition based on the degree of overlap of the compatibility image 70. Furthermore, the estimation results may be displayed by combining the skin information classification image 50 and the composition classification image 60, and any method of combining (overlapping) or creating the combined image may be used. For example, the skin information classification image 50 and the composition classification image 60 may be displayed side by side. For example, transparent images of the skin information classification image 50 and the composition classification image 60 may be created and displayed superimposed on each other. For example, a portion of each of the skin information classification image 50 and the composition classification image 60 may be made transparent, and the transparent image portions (transparent pixel portions) of both images may be displayed superimposed on each other. For example, an image in which the skin information classification image 50 and the composition classification image 60 are superimposed is created in advance, and the superimposed image created in advance is displayed at the timing when the skin information classification image 50 and the composition classification image 60 are superimposed, thereby displaying the skin information classification image 50 and the composition classification image 60 in combination (superimposed). For example, any method may be used, such as performing a thinning process on each of the skin information classification image 50 and the composition classification image 60 (shifting the thinning points (thinning lines) between the skin information classification image 50 and the composition classification image 60) and displaying them superimposed.Furthermore, for example, when the compatibility between the user's skin type and the composition is high, the transmittance of the skin information classification image 50 may be increased and the transmittance of the composition classification image 60 may be decreased. Conversely, when the compatibility between the user's skin type and the composition is low, the transmittance of the skin information classification image 50 may be decreased and the transmittance of the composition classification image 60 may be increased. By displaying the skin information classification image 50 and the composition classification image 60 in combination, it becomes possible to grasp the compatibility between the user's skin type and the composition from the display mode of the compatibility image 70. Furthermore, for example, when the compatibility between the user's skin type and the composition is low, the composition classification image 60 may be displayed smaller than when the compatibility is high. In this way, when the compatibility is high, the skin information classification image 50 and the composition classification image 60 are displayed overlapping at the same size, whereas when the compatibility is low, the composition classification image 60 can be displayed so that it overlaps a portion (e.g., the center) of the skin information classification image 50. This makes it possible to grasp the compatibility between the user's skin type and the composition from the display mode of the compatibility image 70. Furthermore, for example, the brightness or saturation of the composition classification image 60 may be changed depending on the compatibility between the user's skin type and the composition, and the changed composition classification image 60 may be displayed in combination with the skin information classification image 50. This also makes it possible to grasp the compatibility between the user's skin type and the composition from the compatibility image 70. The above is just one example, and displaying the skin information classification image 50 and the composition classification image 60 in combination may be any display method or display mode as long as it is possible to grasp that the skin information classification image 50 and the composition classification image 60 are displayed in combination. Furthermore, in addition to displaying the combination of the skin information classification image 50 and the composition classification image 60, a numerical value representing the compatibility between the user's skin type and the composition may also be displayed.

[0053] As described above, the present invention has been described using specific embodiments, but the present invention is not limited to the above embodiments and includes various modifications, improvements, and the like as long as the object of the present invention is achieved. <Modifications> In this embodiment, when estimating the first and second formation states, a coating film estimation mathematical model was created when a first time period and a second time period had passed after a predetermined cosmetic was applied to the skin of multiple subjects. However, this is not limiting, and a coating film estimation mathematical model may be created depending on the environment in which the first and second time periods passed. For example, by creating different coating film estimation mathematical models for when the first and second time periods passed under the blazing sun and after swimming in the sea, it is possible to suggest the optimal cosmetic for the environment in which the user will use the predetermined cosmetic (cosmetics containing ultraviolet absorbers or ultraviolet scattering agents).

[0054] In this embodiment, a cosmetic containing an ultraviolet absorber or an ultraviolet scattering agent is applied as the specified cosmetic, but this is not limited to this, and sunscreen cosmetics containing only an ultraviolet absorber, only an ultraviolet scattering agent, or both are preferred.

[0055] In this embodiment, cosmetic preparation A was a W / O formulation, cosmetic preparation B was a W / O formulation, cosmetic preparation C was an O / W formulation, cosmetic preparation D was an O / W formulation, and cosmetic preparation E was a W / O formulation, but this is not limited to these. Furthermore, cosmetic preparations A to E used in this embodiment are cosmetics to which an ultraviolet absorber is added in the range of 0 to 15 percent and an ultraviolet scattering agent is added in the range of 5 to 30 percent, but the proportions of ultraviolet absorber and / or ultraviolet scattering agent added to the cosmetics are not limited to these. Cosmetics to which an ultraviolet absorber is added in the range of 0 to 15 percent and an ultraviolet scattering agent in the range of 5 to 30 percent are preferred.

[0056] In this embodiment, a cosmetic to which an ultraviolet absorber and / or an ultraviolet scattering agent has been added was applied as the predetermined cosmetic. However, this is not limited to this. By adding a predetermined proportion of an ultraviolet absorber or an ultraviolet scattering agent (for example, 1% by mass or more but less than 30% by mass, preferably 5% by mass or more but less than 20% by mass, relative to the cosmetic) to a cosmetic to which no ultraviolet absorber and / or ultraviolet scattering agent has been added, it is possible to estimate the state of a coating film that would be formed if the cosmetic to which no ultraviolet absorber and / or ultraviolet scattering agent has been added were actually applied to the skin, without actually applying the cosmetic to which no ultraviolet absorber and / or ultraviolet scattering agent has been added. In this case, although either an ultraviolet absorber or an ultraviolet scattering agent may be added, it is preferable to add an ultraviolet absorber. This is because the addition of an ultraviolet absorber is less likely to affect the formation of a coating film of the cosmetic to which it is added.

[0057] As described above, in this embodiment, three types of estimation methods, i.e., Embodiments 1 to 3, have been described. Any one of the estimation methods may be selected depending on the location to be estimated and the purpose of the estimation. Furthermore, in Embodiment 3, when creating the coating film estimation mathematical model 3, a cosmetic containing an ultraviolet absorber or an ultraviolet scattering agent is applied to the skin of multiple subjects, but the subjects' skin is photographed without being exposed to ultraviolet light (by using the photographing device 40 (smartphone 40) rather than the photographing device 30 (ultraviolet camera 30) as in Embodiments 1 and 2). This makes it possible to reduce the burden on the subjects' skin when creating the coating film estimation mathematical model 3.

[0058] As described above, in the present embodiment, the coating film formation state is estimated assuming that cosmetics A and B are applied in embodiment 1, cosmetics C in embodiment 2, and cosmetics D and E in embodiment 3, but it is also possible to estimate the coating film formation state of cosmetic C, for example, using the method of embodiment 1. It is sufficient to create coating film estimation mathematical models 1 to 3 corresponding to the cosmetic to be estimated.

[0059] As described above, in this embodiment, the state of coating film formed when a cosmetic containing an ultraviolet absorber or an ultraviolet scattering agent is applied is estimated, and compatibility with the user's skin is evaluated based on the estimation results. However, this is not limited to this. The extent to which a specific composition's functions (e.g., UV protection function, anti-itch function, makeup function, whitening function, etc.) can be exhibited may also be evaluated from the estimated state of coating film formation. This is because if the state of coating film formation is good, it can be assumed that the specific composition will be able to exhibit its functions to a high degree, and this can be used, for example, as an indicator during development.

[0060] As described above, in this embodiment, the state of a coating film formed when a cosmetic containing an ultraviolet absorber or an ultraviolet scattering agent is applied is estimated, and the compatibility of the cosmetic with the user's skin is evaluated based on the estimation results, but this is not limited thereto. It is also possible to evaluate the compatibility of a composition with the user's skin based on the estimation results of the state of a coating film formed by the composition.

[0061] As described above, in this embodiment, the compatibility with the user's skin is evaluated by estimating the state of the coating film formed when a cosmetic containing an ultraviolet absorber or an ultraviolet scattering agent is applied, and evaluating whether or not a high level of ultraviolet protection function can be expected based on the estimation results. However, this is not limited to this. For example, when a cosmetic containing a whitening ingredient is applied, if the state of the coating film formed by application of the cosmetic is high, it can be inferred that the whitening ingredient is evenly applied to the skin, and therefore it is also possible to evaluate the compatibility between a cosmetic having a predetermined function (whitening function) and the skin.

[0062] As described above, in this embodiment, the "standard value" is the UV reflectance that is located in the middle when the UV reflectances are sorted in order of UV reflectance, as described in "2) Dividing into two groups according to UV reflectance." However, this is not limited to this. For example, a value that falls within a predetermined top percentage (e.g., a value within the top 25%) when sorted in order of UV reflectance may be used as the standard value, and if the value is higher than the standard value, it may be evaluated that the cosmetic product is expected to have the intended effect. Furthermore, if the overall skin evaluation values ​​are sorted in order of the overall skin evaluation values ​​when applied, it may be used as the standard value, and if the value is higher than the standard value, it may be evaluated that the cosmetic product is expected to have the intended effect. Furthermore, multiple standard values ​​may be prepared and divided into three or more groups.

[0063] In this embodiment, the UV protection effect for each time period is estimated using the first and second formation states individually, but this is not limited to this. For example, the average value of the first and second formation states may be calculated, and the expected UV protection effect from the first time period to the second time period may be estimated from the average value. Alternatively, a predetermined weighting may be applied to either the first or second formation state (e.g., giving priority to the value of the second formation state that has been in existence for a longer period since application, or giving priority to the value of the first or second formation state that has a higher coating film formation state). Then, the average value may be calculated and the expected UV protection effect from the first time period to the second time period may be estimated. In this way, by using the first and second formation states to estimate the expected UV protection effect from the first time period to the second time period, it is possible to estimate the UV protection effect that changes over time since application, thereby providing users with more detailed information they need.

[0064] In this embodiment, the user is assumed to be, for example, a customer who comes to a store looking for cosmetics, but is not limited to this. For example, the user may be a monitor during evaluation conducted in a laboratory during the development of cosmetics. In this embodiment, the "user" refers to a person whose skin is to be estimated using the coating film estimation mathematical models 1 to 3 to estimate the state of a coating film formed on the skin when a specific composition is applied without applying the specific composition to the skin, and the "subject" refers to a person whose skin is used as training data when creating each mathematical model.

[0065] Additional Test Example 1 Fig. 13 is a diagram showing the results of a comparative test of the UV protection effects of the above-mentioned cosmetics C to E. As shown in the figure, the "overall evaluation" and "skin color" determined by the above-mentioned skin condition index mathematical model were each divided into two groups using the median values ​​as thresholds to create four groups, and the UV protection effects of cosmetic C (Embodiment 2), cosmetic D (Embodiment 3), and cosmetic E (Embodiment 3) were compared for each group.

[0066] As a result, it was found that in terms of UV protection effect, cosmetic product E is recommended for group 1, which has a high overall rating and a high skin color value; cosmetic product C is recommended for group 2, which has a high overall rating and a low skin color value; cosmetic products D and E are recommended for group 3, which has a low overall rating and a high skin color value; and cosmetic products C and E are recommended for group 4, which has a low overall rating and a high skin color value.

[0067] In this way, not only when the seven skin condition indices in the above-described embodiment are used as explanatory variables, but also when the two items of "overall evaluation" and "skin color" are used as explanatory variables to classify skin types into four groups, it is possible to recommend to the user cosmetics that have a high UV protection effect for that skin type.

[0068] 14 is a diagram showing the results of another comparative test of the UV protection effects of the above-mentioned cosmetics C to E. The test participants were classified into five groups using a non-hierarchical clustering method (k-means method) using seven items determined by the above-mentioned mathematical model for skin condition indicators: "overall evaluation," "skin color," "makeup feel," "skin age," "masculinity / femininity," "makeup smudge," and "powdery feel." The UV protection effects of cosmetics C (embodiment 2), cosmetics D (embodiment 3), and cosmetics E (embodiment 3) were compared for each group.

[0069] As a result, differences were observed in the UV protection effects of cosmetics C to E among groups 1 to 5. It was found that in terms of UV protection effect, cosmetic D was recommended for group 1, cosmetic C was recommended for group 2, cosmetic C and D were recommended for group 3, cosmetic E was recommended for group 4, and cosmetic D was recommended for group 5.

[0070] In this way, even when the seven skin condition indices in the above-described embodiment are used as explanatory variables to classify skin types into five groups, it is possible to recommend to the user cosmetics that have a high UV protection effect for that skin type.

[0071] (Processing for suggesting cosmetics to a user according to their skin type) In the above-described embodiment, an example was shown in which an image classified into skin types based on estimated skin condition indexes is displayed as a skin classification image on the user's information processing terminal, and a specified composition is displayed as a composition classification image on the user's information processing terminal, and an evaluation based on the estimated results of the formation state of a coating film of the composition when the specified composition is applied to the user's skin is displayed by combining the skin classification image and the composition classification image.

[0072] In this case, the estimation device 200 or the estimation system 400 may display information indicating the characteristics of the above-mentioned classified skin types on the user's information processing terminal, and may further display a score indicating the compatibility (UV protection effect) of each cosmetic corresponding to the skin type with the user's skin type on the user's information processing terminal.

[0073] 15 is a flowchart showing the flow of processing for presenting skin type characteristic information and cosmetic score information based on a skin image by the estimation device 200 or the estimation system 400. In the following description, for convenience, the estimation device 200 is the subject of operations, but the operations are actually performed by the hardware of the estimation device 200 or the estimation system, such as a CPU, a communication unit, and a storage unit, in cooperation with software (programs) stored in the storage unit.

[0074] As shown in the figure, the estimation device 200 receives a skin image of the user's natural face taken by the information processing terminal from the user's information processing terminal (step 11).

[0075] Next, the estimation device 200 acquires a skin condition index value based on the received skin image and the skin condition index mathematical model (step 12).

[0076] Next, the estimation device 200 classifies the user into one of the skin types based on the acquired skin condition index values ​​(step 13).

[0077] When generating the classification information of the skin types, the estimation device 200 or the estimation system 400 generates and stores feature information for explaining the features of each skin type, as shown in Fig. 16. The feature information is generated by evaluating each skin type based on the skin condition index values ​​and the subject's awareness of skin quality.

[0078] At the same time, the estimation device 200 or the estimation system 400 generates and stores score information indicating scores relating to the UV protection effects of multiple types of cosmetics based on the state of coating film formation for each of the above skin types.

[0079] The score information is generated by creating a matrix of skin types and cosmetics, as shown in Figure 17. The score information is calculated numerically using, for example, the UV reflectance of the coating film and the overall evaluation values ​​immediately after application and after a certain time has passed since application. When comparing products of the same skin type, a higher score indicates a higher UV protection effect.

[0080] The score information is not limited to being expressed as a value between 0 and 100 as described above, but may be expressed as a value between 0 and 10, for example, or may be any evaluation information, such as a five-level evaluation information of A, B, C, D, E (or the number of stars, etc.).

[0081] Next, the estimation device 200 displays, on the user's information processing terminal, the information on the classified user's skin type and, among the stored characteristic information, characteristic information corresponding to the skin type, as shown in Fig. 18(A) (step 14). In the example shown in Fig. 18(A), the user is classified as skin type A, and the information on skin type A and the corresponding characteristic information (moist skin type) are displayed.

[0082] Then, as shown in FIG. 18(B), for example, when the user scrolls / tap on the displayed characteristic information or when a predetermined time has elapsed since the start of display, the estimation device 200 displays information about cosmetics with high UV protection effects for the skin type and their score information on the user's information processing terminal (step 15).

[0083] Here, the cosmetics and scores displayed are those of at least the highest-scoring cosmetics for the classified skin type, but information on the top several cosmetics (1st to 3rd place, etc.) and their scores may also be displayed.

[0084] In this way, based on the skin condition index obtained from the user's skin image and the skin condition index mathematical model, the user can be classified into one of several skin types, and the user can be presented with and understood information about the characteristics of that skin type and information about cosmetics with high UV protection effects for that skin type.

[0085] REFERENCE SIGNS LIST 10 Measuring instrument 15 Skin 20 Composition 30 Photography device (ultraviolet camera) 40 Photography device (smartphone) 50 Skin information classification image 60 Composition classification image 70 Compatibility image 130 Skin condition acquisition unit 140 Coating film estimation unit 150 Evaluation unit 160 Display unit 200 Estimation device 330 Skin condition acquisition unit 340 Coating film estimation unit 350 Evaluation unit 360 Display unit 400 Estimation system

Claims

1. A method for estimating a skin condition index indicating a user's skin characteristics, estimating a coating state of a composition when a specified composition is applied to the user's skin using a mathematical model indicating the relationship between the acquired skin condition index and the coating state of the composition when the specified composition is applied to the user's skin, and estimating an ultraviolet protection function based on the result.

2. The estimation method according to claim 1, characterized in that the skin condition index includes evaluation items based on physical property values ​​indicating skin condition measured by a specified measuring device.

3. The estimation method according to claim 2, characterized in that the evaluation items based on the physical property values ​​include at least one of the stratum corneum moisture content, water evaporation rate, skin viscoelasticity, skin flexibility, and contact angle.

4. The estimation method according to claim 1, characterized in that the skin condition index includes an evaluation item obtained using a skin image captured of the user's skin and a skin condition index mathematical model showing the relationship between the skin condition index.

5. The method according to any one of claims 1 to 4, characterized in that the specified composition is a cosmetic containing at least one of an ultraviolet ray absorbing component and an ultraviolet ray scattering component, and the method estimates the formation state of the cosmetic film based on the skin condition index obtained from the user and the mathematical model, and estimates the ultraviolet ray protection function based on the result, the method comprising: obtaining skin condition indexes for each of a plurality of subjects; obtaining the ultraviolet ray reflectance of the cosmetic film from ultraviolet skin images taken under ultraviolet ray irradiation of the skin of the plurality of subjects to which the cosmetic has been applied; and creating the mathematical model by performing machine learning based on the obtained skin condition indexes for the plurality of subjects and the obtained ultraviolet ray reflectance of the cosmetic film for the plurality of subjects.

6. The method according to any one of claims 1 to 4, wherein the specified composition is a cosmetic to which at least one of a component that absorbs ultraviolet light or a component that scatters ultraviolet light has been added, and the method estimates the state of formation of a coating film of the cosmetic based on the skin condition index acquired from the user and the mathematical model, and estimates an ultraviolet protection function based on the result, comprising the steps of: acquiring skin condition indexes for each of a plurality of subjects; acquiring an overall applied skin evaluation indicating the state of the skin of the plurality of subjects to which the cosmetic has been applied, the overall applied skin evaluation being an evaluation item acquired using an applied skin image obtained by capturing an image of the skin of the subject to which the cosmetic has been applied and a skin condition index mathematical model indicating the relationship between the overall applied skin evaluation, and the mathematical model being created by performing machine learning based on the acquired skin condition indexes for the plurality of subjects and the acquired overall applied skin evaluation for the plurality of subjects.

7. The method according to any one of claims 1 to 6, characterized in that the function of the composition is evaluated based on the estimated state of formation of a coating film of the composition.

8. The method of any one of claims 1 to 7, wherein the specified composition is a cosmetic to which at least one of a component that absorbs ultraviolet light and a component that scatters ultraviolet light has been added, the cosmetic has a published ultraviolet light protection value that has been published in advance, and the ultraviolet light protection function is estimated and evaluated as a specified function based on the estimated state of formation of the coating film of the cosmetic and the published ultraviolet light protection value.

9. The method of any one of claims 1 to 7, wherein the specified composition is a cosmetic having at least one of an ultraviolet ray absorbing component and an ultraviolet ray scattering component added thereto, the cosmetic having a specified function, and the estimated state of formation of a coating film of the cosmetic is used to evaluate the compatibility of the cosmetic with the user's skin.

10. An estimation method described in any one of claims 1 to 9, characterized in that at least one of a first formation state, which is the formation state of a coating film of the composition in a first time period after application of the specified composition, and a second formation state, which is the formation state of a coating film of the composition in a second time period after the first time period.

11. The estimation method according to any one of claims 1 to 10, characterized in that the user's skin is classified into one of a plurality of skin types based on the skin condition index, a skin information classification image indicating the corresponding skin type is predetermined for each of the plurality of skin types, a composition classification image indicating the specified composition is predetermined, and the estimation result is displayed using the skin information classification image and the composition classification image.

12. The estimation method according to claim 11, wherein the estimation result is displayed by combining the skin information classification image and the composition classification image.

13. The estimation method according to claim 4, further comprising: storing characteristic information indicating the characteristics of a plurality of skin types and evaluation information indicating an evaluation of the ultraviolet protection function of at least one cosmetic product based on the state of formation of the coating film for each of the plurality of skin types; classifying the user's skin into one of the plurality of skin types based on the skin image and the skin condition index obtained based on the skin condition index mathematical model; outputting the characteristic information corresponding to the classified skin type; and outputting the evaluation information for each of the cosmetics corresponding to the classified skin type.

14. An estimation device comprising: a memory means for storing a skin condition index indicating a user's skin characteristics and information indicating a correlation between the skin condition index and a coating state of a composition when a specified composition is applied to the user's skin; a skin condition acquisition means for acquiring the skin condition index; and a coating film estimation means for referencing the memory means and using the acquired skin condition index to estimate the coating state of the composition when the specified composition is applied to the user's skin, and estimating an ultraviolet ray protection function based on the result.

15. An application program for operating an estimation device that estimates the state of a coating of a composition when a specified composition is applied to a user's skin and estimates an ultraviolet ray protection function based on the result, the application program including: a skin condition acquisition process that acquires a skin condition index that indicates the user's skin characteristics; and a coating estimation process that uses the acquired skin condition index to estimate the state of a coating of the composition on the user's skin and estimates an ultraviolet ray protection function based on the result.

16. An estimation system comprising: a memory means for storing a skin condition index indicating a user's skin characteristics and information indicating a correlation between the skin condition index and a coating state of a composition when a specified composition is applied to the user's skin; a skin condition acquisition means for acquiring the skin condition index; and a coating film estimation means for referencing the memory means and using the acquired skin condition index to estimate the coating state of the composition when the specified composition is applied to the user's skin, and estimating an ultraviolet ray protection function based on the result.

17. An information processing terminal for use in an estimation system connected to the estimation device according to claim 14 via a network, comprising: a transmitting means for transmitting data for determining a skin condition index showing a user's skin characteristics; and a receiving means for receiving an estimation result sent from the coating estimation means.

18. A storage medium storing an application program for operating an estimation device that estimates the state of a coating of a specified composition when it is applied to a user's skin and estimates ultraviolet protection function based on the result, the storage medium storing an application program including a skin condition acquisition process that acquires a skin condition index that indicates the user's skin characteristics, and a coating estimation process that uses the acquired skin condition index to estimate the state of a coating of the composition on the user's skin and estimates ultraviolet protection function based on the result.