Estimation method, estimation device, estimation system, and program

Abstract

To provide a method of estimating the state of formation of a coating film of a specific composition that would result if the composition is applied to the skin of a user without actually applying the composition.SOLUTION: An estimation method is provided, comprising acquiring skin condition indicators indicative of skin characteristics of a user, and using the acquired skin condition indicators to estimate the state of formation of a coating film of a specific composition that would result if the composition is applied to the skin of the user.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The present invention relates to a method for estimating the formation state of a coating film of a composition when a given composition is hypothesized to be applied to a user's skin. [Background technology]

[0002] There is a system that diagnoses the skin or scalp from medical interview data and image data of keratin and / or sebum (Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2018-97899 A Summary of the Invention [Problem to be solved by the invention]

[0004] Incidentally, when a user applies a composition, for example, a cosmetic, to the skin, if the cosmetic coating is uniform, the ingredients contained in the cosmetic spread evenly over the skin, making it easier for the cosmetic to exert its effects sufficiently, so whether the cosmetic coating is sufficiently formed is an item of great interest to users. However, although Patent Document 1 was able to diagnose the skin or scalp from interview data and image data, it did not diagnose the state of the cosmetic coating when the cosmetic is applied.

[0005] The present invention has been made in consideration of the above problems, and relates to a method for estimating the formation state of a coating film of a composition that would be formed on the skin when a specified composition is applied, even if the specified composition is not applied to a user's skin. [Means for solving the problem]

[0006] The present invention relates to an estimation method for estimating the state of a coating film of a composition when a specified composition is applied to the skin of a user, by acquiring a skin condition index that indicates a user's skin characteristics, and using a mathematical model that indicates the relationship between the acquired skin condition index and the state of a coating film of the composition when the specified composition is applied to the skin of the user.

[0007] The present invention also relates to an estimation device including a skin condition index indicating a user's skin characteristics, a memory means for storing information indicating a correlation between the skin condition index and a coating state of a composition when a specified composition is applied to the user's skin, a skin condition acquisition means for acquiring the skin condition index, and a coating film estimation means for referring to the memory means and using the acquired skin condition index to estimate the coating state of the composition when a specified composition is applied to the user's skin.

[0008] The present invention also relates to an application program for operating an estimation device that estimates the state of a coating of a composition when a specified composition is applied to a user's skin, the application program including a skin condition acquisition process that acquires a skin condition index that indicates skin characteristics of the user, and a coating estimation process that uses the acquired skin condition index to estimate the state of a coating of the composition on the user's skin.

[0009] The present invention also relates to an estimation system including a skin condition index indicating a user's skin characteristics, a memory means for storing information indicating a correlation between the skin condition index and a coating state of the composition when a specified composition is applied to the user's skin, a skin condition acquisition means for acquiring the skin condition index, and a coating film estimation means for referring to the memory means and using the acquired skin condition index to estimate the coating state of the composition when a specified composition is applied to the user's skin. Effect of the Invention

[0010] According to the method provided by the present invention, it is possible to estimate the state of formation of a coating of a composition when a given composition is hypothesized to be applied to a user's skin. [Brief description of the drawings]

[0011] [Figure 1] FIG. 2 is an image diagram showing how a skin condition index is obtained in the first embodiment. [Figure 2-1] FIG. 2 is an image diagram showing how the reflectance of skin to which a specific cosmetic material has been applied is obtained in the first and second embodiments. [Figure 2-2] (a) is an image of a bare face photographed in accordance with FIG. 2-1, and (b) is an image of a face photographed in accordance with FIG. 2-1 with cosmetics applied. [Diagram 3] (a) is an image of bare skin irradiated with 320 nm wavelengths in the UVB range, and (b) is an image of skin to which a cosmetic has been applied irradiated with 320 nm wavelengths in the UVB range. [Figure 4] 1(a) shows the results of predicting whether the quality of the coating state of a cosmetic material falls into the low or high group using the coating film estimation mathematical model 1, and FIG. 1(b) shows the degree of agreement between the group predicted using the coating film estimation mathematical model 1 and the actual group, expressed as the accuracy rate. [Diagram 5] 13 is an image diagram showing how a skin image (bare skin image) is obtained in the second and third embodiments. FIG. [Figure 6] 14(a) shows the results of predicting whether the quality of the cosmetic coating film formation state will fall into the low or high group using the coating film estimation mathematical model 2, and FIG. 14(b) shows the degree of agreement between the group predicted using the coating film estimation mathematical model 2 and the actual group, expressed as the accuracy rate. [Figure 7] FIG. 11 is an image diagram showing how to obtain an evaluation value for a comprehensive evaluation of skin to which a specified cosmetic material has been applied in embodiment 3. [Figure 8] 1(a) shows the results of predicting whether the quality of the coating state of a cosmetic material falls into the low or high group using the Coating Film Estimation Mathematical Model 3, and FIG. 1(b) shows the degree of agreement between the group predicted using the Coating Film Estimation Mathematical Model 3 and the actual group, expressed as the accuracy rate. [Figure 9] FIG. 1 is a diagram for estimating the effects of cosmetics 1 to 3 when they are applied. [Figure 10-1] FIG. 2 is a block diagram of an estimation device. [Figure 10-2] FIG. 2 is a block diagram of an estimation device. [Figure 11-1] FIG. 1 is a block diagram of an estimation system. [Figure 11-2] FIG. 1 is a block diagram of an estimation system. [Figure 12] (a-1) to (a-3) are examples of display forms of skin information classification images, (b-1) to (b-3) are examples of display forms of composition classification images, (c-1) is an example of display forms of skin information classification images and composition classification images, and (d-1) and (d-2) are examples of display forms of skin information classification images and composition classification images. [Figure 13] FIG. 1 shows the results of a comparative test of the UV protection effects of cosmetics C to E. [Figure 14] FIG. 13 is a graph showing the results of another comparison test of the UV protection effects of cosmetics C to E. [Figure 15] 11 is a flowchart showing the flow of a process for presenting skin type characteristic information and cosmetic score information based on a skin image performed by an estimation device or estimation system. [Figure 16] 11A to 11C are diagrams illustrating an example of skin type characteristic information generated and stored by the estimation device or the estimation system. [Figure 17] 11 is a diagram showing an example of score information regarding the UV protection effect of cosmetics for each skin type, which is generated and stored by the estimation device or the estimation system. FIG. [Figure 18] FIG. 1A is a diagram showing an example of skin type characteristic information that the estimation device or estimation system displays on a user's information processing terminal, and FIG. 1B is a diagram showing an example of cosmetic score information that the estimation device or estimation system displays on a user's information processing terminal. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings. The drawings of the present embodiment are all intended to explain the technical concept, configuration, and operation of the present invention, and are not intended to specifically limit the configuration. In addition, in all drawings, similar components are given similar reference numerals, and duplicated descriptions are omitted as appropriate.

[0013] An outline of the estimation method in this embodiment (hereinafter, sometimes referred to as this method) will be described. The estimation method of the present embodiment is a method of acquiring a skin condition index indicating a user's skin characteristics, and estimating the state of a coating film of a composition when a specified composition is applied to the user's skin, using the acquired skin condition index and a mathematical model indicating the relationship between the acquired skin condition index and the state of a coating film of the composition when a specified composition is applied to the user's skin. The "skin condition index showing the user's skin characteristics" is an index showing the skin characteristics of the user's skin when a specific composition or a specific cosmetic is not applied, or when the user has washed the face, that is, when the user has bare skin. Here, the "skin characteristics" refers to the nature of the skin, and for example, skin types such as dry skin, normal skin, oily skin, and combination skin, and the index showing the skin characteristics is the "skin condition index". For example, the index is preferably a physical index of the skin such as the moisture content of the stratum corneum, the amount of moisture evaporation, skin viscoelasticity, softness such as skin flexibility, contact angle, color, melanin content, melanin density, skin temperature, moisture content, moisture / oil balance, surface shape, texture, wrinkles, acne, and moles, but also includes the impression of the skin that shows the skin condition, such as skin age, makeup feel, masculinity / femininity, makeup smearing degree, and powdery feel. In addition to the above commonly known skin types, skin types can be classified appropriately based on the above skin condition index. In addition, the skin type is classified based on a predetermined element included in the skin condition index (for example, three elements of "texture", "moisture / oil balance", and "softness"). Any method of classifying the skin type may be used. For example, a condition for classifying into each skin type may be determined in advance, such as when the value of a predetermined element among the values ​​of the above three elements is a predetermined value or more, when all elements are a predetermined value or more, when the value of a predetermined element is a predetermined position or more and the values ​​of other elements are a predetermined value or less, and the skin type may be classified based on the condition. In addition, for example, five clusters may be created by cluster analysis from the values ​​of the three elements of "texture", "moisture / oil balance", and "softness", and a skin type corresponding to each of the created clusters may be associated with the created clusters, and the values ​​of the above three elements included in the skin condition index of the user may be analyzed to determine which cluster the user belongs to, and the skin type may be classified into the corresponding cluster. Note that the above three elements are only an example, and the types and numbers of elements are not limited to these. "User's skin" refers to the soft tissue on the surface of a living body, regardless of the part of the body, such as the face, arms, or hands. The "predetermined composition" refers to a composition intended to be applied to the skin, and broadly includes, for example, cosmetics called lotions, skin lotions, creams, milky lotions, etc., quasi-drugs, and pharmaceuticals. Specific examples include skin care cosmetics such as lotions, skin lotions, milky lotions, creams, beauty essences, massage packs, and lip balms; makeup cosmetics such as foundations, makeup bases, liquid foundations, oil-based foundations, powder foundations, concealers, control colors, eye shadows, blushers, lipsticks, lip glosses, lip liners, and body decollete cosmetics; UV protection cosmetics such as sunscreen lotions, sunscreen gels, and sunscreen creams; bath cosmetics such as bath oils and bath additives; ointments containing bactericidal components, anti-itching components, and anti-inflammatory components, but are not limited thereto. A "film of a composition" is a film formed on skin when a specific composition is applied to the skin. Details will be described later, but even when the same amount of the same composition is applied, the state of the film formed by the composition will differ depending on the condition of the skin to which it is applied, and even when applied to the same skin, the state of the film formed by the composition will differ depending on the type (ingredients) of the composition and the amount applied. The "state of coating film formation" refers to how the coating film of the composition is formed on the skin, and is evaluated by the thickness of the coating film formed, the unevenness of the thickness of the coating film formed, and the uniformity of the coating film formed. For example, when the composition to be applied contains a color, the state where the coating film of the composition is formed without unevenness in color, when the composition to be applied contains particles, the state where the coating film of the composition is formed with uniform particles, when the composition to be applied contains an ultraviolet absorber, the state where ultraviolet rays are absorbed regardless of the position of the coating film of the composition formed, when the composition to be applied contains an ultraviolet scattering agent, the state where ultraviolet rays are reflected regardless of the position of the coating film of the composition formed, etc. "Estimating" means estimating the formation state of a coating film of a composition that would be formed if a specified composition were applied without applying the specified composition to a user's skin, and the estimated results can take any form, such as outputting numerical values, graphs, or simulation images. The "skin information classification image" is any image showing skin types classified based on the skin condition index. The "composition classification image" is any image showing a composition classification based on the characteristics of the composition. The "characteristics of the composition" are not particularly limited as long as they are factors related to the formation state of the coating film of the composition, and examples of the composition include the formulation type, physical properties such as wettability, viscosity, and color. The skin information classification images and the composition classification images are each created based on shape, pattern, color, or shade, or a combination of these, and the estimation results can be output by combining these images, such as by overlaying them.

[0014] When creating the coating film mathematical model prepared in this embodiment, the specific composition applied to the subject's skin was a cosmetic containing at least one of a component that absorbs wavelengths in the ultraviolet region (hereinafter, sometimes referred to as an "ultraviolet absorbing agent") or a component that scatters wavelengths in the ultraviolet region (hereinafter, sometimes referred to as an "ultraviolet scattering agent"). Here, "added cosmetic" includes not only a cosmetic containing at least one of an ultraviolet absorbing agent or an ultraviolet scattering agent already added (containing these components), but also a cosmetic containing no such components to which a predetermined proportion of the component has been added. This makes it possible to estimate the state of formation of a coating film of a cosmetic when it is assumed that a cosmetic containing no components that absorb and / or scatter wavelengths in the ultraviolet region is applied to the user's skin. In this embodiment, for example, a cosmetic product in which an ultraviolet absorbing agent or an ultraviolet scattering agent is added to a W / O type cosmetic product (water in oil cosmetic product) or an O / W type cosmetic product (oil in water cosmetic product) is used. Therefore, it is possible to estimate the ultraviolet protection property of the cosmetic product by using the estimation result of the formation state of the coating film formed on the skin of the cosmetic product when it is assumed that the cosmetic product to which an ultraviolet absorbing agent or an ultraviolet scattering agent is added is applied to the skin of a user. Note that when creating a coating film mathematical model, the cosmetic product may be one to which only an ultraviolet absorbing agent is added, one to which only an ultraviolet scattering agent is added, or one to which both an ultraviolet scattering agent and an ultraviolet absorbing agent are added. In these cases, it is possible to estimate the ultraviolet protection property of the cosmetic product based on the estimation result. Some cosmetics containing added UV absorbers or UV scattering agents have a clearly indicated index showing their UV protection (previously published public UV protection value). The most widely known index showing UV protection is the Sun Protection Factor (SPF) for UVB range UV rays, and the UV protection effect is expressed as an SPF value (e.g., SPF30, etc.). For UVA range UV rays, PFA (Protection Factor of UVA) or UVAPF (UVA Protection factor of product) is used. When evaluating the UV protection of cosmetics, evaluation may be performed against clearly indicated indexes showing UV protection. In this embodiment, the specific composition for which the coating film formation state is estimated is a cosmetic to which at least one of a component that absorbs wavelengths in the ultraviolet region and a component that scatters wavelengths in the ultraviolet region is added, and the estimated coating film formation state of the composition is described as the coating film formation state of the cosmetic. In addition, it will be described how to estimate whether the cosmetic can exhibit its functions (for example, whether the desired ultraviolet protection function can be expected or not) based on the estimated coating film formation state of the cosmetic.

[0015] <Embodiment 1> As shown in Fig. 1, the first embodiment is a method for measuring (obtaining) a skin condition index for a user's skin (bare skin) using a predetermined measuring device 10, and estimating the formation state of a coating film that would be formed on the skin by a predetermined cosmetic material if the cosmetic material were applied based on the measured skin condition index. The formation state of a coating film of the cosmetic material is estimated based on the measured skin condition index and a mathematical model created in advance (the mathematical model used for coating film estimation in the first embodiment is referred to as "coating film estimation mathematical model 1"). In the first embodiment, the formation state of a coating film that would be formed on the skin if cosmetic material A (SPF50) and cosmetic material B (SPF50+) were applied as the predetermined cosmetic material is estimated. The skin condition index acquired in the first embodiment is a physical property value indicating the skin condition measured for the user's skin using a predetermined measuring device 10. The physical property value is, for example, the stratum corneum moisture content, the amount of water evaporation, skin viscoelasticity, skin flexibility, contact angle, etc.

[0016] Figure 1 shows how the amount of water evaporation is measured by placing a contactor on the skin. The skin condition indicators obtained are as follows: Stratum corneum moisture content: Values ​​measured using a stratum corneum moisture meter (Corneometer, Courage+Khazaka) were used. Water evaporation rate: Values ​​measured using a water evaporation meter (Tewameter, Courage+Khazaka) were used. Skin viscoelasticity: Values ​​measured using a skin viscoelasticity measuring device (Cutometer, Courage+Khazaka) were used. Skin flexibility: Values ​​measured using a skin viscoelasticity measuring device (Cutometer, Courage+Khazaka) Contact angle: Values ​​measured using a contact angle meter (PCA-11, Kyowa Interface Science Co., Ltd.) It should be noted that the above-mentioned measuring device is merely an example, and values ​​measured with other measuring devices or values ​​calculated by photographing the skin and processing the image may also be used. Thus, in embodiment 1, the skin condition index includes at least one evaluation item of stratum corneum moisture content, water evaporation rate, skin viscoelasticity, skin flexibility, and contact angle measured by a specified measuring device.

[0017] Next, the coating film estimation mathematical model 1 will be explained. The training data and conditions used to create the coating film estimation mathematical model 1 are as follows. Prescribed composition 20: Cosmetic A (SPF50, formulation W / O) Cosmetic B (SPF50+, W / O formulation) Application area: 4cm x 4cm Amount applied: 16mg for 4cm x 4cm Subjects: Cosmetic A was applied to the forehead or cheeks of 19 men and women. Cosmetic B was applied to the forehead or cheeks of 20 men and women. Camera used: UV camera 30 Application method: Apply evenly by a trained tester Light source: MAX-303, Asahi Spectroscopy Bandpass filter (320nm±5nm) Polarizing plate As shown in Fig. 2-1, a specific composition 20 is applied to the skin of a subject, and image data (ultraviolet skin image) of the subject's skin taken under ultraviolet irradiation by an ultraviolet camera 30 is used. A coating film estimation mathematical model 1 is created from the taken image data in the following procedure.

[0018] 1) Calculate the UV reflectance of the coating of each cosmetic material formed on the skin The UV reflectance of the coating film formed on the skin by cosmetic A when a specific composition 20 (cosmetic A) is applied to the skin (skin 15) of a subject is calculated (referred to as "UV reflectance A"), and the UV reflectance of the coating film formed on the skin by cosmetic B when a specific composition 20 (cosmetic B) is applied to the skin of a subject is calculated (referred to as "UV reflectance B"). The calculation method is as follows. Figure 3(a) shows the case where ultraviolet light with a wavelength of 320 nm (hereinafter referred to as "ultraviolet light") included in the UVB region is irradiated onto the skin (bare skin) of a subject. In the figure, "incident light" is the irradiated ultraviolet light, "specularly reflected light" is the ultraviolet light reflected from the surface of the skin, and "internal scattered light" is the ultraviolet light that is not reflected from the surface of the skin and penetrates the inside of the skin, spreads inside the skin, and emerges from the skin. The intensity of the internal scattered light with the specular reflected light removed is obtained. This is called the internal scattered light intensity of bare skin. FIG. 3(b) shows a case where a specific composition 20 is applied to the skin of a subject and ultraviolet light is irradiated. In the figure, "incident light" is the irradiated ultraviolet light, "specular reflected light" is the ultraviolet light reflected on the surface of the specific composition 20 and on the surface of the skin, and "internal scattered light" is the ultraviolet light that is not reflected on the surface of the specific composition 20 and the surface of the skin, penetrates into the skin, spreads inside the skin, and emerges from the skin. The intensities of the internal scattered light from which the specular reflected light is removed when cosmetic A is applied as the specific composition 20, and the internal scattered light from which the specular reflected light is removed when cosmetic B is applied as the specific composition 20 are obtained. The internal scattered light intensity of the applied skin when cosmetic A is applied is A, and the internal scattered light intensity of the applied skin when cosmetic B is applied is B. Then, by dividing the internal scattered light intensity of the applied skin when the specified composition 20 is applied by the internal scattered light intensity of bare skin, the ultraviolet reflectance of the composition present at the site where the specified composition 20 has been applied is calculated (internal scattered light intensity A of applied skin when cosmetic A is applied / internal scattered light intensity of bare skin=ultraviolet reflectance of the coating film formed by cosmetic A present at the site where cosmetic A has been applied (ultraviolet reflectance A); internal scattered light intensity B of applied skin when cosmetic B is applied / internal scattered light intensity of bare skin=ultraviolet reflectance of the coating film formed by cosmetic B present at the site where cosmetic B has been applied (ultraviolet reflectance B)). In this way, by removing the specularly reflected light and calculating the UV reflectance using the intensity of the internally scattered light, it is possible to accurately estimate the application condition of the coating film formed on the skin (the formation condition of the coating film). Here, polarizing plates are attached to the light source and the ultraviolet camera, ultraviolet light is irradiated onto the skin to which cosmetic A (or cosmetic B) has been applied, the specularly reflected light is removed, and the reflected internally scattered light is photographed by the ultraviolet camera 30, thereby enabling the internal scattering intensity to be measured. In this embodiment, the UV reflectance at a wavelength of 320 nm is calculated taking into consideration that the wavelength range of the UVB region is 320 to 280 nm. However, the wavelength range is not limited to this. For example, when estimating the state of a coating film formed on the skin by a cosmetic product and estimating the UV protection effect in the UVA region from the estimation result, the UV reflectance may be calculated using UV light with a wavelength of 380 to 320 nm, for example, UV light with a wavelength of 350 nm. 2) Divide into two groups based on UV reflectance The calculated UV reflectance of the coating film formed by each cosmetic on the skin is arranged in order of UV reflectance, and each subject is divided into two groups, one with high UV reflectance (50%) and the other with low UV reflectance (50%). The group with high UV reflectance is the "group with low quality of the coating film of the cosmetic," and the group with low UV reflectance is the "group with high quality of the coating film of the cosmetic." In general, when the UV reflectance is high, the coating film of the cosmetic is formed thinly, and when the UV reflectance is low, the coating film of the cosmetic is formed thickly. This difference occurs when the area to which the cosmetic is applied and the amount of the cosmetic applied are constant as in this embodiment, for example, when there are recesses due to wrinkles, acne scars, etc. on the skin surface to which the cosmetic is applied, the cosmetic is applied so as to fill the recesses, and as a result, the coating film formed by the cosmetic on the skin is formed thinly. This is because the state of the coating film of the cosmetic is affected by the state of the skin to which it is applied. Therefore, the UV reflectance of the coating film formed by each cosmetic on the skin calculated for each subject is different (ordered). Although the shape of the skin surface has been described as a factor that affects the state of formation of a cosmetic film, this is merely one example, and other skin conditions and differences in the physical properties of the skin are also factors that affect the state of formation of a cosmetic film. 3) Measure the subject's skin condition index The above-mentioned skin condition indices (stratum corneum moisture content, moisture loss, skin viscoelasticity, skin flexibility, and contact angle) are measured for the subject using a predetermined measuring device. 4) Create training data for machine learning Using the results of dividing the samples into two groups in 2) and the measurement results in 3), training data is created for creating a coating film estimation mathematical model 1. 5) Create a paint film estimation mathematical model 1 A standardization process is performed on each evaluation value, and the most suitable classification model is selected from a number of classification models (e.g., naive bayes (NB), logestic regression (LR), linear discriminant analysis (LDA), random forest (RF), gradient boosting (GB), support vector machine (SVM), Gaussian process (GP)) to determine the prediction model. The prediction model is then used to predict whether the quality of the coating film formation state of the cosmetic material falls into the low or high group. The degree of agreement between the predicted group and the actual group is calculated as the accuracy rate. The generalization performance of the classification model is evaluated by leave-one-out cross-validation (LOOCV), and the calculation model with the highest accuracy rate is determined to be the optimal model: coating film estimation mathematical model 1. Note that in this embodiment, classification model GB is used as coating film estimation mathematical model 1 for cosmetic A, and classification model LDA is used as coating film estimation mathematical model 1 for cosmetic B.

[0019] Figure 4(a) shows the results of predictions made using Film Estimation Mathematical Model 1 as to whether the quality of the film formed by a cosmetic on the skin would fall into the low or high group, as well as the actual results, and Figure 4(b) shows the results calculated as the accuracy rate, which is the degree of agreement between the groups predicted using Film Estimation Mathematical Model 1 and the actual groups. As can be seen from Figures 4(a) and 4(b), when the film formation state of a cosmetic material formed on the skin is predicted using the film formation estimation mathematical model 1, a high accuracy rate can be obtained. Therefore, by using the user's skin condition index obtained using a specified measuring device and the coating film estimation mathematical model 1, it is possible to estimate the state of coating film formation of a specified cosmetic material without applying the cosmetic material to the skin.As a result, even without applying the specified cosmetic material (cosmetics with added UV absorbers or UV scattering agents) to the skin, it is possible to estimate the state of coating film formation of the cosmetic material that will be formed on the skin when the specified cosmetic material is applied to the user's skin (the quality of the coating film formation state of the cosmetic material on the skin), and this makes it possible to evaluate the degree to which an effect based on the function of the specified cosmetic material can be expected (for example, UV protection function in the case of cosmetics with added UV absorbers or UV scattering agents).

[0020] As described above, in the first embodiment, a mathematical model (film estimation mathematical model 1) showing the relationship between the skin condition index and the UV reflectance of the coating film of the cosmetic is created using each of the skin condition indexes (e.g., stratum corneum moisture content, water evaporation rate, skin viscoelasticity, skin flexibility, contact angle measured by the measuring device 10) of multiple subjects (e.g., 19 to 20 men and women) and the UV reflectance of the coating film formed by the cosmetic on the skin calculated from the UV skin images of the multiple subjects (e.g., the images shown in FIG. 2-2 taken by the photographing device shown in FIG. 2-1). Using the created film estimation mathematical model 1 and the user's skin condition indexes (e.g., stratum corneum moisture content, water evaporation rate, skin viscoelasticity, skin flexibility, contact angle) measured by the measuring device 10, it is possible to estimate the formation state of the coating film formed by the cosmetic on the skin when it is assumed that the cosmetic is applied to the user's skin, and it is possible to estimate and evaluate the function exhibited by the cosmetic.

[0021] In addition, the state of formation of the coating film formed by the cosmetic on the skin was estimated using the reflectance of ultraviolet light with a wavelength of 320 nm in the UVB wavelength range, so that it is possible to directly estimate and evaluate the function of the cosmetic (if the cosmetic has ultraviolet protection function in the UVB range, the ultraviolet protection function in the UVB range) based on the state of formation of the coating film formed by the cosmetic on the skin. Specifically, for example, in the case of cosmetic A (SPF50), the ultraviolet reflectance of each of multiple subjects (19 people) is calculated, and a standard value of the calculated ultraviolet reflectance is specified. In this embodiment, the "standard value" refers to the ultraviolet reflectance located in the middle when the ultraviolet reflectances are arranged in order of ultraviolet reflectance, as described in "2) Divide into two groups according to ultraviolet reflectance". If the state of formation of the film formed by the cosmetic on the subject's skin (UV reflectance) estimated by the above-mentioned method is a standard value, then it can be inferred that the claimed effect of cosmetic A (equivalent to SPF 50) can be expected, if it is higher than the standard value, then the claimed effect of cosmetic A (equivalent to SPF 50) can be expected to be sufficient, and if it is lower than the standard value, then it can be inferred that the claimed effect of cosmetic A (equivalent to SPF 50) cannot be expected very well. In this way, the user can judge whether or not a cosmetic is suitable for their own skin based on the estimated state of formation of the film formed by the cosmetic on the skin.

[0022] Generally, as time passes after a certain cosmetic is applied to the skin, the state of the coating film that the cosmetic forms on the skin changes. This is due to various factors, such as external factors such as humidity, temperature, and wind, factors due to the skin characteristics of the subject (user), and the subject's (user's) constitution (whether or not they sweat easily, whether or not there is a lot of movement on the skin surface (in the case of the face, whether or not there are a lot of changes in facial expression)). Therefore, the coating film estimation mathematical model 1 may be configured to estimate the formation state of a coating film formed on the skin by the cosmetic in a first time period after a specified cosmetic is applied to a user's skin (hereinafter referred to as the "first formation state"), and the formation state of a coating film formed on the skin by the cosmetic in a second time period after the first time period (hereinafter referred to as the "second formation state").

[0023] A method for estimating the first formation state and the second formation state will be described. Here, the first time period is, for example, one minute after application, and the second time period is, for example, eight hours after application. Then, the coating film estimation mathematical model 1 may be created at each time. That is, the above-mentioned step of "1) calculating the ultraviolet reflectance of the coating film of each cosmetic material formed on the skin" may be performed by calculating the ultraviolet reflectance of each cosmetic material one minute after application of a predetermined cosmetic material to the skin of multiple subjects and eight hours after application of a predetermined cosmetic material to the skin of multiple subjects, and performing the above-mentioned steps of "2) dividing into two groups according to the ultraviolet reflectance" to "5) creating the coating film estimation mathematical model 1", thereby constructing a coating film estimation mathematical model 1 that estimates the formation state of the coating film formed by the cosmetic material on the skin one minute after application (first formation state) and a coating film estimation mathematical model 1 that estimates the formation state of the coating film formed by the cosmetic material on the skin eight hours after application (second formation state). In this way, a coating film estimation mathematical model 1 is created that estimates the formation state of a coating film formed on the skin by the cosmetic one minute after application (first formation state), and a coating film estimation mathematical model 1 is created that estimates the formation state of a coating film formed on the skin by the cosmetic eight hours after application (second formation state).By using the two coating film estimation mathematical models 1 created and a user's skin condition index obtained using a specified measuring device, it is possible to estimate the formation state of a coating film formed on the skin by the cosmetic a specified time after application, without applying a specified cosmetic to the user's skin and even before a specified time has passed since application (in this embodiment, first time period: 1 minute or second time period: 8 hours). In this way, it is possible to estimate the formation state of a coating film formed on the skin by a specific composition (e.g., cosmetic A, cosmetic B) in a first time period (e.g., 1 minute after application) after application of the composition (first formation state), and the formation state of a coating film formed on the skin by the composition in a second time period (e.g., 8 hours after application) after the first time period (second formation state). It is not necessary to estimate both the first formation state and the second formation state, and only one of them may be estimated depending on the purpose. It is also possible to add a third time period, a fourth time period, etc.

[0024] In addition, by using the first formation state and the second formation state, it is possible to estimate the effects that can be expected in a first time period and the effects that can be expected in a second time period in relation to the effect that the applied composition is seeking. In this way, a specified cosmetic is a cosmetic (e.g., cosmetic A, cosmetic B) to which an ultraviolet absorbing agent or an ultraviolet scattering agent has been added, and the first and second formation states are estimated, and based on the estimated first and second formation states, it is possible to estimate and evaluate the function exerted by the cosmetic (evaluate the extent to which the effect can be expected for the function possessed by the cosmetic). Therefore, for example, if one wishes to estimate and evaluate the UV protection effect when a cosmetic is applied before going out and then 8 hours later is in a situation where it is likely to be exposed to UV rays, one can estimate the state of the film that the cosmetic forms on the skin in the second time period. On the other hand, if one wishes to estimate the UV protection effect when a cosmetic is applied before going out and then 8 hours later is in a situation where it is likely to be exposed to UV rays, one can estimate both the state of the film that the cosmetic forms on the skin in the first time period and the second time period and use both to estimate and evaluate. In this way, it is possible to use different coating film estimation mathematical models 1 according to the purpose.

[0025] <Embodiment 2> The second embodiment is a method for estimating the state of a coating film formed on the skin when a specified composition is applied, based on a skin condition index generated using a mathematical model from an image of a user's skin (bare skin) and a mathematical model showing the relationship between this skin condition index and the UV reflectance when a specified composition is applied to the skin. In this embodiment, the mathematical model used to generate the skin condition index is referred to as the "skin condition index mathematical model". In addition, the mathematical model showing the relationship between the skin condition index obtained in embodiment 2 and the UV reflectance of the coating film of the composition when a predetermined composition is applied to the skin is referred to as the "coating film estimation mathematical model 2". In embodiment 2, the "skin condition index mathematical model" and the "coating film estimation mathematical model 2" are used to estimate the formation state of the coating film formed on the skin of the composition without applying the composition to the user's skin. In embodiment 2, the formation state of the coating film formed on the skin when it is assumed that cosmetic C (SPF50+, formulation O / W) is applied as the predetermined composition is estimated using two types of mathematical models, the "skin condition index mathematical model" and the "coating film estimation mathematical model 2". The skin condition index mathematical model and coating film estimation mathematical model 2 will be explained.

[0026] The "skin condition index mathematical model" is a trained discrimination model that is trained based on multiple training data and is trained to obtain at least the following seven skin condition indexes. Overall rating (overall skin condition) Skin color (whiteness of skin) - Make-up feel (does it look like makeup on the skin or not?) · Skin age (an index showing the degree of skin aging) Masculinity / Femininity (Which skin texture is closer to male or female?) · Makeup smudge level (an index showing the degree of makeup smudge) Powdery feel (an index showing how smooth the skin feels) These seven skin condition indices are acquired as the skin condition indices in the second embodiment. These skin condition indices can be acquired by photographing the user's skin (bare skin) with an imaging device 40 and based on the photographed skin image (bare skin image) and a skin condition index mathematical model, as shown in Fig. 5. The imaging device 40 used in this embodiment may be any type, and may be an independent digital camera, a video camera, or an imaging device provided in a mobile phone, tablet terminal, or personal computer, which are generally referred to as mobile terminals. However, in order to determine the appearance or attribute of the skin image (bare skin image) of the user, it is preferable that the imaging device 40 be a camera capable of capturing a color image capturing visible light. In this way, the skin condition indexes are evaluation items (the above seven items) obtained using a skin image (bare skin image) obtained by capturing a user's skin and a skin condition index mathematical model that indicates the relationship between the skin condition indexes.

[0027] Here, a method for creating the skin condition index mathematical model will be described. The training data used to create the skin condition index mathematical model is a combination of bare facial images of multiple people and facial images with a specified cosmetic applied, along with correct answer information indicating the skin condition of the human faces reflected in each of the facial images. The facial image may include the face of the subject to be captured to an extent that the skin condition of the estimation item can be analyzed, and may include the entire or part of the face of the subject to be captured. The facial image to be acquired may include parts other than the subject's face, such as hair or neck, or the background. In addition, the facial image may be a color image or a grayscale image, as long as it is possible to estimate the skin condition of the human face captured in the facial image. In addition, the facial image may be normalized to a predetermined rectangular shape, or may include a facial image of an image size different from the predetermined image size of the predetermined rectangular shape or a shape different from the predetermined rectangular shape. The predetermined cosmetic material may be any type, and may or may not contain an ultraviolet absorbing agent or an ultraviolet scattering agent. In this embodiment, a foundation is used. The correct answer information is information indicating the skin condition of a human face obtained by a professional evaluator visually evaluating the corresponding face image or the subject of the face image itself using a measuring instrument, etc. In this embodiment, information on the above skin condition indexes (7 items) obtained by visually evaluating the face images by five professional evaluators was used. Overall rating (overall skin condition) Overall skin condition rated on a 7-point scale Skin color (skin whiteness) Evaluate the whiteness of your skin on a 7-point scale - Make-up feel (whether it looks like makeup or not) Evaluation of whether it looks like makeup or not Skin age (an index showing the degree of skin aging) The degree of skin aging is evaluated on a 5-point scale Masculinity / femininity (Which skin texture is closer to, male or female?) Evaluation of whether skin texture is closer to male or female · Degree of makeup smudged (an index showing the degree of makeup smudged) Evaluation of whether the degree of makeup smudged is high or low Powdery feel (an index showing the smoothness of the skin) Evaluation of whether the skin feels smooth or not In this embodiment, the facial images of bare skin and facial images with a predetermined cosmetic applied were each evaluated for the above seven items. Next, for each acquired face image, position coordinates (predetermined position coordinates) of a plurality of predetermined locations in a face region of a human face captured in the target face image are identified. The predetermined position coordinates include at least the position coordinates of shape feature points of the face region. Next, the position of each pixel of the target facial image is converted so that the facial area has a predetermined rectangular shape based on the identified multiple predetermined position coordinates, and the position of each pixel of the original facial image corresponds to the input rules of the skin condition index mathematical model. Then, a skin condition index mathematical model is created using training data including the converted face image. Although the learning algorithm is not limited, in this embodiment, a deep learning is used. In this way, the "skin condition index mathematical model" used in this embodiment was created using both a face image of bare skin and a face image with a specified cosmetic applied, and the evaluation results obtained by evaluating the above seven items for each of the two images. In this embodiment, the above-mentioned skin condition indices (seven items) are indices suitable for estimating the formation state of a coating film that a cosmetic containing an ultraviolet absorbing agent or an ultraviolet scattering agent will form on the skin when it is assumed that the cosmetic is applied, and therefore a skin condition index mathematical model for calculating these indices was used. However, when estimating the formation state of a coating film that a cosmetic other than a cosmetic containing an ultraviolet absorbing agent or an ultraviolet scattering agent will form on the skin when it is assumed that the cosmetic is applied, it is sufficient to use a skin condition index mathematical model that can calculate a skin condition indices suitable for estimating the formation state of a coating film that a cosmetic will form on the skin when it is applied. The "skin condition index mathematical model" may be created by creating either or both of a skin condition index mathematical model (bare skin) created using a face image of bare skin and an evaluation result obtained by evaluating the bare skin face image for the above seven items, and a skin condition index mathematical model (application) created using a face image with a predetermined cosmetic applied and an evaluation result obtained by evaluating the face image with the predetermined cosmetic applied for the above seven items, and may use either or both to obtain the skin condition index (seven items). However, in the second embodiment, since the user's skin image (bare skin image) is used when obtaining the user's skin condition index, it is preferable to at least include a skin condition index mathematical model (bare skin) including a face image of bare skin and an evaluation result obtained by evaluating the bare skin face image for the seven items.

[0028] Next, the coating film estimation mathematical model 2 will be explained. The training data and conditions used to create the coating film estimation mathematical model 2 are as follows. Prescribed composition 20: Cosmetic C (SPF50+, formulation O / W) Application area: 4cm x 4cm Amount applied: 16mg for 4cm x 4cm Subjects: 20 women on the forehead or cheek Camera used: UV camera 30 Application method: Apply evenly by a trained tester Light source: MAX-303, Asahi Spectroscopy Bandpass filter (320nm±5nm) Polarizing plate As shown in FIG. 2-1, a specific composition 20 is applied to the skin of a subject, and image data (ultraviolet skin image) obtained by photographing the subject's skin under ultraviolet irradiation with an ultraviolet camera 30 is used. A coating film estimation mathematical model 2 is created from the photographed image data in the following manner. The method for obtaining the ultraviolet reflectance of the specific composition 20 (cosmetic C) is the same as in the first embodiment.

[0029] 1) Calculate the UV reflectance of the cosmetic film formed on the skin When a specific composition 20 (cosmetic C) is applied to the skin (skin 15) of a subject, the UV reflectance of the coating film formed on the skin by cosmetic C (referred to as "UV reflectance C") is calculated. The calculation method is as follows. Figure 3(a) shows the case where ultraviolet light with a wavelength of 320 nm (hereinafter referred to as "ultraviolet light") included in the UVB region is irradiated onto the skin (bare skin) of a subject. In the figure, "incident light" is the irradiated ultraviolet light, "specularly reflected light" is the ultraviolet light reflected from the surface of the skin, and "internal scattered light" is the ultraviolet light that is not reflected from the surface of the skin and penetrates the inside of the skin, spreads inside the skin, and emerges from the skin. The intensity of the internal scattered light with the specular reflected light removed is obtained. This is called the internal scattered light intensity of bare skin. FIG. 3(b) shows the case where a specific composition 20 is applied to the skin of a subject and ultraviolet light is irradiated. In the figure, "incident light" is the irradiated ultraviolet light, "specular reflected light" is the ultraviolet light reflected on the surface of the specific composition 20 and on the surface of the skin, and "internal scattered light" is the ultraviolet light that is not reflected on the surface of the specific composition 20 and the surface of the skin, penetrates the inside of the skin, spreads inside the skin, and emerges from the skin. The intensity of the internal scattered light from which the specular reflected light has been removed is obtained when cosmetic C is applied as the specific composition 20. This is called the internal scattered light intensity C of the applied skin. Then, by dividing the internal scattered light intensity C of the applied skin when the specified composition 20 is applied by the internal scattered light intensity of bare skin, the ultraviolet reflectance of the composition present at the site where the specified composition 20 has been applied is calculated (internal scattered light intensity C of applied skin when cosmetic C is applied / internal scattered light intensity of bare skin=ultraviolet reflectance (ultraviolet reflectance C) of the coating film formed by cosmetic C present at the site where cosmetic C has been applied). In this way, by removing the specularly reflected light and calculating the UV reflectance using the intensity of the internally scattered light, it is possible to accurately estimate the application condition of the coating film formed on the skin (the formation condition of the coating film). Here, by attaching polarizing plates to the light source and the ultraviolet camera, ultraviolet light is irradiated onto the skin to which cosmetic C has been applied, the specularly reflected light is removed, and the reflected internally scattered light is photographed by the ultraviolet camera 30, thereby making it possible to measure the internal scattering intensity. In this embodiment, the UV reflectance at a wavelength of 320 nm is calculated taking into consideration that the wavelength range of the UVB region is 320 to 280 nm. However, the wavelength range is not limited to this. For example, when estimating the state of a coating film formed on the skin by a cosmetic product and estimating and evaluating the UV protection effect in the UVA region from the estimation result, the UV reflectance may be calculated using UV light with a wavelength of 380 to 320 nm, for example, UV light with a wavelength of 350 nm. 2) Divide into two groups based on UV reflectance The calculated UV reflectance of the coating film formed by each cosmetic on the skin is ranked in order of UV reflectance, and each subject is divided into two groups, one with high UV reflectance (50%) and one with low UV reflectance (50%). The group with high UV reflectance is called the "group with low quality of the cosmetic coating film formation," and the group with low UV reflectance is called the "group with high quality of the cosmetic coating film formation." The UV reflectance of the coating film formed by each cosmetic on the skin calculated for each subject is different (ranked) because the coating film of each cosmetic differs depending on the condition of the skin to which the cosmetic is applied. The condition of the skin to which the cosmetic is applied affects the condition of the cosmetic coating film formation, as explained in the first embodiment. 3) Measure the subject's skin condition index Skin condition indexes (7 items) are obtained using the above-mentioned skin condition index mathematical model and a photographed skin image (bare skin image) of the subject. 4) Create training data for machine learning Using the results of dividing the samples into two groups in 2) and the results obtained in 3), training data for creating a coating film estimation mathematical model 2 is created. 5) Create a paint film estimation mathematical model 2 A standardization process is performed on each evaluation value, and the most suitable classification model is selected from multiple classification models (e.g., naive bayes (NB), logestic regression (LR), linear discriminant analysis (LDA), random forest (RF), gradient boosting (GB), support vector machine (SVM), Gaussian process (GP)) to determine the prediction model. The prediction model is used to predict whether the quality of the coating film formation state of the cosmetic falls into the low or high group. The degree of agreement between the predicted group and the actual group is calculated as the accuracy rate. The generalization performance of the classification model is evaluated by leave-one-out cross-validation (LOOCV), and the calculation model with the highest accuracy rate is determined to be the optimal model: coating film estimation mathematical model 2. Note that in this embodiment, classification model RF is used as the coating film estimation mathematical model 2 for cosmetic C.

[0030] Figure 6(a) shows the results of predictions made using Film Estimation Mathematical Model 2 as to whether the quality of the film formed by a cosmetic on the skin would fall into the low or high group, as well as the actual results, and Figure 6(b) shows the results of calculations of the accuracy rate, which is the degree of agreement between the groups predicted using Film Estimation Mathematical Model 2 and the actual groups. From Figures 6(a) and 6(b), it can be seen that when the film formation state formed by a cosmetic on the skin is predicted using the film formation estimation mathematical model 2, a high accuracy rate can be obtained. Therefore, by using the user's skin condition index estimated using the skin condition index mathematical model and the coating film estimation mathematical model 2, it is possible to estimate the state of formation of a coating film that a specified composition will form on the skin without applying the composition to the skin.Therefore, even without applying the specified composition (a cosmetic product to which an ultraviolet absorbing agent or an ultraviolet scattering agent has been added) to the skin, it is possible to estimate the quality of the state of formation of a coating film that a specified composition will form on the skin when the specified composition is applied to the user's skin.This makes it possible to evaluate the degree to which an effect based on the function of the specified composition (for example, an ultraviolet protection function in the case of a cosmetic product to which an ultraviolet absorbing agent or an ultraviolet scattering agent has been added) can be expected.

[0031] As described above, in the second embodiment, a mathematical model (film estimation mathematical model 2) is created that shows the relationship between the skin condition index and the UV reflectance of the coating film of the cosmetic, based on the skin condition index (e.g., seven items calculated using the skin image of the subject and the skin condition index mathematical model) of each of a plurality of subjects (e.g., 20 women) and the UV reflectance of the coating film formed by the cosmetic on the skin calculated from the UV skin images of the plurality of subjects (e.g., the images shown in FIG. 2-2 taken with the imaging device shown in FIG. 2-1). Using the created film estimation mathematical model 2, the user's skin image (bare skin image), and the user's skin condition index (e.g., the above seven items) obtained from the skin condition mathematical model, it becomes possible to estimate the formation state of the coating film formed by the cosmetic on the skin when it is assumed that the cosmetic is applied to the user's skin, and it becomes possible to estimate and evaluate the function exhibited by the cosmetic.

[0032] As in the first embodiment, the state of the coating film formed by the cosmetic on the skin was estimated using the reflectance of ultraviolet light with a wavelength of 320 nm in the UVB wavelength range, and therefore the function of the cosmetic (UVB protection function in the case of a cosmetic with UVB protection function) can be directly estimated and evaluated based on the state of the coating film formed by the cosmetic on the skin. Specifically, for example, in the case of cosmetic C (SPF50+), the UV reflectance of each of multiple subjects (20 people) is calculated, and a standard value of the calculated UV reflectance is specified. In this embodiment, the "standard value" refers to the UV reflectance located in the middle when the UV reflectances are arranged in order of UV reflectance, as described in "2) Divide into two groups according to UV reflectance". If the state of formation of the coating film formed by the cosmetic on the subject's skin (ultraviolet reflectance) estimated by the above-mentioned method is a standard value, then it can be inferred that the claimed effect of cosmetic C (equivalent to SPF50+) can be expected, if it is higher than the standard value, then the claimed effect of cosmetic C (equivalent to SPF50+) can be expected to be sufficient, and if it is lower than the standard value, then it can be inferred that the claimed effect of cosmetic C (equivalent to SPF50+) cannot be expected very much. Therefore, the user can judge whether or not the cosmetic is suitable for their own skin based on the estimated state of formation of the coating film formed by the cosmetic on the skin.

[0033] Similarly to the first embodiment, the coating film estimation mathematical model 2 can be created with the first time period being, for example, 1 minute after application, and the second time period being, for example, 8 hours after application, to estimate the first and second formation states. Note that the creation method is similar to the first embodiment, in that the step of "1) calculating the UV reflectance of the coating film of the cosmetic formed on the skin" described in the second embodiment is performed by calculating the UV reflectance of the cosmetic 1 minute after application of the cosmetic to the skin of the subject and 8 hours after application of the cosmetic to the skin of the subject, and performing the above-mentioned steps of "2) dividing into two groups according to the UV reflectance" to "5) creating the coating film estimation mathematical model 2", thereby constructing the coating film estimation mathematical model 2 that estimates the formation state of the coating film formed on the skin by the cosmetic 1 minute after application (first formation state) and the coating film estimation mathematical model 2 that estimates the formation state of the coating film formed on the skin by the cosmetic 8 hours after application (first formation state). In this way, a coating film estimation mathematical model 2 is created that estimates the formation state of a coating film formed on the skin by the cosmetic one minute after application (first formation state), and a coating film estimation mathematical model 2 is created that estimates the formation state of a coating film formed on the skin by the cosmetic eight hours after application (second formation state).By using the two coating film estimation mathematical models 2 created and the user's skin condition index obtained using the skin condition index mathematical model, it is possible to estimate the formation state of a coating film formed on the skin by the cosmetic a specified time after application, without applying a specified cosmetic to the user's skin and even before a specified time has passed since application (in this embodiment, first time period: 1 minute or second time period: 8 hours). In this way, it is possible to estimate the formation state of a coating film formed on the skin by a specific composition (e.g., cosmetic C) in a first time period (e.g., 1 minute after application) after application of the composition (first formation state), and the formation state of a coating film formed on the skin by the composition in a second time period (e.g., 8 hours after application) after the first time period (second formation state). It is not necessary to estimate both the first formation state and the second formation state, and only one of them may be estimated depending on the purpose. It is also possible to add a third time period, a fourth time period, etc.

[0034] Furthermore, similarly to embodiment 1, by using the first formation state and the second formation state, it is possible to estimate the effects that can be expected in the first time period and the second time period in relation to the effects that the applied composition is seeking. In this way, the specified cosmetic is a cosmetic to which an ultraviolet absorbing agent or an ultraviolet scattering agent has been added (e.g., cosmetic C), and the first and second formation states can be estimated, and based on the estimated first and second formation states, it is possible to estimate and evaluate the function exerted by the cosmetic (evaluate the extent to which the effect can be expected for the function possessed by the cosmetic). Therefore, for example, if one wishes to estimate and evaluate the UV protection effect when a cosmetic is applied before going out and then 8 hours later is engaged in an activity in a situation where it is likely to be exposed to UV rays, one can estimate the state of the film formed on the skin by the cosmetic in the second time period. Conversely, if one wishes to estimate the UV protection effect when a cosmetic is applied before going out and then 8 hours later is engaged in an activity in a situation where it is likely to be exposed to UV rays continuously, one can estimate both the state of the film formed on the skin by the cosmetic in the first time period and the second time period and use both to estimate and evaluate. In this way, it is possible to use different coating film estimation mathematical model 2 according to the purpose.

[0035] <Embodiment 3> The third embodiment is a method for estimating the state of a coating film formed on the skin by a specified composition when the composition is applied, based on a skin condition index generated using a mathematical model from an image of a user's skin (bare skin) and a mathematical model showing the relationship between this skin condition index and the state of a coating film formed by the specified composition when the specified composition is applied to the skin. In this embodiment, the mathematical model used to generate the skin condition index is referred to as the "skin condition index mathematical model", which is the same as the "skin condition index mathematical model" described in embodiment 2. The mathematical model showing the relationship between the acquired skin condition index and the state of formation of a coating film of a composition when a predetermined composition is applied to the skin is referred to as the "coating film estimation mathematical model 3". In embodiment 3, the "skin condition index mathematical model" and the "coating film estimation mathematical model 3" are used to estimate the state of formation of a coating film formed by a composition on the skin of a user without applying the composition to the skin. The skin condition index mathematical model and coating film estimation model 3 will be explained.

[0036] The "skin condition index mathematical model" is a trained discrimination model trained based on multiple teacher data, and is a discrimination model trained to obtain at least the following seven skin condition indices, and is similar to the "skin condition index mathematical model" described in embodiment 2. Overall rating (overall skin condition) Skin color (whiteness of skin) - Make-up feel (does it look like makeup on the skin or not?) · Skin age (an index showing the degree of skin aging) Masculinity / Femininity (Which skin texture is closer to male or female?) · Makeup smudge level (an index showing the degree of makeup smudge) Powdery feel (an index showing how smooth the skin feels) The "skin condition index mathematical model" is the same as the "skin condition index mathematical model" described in embodiment 2, and is therefore created using both a face image of bare skin and a face image with a specified cosmetic applied, and the evaluation results obtained by evaluating the above seven items for each of the two images. A description of the method for creating the "skin condition index mathematical model" will be omitted.

[0037] Next, the coating film estimation mathematical model 3 will be explained. The training data and conditions used to create the coating film estimation mathematical model 3 are as follows. Prescribed composition 20: Cosmetic D (SPF50+ formulation O / W) Cosmetic E (SPF50+ W / O formulation) Application area: entire face Amount to be applied: 300mg for the entire face Subjects: 20 women with both cosmetics D and E on their entire faces Camera used: Visible light camera Application method: Subject applies evenly over entire face As shown in FIG. 7, a predetermined composition 20 (cosmetic D, cosmetic E) is applied to the skin of a subject, and image data (applied skin image) captured by a photographing device 40 (smartphone 40) is used. The photographing device 40 (smartphone 40) may be any type, such as a digital camera or video camera, or a photographing device provided in a mobile phone, tablet terminal, or personal computer, which are generally referred to as mobile terminals, and is preferably a camera capable of capturing color images using visible light. In this embodiment, the photographing is performed using a camera mounted on a smartphone. A coating film estimation mathematical model 3 is created from the photographed image data (applied skin image) in the following procedure.

[0038] 1) Obtain an overall evaluation score for the skin after application As described above, full-face applied skin images are obtained for multiple subjects (20 women in this embodiment) who have applied each of cosmetics D and E. An overall evaluation value for applied skin is obtained using the obtained full-face applied skin images and the "skin condition index mathematical model." The "evaluation value of the overall applied skin evaluation" is the evaluation value of the "overall evaluation" of the skin condition index (the above seven items (overall evaluation, skin color, makeup feel, skin age, masculinity / femininity, makeup smudge degree, powdery feel)) calculated using the acquired applied skin image of the entire face and the "skin condition index mathematical model". In this embodiment, in order to distinguish it from the "overall evaluation", which is one item of the "skin condition index" calculated using the user's skin image (bare skin image) and the "skin condition index mathematical model", the "overall evaluation" calculated using the applied skin image of the entire face to which cosmetic D (or cosmetic E) has been applied and the "skin condition index mathematical model" is referred to as the "applied skin overall evaluation". In addition, the evaluation value of the applied skin overall evaluation is referred to as the "applied skin overall evaluation value". 2) Divide into two groups based on the overall skin evaluation score after application The overall skin application evaluation score for each cosmetic calculated from each subject was sorted in order of overall skin application evaluation score, and divided into two groups: those with high overall skin application evaluation scores (50%) and those with low overall skin application evaluation scores (50%). The group with high overall skin application evaluation scores was designated the "group with high quality of cosmetic film formation," and the group with low overall skin application evaluation scores was designated the "group with low quality of cosmetic film formation." 3) Measure the subject's skin condition index Skin condition indices (7 items) are obtained for a subject using the skin condition index mathematical model described in the second embodiment and an image of the subject's skin (bare skin) taken with a visible light camera. 4) Create training data for machine learning Using the results of dividing the data into two groups in 2) and the results obtained in 3), training data is created. 5) Create a paint film estimation mathematical model 3 A standardization process is performed on each evaluation value, and the most suitable classification model is selected from a number of classification models (e.g., naive bayes (NB), logestic regression (LR), linear discriminant analysis (LDA), random forest (RF), gradient boosting (GB), support vector machine (SVM), Gaussian process (GP)) to determine the prediction model. The prediction model is then used to predict whether the quality of the coating film formation state of the cosmetic falls into the low or high group. The degree of agreement between the predicted group and the actual group is calculated as the accuracy rate. The generalization performance of the classification model is evaluated using leave-one-out cross validation (LOOCV), and the calculation model with the highest accuracy rate is determined to be the optimal model: coating film estimation mathematical model 3. Note that in this embodiment, classification model NB is used for coating film estimation mathematical model 3 for cosmetic D, and classification model LDA is used for coating film estimation mathematical model 3 for cosmetic E.

[0039] In this way, the coating film estimation mathematical model 3 is created by learning using the "skin condition index (7 items)" generated using the skin condition index mathematical model and skin images (bare skin images) of multiple subjects, and the "applied skin overall evaluation value" generated using the skin condition index inference model and applied skin images of the whole face of multiple subjects with cosmetic D (or cosmetic E) applied to their skin. The skin condition index (7 items) includes items that change depending on the physical property values ​​of the skin (e.g., moisture content of each layer, moisture evaporation value, etc.) that affect the formation of a coating film of the cosmetic on the skin, and as a result of further research, it was found that the coating film estimation mathematical model 3 with a high accuracy rate can be created by using all the calculated skin condition indexes (7 items). In addition, items similar to the skin condition index (7 items) can be calculated using the applied skin images of the whole face of the subject with cosmetic D (or cosmetic E) applied to their skin and the skin condition index inference model, but in this embodiment, only the "applied skin overall evaluation value", which is the evaluation value of the applied skin overall evaluation corresponding to the overall evaluation, is used. This is because, in order to estimate the state of a coating film formed on the skin when a cosmetic is applied to the skin, research was conducted and it was found that the evaluation results of the appearance and finish of the skin to which a cosmetic has been applied are most important when estimating the state of a coating film formed on the skin. As a result, it was found that a coating film estimation mathematical model with a high accuracy rate can be created by using the "overall evaluation value of applied skin", which is an evaluation value of the overall evaluation that indicates the overall goodness of the skin condition.

[0040] Figure 8(a) shows the results of predicting whether the quality of the cosmetic coating film formation state would fall into the low or high group using Coating Film Estimation Mathematical Model 3, and the actual results, and Figure 8(b) shows the results of calculating the accuracy rate, which is the degree of agreement between the group predicted using Coating Film Estimation Mathematical Model 3 and the actual group. From Figures 8(a) and 8(b), it can be seen that when the coating film formation state of a cosmetic material is predicted using the coating film estimation mathematical model 3, a high accuracy rate can be obtained. Therefore, by using the user's skin condition index (7 items) obtained using the skin condition index mathematical model and the coating film estimation mathematical model 3, it is possible to estimate the state of coating film formation of a specified composition by a specified composition. Therefore, even if the specified composition (a cosmetic product to which an ultraviolet absorbing agent or an ultraviolet scattering agent has been added) is not applied to the skin, it is possible to estimate the quality of the coating film formation state assuming that the specified composition is applied to the user's skin. This makes it possible to estimate the degree of effect that can be expected based on the function of the specified composition (for example, the ultraviolet protection function in the case of a cosmetic product to which an ultraviolet absorbing agent or an ultraviolet scattering agent has been added). As described above, in the third embodiment, skin condition indices (e.g., seven items calculated using the skin images (bare skin images) of the subjects and a skin condition index mathematical model) are obtained for each of the skin of a plurality of subjects (e.g., 20 women). A comprehensive applied skin evaluation value is calculated using skin images (e.g., skin images (applied skin images) captured by the photographing device shown in FIG. 7) of the skin (applied skin) of a plurality of subjects to which a cosmetic (e.g., cosmetic D, cosmetic E) has been applied, and the skin condition index mathematical model. A mathematical model (coating film estimation mathematical model 3) showing the relationship between the skin condition indices and the formation state of the cosmetic coating film is created from the obtained skin condition indices (seven items) and the comprehensive applied skin evaluation value. Using a user's skin image (bare skin image), the user's skin condition indicators (e.g., the seven items listed above) obtained from the skin condition mathematical model, and the film coating estimation mathematical model 3, it is possible to estimate the state of the film that a cosmetic (e.g., cosmetic D, cosmetic E) will form on the skin when it is applied to the user's skin, and it is then possible to estimate and evaluate the functions of the cosmetic.

[0041] Similarly to the first and second embodiments, the coating film estimation mathematical model 3 can be created with the first time period being, for example, 1 minute after application, and the second time period being, for example, 8 hours after application, to estimate the first and second formation states. The creation method is similar to the first and second embodiments, in that the step of "1) obtaining evaluation values ​​for each applied skin overall evaluation" described in the third embodiment is performed by obtaining evaluation values ​​for each applied skin overall evaluation 1 minute after application of a given cosmetic to the skin of the subject and 8 hours after application of a given cosmetic to the skin of the subject, and the steps of "2) dividing into two groups according to the evaluation values ​​for the applied skin overall evaluation" to "5) creating the coating film estimation mathematical model 3" described in the third embodiment are performed to respectively configure the coating film estimation mathematical model 3 for estimating the formation state of the coating film of the cosmetic 1 minute after application (first formation state) and the coating film estimation mathematical model 3 for estimating the formation state of the coating film of the cosmetic 8 hours after application (second formation state). In this way, a coating film estimation mathematical model 3 is created that estimates the formation state of a coating film formed on the skin by the cosmetic one minute after application (first formation state), and a coating film estimation mathematical model 3 is created that estimates the formation state of a coating film formed on the skin by the cosmetic eight hours after application (second formation state).By using the two coating film estimation mathematical models 3 created and the user's skin condition index obtained using the skin condition index mathematical model, it is possible to estimate the formation state of a coating film formed on the skin by the cosmetic a specified time after application, without applying a specified cosmetic to the user's skin and even before a specified time has passed since application (in this embodiment, first time period: 1 minute or second time period: 8 hours). In this way, it is possible to estimate the formation state of a coating film formed on the skin by a specific composition (e.g., cosmetic D, cosmetic E) in a first time period (e.g., 1 minute after application) after application of the composition (first formation state), and the formation state of a coating film formed on the skin by the composition in a second time period (e.g., 8 hours after application) after the first time period (second formation state). It is not necessary to estimate both the first formation state and the second formation state, and only one of them may be estimated depending on the purpose. It is also possible to add a third time period, a fourth time period, etc.

[0042] Furthermore, similarly to embodiments 1 and 2, by using the first formation state and the second formation state, it is possible to estimate the effects that can be expected in a first time period and the effects that can be expected in a second time period in relation to the effects that the applied cosmetic product is intended to have. In this way, the specified cosmetic is a cosmetic to which an ultraviolet absorbing agent or an ultraviolet scattering agent has been added (e.g., cosmetic D, cosmetic E), and it is possible to estimate the first formation state and the second formation state, and based on the estimated first formation state and second formation state, to estimate and evaluate the function exerted by the cosmetic (evaluate the extent to which the effect can be expected for the function possessed by the cosmetic).

[0043] Next, a method for evaluating the compatibility of a cosmetic having a specified function with a user's skin will be described, using the state of formation of a coating film formed on the skin by the cosmetic, estimated by the methods of embodiments 1 to 3. As described above, in all of the embodiments, the state of a coating film that the cosmetic will form on the skin when actually applied to the user's skin, without actually applying the cosmetic to which an ultraviolet absorbing agent or an ultraviolet scattering agent has been added, is estimated. The specified cosmetic is a cosmetic to which an ultraviolet absorbing agent or an ultraviolet scattering agent has been added, and in the first and second embodiments, the state of a coating film that the cosmetic will form on the skin is estimated based on the ultraviolet reflectance at a wavelength of 320 nm, which is included in the UVB range, so that it is possible to estimate whether or not the specified cosmetic can be expected to have an effect of protecting against ultraviolet rays in the UVB wavelength range. Furthermore, as described above, it is also possible to estimate a first formation state, which is the formation state of a coating film formed on the skin by the cosmetic in a first time period (e.g., 1 minute after application), and a second formation state, which is the formation state of a coating film formed on the skin by the cosmetic in a second time period (e.g., 8 hours after application), and therefore, by using the first formation state and the second formation state, it is possible to estimate the effects that can be expected in the first time period and the second time period, respectively, in relation to the effects claimed by the applied cosmetic. A method for using these estimation results to suggest cosmetics suitable for the user will then be described.

[0044] Figure 9 shows an example in which the estimated first formation state in the first time period (1 minute later) and the estimated second formation state in the second time period (8 hours later) when three types of cosmetics, Cosmetic 1 to Cosmetic 3, are applied are shown to be higher / lower than the standard values. Here, cosmetics 1 to 3 all have the same published UV protection value (in this embodiment, all are SPF50). In this method, it is possible to estimate whether the cosmetic can be expected to achieve the effect it claims by estimating the state of the coating film that the cosmetic forms on the skin when the cosmetic is applied, so it is effective to compare cosmetics with the same published UV protection value. However, since the standard value differs depending on the cosmetic, it cannot be said that the same UV protection value can be expected even if, for example, cosmetic 1 and cosmetic 2 are both about the standard value, but it is effective as information when proposing cosmetics suitable for the user. From Fig. 9, for example, it can be inferred that cosmetic 2 has difficulty in being applied uniformly by the user because both the first and second formation states are lower than the standard values, and therefore it can be inferred that it is difficult to expect the effects that cosmetic 2 claims. Furthermore, the first formation state of cosmetic 1 is higher than the standard value and the second formation state is about the standard value, while the first formation state of cosmetic 3 is about the standard value but the second formation state is higher than the standard value. Therefore, if the user expects an ultraviolet ray protection effect immediately after applying the cosmetic, cosmetic 1 should be suggested, and if the user applies the cosmetic before going out and will be exposed to ultraviolet rays after a predetermined time, cosmetic 3 should be suggested. In this way, it is possible to use the information as reference when suggesting cosmetics. In this way, the cosmetics (e.g., cosmetics 1 to 3) have publicly-published UV protection values ​​(e.g., SPF values) and it is possible to estimate and evaluate the UV protection function as a predetermined function based on the estimated state of the coating film that the cosmetics form on the skin and the published UV protection values.

[0045] <Estimation device> The estimation device 200 will be described with reference to Fig. 10-1 and Fig. 10-2. Fig. 10-1 shows the case of the first embodiment, and Fig. 10-2 shows the cases of the second and third embodiments. The estimation device 200 in this embodiment is composed of a skin condition acquisition unit 130 and a coating film estimation unit 140. The estimation device 200 is a general-purpose personal computer, and includes an input device such as a keyboard and a pointing device, an arithmetic processing device configured with an MPU, which is a CPU realized as an integrated circuit, an input / output interface, a storage unit, and the like. The skin condition acquisition unit 130 is realized by the arithmetic processing device executing a predetermined process of a program through the input / output interface, and the coating film estimation unit 140 is realized by the arithmetic processing device executing a predetermined process of a program. In addition, the estimation device 200 preferably includes an evaluation unit 150 and a display unit 160 (display device), but the display unit 160 may be provided outside the estimation device 200 and connected via a network or the like. In addition, in the case of embodiment 1, a measuring device 10 that measures a skin condition index as shown in FIG. 10-1 is required, and in the cases of embodiments 2 and 3, an imaging device 40 that captures a skin image (bare skin image) for calculating a skin condition index as shown in FIG. 10-2 is required. When recommending cosmetics by estimating the effectiveness of a specific cosmetic (cosmetics containing UV absorbers or UV scattering agents) by estimating the effectiveness of the cosmetic if it is applied to the user's skin without actually applying the cosmetic in a store, by providing a measuring device 10 and / or a photographing device 40 in addition to the estimation device 200, it is possible to sequentially inform the user of the expected UV protection effect of the specific cosmetic and to suggest recommended cosmetics.

[0046] The skin condition acquisition unit 130 is a means (skin condition acquisition means) for acquiring skin condition indices (seven items) from the measured values ​​measured by the measuring device 10 (embodiment 1) or by using a skin image (bare skin image) captured by the imaging device 40 and a skin condition index mathematical model (embodiment 2 or 3). Note that the second and third embodiments may be configured such that an information processing terminal (not shown) different from the estimation device 200 calculates the skin condition index using a skin image (bare skin image) captured of the user and the skin condition index mathematical model, and the calculated skin condition index can be acquired by the estimation device 200 via a network line, medium, or the like, or the skin condition index mathematical model may be stored in the estimation device 200, a skin image (bare skin image) captured by the imaging device 40 is acquired, and the skin condition index is calculated and acquired by the estimation device 200. The coating film estimation unit 140 is a means (coating film state estimation means) for estimating the state of a coating film formed on the skin by a cosmetic when a predetermined cosmetic is assumed to be applied to the skin of a user, using the acquired skin condition index and any one of the coating film estimation mathematical models 1 to 3. The estimation method is the same as that described above. The evaluation unit 150 is a means for comparatively evaluating cosmetics containing ultraviolet absorbing agents or ultraviolet scattering agents that have published ultraviolet protection values, or proposing cosmetics containing ultraviolet absorbing agents or ultraviolet scattering agents that are suitable for the user's skin, using the state of the coating film formed on the skin by the cosmetic estimated by the coating film estimation unit 140. It is preferable that the evaluation results by the evaluation unit 150 are displayed on the display unit 160 so that the user can easily understand them. By displaying the evaluation result by the evaluation unit 150, for example, the diagram shown in FIG. 9, on the display unit 160, the user can easily understand the estimation result and the evaluation result. The storage unit of the estimation device 200 stores each of the mathematical models and a program for executing the estimation method described above, and the program causes the coating film estimation unit 140 to estimate the formation state of a coating film formed by the composition on the skin using the skin condition indices acquired by the skin condition acquisition unit 130 and each of the mathematical models, causes the evaluation unit 150 to make an evaluation, and causes the display unit 160 to display the evaluation result. Note that some of the functions may be shared with another information processing device, for example, by storing each mathematical model in another device, for example, a predetermined server (not shown), accessing the server from the estimation device 200 via the Internet, and causing the other device to estimate the formation state of a coating film of the cosmetic using the skin condition indices acquired by the estimation device 200.

[0047] <Estimation system> The estimation system 400 will be described with reference to Fig. 11-1 and Fig. 11-2. Fig. 11-1 illustrates the case of the first embodiment, and Fig. 11-2 illustrates the cases of the second and third embodiments. The estimation system 400 in this embodiment is composed of a skin condition acquisition unit 330 and a coating film estimation unit 340. The estimation system 400 includes an information processing terminal 300 capable of executing various processes, and the information processing terminal 300 includes the skin condition acquisition unit 330 and the coating film estimation unit 340. The information processing terminal 300 is a general-purpose personal computer, and includes input devices such as a keyboard and a pointing device, an arithmetic processing unit configured with an MPU, which is a CPU realized as an integrated circuit, an input / output interface, a storage unit, and the like. The skin condition acquisition unit 330 is realized by the arithmetic processing unit executing a predetermined process of a program through the input / output interface, and the coating film estimation unit 340 is realized by the arithmetic processing unit executing a predetermined process of a program. In addition, the information processing terminal 300 preferably includes an evaluation unit 350 and a display unit 360 (display device), but the display unit 360 may be provided outside the information processing terminal 300 and connected via a network or the like. Moreover, in the case of embodiment 1, a measuring device 10 that measures the skin condition index as shown in Fig. 11-1 is required, and in the cases of embodiments 2 and 3, an imaging device 40 that captures an image for calculating the skin condition index as shown in Fig. 11-2 is required. When recommending cosmetics by estimating the degree of effect of a given cosmetic (a cosmetic containing an ultraviolet absorbing agent or an ultraviolet scattering agent) on the user's skin without actually applying it at a store or the like, and assuming that the cosmetic is applied, it is possible to sequentially suggest to the user the expected ultraviolet protection effect of the given cosmetic and the recommended cosmetic by providing the measuring device 10 and / or the imaging device 40 in addition to the estimation system 400.

[0048] The skin condition acquisition unit 330 is a means (skin condition acquisition means) for acquiring a skin condition index from a measurement value measured by the measuring instrument 10 (embodiment 1) or by using a skin image (bare skin image) captured by the photographing device 40 and a skin condition index mathematical model (embodiment 2 or 3). Note that the second and third embodiments may be configured such that an information processing terminal (not shown) different from the estimation system 400 calculates a skin condition index using a skin image (bare skin image) captured of a user and the skin condition index mathematical model, and the calculated skin condition index can be acquired by the information processing terminal 300 via a network line, medium, or the like, or the skin condition index mathematical model may be stored in the estimation system 400, a skin image (bare skin image) captured by the photographing device 40 is acquired, and the skin condition index is calculated and acquired by the estimation system 400. The coating film estimation unit 340 is a means (coating film estimation means) for estimating the formation state of a coating film that a cosmetic will form on the skin when a predetermined cosmetic is applied to the skin of a user, using the acquired skin condition index and any one of the coating film estimation mathematical models 1 to 3. The estimation method is the same as that described above. The evaluation unit 350 is a means for comparatively evaluating cosmetics containing ultraviolet absorbing agents or ultraviolet scattering agents that have published ultraviolet protection values, or proposing cosmetics containing ultraviolet absorbing agents or ultraviolet scattering agents that are suitable for the user's skin, using the state of the coating film formed on the skin by the cosmetic estimated by the coating film estimation unit 340. It is preferable that the evaluation results by the evaluation unit 350 are displayed on the display unit 360 so that the user can easily understand them. By displaying the evaluation result by the evaluation unit 350, for example, the diagram shown in FIG. 9, on the display unit 360, the user can easily understand the estimation result and the evaluation result. The storage unit of the information processing terminal 300 stores the above-mentioned mathematical models and programs for executing the above-mentioned estimation method, and the program causes the coating film estimation unit 340 to estimate the formation state of the coating film formed by the composition on the skin using the skin condition indexes acquired by the skin condition acquisition unit 330 and the mathematical models, causes the evaluation unit 350 to make an evaluation, and causes the evaluation result to be displayed on the display unit 360. Note that some functions may be shared with another information processing device, for example, by storing the mathematical models in another device, for example, a predetermined server (not shown), accessing the server from the estimation system 400 via the Internet, and causing the other device to estimate the formation state of the coating film of the cosmetic using the skin condition indexes acquired by the estimation system 400.

[0049] <Application Program> An application program (hereinafter, also referred to as this program) for causing the estimation device 200 to execute the above-described estimation method is installed in the estimation device 200. Similarly, an application program (hereinafter, also referred to as this program) for causing the information processing terminal 300 to execute the above-mentioned estimation method is installed in the information processing terminal 300. In this embodiment, the application program is application software that estimates the formation state of a coating film of a composition when the composition is applied to the user's skin, without applying the composition. This program includes skin condition acquisition processing and paint film estimation processing. The skin condition acquisition process is a process of acquiring a skin condition index calculated using a skin condition index measured by the measuring device 10, a skin image (bare skin image) of the user captured by the imaging device 40, and a skin condition index mathematical model. Note that the second and third embodiments may be configured such that the skin condition index is calculated by an information processing terminal (not shown) different from the estimation device 200 or the information processing terminal 300 using the captured skin image (bare skin image) of the user and the skin condition index mathematical model, and the calculated skin condition index is acquired by the estimation device 200 or the information processing terminal 300 via a network line, medium, or the like, or the skin condition index mathematical model may be stored in the estimation device 200 or the information processing terminal 300, a skin image (bare skin image) captured by the imaging device 40 is acquired, and the skin condition index is calculated and acquired by the estimation device 200 or the information processing terminal 300. The coating film estimation process is a process that uses the acquired skin condition index and any one of the coating film estimation mathematical models 1 to 3 to estimate the state of formation of a cosmetic coating when a specified cosmetic is applied to a user's skin. It is preferable that the program further includes an evaluation process and a display process. The evaluation process uses the state of the coating film formed on the skin by the cosmetic product estimated in the estimation process to perform a comparative evaluation with cosmetics containing specified UV absorbers or UV scattering agents that have published UV protection values, and to suggest cosmetics containing UV absorbers or UV scattering agents that are suitable for the user. The display process makes it possible to make it easier for the user to understand the estimation results and evaluation results by displaying the evaluation results by the evaluation process, for example, the diagram shown in FIG.

[0050] <Information processing terminal> An information processing terminal (not shown) may be connected via a network to the estimation system 400. The information processing terminal may be, for example, a tablet terminal provided in a store, a smartphone, or a tablet terminal or smartphone owned by a user. The information processing terminal is equipped with a transmitting means (e.g., an input / output interface) for transmitting data (e.g., a skin image (bare skin image)) for determining a skin condition index indicating the user's skin characteristics, and a receiving means (e.g., an input / output interface) for receiving the estimation result sent from the coating film estimation means (coating film estimation unit 340). In this way, if there is an information processing terminal equipped with a transmission means for transmitting data (for example, a skin image (bare skin image)), for example, if the information processing terminal is a tablet terminal or smartphone owned by the user, a user who is reluctant to take a bare skin facial image in a store can take a bare skin facial image of the user with a tablet terminal or smartphone owned by the user at home or the like, and transmit the bare skin facial image as the user's skin image (bare skin image) to the information processing terminal 300 equipped with the estimation system 400 at the store, thereby making it possible to estimate the formation state of the coating film when a predetermined cosmetic is applied. Furthermore, if the information processing terminal has a receiving means for receiving the estimation result, it is also possible to check the estimation result on the tablet terminal or smartphone owned by the user. Note that, since it is preferable that the estimation system 400 is equipped with the evaluation unit 350 as described above, it is preferable that the receiving means can receive the evaluation result if the evaluation unit 350 is provided.

[0051] <How to display the estimated results> Based on the skin condition index obtained by using this estimation method, an image classified into skin types can be displayed as a skin classification image. Also, a predetermined composition can be displayed as a composition classification image, and an evaluation based on an estimation result of the formation state of a coating film of the composition when the predetermined composition is applied to the skin of the user can be displayed by combining the skin classification image and the composition classification image. As described above, the result estimated by the present estimation method or the result evaluated using the estimated result is displayed on the display unit 160, the display unit 360, or the information processing terminal. The display form will be described with reference to Figs. 12(a-1) to (d-2). The skin information classification images 50 in Fig. 12(a-1) to (a-3) are examples of skin information classification images 50 when the user's skin type is classified into three skin types (skin type A, skin type B, and skin type C). Fig. 12(a-1) to (a-3) show the skin information classification images 50, which are the skin information classification image 50 for skin type A, the skin information classification image 50 for skin type B, and the skin information classification image 50 for skin type C. Fig. 12(b-1) to (b-3) show display examples of composition classification images 60 for three compositions (composition 1, composition 2, and composition 3), which are the composition classification image 60 for composition 1, the composition classification image 60 for composition 2, and the composition classification image 60 for composition 3. In this way, the skin information classification images 50 and the composition classification images 60 are all different images. The skin information classification images 50 may be set to images that evoke skin types, and the composition classification images 60 may be set to images that evoke compositions. For example, if skin type A is a moisturized skin type, the design or color of the image may be one that evokes moisture, making it easier for the user to visualize the skin type into which they are classified.

[0052] For example, the compatibility between the user's skin type and the composition can be displayed by combining the skin information classification image 50 and the composition classification image 60. For example, when the user's skin type is skin type A and composition 1 is selected, the skin information classification image 50 in Fig. 12(a-1) and the composition classification image 60 in Fig. 12(b-1) are displayed as a moving image gradually overlapping, making it possible to display the compatibility result between skin type A and composition 1 in an easy-to-understand manner to the user. FIG. 12(c-1) is an image showing the intermediate state in which the skin information classification image 50 and the composition classification image 60 are superimposed. 12(d-1) and (d-2) are compatibility images 70 showing the results of estimation by combining the skin information classification image 50 and the composition classification image 60. FIG. 12(d-1) shows an image in which the skin information classification image 50 and the composition classification image 60 are perfectly overlapped, and is used when the compatibility between the user's skin type and the composition is high, while FIG. 12(d-2) shows an image in which the skin information classification image 50 and the composition classification image 60 are misaligned, and is used when the compatibility between the user's skin type and the composition is low. In this way, the compatibility image 70 may be made available to the user so that the user can understand the compatibility between the skin type and the composition based on the degree of overlap. In addition, the estimation result may be displayed by combining the skin information classification image 50 and the composition classification image 60, and any method of combination (overlapping) or creation of the combined image may be used. For example, the skin information classification image 50 and the composition classification image 60 are displayed side by side. For example, a transparent image of each of the skin information classification image 50 and the composition classification image 60 is created and displayed overlaid. For example, a part of each of the skin information classification image 50 and the composition classification image 60 is made a transparent image, and the transparent image parts (transparent pixel parts) of both images are displayed by superimposing them. For example, an image in which the skin information classification image 50 and the composition classification image 60 are superimposed is created in advance, and the superimposed image created in advance is displayed at the timing when the skin information classification image 50 and the composition classification image 60 are superimposed, thereby displaying the skin information classification image 50 and the composition classification image 60 in combination (superimposed). For example, any method may be used, such as performing a thinning process on each of the skin information classification image 50 and the composition classification image 60 (shifting the thinning points (thinning lines) between the skin information classification image 50 and the composition classification image 60) and displaying them superimposed. Also, for example, when the compatibility between the user's skin type and the composition is high, the transmittance of the skin information classification image 50 may be increased and the transmittance of the composition classification image 60 may be decreased, whereas when the compatibility between the user's skin type and the composition is low, the transmittance of the skin information classification image 50 may be decreased and the transmittance of the composition classification image 60 may be increased. By displaying such skin information classification image 50 and composition classification image 60 in combination, it becomes possible to understand the compatibility between the user's skin type and the composition from the display mode of compatibility image 70.Also, for example, when the compatibility between the user's skin type and the composition is low, the composition classification image 60 may be displayed smaller than when the compatibility is high. In this way, when the compatibility is high, the skin information classification image 50 and the composition classification image 60 are overlapped at the same size, whereas when the compatibility is low, the composition classification image 60 can be displayed so as to overlap a part (for example, the center part) of the skin information classification image 50, so that the compatibility between the user's skin type and the composition can be understood from the display mode of the compatibility image 70. In addition, for example, the brightness or saturation of the composition classification image 60 may be changed depending on the compatibility between the user's skin type and the composition, and the changed composition classification image 60 may be displayed in combination with the skin information classification image 50. In this way, the compatibility between the user's skin type and the composition can be understood from the compatibility image 70. The above content is one example, and the combination and display of the skin information classification image 50 and the composition classification image 60 may be any display method or display mode as long as it is possible to understand that the combination and display of the skin information classification image 50 and the composition classification image 60 can be understood. In addition to displaying a combination of the skin information classification image 50 and the composition classification image 60, a numerical value indicating the compatibility between the user's skin type and the composition can also be displayed.

[0053] As described above, the present invention has been described by showing specific embodiments, but the present invention is not limited to the above-described embodiments and also includes various modifications, improvements, and other aspects as long as the object of the present invention is achieved. <Modification> In this embodiment, when estimating the first and second formation states, coating film estimation mathematical models were created when a first time period and a second time period have passed since a specific cosmetic was applied to the skin of multiple subjects, but this is not limiting, and a coating film estimation mathematical model may be created depending on the environment in which the first and second time periods have passed. For example, by creating different coating film estimation mathematical models for when the time period has passed under the blazing sun and when the time period has passed after swimming in the sea, it is possible to suggest the optimal cosmetic for the environment in which the user uses the specific cosmetic (cosmetics containing ultraviolet absorbing agents and ultraviolet scattering agents).

[0054] In this embodiment, a cosmetic containing an ultraviolet absorbing agent or an ultraviolet scattering agent was applied as the specified cosmetic, but this is not limited thereto, and a sunscreen cosmetic containing only an ultraviolet absorbing agent, only an ultraviolet scattering agent, or both is preferable.

[0055] In this embodiment, cosmetic A is a W / O formulation, cosmetic B is a W / O formulation, cosmetic C is an O / W formulation, cosmetic D is an O / W formulation, and cosmetic E is a W / O formulation, but this is not limited to the above. Furthermore, the cosmetics A to E used in this embodiment are cosmetics to which 0 to 15 percent of the ultraviolet absorbing agent and 5 to 30 percent of the ultraviolet scattering agent are added, but the proportions of the ultraviolet absorbing agent and / or the ultraviolet scattering agent added to the cosmetics are not limited to these. Furthermore, cosmetics to which 0 to 15 percent of the ultraviolet absorbing agent and 5 to 30 percent of the ultraviolet scattering agent are added are preferred.

[0056] In this embodiment, a cosmetic to which an ultraviolet absorbing agent and / or an ultraviolet scattering agent has been added in advance is applied as a predetermined cosmetic, but this is not limited thereto. By adding a predetermined ratio (for example, 1 mass percent or more and less than 30 mass percent, preferably 5 mass percent or more and less than 20 mass percent, relative to the cosmetic) of an ultraviolet absorbing agent or an ultraviolet scattering agent to a cosmetic to which an ultraviolet absorbing agent and / or an ultraviolet scattering agent has not been added, it is possible to estimate the formation state of a coating film that would be formed if the cosmetic to which an ultraviolet absorbing agent and / or an ultraviolet scattering agent has not been added actually on the skin, without actually applying the cosmetic to which an ultraviolet absorbing agent and / or an ultraviolet scattering agent has not been added. In this case, although either an ultraviolet absorbing agent or an ultraviolet scattering agent may be added, it is preferable to add an ultraviolet absorbing agent. This is because the addition of an ultraviolet absorbing agent is less likely to affect the formation of a coating film of the cosmetic to which it is added.

[0057] As described above, in this embodiment, three types of estimation methods, from embodiment 1 to embodiment 3, have been described. Any one of the estimation methods may be selected depending on the location to be estimated and the purpose of estimation. In addition, in embodiment 3, when creating the coating film estimation mathematical model 3, a cosmetic material containing an ultraviolet absorbing agent or an ultraviolet scattering agent is applied to the skin of multiple subjects, but the skin of the subjects is photographed without being exposed to ultraviolet light (instead of photographing with the photographing device 30 (ultraviolet camera 30) as in embodiments 1 and 2, photographing is performed with the photographing device 40 (smartphone 40)), so that it is possible to reduce the burden on the skin of the subjects when creating the coating film estimation mathematical model 3.

[0058] As described above, in this embodiment, the coating film formation state is estimated assuming that cosmetics A and B are applied in embodiment 1, cosmetic C in embodiment 2, and cosmetics D and E in embodiment 3, but it is also possible to estimate the coating film formation state of cosmetic C, for example, by using the method of embodiment 1. All that is required is to create coating film estimation mathematical models 1 to 3 corresponding to the cosmetic to be estimated.

[0059] As described above, in this embodiment, the state of formation of the coating film when a cosmetic containing an ultraviolet absorbing agent or an ultraviolet scattering agent is applied is estimated, and the compatibility with the user's skin is evaluated based on the estimation result, but this is not limited to this. The degree to which a specific composition can exhibit its functions (e.g., ultraviolet protection function, anti-itch function, makeup function, whitening function, etc.) may be evaluated from the estimated state of formation of the coating film. This is because if the state of formation of the coating film is good, it can be assumed that the specific composition can exhibit its functions to a high degree, and it can be used, for example, as an index during development.

[0060] As described above, in this embodiment, the state of the coating film formed when a cosmetic containing an ultraviolet absorbing agent or an ultraviolet scattering agent is applied is estimated, and the compatibility of the cosmetic with the user's skin is evaluated based on the estimation result, but this is not limited thereto. It is also possible to evaluate the compatibility of a composition with a user's skin based on the estimation result of the state of the coating film formed of the composition.

[0061] As described above, in this embodiment, the state of formation of the coating film when a cosmetic containing an ultraviolet absorbing agent or an ultraviolet scattering agent is applied is estimated, and based on the estimation result, whether a high or low ultraviolet protection function is expected is evaluated, thereby evaluating the compatibility with the user's skin, but this is not limited. For example, when a cosmetic containing a whitening ingredient is applied, if the state of formation of the coating film formed by application of the cosmetic is high, it can be inferred that the whitening ingredient is evenly applied to the skin, so it is also possible to evaluate the compatibility of a cosmetic having a predetermined function (whitening function) with the skin.

[0062] As described above, in this embodiment, the "standard value" is the UV reflectance located in the middle when the UV reflectances are arranged in order of UV reflectance as described in "2) Dividing into two groups according to UV reflectance", but this is not limited to this. For example, a value that is in the top predetermined percentage (e.g., a value within the top 25%) when arranged in order of UV reflectance may be set as the standard value, and if the value is higher than the standard value, it may be evaluated that the cosmetic product is expected to have the effect that it claims. Also, a value that is in the top predetermined percentage (e.g., a value within the top 25%) when the applied skin comprehensive evaluation values ​​are arranged in order of applied skin comprehensive evaluation values ​​may be set as the standard value, and if the value is higher than the standard value, it may be evaluated that the cosmetic product is expected to have the effect that it claims. Also, multiple standard values ​​may be prepared and divided into three or more groups.

[0063] In this embodiment, the ultraviolet protection effect in each time period is estimated using the first and second forming states individually, but this is not limited to this. For example, the average value of the first and second forming states may be calculated, and the ultraviolet protection effect expected from the first time period to the second time period may be estimated from the average value, or a predetermined weighting may be applied to either the first or second forming state (for example, the value of the second forming state that has been applied for a longer time since application is prioritized, or the value of the first or second forming state that has a higher coating film formation state is prioritized, etc.), and then the average value may be calculated to estimate the ultraviolet protection effect expected from the first time period to the second time period. In this way, by estimating the ultraviolet protection effect expected from the first time period to the second time period using the first and second forming states, it is possible to estimate the ultraviolet protection effect that changes with the passage of time from application, and therefore it is possible to provide the information required by the user in more detail.

[0064] In this embodiment, the user is assumed to be, for example, a customer who comes to a store looking for cosmetics, but is not limited to this. For example, the user may be a monitor during evaluation conducted in a laboratory during the development of cosmetics. In this embodiment, the "user" is a person with skin for which the state of formation of a coating film formed on the skin when a specific composition is applied without applying the specific composition is estimated using the coating film estimation mathematical models 1 to 3, and the "subject" is a person with skin that is used as training data when creating each mathematical model.

[0065] (Additional Test Example 1) 13 is a diagram showing the results of a comparative test of the UV protection effects of the above-mentioned cosmetics C to E. As shown in the figure, the "overall evaluation" and "skin color" determined by the above-mentioned skin condition index mathematical model were each divided into two groups using the median as a threshold value to create four groups, and the UV protection effects of cosmetic C (embodiment 2), cosmetic D (embodiment 3), and cosmetic E (embodiment 3) were compared for each group.

[0066] As a result, it was found that in terms of UV protection effect, cosmetic E is recommended for Group 1, which has a high overall rating and a high skin color value; cosmetic C is recommended for Group 2, which has a high overall rating and a low skin color value; cosmetics D and E are recommended for Group 3, which has a low overall rating and a high skin color value; and cosmetics C and E are recommended for Group 4, which has a low overall rating and a high skin color value.

[0067] In this way, not only when the seven skin condition indexes in the above-described embodiment are used as explanatory variables, but also when the skin type is classified into four groups using the two items of "overall evaluation" and "skin color" as explanatory variables, it is possible to recommend to the user cosmetics with high UV protection effects for that skin type.

[0068] (Additional Test Example 2) 14 is a diagram showing the results of another comparative test of the UV protection effects of the above-mentioned cosmetics C to E. The test participants were classified into five groups by a non-hierarchical clustering method (k-means method) using seven items determined by the above-mentioned skin condition index mathematical model, namely "overall evaluation," "skin color," "makeup feel," "skin age," "masculinity / femininity," "makeup smudge," and "powdery feel," and the UV protection effects of cosmetic C (embodiment 2), cosmetic D (embodiment 3), and cosmetic E (embodiment 3) were compared for each group.

[0069] As a result, differences were observed in the UV protection effects of cosmetics C, E, and E, respectively, between groups 1 to 5. It was found that in terms of UV protection effect, cosmetic D is recommended for group 1, cosmetic C is recommended for group 2, cosmetic C and D are recommended for group 3, cosmetic E is recommended for group 4, and cosmetic D is recommended for group 5.

[0070] In this way, even when classifying skin types into five groups using the seven skin condition indices in the above-described embodiment as explanatory variables, it is possible to recommend to the user cosmetics that have a high UV protection effect for that skin type.

[0071] (Providing cosmetics suggestions to users based on their skin type) In the above-described embodiment, an example was shown in which an image classified into skin types based on an estimated skin condition index is displayed as a skin classification image on a user's information processing terminal, and a specified composition is displayed as a composition classification image on the user's information processing terminal, and an evaluation based on the estimated result of the formation state of a coating film of the composition when the specified composition is applied to the user's skin is displayed by combining the skin classification image and the composition classification image.

[0072] At this time, the estimation device 200 or the estimation system 400 may display information indicating the characteristics of the classified skin types on the user's information processing terminal, and may further display a score indicating the compatibility (UV protection effect) of each cosmetic corresponding to the skin type with the user's skin type on the user's information processing terminal.

[0073] 15 is a flowchart showing the flow of processing for presenting skin type characteristic information and cosmetic score information based on a skin image by the estimation device 200 or the estimation system 400. In the following description, for convenience, the estimation device 200 is the subject of operations, but the operations are executed by the hardware, such as the CPU, communication unit, and storage unit, of the estimation device 200 or the estimation system in cooperation with software (programs) stored in the storage unit.

[0074] As shown in the figure, the estimation device 200 receives, from the information processing terminal of the user, a skin image of the user's natural face captured by the information processing terminal (step 11).

[0075] Next, the estimation device 200 acquires a skin condition index value based on the received skin image and the skin condition index mathematical model (step 12).

[0076] Next, the estimation device 200 classifies the user into one of the skin types based on the acquired skin condition index value (step 13).

[0077] When generating the classification information of the skin types, the estimation device 200 or the estimation system 400 generates and stores feature information for explaining the features of each skin type, as shown in Fig. 16. The feature information is generated by evaluating each skin type based on the skin condition index value and the subject's awareness of skin quality.

[0078] At the same time, the estimation device 200 or the estimation system 400 generates and stores score information indicating scores relating to the UV protection effects of multiple types of cosmetics, based on the coating film formation state for each skin type.

[0079] The score information is generated by creating a matrix of skin type and cosmetic material, for example as shown in Figure 17. The score information is calculated numerically using, for example, the UV reflectance of the coating film and the overall evaluation value immediately after application and after some time has passed since application. When comparing products of the same skin type, the higher the score, the higher the UV protection effect.

[0080] The score information is not limited to being expressed as a value from 0 to 100 as described above, but may be expressed as a value from 0 to 10, for example, or may be any evaluation information, such as a five-level evaluation information of A, B, C, D, E (or the number of stars, etc.).

[0081] Next, the estimation device 200 displays, on the user's information processing terminal, the stored characteristic information corresponding to the skin type together with the classified information on the user's skin type, as shown in Fig. 18(A) (step 14). In the example shown in Fig. 18, the user is classified as skin type A, and the corresponding characteristic information (moist skin type) is displayed together with the information on the skin type A.

[0082] Then, as shown in FIG. 18(B), for example, when the user scrolls / tap on the displayed characteristic information or when a predetermined time has elapsed since the display started, the estimation device 200 causes the user's information processing terminal to display information about cosmetics with high UV protection effect for the skin type and their score information (step 15).

[0083] Here, the cosmetics and scores displayed are those of at least the highest scoring cosmetics for the classified skin type, but information on the top several cosmetics (1st to 3rd place, etc.) and their scores may also be displayed.

[0084] In this way, based on the skin condition index obtained from the user's skin image and the skin condition index mathematical model, the user can be classified into one of multiple skin types, and the user can be presented with and understood information on the characteristics of that skin type and information on cosmetics with high UV protection effects for that skin type. [Explanation of symbols]

[0085] 10. Measuring Instruments 15 skin 20 Composition 30 Photographic equipment (ultraviolet camera) 40 Camera (smartphone) 50 Skin information classification images 60 Composition classification images 70 compatibility images 130 Skin condition acquisition unit 140 Paint Film Estimation Section 150 Evaluation Department 160 Display section 200 Estimation device 330 Skin condition acquisition unit 340 Coating Estimation Department 350 Evaluation Department 360 display 400 Estimation System

Claims

1. Acquire a skin condition index indicating a skin characteristic of the user; The method uses a mathematical model showing the relationship between the acquired skin condition index and the state of a coating film of the composition when a specified composition is applied to the user's skin to estimate the state of a coating film of the composition when the specified composition is applied to the user's skin, and estimates the UV protection function based on the result.

2. The method according to claim 1 , wherein the skin condition index includes an evaluation item based on a physical property value indicating the skin condition measured by a predetermined measuring device.

3. The method according to claim 2 , wherein the evaluation items based on the physical property values ​​include at least one of stratum corneum moisture content, water evaporation rate, skin viscoelasticity, skin flexibility, and contact angle.

4. The estimation method according to claim 1 , wherein the skin condition index includes an evaluation item obtained using a skin image captured of the user's skin and a skin condition index mathematical model that indicates a relationship between the skin condition index and the skin condition index.

5. the predetermined composition is a cosmetic composition to which at least one of an ultraviolet absorbing component and an ultraviolet scattering component is added, A method for estimating a coating state of the cosmetic composition based on the skin condition index acquired from the user and the mathematical model, and estimating an ultraviolet ray protection function based on the result of the estimation, comprising: Obtaining skin condition indexes for each of a plurality of subjects; acquiring ultraviolet reflectance of a coating film of the cosmetic from ultraviolet skin images obtained by capturing images of the skin of a plurality of subjects to which the cosmetic has been applied under ultraviolet irradiation; The estimation method according to any one of claims 1 to 4, characterized in that the mathematical model is created by performing machine learning on the basis of the acquired skin condition indexes of the multiple subjects and the acquired ultraviolet reflectance of the cosmetic coating film of the multiple subjects.

6. the predetermined composition is a cosmetic preparation to which at least one of an ultraviolet absorbing component and an ultraviolet scattering component is added, A method for estimating a coating state of the cosmetic composition based on the skin condition index acquired from the user and the mathematical model, and estimating an ultraviolet ray protection function based on the result of the estimation, comprising: Obtaining skin condition indexes for each of a plurality of subjects; Obtaining a comprehensive evaluation of the applied skin of each of the multiple subjects, the evaluation indicating the condition of the skin to which the cosmetic has been applied; the overall evaluation of the applied skin is an evaluation item obtained using an applied skin image obtained by capturing an image of the skin of the subject to which the cosmetic has been applied and a skin condition index mathematical model showing a relationship between the applied skin overall evaluation, The method according to any one of claims 1 to 4, characterized in that the mathematical model is created by performing machine learning on the basis of the acquired skin condition indexes of the plurality of subjects and the acquired overall skin evaluations of the plurality of subjects.

7. The method according to any one of claims 1 to 6, further comprising the step of evaluating a function of the composition based on the estimated state of formation of a coating film of the composition.

8. the predetermined composition is a cosmetic composition to which at least one of an ultraviolet absorbing component and an ultraviolet scattering component is added, The cosmetic has a publicly-published UV protection value, The method according to claim 1 , further comprising estimating and evaluating the UV protection function as a predetermined function based on the estimated state of formation of the coating film of the cosmetic and the published UV protection value.

9. the predetermined composition is a cosmetic composition to which at least one of an ultraviolet absorbing component and an ultraviolet scattering component is added, The cosmetic has a predetermined function, The estimation method according to claim 1 , further comprising: evaluating compatibility between the cosmetic and the user's skin using the estimated state of formation of a coating film of the cosmetic.

10. The estimation method according to any one of claims 1 to 9, characterized in that at least one of a first formation state, which is the formation state of a coating film of the composition in a first time period after application of the specified composition, and a second formation state, which is the formation state of a coating film of the composition in a second time period after the first time period.

11. classifying the user's skin into one of a plurality of skin types based on the skin condition index; a skin information classification image indicating each of the plurality of skin types is determined in advance; A composition classification image showing the predetermined composition is determined in advance, The method according to claim 1 , further comprising displaying an estimation result based on the skin information classification image and the composition classification image.

12. The estimation method according to claim 11 , wherein the estimation result is displayed by combining the skin information classification image and the composition classification image.

13. storing characteristic information indicating characteristics of a plurality of types of skin types and evaluation information indicating an evaluation of an ultraviolet protection function of at least one or more cosmetics based on the formation state of the coating film for each of the plurality of types of skin types; classifying the user's skin into any one of the plurality of skin types based on the skin image and the skin condition index obtained based on the skin condition index mathematical model; outputting the characteristic information corresponding to the classified skin type; The evaluation information for each of the cosmetics corresponding to the classified skin type is output. The estimation method according to claim 4.

14. A storage means for storing a skin condition index indicating a user's skin characteristics and information indicating a correlation between the skin condition index and a coating state of a composition when a predetermined composition is applied to the user's skin; A skin condition acquisition means for acquiring the skin condition index; a coating film estimation means for estimating a coating film formation state of a composition when a predetermined composition is applied to the skin of the user by referring to the storage means and using the acquired skin condition index, and estimating an ultraviolet protection function based on the result of the estimation; An estimation device comprising:

15. An application program for operating an estimation device that estimates a coating state of a composition when a predetermined composition is applied to a user's skin and estimates an ultraviolet ray protection function based on the result of the estimation, A skin condition acquisition process for acquiring a skin condition index indicating a skin characteristic of the user; and a coating film estimation process that estimates the formation state of a coating film of the composition on the user's skin using the acquired skin condition index and estimates an ultraviolet ray protection function based on the result.

16. A storage means for storing a skin condition index indicating a user's skin characteristics and information indicating a correlation between the skin condition index and a coating state of a composition when a predetermined composition is applied to the user's skin; A skin condition acquisition means for acquiring the skin condition index; a coating film estimation means for estimating a coating film formation state of a composition when a predetermined composition is applied to the skin of the user by referring to the storage means and using the acquired skin condition index, and estimating an ultraviolet protection function based on the result of the estimation; An estimation system comprising:

17. An information processing terminal for use in an estimation system connected to the estimation device according to claim 14 via a network, comprising: A transmitting means for transmitting data for determining a skin condition index indicating a skin characteristic of a user, and a receiving means for receiving an estimation result transmitted from the coating estimation means; An information processing terminal for use in an estimation system comprising the above-mentioned.

Images