Information processing device, cosmetics production device and program
By constructing a state transition model, the information processing device simulates the change of skin status after cosmetic use, solving the problem that the existing technology cannot predict future skin status, and achieving accurate prediction of skin status after cosmetic use and care suggestions.
Patent Information
- Application Number
- CN201980078607.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2019-05-14
- Filing Date
- 2019-11-01
- Publication Date
- 2024-11-05
- Estimated Expiration
- 2039-11-01
AI Technical Summary
The existing technology is difficult to predict the changes in the skin state after continuous use of cosmetics. It can only represent the skin state when the cosmetics are used once, and cannot predict the future skin state.
Through the information processing device, a state transition model is constructed using multiple subject skin information, subject status information and cosmetic information to simulate the future state changes of the subject's skin, and prompt the prediction results.
It realizes accurate prediction of the skin status after continuous use of cosmetics, provides predictions of future skin conditions and recommended cosmetic information, and helps users formulate care plans.
Smart Images

Figure CN113163929B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to an information processing device, a cosmetics producing device, and a program. Background Art
[0002] Generally speaking, it is important for cosmetic consumers to understand the changes in skin conditions achieved by the cosmetics when selecting cosmetics.
[0003] It is known that the skin condition can be predicted based on the subcutaneous tissue of the skin. For example, Japanese Patent Application Laid-Open No. 2014-064949 discloses a technique for estimating the condition inside the skin based on the light reflection characteristics of the subcutaneous tissue of the skin. Summary of the invention
[0004] Problems to be solved by the invention
[0005] In fact, the changes in skin condition achieved through cosmetics are not determined at the time of using the cosmetics once, but by the duration of use of the cosmetics, the frequency of use, and the amount of use each time.
[0006] However, in Japanese Patent Application Laid-Open No. 2014-064949, the skin condition is estimated based on the condition of the subcutaneous tissue when the cosmetics are used once, so the estimated result only indicates the skin condition at the time when the cosmetics are used, and does not indicate the future skin condition when the cosmetics are continuously used.
[0007] An object of the present invention is to predict the future skin condition when cosmetics are continuously used.
[0008] Technical solutions to solve problems
[0009] One technical solution of the present invention is an information processing device for executing a simulation for predicting a future skin condition when cosmetics are used on the skin, comprising:
[0010] a unit for acquiring skin information of a simulated subject,
[0011] a unit for predicting the transition of the skin state of the simulated subject by inputting the subject's skin information into a state transition model related to the transition of the skin state based on a plurality of subject skin information, subject state information, and cosmetics information, wherein the plurality of subject skin information is information indicating the temporal changes of the skin of a plurality of subjects when each of the subjects uses cosmetics on the skin, the subject state information is information related to the skin state of the subject corresponding to the skin information of each subject, and the cosmetics information is information related to the cosmetics, and
[0012] A unit for indicating the predicted transition of the skin condition.
[0013] Effects of the Invention
[0014] According to the present invention, it is possible to predict the future skin condition when cosmetics are continuously used. BRIEF DESCRIPTION OF THE DRAWINGS
[0015] Figure 1 It is a block diagram showing the configuration of the information processing system according to the present embodiment.
[0016] Figure 2 Yes means Figure 1 A block diagram of the structure of the cosmetics producing device 50.
[0017] Figure 3 This is an explanatory diagram of the outline of this embodiment.
[0018] Figure 4 It is a diagram showing the data structure of the user information database according to the present embodiment.
[0019] Figure 5 It is a diagram showing the data structure of the subject information database according to the present embodiment.
[0020] Figure 6 It is a diagram showing the data structure of the cosmetics information master database according to the present embodiment.
[0021] Figure 7 It is a diagram showing the data structure of the category information master database according to the present embodiment.
[0022] Figure 8 is with Figure 7 A conceptual diagram of the state transition model corresponding to the category information master database.
[0023] Fig. 9 Yes means Figure 8 Conceptual diagram of the inputs and outputs of the state transition model.
[0024] Fig.10 It is a diagram showing the data structure of the simulation log information database according to the present embodiment.
[0025] Fig.11 This is a timing chart of the simulation process of this embodiment.
[0026] Fig.12 It means in Fig.11 Figure 2 is an example of a screen displayed during information processing.
[0027] Fig.13 This is a diagram showing an example of a screen displayed during information processing in Modification Example 1.
[0028] Fig.14 This is a flowchart of information processing of Modification Example 2.
[0029] Fig.15 This is an explanatory diagram of the outline of Modification Example 3.
[0030] Fig.16 This is a diagram showing the data structure of the community information database according to Modification 3.
[0031] Fig.17 This is a timing chart of the community analysis process according to Modification Example 3. DETAILED DESCRIPTION
[0032] Hereinafter, one embodiment of the present invention will be described in detail based on the drawings. In the drawings for describing the embodiments, the same components are denoted by the same reference numerals in principle, and their repeated descriptions are omitted.
[0033] (1) Composition of information processing system
[0034] The configuration of the information processing system will be described. Figure 1 It is a block diagram showing the configuration of the information processing system according to the present embodiment.
[0035] like Figure 1 As shown, the information processing system 1 includes a client device 10 , a server 30 , and a cosmetics producing device 50 .
[0036] The client device 10 , the server 30 , and the cosmetics creating device 50 are connected via a network (eg, the Internet or an intranet) NW.
[0037] The client device 10 is an example of an information processing device that sends a request to the server 30. The client device 10 is, for example, a smartphone, a tablet terminal, or a personal computer.
[0038] The server 30 is an example of an information processing device that provides the client device 10 with a response corresponding to a request sent from the client device 10. The server 30 is, for example, a web server.
[0039] The cosmetics generating device 50 is configured to generate cosmetics based on the cosmetics information transmitted from the client device 10 or the server 30. The cosmetics may be, for example, at least one of the following.
[0040] Skin care cosmetics (for example, at least one of lotion, emulsion, serum, cleanser, cream, and facial mask).
[0041] · Makeup cosmetics (for example, at least one of primer, foundation, concealer, loose powder, lipstick, lip gloss, eye shadow, eyeliner, mascara, eyebrow pencil, blush, and makeup sets)
[0042] (1-1) Configuration of client device
[0043] Reference Figure 1 , the structure of the client device 10 is explained.
[0044] like Figure 1 As shown, the client device 10 includes a storage device 11 , a processor 12 , an input / output interface 13 , and a communication interface 14 .
[0045] The storage device 11 is configured to store programs and data and is, for example, a combination of a ROM (Read Only Memory), a RAM (Random Access Memory), and a storage (for example, a flash memory or a hard disk).
[0046] The program includes, for example, the following programs.
[0047] ·OS (Operating System) program
[0048] Programs that execute information processing applications (e.g., web browsers)
[0049] The data includes, for example, the following data.
[0050] · Databases referenced in information processing
[0051] Data obtained by executing information processing (that is, the results of executing information processing)
[0052] The processor 12 is configured to realize the functions of the client device 10 by activating a program stored in the storage device 11. The processor 12 is an example of a computer.
[0053] The input / output interface 13 is configured to obtain a user's instruction from an input device connected to the client apparatus 10 and output information to an output device connected to the client apparatus 10 .
[0054] The input device is, for example, a keyboard, a pointing device, a touch panel, or a combination thereof.
[0055] An output device is, for example, a display.
[0056] The communication interface 14 is configured to control communication via the network NW.
[0057] (1-2) Server Configuration
[0058] Reference Figure 1 , the structure of the server 30 is explained.
[0059] like Figure 1As shown, the server 30 includes a storage device 31 , a processor 32 , an input / output interface 33 , and a communication interface 34 .
[0060] The storage device 31 is configured to store programs and data. The storage device 31 is, for example, a combination of a ROM, a RAM, and a storage (for example, a flash memory or a hard disk).
[0061] The program includes, for example, the following programs.
[0062] ·OS program
[0063] · Programs that execute information processing applications
[0064] The data includes, for example, the following data.
[0065] · Databases referenced in information processing
[0066] ·The results of information processing
[0067] The processor 32 is configured to realize the functions of the server 30 by activating the program stored in the storage device 31. The processor 32 is an example of a computer.
[0068] The input / output interface 33 is configured to obtain a user's instruction from an input device connected to the server 30 and output information to an output device connected to the server 30 .
[0069] The input device is, for example, a keyboard, a pointing device, a touch panel, or a combination thereof.
[0070] An output device is, for example, a display.
[0071] The communication interface 34 is configured to control communication via the network NW.
[0072] (1-3) Configuration of cosmetics producing device
[0073] The configuration of cosmetics producing device 50 according to the present embodiment will be described. Figure 2 Yes means Figure 1 A block diagram of the structure of the cosmetics producing device 50.
[0074] like Figure 2 As shown, the cosmetics producing device 50 includes a storage device 51, a processor 52, an input / output interface 53, a communication interface 54, an extraction control unit 56, and a plurality of cartridges 55a to 55b.
[0075] The storage device 51 is configured to store programs and data. The storage device 51 is, for example, a combination of a ROM, a RAM, and a storage (for example, a flash memory or a hard disk).
[0076] The program includes, for example, the following programs.
[0077] ·OS program
[0078] ·Control program of the cosmetics producing device 50
[0079] The data includes, for example, the following data.
[0080] ・Information related to the history of production of cosmetics
[0081] Information on the remaining amount of the raw material stored in the plurality of containers 55a to 55b
[0082] The processor 52 is configured to realize the functions of the cosmetics producing device 50 by activating the program stored in the storage device 51. The processor 52 is an example of a computer.
[0083] The input / output interface 53 is configured to obtain a user's instruction from an input device connected to the cosmetics creating apparatus 50 , and output information to an output device connected to the cosmetics creating apparatus 50 .
[0084] The input device is, for example, a keyboard, a pointing device, a touch panel, or a combination thereof.
[0085] An output device is, for example, a display.
[0086] The communication interface 54 is configured to control communication via the network NW.
[0087] The containers 55a to 55b contain raw materials of cosmetics.
[0088] The extraction control unit 56 is configured to extract raw materials from each of the containers 55 a to 55 b based on the cosmetic information transmitted from the client device 10 or the server 30 .
[0089] (2) Overview of Implementation Methods
[0090] The outline of this embodiment will be described. Figure 3 This is an explanatory diagram of the outline of this embodiment.
[0091] like Figure 3 As shown, the server 30 is configured to execute a simulation of the skin condition when cosmetics are applied to the skin.
[0092] The server 30 generates a state transition model related to the state transition of the skin based on multiple subject skin information representing the temporal changes of the skin of multiple subjects when each of the subjects used cosmetics on their skin, subject skin state information related to the skin state of the subject corresponding to each subject skin information, and cosmetics information related to the cosmetics.
[0093] The server 30 acquires, via the client device 10 , cosmetic information related to the target cosmetic that is the object of the simulation.
[0094] The server 30 acquires the subject's skin information of the simulated subject through the client device 10 .
[0095] The server 30 predicts and simulates the transition of the subject's skin condition by inputting the cosmetics information of the target cosmetic and the subject's skin information into the condition transition model.
[0096] The server 30 presents the predicted transition of the skin condition via the client device 10 .
[0097] According to the present embodiment, it is possible to predict the future skin condition when cosmetics are continuously used.
[0098] (3) Database
[0099] The database of this embodiment is described. The following database is stored in the storage device 31.
[0100] (3-1) User Information Database
[0101] The user information database of this embodiment is described. Figure 4 It is a diagram showing the data structure of the user information database according to the present embodiment.
[0102] exist Figure 4 The user information database stores user information related to the user.
[0103] The user information database includes a "user ID" field, a "user name" field, and a "user attribute" field, and each field is associated with each other.
[0104] The user ID is stored in the "user ID" field. The user ID is an example of user identification information for identifying a user.
[0105] The "User Name" field stores information (eg, text) associated with the user name.
[0106] User attribute information related to the attributes of the user is stored in the "user attribute" field. The "user attribute" field includes multiple subfields (a "gender" field and an "age" field).
[0107] The "gender" field stores information related to the gender of the user.
[0108] The "age" field stores information related to the user's age.
[0109] (3-2) Subject Information Database
[0110] The subject information database of this embodiment will be described. Figure 5 It is a diagram showing the data structure of the subject information database according to the present embodiment.
[0111] exist Figure 5 The subject information database stores subject information related to the subject. The subject information database includes a "subject ID" field, a "subject attribute" field, a "date and time" field, a "skin image" field, a "skin condition" field, a "category ID" field, and a "cosmetics ID". Each field is associated with each other.
[0112] The subject ID is stored in the "subject ID" field. The subject ID is an example of subject identification information for identifying a subject.
[0113] The subject attribute information related to the attributes of the subject is stored in the "subject attribute" field. The "subject attribute" field includes a plurality of subfields (a "gender" field and an "age" field).
[0114] The "Gender" field stores information related to the gender of the subject.
[0115] The "Age" field stores information related to the age of the subject.
[0116] The "date and time" field stores information on the date and time when the measurement on the subject was performed.
[0117] The "skin image" field stores image data related to the subject's skin.
[0118] The “skin condition” field stores skin condition information (an example of “subject condition information”) related to the skin condition determined based on the image data of the subject’s skin.
[0119] The "date and time" field, the "skin image" field, and the "skin condition" field are associated with each other. A record is added to the "date and time" field, the "skin image" field, and the "skin condition" field each time measurement is performed.
[0120] That is, the "skin image" field stores image data showing changes in the skin of the subject over time when the subject applies cosmetics to the skin, and the "skin condition" field stores information showing changes in the skin condition of the subject over time when the subject applies cosmetics to the skin.
[0121] The “category ID” field stores a category ID (an example of “category identification information”) for identifying the category corresponding to the skin image data (that is, the category to which the skin condition determined based on the feature amount of the skin image data belongs).
[0122] The “cosmetic ID” field stores a cosmetic ID for identifying the cosmetic used by the test subject (an example of “cosmetic identification information”).
[0123] (3-3) Cosmetics Information Master Database
[0124] The cosmetics information master database according to the present embodiment will be described. Figure 6 It is a diagram showing the data structure of the cosmetics information master database according to the present embodiment.
[0125] exist Figure 6 The cosmetic information master database stores cosmetic information related to cosmetics. The cosmetic information master database includes a "cosmetic ID" field, a "cosmetic name" field, a "recommended usage amount" field, and an "ingredient" field. Each field is associated with each other.
[0126] The cosmetic ID is stored in the "cosmetic ID" field.
[0127] The "cosmetic name" field stores information (eg, text) related to the name of the cosmetic.
[0128] The "recommended usage amount" field stores information related to the recommended usage amount of the cosmetic.
[0129] The "ingredient" field stores information related to the ingredients of the cosmetics. The "ingredient" field includes a plurality of subfields (an "ingredient name" field and a "content ratio" field).
[0130] The “ingredient name” field stores information related to the name of the ingredient of the cosmetic (for example, text, or an ingredient code for identifying the ingredient).
[0131] The "content ratio" field stores information on the content ratio of each component.
[0132] (3-4) Category Information Master Database
[0133] The category information master database of this embodiment will be described. Figure 7 It is a diagram showing the data structure of the category information master database according to the present embodiment. Figure 8 is with Figure 7 A conceptual diagram of the state transition model corresponding to the category information master database. Fig. 9 Yes means Figure 8 Conceptual diagram of the inputs and outputs of the state transition model.
[0134] exist Figure 7 The category information master database stores category information. The category information is information related to the classification of skin based on feature quantities of skin image data of a plurality of subjects.
[0135] The category information master database includes a "category ID" field, a "category summary" field, a "skin characteristics" field, a "recommendation" field, and a "transition probability" field. The fields are associated with each other.
[0136] The category information master database is associated with the cosmetic ID.
[0137] The category ID is stored in the "category ID" field.
[0138] The “category summary” field stores information (eg, text) related to a summary description of the category. The information in the “category summary” field is determined by the administrator of the server 30 .
[0139] The "skin characteristic" field stores skin characteristic information related to the characteristics of skin corresponding to each category. The skin characteristic information indicates at least one of the following.
[0140] · Characteristics of the skin texture (for example, the direction of the texture and the distribution range of the texture)
[0141] · Characteristics of the furrow (for example, the state and shape of the furrow)
[0142] Pore characteristics (for example, the state of pores, the size of pores, the number of pores, and the density of pores)
[0143] Characteristics of the Pichu (for example, the size of the Pichu, the number of Pichu, and the density of the Pichu)
[0144] The "suggestion" field stores suggestion information corresponding to each category. The suggestion information includes suggestion information related to skin care and suggestion information related to makeup.
[0145] The advice information related to skin care includes, for example, at least one of the following.
[0146] Types of primer
[0147] Types of foundation
[0148] · Application method (for example, application with fingers or application with a sponge)
[0149] ·Application method
[0150] Types of cosmetics
[0151] ·Amount of cosmetics used (for example, thin or thick application)
[0152] The makeup-related advice information includes, for example, at least one of the following.
[0153] ・Recommended skin care methods (for example, daily care methods using lotions or emulsions, and special care methods using beauty serums, creams, or facial masks)
[0154] How to use the cosmetics you are currently using (for example, how often you use them and how much you use each time)
[0155] ・Recommended cosmetics (hereinafter referred to as "recommended cosmetics")
[0156] ・Recommended amount of cosmetics to use (for example, frequency of use and amount per use)
[0157] The "transition probability" field includes multiple subfields. The multiple subfields are composed of each time point in the future (for example, 1 day later, 1 week later, 1 month later, 3 months later, 6 months later, and 1 year later). Each subfield is assigned a category ID and stores the transition probability between categories.
[0158] exist Figure 7 In the example, in the "Transition Probability" field of the record with category ID "CLU001" stored in the "Category ID" field, the subfield assigned with the future time point "1 day later" stores transition probabilities P11 to P15 1 day from the category of category ID "CLU001".
[0159] In the "Transition Probability" field of the record storing category ID "CLU002" in the "Category ID" field, transition probabilities P21 to P25 one day from the category of category ID "CLU002" are stored in the subfields assigned with the future time point "1 day later".
[0160] In the "Transition Probability" field of the record storing the category ID "CLU001" in the "Category ID" field, the subfield assigned with the future time point "1 year later" stores the transition probability 1 year from the category of category ID "CLU001".
[0161] Figure 8 The state transition model and Figure 7 That is, the state transition model is associated with the cosmetic ID and is generated based on a plurality of skin image data (that is, images showing changes in the skin over time) of each of a plurality of subjects who used the cosmetics corresponding to the cosmetic ID.
[0162] The state transition model is composed of a plurality of categories and links between the categories. The links show the probability of transition between the categories.
[0163] As an example, Figure 8The state transition pattern includes category 1 of category ID "CLU001" to category 5 of category ID "CLU005". The links between the categories are as follows.
[0164] The probability of transition from category 1 to category 2 after 1 day: P12
[0165] The probability of transition from category 1 to category 3 after 1 day: P13
[0166] The probability of transition from category 1 to category 4 after 1 day: P14
[0167] Probability of transition from category 2 to category 5 after 1 day: P25
[0168] Probability of transition from category 3 to category 4 after 1 day: P34
[0169] Probability of transition from category 3 to category 5 after 1 day: P35
[0170] like Fig. 9 As shown, the input of the state transition model is image data.
[0171] The output of the state transition model is a prediction result of the temporal change of the skin condition when the cosmetic corresponding to the cosmetic ID is used.
[0172] Category Information Master Database ( Figure 7 ) and state transition models ( Figure 8 ) is generated by any of the following methods.
[0173] Learning without a teacher
[0174] ·Learning with a teacher
[0175] Network analysis
[0176] (3-5) Simulation log information database
[0177] The simulation log information database of this embodiment is described. Fig.10 It is a diagram showing the data structure of the simulation log information database according to the present embodiment.
[0178] exist Fig.10 The simulation log information database stores simulation log information related to the historical records of the execution results of the simulation. The simulation log information database includes a "simulation log ID" field, a "date time" field, a "cosmetics ID" field, a "skin image" field, and a "simulation result" field. Each field is associated with each other.
[0179] The simulation log information database is associated with the user ID.
[0180] The simulation log ID for identifying the simulation log information is stored in the "simulation log ID" field.
[0181] The "Date Time" field stores information related to the execution date and time of the simulation.
[0182] The “cosmetics ID” field stores the cosmetics ID of the cosmetic to be simulated.
[0183] The "skin image" field stores image data of a skin image to be simulated.
[0184] The "Simulation Result" field stores information related to the execution result of the simulation. The "Simulation Result" field includes a "1 day later" field, a "1 week later" field, a "1 month later" field, a "3 months later" field, a "6 months later" field, and a "1 year later" field.
[0185] The "1 day later" field stores the category ID of the category to which the skin belongs 1 day after the execution date and time of the simulation.
[0186] The “1 week later” field stores the category ID of the category to which the skin belongs 1 week after the execution date and time of the simulation.
[0187] The "1 month later" field stores the category ID of the category to which the skin belongs 1 month after the execution date and time of the simulation.
[0188] The "3 months later" field stores the category ID of the category to which the skin belongs 3 months after the execution date of the simulation.
[0189] The "6 months later" field stores the category ID of the category to which the skin belongs 6 months after the execution date of the simulation.
[0190] The “1 year later” field stores the category ID of the category to which the skin belongs 1 year after the execution date of the simulation.
[0191] (4) Information processing
[0192] The information processing in this embodiment is described. Fig.11 This is a timing chart of the simulation process of this embodiment. Fig.12 It means in Fig.11 Figure 2 is an example of a screen displayed during information processing.
[0193] like Fig.11 As shown, the client device 10 receives the simulation condition ( S100 ).
[0194] Specifically, the processor 12 makes the screen P100 ( Fig.12 ) is displayed on the monitor.
[0195] The screen P100 includes a display target object A100 and an operation target object B100 .
[0196] The display object A100 includes an image captured by a camera (not shown) disposed in the client device 10 .
[0197] The operation object B100 is an object that receives a user instruction to execute imaging.
[0198] When a user (an example of a "simulated subject") operates target object B100 when display target object A100 includes an image of his or her own skin (e.g., an image of the face), processor 12 generates image data (an example of "subject skin information") containing the image of display target object A100.
[0199] The processor 12 makes the screen P101 ( Fig.12 ) is displayed on the monitor.
[0200] The screen P101 includes an operation object B101 and field objects F101a to F101c.
[0201] The field object F101a is an object for accepting a user's instruction for designating a target cosmetic (for example, cosmetics used by a user) to be the subject of simulation.
[0202] Field object F101b is an object for receiving a user's instruction to designate a characteristic value of the user's skin (an example of "subject skin information"). The characteristic value of the user's skin is at least one of moisture content, pores, texture, sebum content, state of stratum corneum, and skin color.
[0203] The field object F101c is an object that accepts a user's instruction for specifying a target to be simulated.
[0204] After step S100 , the client device 10 executes a simulation request ( S101 ).
[0205] Specifically, when the user inputs a user instruction to the field objects F101 a to F101 b and operates the operation object B101 , the processor 12 transmits simulation request data to the server 30 .
[0206] The simulation request data includes the following information.
[0207] · User ID of the person to be simulated (hereinafter referred to as "target user ID")
[0208] Image data generated in step S100
[0209] · Target cosmetics ID of the target cosmetics corresponding to the user instruction given to the field target object F101a
[0210] A feature amount corresponding to a user instruction given to the field object F101b.
[0211] After step S101 , the server 30 performs a simulation ( S300 ).
[0212] Specifically, processor 32 extracts feature quantities from image data included in the simulation request data.
[0213] The processor 32 determines the skin characteristics of the user based on at least one of the feature quantity extracted from the image data and the feature quantity included in the simulation request data.
[0214] Processor 32 refers to the "skin characteristic" field of the category information master database to identify the category ID associated with the skin characteristic having the highest similarity to the identified skin characteristic. The identified category ID indicates the category to which the skin corresponding to the image data included in the simulation request data belongs.
[0215] Processor 32 refers to the "category summary" field associated with the identified category ID to identify information related to the summary description of the category to which the skin belongs.
[0216] Processor 32 refers to the "suggestion" field associated with the determined category ID to determine the suggestion information corresponding to the category to which the skin belongs.
[0217] The processor 32 refers to each subfield of the "transition probability" field of the category information master database to determine the transition probability of each subfield. The determined transition probability indicates the category to which the skin belongs after 1 day, the category to which the skin belongs after 1 week, the category to which the skin condition belongs after 1 month, the category to which the skin condition belongs after 3 months, the category to which the skin belongs after 6 months, and the category to which the skin belongs after 1 year.
[0218] After step S300 , the server 30 executes updating of the database ( S301 ).
[0219] Specifically, the processor 32 generates a simulation log information database ( Fig.10 ) to add a new record. The fields of the new record store the following information.
[0220] Store the new simulation ID in the Simulation Log ID field
[0221] The "Date and Time" field stores information related to the execution date and time of step S300.
[0222] · Store the cosmetic ID of the object included in the simulation request data in the "Cosmetic ID" field
[0223] Store the image data included in the simulation request data in the "Skin Image" field
[0224] The category ID of the category to which the skin will belong after one day is stored in the "1 day later" field of the "Simulation result" field.
[0225] The category ID of the category to which the skin will belong one week later is stored in the "1 week later" field of the "Simulation result" field.
[0226] The category ID of the category to which the skin will belong one month later is stored in the "1 month later" field of the "Simulation result" field.
[0227] The category ID of the category to which the skin will belong after 3 months is stored in the "3 months later" field of the "Simulation result" field
[0228] The category ID of the category to which the skin will belong after 6 months is stored in the "6 months later" field of the "Simulation result" field.
[0229] The category ID of the category to which the skin will belong one year later is stored in the "1 year later" field of the "Simulation result" field.
[0230] After step S301, the server 30 performs a simulation response (S302).
[0231] Specifically, the processor 32 sends the simulation response data to the client device 10 .
[0232] The simulation response data includes the following information.
[0233] Category ID of the category to which the skin will belong after 1 day
[0234] Category ID of the category to which the skin will belong after 1 week
[0235] Category ID of the category to which the skin will belong after 1 month
[0236] Category ID of the category to which the skin will belong after 3 months
[0237] Category ID of the category to which the skin belongs after 6 months
[0238] Category ID of the category to which the skin will belong after 1 year
[0239] Information related to the summary description of the category determined in step S300
[0240] The suggestion information determined in step S300
[0241] After step S302 , the client device 10 performs presentation of simulation results ( S102 ).
[0242] Specifically, the processor 12 displays the screen P102 ( Fig.12 ) is displayed on the monitor.
[0243] The screen P102 includes display objects A102a to A102b and an operation object B102.
[0244] The displayed target object A102a includes a summary description of the category to which the skin belongs after 1 day, a summary description of the category to which the skin belongs after 1 week, a summary description of the category to which the skin belongs after 1 month, a summary description of the category to which the skin belongs after 3 months, a summary description of the category to which the skin belongs after 1 week, and a summary description of the category to which the skin belongs after 1 year.
[0245] The display target object A102b includes advice information suitable for the skin corresponding to the image data acquired in step S100. The advice information is, for example, recommended cosmetic information related to recommended cosmetics (for example, the cosmetics ID and usage amount of the recommended cosmetics).
[0246] The operation object B102 is an object that receives a user's instruction to transmit the recipe information of the recommended cosmetic to the cosmetics creating device 50 .
[0247] After step S102 , the client device 10 executes a recipe request ( S103 ).
[0248] Specifically, when the user operates the operation target object B102, the processor 12 transmits the recipe request data to the server 30. The recipe request data includes the cosmetics ID of the recommended cosmetics.
[0249] After step S103 , the server 30 executes a recipe response ( S303 ).
[0250] Specifically, the processor 32 refers to the cosmetics master database ( Figure 6 ) to determine the information (ingredient name and content ratio) in the "ingredient" field associated with the cosmetic ID included in the recipe request data.
[0251] The processor 32 sends the recipe information to the cosmetics producing device 50. The recipe information includes the following information.
[0252] · Information from the "ingredients" field determined
[0253] ・Information on recommended amounts of cosmetics to be used
[0254] The cosmetics producing device 50 produces cosmetics based on the recipe information transmitted from the server 30 .
[0255] Specifically, the processor 52 determines the total amount of the raw material to be extracted from the plurality of containers 55a to 55b based on the information on the usage amount included in the recipe information.
[0256] The processor 52 determines the extraction amount of each of the raw materials stored in the plurality of containers 55a to 55b based on the determined total extraction amount and the component names and content ratios included in the recipe information.
[0257] The processor 52 generates a control signal for extracting each raw material stored in the plurality of containers 55a to 55b in the determined extraction amount.
[0258] The extraction control unit 56 extracts the raw materials stored in the plurality of containers 55 a to 55 b based on the control signal generated by the processor 52 .
[0259] Thus, an appropriate amount of cosmetics recommended for use on the skin corresponding to the image data received in step S100 is generated.
[0260] According to this embodiment, the user provides an image of the skin to the client device 10, thereby being able to understand the future skin condition when the cosmetics in use are continuously used by displaying the target object A102a, being able to understand the recommended cosmetics by displaying the target object A102b, and being able to obtain an appropriate amount of recommended cosmetics through the cosmetics generating device 50.
[0261] (5) Modification
[0262] Modifications of this embodiment will be described.
[0263] (5-1) Modification 1
[0264] Modification 1 of the present embodiment will be described. Modification 1 is an example of specifying a target skin condition of a simulation subject. Fig.13 This is a diagram showing an example of a screen displayed during information processing in Modification Example 1.
[0265] In the first modification, in step S100, the user specifies the target cosmetics in the field target object F101a, and specifies the target (for example, the target skin condition) in the field target object F101c. In this case, the target specified in the field target object F101c is assigned a category ID (an example of "target information") corresponding to the target skin condition.
[0266] In step S101 , the processor 12 sends simulation request data to the server 30 .
[0267] The simulation request data includes the following information.
[0268] ·Target user ID
[0269] Image data generated in step S100
[0270] · Target cosmetics ID of the target cosmetics corresponding to the user instruction given to the field target object F101a
[0271] · Feature quantity corresponding to the user instruction given to the field object F101b
[0272] A category ID (hereinafter referred to as "object category ID") assigned to an object provided to the field object F101c.
[0273] In step S300, the processor 32 sends a data to the category information master database ( Figure 7 ) corresponds to the state transition model ( Figure 8 ) Input the image data contained in the simulation request data.
[0274] The processor 32 extracts feature quantities from the image data.
[0275] Processor 32 determines the skin characteristics of the user based on at least one of the feature quantity extracted from the image data and the feature quantity included in the simulation request data.
[0276] Processor 32 refers to the "skin characteristic" field of the category information master database to identify the category ID associated with the skin characteristic having the highest similarity to the identified skin characteristic. The identified category ID indicates the category to which the skin corresponding to the image data included in the simulation request data belongs.
[0277] The processor 32 refers to the transition probability stored in the "transition probability" field associated with the determined category ID, and determines the time required to reach a predetermined transition probability or above. For example, when the category of the skin condition corresponding to the image data included in the simulation data is category 1, the category of the skin condition set as the target is category 2, and the transition probability P12 that is greater than the predetermined transition probability is stored in the "1 month later" field, the processor 32 determines that the time required to reach the target skin condition is "1 month".
[0278] After step S301 , in step S302 , the processor 32 sends the simulation response data to the client device 10 .
[0279] The simulation response data includes information related to the required time determined in step S300.
[0280] After step S302, in step S102, processor 12 causes screen P110 ( Fig.13 ) is displayed on the monitor.
[0281] The screen P110 includes a display target object A110 .
[0282] The display target object A110 includes the time required to achieve the skin condition set as a target.
[0283] According to Modification 1, the user provides the client device 10 with a skin image and a target skin condition, and can thereby understand the time required to achieve the target skin condition by displaying the target object A110.
[0284] (5-2) Modification 2
[0285] Modification 2 of the present embodiment will be described. Modification 2 is an example of a method for generating a category information master database. Fig.14 This is a flowchart of information processing of Modification Example 2.
[0286] like Fig.14 As shown, the server 30 performs analysis of the feature amount ( S400 ).
[0287] Specifically, the processor 32 retrieves the subject information from the subject information database ( Figure 5 ) in the "skin image" field of the image processing unit. The skin feature quantity is, for example, at least one of the moisture content, pores, texture, sebum content, state of the stratum corneum, and skin color.
[0288] After step S400 , the server 30 performs category classification ( S401 ).
[0289] The storage device 31 stores a class classification model. The class classification model is a learned model generated by deep learning. In the class classification model, the correlation between the characteristic amount of the skin and the class is defined.
[0290] The processor 32 inputs the feature quantity obtained in step S400 into the category classification model, thereby determining a category ID corresponding to the feature quantity of each skin image data, and assigning the determined category ID to the feature quantity, thereby determining the category to which the skin condition determined based on the feature quantity belongs.
[0291] After step S401 , the server 30 performs network analysis ( S402 ).
[0292] Specifically, the processor 32 refers to the subject information database ( Figure 5 ), analyzes the categories of feature quantities of multiple skin image data associated with a certain subject ID, thereby determining the transition of the category to which the skin of the subject corresponding to the certain subject ID belongs.
[0293] Processor 32 refers to the category transitions of all subject IDs and calculates statistical values (e.g., average values) of the transition probabilities to the category to which the skin belongs after 1 day, the category to which the skin belongs after 1 week, the category to which the skin condition belongs after 1 month, the category to which the skin condition belongs after 3 months, the category to which the skin belongs after 6 months, and the category to which the skin belongs after 1 year.
[0294] The processor 32 stores the calculated transition probability in the category information master database ( Figure 7 ) field.
[0295] (5-3) Modification 3
[0296] Example of generating communities of multiple categories.
[0297] (5-3-1) Overview of Modification 3
[0298] The outline of Modification 3 is described. Fig.15 This is a schematic diagram for explaining modification example 3.
[0299] like Fig.15 As shown, communities are assigned to each category of variant example 3.
[0300] For example, categories 1 to 5 are assigned to community 1.
[0301] Category 6 to Category 10 are allocated to Community 2.
[0302] Category 11 to Category 15 are allocated to Community 3.
[0303] Category 16 to Category 20 are allocated to Community 4.
[0304] This means the following.
[0305] · The trends of changes in skin characteristics of categories 1 to 5 are common to each other
[0306] · The trends of changes in skin characteristics of categories 6 to 10 are common to each other
[0307] · The trends of changes in skin characteristics of categories 11 to 15 are common to each other
[0308] · The trends of changes in skin characteristics of categories 16 to 20 are common to each other
[0309] · The category belonging to community 1 is easy to change to the category belonging to the adjacent community (such as community 2)
[0310] The category belonging to community 2 is easily transferred to the category belonging to the adjacent community (for example, community 1 or community 3).
[0311] The class belonging to community 3 is likely to change to the class belonging to the adjacent community (for example, community 2 or community 4).
[0312] That is, the probability of transition between communities is defined in the state transition model of Modification 3. In other words, the state transition model defines the transition of the tendency of the change in skin characteristics.
[0313] (5-3-2) Community Information Database
[0314] The community information database according to Modification 3 will be described. Fig.16 This is a diagram showing the data structure of the community information database according to Modification 3.
[0315] exist Fig.16 The community information database stores community information. The community information refers to information related to a community composed of a plurality of categories having common characteristics.
[0316] The community information database includes a "community ID" field, a "category ID" field, and a "community feature" field. Each field is associated with each other.
[0317] The community information database is linked to the cosmetic ID.
[0318] The community ID is stored in the "community ID" field. The community ID is an example of community identification information for identifying the community.
[0319] The category ID of the category assigned to the community is stored in the "category ID" field.
[0320] The "community characteristics" field stores information related to characteristics of the community (hereinafter referred to as "community characteristics information"). The community characteristics information includes, for example, at least one of the following information.
[0321] Information related to the uniformity of the furrows
[0322] Information related to the furrow area
[0323] Information related to the radioactivity of the furrow
[0324] Information related to the fineness of the furrows
[0325] Information related to pore size
[0326] (5-3-3) Information Processing
[0327] The information processing of Modification 3 is described. Fig.17 This is a timing chart of the community analysis process according to Modification Example 3.
[0328] like Fig.17 As shown, the server 30 executes steps S400 to S402 similarly to the second modification, and then executes graph clustering (S500).
[0329] Specifically, the processor 32 accesses the subject information master database ( Figure 5 )'s "skin image" field and "skin condition" field (i.e., a combination of skin image data and skin condition information) are applied to extract communities of each category by any of the following methods. This means that skin categories belonging to the same community are easy to transition between (that is, the probability of transition between categories is high).
[0330] Modularity Q maximization method
[0331] ·Use the greedy algorithm method
[0332] ·Use edge dielectric method
[0333] The processor 32 assigns a unique community ID to the extracted community.
[0334] The processor 32 stores the community ID assigned to each community in the community information database ( Fig.16 )'s "Community ID" field.
[0335] The processor 32 stores the category ID to which each community is assigned in the "category ID" field.
[0336] After step S500 , the server 30 performs analysis between communities ( S501 ).
[0337] Specifically, the processor 32 extracts, for each community, a feature value of skin image data corresponding to a category assigned to the community (hereinafter referred to as a "community feature value"). The community feature value includes, for example, the following.
[0338] ·Skin groove uniformity
[0339] ·Skin groove area
[0340] ·Radiance of the furrow
[0341] · Skin groove fineness
[0342] Pore size
[0343] The processor 32 calculates the statistical value of the characteristic quantity of each community by normalizing the extracted community characteristic quantity.
[0344] The processor 32 stores the statistical value of each community feature in the community information database ( Fig.16 ) in the “Community Characteristics” field.
[0345] Therefore, if Fig.16 As shown, the transition paths between communities can be obtained.
[0346] After step S501 , the server 30 performs analysis within the community ( S502 ).
[0347] Specifically, the processor 32 calculates a statistical value of a community characteristic value (hereinafter referred to as an “in-community characteristic value”) for each category belonging to each community.
[0348] The processor 32 determines the characteristics between the categories constituting each community (specifically, the changes in the community characteristic quantities) within each community based on the characteristic quantities within the community.
[0349] According to Modification 3, it is possible to identify major changes in the user's skin.
[0350] (6) Summary of this embodiment
[0351] This embodiment is summarized.
[0352] A first technical solution of the present embodiment is an information processing device, which is an information processing device (for example, a server 30) that performs a simulation for predicting a future skin condition when cosmetics are applied to the skin, and comprises:
[0353] A unit for acquiring skin information of a simulated subject (e.g., the processor 32 executing step S300);
[0354] a unit (e.g., the processor 32 executing step S300) for predicting a transition of the skin state of a simulated subject by inputting the subject's skin information into a state transition model related to the transition of the skin state based on a plurality of subject skin information, subject state information, and cosmetics information, wherein the plurality of subject skin information is information indicating changes over time in the skin of a plurality of subjects when each of the subjects applies cosmetics to the skin, the subject state information is information related to the subject's skin state corresponding to each subject's skin information, and the cosmetics information is information related to the cosmetics; and
[0355] A unit (eg, the processor 32 executing step S302 ) prompts the predicted transition of the skin condition.
[0356] According to the first technical solution, the subject's skin information is input into a state transition model based on a plurality of subject skin information, subject state information, and cosmetics information to predict the transition of the subject's skin state. Thus, the future skin state when cosmetics are continuously used can be predicted.
[0357] A second technical solution of this embodiment is an information processing device, comprising:
[0358] a unit (e.g., the processor 32 executing step S300) that acquires target information related to the skin condition set as a target by the simulation subject,
[0359] The prediction unit predicts the time required for the skin condition of the simulation subject to reach the skin condition corresponding to the target information.
[0360] According to the second technical solution, the time required to achieve the target skin condition set by the simulation subject is predicted, thereby providing the simulation subject with motivation to continue the care action until the target skin condition is achieved.
[0361] A third technical solution of this embodiment is an information processing device, comprising:
[0362] A unit (eg, the processor 32 executing step S302) that presents advice information on skin care or makeup suitable for the predicted skin condition.
[0363] According to the third aspect, the advice information corresponding to the predicted result of the skin condition is presented, thereby being able to guide the simulated subject to appropriate skin care or makeup.
[0364] A fourth technical solution of this embodiment is an information processing device, comprising:
[0365] a unit for acquiring cosmetic information related to the cosmetics to be applied to the skin of the simulated subject (e.g., the processor 32 executing step S300), and
[0366] A means for presenting advice information on how to use cosmetics based on a combination of the predicted skin condition and the cosmetics information (for example, the processor 32 executing step S302).
[0367] According to the fourth aspect, based on the prediction result of the skin condition, advice information on how to use the cosmetics currently in use is presented, thereby being able to guide the simulated subject to appropriate skin care or makeup.
[0368] A fifth technical solution of this embodiment is an information processing device, comprising:
[0369] A means for presenting recommended cosmetic information related to recommended cosmetics recommended for use based on the predicted skin condition.
[0370] According to the fifth aspect, information on recommended cosmetics corresponding to the predicted result of the skin condition is presented, thereby being able to guide the simulated subject to appropriate skin care or makeup.
[0371] The sixth technical solution of this embodiment is an information processing device,
[0372] The recommended cosmetic information includes information related to the usage amount of the recommended cosmetic.
[0373] According to the sixth aspect, information on the recommended amount of cosmetics to be used corresponding to the predicted result of the skin condition is presented, thereby guiding the simulated subject to appropriate skin care or makeup.
[0374] A seventh technical solution of the present embodiment is an information processing device, comprising:
[0375] The unit (eg, the processor 32 executing step S303 ) for generating the recipe information of the recommended cosmetics is sent to the cosmetics generating device generating the cosmetics.
[0376] According to the seventh aspect, the formula information of the recommended cosmetics corresponding to the prediction result of the skin condition is transmitted to the cosmetics generating device 50. Thus, the simulated subject can easily obtain the recommended cosmetics.
[0377] An eighth technical solution of this embodiment is an information processing device, comprising:
[0378] a means for acquiring cosmetic information related to the target cosmetic to be simulated (for example, the processor 32 executing step S300),
[0379] The prediction unit predicts and simulates the transition of the skin condition of the subject by inputting the cosmetics information of the target cosmetic and the skin information of the subject into the state transition model.
[0380] According to the eighth aspect, it is possible to predict the future skin condition when the target cosmetic arbitrarily designated by the user is continuously used.
[0381] The ninth technical solution of this embodiment is an information processing device,
[0382] State transition models (e.g. Figure 8 ) specifies the categories corresponding to each skin condition and the links between multiple categories.
[0383] The tenth technical solution of this embodiment is an information processing device,
[0384] State transition models (e.g. Fig.15 ) includes a plurality of communities of skin conditions to which the tendency of changes in characteristic quantities of the skin are assigned to be common,
[0385] The state transition model specifies the transitions between communities.
[0386] According to the tenth technical solution, it is possible to determine the main changes in the user's skin.
[0387] The eleventh technical solution of the present embodiment is a cosmetics production device 50, which is a cosmetics production device 50 that can be connected to the above-mentioned information processing device (for example, the server 30), and includes:
[0388] A plurality of containers 55a to 55b for storing raw materials of cosmetics,
[0389] A unit (for example, the processor 52) that determines the extraction amount of the raw material stored in each container 55a to 55b based on the recipe information sent from the information processing device, and
[0390] A unit (for example, the processor 52 ) extracts the raw material stored in each container based on the determined extraction amount.
[0391] According to the eleventh aspect, the formula information of the recommended cosmetics corresponding to the prediction result of the skin condition is transmitted to the cosmetics generating device 50. Thus, the simulated subject can easily obtain the recommended cosmetics.
[0392] The twelfth technical solution of this embodiment is a cosmetics producing device 50,
[0393] The determining means determines the amount of the raw material contained in each container so that the total amount of the raw material contained in the plurality of containers becomes the usage amount when the recipe information includes information on the usage amount of the recommended cosmetic recommended for use based on the predicted skin condition.
[0394] According to the twelfth aspect, the formula information of the recommended cosmetics corresponding to the prediction result of the skin condition is transmitted to the cosmetics generating device 50. Thus, the simulated subject can easily obtain the recommended cosmetics.
[0395] A thirteenth technical means of the present embodiment is a program for causing a computer (for example, the processor 32) to function as any of the above-mentioned means.
[0396] (7) Other Modifications
[0397] Other modified examples will be described.
[0398] The storage device 11 may be connected to the client device 10 via the network NW. The storage device 31 may be connected to the server 30 via the network NW.
[0399] Each step of the above-mentioned information processing may be executed by either the client device 10 or the server 30 .
[0400] In the above embodiment, an example is described in which the characteristic amount of the user's skin is acquired based on the user's instruction. However, this embodiment can also be applied to the case where the characteristic amount is acquired by a moisture measuring device.
[0401] The embodiments of the present invention are described in detail above, but the scope of the present invention is not limited to the above embodiments. In addition, the above embodiments can be variously improved and changed within the scope of the gist of the present invention. In addition, the above embodiments and modifications can be combined.
[0402] Description of Reference Numerals
[0403] 1: Information Processing System
[0404] 10: Client Device
[0405] 11: Storage device
[0406] 12: Processor
[0407] 13: Input and output interface
[0408] 14: Communication interface
[0409] 30: Server
[0410] 31: Storage device
[0411] 32: Processor
[0412] 33: Input and output interface
[0413] 34: Communication interface
[0414] 50: Cosmetic production device
[0415] 51: Storage device
[0416] 52: Processor
[0417] 53: Input and output interface
[0418] 54: Communication interface
[0419] 55a, 55b: Container
[0420] 56: Extraction control unit
Claims
1. An information processing device that performs a simulation for predicting a future skin condition when cosmetics are applied to the skin, comprising: a unit for acquiring skin information of a subject related to the skin of a simulated subject; a unit for predicting a transition of the skin state of the simulated subject by inputting the subject's skin information into a state transition model related to the transition of the skin state based on a plurality of subject skin information, subject state information, and cosmetics information, wherein the plurality of subject skin information is information indicating changes over time in the skin of a plurality of subjects when each of the subjects applies cosmetics to the skin, the subject state information is information related to the skin state of the subject corresponding to each subject's skin information, and the cosmetics information is information related to the cosmetics; and A unit for indicating the predicted transition of the skin condition.
2. The information processing device according to claim 1, comprising: a unit for acquiring target information related to the skin condition set as a target by the simulation subject; The prediction unit predicts a time required for the skin condition of the simulation subject to reach a skin condition corresponding to the target information.
3. The information processing device according to claim 1, comprising: A means for presenting advice information on skin care or makeup suitable for the predicted skin condition.
4. The information processing device according to claim 3, comprising: a unit for acquiring cosmetic information related to the cosmetics to be applied to the skin of the simulated subject; and A means for presenting advice information on a method of using the cosmetics based on a combination of the predicted skin condition and the cosmetics information.
5. The information processing device according to claim 1, comprising: A means for presenting recommended cosmetic information related to recommended cosmetics recommended for use based on the predicted skin condition.
6. The information processing device according to claim 5, The recommended cosmetic information includes information related to the usage amount of the recommended cosmetic.
7. The information processing device according to claim 5 or 6, comprising: A unit for transmitting formula information for generating the recommended cosmetics to a cosmetics generating device for generating cosmetics.
8. The information processing device according to any one of claims 1 to 6, comprising: means for acquiring cosmetic information related to the target cosmetic to be the subject of the simulation, The prediction unit predicts the transition of the skin condition of the simulated subject by inputting the cosmetics information of the target cosmetic and the skin information of the subject into the state transition model.
9. The information processing device according to any one of claims 1 to 6, The state transition model defines a category corresponding to each skin state and links between the categories.
10. The information processing device according to claim 9, The state transition model includes a plurality of communities of skin states to which common tendencies of changes in characteristic quantities of the skin are assigned, The state transition model specifies the transitions between communities.
11. A cosmetics production device, comprising: A plurality of containers for storing raw materials of cosmetics; and A communication interface connected to an information processing device via a network, the information processing device executing a simulation for predicting a future skin condition when cosmetics are applied to the skin, The information processing device, Acquiring subject skin information related to the skin of the simulated subject; Predicting the transition of the skin state of the simulated subject by inputting the subject's skin information into a state transition model related to the transition of the skin state based on multiple subject skin information, subject state information, and cosmetics information, wherein the multiple subject skin information is information indicating the temporal changes of the skin of multiple subjects when each of the subjects uses cosmetics on the skin, the subject state information is information related to the skin state of the subject corresponding to each subject's skin information, and the cosmetics information is information related to the cosmetics; Prompting recommended cosmetics information related to recommended cosmetics recommended for use based on the predicted skin condition; as well as sending the formula information for generating the recommended cosmetics to the cosmetics generating device, The communication interface of the cosmetics production device receives the formula information, The cosmetics producing device further comprises: means for determining the extraction amount of the raw material stored in each container based on the recipe information sent from the information processing device; and Based on the determined extraction amount, the unit of the raw material stored in each container is extracted.
12. The cosmetics producing device according to claim 11, The determining unit determines the amount of extraction of the raw materials contained in each container in a manner such that the total amount of extraction of the raw materials contained in the multiple containers becomes the usage amount when the recipe information includes information related to the usage amount of the recommended cosmetic recommended for use based on the predicted skin condition. 13 . A computer program product comprising a computer program for causing a computer to function as each unit of the information processing apparatus according to claim 1 .
