Cosmetic product suggestion method, cosmetic product suggestion device, and cosmetic product suggestion program

Abstract

We suggest cosmetics that suit the user's skin. [Solution] The cosmetic suggestion method is a cosmetic suggestion method performed by at least one processor, which acquires a skin image in which at least a part of the user's skin is captured and information about the cosmetic product the user is considering purchasing, calculates and outputs a first evaluation value indicating the user's skin condition based on the skin image, and selects and outputs a plurality of suggested cosmetic products that increase the value of the first evaluation value based on the first evaluation value and the information about the cosmetic product.

Description

Technical Field

[0004] , , , ,

[0005] , , ,

[0003] , , ,

[0001] The present disclosure relates to a method for proposing cosmetics, a device for proposing cosmetics, and a program for proposing cosmetics.

Background Art

[0002] Patent Document 1 discloses an apparatus having a nuclear magnetic resonance analyzer and a control device that operates the nuclear magnetic resonance analyzer according to a predetermined procedure, the apparatus including: a skin eigenvalue measurement means for measuring the constitution of a subject and the trouble state of the skin and representing the result by a numerical value within a certain range; a specific compatibility value measurement means for measuring the degree of influence of an arbitrary cosmetic on the skin and representing the result by a numerical value within a certain range; and a compatibility value measurement means for measuring the compatibility between an arbitrary cosmetic and the skin and representing the result by a numerical value within a certain range.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] [[ID=3 fifty-five]]In recent years, due to reasons such as cosmetics not suiting the skin or the effects of cosmetics not being felt, the waste loss of cosmetics has become an issue. On the other hand, in the purchase of cosmetics, purchasers have problems such as not knowing the compatibility with their own skin, not knowing the compatibility with the cosmetics they are currently using, or not knowing the lotion suitable for their current skin condition due to changes in skin quality. Therefore, there has been a demand for a technology that proposes cosmetics suitable for the purchaser's skin and effective for the purchaser's skin-related problems.

[0005] Patent Document 1 discloses a technology that allows anyone to easily measure the compatibility between skin and cosmetics and automatically select the optimal combination of cosmetics. However, the compatibility check device requires placing the cosmetics to be checked on a stand of a dedicated magnetic resonance analyzer, and then having the subject (i.e., the purchaser) apply a face stick to the area of ​​skin they are concerned about to operate the magnetic resonance analyzer. Therefore, it was not intended for individual use by the subject. Furthermore, even if the subject owns a magnetic resonance analyzer, they still need to purchase the cosmetics they want to check, making it difficult to reduce cosmetic waste.

[0006] This disclosure was devised in view of the above-mentioned conventional circumstances and aims to provide a cosmetic suggestion method, a cosmetic suggestion device, and a cosmetic suggestion program that suggest cosmetics suitable for the user's skin. [Means for solving the problem]

[0007] This disclosure provides a cosmetic suggestion method performed by at least one processor, which acquires a skin image in which at least a portion of the user's skin is captured and information about the cosmetic product the user is considering purchasing, calculates and outputs a first evaluation value indicating the user's skin condition based on the skin image, and selects and outputs a plurality of suggested cosmetic products that increase the value of the first evaluation value based on the first evaluation value and the information about the cosmetic product.

[0008] Furthermore, this disclosure provides a cosmetic suggestion device comprising: an acquisition unit that acquires a skin image in which at least a portion of the user's skin is captured and information regarding cosmetics that the user is considering purchasing; a calculation unit that calculates and outputs a first evaluation value indicating the user's skin condition based on the skin image; and a selection unit that selects and outputs a plurality of suggested cosmetics that increase the value of the first evaluation value based on the first evaluation value and the information regarding the cosmetics.

[0009] Furthermore, this disclosure provides a cosmetic suggestion program that is executed by at least one processor, which performs the steps of: obtaining a skin image in which at least a portion of the user's skin is captured and information about cosmetics that the user is considering purchasing; calculating and outputting a first evaluation value indicating the user's skin condition based on the skin image; and selecting and outputting a plurality of suggested cosmetics that increase the value of the first evaluation value based on the first evaluation value and information about the cosmetics. [Effects of the Invention]

[0010] According to this disclosure, it is possible to suggest cosmetics that are suitable for the user's skin. [Brief explanation of the drawing]

[0011] [Figure 1] A diagram showing an example of the overall configuration of the cosmetic proposal system according to the embodiment. [Figure 2] Sequence diagram showing an example of the operation procedure of the cosmetic proposal system according to the embodiment. [Figure 3] Diagram showing example screen transitions for a terminal device (Figure 1) [Figure 4] Diagram showing example screen transitions for a terminal device (Figure 1) [Figure 5] Figure showing example 2 of screen transitions on a terminal device. [Figure 6] Figure showing example 2 of screen transitions on a terminal device. [Modes for carrying out the invention]

[0012] The following describes in detail the configuration and operation of the cosmetic proposal method, cosmetic proposal apparatus, and cosmetic proposal program described herein, with reference to the drawings as appropriate. However, unnecessarily detailed explanations may be omitted. For example, detailed explanations of already well-known matters and redundant explanations of substantially identical configurations may be omitted. This is to avoid the following explanation becoming unnecessarily verbose and to facilitate understanding by those skilled in the art. The accompanying drawings and the following explanation are provided to enable those skilled in the art to fully understand this disclosure and are not intended to limit the subject matter described in the claims.

[0013] In the following explanation, the term "item" will be used synonymously with "cosmetics."

[0014] Referring to Figure 1, the cosmetic suggestion system 100 according to the embodiment will be described. Figure 1 is a diagram showing an example of the overall configuration of the cosmetic suggestion system 100 according to the embodiment.

[0015] The cosmetics recommendation system 100 is a general-purpose device that includes a terminal device P1 owned by the user, a server S1 that suggests cosmetics suitable for the user's skin based on the user's skin condition, and an e-commerce site ST that sells cosmetics.

[0016] In this disclosure, cosmetics refer to products intended for beauty purposes, and while examples of makeup products used on the face (foundation, concealer, makeup base, powder, eyeshadow, mascara, eyeliner, blush, or lip gloss, etc.) will be described, they are not limited to these. Cosmetics in this disclosure may be any cosmetics that can be suggested based on the user's skin condition as captured and analyzed by a camera, and may include, for example, skincare products (e.g., facial cleansers, toners, serums, lotions, creams, sheet masks, scrubs, or sunscreens) or body care products (body lotions, body creams, etc.).

[0017] The terminal device P1 is connected to be wirelessly communicable with the server S1 and the EC site ST, respectively. The terminal device P1 is realized by a general-purpose device such as a Personal Computer (hereinafter referred to as "PC"), a notebook PC, a smartphone, or a tablet terminal. The terminal device P1 includes a communication unit 10, a processor 11, a memory 12, a camera 13, and a monitor 14.

[0018] The communication unit 10 is connected to be wirelessly communicable with the server S1 and the EC site ST, respectively, and executes data transmission and reception. The communication unit 10 outputs various data transmitted from the server S1 or the EC site ST to the processor 11. The communication unit 10 transmits various data output from the processor 11 to the server S1 or the EC site ST. Here, the wireless communication is, for example, short-range wireless communication such as Bluetooth (registered trademark) or NFC (registered trademark), or communication via a wireless LAN (Local Area Network) such as Wi-Fi (registered trademark).

[0019] The processor 11 is configured by using, for example, a Central Processing Unit (hereinafter referred to as "CPU"), a Field Programmable Gate Array (hereinafter referred to as "FPGA"), or a Graphics Processing Unit (hereinafter referred to as "GPU"), and performs various processes and controls in cooperation with the memory 12. Specifically, the processor 11 refers to the programs and data held in the memory 12 and executes the programs to realize functions such as a cosmetic information input unit 111, a candidate cosmetic display unit 112, a candidate cosmetic selection unit 113, and a skin condition score display unit 114. Here, as the functions realized by the processor 11, the cosmetic information input unit 111, the candidate cosmetic display unit 112, the candidate cosmetic selection unit 113, and the skin condition score display unit 114 are each listed. However, it is needless to say that the functions that can be realized by the processor 11 are not limited to these.

[0020] Here, each of the cosmetic information input unit 111, the candidate cosmetic display unit 112, the candidate cosmetic selection unit 113, and the skin condition score display unit 114 may be realized by a dedicated application. In such a case, the terminal device P1 can realize functions such as the cosmetic information input unit 111, the candidate cosmetic display unit 112, the candidate cosmetic selection unit 113, and the skin condition score display unit 114 by installing the dedicated application.

[0021] The cosmetic information input unit 111 receives an input operation of information about cosmetics (hereinafter referred to as "purchase consideration item") that the user desires to propose or purchase (for example, information on the category of cosmetics) or information on cosmetics that the user owns or uses (hereinafter referred to as "owned item") via the operation unit 15, or receives a search operation for the owned item. The cosmetic information input unit 111 transmits the input information to the server S1.

[0022] The candidate cosmetic display unit 112 acquires information on candidates for a plurality of cosmetics (hereinafter referred to as "recommended items") transmitted from the server S1 and proposed to the user. The candidate cosmetic display unit 112 generates recommended item candidate screens SC14, SC14A (see FIGS. 4 and 6) for visualizing the acquired information on the recommended item candidates and outputs them to the monitor 14.

[0023] The candidate cosmetic selection unit 113 receives a selection operation by the user for a recommended item candidate displayed on the recommended item candidate screens SC14, SC14A (see FIGS. 4 and 6) that requires calculation of the user's skin condition (score) during use. The candidate cosmetic selection unit 113 transmits the information on the selected recommended item candidate to the server S 1 in association with a control command for requesting scoring of the amount of change in the skin condition when the user uses this recommended item candidate.

[0024] The skin condition score display unit 114 acquires a score indicating the user's skin condition, which is transmitted from the server S1. The skin condition score display unit 114 generates score screens SC13, SC15, and SC15A (see Figures 3 to 6) that visualize the acquired score and outputs them to the monitor 14.

[0025] Memory 12 includes, for example, Random Access Memory (hereinafter referred to as "RAM"), which serves as work memory used when executing various processes of the processor 11, and Read Only Memory (hereinafter referred to as "ROM"), which stores programs and data that define the operation of the processor 11. Data or information generated or acquired by the processor 11 is temporarily stored in RAM. Programs that define the operation of the processor 11 are written to ROM.

[0026] Camera 13 comprises at least a lens (not shown) and an image sensor (not shown). The image sensor is a solid-state image sensor, such as a Charged-Coupled Device (CCD) or Complementary Metal Oxide Semiconductor (CMOS), which converts the optical image formed on the imaging surface into an electrical signal. Camera 13 starts imaging in response to an imaging start control instruction input by the processor 11 or an imaging operation by the user. Camera 13 outputs the captured image to the processor 11.

[0027] The monitor 14 is constructed using, for example, a Liquid Crystal Display (LCD) or an organic electroluminescence (EL). The monitor 14 outputs and displays the captured image taken by the camera 13 or various screens (see Figures 3 to 6) generated by the processor 11. The various screens displayed on the monitor 14 will be described later.

[0028] The operation unit 15 is provided either integrally with the monitor 14 or separately, and may be an interface consisting of a touch panel, mouse, keyboard, or the like. The operation unit 15 generates electrical signals based on input operations and outputs them to the processor 11.

[0029] Server S1 is wirelessly connected to terminal device P1 and performs data transmission and reception. Based on the data transmitted from terminal device P1, Server S1 analyzes and scores the user's skin condition and selects candidate recommended items to suggest to the user. Server S1 includes a communication unit 20, a processor 21, memory 22, and a cosmetics information database DB.

[0030] The communication unit 20 is connected to the terminal device P1 via wireless communication and performs data transmission and reception. The communication unit 20 outputs various data transmitted from the terminal device P1 to the processor 21. The communication unit 20 transmits various data output from the processor 21 to the terminal device P1.

[0031] The processor 21 is configured using, for example, a CPU, FPGA, or GPU, and works in cooperation with the memory 22 to perform various processes and controls. Specifically, the processor 21 refers to the programs and data held in the memory 22 and executes those programs to realize functions such as the first skin condition score calculation unit 211, the cosmetic search unit 212, and the second skin condition score calculation unit 213. Here, the functions realized by the processor 21 are listed as the first skin condition score calculation unit 211, the cosmetic search unit 212, and the second skin condition score calculation unit 213, but it goes without saying that the functions that the processor 21 can realize are not limited to these.

[0032] The first skin condition score calculation unit 211 analyzes the user's skin condition based on an image (hereinafter referred to as "skin image") in which at least a portion of the user is captured and transmitted from the terminal device P1, and calculates a score for each of several parameters. The first skin condition score calculation unit 211 transmits information of the scores corresponding to each calculated parameter to the terminal device P1.

[0033] The cosmetics search unit 212 uses a pre-trained model to select recommended items for the user. This pre-trained model is generated by learning information such as the user's skin condition, the ingredients of each cosmetic product, and their feel. Based on the user's skin condition or the items they own, the pre-trained model selects recommended items that are suitable for the user's skin condition, or recommended items that are suitable for the user's skin condition and, when used in combination with the items they own, will produce the same cosmetic effect as the recommended items.

[0034] In this context, "suitable for skin condition" refers to improving the user's skin condition, specifically by increasing the score of one of several parameters.

[0035] Furthermore, the trained model may be automatically retrained by receiving feedback from the user's terminal device P1 regarding their experience using the recommended items, the effects they felt, and their evaluations.

[0036] The cosmetics search unit 212 inputs information such as the category of items under consideration for purchase, items owned, or scores for various parameters indicating the user's skin condition into a trained model, and searches for and selects cosmetics to suggest to the user (recommended item candidates) from among multiple cosmetics stored (registered) in the cosmetics information database DB.

[0037] The cosmetics search unit 212 searches for multiple cosmetics stored (registered) in the cosmetics information database DB that are estimated to be effective in, for example, raising the smallest or lowest score among the scores of each parameter, raising the overall score, or raising the score of at least one parameter specified by the user, and selects them as recommended item candidates. The cosmetics search unit 212 also calculates a compatibility score that scores the compatibility when used in combination with the user's owned items and each of the extracted recommended item candidates, and further selects multiple recommended item candidates that are more compatible with the user's owned items from among the multiple recommended item candidates based on the calculated compatibility score. The cosmetics search unit 212 transmits information on the selected multiple recommended item candidates to the terminal device P1.

[0038] In this context, "good compatibility" means that when multiple cosmetics are used in combination, they produce an effect that improves the user's skin condition (score), or that the effects of each of the cosmetics used in combination can be utilized. For example, if the user's owned item is powder and the recommended item candidate is foundation, Server S1 will determine that the recommended item candidate is incompatible if, based on the ingredients of the owned item, the ingredients of the recommended item candidate, and the user's skin condition, using these items together results in makeup that is prone to creasing, i.e., a decrease in the score. On the other hand, if Server S1 determines that using these items together results in makeup that is less likely to smudge, i.e., the score is maintained or increases, then the recommended item candidate is incompatible.

[0039] The second skin condition score calculation unit 213 receives information on recommended item candidates selected by the user from the terminal device P1. Based on the acquired recommended item candidates and the user's skin condition (scores for each parameter), the second skin condition score calculation unit 213 estimates and calculates the scores for each of several parameters representing the user's skin condition when using these recommended item candidates. The second skin condition score calculation unit 213 associates the calculated scores for each of the multiple parameters when using the recommended item candidates with the information on the recommended item candidates used to calculate the scores, and transmits this information to the terminal device P1.

[0040] The second skin condition score calculation unit 213 may calculate the change in the scores of multiple parameters when using the calculated recommended item candidates and the scores of multiple parameters based on the user's skin image, and transmit the calculated change in the scores of multiple parameters based on the user's skin image to the terminal device P1.

[0041] Memory 22 includes, for example, RAM as work memory used when executing each process of processor 21, and ROM which stores programs and data that define the operation of processor 21. Data or information generated or acquired by processor 21 is temporarily stored in RAM. Programs that define the operation of processor 21 are written to ROM.

[0042] The cosmetics information database (DB) is a type of storage, consisting of storage media such as flash memory, hard disk drives (HDDs), or solid state drives (SSDs). The cosmetics information database (DB) stores (registers) information for each cosmetic product, including its category (for example, product categories such as makeup base, concealer, foundation, or face powder, or cosmetic process categories such as skincare or makeup), cosmetic name, information about the ingredients contained in the cosmetic, information about the cosmetic manufacturer, and the price of the cosmetic.

[0043] EC Site ST is an online shopping site that provides services for selling cosmetics via the internet. Furthermore, EC Site ST may offer optional services.

[0044] Next, an example of the operation procedure of the cosmetic suggestion system 100 will be described with reference to Figure 2. Figure 2 is a sequence diagram showing an example of the operation procedure of the cosmetic suggestion system 100 according to an embodiment.

[0045] Terminal device P1 displays the purchase consideration item selection screen SC11 (see Figures 3 and 5) on monitor 14. Based on user operations on the purchase consideration item selection screen SC11, terminal device P1 accepts input of the purchase consideration items (cosmetics) that the user is considering purchasing (St11).

[0046] Terminal device P1 displays the owned item selection screen SC17 (see Figure 5) on monitor 14. Based on user operations on the owned item selection screen SC17, terminal device P1 accepts input of owned items (cosmetics) that the user owns or is using (St12). Note that the processing in step St12 is performed when calculating the compatibility score between recommended item candidates and owned items, and is not mandatory and may be omitted.

[0047] Terminal device P1 displays the skin imaging screen SC12 (see Figures 3 and 5) on the monitor 14 and captures the user's face (skin) with the camera 13. Terminal device P1 acquires a skin image (St13) in which at least a portion of the user's face (skin) captured by the camera 13 is captured.

[0048] Terminal device P1 associates information on items under consideration for purchase with skin images and sends them to server S1 (St14). If the process in step St12 is executed, terminal device P1 associates information on items under consideration for purchase with information on owned items and skin images and sends them to server S1 (St14).

[0049] Server S1 analyzes the user's skin condition based on the user's skin image transmitted from terminal device P1 and calculates (scores) the scores for each of several parameters (St15). Any publicly known technique may be used for analyzing the user's skin condition. Server S1 transmits the calculated scores for each of the multiple parameters to terminal device P1 (St16).

[0050] The terminal device P1 generates a score screen SC13 (see Figures 3 and 5) that visualizes the user's skin condition as a score, based on the scores of multiple parameters transmitted from the server S1 (i.e., the results of the skin condition analysis), and outputs it to the monitor 14 (St17). In this disclosure, the score screen SC13 shows the score as a radar chart as an example, but the display format is not limited to this, and the score may be displayed using only numbers, a bar graph, a table, or letters or symbols (e.g., ◎, ○, △, or ×, etc.).

[0051] Furthermore, server S1 refers to the cosmetics information database DB and searches for cosmetics that suit the user's skin condition based on the scores of each of the calculated parameters (i.e., the user's skin condition). Here, server S1 searches for cosmetics that will increase the score of at least one of the scores of the multiple parameters, or the score of a parameter that the user has specified they wish to improve. Based on the search results, server S1 selects several candidate recommended items to suggest to the user (St18). Server S1 transmits information on the selected candidate recommended items to terminal device P1 (St19).

[0052] Server S1 may select recommended item candidates based on any rules it chooses. For example, it may select a predetermined number of recommended item candidates in order of the largest score increase, in order of the largest average score of each of the multiple parameters, or in order of the largest number of parameters that increase the score.

[0053] Furthermore, if the user has entered their owned items in step St12, server S1 searches for cosmetics that are compatible with the owned items and suit the user's skin condition, based on the compatibility or compatibility score derived from the acquired information on the owned items, and the scores of several parameters (i.e., the user's skin condition). Based on the search results, server S1 selects several recommended item candidates that are compatible with the owned items and to suggest to the user (St18A). Server S1 transmits information on the selected multiple recommended item candidates to terminal device P1 (St19A). Note that if server S1 calculates the compatibility between the owned items and the recommended item candidates as a compatibility score, it may transmit information on multiple recommended item candidates and the compatibility score calculated for each recommended item candidate to terminal device P1 in association with each other.

[0054] Terminal device P1 acquires information on multiple recommended item candidates sent from server S1, generates item candidate screens SC14 and SC14A (see Figures 4 and 6) showing the acquired multiple recommended item candidates, and displays them on monitor 14 (St20).

[0055] Terminal device P1 accepts the user's selection operation for a recommended item from among the multiple recommended item candidates displayed on the item candidate screens SC14 and SC14A, which will be used to calculate changes in the user's skin condition (St21).

[0056] Terminal device P1 sends information about recommended items selected by the user to server S1 (St22).

[0057] Server S1 estimates the user's skin condition when using the recommended item based on the recommended item information sent from terminal device P1, and calculates a score for each of several parameters that indicate the user's skin condition when using the recommended item (St23). Server S1 sends the calculated scores for each of the multiple parameters when using the recommended item to terminal device P1 (St24).

[0058] Terminal device P1 acquires the score for each of the multiple parameters transmitted from server S1, generates score screens SC15 and SC15A (see Figures 4 and 6) that include the user's skin condition when using the recommended item and the user's skin condition when not using the item (before use), and displays them on monitor 14 (St25).

[0059] When terminal device P1 receives a user request to purchase recommended items, it generates purchase item screens SC16 and SC16A (see Figures 4 and 6) and displays them on monitor 14. When terminal device P1 receives a selection (press) operation of the purchase button BT6 included in purchase item screens SC16 and SC16A (St26), it transmits the information of the recommended items displayed on purchase item screens SC16 and SC16A to the EC site ST as information of the purchase item requested by the user (St27).

[0060] As described above, the cosmetic suggestion system 100 according to the embodiment can suggest cosmetics (recommended item candidates) that are suitable for the user's skin condition. Furthermore, the cosmetic suggestion system 100 accepts the selection of recommended items from the recommended item candidates for which the user wishes to know how their skin condition has changed, and can compare the user's skin condition with and without using the recommended item using a score. As a result, the user can check the change in their own skin condition with and without using the recommended item using a score, and thus know whether or not the recommended item is suitable for their skin.

[0061] Furthermore, the cosmetic suggestion system 100 according to the embodiment can suggest cosmetics (recommended item candidates) that are compatible with the cosmetics the user owns or uses and that are suitable for the user's skin, based on the cosmetics the user owns or uses and the user's skin condition. In addition, the cosmetic suggestion system 100 accepts the selection of recommended items from the recommended item candidates for which the user wishes to know the change in their skin condition, and can compare the user's skin condition before and after using the owned items and recommended items in combination using a score. As a result, the user can check the change in their skin condition with and without using the items they own or use and the recommended items using a score, and can therefore determine whether the recommended items are suitable for the owned items and their skin.

[0062] Next, the various screens displayed on terminal device P1 will be described with reference to Figures 3 and 4, respectively. Figure 3 is a diagram showing example 1 of screen transitions on terminal device P1. Figure 4 is a diagram showing example 1 of screen transitions on terminal device P1. Note that the configuration of the various screens shown in Figures 3 and 4 is just an example and is not limited thereto. In addition, the various screens shown in Figures 3 and 4 show the corresponding operation processing numbers to make the correspondence with the sequence diagram shown in Figure 2 easier to understand.

[0063] When the application is launched by user operation, terminal device P1 generates a purchase consideration item selection screen SC11 that accepts the selection of items to be purchased and displays it on monitor 14.

[0064] The item selection screen SC11 shown in Figure 3 includes, as an example, the message MSG1 "Please select items you are considering purchasing" and the cosmetics category "Makeup base, concealer, foundation, face powder".

[0065] When the user selects area SLC1 corresponding to the cosmetics category "foundation," terminal device P1 activates camera 13 and displays skin imaging screen SC12 on monitor 14.

[0066] The skin imaging screen SC12 shown in Figure 3 includes, as an example, the message MSG2 "Scanning skin" and a guide frame GD2 that guides the imaging position of the face (skin).

[0067] Terminal device P1 acquires a skin image IMG1 captured by user operation or application control by processor 11 and transmits it to server S1. Terminal device P1 acquires the user's skin condition (i.e., the score of each of several parameters) transmitted from server S1, generates a score screen SC13 that visualizes the user's skin condition using scores, and displays it on monitor 14.

[0068] The score screen SC13 shown in Figure 3 includes, as an example, a radar chart SCR1 that visualizes the scores of several parameters indicating the user's skin condition: pores, blemishes, dark circles, fine lines, skin texture, dryness, and oiliness. The radar chart SCR1 shown in Figure 3 shows that the pore score is "40", the blemish score is "80", the dark circles score is "70", the fine lines score is "80", the skin texture score is "60", the dryness score is "70", and the oiliness score is "90", visualizing that the pore and skin texture scores are low (bad).

[0069] Terminal device P1 obtains information from server S1 about multiple recommended item candidates that are determined to be suitable for the user's skin condition. Terminal device P1 generates an item candidate screen SC14 that visualizes the multiple recommended item candidates for the user and displays it on monitor 14.

[0070] The item candidate screens SC14 and SC14A shown in Figure 4 include, as an example, the message MSG4 "Recommended items that suit your skin" and multiple recommended item candidates "Foundation A" and "Foundation B".

[0071] Terminal device P1 accepts a selection (press) operation of area SLC4 corresponding to the recommended item "Foundation A," for which the user requests visualization of the score of skin condition after use, from among several recommended item candidates. Terminal device P1 sends information of the recommended item "Foundation A" selected by the user operation to server S1. Note that the number of recommended items selected here is not limited to one, but may be multiple.

[0072] Terminal device P1 acquires the scores for each of several parameters that indicate the user's skin condition when using the recommended item "Foundation A" sent from server S1. Based on the acquired scores for each of the several parameters when using and not using the recommended item "Foundation A", terminal device P1 generates a score screen SC15 and displays it on monitor 14.

[0073] The score screen SC15 shown in Figure 4 includes, as an example, radar chart SCR1 showing the skin condition when the recommended item "Foundation A" is not used, and radar chart SCR2 showing the skin condition when "Foundation A" is used. These radar charts SCR1 and SCR2 are displayed overlaid on each other. In radar chart SCR2 shown in Figure 4, the pore score is "80", the blemish score is "83", the dark circle score is "80", the fine line score is "80", the texture score is "75", the dryness score is "80", and the oiliness score is "90". The score screen SC15 visualizes the amount of change in skin condition by using the recommended item "Foundation A" by comparing radar chart SCR1 and radar chart SCR2.

[0074] Note that the score screen SC15 shown in Figure 4 is an example that includes two scores (each from radar charts SCR1 and SCR2). However, if there are multiple recommended items, the score (radar chart) corresponding to all selected recommended items, or the score corresponding to one or more of the selected recommended items, may be displayed.

[0075] When terminal device P1 receives a user operation requesting the purchase of a recommended item, or a user operation selecting any area on the score screen SC15, it generates a purchase item screen SC16 that accepts the purchase of the recommended item and displays it on monitor 14. If there are multiple recommended items, terminal device P1 generates a purchase item screen SC16 that accepts the purchase of multiple recommended items.

[0076] The purchase item screen SC16 shown in Figure 4 includes, as an example, the price of the recommended item "Foundation A" and a purchase button BT6 to accept the purchase operation for the recommended item "Foundation A".

[0077] When terminal device P1 receives a selection (press) operation of the purchase button BT6 via user operation on the purchased items screen SC16, it transmits information about "Foundation A" to the EC site ST. Terminal device P1 then displays a payment screen (not shown) for purchasing "Foundation A," or the sales screen for "Foundation A" on the EC site ST (not shown), etc., to assist the user in purchasing the cosmetic product (recommended item) they wish to buy.

[0078] Next, the various screens displayed on terminal device P1 will be described with reference to Figures 5 and 6, respectively. Figure 5 is a diagram showing example 2 of screen transitions on terminal device P1. Figure 6 is a diagram showing example 2 of screen transitions on terminal device P1. Note that the configuration of the various screens shown in Figures 5 and 6 is just an example and is not limited thereto. In addition, the various screens shown in Figures 5 and 6 are indicated by corresponding operation processing numbers to make the correspondence with the sequence diagram shown in Figure 2 easier to understand. Furthermore, for the various screens shown in Figures 5 and 6 that are the same as the various screens shown in Figures 3 and 4, the same reference numerals are used, and their explanation is omitted.

[0079] Screen transition example 2 is an example of a screen transition when executing the process of step St12 shown in Figure 2.

[0080] When the user selects the "Foundation" category of cosmetics, terminal device P1 generates an item selection screen SC17 that accepts input from the user regarding cosmetics they own or are currently using, and displays it on monitor 14.

[0081] The item selection screen SC17 shown in Figure 5 includes, as an example, a search box INP7 for searching for cosmetics owned or used by the user, a search button BT7 that performs a search for the search word "Face Powder E" entered in the search box INP7, and the search result "Face Powder E".

[0082] When the user selects area SLC7 corresponding to the search result "Face Powder E", terminal device P1 sends the information of the selected "Face Powder E" to server S1 as information of the user's owned items.

[0083] Terminal device P1 obtains information from server S1 regarding multiple recommended item candidates that have been determined to be compatible with the user's skin condition and owned items, as well as information regarding the compatibility scores between the multiple recommended item candidates and the user's skin condition and owned items. Terminal device P1 generates an item candidate screen SC14A that visualizes the multiple recommended item candidates and their corresponding compatibility scores for the user, and displays it on monitor 14.

[0084] The item candidate screen SC14A shown in Figure 6 includes, as an example, the message MSG4 "Recommended items that suit your skin," multiple recommended item candidates "Foundation C" and "Foundation D," and compatibility scores for the multiple recommended item candidates SCR41 "Foundation C Compatibility Score: 85%" and SCR42 "Foundation D Compatibility Score: 70%."

[0085] Terminal device P1 accepts a selection (press) operation in area SLC4A corresponding to the recommended item "Foundation C," for which the user requests visualization of the skin condition score after use, from among several recommended item candidates. Terminal device P1 sends information of the recommended item "Foundation C" selected by the user operation to server S1. Note that the number of recommended items selected here is not limited to one, but may be multiple.

[0086] Terminal device P1 acquires the scores for each of several parameters that indicate the user's skin condition when using the recommended item "Foundation C" sent from server S1. Based on the acquired scores for each of the several parameters when using and not using the recommended item "Foundation C", terminal device P1 generates a score screen SC15A and displays it on monitor 14.

[0087] The score screen SC15A shown in Figure 6 includes, as an example, radar chart SCR1 showing the skin condition when the recommended item "Foundation C" is not used, and radar chart SCR2 showing the skin condition when "Foundation C" is used. These radar charts SCR1 and SCR2 are displayed overlaid on each other. In radar chart SCR2 shown in Figure 6, the pore score is "80", the blemish score is "83", the dark circle score is "80", the fine line score is "80", the texture score is "75", the dryness score is "80", and the oiliness score is "90". The score screen SC15A visualizes the change in skin condition by using the recommended item "Foundation A" by comparing radar chart SCR1 and radar chart SCR2.

[0088] Note that the score screen SC15A shown in Figure 6 is an example that includes two scores (each of the radar charts SCR1 and SCR2). However, if there are multiple recommended items, the score (radar chart) corresponding to all selected recommended items may be displayed, or the score corresponding to one or more of the selected recommended items may be displayed. Furthermore, the score screen SC15A shown in Figure 6 may show the change in the score values ​​of each of the multiple parameters when the recommended item candidate is used and when it is not used. For example, an increase in score may be shown as a positive number, and a decrease in score may be shown as a negative number.

[0089] When terminal device P1 receives a user request to purchase recommended items, it generates a purchase item screen SC16A that accepts the purchase of the recommended items and displays it on monitor 14. If there are multiple recommended items, terminal device P1 generates a purchase item screen SC16A that accepts the purchase of multiple recommended items.

[0090] The purchase item screen SC16A shown in Figure 6 includes, as an example, the recommended item "Foundation C" and a purchase button BT6 for accepting the purchase operation of the recommended item "Foundation C".

[0091] When terminal device P1 receives a selection (press) operation of the purchase button BT6 via user operation on the purchased item screen SC16A, it transmits information about "Foundation C" to the EC site ST. Terminal device P1 then displays a payment screen (not shown) for purchasing "Foundation C," or the sales screen for "Foundation C" on the EC site ST (not shown), etc., to assist the user in purchasing the cosmetic product (recommended item) they wish to buy.

[0092] (Note) Based on the descriptions of the embodiments described above, the following technologies are disclosed.

[0093] (Technology 1) A method for suggesting cosmetics performed by at least one processor 21, The system acquires a skin image IMG1 in which at least a portion of the user's skin is captured, and information about the cosmetics the user is considering purchasing (information about the items being considered for purchase). Based on the skin image IMG1, a first evaluation value (the score for each of several parameters) indicating the user's skin condition is calculated and output. Based on the first evaluation value and the information regarding the cosmetics, the system selects and outputs multiple suggested cosmetics (recommended item candidates) that increase the first evaluation value. Methods for proposing cosmetics. This allows server S1 to check the user's current skin condition and suggest cosmetics (recommended items) that are suitable for the user's skin condition and can improve it.

[0094] (Technology 2) Further information is obtained on at least one cosmetic product selected by the user from among the multiple suggested cosmetic products (recommended item candidates), Based on the skin image IMG1 and the information of the selected cosmetic product, a second evaluation value (the score for each of several parameters) indicating the condition of the user's skin when using the cosmetic product is calculated and output. The cosmetic proposal method described in (Technology 1). This allows server S1 to accept the selection of recommended items from the list of recommended items for which the user wants to know how their skin condition has changed, enabling it to compare the user's skin condition before and after using the recommended items using a score. As a result, the user can see the change in their skin condition with and without using the recommended items using a score, and thus determine whether or not the recommended items are suitable cosmetics for their skin.

[0095] (Technology 3) The change between the first evaluation value and the second evaluation value is calculated and output. The cosmetic proposal method described in (Technology 2). This allows server S1 to compare the changes in a user's skin condition due to the use of recommended items using a score. As a result, users can see the changes in their skin condition with and without using recommended items in a score, allowing them to determine whether or not the recommended items are suitable for their skin.

[0096] (Technology 4) Further information regarding the cosmetics owned by the aforementioned user is obtained, Based on the skin image IMG1 and the information regarding the cosmetics, the multiple suggested cosmetics (recommended item candidates) are selected. Based on the selected plurality of suggested cosmetics (recommended item candidates) and the cosmetics owned, at least one suggested cosmetic (recommended item candidate) is further selected and output from among the plurality of suggested cosmetics (recommended item candidates). The cosmetic proposal method described in (Technology 1). This allows server S1 to suggest cosmetics (recommended items) that are compatible with the cosmetics the user owns or uses and that are suitable for the user's skin, based on the cosmetics the user owns or uses and the user's skin condition.

[0097] (Technology 5) A third evaluation value (compatibility score) is calculated to indicate the compatibility of each of the selected multiple proposed cosmetic products (recommended item candidates) when used in combination with the existing cosmetic product. Based on the calculated third evaluation value, at least one of the multiple proposed cosmetic products (recommended item candidates) is further selected from among the multiple proposed cosmetic products (recommended item candidates). The cosmetic proposal method described in (Technical 4). This allows server S1 to score the compatibility between the user's owned items and recommended item candidates. Therefore, users can see the changes in their skin condition when using their owned or used items and recommended items, based on the score, and thus determine whether the recommended items are suitable for their owned items and skin type.

[0098] (Technology 6) The outputted suggested cosmetics (recommended item candidates) and the third evaluation value corresponding to the suggested cosmetics (recommended item candidates) are output in association. The cosmetic proposal method described in (Technical 5). This allows server S1 to output a compatibility score between the user's owned items and each recommended item candidate. Users can then check the compatibility score between their owned items and each recommended item, allowing them to determine whether the recommended item is suitable for their owned items and their skin type.

[0099] (Technology 7) An acquisition unit (communication unit 20) acquires a skin image IMG1 in which at least a portion of the user's skin is captured, and information about cosmetics that the user is considering purchasing (information about items under consideration for purchase), A calculation unit (first skin condition score calculation unit 211) calculates and outputs a first evaluation value indicating the user's skin condition based on the skin image IMG1, The system includes a selection unit (cosmetic search unit 212) that selects and outputs a plurality of suggested cosmetic products (recommended item candidates) that increase the value of the first evaluation value, based on the first evaluation value and information about the cosmetic product. Cosmetic product suggestion device (server S1). This allows server S1 to check the user's current skin condition and suggest cosmetics (recommended items) that are suitable for the user's skin condition and can improve it.

[0100] (Technology 8) A cosmetic suggestion program executed by at least one processor 21, The steps include obtaining a skin image IMG1 in which at least a portion of the user's skin is captured, and information about the cosmetics the user is considering purchasing (information about the items being considered for purchase), The steps include: calculating and outputting a first evaluation value indicating the user's skin condition based on the skin image IMG1; A step of selecting and outputting multiple suggested cosmetics (recommended item candidates) that increase the value of the first evaluation value, based on the first evaluation value and information about the cosmetics, Cosmetics suggestion program. This allows the processor 21 of server S1 to check the current skin condition and suggest cosmetics (recommended items) that are suitable for the user's skin condition and can improve it.

[0101] Although various embodiments have been described above with reference to the attached drawings, this disclosure is not limited to such examples. It will be clear to those skilled in the art that various modifications, alterations, substitutions, additions, deletions, and equivalents can be conceived within the scope of the claims, and these will also be understood to fall within the technical scope of this disclosure. Furthermore, the components of the various embodiments described above can be combined arbitrarily without departing from the spirit of the invention. [Industrial applicability]

[0102] This disclosure is useful as a presentation of a cosmetic suggestion method, a cosmetic suggestion apparatus, and a cosmetic suggestion program that propose cosmetics suitable for a user's skin. [Explanation of symbols]

[0103] 10,20 Communications Department 11,21 processors 12.22 memory 13 Cameras 14 monitors 15 Control section 100 Cosmetics Proposal System 111 Cosmetics Information Input Section 112 Candidate cosmetic label section 113 Candidate Cosmetics Selection Department 114 Skin condition score display section 211 First skin condition score calculation unit 212 Cosmetics Search Department 213 Second skin condition score calculation unit DB Cosmetics Information Database IMG1 Skin image P1 Terminal Device S1 Server SC11 Item Selection Screen for Purchase Considerations SC12 Skin imaging screen SC13, SC15, SC15A score screen SC14, SC14A Item Candidate Screen SC16, SC16A Purchased Items Screen SC17 Owned Item Selection Screen SCR1, SCR2 Radar Chart SCR41, SCR42 Compatibility Score

Claims

1. A method for suggesting cosmetics performed by at least one processor, The system obtains a skin image in which at least a portion of the user's skin is captured, and information about the cosmetics the user is considering purchasing. Based on the aforementioned skin image, a first evaluation value indicating the user's skin condition is calculated and output. Based on the first evaluation value and the information regarding the cosmetics, a plurality of suggested cosmetics that increase the first evaluation value are selected and output. Methods for proposing cosmetics.

2. Further information is obtained on at least one cosmetic product selected by the user from among the multiple proposed cosmetic products. Based on the skin image and the information of the selected cosmetic product, a second evaluation value indicating the user's skin condition when the cosmetic product is used is calculated and output. The cosmetic proposal method according to claim 1.

3. The change between the first evaluation value and the second evaluation value is calculated and output. The cosmetic proposal method according to claim 2.

4. Further information regarding the cosmetics owned by the aforementioned user is obtained, Based on the skin image and the information regarding the cosmetics, the multiple proposed cosmetics are selected. Based on the selected plurality of proposed cosmetics and the owned cosmetics, at least one proposed cosmetic to be output from the plurality of proposed cosmetics is further selected and output. The cosmetic proposal method according to claim 1.

5. A third evaluation value is calculated to indicate the compatibility when the selected multiple proposed cosmetics are used in combination with the existing cosmetics. Based on the calculated third evaluation value, at least one of the multiple proposed cosmetics to be output is further selected. The cosmetic proposal method according to claim 4.

6. The output is a combination of the proposed cosmetic product and the third evaluation value corresponding to the proposed cosmetic product. The cosmetic proposal method according to claim 5.

7. An acquisition unit that acquires a skin image in which at least a portion of the user's skin is captured, and information about cosmetics that the user is considering purchasing, A calculation unit calculates and outputs a first evaluation value indicating the user's skin condition based on the aforementioned skin image, The system includes a selection unit that, based on the first evaluation value and information about the cosmetics, selects and outputs a plurality of suggested cosmetics that increase the value of the first evaluation value. Cosmetic product suggestion device.

8. A cosmetic suggestion program executed by at least one processor, The steps include obtaining a skin image in which at least a portion of the user's skin is captured, and information regarding cosmetics that the user is considering purchasing, A step of calculating and outputting a first evaluation value indicating the user's skin condition based on the skin image, A step of selecting and outputting a plurality of suggested cosmetics that increase the value of the first evaluation value, based on the first evaluation value and information about the cosmetics, Cosmetics suggestion program.

Images