Information processing device and program

Abstract

The information processing device comprises: a unit for accepting an image of a subject to be decorated and identifying at least one evaluator ID of an evaluator different from the subject; a unit for generating a plurality of subject decoration images obtained by decorating the image; a unit for storing a plurality of reference decoration images obtained by decorating images of a plurality of characters, a reference image score related to an evaluation made by an evaluator on each reference decoration image, and an evaluator ID of the evaluator who has evaluated the reference decoration image in association with each other; a unit for calculating an object image score related to the evaluation of each object decoration image based on a reference image score associated with the accepted evaluator ID among the plurality of reference image scores; and a unit for prompting at least one object decoration image among the plurality of object decoration images whose object image score satisfies a predetermined condition.

Description

Technical Field

[0001] The present invention relates to an information processing device and a program. Background Art

[0002] In recent years, decoration (such as makeup, hair styling or clothing matching) has gradually become more diverse. In order to select appropriate decoration from countless options, it is necessary to actually try these options to make judgments and comparisons, which takes a lot of time and effort. Especially for people who do not have sufficient knowledge about decoration, it is extremely difficult.

[0003] For example, in order to apply proper makeup, it is necessary to select a makeup that is suitable for the features of the face (human face) and reproduce the makeup. As a technology for improving the implementation technology of makeup, there is, for example, the technology described in Japanese Patent Publication No. 2014-149696. In Japanese Patent Publication No. 2014-149696, the implementation makeup (makeup method) of the user is compared with the reference makeup that the user should refer to, and the implementation makeup is evaluated, and the evaluation result is presented to the user. In this way, the objective evaluation of the makeup applied by the user can be presented to the user, so that makeup assistance including improving the makeup technique can be performed. Summary of the invention

[0004] Problems to be solved by the invention

[0005] However, in Japanese Patent Application Laid-Open No. 2014-149696, since the user is not prompted with a reference makeup that is suitable for his / her face, the user can know the evaluation of the applied makeup, but cannot know the makeup that is suitable for his / her face. In addition, since there are individual differences in aesthetic sense (appreciation), the evaluation result of the applied makeup does not reflect the user's preference.

[0006] As described above, Japanese Patent Application Laid-Open No. 2014-149696 cannot provide a simulation result that matches (adapts to) the user's physical characteristics and reflects the user's preferences.

[0007] An object of the present invention is to present a simulation result that matches the user's physical characteristics and reflects the user's preferences.

[0008] Technical solutions to solve problems

[0009] A technical solution of the present invention is an information processing device, comprising:

[0010] a unit for receiving an image of a subject to be decorated and identifying at least one evaluator ID of an evaluator different from the subject;

[0011] A unit for generating a plurality of object decorated images obtained by decorating the image;

[0012] a unit for storing a plurality of reference decorative images obtained by decorating images of a plurality of characters, a reference image score related to an evaluation made by an evaluator on each reference decorative image, and an evaluator ID of an evaluator who has evaluated the reference decorative image in association with each other;

[0013] means for calculating a target image score related to evaluation of each target decorative image based on a reference image score associated with the received evaluator ID among the plurality of reference image scores; and

[0014] A unit for presenting at least one object decoration image among the plurality of object decoration images, the object image score of which satisfies a predetermined condition.

[0015] Effects of the Invention

[0016] According to the present invention, it is possible to present a simulation result that matches the user's physical characteristics and reflects the user's preferences. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 It is a block diagram showing the configuration of the information processing system according to the present embodiment.

[0018] Figure 2 This is an explanatory diagram of the outline of this embodiment.

[0019] Figure 3 It is a diagram showing the data structure of the user information database according to the present embodiment.

[0020] Figure 4 It is a diagram showing the data structure of a makeup pattern information database according to the present embodiment.

[0021] Figure 5 It is a diagram showing the data structure of the evaluator information database according to the present embodiment.

[0022] Figure 6 It is a diagram showing the data structure of the reference image information database according to the present embodiment.

[0023] Figure 7 This is a timing chart of the makeup simulation process according to this embodiment.

[0024] Figure 8 It means in Figure 7 This figure shows an example of a screen displayed during information processing.

[0025] Fig. 9 1 is a diagram showing the data structure of the image generation log information database according to Modification 1.

[0026] Fig.10 This is a timing chart of the makeup simulation process of Modification Example 1.

[0027] Fig.11 It means in Fig.10 This figure shows an example of a screen displayed during information processing.

[0028] Fig.12 This is a timing chart of the evaluator feedback process according to Modification 1.

[0029] Fig.13 It means in Fig.12 This figure shows an example of a screen displayed during information processing.

[0030] Fig.14 This is a diagram showing an example of a screen displayed during information processing according to Modification Example 2.

[0031] Fig.15 This is a diagram showing the data structure of the image generation log information database according to Modification 3.

[0032] Fig.16 This is a diagram showing an example of a screen displayed during information processing according to Modification 3.

[0033] Fig.17 This is a diagram showing the data structure of a candidate comment information database according to Modification 4.

[0034] Fig.18 It is a diagram showing the data structure of the reference review information database according to Modification 4.

[0035] Fig.19 This is a timing chart of the makeup simulation processing of Modification Example 4.

[0036] Fig. 20 It means in Fig.19 This figure shows an example of a screen displayed during information processing. DETAILED DESCRIPTION

[0037] Hereinafter, one embodiment of the present invention will be described in detail based on the drawings. In the drawings for describing the embodiments, the same components are denoted by the same reference numerals in principle, and their repeated descriptions are omitted.

[0038] (1) Composition of information processing system

[0039] The configuration of the information processing system will be described. Figure 1 It is a block diagram showing the configuration of the information processing system according to the present embodiment.

[0040] like Figure 1 As shown, the information processing system 1 includes a client device 10 and a server 30 .

[0041] The client device 10 and the server 30 are connected via a network (eg, the Internet or a local area network) NW.

[0042] The client device 10 is an example of an information processing device that sends a request to the server 30. The client device 10 is, for example, a smartphone, a tablet terminal, or a personal computer.

[0043] The server 30 is an example of an information processing device that provides the client device 10 with a response corresponding to a request transmitted from the client device 10. The server 30 is, for example, a Web server.

[0044] (1-1) Configuration of client device

[0045] The configuration of the client device 10 will be described.

[0046] like Figure 1 As shown, the client device 10 includes a storage device 11 , a processor 12 , an input / output interface 13 , and a communication interface 14 .

[0047] The storage device 11 is configured to store programs and data. The storage device 11 is, for example, a combination of a ROM (Read Only Memory), a RAM (Random Access Memory), and a storage (for example, a flash memory or a hard disk).

[0048] The program includes, for example, the following programs.

[0049] OS (Operating System) programs

[0050] Programs that execute information processing applications (such as web browsers)

[0051] The data includes, for example, the following data.

[0052] · Databases referenced in information processing

[0053] Data obtained by executing information processing (that is, the results of executing information processing)

[0054] The processor 12 is configured to realize the functions of the client device 10 by activating a program stored in the storage device 11. The processor 12 is an example of a computer.

[0055] The input / output interface 13 is configured to obtain a user's instruction from an input device connected to the client apparatus 10 and output information to an output device connected to the client apparatus 10 .

[0056] The input device is, for example, a keyboard, a pointing device, a touch panel, or a combination thereof.

[0057] An output device is, for example, a display.

[0058] The communication interface 14 is configured to control communication between the client device 10 and the server 30 .

[0059] (1-2) Server Configuration

[0060] The configuration of the server 30 will be described.

[0061] like Figure 1 As shown, the server 30 includes a storage device 31 , a processor 32 , an input / output interface 33 , and a communication interface 34 .

[0062] The storage device 31 is configured to store programs and data. The storage device 31 is, for example, a combination of a ROM, a RAM, and a storage (for example, a flash memory or a hard disk).

[0063] The program includes, for example, the following programs.

[0064] ·OS program

[0065] · Programs that execute information processing applications

[0066] The data includes, for example, the following data.

[0067] · Databases referenced in information processing

[0068] ·The results of information processing

[0069] The processor 32 is configured to realize the functions of the server 30 by activating the program stored in the storage device 31. The processor 32 is an example of a computer.

[0070] The input / output interface 33 is configured to obtain a user's instruction from an input device connected to the server 30 and output information to an output device connected to the server 30 .

[0071] The input device is, for example, a keyboard, a pointing device, a touch panel, or a combination thereof.

[0072] An output device is, for example, a display.

[0073] The communication interface 34 is configured to control communication between the server 30 and the client device 10 .

[0074] (2) Overview of Implementation Methods

[0075] The outline of this embodiment will be described. Figure 2 This is an explanatory diagram of the outline of this embodiment.

[0076] like Figure 2 As shown, the server 30 receives, via the client device 10 , an image of a subject person to be decorated and at least one evaluator ID for identifying an evaluator different from the subject person.

[0077] The server 30 generates a plurality of object decoration images obtained by decorating the image of the object person.

[0078] The server 30 stores a plurality of reference decorative images obtained by decorating images of a plurality of characters, reference image scores related to evaluations of the reference decorative images by evaluators, and evaluator IDs of the evaluators who evaluated the reference decorative images in association with each other.

[0079] The server 30 calculates a target image score related to the evaluation of each target decorative image based on the reference image score associated with the accepted evaluator ID among the plurality of reference image scores.

[0080] The server 30 presents at least one object decoration image whose object image score satisfies a predetermined condition among a plurality of object decoration images via the client device 10 .

[0081] According to the present embodiment, it is possible to present a simulation result that matches the user's physical characteristics and reflects the user's preferences.

[0082] (3) Database

[0083] The database of this embodiment is described. The following database is stored in the storage device 31.

[0084] (3-1) User Information Database

[0085] The user information database of this embodiment is described. Figure 3 It is a diagram showing the data structure of the user information database according to the present embodiment.

[0086] Figure 3 The user information database stores user information related to the user.

[0087] The user information database includes a "user ID" field, a "user name" field, and a "user attribute" field. Each field is associated with each other.

[0088] The user ID is stored in the "user ID" field. The user ID is an example of user identification information for identifying the user.

[0089] Information (eg, text) related to the user name is stored in the "User Name" field.

[0090] User attribute information related to the attributes of the user is stored in the "user attribute" field. The "user attribute" field includes a plurality of subfields (a "gender" field and an "age" field).

[0091] Information related to the user's gender is stored in the "Gender" field.

[0092] Information related to the age of the user is stored in the "age" field.

[0093] (3-2) Makeup pattern information database

[0094] The makeup pattern information database according to the present embodiment will be described. Figure 4 : is a diagram showing the data structure of the makeup pattern information database according to the present embodiment.

[0095] Figure 4 The makeup pattern information database stores makeup pattern information related to the makeup pattern used to generate a simulated image of makeup. The makeup pattern information database includes a "makeup pattern ID" field, a "makeup pattern image" field, a "makeup style (taste)" field, a "subject gender" field, a "subject age" field, and a "cosmetic information" field. Each field is associated with each other.

[0096] The makeup pattern ID is stored in the “makeup pattern ID” field. The makeup pattern ID is an example of makeup pattern identification information for identifying a makeup pattern.

[0097] The "makeup pattern image" field stores makeup pattern image data. The makeup pattern image data is referred to in order to generate a makeup simulation image.

[0098] The “makeup style” field stores information related to the style of the makeup mode.

[0099] The “subject gender” field stores information on the gender of the subject of the makeup mode.

[0100] The “subject age” field stores information on the subject age of the makeup pattern.

[0101] The “cosmetics information” field stores information related to cosmetics used to perform makeup associated with the makeup pattern image (eg, text including the name of the cosmetics).

[0102] (3-3) Evaluator Information Database

[0103] The evaluator information database according to the present embodiment will be described. Figure 5 It is a diagram showing the data structure of the evaluator information database according to the present embodiment.

[0104] Figure 5The evaluator information database stores the evaluator information related to the evaluator. The evaluator information database includes an "evaluator ID" field, an "evaluator name" field, and an "evaluator attribute" field. Each field is associated with each other. The evaluator includes, for example, at least one of the following.

[0105] ·Professionals who apply makeup (hereinafter referred to as "makeup artists")

[0106] · People other than makeup professionals (e.g. ordinary consumers)

[0107] The "evaluator ID" field stores an evaluator ID. The evaluator ID is an example of evaluator identification information for identifying an evaluator.

[0108] The “evaluator name” field stores information (eg, text) related to the evaluator name.

[0109] The "evaluator attribute" field stores the evaluator attribute information related to the attributes of the evaluator. The "evaluator attribute" field includes a plurality of subfields (a "gender" field, an "age" field, and a "skill" field).

[0110] The “gender” field stores information related to the gender of the evaluator.

[0111] The "age" field stores information on the age of the evaluator.

[0112] The "skill" field stores information related to the evaluator's makeup skills. For example, "makeup artist" means having professional-level makeup skills. "Ordinary" means having ordinary consumer-level skills.

[0113] (3-4) Reference image information database

[0114] The reference image information database according to this embodiment will be described. Figure 6 It is a diagram showing the data structure of the reference image information database according to the present embodiment.

[0115] Figure 6 The reference image information database stores reference image information related to the evaluation of the reference makeup image. The reference image information database includes a "reference image ID" field, a "reference bare face image" field, a "reference makeup image" field, and a "reference image score" field. Each field is associated with each other.

[0116] The reference image information database is associated with the evaluator ID.

[0117] The reference image ID is stored in the "reference image ID" field.

[0118] The "reference plain-face image" field stores image data of a person's plain-face image. The "reference plain-face image" field of one record contains a plain-face image of one person.

[0119] The "reference makeup image" field stores image data of a reference makeup image obtained by applying makeup to a person's natural face. The image data of the reference makeup image may be obtained by actually applying makeup to a person's natural face, or may be generated by makeup simulation.

[0120] The “reference image score” field stores information (eg, score) related to the evaluation made by the evaluator on the reference makeup image.

[0121] (4) Information processing

[0122] The information processing in this embodiment is described. Figure 7 This is a timing chart of the makeup simulation process according to this embodiment. Figure 8 It means in Figure 7 Figure 2 is an example of a screen displayed during information processing.

[0123] The user of the client device 10 is a subject of makeup simulation.

[0124] like Figure 7 As shown, the client device 10 receives the simulation condition ( S100 ).

[0125] Specifically, the processor 12 displays the screen P100 ( Figure 8 ) is displayed on the monitor.

[0126] The screen P100 includes field objects F100a to F100b and an operation object B100.

[0127] The field object F100a is an object for accepting a user's instruction for designating an image of a subject person's plain face who is a target of makeup simulation (hereinafter referred to as a “target plain face image”).

[0128] The field object F100b is an object for accepting a user's instruction for specifying an evaluator of makeup simulation.

[0129] The operation object B100 is an object that receives a user instruction for transmitting the user instruction input into the field objects F100 a to F100 b to the server 30 .

[0130] After step S100 , the client device 10 executes a simulation request ( S101 ).

[0131] Specifically, when the user specifies the image data of his or her own bare-face image in field object F100a, enters the evaluator information (such as the evaluator's name or the evaluator's attributes) of at least one evaluator in the makeup simulation in field object F100b, and operates the operation object B100, the processor 12 sends the simulation request data to the server 30.

[0132] The simulation request data contains the following information.

[0133] ・The user ID of the target person (hereinafter referred to as "target user ID")

[0134] Image data of the target plain image specified in the field object F100a

[0135] · Evaluator information specified in field object F100b

[0136] After step S101 , the server 30 generates a target makeup image ( S300 ).

[0137] Specifically, the processor 32 refers to the makeup mode information database ( Figure 4 ), each makeup mode image is overlapped with the object bare face image, and an object makeup image corresponding to each makeup mode image is generated.

[0138] After step S300 , the server 30 performs determination of a prompt image ( S301 ).

[0139] Specifically, the processor 32 refers to the evaluator information database ( Figure 5 ), determine at least one evaluator ID associated with the evaluator information included in the simulation request data.

[0140] The processor 32 references the image information database ( Figure 6 ) is referenced to determine the image data and reference image score of the reference makeup image associated with the evaluator ID.

[0141] The processor 32 calculates the target image score corresponding to each target makeup image generated in step S300. As an example, the processor 32 calculates the target image score S1 by applying the target makeup image to the calculation model G1(x) stored in the storage device 31. The calculation model G1(x) is a function including all the determined reference makeup images and the reference image score associated with each reference makeup image as parameters.

[0142] S1=G1(x)…(Formula 1)

[0143] S1: Object image score

[0144] G1(x): Computational model

[0145] x = object makeup image

[0146] That is, one target makeup image is compared with all the determined reference makeup images, and a target image score of the target makeup image is calculated based on the scores of the reference images. The target image score is calculated for all the target makeup images generated in step S300.

[0147] Processor 32 determines at least one target makeup image of the plurality of target makeup images generated in step S300 whose target image score calculated in the above manner satisfies a predetermined condition as a presentation image to be presented to the user. The predetermined condition may be any of the following conditions.

[0148] The target image score is equal to or higher than a predetermined value

[0149] The object image score falls within a predetermined ranking

[0150] After step S301, the server 30 performs a simulation response (S302).

[0151] Specifically, the processor 32 sends the simulation response data to the client device 10 .

[0152] The simulation response data contains the following information.

[0153] Image data of the target makeup image determined in step S301

[0154] After step S302 , the client device 10 performs presentation of simulation results ( S102 ).

[0155] Specifically, the processor 12 displays the screen P101 ( Figure 8 ) is displayed on the monitor.

[0156] The screen P101 includes a display object A101.

[0157] The display object A101 includes a target makeup image corresponding to the image data included in the simulation response data (that is, a target makeup image whose target image score satisfies a predetermined condition).

[0158] According to this embodiment, by inputting one's own plain face image and desired evaluator information, a simulation result that matches the subject's physical features (facial features) and reflects the evaluator's sensitivity can be presented. Since the evaluator is specified by the user, the simulation result will reflect the user's preferences.

[0159] In particular, by designating a specific makeup artist as an evaluator, it is possible to present a simulation result that brings out the personality of the makeup artist.

[0160] In addition, for users who are sensitive to fashion trends, by including ordinary people as evaluators, simulation results reflecting fashion trends can be presented.

[0161] (5) Modification

[0162] Modifications of this embodiment will be described.

[0163] (5-1) Modification 1

[0164] Modification 1 is described. Modification 1 is an example in which the designation of a reference image score for a generated target makeup image is accepted from an evaluator. Here, an example in which the designation of a reference image score for a presented target makeup image is also accepted from a subject person (user).

[0165] (5-1-1) Image generation log information database

[0166] The image generation log information database according to Modification 1 will be described. Fig. 9 1 is a diagram showing the data structure of the image generation log information database according to Modification 1.

[0167] Fig. 9 The image generation log information database stores the image generation log information related to the history of the execution result of generating the object makeup image. The image generation log information database includes an "image generation log ID" field, a "object bare face image" field, a "object makeup image" field, and a "reference image score" field. Each field is associated with each other.

[0168] The image generation log information database is associated with the user ID.

[0169] The image generation log ID for identifying the image generation log information is stored in the "image generation log ID" field. The image generation log ID is an example of image generation log identification information for identifying the image generation log.

[0170] The “target plain face image” field stores image data of the target plain face image.

[0171] The “target makeup image” field stores image data of the target makeup image.

[0172] The “reference image score” field stores information (eg, score) related to the evaluation made by the user on the target makeup image.

[0173] (5-1-2) Information Processing

[0174] The information processing of Modification 1 is described.

[0175] (5-1-2-1) Makeup simulation processing

[0176] The makeup simulation process according to Modification 1 will be described. Fig.10 This is a timing chart of the makeup simulation process of Modification Example 1. Fig.11 It means in Fig.10 Figure 2 is an example of a screen displayed during information processing.

[0177] Fig.10 The user of the client device 10 is the subject of the makeup simulation.

[0178] like Fig.10 As shown, Figure 7 Likewise, the client device 10 executes steps S100 to S101 .

[0179] After step S101, Figure 7 Likewise, the server 30 executes step S300.

[0180] After step S300 , the server 30 executes updating of the database ( S311 ).

[0181] Specifically, the processor 32 generates an image generation log information database ( Fig. 9 ) and store the following information in each field of the new record.

[0182] The new image generation log ID is stored in the "Image Generation Log ID" field.

[0183] The “target plain face image” field stores image data of the target plain face image included in the simulation request data.

[0184] The “target makeup image” field stores the image data of the target makeup image generated in step S300 .

[0185] After step S311, Figure 7 Likewise, the server 30 executes step S301.

[0186] After step S301, the server 30 performs a simulation response (S312).

[0187] Specifically, the processor 32 sends the simulation response data to the client device 10 .

[0188] The simulation response data contains the following information.

[0189] Image data of the target makeup image determined in step S301

[0190] The image generation log ID of the target makeup image determined in step S301

[0191] After step S312 , the client device 10 performs presentation of simulation results ( S112 ).

[0192] Specifically, the processor 12 displays the screen P201 ( Fig.11 ) is displayed on the monitor.

[0193] The screen P201 includes one or more display objects A201, one or more field objects F201, and an operation object B201. The number of display objects A201 and field objects F201 is the same as the number of target makeup images determined in step S301. For example, when there are two target makeup images, the screen P201 includes two display objects A201 (A201a, A201b) and two field objects F201 (F201a, F201b).

[0194] Each display object A201 includes a target makeup image corresponding to the image data included in the simulation response data (that is, a target makeup image whose target image score satisfies a predetermined condition). Each display object A201 is a simulation result.

[0195] Each field object F201 is an object for accepting designation of a reference image score related to the evaluation of the target makeup image by the user.

[0196] The operation object B201 is an object that accepts a user instruction for transmitting the user instruction input into the field object F201 to the server 30 .

[0197] After step S112 , the client device 10 executes a feedback request ( S113 ).

[0198] Specifically, when the user inputs the evaluation score (reference image score) for the target makeup image displayed by the display object A201 into the field object F201 and operates the operation object B201 , the processor 12 transmits feedback request data to the server 30 .

[0199] The feedback request data contains the following information.

[0200] ·Target user ID

[0201] Reference image score

[0202] Image generation log ID

[0203] After step S113, the server 30 executes updating of the database (S313).

[0204] Specifically, the processor 32 generates an image generation log information database ( Fig. 9 ) stores the reference image score included in the feedback request data.

[0205] (5-1-2-2) Processing of evaluator feedback

[0206] The evaluator feedback process according to Modification 1 will be described. Fig.12 This is a timing chart of the evaluator feedback process according to Modification 1. Fig.13 It means in Fig.12 Figure 2 is an example of a screen displayed during information processing.

[0207] Fig.12 The user of the client device 10 is the evaluator.

[0208] The client device 10 receives the evaluator registration information ( S120 ).

[0209] Specifically, the processor 12 displays the screen P300 ( Fig.13 ) is displayed on the monitor.

[0210] The screen P300 includes a field object F300 and an operation object B300.

[0211] The field object F300 is an object that receives a user instruction for specifying an evaluator ID.

[0212] The operation object B300 is an object that receives a user instruction for transmitting the user instruction input into the field object F300 to the server 30 .

[0213] After step S120 , the client device 10 executes an update request ( S121 ).

[0214] Specifically, when the evaluator inputs his / her evaluator ID in the field object F300 and operates the operation object B300 , the processor 12 sends the update request data to the server 30 .

[0215] The update request data contains the following information.

[0216] · The evaluator's evaluator ID

[0217] In addition, the evaluator may be an evaluator designated by the user in step S100 or an evaluator not designated by the user in step S100 .

[0218] After step S121 , the server 30 performs prompting of a new image ( S320 ).

[0219] Specifically, the processor 32 generates a log information database based on the image ( Fig. 9 ) and the reference image information database ( Figure 6 ), determine the makeup image of the object that the evaluator has not evaluated. The processor 32 generates a log information database ( Fig. 9 ) and sends the evaluation request data to the client device 10.

[0220] Evaluation request data contains the following information.

[0221] Image generation log ID

[0222] ・Image data of the target plain image

[0223] ·Image data of the makeup image of the subject

[0224] The object makeup images that have not yet been evaluated by the evaluator may include the object makeup images prompted in step S112 (that is, the object makeup images whose object image scores calculated in step S301 meet the predetermined conditions) and the object makeup images that were not prompted in step S112 (that is, the object makeup images whose object image scores calculated in step S301 do not meet the predetermined conditions).

[0225] After step S320 , the client device 10 receives a reference image score ( S122 ).

[0226] Specifically, the processor 12 displays the screen P301 ( Fig.13 ) is displayed on the monitor.

[0227] The screen P301 includes one or more display objects A301, one or more field objects F301, and an operation object B301. The number of display objects A301 and field objects F301 is the same as the number of target makeup images determined in step S320. For example, when there are three target makeup images, the screen P301 includes three display objects A301 (A301a, A301b, A301c) and three field objects F301 (F301a, F301b, F301c).

[0228] Each display object A301 includes a target makeup image corresponding to the image data included in the evaluation request data (that is, a target makeup image that has not yet been evaluated by the evaluator). Each display object A301 may further include a corresponding target plain makeup image.

[0229] Each field object F301 is an object for accepting designation of a reference image score related to an evaluation of a target makeup image by an evaluator.

[0230] The operation object B301 is an object that accepts a user instruction for transmitting the user instruction input into the field object F301 to the server 30 .

[0231] After step S122 , the client device 10 executes a feedback request ( S123 ).

[0232] Specifically, when the evaluator inputs the evaluation score (reference image score) for the target makeup image displayed by the display object A301 into the field object F301 and operates the operation object B301 , the processor 12 transmits feedback request data to the server 30 .

[0233] The feedback request data contains the following information.

[0234] Reviewer ID

[0235] Reference image score

[0236] Image generation log ID

[0237] After step S123, the server 30 executes updating of the database (S321).

[0238] Specifically, the processor 32 generates a reference image information database ( Figure 6 ) and store the following information in each field of the new record.

[0239] The image generation log ID included in the feedback request data is stored in the “reference image ID” field.

[0240] The “reference plain-face image” field stores image data of the target plain-face image associated with the image generation log ID.

[0241] The “reference makeup image” field stores image data of a target makeup image associated with the image generation log ID.

[0242] The reference image score included in the feedback request data is stored in the "reference image score" field.

[0243] Thus, in variation 1, the reference image score from the evaluator for the target makeup image generated in step S300 is stored. Thus, in the next simulation and thereafter, the target image score is calculated taking into account the content of the feedback from the evaluator, thereby providing a simulation result that better utilizes the evaluator's unique appreciation (personality).

[0244] In addition, in the first variation, the reference image score from the user for the target makeup image presented in step S112 is stored. Thus, in the next simulation and thereafter, by including the user as the evaluator specified in step S100, the target image score is calculated in consideration of the content of the feedback from the user, and thus a simulation result that better reflects the user's preferences can be presented.

[0245] (5-2) Modification 2

[0246] Modification 2 will be described. Modification 2 is an example of generating a target makeup image reflecting generation conditions (user attributes, user requirements, etc.) specified by the user.

[0247] (5-2-1) Information Processing

[0248] The information processing of Modification 2 is described. Fig.14 This is a diagram showing an example of a screen displayed during information processing in Modification Example 2.

[0249] Regarding Modification 2, Figure 7 In step S100, the processor 12 displays the screen P400 ( Fig.14 ) is displayed on the monitor.

[0250] The screen P400 includes field objects F400a to F400d and an operation object B400.

[0251] The field object F400a is an object for accepting a user's instruction for designating a target plain-faced image.

[0252] The field object F400b is an object for accepting a user's instruction for specifying an evaluator of makeup simulation.

[0253] The field object F400c is an object for accepting a user's instruction for designating a makeup style in makeup simulation.

[0254] The field object F400d is an object for accepting a user instruction for specifying whether or not to reflect the user attribute in the makeup simulation.

[0255] The operation object B400 is an object that receives a user instruction for transmitting a user instruction input into the field objects F400 a to F400 d to the server 30 .

[0256] After step S100 , the client device 10 executes a simulation request ( S101 ).

[0257] Specifically, when the user specifies the image data of his or her own bare-face image in field object F400a, enters the evaluator information (for example, the evaluator's name or the evaluator's attributes) of at least one evaluator in the makeup simulation in field object F400b, enters the makeup style in the makeup simulation in field object F400c, enters whether the user attributes should be reflected in the makeup simulation in field object F400d, and operates the operation object B400, the processor 12 sends the simulation request data to the server 30.

[0258] The simulation request data contains the following information.

[0259] ·Target user ID

[0260] Image data of the target plain image specified in the field object F400a

[0261] · Evaluator information specified in field object F400b

[0262] Information about the makeup style specified in field object F400c

[0263] Whether to reflect information related to user attributes specified in field object F400d

[0264] After step S101 , the server 30 generates a target makeup image ( S300 ).

[0265] Specifically, the processor 32 refers to the user information database ( Figure 3 ) to determine the user attributes (gender and age) associated with the target user ID contained in the simulation request data.

[0266] The processor 32 refers to the makeup mode information database ( Figure 4 ), determine multiple makeup pattern images that match the determined user attributes and the information related to the makeup style contained in the simulation request data.

[0267] The processor 32 superimposes each determined makeup pattern image on the target plain face image to generate a target makeup image corresponding to each makeup pattern image.

[0268] After step S300, Figure 7 Likewise, the server 30 executes steps S301 to S302.

[0269] After step S302, Figure 7 Likewise, the client device 10 executes step S102 .

[0270] Thus, in Modification 2, a target makeup image reflecting the generation conditions (user attributes and user requirements, etc.) specified by the user is generated. Therefore, a simulation result that matches the user's attributes and preferences, etc. can be presented to the user.

[0271] (5-3) Modification 3

[0272] Modification 3 will be described. Modification 3 is an example in which cosmetics information on cosmetics corresponding to the presented target makeup image is presented.

[0273] (5-3-1) Image generation log information database

[0274] The image generation log information database according to Modification 3 will be described. Fig.15 This is a diagram showing the data structure of the image generation log information database according to Modification 3.

[0275] Fig.15 The image generation log information database stores the image generation log information related to the history of the execution result of generating the object makeup image. The image generation log information database includes an "image generation log ID" field, a "object bare face image" field, a "object makeup image" field, and a "cosmetics information" field. Each field is associated with each other.

[0276] The image generation log information database is associated with the user ID.

[0277] The "Image Generation Log ID" field, the "Subject Without Makeup Image" field, and the "Subject With Makeup Image" field are Fig. 9 The instructions are the same.

[0278] The “cosmetics information” field stores information on cosmetics associated with the makeup pattern image used for simulation (eg, text including the name of the cosmetics).

[0279] (5-3-2) Information Processing

[0280] The information processing of Modification 3 is described. Fig.16 This is a diagram showing an example of a screen displayed during information processing in Modification Example 3.

[0281] and Figure 7 Likewise, the client device 10 executes steps S100 to S101 .

[0282] After step S101 , the server 30 generates a target makeup image ( S300 ).

[0283] Specifically, the processor 32 refers to the makeup mode information database ( Figure 4), each makeup mode image is overlapped with the object bare face image, and an object makeup image corresponding to each makeup mode image is generated.

[0284] The processor 32 generates a log information database ( Fig.15 ) and store the following information in each field of the new record.

[0285] The new image generation log ID is stored in the "Image Generation Log ID" field.

[0286] The “target plain face image” field stores image data of the target plain face image included in the simulation request data.

[0287] The “target makeup image” field stores the image data of the target makeup image generated in step S300 .

[0288] The “cosmetic information” field stores cosmetic information associated with the makeup pattern image corresponding to the image data of the target makeup image generated in step S300 .

[0289] After step S300 , the server 30 performs determination of a prompt image ( S301 ).

[0290] Specifically, Figure 7 Likewise, processor 32 determines at least one target makeup image of the plurality of target makeup images generated in step S300 , the target image score calculated in step S301 satisfying a predetermined condition, as a prompt image to be presented to the user.

[0291] The processor 32 generates a log information database with reference to the image ( Fig.15 ) to determine the cosmetic information corresponding to the determined object makeup image.

[0292] After step S301, the server 30 performs a simulation response (S302).

[0293] Specifically, the processor 32 sends the simulation response data to the client device 10 .

[0294] The simulation response data contains the following information.

[0295] Image data of the target makeup image determined in step S301

[0296] The cosmetic information determined in step S301

[0297] After step S302 , the client device 10 performs presentation of simulation results ( S102 ).

[0298] Specifically, the processor 12 displays the screen P501 ( Fig.16 ) is displayed on the monitor.

[0299] The screen P501 includes display objects A501a to A501b.

[0300] Display object A501a includes a target makeup image corresponding to the image data included in the simulation response data (that is, a target makeup image whose target image score satisfies a predetermined condition).

[0301] The display object A501b includes the cosmetic information included in the simulation response data.

[0302] Thus, in Modification 3, information about cosmetics corresponding to the target makeup image is presented. Thus, the user can know the cosmetics required to actually apply the makeup in the presented target makeup image. Therefore, the degree of reproduction of the makeup in the target makeup image by the user is improved.

[0303] (5-4) Modification 4

[0304] Modification 4 will be described. Modification 4 is an example in which a target comment is generated for a presented target makeup image.

[0305] (5-4-1) Candidate review information database

[0306] The candidate review information database according to Modification 4 will be described. Fig.17 This is a diagram showing the data structure of the candidate review information database according to Modification 4.

[0307] Fig.17 The candidate review information database stores candidate review information related to the comments that are candidates to be presented to the user. The candidate review information database includes a "candidate review ID" field and a "candidate comment" field.

[0308] The candidate comment ID is stored in the "Candidate Comment ID" field.

[0309] The “candidate comment” field stores information (eg, text) on comments that are candidates to be presented to the user.

[0310] (5-4-2) Refer to the review information database

[0311] The reference review information database according to Modification 4 will be described. Fig.18 It is a diagram showing the data structure of the reference review information database according to Modification 4.

[0312] Fig.18The reference review information database stores reference review information related to evaluations of reference comments. The reference review information database includes a "reference review ID" field, a "reference image ID" field, a "reference comment" field, and a "reference review score" field.

[0313] The reference image information database is associated with the evaluator ID.

[0314] The reference comment ID is stored in the "reference comment ID" field.

[0315] The reference image ID is stored in the "Reference Image ID" field ( Figure 6 ).

[0316] The “reference comment” field stores information (eg, text) related to a comment on the reference makeup image associated with the reference image ID.

[0317] In the “reference review score” field, information (eg, score) related to the evaluation made by the evaluator on the reference comment is stored.

[0318] (5-4-3) Information Processing

[0319] The information processing of Modification 4 is described. Fig.19 This is a timing chart of the makeup simulation processing of Modification Example 4. Fig. 20 It means in Fig.19 This figure shows an example of a screen displayed during information processing.

[0320] like Fig.19 As shown, Figure 7 Likewise, the client device 10 executes steps S100 to S101 .

[0321] After step S101, Figure 7 Likewise, the server 30 executes steps S300 to S301 .

[0322] After step S301, the server 30 generates a comment for the object (S332).

[0323] Specifically, the processor 32 refers to the review information database ( Fig.18 ) is referenced to determine the reference image ID, reference comment information, and reference comment score associated with the evaluator ID included in the simulation request data. The processor 32 references the image information database ( Figure 6 ) for reference, and determine the reference makeup image associated with the determined reference image ID.

[0324] The processor 32 calculates and stores the candidate review information database ( Fig.17). As an example, the processor 32 calculates the object comment score S2 by applying the candidate comment to the calculation model G2(x) stored in the storage device 31. The calculation model G2(x) is a function including all the determined reference makeup images, the object makeup image determined in step S301, the reference comments associated with each reference makeup image, and the reference comment score as parameters.

[0325] S2=G2(x)…(Formula 2)

[0326] S2: Object review score

[0327] G2(x): Computational model

[0328] x = candidate comment

[0329] That is, based on all reference makeup images associated with the reference image ID, the target makeup image determined in step S301, the reference comments, and the reference review scores, the corresponding values ​​for the candidate review information database ( Fig.17 )'s evaluation of each candidate review related to the object review score.

[0330] The processor 32 determines the candidate review information stored in the database ( Fig.17 ) among the candidate comments of the target review, the candidate comment (hereinafter referred to as the "target comment") having the highest target review score calculated in the above manner is selected as the suggested comment to be suggested to the user.

[0331] After step S332, the server 30 performs a simulation response (S333).

[0332] Specifically, the processor 32 sends the simulation response data to the client device 10 .

[0333] The simulation response data contains the following information.

[0334] Image data of the target makeup image determined in step S301

[0335] Information related to the object comment determined in step S332

[0336] After step S333 , the client device 10 performs presentation of simulation results ( S132 ).

[0337] Specifically, the processor 12 displays the screen P601 ( Fig. 20 ) is displayed on the monitor.

[0338] The screen P601 includes display objects A601a to A601b.

[0339] The display object A 601 a includes a target makeup image corresponding to the image data included in the simulation response data (that is, a target makeup image whose target image score satisfies a predetermined condition).

[0340] Display object A 601b includes information (eg, text) related to the object comment included in the simulation response data.

[0341] As described above, in Modification 4, a target comment for the presented target makeup image is presented. Therefore, the user can obtain advice information and the like related to the presented target makeup image.

[0342] In Modification 4, a target comment for the presented target makeup image is generated based on the reference review score associated with the evaluator ID specified by the user. Therefore, a target comment that matches the presented target makeup image and reflects the user's preference can be presented.

[0343] (6) Summary of this embodiment

[0344] This embodiment is briefly summarized.

[0345] A first technical solution of the present embodiment is an information processing device (for example, a server 30), comprising:

[0346] a unit (for example, the processor 32 that executes the process of step S300 ) that receives an image of a subject to be decorated and identifies at least one evaluator ID of an evaluator different from the subject;

[0347] A unit for generating a plurality of object decoration images obtained by decorating the image of the object person (for example, the processor 32 that executes the process of step S300);

[0348] A means (for example, a management evaluator information database) for storing a plurality of reference decorative images obtained by decorating images of a plurality of persons, reference image scores related to evaluations made by evaluators on each reference decorative image, and evaluator IDs of evaluators who have evaluated the reference decorative images in association with each other. Figure 5 ) of the processor 32);

[0349] a unit (for example, the processor 32 that executes the process of step S301 ) that calculates a target image score related to the evaluation of each target decorative image based on a reference image score associated with the accepted evaluator ID among a plurality of reference image scores; and

[0350] A unit (eg, the processor 32 that executes the process of step S302 ) that indicates at least one object decoration image whose object image score satisfies a predetermined condition among a plurality of object decoration images.

[0351] According to the first technical solution, it is possible to present a simulation result that matches the user's physical characteristics and reflects the user's preferences.

[0352] The second technical solution of this embodiment is an information processing device,

[0353] further comprising means for accepting designation of a reference image score for the generated target decorative image from an evaluator (for example, the processor 32 that executes the process of step S321),

[0354] The storing means stores the generated target decoration image as a reference decoration image, and stores the reference decoration image, a reference image score specified by an evaluator, and an evaluator ID of the evaluator in association with each other.

[0355] According to the second technical solution, the reference image score from the evaluator for the generated object decoration image is stored. Thus, in the next simulation, the object image score is calculated taking into account the content of the feedback from the evaluator, thereby providing a simulation result that better utilizes the unique appreciation (personality) of the evaluator.

[0356] The third technical solution of this embodiment is an information processing device,

[0357] further comprising means for accepting designation of a reference image score from a subject for the presented subject decorative image (for example, the processor 32 that executes the process of step S313),

[0358] The storage unit stores the presented object decoration image, the reference image score designated by the subject, and the subject ID for identifying the subject in association with each other.

[0359] The calculating unit calculates a target image score related to the evaluation of each target decorative image based on a reference image score associated with the received evaluator ID and a reference image score associated with the target person ID among the plurality of reference image scores.

[0360] According to the third technical solution, the reference image score from the user for the suggested object decoration image is stored. Thus, in the next simulation, by including the user as the designated evaluator, the object image score is calculated taking into account the content of the feedback from the user, thereby being able to suggest a simulation result that better reflects the user's preferences.

[0361] A fourth technical solution of this embodiment is an information processing device,

[0362] further comprising a unit for accepting generation conditions related to the target decorative image (for example, the processor 32 that executes the process of step S300),

[0363] The generating unit generates the plurality of object decoration images based on a generating condition.

[0364] According to the fourth aspect, an object decoration image is generated reflecting the generation conditions (user attributes and user requirements, etc.) specified by the user. Therefore, a simulation result that matches the user's attributes and preferences, etc. can be presented to the user.

[0365] A fifth technical solution of this embodiment is an information processing device,

[0366] Decoration is makeup for the face.

[0367] According to the fifth technical solution, regarding facial makeup, it is possible to present a simulation result that matches the user's physical features and reflects the user's preferences.

[0368] A sixth technical solution of this embodiment is an information processing device, further comprising:

[0369] A unit (eg, a management makeup pattern information database) storing cosmetic information about cosmetics corresponding to each of a plurality of object decoration images Figure 4 ) of a processor 32); and

[0370] A unit (eg, the processor 32 that executes the process of step S302 ) that presents cosmetics information about the cosmetics corresponding to the presented target decorative image.

[0371] According to the sixth technical solution, information about the cosmetics corresponding to the target decorative image is presented. Thus, the user can know the cosmetics required to actually apply the makeup in the presented target decorative image. Therefore, the degree of reproduction of the makeup in the target decorative image by the user is improved.

[0372] The seventh technical solution of this embodiment is an information processing device,

[0373] A means for generating an object comment for the presented object decorative image (for example, the processor 32 executing the process of step S332 ) is provided.

[0374] According to the seventh aspect, the object comment for the presented object decorative image is presented, so that the user can obtain advice information and the like related to the presented object decorative image.

[0375] The eighth technical solution of this embodiment is an information processing device,

[0376] The invention also includes a unit for storing a plurality of reference decorative images, a reference comment for each reference decorative image, a reference review score related to an evaluation made by an evaluator on each reference comment, and an evaluator ID of an evaluator who has evaluated the reference comment in association with each other.

[0377] The unit for generating the object comment generates the object comment for the presented object decorative image based on a reference review score associated with the received evaluator ID among the plurality of reference review scores.

[0378] According to the eighth aspect, an object comment for the presented object decorative image is generated based on the reference review score associated with the evaluator ID specified by the user. Therefore, an object comment that matches the presented object decorative image and reflects the user's preference can be presented.

[0379] A ninth technical solution of the present embodiment is a program for causing a computer (for example, the processor 32 ) to function as each of the above-mentioned means.

[0380] (7) Other Modifications

[0381] The storage device 11 may be connected to the client device 10 via the network NW. The storage device 31 may be connected to the server 30 via the network NW.

[0382] Each step of the above-mentioned information processing may be executed in either the client device 10 or the server 30 .

[0383] In this embodiment, an example of "decoration" is makeup, but this embodiment is not limited to this. As "decoration", hair styling, clothing, etc. can also be listed. In the case of hair styling, the evaluator whose information is stored in the evaluator information database includes, for example, professionals in hair styling (hair stylists, etc.). In the case of clothing, the evaluator whose information is stored in the evaluator information database includes, for example, professionals in clothing matching (fashion designers, etc.).

[0384] In this embodiment, an example is shown in which the user is the subject of makeup simulation, but this embodiment is not limited to this. The user may also be an operator who provides services to the subject (for example, a store staff of a store selling cosmetics).

[0385] In this embodiment, an example of calculating the object image score of each object makeup image based on the comparison between the object makeup image and the reference makeup image in determining the prompt image (S301) is shown, but this embodiment is not limited to this. In determining the prompt image (S301), it can also be based on the comparison between the object plain face image and the reference plain face image.

[0386] As the generation conditions in Modification Example 2, in addition to the above, for example, the following items can be listed.

[0387] · "Season" (associated with the makeup pattern ID in the makeup pattern information database ( Fig.16 ). It is possible to present the simulation results suitable for the season to the user.)

[0388] · "Scenario" (associated with the makeup pattern ID in the makeup pattern information database ( Fig.16 ). It is possible to present the simulation results suitable for the scenario to the user.)

[0389] · "Production period of the makeup pattern" (associated with the makeup pattern ID in the makeup pattern information database ( Fig.16 ). It is possible to present the simulation results reflecting the latest fashion trends to the user.)

[0390] · "Maker of the makeup pattern" (associated with the makeup pattern ID in the makeup pattern information database ( Fig.16 ). It is possible to present the simulation results that match the user's preferences to the user. The maker of the makeup pattern can be the same person as the evaluator. Additionally, it is possible to generate the target makeup image using the makeup pattern image of the "maker of the makeup pattern" that is the same as the "evaluator" input by the user into the field object F400a.)

[0391] · "Difficulty level" (associated with the makeup pattern ID in the makeup pattern information database ( Fig.16 ). It is possible to present the simulation results that match the user's makeup skills level to the user.)

[0392] · "Evaluation date" (associated with the reference image ID in the reference image information database ( Figure 6 ). By only using the reference image scores for the period specified by the user in step S301, it is possible to present the simulation results that match the fashion trends to the user.)

[0393] In Modification Example 3, an example of presenting the name of the cosmetic as the cosmetic information is shown, but the present embodiment is not limited thereto. The presented cosmetic information may also be an image of the cosmetic.

[0394] In Modification Example 4, an example where the presented comment is one determined candidate comment is shown, but the present embodiment is not limited thereto. The presented comment may also be, for example, a combination of multiple candidate comments. For example, the candidate comment information database ( Fig.17 ) includes a "candidate comment attribute" field. In step S332, one comment is determined from multiple candidate comments that match one attribute, and in step S132, a comment formed by joining the comments of each attribute is presented. As the candidate comment attributes, for example, the following items can be listed.

[0395] Comments on facial features

[0396] · Comments on the color of each part of the face

[0397] · Comments on makeup techniques

[0398] Comments on the latest fashion trends

[0399] In Modification 4, also with respect to the target comment, similarly to Modification 1, feedback on the evaluation of the target comment can be received from at least one of the evaluator and the user.

[0400] In the modification example 4, an example is shown in which the generation of the object comment (S332) is performed based on the reference review score, but the present embodiment is not limited to this. For example, the makeup mode information database ( Figure 4 ) includes a "comment" field, in step S332, the comment associated with the makeup pattern image used to generate the target makeup image determined in step S301 is determined, and in step S132, the determined comment is prompted.

[0401] The embodiments of the present invention are described in detail above, but the scope of the present invention is not limited to the above embodiments. In addition, the above embodiments can be variously improved and changed within the scope of the gist of the present invention. In addition, the above embodiments and modifications can be combined.

[0402] Description of symbols

[0403] 1 information processing system; 10 client device; 11 storage device; 12 processor; 13 input / output interface; 14 communication interface; 30 server; 31 storage device; 32 processor; 33 input / output interface; 34 communication interface.

Claims

1. An information processing device comprising: a unit for receiving an image of a subject to be decorated and identifying at least one evaluator ID of an evaluator different from the subject; A unit for generating a plurality of object decorated images obtained by decorating the image; a unit for storing, in association with a plurality of reference decorative images obtained by decorating images of a plurality of characters, a reference image score associated with an evaluation made by an evaluator on each reference decorative image, and an evaluator ID of an evaluator who has evaluated the reference decorative image; means for calculating a target image score related to evaluation of each target decorative image based on a reference image score associated with the received evaluator ID among the plurality of reference image scores; as well as A unit for presenting at least one object decoration image among the plurality of object decoration images, the object image score of which satisfies a predetermined condition.

2. The information processing device according to claim 1, further comprising means for accepting designation of a reference image score from an evaluator for the generated target decorative image, The storing unit stores the generated target decorative image as a reference decorative image, and stores the reference decorative image, the reference image score specified by the evaluator, and the evaluator ID of the evaluator in association with each other.

3. The information processing device according to claim 2, further comprising means for accepting designation of a reference image score from the subject for the presented subject decorative image, The storing unit stores the presented object decorative image, the reference image score specified by the subject, and the subject ID for identifying the subject in association with each other. The calculating unit calculates a target image score related to an evaluation of each target decorative image based on a reference image score associated with the received evaluator ID and a reference image score associated with the target person ID among the plurality of reference image scores.

4. The information processing device according to any one of claims 1 to 3, further comprising means for accepting generation conditions related to the target decorative image, The generating unit generates the plurality of object decoration images based on the generating condition.

5. The information processing device according to any one of claims 1 to 4, The decoration is makeup for the face.

6. The information processing device according to claim 5, further comprising: a unit storing cosmetic information about cosmetics corresponding to each of the plurality of object decoration images; and A unit for presenting cosmetics information about cosmetics corresponding to the presented target decorative image.

7. The information processing device according to any one of claims 1 to 6, A means for generating an object comment for the presented object decorative image is provided.

8. The information processing device according to claim 7, The invention also includes a unit for storing the plurality of reference decorative images, reference comments for each reference decorative image, reference review scores related to evaluations made by evaluators for each reference comment, and evaluator IDs of evaluators who have evaluated the reference comments in association with each other. The unit for generating the object comment generates the object comment for the presented object decorative image based on a reference review score associated with the received evaluator ID among the plurality of reference review scores. 9 . A computer program product, comprising a computer program for causing a computer to function as the unit according to claim 1 .

Images