Information processing device, information processing method and information processing program

Abstract

To promote further improvement of usability for users referring to makeup of others.SOLUTION: An information processing device includes a generation part, an application part, and a provision part. The generation part generates, from face images of posters wearing prescribed makeup, makeup information for generating a face image formed by applying same makeup as the prescribed makeup to the face image. The application part applies, to a face image of a user, the makeup information generated from a face image selected by the user from the face images posted by posters satisfying prescribed conditions. The provision part provides, to the user, a content representing the face image to which the makeup information is applied by the application part and a description content of an article used for the makeup.SELECTED DRAWING: Figure 6

Description

Technical Field

[0004] , , , , , , , , , ,

[0005] , ,

[0001] The present invention relates to an information processing apparatus, an information processing method, and an information processing program.

Background Art

[0002] When considering purchasing cosmetics, it often happens that even when looking at the makeup applied to the face of another person such as a model, one cannot imagine how it would look on oneself and does not know whether it would suit oneself.

[0003] Conventionally, as a technology for meeting the desire to confirm whether the makeup applied to the face of another person suits oneself, a technology for assisting makeup by referring to the makeup of another person is known. For example, a technology for presenting the makeup information of another person in association with the area of the user's facial parts is known.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Non-Patent Documents

[0005]

Non-Patent Document 1

[0006] However, conventional technology could not, for example, allow users to try on makeup products used by others to see if they suited them before being directed to sales sites that sell those products, nor could it facilitate the activation of customer referral support by makeup contributors using performance-based compensation. Therefore, there was room for further improvement in usability for users who refer to other people's makeup.

[0007] This application was made in view of the above, and aims to promote further improvements in usability for users who refer to the makeup of others. [Means for solving the problem]

[0008] The information processing device according to the present application is characterized by comprising: a generation unit that generates makeup information for generating a face image in which the same makeup as the predetermined makeup is applied to the face image of a poster who has applied predetermined makeup; an application unit that applies the makeup information generated from a face image selected by the user from among face images posted by posters who meet predetermined conditions to the face image of the user; and a provision unit that provides the user with content including the face image to which the makeup information has been applied by the application unit and explanatory content of the items used for the makeup. [Effects of the Invention]

[0009] According to one embodiment of the system, it is possible to further improve usability for users who refer to the makeup of others. [Brief explanation of the drawing]

[0010] [Figure 1] Figure 1 shows an example of the configuration of an information processing system according to an embodiment. [Figure 2] Figure 2 shows an example of information processing according to the present invention. [Figure 3] Figure 3 is an explanatory diagram illustrating the information processing when the priority of the facial image according to the embodiment is increased. [Figure 4] Figure 4 shows an example of the configuration of a user terminal according to this embodiment. [Figure 5] Figure 5 shows an example of the configuration of a poster terminal according to this embodiment. [Figure 6] Figure 6 shows an example of the configuration of an information processing device according to the embodiment. [Figure 7] Figure 7 shows an example of a poster information storage unit according to the embodiment. [Figure 8] Figure 8 shows an example of a cosmetic information storage unit according to the embodiment. [Figure 9] Figure 9 is a flowchart showing an example of information processing according to the embodiment. [Figure 10]Figure 10 is a hardware configuration diagram showing an example of a computer that implements the functions of an information processing device. [Modes for carrying out the invention]

[0011] The following describes in detail, with reference to the drawings, the embodiments for implementing the information processing device, information processing method, and information processing program according to the present application (hereinafter referred to as "embodiments"). Note that these embodiments do not limit the information processing device, information processing method, and information processing program according to the present application. Furthermore, the same parts are denoted by the same reference numerals in each of the following embodiments, and redundant descriptions are omitted.

[0012] (Embodiment) [1. Configuration of the Information Processing System] The information processing system 1 shown in Figure 1 will now be described. As shown in Figure 1, the information processing system 1 includes a user terminal 10, a poster terminal 20, and an information processing device 100. The user terminal 10, the poster terminal 20, and the information processing device 100 are connected to each other via a predetermined communication network (network N) by wired or wireless means. Figure 1 is a diagram showing an example configuration of the information processing system 1 according to this embodiment.

[0013] User terminal 10 is an information processing device used by users who have a desire to check whether the makeup applied to another person's face suits them. Furthermore, users of user terminal 10 might be, for example, considering purchasing cosmetics. User terminal 10 can be any device as long as it can perform the processing described in the embodiment. User terminal 10 may also be a smartphone, tablet, notebook PC, desktop PC, mobile phone, PDA, or other device. Figure 2 shows the case where user terminal 10 is a smartphone.

[0014] The user terminal 10 is a smart device such as a smartphone or a tablet, and is a portable terminal device that can communicate with any server device via a wireless communication network such as 3G to 5G (Generation) or LTE (Long Term Evolution). Further, the user terminal 10 has a screen such as a liquid crystal display and has a screen with a touch panel function, and may receive various operations on display data such as content, such as a tap operation, a slide operation, and a scroll operation, by a finger or a stylus from the user. In FIG. 2, the user terminal 10 is used by the user U11.

[0015] The contributor terminal 20 is an information processing device used by a contributor who provides a face image with makeup. Further, the contributor who uses the contributor terminal 20 is, for example, one who posts a face image with makeup completed by applying makeup from the state of the natural face before makeup. The contributor terminal 20 may be any device as long as it can realize the processing in the embodiment. Further, the contributor terminal 20 may be a device such as a smartphone, a tablet-type terminal, a notebook PC, a desktop PC, a mobile phone, or a PDA. In FIG. 2, the case where the contributor terminal 20 is a smartphone is shown.

[0016] The contributor terminal 20 is a smart device such as a smartphone or a tablet, and is a portable terminal device that can communicate with any server device via a wireless communication network such as 3G to 5G or LTE. Further, the contributor terminal 20 has a screen such as a liquid crystal display and has a screen with a touch panel function, and may receive various operations on display data such as content, such as a tap operation, a slide operation, and a scroll operation, by a finger or a stylus from the contributor. In FIG. 2, the contributor terminal 20 is used by the contributors P11 and P12. Note that the contributor terminal 201 and the contributor terminal 2 can be respectively the contributor terminals 20 of the contributors P11 and P12.

[0017] The information processing device 100 is an information processing device aimed at promoting further usability improvements for users who refer to the makeup of others, and may be any device as long as it can realize the processing in the embodiment. The information processing device 100 can be realized by, for example, a server device or a cloud system. For example, the information processing device 100 can be realized by a server device or a cloud system that provides a predetermined online shopping mall for selling cosmetics.

[0018] [2. An example of information processing] Figure 2 shows an example of information processing in the information processing system 1 according to the embodiment. In the following embodiment, the processing to respond to the desire of user U11 to check whether or not the makeup of poster P11 suits her will be explained as an example.

[0019] The information processing device 100 acquires information on a face image selected by user U11 from among face images posted by posters such as celebrities, also known as influencers, whose number of followers exceeds a predetermined threshold on a Social Networking Service (SNS) (step S101). Note that the face images that user U11 can select may include multiple face images posted by a single poster. In Figure 2, this includes face image IM11 posted by poster P11, face image IM12 posted by poster P12, etc. The following explanation assumes that user U11 has selected face image IM11 from content CT11. Note that the face images displayed in content CT11 may be selected based on any criteria. For example, face images posted by posters that user U11 follows may be selected preferentially. Content CT11 is content on a predetermined service that manages posters' face images.

[0020] Face image IM11 is a picture of poster P11's face after applying a predetermined makeup. Face image IM21 is a picture of poster P11's face before applying the makeup shown in face image IM11. Face image IM21 may be displayed in content CT11 along with face image IM11, or it may be displayed through an action on face image IM11 (e.g., clicking or tapping). Face image IM21 does not have to be displayed to the user. This allows posters to avoid showing their bare face to users, thus improving usability for posters. Face image IM12 is a picture of poster P12's face after applying a predetermined makeup. Face image IM22 is a picture of poster P12's face before applying the makeup shown in face image IM12. Face image IM22 may be displayed in content CT11 along with face image IM12, or it may be displayed through an action on face image IM12. Face image IM22 does not have to be displayed to the user.

[0021] Here, as an example of a method for generating makeup information, one example is the PSGAN (Pose and Expression Robust Spatial-Aware Generative Adversarial Network) disclosed in Non-Patent Literature 1, which is a method for transferring only the makeup information from one face image to another (Non-Patent Literature 1). This method uses deep learning and can transfer only the makeup information to another face regardless of facial expression or pose. The information processing device 100 uses a method such as PSGAN to generate makeup information for generating a face image in which the same makeup as that used on the face image IM11 selected by user U11 is applied to the face image IM1 of user U11 (step S102). Then, the information processing device 100 uses a method such as PSGAN to apply the makeup information generated in step S102 to the face image IM1 of user U11 (step S103). At this time, the method by which the face image IM1 was acquired does not matter. The facial image IM1 may, for example, be one that user U11 has registered in advance and stored in an external information processing device or the device itself, or it may be one that has been transmitted from the user terminal 10. Furthermore, the facial image IM1 may be one that user U11 has selected as the target for application, or it may be one that has been automatically selected as the target for application. The facial image IM2 is the facial image after applying the image to facial image IM1.

[0022] In step S103, the information processing device 100 transmits information to the user terminal 10 for displaying content that includes a facial image IM2 of user U11 to which makeup information has been applied, and explanatory content for the cosmetics (corresponding to items) used for the makeup (step S104). The user terminal 10 then displays content CT1 based on the information transmitted from the information processing device 100.

[0023] Here, content CT1 includes descriptive content about the cosmetics used by poster P11 for makeup on face image IM11. For example, it includes information such as the product name and price of the cosmetics. Figure 2 shows a case where two cosmetics (PR1 and PR2) are included, such as lipstick and foundation, but the number of cosmetics is not particularly limited. For example, content CT1 may include descriptive content about the set of cosmetics used by poster P11 to transform face image IM11 from its pre-makeup state to a predetermined post-makeup state. The descriptive content may also include operation reception information B1 that accepts an operation to access a predetermined online shopping mall where the set of cosmetics used for makeup can be purchased. When operation reception information B1 accepts an operation, it may, for example, lead to a product page introducing the set of cosmetics, or to a purchase page where the set of cosmetics is added to the cart. Operation reception information B1 may be integrated with face image IM2 or other content in the descriptive content, and when an operation is accepted on face image IM2 or other content in the descriptive content, it may lead to a product page or purchase page.

[0024] The information processing device 100 determines whether user U11 has purchased cosmetics associated with the explanatory content. For example, the information processing device 100 determines whether user U11 has purchased a set or part of cosmetics, including cosmetics PR1 and cosmetics PR2, at a designated online shopping mall accessed by operating the operation reception information B1. If the information processing device 100 determines that user U11 has made a purchase, it decides to award a reward to poster P11, the poster who posted a face image using makeup corresponding to the makeup information in image IM2, in accordance with user U11's purchase. The information processing device 100 then performs the processing to award the reward to poster P11 in accordance with user U11's purchase. The information processing device 100 may also decide to transmit information for poster P11 to receive the reward for user U11's purchase. In this case, the information processing device 100 transmits information for poster P11 to receive the reward for user U11's purchase. The information processing device 100 may also decide to transfer the reward to poster P11's account. In this case, the information processing device 100 performs the process of transferring the reward to the account of poster P11.

[0025] (Processing variation 1: Display using a pre-makeup facial image) In the above embodiment, a predetermined post-makeup face image, such as face image IM11 or face image IM12, is shown in content CT11, but the example is not limited to this. For example, pre-makeup face images, such as face image IM21 or face image IM22, may be displayed in content CT11, and the post-makeup face image may be displayed by an operation on the pre-makeup face image. The information processing device 100 may then generate makeup information to be applied to the user's face image when the user U11 views and selects a post-makeup face image corresponding to the pre-makeup face image.

[0026] (Processing variation 2: Displaying makeup tutorial video) In the above embodiment, predetermined face images after makeup, such as face image IM11 and face image IM12, are displayed in content CT11, and by manipulating the face images after makeup, for example, a face image before makeup is displayed. However, the embodiment is not limited to this example. For example, by manipulating the face images after makeup, a makeup video of the makeup applied by the poster to achieve the finished look from the pre-makeup state may be displayed. The makeup video may include, for example, face images before makeup, such as face image IM21 and face image IM22, and predetermined face images after makeup, such as face image IM11 and face image IM12. The makeup video may also be displayed in content CT11 together with the face images after makeup.

[0027] (Processing variation 3: Limiting to images of the face before makeup) In the above embodiment, it was shown that the pre-makeup facial images such as facial image IM21 and facial image IM22 are images of the poster's bare face, but the example is not limited to this. For example, the pre-makeup facial images such as facial image IM21 and facial image IM22 are predetermined pre-makeup facial images such as facial image IM11 and facial image IM12, and may be facial images with some makeup applied, such as only lipstick or foundation. In this case, the information processing device 100 may generate makeup information such that the makeup information of the cosmetics used in the pre-makeup facial images such as facial image IM21 and facial image IM22 is not applied to the user's facial image, or it may generate makeup information that is applied to the user's facial image. Note that since the pre-makeup facial images such as facial image IM21 and facial image IM22 are used for learning the skeletal structure when generating makeup information, appropriate makeup information can be generated even if they are not images of the bare face. For this reason, the poster's pre-makeup facial image only needs to be registered once on a predetermined service that manages the poster's facial image. Furthermore, the explanatory content about cosmetics used in pre-makeup facial images such as facial image IM21 and facial image IM22 may or may not be included in content CT1.

[0028] (Processing variation 4: Automatic extraction of item information) In the above embodiment, the cosmetics used by poster P11 for makeup with respect to face image IM11 may, for example, be identified in advance by image analysis from face image IM11 and face image IM21, and stored in an external information processing device or the device itself, linked to face image IM11 and face image IM21. Alternatively, they may be identified based on poster P11's purchase history of cosmetics in a predetermined online shopping mall and stored linked to face image IM11 and face image IM21, or they may be identified by poster P11 selecting from a list of candidates displayed based on the purchase history of cosmetics, and stored linked to face image IM11 and face image IM21. Furthermore, they may be identified by poster P11 registering cosmetics that are not sold in a predetermined online shopping mall, and stored linked to face image IM11 and face image IM21.

[0029] (Processing variation 5: Reflects the order of makeup application) In the above embodiment, the information processing device 100 may generate makeup information that reflects the order of makeup applied by the poster P11 to the face image IM11 by identifying the order in which the makeup was applied. In this case, the information processing device 100 may identify the order of makeup by, for example, receiving input of the order of makeup from the poster P11, or, if there is a makeup video related to the face image IM11, it may identify the order of makeup from the makeup video. Alternatively, the information processing device 100 may identify the order of makeup by, for example, learning from multiple makeup videos. Furthermore, in the case of a makeup video, the information processing device 100 can generate makeup information for each type of cosmetic, and may select an applicable face image. Additionally, explanatory content that reflects the order of makeup may be included in content CT1. This allows the information processing device 100 to make appropriate suggestions, including the order of makeup.

[0030] (Processing variation 6: Prioritizing display of facial images 1) In the above embodiment, the face images displayed in content CT1 may be selected based on any criteria and displayed in any order of priority. For example, face images posted by posters followed by user U11 may be selected preferentially, or face images of posters with a large number of followers may be displayed preferentially. Alternatively, for example, face images may be selected or displayed preferentially based on user U11's face information or other physical information.

[0031] Examples of facial information include the shape, size, and arrangement of facial features, facial color and contour (shape), and eye color and size. Facial color also includes, for example, the natural skin tone. This includes, for example, the average color of the entire measurement area excluding the lips, the average color of the forehead area, the average color of the area below the left eye, the average color of the area below the right eye, the average color of the left cheek area, the average color of the right cheek area, the average color of the nose area, the average color of the upper lip, the average color of the lower lip, and the average color of the chin area. Examples of other body information besides facial information include, for example, hair (hairstyle, hair texture, hair color, accessories, etc.), skin (skin color, skin texture, wrinkles, etc.), and body shape (size of parts, overall balance).

[0032] In the above embodiment, the closer the physical information is to that of user U11, the higher the priority may be set so that the poster's face image is selected or displayed preferentially. For example, the higher the priority of the poster's face image, the more identical or similar the face and other physical information of user U11 are. Also, for example, the higher the priority of the poster's face image, the more identical or similar the age, skin age, and skin concerns of user U11 are. Also, for example, the higher the priority of the poster's face image, the more identical or similar the makeup concerns of user U11 are. Also, for example, the higher the priority of the poster's face image, the more identical or similar the hairstyle, hair color, and hair preferences of user U11 are. Also, the lower the priority may be set so that the poster's face image is not selected or displayed preferentially the more distant the physical information is from that of user U11. For example, the lower the priority of the poster's face image, the more different the balance of facial features is from that of user U11. Also, for example, the lower the priority of the poster's face image, the more different the facial contour is from that of user U11. Furthermore, for example, the more the poster's face image differs from that of user U11, the lower the priority of the poster's face image may be.

[0033] Furthermore, facial images may be preferentially selected or displayed based on indicators of their popularity, such as the access history, purchase history, and rating history of multiple users. Specifically, facial images may be preferentially selected or displayed based on the access history of multiple users who selected the facial image, the purchase history of multiple users who were directed to the content provided by selecting the facial image, the rating history of multiple users when applying makeup by selecting the facial image, and the rating history of multiple users after purchase of the facial image or purchased cosmetics. For example, the higher the indicators of the facial image's popularity, such as the access history, purchase history, and rating history of multiple users, the higher the priority of the facial image may be. Furthermore, facial images may be preferentially selected or displayed based on the total price of the set of cosmetics used by the poster for their makeup. For example, the higher the total price of the set of cosmetics used by the poster for their makeup, the higher or lower the priority of the facial image may be.

[0034] (Processing variation 7: Prioritizing display of facial images 2) In the above embodiment, the facial images of posters may be preferentially selected or displayed based on the user U11's cosmetic purchase history. For example, the more identical or similar the cosmetics owned by user U11 are to those owned by user U11, the higher the priority given to the poster's facial image. For example, if user U11's purchase history includes cosmetics PR1, PR2, and PR3, the facial images of posters who have purchased more of these cosmetics may be given higher priority. For example, the facial images of posters who have purchased cosmetics PR2 and PR3 may be given higher priority than the facial images of posters who have purchased only cosmetics PR1. Also, for example, the more identical or similar the facial images are to those owned by user U11, the higher the priority given to the facial images. For example, if user U11's purchase history includes cosmetics PR1, PR2, and PR3, the facial images of posters who have used more of these cosmetics in their makeup may be given higher priority.

[0035] Figure 3 is an explanatory diagram illustrating the information processing when a face image is given a higher priority if it is identical or similar to the cosmetics owned by user U11, based on user U11's cosmetic purchase history. Face images IM11 and IM12 are face images submitted by contributor P11, and face image IM12 is a face image submitted by contributor P12. Furthermore, the cosmetics used for makeup in face image IM11 are cosmetics PR1, cosmetics PR2, and cosmetics PR3, the cosmetics used for makeup in face image IM11 are cosmetics PR1, cosmetics PR4, and cosmetics PR5, and the cosmetics used for makeup in face image IM12 are cosmetics PR2, cosmetics PR6, cosmetics PR7, and cosmetics PR8. If user U11's purchase history includes Cosmetics PR1, Cosmetics PR2, Cosmetics PR3, and Cosmetics PR6, then the facial image IM11, which is common to Cosmetics PR1, Cosmetics PR2, and Cosmetics PR3, will have a higher priority, the facial image IM11, which is common to Cosmetics PR2 and Cosmetics PR6, will have a medium priority, and the facial image IM12, which is common to Cosmetics PR1, will have a lower priority.

[0036] (Processing variation 8: Acquisition of color information) In the above embodiment, skin color, such as complexion, may be measured using a measuring item such as ZOZOGLASS®, which can be worn by the user U11. By accurately measuring skin color with light correction, the accuracy of the makeup information generated by the information processing device 100 can be improved.

[0037] [3. User terminal configuration] Next, the configuration of the user terminal 10 according to the embodiment will be described using Figure 4. Figure 4 is a diagram showing an example of the configuration of the user terminal 10 according to the embodiment. As shown in Figure 4, the user terminal 10 has a communication unit 11, an input unit 12, an output unit 13, and a control unit 14.

[0038] (Communications Section 11) The communication unit 11 is implemented, for example, by a NIC (Network Interface Card). The communication unit 11 is connected to a predetermined network N by wire or wireless connection and sends and receives information to and from the information processing device 100, etc., via the predetermined network N.

[0039] (Input section 12) The input unit 12 receives various operations from the user. In Figure 2, it receives various operations from user U11. For example, the input unit 12 may receive various operations from the user via a touch panel display. Alternatively, the input unit 12 may receive various operations from buttons on the user terminal 10, or from a keyboard or mouse connected to the user terminal 10.

[0040] (Output section 13) The output unit 13 is a display screen for a tablet terminal or the like, implemented by, for example, a liquid crystal display or an organic EL (Electro-Luminescence) display, and is a display device for displaying various types of information. For example, the output unit 13 displays information transmitted from the information processing device 100.

[0041] (Control Unit 14) The control unit 14 is, for example, a controller, and is implemented by a CPU (Central Processing Unit) or MPU (Micro Processing Unit) executing various programs stored in the internal storage device of the user terminal 10 using RAM (Random Access Memory) as the working area. For example, these various programs include application programs installed on the user terminal 10. For example, these various programs include application programs that display content including facial images transmitted from the information processing device 100. The control unit 14 is also implemented by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

[0042] As shown in Figure 4, the control unit 14 has a receiving unit 141 and a transmitting unit 142, and realizes or executes the information processing operations described below.

[0043] (Receiver 141) The receiving unit 141 receives various information from other information processing devices such as the information processing device 100. For example, the receiving unit 141 receives information to display content that includes a user's face image with makeup similar to the makeup used by the poster in the face image selected by the user, and explanatory content about the cosmetics used for the makeup.

[0044] (Transmitter 142) The transmitting unit 142 transmits various information to other information processing devices such as the information processing device 100. For example, the transmitting unit 142 transmits information about a face image selected by the user in order to check whether the poster's makeup suits them.

[0045] [4. Configuration of the poster's device] Next, the configuration of the poster terminal 20 according to the embodiment will be described using Figure 5. Figure 5 is a diagram showing an example of the configuration of the poster terminal 20 according to the embodiment. As shown in Figure 5, the poster terminal 20 has a communication unit 21, an input unit 22, an output unit 23, and a control unit 24.

[0046] (Communications Section 21) The communication unit 21 is implemented, for example, by a NIC (Network Interface Card). The communication unit 21 is connected to a predetermined network N by wire or wireless connection and sends and receives information to and from the information processing device 100, etc., via the predetermined network N.

[0047] (Input section 22) The input unit 22 accepts various operations from the poster. In Figure 2, it accepts various operations from posters P11 and P12. For example, the input unit 22 may accept various operations from the poster via the display surface using a touch panel function. Alternatively, the input unit 22 may accept various operations from buttons provided on the poster terminal 20, or from a keyboard or mouse connected to the poster terminal 20.

[0048] (Output section 23) The output unit 23 is a display screen for a tablet terminal or the like, implemented by, for example, a liquid crystal display or an organic EL display, and is a display device for displaying various types of information. For example, the output unit 23 displays information transmitted from the information processing device 100.

[0049] (Control Unit 24) The control unit 24 is, for example, a controller, and is implemented by a CPU or MPU, etc., which executes various programs stored in the internal storage device of the poster terminal 20 using RAM as the working area. For example, these various programs include application programs installed on the poster terminal 20. For example, these various programs include application programs that transmit the poster's face image in response to the poster's operation. The control unit 14 is implemented by an integrated circuit such as an ASIC or FPGA.

[0050] As shown in Figure 5, the control unit 24 has a receiving unit 241 and a transmitting unit 242, and realizes or executes the information processing operations described below.

[0051] (Receiving unit 241) The receiving unit 241 receives various information from other information processing devices such as the information processing device 100. For example, if a user who has applied makeup to a face image provided by a poster purchases cosmetics corresponding to the applied makeup from a designated online shopping mall, the receiving unit 241 receives information regarding the reward that the poster can receive, which is determined according to the user's purchase. The receiving unit 241 may also receive information that allows the poster to receive the reward corresponding to the user's purchase.

[0052] (Transmitter 242) The transmitting unit 242 transmits various types of information to other information processing devices, such as the information processing device 100. For example, the transmitting unit 142 transmits the poster's face image in response to the poster's actions.

[0053] [5. Configuration of the Information Processing Device] Next, the configuration of the information processing device 100 according to the embodiment will be described using Figure 6. Figure 6 is a diagram showing an example of the configuration of the information processing device 100 according to the embodiment. As shown in Figure 6, the information processing device 100 has a communication unit 110, a storage unit 120, and a control unit 130. The information processing device 100 may also have an input unit (for example, a keyboard or mouse) that receives various operations from the administrator of the information processing device 100, and a display unit (for example, a liquid crystal display) for displaying various information.

[0054] (Communications Department 110) The communication unit 110 is implemented, for example, by a NIC (Network Interface Card). The communication unit 110 is connected to the network N by wire or wireless connection and sends and receives information to and from the user terminal 10, etc., via the network N.

[0055] (Storage unit 120) The storage unit 120 is implemented by, for example, semiconductor memory elements such as RAM and flash memory, or storage devices such as hard disks and optical discs. As shown in Figure 6, the storage unit 120 has a contributor information storage unit 121 and a cosmetics information storage unit 122.

[0056] The poster information storage unit 121 stores the poster's face image. Here, Figure 7 shows an example of the poster information storage unit 121 according to this embodiment. As shown in Figure 7, the poster information storage unit 121 has items such as "poster ID" and "face image".

[0057] The "Poster ID" indicates identification information used to identify the poster. The "Face Image" indicates the poster's real face image, which was registered when the poster first used the service. In the example shown in Figure 7, conceptual information such as "Face Image #11" and "Face Image #12" is shown as being stored in "Face Image," but in reality, image data etc. will be stored. In addition, "Face Image" may also store, for example, the URL where the image data is located or the file path name indicating the storage location.

[0058] In other words, Figure 7 shows an example where the face image of the poster identified by the poster "P11" is "Face Image #11".

[0059] The cosmetics information storage unit 122 stores information about the cosmetics used by the poster for their makeup. As shown in Figure 8, the cosmetics information storage unit 122 has items such as "poster ID," "face image," and "complete set of cosmetics."

[0060] "Poster ID" indicates identification information used to identify the poster. "Face Image" indicates the face image posted by the poster. In the example shown in Figure 8, conceptual information such as "Face Image #21" and "Face Image #22" is shown as being stored in "Face Image," but in reality, image data etc. will be stored. In addition, "Face Image" may also store, for example, the URL where the image data is located or the file path name indicating the storage location. "Cosmetic Set" indicates the cosmetic set used by the poster for makeup.

[0061] In other words, Figure 8 shows an example where the face image posted by poster "P11," identified by the poster, is "Face Image #21," and the set of cosmetics used by the poster for their makeup is "Product A1 (lipstick) from brand XX, Product A2 (foundation) from brand YY, ...." The type of cosmetic is indicated in parentheses.

[0062] (Control unit 130) The control unit 130 is a controller, and is implemented, for example, by a CPU or MPU executing various programs stored in the memory device inside the information processing device 100 using RAM as a working area. Alternatively, the control unit 130 is a controller and can be implemented, for example, by an integrated circuit such as an ASIC or FPGA.

[0063] As shown in Figure 6, the control unit 130 includes an acquisition unit 131, a generation unit 132, an application unit 133, a provision unit 134, and a determination unit 135, and realizes or executes the information processing operations described below. Note that the internal configuration of the control unit 130 is not limited to the configuration shown in Figure 6, and other configurations are also acceptable as long as they perform the information processing described later.

[0064] (Acquisition part 131) The acquisition unit 131 acquires various information from external information processing devices. The acquisition unit 131 also acquires various information from other information processing devices such as the user terminal 10.

[0065] The acquisition unit 131 acquires various information from the storage unit 120. The acquisition unit 131 also stores the acquired information in the storage unit 120.

[0066] The acquisition unit 131 acquires information on a face image selected by the user from among the face images posted by posters on a predetermined service.

[0067] The acquisition unit 131 acquires information about the cosmetics used by the poster for the face image selected by the user.

[0068] (Generation unit 132) The generation unit 132 generates makeup information based on the information acquired by the acquisition unit 131, using a method such as PSGAN to generate a face image in which the same makeup as the makeup used by the poster on the face image selected by the user is applied to the face image. In addition, if the order in which the makeup applied by the poster was identified for the face image selected by the user, the generation unit 132 may also generate makeup information that reflects the order of the makeup.

[0069] The generation unit 132 generates information for displaying content that includes a face image to which makeup information has been applied by the application unit 133 (described later) and cosmetic description content identified based on the information acquired by the acquisition unit 131.

[0070] (Applicable part 133) The application unit 133 generates a face image to be displayed on the user terminal 10 by applying the makeup information generated by the generation unit 132 to the face image of the user selected as the target of application.

[0071] The application unit 133 generates a face image to be displayed on the user terminal 10 by applying makeup information generated from a face image selected from among the face images that are selected or displayed with priority based on the user's face information, body information, cosmetic purchase history, etc., with priority given to those with higher priority.

[0072] The application unit 133 generates a face image to be displayed on the user terminal 10 by applying makeup information generated from a face image selected from among the face images that are selected or displayed preferentially based on a priority determined based on indicators that show the popularity of the face image, such as access history, purchase history, and evaluation history for the face image.

[0073] The application unit 133 generates a face image to be displayed on the user terminal 10 by applying makeup information generated from a face image selected from among the face images that are selected or displayed with priority based on the total price of the cosmetics used by the poster, with priority given to those with higher priority.

[0074] (Provider 134) The provisioning unit 134 transmits information generated by the generation unit 132 for displaying content to the user terminal 10. Upon receiving the information transmitted by the provisioning unit 134, the user terminal 10 displays content corresponding to the information generated by the generation unit 132.

[0075] (Decision Section 135) The decision unit 135 determines whether the user has purchased the cosmetics associated with the content provided by the provision unit 134. If it determines that the user has purchased the cosmetics, it decides to award a reward to the poster who posted the face image selected by the user, corresponding to the user's purchase. The provision unit 134 then performs the necessary processing to award the reward to the poster. The decision unit 135 may also decide to send information to the poster so that they can receive the reward. In this case, the provision unit 134 sends the information to the poster so that they can receive the reward. The decision unit 135 may also decide to transfer the reward to the poster's account. In this case, the provision unit 134 performs the necessary processing to transfer the reward to the poster's account.

[0076] [6. Information Processing Flow] Next, the information processing procedure by the information processing system 1 according to the embodiment will be explained using Figure 9. Figure 9 is a flowchart showing the information processing procedure by the information processing system 1 according to the embodiment.

[0077] As shown in Figure 9, the information processing device 100 acquires information on a face image selected by a user from among the face images posted by posters on a predetermined service (step S201).

[0078] Based on the acquired information, the information processing device 100 generates makeup information for generating a face image in which the same makeup as the makeup used by the poster in the face image selected by the user is applied to the face image (step S202).

[0079] The information processing device 100 generates a facial image to be provided to the user by applying the generated makeup information to the facial image of the user selected as the target of application (step S203).

[0080] The information processing device 100 transmits information for displaying content that includes the generated face image and explanatory content about the cosmetics used by the poster for their makeup (step S204).

[0081] [7. Variations] The information processing system 1 according to the above embodiment may be implemented in various other forms besides the embodiment described above. Therefore, other embodiments of the information processing system 1 will be described below.

[0082] In the above embodiment, the user's face image after applying the makeup information is shown to be displayed on the user terminal 10, but the example is not limited to this. For example, it may be displayed on the terminal device of another person communicating with the user online. For example, if a user selects a poster's face image in order to participate in an online meeting, the makeup related to the selected face image may be virtually applied to the user's face participating in the meeting online, and the face image with the makeup related to the selected face image applied may be displayed on the terminal device of another person. When a user participates in a meeting using the poster's makeup, the user may be charged according to usage status such as usage time and frequency. Furthermore, a process may be performed to give a portion of the amount charged to the user as a reward to the poster. As a result, since the made-up face is displayed to others online, the user can participate in the meeting with their bare face.

[0083] In this case, the application unit 133 applies the makeup information generated by the generation unit 132 to the user's face image being captured in real time, thereby generating a face image to be displayed on another person's terminal device in real time. The generation unit 132 uses the face image generated by the application unit 133 to generate information in real time for displaying the face image with the makeup information applied to the user's face image on another person's terminal device. The provision unit 134 transmits the information generated by the generation unit 132, thereby distributing the face image with the makeup information applied by the application unit 133 to others who communicate with the user online in real time. The determination unit 135 determines the reward to be given to the poster who posted the face image selected by the user, according to the usage status (e.g., usage time and frequency) of the face image generated by the application unit 133 online. In other words, the determination unit 135 determines the reward to be given to the poster who posted the face image that is the source of the makeup information, according to the usage status of the face image with the makeup information applied to the user's face image. Furthermore, the application may be performed on the user's cloud, in which case the provision unit 134 may, for example, only provide the right to use the makeup information. The user may then exercise the provided right to use the makeup information applied to their face image and display that image on another person's terminal device.

[0084] [8. Effects] As described above, the information processing device 100 according to the embodiment includes a generation unit 132, an application unit 133, and a provision unit 134. The generation unit 132 generates makeup information for generating a face image in which the same makeup as the predetermined makeup is applied to the face image of a poster who has applied predetermined makeup. The application unit 133 applies the makeup information generated from a face image selected by the user from among face images posted by posters who meet predetermined conditions to the user's face image. The provision unit 134 provides the user with content showing the face image to which the makeup information has been applied by the application unit 133 and explanatory content of the items used for the makeup.

[0085] As a result, the information processing device 100 according to the embodiment can appropriately respond to the user's desire to instantly check whether or not someone else's makeup suits them.

[0086] Furthermore, the content includes information that allows users to access a designated online shopping mall where they can purchase goods.

[0087] As a result, the information processing device 100 according to the embodiment can appropriately direct users to a predetermined online shopping mall where they can purchase items used by others for makeup.

[0088] Furthermore, the information processing device 100 according to the embodiment further includes a decision unit 135 that determines that if a user purchases an item from a designated online shopping mall, the poster who posted the face image selected by the user will be rewarded according to the user's purchase.

[0089] As a result, the information processing device 100 according to this embodiment can appropriately motivate posters to post facial images.

[0090] Furthermore, the application unit 133 applies makeup information generated from a facial image selected from among the facial images that are preferentially selected or displayed based on predetermined criteria.

[0091] As a result, the information processing device 100 according to this embodiment can provide appropriate information to the user based on predetermined criteria, thereby more appropriately responding to the user's needs.

[0092] Furthermore, the application unit 133 applies makeup information generated from a facial image selected from among the facial images that are selected or displayed in order of priority, based on a priority determined based on at least one of the user's facial information, physical information, or purchase history of goods.

[0093] As a result, the information processing device 100 according to this embodiment can provide users with appropriate information based on facial information, physical information, purchase history of goods, etc., and can therefore respond to users' needs more appropriately.

[0094] Furthermore, the application unit 133 applies makeup information generated from a selected face image, based on a priority determined based on at least one of the access history, purchase history, or evaluation history for the face image, with the higher the priority, the more favorably selected or displayed the face image.

[0095] As a result, the information processing device 100 according to this embodiment can provide users with appropriate information based on access history, purchase history, evaluation history, etc., for facial images, thereby more appropriately responding to users' needs.

[0096] Furthermore, the application unit 133 applies makeup information generated from a facial image selected from among the facial images that are selected or displayed with priority given to those with higher priority, based on the priority determined based on the total price of the goods.

[0097] As a result, the information processing device 100 according to this embodiment can provide users with appropriate information based on the total price of the goods, thereby better meeting the user's needs.

[0098] [9. Hardware Configuration] Furthermore, the user terminal 10, the contributor terminal 20, and the information processing device 100 according to the embodiments described above are implemented by a computer 1000 having a configuration such as that shown in Figure 10. Figure 10 is a hardware configuration diagram showing an example of a computer that implements the functions of the user terminal 10, the contributor terminal 20, and the information processing device 100. The computer 1000 has a CPU 1100, RAM 1200, ROM 1300, HDD 1400, communication interface (I / F) 1500, input / output interface (I / F) 1600, and media interface (I / F) 1700.

[0099] The CPU 1100 operates based on programs stored in the ROM 1300 or HDD 1400, controlling various components. The ROM 1300 stores boot programs executed by the CPU 1100 when the computer 1000 starts up, as well as programs that depend on the computer 1000's hardware.

[0100] The HDD1400 stores programs executed by the CPU1100, as well as data used by such programs. The communication interface1500 acquires data from other devices via a predetermined communication network and sends it to the CPU1100, and transmits data generated by the CPU1100 to other devices via the predetermined communication network.

[0101] The CPU 1100 controls output devices such as displays and printers, and input devices such as keyboards and mice, via the input / output interface 1600. The CPU 1100 acquires data from input devices via the input / output interface 1600. The CPU 1100 also outputs the generated data to output devices via the input / output interface 1600.

[0102] The media interface 1700 reads a program or data stored in the recording medium 1800 and provides it to the CPU 1100 via the RAM 1200. The CPU 1100 loads the program from the recording medium 1800 onto the RAM 1200 via the media interface 1700 and executes the loaded program. The recording medium 1800 is, for example, an optical recording medium such as a DVD (Digital Versatile Disc) or PD (Phase Change Rewritable Disk), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory.

[0103] For example, if the computer 1000 functions as a user terminal 10, a contributor terminal 20, and an information processing device 100 according to the embodiment, the CPU 1100 of the computer 1000 realizes the functions of the control units 14, 24, and 130 by executing programs loaded on the RAM 1200. The CPU 1100 of the computer 1000 reads and executes these programs from the recording medium 1800, but as another example, these programs may be obtained from other devices via a predetermined communication network.

[0104] [10. Other] Furthermore, among the processes described in the above embodiments, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically by known methods. In addition, the processing procedures, specific names, and various data and parameters shown in the above document and drawings can be changed at will unless otherwise specified. For example, the various information shown in each figure is not limited to the information shown.

[0105] Furthermore, the components of each illustrated device are functionally conceptual and do not necessarily need to be physically configured as shown. In other words, the specific forms of distribution and integration of each device are not limited to those shown, and all or part of them can be functionally or physically distributed and integrated in any unit according to various loads and usage conditions.

[0106] Furthermore, the embodiments described above can be combined as appropriate, as long as the processing content is not contradictory.

[0107] Although some embodiments of the present invention have been described in detail above with reference to the drawings, these are illustrative examples, and the present invention can be implemented in various other forms with modifications and improvements based on the knowledge of those skilled in the art, starting with the embodiments described in the disclosure section of the invention.

[0108] Furthermore, the terms "section, module, unit" mentioned above can be replaced with "means" or "circuit," etc. For example, the acquisition unit can be replaced with acquisition means or acquisition circuit. [Explanation of Symbols]

[0109] 1. Information Processing System 10. User terminals 11 Communications Department 12 Input section 13 Output section 14 Control Unit 20 Poster's device 21 Communications Department 22 Input section 23 Output section 24 Control Unit 100 Information Processing Devices 110 Communications Department 120 Storage section 121 Poster Information Storage Department 122 Cosmetics Information Storage Unit 130 Control Unit 131 Acquisition Department 132 Generation part 133 Application section 134 Provision Department 135 Decision Section 141 Receiving Unit 142 Transmitter 241 Receiving Unit 242 Transmitter N Network

Claims

1. A generation unit that generates makeup information for generating a face image in which makeup similar to a predetermined makeup is applied to a face image of a poster wearing the predetermined makeup; an application unit that applies makeup information generated from a face image selected by a user from face images posted by a contributor who satisfies a predetermined condition to the face image of the user; a providing unit that provides a face image to which makeup information has been applied by the applying unit; having the providing unit provides to the user explanatory content including at least one of a brand, a product name, and a sales price of a product used in the makeup and which is linked in advance to each face image of the poster, and including information that allows the user to purchase the product; 23. An information processing apparatus comprising:

2. The information on whether the product can be purchased is information that allows access to a predetermined sales site where the product can be purchased.

2. The information processing apparatus according to claim 1,

3. a decision section that decides, when the user purchases the product at the predetermined sales site, to give a reward corresponding to the purchase by the user to a poster who posted the face image selected by the user.

3. The information processing apparatus according to claim 2, further comprising:

4. The application unit includes: Applying the makeup information generated from a face image selected from the face images that are preferentially selected or displayed based on a predetermined criterion 4. The information processing device according to claim 1, wherein the information processing device is a computer.

5. A computer-implemented information processing method, comprising: A generation step of generating makeup information for generating a face image in which makeup similar to the predetermined makeup is applied to the face image of the poster from the face image of the poster wearing the predetermined makeup; an application step of applying makeup information generated from a face image selected by a user from face images posted by contributors who satisfy a predetermined condition to the face image of the user; a providing step of providing a face image to which makeup information has been applied by the applying step; Including, The providing step provides the user with explanatory content including at least one of a brand, a product name, and a sales price of a product used in the makeup and which is linked in advance to each face image of the poster, and including information that allows the user to purchase the product.

23. An information processing method comprising:

6. A generation step of generating makeup information for generating a face image in which makeup similar to a predetermined makeup is applied to a face image of a poster wearing the predetermined makeup; an application step of applying makeup information generated from a face image selected by a user from face images posted by contributors who satisfy a predetermined condition to the face image of the user; a providing step of providing a face image to which makeup information has been applied by the applying step; on the computer, The provision step includes providing to the user an explanatory content including at least one of a brand, a product name, and a sales price of a product used in the makeup and which is linked in advance to each face image of the poster, and including information that allows the user to purchase the product.

2. An information processing program comprising:

Images