Information processing device, information processing method, and information processing program

Abstract

The present invention makes it possible for a contributor to determine whether or not a fashion measure is likely to lead to a conversion before posting. An information processing device according to the present application includes an acquiring unit, a first display unit, and a second display unit. The acquiring unit acquires a captured image of a contributor to whom a fashion measure has been applied. The first display unit displays at least one thumbnail image of a model to whom the fashion measure is to be applied. When the contributor specifies a thumbnail image, the second display unit displays an image in which the fashion measure has been applied to the model.

Description

Information processing device, information processing method, and information processing program

[0001] The present invention relates to an information processing device, an information processing method, and an information processing program.

[0002] Conventionally, a technique for displaying an image to which a fashion measure such as makeup of a poster has been applied has been known. For example, a technique for displaying an image of a user to which a fashion measure has been applied by a user specifying an image taken by the poster has been known.

[0003] Patent No. 7308317

[0004] W. Jiang, S. Liu, C. Gao, J. Cao, R. He, J. Feng, S. Yan“PSGAN: Pose and Expression Robust Spatial-Aware CAN for Customizable Makeup Transfer”, [online], [searched on April 5, 2020], Internet <https: / / openaccess.thecvf.com / content_CVPR_2020 / html / Jiang_PSGAN_Pose_and_Expression_Robust_Spatial-Aware_GAN_for_Customizable_Makeup_CVPR_2020_paper.html>

[0005] However, while conventional technologies can promote improved usability for users, there is room for further improvement to promote improved usability for contributors. For example, conventional technologies have room for further improvement to make it easier for contributors to satisfy their desire for financial or psychological recognition, such as wanting to share their fashion initiatives with others. Furthermore, conventional technologies have room for further improvement to enable contributors to determine, before posting, whether a fashion initiative is likely to lead to conversions.

[0006] The present application has been made in consideration of the above, and aims to enable posters to determine, before posting, whether a fashion measure is likely to lead to conversions.

[0007] The information processing device of the present application is characterized by having an acquisition unit that acquires an image taken by a poster to which a fashion measure has been applied, a first display unit that displays at least one thumbnail image of a model to which the fashion measure is applied, and a second display unit that, when the poster specifies the thumbnail image, displays an image of the model to which the fashion measure has been applied.

[0008] According to one aspect of the embodiment, it is possible to provide an effect that a poster can determine, before posting, whether or not a fashion measure is likely to lead to conversions.

[0009] FIG. 1 is a diagram illustrating an example of the configuration of an information processing system according to an embodiment. FIG. 2A is a diagram illustrating an example of the overall flow of a user interface on the poster's side. FIG. 2B is a diagram illustrating an example of the overall flow of a user interface on the user's side. FIG. 3 is a diagram illustrating an example of information processing according to an embodiment. FIG. 4 is a diagram illustrating an example of a preview screen according to an embodiment. FIG. 5 is a diagram illustrating an example of the configuration of a terminal device according to an embodiment. FIG. 6 is a diagram illustrating an example of the configuration of an information processing device according to an embodiment. FIG. 7 is a diagram illustrating an example of a model information storage unit according to an embodiment. FIG. 8 is a diagram illustrating an example of an evaluation information storage unit according to an embodiment. FIG. 9 is a flowchart (1) illustrating an example of information processing according to an embodiment. FIG. 10 is a flowchart (2) illustrating an example of information processing according to an embodiment. FIG. 11 is a hardware configuration diagram illustrating an example of a computer that realizes the functions of an information processing device.

[0010] Hereinafter, an information processing device, an information processing method, and an information processing program according to the present application (hereinafter referred to as "embodiments") will be described in detail with reference to the drawings. Note that the information processing device, the information processing method, and the information processing program according to the present application are not limited to these embodiments. Furthermore, the same components in the following embodiments will be denoted by the same reference numerals, and duplicated descriptions will be omitted.

[0011] (Embodiment) [1. Configuration of Information Processing System] An information processing system 1 shown in Fig. 1 will be described. As shown in Fig. 1, the information processing system 1 includes a terminal device 10 and an information processing device 100. The terminal device 10 and the information processing device 100 are connected to each other via a predetermined communication network (network N) so as to be able to communicate with each other via wired or wireless communication. Fig. 1 is a diagram showing an example of the configuration of the information processing system 1 according to an embodiment.

[0012] The terminal device 10 is an information processing device used by a poster who wishes to spread their own fashion initiatives (such as makeup) to others via social media or the like. A poster who uses the terminal device 10 may be, for example, an influencer who disseminates their own fashion initiatives via the Internet. For example, an influencer who distributes videos related to the fashion initiatives they implement. The terminal device 10 may be any device capable of implementing the processes in the embodiment. Furthermore, the terminal device 10 may be a device such as a smartphone, a tablet device, a notebook PC, a desktop PC, a mobile phone, or a PDA. FIG. 3 illustrates a case where the terminal device 10 is a smartphone.

[0013] The terminal device 10 is, for example, a smart device such as a smartphone or tablet, and is a mobile terminal device that can communicate with any server device via a wireless communication network such as 3G to 5G (Generations) or LTE (Long Term Evolution). The terminal device 10 may have a screen such as a liquid crystal display with a touch panel function, and may accept various operations on displayed data such as content, such as tapping, sliding, and scrolling, performed by a contributor using a finger or a stylus. In FIG. 3, the terminal device 10 is used by a contributor U1.

[0014] The information processing device 100 is an information processing device that aims to facilitate satisfaction of a poster's desire for financial or psychological recognition, such as wanting to share their fashion initiatives with others, and to enable the poster to determine before posting whether a fashion initiative is likely to lead to conversions, thereby promoting improved usability for the poster. The information processing device 100 may be any device capable of implementing the processes described in the embodiments. For example, the information processing device 100 is realized by a server device, a cloud system, or the like that provides a predetermined service (which may be a web service or an app service) that enables posting (registering) and trying on of fashion initiatives. In the following embodiment, service W1 will be used as an example of such a service. That is, service W1 is a predetermined service that enables posting and trying on of fashion initiatives.

[0015] [2. Example of Information Processing] There are times when a user wants to spread their own fashion initiatives to others. Furthermore, in order to spread their own fashion initiatives to others, they may want to determine, before posting, what kind of fashion initiatives will lead to conversions (for example, whether they will lead to a purchase or whether they will try on an item). However, with conventional technology, it has not been possible to determine, before posting, for example, what kind of fashion initiatives will lead to conversions among their followers.

[0016] The present application has been made in consideration of the above, and aims to make it easier for posters to satisfy their desire for financial or psychological recognition, such as wanting to spread their own fashion initiatives to others, and to enable posters to determine before posting whether a fashion initiative is likely to lead to conversions.

[0017] In the following embodiments, the application of a fashion measure is not limited to an actual action, but may also include an action performed virtually. That is, the action may be an action that the poster actually performs in the real world, or an action that the poster performs virtually via an avatar or the like.

[0018] In the following embodiments, a case where a poster posts facial makeup is described as an example of a fashion measure. However, the fashion measure does not have to be limited to facial makeup. The fashion measure may be, for example, hair makeup (hair makeup) such as hairstyle and hair color. It may also be, without being limited to makeup, trying on (trying on in the real world or virtually) and coordinating clothes (clothing is not limited to one-piece dresses and may include, for example, shoes, socks, accessories, watches, jewelry, etc.). The following embodiments describe the processing on the poster's side who posts the fashion measure, rather than the processing on the user's side who applies the fashion measure. Note that the poster who posts the fashion measure, for example, photographs (scans) the face after the fashion measure and registers the items used. Furthermore, the user who applies the fashion measure, for example, specifies the poster's posting information, tries on the fashion measure (e.g., full makeup), and, if they like it, purchases the items used (the items used in the full makeup).

[0019] FIG. 2A is a diagram showing an example of the overall flow of the user interface on the poster's side. When poster U1 operates "Register" at the bottom of the first screen from the left, the screen transitions to the second screen from the left. After reading the notes and agreeing to the terms of use (if it is the first time), the screen transitions to the third screen from the left. When photographing the face from multiple angles on the makeup photography screen, the screen transitions to the fourth screen from the left. When the preview screen shows the try-on image of the captured makeup, the screen transitions to the fifth screen from the left. Then, when the user enters a thumbnail image and text on this screen, links the items used, and posts the post, the posted information is made public.

[0020] FIG. 2B is a diagram showing an example of the overall flow of the user interface on the user side. When user P1 selects a makeup style that interests him or her on the first screen from the left, the screen transitions to the second screen from the left. When user P1 operates "Try Makeup" on this screen, the screen transitions to the third screen from the left. On this screen, user P1 can try on registered makeup styles on his or her own face and refer to the items used. Furthermore, when user P1 operates "HOW TO" in the second scene from the left, the screen transitions to the fourth screen from the left. On this screen, it is possible to view an explanatory video on makeup. For example, a web view is launched within the app and the video is played.

[0021] FIG. 3 is a diagram illustrating an example of information processing by the information processing system 1 according to the embodiment. FIG. 3 illustrates an example of information processing on the side of a poster who posts a fashion campaign. A poster U1 uploads their own makeup information to a predetermined service (service W1) provided by the information processing device 100 (step S11). The makeup information may be, for example, information captured by photographing the poster's makeup (e.g., a still image) or information describing how to apply makeup, such as the order and volume of makeup (e.g., a video image). The makeup information may also be, for example, mask information, which is makeup applied to the poster's face, or cosmetic information linked to the posted information. The mask information may be information about the poster's face after makeup, or information about the makeup itself obtained by calculating the difference between the poster's face after makeup and the poster's bare face. The poster U1, for example, uploads a facial image of their face with makeup applied to the service W1. At this time, the poster U1 may, for example, register the items used in the makeup in association with their own makeup information. For example, the information processing device 100 may cause the poster U1 to register items used in the makeup so as to be linked to the makeup information applied by the poster U1. In this case, for example, the information processing device 100 may identify the makeup information by extracting mask information from the posted information.

[0022] When a user specifies posted information of poster U1, the information processing device 100 may, for example, perform processing to apply makeup information associated with the posted information to the user's facial image, or may perform processing to enable the purchase of items used in the makeup. Below, a description is given using a photographed image G1 (which may be a still image or a moving image) as an example of posted information. For example, when a user P1 (e.g., a follower of poster U1) who has viewed (watched) the photographed image G1 specifies the photographed image G1, the information processing device 100 may enable the application of makeup information used in capturing the photographed image G1, or may provide a link to a website where the items used can be purchased. Below, a description is given of a preview screen (pre-post preview screen) that is displayed when poster U1 uploads a photographed image G1 of his or her makeup to service W1. Note that if poster U1 allows (accepts) the posting (registration) on the preview screen (screen C1), the image is made public and available for viewing. The preview screen is a screen that allows the poster to check the makeup try-on image by applying the makeup to multiple face types (fresh, cute, feminine, cool, and androgynous men, etc.) before taking a photo of themselves applying makeup and posting it.

[0023] FIG. 4 is a diagram illustrating an example of a preview screen according to an embodiment. Screen C1 is a preview screen before posting of captured image G1. That is, it is a preview screen displayed on the poster's side before posting. Screen C1 displays, at the top (main) screen, a captured image (captured image G1) taken by poster U1 after applying makeup. Screen C1 also includes a button B1 that allows the user to retake the captured image if the user wants to change the captured image, and a button B2 that allows the user to post the captured image. When button B1 is operated (e.g., clicked or tapped), the preview screen returns to the capture screen. When the user retakes the image, the preview screen returns, and the newly captured image is displayed at the top. When button B2 is operated, the captured image G1 is posted. In this case, the captured image G1 is made public and can be viewed by followers of poster U1, etc. Here, the posted photographed image G1 may be viewable, or information posted along with the photographed image G1 (e.g., items used, etc.) may be viewable, or information registered in association with the poster U1 (e.g., thumbnail images registered separately, etc.) may be viewable.

[0024] Furthermore, screen C1 includes thumbnail images indicating at least one face type. In Fig. 4, from left to right, the screen includes a thumbnail image SG1 with a "Fresh" face type, a thumbnail image SG2 with a "Cute" face type, a thumbnail image SG3 with a "Feminine" face type, a thumbnail image SG4 with a "Cool" face type, and a thumbnail image SG5 with an "Androgynous Male Face Type." In Fig. 4, these thumbnail images SG1 to SG5 are displayed superimposed on the captured image G1. This allows four female face images according to the four types and one male face image with androgynous facial features to be displayed, allowing the user to try on the captured makeup on each image and check how it looks.

[0025] Furthermore, these thumbnail images SG1 to SG5 are selectable. For example, when thumbnail image SG1 is operated, thumbnail image SG1 is selected. At this time, the makeup information of poster U1 (the makeup information used in captured image G1) is applied to the face image of thumbnail image SG1. Then, the face image with the makeup information of poster U1 applied to the face image of thumbnail image SG1 is displayed at the top. As a result, poster U1 can check on the preview screen what kind of makeup his / her makeup will actually look like (whether it suits him / her) on a face type of "Fresh." Similarly, for example, when thumbnail image SG2 is operated, thumbnail image SG2 is selected. At this time, the makeup information of poster U1 is applied to the face image of thumbnail image SG2. Then, the face image with the makeup information of poster U1 applied to the face image of thumbnail image SG2 is displayed at the top. As a result, poster U1 can check on the preview screen what kind of makeup his / her makeup will actually look like on a face type of "Cute." By displaying the preview screen in this manner, it is possible to check, for example, what kind of makeup suits what kind of face type, and what kind of face type the poster's makeup actually suits, before posting. It is also possible to check, for example, whether the poster's post will be attractive to users with the target face type, and whether the poster's post will be attractive to followers, before posting. The face images of the models in the thumbnail images SG1 to SG5 are selection candidates to which the poster U1 can apply makeup information, and the face image of the model to which the poster U1 has selected a thumbnail image and applied makeup information is displayed at the top of the screen C1 (step S12).

[0026] The number of thumbnail images and face types that can be displayed on the screen C1 do not have to be limited to this example. They do not have to be limited to the five thumbnail images SG1 to SG5 shown in FIG. 4 . For example, additional thumbnail images may be hidden to the right of thumbnail image SG5 and displayed by scrolling. The display format of these thumbnail images does not have to be limited to the example shown in FIG. 4 , and any display format may be used. Furthermore, the face types may not be limited to “Fresh,” “Cute,” “Feminine,” “Cool,” or “Androgynous Male.” For example, the face types of the thumbnail images displayed on the screen C1 may be different each time depending on the face type and makeup information of the poster U1. For example, the face types of the thumbnail images displayed on the screen C1 may be different each time the poster U1 slightly changes his or her makeup and retakes the photo.

[0027] The process of extracting the face types of the thumbnail images displayed on the screen C1 will now be described. In Fig. 4, thumbnail images of five face types, "Fresh," "Cute," "Feminine," "Cool," and "Androgynous Male," are displayed. How these five face types are extracted will now be described.

[0028] The information processing device 100 acquires a captured image to be displayed on the screen C1 (pre-post preview screen) (step S101). In the examples of FIGS. 3 and 4, the captured image G1 is acquired. The information processing device 100 then extracts at least one thumbnail image of a model to which makeup information is to be applied based on predetermined conditions (step S102). In the examples of FIGS. 3 and 4, thumbnail images SG1 to SG5 are extracted. The information processing device 100 then displays the extracted thumbnail images in a predetermined area of ​​the screen C1 (so as to be superimposed on the captured image) (step S103). In the examples of FIGS. 3 and 4, the information processing device 100 displays the extracted thumbnail images in area R1. When a thumbnail image is selected, the information processing device 100 generates a facial image of the model to which makeup information has been applied from the facial image of the model in the thumbnail image (step S104). The information processing device 100 then displays the generated facial image of the model at the top of the screen C1 (step S105).

[0029] In step S104, an example of a method for generating a facial image of a model with makeup information applied is, for example, a method called PSGAN (Pose and Expression Robust Spatial-Aware Generative Adversarial Network), which is disclosed in the above-mentioned non-patent document 1, in which only makeup information is transferred from a facial image to another face. This method uses deep learning and can transfer only makeup information to another face regardless of facial expression or pose. Using a method such as PSGAN, the information processing device 100 applies makeup similar to the makeup used by poster U1 in the posted information of poster U1 to the facial image of the model. Specifically, the information processing device 100 generates makeup information for applying makeup similar to the makeup used by poster U1 and applies the generated makeup information to the facial image of the model. Then, in step S105, the information processing device 100 generates a facial image of the model with makeup information applied in this manner, and displays the generated facial image of the model at the top of the screen C1.

[0030] Here, the process of extracting at least one based on predetermined conditions in step S102 will be described. The information processing device 100 performs the extraction process in step S102 based on various conditions. As examples of the extraction process, three patterns will be described: using the degree to which makeup suits the user, using follower information of the poster, and using login information of the model; however, the extraction process is not limited to the following examples.

[0031] (When Using Degree of Makeup Suitability) The information processing device 100 may perform extraction processing based on, for example, the degree to which makeup suits the face type of the model in the thumbnail image. For example, the information processing device 100 may extract thumbnail images in descending order of the model's rating (score) indicating the degree to which the makeup applied by the poster U1 suits them. For example, the information processing device 100 may extract thumbnail images by estimating the degree to which makeup suits the model using machine learning of the rating given by the poster U1 to a face image of the model to which makeup information has been applied. For example, the information processing device 100 may extract thumbnail images by estimating the degree to which makeup suits the model using a learning model trained on machine learning, using a case where the poster U1 has rated the face image of the model to which makeup information has been applied as "suitable" as a positive example and a case where the poster U1 has rated the face image of the model to which makeup information has been applied as "unsuitable" as a negative example.

[0032] For example, the information processing device 100 may evaluate the suitability of makeup by having the poster U1 select (or specify) on the screen C1 a face type of a model that the poster U1 has determined suits the poster's makeup and by learning the selected face type in combination with makeup information. For example, the information processing device 100 may perform machine learning using a combination of the selected face type and makeup information as a positive example, or may perform machine learning using a combination of a face type and makeup information that was not selected as a negative example. The information processing device 100 may then estimate a suitable face type by inputting makeup information into a learning model machine-learned in this way. Furthermore, the information processing device 100 may perform machine learning using information registered on the screen C1 after trying on makeup as a positive example, without having the poster U1 select a face type of a model.

[0033] For example, the information processing device 100 may extract thumbnail images in the order of models whose face types are similar to that of the poster U1. For example, if the face type of the poster U1 is "Cute," the information processing device 100 may preferentially extract thumbnail images of models whose face type is "Cute."

[0034] (When Poster's Follower Information is Used) The information processing device 100 may perform the extraction process based on, for example, the follower information of the poster U1. For example, the information processing device 100 may prioritize extracting thumbnail images of models with the same or similar facial type as the poster U1's followers. Furthermore, for example, the information processing device 100 may prioritize extracting thumbnail images of models with facial types that are of interest to the poster U1's followers. Furthermore, for example, the information processing device 100 may perform the extraction process limited to followers estimated to lead to conversions such as purchases or viewings. In this case, for example, the information processing device 100 may estimate the likelihood of conversions such as purchases or viewings using a model that has learned the relationship between a user's try-on history, purchase history, viewing history, etc. and whether the user has achieved a predetermined conversion, such as making a purchase or viewing predetermined content, and then estimate followers who will lead to conversions based on the estimated likelihood of conversions.

[0035] Furthermore, the information processing device 100 may perform the extraction process based on, for example, facial images of followers rather than models. The information processing device 100 may perform the extraction process based on, for example, facial images of models generated based on facial images of followers (e.g., facial images of models generated based on generation AI). In this case, the information processing device 100 may use, for example, the facial image of a follower who has made the most purchases, viewed the most, tried on clothes the most, or had the most followers, or may use the average facial image of multiple followers. This makes it possible to effectively encourage users to try on clothes by using facial images of followers with a large number of followers, for example.

[0036] (When Model Login Information Is Used) The information processing device 100 may perform the extraction process based on, for example, login information (such as the number of logins and whether the model is a new registrant) of candidate models displayed on the screen C1. For example, the information processing device 100 may prioritize extracting thumbnail images of models with a higher number of logins. Note that the model may be, for example, a model that is identical to or similar to the facial type of a user with a higher number of logins, a model that is identical to or similar to the facial type that a user with a higher number of logins is interested in, or the user himself / herself. Furthermore, a high number of logins does not necessarily mean a high number of logins, but may also include a large number of users. For example, the information processing device 100 may prioritize extracting thumbnail images of models that are estimated to be more likely to have makeup information applied by the poster U1 if the poster U1 posts a content. For example, the information processing device 100 may prioritize extracting thumbnail images of models that are estimated to be more likely to have the poster U1's makeup information applied if the poster U1 posts a content. For example, the information processing device 100 may prioritize extracting thumbnail images of models that are newly registrants to the service W1. Furthermore, for example, the information processing device 100 may preferentially extract thumbnail images of models who have logged in within a predetermined period (e.g., recently).

[0037] The above describes the process for extracting thumbnail images of models who are candidates for applying makeup information. For example, the predetermined conditions for extracting thumbnail images have been described. Below, the process for determining the display mode of thumbnail images after such extraction process (such as display order (sorting order), highlighting, and display of positive information such as face type and follower information) will be described. Specifically, the process for determining the display mode of thumbnail images when displaying thumbnail images in a predetermined area of ​​the screen C1 in step S103 will be described. The information processing device 100 determines the display mode of thumbnail images for step S103 based on various conditions. As an example of the display mode determination process, three patterns will be described: a case where the degree to which makeup suits the model is used, a case where the poster's follower information is used, and a case where the model's login information is used, similar to the extraction process described above. However, the present invention is not limited to these examples. Furthermore, descriptions similar to those of the extraction process described above will be omitted as appropriate.

[0038] (Using the Degree of Makeup Suitability) The information processing device 100 may perform a display mode determination process based on, for example, the degree to which makeup suits the face type of the model in the thumbnail image. For example, the information processing device 100 may determine a display mode such that thumbnail images of models with higher ratings indicating the degree to which the makeup applied by the poster U1 suits them are displayed preferentially (e.g., displayed at the top, displayed at the beginning, or highlighted). Furthermore, for example, the information processing device 100 may determine a display mode such that thumbnail images of models with a face type similar to that of the poster U1 are displayed preferentially. Furthermore, the information processing device 100 may perform a display mode determination process by subdividing face types (e.g., subdividing a face into features such as eyes and lips). In this way, processing may be performed using subtypes of face features rather than types based on the entire face, such as cute or cool. For example, the information processing device 100 may determine a display mode such that thumbnail images of models with higher ratings for each subtype of face type are displayed preferentially. In this case, the information processing device 100 may determine to highlight the matching features, for example, by displaying them in a pop-up or the like. For example, a type determination may be performed based on only specific facial features rather than the entire face, and the specific facial features may be evaluated and displayed preferentially. For example, if the specific facial features are the eyes, thumbnail images of models with cute eyes may be displayed on the preview screen along with thumbnail images of models with cool eyes. If the specific facial features are the lips, thumbnail images of models with cute lips and thumbnail images of models with cool lips may be displayed on the preview screen. In this case, for example, in order to display thumbnail images of models with cute eyes on the preview screen, only thumbnail images of models with cute eyes may be extracted and displayed, and in order to display thumbnail images of models with cool eyes on the preview screen, only thumbnail images of models with cool eyes may be extracted and displayed.

[0039] (When Poster's Follower Information is Used) The information processing device 100 may perform a display mode determination process based on, for example, the follower information of poster U1. For example, the information processing device 100 may perform a display mode determination process based on the facial types of poster U1's followers. For example, the information processing device 100 may determine a display mode such that thumbnail images of models with the same or similar facial types as poster U1's followers are preferentially displayed. Furthermore, for example, the information processing device 100 may perform a display mode determination process based on the proportion of facial types of poster U1's followers. For example, if a high proportion of poster U1's followers have the "Cute" facial type, the information processing device 100 may determine a display mode such that thumbnail images of "Cute" models are preferentially displayed. Furthermore, for example, if a high proportion of poster U1's followers have the "Cute" facial type, the information processing device 100 may determine a display mode such that thumbnail images of "Cute" models are preferentially displayed. Furthermore, for example, if a high proportion of poster U1's followers have the "Cute" facial type, the information processing device 100 may determine a display mode such that thumbnail images of "Cute" models are preferentially displayed. Furthermore, for example, when there are multiple face types with a high proportion, the information processing device 100 may subdivide the face types and perform the process of determining the display mode.

[0040] At this time, the information processing device 100 may determine to highlight the follower type, for example, by using a pop-up or the like. For example, the information processing device 100 may determine to highlight the follower's face type (indicating the follower's face type) by using a pop-up or the like, or to highlight the number of followers for each face type. For example, the information processing device 100 may determine to highlight the thumbnail image by changing the color or thickness of the frame. At this time, the information processing device 100 may also determine to prioritize the display, for example, so that face types with high conversion rates (such as likelihood of trying on clothes) are displayed at the top. This allows the poster U1 to check followers who are highly engaged. Furthermore, the information processing device 100 may determine to notify followers corresponding to the face type selected by the poster U1 that new makeup information has been posted when the poster U1 posts makeup information.

[0041] Furthermore, the information processing device 100 may determine to highlight the follower's face image instead of the model's face image, for example. The information processing device 100 may determine to highlight the follower's face image by displaying a model's face image generated based on the follower's face image (e.g., a model's face image generated based on generation AI). In this case, the information processing device 100 may use the face image of the follower who has made the most purchases, viewed the most items, tried on the most items, or had the most followers, or may use the average face image of multiple followers. This makes it possible to effectively encourage followers to try on items by using the face image of a follower with a large number of followers, for example.

[0042] (When Model Login Information is Used) The information processing device 100 may perform the display mode determination process based on, for example, the login information of a candidate model displayed on the screen C1. For example, the information processing device 100 may perform the display mode determination process based on the number of logins of the model. As in the case of the extraction process described above, the model may be, for example, a model whose face type is identical or similar to that of a user with a high number of logins, a model whose face type is identical or similar to that of a user with a high number of logins, or the user himself / herself. Furthermore, a high number of logins does not necessarily mean a high number of logins, but may also include a large number of users. For example, the information processing device 100 may determine the display mode such that thumbnail images of models with a face type that accounts for a higher proportion of the model's logins are displayed preferentially. Furthermore, for example, if there are multiple face types with a high proportion of the model's logins (e.g., multiple face types exceeding a predetermined threshold), the information processing device 100 may perform the display mode determination process by subdividing the face types. In this case, the information processing device 100 may determine to highlight the model, for example, by displaying a message such as "High likelihood of trying on makeup!" in a pop-up or the like. Furthermore, for example, the information processing device 100 may determine the display mode so that thumbnail images of models who are new registrants to the service W1 are preferentially displayed.

[0043] The process of determining the display mode of the thumbnail images has been described above. After determining the display mode of the thumbnail images, the information processing device 100 displays the thumbnail images in the determined display mode in a predetermined area of ​​the screen C1.

[0044] (Information Processing Variation 1: Fashion Measures) In the above embodiment, makeup has been described as an example of a fashion measure, but the present invention is not limited to this example. For example, the fashion measure may be hair and makeup, such as hairstyle and hair color, or trying on and coordinating clothes. This allows, for example, in the case of hair and makeup, to select a model that suits the hair and makeup posted by poster U1, or to select a model by subdividing the hair and makeup posted by poster U1.

[0045] (Information Processing Variation 2: Friend Setting) In the above embodiment, the model for the thumbnail image is described as a follower of poster U1, but this example is not particularly limited. The model for the thumbnail image may be, for example, only users who have a predetermined relationship with poster U1. For example, it may be only users who have permitted sharing (e.g., users who have been set as friends). This allows only the faces of users who have permitted sharing to be displayed on the preview screen, making it possible to provide a service that can be enjoyed only by friends. Furthermore, the model for the thumbnail image may be, for example, only followers of poster U1 who are estimated to lead to purchases or views.

[0046] (Information Processing Variation 3: Models Likely to Be Try-On) In the above embodiment, an example has been described in which thumbnail images of models likely to be try-on are displayed at the top. In this case, the models likely to be try-on may be, for example, users who have posted within a predetermined period of time to a predetermined service (social commerce) that allows users to post and view fashion coordinations.

[0047] (Information processing variation 4: facial image of model (actual / selected / estimated)) In the above embodiment, an example was given in which the model of the thumbnail image is a follower of poster U1, i.e., a real model, but this example is not particularly limited. The model of the thumbnail image does not have to be a real model, and may be, for example, a model generated by generation AI or the like. In other words, the thumbnail image does not have to be a facial image of a real model, and may be, for example, a facial image of a model generated by generation AI or the like. For example, it may be a facial image of a model generated based on follower information of poster U1. For example, it may be a facial image of a model generated by taking a weighted average based on the number of followers of poster U1.

[0048] In addition, there may be cases where there is no facial image of a model that can be used as a thumbnail image. For example, there may be followers of poster U1 who have not registered their facial images. In this case, for example, if a user, such as a follower of poster U1, has registered facial information such as their face type, the weighting may be changed based on the facial information registered by the user. That is, the thumbnail image may be, for example, a facial image of a model generated based on a weighting changed based on the facial information registered by the user. Furthermore, the facial image of the model may be, for example, a facial image estimated based on user-augmented information based on the user's following relationships, purchase history, etc. In this way, the facial image of the model may be an actually photographed facial image, a facial image based on facial information selected by the user, or a facial image estimated based on user-augmented information.

[0049] (Information Processing Variation 5: Other Functions of Preview Screen) In the above embodiment, for example, an operation button that enables the application of a fashion measure to be turned on and off may be displayed on the screen C1. This makes it possible, for example, to turn on and off makeup information applied to the poster's facial image with a single operation (such as one click or one tap) via the operation button. Also, in the above embodiment, for example, an explanatory guide for first-time users may be displayed on the screen C1. Also, in the above embodiment, for example, it may be possible to enlarge or reduce the facial image in response to an operation by the poster on the screen C1. Also, in the above embodiment, for example, it may be possible to adjust the density of the facial image in response to an operation by the poster on the screen C1. For example, it may be possible to adjust the density for each part of the face using a user interface such as a slider.

[0050] (Information Processing Variation 6: Other Functions of Preview Screen) In the above embodiment, for example, a button for automatically generating a description related to the face type of a thumbnail image may be displayed on the preview screen. For example, when an image is selected, a button for automatically generating a description such as "This makeup looks good on your XX type, so please try it on" may be displayed. Furthermore, in the above embodiment, for example, tags related to face types may be linked and automatically registered on the preview screen to make it easier to search for makeup information from the tags.

[0051] In the above embodiment, for example, the frame of the thumbnail image on the preview screen may be shaped according to the face type of each model. For example, if there are many round faces, the frame may be round, and if there are many basic faces, the frame may be basic. The shape may also be according to the characteristics of each model's face type. This makes it possible to determine each model's face type from the frame, thereby reducing the burden of checking the preview when registering.

[0052] In the above embodiment, for example, instead of selection according to face type, selection according to the purpose of makeup (e.g., date, wedding, girls' night out, etc.) may be allowed. For example, selection may be made from options using different clothes and backgrounds depending on the purpose. In this case, for example, the face types of the thumbnail images may be the same or different depending on the purpose. In other words, the face type may be the same but the clothes and background may be different depending on the purpose, or the clothes and background may be different for each face type depending on the purpose.

[0053] In the above embodiment, for example, the density may be adjusted on the preview screen and then registered, and when trying on, the density may be set to the base value.

[0054] In the above embodiment, for example, face types for which there is little registration of makeup information that suits them may be preferentially extracted or displayed. It is also possible to display the fact that there is little registration in an easily understandable manner without prioritizing extraction or display. This makes it easier for even posters with few followers (such as posters who are difficult to select) to try on their registered makeup information, and promotes this function by allowing makeup information that suits various face types to be registered. It is also possible to suggest which face type should be registered as makeup information, not on the preview screen, but on the screen for photographing a face with makeup or on a screen prior to that, or to suggest which face type should be changed as makeup information on the preview screen if the makeup information is to be changed, or to suggest which makeup information is recommended if the next makeup information is to be registered, when makeup information is registered.

[0055] In the above embodiment, for example, a case where one preview screen is displayed has been described as an example, but in the above embodiment, multiple preview screens may be displayed. For example, when multiple thumbnail images are selected, the multiple preview screens may be displayed simultaneously, side by side, or split into left and right halves and displayed separately.

[0056] In the above embodiment, for example, if the degree of suitability can be displayed, the degree of suitability may be included in the display. Also, for example, the user may be asked to evaluate which looks better and the comparison results may be learned. This makes it possible to achieve highly accurate learning.

[0057] (Information Processing Variation 7: Providing Incentives) In the above embodiment, for example, an incentive may be provided to the poster when the user tries on a product, browses the product after trying it on, purchases the product after trying it on, or returns from a dormant follower. For example, when the user purchases a product, the poster may be provided with electronic money or points that can be used for payment at an online shopping mall that sells the product. This makes it possible to encourage the poster to post with conversions in mind.

[0058] (Information processing variation 8: Display control) In the above embodiment, for example, a case where display control is performed after performing a thumbnail image extraction process has been described as an example, but in the above embodiment, display control may also be performed by fixing the model without performing a thumbnail image extraction process.

[0059] (Information processing variation 9: Automatic display) In the above embodiment, for example, a case has been described in which the poster specifies a thumbnail image to which the fashion measure will be applied. However, in the above embodiment, instead of the poster selecting a thumbnail image, the thumbnail image may be automatically applied to a model with the most suitable face type or a model with the face type of a follower, and displayed to the poster.

[0060] 3. Configuration of the Terminal Device Next, the configuration of the terminal device 10 according to the embodiment will be described with reference to Fig. 5. Fig. 5 is a diagram showing an example configuration of the terminal device 10 according to the embodiment. As shown in Fig. 5, the terminal device 10 has a communication unit 11, an input unit 12, an output unit 13, and a control unit 14.

[0061] (Communication Unit 11) The communication unit 11 is realized by, for example, a network interface card (NIC), etc. The communication unit 11 is connected to a predetermined network N by wire or wirelessly, and transmits and receives information to and from the information processing device 100, etc., via the predetermined network N.

[0062] (Input Unit 12) The input unit 12 accepts various operations from posters. In FIG. 3, the input unit 12 accepts various operations from poster U1. For example, the input unit 12 may accept various operations from the poster via a display screen using a touch panel function. The input unit 12 may also accept various operations from buttons provided on the terminal device 10 or a keyboard or mouse connected to the terminal device 10.

[0063] (Output unit 13) The output unit 13 is a display device for displaying various information, such as a display screen of a tablet terminal realized by a liquid crystal display, an organic EL (Electro-Luminescence) display, etc. For example, the output unit 13 displays information transmitted from the information processing device 100.

[0064] (Control Unit 14) The control unit 14 is, for example, a controller, and is realized by a CPU (Central Processing Unit), an MPU (Micro Processing Unit), or the like executing various programs stored in a storage device within the terminal device 10 using RAM (Random Access Memory) as a work area. For example, these various programs include application programs installed on the terminal device 10. For example, these various programs include an application program that displays a preview screen of posted information including thumbnail images of models who are candidates for applying a fashion measure, based on information transmitted from the information processing device 100. The control unit 14 is also realized by an integrated circuit, for example, an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

[0065] As shown in FIG. 5, the control unit 14 has a receiving unit 141 and a transmitting unit 142, and realizes or executes the information processing operations described below.

[0066] (Receiving unit 141) The receiving unit 141 receives various information from other information processing devices such as the information processing device 100. For example, the receiving unit 141 receives information for displaying a preview screen of posted information including a thumbnail image of a model who is a candidate for applying a fashion measure.

[0067] (Transmitting unit 142) The transmitting unit 142 transmits various types of information to other information processing devices such as the information processing device 100. For example, the transmitting unit 142 transmits selection information selected by the poster from among thumbnail images displayed together with the posted information. Furthermore, for example, when the poster evaluates how well makeup suits them, the transmitting unit 142 transmits evaluation information.

[0068] 4. Configuration of Information Processing Device Next, the configuration of the information processing device 100 according to the embodiment will be described with reference to FIG. 6. FIG. 6 is a diagram showing an example of the configuration of the information processing device 100 according to the embodiment. As shown in FIG. 6, the information processing device 100 includes a communication unit 110, a storage unit 120, and a control unit 130. Note that the information processing device 100 may also include an input unit (e.g., a keyboard, a mouse, etc.) that accepts various operations from an administrator of the information processing device 100, and a display unit (e.g., a liquid crystal display, etc.) that displays various information.

[0069] (Communication Unit 110) The communication unit 110 is realized by, for example, a NIC etc. The communication unit 110 is connected to the network N by wire or wirelessly, and transmits and receives information to and from the terminal device 10 etc. via the network N.

[0070] (Storage Unit 120) The storage unit 120 is realized by, for example, a semiconductor memory element such as a RAM or a flash memory, or a storage device such as a hard disk or an optical disk. As shown in Fig. 6 , the storage unit 120 has a model information storage unit 121 and an evaluation information storage unit 122.

[0071] The model information storage unit 121 stores model information that is a candidate for display on the preview screen (screen C1). Fig. 7 shows an example of the model information storage unit 121 according to the embodiment. As shown in Fig. 7, the model information storage unit 121 has items such as "model ID," "captured image," "setting type information," and "model information."

[0072] "Model ID" indicates identification information for identifying a model (user). "Photographed image" indicates a photographed image of the model registered by the model. In the example shown in FIG. 7, conceptual information such as "Photographed image #1" and "Photographed image #2" is stored in "Photographed image," but in reality, image data or the like is stored. For example, a uniform resource locator (URL) where the image data is located or a file path name indicating the storage location may be stored. "Setting type information" indicates the model's own type information set by the model. In the example shown in FIG. 7, conceptual information such as "Setting type information #1" and "Setting type information #2" is stored in "Setting type information," but in reality, information such as "Face type: Fresh; Hair type: Straight; ..." is stored. "Model information" indicates model information related to the model, such as the model's following relationship and purchase history. In the example shown in Figure 7, conceptual information such as "Model Information #1" and "Model Information #2" is stored in "Model Information", but in reality, information such as "Following: User P111, User P112, ...; Followers: User P211, User P212, ...; Purchase History: Product F1, Product F2, ...; ..." is stored.

[0073] The evaluation information storage unit 122 stores evaluation information made by posters (e.g., evaluation information indicating how well makeup suits a person). An example of the evaluation information storage unit 122 according to the embodiment is shown in FIG. 8. As shown in FIG. 8, the evaluation information storage unit 122 has items such as "evaluation information ID," "poster ID," "model ID," and "evaluation information."

[0074] "Evaluation information ID" indicates identification information for identifying the evaluation information. "Contributor ID" indicates identification information for identifying the contributor who made the evaluation. "Model ID" indicates identification information for identifying the evaluated model. "Evaluation information" indicates the evaluation information of the contributor. In the example shown in Figure 8, conceptual information such as "Evaluation information #1" and "Evaluation information #2" is stored in "Evaluation information," but in reality, information such as a combination of makeup information applied to the model and the contributor's evaluation (suits, does not suit, etc.) is stored.

[0075] (Control Unit 130) The control unit 130 is a controller, and is realized, for example, by a CPU, an MPU, or the like, executing various programs stored in a storage device inside the information processing device 100 using RAM as a work area. The control unit 130 is also realized, for example, by an integrated circuit such as an ASIC or an FPGA.

[0076] 6, the control unit 130 has an acquisition unit 131, an identification unit 132, an extraction unit 133, a first display unit 134, a generation unit 135, a second display unit 136, and a determination unit 137, and realizes or executes the information processing functions described below. Note that the internal configuration of the control unit 130 is not limited to the configuration shown in FIG. 6, and may be any other configuration that performs the information processing described below.

[0077] (Acquisition Unit 131) The acquisition unit 131 acquires various pieces of information from an external information processing device. The acquisition unit 131 acquires various pieces of information from other information processing devices such as the terminal device 10.

[0078] The acquisition unit 131 acquires various pieces of information from the storage unit 120. The acquisition unit 131 also stores the acquired various pieces of information in the storage unit 120.

[0079] The acquisition unit 131 acquires a photographed image of the poster to which the fashion measure has been applied. The acquisition unit 131 also acquires thumbnail images of models who are candidates for applying the fashion measure. The acquisition unit 131 also acquires selection information selected by the poster from the thumbnail images. The acquisition unit 131 also acquires evaluation information if the poster has made an evaluation.

[0080] (Identification unit 132) The identification unit 132 identifies makeup information of a poster by extracting mask information from the photographed image of the poster. For example, the identification unit 132 identifies makeup information by extracting mask information from the photographed image acquired by the acquisition unit 131.

[0081] (Extraction Unit 133) The extraction unit 133 extracts at least one thumbnail image of a model who is a candidate for applying a fashion measure based on a predetermined condition. For example, the extraction unit 133 extracts at least one thumbnail image of a model who is a candidate for applying a fashion measure based on a predetermined condition from among the thumbnail images of models who are candidates for applying a fashion measure and which have been acquired by the acquisition unit 131. For example, the extraction unit 133 extracts at least one thumbnail image of a model who is a candidate for applying a fashion measure in order of the model's highest rating indicating how well makeup suits the model (the more highly rated the model is, the more likely it is to extract at least one thumbnail image of a model who is a candidate for applying a fashion measure). Furthermore, for example, the extraction unit 133 extracts at least one thumbnail image of a model who is a candidate for applying a fashion measure in order of the model's facial type similar to that of the follower (the more similar the model's facial type is, the more likely it is to extract at least one thumbnail image of a model who is a candidate for applying a fashion measure). Furthermore, for example, the extraction unit 133 extracts at least one thumbnail image of a model who is a candidate for applying a fashion measure in order of the model's highest number of logins (the more frequently the model's number of logins is, the more likely it is to extract at least one thumbnail image of a model).

[0082] (First display unit 134) The first display unit 134 displays thumbnail images of models who are candidates for applying the fashion measure. For example, the first display unit 134 displays thumbnail images extracted by the extraction unit 133 (at least one thumbnail image extracted based on a predetermined condition). The first display unit 134 may also perform the extraction process of the extraction unit 133.

[0083] The first display unit 134 preferentially displays thumbnail images on the preview screen in a predetermined display mode (for example, in a predetermined display mode determined by the determination unit 137 described below). The first display unit 134 may also perform the determination process of the determination unit 137 described below. The first display unit 134, for example, preferentially displays thumbnail images of models highly rated for how well makeup suits them. For example, the first display unit 134 preferentially displays thumbnail images of models highly rated for how well makeup suits them from among the thumbnail images extracted by the extraction unit 133. For example, the first display unit 134 preferentially displays thumbnail images of models highly rated for how well makeup suits them by sorting the thumbnail images extracted by the extraction unit 133 in descending order of the ratings indicating how well makeup suits them. The first display unit 134 preferentially displays thumbnail images of models highly rated for how well makeup suits them for each of the subdivided face types.

[0084] For example, the first display unit 134 preferentially displays thumbnail images of models whose facial type is similar to that of the poster. For example, the first display unit 134 preferentially displays thumbnail images of models whose facial type is similar to that of the poster from among the thumbnail images extracted by the extraction unit 133. For example, the first display unit 134 preferentially displays thumbnail images of models whose facial type is similar to that of the poster by sorting the thumbnail images extracted by the extraction unit 133 in order of similarity of facial type to that of the poster.

[0085] The first display unit 134, for example, based on the poster's follower information, preferentially displays thumbnail images of models with a high proportion of followers who have a specific face type. For example, if a specific face type is prevalent among the face types of followers, the first display unit 134 preferentially displays thumbnail images of models with the specific face type. Furthermore, the first display unit 134, for example, based on the model's login information, preferentially displays thumbnail images of models with a specific face type and a high proportion of logins. For example, if a specific face type is prevalent among the face types of models with a high proportion of logins, the first display unit 134 preferentially displays thumbnail images of models with the specific face type. Furthermore, for example, if there are multiple specific face types prevalent among the face types of models with a high proportion of logins, the first display unit 134 preferentially displays thumbnail images of models with the specific face type for each of the subdivisions of the face type.

[0086] (Generation unit 135) The generation unit 135 generates an image to which a fashion measure has been applied. For example, the generation unit 135 generates an image in which a fashion measure has been applied to a thumbnail image selected by a poster, based on the selection information acquired by the acquisition unit 131. For example, the generation unit 135 uses a method such as PSGAN to generate fashion measure information for generating an image to which a fashion measure similar to the fashion measure of the poster has been applied. For example, the generation unit 135 generates an image in which the generated fashion measure information has been applied to a model.

[0087] (Second display unit 136) The second display unit 136 displays an image to which the fashion measure has been applied. For example, the second display unit 136 displays an image (an image to which the fashion measure has been applied) generated by the generation unit 135. Furthermore, the second display unit 136 may perform the generation process of the generation unit 135.

[0088] (Determination Unit 137) The determination unit 137 determines a predetermined display mode for displaying thumbnail images on the preview screen (for example, determines a predetermined display mode for preferential display by the first display unit 134). For example, the determination unit 137 determines the display mode of thumbnail images when displaying them in a predetermined area (area R1) on the screen C1. That is, for example, the determination unit 137 determines thumbnail images to be displayed on the preview screen. For example, the determination unit 137 determines that thumbnail images of models with high ratings indicating how well they look with makeup are to be preferentially displayed. For example, the determination unit 137 determines thumbnail images to be preferentially displayed by sorting the images in descending order of the ratings indicating how well they look with makeup. For example, the determination unit 137 determines a display mode of thumbnail images in which models with higher ratings indicating how well they look with makeup are preferentially displayed by sorting the images in descending order of the ratings indicating how well they look with makeup.

[0089] The determination unit 137 determines, for example, to preferentially display thumbnail images of models whose facial type is similar to the poster. For example, the determination unit 137 determines thumbnail images to be preferentially displayed by sorting the images in order of similarity of facial type to the poster. For example, the determination unit 137 determines a display mode of thumbnail images such that the more similar the facial type to the poster is, the more preferentially displayed the thumbnail images are by sorting the images in order of similarity of facial type to the poster. Furthermore, the determination unit 137 determines, for example, to preferentially display thumbnail images of models whose proportion of followers has a specific facial type. For example, the determination unit 137 determines thumbnail images whose proportion of followers has a specific facial type by sorting the images in order of the highest proportion of followers has a specific facial type. For example, the determination unit 137 determines a display mode of thumbnail images such that the higher the proportion of followers has a specific facial type, the more preferentially displayed the thumbnail images are by sorting the images in order of the highest proportion of followers has a specific facial type. Furthermore, the determination unit 137 determines to preferentially display thumbnail images of models whose proportion of logins to models whose facial type is a specific type is high. For example, the determination unit 137 determines thumbnail images to be preferentially displayed by sorting the images in descending order of the proportion of the number of logins of models with a specific face type. For example, the determination unit 137 determines a display mode of thumbnail images in which models with a specific face type have a higher proportion of the number of logins, by sorting the images in descending order of the proportion of the number of logins of models with a specific face type.

[0090] 5. Information Processing Flow Next, the information processing procedure by the information processing system 1 according to the embodiment will be described with reference to Fig. 9 and Fig. 10. Fig. 9 and Fig. 10 are flowcharts showing the information processing procedure by the information processing system 1 according to the embodiment. Fig. 9 is a flowchart showing the information processing procedure including processing for extracting thumbnail images of a model based on predetermined conditions, and Fig. 10 is a flowchart showing the information processing procedure including processing for preferentially displaying (rearranging to the top) thumbnail images of a model based on a predetermined display mode.

[0091] 9 , the information processing device 100 acquires an image captured by a poster to which a fashion measure has been applied (step S201). The information processing device 100 extracts at least one thumbnail image of a model that is a candidate for applying the fashion measure based on predetermined conditions (step S202). The information processing device 100 displays the extracted thumbnail image on a preview screen (step S203).

[0092] The information processing device 100 determines whether the poster has selected a thumbnail image (step S204). If the poster has selected a thumbnail image (step S204; YES), the information processing device 100 generates an image to which the fashion measure has been applied (step S205). The information processing device 100 displays the generated image on a preview screen (step S206). On the other hand, if the poster has not selected a thumbnail image (step S204; NO), the information processing device 100 ends information processing. In this case, the poster may post without confirming the application of the fashion measure.

[0093] 10 , the information processing device 100 acquires an image captured by a poster to which a fashion measure has been applied (step S301). The information processing device 100 extracts at least one thumbnail image of a model that is a candidate for applying the fashion measure (step S302). The information processing device 100 preferentially displays the extracted thumbnail image on the preview screen in a predetermined display mode (step S303).

[0094] The information processing device 100 determines whether the poster has selected a thumbnail image (step S304). If the poster has selected a thumbnail image (step S304; YES), the information processing device 100 generates an image to which the fashion measure has been applied (step S305). The information processing device 100 displays the generated image on a preview screen (step S306). On the other hand, if the poster has not selected a thumbnail image (step S304; NO), the information processing device 100 ends information processing. In this case, the poster may post without confirming the application of the fashion measure.

[0095] 6. Effects As described above, the information processing device 100 according to the embodiment includes the acquisition unit 131, the first display unit 134, and the second display unit 136. The acquisition unit 131 acquires images captured by the poster to which the fashion measure has been applied. The first display unit 134 displays at least one thumbnail image of a model to which the fashion measure is applied. When the poster designates a thumbnail image, the second display unit 136 displays an image in which the fashion measure has been applied to the model.

[0096] This allows the information processing apparatus 100 according to the embodiment to check, for example, whether a fashion campaign is likely to lead to conversions before posting.

[0097] In addition, the first display unit 134 determines the display mode of thumbnail images such that thumbnail images with a higher rating indicating the degree to which a fashion measure suits a type of a predetermined part of the model's appearance are displayed with higher priority.

[0098] As a result, the information processing apparatus 100 according to the embodiment can check, before posting, the type of model that is likely to lead to conversions, taking into account the degree to which the fashion campaign suits the model, for example.

[0099] Furthermore, the first display unit 134 determines a display mode of thumbnail images such that the higher the evaluation for each of the sub-types of the predetermined portion, the higher the priority of the displayed thumbnail images.

[0100] As a result, the information processing apparatus 100 according to the embodiment can subdivide the type of a predetermined part, such as a face type, and check the type of model that is likely to lead to conversions before posting.

[0101] The first display unit 134 also determines the display mode of thumbnail images such that the more similar the type of a specific part of appearance is to the poster, the more prioritized the images are displayed.

[0102] As a result, the information processing apparatus 100 according to the embodiment can check, before posting, whether or not the fashion campaign is likely to lead to conversions, taking into account, for example, the degree of similarity in type with the poster.

[0103] Furthermore, the first display unit 134 determines a display mode in which thumbnail images of models are preferentially displayed based on follower information of the poster.

[0104] As a result, the information processing apparatus 100 according to the embodiment can check, before posting, whether or not the fashion campaign is likely to lead to conversions, for example, by taking into account follower information of the poster.

[0105] Furthermore, when a specific type is more prevalent among the types of predetermined features related to the appearance of the poster's followers, the first display unit 134 determines a display mode in which thumbnail images of models of the specific type are preferentially displayed.

[0106] As a result, the information processing apparatus 100 according to the embodiment can check, before posting, the type of model that is likely to lead to conversions, for example, by taking into account the proportion of a specific type of follower of the poster.

[0107] Furthermore, the first display unit 134 determines a display mode in which thumbnail images of the model are preferentially displayed based on the login information of the model.

[0108] As a result, the information processing apparatus 100 according to the embodiment can check, before posting, whether the fashion campaign is likely to lead to conversions, for example, by taking into account the login information of the model.

[0109] Furthermore, when the proportion of logins of models of a specific type among types of predetermined appearance features is high, the first display unit 134 determines a display mode in which thumbnail images of models of the specific type are preferentially displayed.

[0110] As a result, the information processing apparatus 100 according to the embodiment can check, before posting, the type of model that is likely to lead to conversions, for example, by taking into account the proportion of the number of logins of models of a specific type.

[0111] 7. Hardware Configuration The terminal device 10 and the information processing device 100 according to the above-described embodiments are realized, for example, by a computer 1000 configured as shown in Fig. 11. Fig. 11 is a hardware configuration diagram showing an example of a computer that realizes the functions of the terminal device 10 and the information processing device 100. The computer 1000 has a CPU 1100, a RAM 1200, a ROM 1300, a HDD 1400, a communication interface (I / F) 1500, an input / output interface (I / F) 1600, and a media interface (I / F) 1700.

[0112] The CPU 1100 operates and controls each unit based on programs stored in the ROM 1300 or the HDD 1400. The ROM 1300 stores a boot program executed by the CPU 1100 when the computer 1000 starts up, programs that depend on the hardware of the computer 1000, and the like.

[0113] The HDD 1400 stores programs executed by the CPU 1100, data used by such programs, etc. The communication interface 1500 acquires data from other devices via a predetermined communication network and sends it to the CPU 1100, and transmits data generated by the CPU 1100 to other devices via the predetermined communication network.

[0114] The CPU 1100 controls output devices such as a display and a printer, and input devices such as a keyboard and a mouse, via the input / output interface 1600. The CPU 1100 acquires data from the input devices via the input / output interface 1600. The CPU 1100 also outputs generated data to the output devices via the input / output interface 1600.

[0115] Media interface 1700 reads a program or data stored in recording medium 1800 and provides it to CPU 1100 via RAM 1200. CPU 1100 loads the program or data from recording medium 1800 onto RAM 1200 via media interface 1700 and executes the loaded program. Recording medium 1800 is, for example, an optical recording medium such as a DVD (Digital Versatile Disc) or a PD (Phase Change Rewritable Disc), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory.

[0116] For example, when the computer 1000 functions as the terminal device 10 and the information processing device 100 according to the embodiment, the CPU 1100 of the computer 1000 executes programs loaded onto the RAM 1200 to realize the functions of the control units 14 and 130. The CPU 1100 of the computer 1000 reads and executes these programs from the recording medium 1800, but as another example, the CPU 1100 may obtain these programs from another device via a predetermined communication network.

[0117] [8. Other] Furthermore, among the processes described in the above embodiments, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically using known methods. In addition, the information including the processing procedures, specific names, various data, and parameters shown in the above documents and drawings can be changed as desired unless otherwise specified. For example, the various information shown in each drawing is not limited to the information shown in the drawings.

[0118] Furthermore, the components of each device shown in the figure are conceptual functional components and do not necessarily have to be physically configured as shown in the figure. In other words, the specific form of distribution and integration of each device is not limited to that shown in the figure, and all or part of them can be functionally or physically distributed and integrated in any unit depending on various loads, usage conditions, etc.

[0119] Furthermore, the above-described embodiments can be combined as appropriate within the scope of not causing any contradiction in the processing content.

[0120] Although some of the embodiments of the present application have been described in detail above with reference to the drawings, these are merely examples, and the present invention can be implemented in other forms that include the embodiments described in the Disclosure of the Invention section and that have been modified and improved in various ways based on the knowledge of those skilled in the art.

[0121] Furthermore, the above-mentioned "section, module, unit" can be read as "means" or "circuit," etc. For example, an acquisition unit can be read as an acquisition means or an acquisition circuit.

[0122] REFERENCE SIGNS LIST 1 Information processing system 10 Terminal device 11 Communication unit 12 Input unit 13 Output unit 14 Control unit 100 Information processing device 110 Communication unit 120 Storage unit 121 Model information storage unit 122 Evaluation information storage unit 130 Control unit 131 Acquisition unit 132 Identification unit 133 Extraction unit 134 First display unit 135 Generation unit 136 Second display unit 137 Determination unit 141 Reception unit 142 Transmission unit N Network

Claims

1. An information processing device comprising: an acquisition unit that acquires an image taken by a poster to which a fashion measure has been applied; a first display unit that displays at least one thumbnail image of a model to which the fashion measure has been applied; and a second display unit that, when the poster designates the thumbnail image, displays an image in which the fashion measure has been applied to the model.

2. The information processing device according to claim 1, characterized in that the first display unit determines the display manner of the thumbnail images so that the thumbnail images with a higher evaluation indicating the degree to which the fashion measure suits a specific type of appearance of the model are displayed preferentially.

3. The information processing device according to claim 2, characterized in that the first display unit determines the display mode of the thumbnail images for each of the subdivided types of the specified part so that the higher the evaluation, the higher the priority of the displayed thumbnail images.

4. The information processing device according to claim 1, characterized in that the first display unit determines the display mode of the thumbnail images so that the more similar the type of a specified part of appearance to the poster, the more prioritized the images are displayed.

5. The information processing device according to claim 1, characterized in that the first display unit determines a display mode in which the thumbnail image of the model is preferentially displayed based on follower information of the poster.

6. The information processing device described in claim 5, characterized in that the first display unit determines a display mode in which, when a specific type is more prevalent among the types of specific features related to the appearance of the poster's followers, the thumbnail images of the models of that specific type are displayed preferentially.

7. The information processing device according to claim 1, characterized in that the first display unit determines a display mode in which the thumbnail image of the model is preferentially displayed based on the login information of the model.

8. The information processing device according to claim 7, characterized in that the first display unit determines a display mode in which, when the proportion of logins of models of a specific type among types of predetermined appearance features is high, the thumbnail images of the models of that specific type are displayed preferentially.

9. An information processing method executed by a computer, comprising: an acquisition step of acquiring an image taken by a poster to which a fashion measure has been applied; a first display step of displaying at least one thumbnail image of a model to which the fashion measure has been applied; and a second display step of displaying an image in which the fashion measure has been applied to the model when the poster designates the thumbnail image.

10. An information processing program that causes a computer to execute the following steps: an acquisition step of acquiring an image taken by a poster to which a fashion measure has been applied; a first display step of displaying at least one thumbnail image of a model to which the fashion measure has been applied; and a second display step of displaying an image in which the fashion measure has been applied to the model when the poster designates the thumbnail image.

Images