Information processing device, information processing method and information processing program

Abstract

To provide an information processing device allowing posters to determine whether or not a fashion initiative is likely to lead to conversion before posting.SOLUTION: An information processing device includes an acquisition unit, a first display unit, and a second display unit. The acquisition unit acquires a captured image of a poster to which a fashion initiative has been applied. The first display unit displays at least one thumbnail image of a model to which the fashion initiative is applied. When the poster specifies the thumbnail image, the second display unit displays an image, with the fashion initiative applied to the model.SELECTED DRAWING: Figure 6

Description

[Technical Field]

[0001] The present invention relates to an information processing device, an information processing method, and an information processing program. [Background technology]

[0002] Conventionally, a technique for displaying an image to which a fashion measure such as makeup of a poster has been applied is known. For example, a technique for displaying an image of a user to which a fashion measure has been applied by a user specifying an image taken by the poster is known. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 7308317 [Non-patent literature]

[0004] [Non-Patent Document 1] W. Jiang, S. Liu, C. Gao, J. Cao, R. He, J. Feng, S. Yan “PSGAN: Pose and Expression Robust Spatial-Aware CAN for Customizable Makeup Transfer”, [online], [Retrieved April 5, 2020], Internet <https: / / openaccess.thecvf.com / content_CVPR_2020 / html / Jiang_PSGAN_Pose_and_Expression_Robust_Spatial-Aware_GAN_for_Customizable_Makeup_CVPR_2020_paper.html> Summary of the Invention [Problem to be solved by the invention]

[0005] However, while conventional technologies can promote improved usability for users, there is room for further improvement to promote improved usability for contributors. For example, conventional technologies have room for further improvement to make it easier for contributors to satisfy their desire for financial or psychological recognition, such as wanting to share their fashion initiatives with others. Furthermore, conventional technologies have room for further improvement to enable contributors to determine, before posting, whether a fashion initiative is likely to lead to conversions.

[0006] The present application has been made in consideration of the above, and aims to enable posters to determine, before posting, whether a fashion measure is likely to lead to conversions. [Means for solving the problem]

[0007] The information processing device of the present application is characterized by having an acquisition unit that acquires an image taken by a poster to which a fashion measure has been applied, a first display unit that displays at least one thumbnail image of a model to which the fashion measure is applied, and a second display unit that, when the poster specifies the thumbnail image, displays an image of the model to which the fashion measure has been applied. [Effects of the Invention]

[0008] According to one aspect of the embodiment, it is possible to provide an effect that a poster can determine, before posting, whether or not a fashion measure is likely to lead to conversions. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of an information processing system according to an embodiment. [Figure 2A] FIG. 2A is a diagram showing an example of the overall flow of the user interface on the poster's side. [Figure 2B] FIG. 2B is a diagram showing an example of the overall flow of the user interface on the user side. [Figure 3] FIG. 3 is a diagram illustrating an example of information processing according to the embodiment. [Figure 4] FIG. 4 is a diagram illustrating an example of a preview screen according to the embodiment. [Figure 5] FIG. 5 is a diagram illustrating an example of the configuration of a terminal device according to the embodiment. [Figure 6] FIG. 6 is a diagram illustrating an example of the configuration of an information processing device according to the embodiment. [Figure 7] FIG. 7 is a diagram illustrating an example of a model information storage unit according to the embodiment. [Figure 8] FIG. 8 is a diagram illustrating an example of an evaluation information storage unit according to the embodiment. [Figure 9] FIG. 9 is a flowchart (1) showing an example of information processing according to the embodiment. [Figure 10] FIG. 10 is a flowchart (2) showing an example of information processing according to the embodiment. [Figure 11] FIG. 11 is a hardware configuration diagram illustrating an example of a computer that realizes the functions of the information processing device. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, an information processing device, an information processing method, and an information processing program according to the present application (hereinafter referred to as "embodiments") will be described in detail with reference to the drawings. Note that the information processing device, the information processing method, and the information processing program according to the present application are not limited to these embodiments. Furthermore, the same components in the following embodiments will be denoted by the same reference numerals, and duplicated descriptions will be omitted.

[0011] (Embodiment) [1. Information Processing System Configuration] An information processing system 1 shown in Fig. 1 will be described. As shown in Fig. 1, the information processing system 1 includes a terminal device 10 and an information processing device 100. The terminal device 10 and the information processing device 100 are connected to each other via a predetermined communication network (network N) so as to be able to communicate with each other via wired or wireless communication. Fig. 1 is a diagram showing an example of the configuration of the information processing system 1 according to an embodiment.

[0012] The terminal device 10 is an information processing device used by a poster who wishes to spread their own fashion initiatives (makeup, etc.) to others via SNS or the like. A poster who uses the terminal device 10 is, for example, an influencer who disseminates their own fashion initiatives using the Internet. For example, an influencer who distributes videos related to the fashion initiatives they implement. The terminal device 10 may be any device that can realize the processing in the embodiment. Furthermore, the terminal device 10 may be a device such as a smartphone, a tablet device, a notebook PC, a desktop PC, a mobile phone, or a PDA. FIG. 3 shows a case where the terminal device 10 is a smartphone.

[0013] The terminal device 10 is, for example, a smart device such as a smartphone or tablet, and is a portable terminal device capable of communicating with any server device via a wireless communication network such as 3G to 5G (Generation) or LTE (Long Term Evolution). The terminal device 10 may have a screen such as a liquid crystal display with a touch panel function, and may accept various operations on displayed data such as content, such as tapping, sliding, and scrolling, performed by a contributor using a finger or a stylus. In FIG. 3, the terminal device 10 is used by a contributor U1.

[0014] The information processing device 100 is an information processing device that aims to facilitate satisfaction of a poster's desire for financial or psychological recognition, such as wanting to share their fashion measures with others, and to enable the poster to determine before posting whether a fashion measure is likely to lead to conversions, thereby promoting improved usability for the poster. The information processing device 100 may be any device capable of implementing the processes described in the embodiments. For example, the information processing device 100 is realized by a server device, a cloud system, or the like that provides a predetermined service (which may be a web service or an app service) that enables posting (registering) and trying on of fashion measures. In the following embodiment, service W1 will be used as an example of such a service. That is, service W1 is a predetermined service that enables posting and trying on of fashion measures.

[0015] [2. An example of information processing] There are times when a user wants to spread their fashion campaign to others. Also, in order to spread their fashion campaign to others, they may want to determine before posting what kind of fashion campaign they should take to lead to conversions (for example, whether it will lead to a purchase or whether they will try on the item). However, with conventional technology, it has not been possible to determine, for example, what kind of fashion campaign they should take to lead to conversions among their followers, etc., before posting.

[0016] The present application has been made in consideration of the above, and aims to make it easier for posters to satisfy their desire for financial or psychological recognition, such as wanting to spread their own fashion initiatives to others, and to enable posters to determine before posting whether a fashion initiative is likely to lead to conversions.

[0017] In the following embodiments, the application of a fashion measure is not limited to an actual action, but may also include a virtual action. That is, the action may be an actual action that the poster performs in the real world, or an action that the poster performs virtually via an avatar or the like.

[0018] In the following embodiments, a case where a poster posts facial makeup will be described as an example of a fashion measure; however, the fashion measure does not have to be limited to facial makeup. The fashion measure may be, for example, hair makeup (hair makeup) such as hairstyle and hair color (hair color), or may be not limited to makeup but may be trying on (trying on may be actual trying on in the real world or virtual trying on) and coordinating clothes (clothing is not limited to one-piece dresses and the like, but may also be, for example, shoes, socks, accessories, watches, jewelry, etc.). In the following embodiments, the process on the poster's side who posts the fashion measure will be described, rather than the process on the user's side who applies the fashion measure. Note that the poster who posts the fashion measure, for example, photographs (scans) the face after the fashion measure and registers the items used. Furthermore, the user who applies the fashion measure, for example, specifies the poster's posting information, tries on the fashion measure (such as full makeup), and if they like it, purchases the items used (the items used in the full makeup).

[0019] FIG. 2A is a diagram showing an example of the overall flow of the user interface on the poster's side. When poster U1 clicks "Register" at the bottom of the first screen from the left, the screen transitions to the second screen from the left. After reading the notes and agreeing to the terms of use (if it is their first time), the screen transitions to the third screen from the left. After taking photos of their face from multiple angles on the makeup photo capture screen, the screen transitions to the fourth screen from the left. After checking the preview screen to see how the captured makeup will look when tried on, the screen transitions to the fifth screen from the left. Then, on this screen, they enter a thumbnail image and text to post, link the items used, and post, and the posted information is made public.

[0020] FIG. 2B is a diagram showing an example of the overall flow of the user interface on the user side. When user P1 selects a makeup style that interests them on the first screen from the left, the screen transitions to the second screen from the left. When user P1 operates "Try Makeup" on this screen, the screen transitions to the third screen from the left. On this screen, user P1 can try on the registered makeup styles on their own face and check the items used. Furthermore, when user P1 operates "HOW TO" on the second screen from the left, the screen transitions to the fourth screen from the left. On this screen, it is possible to watch an explanatory video on the makeup style. For example, a web view may be launched within the app and the video may be played.

[0021] FIG. 3 is a diagram illustrating an example of information processing in the information processing system 1 according to the embodiment. FIG. 3 illustrates an example of information processing on the side of a poster who posts a fashion campaign. The poster U1 uploads his / her makeup information to a predetermined service (service W1) provided by the information processing device 100 (step S11). The makeup information may be, for example, information (such as a still image) capturing the poster's makeup, or information (such as a video) explaining how to apply makeup, such as the order and volume of the makeup. The makeup information may also be, for example, mask information, which is makeup applied to the poster's face, or cosmetic information linked to the posted information. The mask information may be information about the poster's face after makeup, or information about the makeup itself obtained by calculating the difference between the poster's face after makeup and the poster's bare face. The poster U1, for example, uploads a facial image of his / her face with makeup applied to the service W1. At this time, the poster U1 may, for example, register the items used for the makeup, linked to his / her makeup information. For example, the information processing device 100 may cause the poster U1 to register items used in the makeup so as to be linked to the makeup information applied by the poster U1. In this case, for example, the information processing device 100 may identify the makeup information by extracting mask information from the posted information.

[0022] When a user specifies posted information of poster U1, the information processing device 100 may, for example, perform processing to apply makeup information associated with the posted information to the user's facial image, or may perform processing to enable the purchase of items used in the makeup. Hereinafter, a description will be given using a photographed image G1 (which may be a still image or a moving image) as an example of posted information. For example, when a user P1 (such as a follower of poster U1) who has viewed (watched) the photographed image G1 specifies the photographed image G1, the information processing device 100 may enable the application of makeup information used in capturing the photographed image G1, or may provide a link to a website where the items used can be purchased. Hereinafter, a description will be given of a preview screen (pre-post preview screen) that is displayed when poster U1 uploads a photographed image G1 of his or her makeup to service W1. Note that when poster U1 allows (accepts) the posting (registration) on the preview screen (screen C1), the image is made public and can be viewed. The preview screen is a screen that allows the poster to check the makeup try-on image by applying the makeup to multiple face types (fresh, cute, feminine, cool, and androgynous men, etc.) before taking a photo of themselves applying their makeup and posting it.

[0023] FIG. 4 is a diagram showing an example of a preview screen according to an embodiment. Screen C1 is a preview screen before posting of captured image G1. In other words, it is a preview screen displayed on the poster's side before posting. Screen C1 displays, at the top (main) screen, an image (captured image G1) taken by poster U1 after applying makeup. Screen C1 also includes a button B1 that allows retaking the captured image if the poster U1 wants to change it, and a button B2 that allows the captured image to be posted. When button B1 is operated (clicked, tapped, etc.), the preview screen returns to the capture screen. When the poster U1 takes another photo, the screen returns to the preview screen, and the newly captured image is displayed at the top. When button B2 is operated, captured image G1 is posted. In this case, captured image G1 is made public and can be viewed by followers of poster U1, etc. Here, the posted photographed image G1 may become viewable, or the information posted along with the photographed image G1 (e.g., the items used, etc.) may become viewable, or the information registered in association with the poster U1 (e.g., a thumbnail image registered separately, etc.) may become viewable.

[0024] Screen C1 also includes thumbnail images representing at least one face type. In Fig. 4, from left to right, the screen includes thumbnail image SG1 with a "Fresh" face type, thumbnail image SG2 with a "Cute" face type, thumbnail image SG3 with a "Feminine" face type, thumbnail image SG4 with a "Cool" face type, and thumbnail image SG5 with a "male with androgynous features" face type. In Fig. 4, these thumbnail images SG1 to SG5 are displayed superimposed on the captured image G1. This allows four female face images according to the four types and one male face image with androgynous features to be displayed, allowing the user to try on the captured makeup on each image to see how it looks.

[0025] Furthermore, these thumbnail images SG1 to SG5 are selectable. For example, when thumbnail image SG1 is operated, thumbnail image SG1 is selected. At this time, the makeup information of poster U1 (the makeup information used in photographed image G1) is applied to the face image of thumbnail image SG1. Then, the face image with the makeup information of poster U1 applied to the face image of thumbnail image SG1 is displayed at the top. As a result, poster U1 can check on the preview screen what kind of makeup his / her makeup will actually look like (whether it suits him / her, etc.) on a face type of "Fresh." Similarly, for example, when thumbnail image SG2 is operated, thumbnail image SG2 is selected. At this time, the makeup information of poster U1 is applied to the face image of thumbnail image SG2. Then, the face image with the makeup information of poster U1 applied to the face image of thumbnail image SG2 is displayed at the top. As a result, poster U1 can check on the preview screen what kind of makeup his / her makeup will actually look like on a face type of "Cute." By displaying the preview screen in this way, it is possible to check, for example, what kind of makeup suits what kind of face type, and what kind of face type the poster's makeup actually suits, before posting. It is also possible to check, for example, whether the poster's post will be attractive to users with the target face type, and whether the poster's post will be attractive to followers, before posting. The face images of the models in thumbnail images SG1 to SG5 are selection candidates to which the poster U1 can apply makeup information, and the face image of the model to which the poster U1 has selected a thumbnail image and applied makeup information is displayed at the top of screen C1 (step S12).

[0026] The number of thumbnail images and face types that can be displayed on screen C1 do not have to be limited to this example. They do not have to be limited to the five thumbnail images SG1 to SG5 shown in FIG. 4. For example, a further thumbnail image may be hidden to the right of thumbnail image SG5 and displayed by scrolling. The display manner of these thumbnail images does not have to be limited to the example shown in FIG. 4 and may be displayed in any manner. Furthermore, they do not have to be limited to the face types "Fresh," "Cute," "Feminine," "Cool," or "Androgynous Male." For example, the face type of the thumbnail images displayed on screen C1 may be different each time depending on the face type and makeup information of poster U1. For example, the face type of the thumbnail images displayed on screen C1 may be different each time the poster U1 slightly changes his or her makeup and retakes the photo.

[0027] The process of extracting the face type of the thumbnail images displayed on screen C1 will be explained below. In Figure 4, thumbnail images of five face types, "Fresh," "Cute," "Feminine," "Cool," and "Androgynous Male," are displayed. How these five face types are extracted will be explained.

[0028] The information processing device 100 acquires a captured image to be displayed on the screen C1 (pre-post preview screen) (step S101). In the examples of FIGS. 3 and 4, a captured image G1 is acquired. The information processing device 100 then extracts at least one thumbnail image of a model who is a candidate for applying makeup information based on predetermined conditions (step S102). In the examples of FIGS. 3 and 4, thumbnail images SG1 to SG5 are extracted. The information processing device 100 then displays the extracted thumbnail images in a predetermined area of ​​the screen C1 (so as to be superimposed on the captured image) (step S103). In the examples of FIGS. 3 and 4, the information processing device 100 displays the extracted thumbnail images in an area R1. When a thumbnail image is selected, the information processing device 100 generates a facial image of the model to which makeup information has been applied from the facial image of the model in the thumbnail image (step S104). The information processing device 100 then displays the generated facial image of the model at the top of the screen C1 (step S105).

[0029] In step S104, an example of a method for generating a facial image of a model to which makeup information has been applied is a method called PSGAN (Pose and Expression Robust Spatial-Aware Generative Adversarial Network), which is disclosed in the above-mentioned Non-Patent Document 1, in which only makeup information is transferred from a facial image to another face. This method uses deep learning and can transfer only makeup information to another face regardless of facial expression or pose. Using a method such as PSGAN, the information processing device 100 applies makeup similar to the makeup used by poster U1 in the posted information of poster U1 to the facial image of the model. Specifically, the information processing device 100 generates makeup information for applying makeup similar to the makeup used by poster U1 and applies the generated makeup information to the facial image of the model. Then, in step S105, the information processing device 100 generates a facial image of the model to which makeup information has been applied in this manner, and displays the generated facial image of the model at the top of the screen C1.

[0030] Here, the process of extracting at least one based on predetermined conditions in step S102 will be described. The information processing device 100 performs the extraction process in step S102 based on various conditions. As examples of the extraction process, three patterns will be described: using the degree to which makeup suits the user, using follower information of the poster, and using login information of the model; however, the extraction process is not limited to the following examples.

[0031] (Using the degree to which makeup suits you) The information processing device 100 may perform extraction processing based on, for example, the degree to which makeup suits the face type of the model in the thumbnail image. For example, the information processing device 100 may extract thumbnail images in descending order of the model's evaluation (score) indicating the degree to which the makeup applied by the poster U1 suits them. For example, the information processing device 100 may extract thumbnail images by estimating the degree to which makeup suits the model by performing machine learning on the evaluation made by the poster U1 on the face image of the model to which makeup information has been applied. For example, the information processing device 100 may extract thumbnail images by estimating the degree to which makeup suits the model by using a learning model that has been machine-learned, with a positive example being a case in which the poster U1 has evaluated the face image of the model to which makeup information has been applied as "suitable" and a negative example being an example in which the poster U1 has evaluated the face image of the model to which makeup information has been applied as "unsuitable."

[0032] For example, the information processing device 100 may evaluate the suitability of makeup by having the poster U1 select (or specify) on the screen C1 the face type of a model that the poster U1 has determined suits the poster's makeup and by having the selected face type and makeup information combined and learned. For example, the information processing device 100 may perform machine learning using the combination of the selected face type and makeup information as a positive example, or may perform machine learning using the combination of the unselected face type and makeup information as a negative example. The information processing device 100 may then estimate the suitable face type by inputting makeup information into the learning model thus machine-learned. Furthermore, the information processing device 100 may perform machine learning using information registered on the screen C1 after trying on the makeup as a positive example, without having the poster U1 select the face type of the model.

[0033] For example, the information processing device 100 may extract thumbnail images in the order of models whose face type is similar to that of the poster U1. For example, if the face type of the poster U1 is "Cute," the information processing device 100 may preferentially extract thumbnail images of models whose face type is "Cute."

[0034] (When using the poster's follower information) The information processing device 100 may perform the extraction process based on, for example, the follower information of the poster U1. For example, the information processing device 100 may preferentially extract thumbnail images of models whose facial type is the same as or similar to that of the poster U1's followers. Furthermore, for example, the information processing device 100 may preferentially extract thumbnail images of models whose facial type is of interest or concern to the poster U1's followers. Furthermore, for example, the information processing device 100 may perform the extraction process limited to followers who are estimated to lead to conversions such as purchases or viewings. In this case, for example, the information processing device 100 may estimate the likelihood of conversions such as purchases or viewings using a model that has learned the relationship between a user's try-on history, purchase history, viewing history, etc. and whether the user has achieved a predetermined conversion, such as making a purchase or viewing predetermined content, and then estimate followers who will lead to conversions based on the estimated likelihood of conversions.

[0035] Furthermore, the information processing device 100 may perform the extraction process based on, for example, a facial image of a follower, rather than a model. The information processing device 100 may perform the extraction process based on, for example, a facial image of a model generated based on a facial image of a follower (such as a facial image of a model generated based on a generation AI). In this case, the information processing device 100 may use, for example, a facial image of a follower who has made the most purchases, viewed the most, tried on clothes the most, or had the most followers, or may use an average facial image of multiple followers. This makes it possible to effectively encourage followers to try on clothes, for example, by using a facial image of a follower with a large number of followers.

[0036] (When using the model's login information) The information processing device 100 may perform the extraction process based on, for example, login information (such as the number of logins and whether the user is a new registrant) of candidate models displayed on the screen C1. For example, the information processing device 100 may preferentially extract thumbnail images of models with a higher number of logins. Note that the model may be, for example, a model that is identical to or similar to the facial type of a user with a higher number of logins, a model that is identical to or similar to the facial type that the user with a higher number of logins is interested in, or the user himself / herself. Furthermore, a high number of logins is not limited to a high number of logins and may also include a large number of users. Furthermore, for example, the information processing device 100 may preferentially extract thumbnail images of models that are estimated to be more likely to have makeup information applied by the poster U1 if the poster U1 posts a content. Furthermore, for example, the information processing device 100 may preferentially extract thumbnail images of models that are estimated to be more likely to have the makeup information of the poster U1 applied ... newly registrants to the service W1. Furthermore, for example, the information processing device 100 may preferentially extract thumbnail images of models who have logged in within a predetermined period (for example, recently).

[0037] The above describes the process of extracting thumbnail images of models who are candidates for applying makeup information. For example, the predetermined conditions for extracting thumbnail images have been described. Below, the process of determining the display mode of thumbnail images after such extraction process (such as the display order (sorting order), highlighting, and display of positive information such as face type and follower information) will be described. Specifically, the process of determining the display mode of thumbnail images when displaying thumbnail images in a predetermined area of ​​screen C1 in step S103 will be described. The information processing device 100 determines the display mode of thumbnail images for step S103 based on various conditions. As an example of the display mode determination process, three patterns will be described: a case where the degree to which makeup suits the model is used, a case where the poster's follower information is used, and a case where the model's login information is used, as in the above-described extraction process. However, the present invention is not limited to these examples. Furthermore, descriptions similar to those of the above-described extraction process will be omitted as appropriate.

[0038] (Using the degree to which makeup suits you) The information processing device 100 may perform a process of determining a display mode based on, for example, the degree to which makeup suits the face type of the model in the thumbnail image. For example, the information processing device 100 may determine a display mode such that thumbnail images of models with higher ratings indicating the degree to which the makeup applied by the poster U1 suits them are preferentially displayed (for example, displayed at the top, displayed at the beginning, or highlighted). Furthermore, for example, the information processing device 100 may determine a display mode such that thumbnail images of models with a face type similar to that of the poster U1 are preferentially displayed. Furthermore, the information processing device 100 may perform a process of determining a display mode by subdividing face types (for example, subdividing a face into features such as eyes and lips). In this way, processing may be performed using types based on subdivided face features, rather than types based on the entire face, such as cute or cool. The information processing device 100 may determine a display mode such that thumbnail images of models with higher ratings for each subdivision of face types are preferentially displayed. In this case, the information processing device 100 may determine a display mode such that thumbnail images of models with higher ratings for each subdivision of face types are preferentially displayed, for example, by highlighting the model so that it suits the model, using a pop-up or the like. For example, type determination may be performed using only specific facial features rather than the entire face, and evaluation may be performed using the specific facial features for preferential display. For example, if the specific facial features are the eyes, thumbnail images of models with cute eyes may be displayed on the preview screen along with thumbnail images of models with cool eyes, and if the specific facial features are the lips, thumbnail images of models with cute lips and thumbnail images of models with cool lips may be displayed on the preview screen. In this case, for example, in order to display thumbnail images of models with cute eyes on the preview screen, only thumbnail images of models with cute eyes may be extracted and displayed, and in order to display thumbnail images of models with cool eyes on the preview screen, only thumbnail images of models with cool eyes may be extracted and displayed.

[0039] (When using the poster's follower information) The information processing device 100 may perform a process of determining the display mode based on, for example, follower information of the poster U1. For example, the information processing device 100 may perform a process of determining the display mode based on the facial types of the poster U1's followers. For example, the information processing device 100 may determine the display mode such that thumbnail images of models whose facial types are the same as or similar to those of the poster U1's followers are preferentially displayed. Furthermore, for example, the information processing device 100 may perform a process of determining the display mode based on the proportion of facial types of the poster U1's followers. For example, if the proportion of the poster U1's followers whose facial types are "cute," the information processing device 100 may determine the display mode such that thumbnail images of "cute" models are preferentially displayed. Furthermore, for example, if the proportion of the poster U1's followers whose facial types are "cute" is high, the information processing device 100 may determine the display mode such that thumbnail images of "cute" models are preferentially displayed. Furthermore, for example, if the proportion of the poster U1's followers whose facial types are "cute," the information processing device 100 may determine the display mode such that thumbnail images of "cute" models are preferentially displayed. Furthermore, for example, when there are multiple face types with high proportions, the information processing device 100 may subdivide the face types and perform the process of determining the display mode.

[0040] At this time, the information processing device 100 may determine to highlight the follower type, for example, by using a pop-up or the like. For example, the information processing device 100 may determine to highlight the follower's face type (indicating that it is the follower's face type) by using a pop-up or the like, or may determine to highlight the number of followers for each face type. For example, the information processing device 100 may determine to highlight the thumbnail image by changing the color or thickness of the frame. At this time, the information processing device 100 may also determine to prioritize the display so that the face types with high conversion rates (such as the likelihood of trying on clothes) are displayed at the top. This allows the poster U1 to check followers who are highly engaged. Furthermore, the information processing device 100 may determine to notify followers who match the face type selected by the poster U1 that new makeup information has been posted when the poster U1 posts makeup information.

[0041] Furthermore, the information processing device 100 may determine to highlight the follower's face image instead of the model's face image, for example. The information processing device 100 may determine to highlight the follower's face image by displaying a model's face image generated based on the follower's face image (such as a model's face image generated based on a generation AI). In this case, the information processing device 100 may use the face image of the follower who has made the most purchases, viewed the most, tried on the most clothes, or had the most followers, or may use the average face image of multiple followers. This makes it possible to effectively encourage followers to try on clothes by using the face image of a follower with a large number of followers, for example.

[0042] (When using the model's login information) The information processing device 100 may perform a display mode determination process based on, for example, login information of a candidate model displayed on the screen C1. For example, the information processing device 100 may perform a display mode determination process based on the number of logins of the model. As in the case of the extraction process described above, the model may be, for example, a model whose face type is the same as or similar to the face type of a user with a high number of logins, a model whose face type is the same as or similar to the face type that the user with a high number of logins is interested in, or the user himself / herself. Furthermore, a high number of logins does not necessarily mean a high number of logins, but may also include a large number of users. For example, the information processing device 100 may determine a display mode such that thumbnail images of models with a face type that accounts for a higher proportion of the model's logins are displayed preferentially. Furthermore, for example, when there are multiple face types with a high proportion of the model's logins (e.g., when there are multiple face types that exceed a predetermined threshold), the information processing device 100 may perform a display mode determination process by subdividing the face types. In this case, the information processing device 100 may determine to highlight the face type by displaying, for example, a pop-up message saying, "High likelihood of trying on makeup!" Furthermore, for example, the information processing device 100 may determine the display mode so that thumbnail images of models who are new registrants to the service W1 are preferentially displayed.

[0043] The process of determining the display mode of the thumbnail images has been described above. After determining the display mode of the thumbnail images, the information processing device 100 displays the thumbnail images in a predetermined area on the screen C1 in the determined display mode.

[0044] (Information processing variation 1: Fashion measures) In the above embodiment, makeup has been described as an example of a fashion measure, but the example is not particularly limited. For example, it may be hair and makeup such as hairstyle and hair color, or trying on and coordinating clothes. This makes it possible to select a model that suits the hair and makeup posted by poster U1, or to select a model by subdividing the hair and makeup posted by poster U1.

[0045] (Information processing variation 2: Friend setting) In the above embodiment, the model for the thumbnail image is described as a follower of poster U1, but the present invention is not limited to this example. The model for the thumbnail image may be, for example, only users who have a predetermined relationship with poster U1. For example, it may be only users who have permitted sharing (e.g., users who have been set as friends). This allows only the faces of users who have permitted sharing to be displayed on the preview screen, making it possible to provide a service that can be enjoyed only by friends. Furthermore, the model for the thumbnail image may be, for example, only followers of poster U1 who are estimated to be likely to purchase or view the content.

[0046] (Information processing variation 3: Models likely to be tried on) In the above embodiment, an example has been described in which thumbnail images of models who are likely to try on the item are displayed at the top. In this case, the models who are likely to try on the item may be, for example, users who have posted within a predetermined period of time to a predetermined service (social commerce) that allows users to post and view fashion coordinations.

[0047] (Information processing variation 4: Model face image (actual / selected / estimated)) In the above embodiment, an example has been described in which the model of the thumbnail image is a follower of poster U1, i.e., a real model, but the present invention is not particularly limited to this example. The model of the thumbnail image does not have to be a real model, and may be, for example, a model generated by a generation AI or the like. In other words, the thumbnail image does not have to be a facial image of a real model, and may be, for example, a facial image of a model generated by a generation AI or the like. For example, it may be a facial image of a model generated based on follower information of poster U1. For example, it may be a facial image of a model generated by taking a weighted average based on the number of followers of poster U1.

[0048] In addition, there may be cases where there is no facial image of a model that can be used as a thumbnail image. For example, there may be followers of poster U1 who have not registered their facial images. In this case, for example, if a user, such as a follower of poster U1, has registered facial information such as their face type, the weighting may be changed based on the facial information registered by the user. That is, the thumbnail image may be, for example, a facial image of a model generated based on a weighting changed based on the facial information registered by the user. Furthermore, the facial image of a model may be, for example, a facial image estimated based on user-augmented information such as the user's following relationships or purchase history. In this way, the facial image of a model may be an actually photographed facial image, a facial image based on facial information selected by the user, or a facial image estimated based on user-augmented information.

[0049] (Information Processing Variation 5: Other Functions of the Preview Screen) In the above embodiment, for example, an operation button that enables the application of a fashion measure to be turned on and off may be displayed on the screen C1. This makes it possible to turn on and off makeup information applied to the poster's facial image with a single operation (such as one click or one tap) via the operation button. In addition, in the above embodiment, for example, an explanatory guide for first-time users may be displayed on the screen C1. In addition, in the above embodiment, for example, it may be possible to enlarge or reduce the facial image in response to the poster's operation on the screen C1. In addition, in the above embodiment, for example, it may be possible to adjust the density of the facial image in response to the poster's operation on the screen C1. For example, it may be possible to adjust the density for each part of the face using a user interface such as a slider.

[0050] (Information Processing Variation 6: Other Functions of the Preview Screen) In the above embodiment, for example, a button for automatically generating a description related to the face type of the thumbnail image may be displayed on the preview screen. For example, when an image is selected, a button for automatically generating a description such as "This makeup looks good on your XX type, so please try it on" may be displayed. Also, in the above embodiment, for example, tags related to face types may be linked and automatically registered on the preview screen to make it easier to search for makeup information from the tags.

[0051] In the above embodiment, for example, the frame of the thumbnail image on the preview screen may be shaped according to the face type of each model. For example, if there are many round faces, the frame may be round, and if there are many basic faces, the frame may be basic. The shape may also be according to the characteristics of each model's face type. This makes it possible to determine each model's face type from the frame, thereby reducing the burden of checking the preview when registering.

[0052] In the above embodiment, for example, instead of selection according to face type, selection according to the purpose of makeup (for example, a date, a wedding, a girls' night out, etc.) may be allowed. For example, selection may be made from options using different clothes and backgrounds depending on the purpose. In this case, for example, the face types of the thumbnail images may be the same or different depending on the purpose. In other words, the face type may be the same but the clothes and background may be different depending on the purpose, or the clothes and background may be different for each face type depending on the purpose.

[0053] In the above embodiment, for example, the density may be adjusted on the preview screen and then registered, and when trying on, the density may be set to the base value.

[0054] In the above embodiment, for example, face types for which there is little registration of makeup information that suits them may be preferentially extracted or displayed. It is also possible to display the fact that there is little registration in an easily understandable manner without prioritizing extraction or display. This makes it easier for even posters with few followers (such as posters who are difficult to select) to try on their registered makeup information, and promotes this function by allowing makeup information that suits various face types to be registered. It is also possible to suggest which face type of makeup information should be registered not on the preview screen but on the screen for photographing a face with makeup or on the screen prior to that, or to suggest which face type of makeup information should be changed on the preview screen, or to suggest which makeup information is recommended for registering next time makeup information when makeup information is registered.

[0055] In the above embodiment, for example, a case where one preview screen is displayed has been described as an example, but in the above embodiment, multiple preview screens may be displayed. For example, when multiple thumbnail images are selected, the multiple preview screens may be displayed simultaneously, side by side, or split into left and right halves and displayed separately.

[0056] In the above embodiment, for example, if the degree of suitability can be displayed, the degree of suitability may be included in the display. Also, for example, the user may be asked to evaluate which looks better and the comparison results may be learned. This makes it possible to achieve highly accurate learning.

[0057] (Information Processing Variation 7: Providing Incentives) In the above embodiment, for example, an incentive may be given to the poster when the post leads to trying on clothes, browsing of the product after trying on clothes, purchase of the product after trying on clothes, or reactivation of a dormant follower. For example, when the post leads to a purchase of a product, electronic money or points that can be used for payment at an online shopping mall selling the product may be given. This makes it possible to encourage the poster to post with conversion in mind.

[0058] (Information Processing Variation 8: Display Control) In the above embodiment, for example, an example was given of a case where display control is performed after extracting a thumbnail image, but in the above embodiment, display control may also be performed by fixing the model without extracting a thumbnail image.

[0059] (Information Processing Variation 9: Automatic Display) In the above embodiment, for example, a case has been described in which the poster specifies a thumbnail image to which the fashion measure is to be applied. However, in the above embodiment, instead of the poster selecting a thumbnail image, the thumbnail image may be automatically applied to a model with the most suitable face type or a model with the face type of a follower, and displayed to the poster.

[0060] [3. Configuration of terminal device] Next, the configuration of the terminal device 10 according to the embodiment will be described with reference to Fig. 5. Fig. 5 is a diagram showing an example of the configuration of the terminal device 10 according to the embodiment. As shown in Fig. 5, the terminal device 10 has a communication unit 11, an input unit 12, an output unit 13, and a control unit 14.

[0061] (Communications Department 11) The communication unit 11 is realized by, for example, a network interface card (NIC) etc. The communication unit 11 is connected to a predetermined network N by wire or wirelessly, and transmits and receives information to and from the information processing device 100 etc. via the predetermined network N.

[0062] (Input section 12) The input unit 12 accepts various operations from posters. In FIG. 3, the input unit 12 accepts various operations from poster U1. For example, the input unit 12 may accept various operations from the poster via a display screen using a touch panel function. The input unit 12 may also accept various operations from buttons provided on the terminal device 10 or a keyboard or mouse connected to the terminal device 10.

[0063] (Output section 13) The output unit 13 is a display screen of a tablet terminal or the like realized by, for example, a liquid crystal display, an organic EL (Electro-Luminescence) display, etc., and is a display device for displaying various information. For example, the output unit 13 displays information transmitted from the information processing device 100.

[0064] (Control unit 14) The control unit 14 is, for example, a controller, and is realized by a CPU (Central Processing Unit), an MPU (Micro Processing Unit), or the like executing various programs stored in a storage device inside the terminal device 10 using RAM (Random Access Memory) as a work area. For example, these various programs include application programs installed in the terminal device 10. For example, these various programs include an application program that displays a preview screen of posted information including thumbnail images of models who are candidates for applying a fashion measure, based on information transmitted from the information processing device 100. The control unit 14 is also realized by an integrated circuit, for example, an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

[0065] As shown in FIG. 5, the control unit 14 has a receiving unit 141 and a transmitting unit 142, and realizes or executes the information processing operations described below.

[0066] (Receiving unit 141) The receiving unit 141 receives various information from other information processing devices such as the information processing device 100. For example, the receiving unit 141 receives information for displaying a preview screen of posted information including a thumbnail image of a model who is a candidate for applying a fashion measure.

[0067] (Transmitter 142) The transmission unit 142 transmits various types of information to other information processing devices such as the information processing device 100. For example, the transmission unit 142 transmits selection information selected by the poster from among thumbnail images displayed together with the posted information. Furthermore, for example, when the poster evaluates how well makeup suits them, the transmission unit 142 transmits evaluation information.

[0068] 4. Configuration of Information Processing Device Next, the configuration of the information processing device 100 according to the embodiment will be described with reference to Fig. 6. Fig. 6 is a diagram showing an example of the configuration of the information processing device 100 according to the embodiment. As shown in Fig. 6, the information processing device 100 has a communication unit 110, a storage unit 120, and a control unit 130. Note that the information processing device 100 may also have an input unit (e.g., a keyboard, a mouse, etc.) that accepts various operations from an administrator of the information processing device 100, and a display unit (e.g., a liquid crystal display, etc.) that displays various information.

[0069] (Communication unit 110) The communication unit 110 is realized by, for example, a NIC etc. The communication unit 110 is connected to a network N by wire or wirelessly, and transmits and receives information to and from the terminal device 10 etc. via the network N.

[0070] (Storage unit 120) The storage unit 120 is realized by, for example, a semiconductor memory element such as a RAM or a flash memory, or a storage device such as a hard disk or an optical disk. As shown in FIG. 6 , the storage unit 120 has a model information storage unit 121 and an evaluation information storage unit 122.

[0071] The model information storage unit 121 stores model information that is a candidate to be displayed on the preview screen (screen C1). An example of the model information storage unit 121 according to the embodiment is shown in Fig. 7. As shown in Fig. 7, the model information storage unit 121 has items such as "model ID," "captured image," "setting type information," and "model information."

[0072] "Model ID" indicates identification information for identifying a model (user). "Photographed image" indicates a photographed image of the model registered by the model. In the example shown in FIG. 7, conceptual information such as "Photographed image #1" and "Photographed image #2" is stored in "Photographed image," but in reality, image data or the like is stored. For example, a uniform resource locator (URL) where the image data is located or a file path name indicating the storage location may be stored. "Setting type information" indicates the type information set by the model. In the example shown in FIG. 7, conceptual information such as "Setting type information #1" and "Setting type information #2" is stored in "Setting type information," but in reality, information such as "Face type: Fresh; Hair type: Straight; ..." is stored. "Model information" indicates model information related to the model, such as the model's following relationships and purchase history. In the example shown in Figure 7, conceptual information such as "Model Information #1" and "Model Information #2" is stored in "Model Information," but in reality, information such as "Following: User P111, User P112, ...; Followers: User P211, User P212, ...; Purchase History: Product F1, Product F2, ...; ..." is stored.

[0073] The evaluation information storage unit 122 stores evaluation information made by posters (e.g., evaluation information indicating how well makeup suits a person). FIG. 8 shows an example of the evaluation information storage unit 122 according to the embodiment. As shown in FIG. 8, the evaluation information storage unit 122 has items such as "evaluation information ID," "poster ID," "model ID," and "evaluation information."

[0074] "Evaluation information ID" indicates identification information for identifying the evaluation information. "Contributor ID" indicates identification information for identifying the contributor who made the evaluation. "Model ID" indicates identification information for identifying the evaluated model. "Evaluation information" indicates the evaluation information of the contributor. In the example shown in Figure 8, conceptual information such as "Evaluation information #1" and "Evaluation information #2" is stored in "Evaluation information," but in reality, information such as a combination of makeup information applied to the model and the contributor's evaluation (looks good, doesn't look good, etc.) is stored.

[0075] (control unit 130) The control unit 130 is a controller, and is realized by, for example, a CPU, an MPU, or the like executing various programs stored in a storage device inside the information processing device 100 using RAM as a work area. The control unit 130 is also realized by, for example, an integrated circuit such as an ASIC or an FPGA.

[0076] 6, control unit 130 has an acquisition unit 131, an identification unit 132, an extraction unit 133, a first display unit 134, a generation unit 135, a second display unit 136, and a determination unit 137, and realizes or executes the information processing action described below. Note that the internal configuration of control unit 130 is not limited to the configuration shown in FIG. 6, and may be any other configuration that performs the information processing described below.

[0077] (Acquisition part 131) The acquisition unit 131 acquires various pieces of information from an external information processing device. The acquisition unit 131 acquires various pieces of information from other information processing devices such as the terminal device 10.

[0078] The acquiring unit 131 acquires various pieces of information from the storage unit 120. The acquiring unit 131 also stores the acquired various pieces of information in the storage unit 120.

[0079] The acquisition unit 131 acquires a photographed image of the poster to which the fashion measure has been applied. The acquisition unit 131 also acquires thumbnail images of models who are candidates for applying the fashion measure. The acquisition unit 131 also acquires selection information selected by the poster from among the thumbnail images. The acquisition unit 131 also acquires evaluation information if the poster has made an evaluation.

[0080] (Specific Section 132) The identification unit 132 identifies the makeup information of the poster by extracting mask information from the photographed image of the poster. For example, the identification unit 132 identifies the makeup information by extracting mask information from the photographed image acquired by the acquisition unit 131.

[0081] (Extraction part 133) The extraction unit 133 extracts at least one thumbnail image of a model who is a candidate for applying a fashion measure based on a predetermined condition. For example, the extraction unit 133 extracts at least one thumbnail image of a model who is a candidate for applying a fashion measure based on a predetermined condition from among the thumbnail images of models who are candidates for applying a fashion measure acquired by the acquisition unit 131. For example, the extraction unit 133 extracts at least one thumbnail image of a model who is a candidate for applying a fashion measure in order of a model's highest rating indicating how well makeup suits the model (at least one thumbnail image of a model with a higher rating indicating how well makeup suits the model is preferentially extracted). Furthermore, for example, the extraction unit 133 extracts at least one thumbnail image of a model who is a candidate for applying a fashion measure in order of a model's facial type similar to that of followers (at least one thumbnail image of a model with a more similar facial type to that of followers is preferentially extracted). Furthermore, for example, the extraction unit 133 extracts at least one thumbnail image of a model who is a candidate for applying a fashion measure in order of a model's number of logins (at least one thumbnail image of a model with a more frequent logins is preferentially extracted).

[0082] (First display section 134) The first display unit 134 displays thumbnail images of models who are candidates for applying the fashion measure. For example, the first display unit 134 displays thumbnail images extracted by the extraction unit 133 (at least one thumbnail image extracted based on a predetermined condition). The first display unit 134 may also perform the extraction process of the extraction unit 133.

[0083] The first display unit 134 preferentially displays the thumbnail images on the preview screen in a predetermined display mode (for example, in a predetermined display mode determined by the determination unit 137 described below). The first display unit 134 may also perform the determination process of the determination unit 137 described below. The first display unit 134, for example, preferentially displays thumbnail images of models highly rated for how well makeup suits them. For example, the first display unit 134 preferentially displays thumbnail images of models highly rated for how well makeup suits them from among the thumbnail images extracted by the extraction unit 133. For example, the first display unit 134 preferentially displays thumbnail images of models highly rated for how well makeup suits them by sorting the thumbnail images extracted by the extraction unit 133 in descending order of the ratings indicating how well makeup suits them. The first display unit 134 preferentially displays thumbnail images of models highly rated for how well makeup suits them, for example, for each of the subdivided face types.

[0084] For example, the first display unit 134 preferentially displays thumbnail images of models whose facial type is similar to that of the poster. For example, the first display unit 134 preferentially displays thumbnail images of models whose facial type is similar to that of the poster from among the thumbnail images extracted by the extraction unit 133. For example, the first display unit 134 preferentially displays thumbnail images of models whose facial type is similar to that of the poster by rearranging the thumbnail images extracted by the extraction unit 133 in order of similarity of facial type to that of the poster.

[0085] For example, based on the poster's follower information, the first display unit 134 preferentially displays thumbnail images of models with a high proportion of followers who have a specific face type. For example, if a specific face type is prevalent among the face types of followers, the first display unit 134 preferentially displays thumbnail images of models with the specific face type. Furthermore, for example, based on the model's login information, the first display unit 134 preferentially displays thumbnail images of models with a specific face type and a high proportion of logins. For example, if a specific face type is prevalent among the face types of models with a high proportion of logins, the first display unit 134 preferentially displays thumbnail images of models with the specific face type. Furthermore, for example, if there are multiple specific face types prevalent among the face types of models with a high proportion of logins, the first display unit 134 preferentially displays thumbnail images of models with the specific face type for each of the subdivisions of the face type.

[0086] (Generation unit 135) The generation unit 135 generates an image to which a fashion measure has been applied. For example, the generation unit 135 generates an image to which a fashion measure has been applied to a thumbnail image selected by a poster, based on the selection information acquired by the acquisition unit 131. For example, the generation unit 135 generates fashion measure information for generating an image to which a fashion measure similar to the fashion measure of the poster has been applied, using a method such as PSGAN. For example, the generation unit 135 generates an image to which the generated fashion measure information has been applied to a model.

[0087] (Second display section 136) The second display unit 136 displays an image to which the fashion measure has been applied. For example, the second display unit 136 displays an image (an image to which the fashion measure has been applied) generated by the generation unit 135. Furthermore, the second display unit 136 may perform the generation process of the generation unit 135.

[0088] (Decision unit 137) The determination unit 137 determines a predetermined display mode for displaying thumbnail images on the preview screen (for example, determines a predetermined display mode for preferential display by the first display unit 134). For example, the determination unit 137 determines a display mode for thumbnail images when displaying them in a predetermined area (area R1) on the screen C1. That is, for example, the determination unit 137 determines thumbnail images to be displayed on the preview screen. For example, the determination unit 137 determines that thumbnail images of models with high ratings indicating how well they look with makeup are to be preferentially displayed. For example, the determination unit 137 determines thumbnail images to be preferentially displayed by sorting them in descending order of ratings indicating how well they look with makeup. For example, the determination unit 137 determines a display mode for thumbnail images in which models with higher ratings indicating how well they look with makeup are displayed preferentially by sorting them in descending order of ratings indicating how well they look with makeup.

[0089] The determination unit 137 determines, for example, to preferentially display thumbnail images of models whose facial type is similar to the poster. For example, the determination unit 137 determines thumbnail images to be preferentially displayed by sorting the images in order of similarity between the poster and the facial type. For example, the determination unit 137 determines a display mode of thumbnail images such that the more similar the poster and the facial type are, the more preferentially displayed the thumbnail images are, by sorting the images in order of similarity between the poster and the facial type. Furthermore, the determination unit 137 determines, for example, to preferentially display thumbnail images of models whose proportion of followers has a specific facial type. For example, the determination unit 137 determines thumbnail images whose proportion of followers has a specific facial type by sorting the images in order of the highest proportion of followers has a specific facial type. For example, the determination unit 137 determines a display mode of thumbnail images such that the higher the proportion of followers has a specific facial type, the more preferentially displayed the thumbnail images are, by sorting the images in order of the highest proportion of followers has a specific facial type. Furthermore, the determination unit 137 determines to preferentially display thumbnail images of models whose proportion of logins to models whose facial type is a specific type are, by sorting the images in order of the highest proportion of followers has a specific facial type. For example, the determination unit 137 determines thumbnail images to be preferentially displayed by sorting the images in descending order of the proportion of the number of logins of models with a specific face type. For example, the determination unit 137 determines a display mode of thumbnail images in which models with a specific face type are preferentially displayed as they have a higher proportion of the number of logins of models with a specific face type, by sorting the images in descending order of the proportion of the number of logins of models with a specific face type.

[0090] [5. Information Processing Flow] Next, the procedure of information processing by the information processing system 1 according to the embodiment will be described with reference to Fig. 9 and Fig. 10. Fig. 9 and Fig. 10 are flowcharts showing the procedure of information processing by the information processing system 1 according to the embodiment. Fig. 9 is a flowchart showing the procedure of information processing including processing for extracting thumbnail images of models based on predetermined conditions, and Fig. 10 is a flowchart showing the procedure of information processing including processing for preferentially displaying (rearranging to the top) thumbnail images of models based on a predetermined display mode.

[0091] 9, the information processing device 100 acquires an image taken by a poster to which a fashion measure has been applied (step S201). The information processing device 100 extracts at least one thumbnail image of a model that is a candidate for applying the fashion measure based on a predetermined condition (step S202). The information processing device 100 displays the extracted thumbnail image on a preview screen (step S203).

[0092] The information processing device 100 determines whether the poster has selected a thumbnail image (step S204). If the poster has selected a thumbnail image (step S204; YES), the information processing device 100 generates an image to which the fashion measure has been applied (step S205). The information processing device 100 displays the generated image on a preview screen (step S206). On the other hand, if the poster has not selected a thumbnail image (step S204; NO), the information processing device 100 ends information processing. In this case, the poster may post without confirming the application of the fashion measure.

[0093] 10, the information processing device 100 acquires an image taken by a poster to which a fashion measure has been applied (step S301). The information processing device 100 extracts at least one thumbnail image of a model that is a candidate for applying the fashion measure (step S302). The information processing device 100 preferentially displays the extracted thumbnail image on the preview screen in a predetermined display mode (step S303).

[0094] The information processing device 100 determines whether the poster has selected a thumbnail image (step S304). If the poster has selected a thumbnail image (step S304; YES), the information processing device 100 generates an image to which the fashion measure has been applied (step S305). The information processing device 100 displays the generated image on a preview screen (step S306). On the other hand, if the poster has not selected a thumbnail image (step S304; NO), the information processing device 100 ends information processing. In this case, the poster may post without confirming the application of the fashion measure.

[0095] [6. Effects] As described above, the information processing device 100 according to the embodiment includes the acquisition unit 131, the first display unit 134, and the second display unit 136. The acquisition unit 131 acquires an image captured by a poster to which a fashion measure has been applied. The first display unit 134 displays at least one thumbnail image of a model to which the fashion measure is applied. When the poster designates a thumbnail image, the second display unit 136 displays an image in which the fashion measure has been applied to the model.

[0096] As a result, the information processing apparatus 100 according to the embodiment can, for example, check whether or not a fashion measure is likely to lead to conversions before posting.

[0097] Furthermore, first display unit 134 determines the display mode of thumbnail images such that thumbnail images with a higher rating indicating the degree to which a fashion measure suits a type of a predetermined part of the model's appearance are displayed with higher priority.

[0098] As a result, the information processing apparatus 100 according to the embodiment can check, before posting, the type of model that is likely to lead to conversions, taking into account the degree to which the fashion campaign suits the model, for example.

[0099] Furthermore, first display unit 134 determines the display mode of thumbnail images such that the higher the evaluation for each of the subdivided types of the predetermined portion, the higher the priority of display.

[0100] As a result, the information processing apparatus 100 according to the embodiment can subdivide the type of a predetermined part, such as a face type, and check the type of model that is likely to lead to conversions before posting.

[0101] Furthermore, first display unit 134 determines the display mode of thumbnail images such that the more similar the type of a predetermined part of appearance is to the poster, the more prioritized the images are displayed.

[0102] As a result, the information processing apparatus 100 according to the embodiment can check, before posting, whether or not the fashion measure is likely to lead to conversions, taking into account, for example, the degree of similarity in type with the poster.

[0103] Furthermore, first display unit 134 determines a display mode in which thumbnail images of models are preferentially displayed based on follower information of the poster.

[0104] As a result, the information processing apparatus 100 according to the embodiment can check, before posting, whether or not the fashion campaign is likely to lead to conversions, for example, by taking into account follower information of the poster.

[0105] Furthermore, when a specific type is more prevalent among the types of predetermined parts related to the appearance of the poster's followers, first display unit 134 determines a display mode in which thumbnail images of models of the specific type are preferentially displayed.

[0106] As a result, the information processing apparatus 100 according to the embodiment can check, before posting, the type of model that is likely to lead to conversions, for example, by taking into account the proportion of a specific type of follower of the poster.

[0107] Furthermore, the first display unit 134 determines a display mode in which thumbnail images of the model are preferentially displayed based on the login information of the model.

[0108] As a result, the information processing apparatus 100 according to the embodiment can check, before posting, whether or not the fashion campaign is likely to lead to conversions, for example, by taking into account the login information of the model.

[0109] Furthermore, when the proportion of logins of models of a specific type among types of predetermined appearance features is high, first display unit 134 determines a display mode in which thumbnail images of models of the specific type are preferentially displayed.

[0110] As a result, the information processing apparatus 100 according to the embodiment can check, before posting, the type of model that is likely to lead to conversions, for example, by taking into consideration the proportion of the number of logins of models of a specific type.

[0111] [7. Hardware Configuration] The terminal device 10 and the information processing device 100 according to the above-described embodiments are realized, for example, by a computer 1000 configured as shown in Fig. 11. Fig. 11 is a hardware configuration diagram showing an example of a computer that realizes the functions of the terminal device 10 and the information processing device 100. The computer 1000 has a CPU 1100, a RAM 1200, a ROM 1300, an HDD 1400, a communication interface (I / F) 1500, an input / output interface (I / F) 1600, and a media interface (I / F) 1700.

[0112] The CPU 1100 operates and controls each unit based on programs stored in the ROM 1300 or the HDD 1400. The ROM 1300 stores a boot program executed by the CPU 1100 when the computer 1000 starts up, programs that depend on the hardware of the computer 1000, and the like.

[0113] The HDD 1400 stores programs executed by the CPU 1100, data used by these programs, etc. The communication interface 1500 acquires data from other devices via a predetermined communication network and sends it to the CPU 1100, and transmits data generated by the CPU 1100 to other devices via the predetermined communication network.

[0114] The CPU 1100 controls output devices such as a display and a printer, and input devices such as a keyboard and a mouse, via the input / output interface 1600. The CPU 1100 acquires data from the input devices via the input / output interface 1600. The CPU 1100 also outputs generated data to the output devices via the input / output interface 1600.

[0115] Media interface 1700 reads a program or data stored in recording medium 1800 and provides it to CPU 1100 via RAM 1200. CPU 1100 loads the program or data from recording medium 1800 onto RAM 1200 via media interface 1700 and executes the loaded program. Recording medium 1800 is, for example, an optical recording medium such as a DVD (Digital Versatile Disc) or a PD (Phase Change Rewritable Disc), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory.

[0116] For example, when the computer 1000 functions as the terminal device 10 and the information processing device 100 according to the embodiment, the CPU 1100 of the computer 1000 executes programs loaded onto the RAM 1200 to realize the functions of the control units 14 and 130. The CPU 1100 of the computer 1000 reads and executes these programs from the recording medium 1800, but as another example, the CPU 1100 may obtain these programs from another device via a predetermined communication network.

[0117] [8. Other] Furthermore, among the processes described in the above embodiments, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically using known methods. In addition, the information including the processing procedures, specific names, various data, and parameters shown in the above documents and drawings can be changed as desired unless otherwise specified. For example, the various information shown in each drawing is not limited to the information shown in the drawings.

[0118] Furthermore, the components of each device shown in the figure are conceptual functional components and do not necessarily have to be physically configured as shown in the figure. In other words, the specific form of distribution and integration of each device is not limited to that shown in the figure, and all or part of them can be functionally or physically distributed and integrated in any unit depending on various loads, usage conditions, etc.

[0119] Furthermore, the above-described embodiments can be combined as appropriate within the scope of not causing any contradiction in the processing content.

[0120] Although some of the embodiments of the present application have been described in detail above with reference to the drawings, these are merely examples, and the present invention can be implemented in other forms that include the embodiments described in the Disclosure of the Invention section and that have undergone various modifications and improvements based on the knowledge of those skilled in the art.

[0121] Furthermore, the above-mentioned "section, module, unit" can be read as "means" or "circuit," etc. For example, an acquisition unit can be read as an acquisition means or an acquisition circuit.

[0122] The present technology can also be configured as follows. (1) an acquisition unit that acquires a photographed image of a poster to which the fashion measure has been applied; a first display unit that extracts and displays at least one thumbnail image of a model that is a candidate for applying the fashion measure based on a predetermined condition; a second display unit that displays an image in which the fashion measure is applied to the model when the contributor designates the thumbnail image; An information processing device comprising: (2) The first display unit is The thumbnail images are extracted and displayed based on an evaluation indicating the degree to which the fashion measure suits a type of a predetermined part of the model's appearance. The information processing device according to (1) above. (3) The first display unit is The thumbnail images of the models whose appearances are similar to those of the poster are extracted and displayed. The information processing device according to (1) above. (4) The first display unit is The thumbnail image of the model is extracted and displayed based on follower information of the poster. The information processing device according to (1) above. (5) The first display unit is The thumbnail images of the models whose types are similar to those of the followers of the poster and the predetermined part are extracted and displayed. The information processing device according to (3) above. (6) The first display unit is Extracting and displaying the thumbnail image of the model based on the model's login information The information processing device according to (1) above. (7) The first display unit is The thumbnail image of the model estimated to be likely to try on the fashion campaign is extracted and displayed. The information processing device according to (5) above. (8) 1. A computer-implemented information processing method, comprising: an acquisition step of acquiring an image taken by the poster to which the fashion measure has been applied; a first display step of extracting and displaying at least one thumbnail image of a model that is a candidate for applying the fashion measure based on predetermined conditions; a second display step of displaying an image in which the fashion measure is applied to the model when the contributor designates the thumbnail image; An information processing method comprising: (9) A procedure for acquiring images taken by a poster to which the fashion campaign has been applied; a first display step of extracting and displaying at least one thumbnail image of a model that is a candidate for applying the fashion measure based on a predetermined condition; a second display step of displaying an image in which the fashion measure is applied to the model when the contributor designates the thumbnail image; An information processing program characterized by causing a computer to execute the above. [Explanation of symbols]

[0123] 1. Information Processing Systems 10 Terminal Equipment 11 Communications Department 12 Input section 13 Output section 14 Control Unit 100 Information processing device 110 Communications Department 120 Storage section 121 Model information storage unit 122 Evaluation information storage unit 130 control section 131 Acquisition Department 132 Specific part 133 Extraction part 134 1st display section 135 Generation part 136 2nd display section 137 Decision Section 141 Receiving unit 142 Transmitter N Network

Claims

1. an acquisition unit that acquires a photographed image of a poster to which the fashion measure has been applied; a first display unit that displays at least one thumbnail image of a model to which the fashion measure is applied; a second display unit that displays an image in which the fashion measure is applied to the model when the contributor designates the thumbnail image; An information processing device comprising:

2. The first display unit A display mode of the thumbnail images is determined so that thumbnail images with a higher evaluation indicating the degree to which the fashion measure suits a type of a predetermined part of the model's appearance are preferentially displayed.

2. The information processing apparatus according to claim 1, wherein:

3. The first display unit The display mode of the thumbnail images is determined so that the higher the evaluation, the higher the priority for displaying the thumbnail images for each of the subdivided types of the predetermined portion.

3. The information processing apparatus according to claim 2, wherein:

4. The first display unit A display mode of the thumbnail images is determined so that the more similar the type of a predetermined part of the appearance of the poster is, the higher the priority of display.

2. The information processing apparatus according to claim 1, wherein:

5. The first display unit A display mode for preferentially displaying the thumbnail image of the model is determined based on follower information of the poster.

2. The information processing apparatus according to claim 1, wherein:

6. The first display unit If a specific type of model is more prevalent among the types of predetermined parts of the appearance of the poster's followers, a display mode is determined in which the thumbnail images of the models of the specific type are preferentially displayed.

6. The information processing apparatus according to claim 5,

7. The first display unit A display mode for preferentially displaying the thumbnail image of the model is determined based on the login information of the model.

2. The information processing apparatus according to claim 1, wherein:

8. The first display unit When the ratio of the number of logins of models of a specific type is high among types of predetermined parts related to appearance, a display mode is determined in which the thumbnail images of the models of the specific type are preferentially displayed.

8. The information processing apparatus according to claim 7,

9. 1. A computer-implemented information processing method, comprising: an acquisition step of acquiring an image taken by the poster to which the fashion measure has been applied; a first display step of displaying at least one thumbnail image of a model to which the fashion measure is applied; a second display step of displaying an image in which the fashion measure is applied to the model when the contributor designates the thumbnail image; An information processing method comprising:

10. A procedure for acquiring images taken by a poster to which the fashion campaign has been applied; a first display step of displaying at least one thumbnail image of a model to which the fashion measure is applied; a second display step of displaying an image in which the fashion measure is applied to the model when the contributor designates the thumbnail image; An information processing program characterized by causing a computer to execute the above.

Images