Information processing device, information processing method and information processing program
The information processing device addresses the challenge of understanding user fashion preferences by selecting and displaying images with similar or dissimilar attributes based on index values, enhancing personalized recommendations and user convenience.
Patent Information
- Application Number
- JP2023106244
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-06-28
- Publication Date
- 2025-01-17
- Estimated Expiration
- 2043-06-28
AI Technical Summary
Conventional methods struggle to fully understand a user's fashion preferences across various attributes of selected images, making it difficult to make personalized recommendations.
An information processing device that acquires image information from user selections, selects and displays images with similar or dissimilar attributes based on index values, and estimates user preferences by tracking selection patterns.
Enhances personalized recommendations by accurately reflecting user preferences, improving user convenience and reducing the need for extensive image browsing.
Smart Images

Figure 2025005845000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to an information processing device, an information processing method, and an information processing program. [Background technology]
[0002] Conventionally, there is known a technique for grasping a user's favorite fashion style. For example, when a user selects one of the fashion style images, a transition is made to another screen, and the user is prompted to select a fashion style image from among the fashion style images that are different from the selected fashion style, thereby grasping the user's favorite fashion style. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Patent No. 6085017 Summary of the Invention [Problem to be solved by the invention]
[0004] However, with conventional technology, when a user selects a fashion style image, the user's preferences are identified across the entire range of attributes set for the selected image, making it impossible to fully understand the user's preferences.
[0005] The present application has been made in consideration of the above, and aims to make suggestions that take into account the preferences of users. [Means for solving the problem]
[0006] The information processing device according to the present application is characterized in having an acquisition unit that acquires image information of an image selected by a user from a list of images in which an index value is assigned to each of a plurality of indexes, a selection unit that selects, based on the image information acquired by the acquisition unit, an image to be newly presented to the user from among the image selected by the user and images having similar index values for at least one of the plurality of indexes and dissimilar index values for at least one of the plurality of indexes, and a display unit that suggests the image selected by the selection unit to the user by displaying the image selected by the selection unit as a candidate. Effect of the Invention
[0007] According to one aspect of the embodiment, it is possible to provide an effect that suggestions taking into account the preferences of a user can be made. [Brief description of the drawings]
[0008] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of an information processing system according to an embodiment. [Diagram 2] FIG. 2 is a diagram illustrating an example of information processing according to the embodiment. [Diagram 3] FIG. 3 is a diagram illustrating an example of a UI screen according to the embodiment. [Figure 4] FIG. 4 is a diagram illustrating an example of a UI screen according to the embodiment. [Diagram 5] FIG. 5 is a diagram illustrating an example of the configuration of a user terminal according to the embodiment. [Figure 6] FIG. 6 is a diagram illustrating an example of the configuration of the information processing device according to the embodiment. [Figure 7] FIG. 7 is a diagram illustrating an example of an image information storage unit according to the embodiment. [Figure 8] FIG. 8 is a diagram illustrating an example of a preference information storage unit according to the embodiment. [Figure 9] FIG. 9 is a flowchart illustrating an example of information processing according to the embodiment. [Figure 10]FIG. 10 is a hardware configuration diagram illustrating an example of a computer that realizes the functions of the information processing device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0009] Hereinafter, the information processing device, the information processing method, and the information processing program according to the present application will be described in detail with reference to the drawings. Note that the information processing device, the information processing method, and the information processing program according to the present application are not limited to the embodiments. In addition, the same parts in the following embodiments are given the same reference numerals, and duplicated explanations are omitted.
[0010] (Embodiment) [1. Configuration of information processing system] An information processing system 1 shown in Fig. 1 will be described. As shown in Fig. 1, the information processing system 1 includes a user terminal 10 and an information processing device 100. The user terminal 10 and the information processing device 100 are connected to each other via a predetermined communication network (network N) so as to be able to communicate with each other via wired or wireless communication. Fig. 1 is a diagram showing an example of the configuration of the information processing system 1 according to an embodiment.
[0011] The user terminal 10 is an information processing device used by a user who wishes to use (or is already using) a predetermined service. The predetermined service includes, for example, a predetermined e-commerce service where a user can purchase fashion items (including clothes, underwear, shoes, caps, hats, bags, accessories, cosmetics, etc.), and a predetermined coordination service where a user can post and view images related to fashion, such as fashion coordination images and makeup images. The user terminal 10 may be any device that can realize the processing in the embodiment. In addition, the user terminal 10 may be a device such as a smartphone, a tablet terminal, a notebook PC, a desktop PC, a mobile phone, or a PDA. FIG. 2 shows a case where the user terminal 10 is a smartphone.
[0012] The user terminal 10 is, for example, a smart device such as a smartphone or a tablet, and is a mobile terminal device capable of communicating with any server device via a wireless communication network such as 3G to 5G (Generation) or LTE (Long Term Evolution). The user terminal 10 has a screen such as a liquid crystal display with a touch panel function, and may receive various operations on displayed data such as content, such as tapping, sliding, scrolling, etc., performed by a user's finger or a stylus. In FIG. 2, the user terminal 10 is used by a user U1.
[0013] The information processing device 100 is an information processing device intended to make suggestions taking into account the preferences of a user, and may be any device capable of implementing the processes in the embodiment. The information processing device 100 is implemented, for example, by a server device or a cloud system that provides a predetermined electronic commerce service that allows the purchase of fashion items and the like.
[0014] [2. An example of information processing] FIG. 2 is a diagram showing an example of information processing of the information processing system 1 according to the embodiment. In the following embodiment, the user U1 is a user who uses a predetermined service for the first time. For example, the user U1 is a user who installs a predetermined application to use the predetermined service and uses the predetermined application for the first time. In the following embodiment, a case where an image related to fashion (for example, an image related to fashion coordination, an image related to makeup, or an image related to fashion items) is displayed on a UI screen for grasping the user's fashion (for example, fashion coordination, makeup, or fashion items) preferences is described as an example, but grasping the user's preferences is not limited to fashion and may be anything, and the image displayed on the UI screen may be an image targeting any genre. In addition, the products that can be purchased in a predetermined online shopping mall are not limited to fashion and may be anything. In addition, the fashion items according to the embodiment are not limited to clothes, and may be, for example, accessories such as rings, earrings, necklaces, and watches, bags, hats, shoes, etc., and may not be particularly limited. In addition, FIG. 3 and FIG. 4 are diagrams showing an example of a UI screen according to the embodiment. In the following embodiment, the information processing of FIG. 2 is described using FIG. 3 and FIG. 4.
[0015] When the user U1 is a user who uses a predetermined service for the first time, the information processing device 100 transitions to the UI screen of the content C1 (see FIG. 3). For example, when the user U1 inputs user information such as the user's attributes (gender, age, search history, browsing history, purchase history, etc. in other predetermined services) for the first time in order to use the predetermined service, the information processing device 100 transitions to the UI screen of the content C1. The content C1 includes images related to fashion for allowing the user to select a fashion that he or she likes. The content C1 is a content in which images are displayed in three horizontal rows, and when the user scrolls the screen vertically, images arranged in positions according to the scroll are displayed. For example, the content C1 is a content in which, when the user scrolls the screen vertically to the bottom, images arranged near the bottom are displayed in three horizontal rows. The images displayed in the content C1 are arranged in an order according to the attributes of the user. For example, when the user is a woman in her twenties, images related to fashion that is likely to be liked by women in their twenties are displayed with a higher priority. For example, images related to fashion that is likely to be liked by women in their twenties are arranged closer to the top (top side) of the content C1. Also, the closer to the bottom (bottom side) of the content C1 an image is related to a fashion that is less likely to be liked by women in their twenties. Here, the information processing device 100 may, for example, in a predetermined coordination service, estimate that an image related to a style that is more frequently posted by women in their twenties is an image related to a fashion that is more likely to be liked by women in their twenties, or estimate that an image related to a style that is more frequently viewed by women in their twenties is an image related to a fashion that is more likely to be liked by women in their twenties, but is not limited to this. The information processing device 100 may estimate that an image introduced in a predetermined fashion magazine as an image related to a style that is more likely to be liked by women in their twenties is an image related to a fashion that is more likely to be liked by women in their twenties.
[0016] The information processing device 100 determines the priority of each image displayed in the content C1 based on the attribute information of the user U1. Then, the information processing device 100 displays the content C1 by arranging each image in a position according to the determined priority. For example, the information processing device 100 displays the content C1 by arranging each image in descending order of priority based on the determined priority. In FIG. 3, images of fashion A1, fashion A2, fashion A3, fashion A4, fashion A5, fashion A6, fashion A7, fashion A8, and fashion A9 are arranged near the top of the content C1. Specifically, the images of fashion A1, fashion A2, and fashion A3 are arranged in the first vertical column of the content C1, the images of fashion A4, fashion A5, and fashion A6 are arranged in the second vertical column of the content C1, and the images of fashion A7, fashion A8, and fashion A9 are arranged in the third vertical column of the content C1. Moreover, images of fashion A1, fashion A4, and fashion A7 are arranged in the first horizontal row of content C1, images of fashion A2, fashion A5, and fashion A8 are arranged in the second horizontal row of content C1, and images of fashion A3, fashion A6, and fashion A9 are arranged in the third horizontal row of content C1. Images with a lower priority than fashion A1 to fashion A9 are arranged lower than fashion A1 to fashion A9, and are displayed according to scrolling.
[0017] Also, fashion A1 is a fashion of style B1, fashion A2 is a fashion of style B2, fashion A3 is a fashion of style B3, fashion A4 is a fashion of style B4, fashion A5 is a fashion of style B5, fashion A6 is a fashion of style B1, fashion A7 is a fashion of style B2, fashion A8 is a fashion of style B6, and fashion A9 is a fashion of style B7. For this reason, when the style of fashion is taken into consideration, for example, style B1 and style B2 are more likely to be liked by users with the attributes of user U1 than style B6 and style B7, so fashion A1, fashion A2, fashion A6, and fashion A7, which are fashions of style B1 or style B2, are arranged higher than fashion A8 and fashion A9, which are fashions of style B6 or style B7. In this way, fashions of a style that is more likely to be liked by users with the attributes of the target user are arranged closer to the top of content C1, and fashions of a style that is less likely to be liked by users with the attributes of the target user are arranged closer to the bottom of content C1. The style may be one style or a mixture of multiple styles, and in the case of a mixture of multiple styles, different mixing ratios may be treated as different styles. In addition, in a situation where no image is selected, the information processing device 100 may display a list of images such that images showing fashion of the same or similar style are not arranged in close proximity to each other. Specifically, the information processing device 100 may display a list of images such that images having similar index values of an index showing a fashion style among multiple indexes described later are not arranged in close proximity to each other.
[0018] Also, for each image of the content C1, an index value is set for each of the multiple indices. For example, for each image of the content C1, an index value is set for each index corresponding to each index, such as "index 1: index value 8, index 2: index value 1, index 3: index value 9, ...". The index value of each index may be an index value set based on a predetermined rule set manually by an administrator of the information processing device 100, or may be an index value set based on a predetermined rule set manually by a poster of each image, or may be an index value set via a computer such as the information processing device 100. In the latter case, for example, the index value may be set by machine learning (specifically, the index value may be output by using a model that outputs an index value for each index when an image is input). Also, the fashion style of each image may be set based on an index value set for one of the multiple indices, or based on an index value set for each of the multiple indices. For example, the fashion style of each image may be set by taking into account all index values set for each of the multiple indices.
[0019] Here, the index according to the embodiment is, for example, information indicating the characteristics of the image. For example, the index according to the embodiment is information indicating the characteristics of the fashion shown in the image (for example, the style of the fashion, etc.). For example, when the image includes a plurality of fashion items, the index according to the embodiment is information indicating the characteristics of each of the plurality of fashion items (for example, the style, category, color, brand, etc. of each of the fashion items). Also, for example, the index according to the embodiment is information indicating the characteristics of the model (wearer of the fashion item) shown in the image (for example, the facial features, body features, fame, popularity, attributes, etc. of the model). For example, when the image includes a plurality of models, the index according to the embodiment is information indicating the characteristics of each of the plurality of models. Also, for example, the index according to the embodiment is information indicating the characteristics of the background shown in the image. Also, for example, the index according to the embodiment is information indicating the characteristics such as the direction in which the subject was photographed. Also, for example, the index according to the embodiment is information indicating the characteristics such as the ratio of the subject to the image. Note that these examples are merely examples and may not be particularly limited.
[0020] Moreover, the index value according to the embodiment may be an index value automatically set based on the evaluation or input of the user. For example, the index value according to the embodiment may be an index value set so that images that the same user has given a favorable evaluation have similar vectors. For example, the index value according to the embodiment may be an index value set so that images including products purchased by the same user have similar vectors. For example, the index value according to the embodiment may be an index value set so that multiple images that the user judges to have a group of products with similar coordination have similar vectors. For example, the index value according to the embodiment may be an index value set so that multiple images that the user judges to have the same type of brand or the same tendency, or that the user presumes to judge to have such, have similar vectors. The information processing device 100 may generate a model that converts such images into vectors. The information processing device 100 may also perform learning of the model so that such images become similar vectors. The information processing device 100 may also use each dimension of a vector generated when an image is input to the generated model as an index, and use the value of each dimension as an index value. Furthermore, the information processing device 100 may perform similar processing using a model that projects character strings indicating user evaluations into the same distributed representation space using a VSE (Visual-Semantic Embedding) technique.
[0021] In Fig. 3, user U1 selects fashion A2. When user U1 selects fashion A2 by operating (e.g., tapping or clicking) the image of fashion A2, the information processing device 100 acquires operation information indicating that user U1 has selected the image of fashion A2 from the user terminal 10 (step S101). Upon acquiring the operation information of user U1, the information processing device 100 acquires image information of the image of fashion A2 (step S102). Specifically, the information processing device 100 acquires information regarding an index value associated with the image of fashion A2.
[0022] The information processing device 100 displays the UI screen (see FIG. 4) of the content C2 based on the acquired image information. At this time, in order to display the UI screen of the content C2, the information processing device 100 selects an image to be newly presented to the user U1 based on the acquired image information (step S103). Specifically, the information processing device 100 selects an image to be newly presented to the user U1 from among images having an index value similar to that of the image of the fashion A2 selected by the user U1 in the content C1 in at least one index, and having an index value different from that of the image of the fashion A2 in at least one index. For example, the information processing device 100 selects an image to be newly presented to the user U1 from among images having an index value similar to that of the image of the fashion A2 selected by the user U1 in the content C1 in at least one index, and having an index value different from that of the image of the fashion style (for example, an index indicating the characteristics of each fashion item, an index indicating the characteristics of a model, etc.). At this time, for example, the information processing device 100 may select a predetermined number of images in order of high similarity of index values among indices with similar index values, or may select a predetermined number of images in order of low similarity of index values among indices with dissimilar index values. In addition, for example, when the user U1 selects a plurality of images, the information processing device 100 may select a predetermined number of images in order of high similarity of index values among one or more indices among the plurality of similar indices selected by the user U1, and low similarity of index values among one or more indices among the plurality of dissimilar indices. Note that the image to be newly presented to the user U1 is selected, for example, from a group of images prepared in advance, by identifying an image having an index value similar to that of the image of the fashion A2 selected by the user U1 in at least one index and an index value dissimilar to that of the image in at least one index, and then selected from the identified images. In addition, a default value is set in advance for the number of images to be newly presented to the user U1, such as, for example, six images are added when the user selects one image.
[0023] Then, the information processing device 100 displays the content C2 so that the newly presented image is arranged near the image of the fashion A2 selected by the user U1 (step S104). For example, the information processing device 100 displays the content C2 by arranging the newly presented image based on a predetermined rule set in advance according to the position of the image selected by the user. For example, when the position of the image selected by the user is the left column of three horizontal columns, the information processing device 100 arranges the image in any column on the right side within a predetermined range from the position of the image, and when the position of the image selected by the user is the right column of three horizontal columns, the information processing device 100 arranges the image in any column on the left side within a predetermined range from the position of the image, but the predetermined rule is not limited to this. In this way, the information processing device 100 displays the content C2 by determining the number, target, and position of the images to be newly presented based on the information on the index value and the position information of the image selected by the user. The information processing device 100 may determine the priority of each image to be arranged in the content C2, including a newly presented image, and display the content C2 by arranging the images in descending order of priority based on the determined priority. The priority of each image may be determined based on user attribute information, index values for each index of each image, and the like.
[0024] In Fig. 4, images of fashion A1, fashion A2, fashion A21, fashion A22, fashion A23, fashion A6, fashion A24, fashion A25, and fashion A26 are arranged near the top of content C2. Specifically, images of fashion A1, fashion A2, and fashion A21 are arranged in the first vertical column of content C2, images of fashion A22, fashion A23, and fashion A6 are arranged in the second vertical column of content C2, and images of fashion A24, fashion A25, and fashion A26 are arranged in the third vertical column of content C2. Images of fashion A1, fashion A22, and fashion A24 are arranged in the first horizontal column of content C2, images of fashion A2, fashion A23, and fashion A25 are arranged in the second horizontal column of content C2, and images of fashion A21, fashion A6, and fashion A26 are arranged in the third horizontal column of content C2. In FIG. 4, the image of fashion A1 (which can be said to be an image of fashion A1, which has a higher priority than the style of fashion A2) that was placed before the image of fashion A2 selected by user U1 in content C1, and the image of fashion A6, which has a higher priority than the style of fashion A2, are not rearranged and are placed in the same position as content C1. The image of fashion A1 may not be rearranged, and the image of fashion A6 may be rearranged, or the images of fashion A1 and fashion A6 may be rearranged. For example, if user U1 is a user who likes multiple styles and is trying to select multiple images from the beginning, such as when selecting an image of fashion A2 in style B2 and then trying to select fashion A1 in style B1, rearranging everything including the image of fashion A1 in style B1 (such as when transitioning to another screen) may make it difficult to select the image of fashion A1, which may reduce the convenience of the user.Also, if the image of fashion A2 in style B2 was selected first because it was displayed first, but in reality the user prefers style B1 and is also planning to select the image of fashion A6 in style B1, rearranging everything including the image of fashion A6 in style B1 may make it difficult to select the image of fashion A6, which may reduce user convenience. In this way, transitioning to a different screen may reduce user convenience, but by adding images to be displayed and changing the rearrangement as in this embodiment, it is possible to prevent a decrease in user convenience.
[0025] Also, fashion A1 is a fashion of style B1, fashion A2 is a fashion of style B2, fashion A21 is a fashion of style B2, fashion A22 is a fashion of style B2, fashion A23 is a fashion of style B2, fashion A6 is a fashion of style B1, fashion A24 is a fashion of style B2, fashion A25 is a fashion of style B2, and fashion A26 is a fashion of style B2. In FIG. 4, an image of fashion A2 selected by user U1 in content C1 and an image having a similar index value in at least one index (for example, an index indicating the style of the fashion) are arranged in the vicinity of the image of fashion A2, so that an image of fashion of style B2, which is the style of fashion A2, is arranged in the vicinity. Also, the images of fashion A21 to A26 may be selected so that the index values are not similar in at least one index. For example, the images of fashion A21 to A26 may be selected so that they have a common style but at least one of the categories, colors, brands, models, etc. are different. In addition, the information processing device 100 may display a list of images such that, among the multiple newly displayed images, an image that has more features different from the selected image (the number of indices with dissimilar index values or the number of features indicated by the indices) is positioned closer to the selected image.
[0026] Furthermore, the newly presented image becomes a candidate for allowing the user to select a new image. When the user U1 selects a new fashion from among the images displayed in the content C2, the information processing device 100 acquires image information of the newly selected fashion image. For example, the information processing device 100 acquires information on the index value and location information of the newly selected fashion image. For example, when the user U1 selects fashion A21, which is a newly presented image from among the images displayed in the content C2, the information processing device 100 acquires information on the index value and location information of the image of the fashion A21. Also, for example, when the user U1 selects fashion A1, which is not a newly presented image from among the images displayed in the content C2, the information processing device 100 acquires information on the index value and location information of the image of the fashion A1. In this way, the selection of fashion A1 may be accepted from the user U1 at this stage. Then, the information processing device 100 repeats the processes of steps S103 and S104. The information processing device 100 repeats the processes of steps S101 to S104 until a predetermined condition is satisfied. For example, the information processing device 100 may repeat the processing of steps S101 to S104 until the user U1 stops selecting a new fashion, or may repeat the processing of steps S101 to S104 until a predetermined number of times is reached, or may repeat the processing of steps S101 to S104 until sufficient data is collected to enable an estimation of the user's fashion preferences.
[0027] The following describes the estimation process of the fashion taste of the user. The information processing device 100 estimates the importance of the user to each index based on whether or not the user selected a newly displayed image. In this case, for example, the information processing device 100 estimates that the more the user selects a newly displayed image, the higher the importance of the user to an index with a similar index value, and the more the user selects an image other than the newly displayed image, the lower the importance of the user to an index with a similar index value. For example, when the user U1 selects fashion A2 in content C1 and fashion A21 in content C2, the information processing device 100 compares the index value of each index of the image of fashion A2 with the index value of each index of the image of fashion A21 to identify indexes with similar index values, and estimates the importance of the identified index (and / or the index value of the index) to be high. For example, the information processing device 100 estimates that the importance of at least style B2 is high because the index values of at least the indexes indicating the fashion style are similar. Furthermore, for example, if user U1 selects fashion A2 in content C1 and fashion A1 in content C2, the information processing device 100 compares the index values of each index in the image of fashion A2 with the index values of each index in the image of fashion A1 to identify indices with similar index values and estimates the importance of the identified indices as high, and compares the index values of each index in the image of fashion A2 with the index values of each index in the image of fashion A21 to identify indices with similar index values and estimates the importance of the identified indices as low. Then, the information processing device 100 may estimate information about the user's fashion preference based on information about indices estimated to have high importance, or may estimate information about the user's fashion preference based on information about indices estimated to have low importance.For example, in the case of fashion A1 ("style B1, model C1"), fashion A2 ("style B2, model C2"), and fashion A21 ("style B2, model C1"), if fashion A1 is selected after fashion A2 is selected, model C1 similar to fashion A1 and fashion A2 is identified, and the importance of model C1 is estimated to be high, and style B2 similar to fashion A2 and fashion A21 is identified, and the importance of style B2 may be estimated to be low (or not high) taking into account that fashion A21 was not selected. Note that, although the description has been given using fashion A21, fashions A22 to A26 may be used, and the importance of style B2 may be estimated to be low (or not high) taking into account that fashions A22 to A26 were not selected.
[0028] The information processing device 100 may provide various services using information on the estimated user preferences. For example, the information processing device 100 may generate and provide information (such as a top page) that reflects the user preferences in a predetermined electronic commerce service or a predetermined coordination service.
[0029] The information processing device 100 may estimate the user's preference by using the most frequent or average value of the index value for each index, instead of specifying the most important index or the least important index as in the above embodiment. As a specific example, assume that user U1 selects multiple images of simple (fashion feature), white (item feature 1), manufacturer #1 (item feature 2), 150cm (model feature), simple, black, manufacturer #2, 140cm, and simple, beige, manufacturer #2, 160cm, and user U2 selects multiple images of simple, white, manufacturer #1, 150cm, girly, white, manufacturer #2, 150cm, and girly, white, manufacturer #3, 150cm. In this case, user U1 places the most importance on the style "simple", and user U2 places the most importance on the color "white" and height "150cm". The information processing device 100 may grasp the individual preferences by having each of users U1 and U2 select multiple images and obtaining the most frequent or average value for each index. In this case, for example, the mode or average value of each index of user U1 is "Simple (no mode) Manufacturer #2 150cm", and the mode or average value of each index of user U2 is "Girly White (no mode) 150cm". In this way, the mode or average value of the index value may be used for each index without specifying an index with high or low importance. In this way, the information processing device 100 can reduce the number of image candidates that the user must see before identifying the user's preference, thereby improving usability. In addition, the information processing device 100 does not add images that the user does not like at all, thereby improving the quality of the coordination selected by the user (i.e., increasing the possibility that an image that the user likes can be displayed as a candidate).
[0030] (Information processing variation 1: triggered by changes in preferences) In the above embodiment, the user U1 is a user who uses a predetermined service for the first time, and a case where the user U1 transitions to the content C1 when the user U1 uses the predetermined service for the first time has been described. However, the case where the user U1 transitions to the content C1 may not be limited to this example. For example, the user may transition to the content C1 when it is estimated that the user's preferences have changed. The information processing device 100 periodically collects user information such as a user's search history, browsing history, and purchase history in a predetermined e-commerce service or a predetermined coordination service, for example, and determines whether the user information has changed. If it is determined that the user information has changed, it estimates that the user's preferences have changed. Then, the information processing device 100 may suggest the user to transition to the content C1 when it estimates that the user's preferences have changed. In addition, the transition to the content C1 may be made not only when it is estimated that the user's preferences have changed, but also based on the user's initiative, or based on a predetermined rule such as a predetermined frequency.
[0031] (Information processing variation 2: Changing image groups according to the season) In the above embodiment, the case where image information of an image selected by a user from a list of images with predetermined index values (for example, a list of images included in content C1 or content C2) has been described. Here, the list of images may be extracted based on the season when the user transitions to content C1. For example, the information processing device 100 may include an index related to a season among a plurality of indexes, and extract an image corresponding to the season when the user transitions to content C1 based on the index value of the index related to the season. Then, the information processing device 100 may determine the image corresponding to the season when the user transitions to content C1 as the image to be displayed in content C1 or content C2. This enables the information processing device 100 to grasp the fashion preferences of the user for each season. Furthermore, since the information processing device 100 can grasp the fashion preferences of the user corresponding to the season, it becomes possible to make a proposal that stimulates the user's purchasing desire for each season.
[0032] (Information processing variation 3: timing of information processing) The information processing according to the above embodiment may be performed at any timing, and may not be particularly limited. For example, the information processing according to the above embodiment may be performed for all users, or may be performed for a specific user (e.g., a newly signed up user). In addition, for example, the information processing according to the above embodiment may be performed in a case where there are multiple indices that are estimated to be preferences for a certain user, to determine whether the indices truly reflect the preferences by intentionally presenting one of the indices that is different, or may be performed in a case where a product is proposed based on the index value but the conversion rate is low.
[0033] [3. User terminal configuration] Next, the configuration of the user terminal 10 according to the embodiment will be described with reference to Fig. 5. Fig. 5 is a diagram showing an example of the configuration of the user terminal 10 according to the embodiment. As shown in Fig. 5, the user terminal 10 has a communication unit 11, an input unit 12, an output unit 13, and a control unit 14.
[0034] (Communications Department 11) The communication unit 11 is realized by, for example, a network interface card (NIC) etc. The communication unit 11 is connected to a predetermined network N by wire or wirelessly, and transmits and receives information to and from the information processing device 100 etc. via the predetermined network N.
[0035] (Input section 12) The input unit 12 accepts various operations from a user. In Fig. 2, the input unit 12 accepts various operations from a user U1. For example, the input unit 12 may accept various operations from a user via a display surface using a touch panel function. The input unit 12 may also accept various operations from buttons provided on the user terminal 10, or a keyboard or mouse connected to the user terminal 10.
[0036] (Output section 13) The output unit 13 is a display screen of a tablet terminal or the like realized by, for example, a liquid crystal display or an organic EL (Electro-Luminescence) display, and is a display device for displaying various information. For example, the output unit 13 displays content based on information transmitted from the information processing device 100.
[0037] (Control unit 14) The control unit 14 is, for example, a controller, and is realized by a CPU (Central Processing Unit), MPU (Micro Processing Unit), etc., executing various programs stored in a storage device inside the user terminal 10 using a RAM (Random Access Memory) as a working area. For example, the various programs include application programs installed in the user terminal 10. For example, the various programs include application programs for displaying content based on information transmitted from the information processing device 100. The control unit 14 is also realized by an integrated circuit, for example, an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).
[0038] As shown in FIG. 5, the control unit 14 has a receiving unit 141 and a transmitting unit 142, and realizes or executes the information processing operations described below.
[0039] (Receiving unit 141) The receiving unit 141 receives various information from other information processing devices such as the information processing device 100. For example, the receiving unit 141 receives information for displaying content (e.g., content C1, content C2, etc.) for allowing a user to select an image in order to understand the user's preferences.
[0040] (Transmitter 142) The transmission unit 142 transmits various information to other information processing devices such as the information processing device 100. For example, when a user selects an image from the content received by the reception unit 141, the transmission unit 142 transmits operation information including information on the image selected by the user.
[0041] 4. Configuration of Information Processing Device Next, the configuration of the information processing device 100 according to the embodiment will be described with reference to Fig. 6. Fig. 6 is a diagram showing an example of the configuration of the information processing device 100 according to the embodiment. As shown in Fig. 6, the information processing device 100 has a communication unit 110, a storage unit 120, and a control unit 130. Note that the information processing device 100 may have an input unit (e.g., a keyboard, a mouse, etc.) that accepts various operations from an administrator of the information processing device 100, and a display unit (e.g., a liquid crystal display, etc.) that displays various information.
[0042] (Communication unit 110) The communication unit 110 is realized by, for example, a NIC etc. The communication unit 110 is connected to a network N by wire or wirelessly, and transmits and receives information to and from the user terminal 10 etc. via the network N.
[0043] (Storage unit 120) The storage unit 120 is realized by, for example, a semiconductor memory element such as a RAM or a flash memory, or a storage device such as a hard disk or an optical disk. As shown in FIG. 6, the storage unit 120 has an image information storage unit 121 and a preference information storage unit 122.
[0044] The image information storage unit 121 stores information about candidate images to be selected by the user. An example of the image information storage unit 121 according to the embodiment is shown in Fig. 7. As shown in Fig. 7, the image information storage unit 121 has items such as "image ID", "fashion", "target attribute", "image", and "index value".
[0045] "Image ID" indicates identification information for identifying an image. "Fashion" indicates information related to fashion (e.g., fashion style, etc.). "Target attribute" indicates attributes of users targeted by the fashion (e.g., attributes of users for whom the fashion is popular, etc.). This makes it possible to grasp, for example, which age group or gender of users a fashion is popular with. "Image" indicates an image of the fashion (it may be an image of the fashion being worn, including a model). In the example shown in FIG. 7, conceptual information such as "Image #1" and "Image #2" is stored in "Image", but in reality, image data, etc. are stored. In addition, for example, a URL where the image data is located, a file path name indicating the storage location, etc. may be stored in "Image". "Index value" indicates information related to the index value of each index of the image.
[0046] The preference information storage unit 122 stores the preference information of the user. An example of the preference information storage unit 122 according to the embodiment is shown in Fig. 8. As shown in Fig. 8, the preference information storage unit 122 has items such as "user ID", "user information", "selected image", and "selection time".
[0047] "User ID" indicates identification information for identifying a user. "User information" indicates user information (e.g., attribute information, etc.). "Selected image" indicates information regarding the image selected by the user (e.g., image information selected in content C1 or content C2). "Time of selection" indicates information regarding the time when the user selected the image.
[0048] (Control unit 130) The control unit 130 is a controller, and is realized, for example, by a CPU, an MPU, or the like, executing various programs stored in a storage device inside the information processing device 100 using a RAM as a working area. The control unit 130 is also a controller, and is realized, for example, by an integrated circuit such as an ASIC or an FPGA.
[0049] 6, the control unit 130 has an acquisition unit 131, a selection unit 132, a display unit 133, and an estimation unit 134, and realizes or executes the information processing action described below. Note that the internal configuration of the control unit 130 is not limited to the configuration shown in FIG. 6, and may be other configurations as long as they perform the information processing described below.
[0050] (Acquisition part 131) The acquisition unit 131 acquires various pieces of information from an external information processing device. The acquisition unit 131 acquires various pieces of information from other information processing devices such as the user terminal 10.
[0051] The acquiring unit 131 acquires various types of information from the storage unit 120. In addition, the acquiring unit 131 stores the acquired various types of information in the storage unit 120.
[0052] The acquisition unit 131 acquires image information to suggest to the user and allow the user to select when it is estimated that the user's taste has changed. Also, the acquisition unit 131 acquires image information to suggest to the user and allow the user to select according to the season in which the user visited.
[0053] The acquisition unit 131 acquires image information (e.g., information regarding the index value of each index) of an image selected by a user from a list of images (e.g., content C1, content C2, etc.) in which index values are defined for each of a plurality of indexes.
[0054] (Selection unit 132) The selection unit 132 selects an image to be newly presented to the user from among images having an index value similar to the image selected by the user in at least one of the multiple indices and having an index value dissimilar to the image selected by the user, based on the image information acquired by the acquisition unit 131. For example, the selection unit 132 selects a predetermined number of images in descending order of similarity of index values among indices having similar index values. Also, for example, the selection unit 132 selects a predetermined number of images in descending order of similarity of index values among indices having dissimilar index values. Also, for example, the selection unit 132 selects a predetermined number of images in descending order of similarity of index values among the multiple similar indices among the multiple images selected by the user, among indices having similar index values, and having a similarity of index values among indices having dissimilar index values.
[0055] (Display section 133) The display unit 133 displays the image selected by the selection unit 132 as a candidate, thereby suggesting it to the user. Furthermore, the display unit 133 displays the candidate image proposed to the user at a position determined based on the position of the image selected by the user. Furthermore, in a situation where no image is selected (for example, before the user selects an image), the display unit 133 displays the image candidates such that images with the same or similar index values are not placed close to each other. For example, this is the case when content C1 is displayed. Furthermore, the display unit 133 displays the image candidates such that the more features an image has that differ from the image selected by the user, the closer it is to being placed close to the selected image. For example, this is the case when content C2 is displayed.
[0056] (Estimation part 134) The estimation unit 134 estimates the user's importance to each index based on whether or not the user has selected an image newly displayed as a candidate by the display unit 133. For example, the estimation unit 134 estimates that the more the user selects a newly displayed image, the higher the importance the user places on an index having a similar index value between the newly displayed image and an image already selected. Also, for example, the estimation unit 134 estimates that the more the user selects an image other than the newly displayed image, the lower the importance the user places on an index having a similar index value between the newly displayed image and an image already selected. Also, the estimation unit 134 estimates information related to the user's preferences based on the estimated importance the user places on each index.
[0057] [5. Information processing flow] Next, the procedure of information processing by the information processing system 1 according to the embodiment will be described with reference to Fig. 9. Fig. 9 is a flowchart showing the procedure of information processing by the information processing system 1 according to the embodiment.
[0058] As shown in FIG. 9, the information processing device 100 acquires image information of an image selected by a user from a list of images in which index values are defined for each of a plurality of indexes (step S201).
[0059] Based on the acquired image information, the information processing device 100 selects an image to be newly presented to the user from among images having an index value similar to the image selected by the user in at least one of the multiple indices, and having an index value dissimilar to the image selected by the user in at least one of the multiple indices (step S202).
[0060] The information processing device 100 displays the selected image as a candidate, thereby proposing it to the user (step S203).
[0061] The information processing device 100 estimates the user's importance to each index based on whether the user selected the proposed image (step S204).
[0062] The information processing device 100 estimates information about the user's preferences based on the estimated importance of each index to the user (step S205).
[0063] 6. Effects As described above, the information processing device 100 according to the embodiment includes an acquisition unit 131, a selection unit 132, and a display unit 133. The acquisition unit 131 acquires image information of an image selected by a user from a list of images in which an index value is determined for each index of a plurality of indexes. The selection unit 132 selects an image to be newly presented to the user from among images having an index value similar to the image selected by the user in at least one of the plurality of indexes and an index value not similar to the image selected by the user in at least one of the plurality of indexes, based on the image information acquired by the acquisition unit 131. The display unit 133 displays the image selected by the selection unit 132 as a candidate, thereby proposing it to the user.
[0064] This allows the information processing apparatus 100 according to the embodiment to make a proposal that takes into account the preferences of the user based on the index value of the index of each image.
[0065] In addition, the information processing device 100 according to the embodiment further includes an estimation unit 134 that estimates the user's importance to each index based on whether or not the user has selected an image newly displayed as a candidate by the display unit 133.
[0066] As a result, the information processing device 100 according to the embodiment can find important indices for each user, and therefore can appropriately estimate the preferences of the user.
[0067] Furthermore, the estimation unit 134 estimates that the more the user selects a newly displayed image, the higher the importance the user places on indices with similar index values.
[0068] This allows the information processing device 100 according to the embodiment to perform more accurate estimation.
[0069] Furthermore, the estimation unit 134 estimates that the more an image that the user selects that is not a newly displayed image, the lower the importance that the user places on indices with similar index values.
[0070] This allows the information processing device 100 according to the embodiment to perform more accurate estimation.
[0071] Furthermore, the display unit 133 displays the candidate images at positions determined based on the position of the image selected by the user.
[0072] As a result, the information processing device 100 according to the embodiment can control the display position of the candidate images based on the position of the image selected by the user, and can therefore make suggestions that take usability into account.
[0073] Furthermore, the acquiring unit 131 acquires image information of an image selected from the list of images displayed when it is estimated that the user's preferences have changed.
[0074] In this way, the information processing device 100 according to the embodiment can make a proposal that takes into account the new user's preferences when the user's preferences change.
[0075] Furthermore, the acquiring unit 131 acquires image information of an image selected by the user from a list of images extracted according to the season of use.
[0076] In this way, the information processing device 100 according to the embodiment can make a proposal that takes into account the season in which the user uses the information processing device 100.
[0077] Furthermore, the selection unit 132 selects a predetermined number of images in descending order of similarity of index values in one index having an index value similar to that of the image selected by the user, as images to be newly presented to the user.
[0078] This allows the information processing device 100 according to the embodiment to make suggestions that are more in line with the preferences of the user.
[0079] Furthermore, the selection unit 132 selects a predetermined number of images in ascending order of similarity of index value in one index having an index value dissimilar to that of the image selected by the user, as images to be newly presented to the user.
[0080] This allows the information processing device 100 according to the embodiment to make suggestions that are more in line with the preferences of the user.
[0081] In addition, the selection unit 132 selects an image having a high similarity in any of the index values among multiple similar indexes among multiple images selected by the user and a low similarity in other indexes among the multiple indexes as an image to be newly presented to the user.
[0082] This allows the information processing device 100 according to the embodiment to make suggestions that are more in line with the preferences of the user.
[0083] Furthermore, the display unit 133 displays candidate images proposed to the user on the same content as the content from which the user has selected an image.
[0084] As a result, the information processing device 100 according to the embodiment can display images by adding images to be displayed and changing the sorting without transitioning to another screen, thereby preventing a decrease in user convenience.
[0085] [7. Hardware Configuration] Moreover, the user terminal 10 and the information processing device 100 according to the above-described embodiment are realized, for example, by a computer 1000 having a configuration as shown in Fig. 10. Fig. 10 is a hardware configuration diagram showing an example of a computer that realizes the functions of the user terminal 10 and the information processing device 100. The computer 1000 has a CPU 1100, a RAM 1200, a ROM 1300, a HDD 1400, a communication interface (I / F) 1500, an input / output interface (I / F) 1600, and a media interface (I / F) 1700.
[0086] The CPU 1100 operates and controls each unit based on a program stored in the ROM 1300 or the HDD 1400. The ROM 1300 stores a boot program executed by the CPU 1100 when the computer 1000 is started up, programs that depend on the hardware of the computer 1000, and the like.
[0087] The HDD 1400 stores programs executed by the CPU 1100, data used by such programs, etc. The communication interface 1500 acquires data from other devices via a predetermined communication network and sends it to the CPU 1100, and transmits data generated by the CPU 1100 to other devices via the predetermined communication network.
[0088] The CPU 1100 controls output devices such as a display and a printer, and input devices such as a keyboard and a mouse, via the input / output interface 1600. The CPU 1100 acquires data from the input devices via the input / output interface 1600. The CPU 1100 also outputs generated data to the output devices via the input / output interface 1600.
[0089] The media interface 1700 reads a program or data stored in the recording medium 1800 and provides it to the CPU 1100 via the RAM 1200. The CPU 1100 loads the program from the recording medium 1800 onto the RAM 1200 via the media interface 1700 and executes the loaded program. The recording medium 1800 is, for example, an optical recording medium such as a DVD (Digital Versatile Disc) or a PD (Phase change rewritable Disc), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory.
[0090] For example, when the computer 1000 functions as the user terminal 10 and the information processing device 100 according to the embodiment, the CPU 1100 of the computer 1000 executes programs loaded onto the RAM 1200 to realize the functions of the control units 14 and 130. The CPU 1100 of the computer 1000 reads and executes these programs from the recording medium 1800, but as another example, the CPU 1100 may obtain these programs from other devices via a predetermined communication network.
[0091] [8. Other] In addition, among the processes described in the above embodiments, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically by a known method. In addition, the information including the processing procedures, specific names, various data and parameters shown in the above documents and drawings can be changed arbitrarily unless otherwise specified. For example, the various information shown in each drawing is not limited to the illustrated information.
[0092] In addition, each component of each device shown in the figure is a functional concept, and does not necessarily have to be physically configured as shown in the figure. In other words, the specific form of distribution and integration of each device is not limited to that shown in the figure, and all or part of them can be functionally or physically distributed and integrated in any unit according to various loads, usage conditions, etc.
[0093] Furthermore, the above-described embodiments can be appropriately combined as long as the processing contents are not contradictory.
[0094] Although some of the embodiments of the present application have been described in detail above with reference to the drawings, these are merely examples, and the present invention can be embodied in other forms that incorporate various modifications and improvements based on the knowledge of those skilled in the art, including the forms described in the Disclosure of the Invention section.
[0095] Furthermore, the above-mentioned "section, module, unit" can be read as "means" or "circuit", etc. For example, an acquisition section can be read as an acquisition means or an acquisition circuit. [Explanation of symbols]
[0096] 1. Information Processing Systems 10 User terminal 11 Communications Department 12 Input section 13 Output section 14 Control section 100 Information processing device 110 Communications Department 120 Storage section 121 Image information storage unit 122 Preference information storage unit 130 Control section 131 Acquisition Department 132 Selection section 133 Display section 134 Estimation Department 141 Receiving unit 142 Transmitter N Network
Claims
1. an acquisition unit that acquires image information of an image selected by a user from a list of images in which index values are defined for each of a plurality of indexes; a selection unit that selects an image to be newly presented to the user from among images having an index value similar to the image selected by the user in at least one of the plurality of indexes and having an index value dissimilar to the image selected by the user in at least one of the plurality of indexes based on the image information acquired by the acquisition unit; a display unit that displays the image selected by the selection unit as a candidate, thereby proposing the image to the user; 13. An information processing device comprising:
2. an estimation unit that estimates the importance of the user to each index based on whether or not the user has selected an image newly displayed as a candidate by the display unit; 2. The information processing apparatus according to claim 1, further comprising:
3. The estimation unit is It is estimated that the more the user selects the newly displayed image, the higher the importance of the user to the index having a similar index value.
3. The information processing apparatus according to claim 2.
4. The estimation unit is It is estimated that the more the user selects an image other than the newly displayed image, the lower the importance of the user to the index having a similar index value.
3. The information processing apparatus according to claim 2.
5. The display unit is Displaying the candidate images at a location determined based on the location of the user selected image.
2. The information processing apparatus according to claim 1,
6. The acquisition unit is Acquire image information of an image selected from the list of images displayed when it is estimated that the user's preference has changed.
2. The information processing apparatus according to claim 1,
7. The acquisition unit is The user acquires image information of an image selected from the list of images extracted according to the season of use.
2. The information processing apparatus according to claim 1,
8. The selection unit is A predetermined number of images are selected as images to be newly presented to the user in descending order of similarity of the index value in the one index having an index value similar to that of the image selected by the user.
2. The information processing apparatus according to claim 1,
9. The selection unit is A predetermined number of images are selected in descending order of similarity of the index value in the one index that is not similar to the image selected by the user as images to be newly presented to the user.
2. The information processing apparatus according to claim 1,
10. The selection unit is An image having a high similarity in any one of a plurality of similar indices among a plurality of images selected by the user and a low similarity in other of the plurality of indices is selected as an image to be newly presented to the user.
2. The information processing apparatus according to claim 1,
11. The display unit is The candidate image proposed to the user is displayed on the same content as the content in which the user performed the image selection.
2. The information processing apparatus according to claim 1,
12. 1. A computer-implemented information processing method, comprising: an acquisition step of acquiring image information of an image selected by a user from a list of images in which index values are defined for each of a plurality of indexes; a selection step of selecting an image to be newly presented to the user from among images having an index value similar to the image selected by the user in at least one of the plurality of indexes and having an index value dissimilar to the image selected by the user in at least one of the plurality of indexes based on the image information acquired in the acquisition step; a display step of displaying the image selected by the selection step as a candidate to suggest to the user; 13. An information processing method comprising:
13. An acquisition step of acquiring image information of an image selected by a user from a list of images having index values defined for each of a plurality of indexes; a selection step of selecting an image to be newly presented to the user from among images having an index value similar to the image selected by the user in at least one of the plurality of indexes and having an index value dissimilar to the image selected by the user in at least one of the plurality of indexes, based on the image information acquired by the acquisition step; a display step of displaying the image selected by the selection step as a candidate to suggest to the user; An information processing program characterized by causing a computer to execute the above.
Citation Information
Patent Citations
Styling provision system
JP6085017B1
Information-providing system
WO2021157573A1
Auxiliary heating device for automobile
JP1985085017A
Cited By
Information processing device, information processing method, and information processing program
JP7821917B1