Information processing device

Abstract

To provide an information processing apparatus configured to generate effective content for a sales object, which draws the interest of a user.SOLUTION: An information processing apparatus 100 includes: a content generation unit 213 which applies a machine learning model to content for a specific sales object, to generate modified content by modifying a predetermined part other than the specific sales object in the content; and a content providing unit 214 which provides the generated modified content to a user. The content generation unit 213 applies the machine learning model to content for another sales object, and modifies a predetermined part other than the other sales object, according to an action of the user with respect to the modified content, in the content for the other sales object, to generate modified content for the other sales object.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to an information processing device that generates new content based on content for sale using a machine learning model. [Background technology]

[0002] In recent years, a technology has become known in which advertising images are dynamically generated using computer calculations rather than manually generating images used in advertisements (Patent Document 1). Patent Document 1 discloses a technology in which an advertising image generation device dynamically generates advertising images based on a set of generation parameters in which each element constituting the advertisement is specified by text. Patent Document 1 also discloses a technology in which the advertising effect of the advertising image is obtained and the set of generation parameters is optimized. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2018-077615 Summary of the Invention [Problem to be solved by the invention]

[0004] It is known that people have a tendency to develop a liking for an object when they are exposed to it repeatedly (also known as the mere exposure effect). However, while this tendency applies if people are exposed to the same information a few times (for example, three times), it is known that if they are exposed to the same information more than five times, their interest decreases. It is also known that interest can be maintained by presenting non-identical information. If we can take advantage of this human tendency to present information (images and other content) about a sales item, we can effectively attract the user's interest.

[0005] The present invention has been made in view of the above-mentioned problems, and an object of the present invention is to realize a technology that can generate effective content about sales items that attracts the interest of users. [Means for solving the problem]

[0006] In order to solve this problem, for example, an information processing device of the present invention has the following arrangement: An information processing device, one or more processors; a memory storing one or more programs, the one or more programs, when executed by the one or more processors, causing the one or more processors to: applying a machine learning model to content for a specific sales target to generate modified content by modifying a predetermined portion of the content other than the specific sales target; providing the generated modified content to a user; collecting information on the users' accesses to the changed content, and identifying a change type corresponding to the changed content with a high number of accesses based on the access information; applying the machine learning model to content about other sales objects; The portion corresponding to the specified change type other than the other sales object to generate modified content for the other sale object; An information processing device is provided, in which the modified content in which the specified portion has been modified and the modified content for the other sales target are images or videos generated by a machine learning model. [Effects of the Invention]

[0007] According to the present invention, it is possible to generate effective content about sales items that will attract the interest of users. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating an overview of an information processing system according to an embodiment of the present invention. [Figure 2] FIG. 1 is a block diagram showing an example of the functional configuration of an information processing device according to an embodiment of the present invention; [Figure 3] FIG. 1 is a block diagram illustrating an example of the functional configuration of a communication device according to an embodiment of the present invention. [Figure 4] 1 is a flowchart showing a series of operations in a content generation process according to the present embodiment. [Figure 5] 1 is a flowchart showing a series of operations in an access analysis process as an example according to the present embodiment. [Figure 6] 10 is a flowchart showing a series of operations in an access analysis process as another example according to the present embodiment. [Figure 7] FIG. 10 is a diagram showing an example of a user table according to the present embodiment; [Figure 8] FIG. 10 is a diagram showing an example of an extended user table according to the present embodiment. [Figure 9] FIG. 10 is a diagram showing an example of a content table according to the present embodiment; [Figure 10A] FIG. 10 is a diagram showing an example of a search result according to the embodiment; [Figure 10B] FIG. 10 is a diagram showing another example of the search results according to the embodiment; [Figure 11] FIG. 10 is a diagram showing an example of a change type table according to the present embodiment; [Figure 12] FIG. 10 is a diagram illustrating an example of changed content according to the present embodiment. [Figure 13] FIG. 10 is a diagram illustrating an example of changed content according to the present embodiment. [Figure 14] FIG. 10 is a diagram illustrating an example of changed content according to the present embodiment. [Figure 15] FIG. 10 is a diagram showing another example of the search results according to the embodiment; [Figure 16] FIG. 10 is a diagram showing another example of the search results according to the embodiment; DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, the embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the scope of the invention as claimed, and not all combinations of features described in the embodiments are necessarily essential to the invention. Two or more of the features described in the embodiments may be combined in any desired manner. Furthermore, the same reference numerals are used to designate identical or similar components, and redundant descriptions will be omitted.

[0010] <Outline of the information processing system> 1 shows an overview of an information processing system according to this embodiment. The information processing system 10 according to this embodiment includes an information processing device 100, which is, for example, an information processing server, and communication devices 110 and 120, which are, for example, smartphones.

[0011] The information processing device 100 operates as a server that provides information such as web pages for electronic commerce. The information processing device 100 receives a search request or a browse request for items for sale (products or services) from the communication device 110, and provides display information to the communication device 110. The display information includes content about the items for sale or modified content that has been modified from the content.

[0012] In the following embodiment, an example is described in which the content for a specific item for sale is an image. That is, the following description describes an embodiment in which a machine learning model is applied to an image of a specific item for sale to generate modified content (modified image) by modifying portions of the image other than the specific item for sale. However, this embodiment is not limited to cases in which the content is an image, and can also be applied to cases in which the content is text, video, and audio. While this embodiment is primarily described using images, taking a video as an example, a video also has a frame structure and is composed of a collection of images, so similar processing can be performed on each image. Furthermore, if different modification processing is performed on each frame image that makes up a video, the video will not be cohesive when played back. Therefore, in the case of a video, it is desirable that the modification processing applied to the frame images that make up the target video be the same type and identical.

[0013] As mentioned above, it is known that people have a tendency to develop a liking for an object when they are exposed to the same object repeatedly (the mere exposure effect). It is also known that the mere exposure effect can be achieved if people are exposed to the same information several times (e.g., three times), but that interest decreases if they are exposed to the same information five times in a row. To prevent this decline in interest, a known technique is to continue transmitting the same information while making slight changes to the information. Examples of such techniques include slightly shifting the main point of the information, or changing the wording but not changing the essence of the message you want to convey to consumers. Furthermore, because people have a tendency to pay attention to change, adding changes to the object can effectively attract people's attention.

[0014] In this embodiment, by utilizing this human nature, specific information is continuously provided after making slight changes to the information being communicated. For example, if content (e.g., an image) about a specific item for sale exists, the information processing device 100 provides the content about the specific item for sale to the user as is. On the other hand, when the information processing device 100 continuously provides information about the specific item for sale to the user, for example, it generates modified content (e.g., an modified image) by modifying parts of the image about the specific item for sale other than the specific item for sale. Then, it provides the generated modified content to the user. In this manner, it is possible to continuously present information about the specific item for sale to the user while preventing a decrease in the user's interest. The information processing device 100 may provide the content about the specific item for sale to the user as is about three times, and then provide modified content. Furthermore, in this embodiment, it analyzes what kind of modified content attracts the user's interest, and applies the modification method that attracts the user's interest to content about other items for sale.

[0015] The content and changed content for a specific item for sale will be described with reference to FIG. 12, for example. In the example shown in FIG. 12, the specific item for sale is a shirt, and the content is an image. Image 1201 is an image of the specific item for sale (e.g., a shirt), and image 1201 depicts model 1202 (fashion model) wearing shirt 1203 for sale. In image 1201, model 1202 is wearing jeans 1204. Image 1201 is, for example, an image captured by communication device 120 or an image stored in communication device 120, and is transmitted from communication device 120 to information processing device 100.

[0016] Image 1205 is modified content (also referred to as a modified image). This image 1205 is an image generated by the information processing device 100 applying a machine learning model to image 1201 to modify a specific non-sales item portion of image 1205 (i.e., jeans 1204) to a skirt 1208. Therefore, in modified image 1205, model 1202 and shirt 1203 remain unchanged from image 1201.

[0017] The information processing device 100 transmits display information including content or changed content for a specific item for sale to the communication device 110. In this embodiment, the display image is, for example, a search result for the specific item for sale, page information for the item for sale, or a list of images of the specific item for sale.

[0018] The communication device 110 is a device that receives display information provided by the information processing device 100 and presents it to the user. In addition, the communication device 110 transmits to the information processing device 100 a search request for items for sale, a request to view a page for a specific item for sale, or the like, in response to a user operation.

[0019] For example, the communication device 120 transmits an image (i.e., image 1201) of the specific sales item described above to the information processing device 100. For example, the communication device 120 may take a photograph of the image 1201 at the communication device 120, or may acquire and store the image 1201 taken by a device external to the communication device 120.

[0020] <Configuration of information processing device> Next, an example of the functional configuration of the information processing device 100 will be described with reference to FIG. 2. Note that each of the functional blocks described with reference to the figure may be integrated or separated, and the described functions may be realized by different blocks. Also, what is described as hardware may be realized by software, and vice versa. Furthermore, in this embodiment, an example will be described in which the information processing device 100 is a single device, but the information processing device 100 may be configured by multiple devices, or may be configured as one or more virtual machines.

[0021] The communication unit 201 includes a communication circuit or a communication module that communicates with the communication device 110 and the communication device 120 used by the user via a network.

[0022] The control unit 202 includes a CPU 210, which is a processor, and a RAM 211. The CPU 210 is a central processing unit and may be composed of one or more processors. The control unit 202 may further include a GPU in addition to the CPU 210 and the RAM 211, and be configured to be able to efficiently execute machine learning models. The control unit 202 executes computer programs stored in the storage unit 204 to control the operation of each unit of the information processing device 100 and to execute content generation processing and access analysis processing, which will be described later.

[0023] The RAM 211 is a volatile storage medium such as a DRAM, and temporarily stores parameters and processing results for the control unit 202 to execute a computer program. The power supply unit 203 is a power supply that provides power for each unit of the information processing device 100 to operate.

[0024] The storage unit 204 includes a non-volatile storage medium such as a hard disk or semiconductor memory, and stores setting values ​​and computer programs required for the operation of the information processing device 100. The computer programs stored in the storage unit 204 include an operating system for implementing the various functions of the information processing device 100, and various applications such as a browser. The storage unit 204 may include a database therein. The database includes, for example, a user DB 220, a content DB 221, and a change type DB 222.

[0025] The user DB 220 stores data related to users who use the e-commerce service provided by the information processing device 100. FIG. 7 shows a user table 700 stored in the user DB 220. The user table 700 includes a user ID 701, user attribute information 702, and an access history 703. The user ID 701 is information that uniquely identifies a user. The user attribute information 702 may include, for example, the age, gender, and preference information of each user. The access history 703 stores images (originals) of items for sale accessed by the user and modified images generated by a machine learning model, for example, in reverse chronological order of access. Note that the user table 700 may further include or be associated with a purchase history 801 of items purchased by the user through the e-commerce service, as shown in FIG. 8. In a content generation process described below, the control unit 202 may refer to the purchase history to preferentially select modification types similar to the purchased items.

[0026] The content DB 221 stores data related to content provided by the information processing device 100 in the e-commerce service. FIG. 9 shows a content table 900 stored in the content DB 221. The content table 900 includes a content ID 901, content information 902, and content meta information 903. The content ID 901 is information that uniquely identifies content. The content information 902 includes a URL for the content entity, information indicating what the content is for sale, and information identifying the change type. The change type corresponds to the change type table 1100 shown in FIG. 11. The content meta information 903 describes information about models (fashion models) in the content and parts other than those for sale. By using the content meta information 903, the information processing device 100 does not need to re-execute recognition processing for fashion models, clothing, etc., and the processing speed by the information processing device 100 is increased.

[0027] The change type DB 222 is data indicating what can be changed within the content for each item for sale handled in the e-commerce service provided by the information processing device 100. Fig. 11 shows an example of a change type table 1100 when the item for sale is a shirt.

[0028] In addition to the DB, the storage unit 204 may further store substantive data of the content and training data for training the machine learning model. The substantive data of the content may be, for example, image data of an item for sale transmitted from the communication device 120. The training data may be, for example, a large collection of images related to the part of the content to be changed (for example, when changing jeans to a skirt, images of jeans and images of the skirt).

[0029] The content acquisition unit 212 acquires image data of the item for sale transmitted from the communication device 120 and stores it in the storage unit 204. The content acquisition unit 212 may further receive information about the content, such as what the item for sale is, who the model is, what hairstyle it has, and what parts of the item are not for sale, from the communication device 120 and store it in the content DB 221.

[0030] The content generation unit 213 includes, for example, a machine learning model capable of generating content such as images. For example, the content generation unit 213 applies the machine learning model to an image of a specific item for sale (for example, a shirt) to generate a modified image in which a portion of the image other than the item for sale (for example, jeans) is changed to another piece of clothing (for example, a skirt). The content generation unit 213 generates the modified content using, for example, a machine learning model that uses a publicly known instaGAN (instance-aware generative adversarial network, https: / / arxiv.org / pdf / 1812.10889.pdf) algorithm.

[0031] The content generation unit 213 is configured to generate multiple different modified images for parts of an image other than the part for sale. For example, the content generation unit 213 generates modified image 1205 in which the jeans part of the image is modified while maintaining the shirt for sale, as described with reference to FIG. 12, and further generates modified image 1301 in which the model (face) part of the image is modified, as shown in FIG. 13. The content generation unit 213 also generates modified image 1401 in which the background part of the image is modified, as shown in FIG. 14. To generate multiple different modified images, the content generation unit 213 may use, for example, trained machine learning models for modifying each part of the image. That is, the content generation unit 213 may use a first machine learning model for modifying the jeans in the image to a skirt, a second machine learning model for modifying the face of the model in the image, and a third machine learning model for modifying the background part of the image. In this way, the content generation unit 213 generates different modified images, making it possible to collect and analyze user reactions to these modified images.

[0032] In response to receiving a search request (or a browsing request) from communication device 110, content providing unit 214 provides communication device 110 with an image of an item for sale corresponding to the search request (or browsing request). At this time, the image provided by content providing unit 214 may be an image of the item for sale (e.g., an image including a shirt and jeans) or an altered image (e.g., an image including a shirt and a skirt). For example, content providing unit 214 may select and provide an altered image depending on the user, or may randomly select and provide altered images to a specific group of users. The altered image is selected so that user access can be analyzed.

[0033] The access analysis unit 215 executes an access analysis process, which will be described later. For example, the access analysis unit 215 monitors accesses from the communication device 110 to specific images for sale or modified images provided by the information processing device 100, and collects information on the number of accesses to those images. The access analysis unit 215 also compares the number of accesses to modified images provided to one or more users, and identifies modified images with a high number of accesses.

[0034] The learning processing unit 216 trains a machine learning model using, for example, the instaGAN algorithm. The learning data stored in the storage unit 204 is used to train the machine learning model. When separate machine learning models are used to generate multiple modified images, the corresponding learning data is used to train the machine learning models for each of the images.

[0035] <Configuration of communication device 110> Next, an example of the functional configuration of the communication device 110 will be described with reference to FIG. 3. In this embodiment, a case where a smartphone is used as an example of the communication device will be described, but the communication device may be other electronic devices such as a tablet terminal. Note that each of the functional blocks described with reference to the following figures may be integrated or separated, and the described functions may be realized by different blocks. Also, what is described as hardware may be realized by software, and vice versa.

[0036] The communication unit 301 includes, for example, a communication circuit and the like, and communicates with the information processing device 100 by connecting to the Internet via mobile communication such as LTE, or by connecting to a network via wireless LAN communication.

[0037] The control unit 302 includes a CPU 310 and a RAM 311, and controls the operation of each unit in the communication device 110 by, for example, causing the CPU 310 to execute a computer program recorded in the storage unit 307. The CPU 310 includes one or more processors. The RAM 311 includes, for example, a volatile semiconductor memory such as a DRAM.

[0038] The operation unit 303 includes a touch panel, keyboard, etc. provided in the communication device 110. The operation unit 303 accepts operations for GUIs for various operations displayed on the display unit 306 (for example, input of search keywords for items for sale and operations for viewing). The power supply unit 304 provides power to each unit of the communication device 110. The imaging device 305 is, for example, a camera mechanism including an imaging element, and takes pictures in response to instructions from the control unit 302.

[0039] The display unit 306 includes a display device such as an LCD, an OLED, etc. In response to an instruction from the control unit 302, the display unit 306 displays a GUI for inputting search conditions for items for sale, a GUI for displaying search results, etc.

[0040] The storage unit 307 includes a nonvolatile memory such as a semiconductor memory, and stores programs and setting values ​​executed by the control unit 302. The computer programs stored in the storage unit 307 include an operating system for implementing the various functions of the communication device 110, and various applications such as a browser.

[0041] The voice input device 308 includes, for example, a microphone, and inputs voice uttered by a user who uses the communication device 110. The voice input device 308 may not only input voice uttered by the user, but also have a function of recognizing the voice uttered by the user and inputting input information (for example, specification of a search keyword) into an application.

[0042] <Configuration of communication device 120> The functional configuration of communication device 120 may be substantially the same as the functional configuration of communication device 110, except that communication device 120 transmits content for sale to information processing device 100. Note that CPU 310 of communication device 120 controls the operation of each unit within communication device 120 by executing a computer program recorded in storage unit 307 of communication device 120, for example.

[0043] <Series of operations in content generation processing in information processing device> Next, a series of operations in the content generation process executed in the information processing device 100 will be described with reference to Fig. 4. This process is realized by the CPU 210 of the control unit 202 executing a computer program recorded in the storage unit 204. In the following description, for ease of explanation, the processing entity of each step will be collectively described as the control unit 202, but each unit functioning within the control unit 202 will execute the corresponding process depending on the processing content.

[0044] In S401, the control unit 202 acquires an image of a specific object for sale from the communication device 120. The image of the specific object for sale is transmitted from the communication device 120 in response to a user operation on the communication device 120, for example.

[0045] In S402, the control unit 202 applies the trained machine learning model to the image of the specific sales object acquired in S401 to generate a modified image in which a predetermined portion other than the specific sales object has been modified. For example, the control unit 202 specifies one of the modification types described below and causes the content generation unit 213 to generate a modified image.

[0046] In S403, the control unit 202 determines whether modified images have been generated for the number of predetermined variations. The predetermined variations are, for example, the modification types shown in the modification type table 1100 shown in FIG. 11 . Effective modification types may be extracted based on the identity of a specific sales object, and the extracted modification types may be used as the predetermined variations. For example, if the specific sales object is a "shirt," predetermined modification types effective for the "shirt" may be extracted from the modification type table 1100. Alternatively, predetermined modification types may be extracted from the modification type table 1100 based on the user's attributes (gender, age, or preference information). By predetermining modification types effective for the sales object or the user's attributes in this way, it is not necessary to generate modified images for modification types with low effectiveness among the various modification types. In other words, the calculation cost of the control unit 202 can be reduced and processing speed can be increased. If the control unit 202 determines that modified images corresponding to the extracted modification types or all modification types have been generated, the control unit 202 proceeds to S405; otherwise, the control unit 202 proceeds to S404.

[0047] In S404, the control unit 202 changes predetermined portions of the image other than the specific sales object to other portions (for which an altered image has not been generated) in accordance with the change type table 1100. Thereafter, the control unit 202 returns to S402 again to generate an altered image.

[0048] In S405, the control unit 202 receives a request for display information from the user's communication device 110. The request for display information is, for example, a search request in an e-commerce service or a request to view some sales item.

[0049] In S406, the control unit 202 selects the altered image and provides it to the communication device 110 as display information. At this time, the control unit 202 may provide the image for sale (i.e., the original image) to the communication device 110 instead of selecting the altered image, depending on the situation. For example, when the (original) image for sale has been provided to the user more than a predetermined number of times, the control unit 202 may select the altered image and send it to the communication device 110. In other words, the original image for sale may be provided to the user several times to increase the user's favorable impression of the image for sale, and information with a changed presentation may be provided before the user's interest wanes.

[0050] For example, when the request from the communication device 110 is a search request, the control unit 202 transmits search result information and the image for sale (or the modified image) to the communication device 110 as display information. When the display information for transmitting search results is displayed on the communication device 110, it is displayed, for example, as shown in FIG. 10A . In this example, when "shirt" is entered in the search box 1002, a search result screen 1001 displays advertisements 1004 to 1006 related to the search keyword above a search result 1003 for "shirt." At this time, among the advertisements 1004 to 1006, the advertisement 1004 is an image for sale. The control unit 202 may change the advertisement 1004 to an modified image instead of the image for sale. When displaying the modified image, the control unit 202, for example, selects one of the multiple modified images generated in S402 to S404. For example, the control unit 202 may randomly select an modified image from the multiple modified images and transmit the modified image to the communication device 110.

[0051] Alternatively, the control unit 202 may transmit, for example, display information of a search result such as that shown in FIG. 10B to the communication device 110. In this example, when "shirt" is entered in the search window 1002, a search result screen 1010 displays a search result 1011 for "shirt" based on images 1012 to 1014 related to the search keyword. In this example, of the images 1012 to 1014, the image 1012 is the (original) image for sale. The control unit 202 may replace the image for sale with an altered image for the image 1012. When displaying the altered image, the control unit 202 may select, for example, one of the multiple altered images generated in S402 to S404. For example, the control unit 202 may randomly select an altered image from the multiple altered images and transmit the altered image to the communication device 110.

[0052] In this way, the control unit 202 may provide the image for sale or the modified image to the communication device 110 as an advertisement included in the display information, or may provide the image for sale or the modified image to the communication device 110 as an image of a product or the like included in the display information.

[0053] Furthermore, in the above embodiment, the display information of the search results was used as an example. However, for example, in response to a request from the communication device 110 to view one piece of product information, an image for sale or an altered image may be provided to the communication device 110 as an advertisement to be presented within the product information.

[0054] In S407, the control unit 202 collects user accesses (by the communication device 110) to the advertisement or image provided in S406 and analyzes access information to the modified image. As described above, user accesses to each advertisement or image are stored and accumulated in the access history of the user table 700. Specific processing in this step will be described later as access analysis processing. By analyzing this user access, the control unit 202 identifies change types with a high number of accesses. That is, the control unit 202 can identify what types of modified images attract users' interest. Furthermore, by identifying change types with a high number of accesses, modified images can be generated by narrowing down the various change types to those with high effectiveness. That is, there is no need to generate modified images for change types with low effectiveness. This reduces the calculation cost in the control unit 202 and speeds up processing.

[0055] In S408, the control unit 202 generates modified content for another sales item in accordance with the identified modification type. That is, in the processes of S402 to S407, the control unit 202 analyzes and identifies modification types that are effective in increasing access for, for example, the sales item "shirt," and therefore generates modified images for another sales item, for example, a "jacket," in accordance with the identified modification type. In this way, modified images with high advertising and presentation effects can be easily generated and provided to users. When the process of S408 ends, the control unit 202 ends the series of operations of the content generation process.

[0056] Next, a series of operations in the access analysis process executed in the information processing device 100 will be described with reference to Fig. 5. The access analysis process shown in Fig. 5 is a more detailed version of the operation of S407 in the content generation process described above. Therefore, this process is realized by the CPU 210 of the control unit 202 executing a computer program recorded in the storage unit 204. In the following explanation, for ease of explanation, the processing entity of each step will be collectively described as the control unit 202, but each unit (mainly the access analysis unit 215) functioning within the control unit 202 will perform the corresponding process depending on the processing content.

[0057] The access analysis process shown in FIG. 5 is an example of an analysis process, and is a process for identifying a change type with a high number of accesses within a group based on access information from multiple users who form the group. A group may be formed, for example, by multiple users with the same attributes, such as multiple users of the same age or generation. Alternatively, a group may be formed by multiple users with similar preferences. Multiple users with similar preferences are, for example, similar users whose access histories shown in FIG. 7 belong to the same cluster through cluster analysis. Furthermore, multiple users with similar preferences may also be similar users whose purchase histories using e-commerce services (purchase histories shown in FIG. 8) belong to the same cluster through cluster analysis.

[0058] In S501, the control unit 202 acquires access information of multiple users in a group. For example, the control unit 202 acquires information on the access history 703 of the users from the user table 700 described above.

[0059] In S502, the control unit 202 calculates the number of accesses to the modified image to be tallied based on the access history 703 of each user acquired in S501. For example, if the sales item to be analyzed is image 1201 of a "shirt," the control unit 202 calculates the number of accesses to each of the modified images, modified image 1205, modified image 1301, and modified image 1401.

[0060] In S503, the control unit 202 identifies the modified image with the highest number of accesses from among the multiple modified images. For example, the control unit 202 identifies the modified image with the highest number of accesses from among the number of accesses to modified image 1205, the number of accesses to modified image 1301, and the number of accesses to modified image 1401. The control unit 202 may identify a predetermined number of modified images with the highest number of accesses.

[0061] In S504, the control unit 202 identifies the change type based on the changed image with the highest number of accesses identified in S503. For example, if the changed image 1205 has the highest number of accesses, the control unit 202 references the change types in the content table 900 to identify the change type of that image (the change type is from jeans to a skirt). Multiple change types may be identified depending on the processing of S503. After identifying the change type, the control unit 202 then proceeds to S408 shown in FIG. 4.

[0062] Note that identifying the change type by the processing of S504 may be synonymous with identifying a machine learning model corresponding to the change type. For example, if the machine learning model used by the content generation unit 213 differs for each change type, that is, if a corresponding machine learning model is used when generating an image in which jeans have been changed to a skirt and when generating an image in which the model within the image has been changed, identifying the change type is synonymous with identifying the machine learning model.

[0063] In the above-described access analysis process, an example is described in which the access information of multiple users having the same attribute as a predetermined attribute is analyzed. However, if there is no user having the same attribute as the predetermined attribute, or if there is not enough access information for a user having the same attribute as the predetermined attribute, the number of accesses may be analyzed for users having an attribute similar to the predetermined attribute of the user (for example, an age similar to the user's age).

[0064] <Another example of access analysis processing in information processing device> Next, another example of the access analysis processing executed in the information processing device 100 will be described with reference to Fig. 6. The access analysis processing shown in Fig. 6, like that in Fig. 5, is a more detailed version of the operation of S407 in the content generation processing described above. Therefore, this processing is realized by the CPU 210 of the control unit 202 executing a computer program recorded in the storage unit 204. In the following explanation, for ease of explanation, the processing entity of each step will be collectively described as the control unit 202, but each unit (mainly the access analysis unit 215) functioning within the control unit 202 will execute the corresponding processing depending on the processing content.

[0065] The operation of the access analysis process shown in Fig. 6 is an example different from the analysis process shown in Fig. 5, and is an operation for identifying a change type that has a high number of accesses from a single user based on the access information of the single user. In other words, this process is a process for analyzing the most effective change type for each user. Before this process is executed, for example, several changed images generated in S402 to S404 are presented to a single user in advance as display information.

[0066] In S601, the control unit 202 acquires access information of a specific user. For example, the control unit 202 acquires the access information 703 associated with the user ID of the user to be analyzed.

[0067] In S602, the control unit 202 calculates the number of accesses to the multiple changed images. That is, the control unit 202 calculates the number of accesses to the multiple content IDs from the access information 703.

[0068] In S603, the control unit 202 identifies an altered image with a high number of accesses from among the multiple altered images. When altered images 1205, 1301, and 1401 are presented in advance as display information for one user, the control unit 202 identifies an altered image with a high number of accesses from among the number of accesses to altered image 1205, the number of accesses to altered image 1301, and the number of accesses to altered image 1401. The control unit 202 may identify a predetermined number of altered images with a high number of accesses.

[0069] In S604, the control unit 202 identifies the change type based on the changed image with the highest number of accesses identified in S603. For example, if the changed image 1205 has the highest number of accesses, the control unit 202 references the change type in the content table 900 to identify the change type of that image. The control unit 202 may identify multiple change types with the highest number of accesses. After identifying the change type, the control unit 202 then proceeds to S408 shown in FIG. 4.

[0070] In the above embodiment, an example was described in which one image of the original item for sale or one modified image is displayed on the search result screen shown in FIGS. 10A and 10B . However, an image of the original item for sale and a modified image may be displayed simultaneously. The control unit 202 may transmit, for example, search result display information 1010 as shown in FIG. 15 to the communication device 110. In this example, when "shirt" is entered in the search box 1002, search result 1501 for "shirt" is displayed on the search result screen 1010 based on images 1012, 1013, and 1502 related to the search keyword. In this case, one of the images for sale is image 1012 of the original item for sale, and the other is modified image 1502. Displaying the images in this manner can increase the user's opportunities to encounter the item for sale while avoiding the presentation of the same image, thereby preventing a decrease in user interest.

[0071] Furthermore, multiple modified images of the same item for sale may be simultaneously displayed on the search result screen. The control unit 202 may transmit, for example, search result display information 1010 as shown in FIG. 16 to the communication device 110. In this example, when "shirt" is entered in the search box 1002, search result 1601 for "shirt" is displayed on the search result screen 1010 based on images 1602, 1603, and the like related to the search keyword. Among the images of the item for sale, one is modified image 1602 in which jeans have been changed to a skirt. The other is modified image 1603 in which the model has been changed. This search result display information is effective when the original image of the item for sale is presented to the user viewing it a predetermined number of times or more. Displaying the image in this manner increases the user's opportunities to encounter the item for sale, while avoiding the presentation of identical images, thereby preventing a loss of user interest.

[0072] As described above, in this embodiment, the control unit 202 applies a machine learning model to an image of a specific sales object to generate an altered image in which portions of the image other than the specific sales object are altered. The generated altered image is then transmitted to the communication device 110, thereby providing the user with the generated altered image. Furthermore, when using an image of another sales object, a machine learning model that alters a predetermined portion in accordance with the user's behavior regarding the altered content is applied to the image of the other sales object to generate an altered image of the other sales object. This makes it possible to generate effective content for the sales object that attracts users' attention. Furthermore, the control unit 202 collects information on user accesses to the altered image and, based on the access information, identifies an alteration type corresponding to an altered image with a high number of accesses. This makes it possible to identify an image alteration method with a high advertising or presentation effect and suppress the generation of an altered image with a low effect, thereby speeding up the computational processing required for providing content and reducing the required computational resources.

[0073] <Summary of the embodiment> (1) In the above-described embodiments, an information processing device is provided. The information processing device one or more processors; a memory storing one or more programs, the one or more programs, when executed by the one or more processors, causing the one or more processors to: applying a machine learning model to content for a specific sales target to generate modified content by modifying a predetermined portion of the content other than the specific sales target; providing the generated modified content to a user; The machine learning model is applied to content for other sales items, and a predetermined portion of the content for the other sales items other than the other sales items is modified in accordance with the user's behavior with respect to the modified content, thereby generating modified content for the other sales items.

[0074] (2) In the above-described embodiment, the one or more programs may further include: collects information on the users' accesses to the changed content, and identifies a change type corresponding to the changed content with a high number of accesses based on the access information; The predetermined portion other than the other sales object is a portion other than the other sales object according to the specified change type.

[0075] (3) In the above-described embodiment, identifying the type of change is based on a comparison of user access to first content that has changed a first portion of the content other than the specified sale object, and user access to second content that has changed a second portion of the content other than the specified sale object.

[0076] (4) In the above-described embodiment, identifying the change type includes identifying a change type corresponding to changed content that has a high number of accesses by multiple users in the group based on information about accesses of multiple users in the group.

[0077] (5) In the above-described embodiment, identifying the change type includes identifying a change type that has a high number of accesses by a particular user based on information about the particular user's access to changed content for multiple sales items.

[0078] (6) In the above-described embodiment, the specific sales object is a product traded in an e-commerce service; The predetermined portion other than the specific sales object includes at least one of a portion of a person using the product, a pose of the person using the product, and a background portion within the content.

[0079] (7) In the above-described embodiment, identifying the type of change includes identifying one of a machine learning model that generates the first content by changing the first portion of the content and a machine learning model that generates the second content by changing the second portion of the content.

[0080] (8) In the above-described embodiment, identifying the change type includes identifying a change type corresponding to changed content that has a high number of accesses by multiple users having the same attribute as the user's first attribute, based on information on accesses by multiple users having the first attribute.

[0081] (9) In the above-described embodiment, identifying the change type includes, when there is no information on access by multiple users having the same attribute as the first attribute of a user, identifying a change type corresponding to changed content that has a high number of accesses by multiple users having the second attribute based on information on access by multiple users having a second attribute similar to the first attribute.

[0082] (10) In the above embodiment, the content for the particular sale item is provided to the user, and then the generated modified content is provided to the user.

[0083] (11) In the above-described embodiment, providing the modified content to the user includes providing the modified content to the user in response to receiving a request to search for the particular item for sale.

[0084] (12) In the embodiment described above, the content for a particular sale is an image of a particular product.

[0085] (13) In the above embodiment, the content for a particular sales object is a video about a particular product.

[0086] (14) In the above embodiment, the content for a particular sale is text about a particular product.

[0087] (15) In the above embodiment, an information processing method is provided. The information processing method is Applying a machine learning model to content for a specific sales target to generate modified content by modifying a predetermined portion of the content other than the specific sales target; providing the generated modified content to a user; applying a machine learning model to content for the other sale items, and modifying a predetermined portion of the content for the other sale items other than the other sale items in accordance with the user's behavior with respect to the modified content, thereby generating modified content for the other sale items.

[0088] (16) In the above-described embodiments, a computer-readable medium is provided. 1. A non-transitory computer-readable medium containing instructions for one or more programs executed by one or more processors of an information processing device, the one or more programs, when executed by the one or more processors, causing the information processing device to: Applying a machine learning model to content for a specific sales target to generate modified content by modifying a predetermined portion of the content other than the specific sales target; providing the generated modified content to a user; Applying a machine learning model to content for other sales items, and modifying a predetermined portion of the content for the other sales items other than the other sales items in accordance with the user's behavior with respect to the modified content, thereby generating modified content for the other sales items.

[0089] The invention is not limited to the above-described embodiment, and various modifications and variations are possible within the scope of the gist of the invention.

Claims

1. An information processing device, one or more processors; and a memory storing one or more programs, the one or more programs, when executed by the one or more processors, causing the one or more processors to: applying a machine learning model to content for a specific sales target to generate modified content by modifying a predetermined portion of the content other than the specific sales target; providing the generated modified content to a user; collecting information on the users' accesses to the changed content, and identifying a change type corresponding to the changed content with a high number of accesses based on the access information; applying the machine learning model to content for the other sale objects to modify portions of the content for the other sale objects according to the identified modification type other than the other sale objects, thereby generating modified content for the other sale objects; An information processing device, wherein the modified content in which the specified portion has been modified and the modified content for the other sales items are images or videos generated by a machine learning model.

2. 2. The information processing device of claim 1, wherein the identification of the change type is based on a comparison between user access to a first content in which a first portion of the content other than the specific sales object has been changed and user access to a second content in which a second portion of the content other than the specific sales object has been changed.

3. The information processing device according to claim 2 , wherein identifying the change type includes identifying a change type corresponding to changed content that has been accessed frequently by a plurality of users in a group based on access information of the plurality of users in the group.

4. The information processing device according to claim 2 , wherein the identifying the change type includes identifying a change type that has a high number of accesses from a specific user based on information on the specific user's accesses to changed content for a plurality of sales items.

5. the specific sales object is a product traded in an e-commerce service, The information processing device according to claim 1 , wherein the predetermined portion other than the specific sales object includes at least one of a portion of a person using the product, a pose of the person using the product, and a background portion within the content.

Images