Recommendation system, recommendation server, and recommendation method
The recommendation system addresses the challenge of providing personalized recommendations by generating fictitious content using a large-scale language model, ensuring alignment with users' vague images and nuances, thereby enhancing engagement and purchase desire.
Patent Information
- Application Number
- JP2025068617
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2025-04-18
- Publication Date
- 2025-09-29
- Estimated Expiration
- 2045-04-18
AI Technical Summary
Existing recommendation systems fail to provide personalized product recommendations based on users' vague images and nuances, as they either rely on category-based correlations or require explicit user input to design ideal products.
A recommendation system that generates fictitious content information using a large-scale language model based on site summary and user input, selects matching content, and presents personalized recommendations.
Enables personalized content presentation that aligns with users' vague images and nuances by generating fictitious content that matches their input, enhancing user engagement and purchase desire.
Smart Images

Figure 0007745801000001_ABST
Abstract
Description
[Technical Field]
[0001] The present invention relates to a recommendation system, a recommendation server, and a recommendation method, and more particularly to a system that recommends personalized content to a user. [Background technology]
[0002] Conventionally, recommendation technologies that predict and present products that a user is likely to be interested in on an electronic commerce (EC) site that the user browses have been known (see, for example, Patent Documents 1 and 2). Also known is a technology that uses a large-scale language model to generate product descriptions that a user is likely to be interested in (see, for example, Patent Document 3).
[0003] Patent Document 1 discloses a method for multimodally analyzing product images and product descriptions, vectorizing features, and presenting recommended products through machine learning using the vectors. Specifically, the information processing device described in Patent Document 1 converts product data, including product images and product descriptions, into features, and performs machine learning on the features of user data representing the attributes of users who purchase the products (such as age, gender, and occupation) and the features of the product data to create a model that learns the correlation between the features of the user data and the features of the product data. Then, the features of the user data and the features of the product data corresponding to users who access an e-commerce site to purchase the products are acquired, machine learning is performed using the model to calculate compatibility, and the recommendation order of the products is determined based on the compatibility.
[0004] Patent Document 2 discloses a method for generating fictitious product information based on information input by a user and proposing existing products that match the fictitious product information. Specifically, in the computer system described in Patent Document 2, when a user designs an insurance policy by inputting appropriate information on a web page, the insurance design application presents a fictitious insurance product that meets the user's needs, i.e., an ideal insurance product. The insurance design application then searches for actual insurance products that meet the specifications of the ideal insurance product that meets the user's needs and proposes the corresponding insurance product to the user.
[0005] Patent Document 3 discloses that a product description draft for at least one of a product name and a product photo is generated using a large-scale language model. Specifically, the information processing device described in Patent Document 3 generates a prompt to which predetermined text is added for at least one of a product name and a product photo received from a user, and inputs the generated prompt into a large-scale language model to obtain a product description draft for at least one of a product name and a product photo from the large-scale language model.
[0006] According to the technology described in Patent Document 1, products that are correlated with the user's attributes are recommended, but because the recommended products are correlated by categories such as age, gender, and occupation, personalized product recommendations are not necessarily presented for each individual user. In contrast, according to the technology described in Patent Document 2, personalized product recommendations are presented for each individual user, but the user must explicitly design their ideal product. Therefore, it is not possible to present personalized product recommendations based on the vague image or nuances that the user has in mind. [Prior art documents] [Patent documents]
[0007] [Patent Document 1] Patent No. 6543986 [Patent Document 2] Patent No. 6542420 Publication [Patent Document 3] Patent No. 7411137 Summary of the Invention [Problem to be solved by the invention]
[0008] The present invention has been made to solve such problems, and aims to enable users to be presented with recommended content that is personalized to match the vague images and nuances that the users have in mind. [Means for solving the problem]
[0009] In order to solve the above-mentioned problems, the recommendation system of the present invention comprises a fictitious content information generation unit that generates a prompt using site summary information that outlines the site providing the content and free input information from the user, and generates fictitious content information by inputting the generated prompt into a large-scale language model; a content selection unit that selects, from among multiple pieces of content provided on the site, one or more pieces of content that match predetermined conditions with the fictitious content information generated by the fictitious content information generation unit as recommended content; and a recommended content presentation unit that presents the one or more recommended pieces of content selected by the content selection unit to the user. [Effects of the Invention]
[0010] According to the present invention configured as described above, when a user freely inputs information that represents a vague image, nuance, etc. that the user has in mind, fictitious content information that matches the freely input information is generated, and one or more actual contents that match the fictitious content information under predetermined conditions are selected from sites that provide content and presented to the user. This makes it possible to present recommended content that is personalized to the user's vague image, nuance, etc. that the user has in mind. [Brief explanation of the drawings]
[0011] [Figure 1] FIG. 1 is a diagram illustrating an example of the overall configuration of a recommendation system according to an embodiment of the present invention. [Figure 2] FIG. 2 is a block diagram showing an example of a functional configuration of an EC site server according to the present embodiment. [Figure 3] FIG. 2 is a block diagram illustrating an example of the functional configuration of a recommendation server according to the present embodiment. [Figure 4] FIG. 10 is a diagram showing an example of a search information input field included in a web page of an EC site. [Figure 5] FIG. 10 is a diagram illustrating an example of processing by a product feature vector generation unit. [Figure 6] A figure showing an example of a prompt generated by a fictitious product generation unit and fictitious product information generated by an LLM. [Figure 7] FIG. 10 is a diagram illustrating an example of a prompt generated by a product description generation unit. [Figure 8] FIG. 10 is a diagram showing an example of a web page displayed as a search result by a site display unit. [Figure 9] 4 is a flowchart showing an example of operation of the recommendation server 1 (procedure of a recommendation method) according to this embodiment. DETAILED DESCRIPTION OF THE INVENTION
[0012] An embodiment of the present invention will be described below with reference to the drawings. Fig. 1 is a diagram showing an example of the overall configuration of a recommendation system according to this embodiment. The recommendation system of this embodiment is configured to include a recommendation server 1, a large-scale language model (LLM) 2, and an EC site server 3. An administrator terminal 4 and a user terminal 5 are communicably connected to this recommendation system via a communication network 6.
[0013] Here, the recommendation server 1 is communicably connected to the LLM 2, the EC site server 3, and the administrator terminal 4 via a communication network 6. The EC site server 3 is communicably connected to a user terminal 5 via the communication network 6. The communication network 6 is, for example, the Internet, and is constructed to include a public communication line network, a mobile phone line network, etc. A wireless communication path, a LAN (Local Area Network), etc. may be included as part of the communication network 6.
[0014] The recommendation server 1 is a device logically realized by a general-purpose computer such as a workstation or a personal computer, or by cloud computing. The recommendation server 1 may be configured as a single server device or a combination of multiple server devices. The recommendation server 1 cooperates with the EC site server 3 via a WebAPI, selects one of multiple products (an example of content) posted on an EC site (an example of a site that provides content) presented by the EC site server 3, and performs a process of recommending the selected product to a user through the EC site of the EC site server 3.
[0015] LLM2 is a generation AI used by recommendation server 1 when generating recommendation information (including information on recommended products and product descriptions for one or more recommended products). LLM2 is a deep learning model trained using large amounts of text data and image data, and receives prompts from recommendation server 1, including instructions and reference information, and generates answer information according to the instructions and responds to recommendation server 1.
[0016] The EC site server 3 is a general-purpose computer such as a workstation or personal computer, or a device logically realized by cloud computing. The EC site server 3 may be configured as a single server device or a combination of multiple server devices. The EC site server 3 executes a process of displaying a web page of an EC site on a user terminal 5 in response to a request from the user terminal 5. The EC site server 3 also executes a process of linking with the recommendation server 1 via a WebAPI, requesting a search from the recommendation server 1 in response to search information input by a user, and providing the received recommendation information to the user terminal 5.
[0017] The administrator terminal 4 is a terminal used by the administrator of the EC site server 3, and is configured, for example, by a smartphone, tablet, or personal computer. The administrator terminal 4 can access the recommendation server 1 via the communication network 6 using an application or web browser executed on the administrator terminal 4. For example, the administrator terminal 4 can set in the recommendation server 1 any conditions or other necessary information that the recommendation server 1 will provide when generating recommendation information using the LLM 2.
[0018] The user terminal 5 is a terminal used by end users such as consumers, and may be, for example, a smartphone, tablet, personal computer, smart TV, smart watch, or smart home appliance. Any other device that can connect to the communication network 6 and access various content can be used as the user terminal 5. The user terminal 5 can access the EC site server 3 via the communication network 6 and browse the EC site using an application or web browser executed on the user terminal 5. The user terminal 5 can also search for products by entering any information on a search screen provided on the EC site. As will be described in detail later, this embodiment enables product searches not only by simple keyword searches but also by entering vague hopes and feelings as free text, thereby recreating the shopping experience of a physical store online.
[0019] Fig. 2 is a block diagram showing an example of the functional configuration of the EC site server 3 according to this embodiment. Fig. 3 is a block diagram showing an example of the functional configuration of the recommendation server 1 according to this embodiment. The functional configurations of the EC site server 3 and the recommendation server 1 will be described below with reference to Figs. 2 and 3.
[0020] 2, the EC site server 3 of this embodiment has, as its functional configuration, a site display unit 31, a master information providing unit 32, a search information acquiring unit 33, a search request unit 34, and a search result receiving unit 35. The EC site server 3 also has, as a storage medium, a product master DB storage unit 36.
[0021] The functional blocks 31 to 35 execute the following processes through the cooperation of hardware and software. For example, the processes of the functional blocks 31 to 35 are executed by the operation of a program stored in a storage medium such as RAM, ROM, a hard disk, or a semiconductor memory under the control of a processor of a microcomputer including a CPU, RAM, ROM, etc.
[0022] 3, the recommendation server 1 of this embodiment includes, as functional components, a condition setting unit 11, a master information generation unit 12, a product feature vector generation unit 13, a fictitious product information generation unit 14, a product selection unit 15, a product description generation unit 16, and a recommended product presentation unit 17. The fictitious product information generation unit 14 includes, as more specific functional components, a fictitious product generation unit 14a and a fictitious product feature vector generation unit 14b. The recommendation server 1 also includes, as storage media, a management master DB storage unit 18 and a feature vector storage unit 19. The product feature vector generation unit 13, the fictitious product information generation unit 14, the product selection unit 15, the product description generation unit 16, the recommended product presentation unit 17, the fictitious product generation unit 14a and the fictitious product feature vector generation unit 14b are examples of a content feature vector generation unit, a fictitious content information generation unit, a content selection unit, a content description generation unit, a recommended content presentation unit, a fictitious content generation unit and a fictitious content feature vector generation unit, respectively.
[0023] The functional blocks 11 to 17 execute the following processes through the cooperation of hardware and software. For example, the processes of the functional blocks 11 to 17 are executed by the operation of a program stored in a storage medium such as RAM, ROM, a hard disk, or a semiconductor memory under the control of a processor of a microcomputer including a CPU, RAM, ROM, etc.
[0024] In the configuration of the EC site server 3 shown in Fig. 2, the product master DB storage unit 36 stores master information related to products (items) displayed on the EC site. The product master information stored in the product master DB storage unit 36 includes, for example, information such as an ID that uniquely identifies the product, a product name (product title), a product image, a product description, a product category, a price, and inventory status. The product image may be a still image or a video.
[0025] In response to a request from the web browser of the user terminal 5, the site display unit 31 generates a web page of the EC site using the product master information stored in the product master DB storage unit 36 and displays it on the web browser. The web page displayed on the web browser includes information such as the product name, product image, product description, product category, price, and stock status.
[0026] In response to a request from the recommendation server 1, the master information providing unit 32 provides the recommendation server 1 with the product master information stored in the product master DB storage unit 36. The recommendation server 1 copies and stores the product master information managed by the EC site server 3 in order to select one of multiple products posted on the EC site and generate information on the recommended product. For this purpose, the recommendation server 1 requests the EC site server 3 to provide the product master information, and the master information providing unit 32, having received this request, provides the product master information to the recommendation server 1.
[0027] The search information acquisition unit 33 acquires from the user terminal 5 any search information input by the user through a search information input field included in the web page of the EC site displayed by the site display unit 31. FIG. 4 is a diagram showing an example of a search information input field 101 included in the web page of the EC site. As shown in FIG. 4, the user can request the EC site server 3 to execute a search by inputting any free text into the search information input field 101 and pressing a search button 102.
[0028] As described above, in this embodiment, a product search can be performed by freely entering the user's vague hopes and feelings, or the vague image or nuance that the user has in the search information input field 101. Of course, a product search can also be performed by entering search keywords in the search information input field 101. When the search button 102 is pressed, the free-text search information (free input information) entered by the user in the search information input field 101 is transmitted from the user terminal 5 to the EC site server 3 and acquired by the search information acquisition unit 33.
[0029] 4 may be included only on the top page of the EC site, or may be included on multiple web pages included in the EC site. For example, if there are different web pages for each product category, the search information input field 101 may be included on the web page for each product category. When the search information input field 101 is included on multiple web pages in this way, the search request sent from the user terminal 5 to the EC site server 3 includes the search information as well as the identification information of the web page.
[0030] The search request unit 34 transmits the search information (and web page identification information; the same applies in the following description) acquired by the search information acquisition unit 33 to the recommendation server 1 to request a search for recommended products. Upon receiving this search request, the recommendation server 1 executes a search for recommended products and responds with search result information to the EC site server 3. The search result receiving unit 35 of the EC site server 3 receives the search result information, i.e., recommendation information, from the recommendation server 1 and supplies it to the site display unit 31. The site display unit 31 displays the recommendation information on the web page of the EC site as a response to the search request from the user terminal 5 (a response to the search information acquisition unit 33 acquiring the search information from the user terminal 5).
[0031] In the configuration of the recommendation server 1 shown in Fig. 3, the condition setting unit 11 sets arbitrary conditions for the recommendation server 1 to generate recommendation information according to information input to the administrator terminal 4 via a management screen provided from the recommendation server 1 to the administrator terminal 4. For example, the condition setting unit 11 sets filter conditions for specifying products to be excluded from the target when the master information generation unit 12 acquires product master information from the EC site server 3. As an example, it is possible to set conditions for specifying products to be excluded from search targets, such as products in a specific category or price range, or out-of-stock products.
[0032] The condition setting unit 11 also sets any conditions that the product description generation unit 16 applies when generating a product description for a recommended product using LLM2 (details of the product description generation unit 16 will be described later). As an example, it is possible to set conditions for adjusting the content of the product description generated by LLM2, such as "explain in a casual tone," "explain without technical terms," "explain using technical terms," "explain in English," or "explain in friendly language using emojis." This makes it possible to customize the product description to suit the tone of the e-commerce site, the target users, etc.
[0033] The master information generation unit 12 generates management master information to be used for generating recommendation information using the conditions set by the condition setting unit 11, the product master information acquired from the master information providing unit 32 of the EC site server 3 under the filter conditions included therein, and other information input from the administrator terminal 4, and stores the management master information in the management master DB storage unit 18. The management master information stored in the management master DB storage unit 18 includes information such as an ID that uniquely identifies the EC site (or the company that operates the EC site), the domain of the EC site, an ID that uniquely identifies a web page, the product master information (copied and processed) acquired from the EC site server 3, and the conditions set by the condition setting unit 11.
[0034] The management master information stored in the management master DB storage unit 18 further includes templates for instruction statements used in prompts supplied to the LLM 2, HTML templates used by the site display unit 31 when displaying web pages of recommendation information, and site summary information that shows an overview of the EC site. The template information is pre-stored in the management master DB storage unit 18. The site summary information is information that simply expresses the purpose and features of the EC site, and is registered in the management master DB storage unit 18 according to information input from the administrator terminal 4 via a management screen provided to the administrator terminal 4 by the recommendation server 1.
[0035] For example, the name of the EC site, the name of the physical store that operates the EC site, the categories of products sold on the EC site, summaries describing the main features of the products sold on the EC site, and the like are stored as site summary information in the management master DB storage unit 18. Site summary information that provides an overview of the entire EC site may be stored in the management master DB storage unit 18, or multiple pieces of site summary information that provide an overview of each of multiple web pages included in the EC site may be stored in the management master DB storage unit 18.
[0036] The product feature vector generation unit 13 generates product feature vectors from information about multiple products posted on the EC site, and stores them as a database in the feature vector storage unit 19. Note that, although the management master DB storage unit 18 and the feature vector storage unit 19 are shown here as separate components, the product feature vectors generated by the product feature vector generation unit 13 may be stored in an integrated manner together with other information in the management master DB storage unit 18.
[0037] For example, the product feature vector generation unit 13 generates a product feature vector using a product image and a product description from the product master information stored as a duplicate in the management master DB storage unit 18. For example, the product feature vector generation unit 13 identifies feature amounts from the product image and the product description, and converts the feature amounts into a vector sequence (a sequence of numerical data).
[0038] Figure 5 is a diagram showing an example of processing by the product feature vector generation unit 13. As shown in Figure 5 as an example, the product feature vector generation unit 13 generates a prompt 201 using a product image and instruction template stored in the management master DB storage unit 18, and generates a product description 202 inferred from the product image by inputting the generated prompt 201 into the LLM 2. The product feature vector generation unit 13 then generates a product feature vector from the product description 202 generated from the product image and the product description 203 stored as a copy in the management master DB storage unit 18, and stores the generated product feature vector in the feature vector storage unit 19 as a database.
[0039] Any method can be used to generate a product feature vector from a product description. For example, the product feature vector generation unit 13 performs morphological analysis on the product description to break it down into words, calculates the frequency of occurrence of each word and TF-IDF (Term Frequency-Inverse Document Frequency), and generates a product feature vector using these as features. Note that the process described here is merely an example and is not limited to this. For example, the TF-IDF values may be subjected to dimensional compression using singular value decomposition or the like to extract semantic features of the text. Alternatively, words extracted by morphological analysis may be converted into distributed representations, and a product feature vector may be generated using the distributed representations. Alternatively, words extracted by morphological analysis may be applied to an n-gram language model, and a product feature vector may be generated using the acquired n-grams as features.
[0040] The fictitious product generation unit 14a of the fictitious product information generation unit 14 generates a prompt using the site overview information and instruction statement templates stored as management master information in the management master DB storage unit 18 and the search information (freely entered information from the user) included in the search request sent by the search request unit 34 of the EC site server 3, and generates fictitious product information (an example of fictitious content information) by inputting the generated prompt into the LLM 2. The fictitious product information includes, for example, a fictitious product title (product name) and a fictitious product description.
[0041] FIG. 6 shows an example of a prompt generated by the fictitious product generation unit 14a and fictitious product information generated by the LLM2. The instruction sentence in the prompt 301 shown in FIG. 6(a) is created from a template stored in the management master DB storage unit 18. The site summary information in the prompt 301 is transcribed from the management master information stored in the management master DB storage unit 18. If the search information includes identification information for a web page, the fictitious product generation unit 14a generates the prompt 301 using the site summary information corresponding to the web page. The user's desired information in the prompt 301 is transcribed from free input information from the user included in the search request sent by the search request unit 34. When this prompt 301 is input into the LLM2, fictitious product information 302 as shown in FIG. 6(b) is generated.
[0042] The fictitious product feature vector generation unit 14b of the fictitious product information generation unit 14 generates a fictitious product feature vector from the fictitious product information (fictitious product title and fictitious product description) generated by the fictitious product generation unit 14a. Any method can be used to generate a fictitious product feature vector from the fictitious product information. As an example, the fictitious product feature vector generation unit 14b generates a fictitious product feature vector using the same method as the product feature vector generation unit 13.
[0043] The product selection unit 15 selects, as recommended products, one or more products that match, under predetermined conditions, the fictitious product information generated by the fictitious product information generation unit 14 from among a plurality of products listed on the EC site (a plurality of products stored as management master information in the management master DB storage unit 18). In this embodiment, the product selection unit 15 selects, as recommended products, one or more products that match, under predetermined conditions, with respect to the similarity between a plurality of product feature vectors (generated from information about a plurality of products listed on the EC site) stored as a database in the feature vector storage unit 19 and the fictitious product feature vector generated by the fictitious product feature vector generation unit 14b.
[0044] For example, the product selection unit 15 selects as recommended products a predetermined number of products having the greatest similarity between the product feature vector and the fictitious product feature vector. Alternatively, the product selection unit 15 may select as recommended products products having a similarity between the product feature vector and the fictitious product feature vector that is greater than a predetermined value. The similarity between the product feature vector and the fictitious product feature vector can be calculated using, for example, cosine similarity, Euclidean distance, inner product, or Hamming distance.
[0045] The product description generation unit 16 generates a prompt using information on one or more recommended products selected by the product selection unit 15, a template of instructions stored in the management master DB storage unit 18, and information indicating the conditions set by the condition setting unit 11 and stored as management master information in the management master DB storage unit 18, and generates product descriptions for one or more recommended products by inputting the generated prompt into the LLM 2. The product descriptions generated here are appealing statements that encourage purchases by capturing commonalities between one or more recommended products, and can be, for example, captions (headlines), catchphrases, etc.
[0046] FIG. 7 is a diagram showing an example of a prompt 401 generated by the product description generation unit 16. The instruction text in the prompt 401 shown in FIG. 7 is created from a template stored in the management master DB storage unit 18. The product information in the prompt 401 is a copy of the product name and product description stored as management master information in the management master DB storage unit 18 for one or more recommended products selected by the product selection unit 15. The conditions in the prompt 401 are copied from the set conditions stored as management master information in the management master DB storage unit 18. The conditions used here may be conditions set for each web page.
[0047] The product description generation unit 16 may generate a prompt using at least one of the site summary information stored in the management master DB storage unit 18 and the free input information acquired by the fictitious product information generation unit 14 from the EC site server 3, in addition to the information on one or more recommended products selected by the product selection unit 15. In this way, it is possible to generate product descriptions for one or more recommended products based on a comprehensive analysis that takes into account the summary information of the EC site on which the recommended products are posted, and the user's vague wishes and feelings entered as search information by the user.
[0048] The recommended product presentation unit 17 presents to the user one or more recommended products selected by the product selection unit 15 and the product description generated by the product description generation unit 16. That is, the recommended product presentation unit 17 uses an HTML template stored in the management master DB storage unit 18 to generate a web page including one or more recommended products and product descriptions, and provides the web page to the EC site server 3. In the EC site server 3, the search result receiving unit 35 receives the data of this web page, and the site display unit 31 displays it on the EC site.
[0049] 8 is a diagram showing an example of a web page 501 displayed as a search result by the site display unit 31. In the example of Fig. 8, the brand name, product image, product description, and price are displayed for each of four recommended products, along with captions 502 generated by the product description generation unit 16 for the four recommended products. The brand name, product image, product description, and price are generated based on the product master information stored in the management master DB storage unit 18.
[0050] 9 is a flowchart showing an example of operation (recommendation method processing procedure) of the recommendation server 1 according to this embodiment configured as described above. Here, it is assumed that the processing of the master information generation unit 12 and the product feature vector generation unit 13 has already been completed, and the management master DB storage unit 18 and the feature vector storage unit 19 have stored the management master information and the product feature vector.
[0051] First, the fictitious product information generation unit 14 receives a search request transmitted from the search request unit 34 of the EC site server 3 (step S1). This search request includes search information (freely entered information) entered by the user. When the fictitious product information generation unit 14 receives the search request, the fictitious product generation unit 14a generates a prompt using the site overview information stored in the management master DB storage unit 18 and the freely entered information from the user, and generates fictitious product information by inputting the generated prompt into the LLM2 (step S2). In addition, the fictitious product feature vector generation unit 14b generates a fictitious product feature vector from the fictitious product information generated by the fictitious product generation unit 14a (step S3).
[0052] Next, the product selection unit 15 selects one or more recommended products from among the multiple products listed on the EC site based on a similarity calculation between the multiple product feature vectors (generated from information about the multiple products listed on the EC site) stored in the feature vector memory unit 19 and the fictitious product feature vector generated by the fictitious product feature vector generation unit 14b (step S4).
[0053] Furthermore, the product description generation unit 16 generates a prompt using information on one or more recommended products selected by the product selection unit 15 and information indicating the conditions stored in the management master DB storage unit 18, and generates product descriptions for one or more recommended products by inputting the generated prompt into the LLM 2 (step S5). Here, the prompt may be generated using site overview information stored in the management master DB storage unit 18 and free input information acquired by the fictitious product information generation unit 14 from the EC site server 3.
[0054] Next, the recommended product presentation unit 17 generates a web page including one or more recommended products and product descriptions using an HTML template stored in the management master DB storage unit 18, provides this to the EC site server 3 as a response to the search request, and presents the one or more recommended products and product descriptions to the user by displaying them on the EC site (step S6). This completes the processing of the flowchart shown in FIG.
[0055] As described above in detail, according to this embodiment, when a user freely inputs search information that represents a vague image, nuance, etc., that the user has in mind, fictitious product information that matches the freely input information is generated, and one or more actual products that match the fictitious product information under predetermined conditions are selected from the EC site and presented to the user. This makes it possible to present recommended products that are personalized to the user browsing the EC site according to the vague image, nuance, etc. that the user has in mind.
[0056] Furthermore, according to this embodiment, a product description (such as a caption or catchphrase) is generated for one or more selected recommended products, capturing and expressing their commonalities, and the product description is presented to the user in accordance with the one or more recommended products, thereby enhancing the appeal of the recommended products and increasing the user's desire to purchase them.
[0057] In the above embodiment, an example has been described in which the product feature vector generation unit 13 generates a product feature vector using a product image and a product description, but this is not limiting. For example, a product feature vector may be generated from either a product image or a product description. Alternatively, a product feature vector may be generated using other information in addition to the product image and product description. For example, a product feature vector may be generated from a product image, a product title, and a product description.
[0058] In the above embodiment, an example has been described in which a product description is generated from a product image using LLM2, and a product feature vector is generated from the generated product description and the product description as product master information, but the present invention is not limited to this processing. For example, it is also possible to identify image features from a product image and generate a product image feature vector using the features, identify text features from the product description in the product master information and generate a description feature vector using the features, and then generate the product feature vector by vector calculation of the product image feature vector and the description feature vector.
[0059] In the above embodiment, an example of generating fictitious product information using site overview information stored in the management master DB storage unit 18 and free input information from a user has been described, but this is not limiting. For example, instead of or in addition to the site overview information, fictitious product information may be generated using other information stored in the management master DB storage unit 18 and free input information. An example of the other information is at least one of the product title, product image, and product description for each product. For example, site overview information may be generated by inputting at least one of these pieces of information into the LLM2, and fictitious product information may be generated using the generated site overview information and free input information from a user.
[0060] In the above embodiment, the free input information from the user is input as text data, but this is not limiting. For example, the free input information may be input as voice data. In this case, text data may be generated by performing voice recognition processing on the voice data, and the generated text data may be input to the LLM2 to generate fictitious product information. Alternatively, the input voice data may be used directly to generate fictitious product information. In this case, the LLM2 is constructed as a deep learning model trained using voice data. The free input information may also be input as image data.
[0061] In the above embodiment, an example in which a fictitious product title and a fictitious product description are generated as fictitious product information has been described, but this is not limiting. For example, other information may be generated instead of or in addition to this. Examples of other information include a product category and a product image.
[0062] In the above embodiment, an example of selecting recommended products based on the similarity between product feature vectors for multiple products and a fictitious product feature vector has been described, but the present invention is not limited to this. For example, recommended products may be selected by clustering using feature vectors. As a specific example, the dimensionality of the product feature vectors is reduced using a method such as UMAP (Uniform Manifold Approximation and Projection), and products are clustered based on the dimensionally reduced product feature vectors using a method such as HDBSCAN* (Hierarchical Density-Based Spatial Clustering of Applications with Noise). Then, from the generated clusters, a cluster similar to the fictitious product feature vector is selected, and products included in that cluster are selected as recommended products.
[0063] Alternatively, one or more products similar to a fictitious product may be selected from multiple products using a classification model such as a k-nearest neighbor method, or machine learning using a support vector machine or a neural network. When a support vector machine is used, it is possible to select one or more products similar to a fictitious product by generating a classification model in which a discrimination boundary is learned by machine learning using pre-prepared training data. When a neural network is used, it is possible to select one or more products similar to a fictitious product by generating a decision model in which the relationship between product information is learned by machine learning using pre-prepared training data.
[0064] In the above embodiment, an example has been described in which the product description generation unit 16 generates a prompt using information indicating the conditions set by the condition setting unit 11 (conditions set by the administrator of the EC site server 3), but this function is not essential. However, having this function is preferable in that it makes it possible to adjust the product description generated by the LLM2 in accordance with the characteristics of the EC site, the main target users, etc.
[0065] In the above embodiment, an example has been described in which the recommended product presentation unit 17 presents to the user one or more recommended products selected by the product selection unit 15 and the product description generated by the product description generation unit 16, but this is not limiting. For example, only one or more recommended products may be presented to the user. Note that presenting the product description to the user together with the recommended products is preferable in that it can enhance the appeal of the recommended products, as described above, and increase the user's desire to purchase them.
[0066] Furthermore, instead of presenting the product description generated by the product description generation unit 16 to the user, the recommended product presentation unit 17 may present a fictitious product description generated by the fictitious product information generation unit 14 to the user. The fictitious product description is generated using the site overview information of the EC site and free input information from the user, so it may capture common features of one or more recommended products selected based on the fictitious product information and may reflect the user's vague wishes, feelings, etc. Therefore, even when a fictitious product description is presented to the user, it is possible to increase the user's desire to purchase the recommended product. Note that instead of the fictitious product description itself generated by the fictitious product information generation unit 14, a simple caption or catchphrase may be generated based on this product description and presented to the user.
[0067] In the above embodiment, an example has been described in which the condition setting unit 11 sets a filter condition for specifying products to be excluded from the targets for which the master information generating unit 12 acquires product master information from the EC site server 3, and a condition to be added to a prompt when the product description generating unit 16 generates a product description of a recommended product using LLM2. However, the present invention is not limited to this. For example, in addition to these conditions, the number of recommended products to be selected by the product selecting unit 15 may be specified.
[0068] In the above embodiment, the fictitious product information generation unit 14 generates one piece of fictitious product information. However, the fictitious product information generation unit 14 may generate multiple pieces of fictitious product information. In this case, one or more recommended products may be selected for each of the generated fictitious products, and each of these may be presented to the user as a recommended product group. In this case, the product description generation unit 16 generates a product description for each recommended product group. For example, a product group may be generated that groups together products with similar characteristics or purposes, such as "summer casual wear," "office formal wear," and "outdoor goods."
[0069] In the above embodiment, an e-commerce site is used as an example of a site that provides content, and a product is used as an example of the content. However, the present invention is not limited to this. For example, the same processing as in the above embodiment can be applied to selecting content from a plurality of pieces of content provided on various websites and recommending it to a user.
[0070] For example, it is possible to recommend to a user content selected by performing processing similar to that of the above embodiment from content provided on websites such as video distribution sites, music distribution sites, news distribution sites, SNS (social networking service) sites, online learning platforms, etc. In this case, the recommended content provided to the user may be, for example, video, music, news, SNS post information or poster information, learning materials, etc. The information used by the content feature vector generation unit when generating the content feature vector and the fictitious content information generated by the fictitious content information generation unit include, for example, the content title, description, genre, video thumbnail image, music artist name or album name, and information about the poster on the SNS.
[0071] As another example, various matching sites, such as job information sites, can recommend to users content selected from content registered in a database by performing a process similar to that of the above embodiment. For example, in the case of a job information site, fictitious company information can be generated based on freely entered information from a job seeker, and a company from among the actual hiring companies registered in the job information site's database can be recommended to the job seeker. Conversely, fictitious job seeker information can be generated based on freely entered information from a hiring company, and a job seeker from among the actual job seekers registered in the job information site's database can be recommended to the hiring company. In these cases, the information used by the content feature vector generation unit to generate the content feature vector and the fictitious content information generated by the fictitious content information generation unit include information that can be used for matching, such as the attributes, profiles, and descriptions of the job seeker / hiring company.
[0072] As another example, an information search site may recommend to a user content selected from search content registered in a database on the site's management server or an external server by performing a process similar to that of the above embodiment. In this case, in addition to the search information input field that the information search site originally has, a search information input field for inputting free input information to be used for performing a process similar to that of the above embodiment may be provided. Alternatively, the information search site may only have the search information input field that it originally has, and based on the information entered in the search information input field, it may execute the search function that the information search site originally has and perform a process similar to that of the above embodiment, and present the results of each execution to the user.
[0073] As another example, it is also possible to recommend to a user content selected by performing processing similar to that of the above embodiment from content sold at a site such as a physical store, rather than a website. For example, a terminal for users to input free input information may be provided in the physical store, and based on the free input information input from the terminal, content may be selected from a database (e.g., provided in a server device connected to the terminal via a communication network) that accumulates information on content sold at the physical store. The selected content may then be displayed on the terminal and recommended to the user. In this case, an inventory management system may be queried to check whether the content is in stock, and only content that is in stock at the physical store may be selected and recommended.
[0074] The functions and processes described above can be applied in appropriate combinations. Examples of configurations that can be applied to this embodiment are summarized below.
[0075] [Configuration 1] a fictitious content information generation unit that generates prompts using site summary information that indicates an overview of a site that provides content and free input information from a user, and that generates fictitious content information by inputting the generated prompts into a large-scale language model; a content selection unit that selects, from among a plurality of contents provided on the site, one or more pieces of content that match predetermined conditions with the fictitious content information generated by the fictitious content information generation unit as recommended content; a recommended content presentation unit that presents the one or more recommended contents selected by the content selection unit to the user. A recommendation system characterized by:
[0076] [Configuration 2] the fictitious content information generation unit generates a fictitious content feature vector from the fictitious content information; The content selection unit selects, as the recommended content, one or more pieces of content that match, under the predetermined conditions, a plurality of content feature vectors generated from information about the plurality of pieces of content provided on the site and stored as a database with respect to similarity between the fictitious content feature vector and the fictitious content feature vector. 2. The recommendation system according to configuration 1,
[0077] [Configuration 3] the information about the plurality of contents includes a content image and a content description; The system further includes a content feature vector generation unit that generates a content description by inputting a prompt generated using the content image into a large-scale language model, generates the content feature vector from the generated content description and the content description included in information related to the content, and stores the generated content feature vector in the database. 3. The recommendation system according to configuration 2,
[0078] [Configuration 4] 4. The recommendation system according to any one of configurations 1 to 3, wherein the fictitious content information includes a fictitious content title and a fictitious content description.
[0079] [Configuration 5] a content description generation unit that generates a prompt using information about the one or more recommended contents selected by the content selection unit, and inputs the generated prompt into a large-scale language model to generate a content description about the one or more recommended contents; The recommended content presentation unit presents to the user the one or more recommended contents selected by the content selection unit and the content description generated by the content description generation unit. 5. The recommendation system according to any one of configurations 1 to 4, wherein:
[0080] [Configuration 6] The recommendation system according to configuration 5, wherein the content description generation unit generates a prompt using at least one of the site summary information and the free input information in addition to information about the one or more recommended contents.
[0081] [Configuration 7] a condition setting unit that sets an arbitrary condition to be applied when the content description generation unit generates the content description using the large-scale language model; The content description generation unit generates a prompt by further using information indicating the condition set by the condition setting unit. 7. The recommendation system according to configuration 5 or 6,
[0082] [Configuration 8] The recommendation system described in configuration 4 is characterized in that the recommended content presentation unit presents to the user the one or more recommended contents selected by the content selection unit and the fictitious content description generated by the fictitious content information generation unit.
[0083] [Configuration 9] a fictitious content information generation unit that generates prompts using site summary information that indicates an overview of a site that provides content and free input information from a user, and that generates fictitious content information by inputting the generated prompts into a large-scale language model; a content selection unit that selects, from among a plurality of contents provided on the site, one or more pieces of content that match predetermined conditions with the fictitious content information generated by the fictitious content information generation unit as recommended content; a recommended content presentation unit that presents the one or more recommended contents selected by the content selection unit to the user. A recommendation server characterized by:
[0084] [Configuration 10] a step in which a fictitious content information generation unit of the server device generates a prompt using site summary information that indicates an overview of a site that provides content and free input information from a user, and generates fictitious content information by inputting the generated prompt into a large-scale language model; a step in which a content selection unit of the server device selects, as recommended content, one or more pieces of content that match predetermined conditions with the fictitious content information generated by the fictitious content information generation unit from among a plurality of pieces of content provided on the site; a step in which a recommended content presentation unit of the server device presents the one or more recommended contents selected by the content selection unit to the user. A recommendation method characterized by:
[0085] Furthermore, the above-described embodiments are merely examples of specific embodiments for carrying out the present invention, and the technical scope of the present invention should not be construed as being limited thereby. In other words, the present invention can be carried out in various forms without departing from the gist or main characteristics thereof. [Explanation of symbols]
[0086] 1 Recommendation Server 2 Large-scale Language Models (LLMs) 3. EC site server 4. Administrator terminal 5. User terminal 11 Condition setting section 12 Master information generation unit 13 Product feature vector generation unit (content feature vector generation unit) 14. Fictional product information generation unit (fictional content information generation unit) 14a Fictional product generation unit (fictional content generation unit) 14b fictitious product feature vector generation unit (fictitious content feature vector generation unit) 15 Product Selection Department (Content Selection Department) 16 Product description generation unit (content description generation unit) 17 Recommended product presentation unit (recommended content presentation unit)
Claims
1. a fictitious content information generation unit that generates a prompt using site summary information that outlines the site providing the content and free input information from the user, generates fictitious content information by inputting the generated prompt into a large-scale language model, and generates a fictitious content feature vector from the fictitious content information; a content feature vector generation unit that generates a content description by inputting a prompt generated using a content image included in information related to a plurality of contents provided on the site into a large-scale language model, generates a content feature vector from the generated content description and the content description included in the information related to the content, and stores the generated content feature vector as a database; a content selection unit that selects, from the plurality of contents provided on the site, one or more pieces of content that match predetermined conditions with the fictitious content information generated by the fictitious content information generation unit as recommended content; a recommended content presentation unit that presents the one or more recommended contents selected by the content selection unit to the user; The content selection unit selects, as the recommended content, one or more pieces of content that match the predetermined condition regarding similarity between the plurality of content feature vectors stored as the database and the fictitious content feature vector. A recommendation system characterized by:
2. The recommendation system according to claim 1 , wherein the fictitious content information includes a fictitious content title and a fictitious content description.
3. A fictitious content information generation unit that generates prompts using site overview information that outlines a site that provides content and free input information from a user, and generates fictitious content information by inputting the generated prompts into a large-scale language model; a content selection unit that selects, from among a plurality of contents provided on the site, one or more contents that match predetermined conditions with the fictitious content information generated by the fictitious content information generation unit as recommended content; a content description generation unit that generates a prompt using information about the one or more recommended contents selected by the content selection unit, and inputs the generated prompt into a large-scale language model to generate a content description about the one or more recommended contents; a recommended content presentation unit that presents to the user the one or more recommended contents selected by the content selection unit and the content description generated by the content description generation unit. A recommendation system characterized by:
4. The recommendation system of claim 3, characterized in that the content description generation unit generates a prompt using information about the one or more recommended contents as well as at least one of the site summary information and the free-entry information.
5. a condition setting unit that sets an arbitrary condition to be applied when the content description generation unit generates the content description using the large-scale language model; The content description generation unit generates a prompt by further using information indicating the condition set by the condition setting unit. The recommendation system according to claim 3 .
6. The recommendation system described in claim 2, characterized in that the recommended content presentation unit presents to the user the one or more recommended contents selected by the content selection unit and the fictitious content description generated by the fictitious content information generation unit.
7. a fictitious content information generation unit that generates a prompt using site summary information that outlines the site providing the content and free input information from the user, generates fictitious content information by inputting the generated prompt into a large-scale language model, and generates a fictitious content feature vector from the fictitious content information; a content feature vector generation unit that generates a content description by inputting a prompt generated using a content image included in information related to a plurality of contents provided on the site into a large-scale language model, generates a content feature vector from the generated content description and the content description included in the information related to the content, and stores the generated content feature vector as a database; a content selection unit that selects, from the plurality of contents provided on the site, one or more pieces of content that match predetermined conditions with the fictitious content information generated by the fictitious content information generation unit as recommended content; a recommended content presentation unit that presents the one or more recommended contents selected by the content selection unit to the user; The content selection unit selects, as the recommended content, one or more pieces of content that match the predetermined condition regarding similarity between the plurality of content feature vectors stored as the database and the fictitious content feature vector. A recommendation server characterized by:
8. A fictitious content information generation unit that generates prompts using site summary information that represents an overview of a site that provides content and free input information from a user, and generates fictitious content information by inputting the generated prompts into a large-scale language model; a content selection unit that selects, from among a plurality of contents provided on the site, one or more pieces of content that match predetermined conditions with the fictitious content information generated by the fictitious content information generation unit as recommended content; a content description generation unit that generates a prompt using information about the one or more recommended contents selected by the content selection unit, and inputs the generated prompt into a large-scale language model to generate a content description about the one or more recommended contents; a recommended content presentation unit that presents to the user the one or more recommended contents selected by the content selection unit and the content description generated by the content description generation unit. A recommendation server characterized by:
9. A step in which a content feature vector generation unit of a server device generates a content description by inputting a prompt generated using a content image included in information about multiple contents provided on a site into a large-scale language model, generates a content feature vector from the generated content description and the content description included in information about the content, and stores the generated content feature vector as a database; a step in which a fictitious content information generation unit of the server device generates a prompt using site summary information that outlines the site and free input information from a user, generates fictitious content information by inputting the generated prompt into a large-scale language model, and generates a fictitious content feature vector from the fictitious content information; a step in which a content selection unit of the server device selects, as recommended content, one or more pieces of content that match a predetermined condition with the fictitious content information generated by the fictitious content information generation unit from the plurality of pieces of content provided on the site; a step in which a recommended content presentation unit of the server device presents the one or more recommended contents selected by the content selection unit to the user; The content selection unit selects, as the recommended content, one or more pieces of content that match the predetermined condition regarding similarity between the plurality of content feature vectors stored as the database and the fictitious content feature vector. A recommendation method characterized by:
10. A step in which a fictitious content information generation unit of a server device generates a prompt using site summary information that represents an overview of a site that provides content and free input information from a user, and generates fictitious content information by inputting the generated prompt into a large-scale language model; a step in which a content selection unit of the server device selects, as recommended content, one or more pieces of content that match a predetermined condition with the fictitious content information generated by the fictitious content information generation unit from among a plurality of pieces of content provided on the site; a content description generation unit of the server device generating a prompt using information about the one or more recommended contents selected by the content selection unit, and inputting the generated prompt into a large-scale language model to generate a content description about the one or more recommended contents; a step in which a recommended content presentation unit of the server device presents to the user the one or more recommended contents selected by the content selection unit and the content description generated by the content description generation unit. A recommendation method characterized by:
Citation Information
Patent Citations
Optimization method and device for recommendation reason generation model
CN117540078A
Information generation model training method, information generation method, apparatus, electronic device, storage medium, and computer program
JP2023017983A
Program, information processing device, method and system
JP2025051561A
Computer system, program and method executed in the computer system
JP6542420B1
Information processing device, information processing method, and program
JP6543986B2