Information processing device, information processing method, model construction method, and program

By constructing a graph network with user, item, and task relationships using a graph neural network, the solution addresses the limitations of conventional networks in platform businesses, improving customer behavior analysis through enhanced relationship representations.

JP7614134B2Active Publication Date: 2025-01-15RAKUTEN GROUP INC
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
JP2022058399
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2022-03-31
Publication Date
2025-01-15
Estimated Expiration
2042-03-31

AI Technical Summary

Technical Problem

Conventional graph networks are not suitable for platform businesses that offer diverse services, failing to comprehensively express user and item relationships, leading to inadequate customer behavior analysis.

Method used

A graph network is constructed using user and item characteristics to create relationships between users, items, and tasks, employing a graph neural network to extract node representations and learn from these relationships, allowing for more accurate customer behavior analysis.

Benefits of technology

The solution enables the construction of a graph network suitable for platform businesses, enhancing customer behavior analysis by providing more comprehensive and accurate user and item relationship representations.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007614134000001
    Figure 0007614134000001
  • Figure 0007614134000002
    Figure 0007614134000002
  • Figure 0007614134000003
    Figure 0007614134000003
Patent Text Reader

Abstract

To construct a graph network suitable for platform business.SOLUTION: A information processing device is configured to: obtain a fact feature on each of a plurality of users as a user feature; obtain a feature relating to a plurality of items from a predetermined database as an item feature; construct a graph including a plurality of item nodes representing a plurality of user nodes representing the plurality of users, a plurality of item nodes representing the plurality of items, and a link representing a relation between the plurality of user nodes and the plurality of item nodes on the basis of the user feature and the item feature; and extract node representations in the graph on an arbitrary node of the plurality of user nodes and the plurality of item nodes from the graph.SELECTED DRAWING: Figure 9
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an information processing device, an information processing method, a model construction method, and a program. [Background technology]

[0002] In recent years, customer behavior analysis using graph-type networks (graph networks) such as knowledge graphs has been attracting attention. For example, a knowledge graph has been proposed that learns user preferences by modeling the relationships between various pieces of information, including purchase history, categories and store information linked to purchased items (auxiliary information), and information related to the user, such as gender and age (attribute information) (Non-Patent Document 1). [Prior art documents] [Non-patent literature]

[0003] [Non-Patent Document 1] Tadayo Ito, Zhiying Zhang, Gendo Kumoi, Masayuki Goto, “A Study on Purchasing Behavior Analysis Model Based on Knowledge Graph Attention Network,” Transactions of the Information Processing Society of Japan, 63.1, 205-217, (2022). Summary of the Invention [Problem to be solved by the invention]

[0004] Conventional graph networks are not suitable for platform businesses that incorporate diversified business portfolios and provide a variety of services. Specifically, there is room for improvement in terms of realizing a graph network that comprehensively represents the relationships between users in addition to the various relationships related to diversified items, and obtaining more useful customer behavior analysis results.

[0005] The present invention has been made in consideration of the above problems, and has an object to construct a graph network suitable for platform business. [Means for solving the problem]

[0006] In order to solve the above problem, one aspect of an information processing device according to the present invention comprises a user feature acquisition means for acquiring factual features for each of a plurality of users as user features, an item feature acquisition means for acquiring features related to a plurality of items as item features from a predetermined database, a construction means for constructing a graph including a plurality of user nodes representing the plurality of users and a plurality of item nodes representing the plurality of items based on the user features and the item features, and links indicating mutual relationships among the plurality of user nodes and the plurality of item nodes, and an extraction means for extracting from the graph a node representation in the graph for any node among the plurality of user nodes and the plurality of item nodes.

[0007] The construction means may construct a first relationship that is a relationship between the plurality of users, a second relationship that is a relationship between the plurality of items, and a third relationship that is a relationship between the plurality of users and the plurality of items based on the user characteristics and the item characteristics, and may construct the graph using the first relationship, the second relationship, and the third relationship.

[0008] The extraction means can extract, from the graph, a relationship between the plurality of user nodes and any one of the plurality of item nodes as the node expression.

[0009] The arbitrary node may be any user node among the plurality of user nodes, and the extraction means may extract, as the node representation, a user expression that represents a relationship between the plurality of user nodes and the plurality of item nodes for the arbitrary user node.

[0010] The arbitrary node is an arbitrary item node among the plurality of item nodes, and the extraction means can extract, as the node representation, a user expression that represents a relationship between the plurality of user nodes and the plurality of item nodes for the arbitrary item node.

[0011] The graph may be a graph neural network.

[0012] The information processing device may further have a task setting means for setting a plurality of tasks representing a classification of the plurality of items from the item features, and the construction means may construct the graph neural network based on the user features and the item features, the graph neural network including the plurality of user nodes, the plurality of item nodes, and a plurality of task nodes representing the plurality of tasks, and links indicating mutual relationships among the plurality of user nodes, the plurality of item nodes, and the plurality of task nodes.

[0013] The extraction means can extract, from the graph neural network, relationships between the plurality of user nodes, the plurality of item nodes, and the plurality of task nodes for any node among the plurality of user nodes and the plurality of item nodes, as the node representation.

[0014] The node representation may be any one of the plurality of user nodes, and the extraction means may extract, as the node representation, a user expression that represents a relationship between the plurality of user nodes, the plurality of item nodes, and the plurality of task nodes for the arbitrary user node.

[0015] The item node is any one of the plurality of item nodes, and the extraction means can extract, as the node representation, an item representation that represents a relationship between the plurality of user nodes, the plurality of item nodes, and the plurality of task nodes for the any one of the plurality of item nodes.

[0016] Each of the plurality of tasks may be a brand name for each of the plurality of items.

[0017] The construction means may train the graph neural network from relationships between the plurality of user nodes and the plurality of task nodes, and relationships between the plurality of item nodes and the plurality of task nodes.

[0018] In order to solve the above problems, one aspect of an information processing method according to the present invention includes a user feature acquisition step of acquiring factual features for each of a plurality of users as user features, an item feature acquisition step of acquiring features related to a plurality of items as item features from a predetermined database, and a construction step of constructing a graph including a plurality of user nodes representing the plurality of users and a plurality of item nodes representing the plurality of items, and links indicating the mutual relationships among the plurality of user nodes and the plurality of item nodes, based on the user features and the item features.

[0019] In order to solve the above problem, one aspect of a model construction method according to the present invention includes a user feature acquisition step of acquiring factual features for each of a plurality of users as user features, an item feature acquisition step of acquiring features related to a plurality of items as item features from a predetermined database, and a construction step of constructing a model representing the mutual relationships between the plurality of users and the plurality of items based on the user features and the item features, wherein the model is configured to be capable of extracting from the model an expression representing the relationship between the plurality of users and the plurality of items, for any user or any item among the plurality of users and the plurality of items, the expression being used as input data for a predetermined prediction process to be performed by an information processing device.

[0020] In the construction process, the model may be constructed based on the user features and the item features to include a plurality of user nodes representing the plurality of users and a plurality of item nodes representing the plurality of items, and links indicating the mutual relationships between the plurality of user nodes and the plurality of item nodes.

[0021] The model construction method may further include a task setting process for setting a plurality of tasks representing a classification of the plurality of items from the item features, and in the construction process, the model may be constructed based on the user features and the item features to include a plurality of user nodes, a plurality of item nodes, and a plurality of task nodes representing the plurality of tasks, and links indicating the mutual relationships among the plurality of user nodes, the plurality of item nodes, and the plurality of task nodes.

[0022] In order to solve the above-mentioned problems, one aspect of the program according to the present invention is an information processing program for causing a computer to execute information processing, the program causing the computer to execute processes including a user feature acquisition process for acquiring factual features for each of a plurality of users as user features, an item feature acquisition process for acquiring features related to a plurality of items as item features from a predetermined database, and a construction process for constructing a graph including a plurality of user nodes representing the plurality of users and a plurality of item nodes representing the plurality of items, and links indicating the mutual relationships between the plurality of user nodes and the plurality of item nodes, based on the user features and the item features.

[0023] In order to solve the above problem, another aspect of the program according to the present invention is an information processing program for causing a computer to execute information processing, the program causing the computer to execute processes including a user feature acquisition process for acquiring factual features for each of a plurality of users as user features, an item feature acquisition process for acquiring features related to a plurality of items as item features from a predetermined database, and a construction process for constructing a model representing the mutual relationships between the plurality of users and the plurality of items based on the user features and the item features, the model being configured to be capable of extracting from the model an expression representing the relationship between the plurality of users and the plurality of items, for any user or any item among the plurality of users and the plurality of items, the expression being used as input data for a predetermined prediction process to be performed by an information processing device. Effect of the Invention

[0024] According to the present invention, it is possible to construct a graph network suitable for platform business. The above-mentioned objects, aspects, and advantages of the present invention, as well as objects, aspects, and advantages of the present invention not described above, will be understood by those skilled in the art from the following detailed description of the invention by referring to the accompanying drawings and the claims. [Brief description of the drawings]

[0025] [Figure 1] FIG. 1 shows an example of the configuration of an information processing system. [Diagram 2] FIG. 2 shows an example of the functional configuration of the information processing device 10 according to the first embodiment. [Diagram 3] Figure 3 shows a flowchart of the knowledge graph creation procedure. [Figure 4A] FIG. 4A is a diagram for explaining an explicit link. [Figure 4B] FIG. 4B is a diagram for explaining an implicit link. [Diagram 5]FIG. 5 is a diagram for explaining the process of inferring the relationship between links. [Figure 6A] FIG. 6A shows a conceptual diagram of a score (closeness score) based on the closeness of the relationship between a pair of users. [Figure 6B] FIG. 6B shows a schematic architecture of the score prediction model 112. [Figure 6C] FIG. 6C shows a conceptual diagram of a user relationship graph. [Figure 7] FIG. 7 shows a conceptual diagram of an item relationship graph. [Figure 8] FIG. 8 shows a conceptual diagram of a user-item relationship graph. [Figure 9] Figure 9 shows a conceptual diagram of the knowledge graph and user representation. [Figure 10] FIG. 10 is a diagram for explaining the prospective user prediction process according to the first embodiment. [Figure 11] FIG. 11 shows an example of the hardware configuration of the information processing device 10 and the user device 11. As shown in FIG. [Figure 12] FIG. 12 shows a flowchart of the process executed by the information processing device 10 according to the first embodiment. [Figure 13] FIG. 13 shows an example of the functional configuration of an information processing device 10 according to the second embodiment. [Figure 14] FIG. 14 shows a flowchart of the procedure for creating a GNN. [Figure 15] Figure 15 shows a conceptual diagram of the GNN and user representation. [Figure 16] FIG. 16 is a diagram for explaining the prospective user prediction process according to the second embodiment. [Figure 17] FIG. 17 shows a flowchart of the process executed by the information processing device 10 according to the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0026] Hereinafter, with reference to the attached drawings, an embodiment for carrying out the present invention will be described in detail. Among the components disclosed below, those having the same functions are given the same reference numerals, and their description will be omitted. Note that the embodiment disclosed below is an example of a means for realizing the present invention, and should be appropriately modified or changed depending on the configuration of the device to which the present invention is applied and various conditions, and the present invention is not limited to the following embodiment. Furthermore, not all of the combinations of features described in the present embodiment are necessarily essential to the solution of the present invention.

[0027] (First embodiment) [Information processing system configuration] Fig. 1 shows an example of the configuration of an information processing system according to this embodiment. As an example, as shown in Fig. 1, this information processing system includes an information processing device 10 and multiple user devices 11-1 to 11-N (N>1) used by multiple arbitrary users 1 to N. In the following description, unless otherwise specified, user devices 11-1 to 11-N may be collectively referred to as user device 11. In the following description, the terms user device and user may be used synonymously.

[0028] The user device 11 is, for example, a device such as a smartphone or a tablet, and is configured to be able to communicate with the information processing device 10 via a public network such as LTE (Long Term Evolution) or a wireless communication network such as a wireless LAN (Local Area Network). The user device 11 has a display unit (display surface) such as a liquid crystal display, and each user can perform various operations using a GUI (Graphic User Interface) equipped on the liquid crystal display. The operations include various operations on content such as images displayed on the screen, such as tapping, sliding, and scrolling using a finger or a stylus. Note that user device 11 is not limited to the device shown in Fig. 1, and may be a device such as a desktop PC (Personal Computer) or a notebook PC. In this case, each user may perform operations using input devices such as a mouse and a keyboard. User device 11 may also be provided with a separate display screen.

[0029] The user device 11 can log in to a web service (internet-related service) provided from the information processing device 10 or from another device (not shown) via the information processing device 10, and can use the service. The web service can include an online mall, an online supermarket, or services related to communications, finance, real estate, sports, and travel, which are provided via the Internet. By using such a web service, the user device 11 can transmit information about the user of the user device 11 to the information processing device 10.

[0030] For example, the user device 11 can transmit to the information processing device 10 information on characteristics of the user device or the user, such as the IP (Internet Protocol) address of the user device 11, the user's address, and the user's name. In addition, the user device 11 performs positioning calculations based on signals received from GPS (Global Positioning System) satellites (not shown), generates the information obtained by the calculations as location information of the user device 11, and transmits it to the information processing device 10. The information processing device 10 acquires various information from the user device 11, and creates a knowledge graph based on the information. The knowledge graph is a directed graph that expresses real-world knowledge in a structured fact structure. In this embodiment, the knowledge graph is composed of an inter-user relationship (interaction) graph, an inter-item relationship graph, and a user-item relationship graph. Then, the information processing device 10 extracts a user expression (user feature vector, embedded expression, vector expression in a directed graph such as a knowledge graph) for an arbitrary user from the knowledge graph.

[0031] [Functional configuration of information processing device 10] The information processing device 10 according to the present embodiment first acquires various user characteristics from the user devices 11-1 to 11-N, and also acquires characteristics related to items from a predetermined database. In the present embodiment, an item can be a tangible or intangible thing (Thing) that can be provided for various services. For example, for financial (fintech) services, there are items such as bank accounts, financial products such as stocks, investment trusts, and insurance products, cryptocurrency, and smartphone app payments. For digital content services, there are items such as video content such as movies and animations, and still image content such as photos, illustrations, and text. For e-commerce services, there are items such as intangible or tangible products handled in online shopping. For travel services, there are items such as information and reservations related to hotels, package tours, and transportation facilities. For mobile services, there are items such as mobile devices, public network / Internet connections, and communication usage fees. For advertising and media services, there are items such as offline and offline advertising products, direct mail, and advertising via broadcasting and the Internet. For card services, there are items such as credit card payments and point transactions. In addition, with regard to sports and cultural services, there are events such as sporting events and concerts, and items such as merchandise sold at the events.

[0032] The information processing device 10 creates a knowledge graph from the acquired user features and item features, and extracts a user expression for an arbitrary user from the knowledge graph. As described later, the knowledge graph is composed of a user-to-user relationship graph, an item-to-item relationship graph, and a user-item relationship graph. Furthermore, the information processing device 10 uses the user expression to predict a prospective user who has similar user features to a predetermined (given) seed user (target user) (e.g., who is likely to purchase a predetermined item with the seed user).

[0033] FIG. 2 shows an example of a functional configuration of the information processing device 10 according to the present embodiment. The information processing device 10 shown in Fig. 2 includes a user feature acquisition unit 101, an item feature acquisition unit 102, a graph construction unit 103, an expression extraction unit 104, a potential user prediction unit 105, a learning unit 106, an output unit 107, a learning model storage unit 110, and a feature storage unit 120. The learning model storage unit 110 stores a potential user prediction model 111 and a score prediction model 112. The various learning models will be described later. In addition, the feature storage unit 120 is configured to store a user feature 121 and an item feature 122.

[0034] The user feature acquisition unit 101 acquires factual features (factual information) (hereinafter, user features) about each of the user devices 11-1 to 11-N. The user features are factual features (information) that are actually or objectively obtained from the user device or user. The user feature acquisition unit 101 can acquire the user features directly from the user device 11, for example. The user feature acquisition unit 101 can also acquire the user features as information registered in a predetermined web service by the user of the user device 11.

[0035] The user characteristics include the IP address of the user device, the user's address and name, the number of the credit card held by the user, and the user's demographic information (demographic user attributes such as gender, age, residential area, occupation, and family structure). The user characteristics may also include a registration number and a registered name when using a specified web service. The user characteristics may also include a call history, a delivery address other than the user's address for the product when using a specified web service, a usage status when using a specified web service, a usage history (including a purchase history and a sales history), a search history, a browsing history (including a click history), and information on points that can be accumulated by using a service. In this way, the user characteristics can include any information, including information related to the user device or the user himself / herself, and information on the use of a specified service via communication. The user characteristic acquiring unit 101 stores the acquired user characteristic in the characteristic storage unit 120 as a user characteristic 121 .

[0036] The item feature acquisition unit 102 acquires item features (attributes) based on registration information and transaction history in various web services from a predetermined database (not shown). The item features include information identifying the item (hereinafter, item ID), information identifying the genre (higher classification) of the item (hereinafter, genre ID), information identifying the shop where the item is sold (hereinafter, shop ID), and the like. The item features can also include transaction information (number of transactions, etc.) between the item ID and genre ID, and between the item ID and shop ID, depending on the transaction history. The item feature acquisition unit 102 stores the acquired item features in the feature storage unit 120 as item features 122.

[0037] The graph construction unit 103 constructs a knowledge graph based on the various features acquired from the user feature acquisition unit 101 and the item feature acquisition unit 102. The knowledge graph will be described later.

[0038] The expression extraction unit 104 extracts a user expression for any user from the knowledge graph constructed by the graph construction unit 103. The expression extraction unit 104 may also extract an item expression for any item from the knowledge graph. The process of extracting user expressions (or item expressions) will be described later. The expression extraction unit 104 may also extract an embedded expression (vector expression) for any node in the constructed knowledge graph, for example, as a shop expression or a genre expression.

[0039] The prospective user prediction unit 105 predicts a user who has similar user characteristics to a predetermined seed user and is predicted to behave similarly (similarly) to the seed user through a web service as a prospective user (similar user). The seed user is one or more users who have purchased and / or used a given product or service through a web service and / or positively evaluated the product or service through the web service. The seed user is one or more users selected and set from the user devices 11-1 to 11-N. The seed user may be set by an input operation by an operator using an input unit (input unit 205 in FIG. 12), may be set in advance in the system, or may be set by an arbitrary program stored in a storage unit (ROM 202 or RAM 203 in FIG. 11). In this embodiment, the prospective user is predicted using a prospective user prediction model 111 that has been learned by the learning unit 106. The prediction process of the prospective user will be described later.

[0040] The learning unit 106 trains the potential user prediction model 111 and the score prediction model 112, and stores the trained potential user prediction model 111 and score prediction model 112 in the learning model storage unit 110. The learning process of each learning model will be described later.

[0041] The output unit 107 outputs the user expression extracted by the expression extraction unit 104 and the information of the prospective user predicted by the prospective user prediction unit 105. The output may be any output process, may be an output to an external device via a communication I / F (communication I / F 207 in FIG. 11), or may be a display on a display unit (display unit 206 in FIG. 11).

[0042] [Knowledge Graph Construction Procedure] Next, the procedure for creating the knowledge graph according to this embodiment will be described. The knowledge graph is composed of a user relationship graph, an item relationship graph, and a user-item relationship graph. FIG. 3 shows a flowchart of the knowledge graph construction procedure executed by the graph construction unit 103 according to this embodiment. Hereinafter, first, the creation procedures for each of the user relationship graph, the item relationship graph, and the user-item relationship graph (corresponding to the process of S30 in FIG. 3) will be described.

[0043] (1) Creation Procedure of User Relationship Graph The creation procedure of the user relationship graph will be described. In the following description, users A to E are users referred to for the purpose of explanation and may be users of the user device 11. The user relationship graph is composed of the connection of each user node (node having user identification information) surrounded by circles in FIGS. 4A and 4B. In the following description, the user node will be simply referred to as a user. Hereinafter, each step of the process of S30 in FIG. 3 for the user relationship graph will be described.

[0044] <S31: Link Creation> In S31, the graph construction unit 103 predicts and creates links between a plurality of users. The link creation process will be described with reference to Fig. 4A and Fig. 4B. Fig. 4A is a diagram for explaining an explicit link, and Fig. 4B is a diagram for explaining an implicit link. An explicit link is a link created by an explicit common feature between two users (a user pair). An implicit link is a link created as an indirect relationship by utilizing an explicit link that has already been created, even though the existence of an explicit common feature between the user pair is unclear. In this way, links between users are distinguished as explicit links and implicit links.

[0045] Fig. 4A shows an example of creating an explicit link using the IP addresses of the users' user devices as a common feature. Fig. 4A shows an example in which there are an online mall 41, a golf course reservation service 42, a travel-related reservation service 43, and a card management system 44 as web services available to users A to C. Fig. 4A shows these four web services, but the number of web services is not limited to a specific number.

[0046] The online mall 41 is a shopping mall available online (using the Internet). The online mall 41 can provide a wide variety of products and services, such as fashion, books, food, concert tickets, and real estate. The golf course reservation service 42 is operated as a website that provides online services related to golf courses, and can provide, for example, golf course search and reservation and lesson information. The travel-related reservation service 43 is operated as a website that provides various travel services available online. For example, the travel-related reservation service 43 can provide hotel and travel tour reservations, airline and rental car reservations, tourist information, and information about hotels and the surrounding areas. The card management system 44 is operated on a website that provides services related to credit cards issued and managed by a specific card management company. The card management system 44 may provide services in association with at least one of an online mall 41, a golf course reservation service 42, and a travel-related reservation service 43.

[0047] 4A, users A to C each use the same IP address (=198.45.66.xx) to access an online mall 41, a golf course reservation service 42, and a travel-related reservation service 43. The IP address information can be acquired by the user characteristic acquisition unit 101. In such a case, the graph construction unit 103 creates explicit links (for example, link L1 between user A and user C) between users A to C with the same IP address characteristic as shown in link state 45. The explicit links are represented by solid lines.

[0048] In addition to FIG. 4A, an explicit link can be created using a common feature such as a feature of a user's address or a feature of a credit card number used by a user.

[0049] FIG. 4B shows an example of creating an implicit link between users. In the example of FIG. 4B, for user A, users C, D, and E are connected by explicit links, and for user B, users C, D, and E are connected by explicit links. Such link features (features indicating the relationship between links) are embedded into a common feature space, and it is inferred that an implicit relationship is constructed between each user (each node), and the inferred links are created (established) as implicit links. In the example of FIG. 4B, although user A and user B are not connected by an explicit link, as a result of being inferred to have a relationship in the common feature space, an implicit link L2 shown by a dashed line is created. Note that the graph construction unit 103 predicts and creates an implicit link between users by performing learning (representation learning, relationship learning, embedding learning, knowledge graph embedding) of a user relationship graph composed of nodes (users) connected by explicit links. At this time, the graph construction unit 103 may perform the learning based on a known embedding model or an extension thereof as appropriate.

[0050] <S32: Inference of Relationship between Links> In S32, the graph construction unit 103 infers the relationship between the links predicted and created in S31. The inference process of the relationship between links will be described with reference to FIG. 5. FIG. 5 is a diagram for explaining the inference process of the relationship between links, and shows an example of inferring the relationship of a link between user A and user B connected by an explicit link.

[0051] The graph construction unit 103 treats pairs of users connected by the links created in S31 as data points, and groups the pairs (data points) into clusters representing a common type using various information acquired by the user feature acquisition unit 101. The various information can be information such as IP address, address, credit card, age, gender, and friends. Also, each cluster can be a cluster having relationships such as spouse, parent-child, neighbor, same household, colleague, friend, same-sex siblings, opposite-sex siblings, etc. In the example of FIG. 5, pairs of users are indicated by crosses, and as clusters into which the pairs can be grouped, a parent-child cluster 51, a spouse cluster 52, a same-sex sibling cluster 53, a friend cluster 54, and a colleague cluster are shown. Note that although five clusters are shown in FIG. 5, the number of clusters is not limited to a specific number.

[0052] For example, if user A and user B have (share) the feature 50 of having the same surname, an age difference of less than 10 years, opposite genders, and the same address, the graph construction unit 103 can group the pair of user A and user B into a cluster (spouse cluster 52) representing the relationship of husband and wife (spouse).

[0053] <S33: Score Assignment Based on Closeness of Relationship> In S33, the graph construction unit 103 predicts a score based on the closeness of the relationship for the pairs inferred in S32, and assigns the score to the pairs. In the present embodiment, the score is a numerical value between 0 and 1, but there is no specific limitation on the numerical values that the score can take. FIG. 6A shows a conceptual diagram of a score (hereinafter, closeness score) based on the closeness of the relationship of user pairs.

[0054] In the example of FIG. 6A, the closeness of the relationship between the user pair changes depending on the characteristics owned (shared) by user A and user B connected by an explicit link. In the upper part of FIG. 6A, if the relationship between user A and user B has characteristics 60 of same-gender siblings, same address, 1200 call histories, and 50 gift exchanges, the closeness of the relationship between the user pair (i.e., closeness score) is high. On the other hand, in the lower part of FIG. 6A, if the relationship between user A and user B has characteristics 61 of same-gender siblings, different addresses, 30 call histories, and 2 gift exchanges, the closeness of the relationship between the user pair (i.e., closeness score) is low. Thus, as in the example of FIG. 6A, even if user A and user B are siblings of the same gender, the closeness of the relationship between the pair differs depending on other characteristics shared by the pair of users. It is observed that pairs with high relationship closeness have a close social distance from each other and have high influence. On the other hand, pairs with low relationship closeness are observed to have a large social distance from each other and are not closely related.

[0055] In this embodiment, the closeness score for a user pair is predicted using a score prediction model 112. Fig. 6B shows a schematic architecture of the score prediction model 112. The score prediction model 112 is a learning model that predicts a closeness score 64 for a feature 63 of a user pair using the feature 63 as an input.

[0056] The score prediction model 112 is, for example, a learning model that performs weak supervised learning, for example, a learning model using a convolutional neural network (CNN). In this embodiment, the score prediction model 112 is a learning model that is learned using the closeness scores (0 to 1) assigned to a plurality of features for a user pair as teacher data, as shown in FIG. 6A. For example, in the learning stage, combined data such as a closeness score close to 1 set for feature 60 in FIG. 6A and a closeness score close to 0 set for feature 61 is used as teacher data. The learning process is performed by the learning unit 108.

[0057] In this embodiment, the proximity score for a user pair is predicted using the score prediction model 112. However, the graph construction unit 103 may be configured to predict the score by other methods.

[0058] Through the above processing, explicit or implicit links are formed among multiple users, a proximity score is assigned to each link, and a user relationship graph is created. A conceptual diagram of the user relationship graph is shown in FIG. 6C. The proximity score predicted as described above is assigned to each pair of users.

[0059] (2) Procedure for creating an item relationship graph Next, the procedure for creating an item relationship graph will be described. Similar to the procedure for creating a user relationship graph, the graph construction unit 103 creates an item relationship graph according to the flowchart of the relationship graph creation process in S30 in FIG. 3. Note that in the creation of the item relationship graph, the step of S32 is not performed.

[0060] <S31: Creation of links> In S31, the graph construction unit 103 creates links among multiple items based on the item features 122 stored in the feature storage unit 120. As described above, the item features according to this embodiment include an item ID, a genre ID, and a shop ID. That is, at least one genre ID and / or shop ID is associated with one item ID. Note that the genre ID and shop ID may each be hierarchically configured. For example, the genres may be hierarchically configured and each may have a genre ID. Further, the item features are not limited to the item ID, genre ID, and shop ID, and may include other information (attributes) such as information regarding the brand, color, and properties of the item.

[0061] The graph construction unit 103 links the genre ID and the shop ID associated with an arbitrary item ID to the item ID. Fig. 7 shows a conceptual diagram of the item relationship graph. The item relationship graph is composed of connections of each node indicating the item ID, genre ID, or shop ID surrounded by a circle in Fig. 7. In the following description, the node is simply referred to as an item, genre, or shop.

[0062] In Fig. 7, the link connected from the item feature is an explicit link and is shown by a solid line (for example, link L1 between item A and shop A). Also, when the colors and properties between items are similar (when the similarity is higher than a predetermined threshold), the items can be connected by an explicit link (for example, the link between item A and item B). On the other hand, for example, there may be cases where different items are sold in the same shop. In Fig. 7, since both item A and item C are sold in shop A, they are linked to shop A. Therefore, the graph construction unit 103 can connect item A and item C with an implicit link shown by a dashed line (in the example of Fig. 7, link L2 between item A and item C). Note that the graph construction unit 103 predicts and creates an implicit link between items by performing learning (representation learning, relational learning, embedding learning, knowledge graph embedding) of the item relationship graph composed of nodes (users) connected by explicit links. At this time, the graph construction unit 103 may perform the learning based on a known embedding model or its extension as appropriate.

[0063] <S33: Score Assignment Based on Proximity of Relationships> In S33, the graph construction unit 103 predicts a score (proximity score) based on the proximity of the relationship for each pair in the link created in S31, and assigns the score to the pair. In FIG. 7, for example, in genre A, if item A sells better (is traded more frequently) than item B, a high score is assigned to the pair of item A and genre A. Also, for item A, if it is determined that the probability of belonging to genre A is high, a score based on the probability is highly assigned to the pair of item A and genre A. Further, if the similarity between any items is higher, a high score is assigned to the pair of the items.

[0064] The graph construction unit 103 may predict the proximity score for each pair using the above-described score prediction model 112. When using the score prediction model 112, the number of transactions for any pair among items, genres, and shops, and the proximity score (0 to 1) assigned to the feature of the similarity between items are learned as teacher data (see FIG. 6B). For example, in the learning stage, as teacher data, combined data such as a proximity score close to 1 set for the feature of a large number of transactions or high similarity, and a proximity score close to 0 set for the feature of a small number of transactions or low similarity is used. The learning process is performed by the learning unit 108. By score assignment, a score can be represented as a numerical value for each pair, similar to the user relationship graph shown in FIG. 6C.

[0065] (2) Procedure for creating user-item relationship graph Next, the procedure for creating a user-item relationship graph will be described. Similar to the procedure for creating a user relationship graph, the graph construction unit 103 creates a user-item relationship graph according to the flowchart of the S30 relationship graph creation process in FIG. 3. Note that in the creation of the user-item relationship graph, the step of S32 is not performed.

[0066] <S31: Creation of links> In S31, the graph construction unit 103 creates links between any user and one or more items based on the user features 121 stored in the feature memory unit 120. First, the graph construction creation unit 103 obtains user features related to items for each user, such as the purchase history, search history, or browsing history (including click history) of each user, from the user features 121 stored in the feature memory unit 120. The graph construction unit 103 creates a user-item relationship graph for each user using the user features related to the item for each user.

[0067] FIG. 8 shows a conceptual diagram of a user-item relationship graph. The item relationship graph is composed of connections between user nodes and nodes indicating item IDs surrounded by circles in FIG. 7. In the following description, the user nodes and nodes indicating item IDs are simply referred to as users and items.

[0068] In FIG. 8, from the click history of item A by user A, user A and item A are linked. The click history of the item A includes clicking on a predetermined screen area (e.g., button, photo, icon, etc.) related to the item A. Also, from the purchase history of item B by user A, user A and item B are linked. Also, from the sales history of item C by user A, user A and item C are linked. Note that in FIG. 8, user A and each item are connected by explicit links, but an indirect connection from user A to any item may be represented by an implicit link. Also, from the advertisement delivery history related to the item to the user, the user and the item may be linked. Note that the graph construction unit 103 predicts and creates an implicit link between the user and the item by performing learning (representation learning, relational learning, embedding learning, knowledge graph embedding) of the user-item relationship graph composed of nodes (users) connected by explicit links. At this time, the graph construction unit 103 may perform the learning based on a known embedding model or its extension as appropriate.

[0069] <S33: Score Assignment Based on Proximity of Relationships> In S33, the graph construction unit 103 predicts a score (closeness score) based on the closeness of the relationship for each pair in the link created in S31, and assigns the score to the pair. The graph construction unit 103 may predict a closeness score for a pair of a user and an item based on history related to item transactions, such as the above-mentioned click history, purchase history, sales history, and advertisement delivery history. For example, it can be said that the distance between a user and an item is closer when the user actually purchases an item than when the user only clicks on the item. Therefore, in the example of FIG. 8, a higher score is assigned to the pair of user A and item B than to the pair of user A and item A. In addition, a user selling an item is considered to be closer in relationship than a click action, and in the example of FIG. 8, a higher score is assigned to the pair of user A and item C than to the pair of user A and item A. In addition, for example, a low score may be assigned to the pair of user and item when the user does not click or purchase the item even though advertisements related to the item have been delivered to the user multiple times.

[0070] The graph construction unit 103 may predict the closeness score for each pair using the score prediction model 112 described above. When the score prediction model 112 is used, the closeness scores (0 to 1) assigned to the features of the user and item pair are used as training data for learning (see FIG. 6B). For example, in the learning stage, combined data such as a closeness score close to 1 set for the feature of purchase and a closeness score close to 0 set for the feature of click are used as training data. The learning process is performed by the learning unit 108. By assigning scores, the scores can be expressed as numerical values ​​for each pair, similar to the user relationship graph shown in FIG. 6C.

[0071] In Figure 8, the user-item relationship graph is defined as a pair of users and items, but if a user has a history of clicking, purchasing, or selling a specific item, the pair of users and genres (genre IDs) is linked. Then, a closeness score is assigned to the features shared by the pair.

[0072] (4) Procedure for constructing the entire knowledge graph After the user-to-user relationship graph, user-to-item relationship graph, and item-to-item relationship graph are created by the above steps (1) to (3), in S34 of FIG. 3, the graph construction unit 103 connects these graphs to construct (create) the entire knowledge graph. A conceptual diagram of the knowledge graph (knowledge graph 90) is shown in the upper part of FIG. 9. The graph construction unit 103 uses common nodes as connection points in the created user-to-user relationship graph, user-to-item relationship graph, and item-to-item relationship graph to connect all the graphs. Next, the graph construction unit 103 organizes the graphs by deleting duplicate links, etc., and constructs the knowledge graph. Although not shown in FIG. 9, a closeness score indicating the closeness between the nodes is shown between each node (user, item, genre, etc.). The closeness score may be represented by the length of the arrow. Also, although not shown in FIG. 9, each user includes a user feature, or the user feature is connected as a node. Note that nodes such as users, items, and genres correspond to entities (head entities or tail entities) in the knowledge graph, and pairs and links correspond to relations.

[0073] The graph construction unit 103 may construct the entire knowledge graph by linking the fact-based user-to-user relationship graph, the item-to-item relationship graph, and the user-to-item relationship graph, each of which is composed of nodes connected by explicit links and explicit links. The graph construction unit 103 may also construct the entire knowledge graph by linking some of the fact-based user relationship graph, the item-to-item relationship graph, and the user-to-item relationship graph, each of which is composed of nodes connected by explicit links and explicit links, and the remaining of the user-to-user relationship graph, the item-to-item relationship graph, and the user-to-item relationship graph, each of which is composed of nodes connected by explicit links and explicit links and nodes connected by implicit links and implicit links. In other words, the entire knowledge graph may not include at least one implicit link of the user-to-user relationship graph, the item-to-item relationship graph, and the user-to-item relationship graph. The graph construction unit 103 may also predict and create an implicit link between nodes by embedding the created knowledge graph into a feature space (vector space). That is, the graph construction unit 103 may predict and create implicit links from a knowledge graph that is composed of only explicit links. Note that extraction (acquisition) of embedded expressions (vector expressions) of entities such as user expressions may be performed based on the entire knowledge graph that does not include at least one implicit link in the user-to-user relationship graph, the item-to-item relationship graph, and the user-to-item relationship graph.

[0074] [User expression extraction procedure] Next, a procedure for extracting user expressions according to this embodiment will be described. The expression extraction unit 104 extracts user expressions for any user from the knowledge graph constructed by the graph construction unit 103. Specifically, the expression extraction unit 104 embeds the knowledge graph in a feature space (vector space) and learns the embedded expressions (vector expressions) of each node (entity) and each link (relation) in the feature space. The expression extraction unit 104 performs knowledge graph learning (representation learning, relation learning, embedding learning) and extracts (acquires) the embedded expressions (low-dimensional vector expressions) of any user as user expressions (user feature vectors).

[0075] The expression extraction unit 104 may employ a Translation-based model that performs learning based on the distance between vector expressions of entities such as TransE, TransD, and RotatE as an embedding model used for learning (embedding) of a knowledge graph. The expression extraction unit 104 may also employ an Embedding-projection model that performs learning by mapping vector expressions of entities such as TransH, TransR, and STransE to a vector space that differs for each relation. The expression extraction unit 104 may also employ a model that performs learning by using a conversion of vector expressions to a complex space such as ComplEx. The expression extraction unit 104 may also employ a model that performs learning by using a convolutional neural network (NN) including NN such as ConvE, ConvR, and R-GCN. The expression extraction unit 104 may also employ a model that uses an attention mechanism such as Knowledge Graph Attention Network (KGAT), and may appropriately employ a known model such as TorusE or an extension thereof. The expression extraction unit 104 may use regularization (such as L1 regularization or L2 regularization) as appropriate when learning the knowledge graph.

[0076] The user expression may reflect the characteristics of each node and the closeness score assigned between nodes (pairs, links). At this time, the expression extraction unit 104 may learn the vector expression of each node and each link (embedding in a knowledge graph) while weighting the vector expression of the link (relation) between the nodes based on the closeness score between the nodes. Also, the expression extraction unit 104 may focus on or limit the learning of the vector expression of each link whose closeness score exceeds or falls below a predetermined threshold and the node connected via the link, and extract the vector expression of an entity such as an arbitrary user. At this time, the node includes at least a node corresponding to an entity such as an arbitrary user. Also, the expression extraction unit 104 may focus on or limit the learning of the vector expression of each node and each link in the N-th order neighborhood (N>1) of the node corresponding to the entity such as an arbitrary user, and extract the vector expression of the entity such as an arbitrary user. In this way, it is possible to reduce the calculation load by screening the learning target according to the closeness score.

[0077] A conceptual diagram (user representation 91) of a user representation (node ​​representation) extracted for user A is shown at the bottom of FIG. 9. In the user representation 91, information on one or more users, items, genres, shops, etc. connected to user A by implicit or explicit links is reflected in one user representation. The user representation may also represent a closeness score of each node (item, genre, etc.) to user A. In other words, the user representation of user A may correspond to an adjacent representation that reflects the closeness of the relationship between user A and each node. The expression extraction unit 104 may extract an item expression (node ​​expression) for any item from the knowledge graph constructed by the graph construction unit 103.

[0078] Through the above process, the information processing device 10 extracts user expressions and item expressions. The user expressions and item expressions are used as input data for a predetermined prediction process performed by the information processing device 10. That is, the information processing device 10 constructs a knowledge model so as to be able to extract, from the knowledge model, an expression that represents a relationship between an arbitrary user or an arbitrary item and a plurality of users and a plurality of items, and that is used as input data for a predetermined prediction process performed by the information processing device 10. Note that the predetermined prediction process may be performed by an information processing device other than the information processing device 10. Hereinafter, a prospective user prediction process will be described as an example of the predetermined prediction process.

[0079] [Prediction of potential users] Next, a process for predicting a potential user according to the present embodiment will be described. The potential user prediction model 111 is a learning model that predicts a user having similar characteristics to a seed user as a potential user. A seed user is a user who has purchased and / or used a given product or service through a web service and / or has positively evaluated the product or service through the web service.

[0080] The prospective user prediction model 111 is, for example, a learning model based on XGBoost. In the learning stage, the learning unit 106 trains the prospective user prediction model 111 using the user features of a seed user (positive user), the user features of users other than the seed user (negative users), and the user expressions of these users. The user features are base user features and include a purchase history (information on the genre and type of products, etc.) in the web service. The demographic information and the purchase history may each include a plurality of subdivided features. Note that the user features are not limited to demographic information and purchase history, and may include other features such as a point status (available points, etc.), point features (information on point transactions such as points acquired / used from online or offline shops, etc.), etc.

[0081] The learning unit 106 verifies and tunes (adjusts) hyperparameters (parameters that control the behavior of the potential user prediction model 111) by grid search and cross validation. Since XGBoost is a tree (decision tree) based model, the potential user prediction model 111 can generate results that show how input data (user features) affect the model output. This makes it possible to verify, for example, which user features (combinations of subdivided features) are more influential for a seed user.

[0082] The trained potential user prediction model 111 is configured to output, for any user, the possibility that the user has user characteristics similar to those of the seed user (potential of the potential user). The possibility is expressed, for example, as a numerical value between 0 and 1, with the maximum possibility being 1. Here, for example, if the threshold is set to 0.5, the potential user prediction unit 105 can predict (determine) a user having a possibility greater than 0.5 as a potential user (i.e., a potential user having characteristics similar to those of the seed user). Note that there may be a plurality of seed users, and in this case, the potential user prediction unit 105 can predict, as a potential user, a user having user characteristics similar to those of a user included in the plurality of seed users (seed user group).

[0083] In this embodiment, the prospective user prediction unit 105 inputs the user expressions extracted by the expression extraction unit 105 and the base user features for an arbitrary user into the prospective user prediction model 111 to predict whether the arbitrary user is a prospective user. FIG. 10 shows a diagram for explaining the prospective user prediction process according to this embodiment. When the user A is set as an arbitrary user (target user), the prospective user prediction unit 105 inputs the base user features 1001 of the user A and the user expressions 91 extracted by the expression extraction unit 104 into the prospective user prediction model 111 to predict whether the user A is a prospective user. Specifically, the prospective user prediction unit 105 predicts and outputs the possibility that the user A has the same user features as the seed user from the user features 1001 and the user expressions 91 of the user A (the possibility 1002 of the prospective user).

[0084] [Hardware configuration of information processing device 10] FIG. 11 is a block diagram showing an example of a hardware configuration of an information processing device 10 according to the present embodiment. The information processing apparatus 10 according to the present embodiment can be implemented on any single or multiple computers, mobile devices, or any other processing platform. 11, an example in which the information processing device 10 is implemented in a single computer is shown, but the information processing device 10 according to the present embodiment may be implemented in a computer system including multiple computers. The multiple computers may be connected to each other so as to be able to communicate with each other via a wired or wireless network.

[0085] 11, the information processing device 10 may include a CPU 201, a ROM 202, a RAM 203, a HDD 204, an input unit 205, a display unit 206, a communication I / F 207, and a system bus 208. The information processing device 10 may also include an external memory. A CPU (Central Processing Unit) 201 generally controls the operations of the information processing device 10, and controls each of the components (202 to 207) via a system bus 208, which is a data transmission path.

[0086] The ROM (Read Only Memory) 202 is a non-volatile memory that stores control programs and the like necessary for the CPU 201 to execute processing. Note that the programs may be stored in a non-volatile memory such as a HDD (Hard Disk Drive) 204 or an SSD (Solid State Drive) or an external memory such as a removable storage medium (not shown). The RAM (Random Access Memory) 203 is a volatile memory and functions as a main memory, a work area, etc. of the CPU 201. That is, the CPU 201 loads necessary programs, etc. from the ROM 202 to the RAM 203 when executing processing, and realizes various functional operations by executing the programs, etc. The learning model storage unit 110 and the feature storage unit 102 shown in FIG. 2 can be configured by the RAM 203.

[0087] The HDD 204 stores, for example, various data and various information required when the CPU 201 performs processing using a program. The HDD 204 also stores, for example, various data and various information obtained when the CPU 201 performs processing using a program. The input unit 205 is composed of a keyboard and a pointing device such as a mouse. The display unit 206 is configured with a monitor such as a liquid crystal display (LCD), etc. The display unit 206 may be configured in combination with the input unit 205 to function as a GUI (Graphical User Interface).

[0088] The communication I / F 207 is an interface that controls communication between the information processing device 10 and an external device. The communication I / F 207 provides an interface with a network and executes communication with an external device via the network. Various data, various parameters, etc. are transmitted and received between the external device and the communication I / F 207. In this embodiment, the communication I / F 207 may execute communication via a wired LAN (Local Area Network) or a dedicated line conforming to a communication standard such as Ethernet (registered trademark). However, the network available in this embodiment is not limited to this, and may be configured as a wireless network. This wireless network includes wireless PANs (Personal Area Networks) such as Bluetooth (registered trademark), ZigBee (registered trademark), and UWB (Ultra Wide Band). It also includes wireless LANs (Local Area Networks) such as Wi-Fi (Wireless Fidelity) (registered trademark), and wireless MANs (Metropolitan Area Networks) such as WiMAX (registered trademark). It also includes wireless WANs (Wide Area Networks) such as LTE / 3G, 4G, and 5G. Note that the network only needs to connect each device so that they can communicate with each other, and the communication standard, scale, and configuration are not limited to those described above.

[0089] At least some of the functions of each element of the information processing device 10 shown in Fig. 2 can be realized by the CPU 201 executing a program. However, at least some of the functions of each element of the information processing device 10 shown in Fig. 2 may be operated as dedicated hardware. In this case, the dedicated hardware operates under the control of the CPU 201.

[0090] [Hardware configuration of user device 11] The hardware configuration of the user device 11 shown in Fig. 1 may be the same as that of Fig. 11. That is, the user device 10 may include a CPU 201, a ROM 202, a RAM 203, a HDD 204, an input unit 205, a display unit 206, a communication I / F 207, and a system bus 208. The user device 11 can display various information provided by the information processing device 10 on the display unit 206, and perform processing corresponding to an input operation received from a user via a GUI (configured by the input unit 205 and the display unit 206).

[0091] [Processing flow] Fig. 12 shows a flowchart of processing executed by the information processing device 10 according to this embodiment. The processing shown in Fig. 12 can be realized by the CPU 201 of the information processing device 10 loading a program stored in the ROM 202 or the like into the RAM 203 and executing it. For the explanation of Fig. 12, the information processing system shown in Fig. 1 will be referred to. It is assumed that the prospective user prediction model 111 and the score prediction model 112, which have been learned by the learning unit 105, are stored in the learning model storage unit 110.

[0092] In S1201, the user characteristic acquisition unit 101 acquires the user characteristics of each user from the user devices 11-1 to 11-N, and stores them in the characteristic storage unit 120 as user characteristics 121. In addition, the item characteristic acquisition unit 102 acquires item characteristics (attributes) based on registration information and transaction history in various web services from a predetermined database, and stores them in the characteristic storage unit 120 as item characteristics 122. The process of S1201 may be a process of acquiring (collecting) user characteristics and item characteristics for a certain period of time in the past.

[0093] In S1202, the graph constructing unit 103 constructs a knowledge graph. The procedure for creating the knowledge graph is as described above with reference to FIG.

[0094] In S1203, the expression extraction unit 104 extracts user expressions for an arbitrary user from the knowledge graph created in S1202. The procedure for extracting the user expressions is as described above with reference to FIG.

[0095] In S1204, the prospective user prediction unit 105 predicts the possibility that a given user is a prospective user having similar characteristics to a given seed user. In this embodiment, as shown in Fig. 10, for the given user, the base user characteristics of the given user and the user expression of the given user are input to the prospective user prediction model 111, and the possibility that the given user has similar characteristics to the seed user (the possibility of the given user being a prospective user) is predicted and output.

[0096] The prospective user prediction unit 105 can predict, from among a plurality of users, prospective users having similar characteristics to the predetermined seed user as a prospective user group (similar user group). In this case, the prospective user prediction unit 105 inputs, for each user, the user characteristics that are the base of the user and the user expressions of the user into the prospective user prediction model 111 to predict the prospective user group. In addition, when there are a plurality of seed users (seed user group), the prospective user prediction unit 105 can predict, from among the plurality of users, users having user characteristics similar to those of users included in the seed user group as a prospective user group.

[0097] In S1205, the output unit 107 outputs the result of the possibility of the prospective user predicted in S1204. For example, when the processes of S1203 and S1204 are performed for a plurality of users, the output unit 107 can generate information on the information of a prospective user group predicted from the plurality of users and output the information to an external device (not shown).

[0098] In this way, the information processing device according to this embodiment creates a user-to-user relationship graph, an item-to-item relationship graph, and a user-item relationship graph from the user characteristics of multiple users and the characteristics of multiple items, and creates a knowledge graph using each of these relationship graphs. The knowledge graph links all other users and items (including genres, shops, etc.) related to any given user, and is expected to be utilized in platform businesses.

[0099] Furthermore, the information processing device according to this embodiment creates a user representation for an arbitrary user, which represents all other users and items related to the arbitrary user, from the knowledge graph. The user representation is a representation in which the characteristics (attributes) of all other users and items are linked to one user. In other words, the user representation is not an individual representation for each other user or item, but is a representation that includes composite relationships with other users and items for an arbitrary user. This allows the connections of an arbitrary user with other users and items to be treated as one representation, and when the user representation is used for arbitrary prediction processing for a platform business, the amount of computation can be advantageously reduced.

[0100] Furthermore, the information processing device according to this embodiment uses the user expression and user features of an arbitrary user to predict whether the user has similar features to a predetermined seed user (possibility of the user being a prospective user). By using the user expression as well as the user features, prediction can be made with more consideration given to the user's preferences, and the accuracy of the prediction can be improved. Furthermore, the information on prospective users obtained by the prediction enables more targeted marketing.

[0101] Second embodiment Next, a second embodiment will be described. The information processing system according to this embodiment can be configured as shown in Fig. 1, similarly to the first embodiment. Below, differences from the first embodiment will be described, and descriptions of similar configurations and features will be omitted.

[0102] [Functional configuration of information processing device 10] The information processing device 10 according to this embodiment first acquires various user features from the user devices 11-1 to 11-N, and also acquires features related to items from a predetermined database. The information processing device 10 then creates a graph neural network (GNN) from the acquired features, and extracts a user expression for an arbitrary user from the GNN. Furthermore, the information processing device 10 uses the user expression to predict a prospective user who has similar user features to a predetermined seed user (e.g., who is likely to purchase a predetermined item with the seed user).

[0103] FIG. 13 shows an example of the functional configuration of the information processing device 10 according to the present embodiment. 13 includes a user feature acquisition unit 101, an item feature acquisition unit 102, a GNN construction unit 1301, an expression extraction unit 1302, a potential user prediction unit 1303, a learning unit 1304, an output unit 107, a learning model storage unit 110, and a feature storage unit 120. The learning model storage unit 110 stores a potential user prediction model 113 and a score prediction model 112. The feature storage unit 120 is configured to store a user feature 121 and an item feature 122.

[0104] The GNN construction unit 1301 creates a GNN based on user features, item features, and tasks. The construction procedure of the GNN will be described later. The expression extraction unit 1302 extracts a user expression for an arbitrary user from the GNN constructed by the GNN construction unit 1301. The expression extraction unit 1302 may also extract an item expression for an arbitrary item from the GNN. The extraction process of the user expression (or item expression) will be described later.

[0105] The prospective user prediction unit 1303 predicts, as prospective users, a group of users who have the same user characteristics as a predetermined seed user and are predicted to behave in the same (similar) manner as the seed user through the web service. In this embodiment, the prospective users are predicted using the prospective user prediction model 113 trained by the learning unit 106. The prediction process of the prospective users will be described later.

[0106] [Procedure for constructing GNN] Next, the procedure for constructing a GNN according to this embodiment will be described. Fig. 14 shows a flowchart of the procedure for constructing a knowledge graph executed by the GNN construction unit 1301 according to this embodiment. First, in S1401, the GNN construction unit 1301 creates an inter-user relationship graph according to the procedure for creating an inter-user relationship graph described in the first embodiment. The GNN construction unit 1301 also creates an inter-item relationship graph according to the procedure for creating an inter-item relationship graph described in the first embodiment.

[0107] In S1402, the GNN construction unit 1301 creates a relationship graph (user-item relationship graph) between multiple users (user nodes) and multiple items (item nodes) based on the user features 121 stored in the feature storage unit 120. Specifically, the GNN construction unit 1301 first acquires user features related to items for each user, such as the purchase history, search history, or browsing history (including click history) of each user, from the user features 121 stored in the feature storage unit 120. Next, the GNN construction unit 1301 creates a user-item relationship graph using the user features related to the items for each user. For example, the GNN construction unit 1301 forms edges (relationships between nodes) for one or more items for which a purchase history, search history, or browsing history exists for any user.

[0108] Next, in S1403, the GNN construction unit 1301 sets (defines) a plurality of tasks (task nodes) representing classifications of a plurality of items included in the user-item relationship graph, and adds them to the graph. The task is one classification targeted in the market, and may be information indicating, for example, the brand name of the item, the name of the region where the item is sold, or the name of the agency that handles the item. In S1404, the GNN construction unit 1301 trains the GNN, organizes the edges between the nodes, and constructs the GNN.

[0109] A conceptual diagram of a GNN (GNN150) is shown at the top of Fig. 15. In the GNN150, in addition to edges between a plurality of user nodes and a plurality of item nodes, edges between a plurality of task nodes are added. The GNN construction unit 1301 acquires relationships between the plurality of user nodes and the plurality of task nodes and relationships between the plurality of item nodes and the plurality of task nodes from user features and item features, and causes the GNN to learn using the acquired relationships.

[0110] [User expression extraction procedure] Next, the procedure for extracting user expressions according to this embodiment will be described. The expression extraction unit 1302 extracts a user expression for any user from the GNN constructed by the GNN construction unit 1301. Specifically, the expression extraction unit 1302 embeds the GNN in a common feature space (vector space) and learns the embedded expressions (vector expressions) of each node (entity) and each edge (relation) in the feature space. It performs learning (representation learning, relation learning, embedding learning) of the graph network indicated by the GNN, and extracts (obtains) the embedded expression (low-dimensional vector expression) of any user as the user expression (user feature vector).

[0111] 15 shows a conceptual diagram (user representation 151) of a user representation extracted for user A. In user representation 151, in addition to information on one or more users, items, genres, shops, etc. having a relationship with user A, information on a task (e.g., a brand name) is reflected in one user representation. The expression extraction unit 104 may extract an item expression for an arbitrary item from the GNN constructed by the GNN construction unit 1301.

[0112] Through the above process, the information processing device 10 extracts user expressions and item expressions. The user expressions and item expressions are used as input data for a predetermined prediction process performed by the information processing device 10. That is, the information processing device 10 constructs the GNN so that an expression that represents a relationship between an arbitrary user or an arbitrary item and a plurality of users and a plurality of items and is used as input data for a predetermined prediction process performed by the information processing device 10 can be extracted from the GNN. Note that the predetermined prediction process may be performed by an information processing device other than the information processing device 10. Hereinafter, a prospective user prediction process will be described as an example of the predetermined prediction process.

[0113] [Prediction of potential users] Next, a process for predicting a potential user according to the present embodiment will be described. The potential user prediction model 113 is a learning model that predicts a user having similar characteristics to a seed user as a potential user. A seed user is a user who has purchased and / or used a given product or service through a web service and / or has positively evaluated the product or service through the web service.

[0114] The prospective user prediction model 113 is, for example, a learning model based on XGBoost. In the learning stage, the learning unit 106 trains the prospective user prediction model 113 using the user features of the seed user, the user features of users other than the seed user (negative users), and the user expressions of these users. The user features may be base user features (demographic information and purchase history) as in the first embodiment.

[0115] The learning unit 106 verifies and tunes (adjusts) hyperparameters (parameters that control the behavior of the potential user prediction model 113) by grid search and cross validation. Since XGBoost is a tree (decision tree) based model, the potential user prediction model 113 can generate results that show how input data (user features) affect the model output. This makes it possible to verify, for example, which user features (combinations of subdivided features) are more influenced by the seed user.

[0116] The trained potential user prediction model 113 is configured to output, for any user, the possibility that the user has the same user characteristics as the seed user (potential of the potential user). The possibility is expressed, for example, as a numerical value from 0 to 1, with the maximum possibility being 1. Here, for example, if the threshold is set to 0.5, the potential user prediction unit 1303 can predict (determine) a user having a possibility greater than 0.5 as a potential user (i.e., a potential user having the same characteristics as the seed user).

[0117] In this embodiment, the prospective user prediction unit 1303 inputs the user expressions extracted by the expression extraction unit 1302 and the base user features for an arbitrary user into the prospective user prediction model 113 to predict whether the arbitrary user is a prospective user. FIG. 16 shows a diagram for explaining the prospective user prediction process according to this embodiment. When the user A is set as an arbitrary user (target user), the prospective user prediction unit 1303 inputs the base user features 1601 of the user A and the user expressions 151 extracted by the expression extraction unit 1302 into the prospective user prediction model 113 to predict whether the user A is a prospective user. Specifically, the prospective user prediction unit 1303 predicts and outputs the possibility that the user A has the same user features as the seed user from the user features 1601 and the user expressions 151 of the user A (the possibility of the prospective user 1602).

[0118] [Processing flow] Fig. 17 shows a flowchart of processing executed by the information processing device 10 according to this embodiment. The processing shown in Fig. 17 can be realized by the CPU 201 of the information processing device 10 loading a program stored in the ROM 202 or the like into the RAM 203 and executing it. For the explanation of Fig. 17, the information processing system shown in Fig. 1 will be referred to. It is assumed that the prospective user prediction model 113 and the score prediction model 112, which have been learned by the learning unit 105, are stored in the learning model storage unit 110.

[0119] The process of S1701 is the same as the process of S1201 in Fig. 12. In S1702, the GNN constructing unit 1301 constructs a GNN. The procedure for constructing the GNN is as described above with reference to Fig. 14.

[0120] In S1703, the expression extraction unit 1302 extracts a user expression for an arbitrary user from the GNN created in S1702. The procedure for extracting the user expression is as described above with reference to FIG.

[0121] In S1704, the potential user prediction unit 1303 predicts the possibility that a given user is a potential user having similar characteristics to a given seed user. In this embodiment, as shown in Fig. 16, for the given user, the base user characteristics of the given user and the user expression of the given user are input to the potential user prediction model 113, and the possibility that the given user has similar characteristics to the seed user (the possibility of the given user being a potential user) is predicted and output.

[0122] The potential user prediction unit 1303 can predict potential users having similar characteristics to the predetermined seed user from among multiple users as a potential user group. In this case, the potential user prediction unit 1303 inputs the user characteristics that are the base of each user and the user expressions of each user to the potential user prediction model 111 to predict a potential user group.

[0123] In S1705, the output unit 107 outputs the result of the possibility of the prospective user predicted in S1704. For example, when the processes of S1703 and S1704 are performed for a plurality of users, the output unit 107 can generate information on the information of a prospective user group predicted from the plurality of users and output the information to an external device (not shown).

[0124] In this way, the information processing device according to this embodiment creates a GNN from the user characteristics of multiple users, the characteristics of multiple items, and multiple tasks defined as one classification of items. For any given user, the GNN is connected by edges to all other users, items (including genres, shops, etc.), and tasks related to that user, and is expected to be utilized in platform businesses.

[0125] In addition, the information processing device according to this embodiment creates a user representation for an arbitrary user from the GNN, which represents all other users, items, and tasks related to the arbitrary user. The user representation is a representation in which the features (attributes) of all other users, items, and tasks are linked to one user. In other words, the user representation is not an individual representation for each other user or item, but is a representation that includes composite relationships with other users, items, and tasks for an arbitrary user. This allows the connections of an arbitrary user with other users, items, and tasks to be treated as one representation, and when the user representation is used for arbitrary prediction processing for a platform business, the advantageous effect of reducing the amount of calculation processing can be obtained.

[0126] Furthermore, the information processing device according to this embodiment uses the user expression and user features of an arbitrary user to predict whether the arbitrary user has similar features to a predetermined seed user (possibility of the arbitrary user being a prospective user). By using the user expression including the task as well as the user features, prediction can be made with more consideration given to the user's preferences, and the accuracy of the prediction can be improved. Furthermore, the information on the prospective user obtained by the prediction enables more targeted marketing. For example, if the task is set to a brand name, the brand preferences of the arbitrary user become clear, and it becomes possible to develop marketing focused on that brand for the arbitrary user.

[0127] Although specific embodiments have been described above, the embodiments are merely illustrative and are not intended to limit the scope of the present invention. The apparatus and method described in this specification can be embodied in forms other than those described above. Furthermore, the above-described embodiments can be appropriately omitted, substituted, and modified without departing from the scope of the present invention. Such omitted, substituted, and modified forms are included in the scope of the claims and their equivalents, and belong to the technical scope of the present invention. [Explanation of symbols]

[0128] 1 to N: user, 10: information processing device, 11-1 to 11-N: user device, 101: user feature acquisition unit, 102: item feature acquisition unit, 103: graph construction unit, 104; 1302: expression extraction unit, 105; 1303: potential user prediction unit, 106: learning unit, 107: output unit, 110: learning model storage unit, 111; 113: potential user prediction model, 112: score prediction model, 120: feature storage unit, 121: user feature, 122: item feature, 1301: GNN construction unit

Claims

1. A user feature acquisition means for acquiring factual features of each of a plurality of users as user features; an item feature acquiring means for acquiring features relating to each of a plurality of items as item features from a predetermined database; a user-to-user graph constructing means for constructing a user-to-user relationship graph representing relationships between the plurality of users by connecting a plurality of user nodes representing the plurality of users with links using commonalities between the user features; an item-to-item graph constructing means for constructing an item-to-item relationship graph representing relationships between the items by connecting a plurality of item nodes representing the plurality of items with links using the similarities between the item features; a user-item graph constructing means for constructing a user-item relationship graph representing relationships between the plurality of items by connecting the plurality of user nodes and the plurality of item nodes with links using the user features related to the plurality of items; a graph construction means for constructing a graph representing the mutual relationships between the plurality of user nodes and the plurality of item nodes by connecting the plurality of user nodes and the plurality of item nodes with links using common user nodes or item nodes as connection points in the inter-user relationship graph, the inter-item relationship graph, and the user-item graph; an extraction means for embedding the graph in a vector space, learning a vector representation of each node and each link in the vector space, and extracting, as a node representation, a vector representation in the graph for any node among the plurality of user nodes and the plurality of item nodes; 13. An information processing device comprising:

2. 2 . The information processing apparatus according to claim 1 , wherein the extracting means performs learning by weighting the vector representation based on relationships between the plurality of user nodes and the plurality of item nodes.

3. 2. The information processing apparatus according to claim 1, wherein the graph is a graph neural network.

4. The method further comprises: setting a plurality of task nodes representing a plurality of tasks representing a target classification of a market for the plurality of items; 4. The information processing device according to claim 3, wherein the graph construction means acquires relationships between the multiple user nodes and the multiple task nodes and relationships between the multiple item nodes and the multiple task nodes from the user features and the item features, and constructs the graph neural network representing mutual relationships among the multiple user nodes, the multiple item nodes, and the multiple task nodes by using the inter-user relationship graph, the inter-item relationship graph, the user-item graph, the relationships between the multiple user nodes and the multiple task nodes, and the relationships between the multiple item nodes and the multiple task nodes, and connecting the multiple user nodes, the multiple item nodes, and the multiple task nodes with links using common user nodes, item nodes, or task nodes as connection points.

5. 5. The information processing device according to claim 4, wherein the extraction means embeds the graph neural network in the vector space, learns a vector representation of each node and each link in the vector space, and extracts, as the node representation, a vector representation in the graph neural network for any node among the plurality of user nodes and the plurality of item nodes.

6. 6. The information processing apparatus according to claim 4, wherein each of the plurality of tasks is a brand name of each of the plurality of items.

7. An information processing method executed by an information processing device, comprising: a user feature acquisition step of acquiring factual features of each of a plurality of users as user features; an item feature acquisition step of acquiring features relating to each of a plurality of items as item features from a predetermined database; a user-to-user graph construction step of constructing a user-to-user relationship graph representing relationships between the plurality of users by connecting a plurality of user nodes representing the plurality of users with links using commonalities between the user features; an item-to-item graph construction step of constructing an item-to-item relationship graph representing relationships between the plurality of items by connecting a plurality of item nodes representing the plurality of items with links using the similarities between the item features; a user-item graph construction step of constructing a user-item relationship graph representing relationships between the plurality of items by connecting the plurality of user nodes and the plurality of item nodes with links using the user features related to the plurality of items; a graph construction step of constructing a graph representing the mutual relationships between the plurality of user nodes and the plurality of item nodes by connecting the plurality of user nodes and the plurality of item nodes with links using common user nodes or item nodes as connection points in the inter-user relationship graph, the inter-item relationship graph, and the user-item graph; an extraction step of embedding the graph in a vector space, learning a vector representation of each node and each link in the vector space, and extracting, as a node representation, a vector representation in the graph for any node among the plurality of user nodes and the plurality of item nodes; 13. An information processing method comprising:

8. An information processing program for causing a computer to execute information processing, the program comprising: A user feature acquisition process for acquiring factual features of each of a plurality of users as user features; an item feature acquisition process for acquiring features relating to each of a plurality of items as item features from a predetermined database; a user-to-user graph construction process for constructing a user-to-user relationship graph representing relationships between the plurality of users by connecting a plurality of user nodes representing the plurality of users with links using commonalities between the user features; an item-to-item graph construction process for constructing an item-to-item relationship graph representing relationships between the items by connecting a plurality of item nodes representing the plurality of items with links using the similarities between the item features; a user-item graph construction process for constructing a user-item relationship graph representing relationships between the plurality of items by connecting the plurality of user nodes and the plurality of item nodes with links using the user features related to the plurality of items; a graph construction process for constructing a graph representing the mutual relationships between the plurality of user nodes and the plurality of item nodes by connecting the plurality of user nodes and the plurality of item nodes with links using common user nodes or item nodes as connection points in the inter-user relationship graph, the inter-item relationship graph, and the user-item graph; embedding the graph in a vector space, learning vector representations of each node and each link in the vector space, and extracting vector representations in the graph for any node among the plurality of user nodes and the plurality of item nodes as node representations; Information processing program.

Citation Information

Patent Citations

  • Information processing device, information processing method, and program

    JP2010146153A

  • Information processing device, information processing method, and program

    JP2017162275A