Information processing device, information processing method, and information processing program

Abstract

To provide an information processing apparatus that can make an appropriate proposal.SOLUTION: An information processing apparatus according to the present application has an extraction unit and a determination unit. The extraction unit extracts, from a search query group used for a search, a search query satisfying a predetermined condition as a first keyword. The determination unit, based on the first keyword extracted by the extraction unit and second keywords corresponding to sections related to a submission destination of an advertisement, determines a proposed section that is a section to be proposed as a submission destination of the first keyword. For example, the determination unit determines the proposed section of the first keyword, based on comparison between first vector information on the first keyword generated by using a vector conversion model that receives character strings as input and outputs vectors corresponding to the character strings, and second vector information on each of the sections generated by using the vector conversion model.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The present invention relates to an information processing device, an information processing method, and an information processing program. [Background technology]

[0002] 2. Description of the Related Art Conventionally, various technologies relating to advertisements have been provided, for example, technologies relating to the submission of content such as advertisements. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2022-003474 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, there is room for improvement in the above-mentioned conventional technology. For example, the above-mentioned conventional technology merely accepts submission of content such as advertisements from a content source, and when the content source selects a category related to the destination of the advertisement, the content source is not necessarily able to select an appropriate category of the destination. Therefore, it is desired to enable appropriate proposals.

[0005] The present application has been made in view of the above, and aims to provide an information processing device, an information processing method, and an information processing program that enable appropriate suggestions. [Means for solving the problem]

[0006] The information processing device of the present application is characterized by comprising an extraction unit that extracts a search query that satisfies a predetermined condition as a first keyword from a group of search queries used in a search, and a determination unit that determines a proposed category, which is a category to be proposed as a submission destination for the first keyword, based on the first keyword extracted by the extraction unit and second keywords corresponding to each of the categories related to the submission destination of an advertisement. Effect of the Invention

[0007] According to one aspect of the embodiment, an effect is achieved in that it is possible to make appropriate suggestions. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating an example of information processing according to an embodiment. [Diagram 2] FIG. 2 is a diagram showing a specific example of information processing. [Diagram 3] FIG. 3 is a diagram illustrating an example of the configuration of an information processing system according to the embodiment. [Figure 4] FIG. 4 is a diagram illustrating an example of the configuration of the information processing device according to the embodiment. [Diagram 5] FIG. 5 is a diagram illustrating an example of a model information storage unit according to the embodiment. [Figure 6] FIG. 6 is a flowchart showing an example of the flow of information processing executed by the information processing device. [Figure 7] FIG. 7 is a hardware configuration diagram illustrating an example of a computer that realizes the functions of the information processing device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, the information processing device, the information processing method, and the information processing program according to the present application will be described in detail with reference to the drawings. Note that the information processing device, the information processing method, and the information processing program according to the present application are not limited to the embodiments. In addition, the same parts in the following embodiments are denoted by the same reference numerals, and duplicated descriptions are omitted.

[0010] (Embodiment) [1. Information Processing] First, an example of information processing executed by the information processing device 100 will be described with reference to Fig. 1. Fig. 1 is a diagram showing an example of information processing according to an embodiment. In the following, a case will be described as an example in which the information processing device 100 determines a category (also called a "proposed category") to be proposed as a submission destination of the first keyword based on a search query (also called a "first keyword") extracted by the information processing device 100 from a search query group and keywords (also called a "second keyword") corresponding to each category (also simply called a "category") related to the submission destination of the advertisement.

[0011] A classification related to the destination of an advertisement is, for example, a classification in settings when placing an advertisement. Below, a campaign and an ad group are described as examples of classifications related to the destination of an advertisement. A campaign and an ad group are concepts of classification in settings when submitting (placing) a search advertisement. For example, an ad group is a role (component) of registering a keyword (query) in association with an advertisement, and when a search is performed using a keyword as a query, an advertisement associated with the keyword is delivered to a user who performed a search using the keyword. For example, a campaign is a component unit including an ad group, and the same advertising target can be set separately according to budget and targeting.

[0012] [1-1. Configuration of information processing system] Prior to describing the process shown in FIG. 1, the configuration of the information processing system 1 will be described with reference to FIG. 3. FIG. 3 is a diagram showing a configuration example of the information processing system according to the embodiment. As shown in FIG. 3, the information processing system 1 includes a terminal device 10, a user terminal 20, an information providing device 50, and an information processing device 100. The terminal device 10, the user terminal 20, the information providing device 50, and the information processing device 100 are connected to each other via a predetermined network N so as to be communicable with each other by wire or wirelessly. Note that the information processing system 1 shown in FIG. 3 may include a plurality of terminal devices 10, a plurality of user terminals 20, a plurality of information providing devices 50, and a plurality of information processing devices 100.

[0013] The information processing device 100 is a computer that determines a proposed category to be proposed as a destination of advertisements for the first keyword based on a first keyword extracted from a group of search queries and a second keyword corresponding to each category related to the destination of advertisements. For example, the information processing device 100 uses a vector conversion model that receives a character string such as a keyword as an input and outputs vector information (also simply called a "vector") corresponding to the character string, and determines the proposed category using the vectorized information.

[0014] The information processing device 100 proposes the determined proposal category to the advertiser. For example, the information processing device 100 provides information indicating the determined proposal category to the advertiser who has requested the information. The information processing device 100 provides the first keyword as a proposed keyword to the terminal device 10 used by the advertiser (also referred to as the "target advertiser") to which the information is to be provided. The information processing device 100 provides the proposed category of the first keyword together with the proposed keyword to the terminal device 10.

[0015] The terminal device 10 is a computer (advertiser device) used by an advertiser. The advertiser may be a corporation or the like, and the user of the terminal device 10 may be, for example, a publicity officer of the advertiser. For example, the terminal device 10 is realized by a smartphone, a tablet terminal, a notebook PC, a desktop PC, a mobile phone, a PDA, or the like. Note that the example in FIG. 1 shows a case where the terminal device 10 is a notebook PC as an example. The advertiser uses the terminal device 10 to transmit and receive information to and from the information processing device 100. For example, the terminal device 10 displays various information provided by the information processing device 100.

[0016] The terminal device 10 receives information provided from the information processing device 100 and transmits information to the information processing device 100. For example, the terminal device 10 receives content for accepting designation by an advertiser (also referred to as "designation content") from the information processing device 100. For example, the terminal device 10 receives designation content for accepting designation of a keyword by an advertiser from the information processing device 100. For example, the terminal device 10 transmits information indicating a keyword (designated keyword) designated by the advertiser through the designation content to the information processing device 100. The terminal device 10 transmits information indicating the keyword designated by the advertiser to the information processing device 100. For example, the terminal device 10 transmits information indicating the keyword designated by the advertiser to the information processing device 100.

[0017] In addition, an advertiser may use the terminal device 10 to request an agency to submit advertisement content (hereinafter also simply referred to as "advertisement") without submitting the advertisement to the information processing device 100. In this case, it is the agency that submits the advertisement to the information processing device 100. The term "advertiser" is a concept that includes not only advertisers but also agencies, and the term "advertiser device" is a concept that includes not only advertiser devices but also agency devices used by agencies.

[0018] The user terminal 20 is a computer used by a user. The user terminal 20 is a device (terminal device) that can be carried by a user. The user terminal 20 is realized, for example, by a smartphone, a tablet terminal, a notebook PC (Personal Computer), a mobile phone, a PDA (Personal Digital Assistant), or the like. FIG. 1 shows a case where the user terminal 20 is a smartphone. Note that, hereinafter, the user terminal 20 may be referred to as a user. That is, hereinafter, a user can also be read as a user terminal 20. For example, the user terminal 20 is a computer that displays advertisements provided by the information processing device 100. For example, the user terminal 20 displays various information such as advertisements by a display application.

[0019] The information providing device 50 is a computer in which information for providing various information related to a service is stored. For example, the information providing device 50 collects information from various external devices such as a web server, and provides the collected information to the information processing device 100. For example, the information providing device 50 is realized by, for example, a server device or a cloud system. For example, the information providing device 50 provides, as various types of information, information related to the service (service information) and information related to a user who uses the service (user information).

[0020] For example, the information providing device 50 may provide a service of providing data used for learning (also referred to as "learning data") to the information processing device 100. In this case, the information providing device 50 provides the information processing device 100 with data (learning data) used by the information processing device 100 to learn a model. For example, the information providing device 50 provides the information processing device 100 with data (learning data) used by the information processing device 100 to learn a generative model. The information providing device 50 may also provide a service of providing the information processing device 100 with a learned model. For example, the information providing device 50 provides the information processing device 100 with a model (e.g., model M1) used for vector conversion. For example, the information providing device 50 provides the information processing device 100 with a model (e.g., prediction model M2) used to predict an advertising index.

[0021] [1-2. Overview of processing in information processing systems] From here, an example of information processing performed by the information processing system 1 will be described with reference to Fig. 1. Note that, regarding the information processing performed by the information processing system 1, detailed description of the points that are similar to conventional processing will be omitted as appropriate.

[0022] In FIG. 1, the information processing device 100 acquires information used to execute a determination process for determining a proposed category from the information providing device 50 (step S1). The information processing device 100 receives information used to execute the determination process from the information providing device 50. For example, the information processing device 100 acquires a vector conversion model M1 (also simply referred to as "model M1") that converts a character string into a vector from the information providing device 50. The model M1 is a vector conversion model that receives a character string as an input and outputs a vector corresponding to the character string. The model M1 outputs a vector obtained by converting a character string into a vector using a word embedding technique such as word2vec. For example, the model M1 outputs a multi-dimensional (e.g., 200-dimensional) vector corresponding to an input character string. Note that the above is merely an example, and any model can be adopted as the model M1 as long as it outputs a vector corresponding to the characteristics of an input character string. In addition, when learning the model M1, the information processing device 100 may acquire data (learning data) used in the learning process of the model M1 from the information providing device 50.

[0023] The information processing device 100 stores the information acquired from the information providing device 50 in the storage unit 120 (see FIG. 6) (step S2). The information processing device 100 stores the information received from the information providing device 50 in the storage unit 120. For example, when the information processing device 100 acquires a model M1 from the information providing device 50, the information processing device 100 stores the model M1 in the model information storage unit 121 (see FIG. 4). When the information processing device 100 acquires learning data to be used for the learning process from the information providing device 50, the information processing device 100 stores the acquired learning data to be used for the learning process of the model M1 in the model information storage unit 121 (see FIG. 4) in association with the model M1. Note that, when the information processing device 100 has already acquired information to be used for executing a determination process for determining a proposal category, it is not necessary to perform the processes of steps S1 and S2.

[0024] The information processing device 100 extracts a first keyword from the search query group CD used in the search (step S3). The information processing device 100 extracts a first keyword from the search query group CD stored in the search query information storage unit 122 (see FIG. 4). The information processing device 100 extracts, as a first keyword, a search query from the search query group CD that a user who used that search query (also referred to as a unit of "query") accessed a specific site. In FIG. 1, the information processing device 100 extracts keyword KW1, keyword KW2, etc., from the search query group CD as shown in the extracted query list CL.

[0025] In FIG. 1, the keywords are shown as abstract character strings such as KW1, KW2, etc., but each keyword is a character string indicating a specific content such as "Naha Hotel" or "Kyoto Sightseeing". In this way, each keyword may be a combination of multiple keywords. In the case of a combination of multiple keywords, each keyword may be vectorized individually, or each combination of multiple keywords may be vectorized.

[0026] Then, the information processing device 100 executes a process of vectorizing each primary keyword. The information processing device 100 executes a process of generating a vector (also called a "first vector") corresponding to each primary keyword. In Fig. 1, the information processing device 100 generates a first vector corresponding to each primary keyword as shown in a first vector list FV.

[0027] First, the information processing device 100 inputs each of the primary keywords as input information to the model M1 (step S4-1). In Fig. 1, the information processing device 100 inputs each of the primary keywords such as keywords KW1, KW2, etc. as input information to the model M1.

[0028] The model M1 to which input information has been input outputs a vector (step S4-2). In FIG. 1, the model M1 to which keyword KW1 has been input outputs a vector KV1. Moreover, the model M1 to which keyword KW2 has been input outputs a vector KV2. In this manner, the information processing device 100 uses the model M1 to generate vectors KV1, KV2, etc., which are first vectors corresponding to each of the first keywords, such as keywords KW1, KW2, etc.

[0029] Furthermore, the information processing device 100 executes a prediction process for predicting an advertising index corresponding to each primary keyword. In Fig. 1, the information processing device 100 predicts an advertising index corresponding to each primary keyword as shown in a predicted value list IL.

[0030] The information processing device 100 predicts the predicted CVR of each first keyword using a prediction model M2 that receives as input a vector obtained by vectorizing a keyword and outputs a predicted value of CVR (conversion rate) when a keyword corresponding to the vector is used as a search query. For example, the prediction model M2 outputs a predicted CVR value (0 to 100 (%)) when a keyword corresponding to the vector is used as a search query in response to an input of a vector. The information processing device 100 predicts the predicted CVR of the first keyword by inputting the vector of the first keyword into the prediction model M2. The prediction model M2 may be generated for each advertiser, which will be described later.

[0031] In FIG. 1, CVR (conversion rate) is described as an example of the advertising index, but the advertising index is not limited to CVR and any index can be adopted. For example, the advertising index can be any index related to conversion, such as the number of times conversion has been achieved, other than CVR. The conversion here may be any user behavior. For example, the conversion may be a user behavior that leads to the benefit of purchasing a product (using a service) or registering as a member for the target of the advertisement. Note that purchase (use) and membership registration are merely examples, and the conversion may be a request for information, viewing (displaying) a site corresponding to the advertisement, visiting a physical store, etc. In this way, any user behavior that is considered to be a conversion can be set. For example, the administrator of the information processing device 100, the advertiser, etc. may individually set what user behavior is considered to be a conversion for each advertisement. In addition to the index related to conversion, any click-related index such as the number of clicks (number of clicks) and CTR (click-through rate) can be adopted as the advertising index. It should be noted that the above advertising index is merely an example, and any index can be adopted as the advertising index.

[0032] First, the information processing device 100 inputs each of the first vectors as input information to the prediction model M2 (step S5-1). In Fig. 1, the information processing device 100 inputs each of the first vectors, such as vectors KV1 and KV2, as input information to the prediction model M2.

[0033] The prediction model M2 to which the input information has been input outputs a predicted CVR of the keyword corresponding to the input vector (step S5-2). In FIG. 1, the prediction model M2 to which the vector KV1 has been input outputs a predicted CVR value VL1. Moreover, the prediction model M2 to which the vector KV2 has been input outputs a predicted CVR value VL2. In this way, the information processing device 100 uses the prediction model M2 to predict the predicted CVR corresponding to each of the first keywords, such as keywords KW1, KW2, which correspond to each of the vectors KV1, KV2, etc.

[0034] The information processing device 100 extracts a second keyword from the advertising information group AD (step S6). The information processing device 100 extracts a second keyword from the advertising information group AD stored in the advertising information storage unit 123 (see FIG. 4). The information processing device 100 extracts a keyword associated with each advertising campaign in the advertising information group AD as a second keyword. In FIG. 1, the information processing device 100 extracts keyword KW11, keyword KW12, etc. as second keywords for category CP1 (e.g., advertising campaign A) as shown in the category list DL. In addition, the information processing device 100 extracts keyword KW21, keyword KW22, etc. as second keywords for category CP2 (e.g., advertising campaign B).

[0035] Then, the information processing device 100 executes a process of generating a vector (also called a "second vector") corresponding to each division using the second keyword of each division. The information processing device 100 executes a process of generating a second vector based on a vector (also called a "sub-vector") obtained by vectorizing the second keyword corresponding to each division. The information processing device 100 calculates an average of the sub-vectors of the second keyword corresponding to each division, and sets the calculated average as the second vector. In FIG. 1, the information processing device 100 generates a second vector corresponding to each division as shown in the second vector list SV.

[0036] First, the information processing device 100 inputs each of the secondary keywords corresponding to each category as input information to the model M1 (step S7-1). In Fig. 1, the information processing device 100 inputs each of the secondary keywords such as keywords KW11, KW12, etc. for category CP1 as input information to the model M1. Also, the information processing device 100 inputs each of the secondary keywords such as keywords KW21, KW22, etc. for category CP2 as input information to the model M1.

[0037] The model M1 to which the input information is input outputs a vector (step S7-2). In FIG. 1, the model M1 to which the keyword KW11 is input outputs a vector KV11. Moreover, the model M1 to which the keyword KW12 is input outputs a vector KV12. The information processing device 100 calculates a vector KV10, which is an average of the vectors KV11, KV12, etc., as the second vector of the section CP1. Moreover, the model M1 to which the keyword KW21 is input outputs a vector KV21. Moreover, the model M1 to which the keyword KW22 is input outputs a vector KV22. The information processing device 100 calculates a vector KV20, which is an average of the vectors KV21, KV22, etc., as the second vector of the section CP1. In this way, the information processing device 100 generates vectors KV1, KV2, etc., which are second vectors corresponding to each section, by using the model M1.

[0038] The information processing device 100 determines a proposed category for the first keyword based on the first vector of the first keyword and the second vector corresponding to each of the categories (step S8). The information processing device 100 determines a proposed category for each first keyword based on a comparison between the first vector of each first keyword and the second vector of each of the categories. The information processing device 100 determines a proposed category for the first keyword based on the cosine similarity between the first vector of the first keyword and the second vector of each of the categories. In FIG. 1, the information processing device 100 determines, as the proposed category, a similar category having the maximum cosine similarity between the first vector of the first keyword and the second vector of each of the categories among the categories shown in the category list DL.

[0039] 1, as shown in the proposal list PK, for keyword KW1, which is the first keyword, the information processing device 100 determines, as the proposed category, the category CP2 corresponding to vector KV20, which has the maximum cosine similarity with vector KV1. Also, for keyword KW2, which is the first keyword, the information processing device 100 determines, as the proposed category, the category CP1 corresponding to vector KV10, which has the maximum cosine similarity with vector KV2.

[0040] Then, the information processing device 100 provides the information generated by the above process to the advertiser (step S9). For example, the information processing device 100 transmits the first keyword (proposed keyword) together with information indicating a proposal category corresponding to the provided keyword to the terminal device 10 used by the advertiser. The information processing device 100 transmits the first keyword (proposed keyword) together with information indicating a predicted CVR corresponding to the provided keyword to the terminal device 10 used by the advertiser. For example, the information processing device 100 transmits potential keyword list information that displays a list of potential keywords, with the first keyword as a potential keyword, together with information corresponding to the potential keyword, to the terminal device 10. The potential keyword list information includes information indicating, for each potential keyword, various performance values, predicted CVR, proposal categories such as recommended campaigns and recommended ad groups, and the presence or absence of inflow via search advertisements. The terminal device 10 displays the potential keyword list information.

[0041] In this way, the information processing device 100 can make an appropriate proposal by extracting a first keyword from a group of search queries and determining a proposed category for the first keyword based on the extracted first keyword and a second keyword corresponding to each category related to the advertisement submission destination. Also, the information processing device 100 can provide the advertiser with an appropriately determined proposed category by providing the first keyword as a proposed keyword to the terminal device 10 used by the target advertiser, thereby making an appropriate proposal.

[0042] [1-2-1. Example of Processing] On the premise of the information processing performed by the information processing system 1 described above, a specific example of processing by the information processing device 100 will be described with reference to Fig. 2. Fig. 2 is a diagram showing a specific example of information processing. Note that the same points as those described above will not be described as appropriate.

[0043] 2, the keyword KW2, which is the first keyword, is "Naha Hotel", and the first vector corresponding to the keyword KW2 is the vector KV2, which is "0.6, 0.3". The information processing device 100 converts "Naha Hotel" to "0.6, 0.3" by using the model M1.

[0044] In FIG. 2, the keyword KW11, which is "Okinawa", and the keyword KW12, which is "Churaumi", are associated with the category CP1, which is the advertising campaign A. The information processing device 100 converts "Okinawa" into the vector KV11, "0.7, 0.2", by using the model M1. The information processing device 100 also converts "Churaumi" into the vector KV12, "0.5, 0.2", by using the model M1. The information processing device 100 also generates the vector KV10, "0.6, 0.2", by calculating the average of the sub-vectors "0.7, 0.2" and "0.5, 0.2". As shown in the similarity information DS1, the information processing device 100 calculates the cosine similarity between the vector KV2, which is the first vector ("0.6, 0.3"), and the vector KV10, which is the second vector ("0.6, 0.2"), as "0.9".

[0045] In FIG. 2, the section CP2, which is the advertising campaign B, is associated with the keyword KW21, which is "Hokkaido", the keyword KW22, which is "Shiretoko Peninsula", and the like. The information processing device 100 converts "Hokkaido" into the vector KV21, "0.2, 0.8", by using the model M1. The information processing device 100 also converts "Shiretoko Peninsula" into the vector KV22, "0.4, 0.4", by using the model M1. The information processing device 100 also generates the vector KV20, "0.3, 0.6", by calculating the average of the sub-vectors "0.2, 0.8" and "0.4, 0.4". As shown in the similarity information DS2, the information processing device 100 calculates the cosine similarity between the vector KV2, which is the first vector ("0.6, 0.3"), and the vector KV20, which is the second vector ("0.3, 0.6"), as "0.5".

[0046] In Fig. 2, for the first keyword (keyword KW2) "Okinawa", the information processing device 100 determines advertising campaign A, which is the category CP1 corresponding to vector KV10 having the maximum cosine similarity with vector KV2, as the proposed category. That is, in Fig. 2, the information processing device 100 determines to recommend advertising campaign A to the advertiser for the first keyword (keyword KW2) "Okinawa".

[0047] A detailed specific example will be briefly described below, taking as an example a case where the target of information provision is advertiser X. The information processing device 100 generates a prediction model M2 that predicts the likelihood of conversion from the registered keywords of advertiser X. For example, the information processing device 100 calculates the registered keywords and the CVR performance value for the search advertising account of advertiser X.

[0048] The information processing device 100 performs the following processing as preprocessing for registered keywords. For example, the information processing device 100 may refer to a configuration file or the like, correct spelling variations of brand names, etc., and then exclude brand names, etc. in a partial match search. Note that brand names and other brand-name related keywords may have high CVRs and become outliers, so the information processing device 100 can exclude abnormal values ​​of keywords by this exclusion and suppress a decrease in prediction accuracy. The information processing device 100 also excludes outliers in CVR and performs normalization processing so that the CVR falls within the range from 0 to 1. Note that the information processing device 100 may perform random sampling when the learning data is equal to or greater than a certain threshold in order to reduce the processing load.

[0049] The information processing device 100 performs morphological analysis on the registered keywords. The information processing device 100 vectorizes the words after the morphological analysis. For example, the information processing device 100 averages and aggregates each vector for each keyword to create a 200-dimensional vector. The information processing device 100 uses the CVR as a response variable and learns a prediction model M2 from the 200-dimensional vector of each word.

[0050] The information processing device 100 scores the probability of conversion likelihood for the search query. The information processing device 100 extracts search queries flowing into the advertiser X and its competitors, and generates a list of suggested keywords. The information processing device 100 executes the above-mentioned pre-processing for the suggested keywords.

[0051] The information processing device 100 performs morphological analysis on the search query. The information processing device 100 vectorizes the words after the morphological analysis. The information processing device 100 inputs the vector to a prediction model M2 and generates a score (predicted CVR) that predicts the CVR. For example, the information processing device 100 normalizes the score so that the minimum value is 0 and the maximum value is 1.

[0052] The information processing device 100 extracts keywords for each category, such as campaigns and ad groups, registered in search advertisements. The information processing device 100 extracts keywords registered in the search advertisement account of advertiser X and the associated ad campaigns and ad groups.

[0053] Then, the information processing device 100 performs pre-processing on the keywords registered in the search advertisement account of the advertiser X, excluding the removal of outliers in the CVR. The information processing device 100 performs morphological analysis on the registered keywords. The information processing device 100 vectorizes the words of the campaign and the advertisement group, calculates the average value, and calculates the cosine similarity between the calculated average value and the vector of each proposed keyword for all cases. The information processing device 100 determines information to be proposed to the advertiser X based on the calculated cosine similarity, as shown in FIG. 2.

[0054] As described above, the information processing device 100 finds keywords (queries) that have not been reached in the operation of search advertisements, and proposes them together with numerical values ​​that serve as operation indicators. The information processing device 100 extracts unsubmitted queries as extracted queries from among queries that have flowed into the site of an advertiser (business owner) to which the advertisement is proposed and the advertiser's competing sites. The information processing device 100 assigns a predicted score (predicted CVR, etc.) to the extracted queries. For example, the information processing device 100 breaks down the query into parts of speech, vector-converts and quantifies the meaning, generates a machine learning model, and predicts a score (predicted CVR, etc.). The information processing device 100 proposes optimal campaign or ad group divisions, for example, based on the advertiser's account structure and submitted keywords.

[0055] The information processing device 100 vectorizes a query candidate that is a target for delivery of a predetermined advertisement when input, and the advertisement, and if the vector of the query candidate is similar to the vector of the advertisement, proposes the query candidate as a new query. For example, the information processing device 100 uses a model that converts text with a similar intent into a similar vector. Conventionally, in an advertisement campaign, when a registered keyword is input, an advertisement is displayed, and since the keyword is manually registered, keyword omission occurs. Conventionally, it is not possible to respond when a new word is generated.

[0056] Therefore, the information processing device 100 vectorizes the keywords related to the advertisement. Specifically, the information processing device 100 extracts keywords from any information such as advertisement text, set advertisement keywords, and various other metadata related to the advertisement. The information processing device 100 breaks down the extracted keywords into parts of speech. The information processing device 100 vectorizes the keywords for each part of speech using a model. The information processing device 100 links the average value of the vectors to the advertisement. The information processing device 100 may generate a compound query or a long query consisting of multiple words at a predetermined time interval, or may use a history of search queries. The information processing device 100 breaks down and vectorizes the keywords for each part of speech, and obtains the average. The information processing device 100 compares the vector of the search query with the vector of the advertisement to identify a search query having a high similarity. The information processing device 100 proposes a search query that has not been set among the identified search queries. The information processing device 100 may preferentially propose a search query having a high similarity. Note that the above-described process is merely an example, and the information processing device 100 may use various information as appropriate to determine information to be proposed and make a proposal to the advertiser.

[0057] 2. Configuration of Information Processing Device Next, the configuration of the information processing device 100 according to the embodiment will be described with reference to Fig. 4. Fig. 4 is a diagram showing an example of the configuration of the information processing device 100 according to the embodiment. As shown in Fig. 4, the information processing device 100 has a communication unit 110, a storage unit 120, and a control unit 130. Note that the information processing device 100 may have an input unit (e.g., a keyboard, a mouse, etc.) that accepts various operations from an administrator of the information processing device 100, and a display unit (e.g., a liquid crystal display, etc.) that displays various information.

[0058] (Communication unit 110) The communication unit 110 is realized by, for example, a network interface card (NIC) etc. The communication unit 110 is connected to a network by wire or wirelessly, and transmits and receives information between the terminal device 10, the user terminal 20, and the information providing device 50.

[0059] (Storage unit 120) The storage unit 120 is realized by, for example, a semiconductor memory element such as a random access memory (RAM) or a flash memory, or a storage device such as a hard disk or an optical disk. As shown in Fig. 4, the storage unit 120 according to the embodiment has a model information storage unit 121, a search query information storage unit 122, and an advertisement information storage unit 123. The storage unit 120 may store various information, not limited to the above.

[0060] (Model information storage unit 121) The model information storage unit 121 according to the embodiment stores information about the model. For example, the model information storage unit 121 stores information (model data) of a trained model (model) trained (generated) by a learning process. The model information storage unit 121 shown in FIG. 5 stores data used in learning (trained data) in association with the trained model (model). FIG. 5 is a diagram showing an example of a model information storage unit according to the embodiment. In the example shown in FIG. 5, the model information storage unit 121 includes items such as "model ID", "purpose", "model data", and "trained data". In the example of FIG. 5, the model information storage unit 121 stores data used in learning (trained data) in association with the trained model (model).

[0061] "Model ID" indicates identification information for identifying a model. "Use" indicates the use of the corresponding model. "Model data" indicates the data of the model. Figure 5 etc. shows an example in which conceptual information such as "MDT1" is stored in "model data", but in reality, various information constituting the model is included, such as information on the model configuration (network configuration) and information on parameters. For example, "model data" includes information including the nodes in each layer of the network, the functions employed by each node, the connection relationships of the nodes, and the connection coefficients set for the connections between the nodes.

[0062] "Learning data" refers to data used to train a trained model (model). In the "learning data", information indicating a data set used to train the corresponding model is stored. For example, the "learning data" associates data (input information) with correct answer information (output information) corresponding to the data, and stores the data as learning data (also called "data for learning"). FIG. 5 shows an example in which conceptual information such as "LDT1" is stored in the "learning data", but in reality, various information related to the data used to train the corresponding model, such as data (input information) and correct answer information (output information) corresponding to the data, is included.

[0063] In FIG. 5, the model (model M1) identified by the model ID "M1" indicates that its application is "vector conversion." In other words, model M1 indicates that it is a model that outputs (generates) a vector corresponding to an input character string (keyword). Also, it indicates that the model data of model M1 is model data MDT1. Also, it indicates that the learning data used to learn model M1 is learning data LDT1.

[0064] Also, the model (prediction model M2) identified by the model ID "M2" indicates that its use is "CVR prediction." In other words, the prediction model M2 indicates that it is a model that outputs information (score) indicating a predicted CVR for a keyword corresponding to an input vector. For example, the prediction model M2 outputs a value from 0 to 100 (%). For example, the prediction model M2 outputs a predicted value of the CVR for a keyword corresponding to an input vector. It indicates that the model data of the prediction model M2 is model data MDT2. It also indicates that the learning data used to train the prediction model M2 is learning data LDT2. The learning data LDT2 includes multiple training data in which the CVR value (actual value, etc.) of an advertising copy is associated with the advertising copy as correct answer information.

[0065] The model information storage unit 121 may store various information according to the purpose, not limited to the above. For example, the model information storage unit 121 may store a model predicting other advertising indicators, not limited to CVR. For example, the model information storage unit 121 may store a model M3 predicting a CTR. In this case, the model information storage unit 121 stores the model M3 predicting a CTR in association with the data used for learning the model (a combination of the CTR, which is correct information, and the advertising copy from which the actual CTR was obtained).

[0066] (Search query information storage unit 122) The search query information storage unit 122 according to the embodiment stores various pieces of information related to search queries. The search query information storage unit 122 stores information related to keywords used as search queries.

[0067] For example, the search query information storage unit 122 stores a keyword used as a search query in association with information (user ID) identifying a user who used the keyword. For example, the search query information storage unit 122 stores a keyword used as a search query in association with behavior information indicating a post-search behavior of a user who used the keyword. For example, the search query information storage unit 122 stores a keyword used as a search query in association with behavior information indicating that a user who used the keyword accessed a specific site.

[0068] The search query information storage unit 122 is not limited to the above, and may store various kinds of information depending on the purpose.

[0069] (Advertisement information storage unit 123) The advertisement information storage unit 123 according to the embodiment stores various information related to advertisements. For example, the advertisement information storage unit 123 stores various information related to search advertisements. For example, the advertisement information storage unit 123 stores various information related to categories related to advertisement submission destinations, such as campaigns and advertisement groups.

[0070] For example, the advertisement information storage unit 123 stores various information regarding classifications of advertisement submission destinations for each account (advertiser). For example, the advertisement information storage unit 123 stores various information regarding classifications of advertisement submission destinations, such as campaigns and ad groups set by each advertiser, in association with information identifying each advertiser (such as an advertiser ID). Note that advertisers may request submission work, etc., from an agency. The term "advertiser" is intended to be a concept that includes not only advertisers but also agencies.

[0071] For example, the advertisement information storage unit 123 stores, for each campaign, the budget, period, and targeting (target user attributes, etc.) set for that campaign. For each campaign, the advertisement information storage unit 123 stores the advertisement group set for that campaign. For example, the advertisement information storage unit 123 stores, for each campaign, the delivery performance of that campaign.

[0072] For example, the advertisement information storage unit 123 stores, for each advertisement group, keywords and advertisements set for that advertisement group. For example, the advertisement is a keyword specified by an advertiser. For example, the advertisement is an advertisement submitted by an advertiser. For example, the advertisement stores text used as the advertisement, or a file path name indicating the storage location of the text. Note that the advertisement may include an image, or may be data such as a moving image or audio, as long as it includes an advertisement copy.

[0073] For example, the advertisement information storage unit 123 stores, for each advertisement group, the delivery performance of that advertisement group. For example, the advertisement information storage unit 123 stores, for each advertisement group, an advertisement index based on the delivery performance of that advertisement group. For example, the advertisement information storage unit 123 stores, for each advertisement group, advertisement indexes based on the delivery performance collected for that advertisement group, or file path names indicating the storage locations thereof, etc. For example, the advertisement information storage unit 123 stores, for each advertisement group, performance values ​​of various advertisement indexes such as CTR and CVR corresponding to the advertisements of the advertisement group.

[0074] The advertisement information storage unit 123 may store various kinds of information according to the purpose, not limited to the above. For example, the advertisement information storage unit 123 may store information related to the bid price.

[0075] (Control unit 130) Returning to the explanation of Fig. 4, the control unit 130 is a controller, and is realized, for example, by a CPU (Central Processing Unit), MPU (Micro Processing Unit), etc., executing various programs (corresponding to an example of an information processing program) stored in a storage device inside the information processing device 100 using a RAM as a working area. The control unit 130 is also a controller, and is realized, for example, by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

[0076] 4, the control unit 130 has an acquisition unit 131, a learning unit 132, an extraction unit 133, a determination unit 134, and a provision unit 135, and realizes or executes the functions and actions of information processing described below. Note that the internal configuration of the control unit 130 is not limited to the configuration shown in FIG. 4, and may be other configurations as long as they perform the information processing described below.

[0077] (Acquisition part 131) The acquisition unit 131 acquires various information. The acquisition unit 131 acquires various information from external devices such as the terminal device 10, the user terminal 20, and the information providing device 50. The acquisition unit 131 also acquires various information from the storage unit 120. The acquisition unit 131 also acquires various information from the model information storage unit 121, the search query information storage unit 122, the advertisement information storage unit 123, and the like.

[0078] The acquisition unit 131 receives various information from an external information processing device via the communication unit 110. The acquisition unit 131 stores the received information in the storage unit 120. The acquisition unit 131 receives various information from the terminal device 10, the user terminal 20, or the information providing device 50. The acquisition unit 131 acquires information from the terminal device 10 used by the user. For example, the acquisition unit 131 acquires various information from the information providing device 50. For example, the acquisition unit 131 receives learning data used for learning a model from the information providing device 50. For example, the acquisition unit 131 receives a model from the information providing device 50.

[0079] The acquiring unit 131 acquires a group of search queries. The acquiring unit 131 acquires information indicating secondary keywords corresponding to each of the categories.

[0080] (Learning Section 132) The learning unit 132 executes a learning process for learning a learning model (model). Note that, when acquiring learning models such as models M1 and M2 from the information providing device 50, the information processing device 100 does not need to include the learning unit 132.

[0081] For example, the learning unit 132 executes the learning process based on various information acquired by the acquisition unit 131. The learning unit 132 executes the learning process based on information from an external information processing device and information stored in the storage unit 120. The learning unit 132 executes the learning process based on information stored in the model information storage unit 121. The learning unit 132 stores a model generated by learning in the model information storage unit 121.

[0082] The learning unit 132 performs a learning process. The learning unit 132 performs various learning. The learning unit 132 learns various pieces of information based on the information acquired by the acquisition unit 131. The learning unit 132 learns (generates) a model. The learning unit 132 learns various pieces of information such as a model. The learning unit 132 generates a model by learning. The learning unit 132 learns the model using various machine learning techniques. For example, the learning unit 132 learns parameters of the model (network). The learning unit 132 learns the model using various machine learning techniques.

[0083] The learning unit 132 generates various learning models such as the model M1. The learning unit 132 learns network parameters. For example, the learning unit 132 learns network parameters of various learning models such as the model M1. The learning unit 132 performs a learning process using learning data stored in the model information storage unit 121, thereby generating various learning models such as the model M1. For example, the learning unit 132 generates a model used for vector conversion. The learning unit 132 generates various learning models such as the model M1 by learning network parameters of various learning models such as the model M1.

[0084] The learning unit 132 performs a learning process based on the learning data (teacher data) stored in the model information storage unit 121. The learning unit 132 performs a learning process using the learning data stored in the model information storage unit 121, thereby generating various learning models such as model M1.

[0085] For example, the learning unit 132 performs a learning process by a method such as backpropagation so that a vector output by the model M1 approaches correct answer information (desired vector) associated with a character string (input information) input to the model M1. For example, the learning unit 132 performs a learning process so that a vector output by the model M1 to which input information that is a character string such as a keyword is input approaches correct answer information associated with the input information.

[0086] For example, the learning unit 132 adjusts the value of the weight (i.e., the connection coefficient) that is taken into consideration when a value is transmitted between nodes by the learning process. In this way, the learning unit 132 learns the model M1 by a process such as backpropagation that corrects the parameters (connection coefficients) so as to reduce the error between the output in the model M1 and the correct answer information corresponding to the input. For example, the learning unit 132 generates the model M1 by a process such as backpropagation that minimizes a predetermined loss function. This allows the learning unit 132 to perform a learning process that learns the parameters of the model M1.

[0087] The learning method of the model is not limited to the above-mentioned method, and any known technology can be applied. The generation of each model may be performed by appropriately using various conventional technologies related to machine learning. For example, the generation of the model may be performed by using a technology related to machine learning of supervised learning, such as SVM (Support Vector Machine). Also, for example, the generation of the model may be performed by using a technology related to machine learning of unsupervised learning. For example, the generation of the model may be performed by using a deep learning technology. For example, the generation of the model may be performed by appropriately using various deep learning technologies such as DNN (Deep Neural Network), RNN (Recurrent Neural Network), and CNN (Convolutional Neural Network). Note that the description regarding the generation of the above model is an example, and the generation of the model may be performed by a learning method appropriately selected according to the obtainable information, etc. That is, the learning unit 132 may generate the model M1 by any method as long as the model M1 can be learned so as to output a score corresponding to the correct answer information when the input information included in the learning data is input.

[0088] As described above, the method of learning by the learning unit 132 is not particularly limited, but for example, learning data in which data (input information) and its correct answer information (output information) are linked may be prepared, and the learning data may be input to a computation model based on a multi-layer neural network for learning. Also, a method based on DNN such as CNN or 3D-CNN may be used. When targeting time-series data such as voice, the learning unit 132 may use a method based on a recurrent neural network (RNN) or LSTM (Long Short-Term Memory units), which is an extension of RNN.

[0089] The learning unit 132 may also learn a prediction model M2 that is a model used to predict an advertising index. For example, the learning unit 132 may learn a prediction model M2 that is a model used to predict a CVR. For example, the learning unit 132 learns the prediction model M2 using learning data LDT2 including a plurality of teacher data in which a CVR value (such as a performance value of 0 to 100 (%)) of an advertising copy is associated with the advertising copy as correct answer information. For example, the learning unit 132 learns the prediction model M2 so that, when a vector is input, correct answer information (value) associated with a keyword corresponding to the vector is output. For example, the learning unit 132 learns a prediction model M2 that outputs a predicted CVR value (0 to 100 (%)) when a keyword corresponding to the vector is used as a search query in response to an input of the vector. Note that, when the prediction model M2 is acquired from the information providing device 50, the learning unit 132 does not need to learn the prediction model M2.

[0090] (Extraction part 133) The extraction unit 133 extracts various information. For example, the extraction unit 133 extracts various information from various information acquired from an external information processing device such as the terminal device 10, the user terminal 20, or the information providing device 50. For example, the extraction unit 133 extracts various information from various information stored in the storage unit 120. For example, the acquisition unit 131 extracts various information from various information stored in the model information storage unit 121, the search query information storage unit 122, the advertisement information storage unit 123, etc. The acquisition unit 131 extracts a query that satisfies a condition from the search query information storage unit 122.

[0091] For example, the extraction unit 133 extracts various pieces of information from the various pieces of information acquired by the acquisition unit 131. The extraction unit 133 generates various pieces of information using the extracted information. The extraction unit 133 calculates various pieces of information using the extracted information. The extraction unit 133 estimates various pieces of information using the extracted information.

[0092] The extraction unit 133 extracts, as a first keyword, a search query that satisfies a predetermined condition from a group of search queries used in a search. The extraction unit 133 extracts, as a first keyword, a search query in which a user who performed a search performed a predetermined action from the group of search queries. The extraction unit 133 extracts, as a first keyword, a search query in which a user accessed a predetermined site from the group of search queries. The extraction unit 133 determines a proposal category for the first keyword based on the first keyword and the second keyword acquired by the acquisition unit 131. The extraction unit 133 extracts the first keyword from the group of search queries acquired by the acquisition unit 131.

[0093] (Decision unit 134) The determination unit 134 executes a determination process to determine various pieces of information. The determination unit 134 stores the information determined by the determination process in the storage unit 120. For example, the determination unit 134 executes the determination process based on various pieces of information acquired by the acquisition unit 131. For example, the determination unit 134 executes the determination process based on various pieces of information extracted by the extraction unit 133. The determination unit 134 executes the determination process based on various pieces of information stored in the storage unit 120. For example, the determination unit 134 executes the determination process based on various pieces of information received from an external information processing device.

[0094] The determination unit 134 executes the determination process using the model learned by the learning unit 132. The determination unit 134 executes the determination process using the model stored in the model information storage unit 121.

[0095] The determination unit 134 determines, from the second advertising copy generated by the learning model, an advertising candidate copy that is a candidate for use in an advertisement. The determination unit 134 determines, as the advertising candidate copy, the second advertising copy whose advertising indicator satisfies a predetermined condition. The determination unit 134 determines, as the advertising candidate copy, the second advertising copy whose language-likeness condition is satisfied.

[0096] The determination unit 134 determines a proposed category, which is a category proposed as a destination of advertisement submission, for the first keyword, based on the first keyword extracted by the extraction unit 133 and the second keyword corresponding to each of the categories related to the destination of advertisement submission. The determination unit 134 determines the proposed category for the first keyword based on first vector information in which the first keyword is converted into a vector, and second vector information for each of the categories based on the vector conversion of the second keyword corresponding to each of the categories.

[0097] The determination unit 134 determines a proposed category for the first keyword based on a comparison between first vector information of the first keyword generated using a vector conversion model M1 that receives a character string as input and outputs a vector corresponding to the character string, and second vector information of each of the categories generated using the vector conversion model M1. The determination unit 134 determines a proposed category for the first keyword based on a comparison between the first vector information of the first keyword and the second vector information of each of the categories.

[0098] The determination unit 134 determines a proposed category for the first keyword based on the similarity between the first vector information of the first keyword and the second vector information of each of the categories. The determination unit 134 determines a proposed category for the first keyword based on the similarity, which is a cosine similarity, between the first vector information of the first keyword and the second vector information of each of the categories. The determination unit 134 determines, among the categories, a similar category in which the similarity of the second vector information to the first vector information of the first keyword is the largest, as the proposed category.

[0099] The determination unit 134 receives a vector as input, and determines a predicted value of an advertising index for a first keyword using a prediction model M2 that outputs a predicted value of an advertising index for a search advertisement of a keyword corresponding to the vector. The determination unit 134 determines a predicted value of an advertising index for a conversion by a search using the first keyword using the prediction model M2 that outputs a predicted value of an advertising index for a conversion. The determination unit 134 determines a predicted value of an advertising index for the number of times a search using the first keyword led to a conversion using the prediction model M2 that outputs a predicted value of an advertising index for the number of times a conversion was reached. The determination unit 134 determines a predicted value of a conversion rate by a search using the first keyword using the prediction model M2 that outputs a predicted value of a conversion rate.

[0100] The determination unit 134 determines a proposed category for the primary keyword based on the primary keyword and a secondary keyword corresponding to each of the categories, which are a campaign or an advertisement group.

[0101] The determination unit 134 executes a generation process for generating various information. For example, the determination unit 134 executes the generation process based on various information acquired by the acquisition unit 131. For example, the determination unit 134 executes the generation process based on information stored in the storage unit 120. The determination unit 134 executes the generation process based on the determined information.

[0102] The determination unit 134 generates content. For example, the determination unit 134 generates a screen (content) to be provided to the terminal device 10 by appropriately using various technologies such as Java (registered trademark). Note that the determination unit 134 may generate the screen (content) to be provided to the terminal device 10 based on the format of CSS, JavaScript (registered trademark), or HTML. Also, for example, the determination unit 134 may generate the screen (content) in various formats such as JPEG (Joint Photographic Experts Group), GIF (Graphics Interchange Format), and PNG (Portable Network Graphics). The determination unit 134 generates the evaluation receiving content.

[0103] (Provider 135) The providing unit 135 provides various information. The providing unit 135 transmits various information to an external information processing device via the communication unit 110. The providing unit 135 transmits various information to the terminal device 10, the user terminal 20, and the information providing device 50. The providing unit 135 transmits a result of the determination process to the terminal device 10.

[0104] The providing unit 135 provides the information extracted by the extracting unit 133. The providing unit 135 provides the information determined by the determining unit 134. The providing unit 135 transmits the determined advertisement candidate sentence to the terminal device 10. The providing unit 135 provides the information generated by the determining unit 134. The providing unit 135 transmits the determined advertisement to the user terminal 20.

[0105] The providing unit 135 provides the first keyword as a suggested keyword to the terminal device 10 used by the target advertiser, who is the advertiser to which information is to be provided. The providing unit 135 provides the proposed category of the first keyword determined by the determining unit 134 to the terminal device 10 together with the suggested keyword.

[0106] 3. Processing Procedure Next, the procedure of information processing executed by the information processing device 100 according to the embodiment will be described with reference to Fig. 6. Fig. 6 is a flowchart showing an example of the flow of information processing executed by the information processing device.

[0107] 6, the information processing device 100 extracts a search query that satisfies a predetermined condition as a first keyword from a group of search queries used in a search (step S101). For example, the information processing device 100 extracts a search query that a user used to access a predetermined site as a first keyword from the group of search queries.

[0108] Furthermore, the information processing device 100 determines a proposed category, which is a category proposed as a destination of advertisement submission for the first keyword, based on the first keyword and the second keyword corresponding to each category related to the destination of advertisement submission (step S102). For example, the information processing device 100 determines a campaign or an advertisement group as the proposed category of the first keyword, based on the first keyword and the second keyword.

[0109] [4. Effects] As described above, the information processing device 100 according to the embodiment includes the extraction unit 133 and the determination unit 134. The extraction unit 133 extracts a search query that satisfies a predetermined condition from a group of search queries used in a search as a first keyword. The determination unit 134 determines a proposed category that is a category proposed as a submission destination for the first keyword, based on the first keyword extracted by the extraction unit 133 and second keywords corresponding to each category related to the submission destination of the advertisement.

[0110] In this way, the information processing device 100 according to the embodiment can make appropriate suggestions by extracting first keywords from a group of search queries and determining the suggested category of the first keywords based on the extracted first keywords and second keywords corresponding to each of the categories related to the advertisement submission destinations.

[0111] In addition, in the information processing device 100 according to the embodiment, the determination unit 134 determines a proposed category for the first keyword based on first vector information in which the first keyword is converted into a vector and second vector information for each of the categories based on the vector conversion of the second keyword corresponding to each of the categories.

[0112] In this way, the information processing device 100 of the embodiment can enable appropriate suggestions by determining the suggested category of the first keyword based on the first vector information of the first keyword and the second vector information of each of the categories.

[0113] In addition, in the information processing device 100 according to the embodiment, the determination unit 134 determines a proposed category for the first keyword based on a comparison between first vector information of the first keyword generated using a vector conversion model M1 that takes a character string as input and outputs a vector corresponding to the character string, and second vector information of each of the categories generated using the vector conversion model M1.

[0114] In this way, the information processing device 100 according to the embodiment can enable appropriate suggestions by determining the proposal category of the first keyword based on the first vector information and the second vector information generated using the vector conversion model M1, which takes a string as input and outputs a vector corresponding to the string.

[0115] Moreover, in the information processing device 100 according to the embodiment, the determination unit 134 determines a proposed category for the primary keyword based on a comparison between the first vector information of the primary keyword and the second vector information of each of the categories.

[0116] In this way, the information processing device 100 of the embodiment can enable appropriate suggestions by determining the suggested category of the first keyword based on a comparison between the first vector information of the first keyword and the second vector information of each of the categories.

[0117] Moreover, in the information processing device 100 according to the embodiment, the determination unit 134 determines a proposed category for the primary keyword based on the similarity between the first vector information of the primary keyword and the second vector information of each of the categories.

[0118] In this way, the information processing device 100 of the embodiment can enable appropriate suggestions by determining the suggested category of the first keyword based on the similarity between the first vector information of the first keyword and the second vector information of each of the categories.

[0119] In addition, in the information processing device 100 according to the embodiment, the determination unit 134 determines a proposed category for the primary keyword based on the similarity, which is the cosine similarity between the first vector information of the primary keyword and the second vector information of each of the categories.

[0120] In this way, the information processing device 100 according to the embodiment can enable appropriate suggestions by determining the suggested category of the first keyword based on the similarity, which is the cosine similarity between the first vector information of the first keyword and the second vector information of each of the categories.

[0121] Furthermore, in the information processing device 100 according to the embodiment, the determination unit 134 determines, from among the categories, a similar category in which the similarity of the second vector information to the first vector information of the first keyword is the highest, as a proposed category.

[0122] In this way, the information processing device 100 of the embodiment can enable appropriate suggestions by determining as the suggested category a similar category among the categories in which the similarity of the second vector information to the first vector information of the first keyword is greatest.

[0123] In addition, in the information processing device 100 according to the embodiment, the determination unit 134 determines a predicted value of an advertising index for a first keyword using a prediction model M2 that receives a vector as input and outputs a predicted value of an advertising index related to a search advertisement for a keyword corresponding to the vector.

[0124] In this manner, the information processing device 100 according to the embodiment can appropriately predict the predicted value of the advertising index of the first keyword by determining the predicted value of the advertising index of the first keyword using the prediction model M2.

[0125] Moreover, in the information processing device 100 according to the embodiment, the determination unit 134 determines a predicted value of an advertisement index related to a conversion from a search using the first keyword, using the prediction model M2 that outputs a predicted value of an advertisement index related to a conversion.

[0126] In this manner, the information processing device 100 according to the embodiment can appropriately predict the predicted value of the advertising index for the first keyword by determining the predicted value of the advertising index for the conversion of the first keyword using the prediction model M2.

[0127] In addition, in the information processing device 100 according to the embodiment, the determination unit 134 determines a predicted value of an advertising index related to the number of times a search using the first keyword leads to a conversion, using a prediction model M2 that outputs a predicted value of an advertising index related to the number of times a search using the first keyword leads to a conversion.

[0128] In this way, the information processing device 100 according to the embodiment can appropriately predict the predicted value of the advertising index for the first keyword by using the prediction model M2 to determine the predicted value of the advertising index related to the number of times the first keyword leads to conversion.

[0129] Moreover, in the information processing device 100 according to the embodiment, the determination unit 134 determines a predicted value of a conversion rate for a search using the primary keyword, using the prediction model M2 that outputs a predicted value of a conversion rate.

[0130] In this way, the information processing device 100 according to the embodiment can appropriately predict the conversion rate of the primary keyword by determining the predicted value of the conversion rate of the primary keyword using the prediction model M2.

[0131] Moreover, in the information processing device 100 according to the embodiment, the extraction unit 133 extracts, from the search query group, a search query in which the user who performed the search performed a predetermined action, as a primary keyword.

[0132] In this way, the information processing device 100 according to the embodiment can make appropriate suggestions by extracting, from a group of search queries, a search query in which a user who performed a search performed a predetermined action as a first keyword.

[0133] Moreover, in the information processing device 100 according to the embodiment, the extraction unit 133 extracts, from among the search queries, a search query that has caused the user to access a predetermined site as a primary keyword.

[0134] In this manner, the information processing apparatus 100 according to the embodiment can make appropriate suggestions by extracting, from among a group of search queries, a search query with which a user accessed a predetermined site as a primary keyword.

[0135] Moreover, in the information processing device 100 according to the embodiment, the determination unit 134 determines a proposed category for the primary keyword based on the primary keyword and a secondary keyword corresponding to each of the categories, which are a campaign or an advertisement group.

[0136] In this manner, the information processing apparatus 100 according to the embodiment can make an appropriate proposal by determining the primary keyword and the proposal category, which is a campaign or an advertisement group.

[0137] Moreover, the information processing device 100 according to the embodiment includes a providing unit 135. The providing unit 135 provides the first keyword as a suggested keyword to the terminal device 10 used by a target advertiser who is an advertiser to which information is to be provided.

[0138] In this way, the information processing device 100 of the embodiment can provide the first keyword as a suggested keyword to the terminal device 10 used by the target advertiser, who is the advertiser to whom the information is to be provided, thereby providing the advertiser with an appropriately determined proposed category and making an appropriate proposal.

[0139] Furthermore, in the information processing device 100 according to the embodiment, the providing unit 135 provides the proposed category of the primary keyword determined by the determining unit 134 to the terminal device 10 together with the proposed keyword.

[0140] In this way, the information processing device 100 of the embodiment can provide the proposed category of the first keyword together with the proposed keyword to the terminal device 10, thereby providing the advertiser with an appropriately determined proposed category together with the first keyword, and making an appropriate proposal.

[0141] Moreover, the information processing device 100 according to the embodiment includes an acquisition unit 131. The acquisition unit 131 acquires a group of search queries. The extraction unit 133 extracts a primary keyword from the group of search queries acquired by the acquisition unit 131.

[0142] In this way, the information processing device 100 according to the embodiment extracts first keywords from the acquired group of search queries, and determines the proposed category of the first keywords based on the extracted first keywords and second keywords corresponding to each of the categories related to the advertisement submission destinations, thereby enabling appropriate suggestions.

[0143] In the information processing device 100 according to the embodiment, the acquisition unit 131 acquires information indicating secondary keywords corresponding to each of the categories. The extraction unit 133 determines a proposed category for the primary keyword based on the primary keyword and the secondary keyword acquired by the acquisition unit 131.

[0144] In this manner, the information processing device 100 according to the embodiment can make appropriate suggestions by determining the proposal category of the primary keywords based on the primary keywords and the acquired secondary keywords.

[0145] [5. Hardware Configuration] The information processing device 100 according to the embodiment described above is realized by a computer 1000 having a configuration as shown in Fig. 7. Fig. 7 is a hardware configuration diagram showing an example of a computer that realizes the functions of the information processing device. The computer 1000 has a CPU 1100, a RAM 1200, a ROM 1300, a HDD (Hard Disk Drive) 1400, a communication interface (I / F) 1500, an input / output interface (I / F) 1600, and a media interface (I / F) 1700.

[0146] The CPU 1100 operates and controls each unit based on a program stored in the ROM 1300 or the HDD 1400. The ROM 1300 stores a boot program executed by the CPU 1100 when the computer 1000 is started up, programs that depend on the hardware of the computer 1000, and the like.

[0147] The HDD 1400 stores programs executed by the CPU 1100, data used by such programs, etc. The communication interface 1500 receives data from other devices via the network N and sends the data to the CPU 1100, and transmits data generated by the CPU 1100 to other devices via the network N.

[0148] The CPU 1100 controls output devices such as a display and a printer, and input devices such as a keyboard and a mouse, via the input / output interface 1600. The CPU 1100 acquires data from the input devices via the input / output interface 1600. The CPU 1100 also outputs generated data to the output devices via the input / output interface 1600.

[0149] The media interface 1700 reads a program or data stored in the recording medium 1800 and provides it to the CPU 1100 via the RAM 1200. The CPU 1100 loads the program from the recording medium 1800 onto the RAM 1200 via the media interface 1700 and executes the loaded program. The recording medium 1800 is, for example, an optical recording medium such as a DVD (Digital Versatile Disc) or a PD (Phase change rewritable Disc), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory.

[0150] For example, when the computer 1000 functions as the information processing device 100 according to the embodiment, the CPU 1100 of the computer 1000 executes programs loaded onto the RAM 1200 to realize the functions of the control unit 130. The CPU 1100 of the computer 1000 reads and executes these programs from the recording medium 1800, but as another example, the CPU 1100 may obtain these programs from another device via the network N.

[0151] Although some of the embodiments and variants of the present application have been described in detail above with reference to the drawings, these are merely examples, and the present invention can be implemented in other forms that incorporate various modifications and improvements based on the knowledge of those skilled in the art, including the aspects described in the lines of the disclosure of the invention.

[0152] [6. Other] Furthermore, among the processes described in the above embodiments and modifications, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically by a known method. In addition, the information including the processing procedures, specific names, various data and parameters shown in the above documents and drawings can be changed arbitrarily unless otherwise specified. For example, the various information shown in each drawing is not limited to the illustrated information.

[0153] In addition, each component of each device shown in the figure is a functional concept, and does not necessarily have to be physically configured as shown in the figure. In other words, the specific form of distribution and integration of each device is not limited to that shown in the figure, and all or part of them can be functionally or physically distributed and integrated in any unit according to various loads, usage conditions, etc.

[0154] Furthermore, the above-described embodiments and modifications can be appropriately combined as long as the processing contents are not contradictory.

[0155] Furthermore, the above-mentioned "section, module, unit" can be read as "means" or "circuit", etc. For example, an acquisition section can be read as an acquisition means or an acquisition circuit. [Explanation of symbols]

[0156] 1. Information Processing Systems 100 Information processing device 121 Model information storage unit 122 Search query information storage unit 123 Advertising information storage unit 130 Control section 131 Acquisition Department 132 Learning Department 133 Extraction part 134 Decision Section 135 Provision Department 10 Terminal Equipment 20 User terminal 50 Information provision device N Network

Claims

1. an extraction unit that extracts, from a group of search queries used in a search, a search query that satisfies a predetermined condition as a first keyword; a determination unit that determines a proposed category, which is a category to be proposed as a destination of advertisement submission, based on the first keyword extracted by the extraction unit and second keywords corresponding to each category related to the destination of advertisement submission; An information processing device comprising:

2. The determination unit is determining the proposed categories of the first keywords based on first vector information in which the first keywords are converted into vectors and second vector information for each of the categories based on the vector conversion of the second keywords corresponding to each of the categories; 2. The information processing apparatus according to claim 1,

3. The determination unit is determining the proposed category of the first keyword based on a comparison between the first vector information of the first keyword generated using a vector conversion model that receives a character string as an input and outputs a vector corresponding to the character string, and the second vector information of each of the categories generated using the vector conversion model; 3. The information processing apparatus according to claim 2.

4. The determination unit is determining the suggested categories for the first keyword based on a comparison of the first vector information for the first keyword and the second vector information for each of the categories; 3. The information processing apparatus according to claim 2.

5. The determination unit is determining the suggested categories for the first keyword based on a similarity between the first vector information for the first keyword and the second vector information for each of the categories; 3. The information processing apparatus according to claim 2.

6. The determination unit is determining the suggested categories for the first keyword based on the similarity, which is a cosine similarity between the first vector information of the first keyword and the second vector information of each of the categories; 6. The information processing apparatus according to claim 5,

7. The determination unit is Among the categories, a similar category in which the similarity of the second vector information to the first vector information of the first keyword is the largest is determined as the proposed category.

5. The information processing apparatus according to claim 4.

8. The determination unit is A prediction model is used to input a vector and output a prediction value of an advertising index related to a search advertisement of a keyword corresponding to the vector, and a prediction value of the advertising index of the first keyword is determined.

3. The information processing apparatus according to claim 2.

9. The determination unit is determining a predicted value of the advertising metric related to the conversion from a search using the first keyword using a prediction model that outputs a predicted value of the advertising metric related to the conversion; 9. The information processing apparatus according to claim 8,

10. The determination unit is Using a prediction model that outputs a predicted value of the advertising index related to the number of times the conversion has been reached, a predicted value of the advertising index related to the number of times the conversion has been reached through a search using the first keyword is determined.

10. The information processing apparatus according to claim 9,

11. The determination unit is Using a prediction model that outputs a predicted value of a conversion rate, a predicted value of a conversion rate for a search using the first keyword is determined.

11. The information processing apparatus according to claim 10,

12. The extraction unit is A search query in which a user who performed a search performed a predetermined action is extracted as the first keyword from the group of search queries.

2. The information processing apparatus according to claim 1,

13. The extraction unit is A search query with which the user accessed a predetermined site is extracted as the first keyword from the group of search queries.

13. The information processing apparatus according to claim 12.

14. The determination unit is determining the suggested categories of the first keywords based on the first keywords and the second keywords corresponding to each of the categories being a campaign or an ad group; 2. The information processing apparatus according to claim 1,

15. a providing unit that provides the first keyword as a suggested keyword to a terminal device used by a target advertiser who is an advertiser to which information is to be provided; The information processing apparatus according to claim 1 , further comprising:

16. The providing unit is The proposed category of the first keyword determined by the determination unit is provided to the terminal device together with the proposed keyword.

16. The information processing apparatus according to claim 15,

17. an acquisition unit that acquires the group of search queries; Further equipped with The extraction unit is The first keyword is extracted from the group of search queries acquired by the acquisition unit.

2. The information processing apparatus according to claim 1,

18. The acquisition unit is acquiring information indicating the second keywords corresponding to each of the categories; The determination unit is determining the proposed category of the first keyword based on the first keyword and the second keyword acquired by the acquisition unit; 18. The information processing apparatus according to claim 17,

19. 1. A computer-implemented information processing method, comprising: an extraction step of extracting search queries that satisfy a predetermined condition as first keywords from a group of search queries used in the search; a determination step of determining a proposed category, which is a category to be proposed as a destination of advertisement submission for the first keyword, based on the first keyword extracted by the extraction step and second keywords corresponding to each category related to the destination of advertisement submission; 13. An information processing method comprising:

20. an extraction step of extracting a search query that satisfies a predetermined condition as a first keyword from a group of search queries used in the search; a determination step of determining a proposed category, which is a category to be proposed as a destination of advertisement submission, based on the first keyword extracted by the extraction step and second keywords corresponding to each category related to the destination of advertisement submission; An information processing program characterized by causing a computer to execute the above.

Images