Webpage search result sorting adjustment method and system based on machine learning

Abstract

The invention relates to a webpage search result sorting adjustment method and system based on machine learning. The method comprises the following steps: constructing a data set corresponding to a webpage; updating a data set of the webpage based on the historical operation information; acquiring current search information of a user; obtaining the semantic similarity between the current search information of the user and the webpage data set information, and adjusting the webpage sequence based on the semantic similarity to obtain a first sequence; adjusting the first sequence based on a user model and a public model to obtain a second sequence; and based on the semantic similarity between the historical search information of the user and the current search information, adjusting the second sequence to obtain a third sequence. According to the method, the historical operation condition of the user on the webpage is fully considered, the operation condition of the user is matched with the search information, the webpage data set information is updated based on the search information, and the participation of the user behavior in the search result is fully reflected.

Description

Technical Field

[0001] The present invention relates to the technical field of web page search, and in particular to a method and system for adjusting the ranking of web page search results based on machine learning. Background Art

[0002] Various search engines have important value in network applications. Users can obtain the information they need based on the search functions provided by the engines.

[0003] Faced with massive network resources, different servers provide different search methods to provide users with accurate information; the server extracts the required information from the user's search information, and then based on their own different strategies, algorithms, etc., screens out resources corresponding to the search information from the massive network resources.

[0004] However, the screening methods and web page sorting methods provided by current servers are mostly fixed, and the sorting results provided for the same search information are also unchanged; the search strategy cannot be adaptively adjusted based on changes in user search habits.

[0005] In addition, for the same information needs, different users have different search strategies, and the search capabilities of users vary greatly. The server cannot balance the differences in users' search capabilities and strategies, and cannot intelligently expand and match search strategies and results for users. Summary of the invention

[0006] In order to solve the shortcomings of the existing technology, the present invention provides a method for adjusting the ranking of web page search results based on machine learning, comprising the following steps: S1: Construct the data set corresponding to the web page, which stores: Category labels of web pages; At least one keyword set and the total number of clicks, total browsing time, and matching weight with the web page for each keyword set; The quantity identifier of each keyword in the set of all keywords; S2: based on the historical operation information, update the total number of clicks, total browsing time, matching weight with the web page, and the number of keywords in each keyword set; S3: Get the user's current search information; S4: obtaining semantic similarity between the user's current search information and the webpage dataset information, and adjusting the webpage ranking based on the semantic similarity to obtain a first ranking; S5: adjusting the first ranking based on the user model and the public model to obtain a second ranking; S6: Based on the semantic similarity between the user's historical search information and the current search information, adjust the second ranking to obtain a third ranking.

[0007] Wherein, in said S1, when constructing the data set, at least one keyword set is initialized based on the content information of the web page, and a number of keywords, a total number of clicks, a total browsing time and a matching weight are initialized for each keyword set, and the initial total number of clicks, the initial total browsing time and the initial matching weight of each keyword set are 0, 0 and 0 respectively; The matching degree between all the keywords in each keyword set is greater than a first predetermined value; A quantity identifier is initialized for each keyword in the keyword set, and the initial value of the quantity identifier is 0.

[0008] Wherein, updating the matching weight, total click count, total browsing time of each keyword set, and the quantity identifier of each keyword in each keyword set based on the historical operation information includes the following steps: S21: Acquire search information corresponding to a search operation that performs a click operation on a webpage and stays on the webpage for a time exceeding a first predetermined time length; S22: extracting all keywords from the search information as keywords to be matched; Perform the following operations for each keyword to be matched: S23: traverse all keyword sets of the web page, and for each keyword set, obtain a keyword as an existing keyword; S24: Obtain the matching degree between the keyword to be matched and the existing keyword, and determine whether there is an existing keyword that reaches a first predetermined value: If so, determine whether there is a keyword that is consistent with the keyword to be matched in the keyword set where the existing keyword that has reached the first predetermined value is located: if there is a consistency, update the quantity identifier of the keyword that is consistent with the keyword to be matched, and increase its value by 1; if there is no consistency, add the keyword to be matched to the keyword set where the existing keyword that has reached the first predetermined value is located, and initialize its quantity identifier to 1; at the same time, update the total number of clicks, total browsing time and matching weight of the keyword set where the existing keyword is located; If it does not exist, a new keyword set is created and the keywords to be matched are added to the new keyword set, the quantity flag is initialized to 1, and a matching weight, total clicks, and total browsing time are initialized for the new keyword set, and the matching weight is updated.

[0009] The matching weight of the keyword set in which the existing keyword is located is updated through the following steps: Q=Q inital +(x 1 +Time / n) / x 2 + (y 1 +n) / y 2 ; Among them, Q is the matching weight, Q inital To initialize the matching weight, x 1 、x 2 ,y 1 and 2 is the adjustment factor, T ime is the total browsing time, n is the total number of clicks; When there is an existing keyword that reaches the first predetermined value, the total number of clicks of the keyword set to which the existing keyword belongs is increased by 1, and the total browsing time is added to the dwell time obtained in S21.

[0010] When all keyword sets of the web page are traversed, for each keyword set, the keyword with the largest quantity identifier is obtained as the existing keyword; If there are multiple keywords with the maximum number of identifiers in a keyword set, one is randomly selected as the existing keyword.

[0011] The matching degree between the keywords to be matched and the existing keywords is obtained by performing sequence conversion on the keywords to be matched and the existing keywords based on the BOW model to obtain the first vector and the second vector respectively, and calculating the inner product of the first vector and the second vector, and the inner product value is the matching degree.

[0012] The semantic similarity between the user's current search information and the webpage dataset information is obtained through the following steps, and the webpage search ranking is adjusted based on the semantic similarity to obtain the first ranking: S41: extracting keywords from current search information; S42: Obtain the mean of the sum of the word vectors of all keywords in S41 as the first word vector; S43: Obtain one keyword from each of the keyword sets of the web page; S44: The second word vector is obtained by the following formula: ; Among them, C is the second word vector, m is the total number of keywords extracted in S43, is the word vector of the keyword extracted in S43; For word vector The weight value is the matching weight corresponding to the keyword set to which the keyword belongs.

[0013] In S43, a keyword with the largest number of identifiers is obtained from all keyword sets on the web page. If a keyword set contains multiple keywords with the largest number of identifiers, one is randomly selected.

[0014] The present invention further provides a web page search result ranking adjustment system based on machine learning, comprising: The client is used to receive the user's search information; A server, connected to the client, for adjusting the ranking of web page search results based on the user's search information; The server stores a data set for each web page. The data set for each web page stores: Category labels of web pages; At least one keyword set and the total number of clicks, total browsing time, and matching weight with the web page for each keyword set; The quantity identifier of each keyword in the set of all keywords; The server updates the total number of clicks, total browsing time, matching weight with web pages, and quantity identifiers of each keyword in each keyword set based on the historical operation information; When the server adjusts the ranking of web page search results, it obtains the semantic similarity between the user's current search information and the web page data set information, and adjusts the web page ranking based on the semantic similarity to obtain a first ranking.

[0015] When the server adjusts the ranking of web page search results, it also includes: Adjust the first ranking based on the user model and the public model to obtain a second ranking; Based on the semantic similarity between the user's historical search information and the current search information, the second ranking is adjusted to obtain a third ranking.

[0016] When sorting web pages, the present invention fully considers the user's historical operations on the web pages, matches the user's operations with the search information, and updates the web page data set information based on the search information, continuously completes keywords and related matching weights, and assigns different quantity identifiers to different keywords, and assigns different matching weights to different keyword sets; the sorting results of web pages are no longer determined by the server or developer in a single dimension; but are constantly improved based on the user's operation behavior over time, and can automatically improve the keywords lacking in the data set; the more search behaviors the user has, the more targeted the ranking given is, which fully reflects the participation of user behavior in the search results. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 : A flow chart of updating a web page data set in the web page search result ranking adjustment method based on machine learning of the present invention.

[0018] Figure 2 : System architecture diagram of the web page search result ranking adjustment system based on machine learning of the present invention. DETAILED DESCRIPTION

[0019] In order to have a further understanding of the technical solution and beneficial effects of the present invention, the technical solution and beneficial effects produced by the present invention are described in detail below with reference to the accompanying drawings.

[0020] 1. Construction of Web Page Dataset For each web page that needs to be indexed, the present invention constructs a data set for it, and the data set stores: 1. The classification label of the web page. This classification label is pre-set and represents the category of the content provided by the web page, such as computer, architecture, chemistry, life encyclopedia, food, etc.

[0021] 2. At least one keyword set and the total number of clicks, total browsing time and matching weight with the web page for each keyword set.

[0022] For a web page, there should be more than one set of keywords that can characterize the attributes of the web page. When constructing a data set, the present invention initializes at least one keyword set for each web page based on the content information of the web page and initializes several keywords, a total number of clicks, a total browsing time and a matching weight for each keyword set.

[0023] Each keyword set represents the properties of the web page from different perspectives; and the multiple keywords in each keyword set are synonymous with each other. The total number of clicks, total browsing time, and matching weight corresponding to the keyword set represent the reliability and satisfaction of users finding the web page based on the keywords in the keyword set from different perspectives, and also represent the degree of fit between the keywords in the keyword set and the web page from different perspectives; the initial total number of clicks for each keyword set is 0, the initial total browsing time is 0, and the initial matching weight is the same. The specific value of the initial matching weight can be adaptively set based on actual needs.

[0024] As described above, the multiple keywords in each keyword set are synonymous with each other, so the matching degree between all the keywords in each keyword set is greater than a first predetermined value.

[0025] The method for determining the matching degree between keywords is: represent the two keywords as the first keyword and the second keyword respectively, perform sequence conversion on the first keyword and the second keyword based on the BOW model, obtain the first vector of the first keyword and the second vector of the second keyword respectively, calculate the inner product of the first vector and the second vector, and the inner product value is the matching degree.

[0026] The first predetermined value may be set in advance based on needs, or may be determined by calculating the matching degree of each pair of keywords in an existing keyword set and performing a certain linear summation on the calculated multiple matching degrees.

[0027] For example, suppose the name of a webpage is "Method for Extracting Pigments from Carrots", and the content of the webpage mainly introduces how to obtain pigments through solvent extraction. Then the classification label of the webpage can be "Chemistry". When the webpage is initialized, the following keyword set can be constructed for it: The first keyword set includes the following keywords: carrot, red cabbage, small ginseng; The second keyword set includes the following keywords: pigment, carotene; The third keyword set includes the following keywords: extraction and extraction.

[0028] 3. The number of each keyword in the keyword set The quantity indicator of a keyword is usually used to represent the user's tendency to type the keyword when searching for related web pages. The larger the value of the quantity indicator is, the more inclined the user is to search using the keyword when searching for the same type of web pages.

[0029] The present invention initializes a quantity identifier for each keyword in the keyword set, and the initial value of the quantity identifier is 0.

[0030] 2. Update of Web Dataset Please combine Figure 1 , is a flow chart for updating a web page data set of the present invention. The present invention updates the total number of clicks, total browsing time, matching weight of each keyword set, and the quantity identifier of each keyword in each keyword set based on historical operation information.

[0031] Historical operation information can be understood as after the data set of the web page is built, as the user continues to search and browse, different web pages are clicked under different search strategies of the user; therefore, the present invention updates the data set of the web page based on the search information typed by the user and the user's operations on the web page under the relevant search information, so as to continuously improve and optimize the search information that the data set can provide to the user, and continuously increase the pertinence and accuracy of subsequent searches.

[0032] The present invention can periodically obtain historical operation information of users, and update the web page data set according to the obtained historical operation information.

[0033] The specific update steps are as follows: 1. Acquire search information corresponding to a search operation in which a click operation is performed on a web page and the stay time on the web page exceeds a first predetermined time length.

[0034] When a user clicks on a web page and stays on the web page for more than a certain period of time, it means that the web page provides the information the user needs. Then it can be considered that there is a high degree of match between the search information of the user when performing the search operation and the content provided by the web page; therefore, in this case, the search information corresponding to the user's search operation is obtained.

[0035] Assume that the user types "how to extract carotenoids" in the search box, clicks on the webpage "Methods for extracting pigments from carrots" in the search results, and browses for a certain period of time. Then, the data set of the webpage "Methods for extracting pigments from carrots" needs to be updated based on "how to extract carotenoids".

[0036] For each search information, perform the following operations.

[0037] 2. Extract all keywords from the search information as keywords to be matched.

[0038] The search information is the search information typed by the user when searching for a web page. It can be sentence information or keywords. When it is sentence information, keywords need to be extracted through a pre-trained keyword extraction model, or keywords can be extracted from the sentence information through a word segmentation tool.

[0039] Assume that the user types "how to extract carotenoids" in the search box, then the keywords "carotenoids" and "extraction" are extracted through the keyword extraction model or word segmentation tool.

[0040] 3. Perform the following operations for each keyword to be matched (corresponding to Figure 1 The logical content of the keywords to be matched is traversed in (1) Traverse all keyword sets of the web page, and for each keyword set, obtain a keyword from it as the existing keyword; As described above, each keyword in each keyword set has a quantity identifier, which represents the number of times the user used the keyword when searching for the web page, and represents the user's inclination or selection habit for the keyword when searching the web page. Using the keyword with the most search times for subsequent matching operations can also improve the matching efficiency; therefore, when determining existing keywords from the keyword set, the present invention obtains the keyword with the largest quantity identifier as the existing keyword; if there is more than one keyword with the largest quantity identifier in a keyword set, one is randomly selected as the existing keyword.

[0041] (2) Obtaining the matching degree between the keyword to be matched and the existing keyword, and determining whether there is an existing keyword that reaches a first predetermined value; The method for determining the matching degree between keywords is the same as above: the two keywords are represented as the first keyword and the second keyword respectively, and the first keyword and the second keyword are sequence converted based on the BOW model to obtain the first vector of the first keyword and the second vector of the second keyword respectively, and the inner product of the first vector and the second vector is calculated. The inner product value is the matching degree.

[0042] (3) Choose different update strategies based on different situations The first case: there are existing keywords that reach the first predetermined value; At this time, it is further determined whether there is a keyword that is consistent with the keyword to be matched in the keyword set where the existing keywords that have reached the first predetermined value are located: If there is a match, update the quantity flag of the keyword that is consistent with the keyword to be matched, and increase its value by 1; If there is no match, the keyword to be matched is added to the keyword set where the existing keywords that have reached the first predetermined value are located, and the quantity flag thereof is initialized to 1; Finally, the total number of clicks, total browsing time and matching weight of the keyword set where the existing keywords are located are updated; The second situation: there are no existing keywords that reach the first predetermined value; at this time, a new keyword set is created, and the keywords to be matched are added to the newly created keyword set, and its quantity identifier is initialized to 1. A matching weight, total number of clicks, and total browsing time are initialized for the newly created keyword set, and the matching weight is updated.

[0043] For the first case, as described above, the user finds the webpage "Methods for extracting pigments from carrots" through "How to extract carotenoids". At this time, the keyword "carotenoids" is used as a to-be-matched keyword, and is matched one by one with the existing keywords selected from the first keyword set, the second keyword set, and the third keyword set. Assume that the keywords selected from the first keyword set, the second keyword set, and the third keyword set are "carrot", "carotene", and "extraction" respectively; after the matching degree calculation, it is determined that the matching degree between "carotene" and "carotenoids" is greater than the first predetermined value, then it can be determined that "carotene" and "carotenoids" are synonyms in the content category provided by the webpage; At this time, determine whether the keyword "carotenoids" exists in the second keyword set where "carotene" is located: since the keyword "carotenoids" does not exist in the second keyword set at this time, "carotenoids" is added to the second keyword set, and a quantity identifier of 1 is initialized for it; (at this time, the keyword "carotenoids" exists in the second keyword set. When another user finds this webpage based on the keyword "carotenoids" and previews it for a certain period of time, the quantity identifier of "carotenoids" is increased by 1 based on the above update step, and is counted as 2).

[0044] Finally, the total number of clicks, total browsing time and matching weight of the second keyword set are updated.

[0045] In addition, for the keyword "extraction" to be matched, the quantity identifier of the keyword "extraction" in the third keyword set is updated through the same update operation as above, and the total number of clicks, total browsing time and matching weight of the third keyword set are updated.

[0046] It is not difficult to understand that the updated total number of clicks is the original total number of clicks plus 1; the updated total browsing time is the original total browsing time plus the browsing time after the user opens the webpage in this round of update operation.

[0047] The matching weights of the second keyword set and the third keyword set are updated using the following formula: Q=Q inital +(x 1 +T ime / n) / x 2 + (y 1 +n) / y 2 ; Among them, Q is the matching weight, Q inital To initialize the matching weight, x 1 、x 2 ,y 1 and 2 is the adjustment factor, T ime is the total browsing time, and n is the total number of clicks.

[0048] “T ime " / n" can represent the average browsing time of the web page in the user's historical operations, and "T ime / n" and "n" represent the user's satisfaction with the webpage and the matching degree of the webpage to the user's search information from different dimensions. ime / n" and "n" are used to update the matching weights, which makes the representation degree of web page information by different keyword sets more concrete; for the same web page, the higher the matching weight corresponding to the keyword set, the more users are inclined to search for the web page through the keywords in it.

[0049] In the above formula, by adjusting the factor x 1 、x 2 ,y 1 and 2 The introduction of provides a buffer for the impact of the average browsing time and total number of clicks on the matching weight, avoiding large fluctuations in the matching weight due to changes in the average browsing time and total number of clicks, and enhancing the stability of the search method.

[0050] For the second case, for example, suppose the method described in the webpage "Method for Extracting Pigments from Carrots" is pectinase cell wall breaking, and a user finds the webpage based on the keyword "cell wall". Obviously, the keywords in all the keyword sets of the webpage currently do not match "cell wall"; at this time, it can be determined that the existing keyword set in the current webpage data set cannot fully represent the content information of the webpage; at this time, a new keyword set is created, "cell wall" is added to the new keyword set, its quantity identifier is initialized to 1, and a matching weight Q is initialized for the new keyword set. inital , the total number of clicks 1 and the total browsing time (i.e. the browsing time of the user on the web page in this round of update operation), and update the matching weight. The updating method of the matching weight is the same as that described in the first case, and will not be repeated here.

[0051] That is, when sorting web pages, the present invention fully considers the user's historical operations on the web pages, matches the user's historical operations with the search information, and updates the web page data set information based on the search information, continuously improves the keywords and related matching weights, and assigns different quantity identifiers to different keywords, and assigns different matching weights to different keyword sets; the sorting results of web pages are no longer determined by the server or developer in a single dimension; but are constantly improved based on the user's operating behavior over time, and can automatically improve the keywords missing in the data set; the more search behaviors the user has, the more targeted the ranking given, which fully reflects the participation of user behavior in the search results.

[0052] 3. Get the user's current search information The user searches for web pages based on the search information, which is consistent with the historical search information. The current search information may also be sentence information or keywords.

[0053] 4. Get the first ranking The present invention obtains a first ranking based on the semantic similarity between the user's current search information and the webpage data set information, and specifically includes the following steps: 1. Extract keywords from current search information; 2. Get the mean of the sum of the keyword’s word vectors as the first word vector; 3. Obtain one keyword from each of the keyword sets of the web page; specifically, obtain one keyword with the largest number identifier from each of the keyword sets of the web page. If a keyword set has multiple keywords with the largest number identifiers, select one keyword at random. The specific reason has been detailed above. The keyword with the largest number identifier can best represent the user's search habits during search. 4. Get the second word vector using the following formula: ; Among them, C is the second word vector, m is the total number of keywords extracted in step 3, is the word vector of the keyword extracted in step 3; For word vector The weight value is the matching weight corresponding to the keyword set to which the keyword belongs; 5. Obtain the absolute value of the cosine value of the first word vector and the second word vector as the semantic similarity between the user's current search information and the web page dataset information; 6. Adjust the ranking of web pages based on the order of semantic similarity from high to low to obtain the first ranking.

[0054] That is, when calculating semantic similarity, with respect to web pages, the present invention assigns the matching weight corresponding to the keyword set to which the keyword belongs to the weight value of the keyword word vector, performs weighted summation on the keyword word vectors and obtains an average value. In this way, when solving the second word vector of the web page, different keywords have different importance in the final second word vector. In this way, when solving the word vector of the web page, the degree of fit between different keywords and the web page is taken into account, so that the second word vector finally obtained can better represent the content information that the web page can provide.

[0055] 5. Get the second ranking The present invention adjusts the first ranking based on the user model and the public model to obtain the second ranking.

[0056] The user model is constructed based on the data of the user's historical operation web pages and is expressed as (α 1 , α 2 ...α p ); where p is the total number of classification labels, α 1 , α 2 ...α pThey respectively represent the ratio of the total browsing time of users on web pages with category labels 1, 2, ..., p to the total browsing time of users browsing web pages of all categories.

[0057] The mass model is constructed based on the probability of each keyword belonging to each category. For each keyword, the probability of it belonging to each category can be estimated based on the Bayesian classification method (for example, the keyword "apple" may belong to the "digital" category or the "fruit" category). Therefore, the mass model of each keyword can be obtained, which is expressed as (β 1 , β 2 ...β p ), where p is the total number of classification labels, β 1 , β 2 ...β p They respectively represent the probability that the corresponding keyword belongs to category 1, 2, ..., p.

[0058] Based on the user model and the public model, the first ranking is adjusted to obtain the second ranking as follows.

[0059] 1. Extract all keywords from the user’s current search information.

[0060] 2. Build a mass model for each keyword:

[0061] Among them, q is the number of keywords extracted from the user's current search information.

[0062] 3. Obtain the web page classification model through the following formula: ; In the above formula, i refers to a specific keyword; x is the adjustment factor; The meaning of this formula is to integrate the probability of the user's inclination towards each category into a user vector (a probability set that represents the user's interest in each category). At the same time, the keywords in the user's search information are obtained, and the probability of each keyword belonging to each category is integrated into several public vectors. The values ​​in the public vectors are summed and averaged (the final representation is the probability set that the search information input by the user belongs to each category). After multiplying the two probability sets by the corresponding adjustment factors, the resulting web page classification model is also a probability set. The final probability set integrates both the probability information in the user's search information and the user's own inclination information towards different classification contents.

[0063] 4. From the web page classification model, obtain the value corresponding to the category to which the web page belongs.

[0064] Specifically, if the category to which the webpage belongs belongs to the last one, the last probability value is extracted from the webpage classification model P: .

[0065] 5. Integrate the value obtained in step 4 with the semantic similarity during the first sorting, and adjust the first sorting with the final integrated value to obtain the second order.

[0066] The specific integration strategy may be to linearly sum the probability values ​​corresponding to the semantic similarity and the category to which the webpage belongs, or to assign different weights to the probability values ​​corresponding to the semantic similarity and the category to which the webpage belongs for weighted summation, and then adjust the first order based on the weighted summation value. No further details will be given here.

[0067] In summary, by introducing the consideration of classification, on the basis of keyword-based search, we further consider the information of the category to which the keyword belongs, the category to which the web page belongs, and the category preferred by the user, thus avoiding the situation where the same keyword may correspond to different fields, resulting in interference fields in the final detected web pages.

[0068] 6. Get the third ranking The present invention adjusts the second ranking based on the semantic similarity between the user's historical search information and the current search information to obtain the third ranking.

[0069] In a preferred embodiment, the adjustment method is as follows: 1. Obtain at least one historical search information of the user within a predetermined time period before the current search operation; 2. For each historical search information, extract keywords from it and obtain the mean of the sum of the keyword word vectors as the third word vector; 3. Extract keywords from the user's current search information and obtain the mean of the sum of the keyword's word vectors as the first word vector; 4. Obtain the absolute value of the cosine value of the first word vector and the third word vector, and select the historical search information corresponding to the absolute value of the cosine value being greater than the second predetermined value as the target historical search information; 5. Obtaining a target webpage corresponding to the target historical search information, where the target webpage is a webpage that the user clicks on and browses for a time greater than a predetermined time when searching based on the target historical search information; 6. Sort the target web pages in descending order according to the absolute values ​​of the cosine values ​​in step 4; 7. randomly inserting the target web page into the second sorted web page set according to the first ratio; 8. Integrate the duplicate web pages to obtain the third ranked web pages.

[0070] For steps 7-8, the specific technical content of the implementation is exemplified as follows: after steps 1-6, target web page 1, target web page 2, target web page 3, target web page 4, and target web page 5 are found (the absolute values ​​of the cosine values ​​corresponding to target web page 1, target web page 2, target web page 3, target web page 4, and target web page 5 are sequentially decreased), and in the second sorting, the first 20 web pages obtained are existing web page 1 to existing web page 20; assuming that the target web pages are inserted into the web page set of the second sorting according to a ratio of 2:10, target web page 1 and target web page 2 are randomly inserted into any position between existing web page 1 to existing web page 10 (but the insertion position of target web page 1 should be ahead of target web page 2, that is, after insertion, the front and back order of the target web pages remains unchanged), similarly, target web page 3 and target web page 4 are randomly inserted into any position between existing web page 11 to existing web page 20, and so on.

[0071] This situation mainly targets some users who need to continuously consult relevant information for a period of time. For example, some users will continuously consult a certain type of information while writing a paper or doing a project. The search strategy used each time for consultation, or the search statement typed during the search, may have certain deviations. If the user does not organize the information in a timely manner, it may result in the inability to find the web pages that have been found before and meet their needs. Therefore, the present invention uses this method to retrieve the web pages that meet the needs of the user encountered in the previous search process, and intersperse them in the search results this time, which greatly improves the pertinence of the web page sorting and the convenience of user use.

[0072] It should be noted that the purpose of this step of the present invention is to find web pages that are more in line with user needs. At the same time, in actual operations, the reason why users use different search strategies to search for web pages is partly because the previous search strategies did not fully meet their needs. Therefore, in step 5, when obtaining the target web page based on the predetermined time, the predetermined time should be at least equal to the first predetermined time, and preferably, should be greater than the first predetermined time. In other words, the target web page found by the predetermined time must be guaranteed to be what the user needs.

[0073] 7. Get the fourth ranking The present invention adjusts the third ranking based on the associated search information of the web page to obtain the fourth ranking.

[0074] In a preferred embodiment, the adjustment method is as follows: 1. Obtaining related search information in which a predetermined number of web pages ranked at the front of the existing third ranking results are searched by other search information and clicked on and browsed for a predetermined time; 2. For each associated search information, extract keywords from it and obtain the mean of the sum of the keyword vectors as the fourth word vector; 3. Extract keywords from the user's current search information and obtain the mean of the sum of the keyword's word vectors as the first word vector; 4. Obtain the absolute value of the cosine value of the first word vector and the fourth word vector, and select the associated search information corresponding to the absolute value of the cosine value being greater than the second predetermined value as the target search information; 5. For each target search information, perform web search based on it to obtain related web pages, and adjust the order of related web pages based on the semantic similarity between each target search information and the web page dataset information (the adjustment method is the same as the adjustment idea of ​​the first order in the fourth part above); 6. Randomly insert the associated web pages into the third ranked web page set according to the second ratio (see the sixth part above for the specific implementation method); 7. Integrate the duplicate web pages to obtain the fourth ranked web pages.

[0075] The significance of setting this step is that in actual work and life, different users have different search capabilities, and for users with poor search capabilities, they lack the ability to change search strategies to obtain more complete information. Therefore, the present invention provides an associated search function; for web pages searched based on the user's current search information, find out the web pages with higher rankings, and see which search strategies these web pages can be searched through. This is equivalent to helping users expand search strategies and search results, weakening the search engine's demand for user search capabilities, and providing more intelligent search services.

[0076] Figure 2 This is a system architecture diagram of the web page search result ranking adjustment system based on machine learning of the present invention, which is used to implement the adjustment method described above, including a client and a server, the client and the server are connected through a wired or wireless network, the client is built on various mobile terminals, and is used to receive user search information, and the server is used to adjust the web page search result ranking based on the user's search information.

[0077] The server stores a data set for each web page. The data set for each web page stores: Category labels of web pages; At least one keyword set and the total number of clicks, total browsing time, and matching weight with the web page for each keyword set; The quantity identifier of each keyword in the set of all keywords; The server updates the total number of clicks, total browsing time, matching weight with web pages, and quantity identifiers of each keyword in each keyword set based on the historical operation information; When the server adjusts the ranking of the webpage search results, it obtains the semantic similarity between the user's current search information and the webpage data set information, and adjusts the webpage ranking based on the semantic similarity to obtain a first ranking; Adjust the first ranking based on the user model and the public model to obtain a second ranking; Based on the semantic similarity between the user's historical search information and the current search information, the second ranking is adjusted to obtain a third ranking.

[0078] Although the present invention has been described using the above preferred embodiments, they are not intended to limit the scope of protection of the present invention. Any person skilled in the art may make various changes and modifications to the above embodiments without departing from the spirit and scope of the present invention. The scope of protection of the present invention shall be based on the definition of the claims.

Claims

1. A method for adjusting the ranking of web page search results based on machine learning, characterized in that: The steps include: S1: Construct the data set corresponding to the web page, which stores: Category labels of web pages; At least one keyword set and the total number of clicks, total browsing time, and matching weight with the web page for each keyword set; The quantity identifier of each keyword in the set of all keywords; S2: based on the historical operation information, update the total number of clicks, total browsing time, matching weight with the web page, and the number of keywords in each keyword set; S3: Get the user's current search information; S4: Obtaining semantic similarity between the user's current search information and the webpage dataset information, and adjusting the webpage ranking based on the semantic similarity to obtain a first ranking; S5: adjusting the first ranking based on the user model and the public model to obtain a second ranking; S6: Based on the semantic similarity between the user's historical search information and the current search information, adjust the second ranking to obtain a third ranking.

2. The method for adjusting the ranking of web page search results based on machine learning as claimed in claim 1, characterized in that: In S1, when constructing a data set, at least one keyword set is initialized based on the content information of the web page, and a number of keywords, a total number of clicks, a total browsing time, and a matching weight are initialized for each keyword set. The initial total number of clicks, the initial total browsing time, and the initial matching weight of each keyword set are 0, 0, and the same; The matching degree between all the keywords in each keyword set is greater than a first predetermined value; A quantity identifier is initialized for each keyword in the keyword set, and the initial value of the quantity identifier is 0.

3. The method for adjusting the ranking of web page search results based on machine learning as claimed in claim 2, characterized in that: Updating the matching weight, total click count, total browsing time of each keyword set, and the quantity identifier of each keyword in each keyword set based on the historical operation information includes the following steps: S21: Acquire search information corresponding to a search operation that performs a click operation on a webpage and stays on the webpage for a time exceeding a first predetermined time length; S22: extracting all keywords from the search information as keywords to be matched; Perform the following operations for each keyword to be matched: S23: traverse all keyword sets of the web page, and for each keyword set, obtain a keyword as an existing keyword; S24: Obtain the matching degree between the keyword to be matched and the existing keyword, and determine whether there is an existing keyword that reaches a first predetermined value: If so, determine whether there is a keyword that is consistent with the keyword to be matched in the keyword set where the existing keyword that has reached the first predetermined value is located: if there is a consistency, update the quantity identifier of the keyword that is consistent with the keyword to be matched, and increase its value by 1; if there is no consistency, add the keyword to be matched to the keyword set where the existing keyword that has reached the first predetermined value is located, and initialize its quantity identifier to 1; at the same time, update the total number of clicks, total browsing time and matching weight of the keyword set where the existing keyword is located; If it does not exist, a new keyword set is created and the keywords to be matched are added to the new keyword set, the quantity flag is initialized to 1, and a matching weight, total clicks, and total browsing time are initialized for the new keyword set, and the matching weight is updated.

4. The method for adjusting the ranking of web page search results based on machine learning as claimed in claim 3, characterized in that: Update the matching weight of the keyword set where the existing keywords are located through the following steps; Q=Q inital +(x1+T ime / n) / x2+(y1+n) / y2; Among them, Q is the matching weight, Q inital is the initial matching weight, x1, x2, y1 and y2 are adjustment factors, T ime is the total browsing time, n is the total number of clicks; When there is an existing keyword that reaches the first predetermined value, the total number of clicks of the keyword set to which the existing keyword belongs is increased by 1, and the total browsing time is added to the dwell time obtained in S21.

5. The method for adjusting the ranking of web page search results based on machine learning as claimed in claim 3, characterized in that: When traversing all keyword sets of a web page, for each keyword set, the keyword with the largest quantity identifier is obtained as the existing keyword; If there are multiple keywords with the maximum number of identifiers in a keyword set, one is randomly selected as the existing keyword.

6. The method for adjusting the ranking of web page search results based on machine learning as claimed in claim 3, characterized in that: The matching degree between the keyword to be matched and the existing keyword is obtained in the following way: based on the BOW model, the sequence conversion is performed on the keyword to be matched and the existing keyword to obtain the first vector and the second vector respectively, and the inner product of the first vector and the second vector is calculated, and the inner product value is the matching degree.

7. The method for adjusting the ranking of web page search results based on machine learning as claimed in claim 1, characterized in that: The semantic similarity between the user's current search information and the webpage dataset information is obtained through the following steps, and the webpage search ranking is adjusted based on the semantic similarity to obtain the first ranking: S41: extracting keywords from current search information; S42: Obtain the mean of the sum of the word vectors of all keywords in S41 as the first word vector; S43: Obtain one keyword from each of the keyword sets of the web page; S44: The second word vector is obtained by the following formula: / m Among them, C is the second word vector, m is the total number of keywords extracted in S43, is the word vector of the keyword extracted in S43; For word vector The weight value is the matching weight corresponding to the keyword set to which the keyword belongs.

8. The method for adjusting the ranking of web page search results based on machine learning as claimed in claim 7, characterized in that: In S43, a keyword with the largest number of identifiers is obtained from all keyword sets of the web page. If a keyword set has multiple keywords with the largest number of identifiers, one is randomly selected.

9. An adjustment system for the webpage search result ranking adjustment method based on machine learning according to any one of claims 1 to 8, characterized in that: include: The client is used to receive the user's search information; A server, connected to the client, for adjusting the ranking of web page search results based on the user's search information; The server stores a data set for each web page. The data set for each web page stores: Category labels of web pages; At least one keyword set and the total number of clicks, total browsing time, and matching weight with the web page for each keyword set; The quantity identifier of each keyword in the set of all keywords; The server updates the total number of clicks, total browsing time, matching weight with web pages, and quantity identifiers of each keyword in each keyword set based on the historical operation information; When the server adjusts the ranking of web page search results, it obtains the semantic similarity between the user's current search information and the web page data set information, and adjusts the web page ranking based on the semantic similarity to obtain a first ranking.

10. The adjustment system of the webpage search result ranking adjustment method based on machine learning as claimed in claim 9, characterized in that: When the server adjusts the ranking of web page search results, it also includes: Adjust the first ranking based on the user model and the public model to obtain a second ranking; Based on the semantic similarity between the user's historical search information and the current search information, the second ranking is adjusted to obtain a third ranking.

Images