Search quality verification method and device for screening items and computer device

By analyzing users' historical search records, commonly used filter combinations and parameter values ​​are determined to form the conditions to be verified. Search quality is evaluated at different time points, which solves the problem of low efficiency in existing technologies and achieves efficient and accurate search quality verification.

CN117093875BActive Publication Date: 2025-12-19SUZHOU LANGDONG NET TEC CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202311061703.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-08-22
Publication Date
2025-12-19
Estimated Expiration
2043-08-22

AI Technical Summary

Technical Problem

Existing search quality verification methods are inefficient and cannot effectively verify the combination of filter items.

Method used

By analyzing users' historical search records, we can determine commonly used filter combination methods and parameter values, form filter conditions to be verified, and conduct searches at different time points. Based on the differences in results and matching results, we can evaluate the search quality of the filter items.

Benefits of technology

It improves the timeliness and efficiency of search quality, meets business needs, and ensures the accuracy and stability of search results.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117093875B_ABST
    Figure CN117093875B_ABST
Patent Text Reader

Abstract

The application relates to a search quality verification method and device of a screening item, computer equipment, a storage medium and a computer program product. The method comprises the following steps: determining a plurality of screening item combination modes for a retrieval object according to historical search records of a user; determining a target screening item combination mode based on the number of times that each screening item combination mode appears in the historical search records; then performing combination processing on the target screening item combination mode and target parameter values of each screening item included in the target screening item combination mode to obtain a to-be-verified screening condition; further, performing retrieval through the to-be-verified screening condition to obtain a first screening result and a second screening result; finally, determining the search quality of the screening item based on the difference information between the first screening result and the second screening result and the matching result between the second screening result and the to-be-verified screening condition. The method can improve the verification efficiency of the search quality of the screening item.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of computer, in particular to a search quality verification method and device of screening items, computer equipment, storage medium and computer program product. BACKGROUND

[0002] With the development of computer technology, in order to realize the filtering of data, Elasticsearch technology (ES, a real-time distributed storage, search and analysis engine, commonly used for data retrieval) appears. ES is a real-time distributed storage, search and analysis engine, which has powerful data retrieval function. The data structure contained in ES can quickly filter documents, by representing each document as a bit set, where each bit represents whether a particular filter condition matches the document, when executing a query, ES will convert the query into one or more filters, and apply these filters to all documents.

[0003] However, when using ES search engine for query, the number of combination ways of screening items is countless, if the search quality of each combination way of screening items is verified one by one, a lot of time will be consumed. Therefore, the efficiency of the existing search quality verification method is low. SUMMARY

[0004] Therefore, it is necessary to provide a search quality verification method and device of screening items, computer equipment, computer readable storage medium and computer program product, aiming at the technical problem that the efficiency of the existing search quality verification method is low.

[0005] In a first aspect, the present application provides a search quality verification method of screening items. The method comprises:

[0006] determining a plurality of screening item combination ways for the retrieval object according to the historical search records of the user;

[0007] determining a target screening item combination way from the plurality of screening item combination ways based on the number of occurrences of each screening item combination way in the historical search records;

[0008] combining the target screening item combination way and the target parameter value under each screening item included in the target screening item combination way to obtain a to-be-verified screening condition; the screening items included in the to-be-verified screening condition correspond to the screening items in the target screening item combination way;

[0009] performing retrieval through the to-be-verified screening condition at two different search time points to obtain a first screening result and a second screening result;

[0010] determine the search quality of the screening item included in the to-be-verified screening condition based on the difference information between the first screening result and the second screening result and the matching result between the second screening result and the to-be-verified screening condition.

[0011] In one of the embodiments, the target screening item combination manner is determined from the plurality of screening item combination manners based on the number of occurrences of each screening item combination manner in the historical search records, including: sorting the plurality of screening item combination manners according to the number of occurrences; determining, from the plurality of screening item combination manners, a screening item combination manner corresponding to a number of occurrences greater than that of other screening item combination manners as the target screening item combination manner according to the sorting result; and the other screening item combination manners are the screening item combination manners other than the target screening item combination manner in the plurality of screening item combination manners.

[0012] In one of the embodiments, before the target screening item combination manner and the target parameter value under each screening item included in the target screening item combination manner are combined to obtain the to-be-verified screening condition, the method further includes: obtaining, for each screening item, a number of search results of each parameter value under the screening item; and determining, from each parameter value under the screening item, the target parameter value based on the number of search results.

[0013] In one of the embodiments, the target parameter value is determined from each parameter value under the screening item based on the number of search results, including: sorting each parameter value under the screening item according to the number of search results; and determining, from each parameter value, a parameter value corresponding to a number of search results greater than that of other parameter values as the target parameter value according to the sorting result; and the other parameter values are the parameter values other than the target parameter value in each parameter value under the screening item.

[0014] In one of the embodiments, the search quality of the screening item included in the to-be-verified screening condition is determined based on the difference information between the first screening result and the second screening result and the matching result between the second screening result and the to-be-verified screening condition, including: determining first search quality information based on the difference information between the first screening result and the second screening result; determining second search quality information based on the matching result between the second screening result and the to-be-verified screening condition; and obtaining the search quality of the screening item included in the to-be-verified screening condition according to the first search quality information and the second search quality information.

[0015] In one of the embodiments, the difference information between the first screening result and the second screening result is determined by: obtaining a variation ratio of the number of search results corresponding to the first screening result and the second screening result; and based on the variation ratio, a variation ratio threshold corresponding to the first screening result, and a size relationship between the number of search results corresponding to the first screening result and the second screening result, obtaining the difference information between the first screening result and the second screening result.

[0016] In one of the embodiments, the variation ratio threshold corresponding to the first screening result is determined by: determining a target value interval corresponding to the number of search results included in the first screening result from a plurality of preset value intervals; each value interval has a corresponding variation ratio threshold; and obtaining the variation ratio threshold corresponding to the target value interval as the variation ratio corresponding to the first screening result.

[0017] In a second aspect, the present application further provides a search quality verification device. The device comprises:

[0018] A first data confirmation module is configured to determine a plurality of screening item combination manners for a search object based on historical search records of a user.

[0019] A second data confirmation module is configured to determine a target screening item combination manner from the plurality of screening item combination manners based on a number of occurrences of each screening item combination manner in the historical search records; and a data processing module is configured to perform combination processing on the target screening item combination manner and target parameter values under each screening item included in the target screening item combination manner to obtain a to-be-verified screening condition; the screening items included in the to-be-verified screening condition correspond to the screening items in the target screening item combination manner.

[0020] A data retrieval module is configured to perform retrieval through the to-be-verified screening condition to obtain a first screening result and a second screening result at two different search time points, respectively.

[0021] A search quality determination module is configured to determine a search quality of the screening items included in the to-be-verified screening condition based on difference information between the first screening result and the second screening result, and / or a matching result between the second screening result and the to-be-verified screening condition.

[0022] In a third aspect, the present application further provides a computer device. The computer device comprises a memory and a processor, the memory stores a computer program, and the processor implements the search quality verification method of any one of the embodiments of the present application when executing the computer program.

[0023] In a fourth aspect, the present application provides a computer readable storage medium. The computer readable storage medium has a computer program stored thereon, and the computer program, when executed by a processor, implements the search quality verification method of any of the embodiments of the present application.

[0024] In a fifth aspect, the present application provides a computer program product. The computer program product comprises a computer program, and the computer program, when executed by a processor, implements the search quality verification method of any of the embodiments of the present application.

[0025] The search quality verification method, device, computer device, storage medium and computer program product of the above-mentioned screening item have the following beneficial effects: according to the historical search record of the user, a plurality of screening item combination modes for the search object are determined; based on the number of occurrences of each screening item combination mode in the historical search record, a target screening item combination mode is determined from the plurality of screening item combination modes, and the scheme improves the timeliness of the search quality according to the historical search record to confirm the screening item combination mode; then the target screening item combination mode and the target parameter value under each screening item included in the target screening item combination mode are combined to obtain a to-be-verified screening condition: including a screening item and a specific parameter value; wherein the screening item included in the to-be-verified screening condition corresponds to the screening item in the target screening item combination mode, and the to-be-verified screening condition is used for retrieval at two different search time points to obtain a first screening result and a second screening result; finally, based on the difference information between the first screening result and the second screening result, and the matching result between the second screening result and the to-be-verified screening condition, in the scheme, the target screening item combination mode is determined from the plurality of screening item combination modes based on the number of occurrences of each screening item combination mode in the historical search record, which improves the timeliness of the search quality and improves the efficiency of verifying the search quality, and meets the business requirements. BRIEF DESCRIPTION OF DRAWINGS

[0026] Figure 1 An application environment diagram of the search quality verification method of a screening item in an embodiment;

[0027] Figure 2 A flowchart of the search quality verification method of a screening item in an embodiment;

[0028] Figure 3 A flowchart of the search quality verification steps of a screening item in an embodiment;

[0029] Figure 4 A structural block diagram of the search quality verification device of a screening item in an embodiment;

[0030] Figure 5An internal structure diagram of a computer device in an embodiment. DETAILED DESCRIPTION

[0031] For the purpose, technical solutions and advantages of the present application to be clearer, the present application is further described in detail below with reference to the drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and not to limit the present application.

[0032] The search quality verification method of the screening item provided by the embodiments of the present application can be applied in an application environment as shown in Figure 1 . The terminal 102 communicates with the server 104 through a network. The data storage system can store data required to be processed by the server 104. The data storage system can be integrated on the server 104, or placed on a cloud or other network server. In the application scenario of the present application, after the server 104 obtains the historical search records of a user from the terminal 102, the server 104 obtains a plurality of screening item combination modes for a search object according to the historical search records of the user; then, based on the number of occurrences of each screening item combination mode in the historical search records, the target screening item combination mode is determined from the plurality of screening item combination modes; further, the target screening item combination mode and the target parameter values under each screening item included in the target screening item combination mode are combined and processed to obtain a to-be-verified screening condition; the screening items included in the to-be-verified screening condition correspond to the screening items in the target screening item combination mode; the to-be-verified screening condition is used for searching at two different search time points to obtain a first screening result and a second screening result; finally, based on the difference information between the first screening result and the second screening result, and the matching result between the second screening result and the to-be-verified screening condition, the search quality of the screening items included in the to-be-verified screening condition is determined. The terminal 102 can be, but is not limited to, various personal computers, notebook computers, smart phones, tablet computers, Internet of Things devices and portable wearable devices. The Internet of Things device can be a smart speaker, a smart television, a smart air conditioner, a smart vehicle device, etc. The portable wearable device can be a smart watch, a smart bracelet, a head-mounted device, etc. The server 104 can be implemented by an independent server or a server cluster composed of multiple servers.

[0033] In one embodiment, as shown in Figure 2 , a search quality verification method of a screening item is provided. Taking the server 104 in Figure 1 as an example, the method includes the following steps:

[0034] Step 202, determining a plurality of screening item combination modes for a search object according to historical search records of a user.

[0035] According to the historical search records of the user, the combination mode of various filtering conditions used by the user in the search is analyzed and data is recorded in the data storage system. For example, when the user searches using the enterprise name, the industry to which the enterprise belongs, and the in-business and survival of the enterprise, the server will identify and store this combination mode, and determine the combination mode of multiple filtering options for the search object according to the historical search records of the user, which means that the server can obtain the filtering options commonly used by the user according to the historical search behavior of the user, and search according to the combination mode of these filtering options.

[0036] Step 204, based on the number of occurrences of each filtering option combination mode in the historical search records, determine the target filtering option combination mode from the multiple filtering option combination modes.

[0037] Specifically, the server counts the number of occurrences of each filtering option combination mode in the historical search records of the user, and further analyzes and compares the number of occurrences of different filtering option combination modes in the historical search records to determine the most commonly used filtering option combination mode by the user, i.e., the target filtering option combination mode.

[0038] Step 206, combining the target filtering option combination mode and the target parameter values of each filtering option included in the target filtering option combination mode to obtain a to-be-verified filtering condition; the filtering options included in the to-be-verified filtering condition correspond to the filtering options in the target filtering option combination mode.

[0039] Specifically, the to-be-verified filtering condition includes the most commonly used filtering option combination mode and specific parameter values by the user. After the server determines the target filtering option combination mode, it can combine the target parameter values of each filtering option in the combination mode, which means that the server will combine each filtering option in the target filtering option combination mode with its corresponding target parameter value to form a to-be-verified filtering condition.

[0040] Step 208, respectively at two different search time points, search through the to-be-verified filtering condition to obtain a first filtering result and a second filtering result.

[0041] Specifically, the server uses the to-be-verified filtering condition to search at two different search time points to obtain two filtering results.

[0042] Step 210, based on the difference information between the first filtering result and the second filtering result, and the matching result between the second filtering result and the to-be-verified filtering condition, determine the search quality of the filtering options included in the to-be-verified filtering condition.

[0043] Specifically, the server can evaluate the influence degree of each filtering option on the search result by analyzing the difference information and the matching result, and then determine the search quality, so as to provide more accurate search results for the user.

[0044] In the search quality verification method of the filtering option, the server determines a plurality of filtering option combination modes for the search object according to the historical search records of the user; determines a target filtering option combination mode from the plurality of filtering option combination modes based on the number of occurrences of each filtering option combination mode in the historical search records, which improves the timeliness of improving the search quality according to the historical search records; then, the target filtering option combination mode and the target parameter value under each filtering option included in the target filtering option combination mode are combined to obtain a to-be-verified filtering condition: including the filtering option and the specific parameter value; wherein the filtering option included in the to-be-verified filtering condition corresponds to the filtering option in the target filtering option combination mode, and the search is performed through the to-be-verified filtering condition at two different search time points to obtain a first filtering result and a second filtering result; finally, based on the difference information between the first filtering result and the second filtering result, and the matching result between the second filtering result and the to-be-verified filtering condition, the target filtering option combination mode is determined from the plurality of filtering option combination modes based on the number of occurrences of each filtering option combination mode in the historical search records in the present scheme, which improves the timeliness of improving the search quality and improves the efficiency of verifying the search quality, and meets the business requirements.

[0045] In one embodiment, in step 204, determining the target filtering option combination mode from the plurality of filtering option combination modes based on the number of occurrences of each filtering option combination mode in the historical search records can include:

[0046] Step 204a: sorting the plurality of filtering option combination modes according to the number of occurrences.

[0047] Specifically, the plurality of filtering options can be the industry to which the search object belongs, the province area, the number of insured persons, the establishment time, the registration status, the registered capital, and the institution type, etc.

[0048] Step 204b: determining, from the plurality of filtering option combination modes, a filtering option combination mode corresponding to an occurrence number greater than the occurrence numbers of other filtering option combination modes as the target filtering option combination mode according to the sorting result; the other filtering option combination modes are the filtering option combination modes other than the target filtering option combination mode in the plurality of filtering option combination modes.

[0049] Specifically, as the user group and its search behavior are constantly changing, the combination of the verified filter options is constantly updated to more fully meet the needs of users, and the combination of the filter options is re-extracted from the log on a monthly basis to update the target combination of filter options.

[0050] In this embodiment, the target filter option combination is determined by sorting the number of occurrences of various filter option combinations in historical search records, which can improve the accuracy of the search and user satisfaction.

[0051] Further, in one embodiment, before the combination of the target filter option combination and the target parameter value under each filter option included in the target filter option combination to obtain the to-be-verified filter condition, it further includes: for each filter option, obtaining the number of search results of each parameter value under the filter option; based on the number of search results, determining the target parameter value from each parameter value under the filter option.

[0052] In one embodiment, based on the number of search results, the target parameter value is determined from each parameter value under the filter option, including:

[0053] Step 1: Sort each parameter value under the filter option according to the number of search results;

[0054] Specifically, the server writes a request script of the search engine, including a request protocol, a request method, a request header, and a request address, and sets a list of parameter names same as the values or references to the values in the database table field position area, and then sets a list of parameter values same as the values or references to the values in the database table field position area. The selection rule of the parameter values is to maximize the range and the number of filter results to prevent the situation of no filter results after multiple parameter combinations.

[0055] The selection method of the parameter values is to respectively splice the enumerable parameter values and the parameter names to generate filter functions for sequential single requests without using combination methods, record the number of filters, group the parameter names according to the number of filters, and arrange the enumerated parameter values in descending order. The parameter values with the largest number of filters are added to the parameter value list according to the value or reference order in the table field position area.

[0056] Step 2: According to the sorting result, determine the parameter value corresponding to the search result number greater than the search result number of other parameter values from each parameter value as the target parameter value; and the other parameter values are the parameter values under each parameter value except the target parameter value.

[0057] Specifically, due to the liquidity of data, the number of screening results will fluctuate, and the parameter value needs to be updated constantly to ensure that the selected parameter value is the one with the largest number of screening results. Therefore, the screening number is sorted by month, the parameter value is updated, and the target parameter value is confirmed.

[0058] In this embodiment, through the sorting of the parameter value and the selection of the target parameter value, the search term can be more accurately confirmed.

[0059] In one embodiment, in step 210, based on the difference information between the first screening result and the second screening result, and the matching result between the second screening result and the to-be-verified screening condition, the search quality of the screening item included in the to-be-verified screening condition is determined, including:

[0060] Step 210a: based on the difference information between the first screening result and the second screening result, the first search quality information is determined.

[0061] Specifically, the first screening result includes a parameter identifier, a filter function request parameter of a screening item combination, a processed screening result, and a request time. The data in the second screening result is: after setting a specified time interval, reading the filter function request parameter of the screening item combination in the first screening set according to the preset time interval, and then sending a request to obtain the screening result, the first screening result and the second screening result are compared to obtain the first search quality information.

[0062] Step 210b: based on the matching result between the second screening result and the to-be-verified screening condition, the second search quality information is determined.

[0063] Specifically, after the second screening result writes the latest screening result into the second screening set, the request parameter corresponding to the latest screening result of the screening item combination is read in turn, and is matched with the to-be-verified screening condition. According to the matching result, the second search quality information is obtained.

[0064] Step 210c: according to the first search quality information and the second search quality information, the search quality of the screening item included in the to-be-verified screening condition is obtained.

[0065] Specifically, by comparing the two search quality information of the above steps, it is verified whether the quality of the latest screening item is improved.

[0066] Further, in one embodiment, the difference information between the first screening result and the second screening result is determined by: obtaining the variation ratio of the number of search results corresponding to the first screening result and the second screening result; based on the variation ratio and the variation ratio threshold corresponding to the first screening result, and the size relationship between the number of search results corresponding to the first screening result and the second screening result, the difference information between the first screening result and the second screening result is obtained.

[0067] Specifically, the data of the general company data source is steadily increasing after continuous collection and accumulation, and there may be missing data or failure in the synchronization data in the search engine, so in both the increasing and decreasing cases, it is more dangerous to consider the case of the screening result being less. However, the data is steadily flowing, and the company information may change, such as the registered capital of a company changing from 50,000 yuan to 30,000 yuan, which will also lead to the above-mentioned screening result being less. Therefore, a threshold of the difference information proportion needs to be set, for example, 10%, and if the threshold is exceeded, it is considered that the screening result gap is too large and an alarm is pushed. However, since the proportion value depends on the numerator and denominator, that is, the difference information and the count of the first screening result, when the number of the first screening result is small, the floating of the number of difference information will have a huge impact on the proportion. For example, the number of the first screening result is ten, the number of the second screening result is eight, and the difference information proportion is |8-10| / 10=20%, the difference information proportion is large and exceeds the threshold, but the number of difference information is small.

[0068] In the embodiment, through the acquisition of the change rate of the search result numbers corresponding to the first screening result and the second screening result and the analysis and calculation of the change rate and the change rate threshold corresponding to the first screening result, the difference information between the first screening result and the second screening result is more accurate.

[0069] In one embodiment, the change rate threshold corresponding to the screening result is determined by the following method: from a plurality of preset numerical intervals, a target numerical interval corresponding to the number of search results included in the first screening result is determined; each numerical interval has a corresponding change rate threshold; the change rate threshold corresponding to the target numerical interval is acquired as the change rate corresponding to the first screening result.

[0070] Specifically, a ladder proportion threshold needs to be set, for example, when the number of the first screening result is less than one hundred, the proportion threshold is set to 30%; when the number of the first screening result is greater than one hundred and less than ten thousand, the proportion threshold is set to 20%; when the number of the first screening result is greater than ten thousand, the proportion threshold is set to 10%. In this way, the specific threshold can be adjusted according to the alarm quality. At the same time, different priorities are set for the two cases of increasing and decreasing, and the priority of increasing is set to ordinary, and the alarm color is yellow; the priority of decreasing is set to urgent, and the alarm color is red.

[0071] In the embodiment, the change rate threshold corresponding to different numerical intervals in the screening result is acquired, so as to determine the change rate threshold of the target numerical interval, and the change of different thresholds is set with priorities, which can improve the timeliness of the server acquiring the change rate corresponding to the first screening result.

[0072] In an embodiment, in order to facilitate the understanding of the embodiments of the present application by those skilled in the art, the following will take the company as the search object as an example, and the attached Figure 3 The search quality verification method of the screening item provided in the present application will be described in detail.

[0073] It should be noted that when the search object is a company, the corresponding optional screening items generally include: industry, province area, number of insured persons, establishment time, registration status, registered capital and organization type, etc. For example, if a user wants to find a company in B city of software industry with registered capital greater than 50000, the screening condition can be constructed as: registered capital>50000 and province area=A province B city and industry=software and information technology service industry. The registered capital+province area+industry in the screening condition can form a screening item combination mode.

[0074] In the present embodiment, the specific steps of the search quality verification method of the screening item include:

[0075] S302, determining a target screening item combination mode for the company.

[0076] Specifically, according to the search record of the user, a plurality of screening item combination modes are determined, and then the screening input parameter filter function is parsed from the interface level according to the screening item combination mode, and the screening item combination with more occurrences and higher frequency of use in the filter function is found through the specified method.

[0077] S304, screening the parameter value under each screening item in the target screening item combination mode to obtain the target parameter value corresponding to each screening item.

[0078] Specifically, the parameter values and parameter names are spliced to generate a filter function for single request in turn, the filtering quantity is recorded, the filtering quantity of the enumerated parameter values is arranged in descending order after grouping according to the parameter names, and the parameter value with the largest filtering quantity is selected as the parameter value combined with the filtering item. According to the position order of the filtering item, the corresponding inserted data is (software and information technology service industry, Suzhou, Jiangsu, null, null, null, 50000, null), and the parameter identification bit test code corresponding to the value or reference to the value in the parameter position area is 1100010, representing that the corresponding position of the filtering item with the current line is 1, and the value without the parameter is 0. The filtering item and the corresponding filtering item parameter identification bit test code are inserted into the database as a row of data. After the test code field is aggregated and arranged in descending order according to the value, the filtering item combination mode used more frequently by the user can be obtained, and the top ten thousand filtering item combination modes are stored as the first filtering result of the filtering condition. For example, the parameter enumeration value of the registration status is: in business, in existence, migration in, migration out, cancellation, suspension, the single filtering item of the registration status is spliced with the parameter enumeration value to request after the filter function, and the result value is arranged in descending order as: in existence (147551077), cancellation (105402557), in business (41923187), suspension (18411268), migration out (499086), and migration in (313), and the parameter value with the largest filtering quantity is selected as the parameter value. Due to the liquidity of data, the filtering quantity fluctuates, and the parameter value needs to be updated constantly to ensure that the selected parameter value is the parameter value with the largest filtering quantity. The parameter value is updated by requesting and sorting the filtering quantity every month.

[0079] S306, determining the first filtering result.

[0080] Specifically, the filtering result is written into the first filtering result set after the request is sent by using the filter function as the parameter

[0081] The top five companies in the user's historical search record statistics in the screening result account for about 80% of the total number of clicks, that is, the correctness of the top five screening results greatly affects the user's experience of using the search engine to screen companies, so the top five screening results are an important indicator of the quality verification of the screening options. Under the condition of correct interface data retrieval, the screening quantity depends on the data. Generally, the data of the data source is smooth and does not change drastically, otherwise it may be caused by data acquisition failure of the data source or website version upgrade or data cleaning error. If the interface data retrieval is correct, it may be caused by ES synchronization data failure or search engine failure. Setting a reasonable threshold to monitor the change of the screening quantity can timely find the data and ES level vulnerabilities, so the screening quantity is also an important indicator of the quality verification of the screening options. The screening result is processed, and the top five company records of the current screening option combination and the screening quantity are extracted, including the hit company name and the hit information. The parameter identifier, the filtering function request parameter of the screening option combination, the processed screening result, and the request time are taken as the first screening result.

[0082] S308, determining a second screening result.

[0083] Specifically, according to the preset frequency, the same filtering function input parameter as the first screening result is obtained to execute the above steps again, and the screening result is written into the second screening result set. A specified time interval is set, and the filtering function request parameter of the screening option combination in the first screening result is read according to the preset time interval to send a request again, and the screening result is written into the second screening result. The information written in the above step S306 is read from the first screening result, which indicates that the screening result before the specified interval is taken as the reference. The specified time interval is generally set to one day, which needs to cover the time period of the search engine R&D personnel to synchronize full and incremental data and the task online time period, to ensure that the data synchronization and program changes do not introduce defects.

[0084] S310, determining search quality according to the first screening result and the second screening result.

[0085] Specifically, by comparing the latest screening result with the first screening result set according to the screening condition, the first method is to verify the change of the latest screening result and the consistency of the screening result and the screening condition, so as to verify the search quality. Mainly compared with the screening result before the specified time interval, the change of the value of the latest screening result, the smaller the change represents the more stable the screening result. The second method is to verify the consistency of the company information of the latest screening result and the screening condition, and the inconsistency represents that the screening result is wrong. According to the screening condition, the first five company details in the screening result are compared. The mapping relationship between the screening condition and the company detail verification is established, such as the screening condition is that the registered capital is greater than 50,000, and the company's registered capital is obtained through the mapping relationship of the stored detail field. Compared with 50,000. If the comparison relationship is greater than, it is verified to be consistent, otherwise the screening result is wrong. The preset screening condition, the company name verified to be inconsistent with the screening condition, the expected value verified to be inconsistent with the screening condition, the actual value verified to be inconsistent with the screening condition are set to red style, the priority is urgent, the alarm group is pushed and stored in the exception change database, and the developer checks one by one. This situation may be caused by search engine screening failure and the like.

[0086] In the above embodiment, the application can batch and efficiently judge the screening quality of the screening item, cover a large area for the combination mode of the user's complex mass screening item, track and warn the abnormal result of the screening, and improve the stability and accuracy of the screening result in the search engine.

[0087] It should be understood that, although each step in the flowchart involved in each embodiment as described above is displayed in sequence according to the arrow, these steps are not necessarily executed in sequence according to the arrow. Unless otherwise specified herein, the execution of these steps is not strictly limited in sequence, and these steps can be executed in other orders. Moreover, at least part of the steps in the flowchart involved in each embodiment as described above can include multiple steps or stages, which are not necessarily executed at the same time, but can be executed at different times, and the execution sequence of these steps or stages is not necessarily sequential, but can be executed in rotation or alternation with at least part of other steps or steps or stages in other steps.

[0088] In one embodiment, as shown in Figure 4 Based on the same inventive concept, the embodiment of the application further provides a detection device for implementing the search quality verification method of the screening item involved above. It includes a first data confirmation module 401, a second data confirmation module 402, a data processing module 403, a data retrieval module 404 and a search quality determination module 405, wherein:

[0089] The first data confirmation module 401 is configured to determine a plurality of filter item combination manners for the search object according to the historical search record of the user.

[0090] The second data confirmation module 402 is configured to determine a target filter item combination manner from the plurality of filter item combination manners based on the number of occurrences of each filter item combination manner in the historical search record.

[0091] The data processing module 403 is configured to combine the target filter item combination manner and the target parameter value of each filter item included in the target filter item combination manner to obtain a to-be-verified filter condition; the filter items included in the to-be-verified filter condition correspond to the filter items in the target filter item combination manner.

[0092] The data retrieval module 404 is configured to perform retrieval through the to-be-verified filter condition at two different search time points to obtain a first search result and a second search result.

[0093] The search quality determination module 405 is configured to determine the search quality of the filter items included in the to-be-verified filter condition based on the difference information between the first search result and the second search result and / or the matching result between the second search result and the to-be-verified filter condition.

[0094] In an embodiment, the first data confirmation module 401 is further configured to sort the plurality of filter item combination manners according to the number of occurrences in the historical search record; and determine, as the target filter item combination manner, a filter item combination manner corresponding to a number of occurrences greater than the number of occurrences of other filter item combination manners from the plurality of filter item combination manners; the other filter item combination manners are the filter item combination manners other than the target filter item combination manner in the plurality of filter item combination manners.

[0095] In an embodiment, the data processing module 403 further includes a first data processing submodule configured to obtain, for each filter item, the number of search results of each parameter value under the filter item; and determine, as the target parameter value, a parameter value corresponding to a number of search results greater than the number of search results of other parameter values from each parameter value under the filter item based on the number of search results.

[0096] In an embodiment, the data processing module 403 further includes a second data processing submodule configured to sort the parameter values under the filter item according to the number of search results; and determine, as the target parameter value, a parameter value corresponding to a number of search results greater than the number of search results of other parameter values from the parameter values under the filter item according to the sorting result; the other parameter values are the parameter values other than the target parameter value among the parameter values under the filter item.

[0097] In an embodiment, the search quality determination module 405 further comprises a first search quality determination submodule, configured to determine first search quality information based on difference information between the first screening result and the second screening result; determine second search quality information based on a matching result between the second screening result and the to-be-verified screening condition; and obtain search quality of a screening item included in the to-be-verified screening condition according to the first search quality information and the second search quality information.

[0098] In an embodiment, the search quality determination module 405 further comprises a second search quality determination submodule, configured to obtain a variation ratio of the number of search results corresponding to the first screening result and the second screening result; obtain the difference information between the first screening result and the second screening result based on the variation ratio, a variation ratio threshold corresponding to the first screening result, and a size relationship between the number of search results corresponding to the first screening result and the number of search results corresponding to the second screening result.

[0099] In an embodiment, the search quality determination module 405 further comprises a third search quality determination submodule, configured to determine a target numerical interval corresponding to the number of search results included in the first screening result from a plurality of preset numerical intervals; each numerical interval has a corresponding variation ratio threshold; and obtain the variation ratio threshold corresponding to the target numerical interval as the variation ratio corresponding to the first screening result.

[0100] The above-mentioned modules in the search quality verification apparatus can be realized by software, hardware, and combinations thereof, in whole or in part. The above-mentioned modules can be embedded in or independent of a processor in a computer device in hardware form, or stored in a memory in a computer device in software form, so as to be called and executed by a processor to perform operations corresponding to the above-mentioned modules.

[0101] In an embodiment, a computer device is provided, which can be a server, and an internal structure diagram of the computer device can be as shown in FIG. 8. Figure 5As shown in the figure. The computer device includes a processor, a memory, an input / output interface (Input / Output, referred to as I / O) and a communication interface. Among them, the processor, the memory and the input / output interface are connected through the system bus, and the communication interface is connected to the system bus through the input / output interface. Among them, the processor of the computer device is used to provide computing and control capability. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store screening item data. The input / output interface of the computer device is used to exchange information between the processor and external devices. The communication interface of the computer device is used to communicate with external terminals through network connection. The computer program is executed by the processor to realize a screening item search quality verification method.

[0102] Those skilled in the art can understand that, Figure 5 The structure shown in the figure is only a block diagram of part of the structure related to the scheme of the present application, and does not constitute a limitation on the computer device to which the scheme of the present application is applied. The specific computer device can include more or fewer components than those shown in the figure, or combine certain components, or have a different component arrangement.

[0103] In one embodiment, a computer readable storage medium is provided, which stores a computer program. The computer program is executed by the processor to realize the steps in the above method embodiments.

[0104] In one embodiment, a computer program product is provided, which includes a computer program. The computer program is executed by the processor to realize the steps in the above method embodiments.

[0105] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in the present application are all information and data authorized by the user or authorized by all parties, and the collection, use and processing of related data need to comply with relevant laws, regulations and standards of relevant countries and regions.

[0106] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a non-volatile computer readable storage medium, and when the computer program is executed, the processes of the above-mentioned embodiments of the methods can be included. Any reference to memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (Read-Only Memory, ROM), magnetic tape, floppy disk, flash memory, optical storage, high-density embedded non-volatile memory, resistive memory (ReRAM), magnetoresistive random access memory (Magnetoresistive Random Access Memory, MRAM), ferroelectric memory (Ferroelectric Random Access Memory, FRAM), phase change memory (Phase Change Memory, PCM), graphene memory, etc. Volatile memory can include random access memory (Random Access Memory, RAM) or external cache memory, etc. As an illustration but not limitation, RAM can be in various forms, such as static random access memory (Static Random Access Memory, SRAM) or dynamic random access memory (Dynamic Random Access Memory, DRAM), etc. The database involved in the embodiments provided in the present application can include at least one of a relational database and a non-relational database. The non-relational database can include a distributed database based on a block chain, etc., without being limited thereto. The processor involved in the embodiments provided in the present application can be a general-purpose processor, a central processing unit, a graphics processing unit, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, etc., without being limited thereto.

[0107] Any combination of the technical features of the above embodiments can be made. In order to make the description simple, all possible combinations of the technical features in the above embodiments are not described, however, as long as the combination of the technical features does not exist contradictory, it should be considered as the scope of the present application.

[0108] The above embodiments only express several implementation manners of the present application, and the description is more specific and detailed, but it should not be understood as a limitation on the scope of the patent of the present application. It should be pointed out that for ordinary skilled in the art, without departing from the concept of the present application, a number of modifications and improvements can be made, which are within the scope of protection of the present application. Therefore, the protection scope of the present application should be subject to the appended claims.

Claims

1. A method of verifying the quality of a search of a selection item, characterized by, The method comprises: determining a plurality of filter option combination manners for a search object according to historical search records of a user; determining a target filter option combination manner from the plurality of filter option combination manners based on the number of occurrences of each filter option combination manner in the historical search records; combining the target filter option combination manner and target parameter values under each filter option included in the target filter option combination manner to obtain a to-be-verified filter condition; the filter options included in the to-be-verified filter condition correspond to the filter options in the target filter option combination manner; performing search through the to-be-verified filter condition at two different search time points to obtain a first search result and a second search result; determining the search quality of the filter options included in the to-be-verified filter condition based on difference information between the first search result and the second search result and a matching result between the second search result and the to-be-verified filter condition; wherein the difference information between the first search result and the second search result is determined by obtaining a change ratio of the number of search results corresponding to the first search result and the second search result, and determining the change ratio and a change ratio threshold corresponding to the first search result and a size relationship between the number of search results corresponding to the first search result and the second search result; the change ratio threshold corresponding to the first search result is determined by determining a target numerical interval corresponding to the number of search results included in the first search result from a plurality of preset numerical intervals and obtaining a change ratio threshold corresponding to the target numerical interval; each numerical interval has a corresponding change ratio threshold.

2. The method of claim 1, wherein, The method comprises: sorting the plurality of filter option combination manners according to the number of occurrences; determining a filter option combination manner corresponding to a number of occurrences greater than that of other filter option combination manners from the plurality of filter option combination manners as a target filter option combination manner; the other filter option combination manners are filter option combination manners other than the target filter option combination manner in the plurality of filter option combination manners.

3. The method of claim 1, wherein, Before the combining the target filter option combination manner and target parameter values under each filter option included in the target filter option combination manner to obtain a to-be-verified filter condition, the method further comprises: obtaining the number of search results of each parameter value under each filter option; determining a target parameter value from each parameter value under the filter option based on the number of search results.

4. The method of claim 3, wherein, The method comprises: sorting each parameter value under the filter option according to the number of search results; According to the sorting result, a parameter value corresponding to a search result number greater than search result numbers of other parameter values is determined as a target parameter value from the parameter values.

5. The method of claim 1, wherein, The search quality of the screening item included in the to-be-verified screening condition is determined based on difference information between the first screening result and the second screening result, and a matching result between the second screening result and the to-be-verified screening condition, and the search quality comprises: first search quality information is determined based on the difference information between the first screening result and the second screening result; second search quality information is determined based on the matching result between the second screening result and the to-be-verified screening condition; the search quality of the screening item included in the to-be-verified screening condition is obtained according to the first search quality information and the second search quality information.

6. A search quality verification apparatus characterized by comprising: The apparatus comprises: a first data confirmation module configured to determine a plurality of screening item combination manners for a search object according to historical search records of a user; a second data confirmation module configured to determine a target screening item combination manner from the plurality of screening item combination manners according to a number of occurrences of each screening item combination manner in the historical search records; a data processing module configured to perform combination processing on the target screening item combination manner and target parameter values under each screening item included in the target screening item combination manner to obtain a to-be-verified screening condition; the screening items included in the to-be-verified screening condition correspond to the screening items in the target screening item combination manner; a data retrieval module configured to perform retrieval through the to-be-verified screening condition at two different search time points to obtain a first screening result and a second screening result; a search quality determination module configured to determine the search quality of the screening item included in the to-be-verified screening condition based on difference information between the first screening result and the second screening result, and a matching result between the second screening result and the to-be-verified screening condition; wherein the difference information between the first screening result and the second screening result is determined by obtaining a variation ratio of search result numbers corresponding to the first screening result and the second screening result, and determining the variation ratio based on the variation ratio and a variation ratio threshold corresponding to the first screening result, and a size relationship between the search result numbers corresponding to the first screening result and the second screening result; the variation ratio threshold corresponding to the first screening result is determined by determining a target numerical interval corresponding to the search result numbers included in the first screening result from a plurality of preset numerical intervals, and obtaining a variation ratio threshold corresponding to the target numerical interval; each numerical interval has a corresponding variation ratio threshold. 7.A computer device, comprising a memory and a processor, wherein the memory stores a computer program, and the computer device is configured to perform the method according to any one of claims 1-6 when the computer program is executed by the processor. The processor executes the computer program to implement the steps of the method of any one of claims 1 to 5.

8. A computer-readable storage medium having stored thereon a computer program, characterized in that, The computer program is executed by the processor to implement the steps of the method of any one of claims 1 to 5.

9. A computer program product comprising a computer program, characterized in that, The computer program is executed by the processor to implement the steps of the method of any one of claims 1 to 5. The computer program is executed by the processor to implement the steps of the method of any one of claims 1 to 5.

Citation Information

Patent Citations

  • Search quality assessment method and apparatus

    CN107704467A