Test method, device and equipment for sorting strategy of search engine of recruitment platform

Through the automated search engine sorting strategy testing method, multiple use cases and weight scoring items are used to calculate the total sorting score of search results, solving the problems of inefficient and insufficient accuracy of manual testing in the existing technology, and achieving efficient and accurate sorting Strategy testing.

CN119088714AActive Publication Date: 2024-12-06QIAN JIN NETWORK INFORMATION TECH SHANGHAI LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202411250142.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-06
Publication Date
2024-12-06
Estimated Expiration
2044-09-06

AI Technical Summary

Technical Problem

The search engine sorting strategy test of existing recruitment platforms relies on manual execution, which is inefficient and susceptible to human factors, making it difficult to fully cover complex algorithms and multiple factors, resulting in insufficient accuracy and coverage of test results.

Method used

Provide an automated search engine sorting strategy testing method, calculate the total sorting score of search results through multiple use cases and preset weight scoring items, and judge whether the test passes or fails based on the difference value or quotient, reducing human factors and improving the test Efficiency and accuracy.

Benefits of technology

It realizes automated testing of the search engine sorting strategy of the recruitment platform, significantly improves the testing efficiency and accuracy of results, reduces test omissions, and is suitable for the needs of rapid iteration and continuous optimization.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119088714A_ABST
    Figure CN119088714A_ABST
Patent Text Reader

Abstract

The invention discloses a test method, device and equipment for a search engine sorting strategy of a recruitment platform, and the method comprises the steps: obtaining a first search result and a second search result which are used for testing a target case, the target weight to-be-scored items of the first search result and the second search result are different, and the other weight to-be-scored items are the same; running a plurality of use cases of the search engine to obtain weights of a plurality of to-be-scored items in the first search result and weights of a plurality of to-be-scored items in the second search result; according to the obtained weight, calculating a first sorting total score of the first search result, and calculating a second sorting total score of the second search result; calculating a difference or a quotient between the first sorting total score and the second sorting total score to obtain a test weight of the target weight item to be scored; comparing the test weight with the expected weight, and if the test weight is consistent with the expected weight, judging that the target case passes the test; and if not, determining that the test of the target case is not passed. The test efficiency and the coverage rate of the sorting strategy can be improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of big data service technology, and in particular to a testing method, device, electronic device, computer-readable storage medium and computer program product for a search engine ranking strategy of a recruitment platform. Background Art

[0002] The search engine of the recruitment platform allows users to search for desired positions or job seekers' resumes, so that job seekers can find suitable positions and companies, or recruiters can find suitable talents. In the search process, it is usually necessary to rely on sorting strategies to sort the multiple search results. For example, sort the search results according to the degree of match between the search keywords and the recruitment information, or sort them according to the release time of the recruitment information, or sort them according to the completeness and quality of the recruitment information, etc.

[0003] When a new sorting strategy is created or updated, the sorting strategy needs to be tested. However, current sorting strategy testing often relies on manual execution, which is not only time-consuming and labor-intensive, but also inefficient. With the continuous expansion and update of search engine functions, manual testing can no longer meet the needs of rapid iteration and continuous optimization. Moreover, manual testing is easily affected by human factors, such as fatigue and distraction, which can lead to errors in test results. Manual testing is also difficult to cover all possible test scenarios and boundary conditions, which may miss some potential problems.

[0004] In addition, the search engine ranking strategies of recruitment platforms usually involve multiple factors and complex algorithms, including but not limited to keyword matching, user behavior analysis, weight calculation, etc. Current testing methods often fail to fully cover these factors and algorithms, resulting in insufficient comprehensiveness and accuracy of test results. Summary of the invention

[0005] In view of this, embodiments of the present application provide a method, device, electronic device, computer-readable storage medium and computer program product for testing a search engine ranking strategy of a recruitment platform, which are used to solve at least one of the above technical problems.

[0006] The embodiment of the present application provides a test method for a search engine ranking strategy of a recruitment platform. The search engine is provided with a plurality of use cases. The plurality of use cases are used to score a plurality of weighted items to be scored in the search results for any search result based on a plurality of preset weighted scoring items and a scoring standard of each weighted scoring item, and obtain the weight of each weighted item to be scored. The plurality of use cases correspond one-to-one to the plurality of weighted scoring items and the plurality of weighted items to be scored, respectively. The ranking strategy is to calculate the total ranking score of the search result for any search result according to the weights of the plurality of weighted items to be scored in the search result, and to sort the plurality of search results in descending order of the total ranking scores. The test method for the search engine ranking strategy of the recruitment platform includes:

[0007] A first search result and a second search result for testing a target use case are obtained, wherein the target weight items to be scored in the first search result and the second search result are different, and other weight items to be scored except the target weight item to be scored are the same, and the target weight item to be scored is a weight item to be scored corresponding to the target use case; the target weight item to be scored in the first search result meets the preset recruitment or job search requirements, and the target weight item to be scored in the second search result does not meet the recruitment or job search requirements, and the scoring standard of the target weight item is that the target weight item to be scored is given a weight N1 if it meets the recruitment or job search requirements, and a weight N2 if it does not meet the recruitment or job search requirements, and N1>N2;

[0008] Run multiple use cases of the search engine to obtain weights of multiple weighted items to be rated in the first search result and weights of multiple weighted items to be rated in the second search result; calculate a first ranking total score of the first search result based on the weights of the multiple weighted items to be rated in the first search result, and calculate a second ranking total score of the second search result based on the weights of the multiple weighted items to be rated in the second search result; calculate the difference or quotient between the first ranking total score and the second ranking total score, and use the difference or quotient as the test weight of the target weighted item to be rated; compare the test weight of the target weighted item to be rated with the expected weight of the target weighted item to be rated, if they are consistent, determine that the target use case test has passed; if they are inconsistent, determine that the target use case test has failed.

[0009] According to some embodiments of the present application, optionally, multiple weight scoring items include a first type of weight scoring items and a second type of weight scoring items, the first type of weight scoring items are weight scoring items determined based on the user's historical behavior, and the second type of weight scoring items are weight scoring items determined based on the basic attributes of the search results; when the search result is a job seeker's resume, the first type of weight scoring items include a resume weight scoring item that the recruiter is not interested in, and the second type of weight scoring items include at least one of a search term similarity weight scoring item, a resume active time decay weight scoring item, a recent job function in the resume hits the recruitment function weight scoring item, a recent job industry in the resume hits the recruitment industry weight scoring item, a salary weight scoring item, and an education weight scoring item; when the search result is a job application, the first type of weight scoring items include at least one of a job applicant's applied position weight scoring item, a job seeker's not interested region weight scoring item, and a job seeker's not interested commuting distance weight scoring item, and the second type of weight scoring items include at least one of a search term similarity weight scoring item, a salary weight scoring item, a function weight scoring item, and an office location weight scoring item.

[0010] According to some embodiments of the present application, optionally, the first search result is a resume of a first job seeker, and the second search result is a resume of a second job seeker; according to the weights of multiple weighted items to be scored in the first search result, a first ranking total score of the first search result is calculated, and according to the weights of multiple weighted items to be scored in the second search result, a second ranking total score of the second search result is calculated, including: calculating the weights of multiple weighted items to be scored in the resume of the first job seeker according to a first total score formula to obtain a first ranking total score of the resume of the first job seeker; calculating the weights of multiple weighted items to be scored in the resume of the second job seeker according to the first total score formula to obtain a second ranking total score of the resume of the second job seeker; wherein the expression of the first total score formula is: F 总分1 =F1*F2*F3*F4*F5*F6*F7, where F 总分1 It represents the total score of resume ranking, F1 represents the weight of search term similarity, F2 represents the weight of resume active time decay, F3 represents the weight of the most recent job function in the resume hitting the recruitment function, F4 represents the weight of the most recent job industry in the resume hitting the recruitment industry, F5 represents the salary weight, F6 represents the education weight, and F7 represents the weight of resumes that the recruiter is not interested in.

[0011] According to some embodiments of the present application, optionally, the first search result is the first job position to be applied for, and the second search result is the second job position to be applied for; according to the weights of multiple weighted items to be rated in the first search result, a first ranking total score of the first search result is calculated, and according to the weights of multiple weighted items to be rated in the second search result, a second ranking total score of the second search result is calculated, including: calculating the weights of multiple weighted items to be rated in the first job position to be applied for according to a second total score formula to obtain the first ranking total score of the first job position to be applied for; calculating the weights of multiple weighted items to be rated in the second job position to be applied for according to the second total score formula to obtain the second ranking total score of the second job position to be applied for; wherein the expression of the second total score formula is: F 总分2 =F1'*F2'*F3'*F4'*F5'*F6'*F7', where F 总分2 It represents the total score of job ranking, F1' represents the weight of search term similarity, F2' represents the weight of job seekers' applied jobs, F3' represents the weight of salary, F4' represents the weight of function, F5' represents the weight of office location, F6' represents the weight of regions that job seekers are not interested in, and F7' represents the weight of commuting distance that job seekers are not interested in.

[0012] According to some embodiments of the present application, optionally, the testing method of the search engine ranking strategy of the recruitment platform also includes: after multiple use cases are tested, if it is detected that the ranking strategy is updated, and the update is to add a new weight scoring item and its corresponding new use case, then the new use case is used as the target use case, so that only the new use case pairs are tested, and the existing use cases are not tested.

[0013] According to some embodiments of the present application, optionally, multiple use cases of a search engine are run to obtain weights of multiple weighted items to be scored in a first search result and weights of multiple weighted items to be scored in a second search result, including: placing multiple use cases in a comma-separated value CSV file, each use case including at least a use case ID, a use case description, and an expected result; reading multiple use cases in the CSV file, and parameterizing the read multiple use cases; placing the first search result, the second search result, and the user's historical behavior data as pre-data in the CSV file, the user's historical behavior data being used to set a first type of weighted scoring item, the first search result and the second search result corresponding to a target ID of the target use case; calling a search engine interface to run multiple use cases of the search engine, the multiple use cases being specifically used to retrieve the first search result and the second search result corresponding to the target ID in the CSV file, and scoring the multiple weighted items to be scored in the first search result and the second search result, to obtain the weights of the multiple weighted items to be scored in the first search result and the weights of the multiple weighted items to be scored in the second search result.

[0014] The embodiment of the present application provides a test device for a search engine ranking strategy of a recruitment platform. The search engine is provided with multiple use cases. The multiple use cases are used to score multiple weighted items to be scored in the search results for any search result based on multiple preset weighted scoring items and scoring criteria of each weighted scoring item, and obtain the weight of each weighted item to be scored. The multiple use cases correspond one-to-one to the multiple weighted scoring items and the multiple weighted items to be scored respectively; the ranking strategy is to calculate the total ranking score of the search result for any search result according to the weights of the multiple weighted items to be scored in the search result, and to sort the multiple search results in descending order of the total ranking scores. The test device for the search engine ranking strategy of the recruitment platform includes:

[0015] An acquisition module is used to acquire a first search result and a second search result for testing a target use case, wherein the target weight items to be scored in the first search result and the second search result are different, and the other weight items to be scored except the target weight items to be scored are the same, and the target weight items to be scored are weight items to be scored corresponding to the target use case; the target weight items to be scored in the first search result meet the preset recruitment or job search requirements, and the target weight items to be scored in the second search result do not meet the recruitment or job search requirements, and the scoring standard of the target weight items is that the target weight items to be scored are given a weight of N1 if they meet the recruitment or job search requirements, and a weight of N2 if they do not meet the recruitment or job search requirements, and N1>N2;

[0016] An operation module is used to run multiple use cases of the search engine to obtain weights of multiple weighted items to be rated in the first search result and weights of multiple weighted items to be rated in the second search result;

[0017] A first calculation module, configured to calculate a first ranking total score of the first search result according to the weights of the multiple weighted items to be rated in the first search result, and to calculate a second ranking total score of the second search result according to the weights of the multiple weighted items to be rated in the second search result;

[0018] A second calculation module is used to calculate the difference or quotient between the first ranking total score and the second ranking total score, and use the difference or quotient as the test weight of the target weight to be scored item;

[0019] The judgment module is used to compare the test weight of the target weight to be scored item with the expected weight of the target weight to be scored item. If they are consistent, it is determined that the target case test has passed; if they are inconsistent, it is determined that the target case test has failed.

[0020] An embodiment of the present application provides an electronic device, which includes a processor and a memory storing computer program instructions; when the processor executes the computer program instructions, the steps of the test method of the search engine ranking strategy of the recruitment platform as described above are implemented.

[0021] An embodiment of the present application provides a computer-readable storage medium having computer program instructions stored thereon. When the computer program instructions are executed by a processor, the steps of the method for testing the search engine ranking strategy of the recruitment platform as described above are implemented.

[0022] An embodiment of the present application provides a computer program product, which includes computer program instructions. When the computer program instructions are executed by a processor, the steps of the method for testing the search engine ranking strategy of the recruitment platform as described above are implemented.

[0023] The test method, device, electronic device, computer-readable storage medium and computer program product of the search engine ranking strategy of the recruitment platform provided by the embodiments of the present application, on the one hand, for the target use case in multiple use cases of the search engine ranking strategy, the target weight items to be scored in the first search result and the second search result are different, and other weight items to be scored except the target weight items to be scored are the same; the target weight items to be scored in the first search result meet the preset recruitment or job search requirements, and the target weight items to be scored in the second search result do not meet the recruitment or job search requirements, and the scoring criteria for the target weight scoring items are that the target weight items to be scored are given a weight N1 if they meet the recruitment or job search requirements, and a weight N2 if they do not meet the recruitment or job search requirements, and N1>N2; therefore, by running the target use case of the search engine, the weight of the target weight items to be scored in the first search result is different from the target weight items in the second search result. The weights of the items to be scored should be different in theory, and then the first ranking total score of the first search result is calculated based on the weights of multiple weighted items to be scored in the first search result; the second ranking total score of the second search result is calculated based on the weights of multiple weighted items to be scored in the second search result; the first ranking total score and the second ranking total score should also be different in theory; then, the difference or quotient between the first ranking total score and the second ranking total score is calculated, and the difference or quotient is used as the test weight of the target weighted item to be scored; finally, the test weight of the target weighted item to be scored is compared with the expected weight of the target weighted item to be scored. If they are consistent, it can be said that the target case test has passed; if they are inconsistent, it can be said that the target case test has failed, thereby realizing automated testing of the use cases in the sorting strategy, which can significantly improve test efficiency, reduce the impact of human factors, and help improve the accuracy and reliability of test results.

[0024] On the other hand, even if the sorting strategy may involve multiple weighted items to be scored and complex algorithms, by splitting each of the multiple weighted items to be scored and testing the use cases corresponding to each weighted item to be scored in turn, it is possible to reduce omissions during testing and improve test coverage. On the other hand, when the sorting strategy is updated, only the updated use cases can be tested, and the existing use cases are not tested, which can greatly reduce the changes to the test scripts and test processes, improve test efficiency, and reduce the cost of developing test scripts. It is suitable for scenarios where the search engine sorting strategy of the recruitment platform is constantly updated and optimized. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] In order to more clearly illustrate the technical solution of the embodiments of the present application, the following briefly introduces the drawings in the embodiments of the present application.

[0026] Figure 1 A flowchart of a method for testing a search engine ranking strategy of a recruitment platform provided in an embodiment of the present application.

[0027] Figure 2 A flowchart of S102 in the method for testing the search engine ranking strategy of the recruitment platform provided in an embodiment of the present application.

[0028] Figure 3 A structural schematic diagram of a testing device for a search engine ranking strategy of a recruitment platform provided in an embodiment of the present application.

[0029] Figure 4 A schematic diagram of an electronic device for implementing a method for testing a search engine ranking strategy of a recruitment platform according to an embodiment of the present application. DETAILED DESCRIPTION

[0030] The principles and spirit of the present application will be described below with reference to several exemplary embodiments. It should be understood that the purpose of providing these embodiments is to make the principles and spirit of the present application clearer and more thorough, so that those skilled in the art can better understand and implement the principles and spirit of the present application. The exemplary embodiments provided herein are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments herein, all other embodiments obtained by ordinary technicians of the art without creative work are within the scope of protection of this application.

[0031] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the statement "include..." do not exclude the presence of other identical elements in the process, method, article or device including the elements.

[0032] It should be understood that the term "and / or" used in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the associated objects before and after are in an "or" relationship.

[0033] It is obvious to those skilled in the art that various modifications and changes can be made in the present application without departing from the spirit or scope of the present application. Therefore, the present application is intended to cover modifications and changes of the present application that fall within the scope of the corresponding claims (technical solutions for protection) and their equivalents. It should be noted that the implementation methods provided in the embodiments of the present application can be combined with each other without contradiction.

[0034] Before describing the technical solutions provided by the embodiments of the present application, in order to facilitate the understanding of the embodiments of the present application, the present application first specifically describes the problems existing in the related art:

[0035] The search engine of the recruitment platform allows users to search for desired positions or job seekers' resumes, so that job seekers can find suitable positions and companies, or recruiters can find suitable talents. In the search process, it is usually necessary to rely on sorting strategies to sort the multiple search results. For example, sort the search results according to the degree of match between the search keywords and the recruitment information, or sort them according to the release time of the recruitment information, or sort them according to the completeness and quality of the recruitment information, etc.

[0036] When a new sorting strategy is created or updated, the sorting strategy needs to be tested. However, current sorting strategy testing often relies on manual execution, which is not only time-consuming and labor-intensive, but also inefficient. With the continuous expansion and update of search engine functions, manual testing can no longer meet the needs of rapid iteration and continuous optimization. Moreover, manual testing is easily affected by human factors, such as fatigue and distraction, which can lead to errors in test results. Manual testing is also difficult to cover all possible test scenarios and boundary conditions, which may miss some potential problems.

[0037] In addition, the search engine ranking strategies of recruitment platforms usually involve multiple factors and complex algorithms, including but not limited to keyword matching, user behavior analysis, weight calculation, etc. Current testing methods often fail to fully cover these factors and algorithms, resulting in insufficient comprehensiveness and accuracy of test results.

[0038] In view of the above research findings of the inventors, the embodiments of the present application provide a method, device, equipment and computer-readable storage medium for testing the search engine ranking strategy of a recruitment platform, which can solve at least one of the above technical problems existing in the related art.

[0039] The following first introduces the testing method of the search engine ranking strategy of the recruitment platform provided in the embodiment of the present application.

[0040] Users can enter search terms (or search keywords) in the search engine of the recruitment platform (hereinafter referred to as the search engine), and the search engine can search for multiple search results based on the search terms, such as job seekers' resumes or job applications. The sorting strategy of the search engine can sort multiple search results. Specifically, the search engine can be provided with multiple use cases, and the multiple use cases can be used for any search result, based on the preset multiple weight scoring items and the scoring criteria of each weight scoring item, to score the multiple weighted items to be scored in the search results, and obtain the weights of each weighted item to be scored. The multiple use cases correspond to the multiple weighted scoring items and the multiple weighted items to be scored one by one. For example, use case a corresponds to the weighted scoring item f1 and the weighted item to be scored f1', and use case b corresponds to the weighted scoring item f2 and the weighted item to be scored f2', ..., and so on. Use case a can be used for any search result, based on the preset weighted scoring item f1 and the scoring criteria of the weighted scoring item f1, to score the weighted item to be scored f1' in the search results, and obtain the weight of the weighted item to be scored f1'. Use case b can be used to score the weighted scoring item f2' in the search result for any search result based on the preset weighted scoring item f2 and the scoring standard of the weighted scoring item f2, so as to obtain the weight of the weighted scoring item f2'.

[0041] The sorting strategy may be to calculate the total sorting score of any search result according to the weights of multiple weighted items to be scored in the search result, and sort the multiple search results in descending order of the total sorting scores.

[0042] Figure 1 A flow chart of a method for testing a search engine ranking strategy of a recruitment platform provided in an embodiment of the present application. Figure 1 As shown, the method for testing the search engine ranking strategy of the recruitment platform provided in the embodiment of the present application may include the following steps S101 to S105.

[0043] S101: Obtain a first search result and a second search result for testing a target use case.

[0044] The target use case can be any one of the multiple use cases, the weight scoring item corresponding to the target use case is called the target weight scoring item, and the weight to-be-scored item corresponding to the target use case is called the target weight to-be-scored item. The target use case is used to score the target weight to-be-scored item in the search results based on the target weight scoring item and the scoring criteria of the target weight scoring item to obtain the weight of the target weight to-be-scored item.

[0045] The target weight items to be scored in the first search result and the second search result are different, and the weight items to be scored other than the target weight items to be scored are the same. Taking the first search result as the resume of the first job seeker and the second search result as the resume of the second job seeker as an example, assuming that the target weight item to be scored is academic qualifications, the target weight item to be scored in the first search result is, for example, "undergraduate degree", and the target weight item to be scored in the second search result is, for example, "high school degree". The first search result and the second search result have the same weight items to be scored other than the target weight item to be scored. For example, still taking the first search result as the resume of the first job seeker and the second search result as the resume of the second job seeker as an example, for example, the active time of the resumes, job functions, work industries, salary requirements, etc. in the first search result and the second search result, except for the target weight items to be scored, are the same. For example, the active time of the resumes is active in the past 3 days, the job functions are all research and development, the work industries are all Internet, and the salary requirements are all monthly salaries of more than 10,000 yuan.

[0046] The target weighted items to be scored in the first search result meet the preset recruitment or job search requirements, and the target weighted items to be scored in the second search result do not meet the recruitment or job search requirements. The scoring criteria for the target weighted scoring items are that the target weighted items to be scored meet the recruitment or job search requirements and are given a weight N1, and the target weighted items to be scored do not meet the recruitment or job search requirements and are given a weight N2, where N1>N2. The size of N1 and N2 can be flexibly adjusted according to actual conditions, and this application does not limit this. For example, in some examples, N1 can be equal to 10, and N2 can be equal to 1.

[0047] For example, the first search result is the resume of the first job seeker, and the second search result is the resume of the second job seeker. Assuming that the target weight scoring item is academic qualifications, the scoring criteria for the target weight scoring item are that the academic qualifications meet the recruitment requirements and give a weight of N1, and the academic qualifications do not meet the recruitment requirements and give a weight of N2. Recruitment requirements can be flexibly adjusted according to actual conditions, and this application does not limit this. For example, in some examples, for academic qualifications, the recruitment requirement can be a bachelor's degree or above.

[0048] Assuming that the target weight to be scored item in the first job applicant's resume is "undergraduate degree", and the target weight to be scored item in the second job applicant's resume is "high school degree", it can be seen that the target weight to be scored item in the first job applicant's resume meets the recruitment requirements, so if there is no abnormality in the target case, the target weight to be scored item in the first job applicant's resume should theoretically be given a weight of N1. Since the target weight to be scored item in the second job applicant's resume does not meet the recruitment requirements, if there is no abnormality in the target case, the target weight to be scored item in the second job applicant's resume should theoretically be given a weight of N2.

[0049] In other embodiments, optionally, the first search result may also be the first job position, and the second search result may also be the second job position. Taking the first search result as the first job position, and the second search result as the second job position as an example, assuming that the target weight scoring item is salary, the scoring criteria of the target weight scoring item is that the salary meets the job application requirements and is given a weight of N1, and the salary does not meet the job application requirements and is given a weight of N2. The job application requirements can be flexibly adjusted according to actual conditions, and this application does not limit this. For example, in some examples, for salary, the job application requirement can be a salary of more than 10,000 yuan per month.

[0050] Assuming that the target weight to be scored in the first job position is "monthly salary of more than 10,000", and the target weight to be scored in the second job position is "monthly salary of 8,000", it can be seen that the target weight to be scored in the first job position meets the job search requirements, so if there is no abnormality in the target use case, the weight of the target weight to be scored in the first job position should theoretically be N1. Since the target weight to be scored in the second job position does not meet the recruitment requirements, if there is no abnormality in the target use case, the weight of the target weight to be scored in the second job position should theoretically be N2.

[0051] S102: Running multiple use cases of the search engine to obtain weights of multiple weighted items to be rated in the first search result and weights of multiple weighted items to be rated in the second search result.

[0052] In S102, multiple use cases of the search engine are run, and the multiple use cases can be used to score multiple weighted items to be scored in the first search result based on multiple preset weighted scoring items and scoring criteria for each weighted scoring item, and obtain the weight of each weighted item to be scored in the first search result. The multiple use cases can also be used to score multiple weighted items to be scored in the second search result based on multiple preset weighted scoring items and scoring criteria for each weighted scoring item, and obtain the weight of each weighted item to be scored in the second search result.

[0053] Multiple use cases correspond one-to-one to multiple weight scoring items and multiple weight to-be-scored items, respectively. For example, use case a corresponds to weight scoring item f1 and weight to-be-scored item f1', and so on. Use case a can be used for the first search result, based on the preset weight scoring item f1 and the scoring criteria of weight scoring item f1, to score the weight to-be-scored item f1' in the first search result, and obtain the weight of the weight to-be-scored item f1' in the first search result. Use case a can also be used for the second search result, based on the preset weight scoring item f1 and the scoring criteria of weight scoring item f1, to score the weight to-be-scored item f1' in the second search result, and obtain the weight of the weight to-be-scored item f1' in the second search result.

[0054] For the target use case, the target use case can be used to score the target weight to be scored items in the first search result based on the target weight scoring items and the scoring criteria of the target weight scoring items, and obtain the weight of the target weight to be scored items in the first search result, and to score the target weight to be scored items in the second search result, and obtain the weight of the target weight to be scored items in the second search result.

[0055] Since the target weighted items to be rated in the first search result are different from those in the second search result, theoretically, the weight of the target weighted items to be rated in the first search result should be different from that of the target weighted items to be rated in the second search result.

[0056] Since the first search result and the second search result have the same weighted items to be rated except the target weighted item to be rated, the weights of the other weighted items to be rated in the first search result obtained by other use cases should be the same as the weights of the other weighted items to be rated in the second search result.

[0057] S103: Calculate a first ranking total score of the first search result according to the weights of the multiple weighted items to be rated in the first search result, and calculate a second ranking total score of the second search result according to the weights of the multiple weighted items to be rated in the second search result.

[0058] In S103, a first ranking total score of the first search result may be calculated based on the weights of the weighted items to be rated in the first search result and a preset algorithm. A second ranking total score of the second search result may be calculated based on the weights of the weighted items to be rated in the second search result and the preset algorithm.

[0059] The first search result and the second search result use the same preset algorithm. The preset algorithm can be flexibly adjusted according to actual conditions, and this application does not limit this. For example, the preset algorithm can be addition or multiplication.

[0060] For example, in some examples, the weights of multiple weighted items to be rated in the first search result can be added together to obtain a first ranked total score of the first search result; the weights of multiple weighted items to be rated in the second search result can be added together to obtain a second ranked total score of the second search result.

[0061] For example, in other examples, the weights of multiple weighted items to be rated in the first search result can be multiplied to obtain a first ranking total score of the first search result; the weights of multiple weighted items to be rated in the second search result can be multiplied to obtain a second ranking total score of the second search result.

[0062] S104: Calculate the difference or quotient between the first ranking total score and the second ranking total score, and use the difference or quotient as the test weight of the target weight to be scored item.

[0063] In the case where the above preset algorithm is addition, after obtaining the first ranking total score and the second ranking total score, the difference between the first ranking total score and the second ranking total score can be calculated, and the difference can be used as the test weight of the target weight to be scored item. Alternatively, in the case where the above preset algorithm is multiplication, after obtaining the first ranking total score and the second ranking total score, the quotient of the first ranking total score and the second ranking total score can be calculated, and the quotient can be used as the test weight of the target weight to be scored item.

[0064] S105: Compare the test weight of the target weight to be scored item with the expected weight of the target weight to be scored item. If they are consistent, it is determined that the target case test has passed; if they are inconsistent, it is determined that the target case test has failed.

[0065] Taking the example that the test weight of the target weight item to be scored is the quotient of the total score of the first ranking and the total score of the second ranking, the expected weight of the target weight item to be scored can be N1 / N2. N1 and N2 are known, so the expected weight N1 / N2 of the target weight item to be scored is known. As mentioned above, when there is no abnormality in the target use case, the weight of the target weight item to be scored in the first search result should be N1, and the weight of the target weight item to be scored in the second search result should be N2. Therefore, when there is no abnormality in the target use case, the test weight of the target weight item to be scored should also be N1 / N2.

[0066] Taking the test weight of the target weight item to be scored as the difference between the total score of the first ranking and the total score of the second ranking as an example, the expected weight of the target weight item to be scored can be N1-N2. N1 and N2 are known, so the expected weight N1-N2 of the target weight item to be scored is known. As mentioned above, when there is no abnormality in the target use case, the weight of the target weight item to be scored in the first search result should be N1, and the weight of the target weight item to be scored in the second search result should be N2. Therefore, when there is no abnormality in the target use case, the test weight of the target weight item to be scored should also be N1-N2.

[0067] If the test weight of the target weight to be scored item is consistent with the expected weight of the target weight to be scored item, it can be said that there is no abnormality in the target use case and the target use case test is judged to have passed. If the test weight of the target weight to be scored item is inconsistent with the expected weight of the target weight to be scored item, it can be said that there is an abnormality in the target use case and the target use case test is judged to have failed.

[0068] For multiple use cases of the search engine ranking strategy, after the current target use case is tested, an untested use case is used as a new target use case, and the process returns to step S101, and steps S101 to S105 are repeated until multiple use cases are tested.

[0069] It should be noted that different use cases correspond to different weighted scoring items, and different use cases correspond to different weighted to-be-scored items. Accordingly, when updating the target use case, the first search result and the second search result corresponding to the current target use case need to be used.

[0070] The embodiment of the present application provides a testing method for the search engine ranking strategy of a recruitment platform. On the one hand, for a target use case in multiple use cases of the search engine ranking strategy, the target weight items to be scored in the first search result and the second search result are different, and other weight items to be scored except the target weight items to be scored are the same; the target weight items to be scored in the first search result meet the preset recruitment or job-seeking requirements, and the target weight items to be scored in the second search result do not meet the recruitment or job-seeking requirements. The scoring criteria for the target weight scoring items are that the target weight scoring items that meet the recruitment or job-seeking requirements are given a weight N1, and those that do not meet the recruitment or job-seeking requirements are given a weight N2, and N1>N2; therefore, by running the target use case of the search engine, the weights of the target weight items to be scored in the first search result and the weights of the target weight items to be scored in the second search result obtained should theoretically be different. The same, and then calculate the first ranking total score of the first search result according to the weights of multiple weighted items to be scored in the first search result; calculate the second ranking total score of the second search result according to the weights of multiple weighted items to be scored in the second search result; the first ranking total score and the second ranking total score should also be different in theory; then, calculate the difference or quotient between the first ranking total score and the second ranking total score, and use the difference or quotient as the test weight of the target weighted item to be scored; finally, compare the test weight of the target weighted item to be scored with the expected weight of the target weighted item to be scored. If they are consistent, it can be said that the target case test has passed; if they are inconsistent, it can be said that the target case test has not passed, so that the automated testing of the use cases in the sorting strategy can be achieved, which can significantly improve the test efficiency, reduce the influence of human factors, and is conducive to improving the accuracy and reliability of the test results.

[0071] On the other hand, even if the sorting strategy may involve multiple weighted items to be scored and complex algorithms, by splitting each of the multiple weighted items to be scored and testing the use cases corresponding to each weighted item to be scored in turn, it is possible to reduce omissions during testing and improve test coverage. On the other hand, when the sorting strategy is updated, only the updated use cases can be tested, and the existing use cases are not tested, which can greatly reduce the changes to the test scripts and test processes, improve test efficiency, and reduce the cost of developing test scripts. It is suitable for scenarios where the search engine sorting strategy of the recruitment platform is constantly updated and optimized.

[0072] According to some embodiments of the present application, optionally, multiple weight scoring items may include a first type of weight scoring item and a second type of weight scoring item. The first type of weight scoring item may be a weight scoring item determined based on the user's historical behavior, and the second type of weight scoring item is a weight scoring item determined based on the basic attributes of the search results. For example, the user's historical behavior may include determining, based on the user's historical operations on the recruitment platform, resumes that the user is not interested in, areas that the user is not interested in, functions that the user is not interested in, industries that the user is not interested in, salaries that the user is not interested in, and / or commuting distances that the user is not interested in. The resume that the user is not interested in may mean that the recruiter is not interested in the resume of a job seeker with one or more majors, one or more academic qualifications, one or more salaries, one or more addresses, one or more work experiences, one or more job functions, one or more work industries, and / or one or more personality hobbies.

[0073] The basic properties of the search results can be used to help users quickly understand the content of the search results.

[0074] In some embodiments, when the search result is a job seeker's resume, the first category of weight scoring items may include weight scoring items for resumes that the recruiter is not interested in, and the second category of weight scoring items may include at least one of search term similarity weight scoring items, resume active time decay weight scoring items, most recent job function in the resume hitting the recruiting function weight scoring items, most recent job industry in the resume hitting the recruiting industry weight scoring items, salary weight scoring items, and educational background weight scoring items.

[0075] Specifically, when a recruiter searches for a job seeker's resume through a search engine, the first type of weighted scoring item may include a weighted scoring item for a job seeker's not interested resume, and the scoring criteria for the weighted scoring item for a job seeker's not interested resume may be to give a lower weight if the job seeker's resume is a job seeker's not interested resume, that is, does not meet the recruitment requirements; and to give a higher weight if the job seeker's resume is not a job seeker's not interested resume. The weight can be flexibly adjusted according to actual conditions, and this application does not limit this.

[0076] When the search result is a job seeker's resume, the second category of weight scoring items may include at least one of a search term similarity weight scoring item, a resume active time decay weight scoring item, a most recent job function in the resume hitting the recruitment function weight scoring item, a most recent job industry in the resume hitting the recruitment industry weight scoring item, a salary weight scoring item, and an academic qualification weight scoring item.

[0077] The search term similarity weight scoring item is a weight scoring item of the similarity between the content of the job seeker's resume and the search term. The scoring criteria of the search term similarity weight scoring item can be that the higher the similarity between the two, the higher the weight given; conversely, the lower the similarity between the two, the lower the weight given.

[0078] The resume active time decay weight scoring item is a weight scoring item that measures the degree of decay of the resume active time (such as update time, viewing time, or submission time). The scoring criteria for the resume active time decay weight scoring item are that the closer the resume active time is to the current time, the higher the weight is; the farther the resume active time is from the current time, the lower the weight is.

[0079] The weighted scoring item of whether the most recent job function in the resume hits the current job function is a weighted scoring item of whether the most recent job function in the resume hits the current job function. For example, if the job function is R&D and the most recent job function in the resume is also R&D, then the most recent job function in the resume is determined to hit the job function and a higher weight is given; otherwise, a lower weight is given.

[0080] The weighted scoring item of whether the most recent job industry in the resume hits the recruitment industry is a weighted scoring item of whether the most recent job industry in the resume hits the current recruitment industry. For example, if the recruitment industry is the Internet and the most recent job industry in the resume is also the Internet, then the most recent job industry in the resume is determined to hit the recruitment industry and a higher weight is given; otherwise, a lower weight is given.

[0081] The salary weighted scoring item is a weighted scoring item for determining whether the expected salary in the applicant's resume is within the salary range of the recruitment requirements. The scoring criteria for the salary weighted scoring item may be that if the expected salary in the applicant's resume is within the salary range of the recruitment requirements, that is, the expected salary meets the recruitment requirements, a higher weight is given; otherwise, a lower weight is given.

[0082] The education weighted scoring item is a weighted scoring item for determining whether the education in the applicant's resume meets the recruitment requirements. The scoring criteria for the education weighted scoring item may be that if the education in the applicant's resume meets the recruitment requirements, a higher weight is given; otherwise, a lower weight is given.

[0083] Accordingly, the multiple weighted items to be scored of the job seeker's resume may include a weighted item for resumes that the recruiter is not interested in, as well as a weighted item for search term similarity, a weighted item for resume active time decay, a weighted item for the most recent job function in the resume hitting the recruiting function, a weighted item for the most recent job industry in the resume hitting the recruiting industry, a salary weighted item, and at least one of the weighted items for educational qualifications.

[0084] In this way, determining the weighted scoring items based on the user's historical behavior and the basic attributes of the search results is conducive to making the final sorting results conform to the user's habits and personalized needs, thereby improving the user experience.

[0085] When the search result is a resume of a job seeker, the first search result may be the resume of the first job seeker, and the second search result may be the resume of the second job seeker. The target weighted items to be scored in the first job seeker resume and the second job seeker resume are different, and other weighted items to be scored except the target weighted items are the same.

[0086] Correspondingly, S103: calculating the first ranking total score of the first search result according to the weights of multiple weighted items to be rated in the first search result, and calculating the second ranking total score of the second search result according to the weights of multiple weighted items to be rated in the second search result, can include the following steps one and two.

[0087] Step 1: Calculate the weights of multiple weighted scoring items in the resume of the first job applicant according to the first total score formula to obtain a first ranking total score of the resume of the first job applicant.

[0088] Step 2: Calculate the weights of multiple weighted scoring items in the second job applicant's resume according to the first total score formula to obtain a second ranking total score of the second job applicant's resume.

[0089] For example, the expression of the first total score formula may be:

[0090] F 总分1 =F1*F2* F3* F4* F5* F6* F7 (1)

[0091] Among them, F 总分1 It represents the total score of resume ranking, F1 represents the search term similarity weight, that is, the weight of the search term similarity weight item to be scored, F2 represents the resume active time decay weight, that is, the weight of the resume active time decay weight item to be scored, F3 represents the weight of the most recent job function in the resume hitting the recruitment function, that is, the weight of the most recent job function in the resume hitting the recruitment function weight item to be scored, F4 represents the weight of the most recent job industry in the resume hitting the recruitment industry, that is, the weight of the most recent job industry in the resume hitting the recruitment industry weight item to be scored, F5 represents the salary weight, that is, the weight of the salary weight item to be scored, F6 represents the academic qualification weight, that is, the weight of the academic qualification weight item to be scored, F7 represents the weight of resumes that the recruiter is not interested in, that is, the weight of the resume weight item to be scored.

[0092] Based on the above first total score formula, the total score of the resume ranking of the first job applicant, i.e., the first total score, can be obtained. At the same time, based on the above first total score formula, the total score of the resume ranking of the second job applicant, i.e., the second total score, can be obtained.

[0093] In other embodiments, when the search result is a job application, the first type of weighted scoring items may include at least one of a weighted scoring item of the job applicant's applied positions, a weighted scoring item of the region the job applicant is not interested in, and a weighted scoring item of the commuting distance the job applicant is not interested in. The second type of weighted scoring items may include at least one of a weighted scoring item of search term similarity, a weighted scoring item of salary, a weighted scoring item of function, and a weighted scoring item of office location.

[0094] Specifically, when a job seeker searches for a job through a search engine, the first type of weighted scoring items may include at least one of the weighted scoring items of the job seeker's applied positions, the weighted scoring items of the regions that the job seeker is not interested in, and the weighted scoring items of the commuting distance that the job seeker is not interested in. The job seeker's applied positions, the regions that the job seeker is not interested in, and the commuting distance that the job seeker is not interested in can all be determined based on the job seeker's historical data on the recruitment platform. The second type of weighted scoring items may include at least one of the weighted scoring items of search term similarity, salary, function, and office location.

[0095] The search term similarity weight scoring item is a weight scoring item for the similarity between the content of the job application and the search term. The scoring criteria for the search term similarity weight scoring item can be that the higher the similarity between the two, the higher the weight given; conversely, the lower the similarity between the two, the lower the weight given.

[0096] The salary weighted scoring item is a weighted scoring item that determines whether the salary offered by the job position is within the expected salary range of the job seeker. The scoring criteria for the salary weighted scoring item may be that if the salary offered by the job position is within the expected salary range of the job seeker, that is, the salary meets the job application requirements, a higher weight is given; otherwise, a lower weight is given.

[0097] The function weight scoring item is a weight scoring item for determining whether the function of the job position is the job seeker's expected function. The scoring criteria for the function weight scoring item may be that if the function of the job position is the job seeker's expected function, that is, the function meets the job application requirements, a higher weight is given; otherwise, a lower weight is given.

[0098] The office location weighted scoring item is a weighted scoring item for determining whether the office location of the job application is the job seeker's desired office location. The scoring criteria for the office location weighted scoring item may be that if the office location of the job application is the job seeker's desired office location, that is, the office location meets the job application requirements, a higher weight is given; otherwise, a lower weight is given.

[0099] Accordingly, the multiple weighted items to be scored for the applied position may include at least one of the weighted items to be scored for the position the job seeker has applied for, the weighted items to be scored for the area the job seeker is not interested in, and the weighted items to be scored for the commuting distance the job seeker is not interested in, as well as at least one of the weighted items to be scored for search term similarity, the weighted items to be scored for salary, the weighted items to be scored for function, and the weighted items to be scored for office location.

[0100] When the search results are job positions, the first search result may be the first job position, and the second search result may be the second job position. The first job position and the second job position have different target weights to be scored, and other weights to be scored are the same except for the target weights to be scored.

[0101] Correspondingly, S103: calculating the first ranking total score of the first search result according to the weights of multiple weighted items to be rated in the first search result, and calculating the second ranking total score of the second search result according to the weights of multiple weighted items to be rated in the second search result, may include the following steps three and four.

[0102] Step 3: Calculate the weights of multiple weighted scoring items in the first applied position according to the second total score formula to obtain the first ranking total score of the first applied position.

[0103] Step 4: Calculate the weights of multiple weighted scoring items in the second job application based on the second total score formula to obtain a second ranking total score for the second job application.

[0104] The expression of the second total score formula can be:

[0105] F 总分2 =F1'*F2'* F3'* F4'* F5'* F6'* F7' (2)

[0106] Among them, F 总分2 It represents the total score of job ranking, F1' represents the search term similarity weight, that is, the weight of the search term similarity weight item to be scored, F2' represents the weight of the job seeker's applied position, F3' represents the salary weight, F4' represents the function weight, F5' represents the office location weight, F6' represents the weight of the area that the job seeker is not interested in, and F7' represents the weight of the commuting distance that the job seeker is not interested in.

[0107] Based on the above second total score formula, the total position ranking score of the first applied position, i.e., the first ranking total score, can be obtained. At the same time, based on the above second total score formula, the total position ranking score of the second applied position, i.e., the second ranking total score, can be obtained.

[0108] According to some embodiments of the present application, optionally, the method for testing the search engine ranking strategy of the recruitment platform may further include the following steps:

[0109] After multiple use cases have been tested, if it is detected that the sorting strategy has been updated, and the update is to add a new weight scoring item and its corresponding new use case, the new use case will be used as the target use case, so that only the new use case pair is tested, and the existing use case is not tested.

[0110] Specifically, as search engine technology continues to develop, ranking strategies will also be continuously updated and optimized. However, current testing methods often find it difficult to adapt to these changes, requiring frequent adjustments to test scripts and test processes, which increases the complexity and difficulty of testing work.

[0111] In an embodiment of the present application, when it is detected that the sorting strategy has been updated, for the newly added weight scoring items and their corresponding new use cases, the new use cases are taken as target use cases, and the above steps S101 to S105 are executed to test only the new use case pairs and not the existing use cases.

[0112] In this way, when the sorting strategy is updated, by testing the updated use cases and not testing the existing use cases, the changes to the test scripts and test processes can be greatly reduced, the test efficiency can be improved, and the cost of developing test scripts can be reduced. This is suitable for scenarios where the search engine sorting strategy of the recruitment platform is constantly updated and optimized.

[0113] Figure 2 A flow chart of S102 in the method for testing the search engine ranking strategy of the recruitment platform provided in the embodiment of the present application. Figure 2 As shown, according to some embodiments of the present application, optionally, S102: running multiple use cases of the search engine to obtain the weights of multiple weighted items to be scored in the first search result and the weights of multiple weighted items to be scored in the second search result may include the following steps S201 to S204.

[0114] S201: Place multiple use cases into a comma-separated value CSV file, where each use case includes at least a use case ID, a use case description, and an expected result.

[0115] Specifically, taking the search result of a job seeker's resume as an example, first, the interface for calling the search engine can be encapsulated, and the actual_result returned by the interface can be uniformly formatted, for example, {"resumelist":[], "scorelist":[]}.

[0116] Among them, resumelist is the resume ID in the result returned by the interface, which is placed in the resume list in sequence; scorelist is the total score of the resume ID in the result returned by the interface, which is placed in the resume score list in sequence.

[0117] Then, you can build an automated testing architecture based on Python testing frameworks, such as pytest. Specifically, you can put multiple use cases in a comma-separated values ​​(CSV) file with the following structure: use case ID, use case description, interface parameters, and expected results.

[0118] pytest is a Python test framework for writing and running unit tests, integration tests, and functional tests. It provides rich features, including automatic discovery of test cases, parameterized tests, assertion support, parallel testing, and a rich plug-in system.

[0119] S202: Read multiple use cases in the CSV file, and parameterize the read multiple use cases.

[0120] Specifically, you can create a method get_cases() to read multiple use cases in a CSV file. Then, according to the pytest fixture method, such as parametrize, the multiple use cases read are parameterized. The code for the parameterized use case is as follows:

[0121] caseid,caseinfo,request,expect_result

[0122] Among them, the format of expect_result is:

[0123] {"resumelist":[],"weight":}.

[0124] S203: The first search result, the second search result and the user's historical behavior data are placed in a CSV file as pre-data. The user's historical behavior data is used to set the first type of weight scoring items. The first search result and the second search result correspond to the target ID of the target use case.

[0125] Specifically, the first search result, the second search result and the user's historical behavior data can be placed in a CSV file as pre-data with the following structure: use case ID, data description, data type, and specific pre-data content.

[0126] It should be noted that it is necessary to ensure that the placed front data corresponds to the use case ID, and there is only one unique variable that is different between multiple data, and the weight of this unique variable in the sorting strategy is consistent with the expected output weight rank_weight of the use case.

[0127] When inserting data, you can call the corresponding insert data method according to the data type and the corresponding use case ID to complete the processing of the previous data. Data types include but are not limited to ES, opensearch, redis, lindorm-hbase, and tikv.

[0128] S204: Call the search engine interface to run multiple use cases of the search engine, where the multiple use cases are specifically used to retrieve the first search result and the second search result corresponding to the target ID in the CSV file, and score the multiple weighted items to be scored in the first search result and the second search result, to obtain the weights of the multiple weighted items to be scored in the first search result and the weights of the multiple weighted items to be scored in the second search result.

[0129] Specifically, the search engine interface can be called according to the request request parameterized by the use case, so as to run multiple use cases of the search engine. The multiple use cases can be used to retrieve the first search result and the second search result corresponding to the target ID in the CSV file, and score the multiple weighted items to be scored in the first search result and the second search result, and obtain the weights of the multiple weighted items to be scored in the first search result and the weights of the multiple weighted items to be scored in the second search result.

[0130] Then, execute S103 to S105, calculate the first ranking total score of the first search result according to the weights of the multiple weighted items to be rated in the first search result, and calculate the second ranking total score of the second search result according to the weights of the multiple weighted items to be rated in the second search result. Calculate the difference or quotient between the first ranking total score and the second ranking total score, and use the difference or quotient as the test weight of the target weighted item to be rated. Compare the test weight of the target weighted item to be rated with the expected weight of the target weighted item to be rated. If they are consistent, it is determined that the target case test has passed; if they are inconsistent, it is determined that the target case test has failed.

[0131] After the target use case is tested, the inserted preceding data corresponding to the target use case can be deleted to avoid affecting the next test.

[0132] According to some embodiments of the present application, optionally, the method for testing the search engine ranking strategy of the recruitment platform may further include the following steps:

[0133] After multiple use cases are tested, a test report is output.

[0134] The test report may display each use case ID, the use case description of each use case, and the test results of each use case, so that developers can view the test results of each use case.

[0135] Based on the same technical concept as the test method of the search engine ranking strategy of the recruitment platform provided in the above embodiment, accordingly, the present application also provides a test device for the search engine ranking strategy of the recruitment platform. The search engine is provided with multiple use cases, and the multiple use cases are used to score the multiple weighted items to be scored in the search results for any search result based on the preset multiple weighted scoring items and the scoring criteria of each weighted scoring item, and obtain the weight of each weighted item to be scored. The multiple use cases correspond one-to-one to the multiple weighted scoring items and the multiple weighted items to be scored respectively; the ranking strategy is to calculate the total ranking score of the search result for any search result according to the weights of the multiple weighted items to be scored in the search result, and to sort the multiple search results in the order of the total ranking score from large to small. Please refer to the following embodiments.

[0136] Figure 3 A schematic diagram of a structure of a testing device for a search engine ranking strategy of a recruitment platform provided in an embodiment of the present application. Figure 3 As shown, the test device 30 for the search engine ranking strategy of the recruitment platform provided in the embodiment of the present application may include the following modules:

[0137] An acquisition module 301 is used to acquire a first search result and a second search result for testing a target use case, wherein the target weight items to be scored in the first search result and the second search result are different, and the other weight items to be scored except the target weight items to be scored are the same, and the target weight items to be scored are weight items to be scored corresponding to the target use case; the target weight items to be scored in the first search result meet the preset recruitment or job search requirements, and the target weight items to be scored in the second search result do not meet the recruitment or job search requirements, and the scoring standard of the target weight items is that the target weight items to be scored are given a weight N1 if they meet the recruitment or job search requirements, and a weight N2 if they do not meet the recruitment or job search requirements, and N1>N2;

[0138] An operation module 302 is used to operate multiple use cases of the search engine to obtain weights of multiple weighted items to be rated in the first search result and weights of multiple weighted items to be rated in the second search result;

[0139] A first calculation module 303, used to calculate a first ranking total score of the first search result according to the weights of the multiple weighted items to be rated in the first search result, and to calculate a second ranking total score of the second search result according to the weights of the multiple weighted items to be rated in the second search result;

[0140] The second calculation module 304 is used to calculate the difference or quotient between the first ranking total score and the second ranking total score, and use the difference or quotient as the test weight of the target weight to be scored item;

[0141] The judgment module 305 is used to compare the test weight of the target weight to be scored item with the expected weight of the target weight to be scored item. If they are consistent, it is determined that the target case test has passed; if they are inconsistent, it is determined that the target case test has failed.

[0142] The embodiment of the present application provides a testing device for the search engine ranking strategy of a recruitment platform. On the one hand, for a target use case in multiple use cases of the search engine ranking strategy, the target weight items to be scored in the first search result and the second search result are different, and other weight items to be scored except the target weight items to be scored are the same; the target weight items to be scored in the first search result meet the preset recruitment or job-seeking requirements, and the target weight items to be scored in the second search result do not meet the recruitment or job-seeking requirements. The scoring criteria for the target weight scoring items are that the target weight items to be scored are given a weight N1 if they meet the recruitment or job-seeking requirements, and a weight N2 if they do not meet the recruitment or job-seeking requirements, and N1>N2; therefore, by running the target use case of the search engine, the weights of the target weight items to be scored in the first search result and the weights of the target weight items to be scored in the second search result should theoretically be different. The same, and then calculate the first ranking total score of the first search result according to the weights of multiple weighted items to be scored in the first search result; calculate the second ranking total score of the second search result according to the weights of multiple weighted items to be scored in the second search result; the first ranking total score and the second ranking total score should also be different in theory; then, calculate the difference or quotient between the first ranking total score and the second ranking total score, and use the difference or quotient as the test weight of the target weighted item to be scored; finally, compare the test weight of the target weighted item to be scored with the expected weight of the target weighted item to be scored. If they are consistent, it can be said that the target case test has passed; if they are inconsistent, it can be said that the target case test has not passed, so that the automated testing of the use cases in the sorting strategy can be achieved, which can significantly improve the test efficiency, reduce the influence of human factors, and is conducive to improving the accuracy and reliability of the test results.

[0143] On the other hand, even if the sorting strategy may involve multiple weighted items to be scored and complex algorithms, by splitting each of the multiple weighted items to be scored and testing the use cases corresponding to each weighted item to be scored in turn, it is possible to reduce omissions during testing and improve test coverage. On the other hand, when the sorting strategy is updated, only the updated use cases can be tested, and the existing use cases are not tested, which can greatly reduce the changes to the test scripts and test processes, improve test efficiency, and reduce the cost of developing test scripts. It is suitable for scenarios where the search engine sorting strategy of the recruitment platform is constantly updated and optimized.

[0144] Figure 3Each module / unit in the device shown has the function of implementing each step in the testing method of the search engine ranking strategy of the recruitment platform provided in the above method embodiment, and can achieve its corresponding technical effect. For the sake of concise description, it will not be repeated here.

[0145] According to some embodiments of the present application, optionally, the multiple weight scoring items include a first category of weight scoring items and a second category of weight scoring items, the first category of weight scoring items being weight scoring items determined based on the user's historical behavior, and the second category of weight scoring items being weight scoring items determined based on basic attributes of the search results.

[0146] When the search result is a job seeker's resume, the first category of weight scoring items includes weight scoring items for resumes that the recruiter is not interested in, and the second category of weight scoring items includes at least one of the search term similarity weight scoring items, resume active time decay weight scoring items, most recent job function in the resume hitting the recruitment function weight scoring items, most recent job industry in the resume hitting the recruitment industry weight scoring items, salary weight scoring items, and academic qualifications weight scoring items.

[0147] When the search result is a job position, the first category of weighted scoring items includes at least one of a weighted scoring item for positions the job seeker has applied for, a weighted scoring item for areas the job seeker is not interested in, and a weighted scoring item for commuting distances the job seeker is not interested in; the second category of weighted scoring items includes at least one of a search term similarity weighted scoring item, a salary weighted scoring item, a function weighted scoring item, and an office location weighted scoring item.

[0148] According to some embodiments of the present application, optionally, the first search result is a resume of a first job applicant, and the second search result is a resume of a second job applicant. The first calculation module 303 can be used to: calculate the weights of multiple weighted items to be scored in the resume of the first job applicant according to the first total score formula to obtain a first ranking total score of the resume of the first job applicant; calculate the weights of multiple weighted items to be scored in the resume of the second job applicant according to the first total score formula to obtain a second ranking total score of the resume of the second job applicant.

[0149] Among them, the expression of the first total score formula is:

[0150] F 总分1 =F1*F2*F3*F4*F5*F6*F7

[0151] Among them, F 总分1 It represents the total score of resume ranking, F1 represents the weight of search term similarity, F2 represents the weight of job seeker active time decay, F3 represents the weight of the most recent job function in the resume hitting the recruitment function, F4 represents the weight of the most recent job industry in the resume hitting the recruitment industry, F5 represents the salary weight, F6 represents the education weight, and F7 represents the weight of resumes that the recruiter is not interested in.

[0152] According to some embodiments of the present application, optionally, the first search result is the first job position, and the second search result is the second job position. The first calculation module 303 can be used to: calculate the weights of multiple weighted items to be scored in the first job position according to the second total score formula to obtain a first ranking total score for the first job position; calculate the weights of multiple weighted items to be scored in the second job position according to the second total score formula to obtain a second ranking total score for the second job position.

[0153] Among them, the expression of the second total score formula is:

[0154] F 总分2 =F1'*F2'*F3'*F4'*F5'*F6'*F7'

[0155] Among them, F 总分2 It represents the total score of job ranking, F1' represents the weight of search term similarity, F2' represents the weight of job seekers' applied jobs, F3' represents the weight of salary, F4' represents the weight of function, F5' represents the weight of office location, F6' represents the weight of regions that job seekers are not interested in, and F7' represents the weight of commuting distance that job seekers are not interested in.

[0156] According to some embodiments of the present application, optionally, the testing device 30 for the search engine ranking strategy of the recruitment platform may also include an update module, and the update module is used to, after multiple use cases have been tested, if it is detected that the ranking strategy has been updated, and the update is to add a new weight scoring item and its corresponding new use case, then use the new use case as the target use case, so as to only test the new use case pairs and not test the existing use cases.

[0157] According to some embodiments of the present application, optionally, the running module 302 can be used to: place multiple use cases into a comma-separated value CSV file, each use case including at least a use case ID, a use case description and an expected result; read multiple use cases in the CSV file, and parameterize the multiple use cases read out; place the first search result, the second search result and the user's historical behavior data as pre-data in the CSV file, the user's historical behavior data is used to set a first type of weight scoring item, the first search result and the second search result correspond to the target ID of the target use case; call the search engine interface to run multiple use cases of the search engine, the multiple use cases are specifically used to retrieve the first search result and the second search result corresponding to the target ID in the CSV file, and score the multiple weight items to be scored in the first search result and the second search result, and obtain the weights of the multiple weight items to be scored in the first search result and the weights of the multiple weight items to be scored in the second search result.

[0158] The electronic device in the embodiment of the present application may be a user terminal device, a server, other computing devices, or a cloud server. Figure 4 A schematic diagram of the hardware structure of an electronic device according to an embodiment of the present application is shown. The electronic device may include a processor 401 and a memory 402 storing computer program instructions. When the processor 401 executes the computer program instructions, the process or function of any of the above-mentioned embodiments of the method is implemented.

[0159] Specifically, the processor 401 may include a central processing unit (CPU), or an application-specific integrated circuit (ASIC), or may be configured to implement one or more integrated circuits of the embodiments of the present application. The memory 402 may include a large-capacity memory for data or instructions. For example, the memory 402 may be at least one of the following: a hard disk drive (HDD), a read-only memory (ROM), a random access memory (RAM), a floppy disk drive, a flash memory, an optical disk, a magneto-optical disk, a tape, a universal serial bus (USB) drive or other physical / tangible memory storage device. For another example, the memory 402 may include a removable or non-removable (or fixed) medium. For another example, the memory 402 may be inside or outside the integrated gateway disaster recovery device. The memory 402 may be a non-volatile solid-state memory. In other words, the memory 402 generally includes a tangible (non-transitory) computer-readable storage medium (such as a memory device) encoded with computer-executable instructions, and when the software is executed (such as executed by one or more processors), the operations described in the method of the embodiments of the present application may be performed. The processor 401 implements the process or function of any method in the above embodiments by reading and executing the computer program instructions stored in the memory 402 .

[0160] In one example, Figure 4The electronic device shown may also include a communication interface 403 and a bus 410. Among them, the processor 401, the memory 402, and the communication interface 403 are connected through the bus 410 and complete the communication between each other. The communication interface 403 is mainly used to realize the communication between each module, device, unit and / or device in the embodiment of the present application. The bus 410 includes hardware, software or both, and can couple the components of the online data traffic billing device to each other. For example, the bus may include at least one of the following: an accelerated graphics port (AGP) or other graphics bus, an enhanced industrial standard architecture (EISA) bus, a front-end bus (FSB), a hypertransport (HT) interconnect, an industrial standard architecture (ISA) bus, an infinite bandwidth interconnect, a low pin count (LPC) bus, a memory bus, a micro channel architecture (MCA) bus, a peripheral component interconnect (PCI) bus, a PCI-Express (PCI-X) bus, a serial advanced technology attachment (SATA) bus, a video electronics standard association local (VLB) bus or other suitable buses. The bus 410 may include one or more buses. Although the embodiments of the present application describe or illustrate a specific bus, the embodiments of the present application may consider any suitable bus or interconnection method.

[0161] In combination with the method in the above embodiments, an embodiment of the present application also provides a computer-readable storage medium, on which computer program instructions are stored. When the computer program instructions are executed by a processor, the process or function of any method in the above embodiments is implemented.

[0162] In addition, an embodiment of the present application further provides a computer program product, on which computer program instructions are stored. When the computer program instructions are executed by a processor, the process or function of any one of the methods in the above embodiments is implemented.

[0163] The above exemplarily describes the flowcharts and / or block diagrams of the methods, devices, systems and computer program products of the embodiments of the present application, and describes the relevant various aspects. It should be understood that each box or combination thereof in the flowchart and / or block diagram can be implemented by computer program instructions, or by dedicated hardware that performs a specified function or action, or by a combination of dedicated hardware and computer instructions. For example, these computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer or other programmable data processing device to form a machine that enables these instructions executed by such a processor to enable the implementation of the functions / actions specified in each box or combination thereof in the flowchart and / or block diagram. Such a processor can be a general-purpose processor, a special-purpose processor, a special application processor or a field programmable logic circuit.

[0164] The functional blocks shown in the structured block diagram of the embodiment of the present application can be implemented as hardware, software, firmware or a combination thereof. When implemented in hardware, it can be, for example, an electronic circuit, an application-specific integrated circuit (ASIC), appropriate firmware, a plug-in, a function card, etc.; when implemented in software, it is a program or code segment used to perform the required task. The program or code segment can be stored in a memory, or transmitted on a transmission medium or a communication link via a data signal carried in a carrier. The code segment can be downloaded via a computer network such as the Internet, an intranet, etc.

[0165] It should be noted that the present application is not limited to the specific configurations and processes described above or shown in the figures. The above is only a specific implementation of the present application. Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working process of the described system, device, module or unit can refer to the corresponding process in the method embodiment, and no further description is needed.

Claims

1. A method for testing the search engine ranking strategy of a recruitment platform, characterized in that: The search engine is provided with a plurality of use cases, and the plurality of use cases are used to score a plurality of weighted items to be scored in the search results for any search result based on a plurality of preset weighted scoring items and scoring criteria of each weighted scoring item, and obtain the weight of each weighted item to be scored, and the plurality of use cases correspond one-to-one to the plurality of weighted scoring items and the plurality of weighted items to be scored respectively; the sorting strategy is to calculate the total sorting score of the search result for any search result according to the weights of the plurality of weighted items to be scored in the search result, and sort the plurality of search results in descending order of the total sorting scores, and the testing method comprises: A first search result and a second search result for testing a target use case are obtained, wherein the target weight items to be scored in the first search result and the second search result are different, and other weight items to be scored except the target weight item to be scored are the same, and the target weight item to be scored is a weight item to be scored corresponding to the target use case; the target weight item to be scored in the first search result meets the preset recruitment or job search requirements, and the target weight item to be scored in the second search result does not meet the recruitment or job search requirements, and the scoring standard of the target weight item is that the target weight item to be scored is given a weight N1 if it meets the recruitment or job search requirements, and a weight N2 if it does not meet the recruitment or job search requirements, and N1>N2; Run multiple use cases of the search engine to obtain weights of multiple weighted items to be rated in the first search result and weights of multiple weighted items to be rated in the second search result; calculate a first ranking total score of the first search result based on the weights of the multiple weighted items to be rated in the first search result, and calculate a second ranking total score of the second search result based on the weights of the multiple weighted items to be rated in the second search result; calculate the difference or quotient between the first ranking total score and the second ranking total score, and use the difference or quotient as the test weight of the target weighted item to be rated; compare the test weight of the target weighted item to be rated with the expected weight of the target weighted item to be rated, if they are consistent, determine that the target use case test has passed; if they are inconsistent, determine that the target use case test has failed.

2. The testing method according to claim 1, characterized in that: The multiple weight scoring items include a first type of weight scoring item and a second type of weight scoring item, the first type of weight scoring item is a weight scoring item determined based on the user's historical behavior, and the second type of weight scoring item is a weight scoring item determined based on the basic attributes of the search results; When the search result is a resume of a job seeker, the first category of weighted scoring items includes a weighted scoring item for resumes that the recruiter is not interested in, and the second category of weighted scoring items includes at least one of a search term similarity weighted scoring item, a resume active time decay weighted scoring item, a recent job function in the resume hitting the recruitment function weighted scoring item, a recent job industry in the resume hitting the recruitment industry weighted scoring item, a salary weighted scoring item, and an education weighted scoring item; When the search result is a job position, the first category of weight scoring items includes at least one of a weight scoring item for positions the job seeker has applied for, a weight scoring item for areas the job seeker is not interested in, and a weight scoring item for commuting distances the job seeker is not interested in; the second category of weight scoring items includes at least one of a search term similarity weight scoring item, a salary weight scoring item, a function weight scoring item, and an office location weight scoring item.

3. The testing method according to claim 1, characterized in that: The first search result is the resume of the first job seeker, and the second search result is the resume of the second job seeker; Calculating a first ranking total score of the first search result according to the weights of the multiple weighted items to be rated in the first search result, and calculating a second ranking total score of the second search result according to the weights of the multiple weighted items to be rated in the second search result, including: Calculating the weights of multiple weighted scoring items in the resume of the first job applicant according to the first total score formula to obtain a first ranking total score of the resume of the first job applicant; Calculating the weights of the multiple weighted scoring items in the second job applicant's resume according to the first total score formula to obtain a second ranking total score of the second job applicant's resume; The expression of the first total score formula is: <h2 style=";text-align:left;direction:ltr">F<h2 style=";text-align:left;direction:ltr"> 总分1 <h2 style=";text-align:left;direction:ltr"> (F1*F2*F3*F4*F5*F6*F7) Among them, F 总分1 It represents the total score of resume ranking, F1 represents the weight of search term similarity, F2 represents the weight of resume active time decay, F3 represents the weight of the most recent job function in the resume hitting the recruitment function, F4 represents the weight of the most recent job industry in the resume hitting the recruitment industry, F5 represents the salary weight, F6 represents the education weight, and F7 represents the weight of resumes that the recruiter is not interested in.

4. The testing method according to claim 1, characterized in that: The first search result is the first applied position, and the second search result is the second applied position; Calculating a first ranking total score of the first search result according to the weights of the multiple weighted items to be rated in the first search result, and calculating a second ranking total score of the second search result according to the weights of the multiple weighted items to be rated in the second search result, including: Calculate the weights of multiple weighted scoring items in the first applied position according to the second total score formula to obtain a first ranking total score for the first applied position; Calculating the weights of multiple weighted scoring items in the second job application according to the second total score formula to obtain a second ranking total score for the second job application; The expression of the second total score formula is: <h2 style=";text-align:left;direction:ltr">F<h2 style=";text-align:left;direction:ltr"> 总分2 <h2 style=";text-align:left;direction:ltr"> (F1'*F2'*F3'*F4'*F5'*F6'*F7') Among them, F 总分2 It represents the total score of job ranking, F1' represents the weight of search term similarity, F2' represents the weight of job seekers' applied jobs, F3' represents the weight of salary, F4' represents the weight of function, F5' represents the weight of office location, F6' represents the weight of regions that job seekers are not interested in, and F7' represents the weight of commuting distance that job seekers are not interested in.

5. The testing method according to claim 1, characterized in that: The test method also includes: After multiple use cases are tested, if it is detected that the sorting strategy is updated, and the update is to add a new weight scoring item and its corresponding new use case, the new use case will be used as the target use case, so that only the new use case pair is tested, and the existing use case is not tested.

6. The testing method according to claim 1, characterized in that: Running multiple use cases of the search engine to obtain weights of multiple weighted items to be rated in the first search result and weights of multiple weighted items to be rated in the second search result includes: Place multiple use cases into a comma-separated value CSV file, where each use case includes at least a use case ID, a use case description, and an expected result; Read multiple use cases in a CSV file and parameterize the read multiple use cases; The first search result, the second search result and the user's historical behavior data are placed in a CSV file as pre-data, wherein the user's historical behavior data is used to set the first type of weight scoring item, and the first search result and the second search result correspond to the target ID of the target use case; Call the search engine interface to run multiple use cases of the search engine, and the multiple use cases are specifically used to retrieve the first search result and the second search result corresponding to the target ID in the CSV file, and score the multiple weighted items to be scored in the first search result and the second search result, to obtain the weights of the multiple weighted items to be scored in the first search result and the weights of the multiple weighted items to be scored in the second search result.

7. A testing device for search engine ranking strategy of a recruitment platform, characterized in that: The search engine is provided with a plurality of use cases, and the plurality of use cases are used to score a plurality of weighted items to be scored in the search results for any search result based on a plurality of preset weighted scoring items and scoring criteria of each weighted scoring item, and obtain the weight of each weighted item to be scored, and the plurality of use cases correspond one-to-one to the plurality of weighted scoring items and the plurality of weighted items to be scored respectively; the sorting strategy is to calculate the total sorting score of the search result for any search result according to the weights of the plurality of weighted items to be scored in the search result, and sort the plurality of search results in descending order of the total sorting scores, and the testing device comprises: An acquisition module is used to acquire a first search result and a second search result for testing a target use case, wherein the target weight items to be scored in the first search result and the second search result are different, and the other weight items to be scored except the target weight items to be scored are the same, and the target weight items to be scored are weight items to be scored corresponding to the target use case; the target weight items to be scored in the first search result meet the preset recruitment or job search requirements, and the target weight items to be scored in the second search result do not meet the recruitment or job search requirements, and the scoring standard of the target weight items is that the target weight items to be scored are given a weight of N1 if they meet the recruitment or job search requirements, and a weight of N2 if they do not meet the recruitment or job search requirements, and N1>N2; An operation module is used to run multiple use cases of the search engine to obtain weights of multiple weighted items to be rated in the first search result and weights of multiple weighted items to be rated in the second search result; A first calculation module, configured to calculate a first ranking total score of the first search result according to the weights of the multiple weighted items to be rated in the first search result, and to calculate a second ranking total score of the second search result according to the weights of the multiple weighted items to be rated in the second search result; A second calculation module is used to calculate the difference or quotient between the first ranking total score and the second ranking total score, and use the difference or quotient as the test weight of the target weight to be scored item; The judgment module is used to compare the test weight of the target weight to be scored item with the expected weight of the target weight to be scored item. If they are consistent, it is determined that the target case test has passed; if they are inconsistent, it is determined that the target case test has failed.

8. An electronic device, characterized in that: The electronic device comprises: a processor and a memory storing computer program instructions; when the electronic device executes the computer program instructions, the method for testing the search engine ranking strategy of the recruitment platform according to any one of claims 1 to 6 is implemented.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer program instructions, which, when executed by a processor, implement a method for testing a search engine ranking strategy of a recruitment platform according to any one of claims 1 to 6.

10. A computer program product, characterized in that It includes computer program instructions, which, when executed by a processor, implement a method for testing a search engine ranking strategy of a recruitment platform as described in any one of claims 1-6.

Citation Information

Patent Citations

  • Method and device for generating search engine relevance ranking test case

    CN103902449A

  • Method and device for evaluating search engine ordering algorithm effectiveness

    CN104699830A

  • Test case priority quantification method and scheduling device in cloud computing scene

    CN118035073A

  • Machine directed improvement of ranking algorithms

    US7243102B1