Test method and device for recruitment recommendation system, equipment and storage medium

Abstract

The invention discloses a test method and device for a recruitment recommendation system, equipment and a storage medium. The method comprises the steps of obtaining a target request parameter of a user; based on the target request parameter, respectively calling interfaces of recruitment recommendation systems of a first version and a second version to obtain a plurality of first recommendation results and a plurality of second recommendation results; calculating a first proportion of a first recommendation result inconsistent with the reference recommendation result, a second proportion of a second recommendation result inconsistent with the reference recommendation result, and a third proportion of the second recommendation result inconsistent with the first recommendation result; when the missing second recommendation result is expected to be missing and the third proportion is smaller than the first preset threshold value, if the missing second recommendation result is a reference recommendation result interested by the user and the second proportion is smaller than or equal to the first proportion, the test passes; if the reference recommendation result is not interested in the user and the second proportion is greater than or equal to the first proportion, the test passes. The test efficiency and the test accuracy of the recruitment recommendation system can be improved.

Description

Technical Field

[0001] The present application relates to the field of big data service technology, and in particular to a testing method, device, equipment and storage medium for a recruitment recommendation system. Background Art

[0002] The recruitment recommendation system can recommend suitable resumes of job seekers according to the needs of the enterprise and the skills, experience, interests and other characteristics of the talents, thereby helping the enterprise to find suitable talents more quickly and accurately. At the same time, the recruitment recommendation system can also recommend suitable positions for job seekers according to their needs, thereby helping job seekers to find suitable positions more quickly and accurately.

[0003] As user needs continue to evolve, the recruitment recommendation system is being updated and iterated at an increasingly faster pace. For many iterative versions of the recruitment recommendation system, this means that a large amount of regression testing is required, and manual testing can no longer meet the needs of rapid iteration and continuous optimization. It not only consumes a lot of manpower, but also takes a long time and has low returns. Moreover, in some iterative versions, there may only be some code optimizations that do not affect the business logic, but manpower still needs to be allocated to testing, which takes up a lot of the testers' time.

[0004] In addition, it is usually difficult to determine whether the effectiveness of the new version of the recruitment recommendation system has improved, which may result in a large deviation between the final test results and the user's expected results, and the test accuracy is low. Summary of the invention

[0005] In view of this, embodiments of the present application provide a testing method, device, electronic device, computer-readable storage medium, and computer program product for a recruitment recommendation system, which are used to solve at least one of the above technical problems.

[0006] The embodiment of the present application provides a testing method for a recruitment recommendation system, and the testing method for the recruitment recommendation system includes: obtaining a target request parameter of a user in the recruitment recommendation system, the target request parameter including a screening condition input by the user and a reference recommendation result that the user is interested in or not interested in; calling an interface of a first version of the recruitment recommendation system based on the target request parameter to obtain a plurality of first recommendation results, and calling an interface of a second version of the recruitment recommendation system based on the target request parameter to obtain a plurality of second recommendation results; calculating a first proportion of first recommendation results that are inconsistent with the reference recommendation results among the plurality of first recommendation results, and calculating a second proportion of second recommendation results that are inconsistent with the reference recommendation results among the plurality of second recommendation results; comparing the plurality of first recommendation results with the plurality of second recommendation results, And based on the comparison results, determine whether there is any missing data in the multiple second recommendation results compared to the multiple first recommendation results, and calculate the third proportion of the second recommendation results that are inconsistent with the first recommendation results in the multiple second recommendation results; if the missing second recommendation results in the multiple second recommendation results are consistent with the expected missing recommendation results, and the third proportion is less than the first preset threshold, then the size relationship between the first proportion and the second proportion is determined, wherein, if the target request parameter uses a reference recommendation result that the user is interested in, and the second proportion is less than or equal to the first proportion, then the second version of the recruitment recommendation system test is determined to have passed; or, if the target request parameter uses a reference recommendation result that the user is not interested in, and the second proportion is greater than or equal to the first proportion, then the second version of the recruitment recommendation system test is determined to have passed.

[0007] According to some embodiments of the present application, optionally, the testing method for the recruitment recommendation system also includes: if the missing second recommendation result among the multiple second recommendation results is inconsistent with the expected missing recommendation result, and the number of missing second recommendation results is greater than a second preset threshold, then it is determined that the second version of the recruitment recommendation system test has failed; if the target request parameter uses a reference recommendation result that the user is interested in, and the second proportion is greater than the first proportion, then it is determined that the second version of the recruitment recommendation system test has failed; or, if the target request parameter uses a reference recommendation result that the user is not interested in, and the second proportion is less than the first proportion, then it is determined that the second version of the recruitment recommendation system test has failed.

[0008] According to some embodiments of the present application, optionally, the reference recommendation result is a reference recommended position, the first recommendation result is the first recommended position, and the second recommendation result is the second recommended position; or, the reference recommendation result is a reference recommended resume, the first recommendation result is the first recommended resume, and the second recommendation result is the second recommended resume; wherein, in the case where the reference recommendation result is a reference recommended resume of interest to the user, the recommended resume inconsistent with the reference recommended resume is a recommended resume that is inconsistent with the region, age, gender, major, education, work experience and / or personality and hobby description that is of interest to the user; in the case where the reference recommendation result is a reference recommended resume that the user is not interested in, the recommended resume that is inconsistent with the reference recommended resume is a recommended resume that is inconsistent with the region, age, gender, major, education, work experience and / or personality and hobby description that is not of interest to the user.

[0009] According to some embodiments of the present application, optionally, before calling the interface of the first version of the recruitment recommendation system based on the target request parameters to obtain multiple first recommendation results, the testing method for the recruitment recommendation system also includes: turning off the switch for updating the recommended data in the target database, the recommended data including position data or resume data; wherein the first version of the recruitment recommendation system is used to query multiple first recommendation results that meet the target request parameter requirements from the recommended data stored in the target database, and the second version of the recruitment recommendation system is used to query multiple second recommendation results that meet the target request parameter requirements from the recommended data stored in the target database.

[0010] According to some embodiments of the present application, optionally, before turning off the switch for updating recommended data in the target database, the testing method for the recruitment recommendation system also includes: synchronizing recommended data in a source data table from at least one recruitment channel to a target data table in the target database, wherein each piece of recommended data includes multiple fields arranged in columns; setting multiple second target data columns in the target data table that need to be compared with multiple first target data columns in the source data table, and aligning the multiple first target data columns with the multiple second target data columns; comparing the multiple first target data columns with the multiple second target data columns to obtain difference results, the difference results including first data unique to the multiple first target data columns, second data unique to the multiple second target data columns, and at least one item in the second target data column that is different from the data in the first target data column; performing a quality score on this data synchronization based on the difference results, and analyzing problems existing in this data synchronization; outputting an evaluation report, the evaluation report showing the difference results, the quality score of this data synchronization, and problems existing in this data synchronization.

[0011] According to some embodiments of the present application, optionally, a quality score is performed on this data synchronization, and problems existing in this data synchronization are analyzed, including: determining whether the first data missing in the target data table is the expected missing data, and if not, deducting points according to the number or proportion of the first data missing in the target data table according to a preset deduction rule, and determining that the problems existing in this data synchronization at least include missing data; if there are differences between the data in the second target data column and the corresponding first target data column, deducting points according to the number or proportion of data with differences in the second target data column according to a preset deduction rule, and determining that the problems existing in this data synchronization at least include data synchronization rule errors; wherein the preset deduction rule starts from a preset total score, and if the number or proportion of the first data missing in the target data table is x times a first preset deduction threshold, then x times the first preset score is deducted; if the number or proportion of data with differences in the second target data column is y times a second preset deduction threshold, then y times the second preset score is deducted; the multiples are rounded up, and both x and y are positive integers.

[0012] According to some embodiments of the present application, optionally, the testing method for a recruitment recommendation system further includes: after finding a second target data column that has data different from that in the first target data column, executing a test case corresponding to the second target data column that has data different from that in the first target data column to find out the cause of the data difference.

[0013] The embodiment of the present application provides a testing device for a recruitment recommendation system, and the testing device for a recruitment recommendation system includes: an acquisition module, which is used to obtain a target request parameter of a user in the recruitment recommendation system, and the target request parameter includes a screening condition input by the user and a reference recommendation result that the user is interested in or not interested in; a calling module, which is used to call an interface of a first version of the recruitment recommendation system based on the target request parameter to obtain multiple first recommendation results, and to call an interface of a second version of the recruitment recommendation system based on the target request parameter to obtain multiple second recommendation results; a first calculation module, which is used to calculate a first proportion of first recommendation results that are inconsistent with the reference recommendation results among the multiple first recommendation results, and calculate a second proportion of second recommendation results that are inconsistent with the reference recommendation results among the multiple second recommendation results; a second calculation module, which is used to compare the multiple first recommendation results with the multiple A second recommendation result is compared, and according to the comparison result, it is determined whether the multiple second recommendation results are missing data compared with the multiple first recommendation results, and a third proportion of the second recommendation results that are inconsistent with the first recommendation results in the multiple second recommendation results is calculated; a judgment module is used to judge the size relationship between the first proportion and the second proportion if the missing second recommendation result in the multiple second recommendation results is consistent with the expected missing recommendation result, and the third proportion is less than the first preset threshold, wherein if the target request parameter uses a reference recommendation result that the user is interested in, and the second proportion is less than or equal to the first proportion, then it is determined that the second version of the recruitment recommendation system test has passed; or, if the target request parameter uses a reference recommendation result that the user is not interested in, and the second proportion is greater than or equal to the first proportion, then it is determined that the second version of the recruitment recommendation system test has passed.

[0014] An embodiment of the present application provides an electronic device, which includes a processor and a memory storing computer program instructions; when the processor executes the computer program instructions, the steps of the method described above are implemented.

[0015] An embodiment of the present application provides a computer-readable storage medium, on which computer program instructions are stored. When the computer program instructions are executed by a processor, the steps of the method described above are implemented.

[0016] An embodiment of the present application provides a computer program product, wherein the computer program product includes computer program instructions, and when the computer program instructions are executed by a processor, the steps of the method described above are implemented.

[0017] By using the testing method, device, electronic device, computer-readable storage medium and computer program product for a recruitment recommendation system provided by the embodiments of the present application, on the one hand, for the second version (i.e., new version) of the recruitment recommendation system, by comparing the multiple second recommendation results obtained by the second version of the recruitment recommendation system with the multiple first recommendation results obtained by the first version of the recruitment recommendation system and the reference recommendation results that the user is interested in or not interested in, and obtaining the recruitment recommendation system test results based on the multiple comparison results, it is possible to implement automated testing of the new version of the recruitment recommendation system, significantly improve the testing efficiency, reduce the impact of human factors, and help improve the accuracy and reliability of the test results and reduce the testing cost; on the other hand, by comparing the multiple second recommendation results with the multiple first recommendation results, the data missing situation of the second recommendation results and the data difference with the first recommendation results are taken into account. When the data missing situation and the data difference situation are both as expected, by comparing the size relationship between the first proportion and the second proportion, whether the effect of the second version of the recruitment recommendation system is improved is evaluated, so that the final test result is more in line with user expectations, further improving the test accuracy and user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the technical solution of the embodiments of the present application, the following briefly introduces the drawings in the embodiments of the present application.

[0019] Figure 1 A flowchart of a testing method for a recruitment recommendation system provided in an embodiment of the present application.

[0020] Figure 2 A flowchart of step 14 in the testing method for a recruitment recommendation system provided in an embodiment of the present application.

[0021] Figure 3 A schematic diagram of the structure of a testing device for a recruitment recommendation system provided in an embodiment of the present application.

[0022] Figure 4 A schematic diagram of the hardware structure of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0023] The principles and spirit of the present application will be described below with reference to several exemplary embodiments. It should be understood that the purpose of providing these embodiments is to make the principles and spirit of the present application clearer and more thorough, so that those skilled in the art can better understand and implement the principles and spirit of the present application. The exemplary embodiments provided herein are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments herein, all other embodiments obtained by ordinary technicians of the art without creative work are within the scope of protection of this application.

[0024] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the statement "include..." do not exclude the presence of other identical elements in the process, method, article or device including the elements.

[0025] It should be understood that the term "and / or" used in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the associated objects before and after are in an "or" relationship.

[0026] It is obvious to those skilled in the art that various modifications and changes can be made in the present application without departing from the spirit or scope of the present application. Therefore, the present application is intended to cover modifications and changes of the present application that fall within the scope of the corresponding claims (technical solutions for protection) and their equivalents. It should be noted that the implementation methods provided in the embodiments of the present application can be combined with each other without contradiction.

[0027] Before describing the technical solutions provided by the embodiments of the present application, in order to facilitate the understanding of the embodiments of the present application, the present application first specifically describes the problems existing in the related art:

[0028] The recruitment recommendation system can recommend suitable resumes of job seekers according to the needs of the enterprise and the skills, experience, interests and other characteristics of the talents, thereby helping the enterprise to find suitable talents more quickly and accurately. At the same time, the recruitment recommendation system can also recommend suitable positions for job seekers according to their needs, thereby helping job seekers to find suitable positions more quickly and accurately.

[0029] As user needs continue to evolve, the recruitment recommendation system is being updated and iterated at an increasingly faster pace. For many iterative versions of the recruitment recommendation system, this means that a large amount of regression testing is required, and manual testing can no longer meet the needs of rapid iteration and continuous optimization. It not only consumes a lot of manpower, but also takes a long time and has low returns. Moreover, in some iterative versions, there may only be some code optimizations that do not affect the business logic, but manpower still needs to be allocated to testing, which takes up a lot of the testers' time.

[0030] In addition, it is usually difficult to determine whether the effectiveness of the new version of the recruitment recommendation system has improved, which may result in a large deviation between the final test results and the user's expected results, and the test accuracy is low.

[0031] In view of the above research findings of the inventors, the embodiments of the present application provide a testing method, apparatus, device and computer-readable storage medium for a recruitment recommendation system, which can solve at least one of the above technical problems existing in the related art.

[0032] The following first introduces the testing method for the recruitment recommendation system provided in the embodiment of the present application.

[0033] Figure 1 A flow chart of a testing method for a recruitment recommendation system provided in an embodiment of the present application. Figure 1 As shown, the testing method for a recruitment recommendation system provided in an embodiment of the present application may include the following steps S101 to S105.

[0034] S101: Obtain target request parameters of a user in a recruitment recommendation system, where the target request parameters include screening conditions input by the user and reference recommendation results that the user is interested in or not interested in, and the reference recommendation results are determined based on the user's historical behavior data.

[0035] Specifically, the recruitment recommendation system can support reporting request parameters. For example, in job recommendation, the request parameters can include the screening conditions entered by the user for screening jobs, such as the address, salary requirements and functions of this request. In S101, the reporting request parameter function switch of the recruitment recommendation system can be turned on first, and the request parameters of online users can be recorded in a file or database. The request parameters can be the request parameters actually entered by the user. Then, the request parameters that meet the conditions are filtered out from the above request parameters as the target request parameters, such as the request parameters for a certain period of time, or the request parameters containing the specified screening conditions. In job recommendation, for example, the specified screening conditions can be one or more of office location, salary requirements, functions and industries. In resume recommendation, for example, the specified screening conditions can be one or more of office location, age, gender, major, education, work experience, personality and hobby description, salary requirements, functions and industries.

[0036] In the embodiment of the present application, the target request parameter may also include reference recommendation results that the user is interested in or not interested in. For example, in job recommendation, the reference recommendation result may be a reference recommended job that the user is interested in or not interested in, such as software development engineer, etc. For example, in resume recommendation, the reference recommendation result may be a reference recommended resume that the user is interested in or not interested in, such as a resume of the region, age, gender, major, education, work experience and / or personality hobbies that the user is interested in, or a resume of the region, age, gender, major, education, work experience and / or personality hobbies that the user is not interested in.

[0037] In some embodiments, the reference recommendation results that the user is interested in or not interested in can be the recommended results that the user himself inputs as expected or not expected, or can be determined by the user's historical behavior data of the recruitment recommendation system. The user's historical behavior data includes but is not limited to the positions that the user frequently browses, collects and / or submits in the recruitment recommendation system, the resumes that the user views, collects and / or invites for interviews in the recruitment recommendation system, the positions or resumes that the user frequently closes in the recruitment recommendation system and / or is listed as not interested by the user, etc.

[0038] S102: Calling the interface of the first version of the recruitment recommendation system based on the target request parameters to obtain multiple first recommendation results, and calling the interface of the second version of the recruitment recommendation system based on the target request parameters to obtain multiple second recommendation results.

[0039] In S102, the interface of the first version of the recruitment recommendation system can be called based on the target request parameters, and the first version of the recruitment recommendation system can be used to query multiple first recommendation results that meet the target request parameter requirements from the recommendation data stored in the target database. Among them, the target database is used to store recommendation data, and the recommendation data may include position data or resume data. For example, when recommending positions, the first version of the recruitment recommendation system can be used to query multiple first recommended positions that meet the target request parameter requirements from the numerous position data stored in the target database. For example, when recommending resumes, the first version of the recruitment recommendation system can be used to query multiple first recommended resumes that meet the target request parameter requirements from the numerous resume data stored in the target database.

[0040] Similarly, the interface of the second version of the recruitment recommendation system can be called based on the target request parameters, and the second version of the recruitment recommendation system can be used to query multiple second recommendation results that meet the target request parameter requirements from the recommendation data stored in the target database. For example, when recommending positions, the second version of the recruitment recommendation system can be used to query multiple second recommended positions that meet the target request parameter requirements from the numerous position data stored in the target database. For example, when recommending resumes, the second version of the recruitment recommendation system can be used to query multiple second recommended resumes that meet the target request parameter requirements from the numerous resume data stored in the target database.

[0041] In some examples, the first version of the job recommendation system may be an old version of the job recommendation system, and the second version of the job recommendation system may be a new version of the job recommendation system.

[0042] S103: Calculate a first proportion of first recommendation results that are inconsistent with a reference recommendation result among the plurality of first recommendation results, and calculate a second proportion of second recommendation results that are inconsistent with the reference recommendation result among the plurality of second recommendation results.

[0043] For example, taking job recommendation as an example, assuming that the reference recommendation result (i.e., the reference recommended job) that the user is interested in is software development engineer, the multiple first recommendation results obtained by the first version of the recruitment recommendation system are job 1, job 2, and job 3, and the multiple second recommendation results obtained by the second version of the recruitment recommendation system are job 1, job 2, and job 4. Jobs 1 to 3 are all software development engineers, and job 4 is not a software development engineer, so the first proportion is 0 / 3 and the second proportion is 1 / 3.

[0044] S104: Compare the multiple first recommendation results with the multiple second recommendation results, and determine whether the multiple second recommendation results are missing data compared with the multiple first recommendation results based on the comparison result, and calculate a third proportion of the second recommendation results that are inconsistent with the first recommendation results in the multiple second recommendation results.

[0045] Still taking the job recommendation as an example, assuming that the multiple first recommendation results obtained by the first version of the recruitment recommendation system are job 1, job 2 and job 3, and the multiple second recommendation results obtained by the second version of the recruitment recommendation system are job 1, job 2, job 4 and job 5, at this time, compared with the multiple first recommendation results, the data missing from the multiple second recommendation results is job 3, that is, data missing occurs. Jobs 4 and 5 in the multiple second recommendation results are inconsistent with jobs 1, job 2 and job 3 in the multiple first recommendation results, so the third proportion can be 1 / 2.

[0046] S105: If the missing second recommendation result among the multiple second recommendation results is consistent with the expected missing recommendation result, and the third proportion is less than the first preset threshold, then the size relationship between the first proportion and the second proportion is determined, wherein, if the target request parameter uses a reference recommendation result that the user is interested in, and the second proportion is less than or equal to the first proportion, then it is determined that the second version of the recruitment recommendation system test has passed; or, if the target request parameter uses a reference recommendation result that the user is not interested in, and the second proportion is greater than or equal to the first proportion, then it is determined that the second version of the recruitment recommendation system test has passed.

[0047] In actual applications, some of the first recommendation results obtained by the first version of the recruitment recommendation system may be inaccurate. For example, the reference recommendation result (i.e., the reference recommended position) that the user is interested in is a software development engineer, while some of the first recommendation results obtained by the first version of the recruitment recommendation system are not software development engineers. Therefore, after version iteration, it is expected that this part of the inaccurate recommendation results can be deleted from the multiple second recommendation results obtained by the second version of the recruitment recommendation system, and then the missing second recommendation results in the multiple second recommendation results may be the expected missing recommendation results, of course, they may not be the expected missing recommendation results. In some examples, the expected missing recommendation results may be recommendation results that are inconsistent with the reference recommendation results.

[0048] Theoretically, there may be differences between the multiple second recommendation results obtained by the second version of the recruitment recommendation system and the multiple first recommendation results obtained by the first version of the recruitment recommendation system, but the differences will not be too large.

[0049] Therefore, in S105, considering the data missing of the second recommendation result and the data difference with the first recommendation result, if the missing second recommendation result in the multiple second recommendation results is consistent with the expected missing recommendation result, and the third proportion is less than the first preset threshold, it means that the missing second recommendation result in the multiple second recommendation results is the expected missing recommendation result, and the data difference is as expected, then the size relationship between the first proportion and the second proportion can be further determined. The first preset threshold can be flexibly adjusted according to the actual situation, and this application does not limit it.

[0050] In some embodiments, if the target request parameter uses a reference recommendation result of interest to the user, and the second proportion is less than or equal to the first proportion, it means that compared to the multiple first recommendation results, the difference proportion between the multiple second recommendation results and the reference recommendation results of interest to the user has become smaller, and the effect of the second version of the recruitment recommendation system has improved, then it can be determined that the second version of the recruitment recommendation system has passed the test.

[0051] In other embodiments, if the target request parameter uses a reference recommendation result that the user is not interested in, and the second proportion is greater than or equal to the first proportion, it means that compared to the multiple first recommendation results, the difference proportion between the multiple second recommendation results and the reference recommendation results that the user is not interested in has become larger, that is, the difference proportion between the multiple second recommendation results and the reference recommendation results that the user is interested in has become smaller, and the effect of the second version of the recruitment recommendation system has been improved, and it can be determined that the second version of the recruitment recommendation system has passed the test.

[0052] The testing method for a recruitment recommendation system provided in the embodiments of the present application, on the one hand, for a second version (i.e., new version) of the recruitment recommendation system, by comparing multiple second recommendation results obtained by the second version of the recruitment recommendation system with multiple first recommendation results obtained by the first version of the recruitment recommendation system and reference recommendation results that the user is interested in or not interested in, and obtaining the recruitment recommendation system test results based on the multiple comparison results, it is possible to implement automated testing of the new version of the recruitment recommendation system, significantly improve test efficiency, reduce the impact of human factors, and help improve the accuracy and reliability of test results, and reduce test costs; on the other hand, by comparing multiple second recommendation results with multiple first recommendation results, the data missing conditions of the second recommendation results and the data differences with the first recommendation results are taken into account. When the data missing conditions and the data differences are both as expected, by comparing the size relationship between the first proportion and the second proportion, it is evaluated whether the effect of the second version of the recruitment recommendation system has been improved, so that the final test results are more in line with user expectations, further improving test accuracy and user experience.

[0053] According to some embodiments of the present application, optionally, the testing method for a recruitment recommendation system provided by the embodiments of the present application may further include the following steps 1 and 2.

[0054] Step 1: If the missing second recommendation results among the multiple second recommendation results are inconsistent with the expected missing recommendation results, and the number of missing second recommendation results is greater than a second preset threshold, it is determined that the second version of the recruitment recommendation system test has failed.

[0055] If the missing second recommendation result in the plurality of second recommendation results is inconsistent with the expected missing recommendation result, it means that the missing second recommendation result in the plurality of second recommendation results is not the expected missing recommendation result. At this time, if the number of missing second recommendation results is greater than the second preset threshold, it can be determined that the second version of the recruitment recommendation system test has failed.

[0056] Step 2: If the target request parameter uses a reference recommendation result that the user is interested in, and the second proportion is greater than the first proportion, then the second version of the recruitment recommendation system test is determined to have failed; or, if the target request parameter uses a reference recommendation result that the user is not interested in, and the second proportion is less than the first proportion, then the second version of the recruitment recommendation system test is determined to have failed.

[0057] Specifically, if the target request parameter uses the reference recommendation results that the user is interested in, and the second proportion is greater than the first proportion, it means that compared with the multiple first recommendation results, the difference ratio between the multiple second recommendation results and the reference recommendation results that the user is interested in has increased, and the effectiveness of the second version of the recruitment recommendation system has decreased, then it is determined that the second version of the recruitment recommendation system test has failed.

[0058] If the target request parameter uses a reference recommendation result that the user is not interested in, and the second proportion is smaller than the first proportion, it means that compared with the multiple first recommendation results, the difference proportion between the multiple second recommendation results and the reference recommendation results that the user is not interested in has become smaller, that is, the difference proportion between the multiple second recommendation results and the reference recommendation results that the user is interested in has become larger, and the effect of the second version of the recruitment recommendation system has decreased, then it is determined that the second version of the recruitment recommendation system test has failed.

[0059] In this way, by comparing multiple second recommendation results with multiple first recommendation results, the data missing situation of the second recommendation results and the data difference with the first recommendation results are taken into consideration. When the data missing situation and the data difference situation are as expected, the effectiveness of the second version of the recruitment recommendation system is evaluated by comparing the size relationship between the first proportion and the second proportion, so that the final test results are more in line with user expectations, further improving the test accuracy and user experience.

[0060] According to some embodiments of the present application, the recruitment recommendation system can be used for job recommendation. The reference recommendation result can be a reference recommended job, that is, a reference recommended job that the user is interested in or not interested in. The reference recommended job that the user is interested in or not interested in can be a recommended job that the user himself expects to get or does not expect to get, or it can be determined by the user's historical behavior data of the recruitment recommendation system. Accordingly, the first recommendation result can be the first recommended job, and the second recommendation result can be the second recommended job.

[0061] Taking the reference recommended position that the user is interested in as software development engineer as an example, in S103, the first recommendation result inconsistent with the reference recommendation result refers to the first recommended position that is inconsistent with software development engineer (i.e., not a software development engineer), and the second recommendation result inconsistent with the reference recommendation result refers to the second recommended position that is inconsistent with software development engineer (i.e., not a software development engineer).

[0062] In this way, for the new version of the recruitment recommendation system for job recommendation, the present application can realize automated testing of the new version of the recruitment recommendation system, significantly improve test efficiency, reduce the impact of human factors, and help improve the accuracy and reliability of test results and reduce test costs; on the other hand, by comparing multiple second recommended positions with multiple first recommended positions, the data missing conditions of the second recommended positions and the data differences with the first recommended positions are taken into consideration. When the data missing conditions and data differences are in line with expectations, the relationship between the first proportion and the second proportion is compared to evaluate whether the effect of the second version of the recruitment recommendation system has been improved, so that the final test position is more in line with user expectations, further improving test accuracy and user experience.

[0063] According to some other embodiments of the present application, the recruitment recommendation system can be used for job recommendation, optionally. The reference recommendation result can be a reference recommended resume, that is, a reference recommended resume that the user is interested in or not interested in, such as a resume of the region, age, gender, major, education, work experience and / or personality hobbies that the user is interested in, or a resume of the region, age, gender, major, education, work experience and / or personality hobbies that the user is not interested in. The reference recommended resume that the user is interested in or not interested in can be a recommended resume that the user himself expects to obtain or does not expect to obtain, or it can be determined by the user's historical behavior data of the recruitment recommendation system. Accordingly, the first recommendation result can be a first recommended resume, and the second recommendation result can be a second recommended resume.

[0064] In S103, when the reference recommendation result is a reference recommended resume that the user is interested in, the recommended resume that is inconsistent with the reference recommended resume is a recommended resume that is inconsistent with the region, age, gender, education, work experience and / or personality and hobby description that the user is interested in. That is, when the reference recommendation result is a reference recommended resume that the user is interested in, the first recommended resume that is inconsistent with the reference recommended resume is the first recommended resume that is inconsistent with the region, age, gender, education, work experience and / or personality and hobby description that the user is interested in, and the second recommended resume that is inconsistent with the reference recommended resume is the second recommended resume that is inconsistent with the region, age, gender, education, work experience and / or personality and hobby description that the user is interested in.

[0065] In the case where the reference recommendation result is a reference recommended resume that the user is not interested in, the recommended resume that is inconsistent with the reference recommended resume is a recommended resume that is inconsistent with the region, age, gender, education, work experience and / or personality and hobby description that the user is not interested in. That is, in the case where the reference recommendation result is a reference recommended resume that the user is not interested in, the first recommended resume that is inconsistent with the reference recommended resume is the first recommended resume that is inconsistent with the region, age, gender, education, work experience and / or personality and hobby description that the user is not interested in, and the second recommended resume that is inconsistent with the reference recommended resume is the second recommended resume that is inconsistent with the region, age, gender, education, work experience and / or personality and hobby description that the user is not interested in.

[0066] In this way, for the new version of the recruitment recommendation system for resume recommendation, the present application can realize automated testing of the new version of the recruitment recommendation system, significantly improve test efficiency, reduce the impact of human factors, and help improve the accuracy and reliability of test results and reduce test costs; on the other hand, by comparing multiple second recommended resumes with multiple first recommended resumes, the data missing conditions of the second recommended resumes and the data differences with the first recommended resumes are taken into consideration. When the data missing conditions and data differences are both as expected, the relationship between the first proportion and the second proportion is compared to evaluate whether the effect of the second version of the recruitment recommendation system has been improved, so that the final test resume is more in line with user expectations, further improving test accuracy and user experience.

[0067] According to some embodiments of the present application, optionally, the testing method for a recruitment recommendation system provided in the embodiments of the present application may further include the following steps:

[0068] For each filtering condition input by the user in the target request parameter, the proportion of the second recommendation results that meet the requirements of each filtering condition among the multiple second recommendation results can be calculated.

[0069] Taking resume recommendation as an example, the proportion of second recommended resumes whose industries meet the industry screening conditions, the proportion of second recommended resumes whose academic qualifications meet the academic qualification screening conditions, the proportion of second recommended resumes whose ages meet the age screening conditions, etc.

[0070] Accordingly, in S105, if the target request parameter uses a reference recommendation result that the user is interested in, and the second proportion is less than or equal to the first proportion, and the proportion of the second recommendation results that meet the requirements of each screening condition in multiple second recommendation results is greater than or equal to the preset threshold, then the second version of the recruitment recommendation system test is determined to have passed. Alternatively, if the target request parameter uses a reference recommendation result that the user is not interested in, and the second proportion is greater than or equal to the first proportion, and the proportion of the second recommendation results that meet the requirements of each screening condition in multiple second recommendation results is greater than or equal to the preset threshold, then the second version of the recruitment recommendation system test is determined to have passed.

[0071] In this way, whether the second recommendation result meets each filtering condition is taken into consideration. By calculating the proportion of second recommendation results that meet each filtering condition among multiple second recommendation results, and adding the judgment of one or more proportions to obtain the test result, the test accuracy and user experience can be further improved.

[0072] According to some embodiments of the present application, optionally, before S102, calling the interface of the first version of the recruitment recommendation system based on the target request parameter to obtain multiple first recommendation results, the testing method for the recruitment recommendation system provided by the embodiment of the present application may further include the following steps:

[0073] Turn off the switch for updating recommended data in the target database. The recommended data includes position data or resume data.

[0074] As mentioned above, the first version of the recruitment recommendation system can be used to query multiple first recommendation results that meet the target request parameter requirements from the recommendation data stored in the target database. The second version of the recruitment recommendation system can be used to query multiple second recommendation results that meet the target request parameter requirements from the recommendation data stored in the target database.

[0075] There may be a time difference between calling the interface of the first version of the recruitment recommendation system and calling the interface of the second version of the recruitment recommendation system. By turning off the switch for updating the recommended data in the target database, it is possible to effectively avoid differences in the recommendation results of the two versions of the recruitment recommendation system that are not caused by data updates in the target database, thereby further improving the test accuracy.

[0076] According to some embodiments of the present application, optionally, before turning off the switch for updating the recommendation data in the target database, the testing method for the recruitment recommendation system provided by the embodiments of the present application may further include the following steps 11 to 15.

[0077] Step 11: Synchronize the recommended data in the source data table from at least one recruitment channel to the target data table in the target database, where each piece of recommended data includes a plurality of fields arranged in columns.

[0078] In step 11, the recommended data in the source data table from one or more recruitment channels can be synchronized to the target data table in the target database. The recommended data can be position data or resume data. Recruitment channels include but are not limited to recruitment websites, recruitment platforms, internal recommendations and / or social media apps, etc., which are not limited in this application.

[0079] Each piece of recommended data may include multiple fields arranged in columns. Taking the recommended data as resume data as an example, each piece of resume data may include multiple fields such as resume ID, name, age, gender, major, education, place of residence, salary requirements, work experience and / or personality and hobbies description.

[0080] Assuming that the source data table of any recruitment channel is data table A and the target data table is data table B, in step 11, the recommended data in data table A that meets the preset synchronization conditions can be synchronized to data table B. The preset synchronization conditions can be flexibly set according to actual conditions, and this application does not limit this.

[0081] Step 12: Set a plurality of second target data columns in the target data table that need to be compared with the plurality of first target data columns in the source data table, and align the plurality of first target data columns with the plurality of second target data columns.

[0082] Step 13: Compare the multiple first target data columns with the multiple second target data columns to obtain difference results, which include the first data unique to the multiple first target data columns, the second data unique to the multiple second target data columns, and at least one item in the second target data columns that is different from the data in the first target data columns.

[0083] The unique first data in the first target data columns are data existing in the first target data columns but missing in the second target data columns, and the unique second data in the second target data columns are data existing in the second target data columns but missing in the first target data columns.

[0084] Step 14: Based on the difference results, perform a quality score on this data synchronization and analyze the problems that exist in this data synchronization.

[0085] Figure 2 A flow chart of step 14 in the test method for the recruitment recommendation system provided in the embodiment of the present application. Figure 2 As shown, in some specific embodiments, optionally, step 14: scoring the quality of this data synchronization and analyzing the problems existing in this data synchronization may include the following steps 141 and 142.

[0086] Step 141: Determine whether the first data missing in the target data table is the expected missing data. If not, deduct points according to the preset deduction rules based on the number or proportion of the first data missing in the target data table, and determine that the problem existing in this data synchronization at least includes missing data.

[0087] Step 142: If there are differences between the data in the second target data column and the corresponding first target data column, points are deducted according to the preset deduction rules based on the number or proportion of data with differences in the second target data column, and it is determined that the problem with this data synchronization at least includes a data synchronization rule error.

[0088] Among them, the preset deduction rule is that starting from the preset total score, if the number or proportion of the first data missing in the target data table is x times the first preset deduction threshold, then x times the first preset score will be deducted; if the number or proportion of the data with differences in the second target data column is y times the second preset deduction threshold, then y times the second preset score will be deducted; the multiples are rounded up, and x and y are both positive integers.

[0089] It should be noted that the preset total score, the first preset deduction threshold, the second preset deduction threshold, the first preset score and the second preset score can be flexibly adjusted according to actual conditions, and this application does not limit this.

[0090] Both x and y can be integers rounded up. For example, when the number or proportion of the first data missing from the target data table is 1.3 times the first preset deduction threshold, x = 2. When the number or proportion of the data with differences in the second target data column is 2.5 times the second preset deduction threshold, y = 3.

[0091] In some embodiments, optionally, the first preset score may be greater than the second preset score.

[0092] If the data missing problem is serious, more points will be deducted. If the data synchronization rule error problem is a medium-level problem, fewer points can be deducted. If the final score after deduction is less than the preset threshold, the quality of this data synchronization is unqualified.

[0093] Step 15: Output an evaluation report, which displays the difference results, the quality score of this data synchronization, and the problems existing in this data synchronization.

[0094] In this way, when synchronizing recommended data, by finding missing data and differences in the target data table, and performing quality scoring and analyzing the problems existing in this data synchronization, automated testing of data synchronization is achieved, and multiple analyses such as quality analysis and effect analysis are realized, which helps developers quickly and accurately understand the details of this data synchronization.

[0095] According to some embodiments of the present application, optionally, the testing method for a recruitment recommendation system provided in the embodiments of the present application may further include the following steps:

[0096] After finding out the second target data column having data different from the first target data column, a test case corresponding to the second target data column having data different from the first target data column is executed to find out the cause of the data difference.

[0097] Specifically, after finding the second target data column that has data different from the first target data column, only the test case corresponding to the second target data column that has data different from the first target data column can be executed, thereby facilitating rapid discovery of the cause of the data difference in the second target data column, reducing testing workload, shortening testing time, and improving testing efficiency.

[0098] Based on the same technical concept as the testing method for a recruitment recommendation system provided in the above embodiment, the present application also provides a testing device for a recruitment recommendation system.

[0099] Figure 3 A schematic diagram of a structure of a testing device for a recruitment recommendation system provided in an embodiment of the present application. Figure 3 As shown, the testing device 30 for the recruitment recommendation system provided in the embodiment of the present application may include the following modules:

[0100] The acquisition module 301 is used to acquire the target request parameters of the user in the recruitment recommendation system, where the target request parameters include the screening conditions input by the user and the reference recommendation results that the user is interested in or not interested in;

[0101] A calling module 302 is used to call the interface of the first version of the recruitment recommendation system based on the target request parameter to obtain a plurality of first recommendation results, and to call the interface of the second version of the recruitment recommendation system based on the target request parameter to obtain a plurality of second recommendation results;

[0102] A first calculation module 303 is used to calculate a first proportion of first recommendation results inconsistent with the reference recommendation results among the plurality of first recommendation results, and calculate a second proportion of second recommendation results inconsistent with the reference recommendation results among the plurality of second recommendation results;

[0103] A second calculation module 304 is used to compare the multiple first recommendation results with the multiple second recommendation results, and determine whether the multiple second recommendation results are missing data compared with the multiple first recommendation results according to the comparison result, and calculate a third proportion of the second recommendation results that are inconsistent with the first recommendation results in the multiple second recommendation results;

[0104] The judgment module 305 is used to judge the size relationship between the first proportion and the second proportion if the missing second recommendation result in multiple second recommendation results is consistent with the expected missing recommendation result, and the third proportion is less than the first preset threshold value, wherein, if the target request parameter uses the reference recommendation result that the user is interested in, and the second proportion is less than or equal to the first proportion, then it is determined that the second version of the recruitment recommendation system test has passed; or, if the target request parameter uses the reference recommendation result that the user is not interested in, and the second proportion is greater than or equal to the first proportion, then it is determined that the second version of the recruitment recommendation system test has passed.

[0105] The test device for a recruitment recommendation system provided in the embodiment of the present application, on the one hand, for the second version (i.e., new version) of the recruitment recommendation system, by comparing the multiple second recommendation results obtained by the second version of the recruitment recommendation system with the multiple first recommendation results obtained by the first version of the recruitment recommendation system and the reference recommendation results that the user is interested in or not interested in, and obtaining the recruitment recommendation system test results based on the multiple comparison results, it is possible to implement automated testing of the new version of the recruitment recommendation system, significantly improve the test efficiency, reduce the impact of human factors, and help improve the accuracy and reliability of the test results and reduce the test cost; on the other hand, by comparing the multiple second recommendation results with the multiple first recommendation results, the data missing situation of the second recommendation results and the data difference with the first recommendation results are taken into account. When the data missing situation and the data difference situation are both as expected, by comparing the size relationship between the first proportion and the second proportion, it is evaluated whether the effect of the second version of the recruitment recommendation system is improved, so that the final test result is more in line with user expectations, further improving the test accuracy and user experience.

[0106] According to some embodiments of the present application, optionally, the judgment module 305 can also be used to determine that the second version of the recruitment recommendation system test has failed if the missing second recommendation result in multiple second recommendation results is inconsistent with the expected missing recommendation result, and the number of missing second recommendation results is greater than a second preset threshold; if the target request parameter uses a reference recommendation result that the user is interested in, and the second proportion is greater than the first proportion, then the second version of the recruitment recommendation system test has failed; or, if the target request parameter uses a reference recommendation result that the user is not interested in, and the second proportion is less than the first proportion, then the second version of the recruitment recommendation system test has failed.

[0107] According to some embodiments of the present application, optionally, the reference recommendation result is a reference recommended position, the first recommendation result is a first recommended position, and the second recommendation result is a second recommended position. Alternatively, the reference recommendation result is a reference recommended resume, the first recommendation result is a first recommended resume, and the second recommendation result is a second recommended resume.

[0108] Among them, when the reference recommendation result is a reference recommended resume that the user is interested in, the recommended resume that is inconsistent with the reference recommended resume is a recommended resume that is inconsistent with the region, age, gender, education level, work experience and / or personality and hobby description that the user is interested in; when the reference recommendation result is a reference recommended resume that the user is not interested in, the recommended resume that is inconsistent with the reference recommended resume is a recommended resume that is inconsistent with the region, age, gender, education level, work experience and / or personality and hobby description that the user is not interested in.

[0109] According to some embodiments of the present application, optionally, the test device 30 for the recruitment recommendation system provided in the embodiments of the present application may also include a shutdown module, which is used to turn off the switch for updating the recommended data in the target database, and the recommended data includes position data or resume data. Among them, the first version of the recruitment recommendation system is used to query multiple first recommendation results that meet the target request parameter requirements from the recommended data stored in the target database, and the second version of the recruitment recommendation system is used to query multiple second recommendation results that meet the target request parameter requirements from the recommended data stored in the target database.

[0110] According to some embodiments of the present application, optionally, the testing device 30 for a recruitment recommendation system provided in the embodiments of the present application may further include a data synchronization analysis module, which is used to synchronize recommendation data in a source data table from at least one recruitment channel to a target data table in a target database, wherein each recommendation data includes multiple fields arranged in columns; multiple second target data columns in the target data table that need to be compared with multiple first target data columns in the source data table are set, and the multiple first target data columns are aligned with the multiple second target data columns; the multiple first target data columns are compared with the multiple second target data columns to obtain difference results, and the difference results include first data unique to the multiple first target data columns, second data unique to the multiple second target data columns, and at least one item in the second target data column that is different from the data in the first target data column; according to the difference results, a quality score is given to this data synchronization, and problems existing in this data synchronization are analyzed; an evaluation report is output, and the evaluation report shows the difference results, the quality score of this data synchronization, and problems existing in this data synchronization.

[0111] According to some embodiments of the present application, optionally, the data synchronization analysis module can be specifically used to determine whether the missing first data in the target data table is the expected missing data. If not, points are deducted according to the preset deduction rules based on the number or proportion of the missing first data in the target data table, and it is determined that the problem with this data synchronization at least includes missing data; if there is a difference between the data in the second target data column and the corresponding first target data column, points are deducted according to the preset deduction rules based on the number or proportion of the data with differences in the second target data column, and it is determined that the problem with this data synchronization at least includes an error in the data synchronization rule.

[0112] Among them, the preset deduction rule is that starting from the preset total score, if the number or proportion of the first data missing in the target data table is x times the first preset deduction threshold, then x times the first preset score will be deducted; if the number or proportion of the data with differences in the second target data column is y times the second preset deduction threshold, then y times the second preset score will be deducted; the multiples are rounded up, and x and y are both positive integers.

[0113] According to some embodiments of the present application, optionally, the testing device 30 for a recruitment recommendation system provided in the embodiments of the present application may also include an execution module for executing a test case corresponding to the second target data column that is different from the data in the first target data column after finding the second target data column that is different from the data in the first target data column, so as to find out the cause of the data difference.

[0114] Figure 3 Each module / unit in the device shown has the function of implementing each step in the testing method for a recruitment recommendation system provided in the above method embodiment, and can achieve its corresponding technical effect. For the sake of concise description, it will not be repeated here.

[0115] The electronic device in the embodiment of the present application may be a user terminal device, a server, other computing devices, or a cloud server. Figure 4 This is a hardware structure diagram of an electronic device of an embodiment of the present application. The electronic device may include a processor 401 and a memory 402 storing computer program instructions. When the processor 401 executes the computer program instructions, it implements the process or function of any of the above-mentioned embodiment methods.

[0116] Specifically, the processor 401 may include a central processing unit (CPU), or an application-specific integrated circuit (ASIC), or may be configured to implement one or more integrated circuits of the embodiments of the present application. The memory 402 may include a large-capacity memory for data or instructions. For example, the memory 402 may be at least one of the following: a hard disk drive (HDD), a read-only memory (ROM), a random access memory (RAM), a floppy disk drive, a flash memory, an optical disk, a magneto-optical disk, a tape, a universal serial bus (USB) drive or other physical / tangible memory storage device. For another example, the memory 402 may include a removable or non-removable (or fixed) medium. For another example, the memory 402 may be inside or outside the integrated gateway disaster recovery device. The memory 402 may be a non-volatile solid-state memory. In other words, the memory 402 generally includes a tangible (non-transitory) computer-readable storage medium (such as a memory device) encoded with computer-executable instructions, and when the software is executed (such as executed by one or more processors), the operations described in the method of the embodiments of the present application may be performed. The processor 401 implements the process or function of any method in the above embodiments by reading and executing the computer program instructions stored in the memory 402 .

[0117] In one example, Figure 4 The electronic device shown may also include a communication interface 403 and a bus 410. Among them, the processor 401, the memory 402, and the communication interface 403 are connected through the bus 410 and complete the communication between each other. The communication interface 403 is mainly used to realize the communication between each module, device, unit and / or device in the embodiment of the present application. The bus 410 includes hardware, software or both, and can couple the components of the online data traffic billing device to each other. For example, the bus may include at least one of the following: an accelerated graphics port (AGP) or other graphics bus, an enhanced industrial standard architecture (EISA) bus, a front-end bus (FSB), a hypertransport (HT) interconnect, an industrial standard architecture (ISA) bus, an infinite bandwidth interconnect, a low pin count (LPC) bus, a memory bus, a micro channel architecture (MCA) bus, a peripheral component interconnect (PCI) bus, a PCI-Express (PCI-X) bus, a serial advanced technology attachment (SATA) bus, a video electronics standard association local (VLB) bus or other suitable buses. The bus 410 may include one or more buses. Although the embodiments of the present application describe or illustrate a specific bus, the embodiments of the present application may consider any suitable bus or interconnection method.

[0118] In combination with the method in the above embodiments, an embodiment of the present application also provides a computer-readable storage medium, on which computer program instructions are stored. When the computer program instructions are executed by a processor, the process or function of any method in the above embodiments is implemented.

[0119] In addition, an embodiment of the present application further provides a computer program product, on which computer program instructions are stored. When the computer program instructions are executed by a processor, the process or function of any one of the methods in the above embodiments is implemented.

[0120] The above exemplarily describes the flowcharts and / or block diagrams of the methods, devices, systems and computer program products of the embodiments of the present application, and describes the relevant various aspects. It should be understood that each box or combination thereof in the flowchart and / or block diagram can be implemented by computer program instructions, or by dedicated hardware that performs a specified function or action, or by a combination of dedicated hardware and computer instructions. For example, these computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer or other programmable data processing device to form a machine that enables these instructions executed by such a processor to enable the implementation of the functions / actions specified in each box or combination thereof in the flowchart and / or block diagram. Such a processor can be a general-purpose processor, a special-purpose processor, a special application processor or a field programmable logic circuit.

[0121] The functional blocks shown in the structured block diagram of the embodiment of the present application can be implemented as hardware, software, firmware or a combination thereof. When implemented in hardware, it can be, for example, an electronic circuit, an application-specific integrated circuit (ASIC), appropriate firmware, a plug-in, a function card, etc.; when implemented in software, it is a program or code segment used to perform the required task. The program or code segment can be stored in a memory, or transmitted on a transmission medium or a communication link via a data signal carried in a carrier. The code segment can be downloaded via a computer network such as the Internet, an intranet, etc.

[0122] It should be noted that the present application is not limited to the specific configurations and processes described above or shown in the figures. The above is only a specific implementation mode of the present application. Those skilled in the art can clearly understand that for the convenience and brevity of description, the specific working process of the described system, device, module or unit can refer to the corresponding process in the method embodiment without further description. It should be understood that the scope of protection of the present application is not limited to this. Any technician familiar with the technical field can think of various equivalent modifications or substitutions within the technical scope disclosed in the present application, and these modifications or substitutions should be included in the scope of protection of the present application.

Claims

1. A testing method for a recruitment recommendation system, characterized in that: include: Obtain the target request parameters of the user in the recruitment recommendation system, which include the screening conditions entered by the user and the reference recommendation results that the user is interested in or not interested in; Calling the interface of the first version of the recruitment recommendation system based on the target request parameters to obtain multiple first recommendation results, and calling the interface of the second version of the recruitment recommendation system based on the target request parameters to obtain multiple second recommendation results; Calculate a first proportion of first recommendation results inconsistent with the reference recommendation result among the plurality of first recommendation results, and calculate a second proportion of second recommendation results inconsistent with the reference recommendation result among the plurality of second recommendation results; Comparing the plurality of first recommendation results with the plurality of second recommendation results, and determining whether data is missing from the plurality of second recommendation results compared with the plurality of first recommendation results according to the comparison result, and calculating a third proportion of the second recommendation results that are inconsistent with the first recommendation results in the plurality of second recommendation results; If the missing second recommendation result among multiple second recommendation results is consistent with the expected missing recommendation result, and the third proportion is less than the first preset threshold, the size relationship between the first proportion and the second proportion is determined, wherein, if the target request parameter uses a reference recommendation result that the user is interested in, and the second proportion is less than or equal to the first proportion, then the second version of the recruitment recommendation system test is determined to have passed; or, if the target request parameter uses a reference recommendation result that the user is not interested in, and the second proportion is greater than or equal to the first proportion, then the second version of the recruitment recommendation system test is determined to have passed.

2. The method according to claim 1, characterized in that The method further comprises: If the missing second recommendation results in the plurality of second recommendation results are inconsistent with the expected missing recommendation results, and the number of the missing second recommendation results is greater than the second preset threshold, it is determined that the second version of the recruitment recommendation system test has failed; If the target request parameter uses a reference recommendation result that the user is interested in, and the second proportion is greater than the first proportion, then the second version of the recruitment recommendation system test is determined to have failed; or, if the target request parameter uses a reference recommendation result that the user is not interested in, and the second proportion is less than the first proportion, then the second version of the recruitment recommendation system test is determined to have failed.

3. The method according to claim 1, characterized in that The reference recommendation result is a reference recommended position, the first recommendation result is a first recommended position, and the second recommendation result is a second recommended position; Alternatively, the reference recommendation result is a reference recommended resume, the first recommendation result is a first recommended resume, and the second recommendation result is a second recommended resume; Among them, when the reference recommendation result is a reference recommended resume that the user is interested in, the recommended resume that is inconsistent with the reference recommended resume is a recommended resume that is inconsistent with the region, age, gender, major, education, work experience and / or personality and hobby description that the user is interested in; when the reference recommendation result is a reference recommended resume that the user is not interested in, the recommended resume that is inconsistent with the reference recommended resume is a recommended resume that is inconsistent with the region, age, gender, major, education, work experience and / or personality and hobby description that the user is not interested in.

4. The method according to claim 1, characterized in that: Before calling the interface of the first version of the recruitment recommendation system based on the target request parameter to obtain a plurality of first recommendation results, the method further includes: Turn off the switch for updating recommended data in the target database. Recommended data includes job data or resume data. Among them, the first version of the recruitment recommendation system is used to query multiple first recommendation results that meet the target request parameter requirements from the recommendation data stored in the target database, and the second version of the recruitment recommendation system is used to query multiple second recommendation results that meet the target request parameter requirements from the recommendation data stored in the target database.

5. The method according to claim 4, characterized in that Before turning off the switch for updating the recommended data in the target database, the method further includes: Synchronize the recommended data in the source data table from at least one recruitment channel to the target data table of the target database, each piece of recommended data includes a plurality of fields arranged in columns; Setting a plurality of second target data columns in the target data table to be compared with the plurality of first target data columns in the source data table, and aligning the plurality of first target data columns with the plurality of second target data columns; Comparing the plurality of first target data columns with the plurality of second target data columns to obtain difference results, wherein the difference results include at least one item of first data unique to the plurality of first target data columns, second data unique to the plurality of second target data columns, and second target data columns that are different from data in the first target data columns; According to the difference results, the quality of this data synchronization is scored and the problems existing in this data synchronization are analyzed; An evaluation report is output, wherein the evaluation report shows the difference results, the quality score of this data synchronization, and the problems existing in this data synchronization.

6. The method according to claim 5, characterized in that According to the difference results, the quality of this data synchronization is scored and the problems existing in this data synchronization are analyzed, including: Determine whether the first missing data in the target data table is the expected missing data. If not, deduct points according to the preset deduction rule based on the number or proportion of the first missing data in the target data table, and determine that the problem existing in this data synchronization at least includes missing data; If there is a difference between the data in the second target data column and the corresponding first target data column, points are deducted according to the preset deduction rule based on the number or proportion of the data with differences in the second target data column, and it is determined that the problem in this data synchronization at least includes a data synchronization rule error; Among them, the preset deduction rule is that starting from the preset total score, if the number or proportion of the first data missing in the target data table is x times the first preset deduction threshold, then x times the first preset score will be deducted; if the number or proportion of the data with differences in the second target data column is y times the second preset deduction threshold, then y times the second preset score will be deducted; the multiples are rounded up, and x and y are both positive integers.

7. The method according to claim 5, characterized in that The method further comprises: After finding out the second target data column having data different from the first target data column, a test case corresponding to the second target data column having data different from the first target data column is executed to find out the cause of the data difference.

8. A testing device for a recruitment recommendation system, characterized in that: include: An acquisition module is used to obtain the target request parameters of the user in the recruitment recommendation system. The target request parameters include the screening conditions input by the user and the reference recommendation results that the user is interested in or not interested in; A calling module, configured to call the interface of the first version of the recruitment recommendation system based on the target request parameters to obtain a plurality of first recommendation results, and to call the interface of the second version of the recruitment recommendation system based on the target request parameters to obtain a plurality of second recommendation results; A first calculation module is used to calculate a first proportion of first recommendation results inconsistent with the reference recommendation results among the plurality of first recommendation results, and calculate a second proportion of second recommendation results inconsistent with the reference recommendation results among the plurality of second recommendation results; a second calculation module, configured to compare the plurality of first recommendation results with the plurality of second recommendation results, and determine whether data is missing from the plurality of second recommendation results compared with the plurality of first recommendation results according to the comparison result, and calculate a third proportion of the second recommendation results that are inconsistent with the first recommendation results in the plurality of second recommendation results; A judgment module is used to judge the size relationship between the first proportion and the second proportion if the missing second recommendation result among multiple second recommendation results is consistent with the expected missing recommendation result, and the third proportion is less than the first preset threshold, wherein if the target request parameter uses a reference recommendation result that the user is interested in, and the second proportion is less than or equal to the first proportion, then it is determined that the second version of the recruitment recommendation system test has passed; or, if the target request parameter uses a reference recommendation result that the user is not interested in, and the second proportion is greater than or equal to the first proportion, then it is determined that the second version of the recruitment recommendation system test has passed.

9. An electronic device, characterized in that: The electronic device comprises: a processor and a memory storing computer program instructions; when the electronic device executes the computer program instructions, the test method for a recruitment recommendation system as described in any one of claims 1 to 7 is implemented.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer program instructions, and when the computer program instructions are executed by a processor, the testing method for a recruitment recommendation system according to any one of claims 1 to 7 is implemented.

Images