Job description text similarity calculation method based on topic model

Abstract

The invention discloses a job description text similarity calculation method based on a topic model.The method specifically includes the steps of semantic pretreatment, model pretreatment, topic model analysis, clustering analysis, similarity calculation and the like.Projection features of job description texts on different topics are extracted, in combination with multiple specific features such as years of working, working places and education backgrounds, vectorized expression of the job description texts is achieved, and the functions of text similarity calculation and clustering and the like are completed.The texts are expressed through semantic features and field specific features, and the accuracy of similarity calculation of the job description texts is greatly improved.The function of finding jobs with highly-overlapped functions in a massive post and job description database is achieved, and the method assists corresponding departments in completing analysis and decision making.The defects that the deviation is large when a traditional vector space model is used for calculating the text similarity can be overcome, and therefore the automatic judgment function of the function overlapped jobs is better achieved.

Description

technical field [0001] The invention belongs to the technical fields of information retrieval and text mining, and in particular relates to a method for calculating the similarity of job description texts based on topic models. Background technique [0002] With the intensification of competition among enterprises, the proportion of human resources owned by enterprises in the operating costs of enterprises is getting higher and higher. Correspondingly, the deployment and flow of talents within the enterprise is becoming more and more frequent. Therefore, reducing the demand for positions with highly overlapping functions and making full use of on-the-job human resources is one of the important ways for enterprises to reduce costs and improve efficiency. As the scale of enterprises continues to expand, the traditional means of identifying positions with similar functions, such as manual screening and identification, can no longer meet the needs of enterprises. Therefore, de...

AI Technical Summary

Problems solved by technology

[0004] In order to overcome the deficiencies in the prior art, the present invention provides a topic model-based job description text similarity calculation method, which can overcome the shortcomings of the traditional vector space model when calculating text similarity, such as large deviations, so as to better realize Automatic discrimination function of overlapping functional positions

Images