Big Data Analysis and Forecast of Employment Position Requirements for College Students

Abstract

With the help of natural language processing and machine learning, we can analyze the information of online recruitment text posted by employer companies and dig the requirement features of these employment positions, and this is a meaningful work with practical value. However, existing methods for analyzing online recruitment information are too simple to withstand the mass data on the Internet, so this paper aims to study the analysis and forecast of employment position requirements for college students based on big data analysis. At first, the recruitment information of companies is preprocessed, keywords in the recruitment text are extracted by the Term Frequency-Inverse Document Frequency (TF-IDF) algorithm in the Python Chinese word segmentation toolkit, words in the recruitment text are segmented using the open source tool Word2Vec, and the uncounted words in the recruitment text are identified based on the Conditional Random Field (CRF) model. Then, this paper compares the occurrence probability of skills learnt by college students in a certain company employment position with the occurrence probability of the skills in all employment positions on the website, so as to find out the core skills learnt by college students that can match with the job positions required by companies. At last, this paper builds a XGBoost model to forecast the employment position requirements for college students, and verifies the validity of the model using experimental results.