Cloud Computing and Its Application in Big Data Processing of Distance Higher Education

Guolei Zhang, Jia Li, Li Hao

Abstract


In the development of information technology the development of scientific theory has brought the progress of science and technology. The progress of science and technology has an impact on the educational field, which changes the way of education. The arrival of the era of big data for the promotion and dissemination of educational resources has played an important role, it makes more and more people benefit. Modern distance education relies on the background of big data and cloud computing, which is composed of a series of tools to support a variety of teaching mode. Clustering algorithm can provide an effective evaluation method for students' personality characteristics and learning status in distance education. However, the traditional K-means clustering algorithm has the characteristics of randomness, uncertainty, high time complexity, and it does not meet the requirements of large data processing. In this paper, we study the parallel K-means clustering algorithm based on cloud computing platform Hadoop, and give the design and strategy of the algorithm. Then, we carry out experiments on several different sizes of data sets, and compare the performance of the proposed method with the general clustering method. Experimental results show that the proposed algorithm which is accelerated has good speed up and low cost. It is suitable for the analysis and mining of large data in the distance higher education.

Keywords


Cloud computing; Hadoop; Map-Reduce; Distance Higher Education; Parallel k-means clustering algorithm

Full Text:

PDF


Copyright (c) 2017 Guolei Zhang, Jia Li, Li Hao


International Journal of Emerging Technologies in Learning. ISSN: 1863-0383
Creative Commons License SPARC Europe Seal
Indexing:
Web of Science ESCI logo Engineering Information logo INSPEC logo DBLP logo ELSEVIER Scopus logo EDiTLib logo EBSCO logo Ulrich's logo Google Scholar logo Microsoft® Academic Search