A service system based on campus big data cleaning

Abstract

The invention discloses a service system based on campus big data cleaning, which comprises a campus management server, a data collection system, a data classification system, a data cleaning system and a data analysis system. The data collection system collects the data through the student service subsystem, the teaching service subsystem and the resource management subsystem; The data classification system retrieves the data for classification and creates the data organization network. the structure information table is expanded according to different data structures in the data organizationnetwork; The data cleaning system removes the redundant data from the data organization network according to the structure information table. The data analysis system analyzes the correlation betweenthe data, constructs the data relation network, recomposes the relevant data into the fact table, and stores it in the campus management server. The invention can carry out classification cleaning treatment for different data streams, perform correlation analysis, discover the value and rule of data inside, improve analysis efficiency, and provide basis for refined management and decision-makingof the school at the same time.

Description

Technical field [0001] The invention relates to the technical field of data analysis, in particular to a service system based on campus big data cleaning. Background technique [0002] With the continuous development of modern education, teachers, students, and administrators have accumulated massive amounts of data in the teaching, life, and management processes, and they are still growing at a faster rate, such as students’ grades, Internet records, and dining consumption. A large amount of data is generated, in addition to teaching equipment, classroom information, and books. Data has become an increasingly important intangible asset for schools. Therefore, how to reasonably use these data for teaching management and decision-making has become a favorable driving force and foundation for the rapid development of schools. [0003] The data sources of university big data are very wide, including traditional relational databases, semi-structured data such as XML, and unstructured...

AI Technical Summary

Problems solved by technology

Most of the current data cleaning methods are data cleaning for a certain type of specific application domain. In terms of design patterns and usage methods, although it is possible to compile programs or use external standard source files, data dictionaries, etc. according to the found error patterns, in a certain Errors can be corrected to a certain extent; however, it is often necessary to compile complex programs or use manual intervention to complete, and it is not universal for the classification and processing of different data streams

Images