Education industry data integration method, data warehouse system, equipment and medium

A technology of industry data and data warehouse, applied in the field of data warehouse, can solve the problems of inconsistent field and data definition, difficult association, etc., to achieve the effect of easy data query

Pending Publication Date: 2021-11-05
杭州布谷蓝途科技有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] At present, there are many business systems in many schools, which are developed by different manufacturers, resulting in inconsistency in the definition of fields and data, and it is difficult to associate with each other. There is a phenomenon of data islands. Therefore, it is necessary to invent a data integration method for the education industry and establish a data warehouse system. To break the phenomenon of data islands

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Education industry data integration method, data warehouse system, equipment and medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] The following are specific embodiments of the present invention and in conjunction with the accompanying drawings, the technical solutions of the present invention are further described, but the present invention is not limited to these embodiments.

[0028] Such as figure 1 As shown, the first embodiment of the present invention provides an education industry data integration method, including the following steps:

[0029] Step S1: collect data from multiple business systems into the Hadoop distributed file system, map the data to the database table in the form of text, and add the extraction time;

[0030] There are several business systems in the school, including academic engineering system, superstar system, general card system, charging system, etc. These business systems can use relational database management systems, connect these systems through interfaces, and then use the Sqoop data transfer tool to transfer business systems Import the data in the Hadoop dis...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides an education industry data integration method, a data warehouse system, equipment and a medium, belongs to the field of data warehouses; problems of data islands and the like in the prior art are solved; the method comprises the following steps: S1, collecting data from a plurality of business systems into a Hadoop distributed file system, mapping the data into a database table in a text form, and storing the data in a database; adding extracting time; S2, performing standardization processing on the data, including filtering invalid data, and naming the data according to a unified naming specification; S3, summarizing the standardized data, classifying the data according to business themes, and querying the data by using an Impala query system according to the corresponding business themes; and S4, pushing the summarized and classified data to a business application system database. According to the invention, the data in the school business system are integrated through the data warehouse system, so that a data island phenomenon is broken, and a third party can conveniently use an Impala query system to carry out data query.

Description

technical field [0001] The invention belongs to the field of data warehouses, and in particular relates to a data integration method for the education industry, a data warehouse system, equipment and media. Background technique [0002] At present, there are many business systems in many schools, which are developed by different manufacturers, resulting in inconsistency in the definition of fields and data, and it is difficult to associate with each other. There is a phenomenon of data islands. Therefore, it is necessary to invent a data integration method for the education industry and establish a data warehouse system. So as to break the phenomenon of data islands. Contents of the invention [0003] The first purpose of the present invention is to provide a kind of education industry data integration method for the above-mentioned problems existing in the prior art; The second purpose of the present invention is to provide a kind of data warehouse system; The third purpo...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/24G06F16/25G06F16/27G06F16/28
Inventor 郑操
Owner 杭州布谷蓝途科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap