Rail transit data integration method

A data integration and rail transit technology, applied in the field of data processing, can solve problems such as inconsistency between data standards and models, difficulty in meeting decision-making needs, and difficulty in data governance, so as to facilitate life cycle management, enhance data value, facilitate search and The effect of maintenance

Pending Publication Date: 2021-04-27
科技谷(厦门)信息技术有限公司
View PDF9 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] At present, the rail transit data has the following problems: 1. The data is scattered in various departments, and the data of each department is stored in a separate database, which makes it difficult to achieve data aggregation; 2. The standards and models of the data are inconsistent, and data governance is difficult; 3. Lack of ability to effectively process multiple types of data in different formats, resulting in inefficient data reading and data aggregation
It is precisely because of the lack of unified data management that the value of data cannot be brought into play, and data cannot be used to provide theoretical basis for rail transit decision-making, it is difficult to meet the needs of decision-making, let alone realize data-based innovation and value-added

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0024] A rail transit data integration method, characterized in that: comprising the steps of:

[0025] S1. Extract raw data from various rail transit business systems to build a basic data layer;

[0026] S2. Associate the same entity existing in different business data through the data map;

[0027] S3. Extract the data to generate a reusable extracted data layer.

[0028] Before the construction of the basic data layer, the original data is cleaned and processed.

[0029] The raw data extraction includes batch data extraction and stream data extraction.

[0030] The batch data extraction is actively pulled through the data integration artifact Flink and directly written into the basic data layer.

[0031] The streaming data extraction is specifically: first access data through Flink, and then enter the Kafka message queue, and the Kafka queue stores the messages according to the topic classification. Each topic is divided into several areas, and the storage level of each...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a rail transit data integration method, and the method comprises the following steps of S1, extracting original data from each rail transit service system, and constructing a basic data layer; S2, associating the same entity existing in different service data through a data map; S3, extracting the data to generate a reusable extraction data layer. According to the method, a complete basic data layer is constructed, and data association is realized by adopting a data map, so that classification, search and maintenance of the data are facilitated; in addition, through labeling of the data, life cycle management of the data is achieved, and therefore the data value is improved.

Description

technical field [0001] The invention relates to the technical field of data processing, in particular to a rail transit data integration method. Background technique [0002] At present, the rail transit data has the following problems: 1. The data is scattered in various departments, and the data of each department is stored in a separate database, which makes it difficult to achieve data aggregation; 2. The standards and models of the data are inconsistent, and data governance is difficult; 3. Lack of ability to effectively process multiple types of data in different formats, resulting in low efficiency of data reading and data aggregation. It is precisely because of the lack of unified data management that the value of data cannot be brought into play, and data cannot be used to provide theoretical basis for rail transit decision-making, it is difficult to meet the needs of decision-making, let alone realize data-based innovation and value-added. Contents of the inventi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/22G06F16/215G06F16/23G06F16/28
CPCG06F16/2291G06F16/215G06F16/285G06F16/2358
Inventor 陈思恩
Owner 科技谷(厦门)信息技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap