Collaboration method and device for data processing process

A technology of data processing and processing, applied in the field of data processing

Active Publication Date: 2013-05-29
DATANG SOFTWARE TECH
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006]In addition, whether it is time-based or data-processing-dependent, it is very cumbersome in actual use
Due to the large number of interfaces in the ODS system and the large order of magnitude of the data processing process, the process of configuration execution dependency and sequential execution sequence is quite complicated, and the business requirements for operators are quite high. Generally, only experienced maintenance personnel can understand most of the data processing process. It will be a very complicated job to require it to establish the dependencies of different data processing processes correctly, and the possibility of omissions in the configuration process is quite high

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Collaboration method and device for data processing process
  • Collaboration method and device for data processing process
  • Collaboration method and device for data processing process

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0061] In order to make the above objects, features and advantages of the present invention more comprehensible, the present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0062] refer to figure 2 , which shows a flow chart of an embodiment of a collaborative method for a data processing process in the present invention, including:

[0063] Step 201, establishing the configuration information of the input-output relationship between the data processing process and metadata; the metadata includes: data source and data processing result;

[0064] The data processing process in the ODS system generally includes four process links: data extraction, data cleaning, data conversion and data loading. In the technical solution of the present invention, the "data extraction" and "data loading" links in the data processing process will be expanded, that is, through the analysis of the "data extraction" and "...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a collaboration method and device for a data processing process. The method comprises the following steps: building the configuration information of the relationship between a data processing procedure and the input / output of metadata, wherein the metadata comprises a data source and a data processing result; configuring the dispatching and panning information of each data processing process; and executing the corresponding data processing process according to the configuration information and the dispatching and panning information to realize the collaborating process among the data processing processes. According to the invention, the redundant execution waiting time is reduced, the data processing efficiency of an ODS (operational data store) system is improved, and the configuration of the data processing processes is simplified.

Description

technical field [0001] The present invention relates to the technical field of data processing, in particular to a data processing process coordination method and device. Background technique [0002] The ODS system is a sharing platform for cross-system operation data, which undertakes the operation environment and analysis environment. ODS cleans, filters and integrates the data generated by the application system, and at the same time provides cross-system sharing data services such as near real-time operation reports for each application system. [0003] The data structure of the ODS system is as follows: figure 1 As shown, the data processing process includes: extracting business data from other business systems to the interface layer; cleaning, converting and loading data at the interface layer to the integration layer; applying and analyzing cross-system data with data from the integration layer to form Summarize the data of the layer and share the data of the aggre...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F9/46G06Q10/06
Inventor 孙继纲王宇林荣华赵雨佳
Owner DATANG SOFTWARE TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap