Data processing method and device and computer equipment applying data processing method and device

A data processing device and data processing technology, applied in the field of big data processing, can solve the problems of high cost of using tools, heavy system load, unfavorable user management of data assets, etc., and achieve the effect of improving efficiency and good management

Active Publication Date: 2017-11-07
北京希嘉创智数据技术有限公司
View PDF4 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, since each functional module is relatively independent, implementing a simple function and process needs to span several systems, resulting in relatively high tool usage costs, heavy system load, and low data management efficiency, which is not conducive to user management of data assets

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and device and computer equipment applying data processing method and device
  • Data processing method and device and computer equipment applying data processing method and device
  • Data processing method and device and computer equipment applying data processing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0020] The present invention is described below based on examples, but the present invention is not limited to these examples.

[0021] figure 1 is a structural block diagram of a data processing device according to an embodiment of the present invention. Such as figure 1 As shown, the data processing device 1 of the embodiment of the present invention includes: a data object acquisition module 11 , a metadata management module 12 , a data asset generation module 13 and a data quality generation module 14 . Each module is described in detail below.

[0022] The data object obtaining module 11 is configured to obtain the data object of the current data source through a preset interface. The data in different types of databases can be obtained through the preset interface, so as to realize the management of data sources in a unified interface. Through the data object acquisition module 11, various existing mainstream relational databases can also be integrated into a unified...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a data processing method and device and computer equipment applying the data processing method and device. The data processing device comprises a data object acquisition module, a metadata management module, a data asset generation module and a data quality generation module, wherein the data object acquisition module is used for acquiring data objects of a current data source through a preset interface; the metadata management module is used for acquiring metadata of the data objects and recording the change situations of the data objects according to the metadata, and the metadata includes at least one of the following data objects including structure information, field description information and version information; the data asset generation module is used for classifying the data objects according to the contents of data objects and generating data asset information according to classification results; the data quality generation module is used for detecting the contents of the data objects according to predetermined rules and generating a data quality report according to detection results. Through the adoption of the data processing method and device and the computer equipment, the efficiency of data management can be improved, and a user can better manage data assets.

Description

technical field [0001] The invention relates to the field of big data processing, in particular to a data processing method, device and computer equipment using the same. Background technique [0002] In the current application of big data analysis, data governance is the basic work. Based on data governance, there is currently a relatively complete set of methodologies, such as the data governance architecture released by the International Standardization Organization DAMA (Data Management Association, Data Management Agreement). [0003] In the process of data governance, the data generated by different business systems need to be extracted, clarified, converted and standardized, and a large amount of process information and result information will be generated in these steps. For example, data structure, description, definition of data standards, implementation and monitoring of data quality, monitoring and management of data task execution status. At present, the common...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/254
Inventor 汪浩胡添翼
Owner 北京希嘉创智数据技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap