Enterprise data governance method and device based on metadata

A technology of enterprise data and metadata, applied in special data processing applications, database indexing, database updating, etc., can solve problems such as unguaranteed quality, no consideration of impact, and insufficient support to ensure data enhancement and credibility speed, increase speed and quality, and ensure accuracy

Pending Publication Date: 2022-04-15
执中数据科技(苏州)有限责任公司
View PDF0 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, the above existing technologies support the development process more from the perspective of technology research and development, while ignoring the rule definition and auditing of data assets by business personnel, which easily leads to inconsistencies between R&D and business personnel on the details of enterprise data assets and processing rules; Moreover, the above-mentioned existing technologies hardly consider the impact of data source changes (including field changes and field value changes) on the golden copy of enterprise master data. There is no perfect data confirmation and release process, and the quality cannot be guaranteed; The technology mainly deals with the processing of structured data, and when it is necessary to use natural language processing technology to extract unstructured text and entities encounter unstructured text data, the support is not good enough, such as recognition and alignment, need Do additional system integration work

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Enterprise data governance method and device based on metadata
  • Enterprise data governance method and device based on metadata
  • Enterprise data governance method and device based on metadata

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0031] In order to better understand the technical solutions of the embodiments of the present invention, the overall data flow involved in the process of enterprise data governance is firstly introduced.

[0032] see figure 1 , External multi-channel data sources in the overall data flow: including landing databases, API docking, and crawler collection. For various data sources, full and incremental processing, data auditing, data sustainability, and alternative supplementary data sources need to be considered.

[0033] Internal data: including user behavior and transaction data accumulated in the business system, internal corporate documents accumulated over a long period of time, etc.;

[0034] Data Lake: It can store structured data (such as tables in relational databases), semi-structured data (such as CSV, logs, XML, JSON), and unstructured data (such as documents, PDFs, images, audio, and videos).

[0035] The architecture includes: access layer, data storage, data pro...

Embodiment 2

[0085] The embodiment of the present invention provides a data fusion method to support the management and operation of private equity fund asset package information data. Figure 7 Operational interface for asset management data.

[0086] Specifically, the information of a private equity fund asset package includes: basic information, fund overview, partner information, investment and exit information, key project information, etc. Due to the weak digitalization of the primary market and the confidentiality of transactions, etc. The dimensions and accuracy of the data source data are not enough, so data fusion based on multiple data sources is required to ensure the integrity and accuracy of the data. The data sources in this embodiment include industrial and commercial information, investment and financing databases, listed company information, Investment documents provided by the fund manager, etc.

[0087] The specific generation process of fund asset package information ...

Embodiment 3

[0095] An embodiment of the present invention provides a metadata-based enterprise data governance device, including:

[0096] A master data table definition module, configured to define a master data table corresponding to the business analysis target according to the business analysis target;

[0097] a metadata model definition module, configured to define a metadata model based on the master data table;

[0098] The target business table generation module is used to perform data fusion of multiple data sources obtained according to the metadata model to generate a target business table, and automatically execute the fusion engine to perform data extraction, conversion, fusion and verification; confirmation and release module , for storing the target business table in a database buffer table for confirmation and release by business personnel or data personnel.

[0099] Among them, the metadata definition content in the metadata model definition module includes:

[0100] F...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an enterprise data management method and device based on metadata, and the method comprises the steps: defining a main data table corresponding to a business analysis target according to the business analysis target; defining a metadata model based on the main data table; according to the metadata model, performing data fusion on the acquired multiple data sources to generate a target business table, and automatically executing a fusion engine to perform data extraction, conversion, fusion and verification; and storing the target data table into a database buffer table for business personnel or data personnel to confirm and publish. According to the method, metadata definition is carried out on the business data from the business purpose, and a conversion rule, a standard and a verification mechanism from the multi-source data to the target data are clarified. Therefore, the business personnel participate in the data cleaning and constructing process, and the accuracy of the data processing rule and the data quality are ensured.

Description

technical field [0001] The embodiment of the present invention relates to the technical field of enterprise data governance, and in particular to a metadata-based enterprise data governance method and device. Background technique [0002] The digital transformation of an enterprise is a process of informatization, digitalization, and intelligence of the processes and data related to enterprise management and business operations. Automate decision-making and improve efficiency. To this end, the establishment of a data analysis platform will open up the two channels of corporate data and help business development. [0003] At present, the enterprise multi-source data governance platforms that are common in the market all require the direct participation of R&D personnel, such as the data management platform developed based on open source ETL tools, and the data processing and distribution of data routing, transformation and system integration functions realized by defining gr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/22G06F16/23
CPCG06F16/2282G06F16/2365
Inventor 夏磊
Owner 执中数据科技(苏州)有限责任公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap