Data management method and device, storage medium and system

A data management and storage medium technology, applied in the field of data warehouse, can solve large-scale data problems, avalanche effects and other problems, achieve the effect of improving efficiency, preventing avalanche effects, and avoiding large-scale data problems

Inactive Publication Date: 2019-11-15
杭州有赞科技有限公司
View PDF9 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In the process of implementing the present invention, the inventor found that the existing technology has the following defects: when performing data management, warehouse developers often need to spend a lot of energy to pay attention to some other systems for checking data quality or additiona

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data management method and device, storage medium and system
  • Data management method and device, storage medium and system
  • Data management method and device, storage medium and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0053] The technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present invention.

[0054] See figure 1 , Which is a schematic flowchart of a data management method according to an embodiment of the present invention, and the data management method is applied to a metadata system.

[0055] Meta Data (Meta Data) refers to data that describes data, usually composed of descriptions of information structure. With the development of technology, the connotation of metadata has been greatly expanded, such as UML models, data tran...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data management method, which is executed by a metadata system, and comprises the following steps: responding to an offline data task output result table of a data warehouse,executing a data quality check task on the result table to obtain a check result; judging whether the verification result is verification failure or not; in response to the fact that the verificationresult is verification failure, determining a task node with verification failure, and judging whether the task node with verification failure is configured with a first alarm mode or not; wherein the first alarm mode is used for indicating whether the task node is a key task node; and in response to the fact that the task node which fails in verification is configured with a first alarm mode, sending an interrupt signal to the data warehouse so as to enable the data warehouse to interrupt execution of the offline data task. According to the data management method provided by the invention, the data management efficiency can be improved, the avalanche effect of downstream tasks is prevented, and the problem of large-area data is avoided. Meanwhile, the invention further provides a data management device, a storage medium and a system.

Description

Technical field [0001] The invention relates to the technical field of data warehouses, in particular to data management methods, devices, storage media and systems. Background technique [0002] Data warehouse is an indispensable part of companies with massive amounts of data. It is created for further mining of data resources and for decision-making needs. In this process, a series of operations such as data collection, cleaning, and integration are bound to be involved. Then in the data-oriented process, along with data development, data management is bound to be inseparable. [0003] In the process of implementing the present invention, the inventor found that the prior art has the following defects: When performing data management, warehouse developers often need to spend a lot of energy to pay attention to some other systems for checking data quality or additional development data. Quality inspection tasks; moreover, this method of data management is actually a hindsight met...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/2458G06F16/248G06F16/27G06F16/28
CPCG06F16/2471G06F16/248G06F16/27G06F16/283
Inventor 孙伟伟
Owner 杭州有赞科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap