Data checking method and device, electronic equipment and storage medium

A checking and data technology, applied in the computer field, can solve the problems of low data checking efficiency, high reading and writing pressure on the data source server, etc.

Active Publication Date: 2020-12-29
NEW H3C BIG DATA TECH CO LTD
View PDF8 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, with the above data verification method, each time the verification task is performed, it is necessary to repeatedly obtain all the data in the verifi

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data checking method and device, electronic equipment and storage medium
  • Data checking method and device, electronic equipment and storage medium
  • Data checking method and device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0086] The following will clearly and completely describe the technical solutions in the embodiments of the application with reference to the drawings in the embodiments of the application. Apparently, the described embodiments are only some of the embodiments of the application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the scope of protection of this application.

[0087] First, an introduction to the terms used in this application:

[0088] Checklist: A table that needs to analyze massive data.

[0089] Reference table: A table formulated in practical applications as standard data.

[0090] Redis: An open source, memory-based and persistent log-type, key-value database.

[0091] Spark: A fast and general-purpose computing engine designed for large-scale data processing.

[0092] In order to reduce the reading and writing pressure of the da...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a data checking method and device, electronic equipment and a storage medium. The method comprises the following steps of using a preset monitor for recording data change conditions of a checking table and a reference table corresponding to each checking rule; in the process of executing data check of the first check rule for the non-first time, obtaining data change conditions of a check table and a reference table corresponding to the first check rule, and a last check result of the first check rule; and obtaining the current check result of the first check rule according to the data change conditions of the check table and the reference table corresponding to the first check rule and the last check result of the first check rule. The current check result of the first check rule is obtained by utilizing the data change conditions of the check table and the reference table corresponding to the first check rule and the last check result of the first check rule, and all data in the check table and the reference table does not need to be obtained from the data source every time check is carried out, so that read-write pressure of a data source server can be reduced. Data check efficiency is enhanced.

Description

technical field [0001] The present application relates to the field of computer technology, in particular to a data checking method, device, electronic equipment and storage medium. Background technique [0002] With the continuous development of information applications, data has become one of the most valuable assets. There is a direct link between an enterprise's data quality and business performance, and high-quality data can improve a company's competitiveness. How to process massive data and obtain high-quality data has become the focus of attention of various industries. Data quality analysis supports the monitoring of business indicators and data quality, and can analyze data from six dimensions of completeness, validity, timeliness, accuracy, and uniqueness. Data quality inspection can help users discover data quality problems in a timely manner. Correct problems in time to reduce losses. However, in today's information explosion, the types and volume of data hav...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/215G06F16/23G06F16/2455
CPCG06F16/215G06F16/23G06F16/24564
Inventor 元立本石超
Owner NEW H3C BIG DATA TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap