Unlock instant, AI-driven research and patent intelligence for your innovation.

Data quality inspection method and device, computer equipment and storage medium

A data quality and inspection method technology, applied in the field of data processing, can solve problems such as high cost, complex implementation, and low efficiency, and achieve the effects of low cost, strong maintainability, and improved efficiency

Pending Publication Date: 2022-02-08
深圳市华云中盛科技股份有限公司
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Therefore, there are many types of verification types, and there are also many types of databases that need to be adapted, resulting in complex data quality inspection technology, difficult implementation, and various adaptation problems
[0003] The traditional data quality inspection method can only use JDBC (Java Database Connectivity, Java Database Connectivity) connection to obtain data, and then directly calculate the data, and also needs to adapt to various database types, which not only costs more, but also complicates implementation, resulting in maintenance Poor performance, low efficiency and other problems

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data quality inspection method and device, computer equipment and storage medium
  • Data quality inspection method and device, computer equipment and storage medium
  • Data quality inspection method and device, computer equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0039] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0040] It should be understood that when used in this specification and the appended claims, the terms "comprising" and "comprises" indicate the presence of described features, integers, steps, operations, elements and / or components, but do not exclude one or Presence or addition of multiple other features, integers, steps, operations, elements, components and / or collections thereof.

[0041] It should also be understood that the terminology used ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

Embodiments of the invention disclose a data quality inspection method and device, computer equipment and a storage medium. The method comprises the following steps: configuring a data quality calculation rule; acquiring to-be-checked data; converting the to-be-checked data into an SQL statement; and submitting the SQL statement to an Flink cluster, and performing data quality inspection by the Flink cluster in combination with the data quality calculation rule to obtain an inspection result. By implementing the method provided by the embodiment of the invention, data quality inspection cost is low, maintainability is high, and efficiency can be improved.

Description

technical field [0001] The present invention relates to a data processing method, and more specifically refers to a data quality inspection method, device, computer equipment and storage medium. Background technique [0002] Data quality inspection is a common method in data management. It checks whether the data meets the quality requirements through certain rules. The common inspection types are as follows: completeness, standardization, consistency, accuracy, uniqueness, and relevance. Among them, integrity Consistency is used to measure which data is missing or which data is unavailable; consistency is used to measure which data values ​​are conflicting in the meaning of information; accuracy is used to measure which data and information are incorrect, or data is overdue ; Uniqueness is used to measure which data is repeated or which attributes of the data are repeated; relevance is used to measure which associated data is missing or not indexed. Therefore, there are ma...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/242G06F16/28
CPCG06F16/2433G06F16/28
Inventor 彭小冬朱磊陈啸天
Owner 深圳市华云中盛科技股份有限公司
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com