Data quality detection method and device

A data quality and detection method technology, applied in the field of big data, can solve the problems of low versatility and no solution provided, and achieve the effects of expanding the sampling range, long verification cycle, and reducing labor costs

Pending Publication Date: 2020-07-17
JINGDONG TECH HLDG CO LTD
View PDF5 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] (2) Customized detection programs can usually only solve the data quality of a specific scene, and the versatility is not high
[0008] Aiming at many technical problems existing in related technologies, effective solutions have not yet been provided

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data quality detection method and device
  • Data quality detection method and device
  • Data quality detection method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0052] In order to make the purposes, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments It is a part of the embodiments of this application, but not all of them. Based on the embodiments in the present application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present application.

[0053] figure 1 A data quality detection method provided in the embodiment of the present application includes steps S1 to S3 as follows:

[0054] Step S1. Determine the inspection strategy corresponding to the data set to be inspected, and the inspection strategy is used to inspect whether the data to be inspected in the data set to b...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a data quality detection method and device, and the method comprises the steps: determining a detection strategy corresponding to a to-be-detected data set, and enabling the detection strategy to be used for detecting whether to-be-detected data in the to-be-detected data set meets a preset data quality requirement or not; checking to-be-detected data through the checkingstrategy to obtain a checking result corresponding to the to-be-detected data; and obtaining a data quality detection result of the to-be-detected data set according to the detection result. Comparedwith the prior art, the technical scheme provided by the embodiment of the invention has the following advantages: the technical scheme has the following advantages. According to the scheme, the problems of time and labor consuming, high detection cost and long verification period of manual sampling sample generation in the big data quality detection process can be solved; and moreover, the randomdetection sample generation automation and the detection process automation can be realized, the method is suitable for various detection scenes, and the method has the advantages of reducing the labor cost, expanding the sampling range and accelerating the detection speed.

Description

technical field [0001] The present application relates to the technical field of big data, in particular to a data quality detection method and device. Background technique [0002] In the process of processing big data, it is necessary to detect the quality of big data. In related technologies, there are two methods for detecting the quality of big data: [0003] (1) Manual sampling test: R&D personnel need to randomly select a certain number of samples from the population, and then use the manual comparative test method to check the quality of the sampling samples, and use the quality of the samples to evaluate the quality of big data; [0004] (2) Customized detection program: develop a customized detection program to check the data of various dimensions of each individual in the big data to determine whether the big data meets the quality standards. [0005] The applicant found in the process of implementing the present invention that the existing methods for verifying ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/2458G06F16/2455G06F16/215
CPCG06F16/2458G06F16/24564G06F16/215
Inventor 谢良武
Owner JINGDONG TECH HLDG CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap