Data accuracy detection method, apparatus, server, and computer storage medium

A detection method and accuracy technology, applied in the field of big data processing, can solve the problems of wasting system resources and high complexity

Pending Publication Date: 2018-12-28
ZTE CORP
View PDF6 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, there is no uniform method for verifying data accuracy in the industry. For example, some data detection platforms will detect the data under each field in units of fields. Since the data under each field needs to be verified, the calculation The complexity of detection is relatively high, and it is a waste of system resources

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data accuracy detection method, apparatus, server, and computer storage medium
  • Data accuracy detection method, apparatus, server, and computer storage medium
  • Data accuracy detection method, apparatus, server, and computer storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0033] This embodiment provides a data accuracy detection method, please refer to figure 1 shown, including:

[0034] S101: Determine the object to be tested currently to be checked.

[0035] It should be understood that the object to be tested in this embodiment may be a business object to be tested, or may be a logical group object to be tested composed of one or more business object packages to be tested, or may be composed of one or more The higher-level data structure object to be tested is encapsulated by the test logic group object.

[0036] S102: According to the object to be measured and the preset corresponding relationship table between the object to be measured and the index model, the index model corresponding to the object to be tested currently to be checked is obtained from the model database.

[0037] It should be noted that each index model includes the measurement index of the object to be measured, the measured data corresponding to each measurement index...

Embodiment 2

[0076] In order to better understand the present invention, this embodiment provides a more specific data accuracy detection method on the basis of Embodiment 1, Figure 4 It is a simple model for network optimization big data processing in a telecommunications system. The data source is the user bill data provided by the operator, and the data source data is aggregated into a distributed storage system HDFS (Hadoop Distributed File System, distributed file system) cluster . Spark (a fast and general-purpose computing engine designed for large-scale data processing) nodes mainly perform logical operations according to business requirements, and the subject table generated by final cleaning is synchronized to the Gbase (a database product) database for operation and maintenance Personnel access to view.

[0077] Based on the above model, this embodiment takes the object to be tested as an example of a logic group object to be tested for illustration, please refer to Figure 5...

Embodiment 3

[0103] See Figure 9 As shown, this embodiment provides a data accuracy detection device, including a determination module 91, an acquisition module 92, a processing module 93, and a judgment module 94, wherein the determination module 91 is used to determine the object to be tested currently to be checked; Module 92 is used to obtain the index model corresponding to the object to be measured from the model database according to the determined object to be measured and the preset corresponding relationship table between the object to be measured and the index model, and each index model contains the measurement index of the object to be measured , the measured data corresponding to each measurement index, the calculation model corresponding to each measurement index, and the index threshold corresponding to each measurement index; the processing module 93 is used to extract the measured data corresponding to each measurement index of the object to be measured according to the o...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

A method for detecting data accuracy, an APPARATUS, a SERVER AND a COMPUTER STORAGE MEDIUM are provided by the invention. The method comprises: an index model corresponding to the current object to betested is obtained from a model database through a currently determined object-to-be-tested and a preset object-to-be-tested and index model correspondence table, each index model contains the measurement index of the object to be measured, the measured data corresponding to each measurement index, the corresponding calculation model of each measurement index, and the threshold value corresponding to each measurement index, the measured data corresponding to each measurement index of the current object to be measured is extracted according to the obtained index model, the corresponding calculation model of each measurement index is respectively brought in to obtain the index value of each measurement index, the calculated index values of each measurement index are compared with the corresponding index thresholds of each measurement index respectively, and the accuracy of the measured data corresponding to each measurement index of the object to be tested is determined according to thecomparison results, so that the unified measurement of the data of each service to be tested can be realized, and the method has strong practicability and is easy to popularize.

Description

technical field [0001] The invention relates to the technical field of big data processing, in particular to a data accuracy detection method, device, server and computer storage medium. Background technique [0002] With the rapid growth of applications in mobile Internet, wearable devices, Internet of Things and other fields, the scale of data has also experienced explosive growth. It is estimated that by 2020, the scale of global data will reach 40ZB (Zettabyte, Zettabyte), and data is becoming a huge economic assets. [0003] In the process of big data processing, the quality of data will directly affect the accuracy of analysis results. Therefore, big data is not only a huge amount of data, but also has certain requirements for the quality of data. However, in the reality of big data processing, its data sources and data structures are various and complex. How to measure the accuracy of data cleaning results is the focus and difficulty of big data applications. There...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
Inventor 刘茂才向春袁志凯冯双举
Owner ZTE CORP
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap