A Data Validity Inspection System

Abstract

The invention relates to a data validity checking system, which includes one or more clients, one or more uploading servers, a distributed data validity checking platform, a management server, and one or more downloading servers; It manages the tasks of the inspection resources in the formal data validity inspection platform, manages the upload server and download server, and provides services to the client. The data validity checking system can process batch data in parallel without depending on the user's own ability, and can perform automatic, high-safety, and high-parallel data validity checking.

Description

[Technical field][0001]The invention belongs to the field of data processing, and more particularly to a data effectiveness test system.【Background technique】[0002]Data validity test is based on whether it is determined whether or not the data to be verified is effective. For example, validity verification is a common step in data cleaning, and is the first important step after data entry. It is the pre-process basis before the data further processing. During the specific test, if the user inputs gender information, it can be determined whether the value of the gender information is "male" or "female". If not, then such information is obviously invalid, invalid data cannot be used for further analysis. It is not the foundation of the next step.[0003]Data effectiveness verification tools in the prior art are very simple, usually based on Excel or simple forms for verification, a slightly complex verification method requires users to write verification programs themselves. However, wi...

AI Technical Summary

Problems solved by technology

In the specific inspection process, if the user enters gender information, it can be judged whether the value of the gender information is "male" or "female". If not, then such information is obviously invalid, and invalid data cannot be used for further analysis. , nor can it be used as the basis for further work

[0003] The data validity verification tools in the prior art are very simple, usually based on excel or simple forms for verification, and slightly more complicated verification methods require users to write verification programs by themselves

However, with the advent of the big data era, the scale of verification data is massive, and the verification rules required by users cannot be realized through simple excel, and the cost of writing programs for each rule is unimaginable. Based on the above-mentioned problems, now There is an urgent need for a new data validity verification method and system that can process batch data in parallel, independent of the user's own capabilities, and can perform automated, high-security, and high-parallel data validity verification

Images