Data processing method, electronic device and storage medium

Abstract

Embodiments of the present application disclose a data processing method, an electronic device and a storage medium, which relate to data processing and data standardization techniques, wherein the method comprises the following steps: acquiring raw data to be processed; Detecting whether the format of the original data belongs to a data format set; If not, marking the original data as invalid data; If yes, scoring the original data according to a preset scoring rule to obtain a data score of the original data; Judging whether the data score is less than a first score threshold; If not less than, marking the raw data as valid data; If less than, marking the original data as the invalid data; The effective data is grouped by using a diagnostic correlation classification method to facilitateobtaining normative data for subsequent data storage or grouping processing, and the efficiency and accuracy of data processing can be improved.

Description

technical field [0001] The present application relates to the technical field of data processing, and in particular to a data processing method, electronic equipment, and computer storage media. Background technique [0002] Big data has been widely recognized as a strategic new resource that can define the massive data generated in today's era and the related technological development and service innovation. Big data contains huge commercial value. In the field of data circulation, with the rapid growth of data volume, the data quality of different data sources is uneven, and data quality has different concepts and standards. Data quality generally includes data accuracy, completeness, timeliness, consistency, etc. quantitative description. For users in the era of big data, the amount of data they need to store and process is large, and the data sources and data structures are various and complex, which brings many challenges to the analysis and application of big data. ...

AI Technical Summary

Problems solved by technology

Generally speaking, the purpose of obtaining effective information can be achieved by receiving collected data or purchased data for data comparison analysis and processing, but the data itself may have certain errors, and its data types may vary greatly. Therefore, in the data In the process of processing and analysis, the analysis results cannot be obtained accurately and effectively, and it will cause errors or even errors in the system, and the accuracy and processing efficiency of data processing are low.

Images