Data processing method and device, electronic equipment and storage medium

Abstract

The embodiment of the invention discloses a data processing method and device, electronic equipment and a storage medium. The method comprises the following steps: acquiring original data of which the data type is an enumeration type; determining first identification data according to the original data, wherein the original data is uniquely associated with the first identification data; and if it is determined that the number of the original data and the number of the first identification data bits meet the preset constraint condition, converting the original data into second identification data according to a preset conversion rule, wherein the original data is uniquely associated with the second identification data, and the number of the original data is matched with the digit of the second identification data. By executing the technical scheme provided by the embodiment of the invention, the calculation and storage space of a computer can be saved, and the calculation efficiency and the retrieval efficiency are improved.

Description

technical field [0001] The embodiments of the present invention relate to the field of computer technology, and in particular, to a data processing method, device, electronic equipment, and storage medium. Background technique [0002] Extract-Transform-Load (ETL) is the process of loading business system data into the data warehouse after extraction, cleaning and transformation. Provide analysis basis. The design of ETL is divided into three parts: data extraction, data cleaning and conversion, and data loading, which is a very important part of building data warehouse and data mining. [0003] Related technologies In the process of processing big data, the value of the processed data field is an enumeration type, which is called an enumeration field, also called a dictionary field. The value range definition of a dictionary field generally includes dictionary codes, dictionary values, and corresponding description information, where dictionary codes are generally defined...

AI Technical Summary

Problems solved by technology

The problem with this setting is that the dictionary encoding will be relatively long. When the dictionary encoding is involved in the data processing process, it will occupy too many computing and storage resources in the system, which will lead to waste of resources and low data processing efficiency.

Images