Data processing method and device, electronic equipment and storage medium

Abstract

The invention provides a data processing method and device, electronic equipment and a storage medium, and belongs to the technical field of computers. The data processing method comprises the following steps of: acquiring real-time production data and a general data table of a data producer; performing comparison processing on the production data and the general data table, and determining target fields, different from original fields in the general data table, in the production data; taking target field values corresponding to the target fields as first data, and taking original field values corresponding to the original fields as second data; and assembling the first data and the second data to obtain target data, and sending the target data to a data consumer. According to the data processing method and device, the electronic equipment and the storage medium of the technical scheme, the target fields corresponding to the production data can be obtained through screening of the general data table, the field values of the target fields and the original field value corresponding to the original fields are assembled to generate the target data, and the generation rate of the target data and the management efficiency of the production data are improved.

Description

technical field

[0001] The present disclosure relates to the technical field of computers, and in particular, to a data processing method, a data processing device, electronic equipment, and a computer-readable storage medium. Background technique

[0002] In the data management method of the related data warehouse, the production data is extracted from the real-time production database through the log extraction tool, and the production data is processed in real time according to the business processing logic and business indicators to obtain the wide data table. Fields are integrated to generate consumption data.

[0003] However, in the data management method of the relevant data warehouse, the data wide tables corresponding to different production databases are independent of each other, so that different business systems cannot call each other's data wide tables, and further, other business systems still need to use log extraction tools from The production data is extr...

Examples

Embodiment Construction

[0037] Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete and will fully convey the concept of example embodiments to those skilled in the art.

[0038] Furthermore, the described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided in order to give a thorough understanding of embodiments of the present disclosure. However, those skilled in the art will appreciate that the technical solutions of the present disclosure may be practiced without one or more of the specific details, or other methods, components, means, steps, etc. may be employed. In other instances, well-known methods, ap...

technical field

[0001] The present disclosure relates to the technical field of computers, and in particular, to a data processing method, a data processing device, electronic equipment, and a computer-readable storage medium. Background technique

[0002] In the data management method of the related data warehouse, the production data is extracted from the real-time production database through the log extraction tool, and the production data is processed in real time according to the business processing logic and business indicators to obtain the wide data table. Fields are integrated to generate consumption data.

[0003] However, in the data management method of the relevant data warehouse, the data wide tables corresponding to different production databases are independent of each other, so that different business systems cannot call each other's data wide tables, and further, other business systems still need to use log extraction tools from The production data is extr...

Examples

Embodiment Construction

[0037] Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete and will fully convey the concept of example embodiments to those skilled in the art.

[0038] Furthermore, the described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided in order to give a thorough understanding of embodiments of the present disclosure. However, those skilled in the art will appreciate that the technical solutions of the present disclosure may be practiced without one or more of the specific details, or other methods, components, means, steps, etc. may be employed. In other instances, well-known methods, ap...

Images