Data processing method and device, electronic equipment and storage medium

Abstract

The invention relates to a data processing method and device, electronic equipment and a storage medium, and belongs to the technical field of data processing. The method comprises the following steps: acquiring input original data related to a sample; selecting multiple feature selection algorithms corresponding to the task type from a local database according to the obtained task type, wherein multiple feature selection algorithms suitable for the task type are preset in the local database, and each feature selection algorithm corresponds to one weight coefficient; respectively utilizing each feature selection algorithm to perform feature extraction on the original data to obtain a plurality of data features extracted by each feature selection algorithm; and performing feature weighted summation on the multiple data features extracted by each feature selection algorithm and the corresponding weight coefficients to obtain a data feature set. According to the method, important featuresare selected from different angles, so that the integrity of data information can be ensured as much as possible while dimension reduction is ensured, and the probability of information loss is reduced.

Description

technical field [0001] The present application belongs to the technical field of data processing, and in particular relates to a data processing method, device, electronic equipment and storage medium. Background technique [0002] Data features are usually a summary of the attributes or characteristics of the original data, including most of the information of the original data, so the selection of data features is particularly important. However, the existing feature selection methods can only represent the original data and contain most of the information of the original data only when the data quality is good enough. However, for data with insufficient data quality, especially data with extremely high dimensionality but low quality, the existing feature selection methods cannot select a feature set that can represent the original data, which will cause information loss. Contents of the invention [0003] In view of this, the purpose of this application is to provide a...

AI Technical Summary

Problems solved by technology

[0003] In view of this, the purpose of this application is to provide a data processing method, device, electronic equipment and storage medium to improve the problem that the existing feature selection method cannot select a feature set that can represent the original data for high-dimensional original data, resulting in missing information.

Images