Sample processing method and device, electronic equipment and storage medium

Abstract

The invention provides a sample processing method and device, electronic equipment and a storage medium, and the method comprises the steps: determining a plurality of centroids of a plurality of sample class clusters, the plurality of sample class clusters being class clusters formed by clustering a plurality of existing samples in a first sample set, and the plurality of sample class clusters being in one-to-one correspondence with the plurality of centroids; the minimum distance in a plurality of first distances corresponding to the to-be-added sample is determined as a first target distance, and each first distance in the plurality of first distances is the distance from the to-be-added sample to one mass center in the plurality of mass centers; and under the condition that the first target distance is greater than or equal to the target distance threshold value, adding the to-be-added sample into the first sample set. According to the method and the device, the problems of high human resource consumption and easy occurrence of personal errors in a manual sample screening mode in the related technology are solved.

Description

technical field [0001] The present application relates to the field of data processing, and in particular, to a sample processing method and apparatus, an electronic device and a storage medium. Background technique [0002] When the dataset is constructed, in order to ensure that the data distribution has a wide range, it is necessary to continuously expand the samples in the dataset. However, the supplemented new samples may overlap with the original samples. In practical applications, the samples in the overlapping areas need to be removed to achieve a balanced content of the dataset. Currently, sample screening is generally performed manually. [0003] However, the above method of manually screening samples is time-consuming and labor-intensive, and when the sample size is large, it is difficult to complete the sample screening by manual screening. Moreover, there will be human errors in the selected samples. [0004] Therefore, the method of manually screening sample...

AI Technical Summary

Problems solved by technology

[0005] The present application provides a sample processing method and device, electronic equipment and a storage medium, to at least solve the problems of large human resources consumption and human errors in the manual screening of samples in the related art

Images