The application discloses a heterogeneous data fusion device, method and medium for AI
large model pre-training, and relates to the technical field of
artificial intelligence. The heterogeneous data fusion device comprises a collection module, a
processing module and an output module, the
processing module comprises an identification and analysis unit and an alignment and evaluation unit, the output module comprises a filling unit and an index unit; the identification and analysis unit is used for identifying and analyzing heterogeneous data of different modalities, obtaining each standard data object, the alignment and evaluation unit is used for unifying semantic vectors of each standard data object and calculating quality scores of pairs of multi-
modal data; the filling unit is used for filling the pairs of multi-
modal data to corresponding slots of a semantic driving template, and attaching labels and quality scores to target samples, and the index unit is used for encapsulating the target samples into a standard
data structure and constructing a multi-dimensional index of the target samples. The device can unify standards, accurately fuse multi-
modal data, and improve
processing efficiency and the quality of pre-training data.