The application discloses an analysis
processing system of heterogeneous data sources, a
data source abstraction layer, a uniform encapsulation of heterogeneous data sources by using an
iterator design mode, a provision of a standard access interface set, a
data processing layer for obtaining
original data from the
data source abstraction layer and converting the
original data into structured data rows, a process execution layer for encapsulating heterogeneous execution units by using a uniform WorkerBase
base class, the
base class providing an initialization interface, an input / output port acquisition interface, a message notification interface, a work mode setting interface and a type acquisition interface, a process builder for configuring a connection relationship between workers, distributing tasks to a
thread pool, adopting a work stealing mechanism for load balancing, and supporting the merging of continuous tasks. The heterogeneous data sources are uniformly encapsulated through the
iterator interface and the structured data rows are output, data zero-reconstruction access is realized, meanwhile, the work stealing and task merging mechanism of the process builder and the encapsulation of the multi-
modal execution units by using the WorkerBase
base class achieve seamless compatibility and efficiency improvement of the heterogeneous
analysis tools.