The invention relates to the field of electric
digital data processing, in particular to a micro-operator-based large-model cross-platform
system, which comprises a hardware execution layer, a hardware access layer, a pre-compiling layer, a micro-operator layer, a rear-end layer, a framework layer and a model layer. The embodiment of the invention can be suitable for different hardware platforms, can quickly realize the reasoning and
fine tuning of a
large model, effectively simplifies the operator development, debugging and deployment process, and improves the cross-
platform model development efficiency. The invention provides a micro-operator development standard for a
large model scene. The micro-operator development standard comprises a device
access management micro-operator, a
tensor calculation micro-operator and a
large model typical operator realized by combination. In addition, the invention provides a
software architecture scheme, which defines a large
model development process based on the micro operator, covers a micro operator definition and calling mode,
adaptation methods of different back ends, calculation core scheduling and a calculation framework and
model building scheme based on the micro operator, so as to realize high efficiency and cross-platform
adaptation capability of large model reasoning and
fine tuning.