The invention discloses an
inference task collaborative
scheduling system and method oriented to multiple terminals of a swan gap. The
inference task collaborative
scheduling system comprises a communication module Broker, a
system monitoring module SystemProfilter, a scheduling module Scheduler and an
inference task execution module Worker. According to the method, a structured resource
state vector is constructed based on an NDK native interface so as to comprehensively represent the real-time availability of equipment; a lightweight
MQTT protocol is adopted to support low-overhead and high-robustness cross-terminal state synchronization and task distribution; a comprehensive load scoring mechanism fusing task priorities and dynamic weights is designed, a multi-objective
optimization problem based on a non-dominated sorting
genetic algorithm (NSGA-II) is introduced, task
delay is minimized in a combined mode, terminal loads are balanced, and
energy consumption is controlled; meanwhile, the
execution time delay is efficiently estimated in combination with a proxy model based on
linear regression, and the scheduling overhead caused by real reasoning and calling is avoided; the whole architecture is deeply adaptive to a swan-mong
system, and is compatible with an Android platform through modular packaging and unified
communication interface design, and efficient, self-adaptive and cross-platform collaborative scheduling oriented to a swan-mong multi-terminal reasoning task is realized for the first time.