Federal model fragmentation inference method and device based on dynamic bandwidth perception

By employing a dynamic bandwidth-aware federated model fragmentation inference method, and utilizing a lightweight bandwidth prediction model and multidimensional state vectors to optimize model fragment size and acquisition strategy, this approach solves the transmission blocking and latency problems caused by network bandwidth fluctuations in federated learning, achieving efficient model fragment transmission and task execution.

CN122420315APending Publication Date: 2026-07-17CHINA TOWER CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202610873126.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2026-06-17
Publication Date
2026-07-17

AI Technical Summary

Technical Problem

Existing federated learning methods are prone to blocking and delays when the network bandwidth fluctuates significantly, resulting in low overall inference efficiency and an inability to adapt to changes in network conditions.

Method used

By employing a dynamic bandwidth-aware federated model fragmentation inference method, a lightweight bandwidth prediction model is used to predict network state, optimize model fragment size, and dynamically adjust fragment acquisition strategy based on multidimensional state vectors and fragmentation decision model, thereby determining source nodes and transmitting model fragments in the model fragmentation interaction network.

Benefits of technology

It effectively solves the problem of low transmission efficiency caused by the inability of fixed strategies to adapt to dynamic environmental changes, greatly reduces invalid transmission and waiting time, and ensures the timeliness of model fragment transmission and the continuity of task execution.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN122420315A_ABST
    Figure CN122420315A_ABST
Patent Text Reader

Abstract

本发明公开了一种基于动态带宽感知的联邦模型分片推理方法及装置,涉及分布式机器学习技术领域,主要解决在网络带宽波动环境下,分片推理效率低的问题。主要包括基于轻量化带宽预测模型对网络状态数据进行预测处理,得到带宽预测值;以带宽预测值为网络状态约束,优化模型分片大小,得到预期模型分片大小,并依据任务特征、网络状态数据、带宽预测值和设备状态数据构建多维状态向量;依据预期模型分片大小和多维状态向量,基于分片决策模型从不同分片粒度的预设模型分片策略中决策出模型分片获取策略;依据模型分片获取策略,从模型分片交互网络中确定出至少一个源节点,并基于从各源节点接收到的模型分片执行推理任务。主要用于模型分片推理。
Need to check novelty before this filing date? Find Prior Art