An industrial internet computing interference avoidance method, storage medium and processor
By optimizing the deployment order and node selection of model replicas in the Industrial Internet, network bottlenecks and hardware interference issues were resolved, improving the efficiency and performance of model inference.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- SHENZHEN INST OF ADVANCED TECH CHINESE ACAD OF SCI
- Filing Date
- 2023-12-18
- Publication Date
- 2026-07-14
AI Technical Summary
In industrial internet environments with limited bandwidth, deploying multiple replicas of models can lead to network bottlenecks and hardware interference, impacting model inference performance.
A serverless inference system that supports collaborative optimization of network transmission bottlenecks through channel residual control employs a hybrid model placement strategy and scheduling delay planning strategy to optimize the deployment order of model replicas and node selection, thereby avoiding network bandwidth contention.
The execution efficiency of model inference tasks has been optimized, network bandwidth contention and resource interference have been reduced, and overall performance and response speed of inference tasks have been improved.
Smart Images

Figure CN117938777B_ABST