Standby Apparatus Utilization for AI Service Deployment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The existing active/standby communication systems face inefficiencies in implementing data processing services, particularly AI services, due to high resource demands and contention for resources, leading to low efficiency in processing large amounts of data.
Innovation Solution
Deploying function modules of the second service, such as AI services, on idle resources of standby apparatuses to avoid resource contention and optimize the use of computing and storage resources, allowing the active apparatus to focus on primary services while leveraging standby resources for data processing tasks.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If data processing service is implemented using active apparatus in active/standby manner, then service reliability is ensured, but resource utilization efficiency deteriorates
Solution Approach 1:
The standby apparatus is designed to perform multiple functions: it serves as a backup for the active apparatus while simultaneously functioning as a data processing server for AI services. This multi-functionality allows the standby apparatus to be utilized for both reliability purposes and productive data processing tasks, resolving the contradiction between ensuring service reliability and improving resource utilization efficiency
Solution Approach 2:
The standby apparatus independently performs data processing tasks without requiring additional dedicated resources. By leveraging its idle computing and storage capabilities, the standby apparatus serves itself productively while maintaining its backup function, thereby improving overall system resource utilization without compromising service reliability
2Adaptability or versatility
If data processing service is implemented using active apparatus, then service functionality is ensured, but resource contention increases leading to reduced processing efficiency
Solution Approach 1:
The system functionality is segmented into two distinct roles: the active apparatus handles control and management functions, while the standby apparatus handles data processing tasks. This segmentation separates resource-intensive AI processing from control operations, eliminating resource contention and allowing each apparatus to optimize its specific function without interfering with the other
Data Source
Figure 1~2
Figure 3
Figure 4A
AI summary
Embodiments of the present invention disclose a method, an apparatus, and a system for implementing service function deployment, and relate to the fields of communications technologies and artificial intelligence (AI). The system includes an active apparatus and a standby apparatus for a first service, such as an active main processing unit (MPU) and a standby MPU. The active apparatus is configured to process the first service and deploy a first function module (such as a feature extraction module or an inference module) for a second service (such as an AI service) on the standby apparatus. The standby apparatus is configured to process data of the second service by using the first function module. The second service may be implemented by using an idle resource of the standby apparatus for the first service, to effectively ensure efficiency of implementing the second service. In addition, contention with the first service for a resource of the active apparatus may be avoided, thereby ensuring efficiency of implementing the first service by using the active apparatus.