Base Model Adaptation Across Device-Specific ML Constraints
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing machine learning models need to be separately designed and trained for different device types due to varying computing resources, leading to inefficiencies in model generation.
Innovation Solution
A model generation apparatus that acquires base model information and generates individual type models for multiple device types through pruning and quantization based on the base model, reducing the need for separate training processes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If separate machine learning models are built and trained for each device type, then model performance is optimized for specific device capabilities, but model generation time and computational resources increase significantly
Solution Approach 1:
The patent applies universality by creating a single base machine learning model that can be adapted to multiple device types through parameter adjustment rather than training separate models. The base model serves multiple functions across different device architectures (GPU, CPU, FPGA, edge computers) by modifying execution parameters such as batch size, learning rate, and computational precision based on target device capabilities.
Solution Approach 2:
The patent implements parameter changes by systematically adjusting model parameters (batch size, learning rate, precision, memory allocation) based on the computational characteristics of different device types. This allows the same base model to be efficiently deployed across devices with varying computing power, memory capacity, and processing architectures without requiring separate training processes.
2Reliability
If separate machine learning models are trained for each device type, then device-specific optimization is achieved, but computational resources and training costs increase
Solution Approach 1:
The patent applies preliminary action by pre-training a single base model on high-capacity devices (such as GPUs) that can handle the computational burden of training. Once the base model is trained, it is then adapted to other device types through parameter modification rather than retraining, thereby concentrating computational resources in the initial training phase and avoiding redundant training computations for each device type.
Solution Approach 2:
The patent implements copying by creating device-specific model versions through parameter adjustment and configuration copying from the base model rather than creating entirely new models. The base model serves as a template that is copied and adapted to different device architectures, significantly reducing the computational resources required compared to training separate models from scratch for each device type.
3Productivity
If different machine learning models are designed for different device types, then model execution is optimized for each device's computing capacity, but model complexity and development effort increase
Solution Approach 1:
The patent applies segmentation by separating model development into two distinct phases: (1) base model training on high-capacity devices, and (2) device-specific parameter adaptation. This segmentation allows the complex training process to be performed once on powerful hardware, while subsequent device adaptations involve only parameter adjustments, thereby reducing overall development complexity while maintaining execution efficiency across different device types.
Solution Approach 2:
The patent implements dynamics by making model parameters adjustable and adaptable based on target device characteristics. Rather than creating static, device-specific models, the system dynamically adjusts parameters such as batch size, precision, and memory allocation based on the computational capabilities of the target device, allowing a single base model to efficiently serve multiple device types with varying performance characteristics.
Data Source
AI summary
According to the present disclosure, a technology for efficiently generating machine learning models for respective device types is provided. One aspect of the present disclosure pertains to a model generation apparatus having: a model information acquisition unit for acquiring base model information indicating a base model; and a model processing unit capable of generating, on the basis of the base model information, individual type models corresponding to a plurality of device types.


