Neural Network Layer Selection Under Fine-Tuning Memory Constraints

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing artificial neural networks face performance deviations and reduced precision due to training data mismatch between initial training and deployment environments, particularly in memory-constrained systems, necessitating a more efficient and resource-friendly fine-tuning method.

Innovation Solution

A method involving Fisher information analysis to determine the importance of each layer in a neural network, using an optimization algorithm to select a combination of layers for fine-tuning while respecting memory constraints, thereby optimizing performance without full retraining.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the entire neural network is retrained to improve precision, then the neural network precision is improved, but the memory consumption and energy consumption increase significantly

Engineering Contradiction:
Improveneural network precisionVSAvoidenergy consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent segments the neural network into multiple layers and identifies only the critical layers that contribute most to performance deviations. By applying Fisher information analysis, the system determines which specific layers require fine-tuning rather than retraining the entire network. This segmentation approach reduces the scope of fine-tuning operations, thereby lowering memory consumption and energy expenditure while maintaining precision improvement.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies local quality by focusing fine-tuning resources on specific critical layers rather than uniformly processing all layers. The Fisher information analysis identifies layers with highest impact on output deviations, and fine-tuning is concentrated on these localized regions. This selective approach optimizes the allocation of computational resources, reducing overall energy consumption while achieving the desired precision improvement.

Inventive Principle:
Principle #3Local quality

2Adaptability or versatility

If the entire neural network is retrained to adapt to deployment data, then the neural network adapts better to deployment environment, but the memory occupation increases

Engineering Contradiction:
Improveadaptation to deployment environmentVSAvoidmemory occupation
Core Design Contradiction:
Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

The patent divides the neural network into distinct layers and uses Fisher information analysis to identify which segments (layers) are most responsible for performance deviations. By isolating and fine-tuning only these critical segments rather than the entire network, the memory occupation is significantly reduced while still achieving adequate adaptation to the deployment environment.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies partial action by performing fine-tuning on only a subset of layers identified as critical through Fisher information analysis, rather than applying full retraining to all layers. This partial fine-tuning approach provides sufficient adaptation to deployment data while consuming less memory, as evidenced by the comparison between full retraining memory requirements and the reduced memory usage of selective fine-tuning.

Inventive Principle:
Principle #16Partial or excessive action

3Measurement precision

If Fisher information analysis is performed on all layers to identify critical layers, then the fine-tuning precision is improved, but the computation time increases

Engineering Contradiction:
Improvefine-tuning precisionVSAvoidcomputation time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent performs Fisher information analysis as a preliminary step before fine-tuning to pre-identify the critical layers that will benefit most from fine-tuning. This preliminary analysis, while requiring computation, is performed once to determine the optimal set of layers for fine-tuning. Subsequent fine-tuning operations then focus only on these pre-identified layers, avoiding the need to process all layers during the actual fine-tuning phase, thus reducing overall computation time while maintaining fine-tuning precision.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20250371350A1Analyzing and adjusting an artificial neural network
Publication Date: 2025.12.04 STMICROELECTRONICS INT NV
  • US20250371350A1 patent drawing
  • US20250371350A1 patent drawing
  • US20250371350A1 patent drawing

AI summary

In embodiments, a computer-implemented method is proposed for analyzing an already-trained artificial neural network to fine-tune it, the artificial neural network having a succession of layers, each layer having a parameter tensor, the method comprising: extracting a piece of Fisher information for each parameter of the artificial neural network, calculating an index for each layer of the artificial neural network, this index being representative of the pieces of Fisher information calculated for the parameters of this layer, defining a combination of layers to be fine-tuned of the artificial neural network, the combination of layers being defined from parameter tensor indices of the layers of the artificial neural network, comparing the memory occupation required for the fine-tuning of the parameters of the combination of layers and a maximum memory occupation threshold.