Adaptive Neural Network Evolution Through Novel Pattern Integration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing neural network models struggle to maintain performance when exposed to new data patterns that differ from their training datasets, leading to decreased accuracy and potential catastrophic forgetting of learned characteristics.

Innovation Solution

A method for continual learning that involves training a second neural network model using a subset of data identified as novel patterns, determined by a first neural network model, to fine-tune the model's performance without modifying its architecture, thereby enhancing its ability to classify new data patterns.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the neural network model is trained on new data patterns, then the model's ability to classify new patterns improves, but the model may forget previously learned characteristics

Engineering Contradiction:
Improveability to classify new data patternsVSAvoidforgetting of learned characteristics
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The patent implements continual learning by continuously training the neural network model on streaming data in an ongoing manner, rather than performing discrete retraining operations. This continuous training process allows the model to adapt to new data patterns while maintaining previously learned characteristics through persistent refinement of weights and biases based on accumulating data evidence.

Inventive Principle:
Principle #20Continuity of useful action

Solution Approach 2:

The patent modifies the training parameters of the neural network model, specifically adjusting the learning rate and incorporating forgetting factor mechanisms that control how new data influences existing weights. By dynamically changing these parameters during continual training, the model can adapt to new patterns while preserving important previously learned characteristics through controlled parameter evolution.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If the neural network model is fully retrained on new data, then classification accuracy on new patterns improves, but the computational cost and time increase significantly

Engineering Contradiction:
Improveclassification accuracyVSAvoidretraining time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

Instead of performing complete retraining on all historical data, the patent applies partial training actions by continuously processing only the necessary portions of streaming data that are relevant to maintaining and improving classification accuracy. This partial continual training approach achieves sufficient accuracy improvement without the computational overhead of full retraining operations.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The patent performs preliminary continual training operations on streaming data in the background, preparing the model adaptively before actual classification tasks require high accuracy. This preliminary continuous adaptation ensures the model is already tuned to current data patterns when classification is needed, reducing the time required for accuracy improvements.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If the neural network model is fully retrained on new data, then classification accuracy on new patterns improves, but computational resources and energy consumption increase

Engineering Contradiction:
Improveclassification accuracyVSAvoidcomputational energy consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent implements partial continual training that processes only the essential streaming data portions needed to maintain classification accuracy, avoiding the excessive computational energy consumption of full retraining. This selective continuous processing achieves necessary accuracy improvements with significantly reduced energy expenditure compared to complete retraining cycles.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS20250299063A1Adaptive model evolution through identification and integration of novel data patterns
Publication Date: 2025.09.25 PAYPAL INC
  • US20250299063A1 patent drawing
  • US20250299063A1 patent drawing
  • US20250299063A1 patent drawing

AI summary

Systems and methods for performing continual learning for neural network models for performing certain tasks based on data including applying a first neural network model to a second dataset, the first neural network model trained using a first dataset, determining a data distribution representative of the second dataset, determining a third dataset corresponding to a subset of data in the second dataset based on applying a threshold to the data distribution, the subset of data corresponding to new data patterns in the second dataset indicative of including different characteristics than data patterns in the first dataset, obtaining a second neural network model trained using the first dataset, and training the second neural network model using the third dataset to finetune a performance of the second neural network model in performing the certain tasks or other new tasks.