Variance Analysis for Robust Machine Learning Models

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Machine learning models struggle with producing reliable results when trained on datasets with small sample sizes due to high variance between outcomes, leading to unreliable predictions.

Innovation Solution

An information processing technique that identifies high-variance subsets within datasets, partitions them, modifies the partitions by adding noise, and trains additional machine learning models on these modified partitions to generate more robust predictions, thereby reducing variance and improving prediction accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of time

If machine learning models are trained on datasets with small sample sizes, then training time and computational resources are reduced, but prediction reliability and accuracy deteriorate due to high variance between outcomes

Engineering Contradiction:
Improvetraining timeVSAvoidprediction reliability
Core Design Contradiction:
Loss of timeVSReliability

Solution Approach 1:

The patent applies preliminary action by performing variance analysis on the training dataset before model training to identify high-variance subsets. By pre-processing the data to detect which subsets contribute most to outcome variance, the system can then apply targeted modifications (such as oversampling or noise injection) to these specific subsets. This preliminary identification and modification approach allows the model to learn from corrected data patterns, improving prediction reliability without requiring extensive additional training time or resources.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If the size of the training dataset is increased to improve prediction performance, then prediction accuracy improves, but computational resources and processing time increase

Engineering Contradiction:
Improveprediction accuracyVSAvoidcomputational resources
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent applies local quality by treating different subsets of the training data differently based on their variance characteristics. Instead of uniformly processing all data, the system identifies high-variance subsets through variance analysis and applies targeted modifications (such as oversampling, noise injection, or transformation) specifically to these subsets. This localized approach allows the model to focus computational resources on the most problematic data regions, improving overall prediction accuracy without proportionally increasing computational resource consumption across the entire dataset.

Inventive Principle:
Principle #3Local quality

3Ease of manufacture

If machine learning models are trained on original datasets without modification, then training simplicity is maintained, but model robustness deteriorates due to high variance in small sample sizes

Engineering Contradiction:
Improvetraining simplicityVSAvoidmodel robustness
Core Design Contradiction:
Ease of manufactureVSStability of the object's composition

Solution Approach 1:

The patent applies preliminary action by performing variance analysis and identifying high-variance subsets before model training. This pre-processing step automatically detects which data subsets contribute most to outcome variability and applies targeted modifications (such as oversampling or noise injection) to these subsets. The approach maintains training simplicity because the variance analysis and modification process is automated and integrated into the training pipeline, requiring minimal manual intervention while significantly improving model robustness to small sample size variations.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20240378500A1Information processing device, information processing system and information processing method
Publication Date: 2024.11.14 HITACHI LTD
  • US20240378500A1 patent drawing
  • US20240378500A1 patent drawing
  • US20240378500A1 patent drawing

AI summary

An information processing technique is provided for generating machine learning models with a high degree of robustness that are capable of producing reliable results for data sets having small sample sizes. An information processing device includes a variance analysis unit for generating analysis results for an original dataset and identifying a first set of subjects from among the original dataset associated with a first analysis result that achieves a variance threshold, a partition unit for partitioning the first set of subjects into original data partitions and generating copied data partitions, a modification unit for generating modified copy data partitions, and a result generation unit for training machine learning models using the original data partitions and the modified copy data partitions, generating a second analysis result using the machine learning models, and generating a final analysis result by aggregating the first analysis result and the second analysis result.