Multi-Level Model Training for Missing Features

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing personalized recommendation models, such as those based on logistic regression or RANKLR, face challenges in adapting to changing items with missing features, leading to inaccuracies and significant revenue loss, particularly in dynamic environments like news recommendation, where new items frequently appear with incomplete data.

Innovation Solution

A method for training a multi-level model in an information recommendation system by generating a feature group sequence, classifying the model based on this sequence, and training feature weight values to adapt to missing features, ensuring accurate recommendations by prioritizing feature stability and layered training.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If traditional personalized recommendation models (logistic regression or RANKLR) are used, then the model structure is simple and easy to implement, but the model accuracy deteriorates when items have missing features

Engineering Contradiction:
Improvemodel implementation simplicityVSAvoidrecommendation accuracy
Core Design Contradiction:
Ease of manufactureVSMeasurement precision

Solution Approach 1:

The patent segments the feature set into multiple feature groups with different priorities, where each group contains features of the same type. This segmentation allows the model to systematically handle missing features by falling back to lower-priority groups, thereby maintaining recommendation accuracy without significantly complicating the model structure.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces dynamic feature group sequencing that adapts based on feature availability. When higher-priority features are missing, the model dynamically adjusts to use features from lower-priority groups, making the recommendation system flexible and accurate in handling varying data completeness without requiring a completely complex model architecture.

Inventive Principle:
Principle #15Dynamics

2Measurement precision

If the model adapts to changing items with missing features, then the recommendation accuracy improves, but the model complexity increases

Engineering Contradiction:
Improverecommendation accuracyVSAvoidmodel structure complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

By dividing features into priority-based groups, the patent creates a structured adaptation mechanism that handles missing features systematically. This segmentation approach improves accuracy through adaptive feature selection while maintaining relatively simple model structure compared to other adaptive methods.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent changes the parameter organization by introducing feature group priorities and sequences as configurable parameters. This allows the model to adapt to missing features through parameter adjustments rather than structural changes, improving accuracy while controlling model complexity.

Inventive Principle:
Principle #35Parameter changes

3Adaptability or versatility

If feature weight values are trained for each level of the multi-level model, then the model adapts better to missing features, but the training time and computational resources increase

Engineering Contradiction:
Improveadaptability to missing featuresVSAvoidtraining time
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The patent segments the training process into multiple levels corresponding to feature groups, where each level trains weight values for specific feature types. This segmented approach improves adaptability to missing features by enabling targeted training while reducing overall training time through hierarchical processing and selective feature evaluation.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary organization of features into priority-based groups before training. This preliminary action enables more efficient training by pre-establishing the feature evaluation order, allowing the model to quickly adapt to missing features during inference without requiring extensive retraining.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11494594B2Method for training model and information recommendation system
Publication Date: 2022.11.08 GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP LTD
  • US11494594B2 patent drawing
  • US11494594B2 patent drawing
  • US11494594B2 patent drawing

AI summary

A method for training a model and an information recommendation system are provided. The method includes the following. Multiple types of features of the target model are obtained and a feature group sequence of the multiple types of features is generated, where the feature group sequence includes multiple feature groups and a sequence relation between the multiple feature groups and each feature group contains at least one type of features among the multiple types of features. The target model is classified into a multi-level model according to the feature group sequence. A trained target model is obtained by executing a preset training operation on the feature weight values corresponding to each level of the multi-level model.