Uncertainty-Aware Model Retraining for Online User Behavior Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for user behavior detection in new environments are costly, time-consuming, and prone to variations in model performance due to expert involvement or user fatigue, and they may compromise data security.

Innovation Solution

A method and apparatus for recognizing uncertainty in real-time user behavior detection by collecting labeled data and retraining the model, which automatically adjusts behavior classification and interval based on detection uncertainty, thereby optimizing the model for new environments without external intervention.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If experts periodically collect and label data to retrain the model, then model performance is improved, but costs and time consumption increase significantly

Engineering Contradiction:
Improvemodel performanceVSAvoidretraining time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs automatic self-retraining by detecting uncertain behavior instances, collecting relevant video data, generating synthetic labeled data through behavior synthesis, and updating the model without external expert intervention. This self-service mechanism resolves the contradiction by eliminating the time-consuming manual expert labeling process while maintaining model performance improvement.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system proactively identifies uncertain detection results and collects training data in advance before performance degradation becomes critical. By performing preliminary data collection and synthesis when uncertainty thresholds are exceeded, the system prepares training materials ahead of time, reducing the overall retraining cycle time and maintaining continuous model improvement.

Inventive Principle:
Principle #10Preliminary action

2Adaptability or versatility

If users are requested to label data periodically, then model adapts to new environments, but user fatigue reduces performance and separate interfaces increase costs

Engineering Contradiction:
Improveenvironment adaptationVSAvoiduser operation simplicity
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The system eliminates the need for user data labeling by automatically detecting uncertain instances, collecting video data, and synthesizing labeled training data through behavior synthesis modules. This self-service approach maintains environment adaptability while completely removing the operational burden from users, resolving the contradiction between adaptation and ease of operation.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system introduces an intermediate behavior synthesis module that acts as a mediator between raw video data and the training model. This intermediary automatically generates synthetic labeled data without requiring direct user interaction, thereby maintaining adaptability while simplifying user operation to minimal or no involvement.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Quantity of substance

If data labeling is performed through crowd sourcing, then large amounts of data are collected, but data security issues arise and models are not optimized for specific user environments

Engineering Contradiction:
Improvelabeled data quantityVSAvoiddata security risks
Core Design Contradiction:
Quantity of substanceVSObject-affected harmful factors

Solution Approach 1:

The system introduces a local behavior synthesis module as an intermediary that generates synthetic labeled data within the user's own environment without transmitting sensitive information externally. This intermediary produces sufficient training data locally, maintaining data quantity needs while eliminating data security risks associated with crowd sourcing and external data transmission.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system generates training data with local quality characteristics specific to each user's environment by synthesizing behaviors from locally collected video data. This local data generation approach provides sufficient quantity of labeled data tailored to specific environments while keeping all processing local, thereby eliminating data security risks of external transmission.

Inventive Principle:
Principle #3Local quality

4Measurement precision

If the model is retrained frequently to maintain performance, then detection accuracy is improved, but computational resources and time are consumed

Engineering Contradiction:
Improvedetection accuracyVSAvoidcomputational resource consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The system performs partial retraining by selectively updating only the necessary model components using synthetic data generated from uncertain detection instances. Instead of complete frequent retraining, this partial action approach maintains detection accuracy while reducing computational resource consumption and time requirements.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The system prepares synthetic training data in advance when uncertainty is detected, so that retraining can be performed efficiently with pre-prepared data. This preliminary data synthesis action reduces the computational burden during actual retraining operations, balancing detection accuracy maintenance with reduced resource consumption.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20250131327A1Method and apparatus for re-training model by recognizing uncertainty in online user behavior detection
Publication Date: 2025.04.24 ELECTRONICS & TELECOMM RES INST
  • US20250131327A1 patent drawing
  • US20250131327A1 patent drawing
  • US20250131327A1 patent drawing

AI summary

The present invention relates to a method and apparatus for re-training model by recognizing uncertainty in online user behavior detection. A method for training a model related to user behavior detection according to an embodiment of the present disclosure may comprise: detecting one or more behavior instances having a type of user behavior and a time interval of the user behavior; calculating at least one of a first uncertainty value for the type of user behavior or a second uncertainty value for the time interval of the user behavior; generating a first data newly labeling the type of user behavior or a second data newly labeling the time interval of the user behavior; and training a model that recognizes the user behavior information on a frame-by-frame basis.