Video Behavior Recognition Model Using Selective Feature Combinations

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional techniques face difficulties in accurately recognizing specific behaviors in videos, particularly when the behavior is complex, due to the challenge of setting appropriate joint position patterns and the need for extensive sample preparation.

Innovation Solution

An information processing device and program that allows for the specification of feature combinations related to behaviors, training a model using these features to recognize specific behaviors, reducing the need for extensive sample preparation and explicit pattern setting.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional techniques use rule-based joint position patterns for behavior recognition, then simple behaviors can be recognized, but complex behaviors cannot be recognized due to inability to set appropriate patterns

Engineering Contradiction:
Improvebehavior recognition accuracyVSAvoidcapability to recognize complex behaviors
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent changes the fundamental parameters of behavior recognition from rule-based joint position patterns to machine learning models that process diverse features including joint positions, velocities, accelerations, and temporal patterns. This allows the system to adapt to complex behaviors by learning from data rather than relying on predefined rules

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The system transitions from static rule-based patterns to dynamic machine learning models that can adapt and learn from new behavior patterns. The models are trained on diverse datasets and can continuously improve recognition accuracy for complex behaviors through exposure to more training data

Inventive Principle:
Principle #15Dynamics

2Measurement precision

If conventional techniques prepare extensive samples for training, then recognition accuracy can be improved, but workload and processing time increase significantly

Engineering Contradiction:
Improvebehavior recognition accuracyVSAvoidsample preparation time and processing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent performs preliminary actions by pre-training models on comprehensive datasets that capture diverse behavior patterns. Once trained, the models can recognize complex behaviors with high accuracy without requiring extensive additional sample preparation for each specific behavior recognition task

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system uses synthetic or augmented training data that copies and transforms existing behavior patterns to create diverse training samples. This reduces the need for extensive manual sample collection while maintaining recognition accuracy through data augmentation techniques

Inventive Principle:
Principle #26Copying

Data Source

PatentEP4672176A1Information processing device program and information processing device
Publication Date: 2025.12.31 FUJITSU LTD
  • EP4672176A1 patent drawingFigure 1
  • EP4672176A1 patent drawingFigure 2
  • EP4672176A1 patent drawingFigure 3

AI summary

An information processing device (100), among multiple types (110) that classify features related to behaviors of a person, receives specification of a combination (120) of types (110) belonging to each of one or more aspects defining a specific behavior. The information processing device (100), among multiple features calculable based on a first video (101) and related to a behavior of a first person captured in the first video, obtains a feature (121) for each type (110) in the specified combination (120). The information processing device (100), based on the obtained features, trains a model (130) having a function of recognizing a specific behavior of a person captured in a video.