Pose Recognition Model Channel Fusion for Keypoint Accuracy

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional human body posture recognition models calculate errors between heat maps and true values without analyzing the heat maps, leading to low recognition accuracy.

Innovation Solution

A method for optimizing human body posture recognition models by analyzing key point features at individual, local, and global levels through multi-layer feature fusion, including depth-separable convolution, local and global feature fusion processing, and determining linear relationships between channels to update weight coefficients.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional methods directly calculate error between heat maps and true values, then the calculation process is simple, but the recognition accuracy is low

Engineering Contradiction:
Improverecognition accuracyVSAvoidmodel complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the key points into five distinct parts (head, torso, limbs, joints, extremities) and processes each part separately through dedicated convolution layers. This segmentation allows the model to capture spatial relationships and dependencies between different body parts, thereby improving recognition accuracy without overwhelming complexity by organizing the processing into manageable functional modules.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a new dimension of analysis by processing key points at multiple levels (individual key point level, local region level, and global body level). This multi-level processing approach adds dimensional depth to the error calculation, enabling the model to capture both local details and global relationships, thus improving accuracy while maintaining structured complexity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Loss of information

If conventional methods do not analyze heat maps further, then the processing is efficient, but spatial information and key point relationships are not effectively utilized

Engineering Contradiction:
Improvespatial information utilizationVSAvoidprocessing time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The patent performs preliminary analysis of heat maps by extracting spatial information and calculating relationships between key points before the final error calculation. This preliminary action includes computing distances between key points, analyzing spatial patterns, and preparing feature representations that capture essential spatial relationships, thereby reducing information loss while the efficient convolution operations minimize processing time overhead.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces intermediary feature maps and intermediate representations that bridge the raw heat maps and the final error calculation. These intermediaries process and analyze spatial information in a structured manner, acting as mediators that transform raw data into meaningful representations without requiring excessive processing time, thus reducing information loss while maintaining efficiency.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Reliability

If the model does not learn interdependence between key points, then the model structure is simple, but the expression ability and performance are limited

Engineering Contradiction:
Improvemodel performanceVSAvoidmodel structure complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent merges the processing of multiple key points and their relationships into a unified multi-level feature extraction framework. By combining individual key point analysis with local and global relationship modeling in a single integrated structure, the model learns interdependencies between key points while avoiding the complexity of separate analysis modules, thus improving reliability without proportionally increasing structural complexity.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent creates a universal processing framework that handles multiple tasks simultaneously: extracting individual key point features, calculating spatial relationships, and modeling global body structure. This multi-functional approach allows the model to learn interdependencies between key points for improved performance while maintaining a single versatile architecture rather than multiple specialized models, thus managing structural complexity effectively.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS12626528B2Method for optimizing human body posture recognition model, device and computer-readable storage medium
Publication Date: 2026.05.12 UBTECH ROBOTICS CORP LTD
  • US12626528B2 patent drawing
  • US12626528B2 patent drawing
  • US12626528B2 patent drawing

AI summary

A method includes: obtaining heat maps including a predetermined number of key points of a human body; performing depth separable convolution on a feature map corresponding to one of the heat maps corresponding to each of the key points and a convolution kernel of a corresponding channel of the human body posture recognition model to determine a key point feature map corresponding to each channel of the human body posture recognition model; performing local feature fusion processing and/or global feature fusion processing on the key point feature map corresponding to each channel to obtain fusion posture feature maps; determining a linear relationship between the channels of the human body posture recognition model based on the fusion posture feature maps; and updating weight coefficients of the corresponding channels of the human body posture recognition model by using the linear relationship between the channels of the human body posture recognition model.