Multi-Agent Formation Learning With GMM Role Alignment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional methods for predicting team formations in sports analytics are inefficient and prone to pathological solutions, requiring significant computational time and often failing to converge, especially when dealing with dynamic and unordered multi-agent player motion data.

Innovation Solution

A three-step approach involving formation discovery, role assignment, and template clustering, which includes a Gaussian Mixture Model (GMM) and a modified Hungarian Algorithm to align player positions to roles, enabling rapid and stable discovery of formation templates.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional graph neural networks are used to model multi-agent systems, then the model can capture pairwise interactions, but it fails to represent higher-order structural patterns and achieves poor sample efficiency

Engineering Contradiction:
Improvestructural representation accuracyVSAvoidmodel complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the multi-agent system representation into two distinct components: pairwise interaction patterns captured by graph neural networks and higher-order structural patterns captured by hypergraph neural networks. This segmentation allows each component to specialize in capturing different types of structural information, improving overall representation accuracy without requiring a single overly complex model.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent creates a composite modeling approach by combining graph neural networks and hypergraph neural networks into a unified hybrid architecture. This composite structure leverages the strengths of both models - GNNs for pairwise interactions and HGNNs for higher-order relationships - achieving superior sample efficiency and structural representation that neither model could achieve alone.

Inventive Principle:
Principle #40Composite materials

2Productivity

If more data is collected to improve model performance, then sample efficiency may improve, but the complexity of data collection and processing increases

Engineering Contradiction:
Improvesample efficiencyVSAvoiddata processing complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent introduces an intermediary contrastive learning mechanism that operates on augmented views of the same data. Instead of requiring additional raw data, the system creates transformed versions of existing trajectories through data augmentation and applies contrastive learning to capture invariant structural patterns. This intermediary process extracts more value from existing data without increasing data collection complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent changes the parameter space by transforming trajectories into different representations through data augmentation techniques. By applying various transformations (e.g., sub-segmentation, reordering, noise addition) to the same underlying data, the system creates diverse training examples that improve sample efficiency while reusing the same raw data, avoiding the need for additional data collection.

Inventive Principle:
Principle #35Parameter changes

3Reliability

If complex structural patterns are modeled to improve task generalization, then performance on unseen tasks improves, but the training complexity and computational resources increase

Engineering Contradiction:
Improvetask generalization capabilityVSAvoidcomputational resources
Core Design Contradiction:
ReliabilityVSPower

Solution Approach 1:

The patent segments the learning process into two parallel streams: one processing graph-structured data for pairwise interactions and another processing hypergraph-structured data for higher-order patterns. This segmentation allows the system to learn different types of structural representations simultaneously but independently, reducing the computational burden compared to learning all patterns in a single monolithic model.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements contrastive learning with augmented views that processes slightly more information than strictly necessary by creating multiple transformed versions of the same trajectory. This partial excess action in the training phase improves generalization to unseen tasks by learning invariant patterns, while the efficiency gains from better sample efficiency compensate for the additional computational investment during training.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentEP4034962B1System and method for improved structural discovery and representation learning of multi-agent data
Publication Date: 2026.05.06 STATS LLC
  • EP4034962B1 patent drawingFigure 1
  • EP4034962B1 patent drawingFigure 2A
  • EP4034962B1 patent drawingFigure 2B

AI summary

A computing system retrieves player tracking data for a plurality of players across a plurality of events. The player tracking data includes coordinates of player positions during each event. The computing system initializes the player tracking data based on an average position of each player in the plurality of events. The computing system learns an optimal formation of player positions based on the player tracking data using a Gaussian mixture model. The computing system aligns the optimal formation of player positions to a global template by identifying a distance between each distribution in the optimal formation and each distribution in the global template to generate a learned formation template. The computing system assigns a role to each player in the learned template.