Handball Detection Using 3D Pose Modeling

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current Video Assisted Referee (VAR) systems face challenges in accurately detecting handballs due to variations in camera perspectives and the difficulty in determining unnatural silhouettes of players, which can lead to inconsistent decision-making in sporting events.

Innovation Solution

The implementation of an apparatus with processing circuitry and software that utilizes camera feeds from multiple angles to generate pose diagrams, comparing player poses against predetermined natural silhouette boundaries, and employing 3D modeling to accurately determine if a player's arm or hand is in an unnatural position when the ball strikes, thereby aiding in handball detection.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional VAR systems use single or limited camera angles to detect handballs, then the system complexity is low, but the measurement precision and reliability of handball detection deteriorate due to variations in camera perspectives and obstructed views

Engineering Contradiction:
Improvehandball detection accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system transitions from 2D camera images to 3D spatial modeling by generating a 3D representation of the player's body and arm positions. This dimensional transformation allows accurate handball detection even when camera angles are obstructed or vary significantly, as the 3D model reconstructs the natural silhouette boundaries in three-dimensional space rather than relying on single 2D perspectives

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The system creates a universal 3D modeling framework that can process and integrate data from multiple camera angles simultaneously. This multi-functional approach allows the same detection algorithm to work consistently across different camera perspectives, player positions, and viewing angles, improving reliability without proportionally increasing system complexity

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If VAR systems attempt to determine unnatural silhouettes using multiple camera angles, then the measurement precision improves, but the difficulty of detecting and measuring increases due to the complexity of analyzing player poses from different perspectives

Engineering Contradiction:
Improvepose determination accuracyVSAvoidpose analysis complexity
Core Design Contradiction:
Measurement precisionVSDifficulty of detecting and measuring

Solution Approach 1:

The system introduces a 3D spatial model as an intermediary between the raw camera images and the handball detection decision. This intermediary representation simplifies the analysis by providing a standardized three-dimensional framework for comparing arm positions against natural silhouette boundaries, reducing the complexity of directly analyzing multiple 2D camera perspectives

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system transforms the detection parameters from 2D image coordinates to 3D spatial coordinates. By changing the parameter space from planar pixel positions to three-dimensional body segment positions, the system enables more accurate determination of whether arms are in unnatural positions relative to the body, improving pose determination accuracy while providing a consistent reference frame

Inventive Principle:
Principle #35Parameter changes

3Reliability

If the system uses 3D modeling and multiple camera feeds to determine handballs, then the reliability of handball detection improves, but the loss of time increases due to the computational processing required

Engineering Contradiction:
Improvehandball detection consistencyVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs preliminary actions by pre-establishing the 3D spatial relationships and natural silhouette boundaries before making the handball detection decision. By preparing the 3D model framework and expected natural arm positions in advance, the system reduces the computational burden during actual detection, allowing faster processing while maintaining high reliability through the robust 3D analysis framework

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentEP3836012B1A device, computer program and method for determining handball performed by a player
Publication Date: 2024.04.10 SONY GROUP CORP
  • EP3836012B1 patent drawingFigure 1
  • EP3836012B1 patent drawingFigure 2
  • EP3836012B1 patent drawingFigure 3

AI summary

A method of determining a handball performed by a player from an image is described, The method comprises: receiving an image from a camera, the image including an arm or hand of the player and a ball; determining a pose of the player when the ball contacts the arm or hand of the player; comparing the pose of the player against a predetermined pose; and on the basis of the comparison, determining that a handball event has occurred.