Video and Positional Data Synchronization for Sports Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Sports analysts face challenges in synchronizing video streams and positional information streams captured by different systems, leading to difficulties in accurately analyzing player performance, as these streams often require manual intervention to align.

Innovation Solution

An information processing apparatus and method that includes a camera arrangement with remotely controlled pan, tilt, and zoom functions, coupled with image processing techniques for automatic object detection and tracking, and a prediction technique to adjust camera fields of view based on predicted player positions, ensuring synchronized and accurate alignment of video and positional data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual intervention is used to synchronize video streams and positional information streams, then alignment accuracy can be achieved, but time consumption and operational complexity increase

Engineering Contradiction:
Improvealignment accuracyVSAvoidtime consumption
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system automatically synchronizes video streams and positional information streams by detecting common features (such as players, ball, or pitch markers) across both data sources and autonomously aligning them in time and space, eliminating the need for manual intervention while maintaining high alignment accuracy

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system continuously monitors the synchronization status of video and positional data streams, detects misalignments, and automatically adjusts timing offsets and spatial transformations to maintain accurate alignment, creating a closed-loop feedback mechanism that ensures precision without manual input

Inventive Principle:
Principle #23Feedback

2Adaptability or versatility

If different systems are used to capture video streams and positional information, then data collection versatility is improved, but synchronization difficulty increases

Engineering Contradiction:
Improvedata collection versatilityVSAvoidsynchronization complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system introduces a central synchronization module that acts as an intermediary between video capture systems and positional tracking systems, translating and coordinating data from different sources using common reference features to achieve seamless integration despite system heterogeneity

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The synchronization system employs universal feature detection algorithms that can identify and track common elements (players, ball, pitch markers) across multiple different data sources and formats, enabling a single system to handle diverse video and positional data streams from various capture devices

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Manufacturing precision

If camera fields of view are manually adjusted to track players, then image quality can be optimized, but operational efficiency decreases

Engineering Contradiction:
Improveimage qualityVSAvoidoperational efficiency
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The system dynamically adjusts camera fields of view in real-time based on predicted player positions and movement trajectories, automatically optimizing image quality and frame composition without manual intervention, allowing the cameras to adapt their parameters continuously as players move across the pitch

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system uses prediction algorithms to anticipate player positions before they reach them, pre-adjusting camera fields of view and zoom levels to ensure optimal framing and image quality is maintained proactively rather than reactively, improving both image quality and tracking efficiency

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentEP3270327B1Information processing apparatus, method and computer program product
Publication Date: 2022.10.26 SONY GROUP CORP
  • EP3270327B1 patent drawingFigure 1
  • EP3270327B1 patent drawingFigure 2
  • EP3270327B1 patent drawingFigure 3A

AI summary

An information processing apparatus, comprising: receiver circuitry configured to receive i) a video stream comprising a plurality of images, each image containing at least one object located at a position in a plane and the image having associated image timing information indicating its temporal position in the video stream and ii) a stream of object tracking information each having associated object timing information indicating its temporal position in the stream of object tracking information wherein the stream of object tracking information corresponds to the video stream and separately defines the position of the object in the plane captured in each image in the video stream; and controller circuitry configured to perform pattern matching on the position of each of the objects in the video stream and the object tracking information, and when there is a closest matching position, synchronising the image timing information and the object timing information.