System and method for calibrating moving cameras capturing broadcast video

Abstract

A system and method of calibrating moving cameras capturing a sporting event is disclosed herein. A computing system retrieves a broadcast video feed for a sporting event. The broadcast video feed includes a plurality of video frames. The computing system labels, via a neural network, components of a playing surface captured in each video frame. The computing system matches a subset of labeled video frames to a set of templates with various camera perspectives. The computing system fits a playing surface model to the set of labeled video frames that were matched to the set of templates. The computing system identifies camera motion in each video frame using an optical flow model. The computing system generates a homography matrix for each video frame based on the fitted playing surface model and camera motion. The computing system calibrates each camera based on the homography matrix generated for each video frame.

Description

[0001] priority document [0002] This application claims the priority of the U.S. provisional application with the filing date of February 28, 2019 and the application number US 62 / 811,889, the entire contents of which are incorporated herein by reference. technical field [0003] The present disclosure generally relates to systems and methods for calibrating mobile cameras capturing broadcast video feeds. Background technique [0004] Player tracking data has been used in many sports for team and player analysis over the years. However, conventional player tracking systems require sports analytics companies to install fixed cameras at each field where a team plays. This constraint limits the scalability of the athlete tracking system, with limited data collection for current competitions. Additionally, such constraints can incur significant expense for sports analysis companies due to the costs associated with installing the necessary field hardware and maintaining such ...

AI Technical Summary

Problems solved by technology

However, conventional player tracking systems require sports analytics companies to install fixed cameras at each field where a team plays

This constraint limits the scalability of the athlete tracking system, with limited data collection for current competitions

Additionally, such constraints can incur significant expenses for sports analytics companies due to the costs associated with installing the necessary field hardware and maintaining such hardware

Images