Methods and systems of spatiotemporal pattern recognition for video content development

Abstract

A system for enabling user interaction with video content includes an ingestion facility configured to access at least one video feed and a machine learning system configured to process the at least one video feed through a spatiotemporal pattern recognition algorithm that applies machine learning on an event in the at least one feed in order to develop an understanding of the event including identifying context information relating to the event and an entry in a relationship library at least detailing a relationship between two visible video features. The system further includes an extraction facility configured to automatically extract content displaying the event and associate the extracted content with the context information, and a video production facility configured to produce a video content data structure that includes the context information. The system further includes a user interface configured with video interaction options that are based on the context information.

Description

CROSS REFERENCE TO RELATED APPLICATIONS[0001]This application is a continuation of U.S. patent application Ser. No. 15 / 586,379 [SECS-0006-U01] filed May 4, 2017. U.S. patent application Ser. No. 15 / 586,379 claims the benefit of U.S. provisional patent application Ser. No. 62 / 395,886 [SECS-0004-P01] filed Sep. 16, 2016 and is also a continuation-in-part of U.S. patent application Serial No. 14 / 634,070 [SECS-0003-U01] filed Feb. 27, 2015, which claims the benefit of U.S. provisional patent application Ser. No. 62 / 072,308 [SECS-0002-P01] filed Oct. 29, 2014 and U.S. provisional patent application Ser. No. 61 / 945,899 [SECS-0001-P01] filed Feb. 28, 2014. Each of the applications listed above and elsewhere herein are hereby incorporated by reference in its entirety.BACKGROUND[0002]Field of the Invention[0003]The present application generally relates to a system and method for performing analysis of events that appear in live and recorded video feeds, such as sporting events. In particular...

AI Technical Summary

Benefits of technology

[0007]In accordance with various exemplary and non-limiting embodiments, methods and systems disclosed herein enable the exploration of event data captured from video feeds, the discovery of relevant events (such as within a video feed of a sporting event), and the presentation of novel insights, analytic results, and visual displays that enhance decision-making, provide improved entertainment, and provide other benefits.

Problems solved by technology

However, as no one person can evaluate and accurately store all of the information available from the vast volumes of sporting information generated on a daily basis, there seldom exists a storehouse of properly coded and stored information reflecting such large volumes of sports information and, even were such information available, there is lacking the provision of tools capable of mining and analyzing such information.

However, there are many challenges with such systems, including difficulty handling the data, difficulty transforming X, Y, Z data into meaningful and existing sports terminology, difficulty identifying meaningful insights from the data, difficulty visualizing results, and others.

Images