High speed video action recognition and localization

Abstract

An apparatus for detecting an action in a test video. In an illustrative embodiment, the apparatus includes a first mechanism for receiving a query for a particular action via a query video. A second mechanism employs motion vectors associated with the test video to compute one or more motion-similarity values. The one or more motion-similarity values represent motion similarity between a first group of pixels in a first frame of a query video and a second group of pixels in a second frame of the test video based on the motion vectors. A third mechanism uses the one or more similarity values to search for the particular action or similar action in the test video. In a more specific embodiment, another mechanism aggregates the similarity values over a predetermined number of frames to facilitate estimating where the particular action or version thereof occurs or is likely to occur in the test video.

Description

ACKNOWLEDGMENT OF GOVERNMENT SUPPORT[0001]This invention was made with Government support under Contract Number CCR-0330514, awarded by the National Science Foundation (NSF). The Government may have certain rights to this invention.BACKGROUND OF THE INVENTION[0002]This invention is related in general to video processing and more specifically to action-recognition systems and methods for detecting or locating a particular action in a video. Generally, video action recognition systems compare actions in a query video to many reference videos to detect whether an action in the query video matches the action in a particular reference video. In this manner, a particular action such as, e.g., walking, running, jumping, throwing a punch, or other action performed by an animate or inanimate actor can be identified. Action-recognition systems can be employed in various demanding applications, including video surveillance, collision-avoidance for unmanned aerial vehicles, video editing, video...

AI Technical Summary

Benefits of technology

[0007]Hence, this embodiment provides a system for enabling high-speed real-time video action recognition and localization via use of preexisting motion vectors or other motion field information, which are often byproducts of modern video compression schemes. As discussed more fully below, leveraging precomputed motion vectors and emplo

Problems solved by technology

High-speed action-recognition systems are particularly important in surveillance applica

Images