Background Detection As An Optimization For Gesture Recognition

Abstract

Methods and systems are provided allowing for background identification and gesture recognition in video images. A computer-implemented image processing method includes: receiving, using at least one processing circuit, a plurality of image frames of a video; constructing, using at least one processing circuit, a plurality of statistical models of the plurality of image frames at a plurality of pixel granularity levels; constructing, using at least one processing circuit, a plurality of probabilistic models of an input image frame at a plurality of channel granularity levels based on the plurality of statistical models; merging at least some of the plurality of probabilistic models based on a weighted average to form a single probability image; determining background pixels, based on a probability threshold value, from the single probability image; and determining whether the plurality of image frames, when examined in a particular sequence, conveys a gesture by the object.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS[0001]This application is a continuation-in-part application of U.S. patent application Ser. No. 13 / 349,217, filed on Jan. 12, 2012 and entitled “Automatic Background Identification in Video Images,” the entire disclosure of which is incorporated herein by reference.BACKGROUND[0002]This specification relates generally to image processing, and particularly to video image processing.[0003]The Internet provides access to a wide variety of resources, such as video files, audio files, pictures, business and personnel contact information, product information, maps, and news articles. Although textual data were prevalent during early days of the Internet, video file transfers and video communications are becoming more popular with the increase in bandwidth.[0004]In video chat and other digital video applications, a computer must process significant quantities of data in real time to create a high-quality and temporally-accurate image. For instance, if...

AI Technical Summary

Benefits of technology

The patent describes a method for recognizing gestures made by an object using image processing. The method involves receiving a video of the object and constructing a plurality of statistical models and probabilistic models of the image frames. These models are then used to determine if the video frames contain a gesture made by the object. The method can also automatically replace background pixels with desired pixel values and remove background pixels. The technical effect of this patent is to provide a more accurate and efficient method for recognizing gestures made by an object.

Problems solved by technology

For instance, if a person or object in a video conference call is moving a significant amount and is positioned in front of a variety of articles that create a complex background image, both the computer transmitting the video frame data and the computer receiving the data are confronted with enormous data-processing tasks.

Accordingly, gesture recognition is usually a computation-heavy and error-prone process.

Images