Architecture for controlling a computer using hand gestures

Abstract

Architecture for implementing a perceptual user interface. The architecture comprises alternative modalities for controlling computer application programs and manipulating on-screen objects through hand gestures or a combination of hand gestures and verbal commands. The perceptual user interface system includes a tracking component that detects object characteristics of at least one of a plurality of objects within a scene, and tracks the respective object. Detection of object characteristics is based at least in part upon image comparison of a plurality of images relative to a course mapping of the images. A seeding component iteratively seeds the tracking component with object hypotheses based upon the presence of the object characteristics and the image comparison. A filtering component selectively removes the tracked object from the object hypotheses and/or at least one object hypothesis from the set of object hypotheses based upon predetermined removal criteria.

Description

RELATED APPLICATIONS[0001]This is a continuation of U.S. patent application Ser. No. 10 / 396,653, filed on Mar. 25, 2003 and entitled, “ARCHITECTURE FOR CONTROLLING A COMPUTER USING HAND GESTURES,” the entire contents of which is hereby incorporated by reference.TECHNICAL FIELD[0002]The present invention relates generally to controlling a computer system, and more particularly to a system and method to implement alternative modalities for controlling computer application programs and manipulating on-screen objects through hand gestures or a combination of hand gestures and verbal commands.BACKGROUND OF THE INVENTION[0003]A user interface facilitates the interaction between a computer and computer user by enhancing the user's ability to utilize application programs. The traditional interface between a human user and a typical personal computer is implemented with graphical displays and is generally referred to as a graphical user interface (GUI). Input to the computer or particular ap...

AI Technical Summary

Benefits of technology

[0025]In accordance with still another aspect of the invention, two video cameras are mounted substantially parallel to each other to generate video images that are used to determine the depth (distance from the camera, display, or other point of reference) of a moving object us

Problems solved by technology

There are, however, many applications where the traditional user interface is less practical or efficient.

The traditional computer interface is not ideal for a number of applications.

Manipulation of the presentation by the presenter is generally controlled through use of awkward remote controls, which frequently suffer from inconsistent and less precise operation, or require the cooperation of another individual.

Switching between sources, advancing fast fast-forward, rewinding, changing chapters, changing volume, etc., can be very cumbersome in a professional studio as well as in the home.

Similarly, traditional interfaces are not well suited for smaller, specialized electronic gadgets.

Additionally, people with motion impairment conditions find it very challenging to cope with traditional user interfaces and computer access systems.

These conditions and disorders are often accompanied by tremors, spasms, loss of coordination, restricted range of movement, reduced muscle strength, and other motion impairing symptoms.

As people age, their motor skills decline and impact the ability to perform many tasks.

It is known that as people age, their cognitive, perceptual and motor skills decline, with negative effects in their ability to perform many tasks.

The requirement to position a cursor, particularly with smaller graphical presentations, can often be a significant barrier for elderly or afflicted computer users.

However, at the same time, this shift in the user interaction from a primarily text-oriented experience to a point-and-click experience has erected new barriers between people with disabilities and the computer.

For example, for older adults, there is evidence that using the mouse can be quite challenging.

It has been shown that even experienced older computer users move a cursor much more slowly and less accurately than their younger counterparts.

In addition, older adults seem to have increa

Images