Apparatus and method for indicating target by image processing without three-dimensional modeling

Abstract

Using a pair of cameras, the coordinates of a target on a plane to which a user is pointing may be obtained without three-dimensional modeling and using only data derived from the respective images and no three-dimensional scene data. Each camera views at least four registration points on the plane and an indicator of a direction along which the target lies. A linear transform of a first image maps the planar projection of the direction indication into the second image. The coordinates, in the second image, of the target are determined from the intersection of the projection of the direction in the second image and the transformed projection from the first image. In another embodiment, the directions are mapped to a third reference frame or image by respective linear transforms. An application of the system would allow a user to indicate a location on a projection or television screen using a static pointing gesture. No information about the locations of the cameras is required, so the system can be set up quickly.

Description

[0001] Related Application Cross Reference

[0002] This application is related to the following applications, which are hereby incorporated by reference in their entirety:

[0003] US Application 09 / 488,028 for "Multi-Model Video Object Acquisition and Redirection System and Method," filed 1 / 20 / 2000

[0004] US applications 09 / 532,820 and

[0005] US Application 08 / 995,823 for "Method and System for Selectable Option-Based Gestures" filed 12 / 22 / 2000 technical field

[0006] The present invention relates to image recognition, in particular the recognition of pointing gestures for pointing target points on a plane without three-dimensional modeling of the scene. Background technique

[0007] There are many applications that can benefit from gesture recognition. For example, this is a natural mechanism for controlling the aiming of cameras. Another application is using gestures to move an on-screen cursor. For example, it is conceivable to make selections on future smart ...

Images