Method and system for vision-based interaction in a virtual environment

Abstract

Method, computer program and system for tracking movement of a subject. The method includes receiving data from a plurality of fixed position sensors comprising a distributed network of time of flight camera sensors to generate a volumetric three-dimensional representation of the subject, identifying a plurality of clusters within the volumetric three-dimensional representation that correspond to features indicative of motion of the subject relative to the fixed position sensors and one or more other portions of the subject, and presenting one or more objects on one or more three dimensional display screens. The plurality of fixed position sensors are used to track motion of the features of the subject to manipulate the volumetric three-dimensional representation to determine interaction of one or more of the features of the subject and one or more of the one or more objects on one or more of the one or more three dimensional display screens.

Description

CROSS REFERENCE TO RELATED APPLICATIONS[0001]The present application is a continuation of U.S. patent application Ser. No. 12 / 028,704, filed Feb. 8, 2008 to El Dokor et al., entitled “Method and System for Vision-Based Interaction in a Virtual Environment.” This '704 application in turn claims the benefit of and priority to U.S. Provisional Patent Application No. 60 / 899,971 filed on Feb. 8, 2007, entitled “Natural Interaction in Cyberspace,” Application No. 60 / 901,548 filed on Feb. 16, 2007, entitled “Naturally Interactive Environments” and Application No. 60 / 966,056 filed on Aug. 27, 2007, entitled “Multi-Player Vision-Based Aerobic Gaming Controls.” U.S. Provisional Patent Applications No. 60 / 899,971, No. 60 / 901,548 and No. 60 / 966,056. The entire contents of each of these applications are hereby incorporated by reference.FIELD OF THE INVENTION[0002]The field of the invention relates generally to the field of human-machine interfaces and more particularly relates to a method and sy...

AI Technical Summary

Problems solved by technology

The user's experience in a virtual environment, therefore, is limited by a lack of realism and a lack of physical feedback from the virtual environment, as well as a lack of natural means for interaction,

However, the user's experience is limited by the requirement of wearing feedback devices.

Virtual reality using only visual feedback has limitations of its own.

However, peripheral devices are still required to interact with the virtual world.

Images