Camera-based multi-touch interaction apparatus, system and method

Abstract

The invention provides an apparatus, a system and a method. The apparatus, the system and the method are used for controlling and interacting within an interaction volume (1) within a height over the coordinate plane (12) of a computer such as a computer screen, an interactive whiteboard, a horizontal interaction surface, a video / web-conference system, a document camera, a rear-projection screen, a digital signage surface, a television screen or a gaming device, to provide pointing, hovering, selecting, tapping, gesturing, scaling, drawing, writing and erasing, using one or more interacting objects (2), for example, fingers, the hands, the feet, and other objects, for example, pens, brushes, wipers and even more specialized tools. The apparatus and the method can in a system be used together with, or even be integrated into, data projectors (3) of all types and its fixtures / stands (4), and used together with flat screens (12) (like LCD, plasma, OLED, rear-projection screen, etc.) to render such display systems interactive. The apparatus consists of a single camera (5) covering the interaction volume (1) from either a very short distance or from a larger distance to determine the lateral positions (X,Y) and even capturing the pose of the interacting object(s) (2).

Description

technical field [0001] The present invention relates to camera-based multi-touch interaction systems that utilize, for example, camera-based input devices and visible and / or infrared lighting to track objects within an area / space, such as tracking one or more finger or pen; the system enables determination of a two-dimensional position within an area and height above the surface of the area for providing actual two-dimensional input coordinates and in actual interaction states such as "inactive" (no tracking), A precise distinction is made between "hovering" (tracking without touching, sometimes called "in range") and "touching". The present invention also relates to multi-modal input devices and interfaces that eg allow pen and finger touch input and are also operable to handle several objects simultaneously, such as multi-touch computer input devices. Furthermore, the present invention relates to a method of inputting gestures using a three-dimensional based input device an...

AI Technical Summary

Problems solved by technology

A touch-sensitive film coated on top of a flat screen cannot detect hovering or mid-air gestures

Images