Pointing Input via Range Camera Depth Analysis
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional touch-sensitive display technologies are expensive and complex, making them less accessible and intuitive for human-computer interaction compared to other forms of input.
Innovation Solution
A system using a range camera and processor to capture user input by determining the position and orientation of a pointing axis, such as a user's forearm, to control operations on a display surface, enabling both touch and hover interactions without the need for traditional touch-sensitive hardware.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If touch-sensitive display technology is used, then user interaction becomes natural and intuitive, but the hardware becomes expensive and complex
Solution Approach 1:
The patent creates a virtual copy of touch-sensitive display functionality using a range camera and processing system. Instead of using physical touch-sensitive hardware, the system captures depth information of pointing gestures and synthesizes the interaction experience through software processing, thereby achieving touch-like functionality without the expensive hardware
Solution Approach 2:
The patent replaces the mechanical touch-sensitive display hardware with an optical system (range camera) and computational processing. The mechanical detection of finger contact is substituted by optical measurement of pointing axis position and orientation in 3D space, eliminating the need for complex touch-sensitive panels
2Device complexity
If conventional display technology is used, then hardware cost is reduced, but user interaction becomes less intuitive and accessible
Solution Approach 1:
The patent introduces an intermediary system consisting of a range camera and processor that mediates between the user's pointing gestures and the display operations. This intermediary layer translates simple pointing motions into precise display control, making the interaction more intuitive without requiring complex touch hardware
3Adaptability or versatility
If touch-sensitive hardware is implemented, then interaction capabilities are enhanced, but manufacturing cost increases
Solution Approach 1:
The patent creates a software-based copy of touch interaction capabilities using standard hardware components (range camera, processor). This virtual implementation provides the same interaction versatility as expensive touch-sensitive displays but at a fraction of the manufacturing cost, as it uses off-the-shelf components rather than specialized display hardware
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach allows for intuitive and accessible user input on any display surface, emulating touch-sensitive functionality without the need for expensive hardware, providing a richer interaction experience with both touch and hover capabilities.
Implementation Method 1
In the present example, the range camera is based on the time-of-flight principle: pulses of infra-red light are emitted to all objects in the field of view and the time of arrival of the reflected pulses is measured, to determine the distance from the sensor
Data Source
AI summary
Presented is apparatus for capturing user input by pointing at a surface using pointing means. The apparatus comprises: a range camera for producing a depth-image of the pointing means; and a processor. The processor is adapted to determine from the depth-image the position and orientation of a pointing axis of the pointing means; extrapolate from the position and orientation the point of intersection of the axis with the surface; and control an operation based on the location of the point of intersection.