3D Egocentric Interface Using Gesture Threshold Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing user interfaces are inadequate for interacting with three-dimensional systems, lacking a simple and efficient method for user interaction.
Innovation Solution
A method and apparatus for generating a three-dimensional interface with virtual objects, defining stimuli and responses, and sensing interactions using end-effectors such as fingers or styluses to register inputs like touch, click, double click, peg, scale, and swipe.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a two-dimensional interface is used for interaction, then the interface can be implemented on a flat display screen, but it is problematic for systems that operate in three dimensions
Solution Approach 1:
The patent transitions from two-dimensional flat display interfaces to three-dimensional spatial interfaces by introducing depth as an additional dimension for user interaction. Virtual objects are positioned in 3D space and can be manipulated through spatial gestures, allowing users to interact with interfaces that extend beyond the flat screen into the physical space in front of it.
2Adaptability or versatility
If a three-dimensional interface is implemented, then user interaction with 3D systems is enabled, but a simple and efficient method for interaction is lacking
Solution Approach 1:
The system uses the user's own hand and finger movements as the interaction mechanism, eliminating the need for specialized 3D input devices. The camera captures natural hand gestures in 3D space, and the processing system automatically interprets these gestures to control virtual objects, making the interaction method both simple and intuitive.
Solution Approach 2:
The patent replaces physical mechanical interaction devices with optical sensing and computational processing. Instead of requiring specialized 3D controllers or mechanical interfaces, the system uses a camera to capture hand movements and processes these visually to generate control signals, substituting mechanical complexity with optical and computational simplicity.
Data Source
AI summary
In the method, a processor generates a three dimensional interface with at least one virtual object, defines a stimulus of the interface, and defines a response to the stimulus. The stimulus is an approach to the virtual object with a finger or other end-effector to within a threshold of the virtual object. When the stimulus is sensed, the response is executed. Stimuli may include touch, click, double click, peg, scale, and swipe gestures. The apparatus includes a processor that generates a three dimensional interface with at least one virtual object, and defines a stimulus for the virtual object and a response to the stimulus. A display outputs the interface and object. A camera or other sensor detects the stimulus, e.g. a gesture with a finger or other end-effector, whereupon the processor executes the response. The apparatus may be part of a head mounted display.