3D Gesture Input Across Multiple Displays With View Context
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing gesture input technologies in computing systems, such as air and touch gestures, lack the ability to determine the specific direction of gestures across multiple displays or windows, leading to ambiguity in command execution.
Innovation Solution
A system that uses camera and microphone arrays to detect user gestures and determines the current view or display focus, allowing gestures to be interpreted and executed appropriately based on the active view, incorporating three-dimensional physics interactions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If gesture input technologies are used without view context, then gesture recognition is simple, but gesture direction and target identification become ambiguous
Solution Approach 1:
The patent introduces view context as an intermediary element between the gesture and the command execution. The system determines which display or window is the current view and uses this context to resolve gesture ambiguity. This intermediary (view context) provides the necessary directional information without requiring complex gesture variations, thus resolving the contradiction between simplicity and information completeness.
2Adaptability or versatility
If multiple displays are supported without view determination, then system versatility is improved, but gesture target identification becomes ambiguous
Solution Approach 1:
The system performs preliminary determination of the current view (which display or window is active) before executing the gesture command. This preliminary action establishes the context needed for accurate target identification across multiple displays. By preparing this contextual information in advance, the system maintains both versatility and precision without requiring additional complex input from the user.
3Adaptability or versatility
If physics interactions are added to gestures, then realism and complexity of interactions are improved, but system complexity increases
Solution Approach 1:
The patent implements a universal physics engine that handles multiple types of interactions (gravity, collision, momentum) through a single integrated system. This multi-functional approach allows realistic physics-based gestures without proportionally increasing system complexity, as the same physics infrastructure serves multiple interaction purposes rather than requiring separate specialized systems for each interaction type.
Data Source
AI summary
Gesture input with multiple displays, views, and physics is described. In one example, a method includes generating a three dimensional space having a plurality of objects in different positions relative to a user and a virtual object to be manipulated by the user, presenting, on a display, a displayed area having at least a portion of the plurality of different objects, detecting an air gesture of the user against the virtual object, the virtual object being outside the displayed area, generating a trajectory of the virtual object in the three-dimensional space based on the air gesture, the trajectory including interactions with objects of the plurality of objects in the three-dimensional space, and presenting a portion of the generated trajectory on the displayed area.