Hybrid Touch Gesture Input System for Natural Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current gesture-based interaction systems for electronic devices are not flexible enough and do not adapt well to natural interaction patterns, often forcing users to conform to specific interaction methods that may not be intuitive.
Innovation Solution
A method that combines touch-based and non-touch-based interactions, where the characteristics of one type of interaction influence the actions attributed to the other, allowing for more flexible and intuitive input methods, such as using camera-based gestures and touch-sensitive inputs to mimic real-world actions like picking and moving objects.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If gesture-based interaction using camera and image analysis is used, then direct contact with device is reduced, but interaction flexibility and adaptability to natural patterns are limited
Solution Approach 1:
The patent combines touch-based interaction (touchscreen) and non-touch gesture-based interaction (camera-based) into a unified system where both input methods can be used together. The touch input and gesture input are processed simultaneously, and their effects are combined to control the device, allowing users to leverage both direct contact precision and gesture-based natural interaction.
Solution Approach 2:
The patent implements dynamic adaptability where the device can switch between different interaction modes (touch-only, gesture-only, or combined) based on the situation. The system dynamically adjusts which interaction method takes precedence or how they are integrated, making the interaction pattern flexible and adaptable to different usage scenarios and user preferences.
2Adaptability or versatility
If single type of gesture interaction is used, then system simplicity is maintained, but interaction flexibility and intuitiveness are reduced
Solution Approach 1:
The patent creates a universal interaction framework where a single system can handle multiple types of inputs (touch and gestures) through a unified processing mechanism. The device responds to both touch-based and gesture-based inputs using the same control logic, making the system multi-functional without requiring separate processing paths for each interaction type.
Solution Approach 2:
The patent introduces an intermediary processing layer that receives both touch input data and gesture input data, harmonizes them, and produces a unified control command. This mediator layer abstracts the complexity of handling multiple input types, allowing the rest of the system to work with a standardized interface while supporting diverse interaction methods.
3Measurement precision
If touch-based interaction is used, then precise input is achieved, but natural interaction pattern is compromised
Solution Approach 1:
The patent segments the interaction into two distinct phases: a touch-based phase for precise selection and positioning, and a gesture-based phase for natural manipulation and control. Users first touch the screen to precisely select an object or location, then use natural gestures to manipulate it, combining the precision of touch with the naturalness of gestures.
Solution Approach 2:
The patent uses touch-based interaction as a preliminary action to establish precise input (such as selecting an object or defining a starting point), followed by gesture-based interaction to perform the actual manipulation. This preliminary precise input enables subsequent natural gestures to be applied accurately to the intended target.
Data Source
Figure 1
Figure 2a~2b
Figure 3
AI summary
The invention relates to method for providing an input to a device characterized in that the input is based on a combination of at least one touch based interaction and at least one non-touch based interaction with the device, wherein the one type of input influences the action instructed to the device in response to the other type of input. The invention also relates to a corresponding device. To further improve the interaction between a user and a device, feedback providing means can be provided.