3D Face Selection via Hand Gesture Plane Orientation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current CAD applications lack efficient methods for selecting topological elements, such as faces of 3D objects, in 3D immersive environments, particularly due to ambiguity and the need for precise mouse-based interactions or multiple clicks, which are time-consuming and cumbersome.
Innovation Solution
A computer-implemented method using hand gestures to select faces in a 3D immersive environment by detecting a hand gesture with all fingers except the thumb adducted, determining an oriented plane with the palm or back of the hand, and identifying the face with the closest orientation to this plane, allowing for direct and natural interaction without the need for precise mouse control or multiple clicks.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If mouse-based approaches are used for selecting topological elements, then selection precision can be achieved, but operation complexity increases and time consumption increases
Solution Approach 1:
The patent replaces the mechanical mouse-based selection system with a gesture-based selection system. Users perform hand gestures (opening and closing hand) to select topological elements, eliminating the need for precise mouse positioning and clicking. The system detects hand pose and determines selection based on gesture recognition rather than mechanical cursor control.
Solution Approach 2:
The system enables self-service selection where the act of grasping or releasing an object in the virtual environment directly corresponds to selection or deselection. The hand gesture itself serves the dual purpose of both indicating interest in an element and completing the selection action, eliminating the need for separate click actions.
2Measurement precision
If multiple clicks are required to select elements, then selection accuracy can be improved, but productivity decreases
Solution Approach 1:
The patent merges the selection action with the navigation action. A single continuous hand gesture (grasping motion) simultaneously performs both the navigation to and selection of the target element, combining what would traditionally require separate zooming/clicking actions into one unified gesture.
Solution Approach 2:
The system performs preliminary identification of the target element during the gesture execution. As the hand approaches and orients toward an element, the system pre-identifies it as the potential target, so that the final grasping motion confirms selection without requiring additional verification clicks.
3Loss of information
If filters are displayed to reduce selection ambiguity, then selection clarity improves, but device complexity increases
Solution Approach 1:
The patent extracts the filtering logic from the user interface and embeds it within the gesture recognition system. Different gesture variations (different hand orientations, grasping strengths, or gesture sequences) inherently filter for different types of topological elements, eliminating the need for separate filter panels or menus.
Solution Approach 2:
The hand gesture system serves multiple functions simultaneously: it navigates to elements, identifies element types based on gesture characteristics, filters selections by element category, and confirms selection all through a single unified interaction paradigm, replacing multiple specialized controls.
Data Source
Figure 1~2
Figure 3
Figure 4~5
AI summary
The invention notably relates to a computer-implemented method for selecting a face among faces of a 3D object in a 3D immersive environment. Each face is oriented in the 3D immersive environment. The method comprises displaying the 3D object in the 3D immersive environment. The method further comprises detecting S20 a hand gesture. The hand gesture comprises an adduction of all fingers except thumb. The method further comprises determining an oriented plane formed with the palm and/or the back of the hand in the 3D immersive environment. The method further comprises identifying the face of the 3D object having the closest orientation with the oriented plane. This constitutes an improved method for selecting a face among faces of a 3D object in a 3D immersive environment using hand interactions.