Method for selecting command by using upper arm extension information
An upper arm, arm technology, applied in the input/output of user/computer interaction, the input/output process of data processing, instruments, etc., can solve problems such as limitations
Active Publication Date: 2015-08-26
INST OF SOFTWARE - CHINESE ACAD OF SCI
View PDF6 Cites 4 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Cursor movement is controlled by body movement, and the operation and display interface is currently limited to the XOY two-dimensional plane
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment
[0083] In the software environment where the Stretching component is running, the background task of the Stretching component constantly communicates with the depth camera to detect the position of the user's palm in real time. When the user's arm is naturally drooping and the palm is below the shoulder joint, the Stretching component is inactive . When browsing pictures, the user raises his hand at about shoulder height in a natural state. At this time, the Stretching component activates and displays a vertical screen containing three options: "zoom, rotate, and return to the previous level". Direction menu, the cursor is at the edge of the top menu at this time, and no menu option is selected. At this time, the palm is pushed forward, and the stretching length of the arm increases, and the cursor position starts to move downward, passing through three menu options from top to bottom. When the palm stops moving, the cursor is fixed on a certain menu option. If the palm positi...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The present invention discloses a method for selecting a command by using an upper arm extension information. The method includes: 1) creating a Stretching component and menu thereof on the controller; 2) collecting, by a controller, three-dimensional space position of the palm of a user through the depth camera on the display screen in real-time, and then calculating the projection distance from the hand center to the plane of the user body to obtain an arm stretching length of the user and send the same to the Stretching component; 3) converting, by the component, the user's arm stretching length into a display position of the cursor of the menu on the screen; 4) controlling, by the user, the cursor movement by changing the arm stretching length, and when the cursor moves to a menu option to be chosen in the menu, maintaining the gesture suspension time grater than a predetermined time, wherein in this case, the menu option is chosen. The method of the present invention does not use wearable sensors. The method for selecting a menu command by using the upper arm extension information based on the deep camera, and does not affect the fine movements of a finger.
Description
technical field [0001] The invention relates to a method for command selection using upper arm extension information, which has a particularly significant advantage in using a depth camera to interact with a large screen for selection operations, and belongs to the field of human-computer interaction. Background technique [0002] Arm stretching is a very common action that we use in our daily life. Arm-based gestures that users can use to control the position of a target object. Depth cameras currently on the market are capable of capturing the user's body motion with acceptable accuracy, which opens new avenues for tools that enable nature-based body motion. [0003] Recently, some researchers use depth information from depth cameras to support user interaction on tablet devices and large-screen devices. The research of Wilson et al. (WILSON A D. Using a Depth Camera as a Touch Sensor [M]. ACM International Conference on Interactive Tabletops and Surfaces. Saarbrücken, G...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01G06F3/0484G06F3/0487
Inventor 田丰刘杰王宏安
Owner INST OF SOFTWARE - CHINESE ACAD OF SCI