Unlock instant, AI-driven research and patent intelligence for your innovation.

A Method for Command Selection Using Upper Arm Stretch Information

An upper arm and arm technology, applied in the input/output of user/computer interaction, input/output process of data processing, instruments, etc., can solve problems such as limitations

Active Publication Date: 2018-01-05
INST OF SOFTWARE - CHINESE ACAD OF SCI
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Cursor movement is controlled by body movement, and the operation and display interface is currently limited to the XOY two-dimensional plane

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Method for Command Selection Using Upper Arm Stretch Information
  • A Method for Command Selection Using Upper Arm Stretch Information
  • A Method for Command Selection Using Upper Arm Stretch Information

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0083] In the software environment where the Stretching component is running, the background task of the Stretching component constantly communicates with the depth camera to detect the position of the user's palm in real time. When the user's arm is naturally drooping and the palm is below the shoulder joint, the Stretching component is inactive . When browsing pictures, the user raises his hand at about shoulder height in a natural state. At this time, the Stretching component activates and displays a vertical screen containing three options: "zoom, rotate, and return to the previous level". Direction menu, the cursor is at the edge of the top menu at this time, and no menu option is selected. At this time, the palm is pushed forward, and the stretching length of the arm increases, and the cursor position starts to move downward, passing through three menu options from top to bottom. When the palm stops moving, the cursor is fixed on a certain menu option. If the palm positi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method for command selection using upper arm stretch information. The method is as follows: 1) Create a Stretching component and its menu on the controller; 2) The controller collects the three-dimensional space position of the user's palm in real time through the depth camera on the display screen, and then calculates the projection of the palm position to the user's body plane distance, get the user's arm stretch length and send it to the Stretching component; 3) the component converts the user's arm stretch length into the display position of the cursor on the screen on the menu; 4) the user changes the arm stretch length The movement of the cursor is controlled. When the cursor moves to a menu item to be selected on the menu and the hovering time of the gesture is longer than the set time, the menu item is selected. The present invention does not use a wearable sensor, is based on a depth camera, and uses upper arm extension information to select a menu command without affecting the fine movements of fingers.

Description

technical field [0001] The invention relates to a method for command selection using upper arm extension information, which has a particularly significant advantage in using a depth camera to interact with a large screen for selection operations, and belongs to the field of human-computer interaction. Background technique [0002] Arm stretching is a very common action that we use in our daily life. Arm-based gestures that users can use to control the position of a target object. Depth cameras currently on the market are capable of capturing the user's body motion with acceptable accuracy, which opens new avenues for tools that enable nature-based body motion. [0003] Recently, some researchers use depth information from depth cameras to support user interaction on tablet devices and large-screen devices. The research of Wilson et al. (WILSON A D. Using a Depth Camera as a TouchSensor[M]. ACM International Conference on Interactive Tabletops and Surfaces. Saarbrücken, Ger...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/01G06F3/0484G06F3/0487
Inventor 田丰刘杰王宏安
Owner INST OF SOFTWARE - CHINESE ACAD OF SCI