Method for performing accurate three-dimensional modeling based on data glove by using natural gestures

A data glove, 3D modeling technology, applied in 3D modeling, image data processing, input/output of user/computer interaction, etc., can solve the problem of single interaction, poor 3D modeling effect, inability to recognize complex gesture language, etc problem to achieve the effect of avoiding gesture occlusion

Active Publication Date: 2015-07-15
ZHEJIANG UNIV
View PDF5 Cites 25 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Single-use somatosensory devices cannot recognize complex gesture languages, and the measurement accuracy of hands cannot meet the requirements of 3D modeling
However, a single data glove can only recognize gestures because it cannot restore the trajectory and positional relationship, and because it only uses h...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for performing accurate three-dimensional modeling based on data glove by using natural gestures
  • Method for performing accurate three-dimensional modeling based on data glove by using natural gestures

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0023] The present invention will be described in further detail below in conjunction with the accompanying drawings and specific embodiments.

[0024] Such as figure 1 As shown, LilyPad Arduino 1 is fixed at the center of the back of the hand of the data glove of the present invention, and strip-shaped bending sensors 4 are respectively fixed at the five fingers. One end of the pin of each bending sensor 4 is connected to the GND port of LilyPad Arduino, and the other end is Connect the analog port of LilyPad Arduino, connect a voltage divider resistor 9 with a resistance value of 10KΩ between the 5V port of LilyPad Arduino and the analog port, so that the reading of the analog port is the analog value of the voltage on the bending sensor 4, and the size of the analog value reflects The degree of bending of the fingers;

[0025]Fix the FSR402 resistive thin film pressure sensor 5 on the side of the ring finger, middle finger, index finger and the second joint of the index fi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method for performing accurate three-dimensional modeling based on a data glove by using natural gestures. LilyPad Arduino is additionally arranged outside the glove as a processing chip, hand gestures are monitored through bending sensors, FSR402 type resistive thin film pressure sensors and a JY-901 module, and LilyPad XBee and an XBee 1mW Wire Antenna wireless module perform two-way communication with a computer. Hand coordinates obtained by somatosensory equipment are fused with motion data, so that a human body natural language can be understood by the computer, the measurement accuracy can reach that of a mouse, and the three-dimensional modeling of the user with the natural language can be implemented.

Description

technical field [0001] The invention relates to a method for accurate three-dimensional modeling based on data gloves using natural gestures. Background technique [0002] At present, wearable sensors such as bend sensors and accelerometers can already be used in combination to detect basic natural gestures such as bending and straightening of fingers. At the same time, combined with the capture of a large amount of natural gesture data and machine learning, it is now possible to perform gesture recognition with basic finger joint precision. However, the spatial movement of the hand will cause the cumulative error effect of the three-axis accelerometer, resulting in the inability to accurately restore the spatial trajectory of the hand, and directly affecting the judgment of the relative position relationship between the hand and the user's body. This makes the current data gloves can only be applied to gesture recognition of simple finger movements very limitedly, and cann...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T17/00G06F3/01
Inventor 厉向东吕士宏王怡堃孙小我张驰
Owner ZHEJIANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products