Augmented reality three-dimensional plotting system and method based on gesture recognition

A three-dimensional drawing and gesture recognition technology, applied in character and pattern recognition, graphic reading, input/output process of data processing, etc., can solve the problem of unenhanced real-time gesture drawing, etc., and achieve the effect of convenient operation and high error tolerance.

Active Publication Date: 2018-02-23
ZHEJIANG UNIV
View PDF6 Cites 17 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The non-contact three-dimensional space drawing method can be applied in children's education, work display and art creation, but at present, computer graphics drawing is

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Augmented reality three-dimensional plotting system and method based on gesture recognition
  • Augmented reality three-dimensional plotting system and method based on gesture recognition

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0049] Such as figure 1 As shown, an augmented reality 3D drawing system based on gesture recognition includes the following units:

[0050] Hand trajectory tracking unit, which tracks the user's hands in real time and establishes a dynamic trajectory diagram;

[0051] A static gesture recognition unit that recognizes the hand information tracked by the hand trajectory tracking unit in real time and updates the state variable space;

[0052] Three-dimensional drawing unit, which maps the two-dimensional drawing trajectory to the three-dimensional space, and projects the virtual image of the three-dimensional space into the two-dimensional real scene image after operating the three-dimensional space according to the gesture;

[0053] A human-computer interaction interface unit, which includes a drawing interface and a function selection interface to realize real-time, pure gesture human-computer interaction without a mouse and keyboard. The drawing interface displays prompt information ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an augmented reality three-dimensional plotting system and method based on gesture recognition. According to the method, an effect of fusing virtual three-dimensional plottingand a real scenario is achieved on a concept of augmented reality, so that real-time interaction can be performed on a computer and a user. By virtue of real-time gesture recognition and hand motion track recognition, according to the system and method disclosed by the invention, the user is allowed to perform translation, three-dimensional rotation and far and near stretching operations on a two-dimensional plotting plane, and the virtual three-dimensional space is fused with an actual three-dimensional space, so that the effect of plotting in the real three-dimensional space is achieved. Thesystem and method disclosed by the invention can be applied to artistic creation, children education and work demonstration.

Description

technical field [0001] The present invention relates to the field of computer human-computer interaction, in particular to an augmented reality (Augmented Reality, AR) three-dimensional drawing system and drawing method based on gesture recognition. Background technique [0002] Human-computer interaction is a focus of the current information industry, and researchers from all over the world regard it as a key technology for research. After decades of development, the current human-computer interaction technology is gradually shifting from the computer-centered to the user-centered, from the command line interface, the graphical user interface, to the natural user interface (NUI, NaturalUser Interface) development process. In natural user interface interaction technology, gesture has become one of the research focuses of relevant personnel because of its flexible, intuitive and easy-to-learn advantages. [0003] Computer graphics rendering is an important research directio...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/01G06F3/0484G06K9/00
CPCG06F3/017G06F3/04845G06V40/107G06V40/28
Inventor 甄佳楠姜伟
Owner ZHEJIANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products