Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Virtual sand art interactive combination method based on multiple somatosensory devices

A multi-body sense and sand painting technology, which is applied in the field of virtual sand painting interaction and combination, can solve problems such as non-contact sand painting that cannot be simulated

Active Publication Date: 2018-11-30
ZHONGBEI UNIV
View PDF7 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, there is a problem that non-contact sand painting cannot be simulated during drawing, such as sand blowing and sand leakage in the air in real sand painting

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Virtual sand art interactive combination method based on multiple somatosensory devices
  • Virtual sand art interactive combination method based on multiple somatosensory devices
  • Virtual sand art interactive combination method based on multiple somatosensory devices

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0043] like figure 1 As shown, a method for combining virtual sand paintings based on multi-sensing devices in this embodiment includes the following steps:

[0044] 1) Data acquisition: Use the data capture function of Leap Motion to obtain the original hand data drawn by non-contact sand paintings, and obtain the required hand data through the Hand Controller component; connect the PQ Labs G4S touch screen and the display through the interface , contact sand painting drawing is to scan the infrared rays emitted by the outer frame in real time. Once a finger or an object larger than the minimum blocking diameter blocks it, it can judge the hand data that has been in contact to ensure the correct transmission of the data. Through the TUIO protocol in the Obtain the hand touch data drawn by contact sand painting in Unity3D;

[0045] 2) Data processing: first, the feature extraction method is used to preprocess the raw data of the hand, and then new hand feature data is introdu...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention belongs to the technical field of virtual sand painting drawing method, in particular to a virtual sand painting interactive combination method based on multi-motion sensing equipment. According the method, a data capture function of leap motion is firstly applied to obtain original hand data, thus an existing feature extraction method is adopted to preprocess the original data, newhand feature data is introduced to complete dynamic gesture tracking, gesture recognition is performed through template matching, and non-contact virtual sand painting drawing is completed by combining with a rendering effect. A PQLabs G4S touch screen is utilized to acquire touch information, a touch event is produced, a graph embedding method is adopted to convert the touch event into a featurevector for gesture recognition, and meanwhile contact virtual sand painting drawing is completed by combining with a sand grain rendering effect. Virtual sand painting drawing is performed through assistance of leap motion and a touch screen. Compared with real sand paintings, both three-dimensional drawing in the air and contact two-dimensional drawing are achieved, and the method can be well used for virtual sand painting drawing.

Description

technical field [0001] The invention belongs to the technical field of virtual sand painting drawing methods, and in particular relates to a virtual sand painting interactive combination method based on multi-body sensing equipment. The method is a non-contact virtual sand painting drawing based on leap motion and a touch screen based on PQ Labs G4S Controlled virtual sand painting drawing. Background technique [0002] As one of the cores of virtual reality technology, human-computer interaction shoulders the task of improving user immersion experience and system authenticity. The simulation of traditional painting art is one of the most challenging subjects in the field of computer art. While absorbing the nutrition of traditional painting art and promoting the achievements of traditional painting art, it puts forward new requirements for computer simulation painting technology. The virtual sand painting system can theoretically be integrated into any visualization system...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01G06F3/0484
CPCG06F3/017G06F3/04845G06F2203/012
Inventor 张元石倩韩燮马珩钧吕金泽
Owner ZHONGBEI UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products