6-dimentional sensory-interactive virtual instrument system and realization method thereof

A musical instrument and dimension technology, applied in the field of virtual musical instrument system with 6-dimensional sensory interaction, which can solve the problems of poor use effect, high price, and bulky volume.

Active Publication Date: 2013-08-07
ZHEJIANG UNIV
View PDF4 Cites 28 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] Musical instruments are loved by many music lovers, but the traditional musical instruments used today are bulky and expensive, and can only achieve visual, auditory and tactile sensations, and cannot achieve the effect of multi-dimensional interaction. It is very necessary for virtual instruments
Although the

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • 6-dimentional sensory-interactive virtual instrument system and realization method thereof
  • 6-dimentional sensory-interactive virtual instrument system and realization method thereof
  • 6-dimentional sensory-interactive virtual instrument system and realization method thereof

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0076] The following takes a piano as an example to illustrate a virtual musical instrument system of the present invention that realizes 6-dimensional sensory interaction. The personal assistance device described therein is in the form of a glove.

[0077] Using the virtual musical instrument system of the present invention, the following effects can be achieved: when the finger presses the projected virtual key, press down, and the virtual key falls with the finger and fits closely with the finger. At the same time, the human body assisting device gives the finger Corresponding tactile perception information and pressure perception information; when the finger lifts up from the pressed key, the projected virtual key also rises with the finger and fits closely with the finger. At the same time, the human body assisting device also gives the finger Finally, when the key rises to the initial height, it separates from the finger, and the finger continues to rise away from the ke...

Embodiment 2

[0099] After embodiment 1 is completed, it is necessary to switch the type of virtual instrument (for example, switch to a guitar), and its implementation steps are as follows: re-execute step (2) in embodiment 1, reset, change the type of virtual instrument, and select the instrument as Guitar, the guitar is projected by the 3D projection device, and the person is also a glove-shaped human assistance device. Press down on the strings with one hand and pluck the strings with the other.

[0100] The remaining implementation steps are similar to (3)-(6) in Embodiment 1.

[0101] Using the virtual musical instrument system of the present invention, the following effects can be achieved: when the fingers press the projected virtual strings, they feel that they touch the strings, press down, and the virtual strings fall with the fingers and fit closely with the fingers , at the same time, the human body assisting device gives the finger the corresponding tactile perception informa...

Embodiment 3

[0104] After embodiment 1 is completed, it is necessary to switch the working mode of the virtual piano (for example, the playing mode is switched to the corrected fingering mode), and its implementation steps are as follows: re-execute the step (2) in embodiment 1, reset, change the work The mode is corrected fingering mode. The remaining implementation steps are similar to (3)-(6) in Embodiment 1.

[0105] The signal processing unit stores standardized music scores in advance. When a person plays a certain music score, the signal processing unit will compare the key positions played by the person with the standardized music score in real time. If the person plays a mistake, the signal processing unit will send a signal to the human body Auxiliary device, after receiving the signal, the human body auxiliary device will emit a sound to tell the user that the playing is wrong, and prompt the correct playing position; at the same time, the signal processing unit will also send a...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a 6-dimentional sensory-interactive virtual instrument system and a realization method thereof. The 6-dimentional sensory-interactive virtual instrument system comprises a human body auxiliary device, a 3-dimentiaonal camera shooting device, a 3-dimentiaonal projection device and a signal processing unit, wherein the human body auxiliary device is used for collecting human body sound information, contact feeling information and press feeling information and converting all the information into signals to be sent to the signal processing unit; and the signal processing unit processes the signals, sends a signal to control the human body auxiliary device to feed back hearing sensing information, contact feeling sensing information and press feeling sensing information, and controls the 3-dimentiaonal projection device to feed back the 3-dimentiaonal vision sensing information. The invention further provides a realization method of a 6-dimentional sensory-interactive virtual instrument. The realization method comprises the four steps of setting, information collection, signal processing and information feedback. The 6-dimentional sensory-interactive virtual instrument system provided by the invention can greatly realize man-machine interaction and virtual reality, a user can feel an interaction effect just like playing a real instrument, and the system has the advantages of powerful function, convenience in use, exquisite appearance and low cost.

Description

technical field [0001] The invention relates to a musical instrument, in particular to a 6-dimensional sensory interactive virtual musical instrument system and an implementation method thereof. Background technique [0002] Musical instruments are loved by many music lovers, but the traditional musical instruments used today are bulky and expensive, and can only achieve visual, auditory and tactile sensations, and cannot achieve the effect of multi-dimensional interaction. The virtual instrument is very necessary. Although there are some related applications on mobile phones, tablets, and PCs that can realize virtual musical instruments, most of them are very simple designs, that is, musical instruments appear on the screen, you can directly touch them with your fingers, and then make corresponding sounds. Far inferior to real musical instruments. Therefore, it is very necessary to develop a virtual musical instrument system that can realize 6-dimensional sensory virtual ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/01G09B15/08
Inventor 孟濬高恩博刘琼陈啸
Owner ZHEJIANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap