6-dimensional sensory-interactive virtual keyboard instrument system and realization method thereof

A technology of virtual keyboard and implementation method, which is applied in the direction of input/output of user/computer interaction, instruments, music teaching aids, etc., and can solve problems such as poor use effect, high price, and failure to achieve multi-dimensional interaction.

Active Publication Date: 2013-08-07
ZHEJIANG UNIV
View PDF5 Cites 50 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] Keyboard instruments are loved by many music lovers, but the traditional keyboard instruments used now are bulky and expensive, and can only achieve visual, auditory and tactile sensations, and cannot achieve the effect of multi-dimensional interaction. Therefore, how to design and invent how to use electronic The virtual keyboard instrument generated by the device is very necessary
Although there are some related applicat

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • 6-dimensional sensory-interactive virtual keyboard instrument system and realization method thereof
  • 6-dimensional sensory-interactive virtual keyboard instrument system and realization method thereof
  • 6-dimensional sensory-interactive virtual keyboard instrument system and realization method thereof

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0137] A virtual keyboard musical instrument system that realizes 6-dimensional sensory interaction of the present invention is described below by taking a piano as an example. The personal assistance device described therein is in the form of a glove.

[0138] Using this system, the following effects can be achieved: when the finger presses the projected virtual key, press down, the virtual key will drop with the finger and fit closely with the finger, and at the same time, the human body assisting device will give the finger a corresponding sense of touch Perception, pressure perception; when the finger is lifted up from the pressed key, the projected virtual key also rises with the finger and fits closely with the finger. Finally, when the key rises to the initial height, it separates from the finger, the finger continues to rise away from the key, the height of the key does not change, and the finger has no feedback of contact and pressure sense. During the whole process ...

Embodiment 2

[0203] Embodiment 1 takes the piano as an example. If it is necessary to switch the type of virtual keyboard instrument (for example, switch from a piano to an electronic keyboard), just return to the setting step from the cycle working step of the current working mode and reset it. For example, when working in the corrected fingering mode, return to step (1) from the step (3) in the circular working steps and reset in the setting step.

Embodiment 3

[0205] If it is necessary to switch the working mode (for example, the playing mode is switched to prompting the optimal fingering mode), return to the setting step of step (1) from the cycle working step of step (3) to reset.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a 6-dimentional sensory-interactive virtual keyboard instrument system and a realization method thereof. The 6-dimentional sensory-interactive virtual keyboard instrument system comprises a human body auxiliary device, a 3-dimentiaonal camera shooting device, a 3-dimentiaonal projection device, a signal processing unit and a music collection device. The system provided by the invention has various working modes, including a play mode, an optimal fingering prompting mode, a fingering correction mode and a teaching mode, not only can provides a basic play experience for a user, but also has the functions of fingering prompting, fingering correction and teaching demonstration. The 6-dimentional sensory keyboard instrument system provided by the invention is based on the 3-dimentiaonal vision, hearing, touch feeling and press feeling, and the provided virtual instruments comprises a piano, an electronic organ, an accordion, an organ and other keyboard instruments in species, so that the user can feel an interaction effect just like playing a real instrument; and moreover, the system can realize a powerful teaching function, is simple in use method, flexible and space-saving, is the huge breakthrough for a conventional keyboard instrument, and has a very broad application prospect.

Description

technical field [0001] The invention relates to a keyboard musical instrument, in particular to a virtual keyboard musical instrument system with 6-dimensional sensory interaction and an implementation method thereof. Background technique [0002] Keyboard instruments are loved by many music lovers, but the traditional keyboard instruments used today are bulky and expensive, and can only achieve visual, auditory and tactile sensations, and cannot achieve the effect of multi-dimensional interaction. Therefore, how to design and invent how to use electronic The virtual keyboard instrument produced by the device is very necessary. Although there are some related applications on mobile phones, tablets, and PCs that can realize virtual keyboard instruments, most of them are very simple designs, that is, musical instruments appear on the screen, touch them directly with your fingers, and then make corresponding sounds and display some prompts information, although there is a cert...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/01G09B15/08
Inventor 孟濬高恩博刘琼陈啸
Owner ZHEJIANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap