Virtual performance system based on hand motion sensing

Abstract

The invention relates to a set of virtual performance system based on hand motion induction, which comprises a data acquisition glove, a machine vision module, a transmission module, a processing module and a peripheral device, wherein the data acquisition glove induces hand motion; the machine vision module induces hand position information; the transmission module transmits information acquired by the data acquisition glove and the machine vision module to the processing module; the processing module identifies the motion performed by a musical instrument from the received hand information, and generates performance sound and specific scene of the musical instrument; and the peripheral device feeds back the sound and the scene to an operator. The invention provides a virtual musical instrument for carrying out human-computer interaction by using the glove, which has the same or similar play skill as a real musical instrument, so that the operator can naturally and flexibly carry out virtual performance; and simultaneously the performance sound and the specific scene of the musical instrument are fed back to the operator, so that the operator can carry out performance more directly and naturally.

Description

technical field [0001] The invention relates to a set of virtual performance system based on hand motion induction. Background technique [0002] With the rapid improvement of computer system performance, many hardware used in music production has been transformed into software implementation. A large number of high-quality soft sound sources have appeared one after another, so that people no longer need to spend hundreds of thousands or even millions of dollars to buy grand pianos with good timbres, so that people can hear the sounds from the world's top pianos and even perform performances. At the same time, virtual musical instruments built on the software level have also emerged one after another. Virtual musical instrument software such as virtual guitarist and REAL GUITAR have rich performance functions and high-quality timbres. [0003] The virtual musical instrument using soft sound source technology is a new trend in the development of musical instruments. However...

AI Technical Summary

Problems solved by technology

Its glove assembly combines a deformable tube and connects the deformable tube to the signal actuator to recognize hand movements, but this can only recognize the bending movements of fingers, and can only achieve the function of striking musical instruments, not Fully meet the needs of musical instruments

It switches instruments and modes through push buttons, which brings great inconvenience to users.

Therefore, the virtual reality music system described in this patent cannot bring users an approximate real musical instrument playing experience and a comfortable human-computer interaction experience.

Images