Unlock instant, AI-driven research and patent intelligence for your innovation.

A construction method of virtual piano playing system based on kinect

A construction method and piano technology, applied to the details of the processing steps, the input/output process of data processing, instruments, etc., can solve the problems that are difficult to imitate the effect of playing piano keys, it is difficult to achieve sound effects, and it is difficult to satisfy professional users and other issues, to achieve good user experience, three-dimensional picture effects, and satisfying immersive experience

Active Publication Date: 2022-07-26
NORTHWESTERN POLYTECHNICAL UNIV
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although the current virtual piano technology can achieve the effect of piano playing to a certain extent, most of them are program technologies that use computer keyboards for input, and it is difficult to imitate the playing effect of real piano keys using computer keyboards.
At the same time, the sound quality played by the current technology is poor, it is difficult to achieve the sound effect of real piano playing, and it is difficult to meet the needs of professional users

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A construction method of virtual piano playing system based on kinect
  • A construction method of virtual piano playing system based on kinect
  • A construction method of virtual piano playing system based on kinect

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0051] The present invention will be further described below in conjunction with the accompanying drawings and embodiments.

[0052] Step 1: 3D reconstruction of the scene

[0053] Turn on the camera of the Kinect device, capture the spatial depth information, use the camera to obtain the depth information of the real image, calculate the point cloud coordinates of each pixel in each frame of depth image, triangulate the point cloud coordinates, and use the The coordinate information and depth information of each pixel point to calculate the normal vector of the pixel point to realize three-dimensional reconstruction;

[0054] The detailed steps are as follows:

[0055] Step 1.1: Depth Map Acquisition

[0056] Use Microsoft's Kinect SDK to control Kinect, use Open Frameworks for 3D drawing, set the total number of point clouds for OpenGL and 3D scene when starting 3D reconstruction, and draw the key area of ​​the virtual piano on the screen by mouse click, use NuiImageStream...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a construction method of a virtual piano playing system based on Kinect. The three-dimensional reconstruction of the scene is completed by using the Kinect device, the area for creating the virtual keyboard is selected on a suitable plane in the scene, the virtual piano key is generated, and the key pressing detection is performed. After setting the corresponding note to play, the function of playing the virtual piano can be realized. As a human-machine interaction mode, the present invention is a simple and convenient virtual keyboard, which can be extended to the fields of smart home, games, robots, etc.; the OpenGL library is used for display, and the state of the keys is judged by combining the value of the fingertip position, which improves the The accuracy of playing the keys can be improved, which can bring a good user experience. When the virtual piano is realized, a three-dimensional model is established, which makes the picture effect more three-dimensional and satisfies people's immersive experience.

Description

technical field [0001] The invention relates to the fields of electronics and computers, in particular to a construction method based on Kinect equipment. Background technique [0002] In today's market, the program technology that uses computer keys to simulate piano keys for playing is the main method, and there are very few applications for somatosensory interactive playing. Although the current virtual piano technology can achieve the effect of piano playing to a certain extent, most of them are program technologies that use a computer keyboard for input, and it is difficult to imitate the playing effect of real piano keys using a computer keyboard. At the same time, the sound quality played by the current technology is poor, it is difficult to achieve the sound effect of real piano playing, and it is difficult to meet the needs of professional users. SUMMARY OF THE INVENTION [0003] In order to overcome the deficiencies of the prior art, the present invention provid...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06T19/00G16H20/30G06F3/16
CPCG06F3/162G06T19/006G16H20/30G06T2200/08
Inventor 吴俊张子涵王凯王家霈张瑶何贵青蒋晓悦谢红梅夏召强冯晓毅李会方
Owner NORTHWESTERN POLYTECHNICAL UNIV