A construction method of a virtual piano playing system based on Kinect

A construction method and piano technology, applied to the details of the processing steps, the input/output process of data processing, instruments, etc., can solve the problems that are difficult to imitate the effect of playing piano keys, difficult to satisfy professional users, and difficult to achieve sound effects and other issues, to achieve good user experience, three-dimensional picture effects, and satisfying immersive experience

Active Publication Date: 2019-03-08
NORTHWESTERN POLYTECHNICAL UNIV
View PDF4 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although the current virtual piano technology can achieve the effect of piano playing to a certain extent, most of them are program technologies that use computer keyboards for input, and it is difficult to imitate the playing effect of real piano keys using computer keyboards.
At the same time, the sound quality played by the current technology is poor, it is difficult to achieve the sound effect of real piano playing, and it is difficult to meet the needs of professional users

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A construction method of a virtual piano playing system based on Kinect
  • A construction method of a virtual piano playing system based on Kinect
  • A construction method of a virtual piano playing system based on Kinect

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0051] The present invention will be further described below in conjunction with the accompanying drawings and embodiments.

[0052] Step 1: 3D reconstruction of the scene

[0053] Turn on the camera of the Kinect device, capture the spatial depth information, use the camera to obtain the depth information of the real image, calculate the point cloud coordinates of each pixel in each frame of the depth image, perform triangulation calculation on the point cloud coordinates, and use the triangulation The coordinate information and depth information of each pixel point calculate the normal vector of the pixel point to realize three-dimensional reconstruction;

[0054] The detailed steps are as follows:

[0055] Step 1.1: Depth map acquisition

[0056] Use Microsoft's Kinect SDK to control Kinect, use Open Frameworks for 3D drawing, set the total number of point clouds for OpenGL and 3D scenes when starting 3D reconstruction, and draw the key area of ​​the virtual piano on the ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a construction method of a virtual piano playing system based on Kinect, and the Kinect equipment is used to complete the 3D reconstruction of the scene. The virtual keyboard area is selected in the appropriate plane in the scene, and the virtual keys are generated. After the keys are pressed and detected, the corresponding notes are set to play, so that the function of playing the virtual piano can be realized. As an interactive mode between a human and a machine, the invention has simple and convenient virtual keyboard, and can be extended to the fields of intelligenthome, games, robots and the like. The OpenGL library is used as the display, and the value of fingertip position is combined to judge the state of the keys, which improves the accuracy of key playingand can bring good user experience. When the virtual piano is realized, a three-dimensional model is established, which makes the picture more three-dimensional and satisfies people's immersive experience.

Description

technical field [0001] The invention relates to the fields of electronics and computers, in particular to a construction method based on Kinect equipment. Background technique [0002] In today's market, most of them use computer keys to simulate piano keys for playing, and there are very few applications for somatosensory interactive playing. Although the current virtual piano technology can realize the playing effect of the piano to a certain extent, most of them are program technologies that use a computer keyboard to input, and it is difficult to imitate the playing effect of real piano keys using a computer keyboard. At the same time, the sound quality played by the current technology is poor, it is difficult to achieve the sound effect of real piano playing, and it is difficult to meet the needs of professional users. Contents of the invention [0003] In order to overcome the deficiencies in the prior art, the present invention provides a construction method of a K...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T19/00G16H20/30G06F3/16
CPCG06F3/162G06T19/006G16H20/30G06T2200/08
Inventor 吴俊张子涵王凯王家霈张瑶何贵青蒋晓悦谢红梅夏召强冯晓毅李会方
Owner NORTHWESTERN POLYTECHNICAL UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap