Musical instrument playing method and device

Abstract

The invention provides a musical instrument playing method. The method comprises the following steps: obtaining a music score picture of music; identifying and processing the music score picture, and acquiring notes and beats contained in the music score picture; the musical instrument plays the music according to the notes and the beats; displaying the playing information of the music on the musical instrument; the invention further provides a musical instrument device, the music score can be recognized in combination with the musical instrument playing method, the playing information is obtained according to the music score, the musical instrument is controlled to play the specified music, a beginner can visually see the playing information of the musical instrument, and better learning experience is provided for the beginner.

Description

Technical Field

[0001] This application relates to the field of musical instrument technology, and more specifically, to a method and apparatus for playing a musical instrument. Background Technology

[0002] In today's society, cultivating a hobby is becoming increasingly important for everyone; playing the piano is a good choice among them.

[0003] Piano beginners typically learn through teachers explaining music theory and demonstrating playing. However, beginners need to repeatedly watch and learn to master piano playing techniques, and this method of live performance by a teacher cannot meet these needs. Therefore, it is necessary to design a piano device that can automatically play repeatedly to satisfy the learning needs of piano beginners. Summary of the Invention

[0004] This application aims to at least partially solve the above-mentioned technical problems and provide a musical instrument that can recognize musical scores and obtain performance information based on the scores, and control the instrument to play a specified piece of music. Beginners can intuitively see the instrument's playing information, providing a better learning experience for beginners.

[0005] This application provides a method for playing a musical instrument, including:

[0006] Get the sheet music image;

[0007] Identify and process the sheet music image to obtain the notes and rhythm contained in the sheet music image;

[0008] The musical instrument plays the music according to the stated notes and rhythm;

[0009] The instrument displays information about how the music was played.

[0010] Furthermore, the sheet music image is automatically obtained by the instrument or uploaded by the user.

[0011] Furthermore, the sheet music image to be processed is identified, and the sheet music image is converted from the initial format to a preset format.

[0012] Furthermore, the preset format is MID format.

[0013] Furthermore, the notes are generated with corresponding pitches and durations;

[0014] The instrument playing dynamics are obtained from the MID format sheet music file, and control information is generated by combining it with the beat.

[0015] Furthermore, the playing information includes current playing information and upcoming playing information, which are displayed by illuminating with different colored lights.

[0016] A musical instrument apparatus for performing the musical instrument playing method as described in the preceding claims, the musical instrument apparatus comprising a piano stand and piano keys disposed on the piano stand, the piano stand further comprising a first illumination device and a second illumination device for illuminating and displaying the piano keys located above the piano keys, the first illumination device being located above the second illumination device;

[0017] The musical instrument device also includes a music stand located on top of the music stand and a camera device facing the music stand. The camera device is used to acquire the music score information on the music stand and generate a music score image.

[0018] The musical instrument device also includes a drive mechanism for driving the keys;

[0019] The musical instrument device also includes a control system for processing the sheet music image to generate a MID format, and the control system is also used to control the drive mechanism to drive the keys.

[0020] Furthermore, both the first and second illumination devices display lights of different colors, and the piano keys include a currently played state and an upcoming played state. The first and second illumination devices illuminate the piano keys in the currently played state and the upcoming played state to display the playing state of the instrument.

[0021] Furthermore, the drive mechanism includes an electric telescopic rod and a connector, the connector being fixed to the top of the electric telescopic rod and having a certain distance from the hammers inside the piano.

[0022] Furthermore, the musical instrument is a piano, and the keys include black keys and white keys. The first irradiation device is used to irradiate the white keys, and the second irradiation device is used to irradiate the black keys.

[0023] This application provides a musical instrument playing method and device that can recognize musical scores and obtain performance information based on the scores, and control the instrument to play a specified piece of music. Beginners can intuitively see the instrument's playing information, providing a better learning experience for beginners. Attached Figure Description

[0024] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of this application. For those skilled in the art, other drawings can be obtained based on the provided drawings without creative effort.

[0025] Figure 1 A flowchart illustrating the methods of playing musical instruments;

[0026] Figure 2 This is a schematic diagram of the external structure of the musical instrument device;

[0027] Figure 3 A schematic diagram of the drive mechanism and hammers of a musical instrument;

[0028] Figure 4 This is a structural diagram of the connectors and anti-slip sleeves for a musical instrument assembly.

[0029] Figure label:

[0030] 100-Piano, 110-Piano stand, 120-Piano keys, 121-White keys, 122-Black keys, 130-Camera equipment, 140-Scoreboard stand, 150-Illumination equipment, 151-First illumination equipment, 152-Second illumination equipment, 160-Piano hammers, 170-Drive mechanism, 171-Electric telescopic rod, 172-Connector, 173-Anti-slip sleeve. Detailed Implementation

[0031] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0032] like Figure 1 The diagram shown illustrates the process of playing a musical instrument. The playing method includes:

[0033] S100: Get the sheet music image of the piece.

[0034] There are several ways to obtain sheet music images, including users uploading sheet music images themselves or the instruments automatically obtaining them.

[0035] Specifically, the instrument is equipped with a WiFi or Bluetooth wireless transmission controller module for wireless connection between the user and the instrument to transmit sheet music images.

[0036] Specifically, there is a music stand 140 on top of the instrument stand 110 and a camera device 130 facing the music stand 140. The camera device 130 is used to acquire the music score information on the music stand 140 and generate a music score image.

[0037] S200: Identify and process sheet music images to obtain the notes and rhythm contained in the sheet music images.

[0038] The above sheet music image is processed using software pre-installed on the instrument. The specific steps are as follows:

[0039] Upload the sheet music image to a PHP project, integrate Audiveris software into the PHP project to convert the sheet music image (such as JPG / PNG) to MusicXML (MXL), and then use a Python script to parse the MID format sheet music file.

[0040] Audiveris parses sheet music images into structured MusicXML (MXL), which contains data such as notes and beats.

[0041] Furthermore, if there are multiple sheet music files in MID format, then the multiple MID format sheet music files are combined into one MID format sheet music file.

[0042] S300: The instrument plays music according to notes and rhythm.

[0043] Use a specialized library (such as Python's MIDo) to read the MID format sheet music file, extract information such as note events and control instructions, and map the MID note numbers to the positions of the piano keys 100 that the drive mechanism 170 needs to control.

[0044] Specifically, a mapping table is needed to convert the MID note numbers into the specific positions of the hammers 160 below the physical keyboard. Control commands for the drive mechanism 170 are then generated based on the parsed note information, including drive position, drive time, and release time.

[0045] S400: Displays musical performance information on the instrument.

[0046] The light illuminating device 150, which is set above the piano stand 110, illuminates the piano key 120 that is about to be pressed during playing and the subsequent piano key 120, and displays different colors for the piano key 120 in different states, so that the user can clearly observe the changes in the state of the keys.

[0047] In this embodiment, the sheet music image to be processed is identified, and the sheet music image is converted from an initial format to a preset format. The initial format is JPG or PNG, and the preset format is a sheet music file in MID format.

[0048] In this embodiment, the pitch and duration of the musical notes are generated; the instrument playing dynamics are obtained through a MID format file, and control information is generated by combining it with the beat. This corresponds to the instructions in steps S300 and S400 above.

[0049] In this embodiment, the musical instrument is a piano 100.

[0050] like Figures 2 to 4As shown, this embodiment also relates to a musical instrument device, which includes a stand 110 and keys 120 disposed on the stand 110. The stand 110 also has an illumination device 150 located above the keys 120 for illuminating and displaying the keys 120, including a first illumination device 151 and a second illumination device 152, with the first illumination device 151 located above the second illumination device 152. The keys 120 include black keys 122 and white keys 121. The first illumination device 151 illuminates the white keys 121, and the second illumination device 152 illuminates the black keys 122.

[0051] Specifically, the first illumination device 151 and the second illumination device 152 correspond one-to-one with all the black keys 122 and white keys 121 on the piano keys 120. Furthermore, both the first illumination device 151 and the second illumination device 152 are illumination lights with multiple colors. The piano keys 120 include black keys 122 and white keys 121. The first illumination device 151 illuminates the white keys 121, and the second illumination device 152 illuminates the black keys 122. The multiple colors mainly include red, green, blue, and their mixtures. Through different combinations and changes in the colors of the light, the piano keys 120 in a playing state and an upcoming playing state can be clearly distinguished. For example, when a white key 121 is in a playing state, the first illumination device 151 will illuminate that white key 121 with red light; and when that white key 121 is about to be played, the first illumination device 151 will switch to green light. Similarly, for the black keys 122, the second illumination device 152 will also switch colors accordingly based on their playing state. This lighting display method allows beginners to more intuitively observe the playing status of each key 120 during the learning process, thereby better mastering the playing techniques of piano 100.

[0052] Furthermore, the drive mechanism 170 of this musical instrument device includes an electric telescopic rod 171 and a connector 172. The connector 172 is fixed to the top of the electric telescopic rod 171 and maintains a certain distance from the hammers inside the piano 100. The number of drive mechanisms 170 is consistent with the number of keys 120. This design allows the drive mechanism 170 to precisely control the striking force and speed of the hammers, thereby achieving an accurate and smooth playing effect. After the control system generates control information based on the MID file, the drive mechanism 170 adjusts the extension length and speed of the electric telescopic rod 171 according to this information, thereby driving the connector 172 and the hammers to perform corresponding movements, ultimately completing the playing of the music.

[0053] In this embodiment, the musical instrument device also includes a control system. The control system processes sheet music images to generate MID format and also controls the drive mechanism 170 to operate the hammers 160. The control system employs image processing technology and algorithms to quickly and accurately identify note and rhythm information in the sheet music images and convert it into control commands that the drive mechanism 170 can recognize. Furthermore, the control system features a user-friendly interface, allowing users to easily upload sheet music images, adjust playing parameters, and view playing information.

[0054] In summary, this instrument playing method and device, by combining advanced image processing technology, lighting display technology, and drive control technology, provides a completely new learning experience for beginners of the Piano 100. It can not only recognize sheet music and obtain performance information based on the score, but also control the instrument to play specific pieces accurately and fluently. Simultaneously, the intuitive display of playing information through the lighting device 150 makes it easier for beginners to master the techniques of playing the Piano 100 and enjoy the pleasure of music.

[0055] The musical instrument device also includes a music stand 140 located on top of the music stand 110 and a camera device 130 facing the music stand 140. The camera device 130 is used to acquire the music score information on the music stand 140 and generate music score images. The music stand 140 is designed to be stable and can hold music scores of different sizes to meet the diverse needs of users. The camera device 130 has a shooting function to generate music score images for later use.

[0056] In this embodiment, the musical instrument device also includes a drive mechanism 170 for driving the hammers 160; the drive mechanism 170 includes an electric telescopic rod 171 and a connector 172, the connector 172 is fixed to the top of the electric telescopic rod 171 and has a certain distance from the hammers inside the piano 100.

[0057] Both the first illumination device 151 and the second illumination device 152 display lights of different colors. The piano keys 120 include a currently played state and an upcoming played state. The first illumination device 151 and the second illumination device 152 illuminate the keys 120 in the currently played and upcoming played states to indicate the instrument's playing status. The first illumination device 151 and the second illumination device 152 correspond one-to-one with all the black keys 122 and white keys 121 on the piano keys 120. Furthermore, both the first illumination device 151 and the second illumination device 152 are illumination lights with multiple colors. The piano keys 120 include black keys 122 and white keys 121. The first illumination device 151 illuminates the white keys 121, and the second illumination device 152 illuminates the black keys 122. The multiple colors mainly include red, green, blue, and their mixtures. Through the combination and variation of different colored lights, the keys 120 in the currently played and upcoming played states can be clearly distinguished. For example, when a white key 121 is in a playing state, the first illumination device 151 illuminates that white key 121 with a red light; and when the white key 121 is about to be played, the first illumination device 151 switches to illuminating it with a green light. Similarly, for the black key 122, the second illumination device 152 will also switch colors accordingly based on its playing state. This lighting display method allows beginners to more intuitively observe the playing state of each key 120 during the learning process, thereby better mastering the techniques of playing the piano 100.

[0058] The drive mechanism 170 includes an electric telescopic rod 171 and a connector 172. The connector 172 is fixed to the top of the electric telescopic rod 171 and has a certain distance from the hammer inside the piano 100. The connector 172 is block-shaped and has a concave anti-slip sleeve 173 at the bottom end.

[0059] In actual operation, the electric telescopic rod 171 extends and retracts precisely according to the instructions issued by the control system. The connecting piece 172 moves along with the electric telescopic rod 171. Because it maintains a certain distance from the hammers inside the piano 100, when the connecting piece 172 moves to a specific position, it triggers the hammers to strike. This design ensures that the force and speed of the hammer strikes are within preset parameters, resulting in a stable rhythm and accurate pitch in the played music. Furthermore, the extension length and speed of the electric telescopic rod 171 can be adjusted according to different pieces and playing requirements to meet diverse performance needs. Simultaneously, the distance between the connecting piece 172 and the hammers is carefully adjusted to ensure that the hammer strike is not insufficient due to an excessively large distance, nor that the hammer movement is restricted due to an excessively small distance. This ensures that the drive mechanism 170 can efficiently and stably drive the hammers, providing a strong guarantee for the accurate playing of the piano 100.

[0060] It should be noted that, in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. It should also be noted that the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes the element.

[0061] The various embodiments in this specification are described in a related manner. Similar or identical parts between embodiments can be referred to mutually. Each embodiment focuses on describing the differences from other embodiments. In particular, the apparatus embodiments are described simply because they are based on similarities to the method embodiments; relevant parts can be referred to the descriptions of the method embodiments.

[0062] The above are merely embodiments of this application and are not intended to limit the scope of this application. Various modifications and variations can be made to this application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the scope of the claims of this application.

Claims

1. A method of playing a musical instrument, characterized by, The method comprises: acquiring a music score picture of a music piece; identifying and processing the music score picture to acquire notes and beats contained in the music score picture; playing the music piece according to the notes and beats by a musical instrument; displaying playing information of the music piece on the musical instrument.

2. The method of claim 1, wherein, The music score picture of the music piece is automatically acquired by the musical instrument or uploaded by a user.

3. The method of claim 1, wherein, The music score picture to be processed is identified and converted from an initial format to a preset format.

4. The method of claim 3, wherein, The preset format is a MIDI format.

5. The method of claim 4, wherein, The notes are converted into corresponding pitches and durations. Playing strength of the musical instrument is acquired from the MIDI format music score file, and control information is generated by combining the beats.

6. The method of claim 1, wherein, The playing information comprises current playing information and upcoming playing information, which are displayed by different colored light irradiation.

7. A musical instrument apparatus that performs the musical instrument playing method according to any one of claims 1 to 6, characterized by The musical instrument device comprises a piano frame and piano keys arranged on the piano frame, and first and second irradiation devices arranged above the piano keys for irradiating and displaying the piano keys, wherein the first irradiation device is arranged above the second irradiation device. The musical instrument device further comprises a music score frame arranged on the top of the piano frame and a camera device arranged opposite to the music score frame, wherein the camera device is used to acquire music score information on the music score frame and generate a music score picture. The musical instrument device further comprises a driving mechanism for driving a piano hammer. The musical instrument device further comprises a control system, which is used to process the music score picture to generate a MIDI format, and is also used to control the driving mechanism to drive the piano hammer.

8. The musical instrument apparatus of claim 7, wherein, The first and second irradiation devices have different colored light displays, and the piano keys comprise current playing states and upcoming playing states, and the first and second irradiation devices irradiate on the piano keys in the current playing states and upcoming playing states to display playing states of the musical instrument.

9. The musical instrument apparatus of claim 7, wherein, The driving mechanism comprises an electric telescopic rod and a connecting piece, wherein the connecting piece is fixedly arranged on the top of the electric telescopic rod and has a certain interval with a piano hammer inside the piano.

10. The musical instrument apparatus of claim 8, wherein, The musical instrument is a piano.

Images